Patterns across multiple memories are identified over time

Distinct Roles of Medial Prefrontal Cortex Subregions in the Consolidation and Recall of Remote Spatial Memories

It is a common belief that memories, over time, become progressively independent of the hippocampus and are gradually stored in cortical areas. This view is mainly based on evidence showing that prefrontal cortex (PFC) manipulations impair the retrieval of remote memories, while hippocampal inhibition does not. More controversial is whether activity in the medial PFC is required immediately after learning to initiate consolidation. Another question concerns functional differences among PFC subregions in forming and storing remote memories. To address these issues, we directly contrasted the effects of loss-of-function manipulations of the anterior cingulate cortex (aCC) and the ventromedial PFC, which includes the infralimbic (IL) and prelimbic (PL) cortices, before testing and immediately after training on the ability of CD1 mice to recall the hidden platform location in the Morris water maze. We injected an AAV carrying the hM4Di receptor into the PL-IL or aCC. Interestingly, pretest administrations of clozapine-N-oxide (CNO; 3 mg/kg) revealed that the aCC, but not the PL-IL, was necessary to recall remote spatial information. Furthermore, systemic post-training administration of CNO impaired memory recall at remote, but not recent, time points in both groups. These findings revealed a functional dissociation between the two prefrontal areas, demonstrating that both the PL-IL and the aCC are involved in early consolidation of remote spatial memories, but only the aCC is engaged in their recall.

To update or to create? The influence of novelty and prior knowledge on memory networks

Schemas are foundational mental structures shaped by experience. They influence behaviour, guide the encoding of new memories and are shaped by associated information. The adaptability of memory schemas facilitates the integration of new information that aligns with existing knowledge structures. First, we discuss how novel information consistent with an existing schema can be swiftly assimilated when presented. This cognitive updating is facilitated by the interaction between the hippocampus and the prefrontal cortex. Second, when novel information is inconsistent with the schema, it likely engages the hippocampus to encode the information as part of an episodic memory trace. Third, novelty may enhance hippocampal dopamine through either the locus coeruleus or ventral tegmental area pathways, with the pathway involved potentially depending on the type of novelty encountered. We propose a gradient theory of schema and novelty to elucidate the neural processes by which schema updating or novel memory traces are formed. It is likely that experiences vary along a familiarity-novelty continuum, and the degree to which new experiences are increasingly novel will guide whether memory for a new experience either integrates into an existing schema or prompts the creation of a new cognitive framework. This article is part of the theme issue 'Long-term potentiation: 50 years on'.

Age differences in generalization, memory specificity, and their overnight fate in childhood

Memory enables generalization to new situations, and memory specificity that preserves individual episodes. This study investigated generalization, memory specificity, and their overnight fate in 141 4- to 8-year-olds (computerized memory game; 71 females, tested 2020-2021 in Germany). The results replicated age effects in generalization and memory specificity, and a contingency of generalization on object conceptual properties and interobject semantic proximity. Age effects were stronger in generalization than in memory specificity, and generalization was more closely linked to the explicit regularity knowledge in older than in younger children. After an overnight delay, older children retained more generalized and specific memories and showed greater gains but only in generalization. These findings reveal distinct age differences in generalization and memory specificity across childhood.

Is the Papez circuit the location of the elusive episodic memory engram?

All of the brain structures and white matter that make up Papez' circuit, as well as the circuit as a whole, are implicated in the literature in episodic memory formation and recall. This paper shows that Papez' circuit has the detailed structure and connectivity that is evidently required to support the episodic memory engram, and that identifying Papez' circuit as the location of the engram answers a number of long-standing questions regarding the role of medial temporal lobe structures in episodic memory. The paper then shows that the process by which the episodic memory engram may be formed is a network-wide Hebbian potentiation termed "racetrack potentiation", whose frequency corresponds to that observed in vivo in humans for memory functions. Further, by considering the microcircuits observed in the medial temporal lobe structures forming Papez' circuit, the paper establishes the neural mechanisms behind the required functions of sensory information storage and recall, pattern completion, pattern separation, and memory consolidation. The paper shows that Papez' circuit has the necessary connectivity to gather the various elements of an episodic memory occurring within Pöppel's experienced time or "quantum of experience". Finally, the paper shows how the memory engram located in Papez' circuit might be central to the formation of a duplicate engram in the cortex enabling consolidation and long-term storage of episodic memories.

Integrating and fragmenting memories under stress and alcohol

Stress can powerfully influence the way we form memories, particularly the extent to which they are integrated or situated within an underlying spatiotemporal and broader knowledge architecture. These different representations in turn have significant consequences for the way we use these memories to guide later behavior. Puzzlingly, although stress has historically been argued to promote fragmentation, leading to disjoint memory representations, more recent work suggests that stress can also facilitate memory binding and integration. Understanding the circumstances under which stress fosters integration will be key to resolving this discrepancy and unpacking the mechanisms by which stress can shape later behavior. Here, we examine memory integration at multiple levels: linking together the content of an individual experience, threading associations between related but distinct events, and binding an experience into a pre-existing schema or sense of causal structure. We discuss neural and cognitive mechanisms underlying each form of integration as well as findings regarding how stress, aversive learning, and negative affect can modulate each. In this analysis, we uncover that stress can indeed promote each level of integration. We also show how memory integration may apply to understanding effects of alcohol, highlighting extant clinical and preclinical findings and opportunities for further investigation. Finally, we consider the implications of integration and fragmentation for later memory-guided behavior, and the importance of understanding which type of memory representation is potentiated in order to design appropriate interventions.

Large-scale coupling of prefrontal activity patterns as a mechanism for cognitive control in health and disease: evidence from rodent models

Cognitive control of behavior is crucial for well-being, as allows subject to adapt to changing environments in a goal-directed way. Changes in cognitive control of behavior is observed during cognitive decline in elderly and in pathological mental conditions. Therefore, the recovery of cognitive control may provide a reliable preventive and therapeutic strategy. However, its neural basis is not completely understood. Cognitive control is supported by the prefrontal cortex, structure that integrates relevant information for the appropriate organization of behavior. At neurophysiological level, it is suggested that cognitive control is supported by local and large-scale synchronization of oscillatory activity patterns and neural spiking activity between the prefrontal cortex and distributed neural networks. In this review, we focus mainly on rodent models approaching the neuronal origin of these prefrontal patterns, and the cognitive and behavioral relevance of its coordination with distributed brain systems. We also examine the relationship between cognitive control and neural activity patterns in the prefrontal cortex, and its role in normal cognitive decline and pathological mental conditions. Finally, based on these body of evidence, we propose a common mechanism that may underlie the impaired cognitive control of behavior.

A generative model of memory construction and consolidation

Episodic memories are (re)constructed, share neural substrates with imagination, combine unique features with schema-based predictions and show schema-based distortions that increase with consolidation. Here we present a computational model in which hippocampal replay (from an autoassociative network) trains generative models (variational autoencoders) to (re)create sensory experiences from latent variable representations in entorhinal, medial prefrontal and anterolateral temporal cortices via the hippocampal formation. Simulations show effects of memory age and hippocampal lesions in agreement with previous models, but also provide mechanisms for semantic memory, imagination, episodic future thinking, relational inference and schema-based distortions including boundary extension. The model explains how unique sensory and predictable conceptual elements of memories are stored and reconstructed by efficiently combining both hippocampal and neocortical systems, optimizing the use of limited hippocampal storage for new and unusual information. Overall, we believe hippocampal replay training generative models provides a comprehensive account of memory construction, imagination and consolidation.

Multiple Memory Subsystems: Reconsidering Memory in the Mind and Brain

The multiple-memory-systems framework-that distinct types of memory are supported by distinct brain systems-has guided learning and memory research for decades. However, recent work challenges the one-to-one mapping between brain structures and memory types central to this taxonomy, with key memory-related structures supporting multiple functions across substructures. Here we integrate cross-species findings in the hippocampus, striatum, and amygdala to propose an updated framework of multiple memory subsystems (MMSS). We provide evidence for two organizational principles of the MMSS theory: First, opposing memory representations are colocated in the same brain structures; second, parallel memory representations are supported by distinct structures. We discuss why this burgeoning framework has the potential to provide a useful revision of classic theories of long-term memory, what evidence is needed to further validate the framework, and how this novel perspective on memory organization may guide future research.

Social feedback biases emerge during recall but not prediction and shift across the development of social anxiety

Memory is a reconstructive process that can result in events being recalled as more positive or negative than they actually were. While positive recall biases may contribute to well-being, negative recall biases may promote internalizing symptoms, such as social anxiety. Adolescence is characterized by increased salience of peers and peak incidence of social anxiety. Symptoms often wax and wane before becoming more intractable during adulthood. Open questions remain regarding how and when biases for social feedback are expressed and how individual differences in biases may contribute to social anxiety across development. Two studies used a social feedback and cued response task to assess biases about being liked or disliked when retrieving memories vs. making predictions. Findings revealed a robust positivity bias about memories for social feedback, regardless of whether memories were true or false. Moreover, memory bias was associated with social anxiety in a developmentally sensitive way. Among adults (study 1), more severe symptoms of social anxiety were associated with a negativity bias. During the transition from adolescence to adulthood (study 2), age strengthened the positivity bias in those with less severe symptoms and strengthened the negativity bias in those with more severe symptoms. These patterns of bias were isolated to perceived memory retrieval and did not generalize to predictions about social feedback. These results provide initial support for a model by which schemas may infiltrate perceptions of memory for past, but not predictions of future, social events, shaping susceptibility for social anxiety, particularly during the transition into adulthood.

Hippocampal motor memory network reorganization depends on familiarity, not time

There is debate as to whether a time-dependent transformation of the episodic-like memory network is observed for nonepisodic tasks, including procedural motor memory. To determine how motor memory networks reorganize with time and practice, mice performed a motor task in a straight alley maze for 1 d (recent), 20 d of continuous training (continuous), or testing 20 d after the original training (remote), and then regional c-Fos expression was assessed. Elevated hippocampal c-Fos accompanied remote, but not continuous, motor task retrieval after 20 d, suggesting that the hippocampus remains engaged for nonhabitual remote motor memory retrieval.

Integration of event experiences to build relational knowledge in the human brain

We investigated how the human brain integrates experiences of specific events to build general knowledge about typical event structure. We examined an episodic memory area important for temporal relations, anterior-lateral entorhinal cortex, and a semantic memory area important for action concepts, middle temporal gyrus, to understand how and when these areas contribute to these processes. Participants underwent functional magnetic resonance imaging while learning and recalling temporal relations among novel events over two sessions 1 week apart. Across distinct contexts, individual temporal relations among events could either be consistent or inconsistent with each other. Within each context, during the recall phase, we measured associative coding as the difference of multivoxel correlations among related vs unrelated pairs of events. Neural regions that form integrative representations should exhibit stronger associative coding in the consistent than the inconsistent contexts. We found evidence of integrative representations that emerged quickly in anterior-lateral entorhinal cortex (at session 1), and only subsequently in middle temporal gyrus, which showed a significant change across sessions. A complementary pattern of findings was seen with signatures during learning. This suggests that integrative representations are established early in anterior-lateral entorhinal cortex and may be a pathway to the later emergence of semantic knowledge in middle temporal gyrus.

Memories of structured input become increasingly distorted across development

Trajectories of cognitive and neural development suggest that, despite early emergence, the ability to extract environmental patterns changes across childhood. Here, 5- to 9-year-olds and adults (N = 211, 110 females, in a large Canadian city) completed a memory test assessing what they remembered after watching a stream of shape triplets: the particular sequence in which the shapes occurred and/or their group-level structure. After accounting for developmental improvements in overall memory, all ages remembered specific transitions, while memory for group membership was only observed in older children and adults (age by test-type interaction η2  = .05). Thus, while young children form memories for specifics of structured experience, memory for derived associations is refined later-underscoring that adults and young children form different memories despite identical experience.

Time separating spatial memories does not influence their integration in humans

Humans can navigate through similar environments-like grocery stores-by integrating across their memories to extract commonalities or by differentiating between each to find idiosyncratic locations. Here, we investigate one factor that might impact whether two related spatial memories are integrated or differentiated: Namely, the temporal delay between experiences. Rodents have been shown to integrate memories more often when they are formed within 6 hours of each other. To test if this effect influences how humans spontaneously integrate spatial memories, we had 131 participants search for rewards in two similar virtual environments. We separated these learning experiences by either 30 minutes, 3 hours, or 27 hours. Memory integration was assessed three days later. Participants were able to integrate and simultaneously differentiate related memories across experiences. However, neither memory integration nor differentiation was modulated by temporal delay, in contrast to previous work. We further showed that both the levels of initial memory reactivation during the second experience and memory generalization to novel environments were comparable across conditions. Moreover, perseveration toward the initial reward locations during the second experience was related positively to integration and negatively to differentiation-but again, these associations did not vary by delay. Our findings identify important boundary conditions on the translation of rodent memory mechanisms to humans, motivating more research to characterize how even fundamental memory mechanisms are conserved and diverge across species.

Engram neurons: Encoding, consolidation, retrieval, and forgetting of memory

Tremendous strides have been made in our understanding of the neurobiological substrates of memory - the so-called memory "engram". Here, we integrate recent progress in the engram field to illustrate how engram neurons transform across the "lifespan" of a memory - from initial memory encoding, to consolidation and retrieval, and ultimately to forgetting. To do so, we first describe how cell-intrinsic properties shape the initial emergence of the engram at memory encoding. Second, we highlight how these encoding neurons preferentially participate in synaptic- and systems-level consolidation of memory. Third, we describe how these changes during encoding and consolidation guide neural reactivation during retrieval, and facilitate memory recall. Fourth, we describe neurobiological mechanisms of forgetting, and how these mechanisms can counteract engram properties established during memory encoding, consolidation, and retrieval. Motivated by recent experimental results across these four sections, we conclude by proposing some conceptual extensions to the traditional view of the engram, including broadening the view of cell-type participation within engrams and across memory stages. In collection, our review synthesizes general principles of the engram across memory stages, and describes future avenues to further understand the dynamic engram.

The effect of memory load on object reconstruction: Insights from an online mouse-tracking task

Why can't we remember everything that we experience? Previous work in the domain of object memory has suggested that our ability to resolve interference between relevant and irrelevant object features may limit how much we can remember at any given moment. Here, we developed an online mouse-tracking task to study how memory load influences object reconstruction, testing participants synchronously over virtual conference calls. We first tested up to 18 participants concurrently, replicating memory findings from a condition where participants were tested individually. Next, we examined how memory load influenced mouse trajectories as participants reconstructed target objects. We found interference between the contents of working memory and what was perceived during object reconstruction, an effect that interacted with visual similarity and memory load. Furthermore, we found interference from previously studied but currently irrelevant objects, providing evidence of object-to-location binding errors. At the greatest memory load, participants were nearly three times more likely to move their mouse cursor over previously studied nontarget objects, an effect observed primarily during object reconstruction rather than in the period before the final response. As evidence of the dynamic interplay between working memory and perception, these results show that object reconstruction behavior may be altered by (i) interference between what is represented in mind and what is currently being viewed, and (ii) interference from previously studied but currently irrelevant information. Finally, we discuss how mouse tracking can provide a rich characterization of participant behavior at millisecond temporal resolution, enormously increasing power in cognitive psychology experiments.

Emergence of a predictive model in the hippocampus

The brain organizes experiences into memories that guide future behavior. Hippocampal CA1 population activity is hypothesized to reflect predictive models that contain information about future events, but little is known about how they develop. We trained mice on a series of problems with or without a common statistical structure to observe how memories are formed and updated. Mice that learned structured problems integrated their experiences into a predictive model that contained the solutions to upcoming novel problems. Retrieving the model during learning improved discrimination accuracy and facilitated learning. Using calcium imaging to track CA1 activity during learning, we found that hippocampal ensemble activity became more stable as mice formed a predictive model. The hippocampal ensemble was reactivated during training and incorporated new activity patterns from each training problem. These results show how hippocampal activity supports building predictive models by organizing new information with respect to existing memories.

Structured memory representations develop at multiple time scales in hippocampal-cortical networks

Influential views of systems memory consolidation posit that the hippocampus rapidly forms representations of specific events, while neocortical networks extract regularities across events, forming the basis of schemas and semantic knowledge. Neocortical extraction of schematic memory representations is thought to occur on a protracted timescale of months, especially for information that is unrelated to prior knowledge. However, this theorized evolution of memory representations across extended timescales, and differences in the temporal dynamics of consolidation across brain regions, lack reliable empirical support. To examine the temporal dynamics of memory representations, we repeatedly exposed human participants to structured information via sequences of fractals, while undergoing longitudinal fMRI for three months. Sequence-specific activation patterns emerged in the hippocampus during the first 1-2 weeks of learning, followed one week later by high-level visual cortex, and subsequently the medial prefrontal and parietal cortices. Schematic, sequence-general representations emerged in the prefrontal cortex after 3 weeks of learning, followed by the medial temporal lobe and anterior temporal cortex. Moreover, hippocampal and most neocortical representations showed sustained rather than time-limited dynamics, suggesting that representations tend to persist across learning. These results show that specific hippocampal representations emerge early, followed by both specific and schematic representations at a gradient of timescales across hippocampal-cortical networks as learning unfolds. Thus, memory representations do not exist only in specific brain regions at a given point in time, but are simultaneously present at multiple levels of abstraction across hippocampal-cortical networks.

Generalization of navigation memory in honeybees

Flying insects like the honeybee learn multiple features of the environment for efficient navigation. Here we introduce a novel paradigm in the natural habitat, and ask whether the memory of such features is generalized to novel test conditions. Foraging bees from colonies located in 5 different home areas were tested in a common area for their search flights. The home areas differed in the arrangements of rising natural objects or their lack, and in the existence or lack of elongated ground structures. The test area resembled partly or not at all the layout of landmarks in the respective home areas. In particular, the test area lacked rising objects. The search flights were tracked with harmonic radar and quantified by multiples procedures, extracting their differences on an individual basis. Random search as the only guide for searching was excluded by two model calculations. The frequencies of directions of flight sectors differed from both model calculations and between the home areas in a graded fashion. Densities of search flight fixes were used to create heat maps and classified by a partial least squares regression analysis. Classification was performed with a support vector machine in order to account for optimal hyperplanes. A rank order of well separated clusters was found that partly resemble the graded differences between the ground structures of the home areas and the test area. The guiding effect of elongated ground structures was quantified with respect to the sequence, angle and distance from these ground structures. We conclude that foragers generalize their specific landscape memory in a graded way to the landscape features in the test area, and argue that both the existence and absences of landmarks are taken into account. The conclusion is discussed in the context of the learning and generalization process in an insect, the honeybee, with an emphasis on exploratory learning in the context of navigation.

From cognitive maps to spatial schemas

A schema refers to a structured body of prior knowledge that captures common patterns across related experiences. Schemas have been studied separately in the realms of episodic memory and spatial navigation across different species and have been grounded in theories of memory consolidation, but there has been little attempt to integrate our understanding across domains, particularly in humans. We propose that experiences during navigation with many similarly structured environments give rise to the formation of spatial schemas (for example, the expected layout of modern cities) that share properties with but are distinct from cognitive maps (for example, the memory of a modern city) and event schemas (such as expected events in a modern city) at both cognitive and neural levels. We describe earlier theoretical frameworks and empirical findings relevant to spatial schemas, along with more targeted investigations of spatial schemas in human and non-human animals. Consideration of architecture and urban analytics, including the influence of scale and regionalization, on different properties of spatial schemas may provide a powerful approach to advance our understanding of spatial schemas.

Hippocampal and medial prefrontal cortices encode structural task representations following progressive and interleaved training schedules

Memory generalisations may be underpinned by either encoding- or retrieval-based generalisation mechanisms and different training schedules may bias some learners to favour one of these mechanisms over the other. We used a transitive inference task to investigate whether generalisation is influenced by progressive vs randomly interleaved training, and overnight consolidation. On consecutive days, participants learnt pairwise discriminations from two transitive hierarchies before being tested during fMRI. Inference performance was consistently better following progressive training, and for pairs further apart in the transitive hierarchy. BOLD pattern similarity correlated with hierarchical distances in the left hippocampus (HIP) and medial prefrontal cortex (MPFC) following both training schedules. These results are consistent with the use of structural representations that directly encode hierarchical relationships between task features. However, such effects were only observed in the MPFC for recently learnt relationships. Furthermore, the MPFC appeared to maintain structural representations in participants who performed at chance on the inference task. We conclude that humans preferentially employ encoding-based mechanisms to store map-like relational codes that can be used for memory generalisation. These codes are expressed in the HIP and MPFC following both progressive and interleaved training but are not sufficient for accurate inference.

Remembering the pattern: A longitudinal case study on statistical learning in spatial navigation and memory consolidation

Distinct brain systems are thought to support statistical learning over different timescales. Regularities encountered during online perceptual experience can be acquired rapidly by the hippocampus. Further processing during offline consolidation can establish these regularities gradually in cortical regions, including the medial prefrontal cortex (mPFC). These mechanisms of statistical learning may be critical during spatial navigation, for which knowledge of the structure of an environment can facilitate future behavior. Rapid acquisition and prolonged retention of regularities have been investigated in isolation, but how they interact in the context of spatial navigation is unknown. We had the rare opportunity to study the brain systems underlying both rapid and gradual timescales of statistical learning using intracranial electroencephalography (iEEG) longitudinally in the same patient over a period of three weeks. As hypothesized, spatial patterns were represented in the hippocampus but not mPFC for up to one week after statistical learning and then represented in the mPFC but not hippocampus two and three weeks after statistical learning. Taken together, these findings suggest that the hippocampus may contribute to the initial extraction of regularities prior to cortical consolidation.

Flexibility of memory for future-oriented cognition

Memories of daily experiences contain incidental details unique to each experience as well as common latent patterns shared with others. Neural representations focusing on the latter aspect can be reinstated by similar new experiences even though their perceptual features do not match the original experiences perfectly. Such flexible memory use allows for faster learning and better decision-making in novel situations. Here, I review evidence from rodent and primate electrophysiological studies to discuss how memory flexibility is implemented in the spiking activity of neuronal ensembles. These findings uncovered innate and learned coding properties and their potential refinement during sleep that support flexible integration and application of memories for better future adaptation.

Schematic information influences memory and generalisation behaviour for schema-relevant and -irrelevant information

Schemas modulate memory performance for schema-congruent and -incongruent information. However, it is assumed they do not influence behaviour for information irrelevant to themselves. We assessed memory and generalisation behaviour for information related to an underlying pattern, where a schema could be extracted (schema-relevant), and information that was unrelated and therefore irrelevant to the extracted schema (schema-irrelevant). Using precision measures of long-term memory, where participants learnt associations between words and locations around a circle, we assessed memory and generalisation for schema-relevant and -irrelevant information. Words belonged to two semantic categories: human-made and natural. For one category, word-locations were clustered around one point on the circle (clustered condition), while the other category had word-locations randomly distributed (non-clustered condition). The presence of an underlying pattern in the clustered condition allows for the extraction of a schema that can support both memory and generalisation. At test, participants were presented with old (memory) and new (generalisation) words, requiring them to identify a remembered location or make a best guess. The presence of the clustered pattern modulated memory and generalisation. In the clustered condition, participants placed old and new words in locations consistent with the underlying pattern. In contrast, for the non-clustered condition, participants were less likely to place old and new non-clustered words in locations consistent with the clustered condition. Therefore, we provide evidence that the presence of schematic information modulates memory and generalisation for schema-relevant and -irrelevant information. Our results highlight the need to carefully construct appropriate schema-irrelevant control conditions such that behaviour in these conditions is not modulated by the presence of a schema. Theoretically, models of schema processing need to account for how the presence of schematic information can have consequences for information that is irrelevant to itself.

Serial dependence tracks objects and scenes in parallel and independently

The visual world is made up of objects and scenes. Object perception requires both discriminating an individual object from others and binding together different perceptual samples of that object across time. Such binding manifests by serial dependence, the attraction of the current perception of a visual attribute toward values of that attribute seen in the recent past. Scene perception is subserved by global mechanisms such as ensemble perception, the rapid extraction of the average feature value of a group of objects. The current study examined to what extent the perception of single objects in multi-object scenes depended on previous feature values of that object or on the average previous attribute of all objects in the ensemble. Results show that serial dependence occurs independently on two simultaneously present objects, that ensemble perception depends only on previous ensembles, and that serial dependence of an individual object occurs only for the features of that particular object. These results suggest that the temporal integration of successive perceptual samples operates simultaneously at independent levels of visual processing.

Sex Differences in the Spatial Behavior Functions of Adult-Born Neurons in Rats

Adult neurogenesis modifies hippocampal circuits and behavior, but removing newborn neurons does not consistently alter spatial processing, a core function of the hippocampus. Additionally, little is known about sex differences in neurogenesis since few studies have compared males and females. Since adult-born neurons regulate the stress response, we hypothesized that spatial functions may be more prominent under aversive conditions and may differ between males and females given sex differences in stress responding. We therefore trained intact and neurogenesis-deficient rats in the spatial water maze at temperatures that vary in their degree of aversiveness. In the standard water maze, ablating neurogenesis did not alter spatial learning in either sex. However, in cold water, ablating neurogenesis had divergent sex-dependent effects: relative to intact rats, male neurogenesis-deficient rats were slower to escape the maze and female neurogenesis-deficient rats were faster. Neurogenesis promoted temperature-related changes in search strategy in females, but it promoted search strategy stability in males. Females displayed greater recruitment (Fos expression) of the dorsal hippocampus than males, particularly in cold water. However, blocking neurogenesis did not alter Fos expression in either sex. Finally, morphologic analyses revealed greater experience-dependent plasticity in males. Adult-born neurons in males and females had similar morphology at baseline but training increased spine density and reduced presynaptic terminal size, specifically in males. Collectively, these findings indicate that adult-born neurons contribute to spatial learning in stressful conditions and they provide new evidence for sex differences in their behavioral functions.

Forgetting as a form of adaptive engram cell plasticity

One leading hypothesis suggests that memories are stored in ensembles of neurons (or 'engram cells') and that successful recall involves reactivation of these ensembles. A logical extension of this idea is that forgetting occurs when engram cells cannot be reactivated. Forms of 'natural forgetting' vary considerably in terms of their underlying mechanisms, time course and reversibility. However, we suggest that all forms of forgetting involve circuit remodelling that switches engram cells from an accessible state (where they can be reactivated by natural recall cues) to an inaccessible state (where they cannot). In many cases, forgetting rates are modulated by environmental conditions and we therefore propose that forgetting is a form of neuroplasticity that alters engram cell accessibility in a manner that is sensitive to mismatches between expectations and the environment. Moreover, we hypothesize that disease states associated with forgetting may hijack natural forgetting mechanisms, resulting in reduced engram cell accessibility and memory loss.

A new paradigm for investigating temporal order memory shows higher order associations are present in recent but not in remote retrieval

Memory of a sequence of distinct events requires encoding the temporal order as well as the intervals that separates these events. In this study, using order-place association task where the animal learns to associate the location of the food pellet to the order of entry into the event arena, we probe the nature of temporal order memory in mice. In our task, individual trials become distinct events, as the animal is trained to form a unique association between entry order and a correct location. The inter-trial intervals (> 30 min) are chosen deliberately to minimize the inputs from working memory. We develop this paradigm initially using four order-place associates and later extend it to five paired associates. Our results show that animals not only acquire these explicit (entry order to place) associations but also higher order associations that can only be inferred implicitly (temporal relation between the events) from the temporal order of these events. As an indicator of such higher order learning during the probe trial, the mice exhibit predominantly prospective errors that decline proportionally with temporal distance. On the other hand, prior to acquiring the sequence, the retrospective errors are dominant. In addition, we also tested the nature of such acquisitions when temporal order CS is presented along with flavored pellet as a compound stimulus comprising of order and flavor both simultaneously being paired with location. Results from these experiments indicate that the animal learns both order-place and flavor-place associations. Comparing with pure order-place training, we find that the additional flavor stimulus in a compound training paradigm did not interfere with the ability of the animals to acquire the order-place associations. When tested remotely, pure order-place associations could be retrieved only after a reminder training. Further higher order associations representing the temporal relationship between the events is markedly absent in the remote time.

Learning-Induced Shifts in Mice Navigational Strategies Are Unveiled by a Minimal Behavioral Model of Spatial Exploration

Shifts in spatial patterns produced during the execution of a navigational task can be used to track the effects of the accumulation of knowledge and the acquisition of structured information about the environment. Here, we provide a quantitative analysis of mice behavior while performing a novel goal localization task in a large, modular arena, the HexMaze. To demonstrate the effects of different forms of previous knowledge we first obtain a precise statistical characterization of animals' paths with sub-trial resolution and over different phases of learning. The emergence of a flexible representation of the task is accompanied by a progressive improvement of performance, mediated by multiple, multiplexed time scales. We then use a generative mathematical model of the animal behavior to isolate the specific contributions to the final navigational strategy. We find that animal behavior can be accurately reproduced by the combined effect of a goal-oriented component, becoming stronger with the progression of learning, and of a random walk component, producing choices unrelated to the task and only partially weakened in time.

Time-dependent transformations of memory representations differ along the long axis of the hippocampus

Research has shown that sleep is beneficial for the long-term retention of memories. According to theories of memory consolidation, memories are gradually reorganized, becoming supported by widespread, distributed cortical networks, particularly during postencoding periods of sleep. However, the effects of sleep on the organization of memories in the hippocampus itself remains less clear. In a 3-d study, participants encoded separate lists of word-image pairs differing in their opportunity for sleep-dependent consolidation. Pairs were initially studied either before or after an overnight sleep period, and were then restudied in a functional magnetic resonance imaging (fMRI) scan session. We used multivariate pattern similarity analyses to examine fine-grained effects of consolidation on memory representations in the hippocampus. We provide evidence for a dissociation along the long axis of the hippocampus that emerges with consolidation, such that representational patterns for object-word memories initially formed prior to sleep become differentiated in anterior hippocampus and more similar, or overlapping, in posterior hippocampus. Differentiation in anterior hippocampal representations correlated with subsequent behavioral performance. Furthermore, representational overlap in posterior hippocampus correlated with the duration of intervening slow wave sleep. Together, these results demonstrate that sleep-dependent consolidation promotes the reorganization of memory traces along the long axis of the hippocampus.

Evidence of hippocampal learning in human infants

The hippocampus is essential for human memory.¹ The protracted maturation of memory capacities from infancy through early childhood^2-4 is thus often attributed to hippocampal immaturity.^5-7 The hippocampus of human infants has been characterized in terms of anatomy,^8,9 but its function has never been tested directly because of technical challenges.^10,11 Here, we use recently developed methods for task-based fMRI in awake human infants¹² to test the hypothesis that the infant hippocampus supports statistical learning.^13-15 Hippocampal activity increased with exposure to visual sequences of objects when the temporal order contained regularities to be learned, compared to when the order was random. Despite the hippocampus doubling in anatomical volume across infancy, learning-related functional activity bore no relationship to age. This suggests that the hippocampus is recruited for statistical learning at the youngest ages in our sample, around 3 months. Within the hippocampus, statistical learning was clearer in anterior than posterior divisions. This is consistent with the theory that statistical learning occurs in the monosynaptic pathway,¹⁶ which is more strongly represented in the anterior hippocampus.^17,18 The monosynaptic pathway develops earlier than the trisynaptic pathway, which is linked to episodic memory,^19,20 raising the possibility that the infant hippocampus participates in statistical learning before it forms durable memories. Beyond the hippocampus, the medial prefrontal cortex showed statistical learning, consistent with its role in adult memory integration²¹ and generalization.²² These results suggest that the hippocampus supports the vital ability of infants to extract the structure of their environment through experience.

Memory consolidation as an adaptive process

We rely on our long-term memories to guide future behaviors, making it adaptive to prioritize the retention of goal-relevant, salient information in memory. In this review, we discuss findings from rodent and human research to demonstrate that active processes during post-encoding consolidation support the selective stabilization of recent experience into adaptive, long-term memories. Building upon literatures focused on dynamics at the cellular level, we highlight that consolidation also transforms memories at the systems level to support future goal-relevant behavior, resulting in more generalized memory traces in the brain and behavior. We synthesize previous literatures spanning animal research, human cognitive neuroscience, and cognitive psychology to propose an integrative framework for adaptive consolidation by which goal-relevant memoranda are "tagged" for subsequent consolidation, resulting in selective transformations to the structure of memories that support flexible, goal-relevant behaviors.

Tracking the relation between gist and item memory over the course of long-term memory consolidation

Our experiences in the world support memories not only of specific episodes but also of the generalities (the 'gist') across related experiences. It remains unclear how these two types of memories evolve and influence one another over time. In two experiments, 173 human participants encoded spatial locations from a distribution and reported both item memory (specific locations) and gist memory (center for the locations) across 1-2 months. Experiment 1 demonstrated that after 1 month, gist memory was preserved relative to item memory, despite a persistent positive correlation between them. Critically, item memories were biased toward the gist over time. Experiment 2 showed that a spatial outlier item changed this relationship and that the extraction of gist is sensitive to the regularities of items. Our results suggest that the gist starts to guide item memories over longer durations as their relative strengths change.

No consolidation without representation: Correspondence between neural and psychological representations in recent and remote memory

Memory systems consolidation is often conceived as the linear, time-dependent, neurobiological shift of memory from hippocampal-cortical to cortico-cortical dependency. We argue that contrary to this unidirectional view of memory reorganization, information about events may be retained in multiple forms (e.g., event-specific sensory-near episodic memory, event-specific gist information, event-general schematic information, or abstract semantic memory). These representations can all form at the time of the event and may continue to coexist for long durations. Their relative strength, composition, and dominance of expression change with time and experience, with task demands, and through their dynamic interaction with one another. These different psychological mnemonic representations depend on distinct functional and structural neurobiological substrates such that there is a neural-psychological representation correspondence (NPRC) among them. We discuss how the dynamics of psychological memory representations are reflected in multiple levels of neurobiological markers and their interactions. By this view, there are only variations of synaptic consolidation and memory dynamics without assuming a distinct systems consolidation process.

An inhibitory hippocampal-thalamic pathway modulates remote memory retrieval

Memories are supported by distributed hippocampal-thalamic-cortical networks, but the brain regions that contribute to network activity may vary with memory age. This process of reorganization is referred to as systems consolidation, and previous studies have examined the relationship between the activation of different hippocampal, thalamic, and cortical brain regions and memory age at the time of recall. While the activation of some brain regions increases with memory age, other regions become less active. In mice, here we show that the active disengagement of one such brain region, the anterodorsal thalamic nucleus, is necessary for recall at remote time-points and, in addition, which projection(s) mediate such inhibition. Specifically, we identified a sparse inhibitory projection from CA3 to the anterodorsal thalamic nucleus that becomes more active during systems consolidation, such that it is necessary for contextual fear memory retrieval at remote, but not recent, time-points post-learning.

Adaptive Repulsion of Long-Term Memory Representations Is Triggered by Event Similarity

We tested whether similarity between events triggers adaptive biases in how those events are remembered. We generated pairs of competing objects that were identical except in color and varied the degree of color similarity for the competing objects. Subjects (N = 123 across four experiments) repeatedly studied and were tested on associations between each of these objects and corresponding faces. As expected, high color similarity between competing objects created memory interference for object-face associations. Strikingly, high color similarity also resulted in a systematic bias in how the objects themselves were remembered: Competing objects with highly similar colors were remembered as being further apart (in color space) than they actually were. This repulsion of color memories increased with learning and served a clear adaptive purpose: Greater repulsion was associated with lower associative-memory interference. These findings reveal that similarity between events triggers adaptive-memory distortions that minimize interference.

Sleep’s Role in Schema Learning and Creative Insights

Purpose of Review

A recent resurgence of interest in schema theory has influenced research on sleep-dependent memory consolidation and led to a new understanding of how schemata might be activated during sleep and play a role in the reorganisation of memories. This review is aimed at synthesising recent findings into a coherent narrative and draw overall conclusions.

Recent Findings

Rapid consolidation of schematic memories has been shown to benefit from an interval containing sleep. These memories have shown reduced reliance on the hippocampus following consolidation in both humans and rodents. Using a variety of methodologies, notably including the DRM paradigm, it has been shown that activation of a schema can increase the rate of false memory as a result of activation of semantic associates during slow wave sleep (SWS). Memories making use of a schema have shown increased activity in the medial prefrontal cortex, which may reflect both the schematic activation itself and a cognitive control component selecting an appropriate schema to use. SWS seems to be involved in assimilation of new memories within existing semantic frameworks and in making memories more explicit, while REM sleep may be more associated with creating entirely novel associations while keeping memories implicit.

Summary

Sleep plays an important role in schematic memory consolidation, with more rapid consolidation, reduced hippocampal involvement, and increased prefrontal involvement as the key characteristics. Both SWS and REM sleep may have a role to play.

Value-complexity tradeoff explains mouse navigational learning

We introduce a novel methodology for describing animal behavior as a tradeoff between value and complexity, using the Morris Water Maze navigation task as a concrete example. We develop a dynamical system model of the Water Maze navigation task, solve its optimal control under varying complexity constraints, and analyze the learning process in terms of the value and complexity of swimming trajectories. The value of a trajectory is related to its energetic cost and is correlated with swimming time. Complexity is a novel learning metric which measures how unlikely is a trajectory to be generated by a naive animal. Our model is analytically tractable, provides good fit to observed behavior and reveals that the learning process is characterized by early value optimization followed by complexity reduction. Furthermore, complexity sensitively characterizes behavioral differences between mouse strains.

Schematic memories develop quickly, but are not expressed unless necessary

Episodic memory retrieval is increasingly influenced by schematic information as memories mature, but it is unclear whether this is due to the slow formation of schemas over time, or the slow forgetting of the episodes. To address this, we separately probed memory for newly learned schemas as well as their influence on episodic memory decisions. In this experiment, participants encoded images from two categories, with the location of images in each category drawn from a different spatial distribution. They could thus learn schemas of category locations by encoding specific episodes. We found that images that were more consistent with these distributions were more precisely retrieved, and this schematic influence increased over time. However, memory for the schema distribution, measured using generalization to novel images, also became less precise over time. This incongruity suggests that schemas form rapidly, but their influence on episodic retrieval is dictated by the need to bolster fading memory representations.

Statistical prediction of the future impairs episodic encoding of the present

Memory is typically thought of as enabling reminiscence about past experiences. However, memory also informs and guides processing of future experiences. These two functions of memory are often at odds: Remembering specific experiences from the past requires storing idiosyncratic properties that define particular moments in space and time, but by definition such properties will not be shared with similar situations in the future and thus may not be applicable to future situations. We discovered that, when faced with this conflict, the brain prioritizes prediction over encoding. Behavioral tests of recognition and source recall showed that items allowing for prediction of what will appear next based on learned regularities were less likely to be encoded into memory. Brain imaging revealed that the hippocampus was responsible for this interference between statistical learning and episodic memory. The more that the hippocampus predicted the category of an upcoming item, the worse the current item was encoded. This competition may serve an adaptive purpose, focusing encoding on experiences for which we do not yet have a predictive model.

Finding the Pattern: On-Line Extraction of Spatial Structure During Virtual Navigation

While navigating the world, we pick up on patterns of where things tend to appear. According to theories of memory and studies of animal behavior, knowledge of these patterns emerges gradually over days or weeks via consolidation of individual navigation episodes. Here, we discovered that navigation patterns can also be extracted on-line, prior to the opportunity for off-line consolidation, as a result of rapid statistical learning. Thirty human participants navigated a virtual water maze in which platform locations were drawn from a spatial distribution. Within a single session, participants increasingly navigated through the mean of the distribution. This behavior was better simulated by random walks from a model that had only an explicit representation of the current mean, compared with a model that had only memory for the individual platform locations. These results suggest that participants rapidly summarized the underlying spatial distribution and used this statistical knowledge to guide future navigation.

Dissociating memory accessibility and precision in forgetting

Forgetting involves the loss of information over time; however, we know little about what form this information loss takes. Do memories become less precise over time, or do they instead become less accessible? Here we assessed memory for word-location associations across four days, testing whether forgetting involves losses in precision versus accessibility and whether such losses are modulated by learning a generalizable pattern. We show that forgetting involves losses in memory accessibility with no changes in memory precision. When participants learned a set of related word-location associations that conformed to a general pattern, we saw a strong trade-off; accessibility was enhanced, whereas precision was reduced. However, this trade-off did not appear to be modulated by time or confer a long-term increase in the total amount of information maintained in memory. Our results place theoretical constraints on how models of forgetting and generalization account for time-dependent memory processes. PROTOCOL REGISTRATION: The stage 1 protocol for this Registered Report was accepted in principle on 4 June 2019. The protocol, as accepted by the journal, can be found at https://doi.org/10.6084/m9.figshare.c.4368464.v1 .

Systems consolidation impairs behavioral flexibility

Behavioral flexibility is important in a changing environment. Previous research suggests that systems consolidation, a long-term poststorage process that alters memory traces, may reduce behavioral flexibility. However, exactly how systems consolidation affects flexibility is unknown. Here, we tested how systems consolidation affects: (1) flexibility in response to value changes and (2) flexibility in response to changes in the optimal sequence of actions. Mice were trained to obtain food rewards in a Y-maze by switching nose pokes between three arms. During initial training, all arms were rewarded and mice simply had to switch arms in order to maximize rewards. Then, after either a 1 or 28 d delay, we either devalued one arm, or we reinforced a specific sequence of pokes. We found that after a 1 d delay mice adapted relatively easily to the changes. In contrast, mice given a 28 d delay struggled to adapt, especially for changes to the optimal sequence of actions. Immediate early gene imaging suggested that the 28 d mice were less reliant on their hippocampus and more reliant on their medial prefrontal cortex. These data suggest that systems consolidation reduces behavioral flexibility, particularly for changes to the optimal sequence of actions.

The prevalence and importance of statistical learning in human cognition and behavior

Statistical learning, the ability to extract regularities from the environment over time, has become a topic of burgeoning interest. Its influence on behavior, spanning infancy to adulthood, has been demonstrated across a range of tasks, both those labeled as tests of statistical learning and those from other learning domains that predated statistical learning research or that are not typically considered in the context of that literature. Given this pervasive role in human cognition, statistical learning has the potential to reconcile seemingly distinct learning phenomena and may be an under-appreciated but important contributor to a wide range of human behaviors that are studied as unrelated processes, such as episodic memory and spatial navigation.

Sleep Spindles Promote the Restructuring of Memory Representations in Ventromedial Prefrontal Cortex through Enhanced Hippocampal-Cortical Functional Connectivity

Memory consolidation is hypothesized to involve the distribution and restructuring of memory representations across hippocampal and cortical regions. Theories suggest that, through extended hippocampal-cortical interactions, cortical ensembles come to represent more integrated, or overlapping, memory traces that prioritize commonalities across related memories. Sleep processes, particularly fast sleep spindles, are thought to support consolidation, but evidence for this relationship has been mostly limited to memory retention benefits. Whether fast spindles provide a mechanism for neural changes hypothesized to support consolidation, including the strengthening of hippocampal-cortical networks and integration across memory representations, remains unclear, as does the specificity of regions involved. Using functional connectivity analyses of human fMRI data (both sexes), we show that fast spindle density during overnight sleep is related to enhanced hippocampal-cortical functional connectivity the next day, when restudying information learned before sleep. Spindle density modulated connectivity in distinct hippocampal-cortical networks depending on the category of the consolidated stimuli. Specifically, spindle density correlated with functional connectivity between anterior hippocampus and ventromedial prefrontal cortex (vmPFC) for object-word pairs, and posterior hippocampus and posteromedial cortex for scene-word pairs. Using multivariate pattern analyses, we also show that fast spindle density during postlearning sleep is associated with greater pattern similarity, or representational overlap, across individual object-word memories in vmPFC the next day. Further, the relationship between fast spindle density and representational overlap in vmPFC was mediated by the degree of anterior hippocampal-vmPFC functional connectivity. Together, these results suggest that fast spindles support the network distribution of memory traces, potentially restructuring memory representations in vmPFC.SIGNIFICANCE STATEMENT How new experiences are transformed into long-term memories remains a fundamental question for neuroscience research. Theories suggest that memories are stabilized as they are reorganized in the brain, a process thought to be supported by sleep oscillations, particularly sleep spindles. Although sleep spindles have been associated with benefits in memory retention, it is not well understood how spindles modify neural memory traces. This study found that spindles during overnight sleep correlate with changes in neural memory traces, including enhanced functional connectivity in distinct hippocampal-cortical networks and increased pattern similarity among memories in the cortex. The results provide critical evidence that spindles during overnight sleep may act as a physiological mechanism for the restructuring of neural memory traces.

Transformation of Event Representations along Middle Temporal Gyrus

When learning about events through visual experience, one must not only identify which events are visually similar but also retrieve those events' associates-which may be visually dissimilar-and recognize when different events have similar predictive relations. How are these demands balanced? To address this question, we taught participants the predictive structures among four events, which appeared in four different sequences, each cued by a distinct object. In each, one event ("cause") was predictably followed by another ("effect"). Sequences in the same relational category had similar predictive structure, while across categories, the effect and cause events were reversed. Using functional magnetic resonance imaging data, we measured "associative coding," indicated by correlated responses between effect and cause events; "perceptual coding," indicated by correlated responses to visually similar events; and "relational category coding," indicated by correlated responses to sequences in the same relational category. All three models characterized responses within the right middle temporal gyrus (MTG), but in different ways: Perceptual and associative coding diverged along the posterior to anterior axis, while relational categories emerged anteriorly in tandem with associative coding. Thus, along the posterior-anterior axis of MTG, the representation of the visual attributes of events is transformed to a representation of both specific and generalizable relational attributes.

Naïve to expert: Considering the role of previous knowledge in memory

In humans, most of our new memories are in some way or another related to what we have already experienced. However, in memory research, especially in non-human animal research, subjects are often mostly naïve to the world. But we know that previous knowledge will change how memories are processed and which brain areas are critical at which time point. Each process from encoding, consolidation, to memory retrieval will be affected. Here, we summarise previous knowledge effects on the neurobiology of memory in both humans and non-human animals, with a special focus on schemas - associative network structures. Furthermore, we propose a new theory on how there may be a continuous gradient from naïve to expert, which would modulate the importance and role of brain areas, such as the hippocampus and prefrontal cortex.

Reminders reinstate context-specificity to generalized remote memories in rats: relation to activity in the hippocampus and aCC

Conditioned fear memories that are context-specific shortly after conditioning generalize over time. We exposed rats to a context reminder 30 d after conditioning, which served to reinstate context-specificity, and investigated how this reminder alters retrieval-induced activity in the hippocampus and anterior cingulate cortex (aCC) relative to a no reminder condition. c-Fos expression in dorsal CA1 was observed following retrieval in the original context, but not in a novel context, whether or not the memory was reactivated, suggesting that dCA1 retains the context-specific representation. c-Fos was highly expressed in aCC following remote memory testing in both contexts, regardless of reminder condition, indicating that aCC develops generalized representations that are insensitive to memory reactivation.

The neurobiological foundation of memory retrieval

Memory retrieval involves the interaction between external sensory or internally generated cues and stored memory traces (or engrams) in a process termed 'ecphory'. While ecphory has been examined in human cognitive neuroscience research, its neurobiological foundation is less understood. To the extent that ecphory involves 'reawakening' of engrams, leveraging recently developed technologies that can identify and manipulate engrams in rodents provides a fertile avenue for examining retrieval at the level of neuronal ensembles. Here we evaluate emerging neuroscientific research of this type, using cognitive theory as a guiding principle to organize and interpret initial findings. Our Review highlights the critical interaction between engrams and retrieval cues (environmental or artificial) for memory accessibility and retrieval success. These findings also highlight the intimate relationship between the mechanisms important in forming engrams and those important in their recovery, as captured in the cognitive notion of 'encoding specificity'. Finally, we identify several questions that currently remain unanswered.