Overlap between hippocampal pre-encoding and encoding patterns supports episodic memory

Coordinated representations for naturalistic memory encoding and retrieval in hippocampal neural subspaces

Our naturalistic experiences are organized into memories through multiple processes, including novelty encoding, memory formation, and retrieval. However, the neural mechanisms coordinating these processes remain elusive. Using fMRI data acquired during movie viewing and subsequent narrative recall, we examine hippocampal neural subspaces associated with distinct memory processes and characterized their relationships. We quantify novelty in character co-occurrences and the valence of relationships and estimate event memorability. Within the hippocampus, the novelty subspaces encoding each type exhibit partial overlap, and these overlapping novelty subspaces align with the subspace involved in memorability. Notably, following event boundaries, hippocampal states within these subspaces align inversely along a shared coding axis, predicting subsequent recall performance. This novelty-memorability alignment is selectively observed during encoding but not during retrieval. Finally, the identified functional subspaces reflect the intrinsic functional organization of the hippocampus. Our findings offer insights into how the hippocampus dynamically coordinates representations underlying memory encoding and retrieval at the population level to transform ongoing experiences into enduring memories.

Reactivation and consolidation of memory traces during post-encoding rest across the adult lifespan

Episodic memory is a critical cognitive function that enables the encoding, storage, and retrieval of new information. Memory consolidation, a key stage of episodic memory, stabilizes this newly encoded information into long-lasting brain "storage." Studies using fMRI to investigate post-encoding awake rest holds promise to shed light on early, immediate consolidation mechanisms. Here, we review fMRI studies during episodic memory to document common methods to investigate post-encoding consolidation, such as multivoxel pattern analysis (MVPA) and functional connectivity, and the current state of the science in both healthy younger and older adults. In young adults, post-encoding reactivation of stimuli-specific neural patterns in the hippocampus and its connectivity with cortical and subcortical areas (e.g., visual-temporal cortex, medial prefrontal, and medial parietal cortex) correlate with subsequent memory performance. Conversely, studies in older adults highlight the importance of large-scale brain networks during post-encoding rest, particularly the default mode network (DMN). Alterations in connectivity between the DMN and task-positive networks may help older adults maintain episodic memory. Furthermore, non-invasive brain stimulation techniques can enhance these post-encoding consolidation processes and improve memory performance in both younger and older adults. Notably, a lack of studies has investigated post-encoding memory consolidation in neurodegenerative disorders. This review underscores the importance of understanding how post-encoding neural reactivation and connectivity evolve with age to partially explain age-related declines in episodic memory performance and how such declines can be restored.

Distinct mechanisms and functions of episodic memory

The concept of episodic memory (EM) faces significant challenges by two claims: EM might not be a distinct memory system, and EM might be an epiphenomenon of a more general capacity for mental time travel (MTT). Nevertheless, the observations leading to these arguments do not preclude the existence of a mechanically and functionally distinct EM system. First, modular systems, like cognition, can have distinct subsystems that may not be distinguishable in the system's final output. EM could be such a subsystem, even though its effects may be difficult to distinguish from those of other subsystems. Second, EM could have a distinct and consistent low-level function, which is used in diverse high-level functions such as MTT. This article introduces the scenario construction framework, proposing that EM crucially rests on memory traces containing the gist of an episodic experience. During retrieval, EM traces trigger the reconstruction of semantic representations, which were active during the remembered episode, and are further enriched with semantic information, to generate a scenario of the past experience. This conceptualization of EM is consistent with studies on the neural basis of EM and resolves the two challenges while retaining the key properties associated with EM. This article is part of the theme issue 'Elements of episodic memory: lessons from 40 years of research'.

Has the concept of systems consolidation outlived its usefulness? Identification and evaluation of premises underlying systems consolidation

Systems consolidation has mostly been treated as a neural construct defined by the time-dependent change in memory representation from the hippocampus (HPC) to other structures, primarily the neocortex. Here, we identify and evaluate the explicit and implicit premises that underlie traditional or standard models and theories of systems consolidation based on evidence from research on humans and other animals. We use the principle that changes in neural representation over time and experience are accompanied by corresponding changes in psychological representations, and vice versa, to argue that each of the premises underlying traditional or standard models and theories of systems consolidation is found wanting. One solution is to modify or abandon the premises or theories and models. This is reflected in moderated models of systems consolidation that emphasize the early role of the HPC in training neocortical memories until they stabilize. The fault, however, may lie in the very concept of systems consolidation and its defining feature. We propose that the concept be replaced by one of memory systems reorganization, which does not carry the theoretical baggage of systems consolidation and is flexible enough to capture the dynamic nature of memory from inception to very long-term retention and retrieval at a psychological and neural level. The term "memory system reorganization" implies that memory traces are not fixed, even after they are presumably consolidated. Memories can continue to change as a result of experience and interactions among memory systems across the lifetime. As will become clear, hippocampal training of neocortical memories is only one type of such interaction, and not always the most important one, even at inception. We end by suggesting some principles of memory reorganization that can help guide research on dynamic memory processes that capture corresponding changes in memory at the psychological and neural levels.

Prediction errors disrupt hippocampal representations and update episodic memories

The brain supports adaptive behavior by generating predictions, learning from errors, and updating memories to incorporate new information. Prediction error, or surprise, triggers learning when reality contradicts expectations. Prior studies have shown that the hippocampus signals prediction errors, but the hypothesized link to memory updating has not been demonstrated. In a human functional MRI study, we elicited mnemonic prediction errors by interrupting familiar narrative videos immediately before the expected endings. We found that prediction errors reversed the relationship between univariate hippocampal activation and memory: greater hippocampal activation predicted memory preservation after expected endings, but memory updating after surprising endings. In contrast to previous studies, we show that univariate activation was insufficient for understanding hippocampal prediction error signals. We explain this surprising finding by tracking both the evolution of hippocampal activation patterns and the connectivity between the hippocampus and neuromodulatory regions. We found that hippocampal activation patterns stabilized as each narrative episode unfolded, suggesting sustained episodic representations. Prediction errors disrupted these sustained representations and the degree of disruption predicted memory updating. The relationship between hippocampal activation and subsequent memory depended on concurrent basal forebrain activation, supporting the idea that cholinergic modulation regulates attention and memory. We conclude that prediction errors create conditions that favor memory updating, prompting the hippocampus to abandon ongoing predictions and make memories malleable.

Spontaneous perception: a framework for task-free, self-paced perception

Flipping through social media feeds, viewing exhibitions in a museum, or walking through the botanical gardens, people consistently choose to engage with and disengage from visual content. Yet, in most laboratory settings, the visual stimuli, their presentation duration, and the task at hand are all controlled by the researcher. Such settings largely overlook the spontaneous nature of human visual experience, in which perception takes place independently from specific task constraints and its time course is determined by the observer as a self-governing agent. Currently, much remains unknown about how spontaneous perceptual experiences unfold in the brain. Are all perceptual categories extracted during spontaneous perception? Does spontaneous perception inherently involve volition? Is spontaneous perception segmented into discrete episodes? How do different neural networks interact over time during spontaneous perception? These questions are imperative to understand our conscious visual experience in daily life. In this article we propose a framework for spontaneous perception. We first define spontaneous perception as a task-free and self-paced experience. We propose that spontaneous perception is guided by four organizing principles that grant it temporal and spatial structures. These principles include coarse-to-fine processing, continuity and segmentation, agency and volition, and associative processing. We provide key suggestions illustrating how these principles may interact with one another in guiding the multifaceted experience of spontaneous perception. We point to testable predictions derived from this framework, including (but not limited to) the roles of the default-mode network and slow cortical potentials in underlying spontaneous perception. We conclude by suggesting several outstanding questions for future research, extending the relevance of this framework to consciousness and spontaneous brain activity. In conclusion, the spontaneous perception framework proposed herein integrates components in human perception and cognition, which have been traditionally studied in isolation, and opens the door to understand how visual perception unfolds in its most natural context.

Prestimulus Activity in the Cingulo-Opercular Network Predicts Memory for Naturalistic Episodic Experience

Human memory is strongly influenced by brain states occurring before an event, yet we know little about the underlying mechanisms. We found that activity in the cingulo-opercular network (including bilateral anterior insula [aI] and anterior prefrontal cortex [aPFC]) seconds before an event begins can predict whether this event will subsequently be remembered. We then tested how activity in the cingulo-opercular network shapes memory performance. Our findings indicate that prestimulus cingulo-opercular activity affects memory performance by opposingly modulating subsequent activity in two sets of regions previously linked to encoding and retrieval of episodic information. Specifically, higher prestimulus cingulo-opercular activity was associated with a subsequent increase in activity in temporal regions previously linked to encoding and with a subsequent reduction in activity within a set of regions thought to play a role in retrieval and self-referential processing. Together, these findings suggest that prestimulus attentional states modulate memory for real-life events by enhancing encoding and possibly by dampening interference from competing memory substrates.

Dynamics of fMRI patterns reflect sub-second activation sequences and reveal replay in human visual cortex

Neural computations are often fast and anatomically localized. Yet, investigating such computations in humans is challenging because non-invasive methods have either high temporal or spatial resolution, but not both. Of particular relevance, fast neural replay is known to occur throughout the brain in a coordinated fashion about which little is known. We develop a multivariate analysis method for functional magnetic resonance imaging that makes it possible to study sequentially activated neural patterns separated by less than 100 ms with precise spatial resolution. Human participants viewed five images individually and sequentially with speeds up to 32 ms between items. Probabilistic pattern classifiers were trained on activation patterns in visual and ventrotemporal cortex during individual image trials. Applied to sequence trials, probabilistic classifier time courses allow the detection of neural representations and their order. Order detection remains possible at speeds up to 32 ms between items (plus 100 ms per item). The frequency spectrum of the sequentiality metric distinguishes between sub- versus supra-second sequences. Importantly, applied to resting-state data our method reveals fast replay of task-related stimuli in visual cortex. This indicates that non-hippocampal replay occurs even after tasks without memory requirements and shows that our method can be used to detect such spontaneously occurring replay.

Effects of Age on Prestimulus Neural Activity Predictive of Successful Memory Encoding: An fMRI Study

Prestimulus subsequent memory effects (SMEs)-differences in neural activity preceding the onset of study items that are predictive of later memory performance-have consistently been reported in young adults. The present functional magnetic resonance imaging experiment investigated potential age-related differences in prestimulus SMEs. During study, healthy young and older participants made one of two semantic judgments on images, with the judgment signaled by a preceding cue. In test phase, participants first made an item recognition judgment and, for each item judged old, a source memory judgment. Age-invariant prestimulus SMEs were observed in left dorsomedial prefrontal cortex, left hippocampus, and right subgenual cortex. In each case, the effects reflected lower blood oxygen level dependent signal for later recognized items, regardless of source accuracy, than for unrecognized items. A similar age-invariant pattern was observed in left orbitofrontal cortex, but this effect was specific to items attracting a correct source response compared to unrecognized items. In contrast, the left angular gyrus and fusiform cortex demonstrated negative prestimulus SMEs that were exclusive to young participants. The findings indicate that age differences in prestimulus SMEs are regionally specific and suggest that prestimulus SMEs reflect multiple cognitive processes, only some of which are vulnerable to advancing age.

Spiking activity in the human hippocampus prior to encoding predicts subsequent memory

Encoding activity in the medial temporal lobe, presumably evoked by the presentation of stimuli (postonset activity), is known to predict subsequent memory. However, several independent lines of research suggest that preonset activity also affects subsequent memory. We investigated the role of preonset and postonset single-unit and multiunit activity recorded from epilepsy patients as they completed a continuous recognition task. In this task, words were presented in a continuous series and eventually began to repeat. For each word, the patient's task was to decide whether it was novel or repeated. We found that preonset spiking activity in the hippocampus (when the word was novel) predicted subsequent memory (when the word was later repeated). Postonset activity during encoding also predicted subsequent memory, but was simply a continuation of preonset activity. The predictive effect of preonset spiking activity was much stronger in the hippocampus than in three other brain regions (amygdala, anterior cingulate, and prefrontal cortex). In addition, preonset and postonset activity around the encoding of novel words did not predict memory performance for novel words (i.e., correctly classifying the word as novel), and preonset and postonset activity around the time of retrieval did not predict memory performance for repeated words (i.e., correctly classifying the word as repeated). Thus, the only predictive effect was between preonset activity (along with its postonset continuation) at the time of encoding and subsequent memory. Taken together, these findings indicate that preonset hippocampal activity does not reflect general arousal/attention but instead reflects what we term "attention to encoding."

Awake Reactivation of Prior Experiences Consolidates Memories and Biases Cognition

After experiences are encoded into memory, post-encoding reactivation mechanisms have been proposed to mediate long-term memory stabilization and transformation. Spontaneous reactivation of hippocampal representations, together with hippocampal-cortical interactions, are leading candidate mechanisms for promoting systems-level memory strengthening and reorganization. While the replay of spatial representations has been extensively studied in rodents, here we review recent fMRI work that provides evidence for spontaneous reactivation of nonspatial, episodic event representations in the human hippocampus and cortex, as well as for experience-dependent alterations in systems-level hippocampal connectivity. We focus on reactivation during awake post-encoding periods, relationships between reactivation and subsequent behavior, how reactivation is modulated by factors that influence consolidation, and the implications of persistent reactivation for biasing ongoing perception and cognition.