Working Memory Replay Prioritizes Weakly Attended Events

Awake Hippocampal-Cortical Co-reactivation Is Associated with Forgetting

Systems consolidation theories posit that consolidation occurs primarily through a coordinated communication between hippocampus and neocortex [Moscovitch, M., & Gilboa, A. Systems consolidation, transformation and reorganization: Multiple trace theory, trace transformation theory and their competitors. PsyArXiv, 2021; Kumaran, D., Hassabis, D., & McClelland, J. L. What learning systems do intelligent agents need? Complementary learning systems theory updated. Trends in Cognitive Sciences, 20, 512-534, 2016; McClelland, J. L., & O'Reilly, R. C. Why there are complementary learning systems in the hippocampus and neocortex: Insights from the successes and failures of connectionist models of learning and memory. Psychological Review, 102, 419-457, 1995]. Recent sleep studies in rodents have shown that hippocampus and visual cortex replay the same information at temporal proximity ("co-replay"; Lansink, C. S., Goltstein, P. M., Lankelma, J. V., McNaughton, B. L., & Pennartz, C. M. A. Hippocampus leads ventral striatum in replay of place-reward information. PLoS Biology, 7, e1000173, 2009; Peyrache, A., Khamassi, M., Benchenane, K., Wiener, S. I., & Battaglia, F. P. Replay of rule-learning related neural patterns in the prefrontal cortex during sleep. Nature Neuroscience, 12, 919-926, 2009; Wierzynski, C. M., Lubenov, E. V., Gu, M., & Siapas, A. G. State-dependent spike-timing relationships between hippocampal and prefrontal circuits during sleep. Neuron, 61, 587-596, 2009; Ji, D., & Wilson, M. A. Coordinated memory replay in the visual cortex and hippocampus during sleep. Nature Neuroscience, 10, 100-107, 2007). We developed a novel repetition time (TR)-based co-reactivation analysis method to study hippocampal-cortical co-replays in humans using fMRI. Thirty-six young adults completed an image (face or scene) and location paired associate encoding task in the scanner, which were preceded and followed by resting state scans. We identified post-encoding rest TRs (± 1) that showed neural reactivation of each image-location trials in both hippocampus (HPC) and category-selective cortex (fusiform face area [FFA]). This allowed us to characterize temporally proximal coordinated reactivations ("co-reactivations") between HPC and FFA. Moreover, we found that increased HPC-FFA co-reactivations were associated with incorrectly recognized trials after a 1-week delay (p = .004). Finally, we found that these HPC-FFA co-reactivations were also associated with trials that were initially correctly recognized immediately after encoding but were later forgotten in 1-day (p = .043) and 1-week delay period (p = .031). We discuss these results from a trace transformation perspective [Sekeres, M. J., Winocur, G., & Moscovitch, M. The hippocampus and related neocortical structures in memory transformation. Neuroscience Letters, 680, 39-53, 2018; Winocur, G., & Moscovitch, M. Memory transformation and systems consolidation. Journal of the International Neuropsychological Society, 17, 766-780, 2011] and speculate that HPC-FFA co-reactivations may be integrating related events, at the expense of disrupting event-specific details, hence leading to forgetting.

How our understanding of memory replay evolves

Memory reactivations and replay, widely reported in the hippocampus and cortex across species, have been implicated in memory consolidation, planning, and spatial and skill learning. Technological advances in electrophysiology, calcium imaging, and human neuroimaging techniques have enabled neuroscientists to measure large-scale neural activity with increasing spatiotemporal resolution and have provided opportunities for developing robust analytic methods to identify memory replay. In this article, we first review a large body of historically important and representative memory replay studies from the animal and human literature. We then discuss our current understanding of memory replay functions in learning, planning, and memory consolidation and further discuss the progress in computational modeling that has contributed to these improvements. Next, we review past and present analytic methods for replay analyses and discuss their limitations and challenges. Finally, looking ahead, we discuss some promising analytic methods for detecting nonstereotypical, behaviorally nondecodable structures from large-scale neural recordings. We argue that seamless integration of multisite recordings, real-time replay decoding, and closed-loop manipulation experiments will be essential for delineating the role of memory replay in a wide range of cognitive and motor functions.

Inverse forgetting in unconscious episodic memory

Forming memories of experienced episodes calls upon the episodic memory system. Episodic encoding may proceed with and without awareness of episodes. While up to 60% of consciously encoded episodes are forgotten after 10 h, the fate of unconsciously encoded episodes is unknown. Here we track over 10 h, which are filled with sleep or daytime activities, the retention of unconsciously and consciously experienced episodes. The episodes were displayed in cartoon clips that were presented weakly and strongly masked for conscious and unconscious encoding, respectively. Clip retention was tested for distinct clips directly after encoding, 3 min and 10 h after encoding using a forced-choice test that demands deliberate responses in both consciousness conditions. When encoding was conscious, retrieval accuracy decreased by 25% from 3 min to 10 h, irrespective of sleep or wakefulness. When encoding was unconscious, retrieval accuracy increased from 3 min to 10 h and depended on sleep. Hence, opposite to the classic forgetting curve, unconsciously acquired episodic memories strengthen over time and hinge on sleep on the day of learning to gain influence over human behavior.

Event segmentation reveals working memory forgetting rate

We encounter the world as a continuous flow and effortlessly segment sequences of events into episodes. This process of event segmentation engages working memory (WM) for tracking the flow of events and impacts subsequent memory accuracy. WM is limited in how much information (i.e., WM capacity) and for how long the information is retained (i.e., forgetting rate). In this study, across multiple tasks, we estimated participants’ WM capacity and forgetting rate in a dynamic context and evaluated their relationship to event segmentation. A U-shaped relationship across tasks shows that individuals who segmented the movie more finely or coarsely than the average have a faster WM forgetting rate. A separate task assessing long-term memory retrieval revealed that the coarse-segmenters have better recognition of temporal order of events compared to the fine-segmenters. These findings show that event segmentation employs dissociable memory strategies and correlates with how long information is retained in WM

•

The event segmentation grain is variable across individuals

•

The event segmentation grain has a U-shaped relationship with the WM forgetting rate

•

The temporal order memory accuracy decreases with the increasing event segmentation

•

The number of recalled events increases with the increasing event segmentation

Replay in minds and machines

Experience-related brain activity patterns reactivate during sleep, wakeful rest, and brief pauses from active behavior. In parallel, machine learning research has found that experience replay can lead to substantial performance improvements in artificial agents. Together, these lines of research suggest replay has a variety of computational benefits for decision-making and learning. Here, we provide an overview of putative computational functions of replay as suggested by machine learning and neuroscientific research. We show that replay can lead to faster learning, less forgetting, reorganization or augmentation of experiences, and support planning and generalization. In addition, we highlight the benefits of reactivating abstracted internal representations rather than veridical memories, and discuss how replay could provide a mechanism to build internal representations that improve learning and decision-making.

EEG dynamics reveal a dissociation between storage and selective attention within working memory

Selective attention plays a prominent role in prioritizing information in working memory (WM), improving performance for attended representations. However, it remains unclear whether unattended WM representations suffer from information loss. Here we tested the hypothesis that within WM, selectively attending to an item and stopping storing other items are independent mechanisms. We recorded EEG while participants performed a WM recall task in which the item most likely to be tested was cued retrospectively during retention. By manipulating retro-cue reliability (i.e., the ratio of valid to invalid cue trials), we varied the incentive to retain non-cued items. Storage and selective attention in WM were measured during the retention interval by contralateral delay activity (CDA) and contralateral alpha power suppression, respectively. Soon after highly reliable cues, the cued item was attended, and non-cued items suffered information loss. However, for less reliable cues, initially the cued item was attended, but unattended items were kept in WM. Later during the delay, previously unattended items suffered information loss despite now attention being reallocated to their locations, presumably to strengthen their weakening traces. These results show that storage and attention in WM are distinct processes that can behave differently depending on the relative importance of representations.

Replay of Stimulus-specific Temporal Patterns during Associative Memory Formation

Forming a memory often entails the association of recent experience with present events. This recent experience is usually an information-rich and dynamic representation of the world around us. We here show that associating a static cue with a previously shown dynamic stimulus yields a detectable, dynamic representation of this stimulus. We further implicate this representation in the decrease of low-frequency power (∼4–30 Hz) in the ongoing EEG, which is a well-known correlate of successful memory formation. The reappearance of content-specific patterns in desynchronizing brain oscillations was observed in two sensory domains, that is, in a visual condition and in an auditory condition. Together with previous results, these data suggest a mechanism that generalizes across domains and processes, in which the decrease in oscillatory power allows for the dynamic representation of information in ongoing brain oscillations.

Human hippocampal replay during rest prioritizes weakly learned information and predicts memory performance

The hippocampus replays experiences during quiet rest periods, and this replay benefits subsequent memory. A critical open question is how memories are prioritized for this replay. We used functional magnetic resonance imaging (fMRI) pattern analysis to track item-level replay in the hippocampus during an awake rest period after participants studied 15 objects and completed a memory test. Objects that were remembered less well were replayed more during the subsequent rest period, suggesting a prioritization process in which weaker memories—memories most vulnerable to forgetting—are selected for replay. In a second session 12 hours later, more replay of an object during a rest period predicted better subsequent memory for that object. Replay predicted memory improvement across sessions only for participants who slept during that interval. Our results provide evidence that replay in the human hippocampus prioritizes weakly learned information, predicts subsequent memory performance, and relates to memory improvement across a delay with sleep.

The hippocampus is known to 'replay' experiences and memories during rest periods, but it is unclear how particular memories are prioritized for replay. Here, the authors show that information that is remembered less well is replayed more often, suggesting that weaker memories are selected for replay.