Neural correlates of retrieval success and precision: an fMRI study

Prior studies examining the neural mechanisms underlying retrieval success and precision have yielded inconsistent results. Here, their neural correlates were examined using a memory task that assessed precision for spatial location. A sample of healthy young adults underwent fMRI scanning during a single study-test cycle. At study, participants viewed a series of object images, each placed at a randomly selected location on an imaginary circle. At test, studied images were intermixed with new images and presented to the participants. The requirement was to move a cursor to the location of the studied image, guessing if necessary. Participants then signaled whether the presented image as having been studied. Memory precision was quantified as the angle between the studied location and the location selected by the participant. A precision effect was evident in the left angular gyrus, where BOLD activity covaried across trials with location accuracy. Multi-voxel pattern analysis also revealed a significant item-level reinstatement effect for high-precision trials. There was no evidence of a retrieval success effect in the angular gyrus. BOLD activity in the hippocampus was insensitive to both success and precision. These findings are partially consistent with prior evidence that success and precision are dissociable features of memory retrieval.

Visual Recognition Memory of Scenes Is Driven by Categorical, Not Sensory, Visual Representations

When we perceive a scene, our brain processes various types of visual information simultaneously, ranging from sensory features, such as line orientations and colors, to categorical features, such as objects and their arrangements. Whereas the role of sensory and categorical visual representations in predicting subsequent memory has been studied using isolated objects, their impact on memory for complex scenes remains largely unknown. To address this gap, we conducted an fMRI study in which female and male participants encoded pictures of familiar scenes (e.g., an airport picture) and later recalled them, while rating the vividness of their visual recall. Outside the scanner, participants had to distinguish each seen scene from three similar lures (e.g., three airport pictures). We modeled the sensory and categorical visual features of multiple scenes using both early and late layers of a deep convolutional neural network. Then, we applied representational similarity analysis to determine which brain regions represented stimuli in accordance with the sensory and categorical models. We found that categorical, but not sensory, representations predicted subsequent memory. In line with the previous result, only for the categorical model, the average recognition performance of each scene exhibited a positive correlation with the average visual dissimilarity between the item in question and its respective lures. These results strongly suggest that even in memory tests that ostensibly rely solely on visual cues (such as forced-choice visual recognition with similar distractors), memory decisions for scenes may be primarily influenced by categorical rather than sensory representations.

Neuromodulatory effects of high-definition theta transcranial alternating current stimulation on the parietal cortex: a pilot study of healthy males

Introduction

Transcranial alternating current stimulation (tACS) can regulate brain functions by modulating endogenous brain rhythms. Theta-band neural oscillations are associated with memory function. In particular, theta neural oscillatory power evoked in the parietal cortex is closely related to memory retrieval processes. In this study, the immediate effects of high-definition theta transcranial alternating current stimulation (HDθ-tACS) on the human left parietal cortex were investigated using short-latency afferent inhibition (SAI) and electroencephalography (EEG).

Methods

Ten subjects participated in this study. We used 6-Hz HD tACS to stimulate the left parietal cortex for 15 min. SAI was calculated, and non-linear dynamic analysis of the EEG was performed to analyze neuronal function after HD θ-tACS.

Results

The results showed a significant decrease in SAI (p < 0.05), while the left frontoparietal network was reinforced, leading to brain lateralization after HD θ-tACS. During performance of a memory task, F3 signals showed a significant upward trend in approximate entropy following treatment (p < 0.05). There was also a significant decrease in cross-approximate entropy in the C3-C4 and P3-P4 connections following the intervention (p < 0.05) in a resting eyes-open condition and in the memory task condition.

Discussion

In conclusion, HD θ-tACS could alter cholinergic transmission and cortical excitability between the parietal and motor cortices, as well as reinforcing the frontoparietal network and the left-lateralization phenomenon, which may facilitate memory formation, encoding, and consolidation.

Item-specific neural representations during human sleep support long-term memory

Understanding how individual memories are reactivated during sleep is essential in theorizing memory consolidation. Here, we employed the targeted memory reactivation (TMR) paradigm to unobtrusively replaying auditory memory cues during human participants' slow-wave sleep (SWS). Using representational similarity analysis (RSA) on cue-elicited electroencephalogram (EEG), we found temporally segregated and functionally distinct item-specific neural representations: the early post-cue EEG activity (within 0 to 2,000 ms) contained comparable item-specific representations for memory cues and control cues, signifying effective processing of auditory cues. Critically, the later EEG activity (2,500 to 2,960 ms) showed greater item-specific representations for post-sleep remembered items than for forgotten and control cues, indicating memory reprocessing. Moreover, these later item-specific neural representations were supported by concurrently increased spindles, particularly for items that had not been tested prior to sleep. These findings elucidated how external memory cues triggered item-specific neural representations during SWS and how such representations were linked to successful long-term memory. These results will benefit future research aiming to perturb specific memory episodes during sleep.

Lesion-behavior mapping indicates a strategic role for parietal substrates of associative memory

Numerous neuroimaging studies indicate that ventral parietal cortex (VPC), especially angular gyrus, plays an important role in episodic memory. However, the nature of the mnemonic processes supported by this region is far from clear. We previously found that stroke lesions in VPC and lateral temporal cortex caused deficits in cued recall of unimodal word pairs and picture pairs, and cross-modal picture-sound pairs, with larger deficits in the cross-modal task. However, those findings leave open the question whether those regions' integrity is necessary for maintenance of associative representations, or for strategic processes required for their recall. We addressed this question using associative recognition versions of those tasks. We additionally manipulated semantic relatedness of the associated memoranda, to assess VPC's involvement in semantic processing in the context of episodic memory. We analyzed performance of 62 first-event, sub-acute phase stroke patients (31 right- and 31 left-hemisphere damage) relative to 65 healthy participants, and employed voxel-based lesion-behavior mapping (VLBM) to identify task-relevant structures. Patients displayed greater false associative recognition of semantically related compared to unrelated recombined pairs. VLBM analysis implicated right lateral temporo-parietal regions in associative recognition deficits in the cross-modal pairs task, specifically for related recombined and new pairs, seemingly because of difficulty overcoming semantic relatedness bias effects on episodic discrimination. In contrast, damage to ventral parietal and lateral temporal cortex was not implicated in memory for unrelated memoranda. We interpret this pattern of lesion-behavior effects as indicating lateral temporo-parietal cortex involvement in strategic, rather than representational, roles in episodic associative memory.

Predictions transform memories: How expected versus unexpected events are integrated or separated in memory

Our brains constantly generate predictions about the environment based on prior knowledge. Many of the events we experience are consistent with these predictions, while others might be inconsistent with prior knowledge and thus violate our predictions. To guide future behavior, the memory system must be able to strengthen, transform, or add to existing knowledge based on the accuracy of our predictions. We synthesize recent evidence suggesting that when an event is consistent with our predictions, it leads to neural integration between related memories, which is associated with enhanced associative memory, as well as memory biases. Prediction errors, in turn, can promote both neural integration and separation, and lead to multiple mnemonic outcomes. We review these findings and how they interact with factors such as memory reactivation, prediction error strength, and task goals, to offer insight into what determines memory for events that violate our predictions. In doing so, this review brings together recent neural and behavioral research to advance our understanding of how predictions shape memory, and why.

Adding Meaning to Memories: How Parietal Cortex Combines Semantic Content with Episodic Experience

Neuroimaging studies of human memory have consistently found that univariate responses in parietal cortex track episodic experience with stimuli (whether stimuli are 'old' or 'new'). More recently, pattern-based fMRI studies have shown that parietal cortex also carries information about the semantic content of remembered experiences. However, it is not well understood how memory-based and content-based signals are integrated within parietal cortex. Here, in humans (males and females), we used voxel-wise encoding models and a recognition memory task to predict the fMRI activity patterns evoked by complex natural scene images based on (1) the episodic history and (2) the semantic content of each image. Models were generated and compared across distinct subregions of parietal cortex and for occipitotemporal cortex. We show that parietal and occipitotemporal regions each encode memory and content information, but they differ in how they combine this information. Among parietal subregions, angular gyrus was characterized by robust and overlapping effects of memory and content. Moreover, subject-specific semantic tuning functions revealed that successful recognition shifted the amplitude of tuning functions in angular gyrus but did not change the selectivity of tuning. In other words, effects of memory and content were additive in angular gyrus. This pattern of data contrasted with occipitotemporal cortex where memory and content effects were interactive: memory effects were preferentially expressed by voxels tuned to the content of a remembered image. Collectively, these findings provide unique insight into how parietal cortex combines information about episodic memory and semantic content.SIGNIFICANCE STATEMENT Neuroimaging studies of human memory have identified multiple brain regions that not only carry information about "whether" a visual stimulus is successfully recognized but also "what" the content of that stimulus includes. However, a fundamental and open question concerns how the brain integrates these two types of information (memory and content). Here, using a powerful combination of fMRI analysis methods, we show that parietal cortex, particularly the angular gyrus, robustly combines memory- and content-related information, but these two forms of information are represented via additive, independent signals. In contrast, memory effects in high-level visual cortex critically depend on (and interact with) content representations. Together, these findings reveal multiple and distinct ways in which the brain combines memory- and content-related information.

Mapping multidimensional content representations to neural and behavioral expressions of episodic memory

Human neuroimaging studies have shown that the contents of episodic memories are represented in distributed patterns of neural activity. However, these studies have mostly been limited to decoding simple, unidimensional properties of stimuli. Semantic encoding models, in contrast, offer a means for characterizing the rich, multidimensional information that comprises episodic memories. Here, we extensively sampled four human fMRI subjects to build semantic encoding models and then applied these models to reconstruct content from natural scene images as they were viewed and recalled from memory. First, we found that multidimensional semantic information was successfully reconstructed from activity patterns across visual and lateral parietal cortices, both when viewing scenes and when recalling them from memory. Second, whereas visual cortical reconstructions were much more accurate when images were viewed versus recalled from memory, lateral parietal reconstructions were comparably accurate across visual perception and memory. Third, by applying natural language processing methods to verbal recall data, we showed that fMRI-based reconstructions reliably matched subjects' verbal descriptions of their memories. In fact, reconstructions from ventral temporal cortex more closely matched subjects' own verbal recall than other subjects' verbal recall of the same images. Fourth, encoding models reliably transferred across subjects: memories were successfully reconstructed using encoding models trained on data from entirely independent subjects. Together, these findings provide evidence for successful reconstructions of multidimensional and idiosyncratic memory representations and highlight the differential sensitivity of visual cortical and lateral parietal regions to information derived from the external visual environment versus internally-generated memories.

Verbal memory formation across PET-based Braak stages of tau accumulation in Alzheimer's disease

A classical early sign of typical Alzheimer's disease is memory decline, which has been linked to the aggregation of tau in the medial temporal lobe. Verbal delayed free recall and recognition tests have consistently probed useful to detect early memory decline, and there is substantial debate on how performance, particularly in recognition tests, is differentially affected through health and disease in older adults. Using in vivo PET-Braak staging, we investigated delayed recall and recognition memory dysfunction across the Alzheimer's disease spectrum. Our cross-sectional study included 144 cognitively unimpaired elderly, 39 amyloid-β+ individuals with mild cognitive impairment and 29 amyloid-β+ Alzheimer's disease patients from the Translational Biomarkers in Aging and Dementia cohort, who underwent [¹⁸F]MK6240 tau and [¹⁸F]AZD4694 amyloid PET imaging, structural MRI and memory assessments. We applied non-parametric comparisons, correlation analyses, regression models and voxel-wise analyses. In comparison with PET-Braak Stage 0, we found that reduced, but not clinically significant, delayed recall starts at PET-Braak Stage II (adjusted P < 0.0015), and that recognition (adjusted P = 0.011) displayed a significant decline starting at PET-Braak Stage IV. While performance in both delayed recall and recognition related to tau in nearly the same cortical areas, further analyses showed that delayed recall rendered stronger associations in areas of early tau accumulation, whereas recognition displayed stronger correlations in mostly posterior neocortical regions. Our results support the notion that delayed recall and recognition deficits are predominantly associated with tau load in allocortical and neocortical areas, respectively. Overall, delayed recall seems to be more dependent on the integrity of anterior medial temporal lobe structures, while recognition appears to be more affected by tau accumulation in cortices beyond medial temporal regions.

Learning from errors: Distinct neural networks for monitoring errors and maintaining corrects through repeated practice and feedback

How memory representations are eventually established and maintained in the brain is one of central issues in memory research. Although the hippocampus and various brain regions have been shown to be involved in learning and memory, how they coordinate to support successful memory through errors is unclear. In this study, a retrieval practice (RP) - feedback (FB) paradigm was adopted to address this issue. Fifty-six participants (27 in the behavioral group, and 29 in the fMRI group) learned 120 Swahili-Chinese words associations and underwent two RP-answer FB cycles (i.e., RP1, FB1, RP2, FB2). The responses of the fMRI group were recorded in the fMRI scanner. The trials were divided based on participant's performance (correct or incorrect, C or I) during the two RPs and the final test (i.e., trial type, CCC, ICC, IIC III). The results showed that the regions in the salience and executive control networks (S-ECN) during RP, but not during FB, was strongly predictive of final successful memory. Their activation was just before the errors were corrected (i.e., RP1 in ICC trials and RP2 in IIC trials). The anterior insula (AI) is a core region in monitoring repeated errors, and it had differential connectivity with the default mode network (DMN) regions and the hippocampus during the RP and FB phases to inhibit incorrect answers and update memory. In contrast, maintaining corrected memory representation requires repeated RP and FB, which was associated with the DMN activation. Our study clarified how different brain regions support error monitoring and memory maintenance through repeated RP and FB, and emphasized the role of the insula in learning from errors.

Autobiographical event memory and aging: older adults get the gist

We propose that older adults' ability to retrieve episodic autobiographical events, although often viewed through a lens of decline, reveals much about what is preserved and prioritized in cognitive aging. Central to our proposal is the idea that the so-called gist of an autobiographical event is not only spared with normal aging but also well adapted to serve memory-guided behavior in older age. To support our proposal, we review cognitive and brain evidence indicating an age-related shift toward gist memory. We then discuss why this shift likely arises from more than age-related decline and instead partly reflects a natural, arguably adaptive, outcome of experience, motivation, and mode-of-thinking factors. Our proposal reveals an upside of age-related memory changes and identifies important research questions.

Patterns of episodic content and specificity predicting subjective memory vividness

The ability to remember and internally represent events is often accompanied by a subjective sense of "vividness". Vividness measures are frequently used to evaluate the experience of remembering and imagining events, yet little research has considered the objective attributes of event memories that underlie this subjective judgment, and individual differences in this mapping. Here, we tested how the content and specificity of event memories support subjectively vivid recollection. Over three experiments, participants encoded events containing a theme word and three distinct elements - a person, a place, and an object. In a memory test, memory for event elements was assessed at two levels of specificity - semantic gist (names) and perceptual details (lure discrimination). We found a strong correspondence between memory vividness and memory for gist information that did not vary by which elements were contained in memory. There was a smaller, additive benefit of remembering specific perceptual details on vividness, which, in one study, was driven by memory for place details. Moreover, we found individual differences in the relationship between memory vividness and objective memory attributes primarily along the specificity dimension, such that one cluster of participants used perceptual detail to inform memory vividness whereas another cluster was more driven by gist information. Therefore, while gist memory appears to drive vividness on average, there were idiosyncrasies in this pattern across participants. When assessing subjective ratings of memory and imagination, research should consider how these ratings map onto objective memory attributes in the context of their study design and population.

Decreased associative processing and memory confidence in aphantasia

Visual imagery and mental reconstruction of scenes are considered core components of episodic memory retrieval. Individuals with absent visual imagery (aphantasia) score lower on tests of autobiographical memory, suggesting that aphantasia may be associated with differences in episodic and associative processing. In this online study, we tested aphantasic participants and controls on associative recognition and memory confidence for three types of associations encoded incidentally: associations between visual-visual and audio-visual stimulus pairs, associations between an object and its location on the screen, and intraitem associations. Aphantasic participants had a lower rate of high-confidence hits in all associative memory tests compared with controls. Performance on auditory-visual associations was correlated with individual differences in a measure of object imagery in the aphantasic group but not in controls. No overall group difference in memory performance was found, indicating that visual imagery selectively contributes to memory confidence. Analysis of the encoding task revealed that aphantasics made fewer associative links between the stimuli, suggesting a role for visual imagery in associative processing of visual and auditory input. These data enhance our understanding of visual imagery contributions to associative memory and further characterize the cognitive profile of aphantasia.

From remembering to reconstruction: The transformative neural representation of episodic memory

Although memory has long been recognized as a generative process, neural research of memory in recent decades has been predominantly influenced by Tulving's "mental time traveling" perspective and focused on the reactivation and consolidation of encoded memory representations. With the development of multiple powerful analytical approaches to characterize the contents and formats of neural representations, recent studies are able to provide detailed examinations of the representations at various processing stages and have provided exciting new insights into the transformative nature of episodic memory. These studies have revealed the rapid, substantial, and continuous transformation of memory representation during the encoding, maintenance, consolidation, and retrieval of both single and multiple events, as well as event sequences. These transformations are characterized by the abstraction, integration, differentiation, and reorganization of memory representations, enabling the long-term retention and generalization of memory. These studies mark a significant shift in perspective from remembering to reconstruction, which might better reveal the nature of memory and its roles in supporting more effective learning, adaptive decision-making, and creative problem solving.

Brief memory reactivations induce learning in the numeric domain

Learning of arithmetic facts such as the multiplication table requires time-consuming, repeated practice. In light of evidence indicating that reactivation of encoded memories can modulate learning and memory processes at the synaptic, system and behavioral levels, we asked whether brief memory reactivations can induce human learning in the numeric domain. Adult participants performed a number-fact retrieval task in which they learned arbitrary numeric facts. Following encoding and a baseline test, 3 passive, brief reactivation sessions of only 40 s each were conducted on separate days. Learning was evaluated in a retest session. Results showed reactivations induced learning, with improved performance at retest relative to baseline test. Furthermore, performance was superior compared to a control group performing test-retest sessions without reactivations, who showed significant memory deterioration. A standard practice group completed active-retrieval sessions on 3 separate days, and showed significant learning gains. Interestingly, while these gains were higher than those of the reactivations group, subjects showing reactivation-induced learning were characterized by superior efficiency relative to standard practice subjects, with higher rate of improvement per practice time. A follow-up long-term retention experiment showed that 30 days following initial practice, weekly brief reactivations reduced forgetting, with participants performing superior to controls undergoing the same initial practice without reactivations. Overall, the results demonstrate that brief passive reactivations induce efficient learning and reduce forgetting within a numerical context. Time-efficient practice in the numeric domain carries implications for enhancement of learning strategies in daily-life settings.

Predicting memory from the network structure of naturalistic events

When we remember events, we often do not only recall individual events, but also the connections between them. However, extant research has focused on how humans segment and remember discrete events from continuous input, with far less attention given to how the structure of connections between events impacts memory. Here we conduct a functional magnetic resonance imaging study in which participants watch and recall a series of realistic audiovisual narratives. By transforming narratives into networks of events, we demonstrate that more central events-those with stronger semantic or causal connections to other events-are better remembered. During encoding, central events evoke larger hippocampal event boundary responses associated with memory formation. During recall, high centrality is associated with stronger activation in cortical areas involved in episodic recollection, and more similar neural representations across individuals. Together, these results suggest that when humans encode and retrieve complex real-world experiences, the reliability and accessibility of memory representations is shaped by their location within a network of events.

Understanding associative false memories in aging using multivariate analyses

Age-related declines in associative memory are ubiquitous, with decreases in behavioral discriminability largely arising from increases in false memories for recombined lures. Using representational similarity analyses to examine the neural basis of associative false memories in aging, the current study found that neural pattern similarity between Hits and FAs and Hits and CRs differed as a function of age in occipital ROIs, such that older adults exhibited a smaller difference between the two similarity metrics than did younger adults. Additionally, greater Hit-FA representational similarity correlated with increases in associative FAs across several ROIs. Results suggest that while neural representations underlying targets may not differ across ages, greater pattern similarity between the neural representation of targets and lures may reflect reduced distinctiveness of the information encoded in memory, such that old and new items are more difficult to discriminate, leading to more false alarms.

OUP accepted manuscript

Retrieval practice improves retention of information in long-term memory more than restudy, but the underlying neural mechanisms of this “retrieval practice effect” (RPE) remain poorly understood. Therefore, we investigated the behavioral and neural differences between previously retrieved versus restudied items at final retrieval. Thirty younger (20–30 years old) and twenty-five older (50+ years old) adults learned familiar and new picture stimuli either through retrieval or restudy. At final recognition, hemodynamic activity was measured using functional magnetic resonance imaging (fMRI). Behaviorally, younger and older adults showed similar benefits of retrieval practice, with higher recollection, but unchanged familiarity rates. In a univariate analysis of the fMRI data, activation in medial prefrontal cortex and left temporal regions correlated with an individual’s amount of behavioral benefit from retrieval practice, irrespective of age. Compatible with this observation, in a multivariate representational similarity analysis (RSA), retrieval practice led to an increase in pattern similarity for retested items in a priori defined regions of interest, including the medial temporal lobe, as well as prefrontal and parietal cortex. Our findings demonstrate that retrieval practice leads to enhanced long-term memories in younger and older adults alike, and this effect may be driven by fast consolidation processes.

Adaptive Memory Distortions Are Predicted by Feature Representations in Parietal Cortex

Similarity between memories is a primary cause of interference and forgetting. Exaggerating subtle differences between memories is therefore a potential mechanism for reducing interference. Here, we report a human fMRI study (n = 29, 19 female) that tested whether behavioral and neural expressions of memories are adaptively distorted to reduce interference. Participants learned and repeatedly retrieved object images, some of which were identical except for subtle color differences. Behavioral measures of color memory revealed exaggeration of differences between similar objects. Importantly, greater memory exaggeration was associated with lower memory interference. fMRI pattern analyses revealed that color information in parietal cortex was stronger during memory recall when color information was critical for discriminating competing memories. Moreover, greater representational distance between competing memories in parietal cortex predicted greater color memory exaggeration and lower memory interference. Together, these findings reveal that competition between memories induces adaptive, feature-specific distortions in parietal representations and corresponding behavioral expressions.SIGNIFICANCE STATEMENT Similarity between memories is a primary cause of interference and forgetting. Here, we show that, when remembering highly similar objects, subtle differences in the features of these objects are exaggerated in memory to reduce interference. These memory distortions are reflected in, and predicted by, overlap of activity patterns in lateral parietal cortex. These findings provide unique insight into how memory interference is resolved and specifically implicate lateral parietal cortex in representing feature-specific memory distortions.

Cortical Representations of Visual Stimuli Shift Locations with Changes in Memory States

Episodic memory retrieval is thought to rely on reactivation of the same content-sensitive neural activity patterns initially expressed during memory encoding.^1-6 Yet there are emerging examples of content representations expressed in different brain regions during encoding versus retrieval.^7-14 Although these differences have been observed by comparing encoding and retrieval tasks that differ in terms of perceptual experience and cognitive demands, there are many real-world contexts-e.g., meeting a new colleague who reminds you of an old acquaintance-where the memory system might be intrinsically biased either toward encoding (the new colleague) or retrieval (the old acquaintance).¹⁵¹⁶ Here, we test whether intrinsic memory states, independent of task demands, determine the cortical location of content representations. In a human fMRI study, subjects (n = 33) viewed object images and were instructed to either encode the current object or retrieve a similar object from memory. Using pattern classifiers, we show that biases toward encoding versus retrieval were reflected in large-scale attentional networks.^17-19 Critically, memory states decoded from these networks-even when entirely independent from task instructions-predicted shifts of object representations from visual cortex (encoding) to ventral parietal cortex (retrieval). Finally, visual versus ventral parietal cortices exhibited differential connectivity with the hippocampus during memory encoding versus retrieval, consistent with the idea that the hippocampus mediates cortical shifts in content representations. Collectively, these findings demonstrate that intrinsic biases toward memory encoding versus retrieval determine the specific cortical locations that express content information.

Multiple Exposures Enhance Both Item Memory and Contextual Memory Over Time

Repetition learning is an efficient way to enhance memory performance in our daily lives and educational practice. However, it is unclear to what extent repetition or multiple exposures modulate different types of memory over time. The inconsistent findings on it may be associated with encoding strategy. In this study, participants were presented with pairs of pictures (same, similar, and different) once (see section “Experiment 1”) or three times (see section “Experiment 2”) and were asked to make a same/similar/different judgment. By this, an elaborative encoding is more required for the “same” and “similar” conditions than the “different” condition. Then after intervals of 10 min, 1 day, and 1 week, they were asked to perform a recognition test to discriminate a repeated and a similar picture, followed by a remember/know/guess assessment and a contextual judgment. The results showed that after learning the objects three times, both item memory and contextual memory improved. Multiple exposures enhanced the hit rate for the “same” and “similar” conditions, but did not change the false alarm rate significantly. The recollection, rather than the familiarity, contributed to the repetition effect. In addition, the memory enhancement was manifested in each encoding condition and retention interval, especially for the “same” condition and at 10-min and 1-day intervals. These results clarify how repetition influences item and contextual memories during discriminative learning and suggest that multiple exposures render the details more vividly remembered and retained over time when elaborative encoding is emphasized.

Transforming the Concept of Memory Reactivation

Reactivation refers to the phenomenon wherein patterns of neural activity expressed during perceptual experience are re-expressed at a later time, a putative neural marker of memory. Reactivation of perceptual content has been observed across many cortical areas and correlates with objective and subjective expressions of memory in humans. However, because reactivation emphasizes similarities between perceptual and memory-based representations, it obscures differences in how perceptual events and memories are represented. Here, we highlight recent evidence of systematic differences in how (and where) perceptual events and memories are represented in the brain. We argue that neural representations of memories are best thought of as spatially transformed versions of perceptual representations. We consider why spatial transformations occur and identify critical questions for future research.

Neural pattern similarity across concept exemplars predicts memory after a long delay

The irregularities of the world ensure that each interaction we have with a concept is unique. In order to generalize across these unique encounters to form a high-level representation of a concept, we must draw on similarities between exemplars to form new conceptual knowledge that is maintained over a long time. Two neural similarity measures - pattern robustness and encoding-retrieval similarity - are particularly important for predicting memory outcomes. In this study, we used fMRI to measure activity patterns while people encoded and retrieved novel pairings between unfamiliar (Dutch) words and visually presented animal species. We address two underexplored questions: 1) whether neural similarity measures can predict memory outcomes, despite perceptual variability between presentations of a concept and 2) if pattern similarity measures can predict subsequent memory over a long delay (i.e., one month). Our findings indicate that pattern robustness during encoding in brain regions that include parietal and medial temporal areas is an important predictor of subsequent memory. In addition, we found significant encoding-retrieval similarity in the left ventrolateral prefrontal cortex after a month's delay. These findings demonstrate that pattern similarity is an important predictor of memory for novel word-animal pairings even when the concept includes multiple exemplars. Importantly, we show that established predictive relationships between pattern similarity and subsequent memory do not require visually identical stimuli (i.e., are not simply due to low-level visual overlap between stimulus presentations) and are maintained over a month.

Memory Engrams in the Neocortex

While in the past much of our knowledge about memory representations in the brain has relied on loss-of-function studies in which whole brain regions were temporarily inactivated or permanently lesioned, the recent development of new methods has ushered in a new era of downright "engram excitement." Animal research is now able to specifically label, track, and manipulate engram cells in the brain. While early studies have mostly focused on single brain regions like the hippocampus, recently more and more evidence for brain-wide distributed engram networks is emerging. Memory research in humans has also picked up pace, fueled by promising magnetic resonance imaging (MRI)-based methods like diffusion-weighted MRI (DW-MRI) and brain decoding. In this review, we will outline recent advancements in engram research, with a focus on human data and neocortical representations. We will illustrate the available noninvasive methods for the detection of engrams in different neocortical regions like the medial prefrontal cortex and the posterior parietal cortex and discuss evidence for systems consolidation and parallel memory encoding. Finally, we will explore how reactivation and prior knowledge can lead to and enhance engram formation in the neocortex.

Hippocampal and cortical mechanisms at retrieval explain variability in episodic remembering in older adults

Age-related episodic memory decline is characterized by striking heterogeneity across individuals. Hippocampal pattern completion is a fundamental process supporting episodic memory. Yet, the degree to which this mechanism is impaired with age, and contributes to variability in episodic memory, remains unclear. We combine univariate and multivariate analyses of fMRI data from a large cohort of cognitively normal older adults (N=100) to measure hippocampal activity and cortical reinstatement during retrieval of trial-unique associations. Trial-wise analyses revealed that (a) hippocampal activity scaled with reinstatement strength, (b) cortical reinstatement partially mediated the relationship between hippocampal activity and associative retrieval, (c) older age weakened cortical reinstatement and its relationship to memory behaviour. Moreover, individual differences in the strength of hippocampal activity and cortical reinstatement explained unique variance in performance across multiple assays of episodic memory. These results indicate that fMRI indices of hippocampal pattern completion explain within- and across-individual memory variability in older adults.

Deconstructing the Posterior Medial Episodic Network

Our ability to remember or imagine specific events involves the construction of complex mental representations, a process that engages cortical and hippocampal regions in a core posterior medial (PM) brain network. Existing theoretical approaches have described the overarching contributions of the PM network, but less is known about how episodic content is represented and transformed throughout this system. Here, we review evidence of key functional interactions among PM regions and their relation to the core cognitive operations and representations supporting episodic construction. Recent demonstrations of intranetwork functional diversity are integrated with existing accounts to inform a network-based model of episodic construction, in which PM regions flexibly share and manipulate event information to support the variable phenomenology of episodic memory and simulation.

Feature-specific neural reactivation during episodic memory

We present a multi-voxel analytical approach, feature-specific informational connectivity (FSIC), that leverages hierarchical representations from a neural network to decode neural reactivation in fMRI data collected while participants performed an episodic visual recall task. We show that neural reactivation associated with low-level (e.g. edges), high-level (e.g. facial features), and semantic (e.g. “terrier”) features occur throughout the dorsal and ventral visual streams and extend into the frontal cortex. Moreover, we show that reactivation of both low- and high-level features correlate with the vividness of the memory, whereas only reactivation of low-level features correlates with recognition accuracy when the lure and target images are semantically similar. In addition to demonstrating the utility of FSIC for mapping feature-specific reactivation, these findings resolve the contributions of low- and high-level features to the vividness of visual memories and challenge a strict interpretation the posterior-to-anterior visual hierarchy.

Memory recollection involves reactivation of neural activity that occurred during the recalled experience. Here, the authors show that neural reactivation can be decomposed into visual-semantic features, is widely synchronized throughout the brain, and predicts memory vividness and accuracy.

Cortical Overlap and Cortical-Hippocampal Interactions Predict Subsequent True and False Memory

The declarative memory system allows us to accurately recognize a countless number of items and events, particularly those strengthened by repeated exposure. However, increased familiarity due to repetition can also lead to false recognition of related but new items, particularly when mechanisms supporting fine-grain mnemonic discrimination fail. The hippocampus is thought to be particularly important in separating overlapping cortical inputs during encoding so that similar experiences can be differentiated. In the current study of male and female human subjects, we examine how neural pattern similarity between repeated exemplars of a given concept (e.g., apple) influences true and false memory for target or lure images. Consistent with past work, we found that subsequent true recognition was related to pattern similarity between concept exemplars and the entire encoding set (global encoding similarity), particularly in ventral visual stream. In addition, memory for an individual target exemplar (a specific apple) could be predicted solely by the degree of pattern overlap between the other exemplars (different apple pictures) of that concept (concept-specific encoding similarity). Critically, subsequent false memory for lures was mitigated when high concept-specific similarity in cortical areas was accompanied by differentiated hippocampal representations of the corresponding exemplars. Furthermore, both true and false memory entailed the reinstatement of concept-related information at varying levels of specificity. These results link both true and false memory to a measure of concept strength expressed in the overlap of cortical representations, and importantly, illustrate how the hippocampus serves to separate concurrent cortical overlap in the service of detailed memory.SIGNIFICANCE STATEMENT In some instances, the same processes that help promote memory for a general idea or concept can also hinder more detailed memory judgments, which may involve differentiating between closely related items. The current study shows that increased overlap in cortical representations for conceptually-related pictures is associated with increased recognition of repeated concept pictures. Whether similar lure items were falsely remembered as old further depended on the hippocampus, where the presence of more distinct representations protected against later false memory. This work suggests that the differentiability of brain patterns during perception is related to the differentiability of items in memory, but that fine-grain discrimination depends on the interaction between cortex and hippocampus.

Content Tuning in the Medial Temporal Lobe Cortex: Voxels that Perceive, Retrieve

How do we recall vivid details from our past based only on sparse cues? Research suggests that the phenomenological reinstatement of past experiences is accompanied by neural reinstatement of the original percept. This process critically depends on the medial temporal lobe (MTL). Within the MTL, perirhinal cortex (PRC) and parahippocampal cortex (PHC) are thought to support encoding and recall of objects and scenes, respectively, with the hippocampus (HC) serving as a content-independent hub. If the fidelity of recall indeed arises from neural reinstatement of perceptual activity, then successful recall should preferentially draw upon those neural populations within content-sensitive MTL cortex that are tuned to the same content during perception. We tested this hypothesis by having eighteen human participants undergo functional MRI (fMRI) while they encoded and recalled objects and scenes paired with words. Critically, recall was cued with the words only. While HC distinguished successful from unsuccessful recall of both objects and scenes, PRC and PHC were preferentially engaged during successful versus unsuccessful object and scene recall, respectively. Importantly, within PRC and PHC, this content-sensitive recall was predicted by content tuning during perception: Across PRC voxels, we observed a positive relationship between object tuning during perception and successful object recall, while across PHC voxels, we observed a positive relationship between scene tuning during perception and successful scene recall. Our results thus highlight content-based roles of MTL cortical regions for episodic memory and reveal a direct mapping between content-specific tuning during perception and successful recall.

Differential Functional Connectivity along the Long Axis of the Hippocampus Aligns with Differential Role in Memory Specificity and Generalization

The hippocampus contributes to both remembering specific events and generalization across events. Recent work suggests that information may be represented along the longitudinal axis of the hippocampus at varied levels of specificity: detailed representations in the posterior hippocampus and generalized representations in the anterior hippocampus. Similar distinctions are thought to exist within neocortex, with lateral prefrontal and lateral parietal regions supporting memory specificity and ventromedial prefrontal and lateral temporal cortices supporting generalized memory. Here, we tested whether functional connectivity of anterior and posterior hippocampus with cortical memory regions is consistent with these proposed dissociations. We predicted greater connectivity of anterior hippocampus with putative generalization regions and posterior hippocampus with putative memory specificity regions. Furthermore, we tested whether differences in connectivity are stable under varying levels of task engagement. Participants learned to categorize a set of stimuli outside the scanner, followed by an fMRI session that included a rest scan, passive viewing runs, and category generalization task runs. Analyses revealed stronger connectivity of ventromedial pFC to anterior hippocampus and of angular gyrus and inferior frontal gyrus to posterior hippocampus. These differences remained relatively stable across the three phases (rest, passive viewing, category generalization). Whole-brain analyses further revealed widespread cortical connectivity with both anterior and posterior hippocampus, with relatively little overlap. These results contribute to our understanding of functional organization along the long axis of the hippocampus and suggest that distinct hippocampal-cortical connections are one mechanism by which the hippocampus represents both individual experiences and generalized knowledge.

Dissociation of the Perirhinal Cortex and Hippocampus During Discriminative Learning of Similar Objects

Discriminative learning is a paradigm that has been used in animal studies, in which memory of a stimulus is enhanced when it is presented with a similar stimulus rather than with a different one. Human studies have shown that through discriminative learning of similar objects, both item memory and contextual memories are enhanced. However, the underlying neural mechanisms for it are unclear. The hippocampus and perirhinal cortex (PRC) are two possible regions involved in discriminating similar stimuli and forming distinctive memory representations. In this study, 28 participants (15 males) were scanned using high-resolution fMRI when a picture (e.g., a dog) was paired with the same picture, with a similar picture of the same concept (e.g., another dog), or with a picture of a different concept (e.g., a cat). Then, after intervals of 20 min and 1 week, the participants were asked to perform an old/new recognition task, followed by a contextual judgment. The results showed that during encoding, there was stronger activation in the PRC for the "similar" than for the "same" and "different" conditions and it predicted subsequent item memory for the "similar" condition. The hippocampal activation decreased for the "same" versus the "different" condition and the DG/CA3 activation predicted subsequent contextual memory for the "similar" condition. These results suggested that the PRC and hippocampus are functionally dissociated in encoding simultaneously presented objects and predicting subsequent item and contextual memories after discriminative learning.SIGNIFICANCE STATEMENT How the brain separates similar input into nonoverlapping representations and forms distinct memory for them is a fundamental question for the neuroscience of memory. By discriminative learning of similar (vs different) objects, both item and contextual memories are enhanced. This study found functional dissociations between perirhinal cortex (PRC) and hippocampus in discriminating pairs of similar and different objects and in predicting subsequent memory of similar objects in their item and contextual aspects. The results provided clear evidence on the neural mechanisms of discriminative learning and highlighted the importance of the PRC and hippocampus in processing different types of object information when the objects were simultaneously presented.

Decoding the tradeoff between encoding and retrieval to predict memory for overlapping events

When new events overlap with past events, there is a natural tradeoff between encoding the new event and retrieving the past event. Given the ubiquity of overlap among memories, this tradeoff between memory encoding and retrieval is of central importance to computational models of episodic memory (O'Reilly & McClelland 1994; Hasselmo 2005). However, prior studies have not directly linked neural markers of encoding/retrieval tradeoffs to behavioral measures of how overlapping events are remembered. Here, by decoding patterns of scalp electroencephalography (EEG) from male and female human subjects, we show that tradeoffs between encoding and retrieval states are reflected in distributed patterns of neural activity and, critically, these neural tradeoffs predict how overlapping events will later be remembered. Namely, new events that overlapped with past events were more likely to be subsequently remembered if neural patterns were biased toward a memory encoding state-or, conversely, away from a retrieval state. Additionally, we show that neural markers of encoding vs. retrieval states are surprisingly independent from previously-described EEG predictors of subsequent memory. Instead, we demonstrate that previously-described EEG predictors of subsequent memory are better explained by task engagement than by memory encoding, per se. Collectively, our findings provide important insight into how the memory system balances memory encoding and retrieval states and, more generally, into the neural mechanisms that support successful memory formation.

Cortico-hippocampal network connections support the multidimensional quality of episodic memory

Episodic memories reflect a bound representation of multimodal features that can be reinstated with varying precision. Yet little is known about how brain networks involved in memory, including the hippocampus and posterior-medial (PM) and anterior-temporal (AT) systems, interact to support the quality and content of recollection. Participants learned color, spatial, and emotion associations of objects, later reconstructing the visual features using a continuous color spectrum and 360-degree panorama scenes. Behaviorally, dependencies in memory were observed for the gist but not precision of event associations. Supporting this integration, hippocampus, AT, and PM regions showed increased connectivity and reduced modularity during retrieval compared to encoding. These inter-network connections tracked a multidimensional, objective measure of memory quality. Moreover, distinct patterns of connectivity tracked item color and spatial memory precision. These findings demonstrate how hippocampal-cortical connections reconfigure during episodic retrieval, and how such dynamic interactions might flexibly support the multidimensional quality of remembered events.

Memories Fade: The Relationship Between Memory Vividness and Remembered Visual Salience

Past events, particularly emotional experiences, are often vividly recollected. However, it remains unclear how qualitative information, such as low-level visual salience, is reconstructed and how the precision and bias of this information relate to subjective memory vividness. Here, we tested whether remembered visual salience contributes to vivid recollection. In three experiments, participants studied emotionally negative and neutral images that varied in luminance and color saturation, and they reconstructed the visual salience of each image in a subsequent test. Results revealed, unexpectedly, that memories were recollected as less visually salient than they were encoded, demonstrating a novel memory-fading effect, whereas negative emotion increased subjective memory vividness and the precision with which visual features were encoded. Finally, memory vividness tracked both the precision and remembered salience (bias) of visual information. These findings provide evidence that low-level visual information fades in memory and contributes to the experience of vivid recollection.

Flexible updating of dynamic knowledge structures

Schemas are knowledge structures that allow us to make efficient judgments about the world without the cost of memorizing every detail of previous experiences. It has long been known that schemas can enhance long-term memory for related information. The usefulness of schemas, however, critically depends on their adaptability: how flexibly a schema can be updated according to changing environmental conditions. Prior consolidation of a schema supports new learning of schema-consistent information. Yet, the effect of consolidation on inconsistent information, and how schemas may be subsequently updated, are not well understood. It is difficult to track the dynamic updating of knowledge structures with traditional memory measures. Here, using a continuous-report paradigm, we were able to show that schematization increases incrementally with consolidation and that the strength with which schemas are initially established predicts schema-guided responding in a later test. Critically, schema updating in response to inconsistent information was more pronounced in a group which was given time to consolidate compared to a group that was not given time to consolidate. Importantly, the later group reverted back to the no longer relevant schema, indicating that systematic bias towards old information, rather than increased forgetting, underlies reduced memory for schema-inconsistent information.