Cortical reinstatement and the confidence and accuracy of source memory

Reconstructing Spatiotemporal Trajectories of Visual Object Memories in the Human Brain

How the human brain reconstructs, step-by-step, the core elements of past experiences is still unclear. Here, we map the spatiotemporal trajectories along which visual object memories are reconstructed during associative recall. Specifically, we inquire whether retrieval reinstates feature representations in a copy-like but reversed direction with respect to the initial perceptual experience, or alternatively, this reconstruction involves format transformations and regions beyond initial perception. Participants from two cohorts studied new associations between verbs and randomly paired object images, and subsequently recalled the objects when presented with the corresponding verb cue. We first analyze multivariate fMRI patterns to map where in the brain high- and low-level object features can be decoded during perception and retrieval, showing that retrieval is dominated by conceptual features, represented in comparatively late visual and parietal areas. A separately acquired EEG dataset is then used to track the temporal evolution of the reactivated patterns using similarity-based EEG-fMRI fusion. This fusion suggests that memory reconstruction proceeds from anterior frontotemporal to posterior occipital and parietal regions, in line with a conceptual-to-perceptual gradient but only partly following the same trajectories as during perception. Specifically, a linear regression statistically confirms that the sequential activation of ventral visual stream regions is reversed between image perception and retrieval. The fusion analysis also suggests an information relay to frontoparietal areas late during retrieval. Together, the results shed light onto the temporal dynamics of memory recall and the transformations that the information undergoes between the initial experience and its later reconstruction from memory.

Neural correlates of retrieval success and precision: an fMRI study

Prior studies examining the neural mechanisms underlying retrieval success and precision have yielded inconsistent results. Here, their neural correlates were examined using a memory task that assessed precision for spatial location. A sample of healthy young adults underwent fMRI scanning during a single study-test cycle. At study, participants viewed a series of object images, each placed at a randomly selected location on an imaginary circle. At test, studied images were intermixed with new images and presented to the participants. The requirement was to move a cursor to the location of the studied image, guessing if necessary. Participants then signaled whether the presented image as having been studied. Memory precision was quantified as the angle between the studied location and the location selected by the participant. A precision effect was evident in the left angular gyrus, where BOLD activity covaried across trials with location accuracy. Multi-voxel pattern analysis also revealed a significant item-level reinstatement effect for high-precision trials. There was no evidence of a retrieval success effect in the angular gyrus. BOLD activity in the hippocampus was insensitive to both success and precision. These findings are partially consistent with prior evidence that success and precision are dissociable features of memory retrieval.

Post-retrieval stress impairs subsequent memory depending on hippocampal memory trace reinstatement during reactivation

Upon retrieval, memories can become susceptible to meaningful events, such as stress. Post-retrieval memory changes may be attributed to an alteration of the original memory trace during reactivation-dependent reconsolidation or, alternatively, to the modification of retrieval-related memory traces that impact future remembering. Hence, how post-retrieval memory changes emerge in the human brain is unknown. In a 3-day functional magnetic resonance imaging study, we show that post-retrieval stress impairs subsequent memory depending on the strength of neural reinstatement of the original memory trace during reactivation, driven by the hippocampus and its cross-talk with neocortical representation areas. Comparison of neural patterns during immediate and final memory testing further revealed that successful retrieval was linked to pattern-dissimilarity in controls, suggesting the use of a different trace, whereas stressed participants relied on the original memory representation. These representation changes were again dependent on neocortical reinstatement during reactivation. Our findings show disruptive stress effects on the consolidation of retrieval-related memory traces that support future remembering.

The persistence of memory: prior memory responses modulate behavior and brain state engagement

Memory brain states may influence how we experience an event. Memory encoding and retrieval constitute neurally dissociable brain states that individuals can selectively engage based on top-down goals. To the extent that memory states linger in time - as suggested by prior behavioral work - memory states may influence not only the current experience, but also subsequent stimuli and judgments. Thus lingering memory states may have broad influences on cognition, yet this account has not been directly tested utilizing neural measures of memory states. Here we address this gap by testing the hypothesis that memory brain states are modulated by memory judgments, and that these brain states persist for several hundred milliseconds. We recorded scalp electroencephalography (EEG) while participants completed a recognition memory task. We used an independently validated multivariate mnemonic state classifier to assess memory state engagement. We replicate prior behavioral findings; however, our neural findings run counter to the predictions made on the basis of the behavioral data. Surprisingly, we find that prior responses modulate current memory state engagement on the basis of response congruency. That is, we find strong engagement of the retrieval state on incongruent trials - when a target is preceded by a correct rejection of a lure and when a lure is preceded by successful recognition of a target. These findings indicate that cortical brain states are influenced by prior judgments and suggest that a non-mnemonic, internal attention state may be recruited to in the face of changing demands in a dynamic environment.

The effects of forewarning and divided attention on context retrieval in false recognition

After studying a list of words that are semantically associated to a critical lure, participants are more likely to attribute a falsely recognised critical lure to the context of its strong than weak semantic associates. This is known as the source-strength effect. The current study investigated the roles of automatic and controlled processing in context retrieval in false recognition that is demonstrated by the source-strength effect. The results revealed that the source-strength effect was impervious to forewarning (Experiment 1) and remained intact when attentional resources at encoding were reduced (Experiment 2), suggesting that context retrieval in false recognition is based on automatic processes that are not amenable to conscious control and do not require many attentional resources. This interpretation is consistent with the associative activation theory, which proposes that context retrieval in false recognition is based on memory associations between contexts and critical lures that are automatically created when critical lures become automatically activated via spreading activation process.

Menopause Status and Within-Group Differences in Chronological Age Affect the Functional Neural Correlates of Spatial Context Memory in Middle-Aged Females

Reductions in the ability to encode and retrieve past experiences in rich spatial contextual detail (episodic memory) are apparent by midlife-a time when most females experience spontaneous menopause. Yet, little is known about how menopause status affects episodic memory-related brain activity at encoding and retrieval in middle-aged premenopausal and postmenopausal females, and whether any observed group differences in brain activity and memory performance correlate with chronological age within group. We conducted an event-related task fMRI study of episodic memory for spatial context to address this knowledge gap. Multivariate behavioral partial least squares was used to investigate how chronological age and retrieval accuracy correlated with brain activity in 31 premenopausal females (age range, 39.55-53.30 years; mean age, 44.28 years; SD age, 3.12 years) and 41 postmenopausal females (age range, 46.70-65.14 years; mean age, 57.56 years; SD age, 3.93 years). We found that postmenopausal status, and advanced age within postmenopause, was associated with lower spatial context memory. The fMRI analysis showed that only in postmenopausal females, advanced age was correlated with decreased activity in occipitotemporal, parahippocampal, and inferior parietal cortices during encoding and retrieval, and poorer spatial context memory performance. In contrast, only premenopausal females exhibited an overlap in encoding and retrieval activity in angular gyrus, midline cortical regions, and prefrontal cortex, which correlated with better spatial context retrieval accuracy. These results highlight how menopause status and chronological age, nested within menopause group, affect episodic memory and its neural correlates at midlife.SIGNIFICANCE STATEMENT This is the first fMRI study to examine how premenopause and postmenopause status affect the neural correlates of episodic memory encoding and retrieval, and how chronological age contributes to any observed group similarities and differences. We found that both menopause status (endocrine age) and chronological age affect spatial context memory and its neural correlates. Menopause status directly affected the direction of age-related and performance-related correlations with brain activity in inferior parietal, parahippocampal, and occipitotemporal cortices across encoding and retrieval. Moreover, we found that only premenopausal females exhibited cortical reinstatement of encoding-related activity in midline cortical, prefrontal, and angular gyrus, at retrieval. This suggests that spatial context memory abilities may rely on distinct brain systems at premenopause compared with postmenopause.

Recollection and prior knowledge recruit the left angular gyrus during recognition

The human angular gyrus (AG) is implicated in recollection, or the ability to retrieve detailed memory content from a specific episode. A separate line of research examining the neural bases of more general mnemonic representations, extracted over multiple episodes, also highlights the AG as a core region of interest. To reconcile these separate views of AG function, the present fMRI experiment used a Remember-Know paradigm with famous (prior knowledge) and non-famous (no prior knowledge) faces to test whether AG activity could be modulated by both task-specific recollection and general prior knowledge within the same individuals. Increased BOLD activity in the left AG was observed during both recollection in the absence of prior knowledge (recollected > non-recollected or correctly rejected non-famous faces) and when prior knowledge was accessed in the absence of experiment-specific recollection (famous > non-famous correct rejections). This pattern was most prominent for the left AG as compared to the broader inferior parietal lobe. Recollection-related responses in the left AG increased with encoding duration and prior knowledge, despite prior knowledge being incidental to the recognition decision. Overall, the left AG appears sensitive to both task-specific recollection and the incidental access of general prior knowledge, thus broadening our notions of the kinds of mnemonic representations that drive activity in this region.

Age- and Episodic Memory-related Differences in Task-based Functional Connectivity in Women and Men

Aging is associated with episodic memory decline and changes in functional brain connectivity. Understanding whether and how biological sex influences age- and memory performance-related functional connectivity has important theoretical implications for the cognitive neuroscience of memory and aging. Here, we scanned 161 healthy adults between 19 and 76 years of age in an event-related fMRI study of face-location spatial context memory. Adults were scanned while performing easy and difficult versions of the task at both encoding and retrieval. We used multivariate whole-brain partial least squares connectivity to test the hypothesis that there are sex differences in age- and episodic memory performance-related functional connectivity. We examined how individual differences in age and retrieval accuracy correlated with task-related connectivity. We then repeated this analysis after disaggregating the data by self-reported sex. We found that increased encoding and retrieval-related connectivity within the dorsal attention network (DAN), and between DAN and frontoparietal network and visual networks, were positively correlated to retrieval accuracy and negatively correlated with age in both sexes. We also observed sex differences in age- and performance-related functional connectivity: (a) Greater between-networks integration was apparent at both levels of task difficulty in women only, and (b) increased DAN-default mode network connectivity with age was observed in men and was correlated with poorer memory performance. Therefore, the neural correlates of age-related episodic memory decline differ in women and men and have important theoretical and clinical implications for the cognitive neuroscience of memory, aging, and dementia prevention.

Neural reactivation and judgements of vividness reveal separable contributions to mnemonic representation

Mnemonic representations vary in fidelity, sharpness, and strength-qualities that can be examined using both introspective judgements of mental states and objective measures of brain activity. Subjective and objective measures are both valid ways of "reading out" the content of someone's internal mnemonic states, each with different strengths and weaknesses. St-Laurent and colleagues (2015) compared the neural correlates of memory vividness ratings with patterns of neural reactivation evoked during memory recall and found considerable overlap between the two, suggesting a common neural basis underlying these different markers of representational quality. Here we extended this work with meta-analytic methods by pooling together four neuroimaging datasets in order to contrast the neural substrates of neural reactivation and those of vividness judgements. While reactivation and vividness judgements correlated positively with one another and were associated with common univariate activity in the dorsal attention network and anterior hippocampus, some notable differences were also observed. Vividness judgments were tied to stronger activation in the striatum and dorsal attention network, together with activity suppression in default mode network nodes. We also observed a trend for reactivation to be more closely associated with early visual cortex activity. A mediation analysis found support for the hypothesis that neural reactivation is necessary for memory vividness, with activity in the anterior hippocampus associated with greater reactivation. Our results suggest that neural reactivation and vividness judgements reflect common mnemonic processes but differ in the extent to which they engage effortful, attentional processes. Additionally, the similarity between reactivation and vividness appears to arise, partly, through hippocampal engagement during memory retrieval.

Divided attention at retrieval does not influence neural correlates of recollection in young or older adults

Age-related decline in episodic memory has been partially attributed to older adults' reduced domain general processing resources. In the present study, we examined the effects of divided attention (DA) - a manipulation assumed to further deplete the already limited processing resources of older adults - on the neural correlates of recollection in young and older adults. Participants underwent fMRI scanning while they performed an associative recognition test in single and dual (tone detection) task conditions. Recollection effects were operationalized as greater BOLD activity elicited by test pairs correctly endorsed as 'intact' than pairs correctly or incorrectly endorsed as 'rearranged'. Detrimental effects of DA on associative recognition performance were identified in older but not young adults. The magnitudes of recollection effects did not differ between the single and dual (tone detection) tasks in either age group. Across the task conditions, age-invariant recollection effects were evident in most members of the core recollection network. However, while young adults demonstrated robust recollection effects in left angular gyrus, angular gyrus effects were undetectable in the older adults in either task condition. With the possible exception of this result, the findings suggest that DA did not influence processes supporting the retrieval and representation of associative information in either young or older adults, and converge with prior behavioral findings to suggest that episodic retrieval operations are little affected by DA.

The effects of age on neural correlates of recognition memory: An fMRI study

Studies examining the effects of age on the neural correlates of recognition memory have yielded mixed results. In the present study, we employed a modified remember-know paradigm to compare the fMRI correlates of recollection and familiarity in samples of healthy young and older adults. After studying a series of words, participants underwent fMRI scanning during a test phase in which they responded "remember" to a test word if any qualitative information could be recollected about the study event. When recollection failed, participants signaled how confident they were that the test item had been studied. Young and older adults demonstrated statistically equivalent estimates of recollection and familiarity strength, while recognition memory accuracy was significantly lower in the older adults. Robust, age-invariant fMRI effects were evident in two sets of a priori defined brain regions consistently reported in prior studies to be sensitive to recollection and familiarity respectively. In addition, the magnitudes of 'familiarity-attenuation effects' in perirhinal cortex demonstrated age-invariant correlations with estimates of familiarity strength and memory accuracy, replicating prior findings. Together, the present findings add to the evidence that the neural correlates of recognition memory are largely stable across much of the healthy human adult lifespan.

Distinct patterns of hippocampal activity associated with color and spatial source memory

The hippocampus is known to be involved in source memory across a wide variety of stimuli and source types. Thus, source memory activity in the hippocampus is thought to be domain-general such that different types of source information are similarly processed in the hippocampus. However, there is some evidence of domain-specificity for spatial and temporal source information. The current fMRI study aimed to determine whether patterns of activity in the hippocampus differed for two types of visual source information: spatial location and background color. Participants completed three runs of a spatial memory task and three runs of a color memory task. During the study phase, 32 line drawings of common objects and animals were presented to either the left or right of fixation for the spatial memory task or on either a red or green background for the color memory task. During the test phase of both tasks, 48 object word labels were presented in the center of the screen and participants classified the corresponding item as old and previously on the "left"/on a "green" background, old and previously on the "right"/on a "red" background, or "new." Two analysis methods were employed to assess whether hippocampal activity differed between the two source types: a general linear model analysis and a classification-based searchlight multivoxel pattern analysis (MVPA). The searchlight MVPA revealed that activity associated with spatial memory and color memory could be classified with above-chance accuracy in a region of the right anterior hippocampus, and a follow-up analysis revealed that there was a significant effect of memory accuracy. These results indicate that different types of source memory are represented by distinct patterns of activity in the hippocampus.

When the brain, but not the person, remembers: Cortical reinstatement is modulated by retrieval goal in developmental amnesia

Developmental amnesia (DA) is associated with early hippocampal damage and subsequent episodic amnesia emerging in childhood alongside age-appropriate development of semantic knowledge. We employed fMRI to assess whether patients with DA show evidence of 'cortical reinstatement', a neural correlate of episodic memory, despite their amnesia. At study, 23 participants (5 patients) were presented with words overlaid on a scene or a scrambled image for later recognition. Scene reinstatement was indexed by scene memory effects (greater activity for previously presented words paired with a scene rather than scrambled images) that overlapped with scene perception effects. Patients with DA demonstrated scene reinstatement effects in the parahippocampal and retrosplenial cortex that were equivalent to those shown by healthy controls. Behaviourally, however, patients with DA showed markedly impaired scene memory. The data indicate that reinstatement can occur despite hippocampal damage, but that cortical reinstatement is insufficient to support accurate memory performance. Furthermore, scene reinstatement effects were diminished during a retrieval task in which scene information was not relevant for accurate responding, indicating that strategic mnemonic processes operate normally in DA. The data suggest that cortical reinstatement of trial-specific contextual information is decoupled from the experience of recollection in the presence of severe hippocampal atrophy.

Reinstatement of item-specific contextual details during retrieval supports recombination-related false memories

Flexible retrieval mechanisms that allow us to infer relationships across events may also lead to memory errors or distortion when details of one event are misattributed to the related event. Here, we tested how making successful inferences alters representation of overlapping events, leading to false memories. Participants encoded overlapping associations ('AB' and 'BC'), each of which was superimposed on different indoor and outdoor scenes that were pre-exposed prior to associative learning. Participants were subsequently tested on both the directly learned pairs ('AB' and 'BC') and inferred relationships across pairs ('AC'). We predicted that when people make a correct inference, features associated with overlapping events may become integrated in memory. To test this hypothesis, participants completed a final detailed retrieval test, in which they had to recall the scene associated with initially learned 'AB' pairs (or 'BC' pairs). We found that the outcome of inference decisions impacted the degree to which neural patterns elicited during detailed 'AB' retrieval reflected reinstatement of the scene associated with the overlapping 'BC' event. After successful inference, neural patterns in the anterior hippocampus, posterior medial prefrontal cortex, and our content-reinstatement region (left inferior temporal gyrus) were more similar to the overlapping, yet incorrect 'BC' context relative to after unsuccessful inference. Further, greater hippocampal activity during inference was associated with greater reinstatement of the incorrect, overlapping context in our content-reinstatement region, which in turn tracked contextual misattributions during detailed retrieval. These results suggest recombining memories during successful inference can lead to misattribution of contextual details across related events, resulting in false memories.

Effects of age on goal-dependent modulation of episodic memory retrieval

Retrieval gating refers to the ability to modulate the retrieval of features of a single memory episode according to behavioral goals. Recent findings demonstrate that younger adults engage retrieval gating by attenuating the representation of task-irrelevant features of an episode. Here, we examine whether retrieval gating varies with age. Younger and older adults incidentally encoded words superimposed over scenes or scrambled backgrounds that were displayed in one of three spatial locations. Participants subsequently underwent fMRI as they completed two memory tasks: the background task, which tested memory for the word's background, and the location task, testing memory for the word's location. Employing univariate and multivariate approaches, we demonstrated that younger, but not older adults, exhibited attenuated reinstatement of scene information when it was goal-irrelevant (during the location task). Additionally, in younger adults only, the strength of scene reinstatement in the parahippocampal place area during the background task was related to item and source memory performance. Together, these findings point to an age-related decline in the ability to engage retrieval gating.

Hippocampal Theta Oscillations Support Successful Associative Memory Formation

Models of memory formation posit that episodic memory formation depends critically on the hippocampus, which binds features of an event to its context. For this reason, the contrast between study items that are later recollected with their associative pair versus those for which no association is made fails should reveal electrophysiological patterns in the hippocampus selectively involved in associative memory encoding. Extensive data from studies in rodents support a model in which theta oscillations fulfill this role, but results in humans have not been as clear. Here, we used an associative recognition memory procedure to identify hippocampal correlates of successful associative memory encoding and retrieval in patients (10 females and 9 males) undergoing intracranial EEG monitoring. We identified a dissociation between 2-5 Hz and 5-9 Hz theta oscillations, by which power increases in 2-5 Hz oscillations were uniquely linked with successful associative memory in both the anterior and posterior hippocampus. These oscillations exhibited a significant phase reset that also predicted successful associative encoding and distinguished recollected from nonrecollected items at retrieval, as well as contributing to relatively greater reinstatement of encoding-related patterns for recollected versus nonrecollected items. Our results provide direct electrophysiological evidence that 2-5 Hz hippocampal theta oscillations preferentially support the formation of associative memories, although we also observed memory-related effects in the 5-9 Hz frequency range using measures such as phase reset and reinstatement of oscillatory activity.SIGNIFICANCE STATEMENT Models of episodic memory encoding predict that theta oscillations support the formation of interitem associations. We used an associative recognition task designed to elicit strong hippocampal activation to test this prediction in human neurosurgical patients implanted with intracranial electrodes. The findings suggest that 2-5 Hz theta oscillatory power and phase reset in the hippocampus are selectively associated with associative memory judgments. Furthermore, reinstatement of oscillatory patterns in the hippocampus was stronger for successful recollection. Collectively, the findings support a role for hippocampal theta oscillations in human associative memory.

The neural correlates of context retrieval in false recognition

Previous research has demonstrated that some false recognitions are accompanied by retrieval of contexts in which the corresponding semantic associates were presented during the study phase. What kind of neural processes support context retrieval in false recognition? Using functional MRI (fMRI), we tested the hypothesis that context retrieval in false recognition might be supported by brain areas in the core recollection network which also support context retrieval in true recognition. During the study, lists of semantically associated words were presented together with scene pictures that served as contexts. During test, participants judged whether the presented word was old or new. If old, they judged which scene picture was its context and rated memory strength for the context. The results revealed that several regions in the core recollection network, including the bilateral hippocampus, left angular gyrus, and left anterior cingulate cortex, showed greater activations for true recognitions with strong context memory than those with weak context memory. More importantly, these same regions also showed greater activations for false recognitions with strong context memory than those with weak context memory. These findings helped account for why some false recognitions are vivid and accompanied by retrieval of context.

No evidence for an effect of explicit relevance instruction on consolidation of associative memories

Newly encoded memories are stabilized over time through a process or a set of processes termed consolidation, which happens preferentially during sleep. However, not all memories profit equally from this offline stabilization. Previous research suggested that one factor, which determines whether a memory will benefit from sleep consolidation, is future relevance. The aim of our current study was to replicate these findings and expand them to investigate their neural underpinnings. In our experiment, 38 participants learned two sets of object-location associations. The two sets of stimuli were presented to each participant intermixed and in random order. After study, participants performed a baseline retention test and were thereafter instructed that, after a delay containing sleep, they would be tested and rewarded only on one of the two sets of stimuli. This relevance instruction was revoked, however, immediately before the test. Thus, this manipulation affected memory consolidation while having no influence on encoding and retrieval. This retention interval was monitored via actigraphy recordings. While the study session was purely behavioral, the test session was conducted in an MRI scanner, thus we collected neuroimaging data at retrieval of relevant compared with non-relevant items. Behaviorally, we found no effect of the relevance manipulation on memory retention, confidence rating, or reaction time. At a neural level, no effect of relevance on memory retrieval-related brain operations was observed. Contrary to our expectations, the relevance manipulation did not result in improved consolidation, nor in improved subsequent performance at retrieval. These findings challenge previously published results and suggest that future relevance as manipulated here may not be sufficient to produce enhanced memory consolidation.

Age differences in the neural correlates of the specificity of recollection: An event-related potential study

In young adults, the neural correlates of successful recollection vary with the specificity (or amount) of information retrieved. We examined whether the neural correlates of recollection are modulated in a similar fashion in older adults. We compared event-related potential (ERP) correlates of recollection in samples of healthy young and older adults (N = 20 per age group). At study, participants were cued to make one of two judgments about each of a series of words. Subsequently, participants completed a memory test for studied and unstudied words in which they first made a Remember/Know/New (RKN) judgment, followed by a source memory judgment when a word attracted a 'Remember' (R) response. In young adults, the 'left parietal effect' - a putative ERP correlate of successful recollection - was largest for test items endorsed as recollected (R judgment) and attracting a correct source judgment, intermediate for items endorsed as recollected but attracting an incorrect or uncertain source judgment, and, relative to correct rejections, absent for items endorsed as familiar only (K judgment). In marked contrast, the left parietal effect was not detectable in older adults. Rather, regardless of source accuracy, studied items attracting an R response elicited a sustained, centrally maximum negative-going deflection relative to both correct rejections and studied items where recollection failed (K judgment). A similar retrieval-related negativity has been described previously in older adults, but the present findings are among the few to link this effect specifically to recollection. Finally, relative to correct rejections, all classes of correctly recognized old items elicited an age-invariant, late-onsetting positive deflection that was maximal over the right frontal scalp. This finding, which replicates several prior results, suggests that post-retrieval monitoring operations were engaged to an equivalent extent in the two age groups. Together, the present results suggest that there are circumstances where young and older adults engage qualitatively distinct retrieval-related processes during successful recollection.

Neural correlates of retrieval-based enhancement of autobiographical memory in older adults

Lifelog photo review is considered to enhance the recall of personal events. While a sizable body of research has explored the neural basis of autobiographical memory (AM), there is limited neural evidence on the retrieval-based enhancement effect on event memory among older adults in the real-world environment. This study examined the neural processes of AM as was modulated by retrieval practice through lifelog photo review in older adults. In the experiment, blood-oxygen-level dependent response during subjects’ recall of recent events was recorded, where events were cued by photos that may or may not have been exposed to a priori retrieval practice (training). Subjects remembered more episodic details under the trained relative to non-trained condition. Importantly, the neural correlates of AM was exhibited by (1) dissociable cortical areas related to recollection and familiarity, and (2) a positive correlation between the amount of recollected episodic details and cortical activation within several lateral temporal and parietal regions. Further analysis of the brain activation pattern at a few regions of interest within the core remember network showed a training_condition × event_detail interaction effect, suggesting that the boosting effect of retrieval practice depended on the level of recollected event details.

The core episodic simulation network dissociates as a function of subjective experience and objective content

Episodic simulation - the mental construction of a possible future event - has been consistently associated with enhanced activity in a set of neural regions referred to as the core network. In the current functional neuroimaging study, we assessed whether members of the core network are differentially associated with the subjective experience of future events (i.e., vividness) versus the objective content comprising those events (i.e., the amount of episodic details). During scanning, participants imagined future events in response to object cues. On each trial, participants rated the subjective vividness associated with each future event. Participants completed a post-scan interview where they viewed each object cue from the scanner and verbally reported whatever they had thought about. For imagined events, we quantified the number of episodic or internal details in accordance with the Autobiographical Interview (i.e., who, what, when, and where details of each central event). To test whether core network regions are differentially associated with subjective experience or objective episodic content, imagined future events were sorted as a function of their rated vividness or the amount of episodic detail. Univariate analyses revealed that some regions of the core network were uniquely sensitive to the vividness of imagined future events, including the hippocampus (i.e., high > low vividness), whereas other regions, such as the lateral parietal cortex, were sensitive to the amount of episodic detail in the event (i.e., high > low episodic details). The present results indicate that members of the core network support distinct episodic simulation-related processes.

Activation of stimulus-specific processing regions at retrieval tracks the strength of relational memory

Many theories of episodic memory posit that the subjective experience of recollection may be driven by the activation of stimulus-specific cortical regions during memory retrieval. This study examined cortical activation during associative memory retrieval to identify brain regions that support confidence judgments of source memory in stimulus-specific ways. Adjectives were encoded with either a picture of a face or a scene. During a source memory test, the word was presented alone and the participant was asked if the word had been previously paired with a face or a scene. We identified brain regions that were selectively active when viewing pictures of scenes or faces with a separate localizer scan. We then identified brain regions that were differentially activated to words during the source memory test that had been previously paired with faces or scenes, masked by the localizer activations, and examined how those regions were modulated by the strength of the source memory. Bilateral amygdala activation tracked source memory confidence for faces, while parahippocampal cortex tracked source memory confidence for scenes. The magnitude of the activation of these domain-specific perceptual-processing brain regions during memory retrieval may contribute to the subjective strength of episodic recollection.

Holistic Recollection via Pattern Completion Involves Hippocampal Subfield CA3

Episodic memories typically comprise multiple elements. A defining characteristic of episodic retrieval is holistic recollection, i.e., comprehensive recall of the elements a memorized event encompasses. A recent study implicated activity in the human hippocampus with holistic recollection of multi-element events based on cues (Horner et al., 2015). Here, we obtained ultra-high resolution functional neuroimaging data at 7 tesla in 30 younger adults (12 female) using the same paradigm. In accordance with anatomically inspired computational models and animal research, we found that metabolic activity in hippocampal subfield CA3 (but less pronounced in dentate gyrus) correlated with this form of mnemonic pattern completion across participants. Our study provides the first evidence in humans for a strong involvement of hippocampal subfield CA3 in holistic recollection via pattern completion.

SIGNIFICANCE STATEMENT Memories of daily events usually involve multiple elements, although a single element can be sufficient to prompt recollection of the whole event. Such holistic recollection is thought to require reactivation of brain activity representing the full event from one event element (“pattern completion”). Computational and animal models suggest that mnemonic pattern completion is accomplished in a specific subregion of the hippocampus called CA3, but empirical evidence in humans was lacking. Here, we leverage the ultra-high resolution of 7 tesla neuroimaging to provide first evidence for a strong involvement of the human CA3 in holistic recollection of multi-element events via pattern completion.

Effects of age on across-participant variability of cortical reinstatement effects

Using functional magnetic resonance imaging data, we assessed whether across-participant variability of content-selective retrieval-related neural activity differs with age. We addressed this question by employing across-participant multi-voxel pattern analysis (MVPA), predicting that increasing age would be associated with reduced variability of retrieval-related cortical reinstatement across participants. During study, 24 young and 24 older participants viewed objects and concrete words. Test items comprised studied words, names of studied objects, and unstudied words. Participants judged whether the items were recollected, familiar, or new by making 'Remember', 'Know' and 'New' responses, respectively. MVPA was conducted on each region belonging to the 'core recollection network', dorsolateral prefrontal cortex, and a previously identified content-selective voxel set. A leave-one-participant-out classification approach was employed whereby a classifier was trained on a subset of participants and tested on the data from a yoked pair of held-out participants. Classifiers were trained on the study phase data to discriminate the study trials as a function of content (picture or word). The classifiers were then applied to the test phase data to discriminate studied test words according to their study condition. In all of the examined regions, classifier performance demonstrated little or no sensitivity to age and, for the test data, was robustly above chance. Thus, there was little evidence to support the hypothesis that across-participant variability of retrieval-related cortical reinstatement differs with age. The findings extend prior evidence by demonstrating that content-selective cortical reinstatement is sufficiently invariant to support across-participant multi-voxel classification across the healthy adult lifespan.

Gamma oscillations during episodic memory processing provide evidence for functional specialization in the longitudinal axis of the human hippocampus

The question of whether the anterior and posterior hippocampus serve different or complementary functional roles during episodic memory processing has been motivated by noteworthy findings in rodent experiments and from noninvasive studies in humans. Researchers have synthesized these data to postulate several models of functional specialization, However, the issue has not been explored in detail using direct brain recordings. We recently published evidence that theta power increases during episodic memory encoding occur in the posterior hippocampus in humans. In our current investigation we analyzed an expanded data set of 32 epilepsy patients undergoing stereo EEG seizure mapping surgery with electrodes precisely targeted to the anterior and posterior hippocampus simultaneously who performed an episodic memory task. Using a repeated measures design, we looked for an interaction between encoding versus retrieval differences in gamma oscillatory power and anterior versus posterior hippocampal location. Our findings are consistent with a recently articulated model (the HERNET model) favoring posterior hippocampal activation during retrieval related processing. We also tested for encoding versus retrieval differences in the preferred gamma frequency band (high versus low gamma oscillations) motivated by published rodent data.

An ERP study of multidimensional source retrieval in depression

We collected event-related potentials (ERPs) from 24 unmedicated adults with Major Depressive Disorder (MDD) and 24 controls during source memory retrieval. Words were encoded on the left or right during animacy and mobility judgments. Mobility judgments were slower than animacy judgments, suggesting deeper encoding. Participants then recalled the encoding judgment (Question cue) and position (Side cue) for each word. Depressed adults, but not controls, showed better accuracy for words from the mobility task presented under the Question vs. Side Cue. Furthermore, depressed adults showed larger left parietal ERPs to words from the mobility task presented under the Question vs. the Side Cue from 400 to 800 ms and 800-1400 ms. This ERP effect was negatively correlated with sleep quality. Thus, deep encoding followed by retrieval of the encoding judgment supported memory in MDD and augmented left parietal ERPs that have been linked to recollection and that appear sensitive to sleep disturbance.

Oscillatory Reinstatement Enhances Declarative Memory

Declarative memory recall is thought to involve the reinstatement of neural activity patterns that occurred previously during encoding. Consistent with this view, greater similarity between patterns of activity recorded during encoding and retrieval has been found to predict better memory performance in a number of studies. Recent models have argued that neural oscillations may be crucial to reinstatement for successful memory retrieval. However, to date, no causal evidence has been provided to support this theory, nor has the impact of oscillatory electrical brain stimulation during encoding and retrieval been assessed. To explore this we used transcranial alternating current stimulation over the left dorsolateral prefrontal cortex of human participants [n = 70, 45 females; age mean (SD) = 22.12 (2.16)] during a declarative memory task. Participants received either the same frequency during encoding and retrieval (60–60 or 90–90 Hz) or different frequencies (60–90 or 90–60 Hz). When frequencies matched there was a significant memory improvement (at both 60 and 90 Hz) relative to sham stimulation. No improvement occurred when frequencies mismatched. Our results provide support for the role of oscillatory reinstatement in memory retrieval.

SIGNIFICANCE STATEMENT Recent neurobiological models of memory have argued that large-scale neural oscillations are reinstated to support successful memory retrieval. Here we used transcranial alternating current stimulation (tACS) to test these models. tACS has recently been shown to induce neural oscillations at the frequency stimulated. We stimulated over the left dorsolateral prefrontal cortex during a declarative memory task involving learning a set of words. We found that tACS applied at the same frequency during encoding and retrieval enhances memory. We also find no difference between the two applied frequencies. Thus our results are consistent with the proposal that reinstatement of neural oscillations during retrieval supports successful memory retrieval.

Ventral lateral parietal cortex and episodic memory retrieval

With the advent of functional neuroimaging it quickly became apparent that successful episodic memory retrieval was consistently associated with enhanced activity in ventral lateral parietal cortex (VLPC), especially the left angular gyrus. Here, we selectively review recent neuropsychological and functional neuroimaging evidence relevant to the question of the functional significance of this activity. We argue that the balance of the evidence suggests that the angular gyrus supports the representation of retrieved episodic information, and that this likely reflects a more general role for the region in representing multi-modal and multi-domain information.

The effect of focal cortical frontal and posterior lesions on recollection and familiarity in recognition memory

Recognition memory can be subdivided into two processes: recollection (a contextually rich memory) and familiarity (a sense that an item is old). The brain network supporting recognition encompasses frontal, parietal and medial temporal regions. Which specific regions within the frontal lobe are critical for recollection vs. familiarity, however, are unknown; past studies of focal lesion patients have yielded conflicting results. We examined patients with focal lesions confined to medial polar (MP), right dorsal frontal (RDF), right frontotemporal (RFT), left dorsal frontal (LDF), temporal, and parietal regions and matched controls. A series of words and their humorous definitions were presented either auditorily or visually to all participants. Recall, recognition, and source memory were tested at 30 min and 24 h delay, along with "remember/know" judgments for recognized items. The MP, RDF, temporal and parietal groups were impaired on subjectively reported recollection; their intact recognition performance was supported by familiarity. None of the groups were impaired on cued recall, recognition familiarity or source memory. These findings suggest that the MP and RDF regions, along with parietal and temporal regions, are necessary for subjectively-reported recollection, while the LDF and right frontal ventral regions, as those affected in the RTF group, are not.

Modulation of Oscillatory Power and Connectivity in the Human Posterior Cingulate Cortex Supports the Encoding and Retrieval of Episodic Memories

Existing data from noninvasive studies have led researchers to posit that the posterior cingulate cortex (PCC) supports mnemonic processes: It exhibits degeneration in memory disorders, and fMRI investigations have demonstrated memory-related activation principally during the retrieval of memory items. Despite these data, the role of the PCC in episodic memory has received only limited treatment using the spatial and temporal precision of intracranial EEG, with previous analyses focused on item retrieval. Using data gathered from 21 human participants who underwent stereo-EEG for seizure localization, we characterized oscillatory patterns in the PCC during the encoding and retrieval of episodic memories. We identified a subsequent memory effect during item encoding characterized by increased gamma band oscillatory power and a low-frequency power desynchronization. Fourteen participants had stereotactic electrodes located simultaneously in the hippocampus and PCC, and with these unique data, we describe connectivity changes between these structures that predict successful item encoding and that precede item retrieval. Oscillatory power during retrieval matched the pattern we observed during encoding, with low-frequency (below 15 Hz) desynchronization and a gamma band (especially high gamma, 70-180 Hz) power increase. Encoding is characterized by synchrony between the hippocampus and PCC, centered at 3 Hz, consistent with other observations of properties of this oscillation akin to those for rodent theta activity. We discuss our findings in light of existing theories of episodic memory processing, including the information via desynchronization hypothesis and retrieved context theory, and examine how our data fit with existing theories for the functional role of the PCC. These include a postulated role for the PCC in modulating internally directed attention and for representing or integrating contextual information for memory items.

Imagining the future: The core episodic simulation network dissociates as a function of timecourse and the amount of simulated information

Neuroimaging data indicate that episodic memory (i.e., remembering specific past experiences) and episodic simulation (i.e., imagining specific future experiences) are associated with enhanced activity in a common set of neural regions, often referred to as the core network. This network comprises the hippocampus, parahippocampal cortex, lateral and medial parietal cortex, lateral temporal cortex, and medial prefrontal cortex. Evidence for a core network has been taken as support for the idea that episodic memory and episodic simulation are supported by common processes. Much remains to be learned about how specific core network regions contribute to specific aspects of episodic simulation. Prior neuroimaging studies of episodic memory indicate that certain regions within the core network are differentially sensitive to the amount of information recollected (e.g., the left lateral parietal cortex). In addition, certain core network regions dissociate as a function of their timecourse of engagement during episodic memory (e.g., transient activity in the posterior hippocampus and sustained activity in the left lateral parietal cortex). In the current study, we assessed whether similar dissociations could be observed during episodic simulation. We found that the left lateral parietal cortex modulates as a function of the amount of simulated details. Of particular interest, while the hippocampus was insensitive to the amount of simulated details, we observed a temporal dissociation within the hippocampus: transient activity occurred in relatively posterior portions of the hippocampus and sustained activity occurred in anterior portions. Because the posterior hippocampal and lateral parietal findings parallel those observed during episodic memory, the present results add to the evidence that episodic memory and episodic simulation are supported by common processes. Critically, the present study also provides evidence that regions within the core network support dissociable processes.

Decoding the content of recollection within the core recollection network and beyond

Recollection - retrieval of qualitative information about a past event - is associated with enhanced neural activity in a consistent set of neural regions (the 'core recollection network') seemingly regardless of the nature of the recollected content. Here, we employed multi-voxel pattern analysis (MVPA) to assess whether retrieval-related functional magnetic resonance imaging (fMRI) activity in core recollection regions - including the hippocampus, angular gyrus, medial prefrontal cortex, retrosplenial/posterior cingulate cortex, and middle temporal gyrus - contain information about studied content and thus demonstrate retrieval-related 'reinstatement' effects. During study, participants viewed objects and concrete words that were subjected to different encoding tasks. Test items included studied words, the names of studied objects, or unstudied words. Participants judged whether the items were recollected, familiar, or new by making 'remember', 'know', and 'new' responses, respectively. The study history of remembered test items could be reliably decoded using MVPA in most regions, as well as from the dorsolateral prefrontal cortex, a region where univariate recollection effects could not be detected. The findings add to evidence that members of the core recollection network, as well as at least one neural region where mean signal is insensitive to recollection success, carry information about recollected content. Importantly, the study history of recognized items endorsed with a 'know' response could be decoded with equal accuracy. The results thus demonstrate a striking dissociation between mean signal and multi-voxel indices of recollection. Moreover, they converge with prior findings in suggesting that, as it is operationalized by classification-based MVPA, reinstatement is not uniquely a signature of recollection.

Medial temporal lobe reinstatement of content-specific details predicts source memory

Leading theories propose that when remembering past events, medial temporal lobe (MTL) structures reinstate the neural patterns that were active when those events were initially encoded. Accurate reinstatement is hypothesized to support detailed recollection of memories, including their source. While several studies have linked cortical reinstatement to successful retrieval, indexing reinstatement within the MTL network and its relationship to memory performance has proved challenging. Here, we addressed this gap in knowledge by having participants perform an incidental encoding task, during which they visualized people, places, and objects in response to adjective cues. During a surprise memory test, participants saw studied and novel adjectives and indicated the imagery task they performed for each adjective. A multivariate pattern classifier was trained to discriminate the imagery tasks based on functional magnetic resonance imaging (fMRI) responses from hippocampus and MTL cortex at encoding. The classifier was then tested on MTL patterns during the source memory task. We found that MTL encoding patterns were reinstated during successful source retrieval. Moreover, when participants made source misattributions, errors were predicted by reinstatement of incorrect source content in MTL cortex. We further observed a gradient of content-specific reinstatement along the anterior-posterior axis of hippocampus and MTL cortex. Within anterior hippocampus, we found that reinstatement of person content was related to source memory accuracy, whereas reinstatement of place information across the entire hippocampal axis predicted correct source judgments. Content-specific reinstatement was also graded across MTL cortex, with PRc patterns evincing reactivation of people and more posterior regions, including PHc, showing evidence for reinstatement of places and objects. Collectively, these findings provide key evidence that source recollection relies on reinstatement of past experience within the MTL network.

Simulation-based mentalizing generates a "proxy" self-reference effect in memory

The self-reference effect (SRE) in memory is thought to depend on specialized mechanisms that enhance memory for self-relevant information. We investigated whether these mechanisms can be engaged "by proxy" when we simulate other people, by asking participants to interact with two virtual partners: one similar and one dissimilar to self. Participants viewed pairs of objects and picked one for themselves, for their similar partner, or their dissimilar partner. A surprise memory test followed that required participants to identify which object of each pair was chosen, and for whom. Finally, participants were shown both partners' object pairs again, and asked to indicate their personal preference. Four key findings were observed. Overlap between participants' own choice and those made for their partner was significantly higher for the similar than the dissimilar partner, revealing participants' use of their own preferences to simulate the similar partner. Recollection of chosen objects was significantly higher for self than for both partners and, critically, was significantly higher for similar than dissimilar partners. Source confusion between self and the similar partner was also higher. These findings suggest that self-reference by proxy enhances memory for non-self-relevant material, and we consider the theoretical implications for functional interpretation of the SRE.

Decoding fMRI Signatures of Real-world Autobiographical Memory Retrieval

Extant neuroimaging data implicate frontoparietal and medial-temporal lobe regions in episodic retrieval, and the specific pattern of activity within and across these regions is diagnostic of an individual's subjective mnemonic experience. For example, in laboratory-based paradigms, memories for recently encoded faces can be accurately decoded from single-trial fMRI patterns [Uncapher, M. R., Boyd-Meredith, J. T., Chow, T. E., Rissman, J., & Wagner, A. D. Goal-directed modulation of neural memory patterns: Implications for fMRI-based memory detection. Journal of Neuroscience, 35, 8531–8545, 2015; Rissman, J., Greely, H. T., & Wagner, A. D. Detecting individual memories through the neural decoding of memory states and past experience. Proceedings of the National Academy of Sciences, U.S.A., 107, 9849–9854, 2010]. Here, we investigated the neural patterns underlying memory for real-world autobiographical events, probed at 1- to 3-week retention intervals as well as whether distinct patterns are associated with different subjective memory states. For 3 weeks, participants (n = 16) wore digital cameras that captured photographs of their daily activities. One week later, they were scanned while making memory judgments about sequences of photos depicting events from their own lives or events captured by the cameras of others. Whole-brain multivoxel pattern analysis achieved near-perfect accuracy at distinguishing correctly recognized events from correctly rejected novel events, and decoding performance did not significantly vary with retention interval. Multivoxel pattern classifiers also differentiated recollection from familiarity and reliably decoded the subjective strength of recollection, of familiarity, or of novelty. Classification-based brain maps revealed dissociable neural signatures of these mnemonic states, with activity patterns in hippocampus, medial PFC, and ventral parietal cortex being particularly diagnostic of recollection. Finally, a classifier trained on previously acquired laboratory-based memory data achieved reliable decoding of autobiographical memory states. We discuss the implications for neuroscientific accounts of episodic retrieval and comment on the potential forensic use of fMRI for probing experiential knowledge.

Decisions about the past are guided by reinstatement of specific memories in the hippocampus and perirhinal cortex

When faced with a new challenge, we often reflect on related past experiences to guide our behavior. The ability to retrieve memories that overlap with current experience, a process known as pattern completion, is theorized as a critical function of the hippocampus. Although this view has influenced research for decades, there is little empirical support for hippocampal pattern completion to individual memory elements and its influence on behavior. We used pattern analysis of brain activity measured with functional magnetic resonance imaging to demonstrate that specific elements of past experiences are reinstated in the hippocampus, as well as perirhinal cortex (PRC), when making decisions about those experiences. Linking neural measures of specific memory reinstatement in the hippocampus and PRC to behavior with computational modeling revealed that reinstatement predicts the speed of memory-based decisions. Moreover, hippocampal activation during retrieval was selectively coupled to regions of occipito-temporal cortex that showed content-specific item reinstatement. These results provide evidence for hippocampal pattern completion and its role in the mechanisms of decision making.

Effect of emotional valence on retrieval-related recapitulation of encoding activity in the ventral visual stream

While prior work has shown greater retrieval-related reactivation in the ventral visual stream for emotional stimuli compared to neutral stimuli, the effects of valence on retrieval-related recapitulation of successful encoding processes (Dm effects) have yet to be investigated. Here, seventeen participants (aged 19-35) studied line drawings of negative, positive, or neutral images followed immediately by the complete photo. After a 20-min delay, participants performed a challenging recognition memory test, distinguishing the studied line drawing outlines from novel ones. First, results replicated earlier work by demonstrating that negative and positive hits elicited greater ventral occipito-temporal cortex (VOTC) activity than neutral hits during both encoding and retrieval. Moreover, the amount of activation in portions of the VOTC correlated with the magnitude of participants' emotional memory enhancement. Second, results revealed significant retrieval-related recapitulation of Dm effects (Hits>Misses) in VOTC (anterior inferior temporal gyri) only for negative stimuli. Third, connectivity between the amygdala and fusiform gyrus during the encoding of negative stimuli increased the likelihood of fusiform activation during successful retrieval. Together, these results suggest that recapitulation in posterior VOTC reflects memory for the affective dimension of the stimuli (Emotional Hits>Neutral Hits) and the magnitude of activation in some of these regions is related to superior emotional memory. Moreover, for negative stimuli, recapitulation in more anterior portions of the VOTC is greater for remembered than forgotten items. The current study offers new evidence for effects of emotion on recapitulation of activity and functional connectivity in support of memory.