Pattern reactivation co-varies with activity in the core recollection network during source memory

The effects of forewarning and divided attention on context retrieval in false recognition

After studying a list of words that are semantically associated to a critical lure, participants are more likely to attribute a falsely recognised critical lure to the context of its strong than weak semantic associates. This is known as the source-strength effect. The current study investigated the roles of automatic and controlled processing in context retrieval in false recognition that is demonstrated by the source-strength effect. The results revealed that the source-strength effect was impervious to forewarning (Experiment 1) and remained intact when attentional resources at encoding were reduced (Experiment 2), suggesting that context retrieval in false recognition is based on automatic processes that are not amenable to conscious control and do not require many attentional resources. This interpretation is consistent with the associative activation theory, which proposes that context retrieval in false recognition is based on memory associations between contexts and critical lures that are automatically created when critical lures become automatically activated via spreading activation process.

Menopause Status and Within-Group Differences in Chronological Age Affect the Functional Neural Correlates of Spatial Context Memory in Middle-Aged Females

Reductions in the ability to encode and retrieve past experiences in rich spatial contextual detail (episodic memory) are apparent by midlife-a time when most females experience spontaneous menopause. Yet, little is known about how menopause status affects episodic memory-related brain activity at encoding and retrieval in middle-aged premenopausal and postmenopausal females, and whether any observed group differences in brain activity and memory performance correlate with chronological age within group. We conducted an event-related task fMRI study of episodic memory for spatial context to address this knowledge gap. Multivariate behavioral partial least squares was used to investigate how chronological age and retrieval accuracy correlated with brain activity in 31 premenopausal females (age range, 39.55-53.30 years; mean age, 44.28 years; SD age, 3.12 years) and 41 postmenopausal females (age range, 46.70-65.14 years; mean age, 57.56 years; SD age, 3.93 years). We found that postmenopausal status, and advanced age within postmenopause, was associated with lower spatial context memory. The fMRI analysis showed that only in postmenopausal females, advanced age was correlated with decreased activity in occipitotemporal, parahippocampal, and inferior parietal cortices during encoding and retrieval, and poorer spatial context memory performance. In contrast, only premenopausal females exhibited an overlap in encoding and retrieval activity in angular gyrus, midline cortical regions, and prefrontal cortex, which correlated with better spatial context retrieval accuracy. These results highlight how menopause status and chronological age, nested within menopause group, affect episodic memory and its neural correlates at midlife.SIGNIFICANCE STATEMENT This is the first fMRI study to examine how premenopause and postmenopause status affect the neural correlates of episodic memory encoding and retrieval, and how chronological age contributes to any observed group similarities and differences. We found that both menopause status (endocrine age) and chronological age affect spatial context memory and its neural correlates. Menopause status directly affected the direction of age-related and performance-related correlations with brain activity in inferior parietal, parahippocampal, and occipitotemporal cortices across encoding and retrieval. Moreover, we found that only premenopausal females exhibited cortical reinstatement of encoding-related activity in midline cortical, prefrontal, and angular gyrus, at retrieval. This suggests that spatial context memory abilities may rely on distinct brain systems at premenopause compared with postmenopause.

Brain activity patterns underlying memory confidence

The primary aim of this review is to examine the brain activity patterns that are related to subjectively perceived memory confidence. We focus on the main brain regions involved in episodic memory: the medial temporal lobe (MTL), prefrontal cortex (PFC), and posterior parietal cortex (PPC), and relate activity in their subregions to memory confidence. How this brain activity in both the encoding and retrieval phase is related to (subsequent) memory confidence ratings will be discussed. Specifically, encoding related activity in MTL regions and ventrolateral PFC mainly shows a positive linear increase with subsequent memory confidence, while dorsolateral and ventromedial PFC activity show mixed patterns. In addition, encoding-related PPC activity seems to only have indirect effects on memory confidence ratings. Activity during retrieval in both the hippocampus and parahippocampal cortex increases with memory confidence, especially during high-confident recognition. Retrieval-related activity in the PFC and PPC show mixed relationships with memory confidence, likely related to post-retrieval monitoring and attentional processes, respectively. In this review, these MTL, PFC, and PPC activity patterns are examined in detail and related to their functional roles in memory processes. This insight into brain activity that underlies memory confidence is important for our understanding of brain-behaviour relations and memory-guided decision making.

Retrospective confidence judgments: Meta-analysis of functional magnetic resonance imaging studies

Confidence in our retrieved memories, that is, retrospective confidence, is a metamemory process we perform daily. There is an abundance of applied research focusing on the metamemory judgments and very diverse studies including a wide range of clinical populations. However, the neural correlates that support its functioning are not well defined impeding the implementation of noninvasive neuromodulatory clinical interventions. To address the neural basis of metamemory judgments, we ran a meta‐analysis, where we used the activation likelihood estimation method on the 19 eligible functional magnetic resonance imaging studies. The main analysis of retrospective confidence revealed concordant bilateral activation in the parahippocampal gyrus, left middle frontal gyrus, and right amygdala. We also run an analysis between the two extreme levels of confidence, namely, high and low. This additional analysis was exploratory, since the minimum amount of articles reporting these two levels was not reached. Activations for the exploratory high > low confidence subtraction analysis were the same as observed in the main analysis on retrospective confidence, whereas the exploratory low > high subtraction showed distinctive activations of the right precuneus. The involvement of the right precuneus emphasizes its role in the evaluation of low confidence memories, as suggested by previous studies. Overall, our study contributes to a better understanding of the specific brain structures involved in confidence evaluations. Better understanding of the neural basis of metamemory might eventually lead to designing more precise neuromodulatory interventions, significantly improving treatment of patients suffering from metamemory problems.

Imaging recollection, familiarity, and novelty in the frontoparietal control and default mode networks and the anterior-posterior medial temporal lobe: An integrated view and meta-analysis

A network-level model of recollection-based recognition (R), familiarity-based recognition (F), and novelty recognition (N) was constructed, and its validity was evaluated through meta-analyses to produce an integrated view of neuroimaging data. The model predicted the following: (a) the overall magnitude of the frontoparietal control network (FPCN) activity (which supports retrieval and decision effort) is in the order of F > R > N; (b) that of the posterior medial temporal network (MTL) activity (which plays a direct role in retrieval) is in the order of R > N > F; (c) that of the anterior MTL activity (which supports novelty-encoding) is in the order of N > R > F; (d) that of the default mode network (DMN) activity (which supports the subjective experience of remembering) is in the order of R > N > F. The meta-analyses results were consistent with these predictions. Subsystem analysis indicated a functional dissociation between the cingulo-opercular vs. frontoparietal components of the FPCN and between the core vs. medial temporal components of the DMN.

The neural correlates of context retrieval in false recognition

Previous research has demonstrated that some false recognitions are accompanied by retrieval of contexts in which the corresponding semantic associates were presented during the study phase. What kind of neural processes support context retrieval in false recognition? Using functional MRI (fMRI), we tested the hypothesis that context retrieval in false recognition might be supported by brain areas in the core recollection network which also support context retrieval in true recognition. During the study, lists of semantically associated words were presented together with scene pictures that served as contexts. During test, participants judged whether the presented word was old or new. If old, they judged which scene picture was its context and rated memory strength for the context. The results revealed that several regions in the core recollection network, including the bilateral hippocampus, left angular gyrus, and left anterior cingulate cortex, showed greater activations for true recognitions with strong context memory than those with weak context memory. More importantly, these same regions also showed greater activations for false recognitions with strong context memory than those with weak context memory. These findings helped account for why some false recognitions are vivid and accompanied by retrieval of context.

Deconstructing the Posterior Medial Episodic Network

Our ability to remember or imagine specific events involves the construction of complex mental representations, a process that engages cortical and hippocampal regions in a core posterior medial (PM) brain network. Existing theoretical approaches have described the overarching contributions of the PM network, but less is known about how episodic content is represented and transformed throughout this system. Here, we review evidence of key functional interactions among PM regions and their relation to the core cognitive operations and representations supporting episodic construction. Recent demonstrations of intranetwork functional diversity are integrated with existing accounts to inform a network-based model of episodic construction, in which PM regions flexibly share and manipulate event information to support the variable phenomenology of episodic memory and simulation.

Neural correlates of retrieval-based enhancement of autobiographical memory in older adults

Lifelog photo review is considered to enhance the recall of personal events. While a sizable body of research has explored the neural basis of autobiographical memory (AM), there is limited neural evidence on the retrieval-based enhancement effect on event memory among older adults in the real-world environment. This study examined the neural processes of AM as was modulated by retrieval practice through lifelog photo review in older adults. In the experiment, blood-oxygen-level dependent response during subjects’ recall of recent events was recorded, where events were cued by photos that may or may not have been exposed to a priori retrieval practice (training). Subjects remembered more episodic details under the trained relative to non-trained condition. Importantly, the neural correlates of AM was exhibited by (1) dissociable cortical areas related to recollection and familiarity, and (2) a positive correlation between the amount of recollected episodic details and cortical activation within several lateral temporal and parietal regions. Further analysis of the brain activation pattern at a few regions of interest within the core remember network showed a training_condition × event_detail interaction effect, suggesting that the boosting effect of retrieval practice depended on the level of recollected event details.

A systematic review of brain functional connectivity patterns involved in episodic and semantic memory

The study of functional connectivity and declarative memory has lately been focused on finding biomarkers of neuropsychological diseases. However, little is known about its patterns in healthy brains. Thus, in this systematic review we analyze and integrate the findings of 81 publications regarding functional connectivity (measured by fMRI during both task and resting-state) and semantic and episodic memory in healthy adults. Moreover, we discriminate and analyze the main areas and links found in specific memory phases (encoding, storage or retrieval) based on several criteria, such as time length, depth of processing, rewarding value of the information, vividness and amount or kind of details retrieved. There is a certain degree of overlap between the networks of episodic and semantic memory and between the encoding and retrieval stages. Although several differences are pointed out during the article, this calls to attention the need for further empirical studies that actively compare both types of memory, particularly using other baseline conditions apart from the traditional resting state. Indeed, the active involvement of the default mode network in both declarative memory and resting condition suggests the possibility that during rest there is an on-going memory processing. We find support for the 'attention to memory' hypothesis, the memory differentiation model and the appropriate transfer hypothesis, but some evidence is inconsistent with the traditional hub-and-spoke model.

Activation of stimulus-specific processing regions at retrieval tracks the strength of relational memory

Many theories of episodic memory posit that the subjective experience of recollection may be driven by the activation of stimulus-specific cortical regions during memory retrieval. This study examined cortical activation during associative memory retrieval to identify brain regions that support confidence judgments of source memory in stimulus-specific ways. Adjectives were encoded with either a picture of a face or a scene. During a source memory test, the word was presented alone and the participant was asked if the word had been previously paired with a face or a scene. We identified brain regions that were selectively active when viewing pictures of scenes or faces with a separate localizer scan. We then identified brain regions that were differentially activated to words during the source memory test that had been previously paired with faces or scenes, masked by the localizer activations, and examined how those regions were modulated by the strength of the source memory. Bilateral amygdala activation tracked source memory confidence for faces, while parahippocampal cortex tracked source memory confidence for scenes. The magnitude of the activation of these domain-specific perceptual-processing brain regions during memory retrieval may contribute to the subjective strength of episodic recollection.

Effects of amnesia on processing in the hippocampus and default mode network during a naturalistic memory task: A case study

Despite their severely impaired episodic memory, individuals with amnesia are able to comprehend ongoing events. Online representations of a current event are thought to be supported by a network of regions centred on the posterior midline cortex (PMC). By contrast, episodic memory is widely believed to be supported by interactions between the hippocampus and these cortical regions. In this MRI study, we investigated the encoding and retrieval of real life-like events (video clips) in a patient with severe amnesia likely resulting from a stroke to the right (and possibly the left) thalamus, and a group of 20 age-matched controls. Structural MRI revealed grey matter reductions in left hippocampus and left thalamus in comparison to controls. We first characterised the regions activated in the controls while they watched and retrieved the videos. There were no differences in activation between the patient and controls in any of the regions. We then identified a widespread network of brain regions, including the hippocampus, that were functionally connected with the PMC in controls. However, in the patient there was a specific reduction in functional connectivity between the PMC and a region of left hippocampus when both watching and attempting to retrieve the videos. A follow up analysis of the control group revealed that, when watching the videos, the functional connectivity between these two regions was correlated with memory performance. Taken together, these findings support the view that the interactions between the PMC and the hippocampus enable the encoding and retrieval of naturalistic events.

NEVER forget: negative emotional valence enhances recapitulation

A hallmark feature of episodic memory is that of "mental time travel," whereby an individual feels they have returned to a prior moment in time. Cognitive and behavioral neuroscience methods have revealed a neurobiological counterpart: Successful retrieval often is associated with reactivation of a prior brain state. We review the emerging literature on memory reactivation and recapitulation, and we describe evidence for the effects of emotion on these processes. Based on this review, we propose a new model: Negative Emotional Valence Enhances Recapitulation (NEVER). This model diverges from existing models of emotional memory in three key ways. First, it underscores the effects of emotion during retrieval. Second, it stresses the importance of sensory processing to emotional memory. Third, it emphasizes how emotional valence - whether an event is negative or positive - affects the way that information is remembered. The model specifically proposes that, as compared to positive events, negative events both trigger increased encoding of sensory detail and elicit a closer resemblance between the sensory encoding signature and the sensory retrieval signature. The model also proposes that negative valence enhances the reactivation and storage of sensory details over offline periods, leading to a greater divergence between the sensory recapitulation of negative and positive memories over time. Importantly, the model proposes that these valence-based differences occur even when events are equated for arousal, thus rendering an exclusively arousal-based theory of emotional memory insufficient. We conclude by discussing implications of the model and suggesting directions for future research to test the tenets of the model.

Effects of age on across-participant variability of cortical reinstatement effects

Using functional magnetic resonance imaging data, we assessed whether across-participant variability of content-selective retrieval-related neural activity differs with age. We addressed this question by employing across-participant multi-voxel pattern analysis (MVPA), predicting that increasing age would be associated with reduced variability of retrieval-related cortical reinstatement across participants. During study, 24 young and 24 older participants viewed objects and concrete words. Test items comprised studied words, names of studied objects, and unstudied words. Participants judged whether the items were recollected, familiar, or new by making 'Remember', 'Know' and 'New' responses, respectively. MVPA was conducted on each region belonging to the 'core recollection network', dorsolateral prefrontal cortex, and a previously identified content-selective voxel set. A leave-one-participant-out classification approach was employed whereby a classifier was trained on a subset of participants and tested on the data from a yoked pair of held-out participants. Classifiers were trained on the study phase data to discriminate the study trials as a function of content (picture or word). The classifiers were then applied to the test phase data to discriminate studied test words according to their study condition. In all of the examined regions, classifier performance demonstrated little or no sensitivity to age and, for the test data, was robustly above chance. Thus, there was little evidence to support the hypothesis that across-participant variability of retrieval-related cortical reinstatement differs with age. The findings extend prior evidence by demonstrating that content-selective cortical reinstatement is sufficiently invariant to support across-participant multi-voxel classification across the healthy adult lifespan.

Ventral lateral parietal cortex and episodic memory retrieval

With the advent of functional neuroimaging it quickly became apparent that successful episodic memory retrieval was consistently associated with enhanced activity in ventral lateral parietal cortex (VLPC), especially the left angular gyrus. Here, we selectively review recent neuropsychological and functional neuroimaging evidence relevant to the question of the functional significance of this activity. We argue that the balance of the evidence suggests that the angular gyrus supports the representation of retrieved episodic information, and that this likely reflects a more general role for the region in representing multi-modal and multi-domain information.

Remembering verbally-presented items as pictures: Brain activity underlying visual mental images in schizophrenia patients with visual hallucinations

BACKGROUND

Previous research suggests that visual hallucinations in schizophrenia consist of mental images mistaken for percepts due to failure of the reality-monitoring processes. However, the neural substrates that underpin such dysfunction are currently unknown. We conducted a brain imaging study to investigate the role of visual mental imagery in visual hallucinations.

METHOD

Twenty-three patients with schizophrenia and 26 healthy participants were administered a reality-monitoring task whilst undergoing an fMRI protocol. At the encoding phase, a mixture of pictures of common items and labels designating common items were presented. On the memory test, participants were requested to remember whether a picture of the item had been presented or merely its label.

RESULTS

Visual hallucination scores were associated with a liberal response bias reflecting propensity to erroneously remember pictures of the items that had in fact been presented as words. At encoding, patients with visual hallucinations differentially activated the right fusiform gyrus when processing the words they later remembered as pictures, which suggests the formation of visual mental images. On the memory test, the whole patient group activated the anterior cingulate and medial superior frontal gyrus when falsely remembering pictures. However, no differential activation was observed in patients with visual hallucinations, whereas in the healthy sample, the production of visual mental images at encoding led to greater activation of a fronto-parietal decisional network on the memory test.

CONCLUSIONS

Visual hallucinations are associated with enhanced visual imagery and possibly with a failure of the reality-monitoring processes that enable discrimination between imagined and perceived events.

Family history and APOE4 risk for Alzheimer's disease impact the neural correlates of episodic memory by early midlife

Episodic memory impairment is a consistent, pronounced deficit in pre-clinical stages of late-onset Alzheimer's disease (AD). Individuals with risk factors for AD exhibit altered brain function several decades prior to the onset of AD-related symptoms. In the current event-related fMRI study of spatial context memory we tested the hypothesis that middle-aged adults (MA; 40–58 yrs) with a family history of late onset AD (MA_+ FH), or a combined + FH and apolipoprotein E ε4 allele risk factors for AD (MA_{+ FH + APOE4}), will exhibit differences in encoding and retrieval-related brain activity, compared to − FH − APOE4 MA controls. We also hypothesized that the two at-risk MA groups will exhibit distinct patterns of correlation between brain activity and memory performance, compared to controls. To test these hypotheses we conducted multivariate task, and behavior, partial least squares analysis of fMRI data obtained during successful context encoding and retrieval. Our results indicate that even though there were no significant group differences in context memory performance, there were significant differences in brain activity and brain-behavior correlations involving the hippocampus, inferior parietal cortex, cingulate, and precuneus cortex in MA with AD risk factors, compared to controls. In addition, we observed that brain activity and brain-behavior correlations in anterior-medial PFC and in ventral visual cortex differentiated the two MA risk groups from each other, and from MA_controls. Our results indicate that functional differences in episodic memory-related regions are present by early midlife in adults with + FH and + APOE-4 risk factors for late onset AD, compared to middle-aged controls.

•

FMRI study of context memory in middle-aged adults (MA) with vs. without specific AD risk factors

•

MA with vs. without AD risk factors show different angular gyrus, cingulate and precuneus activity patterns.

•

MA with AD risk factors showed increased hippocampus activity at encoding, compared to controls.

•

Medial PFC and visual cortex function differentiated + FH vs. + APOE4 MA risk groups.

Decoding the content of recollection within the core recollection network and beyond

Recollection - retrieval of qualitative information about a past event - is associated with enhanced neural activity in a consistent set of neural regions (the 'core recollection network') seemingly regardless of the nature of the recollected content. Here, we employed multi-voxel pattern analysis (MVPA) to assess whether retrieval-related functional magnetic resonance imaging (fMRI) activity in core recollection regions - including the hippocampus, angular gyrus, medial prefrontal cortex, retrosplenial/posterior cingulate cortex, and middle temporal gyrus - contain information about studied content and thus demonstrate retrieval-related 'reinstatement' effects. During study, participants viewed objects and concrete words that were subjected to different encoding tasks. Test items included studied words, the names of studied objects, or unstudied words. Participants judged whether the items were recollected, familiar, or new by making 'remember', 'know', and 'new' responses, respectively. The study history of remembered test items could be reliably decoded using MVPA in most regions, as well as from the dorsolateral prefrontal cortex, a region where univariate recollection effects could not be detected. The findings add to evidence that members of the core recollection network, as well as at least one neural region where mean signal is insensitive to recollection success, carry information about recollected content. Importantly, the study history of recognized items endorsed with a 'know' response could be decoded with equal accuracy. The results thus demonstrate a striking dissociation between mean signal and multi-voxel indices of recollection. Moreover, they converge with prior findings in suggesting that, as it is operationalized by classification-based MVPA, reinstatement is not uniquely a signature of recollection.

Medial temporal lobe reinstatement of content-specific details predicts source memory

Leading theories propose that when remembering past events, medial temporal lobe (MTL) structures reinstate the neural patterns that were active when those events were initially encoded. Accurate reinstatement is hypothesized to support detailed recollection of memories, including their source. While several studies have linked cortical reinstatement to successful retrieval, indexing reinstatement within the MTL network and its relationship to memory performance has proved challenging. Here, we addressed this gap in knowledge by having participants perform an incidental encoding task, during which they visualized people, places, and objects in response to adjective cues. During a surprise memory test, participants saw studied and novel adjectives and indicated the imagery task they performed for each adjective. A multivariate pattern classifier was trained to discriminate the imagery tasks based on functional magnetic resonance imaging (fMRI) responses from hippocampus and MTL cortex at encoding. The classifier was then tested on MTL patterns during the source memory task. We found that MTL encoding patterns were reinstated during successful source retrieval. Moreover, when participants made source misattributions, errors were predicted by reinstatement of incorrect source content in MTL cortex. We further observed a gradient of content-specific reinstatement along the anterior-posterior axis of hippocampus and MTL cortex. Within anterior hippocampus, we found that reinstatement of person content was related to source memory accuracy, whereas reinstatement of place information across the entire hippocampal axis predicted correct source judgments. Content-specific reinstatement was also graded across MTL cortex, with PRc patterns evincing reactivation of people and more posterior regions, including PHc, showing evidence for reinstatement of places and objects. Collectively, these findings provide key evidence that source recollection relies on reinstatement of past experience within the MTL network.

Decoding fMRI Signatures of Real-world Autobiographical Memory Retrieval

Extant neuroimaging data implicate frontoparietal and medial-temporal lobe regions in episodic retrieval, and the specific pattern of activity within and across these regions is diagnostic of an individual's subjective mnemonic experience. For example, in laboratory-based paradigms, memories for recently encoded faces can be accurately decoded from single-trial fMRI patterns [Uncapher, M. R., Boyd-Meredith, J. T., Chow, T. E., Rissman, J., & Wagner, A. D. Goal-directed modulation of neural memory patterns: Implications for fMRI-based memory detection. Journal of Neuroscience, 35, 8531–8545, 2015; Rissman, J., Greely, H. T., & Wagner, A. D. Detecting individual memories through the neural decoding of memory states and past experience. Proceedings of the National Academy of Sciences, U.S.A., 107, 9849–9854, 2010]. Here, we investigated the neural patterns underlying memory for real-world autobiographical events, probed at 1- to 3-week retention intervals as well as whether distinct patterns are associated with different subjective memory states. For 3 weeks, participants (n = 16) wore digital cameras that captured photographs of their daily activities. One week later, they were scanned while making memory judgments about sequences of photos depicting events from their own lives or events captured by the cameras of others. Whole-brain multivoxel pattern analysis achieved near-perfect accuracy at distinguishing correctly recognized events from correctly rejected novel events, and decoding performance did not significantly vary with retention interval. Multivoxel pattern classifiers also differentiated recollection from familiarity and reliably decoded the subjective strength of recollection, of familiarity, or of novelty. Classification-based brain maps revealed dissociable neural signatures of these mnemonic states, with activity patterns in hippocampus, medial PFC, and ventral parietal cortex being particularly diagnostic of recollection. Finally, a classifier trained on previously acquired laboratory-based memory data achieved reliable decoding of autobiographical memory states. We discuss the implications for neuroscientific accounts of episodic retrieval and comment on the potential forensic use of fMRI for probing experiential knowledge.

Decisions about the past are guided by reinstatement of specific memories in the hippocampus and perirhinal cortex

When faced with a new challenge, we often reflect on related past experiences to guide our behavior. The ability to retrieve memories that overlap with current experience, a process known as pattern completion, is theorized as a critical function of the hippocampus. Although this view has influenced research for decades, there is little empirical support for hippocampal pattern completion to individual memory elements and its influence on behavior. We used pattern analysis of brain activity measured with functional magnetic resonance imaging to demonstrate that specific elements of past experiences are reinstated in the hippocampus, as well as perirhinal cortex (PRC), when making decisions about those experiences. Linking neural measures of specific memory reinstatement in the hippocampus and PRC to behavior with computational modeling revealed that reinstatement predicts the speed of memory-based decisions. Moreover, hippocampal activation during retrieval was selectively coupled to regions of occipito-temporal cortex that showed content-specific item reinstatement. These results provide evidence for hippocampal pattern completion and its role in the mechanisms of decision making.