Dissociable neural mechanisms for goal-directed versus incidental memory reactivation

Developmental refinements to neural attentional state during semantic memory retrieval through adolescence

Despite the fact that attention undergoes protracted development, little is known about how it may support memory refinements in childhood and adolescence. Here, we asked whether people differentially focus their attention on semantic or perceptual information over development during memory retrieval. First, we trained a multivoxel classifier to characterize whole-brain neural patterns reflecting semantic versus perceptual attention in a cued attention task. We then used this classifier to quantify how attention varied in a separate dataset in which children, adolescents, and adults retrieved autobiographical, semantic, and episodic memories. All age groups demonstrated a semantic attentional bias during memory retrieval, with significant age differences in this bias during the semantic task. Trials began with a preparatory picture cue followed by a retrieval question, which allowed us to ask whether attentional biases varied by trial period. Adults showed a semantic bias earlier during the picture cues, whereas adolescents showed this bias during the question. Adults and adolescents also engaged different brain regions-superior parietal cortex and ventral visual regions, respectively-during preparatory picture cues. Our results demonstrate that retrieval-related attention undergoes refinement beyond childhood. These findings suggest that alongside expanding semantic knowledge, attention-related changes may support the maturation of factual knowledge retrieval.

Adding Meaning to Memories: How Parietal Cortex Combines Semantic Content with Episodic Experience

Neuroimaging studies of human memory have consistently found that univariate responses in parietal cortex track episodic experience with stimuli (whether stimuli are 'old' or 'new'). More recently, pattern-based fMRI studies have shown that parietal cortex also carries information about the semantic content of remembered experiences. However, it is not well understood how memory-based and content-based signals are integrated within parietal cortex. Here, in humans (males and females), we used voxel-wise encoding models and a recognition memory task to predict the fMRI activity patterns evoked by complex natural scene images based on (1) the episodic history and (2) the semantic content of each image. Models were generated and compared across distinct subregions of parietal cortex and for occipitotemporal cortex. We show that parietal and occipitotemporal regions each encode memory and content information, but they differ in how they combine this information. Among parietal subregions, angular gyrus was characterized by robust and overlapping effects of memory and content. Moreover, subject-specific semantic tuning functions revealed that successful recognition shifted the amplitude of tuning functions in angular gyrus but did not change the selectivity of tuning. In other words, effects of memory and content were additive in angular gyrus. This pattern of data contrasted with occipitotemporal cortex where memory and content effects were interactive: memory effects were preferentially expressed by voxels tuned to the content of a remembered image. Collectively, these findings provide unique insight into how parietal cortex combines information about episodic memory and semantic content.SIGNIFICANCE STATEMENT Neuroimaging studies of human memory have identified multiple brain regions that not only carry information about "whether" a visual stimulus is successfully recognized but also "what" the content of that stimulus includes. However, a fundamental and open question concerns how the brain integrates these two types of information (memory and content). Here, using a powerful combination of fMRI analysis methods, we show that parietal cortex, particularly the angular gyrus, robustly combines memory- and content-related information, but these two forms of information are represented via additive, independent signals. In contrast, memory effects in high-level visual cortex critically depend on (and interact with) content representations. Together, these findings reveal multiple and distinct ways in which the brain combines memory- and content-related information.

Neural evidence for advantaged representation of first items in memory

Visual areas activated during perception can retain specific information held in memory without the presence of physical stimuli via distributed activity patterns. Neuroimaging studies have shown that the delay-period representation of information in visual areas is modulated by factors such as memory load and task demands, raising the possibility of serial position as another potential modulator. Specifically, enhanced representation of first items during the post-encoding delay period may serve as a mechanism underlying the well-established but not well-understood primacy effect - the mnemonic advantage of first items. To test this hypothesis, 13 males and 16 females performed a human fMRI task, wherein each trial consisted of the sequential encoding of two stimuli (a famous face and landscape, order counterbalanced), followed by a distracting task, a delay period, and then a cued recall of one of the items. Participants exhibited the expected behavioral primacy effect, manifested as faster recall of the first items. In order to elucidate the still debated neural underpinnings of this effect, using multivariate decoding, a classifier was trained on data collected during encoding to differentiate stimulus categories (i.e., faces vs. landscapes) and tested on data collected during the post-encoding period. Greater reactivation of first versus second items was observed in the ventral occipito-temporal cortex during the entire post-encoding period but not during encoding. Moreover, trial-level analyses revealed that the degree of first-item neural advantage during the post-encoding delay predicted the behavioral primacy effect. These findings highlight the role of item reinstatement in ventral occipito-temporal cortex in the primacy effect and are discussed in the context of the uniqueness of the very first item and event boundaries, illuminating putative neural mechanisms underlying the effect.

Perception and memory have distinct spatial tuning properties in human visual cortex

Reactivation of earlier perceptual activity is thought to underlie long-term memory recall. Despite evidence for this view, it is unclear whether mnemonic activity exhibits the same tuning properties as feedforward perceptual activity. Here, we leverage population receptive field models to parameterize fMRI activity in human visual cortex during spatial memory retrieval. Though retinotopic organization is present during both perception and memory, large systematic differences in tuning are also evident. Whereas there is a three-fold decline in spatial precision from early to late visual areas during perception, this pattern is not observed during memory retrieval. This difference cannot be explained by reduced signal-to-noise or poor performance on memory trials. Instead, by simulating top-down activity in a network model of cortex, we demonstrate that this property is well explained by the hierarchical structure of the visual system. Together, modeling and empirical results suggest that computational constraints imposed by visual system architecture limit the fidelity of memory reactivation in sensory cortex.

Neural activity from perception is thought to be reactivated during memory recall. Here, the authors show that memory reactivation in visual cortex exhibits different tuning properties from those observed during perception.

Readiness to remember: predicting variability in episodic memory

Learning and remembering are fundamental to our lives, so what causes us to forget? Answers often highlight preparatory processes that precede learning, as well as mnemonic processes during the act of encoding or retrieval. Importantly, evidence now indicates that preparatory processes that precede retrieval attempts also have powerful influences on memory success or failure. Here, we review recent work from neuroimaging, electroencephalography, pupillometry, and behavioral science to propose an integrative framework of retrieval-period dynamics that explains variance in remembering in the moment and across individuals as a function of interactions among preparatory attention, goal coding, and mnemonic processes. Extending this approach, we consider how a 'readiness to remember' (R2R) framework explains variance in high-level functions of memory and mnemonic disruptions in aging.

Category-sensitive incidental reinstatement in medial temporal lobe subregions during word recognition

During associative retrieval, the brain reinstates neural representations that were present during encoding. The human medial temporal lobe (MTL), with its subregions hippocampus (HC), perirhinal cortex (PRC), and parahippocampal cortex (PHC), plays a central role in neural reinstatement. Previous studies have given compelling evidence for reinstatement in the MTL during explicitly instructed associative retrieval. High-confident recognition may be similarly accompanied by recollection of associated information from the encoding context. It is unclear, however, whether high-confident recognition memory elicits reinstatement in the MTL even in the absence of an explicit instruction to retrieve associated information. Here, we addressed this open question using high-resolution fMRI. Twenty-eight male and female human volunteers engaged in a recognition memory task for words that they had previously encoded together with faces and scenes. Using complementary univariate and multivariate approaches, we show that MTL subregions including the PRC, PHC, and HC differentially reinstate category-sensitive representations during high-confident word recognition, even though no explicit instruction to retrieve the associated category was given. This constitutes novel evidence that high-confident recognition memory is accompanied by incidental reinstatement of associated category information in MTL subregions, and supports a functional model of the MTL that emphasizes content-sensitive representations during both encoding and retrieval.

Neural reactivation and judgements of vividness reveal separable contributions to mnemonic representation

Mnemonic representations vary in fidelity, sharpness, and strength-qualities that can be examined using both introspective judgements of mental states and objective measures of brain activity. Subjective and objective measures are both valid ways of "reading out" the content of someone's internal mnemonic states, each with different strengths and weaknesses. St-Laurent and colleagues (2015) compared the neural correlates of memory vividness ratings with patterns of neural reactivation evoked during memory recall and found considerable overlap between the two, suggesting a common neural basis underlying these different markers of representational quality. Here we extended this work with meta-analytic methods by pooling together four neuroimaging datasets in order to contrast the neural substrates of neural reactivation and those of vividness judgements. While reactivation and vividness judgements correlated positively with one another and were associated with common univariate activity in the dorsal attention network and anterior hippocampus, some notable differences were also observed. Vividness judgments were tied to stronger activation in the striatum and dorsal attention network, together with activity suppression in default mode network nodes. We also observed a trend for reactivation to be more closely associated with early visual cortex activity. A mediation analysis found support for the hypothesis that neural reactivation is necessary for memory vividness, with activity in the anterior hippocampus associated with greater reactivation. Our results suggest that neural reactivation and vividness judgements reflect common mnemonic processes but differ in the extent to which they engage effortful, attentional processes. Additionally, the similarity between reactivation and vividness appears to arise, partly, through hippocampal engagement during memory retrieval.

The functional dissociation of posterior parietal regions during multimodal memory formation

The incidental acquisition of multimodal associations is a key memory function for everyday life. While the posterior parietal cortex has been frequently shown to be involved for these memory functions, ventral and dorsal regions revealed differences in their functional recruitment and the precise difference in multimodal memory processing with respect to the associative process has not been differentiated. Using an incidental multimodal learning task, we isolated the associative process during multimodal learning and recollection. The result of the present functional magnetic resonance imaging (fMRI) study demonstrated that during both learning and recollection a clear functional differentiation between ventral and dorsal posterior parietal regions was found and can be related directly to the associative process. The recruitment of a ventral region, the angular gyrus, was specific for learning and recollection of multimodal associations. In contrast, a dorsal region, the superior parietal lobule, could be attributed to memory guided attentional processing. Independent of the memory stage, we assumed a general role for the angular gyrus in the generation of associative representations and updating of fixed association, episodic memory.

Developmental differences in memory reactivation relate to encoding and inference in the human brain

Despite the fact that children can draw on their memories to make novel inferences, it is unknown whether they do so through the same neural mechanisms as adults. We measured memory reinstatement as participants aged 7-30 years learned new, related information. While adults brought memories to mind throughout learning, adolescents did so only transiently, and children not at all. Analysis of trial-wise variability in reactivation showed that discrepant neural mechanisms-and in particular, what we interpret as suppression of interfering memories during learning in early adolescence-are nevertheless beneficial for later inference at each developmental stage. These results suggest that while adults build integrated memories well-suited to informing inference directly, children and adolescents instead must rely on separate memories to be individually referenced at the time of inference decisions.

Encoding contexts are incidentally reinstated during competitive retrieval and track the temporal dynamics of memory interference

The ability to remember an episode from our past is often hindered by competition from similar events. For example, if we want to remember the article a colleague recommended during the last lab meeting, we may need to resolve interference from other article recommendations from the same colleague. This study investigates if the contextual features specifying the encoding episodes are incidentally reinstated during competitive memory retrieval. Competition between memories was created through the AB/AC interference paradigm. Individual word-pairs were presented embedded in a slowly drifting real-word-like context. Multivariate pattern analysis (MVPA) of high temporal-resolution electroencephalographic (EEG) data was used to investigate context reactivation during memory retrieval. Behaviorally, we observed proactive (but not retroactive) interference; that is, performance for AC competitive retrieval was worse compared with a control DE noncompetitive retrieval, whereas AB retrieval did not suffer from competition. Neurally, proactive interference was accompanied by an early reinstatement of the competitor context and interference resolution was associated with the ensuing reinstatement of the target context. Together, these findings provide novel evidence showing that the encoding contexts of competing discrete events are incidentally reinstated during competitive retrieval and that such reinstatement tracks retrieval competition and subsequent interference resolution.

Delta-modulated cortical alpha oscillations support new knowledge generation through memory integration

The ability to generate new knowledge depends on integration of separate information. For example, in one episode an individual may learn that apple seeds are called pips. In a separate episode, the individual may then learn that pips contain cyanide. Integration of the related facts in memory may then support derivation of the new knowledge that apple seeds contain cyanide. Past studies show that adults form relational memories that represent the commonalities among discrete events, and that such integrated representation supports the ability to infer new knowledge. Although these integrated representations are thought to result from linking separate memories to the same neuronal ensemble, the neural mechanisms that underlie formation of such linkages are not well understood. Here we examined whether self-derivation of new, integrated knowledge was supported by oscillatory coherence, a means of linking discrete neuronal ensembles. Cortical alpha coherence was greater when adults encoded new facts that could be integrated with existing knowledge, relative to encoding unrelated facts, particularly in participants who showed better performance on the subsequent test of knowledge generation via fact integration. In high performers, posterior alpha amplitude was also modulated by delta phase, a form of cross-frequency coupling previously implicated in coordinating information stored widely throughout the cortex. Examination of the timing and topography of these respective signatures suggested that these oscillatory dynamics work in concert to encode and represent new knowledge with respect to prior knowledge that is reactivated, thus revealing fundamental mechanisms through which related memories are linked into integrated knowledge structures.

Reinstatement of Event Details during Episodic Simulation in the Hippocampus

According to the constructive episodic simulation hypothesis, episodic simulation (i.e., imagining specific novel future episodes) draws on some of the same neurocognitive processes that support episodic memory (i.e., recalling specific past episodes). Episodic retrieval supports the ability to simulate future experiences by providing access to episodic details (e.g., the people and locations that comprise memories) that can be recombined in new ways. In the current functional neuroimaging study, we test this hypothesis by examining whether the hippocampus, a region implicated in the reinstatement of episodic information during memory, supports reinstatement of episodic information during simulation. Employing a multivoxel pattern similarity analysis, we interrogated the similarity between hippocampal neural patterns during memory and simulation at the level of individual event details. Our findings indicate that the hippocampus supports the reinstatement of detail-specific information from episodic memory during simulation, with the level of reinstatement contributing to the subjective experience of simulated details.

Adaptive Memory Distortions Are Predicted by Feature Representations in Parietal Cortex

Similarity between memories is a primary cause of interference and forgetting. Exaggerating subtle differences between memories is therefore a potential mechanism for reducing interference. Here, we report a human fMRI study (n = 29, 19 female) that tested whether behavioral and neural expressions of memories are adaptively distorted to reduce interference. Participants learned and repeatedly retrieved object images, some of which were identical except for subtle color differences. Behavioral measures of color memory revealed exaggeration of differences between similar objects. Importantly, greater memory exaggeration was associated with lower memory interference. fMRI pattern analyses revealed that color information in parietal cortex was stronger during memory recall when color information was critical for discriminating competing memories. Moreover, greater representational distance between competing memories in parietal cortex predicted greater color memory exaggeration and lower memory interference. Together, these findings reveal that competition between memories induces adaptive, feature-specific distortions in parietal representations and corresponding behavioral expressions.SIGNIFICANCE STATEMENT Similarity between memories is a primary cause of interference and forgetting. Here, we show that, when remembering highly similar objects, subtle differences in the features of these objects are exaggerated in memory to reduce interference. These memory distortions are reflected in, and predicted by, overlap of activity patterns in lateral parietal cortex. These findings provide unique insight into how memory interference is resolved and specifically implicate lateral parietal cortex in representing feature-specific memory distortions.

Effects of age on goal-dependent modulation of episodic memory retrieval

Retrieval gating refers to the ability to modulate the retrieval of features of a single memory episode according to behavioral goals. Recent findings demonstrate that younger adults engage retrieval gating by attenuating the representation of task-irrelevant features of an episode. Here, we examine whether retrieval gating varies with age. Younger and older adults incidentally encoded words superimposed over scenes or scrambled backgrounds that were displayed in one of three spatial locations. Participants subsequently underwent fMRI as they completed two memory tasks: the background task, which tested memory for the word's background, and the location task, testing memory for the word's location. Employing univariate and multivariate approaches, we demonstrated that younger, but not older adults, exhibited attenuated reinstatement of scene information when it was goal-irrelevant (during the location task). Additionally, in younger adults only, the strength of scene reinstatement in the parahippocampal place area during the background task was related to item and source memory performance. Together, these findings point to an age-related decline in the ability to engage retrieval gating.

Transforming the Concept of Memory Reactivation

Reactivation refers to the phenomenon wherein patterns of neural activity expressed during perceptual experience are re-expressed at a later time, a putative neural marker of memory. Reactivation of perceptual content has been observed across many cortical areas and correlates with objective and subjective expressions of memory in humans. However, because reactivation emphasizes similarities between perceptual and memory-based representations, it obscures differences in how perceptual events and memories are represented. Here, we highlight recent evidence of systematic differences in how (and where) perceptual events and memories are represented in the brain. We argue that neural representations of memories are best thought of as spatially transformed versions of perceptual representations. We consider why spatial transformations occur and identify critical questions for future research.

Functional Interplay Between Posterior Parietal Cortex and Hippocampus During Detection of Memory Targets and Non-targets

Posterior parietal cortex is frequently activated during episodic memory retrieval but its role during retrieval and its interactions with the hippocampus are not yet clear. In this fMRI study, we investigated the neural bases of recognition memory when study repetitions and retrieval goals were manipulated. During encoding participants studied words either once or three times, and during retrieval they were rewarded more to detect either studied words or new words. We found that (1) dorsal parietal cortex (DPC) was more engaged during detection of items studied once compared to three times, whereas regions in the ventral parietal cortex (VPC) responded more to items studied multiple times; (2) DPC, within a network of brain regions functionally connected to the anterior hippocampus, responded more to items consistent with retrieval goals (associated with high reward); (3) VPC, within a network of brain regions functionally connected to the posterior hippocampus, responded more to items not aligned with retrieval goals (i.e., unexpected). These findings support the hypothesis that DPC and VPC regions contribute differentially to top-down vs. bottom-up attention to memory. Moreover, they reveal a dissociation in the functional profile of the anterior and posterior hippocampi.

Hippocampal and cortical mechanisms at retrieval explain variability in episodic remembering in older adults

Age-related episodic memory decline is characterized by striking heterogeneity across individuals. Hippocampal pattern completion is a fundamental process supporting episodic memory. Yet, the degree to which this mechanism is impaired with age, and contributes to variability in episodic memory, remains unclear. We combine univariate and multivariate analyses of fMRI data from a large cohort of cognitively normal older adults (N=100) to measure hippocampal activity and cortical reinstatement during retrieval of trial-unique associations. Trial-wise analyses revealed that (a) hippocampal activity scaled with reinstatement strength, (b) cortical reinstatement partially mediated the relationship between hippocampal activity and associative retrieval, (c) older age weakened cortical reinstatement and its relationship to memory behaviour. Moreover, individual differences in the strength of hippocampal activity and cortical reinstatement explained unique variance in performance across multiple assays of episodic memory. These results indicate that fMRI indices of hippocampal pattern completion explain within- and across-individual memory variability in older adults.

Content Tuning in the Medial Temporal Lobe Cortex: Voxels that Perceive, Retrieve

How do we recall vivid details from our past based only on sparse cues? Research suggests that the phenomenological reinstatement of past experiences is accompanied by neural reinstatement of the original percept. This process critically depends on the medial temporal lobe (MTL). Within the MTL, perirhinal cortex (PRC) and parahippocampal cortex (PHC) are thought to support encoding and recall of objects and scenes, respectively, with the hippocampus (HC) serving as a content-independent hub. If the fidelity of recall indeed arises from neural reinstatement of perceptual activity, then successful recall should preferentially draw upon those neural populations within content-sensitive MTL cortex that are tuned to the same content during perception. We tested this hypothesis by having eighteen human participants undergo functional MRI (fMRI) while they encoded and recalled objects and scenes paired with words. Critically, recall was cued with the words only. While HC distinguished successful from unsuccessful recall of both objects and scenes, PRC and PHC were preferentially engaged during successful versus unsuccessful object and scene recall, respectively. Importantly, within PRC and PHC, this content-sensitive recall was predicted by content tuning during perception: Across PRC voxels, we observed a positive relationship between object tuning during perception and successful object recall, while across PHC voxels, we observed a positive relationship between scene tuning during perception and successful scene recall. Our results thus highlight content-based roles of MTL cortical regions for episodic memory and reveal a direct mapping between content-specific tuning during perception and successful recall.

Awake Reactivation of Prior Experiences Consolidates Memories and Biases Cognition

After experiences are encoded into memory, post-encoding reactivation mechanisms have been proposed to mediate long-term memory stabilization and transformation. Spontaneous reactivation of hippocampal representations, together with hippocampal-cortical interactions, are leading candidate mechanisms for promoting systems-level memory strengthening and reorganization. While the replay of spatial representations has been extensively studied in rodents, here we review recent fMRI work that provides evidence for spontaneous reactivation of nonspatial, episodic event representations in the human hippocampus and cortex, as well as for experience-dependent alterations in systems-level hippocampal connectivity. We focus on reactivation during awake post-encoding periods, relationships between reactivation and subsequent behavior, how reactivation is modulated by factors that influence consolidation, and the implications of persistent reactivation for biasing ongoing perception and cognition.

Effects of age on across-participant variability of cortical reinstatement effects

Using functional magnetic resonance imaging data, we assessed whether across-participant variability of content-selective retrieval-related neural activity differs with age. We addressed this question by employing across-participant multi-voxel pattern analysis (MVPA), predicting that increasing age would be associated with reduced variability of retrieval-related cortical reinstatement across participants. During study, 24 young and 24 older participants viewed objects and concrete words. Test items comprised studied words, names of studied objects, and unstudied words. Participants judged whether the items were recollected, familiar, or new by making 'Remember', 'Know' and 'New' responses, respectively. MVPA was conducted on each region belonging to the 'core recollection network', dorsolateral prefrontal cortex, and a previously identified content-selective voxel set. A leave-one-participant-out classification approach was employed whereby a classifier was trained on a subset of participants and tested on the data from a yoked pair of held-out participants. Classifiers were trained on the study phase data to discriminate the study trials as a function of content (picture or word). The classifiers were then applied to the test phase data to discriminate studied test words according to their study condition. In all of the examined regions, classifier performance demonstrated little or no sensitivity to age and, for the test data, was robustly above chance. Thus, there was little evidence to support the hypothesis that across-participant variability of retrieval-related cortical reinstatement differs with age. The findings extend prior evidence by demonstrating that content-selective cortical reinstatement is sufficiently invariant to support across-participant multi-voxel classification across the healthy adult lifespan.

Process-Specific Alliances (PSAs) in Cognitive Neuroscience

Most cognitive neuroscience theories have focused on the functions of individual brain regions, but cognitive abilities depend also on functional interactions among multiple regions. Many recent studies on these interactions have examined large-scale, resting-state networks, but these networks are difficult to link to theories about specific cognitive processes. Cognitive theories are easier to link to the mini-networks we call process specific alliances (PSAs). A PSA is a small team of brain regions that rapidly assemble to mediate a cognitive process in response to task demands but quickly disassemble when the process is no longer needed. We compare PSAs to resting-state networks and to other connectivity-based, task-related networks, and we characterize the advantages and disadvantages of each type of network.

Decomposing Parietal Memory Reactivation to Predict Consequences of Remembering

Memory retrieval can strengthen, but also distort memories. Parietal cortex is a candidate region involved in retrieval-induced memory changes as it reflects retrieval success and represents retrieved content. Here, we conducted an fMRI experiment to test whether different forms of parietal reactivation predict distinct consequences of retrieval. Subjects studied associations between words and pictures of faces, scenes, or objects, and then repeatedly retrieved half of the pictures, reporting the vividness of the retrieved pictures (“retrieval practice”). On the following day, subjects completed a recognition memory test for individual pictures. Critically, the test included lures highly similar to studied pictures. Behaviorally, retrieval practice increased both hit and false alarm (FA) rates to similar lures, confirming a causal influence of retrieval on subsequent memory. Using pattern similarity analyses, we measured two different levels of reactivation during retrieval practice: generic “category-level” reactivation and idiosyncratic “item-level” reactivation. Vivid remembering during retrieval practice was associated with stronger category- and item-level reactivation in parietal cortex. However, these measures differentially predicted subsequent recognition memory performance: whereas higher category-level reactivation tended to predict FAs to lures, item-level reactivation predicted correct rejections. These findings indicate that parietal reactivation can be decomposed to tease apart distinct consequences of memory retrieval.

Competitive learning modulates memory consolidation during sleep

Competition between memories can cause weakening of those memories. Here we investigated memory competition during sleep in human participants by presenting auditory cues that had been linked to two distinct picture-location pairs during wake. We manipulated competition during learning by requiring participants to rehearse picture-location pairs associated with the same sound either competitively (choosing to rehearse one over the other, leading to greater competition) or separately; we hypothesized that greater competition during learning would lead to greater competition when memories were cued during sleep. With separate-pair learning, we found that cueing benefited spatial retention. With competitive-pair learning, no benefit of cueing was observed on retention, but cueing impaired retention of well-learned pairs (where we expected strong competition). During sleep, post-cue beta power (16-30 Hz) indexed competition and predicted forgetting, whereas sigma power (11-16 Hz) predicted subsequent retention. Taken together, these findings show that competition between memories during learning can modulate how they are consolidated during sleep.

Parietal Representations of Stimulus Features Are Amplified during Memory Retrieval and Flexibly Aligned with Top-Down Goals

In studies of human episodic memory, the phenomenon of reactivation has traditionally been observed in regions of occipitotemporal cortex (OTC) involved in visual perception. However, reactivation also occurs in lateral parietal cortex (LPC), and recent evidence suggests that stimulus-specific reactivation may be stronger in LPC than in OTC. These observations raise important questions about the nature of memory representations in LPC and their relationship to representations in OTC. Here, we report two fMRI experiments that quantified stimulus feature information (color and object category) within LPC and OTC, separately during perception and memory retrieval, in male and female human subjects. Across both experiments, we observed a clear dissociation between OTC and LPC: while feature information in OTC was relatively stronger during perception than memory, feature information in LPC was relatively stronger during memory than perception. Thus, while OTC and LPC represented common stimulus features in our experiments, they preferentially represented this information during different stages. In LPC, this bias toward mnemonic information co-occurred with stimulus-level reinstatement during memory retrieval. In Experiment 2, we considered whether mnemonic feature information in LPC was flexibly and dynamically shaped by top-down retrieval goals. Indeed, we found that dorsal LPC preferentially represented retrieved feature information that addressed the current goal. In contrast, ventral LPC represented retrieved features independent of the current goal. Collectively, these findings provide insight into the nature and significance of mnemonic representations in LPC and constitute an important bridge between putative mnemonic and control functions of parietal cortex.SIGNIFICANCE STATEMENT When humans remember an event from the past, patterns of sensory activity that were present during the initial event are thought to be reactivated. Here, we investigated the role of lateral parietal cortex (LPC), a high-level region of association cortex, in representing prior visual experiences. We find that LPC contained stronger information about stimulus features during memory retrieval than during perception. We also found that current task goals influenced the strength of stimulus feature information in LPC during memory. These findings suggest that, in addition to early sensory areas, high-level areas of cortex, such as LPC, represent visual information during memory retrieval, and that these areas may play a special role in flexibly aligning memories with current goals.

Just above Chance: Is It Harder to Decode Information from Prefrontal Cortex Hemodynamic Activity Patterns?

The prefrontal cortex (PFC) is central to flexible, goal-directed cognition, and understanding its representational code is an important problem in cognitive neuroscience. In humans, multivariate pattern analysis (MVPA) of fMRI blood oxygenation level-dependent (BOLD) measurements has emerged as an important approach for studying neural representations. Many previous studies have implicitly assumed that MVPA of fMRI BOLD is just as effective in decoding information encoded in PFC neural activity as it is in visual cortex. However, MVPA studies of PFC have had mixed success. Here we estimate the base rate of decoding information from PFC BOLD activity patterns from a meta-analysis of published MVPA studies. We show that PFC has a significantly lower base rate (55.4%) than visual areas in occipital (66.6%) and temporal (71.0%) cortices and one that is close to chance levels. Our results have implications for the design and interpretation of MVPA studies of PFC and raise important questions about its functional organization.

Bottom-Up and Top-Down Factors Differentially Influence Stimulus Representations Across Large-Scale Attentional Networks

Visual attention is thought to be supported by three large-scale frontoparietal networks: the frontoparietal control network (FPCN), the dorsal attention network (DAN), and the ventral attention network (VAN). The traditional view is that these networks support visual attention by biasing and evaluating sensory representations in visual cortical regions. However, recent evidence suggests that frontoparietal regions actively represent perceptual stimuli. Here, we assessed how perceptual stimuli are represented across large-scale frontoparietal and visual networks. Specifically, we tested whether representations of stimulus features across these networks are differentially sensitive to bottom-up and top-down factors. In a pair of pattern-based fMRI studies, male and female human subjects made perceptual decisions about face images that varied along two independent dimensions: gender and affect. Across studies, we interrupted bottom-up visual input using backward masks. Within studies, we manipulated which stimulus features were goal relevant (i.e., whether gender or affect was relevant) and task switching (i.e., whether the goal on the current trial matched the goal on the prior trial). We found that stimulus features could be reliably decoded from all four networks and, importantly, that subregions within each attentional network maintained coherent representations. Critically, the different attentional manipulations (interruption, goal relevance, and task switching) differentially influenced feature representations across networks. Whereas visual interruption had a relatively greater influence on representations in visual regions, goal relevance and task switching had a relatively greater influence on representations in frontoparietal networks. Therefore, large-scale brain networks can be dissociated according to how attention influences the feature representations that they maintain.SIGNIFICANCE STATEMENT Visual attention is supported by multiple frontoparietal attentional networks. However, it remains unclear how stimulus features are represented within these networks and how they are influenced by attention. Here, we assessed feature representations in four large-scale networks using a perceptual decision-making paradigm in which we manipulated top-down and bottom-up factors. We found that top-down manipulations such as goal relevance and task switching modulated feature representations in attentional networks, whereas bottom-up manipulations such as interruption of visual processing had a relatively stronger influence on feature representations in visual regions. Together, these findings indicate that attentional networks actively represent stimulus features and that representations within different large-scale networks are influenced by different forms of attention.

Task Context Overrules Object- and Category-Related Representational Content in the Human Parietal Cortex

The dorsal, parietal visual stream is activated when seeing objects, but the exact nature of parietal object representations is still under discussion. Here we test 2 specific hypotheses. First, parietal cortex is biased to host some representations more than others, with a different bias compared with ventral areas. A prime example would be object action representations. Second, parietal cortex forms a general multiple-demand network with frontal areas, showing similar task effects and representational content compared with frontal areas. To differentiate between these hypotheses, we implemented a human neuroimaging study with a stimulus set that dissociates associated object action from object category while manipulating task context to be either action- or category-related. Representations in parietal as well as prefrontal areas represented task-relevant object properties (action representations in the action task), with no sign of the irrelevant object property (category representations in the action task). In contrast, irrelevant object properties were represented in ventral areas. These findings emphasize that human parietal cortex does not preferentially represent particular object properties irrespective of task, but together with frontal areas is part of a multiple-demand and content-rich cortical network representing task-relevant object properties.

What Is Memory-Guided Attention? How Past Experiences Shape Selective Visuospatial Attention in the Present

What controls our attention? It is historically thought that there are two primary factors that determine selective attention: the perceptual salience of the stimuli and the goals based on the task at hand. However, this distinction doesn't neatly capture the varied ways our past experience can influence our ongoing mental processing. In this chapter, we aim to describe how past experience can be systematically characterized by different types of memory, and we outline experimental evidence suggesting how attention can then be guided by each of these different memory types. We highlight findings from human behavioral, neuroimaging, and neuropsychological work from the perspective of two related frameworks of human memory: the multiple memory systems (MMS) framework and the neural processing (NP) framework. The MMS framework underscores how memory can be separated based on consciousness (declarative and non-declarative memory), while the NP framework emphasizes different forms of memory as reflective of different brain processing modes (rapid encoding of flexible associations, slow encoding of rigid associations, and rapid encoding of single or unitized items). We describe how memory defined by these frameworks can guide our attention, even when they do not directly relate to perceptual salience or the goals concerning the current task. We close by briefly discussing theoretical implications as well as some interesting avenues for future research.

Ventral lateral parietal cortex and episodic memory retrieval

With the advent of functional neuroimaging it quickly became apparent that successful episodic memory retrieval was consistently associated with enhanced activity in ventral lateral parietal cortex (VLPC), especially the left angular gyrus. Here, we selectively review recent neuropsychological and functional neuroimaging evidence relevant to the question of the functional significance of this activity. We argue that the balance of the evidence suggests that the angular gyrus supports the representation of retrieved episodic information, and that this likely reflects a more general role for the region in representing multi-modal and multi-domain information.

Reconstructing Perceived and Retrieved Faces from Activity Patterns in Lateral Parietal Cortex

Recent findings suggest that the contents of memory encoding and retrieval can be decoded from the angular gyrus (ANG), a subregion of posterior lateral parietal cortex. However, typical decoding approaches provide little insight into the nature of ANG content representations. Here, we tested whether complex, multidimensional stimuli (faces) could be reconstructed from ANG by predicting underlying face components from fMRI activity patterns in humans. Using an approach inspired by computer vision methods for face recognition, we applied principal component analysis to a large set of face images to generate eigenfaces. We then modeled relationships between eigenface values and patterns of fMRI activity. Activity patterns evoked by individual faces were then used to generate predicted eigenface values, which could be transformed into reconstructions of individual faces. We show that visually perceived faces were reliably reconstructed from activity patterns in occipitotemporal cortex and several lateral parietal subregions, including ANG. Subjective assessment of reconstructed faces revealed specific sources of information (e.g., affect and skin color) that were successfully reconstructed in ANG. Strikingly, we also found that a model trained on ANG activity patterns during face perception was able to successfully reconstruct an independent set of face images that were held in memory. Together, these findings provide compelling evidence that ANG forms complex, stimulus-specific representations that are reflected in activity patterns evoked during perception and remembering.

SIGNIFICANCE STATEMENT

Neuroimaging studies have consistently implicated lateral parietal cortex in episodic remembering, but the functional contributions of lateral parietal cortex to memory remain a topic of debate. Here, we used an innovative form of fMRI pattern analysis to test whether lateral parietal cortex actively represents the contents of memory. Using a large set of human face images, we first extracted latent face components (eigenfaces). We then used machine learning algorithms to predict face components from fMRI activity patterns and, ultimately, to reconstruct images of individual faces. We show that activity patterns in a subregion of lateral parietal cortex, the angular gyrus, supported successful reconstruction of perceived and remembered faces, confirming a role for this region in actively representing remembered content.

Lower Parietal Encoding Activation Is Associated with Sharper Information and Better Memory

Mean fMRI activation in ventral posterior parietal cortex (vPPC) during memory encoding often negatively predicts successful remembering. A popular interpretation of this phenomenon is that vPPC reflects "off-task" processing. However, recent fMRI studies considering distributed patterns of activity suggest that vPPC actively represents encoded material. Here, we assessed the relationships between pattern-based content representations in vPPC, mean activation in vPPC, and subsequent remembering. We analyzed data from two fMRI experiments where subjects studied then recalled word-face or word-scene associations. For each encoding trial, we measured 1) mean univariate activation within vPPC and 2) the strength of face/scene information as indexed by pattern analysis. Mean activation in vPPC negatively predicted subsequent remembering, but the strength of pattern-based information in the same vPPC voxels positively predicted later memory. Indeed, univariate amplitude averaged across vPPC voxels negatively correlated with pattern-based information strength. This dissociation reflected a tendency for univariate reductions to maximally occur in voxels that were not strongly tuned for the category of encoded stimuli. These results indicate that vPPC activity patterns reflect the content and quality of memory encoding and constitute a striking example of lower univariate activity corresponding to stronger pattern-based information.

Decoding the content of recollection within the core recollection network and beyond

Recollection - retrieval of qualitative information about a past event - is associated with enhanced neural activity in a consistent set of neural regions (the 'core recollection network') seemingly regardless of the nature of the recollected content. Here, we employed multi-voxel pattern analysis (MVPA) to assess whether retrieval-related functional magnetic resonance imaging (fMRI) activity in core recollection regions - including the hippocampus, angular gyrus, medial prefrontal cortex, retrosplenial/posterior cingulate cortex, and middle temporal gyrus - contain information about studied content and thus demonstrate retrieval-related 'reinstatement' effects. During study, participants viewed objects and concrete words that were subjected to different encoding tasks. Test items included studied words, the names of studied objects, or unstudied words. Participants judged whether the items were recollected, familiar, or new by making 'remember', 'know', and 'new' responses, respectively. The study history of remembered test items could be reliably decoded using MVPA in most regions, as well as from the dorsolateral prefrontal cortex, a region where univariate recollection effects could not be detected. The findings add to evidence that members of the core recollection network, as well as at least one neural region where mean signal is insensitive to recollection success, carry information about recollected content. Importantly, the study history of recognized items endorsed with a 'know' response could be decoded with equal accuracy. The results thus demonstrate a striking dissociation between mean signal and multi-voxel indices of recollection. Moreover, they converge with prior findings in suggesting that, as it is operationalized by classification-based MVPA, reinstatement is not uniquely a signature of recollection.

Hippocampal Mismatch Signals Are Modulated by the Strength of Neural Predictions and Their Similarity to Outcomes

The hippocampus is thought to compare predicted events with current perceptual input, generating a mismatch signal when predictions are violated. However, most prior studies have only inferred when predictions occur without measuring them directly. Moreover, an important but unresolved question is whether hippocampal mismatch signals are modulated by the degree to which predictions differ from outcomes. Here, we conducted a human fMRI study in which subjects repeatedly studied various word-picture pairs, learning to predict particular pictures (outcomes) from the words (cues). After initial learning, a subset of cues was paired with a novel, unexpected outcome, whereas other cues continued to predict the same outcome. Critically, when outcomes changed, the new outcome was either "near" to the predicted outcome (same visual category as the predicted picture) or "far" from the predicted outcome (different visual category). Using multivoxel pattern analysis, we indexed cue-evoked reactivation (prediction) within neocortical areas and related these trial-by-trial measures of prediction strength to univariate hippocampal responses to the outcomes. We found that prediction strength positively modulated hippocampal responses to unexpected outcomes, particularly when unexpected outcomes were close, but not identical, to the prediction. Hippocampal responses to unexpected outcomes were also associated with a tradeoff in performance during a subsequent memory test: relatively faster retrieval of new (updated) associations, but relatively slower retrieval of the original (older) associations. Together, these results indicate that hippocampal mismatch signals reflect a comparison between active predictions and current outcomes and that these signals are most robust when predictions are similar, but not identical, to outcomes.

SIGNIFICANCE STATEMENT

Although the hippocampus is widely thought to signal "mismatches" between memory-based predictions and outcomes, previous research has not linked hippocampal mismatch signals directly to neural measures of prediction strength. Here, we show that hippocampal mismatch signals increase as a function of the strength of predictions in neocortical regions. This increase in hippocampal mismatch signals was particularly robust when outcomes were similar, but not identical, to predictions. These results indicate that hippocampal mismatch signals are driven by both the active generation of predictions and the similarity between predictions and outcomes.

Modulation of task demands suggests that semantic processing interferes with the formation of episodic associations

Although episodic and semantic memory share overlapping neural mechanisms, it remains unclear how our pre-existing semantic associations modulate the formation of new, episodic associations. When freely recalling recently studied words, people rely on both episodic and semantic associations, shown through temporal and semantic clustering of responses. We asked whether orienting participants toward semantic associations interferes with or facilitates the formation of episodic associations. We compared electroencephalographic (EEG) activity recorded during the encoding of subsequently recalled words that were either temporally or semantically clustered. Participants studied words with or without a concurrent semantic orienting task. We identified a neural signature of successful episodic association formation whereby high-frequency EEG activity (HFA, 44-100 Hz) overlying left prefrontal regions increased for subsequently temporally clustered words, but only for those words studied without a concurrent semantic orienting task. To confirm that this disruption in the formation of episodic associations was driven by increased semantic processing, we measured the neural correlates of subsequent semantic clustering. We found that HFA increased for subsequently semantically clustered words only for lists with a concurrent semantic orienting task. This dissociation suggests that increased semantic processing of studied items interferes with the neural processes that support the formation of novel episodic associations. (PsycINFO Database Record

Task-specific Aspects of Goal-directed Word Generation Identified via Simultaneous EEG–fMRI

Generating words according to a given rule relies on retrieval-related search and postretrieval control processes. Using fMRI, we recently characterized neural patterns of word generation in response to episodic, semantic, and phonemic cues by comparing free recall of wordlists, category fluency, and letter fluency [Shapira-Lichter, I., Oren, N., Jacob, Y., Gruberger, M., & Hendler, T. Portraying the unique contribution of the default mode network to internally driven mnemonic processes. Proceedings of the National Academy of Sciences, U.S.A., 110, 4950–4955, 2013]. Distinct selectivity for each condition was evident, representing discrete aspects of word generation-related memory retrieval. For example, the precuneus, implicated in processing spatiotemporal information, emerged as a key contributor to the episodic condition, which uniquely requires this information. Gamma band is known to play a central role in memory, and increased gamma power has been observed before word generation. Yet, gamma modulation in response to task demands has not been investigated. To capture the task-specific modulation of gamma power, we analyzed the EEG data recorded simultaneously with the aforementioned fMRI, focusing on the activity locked to and immediately preceding word articulation. Transient increases in gamma power were identified in a parietal electrode immediately before episodic and semantic word generation, however, within a different time frame relative to articulation. Gamma increases were followed by an alpha-theta decrease in the episodic condition, a gamma decrease in the semantic condition. This pattern indicates a task-specific modulation of the gamma signal corresponding to the specific demands of each word generation task. The gamma power and fMRI signal from the precuneus were correlated during the episodic condition, implying the existence of a common cognitive construct uniquely required for this task, possibly the reactivation or processing of spatiotemporal information.

Age-related differences in the neural basis of the subjective vividness of memories: evidence from multivoxel pattern classification

Although older adults often show reduced episodic memory accuracy, their ratings of the subjective vividness of their memories often equal or even exceed those of young adults. Such findings suggest that young and older adults may differentially access and/or weight different kinds of information in making vividness judgments. We examined this idea using multivoxel pattern classification of fMRI data to measure category representations while participants saw and remembered pictures of objects and scenes. Consistent with our hypothesis, there were age-related differences in how category representations related to the subjective sense of vividness. During remembering, older adults' vividness ratings were more related, relative to young adults', to category representations in prefrontal cortex. In contrast, young adults' vividness ratings were more related, relative to older adults, to category representations in parietal cortex. In addition, category representations were more correlated among posterior regions in young than in older adults, whereas correlations between PFC and posterior regions did not differ between the 2 groups. Together, these results are consistent with the idea that young and older adults differentially weight different types of information in assessing subjective vividness of their memories.

The Associative Memory Deficit in Aging Is Related to Reduced Selectivity of Brain Activity during Encoding

Human aging is characterized by reductions in the ability to remember associations between items, despite intact memory for single items. Older adults also show less selectivity in task-related brain activity, such that patterns of activation become less distinct across multiple experimental tasks. This reduced selectivity or dedifferentiation has been found for episodic memory, which is often reduced in older adults, but not for semantic memory, which is maintained with age. We used fMRI to investigate whether there is a specific reduction in selectivity of brain activity during associative encoding in older adults, but not during item encoding, and whether this reduction predicts associative memory performance. Healthy young and older adults were scanned while performing an incidental encoding task for pictures of objects and houses under item or associative instructions. An old/new recognition test was administered outside the scanner. We used agnostic canonical variates analysis and split-half resampling to detect whole-brain patterns of activation that predicted item versus associative encoding for stimuli that were later correctly recognized. Older adults had poorer memory for associations than did younger adults, whereas item memory was comparable across groups. Associative encoding trials, but not item encoding trials, were predicted less successfully in older compared with young adults, indicating less distinct patterns of associative-related activity in the older group. Importantly, higher probability of predicting associative encoding trials was related to better associative memory after accounting for age and performance on a battery of neuropsychological tests. These results provide evidence that neural distinctiveness at encoding supports associative memory and that a specific reduction of selectivity in neural recruitment underlies age differences in associative memory.

Neural Signatures of Controlled and Automatic Retrieval Processes in Memory-based Decision-making

Decision-making often requires retrieval from memory. Drawing on the neural ACT-R theory [Anderson, J. R., Fincham, J. M., Qin, Y., & Stocco, A. A central circuit of the mind. Trends in Cognitive Sciences, 12, 136-143, 2008] and other neural models of memory, we delineated the neural signatures of two fundamental retrieval aspects during decision-making: automatic and controlled activation of memory representations. To disentangle these processes, we combined a paradigm developed to examine neural correlates of selective and sequential memory retrieval in decision-making with a manipulation of associative fan (i.e., the decision options were associated with one, two, or three attributes). The results show that both the automatic activation of all attributes associated with a decision option and the controlled sequential retrieval of specific attributes can be traced in material-specific brain areas. Moreover, the two facets of memory retrieval were associated with distinct activation patterns within the frontoparietal network: The dorsolateral prefrontal cortex was found to reflect increasing retrieval effort during both automatic and controlled activation of attributes. In contrast, the superior parietal cortex only responded to controlled retrieval, arguably reflecting the sequential updating of attribute information in working memory. This dissociation in activation pattern is consistent with ACT-R and constitutes an important step toward a neural model of the retrieval dynamics involved in memory-based decision-making.

Retrieval Goal Modulates Memory for Context

fMRI was employed to assess whether the contents of recollection vary according to retrieval goal. At study, visually presented words were superimposed on urban or rural scenes or a gray background. The word-background pairs were presented in one of three spatial locations. During a scanned test phase, studied and unstudied words were presented. Two different source memory tasks were randomly interleaved. In the "background" task, the requirement was to judge whether the word had been presented against one of the two classes of scene, as opposed to the alternate class or the gray background. In the "location" task, discrimination was between words presented in one of the two lateral locations and words presented in either of the alternate locations. In both tasks, unstudied words required a separate response. In the background task, words studied against scenes elicited greater activity in parahippocampal and retrosplenial cortex than did words studied against the gray background, consistent with prior reports of scene reinstatement effects. Reinstatement effects were also evident in the location task. Relative to the background task, however, the effects were attenuated in parahippocampal cortex. In other regions, including medial prefrontal and posterior cingulate cortex, activity elicited in the location task by items associated with scenes was lower than that elicited by items presented on the gray background. The findings are interpreted as evidence that contextual retrieval is partially modulated by retrieval goal.

Predicting the integration of overlapping memories by decoding mnemonic processing states during learning

The hippocampal memory system is thought to alternate between two opposing processing states: encoding and retrieval. When present experience overlaps with past experience, this creates a potential tradeoff between encoding the present and retrieving the past. This tradeoff may be resolved by memory integration-that is, by forming a mnemonic representation that links present experience with overlapping past experience. Here, we used fMRI decoding analyses to predict when - and establish how - past and present experiences become integrated in memory. In an initial experiment, we alternately instructed subjects to adopt encoding, retrieval or integration states during overlapping learning. We then trained across-subject pattern classifiers to 'read out' the instructed processing states from fMRI activity patterns. We show that an integration state was clearly dissociable from encoding or retrieval states. Moreover, trial-by-trial fluctuations in decoded evidence for an integration state during learning reliably predicted behavioral expressions of successful memory integration. Strikingly, the decoding algorithm also successfully predicted specific instances of spontaneous memory integration in an entirely independent sample of subjects for whom processing state instructions were not administered. Finally, we show that medial prefrontal cortex and hippocampus differentially contribute to encoding, retrieval, and integration states: whereas hippocampus signals the tradeoff between encoding vs. retrieval states, medial prefrontal cortex actively represents past experience in relation to new learning.

Goal-Directed Modulation of Neural Memory Patterns: Implications for fMRI-Based Memory Detection

Remembering a past event elicits distributed neural patterns that can be distinguished from patterns elicited when encountering novel information. These differing patterns can be decoded with relatively high diagnostic accuracy for individual memories using multivoxel pattern analysis (MVPA) of fMRI data. Brain-based memory detection--if valid and reliable--would have clear utility beyond the domain of cognitive neuroscience, in the realm of law, marketing, and beyond. However, a significant boundary condition on memory decoding validity may be the deployment of "countermeasures": strategies used to mask memory signals. Here we tested the vulnerability of fMRI-based memory detection to countermeasures, using a paradigm that bears resemblance to eyewitness identification. Participants were scanned while performing two tasks on previously studied and novel faces: (1) a standard recognition memory task; and (2) a task wherein they attempted to conceal their true memory state. Univariate analyses revealed that participants were able to strategically modulate neural responses, averaged across trials, in regions implicated in memory retrieval, including the hippocampus and angular gyrus. Moreover, regions associated with goal-directed shifts of attention and thought substitution supported memory concealment, and those associated with memory generation supported novelty concealment. Critically, whereas MVPA enabled reliable classification of memory states when participants reported memory truthfully, the ability to decode memory on individual trials was compromised, even reversing, during attempts to conceal memory. Together, these findings demonstrate that strategic goal states can be deployed to mask memory-related neural patterns and foil memory decoding technology, placing a significant boundary condition on their real-world utility.

Evidence for holistic episodic recollection via hippocampal pattern completion

Recollection is thought to be the hallmark of episodic memory. Here we provide evidence that the hippocampus binds together the diverse elements forming an event, allowing holistic recollection via pattern completion of all elements. Participants learn complex ‘events' from multiple overlapping pairs of elements, and are tested on all pairwise associations. At encoding, element ‘types' (locations, people and objects/animals) produce activation in distinct neocortical regions, while hippocampal activity predicts memory performance for all within-event pairs. When retrieving a pairwise association, neocortical activity corresponding to all event elements is reinstated, including those incidental to the task. Participant's degree of incidental reinstatement correlates with their hippocampal activity. Our results suggest that event elements, represented in distinct neocortical regions, are bound into coherent ‘event engrams' in the hippocampus that enable episodic recollection—the re-experiencing or holistic retrieval of all aspects of an event—via a process of hippocampal pattern completion and neocortical reinstatement.

The holistic retrieval of complex event memories is thought to be the hallmark of episodic memory. Here, the authors provide behavioural and neuroimaging evidence that the hippocampus binds together the elements forming an event to allow holistic episodic recollection via pattern completion of all elements.

Cortical reinstatement and the confidence and accuracy of source memory

Cortical reinstatement refers to the overlap between neural activity elicited during the encoding and the subsequent retrieval of an episode, and is held to reflect retrieved mnemonic content. Previous findings have demonstrated that reinstatement effects reflect the quality of retrieved episodic information as this is operationalized by the accuracy of source memory judgments. The present functional magnetic resonance imaging (fMRI) study investigated whether reinstatement-related activity also co-varies with the confidence of accurate source judgments. Participants studied pictures of objects along with their visual or spoken names. At test, they first discriminated between studied and unstudied pictures and then, for each picture judged as studied, they also judged whether it had been paired with a visual or auditory name, using a three-point confidence scale. Accuracy of source memory judgments- and hence the quality of the source-specifying information--was greater for high than for low confidence judgments. Modality-selective retrieval-related activity (reinstatement effects) also co-varied with the confidence of the corresponding source memory judgment. The findings indicate that the quality of the information supporting accurate judgments of source memory is indexed by the relative magnitude of content-selective, retrieval-related neural activity.