Neural reinstatement and the amount of information recollected

Neural correlates of paired associate recollection: A neuroimaging meta-analysis

Functional neuroimaging data on paired associate recollection have expanded over the years, raising the need for an integrative understanding of the literature. The present study performed a quantitative meta-analysis of the data to fulfill that need. The meta-analysis focused on the three most widely used types of activation contrast: Hit > Miss, Intact > Rearranged, and Memory > Perception. The major results were as follows. First, the Hit > Miss contrast mainly involved regions in the default mode network (DMN)/medial temporal lobe (MTL), likely reflecting a greater amount of retrieved information during the Hit than Miss trials. Second, the Intact > Rearranged contrast mainly involved regions in the DMN/MTL, supporting the view that rejecting recombination foils is based on familiarity with the component parts in the absence of recollection. Third, the Memory > Perception contrast primarily involved regions in the frontoparietal control network, likely reflecting the greater demands on controlled processing during Memory than Perception conditions. Fourth, the subcortical clusters included the amygdala, caudate nucleus/putamen, and mediodorsal thalamus regions, suggesting that these regions are components of the neural circuits supporting associative recollection. Finally, comparisons with previous meta-analyses suggested that associative recollection involves the DMN regions more strongly than source recollection but less strongly than subjective recollection. In conclusion, this study contributes uniquely to the growing literature on paired associate recollection by clarifying the convergent findings and differences among studies.

Recollection and prior knowledge recruit the left angular gyrus during recognition

The human angular gyrus (AG) is implicated in recollection, or the ability to retrieve detailed memory content from a specific episode. A separate line of research examining the neural bases of more general mnemonic representations, extracted over multiple episodes, also highlights the AG as a core region of interest. To reconcile these separate views of AG function, the present fMRI experiment used a Remember-Know paradigm with famous (prior knowledge) and non-famous (no prior knowledge) faces to test whether AG activity could be modulated by both task-specific recollection and general prior knowledge within the same individuals. Increased BOLD activity in the left AG was observed during both recollection in the absence of prior knowledge (recollected > non-recollected or correctly rejected non-famous faces) and when prior knowledge was accessed in the absence of experiment-specific recollection (famous > non-famous correct rejections). This pattern was most prominent for the left AG as compared to the broader inferior parietal lobe. Recollection-related responses in the left AG increased with encoding duration and prior knowledge, despite prior knowledge being incidental to the recognition decision. Overall, the left AG appears sensitive to both task-specific recollection and the incidental access of general prior knowledge, thus broadening our notions of the kinds of mnemonic representations that drive activity in this region.

Neural signatures associated with temporal compression in the verbal retelling of past events

When we retell our past experiences, we aim to reproduce some version of the original events; this reproduced version is often temporally compressed relative to the original. However, it is currently unclear how this compression manifests in brain activity. One possibility is that a compressed retrieved memory manifests as a neural pattern which is more dissimilar to the original, relative to a more detailed or vivid memory. However, we argue that measuring raw dissimilarity alone is insufficient, as it confuses a variety of interesting and uninteresting changes. To address this problem, we examine brain pattern changes that are consistent across people. We show that temporal compression in individuals’ retelling of past events predicts systematic encoding-to-recall transformations in several higher associative regions. These findings elucidate how neural representations are not simply reactivated, but can also be transformed due to temporal compression during a universal form of human memory expression: verbal retelling.

Brain patterns measured while participants first watched a movie in the fMRI scanner, then recalled the movie’s key narrative features, demonstrate that temporal compression in individuals’ retelling of past events predicts encoding-to-recall transformations.

Representation of viewed and recalled film clips in patterns of brain activity in a person with developmental amnesia

As clear memories transport us back into the past, the brain also revives prior patterns of neural activity, a phenomenon known as neural reactivation. While growing evidence indicates a link between neural reactivation and typical variations in memory performance in healthy individuals, it is unclear how and to what extent reactivation is disrupted by a memory disorder. The current study characterizes neural reactivation in a case of amnesia using Multivoxel Pattern Analysis (MVPA). We tested NC, an individual with developmental amnesia linked to a diencephalic stroke, and 19 young adult controls on a functional magnetic resonance imaging (fMRI) task during which participants viewed and recalled short videos multiple times. An encoding classifier trained and tested to identify videos based on brain activity patterns elicited at perception revealed superior classification in NC. The enhanced consistency in stimulus representation we observed in NC at encoding was accompanied by an absence of multivariate repetition suppression, which occurred over repeated viewing in the controls. Another recall classifier trained and tested to identify videos during mental replay indicated normal levels of classification in NC, despite his poor memory for stimulus content. However, a cross-condition classifier trained on perception trials and tested on mental replay trials-a strict test of reactivation-revealed significantly poorer classification in NC. Thus, while NC's brain activity was consistent and stimulus-specific during mental replay, this specificity did not reflect the reactivation of patterns elicited at perception to the same extent as controls. Fittingly, we identified brain regions for which activity supported stimulus representation during mental replay to a greater extent in NC than in controls. This activity was not modeled on perception, suggesting that compensatory patterns of representation based on generic knowledge can support consistent mental constructs when memory is faulty. Our results reveal several ways in which amnesia impacts distributed patterns of stimulus representation during encoding and retrieval.

Age differences in the neural correlates of the specificity of recollection: An event-related potential study

In young adults, the neural correlates of successful recollection vary with the specificity (or amount) of information retrieved. We examined whether the neural correlates of recollection are modulated in a similar fashion in older adults. We compared event-related potential (ERP) correlates of recollection in samples of healthy young and older adults (N = 20 per age group). At study, participants were cued to make one of two judgments about each of a series of words. Subsequently, participants completed a memory test for studied and unstudied words in which they first made a Remember/Know/New (RKN) judgment, followed by a source memory judgment when a word attracted a 'Remember' (R) response. In young adults, the 'left parietal effect' - a putative ERP correlate of successful recollection - was largest for test items endorsed as recollected (R judgment) and attracting a correct source judgment, intermediate for items endorsed as recollected but attracting an incorrect or uncertain source judgment, and, relative to correct rejections, absent for items endorsed as familiar only (K judgment). In marked contrast, the left parietal effect was not detectable in older adults. Rather, regardless of source accuracy, studied items attracting an R response elicited a sustained, centrally maximum negative-going deflection relative to both correct rejections and studied items where recollection failed (K judgment). A similar retrieval-related negativity has been described previously in older adults, but the present findings are among the few to link this effect specifically to recollection. Finally, relative to correct rejections, all classes of correctly recognized old items elicited an age-invariant, late-onsetting positive deflection that was maximal over the right frontal scalp. This finding, which replicates several prior results, suggests that post-retrieval monitoring operations were engaged to an equivalent extent in the two age groups. Together, the present results suggest that there are circumstances where young and older adults engage qualitatively distinct retrieval-related processes during successful recollection.

NEVER forget: negative emotional valence enhances recapitulation

A hallmark feature of episodic memory is that of "mental time travel," whereby an individual feels they have returned to a prior moment in time. Cognitive and behavioral neuroscience methods have revealed a neurobiological counterpart: Successful retrieval often is associated with reactivation of a prior brain state. We review the emerging literature on memory reactivation and recapitulation, and we describe evidence for the effects of emotion on these processes. Based on this review, we propose a new model: Negative Emotional Valence Enhances Recapitulation (NEVER). This model diverges from existing models of emotional memory in three key ways. First, it underscores the effects of emotion during retrieval. Second, it stresses the importance of sensory processing to emotional memory. Third, it emphasizes how emotional valence - whether an event is negative or positive - affects the way that information is remembered. The model specifically proposes that, as compared to positive events, negative events both trigger increased encoding of sensory detail and elicit a closer resemblance between the sensory encoding signature and the sensory retrieval signature. The model also proposes that negative valence enhances the reactivation and storage of sensory details over offline periods, leading to a greater divergence between the sensory recapitulation of negative and positive memories over time. Importantly, the model proposes that these valence-based differences occur even when events are equated for arousal, thus rendering an exclusively arousal-based theory of emotional memory insufficient. We conclude by discussing implications of the model and suggesting directions for future research to test the tenets of the model.

Modulation of Oscillatory Power and Connectivity in the Human Posterior Cingulate Cortex Supports the Encoding and Retrieval of Episodic Memories

Existing data from noninvasive studies have led researchers to posit that the posterior cingulate cortex (PCC) supports mnemonic processes: It exhibits degeneration in memory disorders, and fMRI investigations have demonstrated memory-related activation principally during the retrieval of memory items. Despite these data, the role of the PCC in episodic memory has received only limited treatment using the spatial and temporal precision of intracranial EEG, with previous analyses focused on item retrieval. Using data gathered from 21 human participants who underwent stereo-EEG for seizure localization, we characterized oscillatory patterns in the PCC during the encoding and retrieval of episodic memories. We identified a subsequent memory effect during item encoding characterized by increased gamma band oscillatory power and a low-frequency power desynchronization. Fourteen participants had stereotactic electrodes located simultaneously in the hippocampus and PCC, and with these unique data, we describe connectivity changes between these structures that predict successful item encoding and that precede item retrieval. Oscillatory power during retrieval matched the pattern we observed during encoding, with low-frequency (below 15 Hz) desynchronization and a gamma band (especially high gamma, 70-180 Hz) power increase. Encoding is characterized by synchrony between the hippocampus and PCC, centered at 3 Hz, consistent with other observations of properties of this oscillation akin to those for rodent theta activity. We discuss our findings in light of existing theories of episodic memory processing, including the information via desynchronization hypothesis and retrieved context theory, and examine how our data fit with existing theories for the functional role of the PCC. These include a postulated role for the PCC in modulating internally directed attention and for representing or integrating contextual information for memory items.

Similarities and differences in the default mode network across rest, retrieval, and future imagining

The default mode network (DMN) has been identified reliably during rest, as well as during the performance of tasks such as episodic retrieval and future imagining. It remains unclear why this network is engaged across these seemingly distinct conditions, though many hypotheses have been proposed to account for these effects. Prior to generating hypotheses explaining common DMN involvement, the degree of commonality in the DMN across these conditions, within individuals, must be statistically determined to test whether or not the DMN is truly a unitary network, equally engaged across rest, retrieval and future imagining. To provide such a test, we used comparable paradigms (self-directed, uninterrupted thought of equal duration) across the three conditions (rest, retrieval, and future imagining) in a within-participant design. We found lower than expected pattern similarity in DMN functional connectivity across the three conditions. Similarity in connectivity accounted for only 40-50% of the total variance. Partial Least Squares (PLS) analyses revealed the medial temporal regions of the DMN were preferentially coupled with one another during episodic retrieval and future imagining, whereas the non-medial temporal regions of the DMN (e.g., medial prefrontal cortex, lateral temporal cortex, and temporal pole) were preferentially coupled during rest. These results suggest that DMN connectivity may be more flexible than previously considered. Our findings are in line with emerging evidence that the DMN is not a static network engaged commonly across distinct cognitive processes, but is instead a dynamic system, topographically changing in relation to ongoing cognitive demands. Hum Brain Mapp 38:1155-1171, 2017. © 2016 Wiley Periodicals, Inc.

Decoding fMRI Signatures of Real-world Autobiographical Memory Retrieval

Extant neuroimaging data implicate frontoparietal and medial-temporal lobe regions in episodic retrieval, and the specific pattern of activity within and across these regions is diagnostic of an individual's subjective mnemonic experience. For example, in laboratory-based paradigms, memories for recently encoded faces can be accurately decoded from single-trial fMRI patterns [Uncapher, M. R., Boyd-Meredith, J. T., Chow, T. E., Rissman, J., & Wagner, A. D. Goal-directed modulation of neural memory patterns: Implications for fMRI-based memory detection. Journal of Neuroscience, 35, 8531–8545, 2015; Rissman, J., Greely, H. T., & Wagner, A. D. Detecting individual memories through the neural decoding of memory states and past experience. Proceedings of the National Academy of Sciences, U.S.A., 107, 9849–9854, 2010]. Here, we investigated the neural patterns underlying memory for real-world autobiographical events, probed at 1- to 3-week retention intervals as well as whether distinct patterns are associated with different subjective memory states. For 3 weeks, participants (n = 16) wore digital cameras that captured photographs of their daily activities. One week later, they were scanned while making memory judgments about sequences of photos depicting events from their own lives or events captured by the cameras of others. Whole-brain multivoxel pattern analysis achieved near-perfect accuracy at distinguishing correctly recognized events from correctly rejected novel events, and decoding performance did not significantly vary with retention interval. Multivoxel pattern classifiers also differentiated recollection from familiarity and reliably decoded the subjective strength of recollection, of familiarity, or of novelty. Classification-based brain maps revealed dissociable neural signatures of these mnemonic states, with activity patterns in hippocampus, medial PFC, and ventral parietal cortex being particularly diagnostic of recollection. Finally, a classifier trained on previously acquired laboratory-based memory data achieved reliable decoding of autobiographical memory states. We discuss the implications for neuroscientific accounts of episodic retrieval and comment on the potential forensic use of fMRI for probing experiential knowledge.

Distributed Patterns of Reactivation Predict Vividness of Recollection

According to the principle of reactivation, memory retrieval evokes patterns of brain activity that resemble those instantiated when an event was first experienced. Intuitively, one would expect neural reactivation to contribute to recollection (i.e., the vivid impression of reliving past events), but evidence of a direct relationship between the subjective quality of recollection and multiregional reactivation of item-specific neural patterns is lacking. The current study assessed this relationship using fMRI to measure brain activity as participants viewed and mentally replayed a set of short videos. We used multivoxel pattern analysis to train a classifier to identify individual videos based on brain activity evoked during perception and tested how accurately the classifier could distinguish among videos during mental replay. Classification accuracy correlated positively with memory vividness, indicating that the specificity of multivariate brain patterns observed during memory retrieval was related to the subjective quality of a memory. In addition, we identified a set of brain regions whose univariate activity during retrieval predicted both memory vividness and the strength of the classifier's prediction irrespective of the particular video that was retrieved. Our results establish distributed patterns of neural reactivation as a valid and objective marker of the quality of recollection.

Cortical and subcortical contributions to sequence retrieval: Schematic coding of temporal context in the neocortical recollection network

Episodic memory entails the ability to remember what happened when. Although the available evidence indicates that the hippocampus plays a role in structuring serial order information during retrieval of event sequences, information processed in the hippocampus must be conveyed to other cortical and subcortical areas in order to guide behavior. However, the extent to which other brain regions contribute to the temporal organization of episodic memory remains unclear. Here, we examined multivoxel activity pattern changes during retrieval of learned and random object sequences, focusing on a neocortical "core recollection network" that includes the medial prefrontal cortex, retrosplenial cortex, and angular gyrus, as well as on striatal areas including the caudate nucleus and putamen that have been implicated in processing of sequence information. The results demonstrate that regions of the core recollection network carry information about temporal positions within object sequences, irrespective of object information. This schematic coding of temporal information is in contrast to the putamen, which carried information specific to objects in learned sequences, and the caudate, which carried information about objects, irrespective of sequence context. Our results suggest a role for the cortical recollection network in the representation of temporal structure of events during episodic retrieval, and highlight the possible mechanisms by which the striatal areas may contribute to this process. More broadly, the results indicate that temporal sequence retrieval is a useful paradigm for dissecting the contributions of specific brain regions to episodic memory.