The neural correlates of recollection: transient versus sustained FMRI effects

Switching off: disruptive TMS reveals distinct contributions of the posterior middle temporal gyrus and angular gyrus to bilingual speech production

The role of the left temporoparietal cortex in speech production has been extensively studied during native language processing, proving crucial in controlled lexico-semantic retrieval under varying cognitive demands. Yet, its role in bilinguals, fluent in both native and second languages, remains poorly understood. Here, we employed continuous theta burst stimulation to disrupt neural activity in the left posterior middle-temporal gyrus (pMTG) and angular gyrus (AG) while Italian-Friulian bilinguals performed a cued picture-naming task. The task involved between-language (naming objects in Italian or Friulian) and within-language blocks (naming objects ["knife"] or associated actions ["cut"] in a single language) in which participants could either maintain (non-switch) or change (switch) instructions based on cues. During within-language blocks, cTBS over the pMTG entailed faster naming for high-demanding switch trials, while cTBS to the AG elicited slower latencies in low-demanding non-switch trials. No cTBS effects were observed in the between-language block. Our findings suggest a causal involvement of the left pMTG and AG in lexico-semantic processing across languages, with distinct contributions to controlled vs. "automatic" retrieval, respectively. However, they do not support the existence of shared control mechanisms within and between language(s) production. Altogether, these results inform neurobiological models of semantic control in bilinguals.

The influence of the precuneus on the medial temporal cortex determines the subjective quality of memory during the retrieval of naturalistic episodes

Memory retrieval entails dynamic interactions between the medial temporal lobe and areas in the parietal and frontal cortices. Here, we tested the hypothesis that effective connectivity between the precuneus, in the medial parietal cortex, and the medial temporal cortex contributes to the subjective quality of remembering objects together with information about their rich spatio-temporal encoding context. During a 45 min encoding session, the participants were presented with pictures of objects while they actively explored a virtual town. The following day, under fMRI, participants were presented with images of objects and had to report whether: they recognized the object and could remember the place/time of encoding, the object was familiar only, or the object was new. The hippocampus/parahippocampus, the precuneus and the ventro-medial prefrontal cortex activated when the participants successfully recognized objects they had seen in the virtual town and reported that they could remember the place/time of these events. Analyses of effective connectivity showed that the influence exerted by the precuneus on the medial temporal cortex mediates this effect of episodic recollection. Our findings demonstrate the role of the inter-regional connectivity in mediating the subjective experience of remembering and underline the relevance of studying memory in contextually-rich conditions.

Age differences in the neural correlates of recollection: transient versus sustained fMRI effects

Prior functional magnetic resonance imaging findings in young adults indicate that recollection-sensitive neural regions dissociate according to the time courses of their respective recollection effects. Here, we examined whether such dissociations are also evident in older adults. Young and older participants encoded a series of word-image pairs, judging which of the denoted objects was the smaller. At the test, participants judged whether each of a series of test words was old or new. If a word was old, the requirement was to recall the associated image and maintain it over a variable delay period. Older adults demonstrated significantly lower associative memory performance than young adults. Transient recollection effects were identified in the left hippocampus, medial prefrontal cortex, and posterior cingulate, while sustained effects were widespread across left lateral cortex and were also evident in the bilateral striatum. Except for those in the left insula, all effects were age-invariant. These findings suggest that both transient and sustained recollection effects are largely stable across much of the healthy adult life span.

The effects of age on neural correlates of recollection: transient versus sustained fMRI effects

Prior fMRI findings in young adults indicate that recollection-sensitive neural regions dissociate according to the time courses of their respective recollection effects. Here, we examined whether such dissociations are also evident in older adults. Young and older participants encoded a series of word-object image pairs, judging which of the denoted objects was the smaller. At test, participants first judged whether a test word was old or new. For items judged old, they were required to recall the associated image and hold it in mind across a variable delay period. A post-delay cue denoted which of three judgments should be made on the retrieved image. Older adults demonstrated significantly lower associative memory performance than young adults. Replicating prior findings, transient recollection effects were identified in the left hippocampus, medial prefrontal cortex and posterior cingulate, while sustained effects were widespread across left lateral cortex and were also evident in the bilateral striatum. With the exception of those in the left insula, all effects were age-invariant. These findings add to the evidence that recollection-related BOLD effects in different neural regions can be temporally dissociated. Additionally, the findings suggest that both transient and sustained recollection effects are largely stable across much of the healthy adult lifespan.

Neural correlates of paired associate recollection: A neuroimaging meta-analysis

Functional neuroimaging data on paired associate recollection have expanded over the years, raising the need for an integrative understanding of the literature. The present study performed a quantitative meta-analysis of the data to fulfill that need. The meta-analysis focused on the three most widely used types of activation contrast: Hit > Miss, Intact > Rearranged, and Memory > Perception. The major results were as follows. First, the Hit > Miss contrast mainly involved regions in the default mode network (DMN)/medial temporal lobe (MTL), likely reflecting a greater amount of retrieved information during the Hit than Miss trials. Second, the Intact > Rearranged contrast mainly involved regions in the DMN/MTL, supporting the view that rejecting recombination foils is based on familiarity with the component parts in the absence of recollection. Third, the Memory > Perception contrast primarily involved regions in the frontoparietal control network, likely reflecting the greater demands on controlled processing during Memory than Perception conditions. Fourth, the subcortical clusters included the amygdala, caudate nucleus/putamen, and mediodorsal thalamus regions, suggesting that these regions are components of the neural circuits supporting associative recollection. Finally, comparisons with previous meta-analyses suggested that associative recollection involves the DMN regions more strongly than source recollection but less strongly than subjective recollection. In conclusion, this study contributes uniquely to the growing literature on paired associate recollection by clarifying the convergent findings and differences among studies.

Similarity in activity and laterality patterns in the angular gyrus during autobiographical memory retrieval and self-referential processing

Long-term memory is arguably one of the key cognitive functions. At the neural level, the lateral parietal cortex and the angular gyrus, particularly in the left hemisphere, exhibit strong activations during autobiographical and episodic memory retrieval. In a separate sub-field, left-lateralized activations of the angular gyrus are also found during self-referential processing, defined as higher activity when a trait term is judged by participants as being related to them vs. related to someone else. The question is whether episodic/autobiographical memory retrieval and self-referential processing effects are related. In the present study, thirty participants participated in the fMRI study with two separate experiments: autobiographical memory retrieval (Experiment 1) and self-referential processing (Experiment 2). In a series of analyses, including the most critical spatial correlation analysis between experiments, we found neural similarity between autobiographical memory retrieval and self-referential processing. Given that self-referential processing was identified in a selective way, the most plausible interpretation of our findings is that self-referential processing might partly explain the activation of the left angular gyrus during autobiographical memory retrieval. Our results are in line with the seminal view of Endel Tulving that the sense of self is a fundamental attribute of long-term memory recollection. However, it should be emphasized that: a) our results do not imply that the left angular gyrus is not involved in the retrieval of episodic memory details; and b) given that our experiment included an autobiographical memory task, generalization of our results to the episodic memory laboratory tasks has yet to be tested.

Dual-axes of functional organisation across lateral parietal cortex: the angular gyrus forms part of a multi-modal buffering system

Decades of neuropsychological and neuroimaging evidence have implicated the lateral parietal cortex (LPC) in a myriad of cognitive domains, generating numerous influential theoretical models. However, these theories fail to explain why distinct cognitive activities appear to implicate common neural regions. Here we discuss a unifying model in which the angular gyrus forms part of a wider LPC system with a core underlying neurocomputational function; the multi-sensory buffering of spatio-temporally extended representations. We review the principles derived from computational modelling with neuroimaging task data and functional and structural connectivity measures that underpin the unified neurocomputational framework. We propose that although a variety of cognitive activities might draw on shared underlying machinery, variations in task preference across angular gyrus, and wider LPC, arise from graded changes in the underlying structural connectivity of the region to different input/output information sources. More specifically, we propose two primary axes of organisation: a dorsal-ventral axis and an anterior-posterior axis, with variations in task preference arising from underlying connectivity to different core cognitive networks (e.g. the executive, language, visual, or episodic memory networks).

The functional dissociation of posterior parietal regions during multimodal memory formation

The incidental acquisition of multimodal associations is a key memory function for everyday life. While the posterior parietal cortex has been frequently shown to be involved for these memory functions, ventral and dorsal regions revealed differences in their functional recruitment and the precise difference in multimodal memory processing with respect to the associative process has not been differentiated. Using an incidental multimodal learning task, we isolated the associative process during multimodal learning and recollection. The result of the present functional magnetic resonance imaging (fMRI) study demonstrated that during both learning and recollection a clear functional differentiation between ventral and dorsal posterior parietal regions was found and can be related directly to the associative process. The recruitment of a ventral region, the angular gyrus, was specific for learning and recollection of multimodal associations. In contrast, a dorsal region, the superior parietal lobule, could be attributed to memory guided attentional processing. Independent of the memory stage, we assumed a general role for the angular gyrus in the generation of associative representations and updating of fixed association, episodic memory.

Lesion-behaviour mapping reveals multifactorial neurocognitive processes in recognition memory for unfamiliar faces

Face recognition abilities, which play a critical role in social interactions, involve face processing and identifying familiar faces, but also remembering one-off encounters with previously unfamiliar faces. Previous functional imaging and lesion studies have found evidence for temporal, frontal, and parietal contributions to episodic recognition memory for previously unfamiliar faces. However, the functional contributions of these regions remain unclear. We, therefore, conducted a systematic group analysis of this memory function using lesion-behavior mapping. 95 first-event stroke patients (53 with right- and 42 with left-hemisphere damage) in the sub-acute phase performed the Wechsler Memory Scale (WMS-III) face recognition memory subtest. We analyzed their performance relative to 75 healthy controls, using signal detection measures. To identify brain lesions specifically implicated in face recognition deficits, we used voxel-based lesion-behavior mapping (VLBM; an analysis comparing the performance of participants with and without damage affecting a given voxel). Behavioral analysis disclosed a pronounced impairment in the performance of patients with right hemisphere damage. Frontal damage was associated with an increased amount of false alarms (i.e., failed rejection of new face items) and overly liberal criterion setting, without affecting the recognition of studied faces. In contrast, parietal damage was associated with impaired recognition of studied faces, which was more pronounced in immediate than in delayed retrieval. These findings suggest the existence of multifactorial neurocognitive processes in recognition memory for unfamiliar faces.

Theta rhythmicity governs human behavior and hippocampal signals during memory-dependent tasks

Memory formation and reinstatement are thought to lock to the hippocampal theta rhythm, predicting that encoding and retrieval processes appear rhythmic themselves. Here, we show that rhythmicity can be observed in behavioral responses from memory tasks, where participants indicate, using button presses, the timing of encoding and recall of cue-object associative memories. We find no evidence for rhythmicity in button presses for visual tasks using the same stimuli, or for questions about already retrieved objects. The oscillations for correctly remembered trials center in the slow theta frequency range (1-5 Hz). Using intracranial EEG recordings, we show that the memory task induces temporally extended phase consistency in hippocampal local field potentials at slow theta frequencies, but significantly more for remembered than forgotten trials, providing a potential mechanistic underpinning for the theta oscillations found in behavioral responses.

Brain Mechanisms Underlying the Subjective Experience of Remembering

The ability to remember events in vivid, multisensory detail is a significant part of human experience, allowing us to relive previous encounters and providing us with the store of memories that shape our identity. Recent research has sought to understand the subjective experience of remembering, that is, what it feels like to have a memory. Such remembering involves reactivating sensory-perceptual features of an event and the thoughts and feelings we had when the event occurred, integrating them into a conscious first-person experience. It allows us to reflect on the content of our memories and to understand and make judgments about them, such as distinguishing events that actually occurred from those we might have imagined or been told about. In this review, we consider recent evidence from functional neuroimaging in healthy participants and studies of neurological and psychiatric conditions, which is shedding new light on how we subjectively experience remembering. Expected final online publication date for the Annual Review of Psychology, Volume 73 is January 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Reinstatement of Event Details during Episodic Simulation in the Hippocampus

According to the constructive episodic simulation hypothesis, episodic simulation (i.e., imagining specific novel future episodes) draws on some of the same neurocognitive processes that support episodic memory (i.e., recalling specific past episodes). Episodic retrieval supports the ability to simulate future experiences by providing access to episodic details (e.g., the people and locations that comprise memories) that can be recombined in new ways. In the current functional neuroimaging study, we test this hypothesis by examining whether the hippocampus, a region implicated in the reinstatement of episodic information during memory, supports reinstatement of episodic information during simulation. Employing a multivoxel pattern similarity analysis, we interrogated the similarity between hippocampal neural patterns during memory and simulation at the level of individual event details. Our findings indicate that the hippocampus supports the reinstatement of detail-specific information from episodic memory during simulation, with the level of reinstatement contributing to the subjective experience of simulated details.

Mapping the organization and dynamics of the posterior medial network during movie watching

Brain regions within a posterior medial network (PMN) are characterized by sensitivity to episodic tasks, and they also demonstrate strong functional connectivity as part of the default network. Despite its cohesive structure, delineating the intranetwork organization and functional diversity of the PMN is crucial for understanding its contributions to multidimensional event cognition. Here, we probed functional connectivity of the PMN during movie watching to identify its pattern of connections and subnetwork functions in a split-sample replication of 136 participants. Consistent with prior findings of default network fractionation, we identified distinct PMN subsystems: a Ventral PM subsystem (retrosplenial cortex, parahippocampal cortex, posterior angular gyrus) and a Dorsal PM subsystem (medial prefrontal cortex, hippocampus, precuneus, posterior cingulate cortex, anterior angular gyrus). Ventral and Dorsal PM subsystems were differentiated by functional connectivity with parahippocampal cortex and precuneus and integrated by retrosplenial cortex and posterior cingulate cortex, respectively. Finally, the distinction between PMN subsystems is functionally relevant: whereas both Dorsal and Ventral PM connectivity tracked the movie content, only Ventral PM connections increased in strength at event transitions and appeared sensitive to episodic memory. Overall, these findings reveal PMN functional pathways and the distinct functional roles of intranetwork subsystems during event cognition.

Roles of the Default Mode and Multiple-Demand Networks in Naturalistic versus Symbolic Decisions

The default mode network (DMN) is often associated with representing semantic, social, and situational content of contexts and episodes. The DMN may therefore be important for contextual decision-making, through representing situational constraints and simulating common courses of events. Most decision-making paradigms, however, use symbolic stimuli and instead implicate cognitive control regions, such as the multiple demand (MD) system. This fMRI study aimed to contrast the brain mechanisms underlying decision-making based on rich naturalistic contexts or symbolic cues. While performing an ongoing task, 40 human participants (25 female) responded to different sounds. For one sound, the stimulus-response mapping was fixed; responses for the other sounds depended on the visual context: either lifelike scenes or letter symbols, varying across participants. Despite minimal behavioral differences between the groups, posterior DMN regions showed increased activity during context-dependent decision-making using the naturalistic scenes only, compared with symbolic cues. More anterior temporal and frontal DMN regions showed a different pattern, with sensitivity to the need for contextual control, but not to the type of context. Furthermore, in the scenes group, widespread DMN regions showed stronger representation of not just the context but also the sound whose significance it modulated. In comparison, the MD system showed strong univariate activity for every decision, but, intriguingly, somewhat reduced activity in the case of a scene-based but demanding context-dependent decision. Depending on context, we suggest, either DMN or MD regions may play a prominent role in selection and control of appropriate behavior.

SIGNIFICANCE STATEMENT Contextual knowledge is widely believed to be important for guiding real-world goal-directed behavior. Much remains to be understood, however, regarding the underlying brain mechanisms. Using a novel paradigm to contrast decisions based on richly meaningful naturalistic scenes with decisions based on symbolic cues, we find that both multiple demand regions and default mode regions may contribute to the cognitive control of behavior. Rich semantic context enhances representation not just of the context itself, but also of the contents of the decision that it controls. Dependence of a decision on naturalistic context can also reverse the common pattern of multiple demand regions responding more, and default mode regions responding less, to more difficult decisions.

The Left Angular Gyrus Is Causally Involved in Context-dependent Integration and Associative Encoding during Narrative Reading

The role of the left angular gyrus (AG) in language processing remains unclear. In this study, we used TMS to test the hypothesis that the left AG causally supports the processes necessary for context-dependent integration and encoding of information during language processing. We applied on-line TMS over the left AG to disrupt the on-line context-dependent integration during a language reading task, specifically while human participants integrated information between two sequentially presented paragraphs of text ("context" and "target" paragraphs). We assessed the effect of TMS on the left AG by asking participants to retrieve integrated contextual information when given the target condition as cue in a successive memory task. Results from the memory task showed that TMS applied over the left AG during reading impaired the formation of integrated context-target representation. These results provide the first evidence of a causal link between the left AG function, on-line information integration, and associative encoding during language processing.

A Unifying Account of Angular Gyrus Contributions to Episodic and Semantic Cognition

The angular gyrus (AG) region of lateral parietal cortex has been implicated in a wide variety of tasks and functions, generating numerous influential theories. However, these theories largely fail to explain why so many apparently distinct cognitive activities implicate common parietal structures. We propose a unifying model, based on a set of central principles, to account for coalescences of cognitive task activations across AG. To illustrate the proposed framework, we show how these principles account for findings from studies of episodic and semantic memory that have independently implicated the same AG regions but thus far been considered from largely domain-specific perspectives. We conclude that AG computations, as part of a wider lateral parietal system, enable the online dynamic buffering of multisensory spatiotemporally extended representations.

Neural substrates of long-term item and source memory for emotional associates: An fMRI study

Since Tulving's influential work on the distinction between familiarity and recollection-based retrieval, numerous studies have found evidence for differential contribution of these retrieval mechanisms on emotional episodic memory. Particularly, retrieval advantage for emotional, compared to neutral, information has been related to recollection-, but not familiarity-mediated processes. Neuroimaging studies suggest that this recollection-based retrieval for emotional information is related to stronger engagement of regions in the medial temporal lobe (MTL), posterior parietal cortex (PPC), and prefrontal cortex (PFC). In the present study, we investigated neural correlates related to long-term memory of neutral information that has been associated with emotional and neutral contexts, using functional magnetic resonance imaging (fMRI). During encoding, different neutral objects integrated with emotional or neutral scenes were presented. One week later, the encoded objects were intermixed with new ones and participants had to indicate whether the objects were previously seen or not, using the Remember/Know procedure (item memory). Furthermore, memory for the correct scene background category was also tested (contextual source memory). First, replicating previous findings, we observed a preference for recollection-dependent memory retrieval versus familiarity-dependent memory retrieval for those neutral objects encoded in emotional compared to neutral contexts. Second, consistent with these behavioral effects, objects encoded with emotional, compared to neutral, scenes produced larger memory-related activity in recollection-sensitive brain regions, including PPC and PFC regions. Third, correctly retrieved emotional compared to neutral contextual information was associated with increased activity in these brain areas. Together, these results suggest that memory for information encoded in emotional contexts is remarkably robust over time and mediated by recollection-based processes.

Flexible recruitment of memory-based choice representations by the human medial frontal cortex

Decision-making in complex environments relies on flexibly using prior experience. This process depends on the medial frontal cortex (MFC) and the medial temporal lobe, but it remains unknown how these structures implement selective memory retrieval. We recorded single neurons in the MFC, amygdala, and hippocampus while human subjects switched between making recognition memory-based and categorization-based decisions. The MFC rapidly implemented changing task demands by using different subspaces of neural activity and by representing the currently relevant task goal. Choices requiring memory retrieval selectively engaged phase-locking of MFC neurons to amygdala and hippocampus field potentials, thereby enabling the routing of memories. These findings reveal a mechanism for flexibly and selectively engaging memory retrieval and show that memory-based choices are preferentially represented in the frontal cortex when required.

Deconstructing the Posterior Medial Episodic Network

Our ability to remember or imagine specific events involves the construction of complex mental representations, a process that engages cortical and hippocampal regions in a core posterior medial (PM) brain network. Existing theoretical approaches have described the overarching contributions of the PM network, but less is known about how episodic content is represented and transformed throughout this system. Here, we review evidence of key functional interactions among PM regions and their relation to the core cognitive operations and representations supporting episodic construction. Recent demonstrations of intranetwork functional diversity are integrated with existing accounts to inform a network-based model of episodic construction, in which PM regions flexibly share and manipulate event information to support the variable phenomenology of episodic memory and simulation.

Context-Dependent Coding of Temporal Distance Between Cinematic Events in the Human Precuneus

How temporal and contextual information interactively impact on behavior and brain activity during the retrieval of temporal order about naturalistic episodes remains incompletely understood. Here, we used fMRI to examine the effects of contextual signals derived from the content of the movie on the neural correlates underlying memory retrieval of temporal-order in human subjects of both sexes. By contrasting SAME versus DIFF storyline conditions during the retrieval of the temporal order of cinematic events, we found that the activation in the precuneus, as well as behavior, are significantly modulated according to storyline condition, supporting our prediction of contextual information contributing to temporal retrieval. We suggest that the precuneus engages in memory retrieval via reconstructive mechanisms, entailing search within a movie-specific, situational knowledge-structure. Furthermore, information-based analyses of multivoxel activity revealed that the precuneus also contains a context-independent linear representation of temporal distances, consistent with a chronological organization of memory traces. We thus put forward that the retrieval of the temporal-order of naturalistic events encoded in rich and dynamic contexts relies on the joint contribution of chronological and reconstructive mechanisms, both of which rely on the medioposterior parietal cortex in humans.SIGNIFICANCE STATEMENT Successful retrieval of episodic memory is dependent on both temporal and contextual signals. However, when contextual signals derived from multiple storylines or narratives are complex and intertwined, the behavioral and neural correlates underpinning the interplay between time and context is not completely understood. Here we characterized the activation level and multivoxel pattern of BOLD signals underlying the modulation of such contextual information during temporal order judgment in the precuneus. Our findings provide us with an elucidation of subprocesses implicating the medial parietal cortex in realizing temporal organization of episodic details.

Abnormal distraction and load-specific connectivity during working memory in cognitively normal Parkinson's disease

Visuospatial working memory impairments are common in Parkinson's disease (PD), yet the underlying neural mechanisms are poorly understood. The present study investigated abnormalities in context‐dependent functional connectivity of working memory hubs in PD. Cognitively normal PD and control participants underwent fMRI while performing a visuospatial working memory task. To identify sources of dysfunction, distraction, and load‐modulated connectivity were disentangled for encoding and retrieval phases of the task. Despite normal working memory performance in PD, two features of abnormal connectivity were observed, one due to a loss in normal context‐related connectivity and another related to upregulated connectivity of hubs for which the controls did not exhibit context‐dependent connectivity. During encoding, striatal‐prefrontal coupling was lost in PD, both during distraction and high memory loads. However, long‐range connectivity of prefrontal, medial temporal and occipital hubs was upregulated in a context‐specific manner. Memory retrieval was characterized by different aberrant connectivity patterns, wherein precuneus connectivity was upregulated during distraction, whereas prefrontal couplings were lost as memory load approached capacity limits. Features of abnormal functional connectivity in PD had pathological and compensatory influences as they correlated with poorer working memory or better visuospatial skills. The results offer new insights into working memory‐related signatures of aberrant cortico–cortical and corticostriatal functional connections, which may portend future declines in different facets of working memory.

The effect of rule retrieval on activity in the default mode network

The default mode network (DMN) is often associated with internally-directed cognition, distinct from the constraints of the external environment. However, a recent finding is that the DMN shows strong activation after large task switches during a demanding externally-directed task (Crittenden et al., 2015; Smith et al., 2018). Following other proposals, we have suggested that the DMN encodes cognitive or environmental context, and that context representations are momentarily strengthened during large cognitive switches, perhaps so that new activity can be checked against current environmental constraints. An alternative account, consistent with the role of the DMN in episodic memory, might be that switches to a substantially new task increase demands on rule retrieval. To test this alternative, we directly manipulated rule retrieval demands. Contrary to the retrieval account, increased retrieval demand led to reduced DMN activity, accompanied by increased activation in prefrontal and lateral parietal cognitive control areas. Unlike episodic retrieval, with its rich contextual representations, rule retrieval does not drive DMN activity. Accordingly, it cannot explain increased DMN activity during large cognitive switches.

Reduced Visual and Frontal Cortex Activation During Visual Working Memory in Grapheme-Color Synaesthetes Relative to Young and Older Adults

The sensory recruitment model envisages visual working memory (VWM) as an emergent property that is encoded and maintained in sensory (visual) regions. The model implies that enhanced sensory-perceptual functions, as in synaesthesia, entail a dedicated VWM-system, showing reduced visual cortex activity as a result of neural specificity. By contrast, sensory-perceptual decline, as in old age, is expected to show enhanced visual cortex activity as a result of neural broadening. To test this model, young grapheme-color synaesthetes, older adults and young controls engaged in a delayed pair-associative retrieval and a delayed matching-to-sample task, consisting of achromatic fractal stimuli that do not induce synaesthesia. While a previous analysis of this dataset (Pfeifer et al., 2016) has focused on cued retrieval and recognition of pair-associates (i.e., long-term memory), the current study focuses on visual working memory and considers, for the first time, the crucial delay period in which no visual stimuli are present, but working memory processes are engaged. Participants were trained to criterion and demonstrated comparable behavioral performance on VWM tasks. Whole-brain and region-of-interest-analyses revealed significantly lower activity in synaesthetes’ middle frontal gyrus and visual regions (cuneus, inferior temporal cortex), respectively, suggesting greater neural efficiency relative to young and older adults in both tasks. The results support the sensory recruitment model and can explain age and individual WM-differences based on neural specificity in visual cortex.

Exploring the neurocognitive basis of episodic recollection in autism

Increasing evidence indicates that the subjective experience of recollection is diminished in autism spectrum disorder (ASD) compared to neurotypical individuals. The neurocognitive basis of this difference in how past events are re-experienced has been debated and various theoretical accounts have been proposed to date. Although each existing theory may capture particular features of memory in ASD, recent research questions whether any of these explanations are alone sufficient or indeed fully supported. This review first briefly considers the cognitive neuroscience of how episodic recollection operates in the neurotypical population, informing predictions about the encoding and retrieval mechanisms that might function atypically in ASD. We then review existing research on recollection in ASD, which has often not distinguished between different theoretical explanations. Recent evidence suggests a distinct difficulty engaging recollective retrieval processes, specifically the ability to consciously reconstruct and monitor a past experience, which is likely underpinned by altered functional interactions between neurocognitive systems rather than brain region-specific or process-specific dysfunction. This integrative approach serves to highlight how memory research in ASD may enhance our understanding of memory processes and networks in the typical brain. We make suggestions for future research that are important for further specifying the neurocognitive basis of episodic recollection in ASD and linking such difficulties to social developmental and educational outcomes.

Role of the Default Mode Network in Cognitive Transitions

A frequently repeated finding is that the default mode network (DMN) shows activation decreases during externally focused tasks. This finding has led to an emphasis in DMN research on internally focused self-relevant thought processes. A recent study, in contrast, implicates the DMN in substantial externally focused task switches. Using functional magnetic resonance imaging, we scanned 24 participants performing a task switch experiment. Whilst replicating previous DMN task switch effects, we also found large DMN increases for brief rests as well as task restarts after rest. Our findings are difficult to explain using theories strictly linked to internal or self-directed cognition. In line with principal results from the literature, we suggest that the DMN encodes scene, episode or context, by integrating spatial, self-referential, and temporal information. Context representations are strong at rest, but rereference to context also occurs at major cognitive transitions.

Reduced Hippocampal Functional Connectivity During Episodic Memory Retrieval in Autism

Increasing recent research has sought to understand the recollection impairments experienced by individuals with autism spectrum disorder (ASD). Here, we tested whether these memory deficits reflect a reduction in the probability of retrieval success or in the precision of memory representations. We also used functional magnetic resonance imaging (fMRI) to study the neural mechanisms underlying memory encoding and retrieval in ASD, focusing particularly on the functional connectivity of core episodic memory networks. Adults with ASD and typical control participants completed a memory task that involved studying visual displays and subsequently using a continuous dial to recreate their appearance. The ASD group exhibited reduced retrieval success, but there was no evidence of a difference in retrieval precision. fMRI data revealed similar patterns of brain activity and functional connectivity during memory encoding in the 2 groups, though encoding-related lateral frontal activity predicted subsequent retrieval success only in the control group. During memory retrieval, the ASD group exhibited attenuated lateral frontal activity and substantially reduced hippocampal connectivity, particularly between hippocampus and regions of the fronto-parietal control network. These findings demonstrate notable differences in brain function during episodic memory retrieval in ASD and highlight the importance of functional connectivity to understanding recollection-related retrieval deficits in this population.

Neuronal baseline shifts underlying boundary setting during free recall

Asked to freely recall items from a predefined set (e.g., animals), we rarely recall a wrong exemplar (e.g., a vegetable). This capability is so powerful and effortless that it is essentially taken for granted, yet, surprisingly, the underlying neuronal mechanisms are unknown. Here we investigate this boundary setting mechanism using intracranial recordings (ECoG), in 12 patients undergoing epilepsy monitoring engaged in episodic free recall. After viewing vivid photographs from two categories (famous faces and places), patients were asked to freely recall these items, targeting each category in separate blocks. Our results reveal a rapid and sustained rise in neuronal activity (“baseline shift”) in high-order visual areas that persists throughout the free recall period and reflects the targeted category. We further show a more transient reactivation linked to individual recall events. The results point to baseline shift as a flexible top−down mechanism that biases spontaneous recall to remain within the required categorical boundaries.

Though people are easily able to recall items in a category without mentioning a wrong exemplar, the mechanism underlying this ability is unknown. Here, authors use intracranial recordings to show that this ability is likely due to a selective increase in baseline neuronal activity in category-specific regions.

Rethinking the Role of the Angular Gyrus in Remembering the Past and Imagining the Future: The Contextual Integration Model

Despite consistent activation on tasks of episodic memory, the precise contribution of the left angular gyrus (AG) to mnemonic functions remains vigorously debated. Mounting evidence suggests that AG activity scales with subjective ratings of vividness and confidence in recollection, with further evidence pointing to its involvement during construction of detailed and coherent future simulations. Lesion studies, however, indicate that damage to the AG does not render patients amnesic on standard source and associative memory paradigms. To reconcile these findings, we present the Contextual Integration Model as a unifying framework that couches the mnemonic role of the AG in terms of multimodal integration and representation of contextual information across temporal contexts. Irrespective of whether one is remembering the past or constructing future or hypothetical scenarios, the Contextual Integration Model holds that the core elements of an event (i.e., the who, what, when, where) are bound within the medial temporal lobes while the multimodal details, which give rise to perceptually rich recollection, are integrated and represented in the AG. Building on previous work, the Contextual Integration Model therefore provides a comprehensive exposition of the mnemonic and constructive functions of the AG across temporal contexts, offering a novel test-bed for future work.

Characterizing the role of the hippocampus during episodic simulation and encoding

The hippocampus has been consistently associated with episodic simulation (i.e., the mental construction of a possible future episode). In a recent study, we identified an anterior-posterior temporal dissociation within the hippocampus during simulation. Specifically, transient simulation-related activity occurred in relatively posterior portions of the hippocampus and sustained activity occurred in anterior portions. In line with previous theoretical proposals of hippocampal function during simulation, the posterior hippocampal activity was interpreted as reflecting a transient retrieval process for the episodic details necessary to construct an episode. In contrast, the sustained anterior hippocampal activity was interpreted as reflecting the continual recruitment of encoding and/or relational processing associated with a simulation. In the present study, we provide a direct test of these interpretations by conducting a subsequent memory analysis of our previously published data to assess whether successful encoding during episodic simulation is associated with the anterior hippocampus. Analyses revealed a subsequent memory effect (i.e., later remembered > later forgotten simulations) in the anterior hippocampus. The subsequent memory effect was transient and not sustained. Taken together, the current findings provide further support for a component process model of hippocampal function during simulation. That is, unique regions of the hippocampus support dissociable processes during simulation, which include the transient retrieval of episodic information, the sustained binding of such information into a coherent episode, and the transient encoding of that episode for later retrieval.

Cortical representation of persistent visual stimuli

Research into visual neural activity has focused almost exclusively on onset- or change-driven responses and little is known about how information is encoded in the brain during sustained periods of visual perception. We used intracranial recordings in humans to determine the degree to which the presence of a visual stimulus is persistently encoded by neural activity. The correspondence between stimulus duration and neural response duration was strongest in early visual cortex and gradually diminished along the visual hierarchy, such that is was weakest in inferior-temporal category-selective regions. A similar posterior-anterior gradient was found within inferior temporal face-selective regions, with posterior but not anterior sites showing persistent face-selective activity. The results suggest that regions that appear uniform in terms of their category selectivity are dissociated by how they temporally represent a stimulus in support of ongoing visual perception, and delineate a large-scale organizing principle of the ventral visual stream.

Ventral lateral parietal cortex and episodic memory retrieval

With the advent of functional neuroimaging it quickly became apparent that successful episodic memory retrieval was consistently associated with enhanced activity in ventral lateral parietal cortex (VLPC), especially the left angular gyrus. Here, we selectively review recent neuropsychological and functional neuroimaging evidence relevant to the question of the functional significance of this activity. We argue that the balance of the evidence suggests that the angular gyrus supports the representation of retrieved episodic information, and that this likely reflects a more general role for the region in representing multi-modal and multi-domain information.

Recognition memory: Cellular evidence of a massive contribution of the LEC to familiarity and a lack of involvement of the hippocampal subfields CA1 and CA3

A highly debated issue in memory research is whether familiarity is supported by the parahippocampal region, especially the lateral (LEC) and the perirhinal (PER) cortices, or whether it is supported by the same brain structure as recollection: the hippocampus. One reason for this is that conflicting results have emerged regarding the contribution of the hippocampus to familiarity. This might stem from the lack of dissociation between hippocampal subfields CA1 and CA3 as these areas are involved to a different extent in processes which are pertinent to familiarity. Another reason is that empirical evidence for a contribution of the LEC is still missing. Furthermore, it is unclear whether the superficial and the deep layers of the LEC would equally contribute to this process as these layers are differentially recruited during memory retrieval which partly relies on familiarity. To identify the specific contribution of the LEC, CA1, and CA3, we imaged with cellular resolution activity in the brain of rats performing a version of a standard human memory task adapted to rats that yields judgments based on familiarity. Using this translational approach, we report that in striking contrast to CA1 and CA3, the LEC is recruited for familiarity-judgments and that its contribution is comparable to that of the PER. These results show for the first time that the LEC, specifically its deep layers, contributes to familiarity and constitute the first cellular evidence that the hippocampus does not, thus establishing that familiarity does not share the same neural substrate as recollection.

A short cut to the past: Cueing via concrete objects improves autobiographical memory retrieval in Alzheimer's disease patients

Older adults diagnosed with Alzheimer's disease (AD) have difficulties accessing autobiographical memories. However, this deficit tends to spare memories dated to earlier parts of their lives, and may partially reflect retrieval deficits rather than complete memory loss. Introducing a novel paradigm, the present study examines whether autobiographical memory recall can be improved in AD by manipulating the sensory richness, concreteness and cultural dating of the memory cues. Specifically, we examine whether concrete everyday objects historically dated to the participants' youth (e.g., a skipping rope), relative to verbal cues (i.e., the verbal signifiers for the objects) facilitate access to autobiographical memories. The study includes 49 AD patients, and 50 healthy, older matched control participants, all tested on word versus object-cued recall. Both groups recalled significantly more memories, when cued by objects relative to words, but the advantage was significantly larger in the AD group. In both groups, memory descriptions were longer and significantly more episodic in nature in response to object-cued recall. Together these findings suggest that the multimodal nature of the object cues (i.e. vision, olfaction, audition, somatic sensation) along with specific cue characteristics, such as time reference, texture, shape, may constrain the retrieval search, potentially minimizing executive function demands, and hence strategic processing requirements, thus easing access to autobiographical memories in AD.

The contribution of the human posterior parietal cortex to episodic memory

The posterior parietal cortex (PPC) is traditionally associated with attention, perceptual decision making and sensorimotor transformations, but more recent human neuroimaging studies support an additional role in episodic memory retrieval. In this Opinion article, we present a functional-anatomical model of the involvement of the PPC in memory retrieval. Parietal regions involved in perceptual attention and episodic memory are largely segregated and often show a push-pull relationship, potentially mediated by prefrontal regions. Moreover, different PPC regions carry out specific functions during retrieval - for example, representing retrieved information, recoding this information based on task demands, or accumulating evidence for memory decisions.

Contextually Mediated Spontaneous Retrieval Is Specific to the Hippocampus

Although it is now well established that the hippocampus supports memory encoding [1, 2], little is known about hippocampal activity during spontaneous memory retrieval. Recent intracranial electroencephalographic (iEEG) work has shown that hippocampal activity during encoding predicts subsequent temporal organization of memories [3], supporting a role in contextual binding. It is an open question, however, whether the hippocampus similarly supports contextually mediated processes during retrieval. Here, we analyzed iEEG recordings obtained from 215 epilepsy patients as they performed a free recall task. To identify neural activity specifically associated with contextual retrieval, we compared correct recalls, intrusions (incorrect recall of either items from prior lists or items not previously studied), and deliberations (matched periods during recall when no items came to mind). Neural signals that differentiate correct recalls from both other retrieval classes reflect contextual retrieval, as correct recalls alone arise from the correct context. We found that in the hippocampus, high-frequency activity (HFA, 44-100 Hz), a proxy for neural activation [4], was greater prior to correct recalls relative to the other retrieval classes, with no differentiation between intrusions and deliberations. This pattern was not observed in other memory-related cortical regions, including DLPFC, thus supporting a specific hippocampal contribution to contextually mediated memory retrieval.

Imagining the future: The core episodic simulation network dissociates as a function of timecourse and the amount of simulated information

Neuroimaging data indicate that episodic memory (i.e., remembering specific past experiences) and episodic simulation (i.e., imagining specific future experiences) are associated with enhanced activity in a common set of neural regions, often referred to as the core network. This network comprises the hippocampus, parahippocampal cortex, lateral and medial parietal cortex, lateral temporal cortex, and medial prefrontal cortex. Evidence for a core network has been taken as support for the idea that episodic memory and episodic simulation are supported by common processes. Much remains to be learned about how specific core network regions contribute to specific aspects of episodic simulation. Prior neuroimaging studies of episodic memory indicate that certain regions within the core network are differentially sensitive to the amount of information recollected (e.g., the left lateral parietal cortex). In addition, certain core network regions dissociate as a function of their timecourse of engagement during episodic memory (e.g., transient activity in the posterior hippocampus and sustained activity in the left lateral parietal cortex). In the current study, we assessed whether similar dissociations could be observed during episodic simulation. We found that the left lateral parietal cortex modulates as a function of the amount of simulated details. Of particular interest, while the hippocampus was insensitive to the amount of simulated details, we observed a temporal dissociation within the hippocampus: transient activity occurred in relatively posterior portions of the hippocampus and sustained activity occurred in anterior portions. Because the posterior hippocampal and lateral parietal findings parallel those observed during episodic memory, the present results add to the evidence that episodic memory and episodic simulation are supported by common processes. Critically, the present study also provides evidence that regions within the core network support dissociable processes.

Decoding the content of recollection within the core recollection network and beyond

Recollection - retrieval of qualitative information about a past event - is associated with enhanced neural activity in a consistent set of neural regions (the 'core recollection network') seemingly regardless of the nature of the recollected content. Here, we employed multi-voxel pattern analysis (MVPA) to assess whether retrieval-related functional magnetic resonance imaging (fMRI) activity in core recollection regions - including the hippocampus, angular gyrus, medial prefrontal cortex, retrosplenial/posterior cingulate cortex, and middle temporal gyrus - contain information about studied content and thus demonstrate retrieval-related 'reinstatement' effects. During study, participants viewed objects and concrete words that were subjected to different encoding tasks. Test items included studied words, the names of studied objects, or unstudied words. Participants judged whether the items were recollected, familiar, or new by making 'remember', 'know', and 'new' responses, respectively. The study history of remembered test items could be reliably decoded using MVPA in most regions, as well as from the dorsolateral prefrontal cortex, a region where univariate recollection effects could not be detected. The findings add to evidence that members of the core recollection network, as well as at least one neural region where mean signal is insensitive to recollection success, carry information about recollected content. Importantly, the study history of recognized items endorsed with a 'know' response could be decoded with equal accuracy. The results thus demonstrate a striking dissociation between mean signal and multi-voxel indices of recollection. Moreover, they converge with prior findings in suggesting that, as it is operationalized by classification-based MVPA, reinstatement is not uniquely a signature of recollection.

Memória de Reconhecimento: Modelos de Processamento Simples versus Duplo

Resumo O processo de reconhecimento de memórias consiste em discriminar informações previamente encontradas de informações novas. Duas abordagens teóricas divergentes buscam explicar esse fenômeno. A primeira propõe que o reconhecimento se baseia essencialmente na sensação de familiaridade gerada por cada estímulo. A segunda propõe que além da intensidade da familiaridade, a evocação de aspectos qualitativos e contextuais dos eventos memorizados possui um papel fundamental no processo de reconhecimento. Aspectos teóricos e metodológicos inerentes às duas linhas teóricas são criticamente discutidos no presente artigo, sendo que o resultado dessa discussão se apresenta favorável à segunda perspectiva teórica.

Distinct neural mechanisms underlie the success, precision, and vividness of episodic memory

A network of brain regions have been linked with episodic memory retrieval, but limited progress has been made in identifying the contributions of distinct parts of the network. Here, we utilized continuous measures of retrieval to dissociate three components of episodic memory: retrieval success, precision, and vividness. In the fMRI scanner, participants encoded objects that varied continuously on three features: color, orientation, and location. Participants’ memory was tested by having them recreate the appearance of the object features using a continuous dial, and continuous vividness judgments were recorded. Retrieval success, precision, and vividness were dissociable both behaviorally and neurally: successful versus unsuccessful retrieval was associated with hippocampal activity, retrieval precision scaled with activity in the angular gyrus, and vividness judgments tracked activity in the precuneus. The ability to dissociate these components of episodic memory reveals the benefit afforded by measuring memory on a continuous scale, allowing functional parcellation of the retrieval network.

DOI:http://dx.doi.org/10.7554/eLife.18260.001

Remembering is something we do countless times each day. The detail and vividness with which we can remember is part of what makes memories so precious. Given the significance and complexity of memories, it is perhaps unsurprising that several parts of the brain are needed for us to experience them. Indeed, the brain regions involved in memory all work so closely together that it is a challenge to identify what role each region plays.

Richter, Cooper et al. aimed to design a memory task that could separate key characteristics of remembering, which would allow them to study links between each aspect and the different brain regions involved in memory. The resulting test involved showing people images of different objects whilst they were in an MRI medical imaging scanner. The people taking the test were asked to remember several objects that could vary in color, position and orientation. Participants were asked to rate how vividly they remembered the objects and then tried to precisely recreate their color, orientation and position.

The test allowed Richter, Cooper et al. to link specific parts of the brain to certain aspects of remembering. The hippocampus, an area known to be important in memory processing, indicated whether or not information had been remembered. More vivid memories were linked to greater activity in a region called the precuneus, which plays a role in imagination. Lastly, activity in a third region – the angular gyrus – indicated the precision of each memory.

Being able to study different aspects of memory using tests like this that collect detailed measurements could be important in identifying memory problems, for example, in people with brain diseases or head injuries, or after a stroke. Specifically, the methods developed by Richter, Cooper et al. could provide sensitive tools for detecting memory difficulties at an early stage. This may help more people to get treated sooner, potentially minimizing lasting complications.

DOI:http://dx.doi.org/10.7554/eLife.18260.002

Two Distinct Scene-Processing Networks Connecting Vision and Memory

A number of regions in the human brain are known to be involved in processing natural scenes, but the field has lacked a unifying framework for understanding how these different regions are organized and interact. We provide evidence from functional connectivity and meta-analyses for a new organizational principle, in which scene processing relies upon two distinct networks that split the classically defined parahippocampal place area (PPA). The first network of strongly connected regions consists of the occipital place area/transverse occipital sulcus and posterior PPA, which contain retinotopic maps and are not strongly coupled to the hippocampus at rest. The second network consists of the caudal inferior parietal lobule, retrosplenial complex, and anterior PPA, which connect to the hippocampus (especially anterior hippocampus), and are implicated in both visual and nonvisual tasks, including episodic memory and navigation. We propose that these two distinct networks capture the primary functional division among scene-processing regions, between those that process visual features from the current view of a scene and those that connect information from a current scene view with a much broader temporal and spatial context. This new framework for understanding the neural substrates of scene-processing bridges results from many lines of research, and makes specific functional predictions.

Neural Global Pattern Similarity Underlies True and False Memories

The neural processes giving rise to human memory strength signals remain poorly understood. Inspired by formal computational models that posit a central role of global matching in memory strength, we tested a novel hypothesis that the strengths of both true and false memories arise from the global similarity of an item's neural activation pattern during retrieval to that of all the studied items during encoding (i.e., the encoding-retrieval neural global pattern similarity [ER-nGPS]). We revealed multiple ER-nGPS signals that carried distinct information and contributed differentially to true and false memories: Whereas the ER-nGPS in the parietal regions reflected semantic similarity and was scaled with the recognition strengths of both true and false memories, ER-nGPS in the visual cortex contributed solely to true memory. Moreover, ER-nGPS differences between the parietal and visual cortices were correlated with frontal monitoring processes. By combining computational and neuroimaging approaches, our results advance a mechanistic understanding of memory strength in recognition.

SIGNIFICANCE STATEMENT

What neural processes give rise to memory strength signals, and lead to our conscious feelings of familiarity? Using fMRI, we found that the memory strength of a given item depends not only on how it was encoded during learning, but also on the similarity of its neural representation with other studied items. The global neural matching signal, mainly in the parietal lobule, could account for the memory strengths of both studied and unstudied items. Interestingly, a different global matching signal, originated from the visual cortex, could distinguish true from false memories. The findings reveal multiple neural mechanisms underlying the memory strengths of events registered in the brain.

Integration Processes Compared: Cortical Differences for Consistency Evaluation and Passive Comprehension in Local and Global Coherence

This research studies the neural systems underlying two integration processes that take place during natural discourse comprehension: consistency evaluation and passive comprehension. Evaluation was operationalized with a consistency judgment task and passive comprehension with a passive listening task. Using fMRI, the experiment examined the integration of incoming sentences with more recent, local context and with more distal, global context in these two tasks. The stimuli were stories in which we manipulated the consistency of the endings with the local context and the relevance of the global context for the integration of the endings. A whole-brain analysis revealed several differences between the two tasks. Two networks previously associated with semantic processing and attention orienting showed more activation during the judgment than the passive listening task. A network previously associated with episodic memory retrieval and construction of mental scenes showed greater activity when global context was relevant, but only during the judgment task. This suggests that evaluation, more than passive listening, triggers the reinstantiation of global context and the construction of a rich mental model for the story. Finally, a network previously linked to fluent updating of a knowledge base showed greater activity for locally consistent endings than inconsistent ones, but only during passive listening, suggesting a mode of comprehension that relies on a local scope approach to language processing. Taken together, these results show that consistency evaluation and passive comprehension weigh differently on distal and local information and are implemented, in part, by different brain networks.

Typicality sharpens category representations in object-selective cortex

The purpose of categorization is to identify generalizable classes of objects whose members can be treated equivalently. Within a category, however, some exemplars are more representative of that concept than others. Despite long-standing behavioral effects, little is known about how typicality influences the neural representation of real-world objects from the same category. Using fMRI, we showed participants 64 subordinate object categories (exemplars) grouped into 8 basic categories. Typicality for each exemplar was assessed behaviorally and we used several multi-voxel pattern analyses to characterize how typicality affects the pattern of responses elicited in early visual and object-selective areas: V1, V2, V3v, hV4, LOC. We found that in LOC, but not in early areas, typical exemplars elicited activity more similar to the central category tendency and created sharper category boundaries than less typical exemplars, suggesting that typicality enhances within-category similarity and between-category dissimilarity. Additionally, we uncovered a brain region (cIPL) where category boundaries favor less typical categories. Our results suggest that typicality may constitute a previously unexplored principle of organization for intra-category neural structure and, furthermore, that this representation is not directly reflected in image features describing natural input, but rather built by the visual system at an intermediate processing stage.

Attending to auditory memory

Attention to memory describes the process of attending to memory traces when the object is no longer present. It has been studied primarily for representations of visual stimuli with only few studies examining attention to sound object representations in short-term memory. Here, we review the interplay of attention and auditory memory with an emphasis on 1) attending to auditory memory in the absence of related external stimuli (i.e., reflective attention) and 2) effects of existing memory on guiding attention. Attention to auditory memory is discussed in the context of change deafness, and we argue that failures to detect changes in our auditory environments are most likely the result of a faulty comparison system of incoming and stored information. Also, objects are the primary building blocks of auditory attention, but attention can also be directed to individual features (e.g., pitch). We review short-term and long-term memory guided modulation of attention based on characteristic features, location, and/or semantic properties of auditory objects, and propose that auditory attention to memory pathways emerge after sensory memory. A neural model for auditory attention to memory is developed, which comprises two separate pathways in the parietal cortex, one involved in attention to higher-order features and the other involved in attention to sensory information. This article is part of a Special Issue entitled SI: Auditory working memory.