Brain Mechanisms Underlying the Subjective Experience of Remembering

Grounding Cognition in Perceptual Experience

The aim of this Special Issue was to put forward a multifaceted reflection on the relevance of perceptual experience in affecting and modeling various aspects of cognitive performance [...].

Frequency-specific directed connectivity between the hippocampus and parietal cortex during verbal and spatial episodic memory: an intracranial EEG replication

Hippocampus-parietal cortex circuits are thought to play a crucial role in memory and attention, but their neural basis remains poorly understood. We employed intracranial intracranial electroencephalography (iEEG) to investigate the neurophysiological underpinning of these circuits across three memory tasks spanning verbal and spatial domains. We uncovered a consistent pattern of higher causal directed connectivity from the hippocampus to both lateral parietal cortex (supramarginal and angular gyrus) and medial parietal cortex (posterior cingulate cortex) in the delta-theta band during memory encoding and recall. This connectivity was independent of activation or suppression states in the hippocampus or parietal cortex. Crucially, directed connectivity from the supramarginal gyrus to the hippocampus was enhanced in participants with higher memory recall, highlighting its behavioral significance. Our findings align with the attention-to-memory model, which posits that attention directs cognitive resources toward pertinent information during memory formation. The robustness of these results was demonstrated through Bayesian replication analysis of the memory encoding and recall periods across the three tasks. Our study sheds light on the neural basis of casual signaling within hippocampus-parietal circuits, broadening our understanding of their critical roles in human cognition.

Constructive Memory and Conscious Experience

Episodic memory relies on constructive processes that support simulating novel future events by flexibly recombining elements of past experiences, and that can also give rise to memory errors. In recent studies, we have developed methods to characterize the cognitive and neural processes that support conscious experiences linked to this process of episodic recombination, both when people simulate novel future events and commit recombination-related memory errors. In this Perspective, we summarize recent studies that illustrate these phenomena, and discuss broader implications for characterizing the basis of conscious experiences associated with constructive memory from a cognitive neuroscience perspective.

The influence of the precuneus on the medial temporal cortex determines the subjective quality of memory during the retrieval of naturalistic episodes

Memory retrieval entails dynamic interactions between the medial temporal lobe and areas in the parietal and frontal cortices. Here, we tested the hypothesis that effective connectivity between the precuneus, in the medial parietal cortex, and the medial temporal cortex contributes to the subjective quality of remembering objects together with information about their rich spatio-temporal encoding context. During a 45 min encoding session, the participants were presented with pictures of objects while they actively explored a virtual town. The following day, under fMRI, participants were presented with images of objects and had to report whether: they recognized the object and could remember the place/time of encoding, the object was familiar only, or the object was new. The hippocampus/parahippocampus, the precuneus and the ventro-medial prefrontal cortex activated when the participants successfully recognized objects they had seen in the virtual town and reported that they could remember the place/time of these events. Analyses of effective connectivity showed that the influence exerted by the precuneus on the medial temporal cortex mediates this effect of episodic recollection. Our findings demonstrate the role of the inter-regional connectivity in mediating the subjective experience of remembering and underline the relevance of studying memory in contextually-rich conditions.

Hippocampal-parietal cortex causal directed connectivity during human episodic memory formation: Replication across three experiments

Hippocampus-parietal cortex circuits are thought to play a crucial role in memory and attention, but their neural basis remains poorly understood. We employed intracranial EEG from 96 participants (51 females) to investigate the neurophysiological underpinning of these circuits across three memory tasks spanning verbal and spatial domains. We uncovered a consistent pattern of higher causal directed connectivity from the hippocampus to both lateral parietal cortex (supramarginal and angular gyrus) and medial parietal cortex (posterior cingulate cortex) in the delta-theta band during memory encoding and recall. This connectivity was independent of activation or suppression states in the hippocampus or parietal cortex. Crucially, directed connectivity from the supramarginal gyrus to the hippocampus was enhanced in participants with higher memory recall, highlighting its behavioral significance. Our findings align with the attention-to-memory model, which posits that attention directs cognitive resources toward pertinent information during memory formation. The robustness of these results was demonstrated through Bayesian replication analysis of the memory encoding and recall periods across the three tasks. Our study sheds light on the neural basis of casual signaling within hippocampus-parietal circuits, broadening our understanding of their critical roles in human cognition.

The Subjective Experience of Autobiographical Remembering: Conceptual and Methodological Advances and Challenges

The investigation of the phenomenology of autobiographical memories (i.e., how a memory is subjectively experienced and its meaning) has provided an important contribution to our understanding of autobiographical remembering. Over the last two decades, the study of phenomenology has received widespread scientific attention, and the field has undergone quite relevant conceptual and methodological changes. In the present work, we (1) review some basic and well-established research findings and methodological achievements; (2) discuss new theoretical and methodological challenges, with a special focus on the issue of the phenomenological experience of the retrieval process and its relationship with the phenomenology of the products of retrieval; and (3) propose an alternative way of conceptualizing and understanding it in the framework of experimental phenomenology.

Sense of own body shapes neural processes of memory encoding and reinstatement

How is the fundamental sense of one's body, a basic aspect of selfhood, incorporated into memories for events? Disrupting bodily self-awareness during encoding impairs functioning of the left posterior hippocampus during retrieval, which implies weakened encoding. However, how changes in bodily self-awareness influence neural encoding is unknown. We investigated how the sense of body ownership, a core aspect of the bodily self, impacts encoding in the left posterior hippocampus and additional core memory regions including the angular gyrus. Furthermore, we assessed the degree to which memories are reinstated according to body ownership during encoding and vividness during retrieval as a measure of memory strength. We immersed participants in naturalistic scenes where events unfolded while we manipulated feelings of body ownership with a full-body-illusion during functional magnetic resonance imaging scanning. One week later, participants retrieved memories for the videos during functional magnetic resonance imaging scanning. A whole brain analysis revealed that patterns of activity in regions including the right hippocampus and angular gyrus distinguished between events encoded with strong versus weak body ownership. A planned region-of-interest analysis showed that patterns of activity in the left posterior hippocampus specifically could predict body ownership during memory encoding. Using the wider network of regions sensitive to body ownership during encoding and the left posterior hippocampus as separate regions-of-interest, we observed that patterns of activity present at encoding were reinstated more during the retrieval of events encoded with strong body ownership and high memory vividness. Our results demonstrate how the sense of physical self is bound within an event during encoding, which facilitates reactivation of a memory trace during retrieval.

Inner speech as language process and cognitive tool

Many people report a form of internal language known as inner speech (IS). This review examines recent growth of research interest in the phenomenon, which has broadly supported a theoretical model in which IS is a functional language process that can confer benefits for cognition in a range of domains. A key insight to have emerged in recent years is that IS is an embodied experience characterized by varied subjective qualities, which can be usefully modeled in artificial systems and whose neural signals have the potential to be decoded through advancing brain-computer interface technologies. Challenges for future research include understanding individual differences in IS and mapping form to function across IS subtypes.

A spontaneous neural replay account for involuntary autobiographical memories and déjà vu experiences

Barzykowski and Moulin argue both involuntary autobiographical memories and déjà vu experiences rely on the same involuntary memory retrieval processes but their underlying neurological basis remains unclear. We propose spontaneous neural replay in the default mode network (DMN) and hippocampus as the basis for involuntary autobiographical memories, whereas for déjà vu experiences such transient activation is limited to the DMN.

The role of bodily self-consciousness in episodic memory of naturalistic events: an immersive virtual reality study

Recent studies suggest that the human body plays a critical role in episodic memory. Still, the precise relationship between bodily self-consciousness (BSC) and memory formation of specific events, especially in real-life contexts, remains a topic of ongoing research. The present study investigated the relationship between BSC and episodic memory (EM) using immersive virtual reality (VR) technology. Participants were immersed in an urban environment with naturalistic events, while their visuomotor feedback was manipulated in three within-subjects conditions: Synchronous, Asynchronous, and No-body. Our results show that asynchronous visuomotor feedback and not seeing one's body, compared to synchronous feedback, decrease the sense of self-identification, self-location and agency, and sense of presence. Moreover, navigating in the Asynchronous condition had a detrimental impact on incidental event memory, perceptual details, contextual association, subjective sense of remembering, and memory consolidation. In contrast, participants in the No-Body condition were only impaired in egocentric spatial memory and the sense of remembering at ten-day delay. We discuss these findings in relation to the role of bodily self-representation in space during event memory encoding. This study sheds light on the complex interplay between BSC, sense of presence, and episodic memory processes, and strengthens the potential of embodiment and VR technology in studying and enhancing human cognition.

Conscious awareness and memory systems in the brain

The term "memory" typically refers to conscious retrieval of events and experiences from our past, but experience can also change our behaviour without corresponding awareness of the learning process or the associated outcome. Based primarily on early neuropsychological work, theoretical perspectives have distinguished between conscious memory, said to depend critically on structures in the medial temporal lobe (MTL), and a collection of performance-based memories that do not. The most influential of these memory systems perspectives, the declarative memory theory, continues to be a mainstay of scientific work today despite mounting evidence suggesting that contributions of MTL structures go beyond the kinds or types of memory that can be explicitly reported. Consistent with these reports, more recent perspectives have focused increasingly on the processing operations supported by particular brain regions and the qualities or characteristics of resulting representations whether memory is expressed with or without awareness. These alternatives to the standard model generally converge on two key points. First, the hippocampus is critical for relational memory binding and representation even without awareness and, second, there may be little difference between some types of priming and explicit, familiarity-based recognition. Here, we examine the evolution of memory systems perspectives and critically evaluate scientific evidence that has challenged the status quo. Along the way, we highlight some of the challenges that researchers encounter in the context of this work, which can be contentious, and describe innovative methods that have been used to examine unconscious memory in the lab. This article is categorized under: Psychology > Memory Psychology > Theory and Methods Philosophy > Consciousness.

Effects of prior knowledge on brain activation and functional connectivity during memory retrieval

Previous studies have shown that the ventral medial prefrontal cortex (vmPFC) plays an important role in schema-related memory. However, there is an intensive debate to what extent the activation of subregions of the hippocampus is involved in retrieving schema-related memory. In addition, it is unclear how the functional connectivity (FC) between the vmPFC and the hippocampus, as well as the connectivity of the vmPFC with other regions, are modulated by prior knowledge (PK) during memory retrieval over time. To address these issues, participants learned paragraphs that described features of each unfamiliar word from familiar and unfamiliar categories (i.e., high and low PK conditions) 20 min, 1 day, and 1 week before the test. They then performed a recognition task to judge whether the sentences were old in the scanner. The results showed that the activation of the anterior-medial hippocampus (amHPC) cluster was stronger when the old sentences with high (vs. low) PK were correctly retrieved. The activation of the posterior hippocampus (pHPC) cluster, as well as the vmPFC, was stronger when the new sentences with high (vs. low) PK were correctly rejected (i.e., CR trials), whereas the cluster of anterior-lateral hippocampus (alHPC) showed the opposite. The FC of the vmPFC with the amHPC and perirhinal cortex/inferior temporal gyrus was stronger in the high (vs. low) PK condition, whereas the FC of the vmPFC with the alHPC, thalamus and frontal regions showed the opposite for the CR trials. This study highlighted that different brain networks, which were associated with the vmPFC, subregions of the hippocampus and cognitive control regions, were responsible for retrieving the information with high and low PK.

20 years of the default mode network: A review and synthesis

The discovery of the default mode network (DMN) has revolutionized our understanding of the workings of the human brain. Here, I review developments that led to the discovery of the DMN, offer a personal reflection, and consider how our ideas of DMN function have evolved over the past two decades. I summarize literature examining the role of the DMN in self-reference, social cognition, episodic and autobiographical memory, language and semantic memory, and mind wandering. I identify unifying themes and propose new perspectives on the DMN's role in human cognition. I argue that the DMN integrates and broadcasts memory, language, and semantic representations to create a coherent "internal narrative" reflecting our individual experiences. This narrative is central to the construction of a sense of self, shapes how we perceive ourselves and interact with others, may have ontogenetic origins in self-directed speech during childhood, and forms a vital component of human consciousness.

Variational relevance evaluation of individual fMRI data enables deconstruction of task-dependent neural dynamics

In neuroimaging research, univariate analysis has always been used to localize "representations" at the microscale, whereas network approaches have been applied to characterize transregional "operations". How are representations and operations linked through dynamic interactions? We developed the variational relevance evaluation (VRE) method to analyze individual task fMRI data, which selects informative voxels during model training to localize the "representation", and quantifies the dynamic contributions of single voxels across the whole-brain to different cognitive functions to characterize the "operation". Using 15 individual fMRI data files for higher visual area localizers, we evaluated the characterization of selected voxel positions of VRE and revealed different object-selective regions functioning in similar dynamics. Using another 15 individual fMRI data files for memory retrieval after offline learning, we found similar task-related regions working in different neural dynamics for tasks with diverse familiarities. VRE demonstrates a promising horizon in individual fMRI research.

Towards a pluralistic neurobiological understanding of consciousness

Theories of consciousness are often based on the assumption that a single, unified neurobiological account will explain different types of conscious awareness. However, recent findings show that, even within a single modality such as conscious visual perception, the anatomical location, timing, and information flow of neural activity related to conscious awareness vary depending on both external and internal factors. This suggests that the search for generic neural correlates of consciousness may not be fruitful. I argue that consciousness science requires a more pluralistic approach and propose a new framework: joint determinant theory (JDT). This theory may be capable of accommodating different brain circuit mechanisms for conscious contents as varied as percepts, wills, memories, emotions, and thoughts, as well as their integrated experience.

Reduced memory precision in older age is associated with functional and structural differences in the angular gyrus

Decreased fidelity of mnemonic representations plays a critical role in age-related episodic memory deficits, yet the brain mechanisms underlying such reductions remain unclear. Using functional and structural neuroimaging, we examined how changes in two key nodes of the posterior-medial network, the hippocampus and the angular gyrus (AG), might underpin loss of memory precision in older age. Healthy young and older adults completed a memory task that involved reconstructing object features on a continuous scale. Investigation of blood-oxygen-level-dependent (BOLD) activity during retrieval revealed an age-related reduction in activity reflecting successful recovery of object features in the hippocampus, whereas trial-wise modulation of BOLD signal by graded memory precision was diminished in the AG. Gray matter volume of the AG further predicted individual differences in memory precision in older age, beyond likelihood of successful retrieval. These findings provide converging evidence for a role of functional and structural integrity of the AG in constraining the fidelity of episodic remembering in older age, yielding new insights into parietal contributions to age-related episodic memory decline.

Neural correlates of paired associate recollection: A neuroimaging meta-analysis

Functional neuroimaging data on paired associate recollection have expanded over the years, raising the need for an integrative understanding of the literature. The present study performed a quantitative meta-analysis of the data to fulfill that need. The meta-analysis focused on the three most widely used types of activation contrast: Hit > Miss, Intact > Rearranged, and Memory > Perception. The major results were as follows. First, the Hit > Miss contrast mainly involved regions in the default mode network (DMN)/medial temporal lobe (MTL), likely reflecting a greater amount of retrieved information during the Hit than Miss trials. Second, the Intact > Rearranged contrast mainly involved regions in the DMN/MTL, supporting the view that rejecting recombination foils is based on familiarity with the component parts in the absence of recollection. Third, the Memory > Perception contrast primarily involved regions in the frontoparietal control network, likely reflecting the greater demands on controlled processing during Memory than Perception conditions. Fourth, the subcortical clusters included the amygdala, caudate nucleus/putamen, and mediodorsal thalamus regions, suggesting that these regions are components of the neural circuits supporting associative recollection. Finally, comparisons with previous meta-analyses suggested that associative recollection involves the DMN regions more strongly than source recollection but less strongly than subjective recollection. In conclusion, this study contributes uniquely to the growing literature on paired associate recollection by clarifying the convergent findings and differences among studies.

Recollection and prior knowledge recruit the left angular gyrus during recognition

The human angular gyrus (AG) is implicated in recollection, or the ability to retrieve detailed memory content from a specific episode. A separate line of research examining the neural bases of more general mnemonic representations, extracted over multiple episodes, also highlights the AG as a core region of interest. To reconcile these separate views of AG function, the present fMRI experiment used a Remember-Know paradigm with famous (prior knowledge) and non-famous (no prior knowledge) faces to test whether AG activity could be modulated by both task-specific recollection and general prior knowledge within the same individuals. Increased BOLD activity in the left AG was observed during both recollection in the absence of prior knowledge (recollected > non-recollected or correctly rejected non-famous faces) and when prior knowledge was accessed in the absence of experiment-specific recollection (famous > non-famous correct rejections). This pattern was most prominent for the left AG as compared to the broader inferior parietal lobe. Recollection-related responses in the left AG increased with encoding duration and prior knowledge, despite prior knowledge being incidental to the recognition decision. Overall, the left AG appears sensitive to both task-specific recollection and the incidental access of general prior knowledge, thus broadening our notions of the kinds of mnemonic representations that drive activity in this region.

Similarity in activity and laterality patterns in the angular gyrus during autobiographical memory retrieval and self-referential processing

Long-term memory is arguably one of the key cognitive functions. At the neural level, the lateral parietal cortex and the angular gyrus, particularly in the left hemisphere, exhibit strong activations during autobiographical and episodic memory retrieval. In a separate sub-field, left-lateralized activations of the angular gyrus are also found during self-referential processing, defined as higher activity when a trait term is judged by participants as being related to them vs. related to someone else. The question is whether episodic/autobiographical memory retrieval and self-referential processing effects are related. In the present study, thirty participants participated in the fMRI study with two separate experiments: autobiographical memory retrieval (Experiment 1) and self-referential processing (Experiment 2). In a series of analyses, including the most critical spatial correlation analysis between experiments, we found neural similarity between autobiographical memory retrieval and self-referential processing. Given that self-referential processing was identified in a selective way, the most plausible interpretation of our findings is that self-referential processing might partly explain the activation of the left angular gyrus during autobiographical memory retrieval. Our results are in line with the seminal view of Endel Tulving that the sense of self is a fundamental attribute of long-term memory recollection. However, it should be emphasized that: a) our results do not imply that the left angular gyrus is not involved in the retrieval of episodic memory details; and b) given that our experiment included an autobiographical memory task, generalization of our results to the episodic memory laboratory tasks has yet to be tested.

Are involuntary autobiographical memory and déjà vu natural products of memory retrieval?

Involuntary autobiographical memories (IAMs) and déjà vu are phenomena that occur spontaneously in daily life. IAMs are recollections of the personal past, whereas déjà vu is defined as an experience in which the person feels familiarity at the same time as knowing that the familiarity is false. We present and discuss the idea that both IAMs and déjà vu can be explained as natural phenomena resulting from memory processing and, importantly, are both based on the same memory retrieval processes. Briefly, we hypothesise that both can be described as "involuntary" or spontaneous cognitions, where IAMs deliver content and déjà vu delivers only the feeling of retrieval. We map out the similarities and differences between the two, making a theoretical and neuroscientific account for their integration into models of memory retrieval and how the autobiographical memory literature can explain these quirks of daily life and unusual but meaningful phenomena. We explain the emergence of the déjà vu phenomenon by relating it to well-known mechanisms of autobiographical memory retrieval, concluding that IAMs and déjà vu lie on a continuum.

Competency in Navigating Arbitrary Spaces as an Invariant for Analyzing Cognition in Diverse Embodiments

One of the most salient features of life is its capacity to handle novelty and namely to thrive and adapt to new circumstances and changes in both the environment and internal components. An understanding of this capacity is central to several fields: the evolution of form and function, the design of effective strategies for biomedicine, and the creation of novel life forms via chimeric and bioengineering technologies. Here, we review instructive examples of living organisms solving diverse problems and propose competent navigation in arbitrary spaces as an invariant for thinking about the scaling of cognition during evolution. We argue that our innate capacity to recognize agency and intelligence in unfamiliar guises lags far behind our ability to detect it in familiar behavioral contexts. The multi-scale competency of life is essential to adaptive function, potentiating evolution and providing strategies for top-down control (not micromanagement) to address complex disease and injury. We propose an observer-focused viewpoint that is agnostic about scale and implementation, illustrating how evolution pivoted similar strategies to explore and exploit metabolic, transcriptional, morphological, and finally 3D motion spaces. By generalizing the concept of behavior, we gain novel perspectives on evolution, strategies for system-level biomedical interventions, and the construction of bioengineered intelligences. This framework is a first step toward relating to intelligence in highly unfamiliar embodiments, which will be essential for progress in artificial intelligence and regenerative medicine and for thriving in a world increasingly populated by synthetic, bio-robotic, and hybrid beings.

Sensitivity of the hippocampus to objective but not subjective episodic memory judgments

We assessed whether neural activity in the hippocampus dissociates according to whether memory test items elicit a subjective sense of recollection or accurate retrieval of contextual information. We reanalyzed a previously acquired dataset from a study in which participants made both objective (source memory for spatial context) and subjective (Remember-Know) judgments for each test item. Results indicated that the hippocampus was exclusively sensitive to the amount of contextual information retrieved, such that accurate source memory judgments were associated with greater activity than inaccurate judgments, regardless of Remember/Know status. The findings add to the evidence that the hippocampus is insensitive to the subjective experience of recollection, but supports retrieval of contextual information.

EXPRESS: "Be careful what you recall": Retrieval induced forgetting of genuine real-life autobiographical memories

Which episodes from our lives will be remembered and which will be forgotten, and why? This question has still not been answered satisfactorily by research into autobiographical memory. Previous work has shown that retrieval-induced forgetting (RIF) might be a factor responsible for forgetting parts of the autobiographical memory content. However, none of the previous studies assessed RIF in memories for recent, controlled, personal events. We report here the results of an experiment in which autobiographical memories of real-life events were induced in a controlled, but fully naturalistic, manner, under the disguise of team-building exercises, while an adapted RIF paradigm was applied to these memories. Results clearly showed the influence of RIF on auto-biographical memory retrieval. These findings demonstrate conclusively that RIF occurs in everyday life when remembering personal events.

Episodic Memory Precision and Reality Monitoring Following Stimulation of Angular Gyrus

The qualities of remembered experiences are often used to inform "reality monitoring" judgments, our ability to distinguish real and imagined events [Johnson, M. K., & Raye, C. L. Reality monitoring. Psychological Review, 88, 67-85, 1981]. Previous experiments have tended to investigate only whether reality monitoring decisions are accurate or not, providing little insight into the extent to which reality monitoring may be affected by qualities of the underlying mnemonic representations. We used a continuous-response memory precision task to measure the quality of remembered experiences that underlie two different types of reality monitoring decisions: self/experimenter decisions that distinguish actions performed by participants and the experimenter and imagined/perceived decisions that distinguish imagined and perceived experiences. The data revealed memory precision to be associated with higher accuracy in both self/experimenter and imagined/perceived reality monitoring decisions, with lower precision linked with a tendency to misattribute self-generated experiences to external sources. We then sought to investigate the possible neurocognitive basis of these observed associations by applying brain stimulation to a region that has been implicated in precise recollection of personal events, the left angular gyrus. Stimulation of angular gyrus selectively reduced the association between memory precision and self-referential reality monitoring decisions, relative to control site stimulation. The angular gyrus may, therefore, be important for the mnemonic processes involved in representing remembered experiences that give rise to a sense of self-agency, a key component of "autonoetic consciousness" that characterizes episodic memory [Tulving, E. Elements of episodic memory. Oxford, United Kingdom: Oxford University Press, 1985].