Multi-voxel pattern classification differentiates personally experienced event memories from secondhand event knowledge

The influence of the precuneus on the medial temporal cortex determines the subjective quality of memory during the retrieval of naturalistic episodes

Memory retrieval entails dynamic interactions between the medial temporal lobe and areas in the parietal and frontal cortices. Here, we tested the hypothesis that effective connectivity between the precuneus, in the medial parietal cortex, and the medial temporal cortex contributes to the subjective quality of remembering objects together with information about their rich spatio-temporal encoding context. During a 45 min encoding session, the participants were presented with pictures of objects while they actively explored a virtual town. The following day, under fMRI, participants were presented with images of objects and had to report whether: they recognized the object and could remember the place/time of encoding, the object was familiar only, or the object was new. The hippocampus/parahippocampus, the precuneus and the ventro-medial prefrontal cortex activated when the participants successfully recognized objects they had seen in the virtual town and reported that they could remember the place/time of these events. Analyses of effective connectivity showed that the influence exerted by the precuneus on the medial temporal cortex mediates this effect of episodic recollection. Our findings demonstrate the role of the inter-regional connectivity in mediating the subjective experience of remembering and underline the relevance of studying memory in contextually-rich conditions.

Neural Representation of Collective Self-esteem in Resting-state Functional Connectivity and its Validation in Task-dependent Modality

INTRODUCTION

Collective self-esteem (CSE) is an important personality variable, defined as self-worth derived from membership in social groups. A study explored the neural basis of CSE using a task-based functional magnetic resonance imaging (fMRI) paradigm; however, task-independent neural basis of CSE remains to be explored, and whether the CSE neural basis of resting-state fMRI is consistent with that of task-based fMRI is unclear.

METHODS

We built support vector regression (SVR) models to predict CSE scores using topological metrics measured in the resting-state functional connectivity network (RSFC) as features. Then, to test the reliability of the SVR analysis, the activation pattern of the identified brain regions from SVR analysis was used as features to distinguish collective self-worth from other conditions by multivariate pattern classification in task-based fMRI dataset.

RESULTS

SVR analysis results showed that leverage centrality successfully decoded the individual differences in CSE. The ventromedial prefrontal cortex, anterior cingulate cortex, posterior cingulate gyrus, precuneus, orbitofrontal cortex, posterior insula, postcentral gyrus, inferior parietal lobule, temporoparietal junction, and inferior frontal gyrus, which are involved in self-referential processing, affective processing, and social cognition networks, participated in this prediction. Multivariate pattern classification analysis found that the activation pattern of the identified regions from the SVR analysis successfully distinguished collective self-worth from relational self-worth, personal self-worth and semantic control.

CONCLUSION

Our findings revealed CSE neural basis in the whole-brain RSFC network, and established the concordance between leverage centrality and the activation pattern (evoked during collective self-worth task) of the identified regions in terms of representing CSE.

VR for Cognition and Memory

This chapter will provide a review of research into human cognition through the lens of VR-based paradigms for studying memory. Emphasis is placed on why VR increases the ecological validity of memory research and the implications of such enhancements.

Distinct Neural Profiles of Frontoparietal Networks in Boys with ADHD and Boys with Persistent Depressive Disorder

Working memory deficits are common in attention-deficit/hyperactivity disorder (ADHD) and depression-two common neurodevelopmental disorders with overlapping cognitive profiles but distinct clinical presentation. Multivariate techniques have previously been utilized to understand working memory processes in functional brain networks in healthy adults but have not yet been applied to investigate how working memory processes within the same networks differ within typical and atypical developing populations. We used multivariate pattern analysis (MVPA) to identify whether brain networks discriminated between spatial versus verbal working memory processes in ADHD and Persistent Depressive Disorder (PDD). Thirty-six male clinical participants and 19 typically developing (TD) boys participated in a fMRI scan while completing a verbal and a spatial working memory task. Within a priori functional brain networks (frontoparietal, default mode, salience), the TD group demonstrated differential response patterns to verbal and spatial working memory. The PDD group showed weaker differentiation than TD, with lower classification accuracies observed in primarily the left frontoparietal network. The neural profiles of the ADHD and PDD differed specifically in the SN where the ADHD group's neural profile suggests significantly less specificity in neural representations of spatial and verbal working memory. We highlight within-group classification as an innovative tool for understanding the neural mechanisms of how cognitive processes may deviate in clinical disorders, an important intermediary step towards improving translational psychiatry.

Prefrontal cortical activation associated with prospective memory while walking around a real-world street environment

Rostral PFC (area 10) activation is common during prospective memory (PM) tasks. But it is not clear what mental processes these activations index. Three candidate explanations from cognitive neuroscience theory are: (i) monitoring of the environment; (ii) spontaneous intention retrieval; (iii) a combination of the two. These explanations make different predictions about the temporal and spatial patterns of activation that would be seen in rostral PFC in naturalistic settings. Accordingly, we plotted functional events in PFC using portable fNIRS while people were carrying out a PM task outside the lab and responding to cues when they were encountered, to decide between these explanations. Nineteen people were asked to walk around a street in London, U.K. and perform various tasks while also remembering to respond to prospective memory (PM) cues when they detected them. The prospective memory cues could be either social (involving greeting a person) or non-social (interacting with a parking meter) in nature. There were also a number of contrast conditions which allowed us to determine activation specifically related to the prospective memory components of the tasks. We found that maintaining both social and non-social intentions was associated with widespread activation within medial and right hemisphere rostral prefrontal cortex (BA 10), in agreement with numerous previous lab-based fMRI studies of prospective memory. In addition, increased activation was found within lateral prefrontal cortex (BA 45 and 46) when people were maintaining a social intention compared to a non-social one. The data were then subjected to a GLM-based method for automatic identification of functional events (AIDE), and the position of the participants at the time of the activation events were located on a map of the physical space. The results showed that the spatial and temporal distribution of these events was not random, but aggregated around areas in which the participants appeared to retrieve their future intentions (i.e., where they saw intentional cues), as well as where they executed them. Functional events were detected most frequently in BA 10 during the PM conditions compared to other regions and tasks. Mobile fNIRS can be used to measure higher cognitive functions of the prefrontal cortex in "real world" situations outside the laboratory in freely ambulant individuals. The addition of a "brain-first" approach to the data permits the experimenter to determine not only when haemodynamic changes occur, but also where the participant was when it happened. This can be extremely valuable when trying to link brain and cognition.

Memory for spatio-temporal contextual details during the retrieval of naturalistic episodes

Episodic memory entails the storage of events together with their spatio-temporal context and retrieval comprises the subjective experience of a link between the person who remembers and the episode itself. We used an encoding procedure with mobile-phones to generate experimentally-controlled episodes in the real world: object-images were sent to the participants' phone, with encoding durations up to 3 weeks. In other groups of participants, the same objects were encoded during the exploration of a virtual town (45 min) or using a standard laboratory paradigm, with pairs of object/place-images presented in a sequence of unrelated trials (15 min). At retrieval, we tested subjective memory for the objects (remember/familiar) and memory for the context (place and time). We found that accurate and confident context-memory increased the likelihood of "remember" responses, in all encoding contexts. We also tested the participants' ability to judge the temporal-order of the encoded episodes. Using a model of temporal similarity, we demonstrate scale-invariant properties of order-retrieval, but also highlight the contribution of non-chronological factors. We conclude that the mechanisms governing episodic memory retrieval can operate across a wide range of spatio-temporal contexts and that the multi-dimensional nature of the episodic traces contributes to the subjective experience of retrieval.

Multivariable pattern classification differentiates relational self-esteem from personal self-esteem

Relational self-esteem (RSE) refers to one’s sense of self-worth based on the relationship with significant others, such as family and best friends. Although previous neuroimaging research has investigated the neural processes of RSE, it is less clear how RSE is represented in multivariable neural patterns. Being able to identify a stable RSE signature could contribute to knowledge about relational self-worth. Here, using multivariate pattern classification to differentiate RSE from personal self-esteem (PSE), which pertains to self-worth derived from personal attributes, we obtained a stable diagnostic signature of RSE relative to PSE. We found that multivariable neural activities in the superior/middle temporal gyrus, precuneus, posterior cingulate cortex, dorsal medial Prefrontal Cortex (dmPFC) and temporo-parietal junction were responsible for diagnosis of RSE, suggesting that the evaluation of RSE involves the retrieval of relational episodic memory, perspective-taking and value calculation. Further, these diagnostic neural signatures were able to sensitively decode neural activities related to RSE in another independent test sample, indicating the reliability of the brain state represented. By providing a reliable multivariate brain pattern for RSE relative to PSE, our results informed more cognitively prominent processing of RSE than that of PSE and enriched our knowledge about how relational self-worth is generated in the brain.

Behavioural and neurophysiological signatures in the retrieval of individual memories of recent and remote real-life routine episodic events

Autobiographical memory (AM) has been largely investigated as the ability to recollect specific events that belong to an individual's past. However, how we retrieve real-life routine episodes and how the retrieval of these episodes changes with the passage of time remain unclear. Here, we asked participants to use a wearable camera that automatically captured pictures to record instances during a week of their routine life and implemented a deep neural network-based algorithm to identify picture sequences that represented episodic events. We then asked each participant to return to the lab to retrieve AMs for single episodes cued by the selected pictures 1 week, 2 weeks and 6-14 months after encoding while scalp electroencephalographic (EEG) activity was recorded. We found that participants were more accurate in recognizing pictured scenes depicting their own past than pictured scenes encoded in the lab, and that memory recollection of personally experienced events rapidly decreased with the passing of time. We also found that the retrieval of real-life picture cues elicited a strong and positive 'ERP old/new effect' over frontal regions and that the magnitude of this ERP effect was similar throughout memory tests over time. However, we observed that recognition memory induced a frontal theta power decrease and that this effect was mostly seen when memories were tested after 1 and 2 weeks but not after 6-14 months from encoding. Altogether, we discuss the implications for neuroscientific accounts of episodic retrieval and the potential benefits of developing individual-based AM exploration strategies at the clinical level.

Neural correlates of retrieval-based enhancement of autobiographical memory in older adults

Lifelog photo review is considered to enhance the recall of personal events. While a sizable body of research has explored the neural basis of autobiographical memory (AM), there is limited neural evidence on the retrieval-based enhancement effect on event memory among older adults in the real-world environment. This study examined the neural processes of AM as was modulated by retrieval practice through lifelog photo review in older adults. In the experiment, blood-oxygen-level dependent response during subjects’ recall of recent events was recorded, where events were cued by photos that may or may not have been exposed to a priori retrieval practice (training). Subjects remembered more episodic details under the trained relative to non-trained condition. Importantly, the neural correlates of AM was exhibited by (1) dissociable cortical areas related to recollection and familiarity, and (2) a positive correlation between the amount of recollected episodic details and cortical activation within several lateral temporal and parietal regions. Further analysis of the brain activation pattern at a few regions of interest within the core remember network showed a training_condition × event_detail interaction effect, suggesting that the boosting effect of retrieval practice depended on the level of recollected event details.

The experience of vivid autobiographical reminiscence is supported by subjective content representations in the precuneus

The human posteromedial cortex, which includes core regions of the default mode network (DMN), is thought to play an important role in episodic memory. However, the nature and functional role of representations in these brain regions remain unspecified. Nine participants (all female) wore smartphone devices to record episodes from their daily lives for multiple weeks, each night indicating the personally-salient attributes of each episode. Participants then relived their experiences in an fMRI scanner cued by images from their own lives. Representational Similarity Analysis revealed a broad network, including parts of the DMN, that represented personal semantics during autobiographical reminiscence. Within this network, activity in the right precuneus reflected more detailed representations of subjective contents during vivid relative to non-vivid, recollection. Our results suggest a more specific mechanism underlying the phenomenology of vivid autobiographical reminiscence, supported by rich subjective content representations in the precuneus, a hub of the DMN previously implicated in metacognitive evaluations during memory retrieval.

Enhancing the Ecological Validity of fMRI Memory Research Using Virtual Reality

Functional magnetic resonance imaging (fMRI) is a powerful research tool to understand the neural underpinnings of human memory. However, as memory is known to be context-dependent, differences in contexts between naturalistic settings and the MRI scanner environment may potentially confound neuroimaging findings. Virtual reality (VR) provides a unique opportunity to mitigate this issue by allowing memories to be formed and/or retrieved within immersive, navigable, visuospatial contexts. This can enhance the ecological validity of task paradigms, while still ensuring that researchers maintain experimental control over critical aspects of the learning and testing experience. This mini-review surveys the growing body of fMRI studies that have incorporated VR to address critical questions about human memory. These studies have adopted a variety of approaches, including presenting research participants with VR experiences in the scanner, asking participants to retrieve information that they had previously acquired in a VR environment, or identifying neural correlates of behavioral metrics obtained through VR-based tasks performed outside the scanner. Although most such studies to date have focused on spatial or navigational memory, we also discuss the promise of VR in aiding other areas of memory research and facilitating research into clinical disorders.