First-person body view modulates the neural substrates of episodic memory and autonoetic consciousness: A functional connectivity study

The experimental study of consciousness: Is psychology travelling back to the future?

It was with the promise of rendering an experimental approach to consciousness that psychology started its trajectory as an independent science more than 150 years ago. Here, we will posit that the neurosciences were instrumental in leading psychology to resume the study of consciousness by projecting an empirical agenda for the future. First, we will start by showing how scientists were able to venture into the consciousness of supposedly unconscious patients, opening the door for the identification of important neural correlates of distinct consciousness states. Then, we will describe how different technological advances and elegant experimental paradigms helped in establishing important neuronal correlates of global consciousness (i.e., being conscious at all), perceptual consciousness (i.e., being conscious of something), and self-consciousness (i.e., being conscious of itself). Finally, we will illustrate how the study of complex consciousness experiences may contribute to the clarification of the mechanisms associated with global consciousness, the relationship between perceptual and self-consciousness, and the interface among distinct self-consciousness domains. In closing, we will elaborate on the road ahead of us for re-establishing psychology as a science of consciousness.

Comparing episodic memory outcomes from walking augmented reality and stationary virtual reality encoding experiences

Episodic Memory (EM) is the neurocognitive capacity to consciously recollect personally experienced events in specific spatio-temporal contexts. Although the relevance of spatial and temporal information is widely acknowledged in the EM literature, it remains unclear whether and how EM performance and organisation is modulated by self-motion, and by motor- and visually- salient environmental features (EFs) of the encoding environment. This study examines whether and how EM is modulated by locomotion and the EFs encountered in a controlled lifelike learning route within a large-scale building. Twenty-eight healthy participants took part in a museum-tour encoding task implemented in walking Augmented Reality (AR) and stationary Virtual Reality (VR) conditions. EM performance and organisation were assessed immediately and 48-hours after trials using a Remember/Familiar recognition paradigm. Results showed a significant positive modulation effect of locomotion on distinctive EM aspects. Findings highlighted a significant performance enhancement effect of stairway-adjacent locations compared to dead-end and mid-route stimuli-presentation locations. The results of this study may serve as design criteria to facilitate neurocognitive rehabilitative interventions of EM. The underlying technological framework developed for this study represents a novel and ecologically sound method for evaluating EM processes in lifelike situations, allowing researchers a naturalistic perspective into the complex nature of EM.

The role of bodily self-consciousness in episodic memory of naturalistic events: an immersive virtual reality study

Recent studies suggest that the human body plays a critical role in episodic memory. Still, the precise relationship between bodily self-consciousness (BSC) and memory formation of specific events, especially in real-life contexts, remains a topic of ongoing research. The present study investigated the relationship between BSC and episodic memory (EM) using immersive virtual reality (VR) technology. Participants were immersed in an urban environment with naturalistic events, while their visuomotor feedback was manipulated in three within-subjects conditions: Synchronous, Asynchronous, and No-body. Our results show that asynchronous visuomotor feedback and not seeing one's body, compared to synchronous feedback, decrease the sense of self-identification, self-location and agency, and sense of presence. Moreover, navigating in the Asynchronous condition had a detrimental impact on incidental event memory, perceptual details, contextual association, subjective sense of remembering, and memory consolidation. In contrast, participants in the No-Body condition were only impaired in egocentric spatial memory and the sense of remembering at ten-day delay. We discuss these findings in relation to the role of bodily self-representation in space during event memory encoding. This study sheds light on the complex interplay between BSC, sense of presence, and episodic memory processes, and strengthens the potential of embodiment and VR technology in studying and enhancing human cognition.

Simulating the situated-self drives hippocampo-cortical engagement during inner narration of events

We often use inner narration when thinking about past and future events. The present paradigm explicitly addresses the influence of the language used in inner narration on the hippocampus-dependent event construction process. We assessed the language context effect during the inner narration of different event types: past, future, daydream, and self-unrelated fictitious events. The language context was assessed via a fluent bilingual population who used inner narration, either in their first language (L1) or second language (L2). Not all inner narration of events elicited hippocampo-cortical activity. In fact, only the angular gyrus and precuneus-retrosplenial cortex were activated by inner narration across all event types. More precisely, only inner narration of events which entailed the simulation of bodily self-location in space (whether or not they were time-marked: past, future, daydream) depended on the hippocampo-cortical system, while inner narration of events that did not entail bodily self-location (self-unrelated fictitious) did not. The language context of the narration influenced the bilinguals' hippocampo-cortical system by enhancing the co-activation of semantic areas with the hippocampus for inner narration of events in the L2. Overall, this study highlights 2 important characteristics of hippocampo-cortical-dependent inner narration of events: The core episodic hippocampal system is activated for inner narration of events simulating self-location in space (regardless of time-marking), and the inner language used for narration (L1 or L2) mediates hippocampal functional connectivity.

Virtual reality-based sensorimotor adaptation shapes subsequent spontaneous and naturalistic stimulus-driven brain activity

Our everyday life summons numerous novel sensorimotor experiences, to which our brain needs to adapt in order to function properly. However, tracking plasticity of naturalistic behavior and associated brain modulations is challenging. Here, we tackled this question implementing a prism adaptation-like training in virtual reality (VRPA) in combination with functional neuroimaging. Three groups of healthy participants (N = 45) underwent VRPA (with a shift either to the left/right side, or with no shift), and performed functional magnetic resonance imaging (fMRI) sessions before and after training. To capture modulations in free-flowing, task-free brain activity, the fMRI sessions included resting-state and free-viewing of naturalistic videos. We found significant decreases in spontaneous functional connectivity between attentional and default mode (DMN)/fronto-parietal networks, only for the adaptation groups, more pronouncedly in the hemisphere contralateral to the induced shift. In addition, VRPA was found to bias visual responses to naturalistic videos: Following rightward adaptation, we found upregulation of visual response in an area in the parieto-occipital sulcus (POS) only in the right hemisphere. Notably, the extent of POS upregulation correlated with the size of the VRPA-induced after-effect measured in behavioral tests. This study demonstrates that a brief VRPA exposure can change large-scale cortical connectivity and correspondingly bias visual responses to naturalistic sensory inputs.

Effects of virtual body-representation on motor skill learning

Motor learning is often hindered or facilitated by visual information from one's body and its movement. However, it is unclear whether visual representation of the body itself facilitates motor learning. Thus, we tested the effects of virtual body-representation on motor learning through a virtual reality rotary pursuit task. In the task, visual feedback on participants' movements was identical, but virtual body-representation differed by dividing the experimental conditions into three conditions: non-avatar, non-hand avatar, and hand-shaped avatar. We measured the differences in the rate of motor learning, body-ownership, and sense of agency in the three conditions. Although there were no differences in body-ownership and sense of agency between the conditions, the hand-shaped avatar condition was significantly superior to the other conditions in the rate of learning. These findings suggest that visually recognizing one's body shape facilitates motor learning.

The Remapping of Peripersonal Space in a Real but Not in a Virtual Environment

One of the most surprising features of our brain is the fact that it is extremely plastic. Among the various plastic processes supported by our brain, there is the neural representation of the space surrounding our body, the peripersonal space (PPS). The effects of real-world tool use on the PPS are well known in cognitive neuroscience, but little is still known whether similar mechanisms also govern virtual tool use. To this purpose, the present study investigated the plasticity of the PPS before and after a real (Experiment 1) or virtual motor training with a tool (Experiment 2). The results show the expansion of the PPS only following real-world tool use but not virtual use, highlighting how the two types of training potentially rely on different processes. This study enriches the current state of the art on the plasticity of PPS in real and virtual environments. We discuss our data with respect to the relevance for the development of effective immersive environment for trainings, learning and rehabilitation.

Personal Memories and Bodily-Cues Influence Our Sense of Self

How do our bodies influence who we are? Recent research in cognitive neuroscience has examined consciousness associated with the self and related multisensory processing of bodily signals, the so-called bodily self-consciousness. A parallel line of research has highlighted the concept of the autobiographical self and the associated autonoetic consciousness, which enables us to mentally travel in time. The subjective re-experiencing of past episodes is described as re-living them from within or outside one's body. In this brief perspective, I aim to explore the underlying characteristics of self-consciousness and its relation to bodily signals and episodic memory. I will outline some recent behavioral and neuroimaging evidence indicating that bodily cues play a fundamental role in autobiographical memory. Finally, I will discuss these emerging concepts regarding the current understanding of bodily-self, autobiographical-self, their links to self-consciousness, and suggest directions for future research.

In search of a naturalistic neuroimaging approach: Exploration of general feasibility through the case of VR-fMRI and application in the domain of episodic memory

Virtual Reality (VR) is an increasingly widespread tool for research as it allows the creation of experiments taking place in multimodal and daily-life-like environments, while keeping a strong experimental control. Adding neuroimaging to VR leads to a better understanding of the underlying brain networks activated during a naturalistic task, whether for research purposes or rehabilitation. The present paper focuses on the specific use of concurrent VR and fMRI and its technical challenges and feasibility, with a brief examination of the general existing solutions. Following the PRISMA guidelines, the review investigates the particular case of how VR-fMRI has explored episodic memory so far, with a comparison of object- and place-based episodic memory. This review confirms the involvement of cerebral regions well-known to be implicated in episodic memory and unravels other regions devoted to bodily and narrative aspects of the self, promoting new avenues of research in the domain of naturalistic episodic memory. Future studies should develop more immersive and interactive virtual neuroimaging features to increase ecological and embodied neurocognition aspects.

The perspectives of mapping and monitoring of the sense of self in neurosurgical patients

Surgical treatment of tumors, epileptic foci or of vascular origin, requires a detailed individual pre-surgical workup and intra-operative surveillance of brain functions to minimize the risk of post-surgical neurological deficits and decline of quality of life. Most attention is attributed to language, motor functions, and perception. However, higher cognitive functions such as social cognition, personality, and the sense of self may be affected by brain surgery. To date, the precise localization and the network patterns of brain regions involved in such functions are not yet fully understood, making the assessment of risks of related post-surgical deficits difficult. It is in the interest of neurosurgeons to understand with which neural systems related to selfhood and personality they are interfering during surgery. Recent neuroscience research using virtual reality and clinical observations suggest that the insular cortex, medial prefrontal cortex, and temporo-parietal junction are important components of a neural system dedicated to self-consciousness based on multisensory bodily processing, including exteroceptive and interoceptive cues (bodily self-consciousness (BSC)). Here, we argue that combined extra- and intra-operative approaches using targeted cognitive testing, functional imaging and EEG, virtual reality, combined with multisensory stimulations, may contribute to the assessment of the BSC and related cognitive aspects. Although the usefulness of particular biomarkers, such as cardiac and respiratory signals linked to virtual reality, and of heartbeat evoked potentials as a surrogate marker for intactness of multisensory integration for intra-operative monitoring has to be proved, systemic and automatized testing of BSC in neurosurgical patients will improve future surgical outcome.