The timing of temporoparietal and frontal activations during mental own body transformations from different visuospatial perspectives

The brain dynamics of visuospatial perspective-taking captured by intracranial EEG

Visuospatial perspective-taking (VPT) is the ability to imagine a scene from a position different from the one used in self-perspective judgments (SPJ). We typically use VPT to understand how others see the environment. VPT requires overcoming the self-perspective, and impairments in this process are implicated in various brain disorders, such as schizophrenia and autism. However, the underlying brain areas of VPT are not well distinguished from SPJ-related ones and from domain-general responses to both perspectives. In addition, hierarchical processing theory suggests that domain-specific processes emerge over time from domain-general ones. It mainly focuses on the sensory system, but outside of it, support for this hypothesis is lacking. Therefore, we aimed to spatiotemporally distinguish brain responses domain-specific to VPT from the specific ones to self-perspective, and domain-general responses to both perspectives. In particular, we intended to test whether VPT- and SPJ specific responses begin later than the general ones. We recorded intracranial EEG data from 30 patients with epilepsy who performed a task requiring laterality judgments during VPT and SPJ, and analyzed the spatiotemporal features of responses in the broad gamma band (50-150 Hz). We found VPT-specific processing in a more extensive brain network than SPJ-specific processing. Their dynamics were similar, but both differed from the general responses, which began earlier and lasted longer. Our results anatomically distinguish VPT-specific from SPJ-specific processing. Furthermore, we temporally differentiate between domain-specific and domain-general processes both inside and outside the sensory system, which serves as a novel example of hierarchical processing.

Physical Body Orientation Impacts Virtual Navigation Experience and Performance

Most human navigation studies in MRI rely on virtual navigation. However, the necessary supine position in MRI makes it fundamentally different from daily ecological navigation. Nonetheless, until now, no study has assessed whether differences in physical body orientation (BO) affect participants' experienced BO during virtual navigation. Here, combining an immersive virtual reality navigation task with subjective BO measures and implicit behavioral measures, we demonstrate that physical BO (either standing or supine) modulates experienced BO. Also, we show that standing upright BO is preferred during spatial navigation: participants were more likely to experience a standing BO and were better at spatial navigation when standing upright. Importantly, we report that showing a supine virtual agent reduces the conflict between the preferred BO and physical supine BO. Our study provides critical, but missing, information regarding experienced BO during virtual navigation, which should be considered cautiously when designing navigation studies, especially in MRI.

Visuospatial perspective taking in people with Down syndrome

Visuospatial perspective taking (VPT) refers to the process of mentally representing a viewpoint different from one's own. It is related to mental rotation and theory of mind and helps to support some complex spatial activities such as wayfinding. Despite research advances in spatial cognition, little is known about VPT in people with Down syndrome (DS). Here, we examined VPT in people with DS. A total of 38 individuals with DS (aged 12-25 years old) and nonverbal ability-matched typically developing (TD) children (aged 4-9 years old) participated. They completed two VPT tasks: the classic Piagetian Three Mountains Task and a modified version of the "Dog Task" (Newcombe & Huttenlocher, 1992). For both groups, the Three Mountains Task was more difficult than the Dog Task, implying the impact of task complexity on assessing VPT. However, the overall performance did not differ between the TD and DS groups in either VPT task. Implications of the results were discussed.

Hand and Foot Selection in Mental Body Rotations Involves Motor-Cognitive Interactions

Action imagery involves the mental representation of an action without overt execution, and can contribute to perspective taking, such as that required for left-right judgments in mental body rotation tasks. It has been shown that perspective (back view, front view), rotational angle (head-up, head-down), and abstractness (abstract, realistic) of the stimulus material influences speed and correctness of the judgement. The present studies investigated whether left-right judgements are more difficult on legs than on arms and whether the type of limb interacts with the other factors. Furthermore, a combined score for speed and accuracy was explored to eliminate possible tradeoffs and to obtain the best possible measure of subjects' individual ability. Study 1 revealed that the front view is more difficult than the back view because it involves a vertical rotation in perspective taking. Head-down rotations are more difficult than head-up rotations because they involve a horizontal rotation in perspective taking. Furthermore, leg stimuli are more difficult than hand stimuli, particularly in head-down rotations. In Study 2, these findings were replicated in abstract stimuli as well as in realistic stimuli. In addition, perspective taking for realistic stimuli in the back view is easier than realistic stimuli in the front view or abstract stimuli (in both perspectives). We conclude that realistic stimulus material facilitates task comprehension and amplifies the effects of perspective. By replicating previous findings, the linear speed-accuracy score was shown to be a valid measure to capture performance in mental body rotations.

Brain mechanisms of visuospatial perspective-taking in relation to object mental rotation and the theory of mind

Visuospatial perspective-taking (VPT) is a process of imagining what can be seen and how a scene looks from a location and orientation in space that differs from one's own. It comprises two levels that are underpinned by distinct neurocognitive processes. Level-2 VPT is often studied in relation to two other cognitive phenomena, object mental rotation (oMR) and theory of mind (ToM). With the aim to describe the broad picture of neurocognitive processes underlying level-2 VPT, here we give an overview of the recent behavioral and neuroscientific findings of level-2 VPT. We discuss its relation to level-1 VPT, which is also referred to as perspective-tracking, and the neighboring topics, oMR and ToM. Neuroscientific research shows that level-2 VPT is a diverse cognitive process, encompassing functionally distinct neural circuits. It shares brain substrates with oMR, especially those parietal brain areas that are specialized in spatial reasoning. However, compared to oMR, level-2 VPT involves additional activations in brain structures that are typically involved in ToM tasks and deal with self/other distinctions. In addition, level-2 VPT has been suggested to engage brain areas coding for internal representations of the body. Thus, the neurocognitive model underpinning level-2 VPT can be understood as a combination of visuospatial processing with social cognition and body schema representations.

A causal role for the right angular gyrus in self-location mediated perspective taking

Recent theories suggest that self-consciousness, in its most elementary form, is functionally disconnected from the phenomenal body. Patients with psychosis frequently misattribute their thoughts and actions to external sources; and in certain out-of-body experiences, lucid states, and dreams body-ownership is absent but self-identification is preserved. To explain these unusual experiences, we hypothesized that self-identification depends on inferring self-location at the right angular gyrus (i.e., perspective-taking). This process relates to the discrimination of self-produced signals (endogenous attention) from environmental stimulation (exogenous attention). Therefore, when this mechanism fails, this causes altered sensations and perceptions. We combined a Full-body Illusion paradigm with brain stimulation (HD-tDCS) and found a clear causal association between right angular gyrus activation and alterations in self-location (perspective-taking). Anodal versus sham HD-tDCS resulted in: a more profound out-of-body shift (with reduced sense of agency); and a weakened ability to discriminate self from other perspectives. We conclude that self-identification is mediated in the brain by inferring self-location (i.e., perspective-taking). Self-identification can be decoupled from the bodily self, explaining phenomena associated with disembodiment. These findings present novel insights into the relationship between mind and body, and may offer important future directions for treating psychosis symptoms and rehabilitation programs to aid in the recovery from a nervous system injury. The brain's ability to locate itself might be the key mechanism for self-identification and distinguishing self from other signals (i.e., perspective-taking).

Mental rotation with abstract and embodied objects as stimuli: evidence from event-related potential (ERP)

This study investigated sex differences in performance and neuronal activity in a mental rotation task with abstract and embodied figures. Fifty-eight participants (26 females and 32 males) completed a chronometric mental rotation task with cube figures, human figures, and body postures. The results are straightforward: depending on angular disparity, participants had a faster reaction time and a higher accuracy rate for embodied stimuli compared to cube figures. The electroencephalogram (EEG) activity pattern showed a higher negative amplitude modulation in the frontal electrodes for females compared to males during the late (400-600 ms) time interval. From 200 to 400 ms after stimulus onset, there was a different activation pattern in the parietal and central electrodes, whereas frontal electrodes did not show differences between embodied and abstract stimuli. From 400 to 600 ms after stimulus onset, there was a different pattern in the central and frontal electrodes but not in the parietal areas for embodied figures in compared to cube figures. Concluding, even though there were no sex differences in the behavioral data, the EEG data did show alterations at the late time interval. Thus, the disparate results regarding sex differences that depend on the type of analysis (behavioral versus neurophysiological) should be more thoroughly investigated. Furthermore, the difference in processing embodied stimuli in an object-based mental rotation task could be confirmed in EEG activity pattern for the first time.

Motor Program Transformation of Throwing Dart from the Third-Person Perspective

The perspective of perceiving one's action affects its speed and accuracy. In the present study, we investigated the change in accuracy and kinematics when subjects throw darts from the first-person perspective and the third-person perspective with varying angles of view. To model the third-person perspective, subjects were looking at themselves as well as the scene through the virtual reality head-mounted display (VR HMD). The scene was supplied by a video feed from the camera located to the up and 0, 20 and 40 degrees to the right behind the subjects. The 28 subjects wore a motion capture suit to register their right hand displacement, velocity and acceleration, as well as torso rotation during the dart throws. The results indicated that mean accuracy shifted in opposite direction with the changes of camera location in vertical axis and in congruent direction in horizontal axis. Kinematic data revealed a smaller angle of torso rotation to the left in all third-person perspective conditions before and during the throw. The amplitude, speed and acceleration in third-person condition were lower compared to the first-person view condition, before the peak velocity of the hand in the direction toward the target and after the peak velocity in lowering the hand. Moreover, the hand movement angle was smaller in the third-person perspective conditions with 20 and 40 angle of view, compared with the first-person perspective condition just preceding the time of peak velocity, and the difference between conditions predicted the changes in mean accuracy of the throws. Thus, the results of this study revealed that subject's localization contributed to the transformation of the motor program.

Effects of Stimulus Type and Strategy on Mental Rotation Network: An Activation Likelihood Estimation Meta-Analysis

We can predict how an object would look like if we were to see it from different viewpoints. The brain network governing mental rotation (MR) has been studied using a variety of stimuli and tasks instructions. By using activation likelihood estimation (ALE) meta-analysis we tested whether different MR networks can be modulated by the type of stimulus (body vs. non-body parts) or by the type of tasks instructions (motor imagery-based vs. non-motor imagery-based MR instructions). Testing for the bodily and non-bodily stimulus axis revealed a bilateral sensorimotor activation for bodily-related as compared to non-bodily-related stimuli and a posterior right lateralized activation for non-bodily-related as compared to bodily-related stimuli. A top-down modulation of the network was exerted by the MR tasks instructions with a bilateral (preferentially sensorimotor left) network for motor imagery- vs. non-motor imagery-based MR instructions and the latter activating a preferentially posterior right occipito-temporal-parietal network. The present quantitative meta-analysis summarizes and amends previous descriptions of the brain network related to MR and shows how it is modulated by top-down and bottom-up experimental factors.

Changing perspective: The role of vestibular signals

Social interactions depend on mechanisms such as the ability to take another person's viewpoint, i.e. visuo-spatial perspective taking. However, little is known about the sensorimotor mechanisms underpinning perspective taking. Because vestibular signals play roles in mental rotation and spatial cognition tasks and because damage to the vestibular cortex can disturb egocentric perspective, vestibular signals stand as important candidates for the sensorimotor foundations of perspective taking. Yet, no study merged natural full-body vestibular stimulations and explicit visuo-spatial perspective taking tasks in virtual environments. In Experiment 1, we combined natural vestibular stimulation on a rotatory chair with virtual reality to test how vestibular signals are processed to simulate the viewpoint of a distant avatar. While they were rotated, participants tossed a ball to a virtual character from the viewpoint of a distant avatar. Our results showed that vestibular signals influence perspective taking in a direction-specific way: participants were faster when their physical body rotated in the same direction as the mental rotation needed to take the avatar's viewpoint. In Experiment 2, participants realized 3D object mental rotations, which did not involve perspective taking, during the same whole-body vestibular stimulation. Our results demonstrated that vestibular stimulation did not affect 3D object mental rotations. Altogether, these data indicate that vestibular signals have a direction-specific influence on visuo-spatial perspective taking (self-centered mental imagery), but not a general effect on mental imagery. Findings from this study suggest that vestibular signals contribute to one of the most crucial mechanisms of social cognition: understanding others' actions.

Functional Dissociations Within Posterior Parietal Cortex During Scene Integration and Viewpoint Changes

The posterior parietal cortex (PPC) is an anatomically heterogeneous brain region implicated in a wide range of cognitive operations, including egocentric spatial processing and both short- and long-term memory. Here, we report functional specificities of cytoarchitectonically defined subregions of PPC during the processing of scenes across changes in viewpoint. Participants (n = 16) saw photographs of familiar and unfamiliar places while undergoing functional magnetic resonance imaging (fMRI). On each trial, 4 viewpoints of the same place were presented, with either a plausible sequence of viewpoints (SEQ) or a scrambled order (SCRA). Distinct response profiles were observed within PPC. Area 7A showed increased activity for SEQ versus SCRA order, regardless of place familiarity, whereas the rostral inferior parietal lobule showed preferential increases for unfamiliar versus familiar places in SEQ series. In contrast, more posterior subregions in both superior and inferior PPC exhibited increases for familiar versus unfamiliar places at the end of the sequence, regardless of order. The data highlight the distinctive contribution of several subregions of PPC during the processing of scenes, with specific cortical areas involved in the progressive integration of spatial information across viewpoint changes, and others involved in the retrieval and maintenance of scene information in memory.

Fractionating the unitary notion of dissociation: disembodied but not embodied dissociative experiences are associated with exocentric perspective-taking

It has been argued that hallucinations which appear to involve shifts in egocentric perspective (e.g., the out-of-body experience, OBE) reflect specific biases in exocentric perspective-taking processes. Via a newly devised perspective-taking task, we examined whether such biases in perspective-taking were present in relation to specific dissociative anomalous body experiences (ABE) - namely the OBE. Participants also completed the Cambridge Depersonalization Scale (CDS; Sierra and Berrios, 2000) which provided measures of additional embodied ABE (unreality of self) and measures of derealization (unreality of surroundings). There were no reliable differences in the level of ABE, emotional numbing, and anomalies in sensory recall reported between the OBE and control group as measured by the corresponding CDS subscales. In contrast, the OBE group did provide significantly elevated measures of derealization ("alienation from surroundings" CDS subscale) relative to the control group. At the same time we also found that the OBE group was significantly more efficient at completing all aspects of the perspective-taking task relative to controls. Collectively, the current findings support fractionating the typically unitary notion of dissociation by proposing a distinction between embodied dissociative experiences and disembodied dissociative experiences - with only the latter being associated with exocentric perspective-taking mechanisms. Our findings - obtained with an ecologically valid task and a homogeneous OBE group - also call for a re-evaluation of the relationship between OBEs and perspective-taking in terms of facilitated disembodied experiences.

Modeling of visuospatial perspectives processing and modulation of the fronto-parietal network activity during action imitation

It has been suggested that the human mirror neuron system (MNS) plays a critical role in action observation and imitation. However, the transformation of perspective between the observed (allocentric) and the imitated (egocentric) actions has received little attention. We expand a previously proposed biologically plausible MNS model by incorporating general spatial transformation capabilities that are assumed to be encoded by the intraparietal sulcus (IPS) and the superior parietal lobule (SPL) as well as investigating their interactions with the inferior frontal gyrus and the inferior parietal lobule. The results reveal that the IPS/SPL could process the frame of reference and the viewpoint transformations, and provide invariant visual representations for the temporo-parieto-frontal circuit. This allows the imitator to imitate the action performed by a demonstrator under various perspectives while replicating results from the literatures. Our results confirm and extend the importance of perspective transformation processing during action observation and imitation.

Multisensory origin of the subjective first-person perspective: visual, tactile, and vestibular mechanisms

In three experiments we investigated the effects of visuo-tactile and visuo-vestibular conflict about the direction of gravity on three aspects of bodily self-consciousness: self-identification, self-location, and the experienced direction of the first-person perspective. Robotic visuo-tactile stimulation was administered to 78 participants in three experiments. Additionally, we presented participants with a virtual body as seen from an elevated and downward-directed perspective while they were lying supine and were therefore receiving vestibular and postural cues about an upward-directed perspective. Under these conditions, we studied the effects of different degrees of visuo-vestibular conflict, repeated measurements during illusion induction, and the relationship to a classical measure of visuo-vestibular integration. Extending earlier findings on experimentally induced changes in bodily self-consciousness, we show that self-identification does not depend on the experienced direction of the first-person perspective, whereas self-location does. Changes in bodily self-consciousness depend on visual gravitational signals. Individual differences in the experienced direction of first-person perspective correlated with individual differences in visuo-vestibular integration. Our data reveal important contributions of visuo-vestibular gravitational cues to bodily self-consciousness. In particular we show that the experienced direction of the first-person perspective depends on the integration of visual, vestibular, and tactile signals, as well as on individual differences in idiosyncratic visuo-vestibular strategies.

Brain systems for visual perspective taking and action perception

Taking another person's viewpoint and making sense of their actions are key processes that guide social behavior. Previous neuroimaging investigations have largely studied these processes separately. The current study used functional magnetic resonance imaging to examine how the brain incorporates another person's viewpoint and actions into visual perspective judgments. Participants made a left-right judgment about the location of a target object from their own (egocentric) or an actor's visual perspective (altercentric). Actor location varied around a table and the actor was either reaching or not reaching for the target object. Analyses examined brain regions engaged in the egocentric and altercentric tasks, brain regions where response magnitude tracked the orientation of the actor in the scene and brain regions sensitive to the action performed by the actor. The blood oxygen level-dependent (BOLD) response in dorsomedial prefrontal cortex (dmPFC) was sensitive to actor orientation in the altercentric task, whereas the response in right inferior frontal gyrus (IFG) was sensitive to actor orientation in the egocentric task. Thus, dmPFC and right IFG may play distinct but complementary roles in visual perspective taking (VPT). Observation of a reaching actor compared to a non-reaching actor yielded activation in lateral occipitotemporal cortex, regardless of task, showing that these regions are sensitive to body posture independent of social context. By considering how an observed actor's location and action influence the neural bases of visual perspective judgments, the current study supports the view that multiple neurocognitive "routes" operate during VPT.

Body context and posture affect mental imagery of hands

Different visual stimuli have been shown to recruit different mental imagery strategies. However the role of specific visual stimuli properties related to body context and posture in mental imagery is still under debate. Aiming to dissociate the behavioural correlates of mental processing of visual stimuli characterized by different body context, in the present study we investigated whether the mental rotation of stimuli showing either hands as attached to a body (hands-on-body) or not (hands-only), would be based on different mechanisms. We further examined the effects of postural changes on the mental rotation of both stimuli. Thirty healthy volunteers verbally judged the laterality of rotated hands-only and hands-on-body stimuli presented from the dorsum- or the palm-view, while positioning their hands on their knees (front postural condition) or behind their back (back postural condition). Mental rotation of hands-only, but not of hands-on-body, was modulated by the stimulus view and orientation. Additionally, only the hands-only stimuli were mentally rotated at different speeds according to the postural conditions. This indicates that different stimulus-related mechanisms are recruited in mental rotation by changing the bodily context in which a particular body part is presented. The present data suggest that, with respect to hands-only, mental rotation of hands-on-body is less dependent on biomechanical constraints and proprioceptive input. We interpret our results as evidence for preferential processing of visual- rather than kinesthetic-based mechanisms during mental transformation of hands-on-body and hands-only, respectively.

The Two Forms of Visuo-Spatial Perspective Taking are Differently Embodied and Subserve Different Spatial Prepositions

We set out to distinguish level 1 (VPT-1) and level 2 (VPT-2) perspective taking with respect to the embodied nature of the underlying processes as well as to investigate their dependence or independence of response modality (motor vs. verbal). While VPT-1 reflects understanding of what lies within someone else's line of sight, VPT-2 involves mentally adopting someone else's spatial point of view. Perspective taking is a high-level conscious and deliberate mental transformation that is crucially placed at the convergence of perception, mental imagery, communication, and even theory of mind in the case of VPT-2. The differences between VPT-1 and VPT-2 mark a qualitative boundary between humans and apes, with the latter being capable of VPT-1 but not of VPT-2. However, our recent data showed that VPT-2 is best conceptualized as the deliberate simulation or emulation of a movement, thus underpinning its embodied origins. In the work presented here we compared VPT-2 to VPT-1 and found that VPT-1 is not at all, or very differently embodied. In a second experiment we replicated the qualitatively different patterns for VPT-1 and VPT-2 with verbal responses that employed spatial prepositions. We conclude that VPT-1 is the cognitive process that subserves verbal localizations using "in front" and "behind," while VPT-2 subserves "left" and "right" from a perspective other than the egocentric. We further conclude that both processes are grounded and situated, but only VPT-2 is embodied in the form of a deliberate movement simulation that increases in mental effort with distance and incongruent proprioception. The differences in cognitive effort predict differences in the use of the associated prepositions. Our findings, therefore, shed light on the situated, grounded and embodied basis of spatial localizations and on the psychology of their use.

The Two Forms of Visuo-Spatial Perspective Taking are Differently Embodied and Subserve Different Spatial Prepositions

We set out to distinguish level 1 (VPT-1) and level 2 (VPT-2) perspective taking with respect to the embodied nature of the underlying processes as well as to investigate their dependence or independence of response modality (motor vs. verbal). While VPT-1 reflects understanding of what lies within someone else's line of sight, VPT-2 involves mentally adopting someone else's spatial point of view. Perspective taking is a high-level conscious and deliberate mental transformation that is crucially placed at the convergence of perception, mental imagery, communication, and even theory of mind in the case of VPT-2. The differences between VPT-1 and VPT-2 mark a qualitative boundary between humans and apes, with the latter being capable of VPT-1 but not of VPT-2. However, our recent data showed that VPT-2 is best conceptualized as the deliberate simulation or emulation of a movement, thus underpinning its embodied origins. In the work presented here we compared VPT-2 to VPT-1 and found that VPT-1 is not at all, or very differently embodied. In a second experiment we replicated the qualitatively different patterns for VPT-1 and VPT-2 with verbal responses that employed spatial prepositions. We conclude that VPT-1 is the cognitive process that subserves verbal localizations using "in front" and "behind," while VPT-2 subserves "left" and "right" from a perspective other than the egocentric. We further conclude that both processes are grounded and situated, but only VPT-2 is embodied in the form of a deliberate movement simulation that increases in mental effort with distance and incongruent proprioception. The differences in cognitive effort predict differences in the use of the associated prepositions. Our findings, therefore, shed light on the situated, grounded and embodied basis of spatial localizations and on the psychology of their use.