I feel who I see: Visual body identity affects visual–tactile integration in peripersonal space

Beyond peripersonal boundaries: insights from crossmodal interactions

We experience our self as a body located in space. However, how information about self-location is integrated into multisensory processes underlying the representation of the peripersonal space (PPS), is still unclear. Prior studies showed that the presence of visual information related to oneself modulates the multisensory processes underlying PPS. Here, we used the crossmodal congruency effect (CCE) to test whether this top-down modulation depends on the spatial location of the body-related visual information. Participants responded to tactile events on their bodies while trying to ignore a visual distractor presented on the mirror reflection of their body (Self) either in the peripersonal space (Near) or in the extrapersonal space (Far). We found larger CCE when visual events were presented on the mirror reflection in the peripersonal space, as compared to the extrapersonal space. These results suggest that top-down modulation of the multisensory bodily self is only possible within the PPS.

Relating different Dimensions of Bodily Experiences: Review and proposition of an integrative model relying on phenomenology, predictive brain and neuroscience of the self

How we mentally experience our body has been studied in a variety research domains. Each of these domains focuses in its own ways on different aspects of the body, namely the neurophysiological, perceptual, affective or social components, and proposes different conceptual taxonomies. It is therefore difficult to find one's way through this vast literature and to grasp the relationships between the different dimensions of bodily experiences. In this narrative review, we summarize the existing research directions and present their limits. We propose an integrative framework, grounded in studies on phenomenal consciousness, self-consciousness and bodily self-consciousness, that can provide a common basis for evaluating findings on different dimensions of bodily experiences. We review the putative mechanisms, relying on predictive processes, and neural substrates that support this model. We discuss how this model enables a conceptual assessment of the interrelationships between multiple dimensions of bodily experiences and potentiate interdisciplinary approaches.

Neural Representation of the Parent-Child Attachment from Infancy to Adulthood

Attachment theory is built on the assumption of consistency; the mother–infant bond is thought to underpin the life-long representations individuals construct of attachment relationships. Still, consistency in the individual’s neural response to attachment-related stimuli representing his or her entire relational history has not been investigated. Mothers and children were followed across two decades and videotaped in infancy (3–6 months), childhood (9–12 years) and young adulthood (18–24 years). In adulthood, participants underwent functional magnetic resonance imaging while exposed to videos of own mother–child interactions (Self) vs unfamiliar interactions (Other). Self-stimuli elicited greater activations across preregistered nodes of the human attachment network, including thalamus-to-brainstem, amygdala, hippocampus, anterior cingulate cortex (ACC), insula and temporal cortex. Critically, self-stimuli were age-invariant in most regions of interest despite large variability in social behavior, and Bayesian analysis showed strong evidence for lack of age-related differences. Psycho–physiological interaction analysis indicated that self-stimuli elicited tighter connectivity between ACC and anterior insula, consolidating an interface associating information from exteroceptive and interceptive sources to sustain attachment representations. Child social engagement behavior was individually stable from infancy to adulthood and linked with greater ACC and insula response to self-stimuli. Findings demonstrate overlap in circuits sustaining parental and child attachment and accord with perspectives on the continuity of attachment across human development.

Modulation of Bodily Self-Consciousness by Self and External Touch

The full body illusion (FBI) is a bodily illusion based on the application of multisensory conflicts that induce changes in bodily self-consciousness (BSC). This has been used to study cognitive brain mechanisms underlying body ownership and related aspects of self-consciousness. Typically, such paradigms employ external passive multisensory stimulation, thus neglecting the possible contributions of self-generated action and haptic cues to body ownership. In this article, the effects of both external and voluntary self-touch on BSC were examined with a robotics-based FBI paradigm. We compared the effects of classical passive visuotactile stimulation and active self-touch (in which experimental participants had a sense of agency over the tactile stimulation) on the FBI. We evaluated these effects using a questionnaire, crossmodal congruency task, and measurements of changes in self-location. The results indicated that both synchronous passive visuotactile stimulation and synchronous active self-touch induced illusory ownership over a virtual body, without significant differences in their magnitudes. However, the FBI induced by active self-touch was associated with a larger drift in self-location towards the virtual body. These results show that movement-related signals arising from self-touch impact the BSC not only for hand ownership but also for torso-centered body ownership and related aspects of BSC.

The development of visuotactile congruency effects for sequences of events

Sensitivity to the temporal coherence of visual and tactile signals increases perceptual reliability and is evident during infancy. However, it is not clear how, or whether, bidirectional visuotactile interactions change across childhood. Furthermore, no study has explored whether viewing a body modulates how children perceive visuotactile sequences of events. Here, children aged 5-7 years (n = 19), 8 and 9 years (n = 21), and 10-12 years (n = 24) and adults (n = 20) discriminated the number of target events (one or two) in a task-relevant modality (touch or vision) and ignored distractors (one or two) in the opposing modality. While participants performed the task, an image of either a hand or an object was presented. Children aged 5-7 years and 8 and 9 years showed larger crossmodal interference from visual distractors when discriminating tactile targets than the converse. Across age groups, this was strongest when two visual distractors were presented with one tactile target, implying a "fission-like" crossmodal effect (perceiving one event as two events). There was no influence of visual context (viewing a hand or non-hand image) on visuotactile interactions for any age group. Our results suggest robust interference from discontinuous visual information on tactile discrimination of sequences of events during early and middle childhood. These findings are discussed with respect to age-related changes in sensory dominance, selective attention, and multisensory processing.

Modulation of vection latencies in the full-body illusion

Current neuroscientific models of bodily self-consciousness (BSC) argue that inaccurate integration of sensory signals leads to altered states of BSC. Indeed, using virtual reality technology, observers viewing a fake or virtual body while being exposed to tactile stimulation of the real body, can experience illusory ownership over-and mislocalization towards-the virtual body (Full-Body Illusion, FBI). Among the sensory inputs contributing to BSC, the vestibular system is believed to play a central role due to its importance in estimating self-motion and orientation. This theory is supported by clinical evidence that vestibular loss patients are more prone to altered BSC states, and by recent experimental evidence that visuo-vestibular conflicts can disrupt BSC in healthy individuals. Nevertheless, the contribution of vestibular information and self-motion perception to BSC remains largely unexplored. Here, we investigate the relationship between alterations of BSC and self-motion sensitivity in healthy individuals. Fifteen participants were exposed to visuo-vibrotactile conflicts designed to induce an FBI, and subsequently to visual rotations that evoked illusory self-motion (vection). We found that synchronous visuo-vibrotactile stimulation successfully induced the FBI, and further observed a relationship between the strength of the FBI and the time necessary for complete vection to arise. Specifically, higher self-reported FBI scores across synchronous and asynchronous conditions were associated to shorter vection latencies. Our findings are in agreement with clinical observations that vestibular loss patients have higher FBI susceptibility and lower vection latencies, and argue for increased visual over vestibular dependency during altered states of BSC.

Changing motor perception by sensorimotor conflicts and body ownership

Experimentally induced sensorimotor conflicts can result in a loss of the feeling of control over a movement (sense of agency). These findings are typically interpreted in terms of a forward model in which the predicted sensory consequences of the movement are compared with the observed sensory consequences. In the present study we investigated whether a mismatch between movements and their observed sensory consequences does not only result in a reduced feeling of agency, but may affect motor perception as well. Visual feedback of participants’ finger movements was manipulated using virtual reality to be anatomically congruent or incongruent to the performed movement. Participants made a motor perception judgment (i.e. which finger did you move?) or a visual perceptual judgment (i.e. which finger did you see moving?). Subjective measures of agency and body ownership were also collected. Seeing movements that were visually incongruent to the performed movement resulted in a lower accuracy for motor perception judgments, but not visual perceptual judgments. This effect was modified by rotating the virtual hand (Exp.2), but not by passively induced movements (Exp.3). Hence, sensorimotor conflicts can modulate the perception of one’s motor actions, causing viewed “alien actions” to be felt as one’s own.

Is that me in the mirror? Depersonalisation modulates tactile mirroring mechanisms

Our sense of self is thought to develop through sensory-motor contingencies provided, not only by observing one's own body, but also by mirroring interactions with others. This suggests that there is a strong link between mirroring mechanisms and the bodily self. The present study tested whether this link is expressed at early, implicit stages of the mirroring process or at later, more cognitive stages. We also provide, to the best of our knowledge, the first demonstration of how inter-individual differences in our sense of bodily self may affect mirroring mechanisms. We used somatosensory event-related potentials (SEPs) to investigate the temporal dynamics of mirroring highly self-related information (viewed touch on one's own face) compared to other-related information (viewed touch on a stranger's face), in individuals with low and high levels of depersonalisation, a mental condition characterised by feeling detached or estranged from one's self and body. For the low-depersonalisation group, mirroring for self-related events (P45) preceded mirroring for other-related events (N80). At later stages (P200), mirroring was stronger for other-related than self-related events. This shows that early, implicit and later, more cognitive processes play different relative roles in mirroring self- and other-related bodily events. Critically, mirroring differed in the high-depersonalisation group, specifically for self-related events. An absence of early, implicit mirroring for self-related events over P45 suggests that the associated processes may be the neural correlates of the disembodiment experienced in depersonalisation. A lack of differential mirroring for self- and other-related events over P200 may reflect compensatory mechanisms that redress deficiencies in mirroring at earlier stages, which may break down to give rise to symptoms of depersonalisation. Alternatively, or in addition, they may represent an attenuation of processes related to self-other distinction. Our study thus shows that mirroring, especially for events on one's own face, can be strongly affected by how connected the observer feels to their own bodily self.

Those are Your Legs: The Effect of Visuo-Spatial Viewpoint on Visuo-Tactile Integration and Body Ownership

Experiencing a body part as one's own, i.e., body ownership, depends on the integration of multisensory bodily signals (including visual, tactile, and proprioceptive information) with the visual top-down signals from peripersonal space. Although it has been shown that the visuo-spatial viewpoint from where the body is seen is an important visual top-down factor for body ownership, different studies have reported diverging results. Furthermore, the role of visuo-spatial viewpoint (sometime also called first-person perspective) has only been studied for hands or the whole body, but not for the lower limbs. We thus investigated whether and how leg visuo-tactile integration and leg ownership depended on the visuo-spatial viewpoint from which the legs were seen and the anatomical similarity of the visual leg stimuli. Using a virtual leg illusion, we tested the strength of visuo-tactile integration of leg stimuli using the crossmodal congruency effect (CCE) as well as the subjective sense of leg ownership (assessed by a questionnaire). Fifteen participants viewed virtual legs or non-corporeal control objects, presented either from their habitual first-person viewpoint or from a viewpoint that was rotated by 90°(third-person viewpoint), while applying visuo-tactile stroking between the participants legs and the virtual legs shown on a head-mounted display. The data show that the first-person visuo-spatial viewpoint significantly boosts the visuo-tactile integration as well as the sense of leg ownership. Moreover, the viewpoint-dependent increment of the visuo-tactile integration was only found in the conditions when participants viewed the virtual legs (absent for control objects). These results confirm the importance of first person visuo-spatial viewpoint for the integration of visuo-tactile stimuli and extend findings from the upper extremity and the trunk to visuo-tactile integration and ownership for the legs.

Sliding perspectives: dissociating ownership from self-location during full body illusions in virtual reality

Bodily illusions have been used to study bodily self-consciousness and disentangle its various components, among other the sense of ownership and self-location. Congruent multimodal correlations between the real body and a fake humanoid body can in fact trigger the illusion that the fake body is one's own and/or disrupt the unity between the perceived self-location and the position of the physical body. However, the extent to which changes in self-location entail changes in ownership is still matter of debate. Here we address this problem with the support of immersive virtual reality. Congruent visuotactile stimulation was delivered on healthy participants to trigger full body illusions from different visual perspectives, each resulting in a different degree of overlap between real and virtual body. Changes in ownership and self-location were measured with novel self-posture assessment tasks and with an adapted version of the cross-modal congruency task. We found that, despite their strong coupling, self-location and ownership can be selectively altered: self-location was affected when having a third person perspective over the virtual body, while ownership toward the virtual body was experienced only in the conditions with total or partial overlap. Thus, when the virtual body is seen in the far extra-personal space, changes in self-location were not coupled with changes in ownership. If a partial spatial overlap is present, ownership was instead typically experienced with a boosted change in the perceived self-location. We discussed results in the context of the current knowledge of the multisensory integration mechanisms contributing to self-body perception. We argue that changes in the perceived self-location are associated to the dynamical representation of peripersonal space encoded by visuotactile neurons. On the other hand, our results speak in favor of visuo-proprioceptive neuronal populations being a driving trigger in full body ownership illusions.

Full body illusion is associated with widespread skin temperature reduction

A central feature of our consciousness is the experience of the self as a unified entity residing in a physical body, termed bodily self-consciousness. This phenomenon includes aspects such as the sense of owning a body (also known as body ownership) and has been suggested to arise from the integration of sensory signals from the body. Several studies have shown that temporally synchronous tactile stimulation of the real body and visual stimulation of a fake or virtual body can induce changes in bodily self-consciousness, typically resulting in a sense of illusory ownership over the fake body. The present study assessed the effect of anatomical congruency of visuo-tactile stimulation on bodily self-consciousness. A virtual body was presented and temporally synchronous visuo-tactile stroking was applied simultaneously to the participants' body and to the virtual body. We manipulated the anatomical locations of the visuo-tactile stroking (i.e., on the back, on the leg), resulting in congruent stroking (stroking was felt and seen on the back or the leg) or incongruent stroking (i.e., stroking was felt on the leg and seen on the back). We measured self-identification with the virtual body and self-location as well as skin temperature. Illusory self-identification with the avatar as well as changes in self-location were experienced in the congruent stroking conditions. Participants showed a decrease in skin temperature across several body locations during congruent stimulation. These data establish that the full-body illusion (FBI) alters bodily self-consciousness and instigates widespread physiological changes in the participant's body.

"Seeing" and "feeling" architecture: how bodily self-consciousness alters architectonic experience and affects the perception of interiors

Over the centuries architectural theory evolved several notions of embodiment, proposing in the nineteenth and twentieth century that architectonic experience is related to physiological responses of the observer. Recent advances in the cognitive neuroscience of embodiment (or bodily self-consciousness) enable empirical studies of architectonic embodiment. Here, we investigated how architecture modulates bodily self-consciousness by adapting a video-based virtual reality (VR) setup previously used to investigate visuo-tactile mechanisms of bodily self-consciousness. While standing in two different interiors, participants were filmed from behind and watched their own virtual body online on a head-mounted display (HMD). Visuo-tactile strokes were applied in synchronous or asynchronous mode to the participants and their virtual body. Two interiors were simulated in the laboratory by placing the sidewalls either far or near from the participants, generating a large and narrow room. We tested if bodily self-consciousness was differently modulated when participants were exposed to both rooms and whether these changes depend on visuo-tactile stimulation. We measured illusory touch, self-identification, and performed length estimations. Our data show that synchronous stroking of the physical and the virtual body induces illusory touch and self-identification with the virtual body, independent of room-size. Moreover, in the narrow room we observed weak feelings of illusory touch with the sidewalls and of approaching walls. These subjective changes were complemented by a stroking-dependent modulation of length estimation only in the narrow room with participants judging the room-size more accurately during conditions of illusory self-identification. We discuss our findings and previous notions of architectonic embodiment in the context of the cognitive neuroscience of bodily self-consciousness and propose an empirical framework grounded in architecture, cognitive neuroscience, and VR.

"Self pop-out": agency enhances self-recognition in visual search

In real-life situations, we are often required to recognize our own movements among movements originating from other people. In social situations, these movements are often correlated (for example, when dancing or walking with others) adding considerable difficulty to self-recognition. Studies from visual search have shown that visual attention can selectively highlight specific features to make them more salient. Here, we used a novel visual search task employing virtual reality and motion tracking to test whether visual attention can use efferent information to enhance self-recognition of one's movements among four or six moving avatars. Active movements compared to passive movements allowed faster recognition of the avatar moving like the subject. Critically, search slopes were flat for the active condition but increased for passive movements, suggesting efficient search for active movements. In a second experiment, we tested the effects of using the participants' own movements temporally delayed as distractors in a self-recognition discrimination task. We replicated the results of the first experiment with more rapid self-recognition during active trials. Importantly, temporally delayed distractors increased reaction times despite being more perceptually different than the spatial distractors. The findings demonstrate the importance of agency in self-recognition and self-other discrimination from movement in social settings.

The effect of limb crossing and limb congruency on multisensory integration in peripersonal space for the upper and lower extremities

The present study investigated how multisensory integration in peripersonal space is modulated by limb posture (i.e. whether the limbs are crossed or uncrossed) and limb congruency (i.e. whether the observed body part matches the actual position of one's limb). This was done separately for the upper limbs (Experiment 1) and the lower limbs (Experiment 2). The crossmodal congruency task was used to measure peripersonal space integration for the hands and the feet. It was found that the peripersonal space representation for the hands but not for the feet is dynamically updated based on both limb posture and limb congruency. Together these findings show how dynamic cues from vision, proprioception, and touch are integrated in peripersonal limb space and highlight fundamental differences in the way in which peripersonal space is represented for the upper and lower extremity.