Spontaneous imitative movements induced by an illusory embodied fake hand

Threatening an Illusory Limb: An Event-related Potential Study of the Rubber Hand Illusion

BACKGROUND

The rubber hand illusion (RHI) is a well-established method for studying body ownership: Given adequate concordance of visual, sensory, and proprioceptive stimuli, the individual experiences a rubber hand as his or her own.

OBJECTIVE

To study the effects of a threat to the rubber hand.

METHODS

We created a typical RHI paradigm but added threatening pain: Both the real hand of an individual and the rubber hand were stroked with a brush, either synchronously (RHI-inducing condition) or asynchronously (control condition), but only the rubber hand was then pricked with a needle to create a threatening pain condition. Event-related potentials (ERPs) were recorded in a group of 23 typically-developed individuals. ERP effects were source-localized using low-resolution electromagnetic tomography.

RESULTS

The individuals consistently reported experience of the RHI during the experiment when the brush strokes were applied synchronously to both the real hand and the rubber hand. ERP analysis revealed that synchronous brush stroking gave rise to higher amplitude of frontal ERPs in the 100-200 ms range than asynchronous brush stroking, which was interpreted as reflecting the RHI. In the threatening pain condition, ERPs showed a greater positivity at frontocentral electrodes, source localized in the supplementary motor area (SMA).

CONCLUSION

SMA activation could reflect a control mechanism over reflexive motor activity, facilitating a possible threat-related response. Further studies should address ERP effects and the extent of the RHI to standard and threat stimuli in a correlative fashion to further elucidate the functional significance of the neurophysiological findings.

Facilitation of imitative movement in patients with chronic hemiplegia triggered by illusory ownership

The sense of body ownership, the feeling that one's body belongs to oneself, is a crucial subjective conscious experience of one's body. Recent methodological advances regarding crossmodal illusions have provided novel insights into how multisensory interactions shape human perception and cognition, underpinning conscious experience, particularly alteration of body ownership. Moreover, in post-stroke rehabilitation, encouraging the use of the paretic limb in daily life is considered vital, as a settled sense of ownership and attentional engagement toward the paralyzed body part may promote increased frequency of its use and prevent learned nonuse. Therefore, in addition to traditional methods, novel interventions using neurorehabilitation techniques that induce self-body recognition are needed. This study investigated whether the illusory experience of a patient's ownership alterations of their paretic hand facilitates the enhancement in the range of motion of succeeding imitation movements. An experiment combining a modified version of the rubber hand illusion with imitation training was conducted with chronic hemiplegia. A larger imitation movement of the paretic hand was observed in the illusion-induced condition, indicating that the feeling of ownership toward the observed limb promotes the induction of intrinsic potential for motor performance. This training, using subjective experience, may help develop new post-stroke rehabilitation interventions.

Mu Rhythm Desynchronization while Observing Rubber Hand Movement in the Mirror: The Interaction of Body Representation with Visuo-Tactile Stimulation

During rubber hand illusion (RHI), participants feel that a rubber (fake) hand is their own (i.e., embodiment of the rubber hand) if the unseen real hand and seen rubber hand are stroked synchronously (i.e., visuo-tactile stimuli). The RHI is also evoked if the real and rubber hands are placed in the same position (i.e., visual-proprioceptive congruency), which can be performed using a mirror setting. Using electroencephalography (EEG) and mirror settings, we compared μ rhythm (8-13 Hz) event-related desynchronization (ERD; an index of sensorimotor activation) while watching the movements of embodied or non-embodied rubber hands, which was preceded by an observation of the rubber hand with or without synchronous visuo-tactile stimuli. The illusory ownership of the fake hand was manipulated using visual continuity with (RHI) and without (non-RHI) a fake forearm. Resultantly, an ownership-dependent μ rhythm ERD was found when delivering visuo-tactile stimuli; a greater and more persistent μ rhythm ERD during the rubber hand movement was identified in the RHI in comparison to the non-RHI condition. However, no difference was observed between the two when observing the fake hand alone. These findings suggest the possibility that a self-related multisensory interaction between body representation (top-down processing) and visuo-tactile inputs (bottom-up processing) before a fake hand movement produces ownership-dependent sensorimotor activations during subsequent movement observations.

Effect of immersive visualization technologies on cognitive load, motivation, usability, and embodiment

Virtual reality (VR) is a promising tool to promote motor (re)learning in healthy users and brain-injured patients. However, in current VR-based motor training, movements of the users performed in a three-dimensional space are usually visualized on computer screens, televisions, or projection systems, which lack depth cues (2D screen), and thus, display information using only monocular depth cues. The reduced depth cues and the visuospatial transformation from the movements performed in a three-dimensional space to their two-dimensional indirect visualization on the 2D screen may add cognitive load, reducing VR usability, especially in users suffering from cognitive impairments. These 2D screens might further reduce the learning outcomes if they limit users' motivation and embodiment, factors previously associated with better motor performance. The goal of this study was to evaluate the potential benefits of more immersive technologies using head-mounted displays (HMDs). As a first step towards potential clinical implementation, we ran an experiment with 20 healthy participants who simultaneously performed a 3D motor reaching and a cognitive counting task using: (1) (immersive) VR (IVR) HMD, (2) augmented reality (AR) HMD, and (3) computer screen (2D screen). In a previous analysis, we reported improved movement quality when movements were visualized with IVR than with a 2D screen. Here, we present results from the analysis of questionnaires to evaluate whether the visualization technology impacted users' cognitive load, motivation, technology usability, and embodiment. Reports on cognitive load did not differ across visualization technologies. However, IVR was more motivating and usable than AR and the 2D screen. Both IVR and AR rea ched higher embodiment level than the 2D screen. Our results support our previous finding that IVR HMDs seem to be more suitable than the common 2D screens employed in VR-based therapy when training 3D movements. For AR, it is still unknown whether the absence of benefit over the 2D screen is due to the visualization technology per se or to technical limitations specific to the device.

EEG signature of breaks in embodiment in VR

The brain mechanism of embodiment in a virtual body has grown a scientific interest recently, with a particular focus on providing optimal virtual reality (VR) experiences. Disruptions from an embodied state to a less- or non-embodied state, denominated Breaks in Embodiment (BiE), are however rarely studied despite their importance for designing interactions in VR. Here we use electroencephalography (EEG) to monitor the brain's reaction to a BiE, and investigate how this reaction depends on previous embodiment conditions. The experimental protocol consisted of two sequential steps; an induction step where participants were either embodied or non-embodied in an avatar, and a monitoring step where, in some cases, participants saw the avatar's hand move while their hand remained still. Our results show the occurrence of error-related potentials linked to observation of the BiE event in the monitoring step. Importantly, this EEG signature shows amplified potentials following the non-embodied condition, which is indicative of an accumulation of errors across steps. These results provide neurophysiological indications on how progressive disruptions impact the expectation of embodiment for a virtual body.

The rubber hand illusion is accompanied by a distributed reduction of alpha and beta power in the EEG

Previous studies have reported correlates of bodily self-illusions such as the rubber hand in signatures of rhythmic brain activity. However, individual studies focused on specific variations of the rubber hand paradigm, used different experimental setups to induce this, or used different control conditions to isolate the neurophysiological signatures related to the illusory state, leaving the specificity of the reported illusion-signatures unclear. We here quantified correlates of the rubber hand illusion in EEG-derived oscillatory brain activity and asked two questions: which of the observed correlates are robust to the precise nature of the control conditions used as contrast for the illusory state, and whether such correlates emerge directly around the subjective illusion onset. To address these questions, we relied on two experimental configurations to induce the illusion, on different non-illusion conditions to isolate neurophysiological signatures of the illusory state, and we implemented an analysis directly focusing on the immediate moment of the illusion onset. Our results reveal a widespread suppression of alpha and beta-band activity associated with the illusory state in general, whereby the reduction of beta power prevailed around the immediate illusion onset. These results confirm previous reports of a suppression of alpha and beta rhythms during body illusions, but also highlight the difficulties to directly pinpoint the precise neurophysiological correlates of the illusory state.

Influence of the Somatic Rubber Hand Illusion on Maximum Grip Aperture

The classic rubber hand illusion (RHI), based on visual, proprioceptive, and tactile feedback, can affect actions. However, it is not known whether these effects still occur if the paradigm is administered without visual feedback. In this study, we used the somatic RHI to test in thirty-two healthy individuals whether the incorporation of the rubber hand based on proprioceptive and tactile information only is sufficient to generate changes in actions. We measured maximum grip aperture (GA) changes towards a target and associated brain activations within the dorsal stream before and after the somatic RHI. Behavioural and neuroimaging data do not support an effect on maximum GA when the RHI is based on proprioceptive and tactile information only.

Multisensory and Sensorimotor Integration in the Embodied Self: Relationship between Self-Body Recognition and the Mirror Neuron System

The embodied self is rooted in the self-body in the "here and now". The senses of self-ownership and self-agency have been proposed as the basis of the sense of embodied self, and many experimental studies have been conducted on this subject. This review summarizes the experimental research on the embodied self that has been conducted over the past 20 years, mainly from the perspective of multisensory integration and sensorimotor integration regarding the self-body. Furthermore, the phenomenon of back projection, in which changes in an external object (e.g., a rubber hand) with which one has a sense of ownership have an inverse influence on the sensation and movement of one's own body, is discussed. This postulates that the self-body illusion is not merely an illusion caused by multisensory and/or sensorimotor integration, but is the incorporation of an external object into the self-body representation in the brain. As an extension of this fact, we will also review research on the mirror neuron system, which is considered to be the neural basis of recognition of others, and discuss how the neural basis of self-body recognition and the mirror neuron system can be regarded as essentially the same.

Preliminary Evaluation of the Moving Rubber Foot Illusion in a Sample of Female University Students

The Rubber Foot Illusion (RFI) is an illusion in which one is made to feel that a model foot is their own through synchronous visuo-tactile stimulation. Previous research suggests that the conditions the RFI can be elicited under are similar to those of the Rubber Hand Illusion (RHI). However, it was unknown if the RFI could be elicited by synchronous movement of a participant's foot and a model foot. To examine this, we developed the Moving Rubber Foot Illusion (mRFI) and compared participants' experience of it to the RFI. The results of this study suggests that the RFI can be elicited through synchronous movement, and results in more proprioceptive drift than a static variant of the RFI. More work is needed to better understand the mechanisms underlying the mRFI.

Neural mechanisms underlying the Rubber Hand Illusion: A systematic review of related neurophysiological studies

INTRODUCTION

Many researchers took advantage of the well-established rubber hand illusion (RHI) paradigm to explore the link between the sense of body ownership and the different brain structures and networks. Here, we aimed to review the studies that have investigated this phenomenon by means of neurophysiological techniques.

METHODS

The MEDLINE, accessed by Pubmed and EMBASE electronic databases, was searched using the medical subject headings: "Rubber hand illusion" AND "Transcranial magnetic stimulation (TMS)" OR "Evoked potentials (EP)" OR "Event related potentials (ERP)" OR "Electroencephalography (EEG)".

RESULTS

Transcranial magnetic stimulation studies revealed a significant excitability drop in primary motor cortex hand circuits accompanying the disembodiment of the real hand during the RHI experience and that the perceived ownership over the rubber hand is associated with normal parietal-motor communication. Moreover, TMS provided causal evidence that the extrastriate body area is involved in the RHI and subsequently in body representation, while neuromodulation of ventral premotor area and the inferior parietal lobe did not result in an enhancement of embodiment. EP and ERP studies suggest that pre-existing body representations may affect larger stages of tactile processing and support predictive coding models of the functional architecture of multisensory integration in bodily perceptual experience. High-frequency oscillations on EEG play a role in the integrative processing of stimuli across modalities, and EEG activity in γ band activity in the parietal area reflects the visuotactile integration process. EEG studies also revealed that RHI is associated with the neural circuits underlying motor control and that premotor areas play a crucial role in mediating illusory body ownership.

CONCLUSION

Neurophysiological studies shed new light on our understanding of the different aspects that contribute to the formation of a coherent self-awareness in humans.

Distinct modulation of mu and beta rhythm desynchronization during observation of embodied fake hand rotation

The rubber hand illusion (RHI) is a phenomenon whereby participants recognize a fake hand as their own. Studies have examined the effects of observing fake hand movements after the RHI on brain sensorimotor activity, although results remain controversial. To address these discrepancies, we investigated the effects of observation of fake hand rotation after the RHI on sensorimotor mu (μ: 8-13 Hz) and beta (β: 15-25 Hz) rhythm event-related desynchronization (ERD) using electroencephalography (EEG). Questionnaire results and proprioceptive drift revealed that the RHI occurred in participants when their invisible hand and fake visible hand were stroked synchronously but not during asynchronous stroking. Independent component (IC) clustering from EEG data during movement observation identified three IC clusters, including the right sensorimotor, left sensorimotor, and left occipital cluster. In the right sensorimotor cluster, we observed distinct modulation of μ and β ERD during fake hand rotation. Illusory ownership over the fake hand enhanced μ ERD but inversely attenuated β ERD. Further, the extent of μ ERD correlated with proprioceptive drift, but not with questionnaire ratings, whereas the converse results were obtained for β ERD. No ownership-dependent ERD modulation was detected in the left sensorimotor cluster. Alpha (α: 8-13 Hz) rhythm ERD of the left occipital cluster was smaller in the synchronous condition than in the asynchronous condition, but α ERD was not correlated with questionnaire rating or drift. These findings suggest that observing embodied fake hand rotation induces distinct cortical processing in sensorimotor brain areas.

Congruency of Information Rather Than Body Ownership Enhances Motor Performance in Highly Embodied Virtual Reality

In immersive virtual reality, the own body is often visually represented by an avatar. This may induce a feeling of body ownership over the virtual limbs. Importantly, body ownership and the motor system share neural correlates. Yet, evidence on the functionality of this neuroanatomical coupling is still inconclusive. Findings from previous studies may be confounded by the congruent vs. incongruent multisensory stimulation used to modulate body ownership. This study aimed to investigate the effect of body ownership and congruency of information on motor performance in immersive virtual reality. We aimed to modulate body ownership by providing congruent vs. incongruent visuo-tactile stimulation (i.e., participants felt a brush stroking their real fingers while seeing a virtual brush stroking the same vs. different virtual fingers). To control for congruency effects, unimodal stimulation conditions (i.e., only visual or tactile) with hypothesized low body ownership were included. Fifty healthy participants performed a decision-making (pressing a button as fast as possible) and a motor task (following a defined path). Body ownership was assessed subjectively with established questionnaires and objectively with galvanic skin response (GSR) when exposed to a virtual threat. Our results suggest that congruency of information may decrease reaction times and completion time of motor tasks in immersive virtual reality. Moreover, subjective body ownership is associated with faster reaction times, whereas its benefit on motor task performance needs further investigation. Therefore, it might be beneficial to provide congruent information in immersive virtual environments, especially during the training of motor tasks, e.g., in neurorehabilitation interventions.

Using Body Ownership to Modulate the Motor System in Stroke Patients

Recent findings suggest that body ownership can activate the motor system in the absence of movement execution. Here, we investigated whether such a process promotes motor recovery in stroke patients. A group of patients with left-hemisphere damage (N = 12) and chronic motor deficits completed an immersive virtual reality training (three sessions of 15 min each week for 11 weeks). Patients sat still and either experienced (first-person perspective) or did not experience (third-person perspective) illusory ownership over the body of a standing virtual avatar. After the training, in which the avatar walked around a virtual environment, only patients who experienced the illusion improved gait and balance. We argue that representing the virtual body as their own allowed patients to access motor functioning and promoted motor recovery. This procedure might be integrated with rehabilitative approaches centered on motor execution. These findings also have an impact on the knowledge of the motor system in general.

The Relationship Between Referral of Touch and the Feeling of Ownership in the Rubber Hand Illusion

The rubber hand illusion (RHI) is one of the most commonly used paradigms to examine the sense of body ownership. Touches are synchronously applied to the real hand, hidden from view, and a false hand in an anatomically congruent position. During the illusion one may perceive that the feeling of touch arises from the false hand (referral of touch), and that the false hand is one's own. The relationship between referral of touch and body ownership in the illusion is unclear, and some articles average responses to statements addressing these experiences, which may be inappropriate depending on the research question of interest. To address these concerns, we re-analyzed three freely available datasets to better understand the relationship between referral of touch and feeling of ownership in the RHI. We found that most participants who report a feeling of ownership also report referral of touch, and that referral of touch and ownership show a moderately strong positive relationship that was highly replicable. In addition, referral of touch tends to be reported more strongly and more frequently than the feeling of ownership over the hand. The former observations confirm that referral of touch and ownership are related experiences in the RHI. The latter, however, indicate that when pooling the statements one may obtain a higher number of illusion ‘responders’ compared to considering the ownership statements in isolation. These results have implications for the RHI as an experimental paradigm.

I'm a believer: Illusory self-generated touch elicits sensory attenuation and somatosensory evoked potentials similar to the real self-touch

Sensory attenuation (i.e., the phenomenon whereby self-produced sensations are perceived as less intense compared to externally occurring ones) is among the neurocognitive processes that help distinguishing ourselves from others. It is thought to be rooted in the motor system (e.g., related to motor intention and prediction), while the role of body awareness, which necessarily accompanies any voluntary movement, in this phenomenon is largely unknown. To fill this gap, here we compared the perceived intensity, somatosensory evoked potentials, and alpha-band desynchronization for self-generated, other-generated, and embodied-fake-hand-generated somatosensory stimuli. We showed that sensory attenuation triggered by the own hand and by the embodied fake hand had the same behavioral and neurophysiological signatures (reduced subjective intensity, reduced of N140 and P200 SEP components and post-stimulus alpha-band desynchronization). Therefore, signals subserving body ownership influenced attenuation of somatosensory stimuli, possibly in a postdictive manner. This indicates that body ownership is crucial for distinguishing the source of the perceived sensations.

Functional properties of extended body representations in the context of kinesthesia

A person's internal representation of his/her body is not fixed. It can be substantially modified by neurological injuries and can also be extended (in healthy participants) to incorporate objects that have a corporeal appearance (such as fake body segments, e.g. a rubber hand), virtual whole bodies (e.g. avatars), and even objects that do not have a corporeal appearance (e.g. tools). Here, we report data from patients and healthy participants that emphasize the flexible nature of body representation and question the extent to which incorporated objects have the same functional properties as biological body parts. Our data shed new light by highlighting the involvement of visual motion information from incorporated objects (rubber hands, full body avatars and hand-held tools) in the perception of one's own movement (kinesthesia). On the basis of these findings, we argue that incorporated objects can be treated as body parts, especially when kinesthesia is involved.

Sensorimotor and Posterior Brain Activations During the Observation of Illusory Embodied Fake Hand Movement

In the rubber hand illusion (RHI), the subject recognizes a fake hand as his or her own. We recently found that the observation of embodied fake hand movement elicited mu-rhythm (8–13 Hz) desynchronization on electroencephalography (EEG), suggesting brain activation in the sensorimotor regions. However, it is known that mu-rhythm desynchronization during action observation is confounded with occipital alpha-rhythm desynchronization, which is modulated by attention. This study examined the independence of brain activities in the sensorimotor and occipital regions relating to the movement observation under the RHI. The invisible participant’s left and fake right hands were stroked simultaneously, which was interrupted by unexpected fake hand movements. A mirror-reversed image of the fake hand was shown on a monitor in front of the participant with a delay of 80, 280, or 480 ms. Illusion strength decreased as a function of the delay. EEG independent component analysis (ICA) and ICA clustering revealed six clusters with observation-induced desynchronization of 8–13 Hz frequency band. In the right sensorimotor cluster, mu-rhythm desynchronization was the greatest under the 80-ms delay, while alpha-rhythm desynchronization of the occipital clusters did not show delay-dependence. These results suggest that brain activation in the sensorimotor areas (i.e., mu-rhythm desynchronization) induced by embodied fake hand movement is independent of that in the occipital areas (alpha-rhythm desynchronization).

The Role of Body-Related Afferent Signals in Human Sense of Agency

At present, most of the neurocognitive models of human sense of agency (ie, "this action is due to my own will") have been traditionally rooted in a variety of internal efferent signals arising within the motor system. However, recent neuroscientific evidence has suggested that also the body-related afferent signals that subserve body ownership (ie, "this body is mine") might have a key role in this process. Accordingly, in the present review paper, we briefly examined the literature investigating how and to what extent body ownership contributes to building up human motor consciousness. Evidence suggests that, if required by the context, body ownership per se can act on agency attribution (ie, independently from efferent signals). Hence, a unitary and coherent subjective experience of willed actions (ie, "this willed action is being realized by my own body") requires both awareness of being an agent and of owning the body.

Body ownership increases the interference between observed and executed movements

When we successfully achieve willed actions, the feeling that our moving body parts belong to the self (i.e., body ownership) is barely required. However, how and to what extent the awareness of our own body contributes to the neurocognitive processes subserving actions is still debated. Here we capitalized on immersive virtual reality in order to examine whether and how body ownership influences motor performance (and, secondly, if it modulates the feeling of voluntariness). Healthy participants saw a virtual body either from a first or a third person perspective. In both conditions, they had to draw continuously straight vertical lines while seeing the virtual arm doing the same action (i.e., drawing lines) or deviating from them (i.e., drawing ellipses). Results showed that when there was a mismatch between the intended and the seen movements (i.e., participants had to draw lines but the avatar drew ellipses), motor performance was strongly "attracted" towards the seen (rather than the performed) movement when the avatar's body part was perceived as own (i.e., first person perspective). In support of previous studies, here we provide direct behavioral evidence that the feeling of body ownership modulates the interference of seen movements to the performed movements.