Spatial hearing training in virtual reality with simulated asymmetric hearing loss

Sound localization is essential to perceive the surrounding world and to interact with objects. This ability can be learned across time, and multisensory and motor cues play a crucial role in the learning process. A recent study demonstrated that when training localization skills, reaching to the sound source to determine its position reduced localization errors faster and to a greater extent as compared to just naming sources' positions, despite the fact that in both tasks, participants received the same feedback about the correct position of sound sources in case of wrong response. However, it remains to establish which features have made reaching to sound more effective as compared to naming. In the present study, we introduced a further condition in which the hand is the effector providing the response, but without it reaching toward the space occupied by the target source: the pointing condition. We tested three groups of participants (naming, pointing, and reaching groups) each while performing a sound localization task in normal and altered listening situations (i.e. mild-moderate unilateral hearing loss) simulated through auditory virtual reality technology. The experiment comprised four blocks: during the first and the last block, participants were tested in normal listening condition, while during the second and the third in altered listening condition. We measured their performance, their subjective judgments (e.g. effort), and their head-related behavior (through kinematic tracking). First, people's performance decreased when exposed to asymmetrical mild-moderate hearing impairment, more specifically on the ipsilateral side and for the pointing group. Second, we documented that all groups decreased their localization errors across altered listening blocks, but the extent of this reduction was higher for reaching and pointing as compared to the naming group. Crucially, the reaching group leads to a greater error reduction for the side where the listening alteration was applied. Furthermore, we documented that, across blocks, reaching and pointing groups increased the implementation of head motor behavior during the task (i.e., they increased approaching head movements toward the space of the sound) more than naming. Third, while performance in the unaltered blocks (first and last) was comparable, only the reaching group continued to exhibit a head behavior similar to those developed during the altered blocks (second and third), corroborating the previous observed relationship between the reaching to sounds task and head movements. In conclusion, this study further demonstrated the effectiveness of reaching to sounds as compared to pointing and naming in the learning processes. This effect could be related both to the process of implementing goal-directed motor actions and to the role of reaching actions in fostering the implementation of head-related motor strategies.

Peripersonal space around the upper and the lower limbs

Peripersonal space (PPS), the space closely surrounding the body, is typically characterised by enhanced multisensory integration. Neurophysiological and behavioural studies have consistently shown stronger visuo-tactile integration when a visual stimulus is presented close to the tactually stimulate body part in near space (within PPS) than in far space. However, in the majority of these studies, tactile stimuli were delivered to the upper limbs, torso and face. Therefore, it is not known whether the space surrounding the lower limbs is characterised by similar multisensory properties. To address this question, we asked participants to complete two versions of the classic visuo-tactile crossmodal congruency task in which they had to perform speeded elevation judgements of tactile stimuli presented to the dorsum of the hand and foot while a simultaneous visual distractor was presented at spatially congruent or incongruent locations either in near or far space. In line with existing evidence, when the tactile target was presented to the hand, the size of the crossmodal congruency effect (CCE) decreased in far as compared to near space, suggesting stronger visuo-tactile multisensory integration within PPS. In contrast, when the tactile target was presented to the foot, the CCE decreased for visual distractors in near than far space. These findings show systematic differences between the representation of PPS around upper and lower limbs, suggesting that the multisensory properties of the different body part-centred representations of PPS are likely to depend on the potential actions performed by the different body parts.

Contribution of motor and proprioceptive information to visuotactile interaction in peripersonal space during bike riding

The space immediately around the body, known as the peripersonal space (PPS), plays an important role in interactions with the environment. Specific representations are reported to be constructed in the brain. PPS expansion reportedly occurs during whole-body self-motions, such as walking; however, little is known regarding how dynamic cues in proprioceptive/motor information contribute to such phenomena. Thus, we investigated this issue using a pedaling bike situation. We defined PPS as the maximum distance at which a visual probe facilitated tactile detection at the chest. Experiment 1 compared two conditions where participants did or did not pedal the bike at a constant speed while observing an optic flow that simulated forward self-motion (pedaling and no pedaling). Experiment 2 investigated the effect of pedal resistances (high and low) while presenting the same optic flow as in Experiment 1. The results revealed that the reaction time (RT) difference (probe RT - baseline RT) was larger for the pedaling than for the no-pedaling condition. However, pedal resistance differences hardly affected the visuotactile interaction, although the participants clearly experienced differences in force. These results suggest that proprioceptive/motor cues can contribute to the modulation of PPS representation, but dynamic information included in these cues may have little influence.

Seeming confines: Electrophysiological evidence of peripersonal space remapping following tool-use in humans

The peripersonal space (PPS) is a special portion of space immediately surrounding the body, where the integration between tactile stimuli delivered on the body and auditory or visual events emanating from the environment occurs. Interestingly, PPS can widen if a tool is employed to interact with objects in the far space. However, electrophysiological evidence of such tool-use dependent plasticity in the human brain is scarce. Here, in a series of three experiments, participants were asked to respond to tactile stimuli, delivered to their right hand, either in isolation (unimodal condition) or combined with auditory stimulation, which could occur near (bimodal-near) or far from the stimulated hand (bimodal-far). According to multisensory integration spatial rule, when bimodal stimuli are presented at the same location, we expected a response enhancement (response time - RT - facilitation and event-related potential - ERP - super-additivity). In Experiment 1, we verified that RT facilitation was driven by bimodal input spatial congruency, independently from auditory stimulus intensity. In Experiment 2, we showed that our bimodal task was effective in eliciting the magnification of ERPs in bimodal conditions, with significantly larger responses in the near as compared to far condition. In Experiment 3 (main experiment), we explored tool-use driven PPS plasticity. Our audio-tactile task was performed either following tool-use (a 20-min reaching task, performed using a 145 cm-long rake) or after a control cognitive training (a 20-min visual discrimination task) performed in the far space. Following the control training, faster RTs and greater super-additive ERPs were found in bimodal-near as compared to bimodal-far condition (replicating Experiment 2 results). Crucially, this far-near differential response was significantly reduced after tool-use. Altogether our results indicate a selective effect of tool-use remapping in extending the boundaries of PPS. The present finding might be considered as an electrophysiological evidence of tool-use dependent plasticity in the human brain.

Associative learning in peripersonal space: fear responses are acquired in hand-centered coordinates

Space coding affects perception of stimuli associated to negative valence: threatening stimuli presented within the peripersonal space (PPS) speed up behavioral responses compared with nonthreatening events. However, it remains unclear whether the association between stimuli and their negative valence is acquired in a body part-centered reference system, a main feature of the PPS coding. Here we test the hypothesis that associative learning takes place in hand-centered coordinates and can therefore remap according to hand displacement. In two experiments, we used a Pavlovian fear-learning paradigm to associate a visual stimulus [light circle, the conditioned stimulus (CS)] with an aversive stimulus (electrocutaneous shock) applied on the right hand only when the CS was displayed close (CS+) but when not far from it (CS-). Measuring the skin conductance response (SCR), we observed successful fear conditioning, with increased anticipatory fear responses associated with CS+. Crucially, experiment I showed a remapping of these responses following hand displacement, with a generalization to both types of CS. Experiment II corroborated and further extended our findings by ruling out the novelty of the experimental context as a driving factor of such modulations. Indeed, fear responses were present only for stimuli within the PPS but not for new stimuli displayed outside the PPS. By revealing a hand-centered (re)mapping of the conditioning effect, these findings indicate that associative learning can arise in hand-centered coordinates. They further suggest that the threatening valence of an object also depends on its basic spatial relationship with our body.NEW & NOTEWORTHY Associative fear learning takes place in hand-centered coordinates. Using a Pavlovian fear-learning paradigm, we show that the anticipatory skin conductance response indicating the association between the negative value and an initially neutral stimulus is acquired and then remapped in space when the stimulated body part moves to a different position. These results demonstrate the relationship between the representation of peripersonal space and the encoding of threatening stimuli. Hypotheses concerning the underlying neural network are discussed.

Peripersonal and reaching space differ: Evidence from their spatial extent and multisensory facilitation pattern

Peripersonal space (PPS) is a multisensory representation of the space near body parts facilitating interactions with the close environment. Studies on non-human and human primates agree in showing that PPS is a body part-centered representation that guides actions. Because of these characteristics, growing confusion surrounds peripersonal and arm-reaching space (ARS), that is the space one's arm can reach. Despite neuroanatomical evidence favoring their distinction, no study has contrasted directly their respective extent and behavioral features. Here, in five experiments (N = 140) we found that PPS differs from ARS, as evidenced both by participants' spatial and temporal performance and by its modeling. We mapped PPS and ARS using both their respective gold standard tasks and a novel multisensory facilitation paradigm. Results show that: (1) PPS is smaller than ARS; (2) multivariate analyses of spatial patterns of multisensory facilitation predict participants' hand locations within ARS; and (3) the multisensory facilitation map shifts isomorphically following hand positions, revealing hand-centered coding of PPS, therefore pointing to a functional similarity to the receptive fields of monkeys' multisensory neurons. A control experiment further corroborated these results and additionally ruled out the orienting of attention as the driving mechanism for the increased multisensory facilitation near the hand. In sharp contrast, ARS mapping results in a larger spatial extent, with undistinguishable patterns across hand positions, cross-validating the conclusion that PPS and ARS are distinct spatial representations. These findings show a need for refinement of theoretical models of PPS, which is relevant to constructs as diverse as self-representation, social interpersonal distance, and motor control.

The Redundant Signals Effect and the Full Body Illusion: not Multisensory, but Unisensory Tactile Stimuli Are Affected by the Illusion

During a full body illusion (FBI), participants experience a change in self-location towards a body that they see in front of them from a third-person perspective and experience touch to originate from this body. Multisensory integration is thought to underlie this illusion. In the present study we tested the redundant signals effect (RSE) as a new objective measure of the illusion that was designed to directly tap into the multisensory integration underlying the illusion. The illusion was induced by an experimenter who stroked and tapped the participant's shoulder and underarm, while participants perceived the touch on the virtual body in front of them via a head-mounted display. Participants performed a speeded detection task, responding to visual stimuli on the virtual body, to tactile stimuli on the real body and to combined (multisensory) visual and tactile stimuli. Analysis of the RSE with a race model inequality test indicated that multisensory integration took place in both the synchronous and the asynchronous condition. This surprising finding suggests that simultaneous bodily stimuli from different (visual and tactile) modalities will be transiently integrated into a multisensory representation even when no illusion is induced. Furthermore, this finding suggests that the RSE is not a suitable objective measure of body illusions. Interestingly however, responses to the unisensory tactile stimuli in the speeded detection task were found to be slower and had a larger variance in the asynchronous condition than in the synchronous condition. The implications of this finding for the literature on body representations are discussed.

When two worlds collide: the influence of an obstacle in peripersonal space on multisensory encoding

Multisensory coding of the space surrounding our body, the peripersonal space, is crucial for motor control. Recently, it has been proposed that an important function of multisensory coding is that it allows anticipation of the tactile consequences of contact with a nearby object. Indeed, performing goal-directed actions (i.e. pointing and grasping) induces a continuous visuotactile remapping as a function of on-line sensorimotor requirements. Here, we investigated whether visuotactile remapping can be induced by obstacles, e.g. objects that are not the target of the grasping movement. In the current experiment, we used a cross-modal obstacle avoidance paradigm, in which participants reached past an obstacle to grasp a second object. Participants indicated the location of tactile targets delivered to the hand during the grasping movement, while a visual cue was sometimes presented simultaneously on the to-be-avoided object. The tactile and visual stimulation was triggered when the reaching hand passed a position that was drawn randomly from a continuous set of predetermined locations (between 0 and 200 mm depth at 5 mm intervals). We observed differences in visuotactile interaction during obstacle avoidance dependent on the location of the stimulation trigger: visual interference was enhanced for tactile stimulation that occurred when the hand was near the to-be-avoided object. We show that to-be-avoided obstacles, which are relevant for action but are not to-be-interacted with (as the terminus of an action), automatically evoke the tactile consequences of interaction. This shows that visuotactile remapping extends to obstacle avoidance and that this process is flexible.

Testosterone administration in women increases the size of their peripersonal space

Peripersonal space (PPS) is the space immediately surrounding the body, conceptualised as a sensory-motor interface between body and environment. PPS size differs between individuals and contexts, with intrapersonal traits and states, as well as social factors having a determining role on the size of PPS. Testosterone plays an important role in regulating social-motivational behaviour and is known to enhance dominance motivation in an implicit and unconscious manner. We investigated whether the dominance-enhancing effects of testosterone reflect as changes in the representation of PPS in a within-subjects testosterone administration study in women (N = 19). Participants performed a visuo-tactile integration task in a mixed-reality setup. Results indicated that the administration of testosterone caused a significant enlargement of participants' PPS, suggesting that testosterone caused participants to implicitly appropriate a larger space as their own. These findings suggest that the dominance-enhancing effects of testosterone reflect at the level of sensory-motor processing in PPS.

Predicting Upcoming Events Occurring in the Space Surrounding the Hand

Predicting upcoming sensorimotor events means creating forward estimates of the body and the surrounding world. This ability is a fundamental aspect of skilled motor behavior and requires an accurate and constantly updated representation of the body and the environment. To test whether these prediction mechanisms could be affected by a peripheral injury, we employed an action observation and electroencephalogram (EEG) paradigm to assess the occurrence of prediction markers in anticipation of observed sensorimotor events in healthy and brachial plexus injury (BPI) participants. Nine healthy subjects and six BPI patients watched a series of video clips showing an actor's hand and a colored ball in an egocentric perspective. The color of the ball indicated whether the hand would grasp it (hand movement), or the ball would roll toward the hand and touch it (ball movement), or no event would occur (no movement). In healthy participants, we expected to find distinct electroencephalographic activation patterns (EEG signatures) specific to the prediction of the occurrence of each of these situations. Cluster analysis from EEG signals recorded from electrodes placed over the sensorimotor cortex of control participants showed that predicting either an upcoming hand movement or the occurrence of a tactile event yielded specific neural signatures. In BPI participants, the EEG signals from the sensorimotor cortex contralateral to the dominant hand in the hand movement condition were different compared to the other conditions. Furthermore, there were no differences between ball movement and no movement conditions in the sensorimotor cortex contralateral to the dominant hand, suggesting that BPI blurred specifically the ability to predict upcoming tactile events for the dominant hand. These results highlight the role of the sensorimotor cortex in creating estimates of both actions and tactile interactions in the space around the body and suggest plastic effects on prediction coding following peripheral sensorimotor loss.

Interpersonal Motor Interactions Shape Multisensory Representations of the Peripersonal Space

This perspective review focuses on the proposal that predictive multisensory integration occurring in one's peripersonal space (PPS) supports individuals' ability to efficiently interact with others, and that integrating sensorimotor signals from the interacting partners leads to the emergence of a shared representation of the PPS. To support this proposal, we first introduce the features of body and PPS representations that are relevant for interpersonal motor interactions. Then, we highlight the role of action planning and execution on the dynamic expansion of the PPS. We continue by presenting evidence of PPS modulations after tool use and review studies suggesting that PPS expansions may be accounted for by Bayesian sensory filtering through predictive coding. In the central section, we describe how this conceptual framework can be used to explain the mechanisms through which the PPS may be modulated by the actions of our interaction partner, in order to facilitate interpersonal coordination. Last, we discuss how this proposal may support recent evidence concerning PPS rigidity in Autism Spectrum Disorder (ASD) and its possible relationship with ASD individuals' difficulties during interpersonal coordination. Future studies will need to clarify the mechanisms and neural underpinning of these dynamic, interpersonal modulations of the PPS.

Sensorimotor Representation Learning for an “Active Self” in Robots: A Model Survey

Safe human-robot interactions require robots to be able to learn how to behave appropriately in spaces populated by people and thus to cope with the challenges posed by our dynamic and unstructured environment, rather than being provided a rigid set of rules for operations. In humans, these capabilities are thought to be related to our ability to perceive our body in space, sensing the location of our limbs during movement, being aware of other objects and agents, and controlling our body parts to interact with them intentionally. Toward the next generation of robots with bio-inspired capacities, in this paper, we first review the developmental processes of underlying mechanisms of these abilities: The sensory representations of body schema, peripersonal space, and the active self in humans. Second, we provide a survey of robotics models of these sensory representations and robotics models of the self; and we compare these models with the human counterparts. Finally, we analyze what is missing from these robotics models and propose a theoretical computational framework, which aims to allow the emergence of the sense of self in artificial agents by developing sensory representations through self-exploration.

Preferential Reaching and End-State Comfort: How Task Demands Influence Motor Planning

Various factors (e.g., hand preference, object properties) constrain reach-to-grasp in hemispace. With object use, end-state comfort (ESC) has been shown to supersede the preferential use of one hand at the midline. To assess how location, size, and orientation of objects (dowel, mallet, cup) influence preferred-hand use and ESC (N = 50; M_age = 20.83), three preferential reaching tasks were implemented. Object location influenced hand selection in all tasks, along with size (cups) and orientation (mallets). Object location and orientation influenced ESC, but only with dowels and mallets. When oriented away from the preferred hand in hemispace, there was a higher occurrence of non-preferred hand use to facilitate ESC. Overall, findings add to understanding of ESC and preferential reaching with varying task demands.

Effect of tool-use observation on metric body representation and peripersonal space

In everyday life, we constantly act and interact with objects and with others' people through our body. To properly perform actions, the representations of the dimension of body-parts (metric body representation, BR) and of the space surrounding the body (peripersonal space, PPS) need to be constantly updated. Previous evidence has shown that BR and PPS representation are highly flexible, being modulated by sensorimotor experiences, such as the active use of tools to reach objects in the far space. In this study, we investigate whether the observation of another person using a tool to interact with objects located in the far space is sufficient to influence the plasticity of BR and PPS representation in a similar way to active tool-use. With this aim, two groups of young healthy participants were asked to perform 20 min trainings based on the active use of a tool to retrieve far cubes (active tool-use) and on the first-person observation of an experimenter doing the same tool-use training (observational tool-use). Behavioural tasks adapted from literature were used to evaluate the effects of the active and observational tool-use on BR (body-landmarks localization task-group 1), and PPS (audio-tactile interaction task - group 2). Results show that after active tool-use, participants perceived the length of their arm as longer than at baseline, while no significant differences appear after observation. Similarly, significant modifications in PPS representation, with comparable multisensory facilitation on tactile responses due to near and far sounds, were seen only after active tool-use, while this did not occur after observation. Together these results suggest that a mere observational training could not be sufficient to significantly modulate BR or PPS. The dissociation found in the active and observational tool-use points out differences between action execution and action observation, by suggesting a fundamental role of the motor planning, the motor intention, and the related sensorimotor feedback in driving BR and PPS plasticity.

Rapid Recalibration of Peri-Personal Space: Psychophysical, Electrophysiological, and Neural Network Modeling Evidence

Interactions between individuals and the environment occur within the peri-personal space (PPS). The encoding of this space plastically adapts to bodily constraints and stimuli features. However, these remapping effects have not been demonstrated on an adaptive time-scale, trial-to-trial. Here, we test this idea first via a visuo-tactile reaction time (RT) paradigm in augmented reality where participants are asked to respond as fast as possible to touch, as visual objects approach them. Results demonstrate that RTs to touch are facilitated as a function of visual proximity, and the sigmoidal function describing this facilitation shifts closer to the body if the immediately precedent trial had indexed a smaller visuo-tactile disparity. Next, we derive the electroencephalographic correlates of PPS and demonstrate that this multisensory measure is equally shaped by recent sensory history. Finally, we demonstrate that a validated neural network model of PPS is able to account for the present results via a simple Hebbian plasticity rule. The present findings suggest that PPS encoding remaps on a very rapid time-scale and, more generally, that it is sensitive to sensory history, a key feature for any process contextualizing subsequent incoming sensory information (e.g., a Bayesian prior).

Hand blink reflex in virtual reality: The role of vision and proprioception in modulating defensive responses

Our research focused on the role of vision and proprioception in modulating a defensive reflex (hand blink reflex, HBR) whose magnitude is enhanced when the threatened hand is inside the peripersonal space of the face. We capitalized on virtual reality, which allows dissociating vision and proprioception by presenting a virtual limb in congruent/incongruent positions with respect to the participants' limb. In experiment 1, participants placed their own stimulated hand in far/near positions with respect to their face (postural manipulation task), while observing a virtual empty scenario. Vision was not informative, but the HBR was significantly enhanced in near compared with far position, suggesting that proprioception is sufficient for the HBR modulation to occur. In experiment 2, participants did not perform the postural manipulation but they (passively) observed the avatar's virtual limb performing it. Proprioceptive signals were not informative, but the HBR was significantly enhanced when the observed virtual limb was near to the face, suggesting that visual information plays a role in modulating the HBR. In experiment 3, both participants and avatar performed the postural manipulation, either congruently (both of them far/near) or incongruently (one of them far, the other near). The HBR modulation was present only in congruent conditions. In incongruent conditions, the conflict between vision and proprioception confounded the system, abolishing the difference between far and near positions. Taken together, these findings promote the view that observing a virtual limb modulates the HBR, providing also new evidence on the role of vision and proprioception in modulating this subcortical reflex.

Peri-personal space encoding in patients with disorders of consciousness and cognitive-motor dissociation

Behavioral assessments of consciousness based on overt command following cannot differentiate patients with disorders of consciousness (DOC) from those who demonstrate a dissociation between intent/awareness and motor capacity: cognitive motor dissociation (CMD). We argue that delineation of peri-personal space (PPS) – the multisensory-motor space immediately surrounding the body – may differentiate these patients due to its central role in mediating human-environment interactions, and putatively in scaffolding a minimal form of selfhood. In Experiment 1, we determined a normative physiological index of PPS by recording electrophysiological (EEG) responses to tactile, auditory, or audio-tactile stimulation at different distances (5 vs. 75 cm) in healthy volunteers (N = 19). Contrasts between paired (AT) and summed (A + T) responses demonstrated multisensory supra-additivity when AT stimuli were presented near, i.e., within the PPS, and highlighted somatosensory-motor sensors as electrodes of interest. In Experiment 2, we recorded EEG in patients behaviorally diagnosed as DOC or putative CMD (N = 17, 30 sessions). The PPS-measure developed in Experiment 1 was analyzed in relation with both standard clinical diagnosis (i.e., Coma Recovery Scale; CRS-R) and a measure of neural complexity associated with consciousness. Results demonstrated a significant correlation between the PPS measure and neural complexity, but not with the CRS-R, highlighting the added value of the physiological recordings. Further, multisensory processing in PPS was preserved in putative CMD but not in DOC patients. Together, the findings suggest that indexing PPS allows differentiating between groups of patients whom both show overt motor impairments (DOC and CMD) but putatively distinct levels of awareness or motor intent.

•

Behavioral assessments confound consciousness and motor output.

•

We suggest that multisensory coding of actionable space may dissociate these two.

•

We develop an electrophysiological marker of peri-personal space.

•

Then use this marker to distinguish impairments in consciousness and motor output.

Aim and Plausibility of Action Chains Remap Peripersonal Space

Successful interaction with objects in the peripersonal space requires that the information relative to current and upcoming positions of our body is continuously monitored and updated with respect to the location of target objects. Voluntary actions, for example, are known to induce an anticipatory remapping of the peri-hand space (PHS, i.e., the space near the acting hand) during the very early stages of the action chain: planning and initiating an object grasp increase the interference exerted by visual stimuli coming from the object on touches delivered to the grasping hand, thus allowing for hand-object position monitoring and guidance. Voluntarily grasping an object, though, is rarely performed in isolation. Grasping a candy, for example, is most typically followed by concatenated secondary action steps (bringing the candy to the mouth and swallowing it) that represent the agent’s ultimate intention (to eat the candy). However, whether and when complex action chains remap the PHS remains unknown, just as whether remapping is conditional to goal achievability (e.g., candy-mouth fit). Here we asked these questions by assessing changes in visuo-tactile interference on the acting hand while participants had to grasp an object serving as a support for an elongated candy, and bring it toward their mouth. Depending on its orientation, the candy could potentially enter the participants’ mouth (plausible goal), or not (implausible goal). We observed increased visuo-tactile interference at relatively late stages of the action chain, after the object had been grasped, and only when the action goal was plausible. These findings suggest that multisensory interactions during action execution depend upon the final aim and plausibility of complex goal-directed actions, and extend our knowledge about the role of peripersonal space in guiding goal-directed voluntary actions.

Hands Ahead in Mind and Motion: Active Inference in Peripersonal Hand Space

According to theories of anticipatory behavior control, actions are initiated by predicting their sensory outcomes. From the perspective of event-predictive cognition and active inference, predictive processes activate currently desired events and event boundaries, as well as the expected sensorimotor mappings necessary to realize them, dependent on the involved predicted uncertainties before actual motor control unfolds. Accordingly, we asked whether peripersonal hand space is remapped in an uncertainty anticipating manner while grasping and placing bottles in a virtual reality (VR) setup. To investigate, we combined the crossmodal congruency paradigm with virtual object interactions in two experiments. As expected, an anticipatory crossmodal congruency effect (aCCE) at the future finger position on the bottle was detected. Moreover, a manipulation of the visuo-motor mapping of the participants’ virtual hand while approaching the bottle selectively reduced the aCCE at movement onset. Our results support theories of event-predictive, anticipatory behavior control and active inference, showing that expected uncertainties in movement control indeed influence anticipatory stimulus processing.