Tool-Use: Capturing Multisensory Spatial Attention or Extending Multisensory Peripersonal Space?

The different impact of attention, movement, and sensory information on body metric representation

A growing body of research investigating the relationship between body representation and tool-use has shown that body representation is highly malleable. The nature of the body representation does not consist only of sensory attributes but also of motor action-oriented qualities, which may modulate the subjective experience of our own body. However, how these multisensory factors and integrations may specifically guide and constrain body reorientation's plasticity has been under-investigated. In this study, we used a forearm bisection task to selectively investigate the contribution of motor, sensory, and attentional aspects in guiding body representation malleability. Results show that the perceived forearm midpoint deviates from the real one. This shift is further modulated by a motor task but not by a sensory task, whereas the attentional task generates more uncertain results. Our findings provide novel insight into the individual role of movement, somatosensation, and attention in modulating body metric representation.

Action does not drive visual biases in peri-tool space

Observers experience visual biases in the area around handheld tools. These biases may occur when active use leads an observer to incorporate a tool into the body schema. However, the visual salience of a handheld tool may instead create an attentional prioritization that is not reliant on body-based representations. We investigated these competing explanations of near-tool visual biases in two experiments during which participants performed a target detection task. Targets could appear near or far from a tool positioned next to a display. In Experiment 1, participants showed facilitation in detecting targets that appeared near a simple handheld rake tool regardless of whether they first used the rake to retrieve objects, but participants who only viewed the tool without holding it were no faster to detect targets appearing near the rake than targets that appeared on the opposite side of the display. In a second experiment, participants who held a novel magnetic tool again showed a near-tool bias even when they refrained from using the tool. Taken together, these results suggest active use is unnecessary, but visual salience is not sufficient, to introduce visual biases in peri-tool space.

Knowing your boundaries: no effect of tool-use on body representation following a gather-and-sort task

Internal representations of the body have received considerable attention in recent years, particularly in the context of tool-use. Results have supported the notion that these representations are plastic and tool-use engenders an extension of the internal representation of the arm. However, the limitations of the literature underlying this tool embodiment process have not been adequately considered or tested. For example, there is some evidence that tool-use effects do not extend beyond simplistic tool-use tasks. To further clarify this issue, 66 participants engaged in a period of tool-augmented reaches in a speeded gather-and-sort task. If task characteristics inherent to simplistic tasks are relevant to putative embodiment effects, it was predicted that there would be no effect of tool-use on tactile distance judgments or forearm bisections. A Bayesian analysis found considerable support for the null hypothesis in both outcome measures, suggesting that some of the evidence for tool embodiment may be based in task characteristics inherent in the narrow range of tool-use tasks used to study them, rather than a tool incorporation process. Potential sources of influence stemming from these characteristics are discussed.

Physically real and virtual reality exposed line bisection response patterns: visuospatial attention allocation in virtual reality

INTRODUCTION

To understand the nature of hemispatial attention allocation in virtual reality (VR), a line bisection task (LBT) was administered both in a real environment and a virtual environment to assess the rate of pseudoneglect. The mental construction of real and virtual environments was assumed to increase visuospatial activity in right hemisphere-related cognitive processes; an alteration in the activity that manifests in the direction and rate of line bisection lateral error.

METHODS

In the present study, fifty-one right-handed healthy college students were recruited. They performed a line bisection task in real and virtual environments.

RESULTS

The obtained data showed that LBT errors in real and VR environments were correlated and individually consistent. Furthermore, a leftward LBT error was found in the physically real environment, however, in a VR the line bisection bias drifted towards the right hemispace. Participants with a lower right-handedness score showed a lower rate of left LBT bias in a real environment, but in VR, their LBT error showed a stronger rightwards error.

DISCUSSION

Participants showed an individually consistent pattern in both real and VR environments, but VR-induced visuospatial reality construction was associated with rightward LBT bias in a virtual environment.

The Remapping of Peripersonal Space in a Real but Not in a Virtual Environment

One of the most surprising features of our brain is the fact that it is extremely plastic. Among the various plastic processes supported by our brain, there is the neural representation of the space surrounding our body, the peripersonal space (PPS). The effects of real-world tool use on the PPS are well known in cognitive neuroscience, but little is still known whether similar mechanisms also govern virtual tool use. To this purpose, the present study investigated the plasticity of the PPS before and after a real (Experiment 1) or virtual motor training with a tool (Experiment 2). The results show the expansion of the PPS only following real-world tool use but not virtual use, highlighting how the two types of training potentially rely on different processes. This study enriches the current state of the art on the plasticity of PPS in real and virtual environments. We discuss our data with respect to the relevance for the development of effective immersive environment for trainings, learning and rehabilitation.

Are tools truly incorporated as an extension of the body representation?: Assessing the evidence for tool embodiment

The predominant view on human tool-use suggests that an action-oriented body representation, the body schema, is altered to fit the tool being wielded, a phenomenon termed tool embodiment. While observations of perceptual change after tool-use purport to support this hypothesis, several issues undermine their validity in this context, discussed at length in this critical review. The primary measures used as indicators of tool embodiment each face unique challenges to their construct validity. Further, the perceptual changes taken as indicating extension of the body representation only appear to account for a fraction of the tool's size in any given experiment, and do not demonstrate the covariance with tool length that the embodiment hypothesis would predict. The expression of tool embodiment also appears limited to a narrow range of tool-use tasks, as deviations from a simple reaching paradigm can mollify or eliminate embodiment effects altogether. The shortcomings identified here generate important avenues for future research. Until the source of the kinematic and perceptual effects that have substantiated tool embodiment is disambiguated, the hypothesis that the body representation changes to fit tools during tool-use should not be favored over other possibilities such as the formation of separable internal tool models, which seem to offer a more complete account of human tool-use behaviors. Indeed, studies of motor learning have observed analogous perceptual changes as aftereffects to adaptation despite the absence of handheld tool-use, offering a compelling alternative explanation, though more work is needed to confirm this possibility.

On the psychological origins of tool use

The ubiquity of tool use in human life has generated multiple lines of scientific and philosophical investigation to understand the development and expression of humans' engagement with tools and its relation to other dimensions of human experience. However, existing literature on tool use faces several epistemological challenges in which the same set of questions generate many different answers. At least four critical questions can be identified, which are intimately intertwined-(1) What constitutes tool use? (2) What psychological processes underlie tool use in humans and nonhuman animals? (3) Which of these psychological processes are exclusive to tool use? (4) Which psychological processes involved in tool use are exclusive to Homo sapiens? To help advance a multidisciplinary scientific understanding of tool use, six author groups representing different academic disciplines (e.g., anthropology, psychology, neuroscience) and different theoretical perspectives respond to each of these questions, and then point to the direction of future work on tool use. We find that while there are marked differences among the responses of the respective author groups to each question, there is a surprising degree of agreement about many essential concepts and questions. We believe that this interdisciplinary and intertheoretical discussion will foster a more comprehensive understanding of tool use than any one of these perspectives (or any one of these author groups) would (or could) on their own.

Contribution of motor and proprioceptive information to visuotactile interaction in peripersonal space during bike riding

The space immediately around the body, known as the peripersonal space (PPS), plays an important role in interactions with the environment. Specific representations are reported to be constructed in the brain. PPS expansion reportedly occurs during whole-body self-motions, such as walking; however, little is known regarding how dynamic cues in proprioceptive/motor information contribute to such phenomena. Thus, we investigated this issue using a pedaling bike situation. We defined PPS as the maximum distance at which a visual probe facilitated tactile detection at the chest. Experiment 1 compared two conditions where participants did or did not pedal the bike at a constant speed while observing an optic flow that simulated forward self-motion (pedaling and no pedaling). Experiment 2 investigated the effect of pedal resistances (high and low) while presenting the same optic flow as in Experiment 1. The results revealed that the reaction time (RT) difference (probe RT - baseline RT) was larger for the pedaling than for the no-pedaling condition. However, pedal resistance differences hardly affected the visuotactile interaction, although the participants clearly experienced differences in force. These results suggest that proprioceptive/motor cues can contribute to the modulation of PPS representation, but dynamic information included in these cues may have little influence.

Does response facilitation to visuo-tactile stimuli around a remote-controlled hand avatar reflect peripersonal space or attentional bias?

People react faster to visuo-tactile stimuli presented near the body (i.e., in peripersonal space) than to tactile stimuli presented alone. This multi-sensory facilitation effect has been used as a measurement of peripersonal space. Previous research has reported that peripersonal space representations can be modulated by actively using hand-held tools or disconnected hand avatars. However, previous research has ignored the possibility that the attentional effect of active tool use could affect multi-sensory facilitation. In the present study, we delivered tactile stimuli to participants' left or right hand concurrently with visual stimuli presented near a virtual hand avatar operated by the movements of participants' left or right hand, which was shown far in a virtual environment and disconnected from the body. Participants reacted to tactile stimuli while ignoring the visual stimuli. The results indicated a multi-sensory facilitation effect when tactile stimuli were delivered to the hand used to operate the hand avatar. In contrast, the facilitation was not observed when the tactile stimuli were delivered to the hand that is not operating the hand avatar. These results suggest that the strength of the multi-sensory facilitation effect differed across conditions, even though the visual attention captured around the hand avatar was controlled across conditions. We concluded that the modulation of peripersonal space resulting from using tools or avatars is nearly independent of visual attention captured around tools or avatars.

The Interrelation Between Peripersonal Action Space and Interpersonal Social Space: Psychophysiological Evidence and Clinical Implications

The peripersonal space is an adaptive and flexible interface between the body and the environment that fulfills a dual-motor function: preparing the body for voluntary object-oriented actions to interact with incentive stimuli and preparing the body for defensive responses when facing potentially harmful stimuli. In this position article, we provide arguments for the sensorimotor rooting of the peripersonal space representation and highlight the variables that contribute to its flexible and adaptive characteristics. We also demonstrate that peripersonal space represents a mediation zone between the body and the environment contributing to not only the control of goal-directed actions but also the organization of social life. The whole of the data presented and discussed led us to the proposal of a new theoretical framework linking the peripersonal action space and the interpersonal social space and we highlight how this theoretical framework can account for social behaviors in populations with socio-emotional deficits.

Vision is biased near handheld, but not remotely operated, tools

Previous studies have shown that after actively using a handheld tool for a period of time, participants show visual biases toward stimuli presented near the end of the tool. Research suggests this is driven by an incorporation of the tool into the observer's body schema, extending peripersonal space to surround the tool. This study aims to investigate whether the same visual biases might be seen near remotely operated tools. Participants used tools-a handheld rake (Experiment 1), a remote-controlled drone (Experiment 2), a remote-controlled excavator (Experiment 3), or a handheld excavator (Experiment 4)-to rake sand for several minutes, then performed a target-detection task in which they made speeded responses to targets appearing near and far from the tool. In Experiment 1, participants detected targets appearing near the rake significantly faster than targets appearing far from the rake, replicating previous findings. We failed to find strong evidence of improved target detection near remotely operated tools in Experiments 2 and 3, but found clear evidence of near-tool facilitation in Experiment 4 when participants physically picked up the excavator and used it as a handheld tool. These results suggest that observers may not incorporate remotely operated tools into the body schema in the same manner as handheld tools. We discuss potential mechanisms that may drive these differences in embodiment between handheld and remote-controlled tools.

Schizotypy and individual differences in peripersonal space plasticity

The space surrounding our body, defined as peripersonal space (PPS), is dynamically shaped by our motor experiences. For instance, PPS extends after using a tool to reach far objects. Several studies have demonstrated how PPS size varies across people, depending on different individual characteristics, including schizotypy. Coherently, narrower PPS boundaries have been reported among high schizotypal individuals and schizophrenia patients. However, little is known about the relationship between PPS plasticity and personality traits like schizotypy. To this purpose, the present study has investigated the individual PPS plasticity, after two different motor trainings, along the schizotypal continuum. Specifically, PPS plasticity was tested after using a tool (Experiment 1) and after the mere observation of another person using the same tool (Experiment 2). Indeed, previous evidence has shown that tool-use observation influences visual distance judgments, extending the representation of PPS. To date, however, there is no study investigating whether observation of tools action could also affect multisensory PPS tasks. Experiment 1 has shown that PPS boundaries extended after using the tool; on the other hand, Experiment 2 has revealed the absence of PPS expansion. Moreover, greater PPS expansion emerged in the relatively-low schizotypal group than in the relatively-high one, regardless of the type of motor training performed. The absence of PPS modulation after the observation task is discussed in relation to recent findings showing that intentional action and/or the goal of the action represent potentially crucial elements to trigger PPS plasticity. Finally, these new results extend previous evidence underlining a potential general functional alteration of PPS with the increase of schizotypal level.

Tool use modulates early stages of visuo-tactile integration in far space: Evidence from event-related potentials

The neural representation of multisensory space near the body is modulated by the active use of long tools in non-human primates. Here, we investigated whether the electrophysiological correlates of visuo-tactile integration in near and far space were modulated by active tool use in healthy humans. Participants responded to a tactile target delivered to one hand while an irrelevant visual stimulus was presented ipsilaterally in near or far space. This crossmodal task was performed after the use of either short or long tools. Crucially, the P100 components elicited by visuo-tactile stimuli was enhanced on far as compared to near space trials after the use of long tools, while no such difference was present after short tool use. Thus, we found increased neural responses in brain areas encoding tactile stimuli to the body when visual stimuli were presented close to the tip of the tool after long tool use. This increased visuo-tactile integration on far space trials following the use of long tools might indicate a transient remapping of multisensory space. We speculate that performing voluntary actions with long tools strengthens the representation of sensory information arising within portions of space (i.e. the hand and the tip of the tool) that are most functionally relevant to one's behavioural goals.

Enhanced audio-tactile multisensory interaction in a peripersonal task after echolocation

Peripersonal space (PPS) is created by a multisensory interaction between different sensory modalities and can be modified by experience. In this article, we investigated whether an auditory training, inside the peripersonal space area, can modify the PPS around the head in sighted participants. The auditory training was based on echolocation. We measured the participant's reaction times to a tactile stimulation on the neck, while task-irrelevant looming auditory stimuli were presented. Sounds more strongly affect tactile processing when located within a limited distance from the body. We measured spatially dependent audio-tactile interaction as a proxy of PPS representation before and after an echolocation training. We found a significant speeding effect on tactile RTs after echolocation, specifically when sounds where around the location where the echolocation task was performed. This effect could not be attributed to a task repetition effect nor to a shift of spatial attention, as no changes of PPS were found in two control groups of participants, who performed the PPS task after either a break or a temporal auditory task (with stimuli located at the same position of echolocation task). These findings show that echolocation affects multisensory processing inside PPS representation, likely to better represent the space where external stimuli, have to be localized.

Handedness modulates proprioceptive drift in the rubber hand illusion

Preference for use of either the left or right hand (‘handedness’) has been linked with modulations of perception and sensory processing—both of space and the body. Here we ask whether multisensory integration of bodily information also varies as a function of handedness. We created a spatial disparity between visual and somatosensory hand position information using the rubber hand illusion, and use the magnitude of illusory shifts in hand position (proprioceptive ‘drift’) as a tool to probe the weighted integration of multisensory information. First, we found drift was significantly reduced when the illusion was performed on the dominant vs. non-dominant hand. We suggest increased manual dexterity of the dominant hand causes greater representational stability and thus an increased resistance to bias by the illusion induction. Second, drift was generally greatest when the hand was in its habitual action space (i.e., near the shoulder of origin), compared to when it laterally displaced towards, or across the midline. This linear effect, however, was only significant for the dominant hand—in both left- and right-handed groups. Thus, our results reveal patterns of habitual hand action modulate drift both within a hand (drift varies with proximity to action space), and between hands (differences in drift between the dominant and non-dominant hands). In contrast, we were unable to find conclusive evidence to support, or contradict, an overall difference between left- and right-handers in susceptibility to RHI drift (i.e., total drift, collapsed across hand positions). In sum, our results provide evidence that patterns of daily activity—and the subsequent patterns of sensory input—shape multisensory integration across space.

What is peripersonal space? An examination of unresolved empirical issues and emerging findings

Findings from diverse fields of study, including neuroscience, psychology, zoology, and sociology, demonstrate that human and non-human primates maintain a representation of the space immediately surrounding the body, known as peripersonal space (PPS). However, progress in this field has been hampered by the lack of an agreed upon definition of PPS. Since the beginning of its formal study, scientists have argued that PPS plays a crucial role in both defensive and non-defensive actions. Yet consensus is lacking about the cognitive and neural instantiation of these functions. In particular, researchers have begun to ask whether a single, unified system of spatial-attentional resources supports both the defensive and non-defensive functions of PPS or, rather, whether there are multiple, independent systems. Moreover, there are open questions about the specificity of PPS. For example: Does PPS dissociate from other well-known phenomena such as personal space and the body schema? Finally, emerging research has brought attention to important questions about individual differences in the flexibility of PPS and the distribution of PPS in front compared to behind the body. In this advanced review, we shed light on questions about the nature of PPS, offering answers when the research permits or providing recommendations for achieving answers in future research. In so doing, we lay the groundwork for a comprehensive definition of PPS. This article is categorized under: Cognitive Biology > Evolutionary Roots of Cognition Psychology > Attention Psychology > Perception and Psychophysics Neuroscience > Plasticity.

Auditory and visual distractors disrupt multisensory temporal acuity in the crossmodal temporal order judgment task

The ability to synthesize information across multiple senses is known as multisensory integration and is essential to our understanding of the world around us. Sensory stimuli that occur close in time are likely to be integrated, and the accuracy of this integration is dependent on our ability to precisely discriminate the relative timing of unisensory stimuli (crossmodal temporal acuity). Previous research has shown that multisensory integration is modulated by both bottom-up stimulus features, such as the temporal structure of unisensory stimuli, and top-down processes such as attention. However, it is currently uncertain how attention alters crossmodal temporal acuity. The present study investigated whether increasing attentional load would decrease crossmodal temporal acuity by utilizing a dual-task paradigm. In this study, participants were asked to judge the temporal order of a flash and beep presented at various temporal offsets (crossmodal temporal order judgment (CTOJ) task) while also directing their attention to a secondary distractor task in which they detected a target stimulus within a stream visual or auditory distractors. We found decreased performance on the CTOJ task as well as increases in both the positive and negative just noticeable difference with increasing load for both the auditory and visual distractor tasks. This strongly suggests that attention promotes greater crossmodal temporal acuity and that reducing the attentional capacity to process multisensory stimuli results in detriments to multisensory temporal processing. Our study is the first to demonstrate changes in multisensory temporal processing with decreased attentional capacity using a dual task paradigm and has strong implications for developmental disorders such as autism spectrum disorders and developmental dyslexia which are associated with alterations in both multisensory temporal processing and attention.

Reachability and the sense of embodiment in amputees using prostheses

Amputated patients are hardly satisfied with upper limb prostheses, and tend to favour the use of their contralateral arm to partially compensate their disability. This may seem surprising in light of recent evidences that external objects (rubber hand or tool) can easily be embodied, namely incorporated in the body representation. We investigated both implicit body representations (by evaluating the peripersonal space using a reachability judgement task) and the quality of bodily integration of the patient’s prosthesis (assessed via questionnaires). As expected, the patients estimated that they could reach further while wearing their prosthesis, showing an embodiment of their prosthesis in their judgement. Yet, the real reaching space was found to be smaller with their prosthesis than with their healthy limb, showing a large error between reachability judgement and actual capacity. An overestimation was also found on the healthy side (comparatively to healthy subjects) suggesting a bilateral modification of body representation in amputated patients. Finally, a correlation was found between the quality of integration of the prosthesis and the way the body representation changed. This study therefore illustrates the multifaceted nature of the phenomenon of prosthesis integration, which involves its incorporation as a tool, but also various specific subjective aspects.

Visual Distractors Disrupt Audiovisual Integration Regardless of Stimulus Complexity

The intricate relationship between multisensory integration and attention has been extensively researched in the multisensory field; however, the necessity of attention for the binding of multisensory stimuli remains contested. In the current study, we investigated whether diverting attention from well-known multisensory tasks would disrupt integration and whether the complexity of the stimulus and task modulated this interaction. A secondary objective of this study was to investigate individual differences in the interaction of attention and multisensory integration. Participants completed a simple audiovisual speeded detection task and McGurk task under various perceptual load conditions: no load (multisensory task while visual distractors present), low load (multisensory task while detecting the presence of a yellow letter in the visual distractors), and high load (multisensory task while detecting the presence of a number in the visual distractors). Consistent with prior studies, we found that increased perceptual load led to decreased reports of the McGurk illusion, thus confirming the necessity of attention for the integration of speech stimuli. Although increased perceptual load led to longer response times for all stimuli in the speeded detection task, participants responded faster on multisensory trials than unisensory trials. However, the increase in multisensory response times violated the race model for no and low perceptual load conditions only. Additionally, a geometric measure of Miller’s inequality showed a decrease in multisensory integration for the speeded detection task with increasing perceptual load. Surprisingly, we found diverging changes in multisensory integration with increasing load for participants who did not show integration for the no load condition: no changes in integration for the McGurk task with increasing load but increases in integration for the detection task. The results of this study indicate that attention plays a crucial role in multisensory integration for both highly complex and simple multisensory tasks and that attention may interact differently with multisensory processing in individuals who do not strongly integrate multisensory information.

Multisensory aversive stimuli differentially modulate negative feelings in near and far space

Affect, space, and multisensory integration are processes that are closely linked. However, it is unclear whether the spatial location of emotional stimuli interacts with multisensory presentation to influence the emotional experience they induce in the perceiver. In this study, we used the unique advantages of virtual reality techniques to present potentially aversive crowd stimuli embedded in a natural context and to control their display in terms of sensory and spatial presentation. Individuals high in crowdphobic fear navigated in an auditory-visual virtual environment, in which they encountered virtual crowds presented through the visual channel, the auditory channel, or both. They reported the intensity of their negative emotional experience at a far distance and at a close distance from the crowd stimuli. Whereas auditory-visual presentation of close feared stimuli amplified negative feelings, auditory-visual presentation of distant feared stimuli did not amplify negative feelings. This suggests that spatial closeness allows multisensory processes to modulate the intensity of the emotional experience induced by aversive stimuli. Nevertheless, the specific role of auditory stimulation must be investigated to better understand this interaction between multisensory, affective, and spatial representation processes. This phenomenon may serve the implementation of defensive behaviors in response to aversive stimuli that are in position to threaten an individual's feeling of security.

Investigating visual-tactile interactions over time and space in adults with autism

It has been suggested that the sensory symptoms which affect many people with autism spectrum conditions (ASC) may be related to alterations in multisensory processing. Typically, the likelihood of interactions between the senses increases when information is temporally and spatially coincident. We explored visual-tactile interactions in adults with ASC for the first time in two experiments using low-level stimuli. Both participants with ASC and matched neurotypical controls only produced crossmodal interactions to near simultaneous stimuli, suggesting that temporal modulation is unaffected in the adult population. We also provide preliminary evidence that visual-tactile interactions may occur over greater spatial distances in participants with ASC, which merits further exploration.

Multisensory Tracking of Objects in Darkness: Capture of Positive Afterimages by the Tactile and Proprioceptive Senses

This paper reports on three experiments investigating the contribution of different sensory modalities to the tracking of objects moved in total darkness. Participants sitting in the dark were exposed to a brief, bright flash which reliably induced a positive visual afterimage of the scene so illuminated. If the participants subsequently move their hand in the darkness, the visual afterimage of that hand fades or disappears; this is presumably due to conflict between the illusory visual afterimage (of the hand in its original location) and other information (e.g., proprioceptive) from a general mechanism for tracking body parts. This afterimage disappearance effect also occurs for held objects which are moved in the dark, and some have argued that this represents a case of body schema extension, i.e. the rapid incorporation of held external objects into the body schema. We demonstrate that the phenomenon is not limited to held objects and occurs in conditions where incorporation into the body schema is unlikely. Instead, we propose that the disappearance of afterimages of objects moved in darkness comes from a general mechanism for object tracking which integrates input from multiple sensory systems. This mechanism need not be limited to tracking body parts, and thus we need not invoke body schema extension to explain the afterimage disappearance. In this series of experiments, we test whether auditory feedback of object movement can induce afterimage disappearance, demonstrate that the disappearance effect scales with the magnitude of proprioceptive feedback, and show that tactile feedback alone is sufficient for the effect. Together, these data demonstrate that the visual percept of a positive afterimage is constructed not just from visual input of the scene when light reaches the eyes, but in conjunction with input from multiple other senses.

Tool-use: An open window into body representation and its plasticity

Over the last decades, scientists have questioned the origin of the exquisite human mastery of tools. Seminal studies in monkeys, healthy participants and brain-damaged patients have primarily focused on the plastic changes that tool-use induces on spatial representations. More recently, we focused on the modifications tool-use must exert on the sensorimotor system and highlighted plastic changes at the level of the body representation used by the brain to control our movements, i.e., the Body Schema. Evidence is emerging for tool-use to affect also more visually and conceptually based representations of the body, such as the Body Image. Here we offer a critical review of the way different tool-use paradigms have been, and should be, used to try disentangling the critical features that are responsible for tool incorporation into different body representations. We will conclude that tool-use may offer a very valuable means to investigate high-order body representations and their plasticity.

The Remapping of Time by Active Tool-Use

Multiple, action-based space representations are each based on the extent to which action is possible toward a specific sector of space, such as near/reachable and far/unreachable. Studies on tool-use revealed how the boundaries between these representations are dynamic. Space is not only multidimensional and dynamic, but it is also known for interacting with other dimensions of magnitude, such as time. However, whether time operates on similar action-driven multiple representations and whether it can be modulated by tool-use is yet unknown. To address these issues, healthy participants performed a time bisection task in two spatial positions (near and far space) before and after an active tool-use training, which consisted of performing goal-directed actions holding a tool with their right hand (Experiment 1). Before training, perceived stimuli duration was influenced by their spatial position defined by action. Hence, a dissociation emerged between near/reachable and far/unreachable space. Strikingly, this dissociation disappeared after the active tool-use training since temporal stimuli were now perceived as nearer. The remapping was not found when a passive tool-training was executed (Experiment 2) or when the active tool-training was performed with participants' left hand (Experiment 3). Moreover, no time remapping was observed following an equivalent active hand-training but without a tool (Experiment 4). Taken together, our findings reveal that time processing is based on action-driven multiple representations. The dynamic nature of these representations is demonstrated by the remapping of time, which is action- and effector-dependent.

Peripersonal space as the space of the bodily self

Bodily self-consciousness (BSC) refers to experience of one's self as located within an owned body (self-identification) and as occupying a specific location in space (self-location). BSC can be altered through multisensory stimulation, as in the Full Body Illusion (FBI). If participants view a virtual body from a distance being stroked, while receiving synchronous tactile stroking on their physical body, they feel as if the virtual body were their own and they experience, subjectively, to drift toward the virtual body. Here we hypothesized that--while normally the experience of the body in space depends on the integration of multisensory body-related signals within a limited space surrounding the body (i.e. peripersonal space, PPS)--during the FBI the boundaries of PPS would shift toward the virtual body, that is, toward the position of experienced self-location. To test this hypothesis, we used synchronous visuo-tactile stroking to induce the FBI, as contrasted with a control condition of asynchronous stroking. Concurrently, we applied an audio-tactile interaction paradigm to estimate the boundaries of PPS. PPS was measured in front of and behind the participants' body as the distance where tactile information interacted with auditory stimuli looming in space toward the participant's physical body. We found that during synchronous stroking, i.e. when participants experienced the FBI, PPS boundaries extended in the front-space, toward the avatar, and concurrently shrunk in the back-space, as compared to the asynchronous stroking control condition, when FBI was induced. These findings support the view that during the FBI, PPS boundaries translate toward the virtual body, such that the PPS representation shifts from being centered at the location of the physical body to being now centered at the subjectively experienced location of the self.

Extending peripersonal space representation without tool-use: evidence from a combined behavioral-computational approach

Stimuli from different sensory modalities occurring on or close to the body are integrated in a multisensory representation of the space surrounding the body, i.e., peripersonal space (PPS). PPS dynamically modifies depending on experience, e.g., it extends after using a tool to reach far objects. However, the neural mechanism underlying PPS plasticity after tool use is largely unknown. Here we use a combined computational-behavioral approach to propose and test a possible mechanism accounting for PPS extension. We first present a neural network model simulating audio-tactile representation in the PPS around one hand. Simulation experiments showed that our model reproduced the main property of PPS neurons, i.e., selective multisensory response for stimuli occurring close to the hand. We used the neural network model to simulate the effects of a tool-use training. In terms of sensory inputs, tool use was conceptualized as a concurrent tactile stimulation from the hand, due to holding the tool, and an auditory stimulation from the far space, due to tool-mediated action. Results showed that after exposure to those inputs, PPS neurons responded also to multisensory stimuli far from the hand. The model thus suggests that synchronous pairing of tactile hand stimulation and auditory stimulation from the far space is sufficient to extend PPS, such as after tool-use. Such prediction was confirmed by a behavioral experiment, where we used an audio-tactile interaction paradigm to measure the boundaries of PPS representation. We found that PPS extended after synchronous tactile-hand stimulation and auditory-far stimulation in a group of healthy volunteers. Control experiments both in simulation and behavioral settings showed that the same amount of tactile and auditory inputs administered out of synchrony did not change PPS representation. We conclude by proposing a simple, biological-plausible model to explain plasticity in PPS representation after tool-use, which is supported by computational and behavioral data.

Dissociating effect of upper limb non-use and overuse on space and body representations

Accurate and updated representations of the space where the body acts, i.e. the peripersonal space (PPS), and the location and dimension of body parts (body representation, BR) are essential to perform actions. Because both PPS and BR are involved in motor execution and display the same plastic proprieties after the use of a tool to reach far objects, it has been suggested that they overlap in a unique representation of the body in a space devoted to action. Here we determined whether manipulating actions in space, without modifying body metrics, i.e. through immobilization, induces a dissociation of the plastic properties of PPS and BR. In 39 healthy subjects we evaluated PPS and BR for the non-used right limb and the overused left limb before and after 10 h of right arm immobilization. We observed that non-use reduces PPS representation around the immobilized arm, without affecting the metric representation (i.e. perceived length) of that limb. In contrast, overuse modulates the metric representation of the free arm, leaving PPS unchanged around that limb. These results suggest that the plasticity in PPS and BR depends on different mechanisms; while PPS representation is shaped as a function of the dimension of the acting space, metric characteristics of BR are forged on a complex interplay between visual and sensorimotor information related to the body. This behavioral dissociation between PPS and BR defines a new scenario for the role of action in shaping space and body representations.

Immediate tool incorporation processes determine human motor planning with tools

Human dexterity with tools is believed to stem from our ability to incorporate and use tools as parts of our body. However tool incorporation, evident as extensions in our body representation and peri-personal space, has been observed predominantly after extended tool exposures and does not explain our immediate motor behaviours when we change tools. Here we utilize two novel experiments to elucidate the presence of additional immediate tool incorporation effects that determine motor planning with tools. Interestingly, tools were observed to immediately induce a trial-by-trial, tool length dependent shortening of the perceived limb lengths, opposite to observations of elongations after extended tool use. Our results thus exhibit that tools induce a dual effect on our body representation; an immediate shortening that critically affects motor planning with a new tool, and the slow elongation, probably a consequence of skill related changes in sensory-motor mappings with the repeated use of the tool.

Coherent anti-Stokes Raman scattering with single-molecule sensitivity using a plasmonic Fano resonance

Plasmonic nanostructures are of particular interest as substrates for the spectroscopic detection and identification of individual molecules. Single-molecule sensitivity Raman detection has been achieved by combining resonant molecular excitation with large electromagnetic field enhancements experienced by a molecule associated with an interparticle junction. Detection of molecules with extremely small Raman cross-sections (~10(-30) cm(2) sr(-1)), however, has remained elusive. Here we show that coherent anti-Stokes Raman spectroscopy (CARS), a nonlinear spectroscopy of great utility and potential for molecular sensing, can be used to obtain single-molecule detection sensitivity, by exploiting the unique light harvesting properties of plasmonic Fano resonances. The CARS signal is enhanced by ~11 orders of magnitude relative to spontaneous Raman scattering, enabling the detection of single molecules, which is verified using a statistically rigorous bi-analyte method. This approach combines unprecedented single-molecule spectral sensitivity with plasmonic substrates that can be fabricated using top-down lithographic strategies.

Tool use imagery triggers tool incorporation in the body schema

Tool-use has been shown to modify the way the brain represents the metrical characteristics of the effector controlling the tool. For example, the use of tools that elongate the physical length of the arm induces kinematic changes affecting selectively the transport component of subsequent free-hand movements. Although mental simulation of an action is known to involve -to a large extent- the same processes as those at play in overt motor execution, whether tool-use imagery can yield similar effects on the body representation remains unknown. Mentally simulated actions indeed elicit autonomic physiological responses and follow motor execution rules that are comparable to those associated with the correspondent overt performance. Therefore, here we investigated the effects of the mental simulation of actions performed with a tool on the body representation by studying subsequent free-hand movements. Subjects executed reach to grasp movements with their hand before and after an imagery task performed with either a tool elongating their arm length or, as a control, with their hand alone. Two main results were found: First, in agreement with previous studies, durations of imagined movements performed with the tool and the hand were similarly affected by task difficulty. Second, kinematics of free-hand movements was affected after tool-use imagery, but not hand-use imagery, in a way similar to that previously documented after actual tool-use. These findings constitute the first evidence that tool-use imagery is sufficient to affect the representation of the user's arm.

Neural model for learning-to-learn of novel task sets in the motor domain

During development, infants learn to differentiate their motor behaviors relative to various contexts by exploring and identifying the correct structures of causes and effects that they can perform; these structures of actions are called task sets or internal models. The ability to detect the structure of new actions, to learn them and to select on the fly the proper one given the current task set is one great leap in infants cognition. This behavior is an important component of the child's ability of learning-to-learn, a mechanism akin to the one of intrinsic motivation that is argued to drive cognitive development. Accordingly, we propose to model a dual system based on (1) the learning of new task sets and on (2) their evaluation relative to their uncertainty and prediction error. The architecture is designed as a two-level-based neural system for context-dependent behavior (the first system) and task exploration and exploitation (the second system). In our model, the task sets are learned separately by reinforcement learning in the first network after their evaluation and selection in the second one. We perform two different experimental setups to show the sensorimotor mapping and switching between tasks, a first one in a neural simulation for modeling cognitive tasks and a second one with an arm-robot for motor task learning and switching. We show that the interplay of several intrinsic mechanisms drive the rapid formation of the neural populations with respect to novel task sets.

A brief review of the role of training in near-tool effects

Research suggests that, like near-hand effects, visual targets appearing near the tip of a hand-held real or virtual tool are treated differently than other targets. This paper reviews neurological and behavioral evidence relevant to near-tool effects and describes how the effect varies with the functional properties of the tool and the knowledge of the participant. In particular, the paper proposes that motor knowledge plays a key role in the appearance of near-tool effects.

Movement paths in operating hand-held tools: tests of distal-shift hypotheses

Extending the body with a tool could imply that characteristics of hand movements become characteristics of the movement of the effective part of the tool. Recent research suggests that such distal shifts are subject to boundary conditions. Here we propose the existence of three constraints: a strategy constraint, a constraint of movement characteristics, and a constraint of mode of control. We investigate their validity for the curvature of transverse movements aimed at a target while using a sliding first-order lever. Participants moved the tip of the effort arm of a real or virtual lever to control a cursor representing movements of the tip of the load arm of the lever on a monitor. With this tool, straight transverse hand movements are associated with concave curvature of the path of the tip of the tool. With terminal visual feedback and when targets were presented for the hand, hand paths were slightly concave in the absence of the dynamic transformation of the tool and slightly convex in its presence. When targets were presented for the tip of the lever, both the concave and convex curvatures of the hand paths became stronger. Finally, with continuous visual feedback of the tip of the lever, curvature of hand paths became convex and concave curvature of the paths of the tip of the lever was reduced. In addition, the effect of the dynamic transformation on curvature was attenuated. These findings support the notion that distal shifts are subject to at least the three proposed constraints.

Tool-use reshapes the boundaries of body and peripersonal space representations

Interaction with objects in the environment typically requires integrating information concerning the object location with the position and size of body parts. The former information is coded in a multisensory representation of the space around the body, a representation of peripersonal space (PPS), whereas the latter is enabled by an online, constantly updated, action-orientated multisensory representation of the body (BR). Using a tool to act upon relatively distant objects extends PPS representation. This effect has been interpreted as indicating that tools can be incorporated into BR. However, empirical data showing that tool-use simultaneously affects PPS representation and BR are lacking. To study this issue, we assessed the extent of PPS representation by means of an audio-tactile interaction task and BR by means of a tactile distance perception task and a body-landmarks localisation task, before and after using a 1-m-long tool to reach far objects. Tool-use extended the representation of PPS along the tool axis and concurrently shaped BR; after tool-use, subjects perceived their forearm narrower and longer compared to before tool-use, a shape more similar to the one of the tool. Tool-use was necessary to induce these effects, since a pointing task did not affect PPS and BR. These results show that a brief training with a tool induces plastic changes both to the perceived dimensions of the body part acting upon the tool and to the space around it, suggesting a strong overlap between peripersonal space and body representation.

The effect of limb crossing and limb congruency on multisensory integration in peripersonal space for the upper and lower extremities

The present study investigated how multisensory integration in peripersonal space is modulated by limb posture (i.e. whether the limbs are crossed or uncrossed) and limb congruency (i.e. whether the observed body part matches the actual position of one's limb). This was done separately for the upper limbs (Experiment 1) and the lower limbs (Experiment 2). The crossmodal congruency task was used to measure peripersonal space integration for the hands and the feet. It was found that the peripersonal space representation for the hands but not for the feet is dynamically updated based on both limb posture and limb congruency. Together these findings show how dynamic cues from vision, proprioception, and touch are integrated in peripersonal limb space and highlight fundamental differences in the way in which peripersonal space is represented for the upper and lower extremity.

Tool-use practice induces changes in intrinsic functional connectivity of parietal areas

Intrinsic functional connectivity from resting state functional magnetic resonance imaging (rsfMRI) has increasingly received attention as a possible predictor of cognitive function and performance. In this study, we investigated the influence of practicing skillful tool manipulation on intrinsic functional connectivity in the resting brain. Acquisition of tool-use skill has two aspects such as formation of motor representation for skillful manipulation and acquisition of the tool concept. To dissociate these two processes, we chose chopsticks-handling with the non-dominant hand. Because participants were already adept at chopsticks-handling with their dominant hand, practice with the non-dominant hand involved only acquiring the skill for tool manipulation with existing knowledge. Eight young participants practiced chopsticks-handling with their non-dominant hand for 8 weeks. They underwent functional magnetic resonance imaging (fMRI) sessions before and after the practice. As a result, functional connectivity among tool-use-related regions of the brain decreased after practice. We found decreased functional connectivity centered on parietal areas, mainly the supramarginal gyrus (SMG) and superior parietal lobule (SPL) and additionally between the primary sensorimotor area and cerebellum. These results suggest that the parietal lobe and cerebellum purely mediate motor learning for skillful tool-use. This decreased functional connectivity may represent increased efficiency of functional network.

Visuo-tactile integration and body ownership during self-generated action

Although there is increasing knowledge about how visual and tactile cues from the hands are integrated, little is known about how self-generated hand movements affect such multisensory integration. Visuo-tactile integration often occurs under highly dynamic conditions requiring sensorimotor updating. Here, we quantified visuo-tactile integration by measuring cross-modal congruency effects (CCEs) in different bimanual hand movement conditions with the use of a robotic platform. We found that classical CCEs also occurred during bimanual self-generated hand movements, and that such movements lowered the magnitude of visuo-tactile CCEs as compared to static conditions. Visuo-tactile integration, body ownership and the sense of agency were decreased by adding a temporal visuo-motor delay between hand movements and visual feedback. These data show that visual stimuli interfere less with the perception of tactile stimuli during movement than during static conditions, especially when decoupled from predictive motor information. The results suggest that current models of visuo-tactile integration need to be extended to account for multisensory integration in dynamic conditions.

Extending the body to virtual tools using a robotic surgical interface: evidence from the crossmodal congruency task

The effects of real-world tool use on body or space representations are relatively well established in cognitive neuroscience. Several studies have shown, for example, that active tool use results in a facilitated integration of multisensory information in peripersonal space, i.e. the space directly surrounding the body. However, it remains unknown to what extent similar mechanisms apply to the use of virtual-robotic tools, such as those used in the field of surgical robotics, in which a surgeon may use bimanual haptic interfaces to control a surgery robot at a remote location. This paper presents two experiments in which participants used a haptic handle, originally designed for a commercial surgery robot, to control a virtual tool. The integration of multisensory information related to the virtual-robotic tool was assessed by means of the crossmodal congruency task, in which subjects responded to tactile vibrations applied to their fingers while ignoring visual distractors superimposed on the tip of the virtual-robotic tool. Our results show that active virtual-robotic tool use changes the spatial modulation of the crossmodal congruency effects, comparable to changes in the representation of peripersonal space observed during real-world tool use. Moreover, when the virtual-robotic tools were held in a crossed position, the visual distractors interfered strongly with tactile stimuli that was connected with the hand via the tool, reflecting a remapping of peripersonal space. Such remapping was not only observed when the virtual-robotic tools were actively used (Experiment 1), but also when passively held the tools (Experiment 2). The present study extends earlier findings on the extension of peripersonal space from physical and pointing tools to virtual-robotic tools using techniques from haptics and virtual reality. We discuss our data with respect to learning and human factors in the field of surgical robotics and discuss the use of new technologies in the field of cognitive neuroscience.

Dynamic sounds capture the boundaries of peripersonal space representation in humans

Background

We physically interact with external stimuli when they occur within a limited space immediately surrounding the body, i.e., Peripersonal Space (PPS). In the primate brain, specific fronto-parietal areas are responsible for the multisensory representation of PPS, by integrating tactile, visual and auditory information occurring on and near the body. Dynamic stimuli are particularly relevant for PPS representation, as they might refer to potential harms approaching the body. However, behavioural tasks for studying PPS representation with moving stimuli are lacking. Here we propose a new dynamic audio-tactile interaction task in order to assess the extension of PPS in a more functionally and ecologically valid condition.

Methodology/Principal Findings

Participants vocally responded to a tactile stimulus administered at the hand at different delays from the onset of task-irrelevant dynamic sounds which gave the impression of a sound source either approaching or receding from the subject’s hand. Results showed that a moving auditory stimulus speeded up the processing of a tactile stimulus at the hand as long as it was perceived at a limited distance from the hand, that is within the boundaries of PPS representation. The audio-tactile interaction effect was stronger when sounds were approaching compared to when sounds were receding.

Conclusion/Significance

This study provides a new method to dynamically assess PPS representation: The function describing the relationship between tactile processing and the position of sounds in space can be used to estimate the location of PPS boundaries, along a spatial continuum between far and near space, in a valuable and ecologically significant way.