The multisensory attentional consequences of tool use: a functional magnetic resonance imaging study

Contribution of motor and proprioceptive information to visuotactile interaction in peripersonal space during bike riding

The space immediately around the body, known as the peripersonal space (PPS), plays an important role in interactions with the environment. Specific representations are reported to be constructed in the brain. PPS expansion reportedly occurs during whole-body self-motions, such as walking; however, little is known regarding how dynamic cues in proprioceptive/motor information contribute to such phenomena. Thus, we investigated this issue using a pedaling bike situation. We defined PPS as the maximum distance at which a visual probe facilitated tactile detection at the chest. Experiment 1 compared two conditions where participants did or did not pedal the bike at a constant speed while observing an optic flow that simulated forward self-motion (pedaling and no pedaling). Experiment 2 investigated the effect of pedal resistances (high and low) while presenting the same optic flow as in Experiment 1. The results revealed that the reaction time (RT) difference (probe RT - baseline RT) was larger for the pedaling than for the no-pedaling condition. However, pedal resistance differences hardly affected the visuotactile interaction, although the participants clearly experienced differences in force. These results suggest that proprioceptive/motor cues can contribute to the modulation of PPS representation, but dynamic information included in these cues may have little influence.

The Embodiment of Objects: Review, Analysis, and Future Directions

Here we offer a thorough review of the empirical literature on the conditions under which an object, such as a tool or a prosthetic (whether real or virtual), can be experienced as being in some sense a part or extension of one's body. We discuss this literature both from the standpoint of the apparent malleability of our body representations, and also from within the framework of radical embodied cognition, which understands the phenomenon to result not from an alteration to a representation, but rather from the achievement of a certain kind of sensory/motor coupling. We highlight both the tensions between these frameworks, and also areas where they can productively complement one another for future research.

Tool Use Modulates Somatosensory Cortical Processing in Humans

Tool use leads to plastic changes in sensorimotor body representations underlying tactile perception. The neural correlates of this tool-induced plasticity in humans have not been adequately characterized. This study used ERPs to investigate the stage of sensory processing modulated by tool use. Somatosensory evoked potentials, elicited by median nerve stimulation, were recorded before and after two forms of object interaction: tool use and hand use. Compared with baseline, tool use-but not use of the hand alone-modulated the amplitude of the P100. The P100 is a mid-latency component that indexes the construction of multisensory models of the body and has generators in secondary somatosensory and posterior parietal cortices. These results mark one of the first demonstrations of the neural correlates of tool-induced plasticity in humans and suggest that tool use modulates relatively late stages of somatosensory processing outside primary somatosensory cortex. This finding is consistent with what has been observed in tool-trained monkeys and suggests that the mechanisms underlying tool-induced plasticity have been preserved across primate evolution.

Tool use modulates early stages of visuo-tactile integration in far space: Evidence from event-related potentials

The neural representation of multisensory space near the body is modulated by the active use of long tools in non-human primates. Here, we investigated whether the electrophysiological correlates of visuo-tactile integration in near and far space were modulated by active tool use in healthy humans. Participants responded to a tactile target delivered to one hand while an irrelevant visual stimulus was presented ipsilaterally in near or far space. This crossmodal task was performed after the use of either short or long tools. Crucially, the P100 components elicited by visuo-tactile stimuli was enhanced on far as compared to near space trials after the use of long tools, while no such difference was present after short tool use. Thus, we found increased neural responses in brain areas encoding tactile stimuli to the body when visual stimuli were presented close to the tip of the tool after long tool use. This increased visuo-tactile integration on far space trials following the use of long tools might indicate a transient remapping of multisensory space. We speculate that performing voluntary actions with long tools strengthens the representation of sensory information arising within portions of space (i.e. the hand and the tip of the tool) that are most functionally relevant to one's behavioural goals.

Locating primary somatosensory cortex in human brain stimulation studies: experimental evidence

Transcranial magnetic stimulation (TMS) over human primary somatosensory cortex (S1) does not produce immediate outputs. Researchers must therefore rely on indirect methods for TMS coil positioning. The "gold standard" is to use individual functional and structural magnetic resonance imaging (MRI) data, but the majority of studies don't do this. The most common method to locate the hand area of S1 (S1-hand) is to move the coil posteriorly from the hand area of primary motor cortex (M1-hand). Yet, S1-hand is not directly posterior to M1-hand. We localized the index finger area of S1-hand (S1-index) experimentally in four ways. First, we reanalyzed functional MRI data from 20 participants who received vibrotactile stimulation to their 10 digits. Second, to assist the localization of S1-hand without MRI data, we constructed a probabilistic atlas of the central sulcus from 100 healthy adult MRIs and measured the likely scalp location of S1-index. Third, we conducted two experiments mapping the effects of TMS across the scalp on tactile discrimination performance. Fourth, we examined all available neuronavigation data from our laboratory on the scalp location of S1-index. Contrary to the prevailing method, and consistent with systematic review evidence, S1-index is close to the C3/C4 electroencephalography (EEG) electrode locations on the scalp, ~7-8 cm lateral to the vertex, and ~2 cm lateral and 0.5 cm posterior to the M1-hand scalp location. These results suggest that an immediate revision to the most commonly used heuristic to locate S1-hand is required. The results of many TMS studies of S1-hand need reassessment. NEW & NOTEWORTHY Noninvasive human brain stimulation requires indirect methods to target particular brain areas. Magnetic stimulation studies of human primary somatosensory cortex have used scalp-based heuristics to find the target, typically locating it 2 cm posterior to the motor cortex. We measured the scalp location of the hand area of primary somatosensory cortex and found that it is ~2 cm lateral to motor cortex. Our results suggest an immediate revision of the prevailing method is required.

What is peripersonal space? An examination of unresolved empirical issues and emerging findings

Findings from diverse fields of study, including neuroscience, psychology, zoology, and sociology, demonstrate that human and non-human primates maintain a representation of the space immediately surrounding the body, known as peripersonal space (PPS). However, progress in this field has been hampered by the lack of an agreed upon definition of PPS. Since the beginning of its formal study, scientists have argued that PPS plays a crucial role in both defensive and non-defensive actions. Yet consensus is lacking about the cognitive and neural instantiation of these functions. In particular, researchers have begun to ask whether a single, unified system of spatial-attentional resources supports both the defensive and non-defensive functions of PPS or, rather, whether there are multiple, independent systems. Moreover, there are open questions about the specificity of PPS. For example: Does PPS dissociate from other well-known phenomena such as personal space and the body schema? Finally, emerging research has brought attention to important questions about individual differences in the flexibility of PPS and the distribution of PPS in front compared to behind the body. In this advanced review, we shed light on questions about the nature of PPS, offering answers when the research permits or providing recommendations for achieving answers in future research. In so doing, we lay the groundwork for a comprehensive definition of PPS. This article is categorized under: Cognitive Biology > Evolutionary Roots of Cognition Psychology > Attention Psychology > Perception and Psychophysics Neuroscience > Plasticity.

Tool-use: An open window into body representation and its plasticity

Over the last decades, scientists have questioned the origin of the exquisite human mastery of tools. Seminal studies in monkeys, healthy participants and brain-damaged patients have primarily focused on the plastic changes that tool-use induces on spatial representations. More recently, we focused on the modifications tool-use must exert on the sensorimotor system and highlighted plastic changes at the level of the body representation used by the brain to control our movements, i.e., the Body Schema. Evidence is emerging for tool-use to affect also more visually and conceptually based representations of the body, such as the Body Image. Here we offer a critical review of the way different tool-use paradigms have been, and should be, used to try disentangling the critical features that are responsible for tool incorporation into different body representations. We will conclude that tool-use may offer a very valuable means to investigate high-order body representations and their plasticity.

Perceptual changes of interaction between hand and object in an experimental phantom hand

The authors examined whether the wrist and elbow were perceived as flexed when a stick was fixed to the hand while the joints were extended during anesthesia. Ten healthy participants lay on their back on a bed with their eyes closed, and a stick was fixed to their right hand. Surprisingly, while the perceived position of the wrist and elbow moved toward flexion from 10 to 40 min after the ischemic block, the stick fixed to the hand was also perceived as having moved toward flexion from 10 to 20 min after the block. Such coupling the change in the perceived stick position with the change in body image suggests a new type of hand-object illusion.

A brief review of the role of training in near-tool effects

Research suggests that, like near-hand effects, visual targets appearing near the tip of a hand-held real or virtual tool are treated differently than other targets. This paper reviews neurological and behavioral evidence relevant to near-tool effects and describes how the effect varies with the functional properties of the tool and the knowledge of the participant. In particular, the paper proposes that motor knowledge plays a key role in the appearance of near-tool effects.

Induced gamma-band response to fragmented images: An intracranial EEG study

Induced gamma-band response (iGBR) has been linked to coherent perception of images and is thought to represent the synchronisation of neuronal populations mediating binding of elements composing the image and the comparisons with memory for proper recognition. This study uses fragmented images with intracranial electroencephalography to investigate the precise spatio-temporal dynamic of iGBR elicited by the recognition of objects presented for the first time and 24h later. Results show an increased iGBR at recognition in regions involved in bottom-up processes such as the cuneus and the lateral occipital complex. Top-down facilitation involved the lingual gyrus, the precuneus and the superior parietal lobule when images were presented for the first time. Twenty-four hours later, top-down facilitation was mediated by frontal areas involved in retrieval from episodic memory. This study showed that the classically reported iGBR is related to object recognition and that top-down processes vary according to task demand.

The role of motor learning in spatial adaptation near a tool

Some visual-tactile (bimodal) cells have visual receptive fields (vRFs) that overlap and extend moderately beyond the skin of the hand. Neurophysiological evidence suggests, however, that a vRF will grow to encompass a hand-held tool following active tool use but not after passive holding. Why does active tool use, and not passive holding, lead to spatial adaptation near a tool? We asked whether spatial adaptation could be the result of motor or visual experience with the tool, and we distinguished between these alternatives by isolating motor from visual experience with the tool. Participants learned to use a novel, weighted tool. The active training group received both motor and visual experience with the tool, the passive training group received visual experience with the tool, but no motor experience, and finally, a no-training control group received neither visual nor motor experience using the tool. After training, we used a cueing paradigm to measure how quickly participants detected targets, varying whether the tool was placed near or far from the target display. Only the active training group detected targets more quickly when the tool was placed near, rather than far, from the target display. This effect of tool location was not present for either the passive-training or control groups. These results suggest that motor learning influences how visual space around the tool is represented.

Manipulable objects facilitate cross-modal integration in peripersonal space

Previous studies have shown that tool use often modifies one's peripersonal space – i.e. the space directly surrounding our body. Given our profound experience with manipulable objects (e.g. a toothbrush, a comb or a teapot) in the present study we hypothesized that the observation of pictures representing manipulable objects would result in a remapping of peripersonal space as well. Subjects were required to report the location of vibrotactile stimuli delivered to the right hand, while ignoring visual distractors superimposed on pictures representing everyday objects. Pictures could represent objects that were of high manipulability (e.g. a cell phone), medium manipulability (e.g. a soap dispenser) and low manipulability (e.g. a computer screen). In the first experiment, when subjects attended to the action associated with the objects, a strong cross-modal congruency effect (CCE) was observed for pictures representing medium and high manipulability objects, reflected in faster reaction times if the vibrotactile stimulus and the visual distractor were in the same location, whereas no CCE was observed for low manipulability objects. This finding was replicated in a second experiment in which subjects attended to the visual properties of the objects. These findings suggest that the observation of manipulable objects facilitates cross-modal integration in peripersonal space.

Distinct functional contributions of primary sensory and association areas to audiovisual integration in object categorization

Multisensory interactions have been demonstrated in a distributed neural system encompassing primary sensory and higher-order association areas. However, their distinct functional roles in multisensory integration remain unclear. This functional magnetic resonance imaging study dissociated the functional contributions of three cortical levels to multisensory integration in object categorization. Subjects actively categorized or passively perceived noisy auditory and visual signals emanating from everyday actions with objects. The experiment included two 2 x 2 factorial designs that manipulated either (1) the presence/absence or (2) the informativeness of the sensory inputs. These experimental manipulations revealed three patterns of audiovisual interactions. (1) In primary auditory cortices (PACs), a concurrent visual input increased the stimulus salience by amplifying the auditory response regardless of task-context. Effective connectivity analyses demonstrated that this automatic response amplification is mediated via both direct and indirect [via superior temporal sulcus (STS)] connectivity to visual cortices. (2) In STS and intraparietal sulcus (IPS), audiovisual interactions sustained the integration of higher-order object features and predicted subjects' audiovisual benefits in object categorization. (3) In the left ventrolateral prefrontal cortex (vlPFC), explicit semantic categorization resulted in suppressive audiovisual interactions as an index for multisensory facilitation of semantic retrieval and response selection. In conclusion, multisensory integration emerges at multiple processing stages within the cortical hierarchy. The distinct profiles of audiovisual interactions dissociate audiovisual salience effects in PACs, formation of object representations in STS/IPS and audiovisual facilitation of semantic categorization in vlPFC. Furthermore, in STS/IPS, the profiles of audiovisual interactions were behaviorally relevant and predicted subjects' multisensory benefits in performance accuracy.