The relation between body semantics and spatial body representations

A Body Map Beyond Perceptual Experience

The human body is perhaps the most ubiquitous and salient visual stimulus that we encounter in our daily lives. Given the prevalence of images of human bodies in natural scene statistics, it is no surprise that our mental representations of the body are thought to strongly originate from visual experience. Yet, little is still known about high-level cognitive representations of the body. Here, we retrieved a body map from natural language, taking this as a window into high-level cognitive processes. We first extracted a matrix of distances between body parts from natural language data and employed this matrix to extrapolate a body map. To test the effectiveness of this high-level body map, we then conducted a series of experiments in which participants were asked to classify the distance between pairs of body parts, presented either as words or images. We found that the high-level body map was systematically activated when participants were making these distance judgments. Crucially, the linguistic map explained participants' performance over and above the visual body map, indicating that the former cannot be simply conceived as a by-product of perceptual experience. These findings, therefore, establish the existence of a behaviorally relevant, high-level representation of the human body.

Linguistic embodiment in typical and atypical anorexia nervosa: Evidence from an image-word matching task

OBJECTIVE

The integration of sensory, motor, and cognitive systems is embodied cognition, according to which mind and body are not separate and distinct, and our body (and our brain, as part of the body) contributes to determining our mental and cognitive processes. In spite of limited data available, Anorexia nervosa (AN) appears as a condition in which embodied cognition is altered, in particular, if we consider bodily sensations and visuospatial information processing. We aimed to evaluate the ability to correctly identify body parts and actions in both full (AN) and atypical AN (AAN), looking at the role of the underweight status.

METHOD

A group of 143 females (AN = 45, AAN = 43, unaffected women = 55) was enrolled. All participants performed a linguistic embodied task to evaluate the association between a picture-showing a bodily action-and a written verb. Additionally, a subsample of 24 AN participants performed a retest after stable weight recovery.

RESULTS

Both AN and AAN demonstrated an abnormal ability to evaluate the picture-written verb associations, especially if the involved bodily effectors were the same in both stimuli (i.e., pictorial and verbal) and needed a longer response time.

CONCLUSIONS

Specific embodied cognition linked to body schema seems to be impaired in persons with AN. The longitudinal analysis showed a difference between AN and AAN only in the underweight condition, suggesting the presence of an abnormal linguistic embodiment. More attention should be devoted to embodiment during AN treatment to improve bodily cognition, which might, in turn, diminish body misperception.

Multisensory Interference in Early Deaf Adults

Multisensory interactions in deaf cognition are largely unexplored. Unisensory studies suggest that behavioral/neural changes may be more prominent for visual compared to tactile processing in early deaf adults. Here we test whether such an asymmetry results in increased saliency of vision over touch during visuo-tactile interactions. About 23 early deaf and 25 hearing adults performed two consecutive visuo-tactile spatial interference tasks. Participants responded either to the elevation of the tactile target while ignoring a concurrent visual distractor at central or peripheral locations (respond to touch/ignore vision), or they performed the opposite task (respond to vision/ignore touch). Multisensory spatial interference emerged in both tasks for both groups. Crucially, deaf participants showed increased interference compared to hearing adults when they attempted to respond to tactile targets and ignore visual distractors, with enhanced difficulties with ipsilateral visual distractors. Analyses on task-order revealed that in deaf adults, interference of visual distractors on tactile targets was much stronger when this task followed the task in which vision was behaviorally relevant (respond to vision/ignore touch). These novel results suggest that behavioral/neural changes related to early deafness determine enhanced visual dominance during visuo-tactile multisensory conflict.

When the body is time: spatial and temporal deixis in children with visual impairments and sighted children

While there is mounting evidence explaining how concrete concepts are processed, the evidence demonstrating how abstract concepts are processed is rather scant. Most research illustrating how concrete and abstract concepts are processed has been obtained from adult populations. Consequently, not much is known about how these concepts are processed by children, especially those with sensorimotor impairments. This paper reports a study in which groups of children who were either visual-motor impaired (VMG), blind (BG), or sighted (CG) were requested to perform deictic gestures for temporal and spatial concepts. The results showed that: (i) spatial pointing was performed faster than temporal pointing across all groups of children; (ii) such difference in pointing times occurred also within groups; and (iii) the slowest pointing times were those of the blind children followed by the VMG and the CG children, respectively. Additionally, while CG children correctly performed the pointing tasks, VMG and, particularly, BG children relied on a form of deixis known as autotopological (or personal) deixis. The results thus suggest that deprivation or lack of sensorimotor experience with the environment affects the processing of abstract concepts and that a compensatory mechanism may be to rely on the body as a reference frame.

Force feedback facilitates multisensory integration during robotic tool use

The present study investigated the effects of force feedback in relation to tool use on the multisensory integration of visuo-tactile information. Participants learned to control a robotic tool through a surgical robotic interface. Following tool-use training, participants performed a crossmodal congruency task, by responding to tactile vibrations applied to their hands, while ignoring visual distractors superimposed on the robotic tools. In the first experiment it was found that tool-use training with force feedback facilitates multisensory integration of signals from the tool, as reflected in a stronger crossmodal congruency effect with the force feedback training compared to training without force feedback and to no training. The second experiment extends these findings by showing that training with realistic online force feedback resulted in a stronger crossmodal congruency effect compared to training in which force feedback was delayed. The present study highlights the importance of haptic information for multisensory integration and extends findings from classical tool-use studies to the domain of robotic tools. We argue that such crossmodal congruency effects are an objective measure of robotic tool integration and propose some potential applications in surgical robotics, robotic tools, and human-tool interaction.