The role of somatosensation in automatic visuo-motor control: a comparison of congenital and acquired sensory loss

Women show enhanced proprioceptive target estimation through visual-proprioceptive conflict resolution

To form a unified and coherent perception of the organism's state and its relationship with the surrounding environment, the nervous system combines information from various sensory modalities through multisensory integration processes. Occasionally, data from two or more sensory channels may provide conflicting information. This is particularly evident in experiments using the mirror-guided drawing task and the mirror-box illusion, where there is conflict between positional estimates guided by vision and proprioception. This study combined two experimental protocols (the mirror-box and the mirror-guided drawing tasks) to examine whether the learned resolution of visuo-proprioceptive conflicts in the mirror-guided drawing task would improve proprioceptive target estimation of men and women during the mirror-box test. Our results confirm previous findings of visual reaching bias produced by the mirror-box illusion and show that this effect is progressively reduced by improvement in the mirror drawing task performance. However, this was only observed in women. We discuss these findings in the context of possible gender differences in multisensory integration processes as well as in embodiment.

Visual context affects the perceived timing of tactile sensations elicited through intra-cortical microstimulation

Intra-cortical microstimulation (ICMS) is a technique to provide tactile sensations for a somatosensory brain-machine interface (BMI). A viable BMI must function within the rich, multisensory environment of the real world, but how ICMS is integrated with other sensory modalities is poorly understood. To investigate how ICMS percepts are integrated with visual information, ICMS and visual stimuli were delivered at varying times relative to one another. Both visual context and ICMS current amplitude were found to bias the qualitative experience of ICMS. In two tetraplegic participants, ICMS and visual stimuli were more likely to be experienced as occurring simultaneously when visual stimuli were more realistic, demonstrating an effect of visual context on the temporal binding window. The peak of the temporal binding window varied but was consistently offset from zero, suggesting that multisensory integration with ICMS can suffer from temporal misalignment. Recordings from primary somatosensory cortex (S1) during catch trials where visual stimuli were delivered without ICMS demonstrated that S1 represents visual information related to ICMS across visual contexts.

Impact of supplementary sensory feedback on the control and embodiment in human movement augmentation

In human movement augmentation, the number of controlled degrees of freedom could be enhanced by the simultaneous and independent use of supernumerary robotic limbs (SRL) and natural ones. However, this poses several challenges, that could be mitigated by encoding and relaying the SRL status. Here, we review the impact of supplementary sensory feedback on the control and embodiment of SRLs. We classify the main feedback features and analyse how they improve control performance. We report the feasibility of pushing body representation beyond natural human morphology and suggest that gradual SRL embodiment could make multisensory incongruencies less disruptive. We also highlight shared computational bases between SRL motor control and embodiment and suggest contextualizing them within the same theoretical framework. Finally, we argue that a shift towards long term experimental paradigms is necessary for successfully integrating motor control and embodiment.

Supernumerary robotic limbs are robotic devices providing additional limbs to the user. Mattia Pinardi and colleagues review the impact of supplementary sensory feedback on the control performance and embodiment of supernumerary robotic limbs.

Exploring crossmodal correspondences for future research in human movement augmentation

"Crossmodal correspondences" are the consistent mappings between perceptual dimensions or stimuli from different sensory domains, which have been widely observed in the general population and investigated by experimental psychologists in recent years. At the same time, the emerging field of human movement augmentation (i.e., the enhancement of an individual's motor abilities by means of artificial devices) has been struggling with the question of how to relay supplementary information concerning the state of the artificial device and its interaction with the environment to the user, which may help the latter to control the device more effectively. To date, this challenge has not been explicitly addressed by capitalizing on our emerging knowledge concerning crossmodal correspondences, despite these being tightly related to multisensory integration. In this perspective paper, we introduce some of the latest research findings on the crossmodal correspondences and their potential role in human augmentation. We then consider three ways in which the former might impact the latter, and the feasibility of this process. First, crossmodal correspondences, given the documented effect on attentional processing, might facilitate the integration of device status information (e.g., concerning position) coming from different sensory modalities (e.g., haptic and visual), thus increasing their usefulness for motor control and embodiment. Second, by capitalizing on their widespread and seemingly spontaneous nature, crossmodal correspondences might be exploited to reduce the cognitive burden caused by additional sensory inputs and the time required for the human brain to adapt the representation of the body to the presence of the artificial device. Third, to accomplish the first two points, the benefits of crossmodal correspondences should be maintained even after sensory substitution, a strategy commonly used when implementing supplementary feedback.

S1 represents multisensory contexts and somatotopic locations within and outside the bounds of the cortical homunculus

Recent literature suggests that tactile events are represented in the primary somatosensory cortex (S1) beyond its long-established topography; in addition, the extent to which S1 is modulated by vision remains unclear. To better characterize S1, human electrophysiological data were recorded during touches to the forearm or finger. Conditions included visually observed physical touches, physical touches without vision, and visual touches without physical contact. Two major findings emerge from this dataset. First, vision strongly modulates S1 area 1, but only if there is a physical element to the touch, suggesting that passive touch observation is insufficient to elicit neural responses. Second, despite recording in a putative arm area of S1, neural activity represents both arm and finger stimuli during physical touches. Arm touches are encoded more strongly and specifically, supporting the idea that S1 encodes tactile events primarily through its topographic organization but also more generally, encompassing other areas of the body.

Dissociation between dreams and wakefulness: Insights from body and action representations of rare individuals with massive somatosensory deafferentation

The realism of body and actions in dreams is thought to be induced by simulations based on internal representations used during wakefulness. As somatosensory signals contribute to the updating of body and action representations, these are impaired when somatosensory signals are lacking. Here, we tested the hypothesis that individuals with somatosensory deafferentation have impaired body and actions in their dreams, as in wakefulness. We questioned three individuals with a severe, acquired sensory neuropathy on their dreams. While deafferented participants were impaired in daily life, they could dream of themselves as able-bodied, with some sensations (touch, proprioception) and actions (such as running or jumping) which had not been experienced in physical life since deafferentation. We speculate that simulation in dreams could be based on former, "healthy" body and action representations. Our findings are consistent with the idea that distinct body and action representations may be used during dreams and wakefulness.

Limb position sense and sensorimotor performance under conditions of weightlessness

This is a review of the current state of knowledge of the effects of weightlessness on human proprioception. Two aspects have been highlighted: the sense of limb position and performance in sensorimotor tasks. For the sense of position, an important consideration is that there probably exists more than one sense: one measured in a blindfolded, two-limb position matching task, the other, by pointing to the perceived position of a hidden limb. There is evidence that these two senses are supported by distinct central projection pathways. When assessing the effects of weightlessness this must be considered. Whether there is a role for vestibular influences on position sense during changes in gravitational forces is an issue for future experiments. A consideration that has proved helpful for the study of sensorimotor tasks under conditions of weightlessness is to examine the performance of subjects who have lost their proprioceptive senses, either congenitally, or later in life, as a result of disease. In weightlessness, normal subjects appear to have particular difficulties with feedback-controlled tasks. A major factor is the influence of vision on performance. In addition, the stress of working in a weightless environment leads to additional cognitive load, making the execution of even simple everyday tasks difficult.