Functional inhibition of the human middle temporal cortex affects non-visual motion perception: a repetitive transcranial magnetic stimulation study during tactile speed discrimination

Functional relevance of the extrastriate body area for visual and haptic object recognition: a preregistered fMRI-guided TMS study

The extrastriate body area (EBA) is a region in the lateral occipito-temporal cortex (LOTC), which is sensitive to perceived body parts. Neuroimaging studies suggested that EBA is related to body and tool processing, regardless of the sensory modalities. However, how essential this region is for visual tool processing and nonvisual object processing remains a matter of controversy. In this preregistered fMRI-guided repetitive transcranial magnetic stimulation (rTMS) study, we examined the causal involvement of EBA in multisensory body and tool recognition. Participants used either vision or haptics to identify 3 object categories: hands, teapots (tools), and cars (control objects). Continuous theta-burst stimulation (cTBS) was applied over left EBA, right EBA, or vertex (control site). Performance for visually perceived hands and teapots (relative to cars) was more strongly disrupted by cTBS over left EBA than over the vertex, whereas no such object-specific effect was observed in haptics. The simulation of the induced electric fields confirmed that the cTBS affected regions including EBA. These results indicate that the LOTC is functionally relevant for visual hand and tool processing, whereas the rTMS over EBA may differently affect object recognition between the 2 sensory modalities.

Direction-selective modulation of visual motion rivalry by collocated tactile motion

Early models of multisensory integration posited that cross-modal signals only converged in higher-order association cortices and that vision automatically dominates. However, recent studies have challenged this view. In this study, the significance of the alignment of motion axes and spatial alignment across visual and tactile stimuli, as well as the effect of hand visibility on visuo-tactile interactions were examined. Using binocular rivalry, opposed motions were presented to each eye and participants were required to track the perceived visual direction. A tactile motion that was either a leftward or rightward sweep across the fingerpad was intermittently presented. Results showed that tactile effects on visual percepts were dependent on the alignment of motion axes: rivalry between up/down visual motions was not modulated at all by left/right tactile motion. On the other hand, visual percepts could be altered by tactile motion signals when both modalities shared a common axis of motion: a tactile stimulus could maintain the dominance duration of a congruent visual stimulus and shorten its suppression period. The effects were also conditional on the spatial alignment of the visual and tactile stimuli, being eliminated when the tactile device was displaced 15 cm away to the right of the visual stimulus. In contrast, visibility of the hand touching the tactile stimulus facilitated congruent switches relative to a visual-only baseline but did not present a significant advantage overall. In sum, these results show a low-level sensory interaction that is conditional on visual and tactile stimuli sharing a common motion axis and location in space.

Neurophysiology of slip sensation and grip reaction: insights for hand prosthesis control of slippage

Sensory feedback is pivotal for a proficient dexterity of the hand. By modulating the grip force in function of the quick and not completely predictable change of the load force, grabbed objects are prevented to slip from the hand. Slippage control is an enabling achievement to all manipulation abilities. However, in hand prosthetics, the performance of even the most innovative research solutions proposed so far to control slippage remain distant from the human physiology. Indeed, slippage control involves parallel and compensatory activation of multiple mechanoceptors, spinal and supraspinal reflexes, and higher-order voluntary behavioral adjustments. In this work, we reviewed the literature on physiological correlates of slippage to propose a three-phases model for the slip sensation and reaction. Furthermore, we discuss the main strategies employed so far in the research studies that tried to restore slippage control in amputees. In the light of the proposed three-phase slippage model and from the weaknesses of already implemented solutions, we proposed several physiology-inspired solutions for slippage control to be implemented in the future hand prostheses. Understanding the physiological basis of slip detection and perception and implementing them in novel hand feedback system would make prosthesis manipulation more efficient and would boost its perceived naturalness, fostering the sense of agency for the hand movements.

Effects of online repetitive transcranial magnetic stimulation (rTMS) on cognitive processing: A meta-analysis and recommendations for future studies

Online repetitive transcranial magnetic stimulation (rTMS), applied while subjects are performing a task, is widely used to disrupt brain regions underlying cognition. However, online rTMS has also induced "paradoxical enhancement". Given the rapid proliferation of this approach, it is crucial to develop a better understanding of how online stimulation influences cognition, and the optimal parameters to achieve desired effects. To accomplish this goal, a quantitative meta-analysis was performed with random-effects models fitted to reaction time (RT) and accuracy data. The final dataset included 126 studies published between 1998 and 2016, with 244 total effects for reaction times, and 202 for accuracy. Meta-analytically, rTMS at 10 Hz and 20 Hz disrupted accuracy for attention, executive, language, memory, motor, and perception domains, while no effects were found with 1 Hz or 5 Hz. Stimulation applied at and 10 and 20 Hz slowed down RTs in attention and perception tasks. No performance enhancement was found. Meta-regression analysis showed that fMRI-guided targeting and short inter-trial intervals are associated with increased disruptive effects with rTMS.

Blindness and Human Brain Plasticity

Early blindness causes fundamental alterations of neural function across more than 25% of cortex-changes that span the gamut from metabolism to behavior and collectively represent one of the most dramatic examples of plasticity in the human brain. The goal of this review is to describe how the remarkable behavioral and neuroanatomical compensations demonstrated by blind individuals provide insights into the extent, mechanisms, and limits of human brain plasticity.

Connectivity of the ventral visual cortex is necessary for object recognition in patients

The functional profiles of regions in the ventral occipital-temporal cortex (VTC), a critical region for object visual recognition, are associated with the VTC connectivity patterns to nonvisual regions relevant to the corresponding object domain. However, whether and how whole-brain connections affect recognition behavior remains untested. We directly examined the necessity of VTC connectivity in object recognition behavior by testing 82 patients whose lesion spared relevant VTC regions but affected various white matter (WM) tracts and other regions. In these patients, we extracted the whole-brain anatomical connections of two VTC domain-selective (large manmade objects and animals) clusters with probabilistic tractography, and examined whether such connectivity pattern can predict recognition performance of the corresponding domains with support vector regression (SVR) analysis. We found that the whole-brain anatomical connectivity of large manmade object-specific cluster successfully predicted patients' large object recognition performance but not animal recognition or control tasks, even after we excluded connections with early visual regions. The contributing connections to large object recognition included tracts between VTC-large object cluster and distributed regions both within and beyond the visual cortex (e.g., putamen, superior, and middle temporal gyrus). These results provide causal evidence that the VTC whole-brain anatomical connectivity is necessary for at least certain domains of object recognition behavior.

Visual area V5/hMT+ contributes to perception of tactile motion direction: a TMS study

Human imaging studies have reported activations associated with tactile motion perception in visual motion area V5/hMT+, primary somatosensory cortex (SI) and posterior parietal cortex (PPC; Brodmann areas 7/40). However, such studies cannot establish whether these areas are causally involved in tactile motion perception. We delivered double-pulse transcranial magnetic stimulation (TMS) while moving a single tactile point across the fingertip, and used signal detection theory to quantify perceptual sensitivity to motion direction. TMS over both SI and V5/hMT+, but not the PPC site, significantly reduced tactile direction discrimination. Our results show that V5/hMT+ plays a causal role in tactile direction processing, and strengthen the case for V5/hMT+ serving multimodal motion perception. Further, our findings are consistent with a serial model of cortical tactile processing, in which higher-order perceptual processing depends upon information received from SI. By contrast, our results do not provide clear evidence that the PPC site we targeted (Brodmann areas 7/40) contributes to tactile direction perception.

Tactile Apparent Motion on the Torso Modulates Perceived Forward Self-Motion Velocity

The present study investigated whether a tactile flow created by a matrix of vibrators in a seat pan simultaneously presented with an optical flow in peripheral vision enhances the perceived forward velocity of self-motion. A brief tactile motion stimulus consisted of four successive rows of vibration, and the interstimulus onset between the tactile rows was varied to change the velocity of the tactile motion. The results show that the forward velocity of self-motion is significantly overestimated for rapid tactile flows and underestimated for slow ones, compared with optical flow alone or non-motion vibrotactile stimulation conditions. In addition, the effect with a temporal tactile rhythm without changing the stimulus location was smaller than that with spatiotemporal tactile motion, with the interstimulus onset interval to elicit a clear sensation of tactile apparent motion. These findings suggest that spatiotemporal tactile motion is effective in inducing a change in the perceived forward velocity of self-motion.

Early Blindness Results in Developmental Plasticity for Auditory Motion Processing within Auditory and Occipital Cortex

Early blind subjects exhibit superior abilities for processing auditory motion, which are accompanied by enhanced BOLD responses to auditory motion within hMT+ and reduced responses within right planum temporale (rPT). Here, by comparing BOLD responses to auditory motion in hMT+ and rPT within sighted controls, early blind, late blind, and sight-recovery individuals, we were able to separately examine the effects of developmental and adult visual deprivation on cortical plasticity within these two areas. We find that both the enhanced auditory motion responses in hMT+ and the reduced functionality in rPT are driven by the absence of visual experience early in life; neither loss nor recovery of vision later in life had a discernable influence on plasticity within these areas. Cortical plasticity as a result of blindness has generally be presumed to be mediated by competition across modalities within a given cortical region. The reduced functionality within rPT as a result of early visual loss implicates an additional mechanism for cross modal plasticity as a result of early blindness—competition across different cortical areas for functional role.

Re-examining overlap between tactile and visual motion responses within hMT+ and STS

Here, we examine overlap between tactile and visual motion BOLD responses within the human MT+ complex. Although several studies have reported tactile responses overlapping with hMT+, many used group average analyses, leaving it unclear whether these responses were restricted to subregions of hMT+. Moreover, previous studies either employed a tactile task or passive stimulation, leaving it unclear whether or not tactile responses in hMT+ are simply the consequence of visual imagery. Here, we carried out a replication of one of the classic papers finding tactile responses in hMT+. We mapped MT and MST in individual subjects using visual field localizers. We then examined responses to tactile motion on the arm, either presented passively or in the presence of a visual task performed at fixation designed to minimize visualization of the concurrent tactile stimulation. To our surprise, without a visual task, we found only weak tactile motion responses in MT (6% of voxels showing tactile responses) and MST (2% of voxels). With an unrelated visual task designed to withdraw attention from the tactile modality, responses in MST were reduced to almost nothing (<1% regions). Consistent with previous results, we did observe tactile responses in STS regions superior and anterior to hMT+. Despite the lack of individual overlap, group-averaged responses produced strong spurious overlap between tactile and visual motion responses within hMT+ that resembled those observed in previous studies. The weak nature of tactile responses in hMT+ (and their abolition by withdrawal of attention) suggests that hMT+ may not serve as a supramodal motion processing module.

Auditory motion processing after early blindness

Studies showing that occipital cortex responds to auditory and tactile stimuli after early blindness are often interpreted as demonstrating that early blind subjects "see" auditory and tactile stimuli. However, it is not clear whether these occipital responses directly mediate the perception of auditory/tactile stimuli, or simply modulate or augment responses within other sensory areas. We used fMRI pattern classification to categorize the perceived direction of motion for both coherent and ambiguous auditory motion stimuli. In sighted individuals, perceived motion direction was accurately categorized based on neural responses within the planum temporale (PT) and right lateral occipital cortex (LOC). Within early blind individuals, auditory motion decisions for both stimuli were successfully categorized from responses within the human middle temporal complex (hMT+), but not the PT or right LOC. These findings suggest that early blind responses within hMT+ are associated with the perception of auditory motion, and that these responses in hMT+ may usurp some of the functions of nondeprived PT. Thus, our results provide further evidence that blind individuals do indeed "see" auditory motion.

Revisiting the adaptive and maladaptive effects of crossmodal plasticity

One of the most striking demonstrations of experience-dependent plasticity comes from studies of sensory-deprived individuals (e.g., blind or deaf), showing that brain regions deprived of their natural inputs change their sensory tuning to support the processing of inputs coming from the spared senses. These mechanisms of crossmodal plasticity have been traditionally conceptualized as having a double-edged sword effect on behavior. On one side, crossmodal plasticity is conceived as adaptive for the development of enhanced behavioral skills in the remaining senses of early-deaf or blind individuals. On the other side, crossmodal plasticity raises crucial challenges for sensory restoration and is typically conceived as maladaptive since its presence may prevent optimal recovery in sensory-re-afferented individuals. In the present review we stress that this dichotomic vision is oversimplified and we emphasize that the notions of the unavoidable adaptive/maladaptive effects of crossmodal reorganization for sensory compensation/restoration may actually be misleading. For this purpose we critically review the findings from the blind and deaf literatures, highlighting the complementary nature of these two fields of research. The integrated framework we propose here has the potential to impact on the way rehabilitation programs for sensory recovery are carried out, with the promising prospect of eventually improving their final outcomes.

The blind brain: How (lack of) vision shapes the morphological and functional architecture of the human brain

Since the early days, how we represent the world around us has been a matter of philosophical speculation. Over the last few decades, modern neuroscience, and specifically the development of methodologies for the structural and the functional exploration of the brain have made it possible to investigate old questions with an innovative approach. In this brief review, we discuss the main findings from a series of brain anatomical and functional studies conducted in sighted and congenitally blind individuals by our’s and others' laboratories. Historically, research on the ‘blind brain’ has focused mainly on the cross-modal plastic changes that follow sensory deprivation. More recently, a novel line of research has been developed to determine to what extent visual experience is truly required to achieve a representation of the surrounding environment. Overall, the results of these studies indicate that most of the brain fine morphological and functional architecture is programmed to develop and function independently from any visual experience. Distinct cortical areas are able to process information in a supramodal fashion, that is, independently from the sensory modality that carries that information to the brain. These observations strongly support the hypothesis of a modality-independent, i.e. more abstract, cortical organization, and may contribute to explain how congenitally blind individuals may interact efficiently with an external world that they have never seen.

Compensatory plasticity and cross-modal reorganization following early visual deprivation

For human and non-human primates, vision is one of the most privileged sensory channels used to interact with the environment. The importance of vision is strongly embedded in the organization of the primate brain as about one third of its cortical surface is involved in visual functions. It is therefore not surprising that the absence of vision from birth, or the loss of vision later in life, has huge consequences, both anatomically and functionally. Studies in animals and humans, conducted over the past few decades, have demonstrated that the absence of vision causes massive structural changes that take place not only in the visually deprived cortex but also in other brain areas. These studies have further shown that the visually deprived cortex becomes responsive to a wide variety of non-visual sensory inputs. Recent studies even showed a role of the visually deprived cortex in cognitive processes. At the behavioral level, increases in acuity for auditory and tactile processes have been reported. The study of the congenitally blind brain also offers a unique model to gain better insights into the functioning of the normal sighted brain and to understand to what extent visual experience is necessary for the brain to develop its functional architecture. Finally, the study of the blind brain allows us to investigate how consciousness develops in the absence of vision. How does the brain of someone who has never had any visual perception form an image of the external world? In this paper, we discuss recent findings from animal studies as well as from behavioural and functional brain imaging studies in sighted and blind individuals that address these questions.

General and specific consciousness: a first-order representationalist approach

It is widely acknowledged that a complete theory of consciousness should explain general consciousness (what makes a state conscious at all) and specific consciousness (what gives a conscious state its particular phenomenal quality). We defend first-order representationalism, which argues that consciousness consists of sensory representations directly available to the subject for action selection, belief formation, planning, etc. We provide a neuroscientific framework for this primarily philosophical theory, according to which neural correlates of general consciousness include prefrontal cortex, posterior parietal cortex, and non-specific thalamic nuclei, while neural correlates of specific consciousness include sensory cortex and specific thalamic nuclei. We suggest that recent data support first-order representationalism over biological theory, higher-order representationalism, recurrent processing theory, information integration theory, and global workspace theory.

Neural pathways conveying novisual information to the visual cortex

The visual cortex has been traditionally considered as a stimulus-driven, unimodal system with a hierarchical organization. However, recent animal and human studies have shown that the visual cortex responds to non-visual stimuli, especially in individuals with visual deprivation congenitally, indicating the supramodal nature of the functional representation in the visual cortex. To understand the neural substrates of the cross-modal processing of the non-visual signals in the visual cortex, we firstly showed the supramodal nature of the visual cortex. We then reviewed how the nonvisual signals reach the visual cortex. Moreover, we discussed if these non-visual pathways are reshaped by early visual deprivation. Finally, the open question about the nature (stimulus-driven or top-down) of non-visual signals is also discussed.

Plasticity of the dorsal "spatial" stream in visually deprived individuals

Studies on visually deprived individuals provide one of the most striking demonstrations that the brain is highly plastic and is able to rewire as a function of the sensory input it receives from the environment. In the current paper, we focus on spatial abilities that are typically related to the dorsal visual pathway (i.e., spatial/motion processing). Bringing together evidence from cataract-reversal individuals, early- and late-blind individuals and sight-recovery cases of long-standing blindness, we suggest that the dorsal “spatial” pathway is mostly plastic early in life and is then more resistant to subsequent experience once it is set, highlighting some limits of neuroplasticity.

Touching motion: rTMS on the human middle temporal complex interferes with tactile speed perception

Brain functional and psychophysical studies have clearly demonstrated that visual motion perception relies on the activity of the middle temporal complex (hMT+). However, recent studies have shown that hMT+ seems to be also activated during tactile motion perception, suggesting that this visual extrastriate area is involved in the processing and integration of motion, irrespective of the sensorial modality. In the present study, we used repetitive transcranial magnetic stimulation (rTMS) to assess whether hMT+ plays a causal role in tactile motion processing. Blindfolded participants detected changes in the speed of a grid of tactile moving points with their finger (i.e. tactile modality). The experiment included three different conditions: a control condition with no TMS and two TMS conditions, i.e. hMT+-rTMS and posterior parietal cortex (PPC)-rTMS. Accuracies were significantly impaired during hMT+-rTMS but not in the other two conditions (No-rTMS or PPC-rTMS), moreover, thresholds for detecting speed changes were significantly higher in the hMT+-rTMS with respect to the control TMS conditions. These findings provide stronger evidence that the activity of the hMT+ area is involved in tactile speed processing, which may be consistent with the hypothesis of a supramodal role for that cortical region in motion processing.

The nature of consciousness in the visually deprived brain

Vision plays a central role in how we represent and interact with the world around us. The primacy of vision is structurally imbedded in cortical organization as about one-third of the cortical surface in primates is involved in visual processes. Consequently, the loss of vision, either at birth or later in life, affects brain organization and the way the world is perceived and acted upon. In this paper, we address a number of issues on the nature of consciousness in people deprived of vision. Do brains from sighted and blind individuals differ, and how? How does the brain of someone who has never had any visual perception form an image of the external world? What is the subjective correlate of activity in the visual cortex of a subject who has never seen in life? More in general, what can we learn about the functional development of the human brain in physiological conditions by studying blindness? We discuss findings from animal research as well from recent psychophysical and functional brain imaging studies in sighted and blind individuals that shed some new light on the answers to these questions.

Effects of Visual Experience on the Human MT+ Functional Connectivity Networks: An fMRI Study of Motion Perception in Sighted and Congenitally Blind Individuals

Human middle temporal complex (hMT+) responds also to the perception of non-visual motion in both sighted and early blind individuals, indicating a supramodal organization. Visual experience, however, leads to a segregation of hMT+ into a more anterior subregion, involved in the supramodal representation of motion, and a posterior subregion that processes visual motion only. In contrast, in congenitally blind subjects tactile motion activates the full extent of hMT+. Here, we used fMRI to investigate brain areas functionally connected with the two hMT+ subregions (seeds) during visual and tactile motion in sighted and blind individuals. A common functional connectivity network for motion processing, including bilateral ventral and dorsal extrastriate, inferior frontal, middle and inferior temporal areas, correlated with the two hMT+ seeds both in sighted and blind individuals during either visual or tactile motion, independently from the sensory modality through which the information was acquired. Moreover, ventral premotor, somatosensory, and posterior parietal areas correlated only with the anterior but not with the posterior portion of hMT+ in sighted subjects, and with both hMT+ seeds in blind subjects. Furthermore, a correlation between middle temporal and occipital areas with primary somatosensory seeds was demonstrated across conditions in both sighted and blind individuals, suggesting a cortico-cortical pathway that conveys non-visual information from somatosensory cortex, through posterior parietal regions, to ventral extrastriate cortex. These findings expand our knowledge about the development of the functional organization within hMT+ by showing that distinct patterns of brain functional correlations originate from the anterior and posterior hMT+ subregions as a result of visual experience.