Altered auditory-tactile interactions in congenitally blind humans: an event-related potential study

Early attentional processing and cortical remapping strategies of tactile stimuli in adults with an early and late-onset visual impairment: A cross-sectional study

Neuroplastic changes appear in people with visual impairment (VI) and they show greater tactile abilities. Improvements in performance could be associated with the development of enhanced early attentional processes based on neuroplasticity. Currently, the various early attentional and cortical remapping strategies that are utilized by people with early (EB) and late-onset blindness (LB) remain unclear. Thus, more research is required to develop effective rehabilitation programs and substitution devices. Our objective was to explore the differences in spatial tactile brain processing in adults with EB, LB and a sighted control group (CG). In this cross-sectional study 27 participants with VI were categorized into EB (n = 14) and LB (n = 13) groups. They were then compared with a CG (n = 15). A vibrotactile device and event-related potentials (ERPs) were utilized while participants performed a spatial tactile line recognition task. The P100 latency and cortical areas of maximal activity were analyzed during the task. The three groups had no statistical differences in P100 latency (p>0.05). All subjects showed significant activation in the right superior frontal areas. Only individuals with VI activated the left superior frontal regions. In EB subjects, a higher activation was found in the mid-frontal and occipital areas. A higher activation of the mid-frontal, anterior cingulate cortex and orbitofrontal zones was observed in LB participants. Compared to the CG, LB individuals showed greater activity in the left orbitofrontal zone, while EB exhibited greater activity in the right superior parietal cortex. The EB had greater activity in the left orbitofrontal region compared to the LB. People with VI may not have faster early attentional processing. EB subjects activate the occipital lobe and right superior parietal cortex during tactile stimulation because of an early lack of visual stimuli and a multimodal information processing. In individuals with LB and EB the orbitofrontal area is activated, suggesting greater emotional processing.

Development and experience-dependence of multisensory spatial processing

Multisensory spatial processes are fundamental for efficient interaction with the world. They include not only the integration of spatial cues across sensory modalities, but also the adjustment or recalibration of spatial representations to changing cue reliabilities, crossmodal correspondences, and causal structures. Yet how multisensory spatial functions emerge during ontogeny is poorly understood. New results suggest that temporal synchrony and enhanced multisensory associative learning capabilities first guide causal inference and initiate early coarse multisensory integration capabilities. These multisensory percepts are crucial for the alignment of spatial maps across sensory systems, and are used to derive more stable biases for adult crossmodal recalibration. The refinement of multisensory spatial integration with increasing age is further promoted by the inclusion of higher-order knowledge.

The perception of affective and discriminative touch in blind individuals

Enhanced tactile acuity in blindness is among the most widely reported results of neuroplasticity following prolonged visual deprivation. However, tactile submodalities other than discriminative touch are profoundly understudied in blind individuals. Here, we examined the influence of blindness on two tactile submodalities, affective and discriminative touch, the former being vital for social functioning and emotional processing. We tested 36 blind individuals and 36 age- and sex-matched sighted volunteers. In Experiment 1, we measured the perception of affective tactile signals by asking participants to rate the pleasantness of touch delivered on the palm (nonhairy skin, sparsely innervated with C tactile [CT] fibers) or the forearm (hairy skin, densely innervated with CT fibers) in a CT-optimal versus a CT-nonoptimal manner using a paradigm grounded in studies on tactile sensory neurophysiology. In Experiment 2, we implemented a classic task assessing discriminative touch abilities, the grating orientation task. We found that blind individuals rated the touch as more pleasant when delivered on the palm than on the forearm, while the opposite pattern was observed for sighted participants, who rated stimulation on the forearm as more pleasant than stimulation on the palm. We also replicated the previous findings showing enhanced discriminative tactile acuity in blind individuals. Altogether, our results suggest that blind individuals might experience affective touch differently than sighted individuals, with relatively greater pleasantness perceived on the palm. These results provide a broader insight into somatosensory perception in blind individuals, for the first time taking into consideration the socioemotional aspect of touch.

Somatosensory processing in deaf and deafblind individuals: How does the brain adapt as a function of sensory and linguistic experience? A critical review

How do deaf and deafblind individuals process touch? This question offers a unique model to understand the prospects and constraints of neural plasticity. Our brain constantly receives and processes signals from the environment and combines them into the most reliable information content. The nervous system adapts its functional and structural organization according to the input, and perceptual processing develops as a function of individual experience. However, there are still many unresolved questions regarding the deciding factors for these changes in deaf and deafblind individuals, and so far, findings are not consistent. To date, most studies have not taken the sensory and linguistic experiences of the included participants into account. As a result, the impact of sensory deprivation vs. language experience on somatosensory processing remains inconclusive. Even less is known about the impact of deafblindness on brain development. The resulting neural adaptations could be even more substantial, but no clear patterns have yet been identified. How do deafblind individuals process sensory input? Studies on deafblindness have mostly focused on single cases or groups of late-blind individuals. Importantly, the language backgrounds of deafblind communities are highly variable and include the usage of tactile languages. So far, this kind of linguistic experience and its consequences have not been considered in studies on basic perceptual functions. Here, we will provide a critical review of the literature, aiming at identifying determinants for neuroplasticity and gaps in our current knowledge of somatosensory processing in deaf and deafblind individuals.

Event-related potentials reveal early visual-tactile integration in the deaf

This study examined visual-tactile perceptual integration in deaf and normal hearing individuals. Participants were presented with photos of faces or pictures of an oval in either a visual mode or a visual-tactile mode in a recognition learning task. Event-related potentials (ERPs) were recorded when participants recognized real faces and pictures of ovals in learning stage. Results from the parietal-occipital region showed that photos of faces accompanied with vibration elicited more positive-going ERP responses than photos of faces without vibration as indicated in the components of P1 and N170 in both deaf and hearing individuals. However, pictures of ovals accompanied with vibration produced more positive-going ERP responses than pictures of ovals without vibration in N170, which was only found in deaf individuals. A reversed pattern was shown in the temporal region indicating that real faces with vibration elicited less positive ERPs than photos of faces without vibration in both N170 and N300 for deaf, but such pattern did not appear in N170 and N300 for normal hearing. The results suggest that multisensory integration across the visual and tactile modality involves more fundamental perceptual regions than auditory regions. Moreover, auditory deprivation played an essential role at the perceptual encoding stage of the multisensory integration.

Data-Driven Classification of Spectral Profiles Reveals Brain Region-Specific Plasticity in Blindness

Congenital blindness has been shown to result in behavioral adaptation and neuronal reorganization, but the underlying neuronal mechanisms are largely unknown. Brain rhythms are characteristic for anatomically defined brain regions and provide a putative mechanistic link to cognitive processes. In a novel approach, using magnetoencephalography resting state data of congenitally blind and sighted humans, deprivation-related changes in spectral profiles were mapped to the cortex using clustering and classification procedures. Altered spectral profiles in visual areas suggest changes in visual alpha-gamma band inhibitory-excitatory circuits. Remarkably, spectral profiles were also altered in auditory and right frontal areas showing increased power in theta-to-beta frequency bands in blind compared with sighted individuals, possibly related to adaptive auditory and higher cognitive processing. Moreover, occipital alpha correlated with microstructural white matter properties extending bilaterally across posterior parts of the brain. We provide evidence that visual deprivation selectively modulates spectral profiles, possibly reflecting structural and functional adaptation.

The role of spatial selective attention in the processing of affective prosodies in congenitally blind adults: An ERP study

The question whether spatial selective attention is necessary in order to process vocal affective prosody has been controversially discussed in sighted individuals: whereas some studies argue that attention is required in order to process emotions, other studies conclude that vocal prosody can be processed even outside the focus of spatial selective attention. Here, we asked whether spatial selective attention is necessary for the processing of affective prosodies after visual deprivation from birth. For this purpose, pseudowords spoken in happy, neutral, fearful or threatening prosodies were presented at the left or right loudspeaker. Congenitally blind individuals (N = 8) and sighted controls (N = 13) had to attend to one of the loudspeakers and detect rare pseudowords presented at the attended loudspeaker during EEG recording. Emotional prosody of the syllables was task-irrelevant. Blind individuals outperformed sighted controls by being more efficient in detecting deviant syllables at the attended loudspeaker. A higher auditory N1 amplitude was observed in blind individuals compared to sighted controls. Additionally, sighted controls showed enhanced attention-related ERP amplitudes in response to fearful and threatening voices during the time range of the N1. By contrast, blind individuals revealed enhanced ERP amplitudes in attended relative to unattended locations irrespective of the affective valence in all time windows (110-350 ms). These effects were mainly observed at posterior electrodes. The results provide evidence for "emotion-general" auditory spatial selective attention effects in congenitally blind individuals and suggest a potential reorganization of the voice processing brain system following visual deprivation from birth.

Olfactory perception and blindness: a systematic review and meta-analysis

Anecdotal reports suggest that blind people might develop supra-normal olfactory abilities. However, scientific evidence shows a mixed pattern of findings. Inconsistent observations are reported for both sensory-driven olfactory tasks (e.g., odor threshold) and higher-order olfactory functions (e.g., odor identification). To quantify the evidence systematically, we conducted a review and meta-analysis. Studies were included if they examined olfactory function (i.e., odor threshold, odor discrimination, free odor identification, or cued odor identification) in blind compared with a sighted control group. Articles were identified through computerized literature search. A total of 18 studies focused on olfactory threshold (n = 1227: 590 blind and 637 sighted individuals), 14 studies targeted discrimination (n = 940: 455 blind and 485 sighted), 14 studies measured cued identification (n = 968: 468 blind and 500 sighted), and 7 studies (n = 443: 224 blind and 219 sighted individuals) assessed free identification. Overall, there were no differences in effect sizes between the blind and sighted individuals after correcting the results for publication bias. We additionally conducted an exploratory analysis targeting the role played by three moderators of interests: participants' age, the proportion of women versus men in each of the studies included into meta-analysis and onset of blindness (early blind vs. late-blind). However, none of the moderators affected the observed results. To conclude, blindness seems not to affect cued/free odor identification, odor discrimination or odor thresholds.

Blindness, Psychosis, and the Visual Construction of the World

The relationship between visual loss and psychosis is complex: congenital visual loss appears to be protective against the development of a psychotic disorder, particularly schizophrenia. In later life, however, visual deprivation or visual loss can give rise to hallucinosis, disorders of visual insight such as blindsight or Anton syndrome, or, in the context of neurodegenerative disorders, more complex psychotic presentations. We draw on a computational psychiatric approach to consider the foundational role of vision in the construction of representations of the world and the effects of visual loss at different developmental stages. Using a Bayesian prediction error minimization model, we describe how congenital visual loss may be protective against the development of the kind of computational deficits postulated to underlie schizophrenia, by increasing the precision (and consequent stability) of higher-level (including supramodal) priors, focusing on visual loss-induced changes in NMDA receptor structure and function as a possible mechanistic substrate. In simple terms, we argue that when people cannot see from birth, they rely more heavily on the context they extract from the other senses, and the resulting model of the world is more impervious to the false inferences, made in the face of inevitably noisy perceptual input, that characterize schizophrenia. We show how a Bayesian prediction error minimization framework can also explain the relationship between later visual loss and other psychotic symptoms, as well as the effects of visual deprivation and hallucinogenic drugs, and outline experimentally testable hypotheses generated by this approach.

How Much Spatial Information Is Lost in the Sensory Substitution Process? Comparing Visual, Tactile, and Auditory Approaches

Sensory substitution devices (SSDs) can convey visuospatial information through spatialised auditory or tactile stimulation using wearable technology. However, the level of information loss associated with this transformation is unknown. In this study, novice users discriminated the location of two objects at 1.2 m using devices that transformed a 16 × 8-depth map into spatially distributed patterns of light, sound, or touch on the abdomen. Results showed that through active sensing, participants could discriminate the vertical position of objects to a visual angle of 1°, 14°, and 21°, and their distance to 2 cm, 8 cm, and 29 cm using these visual, auditory, and haptic SSDs, respectively. Visual SSDs significantly outperformed auditory and tactile SSDs on vertical localisation, whereas for depth perception, all devices significantly differed from one another (visual > auditory > haptic). Our findings highlight the high level of acuity possible for SSDs even with low spatial resolutions (e.g., 16 × 8) and quantify the level of information loss attributable to this transformation for the SSD user. Finally, we discuss ways of closing this “modality gap” found in SSDs and conclude that this process is best benchmarked against performance with SSDs that return to their primary modality (e.g., visuospatial into visual).

Short-term visual deprivation boosts the flexibility of body representation

Short-term visual deprivation by blindfolding influences tactile acuity and orientation in space and, on a neural level, leads to enhanced excitability of visual and motor cortices. However, to the best of our knowledge, the possible effects of short-term visual deprivation on body representation have not been examined. In the present study, we tested two groups of 30 healthy participants with the somatic rubber hand illusion, a well-established paradigm to probe the dynamic plasticity of body representation. Before the start of the procedure, the experimental group was blindfolded for 120 minutes, while the control group wore transparent goggles for the same amount of time. We found that although there was no difference in the subjective feeling of ownership of the rubber hand during the illusion, the blindfolded group showed a significantly larger recalibration of hand position sense towards the location of the rubber hand than the control group. This finding suggests that short-term visual deprivation boosts plasticity of body representation in terms of multisensory spatial recalibration of hand position sense.

Task demands affect spatial reference frame weighting during tactile localization in sighted and congenitally blind adults

Task demands modulate tactile localization in sighted humans, presumably through weight adjustments in the spatial integration of anatomical, skin-based, and external, posture-based information. In contrast, previous studies have suggested that congenitally blind humans, by default, refrain from automatic spatial integration and localize touch using only skin-based information. Here, sighted and congenitally blind participants localized tactile targets on the palm or back of one hand, while ignoring simultaneous tactile distractors at congruent or incongruent locations on the other hand. We probed the interplay of anatomical and external location codes for spatial congruency effects by varying hand posture: the palms either both faced down, or one faced down and one up. In the latter posture, externally congruent target and distractor locations were anatomically incongruent and vice versa. Target locations had to be reported either anatomically (“palm” or “back” of the hand), or externally (“up” or “down” in space). Under anatomical instructions, performance was more accurate for anatomically congruent than incongruent target-distractor pairs. In contrast, under external instructions, performance was more accurate for externally congruent than incongruent pairs. These modulations were evident in sighted and blind individuals. Notably, distractor effects were overall far smaller in blind than in sighted participants, despite comparable target-distractor identification performance. Thus, the absence of developmental vision seems to be associated with an increased ability to focus tactile attention towards a non-spatially defined target. Nevertheless, that blind individuals exhibited effects of hand posture and task instructions in their congruency effects suggests that, like the sighted, they automatically integrate anatomical and external information during tactile localization. Moreover, spatial integration in tactile processing is, thus, flexibly adapted by top-down information—here, task instruction—even in the absence of developmental vision.

Multisensory Interference in Early Deaf Adults

Multisensory interactions in deaf cognition are largely unexplored. Unisensory studies suggest that behavioral/neural changes may be more prominent for visual compared to tactile processing in early deaf adults. Here we test whether such an asymmetry results in increased saliency of vision over touch during visuo-tactile interactions. About 23 early deaf and 25 hearing adults performed two consecutive visuo-tactile spatial interference tasks. Participants responded either to the elevation of the tactile target while ignoring a concurrent visual distractor at central or peripheral locations (respond to touch/ignore vision), or they performed the opposite task (respond to vision/ignore touch). Multisensory spatial interference emerged in both tasks for both groups. Crucially, deaf participants showed increased interference compared to hearing adults when they attempted to respond to tactile targets and ignore visual distractors, with enhanced difficulties with ipsilateral visual distractors. Analyses on task-order revealed that in deaf adults, interference of visual distractors on tactile targets was much stronger when this task followed the task in which vision was behaviorally relevant (respond to vision/ignore touch). These novel results suggest that behavioral/neural changes related to early deafness determine enhanced visual dominance during visuo-tactile multisensory conflict.

Individual Differences in Sensory Substitution

Sensory substitution devices were developed in the context of perceptual rehabilitation and they aim at compensating one or several functions of a deficient sensory modality by converting stimuli that are normally accessed through this deficient sensory modality into stimuli accessible by another sensory modality. For instance, they can convert visual information into sounds or tactile stimuli. In this article, we review those studies that investigated the individual differences at the behavioural, neural, and phenomenological levels when using a sensory substitution device. We highlight how taking into account individual differences has consequences for the optimization and learning of sensory substitution devices. We also discuss the extent to which these studies allow a better understanding of the experience with sensory substitution devices, and in particular how the resulting experience is not akin to a single sensory modality. Rather, it should be conceived as a multisensory experience, involving both perceptual and cognitive processes, and emerging on each user’s pre-existing sensory and cognitive capacities.

The Sound of Vision Project: On the Feasibility of an Audio-Haptic Representation of the Environment, for the Visually Impaired

The Sound of Vision project involves developing a sensory substitution device that is aimed at creating and conveying a rich auditory representation of the surrounding environment to the visually impaired. However, the feasibility of such an approach is strongly constrained by neural flexibility, possibilities of sensory substitution and adaptation to changed sensory input. We review evidence for such flexibility from various perspectives. We discuss neuroplasticity of the adult brain with an emphasis on functional changes in the visually impaired compared to sighted people. We discuss effects of adaptation on brain activity, in particular short-term and long-term effects of repeated exposure to particular stimuli. We then discuss evidence for sensory substitution such as Sound of Vision involves, while finally discussing evidence for adaptation to changes in the auditory environment. We conclude that sensory substitution enterprises such as Sound of Vision are quite feasible in light of the available evidence, which is encouraging regarding such projects.

Functional connectivity of visual cortex in the blind follows retinotopic organization principles

Although early visual experience is essential for the proper development of visual cortex, Striem-Amit et al. show that the underlying connectivity structure of retinotopic mapping is retained even in congenitally blind individuals. This basic organisational principle emerges independently of visual input and persists despite lifelong experience-dependent plasticity.

Is visual input during critical periods of development crucial for the emergence of the fundamental topographical mapping of the visual cortex? And would this structure be retained throughout life-long blindness or would it fade as a result of plastic, use-based reorganization? We used functional connectivity magnetic resonance imaging based on intrinsic blood oxygen level-dependent fluctuations to investigate whether significant traces of topographical mapping of the visual scene in the form of retinotopic organization, could be found in congenitally blind adults. A group of 11 fully and congenitally blind subjects and 18 sighted controls were studied. The blind demonstrated an intact functional connectivity network structural organization of the three main retinotopic mapping axes: eccentricity (centre-periphery), laterality (left-right), and elevation (upper-lower) throughout the retinotopic cortex extending to high-level ventral and dorsal streams, including characteristic eccentricity biases in face- and house-selective areas. Functional connectivity-based topographic organization in the visual cortex was indistinguishable from the normally sighted retinotopic functional connectivity structure as indicated by clustering analysis, and was found even in participants who did not have a typical retinal development in utero (microphthalmics). While the internal structural organization of the visual cortex was strikingly similar, the blind exhibited profound differences in functional connectivity to other (non-visual) brain regions as compared to the sighted, which were specific to portions of V1. Central V1 was more connected to language areas but peripheral V1 to spatial attention and control networks. These findings suggest that current accounts of critical periods and experience-dependent development should be revisited even for primary sensory areas, in that the connectivity basis for visual cortex large-scale topographical organization can develop without any visual experience and be retained through life-long experience-dependent plasticity. Furthermore, retinotopic divisions of labour, such as that between the visual cortex regions normally representing the fovea and periphery, also form the basis for topographically-unique plastic changes in the blind.

Visuo-tactile interactions in the congenitally deaf: a behavioral and event-related potential study

Auditory deprivation is known to be accompanied by alterations in visual processing. Yet not much is known about tactile processing and the interplay of the intact sensory modalities in the deaf. We presented visual, tactile, and visuo-tactile stimuli to congenitally deaf and hearing individuals in a speeded detection task. Analyses of multisensory responses showed a redundant signals effect that was attributable to a coactivation mechanism in both groups, although the redundancy gain was less in the deaf. In line with these behavioral results, on a neural level, there were multisensory interactions in both groups that were again weaker in the deaf. In hearing but not deaf participants, somatosensory event-related potential N200 latencies were modulated by simultaneous visual stimulation. A comparison of unisensory responses between groups revealed larger N200 amplitudes for visual and shorter N200 latencies for tactile stimuli in the deaf. Furthermore, P300 amplitudes were also larger in the deaf. This group difference was significant for tactile and approached significance for visual targets. The differences in visual and tactile processing between deaf and hearing participants, however, were not reflected in behavior. Both the behavioral and electroencephalography (EEG) results suggest more pronounced multisensory interaction in hearing than in deaf individuals. Visuo-tactile enhancements could not be explained by perceptual deficiency, but could be partly attributable to inverse effectiveness.

What does a neuron learn from multisensory experience?

The brain's ability to integrate information from different senses is acquired only after extensive sensory experience. However, whether early life experience instantiates a general integrative capacity in multisensory neurons or one limited to the particular cross-modal stimulus combinations to which one has been exposed is not known. By selectively restricting either visual-nonvisual or auditory-nonauditory experience during the first few months of life, the present study found that trisensory neurons in cat superior colliculus (as well as their bisensory counterparts) became adapted to the cross-modal stimulus combinations specific to each rearing environment. Thus, even at maturity, trisensory neurons did not integrate all cross-modal stimulus combinations to which they were capable of responding, but only those that had been linked via experience to constitute a coherent spatiotemporal event. This selective maturational process determines which environmental events will become the most effective targets for superior colliculus-mediated shifts of attention and orientation.

Sensory Imagery in Individuals who Are Blind and Sighted: Examining Unimodal and Multimodal Forms

Introduction

Previous research has suggested that visual images are more easily generated, more vivid, and more memorable than other sensory modalities. This research examined whether or not imagery is experienced in similar ways by people with and without sight. Specifically, the imageability of visual, auditory, and tactile cue words was compared. The degree to which images were multimodal or unimodal was also examined.

Methods

Twelve participants who were totally blind from early infancy and 12 sighted participants generated images in response to 53 sensory and nonsensory words, rating imageability and the sensory modality, and describing images. From these 53 items, 4 subgroups of words that stimulated images that were predominantly visual, tactile, auditory, and low-imagery were created.

Results

T-tests comparing imageability ratings from blind and sighted participants found no differences for auditory and tactile words (both p > .1). Nevertheless, although participants without sight found auditory and tactile images equally imageable, sighted participants found images in response to tactile cue words harder to generate than visual cue words (mean difference: −0.51, p = .025). Participants with sight were also more likely to develop multisensory images than were participants without sight (both U ≥ 15.0, N1 = 12, N2 = 12, p ≤.008).

Discussion

For both the blind and sighted groups, auditory and tactile images were rich and varied, and similar language was used. Sighted participants were more likely to generate multimodal images, and this was particularly the case for tactile words. Nevertheless, cue words that resulted in multisensory images were not necessarily rated as more imageable. The discussion considers whether or not multimodal imagery represents a method of compensating for impoverished unimodal imagery.

Implications for practitioners

Imagery is important not only as a mnemonic in memory rehabilitation, but also in everyday uses for modes such as autobiographical memory. This research emphasizes the importance of not only auditory and tactile sensory imagery, but also spatial imagery for people without sight.

"To see or not to see: that is the question." The "Protection-Against-Schizophrenia" (PaSZ) model: evidence from congenital blindness and visuo-cognitive aberrations

The causes of schizophrenia are still unknown. For the last 100 years, though, both “absent” and “perfect” vision have been associated with a lower risk for schizophrenia. Hence, vision itself and aberrations in visual functioning may be fundamental to the development and etiological explanations of the disorder. In this paper, we present the “Protection-Against-Schizophrenia” (PaSZ) model, which grades the risk for developing schizophrenia as a function of an individual's visual capacity. We review two vision perspectives: (1) “Absent” vision or how congenital blindness contributes to PaSZ and (2) “perfect” vision or how aberrations in visual functioning are associated with psychosis. First, we illustrate that, although congenitally blind and sighted individuals acquire similar world representations, blind individuals compensate for behavioral shortcomings through neurofunctional and multisensory reorganization. These reorganizations may indicate etiological explanations for their PaSZ. Second, we demonstrate that visuo-cognitive impairments are fundamental for the development of schizophrenia. Deteriorated visual information acquisition and processing contribute to higher-order cognitive dysfunctions and subsequently to schizophrenic symptoms. Finally, we provide different specific therapeutic recommendations for individuals who suffer from visual impairments (who never developed “normal” vision) and individuals who suffer from visual deterioration (who previously had “normal” visual skills). Rather than categorizing individuals as “normal” and “mentally disordered,” the PaSZ model uses a continuous scale to represent psychiatrically relevant human behavior. This not only provides a scientific basis for more fine-grained diagnostic assessments, earlier detection, and more appropriate therapeutic assignments, but it also outlines a trajectory for unraveling the causes of abnormal psychotic human self- and world-perception.

Short term memory and working memory in blind versus sighted children

There is evidence that blind people may strengthen their memory skills to compensate for absence of vision. However, which aspects of memory are involved is open to debate and a developmental perspective is generally lacking. In the present study, we compared the short term memory (STM) and working memory (WM) of 10-year-old blind children and sighted children. STM was measured using digit span forward, name learning, and word span tasks; WM was measured using listening span and digit span backward tasks. The blind children outperformed their sighted peers on both STM and WM tasks. The enhanced capacity of the blind children on digit span and other STM tasks confirms the results of earlier research; the significantly better performance of the blind children relative to their sighted peers on verbal WM tasks is a new interesting finding. Task characteristics, including the verbal nature of the WM tasks and strategies used to perform these tasks, are discussed.

Visual sensory disability: rehabilitative treatment in an aquatic environment

The outcome of this study is based on the concept of the enormous potentiality that is expressed, after the elimination of myofascial and articular compensation, from the body system. 10 low vision and blind subjects aged between 35 and 50 years. The subjects performed 10 sessions (2/week) for 5 weeks. Each session consisted of a training in the gym (30 minutes) and hydrokinetic therapy (45 minutes) All the subjects at the beginning (T0) and at the end (T1) of the rehabilitation program were tested by static baropodometry and the stabilometric (Milletrix, Diagnostic support, Rome, Italy). Our results shows an increase of the total area of support surface (p0.05). The stabilometry results shows an improvement of the orthostatic balance, sway area and the ellipse area decrease respectively 15% (236,9vs201 p≤0.05) and 41% b(p≤0.05). Thus, the energy expenditure of the patient in maintaining the orthostatic position without visual afferences is lower. Rehabilitative treatment in an aquatic environment resulted effective in improving posture and balance in all patients with increased precision in the execution of the step, which implies less effort during walk, less energy consumption and better quality of life.

The role of visual experience for the neural basis of spatial cognition

Blindness often results in the adaptive neural reorganization of the remaining modalities, producing sharper auditory and haptic behavioral performance. Yet, non-visual modalities might not be able to fully compensate for the lack of visual experience as in the case of congenital blindness. For example, developmental visual experience seems to be necessary for the maturation of multisensory neurons for spatial tasks. Additionally, the ability of vision to convey information in parallel might be taken into account as the main attribute that cannot be fully compensated by the spared modalities. Therefore, the lack of visual experience might impair all spatial tasks that require the integration of inputs from different modalities, such as having to represent a set of objects on the basis of the spatial relationships among the objects, rather than the spatial relationship that each object has with oneself. Here we integrate behavioral and neural evidence to conclude that visual experience is necessary for the neural development of normal spatial cognition.

Audiotactile integration is reduced in congenital blindness in a spatial ventriloquism task

In the ventriloquism effect, the presentation of spatially discrepant visual information biases the localization of simultaneously presented sounds. Recently, an analogous spatial influence of touch on audition has been observed. By manipulating hand posture, it has been demonstrated that this audiotactile ventriloquist effect predominantly operates in an external frame of reference. In the present study, we examined the contribution of developmental vision to audiotactile interactions as indicated by the ventriloquism effect. Congenitally blind, late blind and sighted adults were asked to report the perceived location of sounds presented from a left, a central or a right location. Auditory stimuli were either delivered alone or concurrently with touches at the left or the right hand. The hands were located to the right and to the left of the lateral speakers and participants either adopted an uncrossed or a crossed hand posture. While sighted controls and late blind participants similarly mislocalized auditory stimuli toward the concurrent tactile stimuli in bimodal trials, the congenitally blind showed a reduced ventriloquism effect. All groups showed a reduced audiotactile ventriloquism effect in the crossed hand condition. However, the magnitude of the reduction was significantly larger in the group of congenitally blind than in the group of sighted controls. These results suggest reduced audio-tactile interactions in spatial processing following a lack of visual input from birth.

Recognition memory for vibrotactile rhythms: an fMRI study in blind and sighted individuals

Calcarine sulcal cortex possibly contributes to semantic recognition memory in early blind (EB). We assessed a recognition memory role using vibrotactile rhythms and a retrieval success paradigm involving learned "old" and "new" rhythms in EB and sighted. EB showed no activation differences in occipital cortex indicating retrieval success but replicated findings of somatosensory processing. Both groups showed retrieval success in primary somatosensory, precuneus, and orbitofrontal cortex. The S1 activity might indicate generic sensory memory processes.

Multisensory processing in children with autism: high-density electrical mapping of auditory-somatosensory integration

Successful integration of signals from the various sensory systems is crucial for normal sensory-perceptual functioning, allowing for the perception of coherent objects rather than a disconnected cluster of fragmented features. Several prominent theories of autism suggest that automatic integration is impaired in this population, but there have been few empirical tests of this thesis. A standard electrophysiological metric of multisensory integration (MSI) was used to test the integrity of auditory-somatosensory integration in children with autism (N=17, aged 6-16 years), compared to age- and IQ-matched typically developing (TD) children. High-density electrophysiology was recorded while participants were presented with either auditory or somatosensory stimuli alone (unisensory conditions), or as a combined auditory-somatosensory stimulus (multisensory condition), in randomized order. Participants watched a silent movie during testing, ignoring concurrent stimulation. Significant differences between neural responses to the multisensory auditory-somatosensory stimulus and the unisensory stimuli (the sum of the responses to the auditory and somatosensory stimuli when presented alone) served as the dependent measure. The data revealed group differences in the integration of auditory and somatosensory information that appeared at around 175 ms, and were characterized by the presence of MSI for the TD but not the autism spectrum disorder (ASD) children. Overall, MSI was less extensive in the ASD group. These findings are discussed within the framework of current knowledge of MSI in typical development as well as in relation to theories of ASD.

Early- and Late-Onset Blindness Both Curb Audiotactile Integration on the Parchment-Skin Illusion

It has been shown that congenital blindness can lead to anomalies in the integration of auditory and tactile information, at least under certain conditions. In the present study, we used the parchment-skin illusion, a robust illustration of sound-biased perception of touch based on changes in frequency, to investigate the specificities of audiotactile interactions in early- and late-onset blind individuals. Blind individuals in both groups did not experience any illusory change in tactile perception when the frequency of the auditory signal was modified, whereas sighted individuals consistently experienced the illusion. This demonstration that blind individuals had reduced susceptibility to an auditory-tactile illusion suggests either that vision is necessary for the establishment of audiotactile interactions or that auditory and tactile information can be processed more independently in blind individuals than in sighted individuals. In addition, the results obtained in late-onset blind participants suggest that visual input may play a role in the maintenance of audiotactile integration.

Optimality in mono- and multisensory map formation

In the struggle for survival in a complex and dynamic environment, nature has developed a multitude of sophisticated sensory systems. In order to exploit the information provided by these sensory systems, higher vertebrates reconstruct the spatio-temporal environment from each of the sensory systems they have at their disposal. That is, for each modality the animal computes a neuronal representation of the outside world, a monosensory neuronal map. Here we present a universal framework that allows to calculate the specific layout of the involved neuronal network by means of a general mathematical principle, viz., stochastic optimality. In order to illustrate the use of this theoretical framework, we provide a step-by-step tutorial of how to apply our model. In so doing, we present a spatial and a temporal example of optimal stimulus reconstruction which underline the advantages of our approach. That is, given a known physical signal transmission and rudimental knowledge of the detection process, our approach allows to estimate the possible performance and to predict neuronal properties of biological sensory systems. Finally, information from different sensory modalities has to be integrated so as to gain a unified perception of reality for further processing, e.g., for distinct motor commands. We briefly discuss concepts of multimodal interaction and how a multimodal space can evolve by alignment of monosensory maps.

The Involvement of Occipital Cortex in the Early Blind in Auditory and Tactile Duration Discrimination Tasks

Early blind participants outperform controls on several spatially oriented perceptual tasks such as sound localization and tactile orientation discrimination. Previous studies have suggested that the recruitment of occipital cortex in the blind is responsible for this improvement. For example, electroencephalographic studies showed an enlarged posterior negativity for the blind in these tasks compared to controls. In our study, the question was raised whether the early blind are also better at tasks in which the duration of auditory and tactile stimuli must be discriminated. The answer was affirmative. Our electroencephalographic data revealed an enlarged posterior negativity for the blind relative to controls. Source analyses showed comparable solutions in the case of auditory and tactile targets for the blind. These findings support the interpretation of these negativities in terms of a supramodal rather than a modality-specific process, although confirmation with more spatially sensitive methods seems necessary. We additionally examined whether the early blind are less affected by irrelevant tactile or auditory exogenous cues preceding auditory or tactile targets than controls. No differences in alerting and orienting effects of these cues were found between the blind and the controls. Together, our results support the view that major differences between early blind participants and sighted controls on auditory and tactile duration discrimination tasks relate to a late and likely supramodal process that takes place in occipital areas.

Auditory and auditory-tactile processing in congenitally blind humans

Studying blind humans is an excellent opportunity to investigate how experience might shape auditory processing. In everyday life, blind humans rely more on auditory information than sighted humans to recognize people, localize events, or process language. A growing number of studies have provided evidence that the increased use of the auditory system results in compensatory behavior in the blind. Blind humans perform better in perceptual auditory tasks, like pitch or duration discrimination, and in auditory language and memory tasks. Neural plasticity at different levels of the auditory processing stream has been linked to these behavioral benefits. In everyday life, many events stimulate more than one sensory system. Multisensory research has cumulated evidence that the integration of information across modalities facilitates perception and action control. Neurophysiological correlates of multisensory interactions have been described for various subcortical and cortical areas. There is evidence that vision plays a pivotal role in setting up multisensory functions during ontogeny. This article summarizes evidence for a reorganization of multisensory brain areas and reduced crossmodal interactions on the behavioral level following congenital visual deprivation.

Inhibition, not excitation, is the key to multimodal sensory integration

Multimodal neuronal maps, combining input from two or more sensory systems, play a key role in the processing of sensory and motor information. For such maps to be of any use, the input from all participating modalities must be calibrated so that a stimulus at a specific spatial location is represented at an unambiguous position in the multimodal map. Here we discuss two methods based on supervised spike-timing-dependent plasticity (STDP) to gauge input from different sensory modalities so as to ensure a proper map alignment. The first uses an excitatory teacher input. It is therefore called excitation-mediated learning. The second method is based on an inhibitory teacher signal, as found in the barn owl, and is called inhibition-mediated learning. Using detailed analytical calculations and numerical simulations, we demonstrate that inhibitory teacher input is essential if high-quality multimodal integration is to be learned rapidly. Furthermore, we show that the quality of the resulting map is not so much limited by the quality of the teacher signal but rather by the accuracy of the input from other sensory modalities.

Auditory evoked visual awareness following sudden ocular blindness: an EEG and TMS investigation

Neurophysiological and neuroanatomical studies have provoked controversy about whether the visual cortex may be more modifiable than previously believed. Auditory processing is enhanced in blind compared to sighted people, and the enhancement might reflect encroachment of auditory transmission onto visual cortex. To address this issue, we recorded the auditory event-related potentials (ERPs) correlated with auditory related paradoxical visual awareness in a subject with traumatic total late-onset blindness. We found that (1) there was auditory related brain activity over the occipital visual scalp regions starting from a very early stage (< 80 ms) and (2) this occipital activity was significantly different between "visually aware" and "visually unaware" responses in the P1 (40-80 ms) component following meaningful stimuli. There was also a significant difference between responses with and without visual awareness in the N1 (100-120 ms) component following either tones or meaningful stimuli. The phosphenes accompanying auditory stimuli in the ERP experiment were always perceived to be directly in front of the subject and this was reproduced by transcranial magnetic stimulation over the blind primary visual cortex and by sudden sounds delivered to the side or behind the subject. The TMS induced phosphenes were restricted to the central part of the space and were, at least qualitatively, the same as those induced by sounds. The results are clear evidence that human perceptual functions can be reorganized after sudden, late-onset, total ocular blindness.

Early visual deprivation impairs multisensory interactions in humans

Animal studies have shown that visual deprivation during the first months of life permanently impairs the interactions between sensory systems. Here we report an analogous effect for humans who had been deprived of pattern vision for at least the first five months of their life as a result of congenital binocular cataracts. These patients showed reduced audio-visual interactions in later life, although their visual performance in control tasks was unimpaired. Thus, adequate (multisensory) input during the first months of life seems to be a prerequisite in humans, as well as in animals, for the full development of cross-modal interactions.

Tactile enhancement of auditory detection and perceived loudness

To study the effects of touch on auditory processing, we examined whether uninformative and irrelevant tactile stimuli presented together with task-relevant sounds can improve auditory detection (Experiment 1), and enhance perceived loudness (Experiment 2). We demonstrated that irrelevant tactile signals facilitate the detection of faint tones, and increase auditory intensity ratings. These crossmodal facilitation effects were found for synchronous when compared to asynchronous auditory-tactile stimulation, and were stronger for weaker than for louder sounds. They are interpreted in terms of a multisensory integration mechanism that increases the strength of auditory signals, and adheres to the rules of inverse effectiveness and temporal (but not spatial) co-occurrence. This integration might be mediated by auditory-tactile multisensory neurons in regions of auditory association cortex that are also involved in auditory detection and loudness discrimination.

Attention and sensory interactions within the occipital cortex in the early blind: an fMRI study

Visual deprivation early in life results in occipital cortical responsiveness across a broad range of perceptual and cognitive tasks. In the reorganized occipital cortex of early blind (EB) individuals, the relative lack of specificity for particular sensory stimuli and tasks suggests that attention effects may play a prominent role in these areas. We wished to establish whether occipital cortical areas in the EB were responsive to stimuli across sensory modalities (auditory, tactile) and whether these areas maintained or altered their activity as a function of selective attention. Using a three-stimulus oddball paradigm and event-related functional magnetic resonance imaging, auditory and tactile tasks presented separately demonstrated that several occipital regions of interest (ROIs) in the EB, but not sighted controls (SCs), responded to targets and task-irrelevant distracter stimuli of both modalities. When auditory and tactile stimuli were presented simultaneously with subjects alternating attention between sensory streams, only the calcarine sulcus continued to respond to stimuli in both modalities. In all other ROIs, responses to auditory targets were as large or larger than those observed in the auditory-alone condition, but responses to tactile targets were attenuated or abolished by the presence of unattended auditory stimuli. Both auditory and somatosensory cortices responded consistently to auditory and tactile targets, respectively. These results reveal mechanisms of orienting and selective attention within the visual cortex of EB individuals and suggest that mechanisms of enhancement and suppression interact asymmetrically on auditory and tactile streams during bimodal sensory presentation.

Developmental vision determines the reference frame for the multisensory control of action

Both animal and human studies suggest that action goals are defined in external coordinates regardless of their sensory modality. The present study used an auditory-manual task to test whether the default use of such an external reference frame is innately determined or instead acquired during development because of the increasing dominance of vision over manual control. In Experiment I, congenitally blind, late blind, and age-matched sighted adults had to press a left or right response key depending on the bandwidth of pink noise bursts presented from either the left or right loudspeaker. Although the spatial location of the sounds was entirely task-irrelevant, all groups responded more efficiently with uncrossed hands when the sound was presented from the same side as the responding hand ("Simon effect"). This effect reversed with crossed hands only in the congenitally blind: They responded faster with the hand that was located contralateral to the sound source. In Experiment II, the instruction to the participants was changed: They now had to respond with the hand located next to the sound source. In contrast to Experiment I ("Simon-task"), this task required an explicit matching of the sound's location with the position of the responding hand. In Experiment II, the congenitally blind participants showed a significantly larger crossing deficit than both the sighted and late blind adults. This pattern of results implies that developmental vision induces the default use of an external coordinate frame for multisensory action control; this facilitates not only visual but also auditory-manual control.

Altered tactile spatial attention in the early blind

To investigate whether superior tactile acuity in the blind is due to alterations of attentional selection mechanisms, event-related brain potentials (ERPs) were measured in a group of early blind and a group of sighted individuals who performed a difficult tactile spatial selection task. We found systematic differences in the attentional processing of tactile events between early blind and sighted individuals. The blind not only responded faster to tactile targets, but also showed attentional modulations of early somatosensory ERP components (P100 and N140). In contrast, ERP effects of spatial attention in the sighted only emerged at longer-latencies (about 200 ms post-stimulus). Our findings suggest that increased use of one sense due to sensory deprivation, such as touch in blind people, leads to alterations of attentional selection mechanism within modality-specific cortex.

Shifts of attention in the early blind: an erp study of attentional control processes in the absence of visual spatial information

To investigate the role of visual spatial information in the control of spatial attention, event-related brain potentials (ERPs) were recorded during a tactile attention task for a group of totally blind participants who were either congenitally blind or had lost vision during infancy, and for an age-matched, sighted control group who performed the task in the dark. Participants had to shift attention to the left or right hand (as indicated by an auditory cue presented at the start of each trial) in order to detect infrequent tactile targets delivered to this hand. Effects of tactile attention on the processing of tactile events, as reflected by attentional modulations of somatosensory ERPs to tactile stimuli, were very similar for early blind and sighted participants, suggesting that the capacity to selectively process tactile information from one hand versus the other does not differ systematically between the blind and the sighted. ERPs measured during the cue-target interval revealed an anterior directing attention negativity (ADAN) that was present for the early blind group as well as for the sighted control group. In contrast, the subsequent posterior late direction attention negativity (LDAP) was absent in both groups. These results suggest that these two components reflect functionally distinct attentional control mechanisms which differ in their dependence on the availability of visually coded representations of external space.