Enhanced sensitivity to echo cues in blind subjects

Effects of type of emission and masking sound, and their spatial correspondence, on blind and sighted people's ability to echolocate

Ambient sound can mask acoustic signals. The current study addressed how echolocation in people is affected by masking sound, and the role played by type of sound and spatial (i.e. binaural) similarity. We also investigated the role played by blindness and long-term experience with echolocation, by testing echolocation experts, as well as blind and sighted people new to echolocation. Results were obtained in two echolocation tasks where participants listened to binaural recordings of echolocation and masking sounds, and either localized echoes in azimuth or discriminated echo audibility. Echolocation and masking sounds could be either clicks or broad band noise. An adaptive staircase method was used to adjust signal-to-noise ratios (SNRs) based on participants' responses. When target and masker had the same binaural cues (i.e. both were monoaural sounds), people performed better (i.e. had lower SNRs) when target and masker used different types of sound (e.g. clicks in noise-masker or noise in clicks-masker), as compared to when target and masker used the same type of sound (e.g. clicks in click-, or noise in noise-masker). A very different pattern of results was observed when masker and target differed in their binaural cues, in which case people always performed better when clicks were the masker, regardless of type of emission used. Further, direct comparison between conditions with and without binaural difference revealed binaural release from masking only when clicks were used as emissions and masker, but not otherwise (i.e. when noise was used as masker or emission). This suggests that echolocation with clicks or noise may differ in their sensitivity to binaural cues. We observed the same pattern of results for echolocation experts, and blind and sighted people new to echolocation, suggesting a limited role played by long-term experience or blindness. In addition to generating novel predictions for future work, the findings also inform instruction in echolocation for people who are blind or sighted.

Late Blindness and Deafness are Associated with Decreased Tactile Sensitivity, But Early Blindness is Not

Perceptual experience is shaped by a complex interaction between our sensory systems in which each sense conveys information on specific properties of our surroundings. This multisensory processing of complementary information improves the accuracy of our perceptual judgments and leads to more precise and faster reactions. Sensory impairment or loss in one modality leads to information deficiency that can impact other senses in various ways. For early auditory or visual loss, impairment and/or compensatory increase of the sensitivity of other senses are equally well described. Investigating individuals with deafness (N = 73), early (N = 51), late blindness (N = 49) and corresponding controls, we compared tactile sensitivity using the standard monofilament test on two locations, the finger and handback. Results indicate lower tactile sensitivity in people with deafness and late blindness but not in people with early blindness compared to respective controls, irrespective of stimulation location, gender, and age. Results indicate that neither sensory compensation nor simple use-dependency or a hindered development of the tactile sensory system is sufficient to explain changes in somatosensation after the sensory loss but that a complex interaction of effects is present.

Effects of Congenital Blindness on Ultrasonic Vocalizations and Social Behaviors in the ZRDBA Mouse

Mice produce ultrasonic vocalizations (USVs) at different ages and social contexts, including maternal-pup separation, social play in juveniles, social interactions, and mating in adults. The USVs' recording can be used as an index of sensory detection, internal state, and social motivation. While sensory deprivation may alter USVs' emission and some social behaviors in deaf and anosmic rodents, little is known about the effects of visual deprivation in rodents. This longitudinal study aimed to assess acoustic communication and social behaviors using a mouse model of congenital blindness. Anophthalmic and sighted mice were assayed to a series of behavioral tests at three different ages, namely, the maternal isolation-induced pup USV test and the home odor discrimination and preference test on postnatal day (PND) 7, the juvenile social test on PND 30-35, and the female urine-induced USVs and scent-marking behavior at 2-3 months. Our results evidenced that (1) at PND 7, USVs' total number between both groups was similar, all mice vocalized less during the second isolation period than the first period, and both phenotypes showed similar discrimination and preference, favoring exploration of the home bedding odor; (2) at PND 30-35, anophthalmic mice engaged less in social behaviors in the juvenile play test than sighted ones, but the number of total USVs produced is not affected; and (3) at adulthood, when exposed to a female urine spot, anophthalmic male mice displayed faster responses in terms of USVs' emission and sniffing behavior, associated with a longer time spent exploring the female urinary odor. Interestingly, acoustic behavior in the pups and adults was correlated in sighted mice only. Together, our study reveals that congenital visual deprivation had no effect on the number of USVs emitted in the pups and juveniles, but affected the USVs' emission in the adult male and impacted the social behavior in juvenile and adult mice.

Auditory Behavior in Adult-Blinded Mice

Cross-modal plasticity occurs when the function of remaining senses is enhanced following deprivation or loss of a sensory modality. Auditory neural responses are enhanced in the auditory cortex, including increased sensitivity and frequency selectivity, following short-term visual deprivation in adult mice (Petrus et al. Neuron 81:664-673, 2014). Whether or not these visual deprivation-induced neural changes translate into improved auditory perception and performance remains unclear. As an initial investigation of the effects of adult visual deprivation on auditory behaviors, CBA/CaJ mice underwent binocular enucleation at 3-4 weeks old and were tested on a battery of learned behavioral tasks, acoustic startle response (ASR), and prepulse inhibition (PPI) tests beginning at least 2 weeks after the enucleation procedure. Auditory brain stem responses (ABRs) were also measured to screen for potential effects of visual deprivation on non-behavioral hearing function. Control and enucleated mice showed similar tone detection sensitivity and frequency discrimination in a conditioned lick suppression test. Both groups showed normal reactivity to sound as measured by ASR in a quiet background. However, when startle-eliciting stimuli were presented in noise, enucleated mice showed decreased ASR amplitude relative to controls. Control and enucleated mice displayed no significant differences in ASR habituation, PPI tests, or ABR thresholds, or wave morphology. Our findings suggest that while adult-onset visual deprivation induces cross-modal plasticity at the synaptic and circuit levels, it does not substantially influence simple auditory behavioral performance.

Morphometry Difference of the Hippocampal Formation Between Blind and Sighted Individuals

The detailed morphometry alterations of the human hippocampal formation (HF) for blind individuals are still understudied. 50 subjects were recruited from Yantai Affiliated Hospital of Binzhou Medical University, including 16 congenital blindness, 14 late blindness, and 20 sighted controls. Volume and shape analysis were conducted between the blind (congenital or late) and sighted groups to observe the (sub)regional alterations of the HF. No significant difference of the hippocampal volume was observed between the blind and sighted subjects. Rightward asymmetry of the hippocampal volume was found for both congenital and late blind individuals, while no significant hemispheric difference was observed for the sighted controls. Shape analysis showed that the superior and inferior parts of both the hippocampal head and tail expanded, while the medial and lateral parts constrained for the blind individuals as compared to the sighted controls. The morphometry alterations for the congenital blind and late blind individuals are nearly the same. Significant expansion of the superior part of the hippocampal tail for both congenital and late blind groups were observed for the left hippocampi after FDR correction. Current results suggest that the cross-model plastic may occur in both hemispheres of the HF to improve the navigation ability without the stimuli of visual cues, and the alteration is more prominent for the left hemisphere.

Early and late visual deprivation induce hypersensitivity to mechanical and thermal noxious stimuli in the ZRDBA mouse

BACKGROUND

Visual deprivation leads to behavioural adaptations. Early visual deprivation has greater effects on sensory systems compared with late visual deprivation. Although this has been well studied, the impact of visual deprivation on pain sensitivity has scarcely been investigated. In humans, one study indicates that pain sensitivity is increased in early, but not late-onset blindness. In animals, one study indicates that sensitivity to noxious stimulation is increased in anophthalmic mice, but the impact of late visual deprivation on sensitivity remains unknown. The aim of this behavioural study was to examine sensitivity to noxious stimulation in mice with early and late visual deprivation. We hypothesized that visual deprivation would have different effects on sensitivity to noxious stimulation depending on its onset.

METHODS

In Experiment 1, mechanical and thermal sensitivity was examined in four ZRDBA mouse groups: sighted mice, anophthalmic mice, dark-reared sighted mice and adult sighted mice deprived of vision for one week. In Experiment 2, mechanical and thermal sensitivity was examined in adult sighted ZRDBA mice deprived of vision for two months.

RESULTS

Anophthalmic and dark-reared mice showed mechanical and thermal hypersensitivity, while the one-week visual deprivation did not alter sensitivity. The two-month deprivation also resulted in mechanical and thermal hypersensitivity.

CONCLUSIONS

These results indicate that early visual deprivation, regardless of the integrity of the visual system, induces hypersensitivity. Moreover, the present findings indicate that late visual deprivation may induce mechanical and thermal hypersensitivity, although this depends on visual deprivation duration. These results have implications for the biological significance of pain in the blind.

SIGNIFICANCE

Sensory deprivation induces behavioural adaptions. For most sensory systems, the extent of these adaptations generally depends on the stage of cerebral development. In contrast, the present results indicate that for the nociceptive system, both early and late visual deprivation have similar effects. Anophthalmic, dark-reared mice and adult mice deprived of vision for two months showed thermal and mechanical hypersensitivity. This shows a clear interaction between visual and nociceptive systems and has implications for the biological significance of pain in the blind.

Factors Affecting Auditory Estimates of Virtual Room Size: Effects of Stimulus, Level, and Reverberation

When vision is unavailable, auditory level and reverberation cues provide important spatial information regarding the environment, such as the size of a room. We investigated how room-size estimates were affected by stimulus type, level, and reverberation. In Experiment 1, 15 blindfolded participants estimated room size after performing a distance bisection task in virtual rooms that were either anechoic (with level cues only) or reverberant (with level and reverberation cues) with a relatively short reverberation time of T₆₀ = 400 milliseconds. Speech, noise, or clicks were presented at distances between 1.9 and 7.1 m. The reverberant room was judged to be significantly larger than the anechoic room (p < .05) for all stimuli. In Experiment 2, only the reverberant room was used and the overall level of all sounds was equalized, so only reverberation cues were available. Ten blindfolded participants took part. Room-size estimates were significantly larger for speech than for clicks or noise. The results show that when level and reverberation cues are present, reverberation increases judged room size. Even relatively weak reverberation cues provide room-size information, which could potentially be used by blind or visually impaired individuals encountering novel rooms.

Comparing Echo-Detection and Echo-Localization in Sighted Individuals

Echolocation is the ability to gather information from sound reflections. Most previous studies have focused on the ability to detect sound reflections, others on the ability to localize sound reflections, but no previous study has compared the two abilities in the same individuals. Our study compared echo-detection (reflecting object present or not?) and echo-localization (reflecting object to the left or right?) in 10 inexperienced sighted participants across 10 distances (1-4.25 m) to the reflecting object, using an automated system for studying human echolocation. There were substantial individual differences, particularly in the performance on the echo-localization task. However, most participants performed better on the detection than the localization task, in particular at the closest distances (1 and 1.7 m), illustrating that it sometimes may be hard to perceive whether an audible reflection came from the left or right.

Brain-Machine Interfaces to Assist the Blind

The loss or absence of vision is probably one of the most incapacitating events that can befall a human being. The importance of vision for humans is also reflected in brain anatomy as approximately one third of the human brain is devoted to vision. It is therefore unsurprising that throughout history many attempts have been undertaken to develop devices aiming at substituting for a missing visual capacity. In this review, we present two concepts that have been prevalent over the last two decades. The first concept is sensory substitution, which refers to the use of another sensory modality to perform a task that is normally primarily sub-served by the lost sense. The second concept is cross-modal plasticity, which occurs when loss of input in one sensory modality leads to reorganization in brain representation of other sensory modalities. Both phenomena are training-dependent. We also briefly describe the history of blindness from ancient times to modernity, and then proceed to address the means that have been used to help blind individuals, with an emphasis on modern technologies, invasive (various type of surgical implants) and non-invasive devices. With the advent of brain imaging, it has become possible to peer into the neural substrates of sensory substitution and highlight the magnitude of the plastic processes that lead to a rewired brain. Finally, we will address the important question of the value and practicality of the available technologies and future directions.

A Comparative Study in Real-Time Scene Sonification for Visually Impaired People

In recent years, with the development of depth cameras and scene detection algorithms, a wide variety of electronic travel aids for visually impaired people have been proposed. However, it is still challenging to convey scene information to visually impaired people efficiently. In this paper, we propose three different auditory-based interaction methods, i.e., depth image sonification, obstacle sonification as well as path sonification, which convey raw depth images, obstacle information and path information respectively to visually impaired people. Three sonification methods are compared comprehensively through a field experiment attended by twelve visually impaired participants. The results show that the sonification of high-level scene information, such as the direction of pathway, is easier to learn and adapt, and is more suitable for point-to-point navigation. In contrast, through the sonification of low-level scene information, such as raw depth images, visually impaired people can understand the surrounding environment more comprehensively. Furthermore, there is no interaction method that is best suited for all participants in the experiment, and visually impaired individuals need a period of time to find the most suitable interaction method. Our findings highlight the features and the differences of three scene detection algorithms and the corresponding sonification methods. The results provide insights into the design of electronic travel aids, and the conclusions can also be applied in other fields, such as the sound feedback of virtual reality applications.

The accuracy of auditory spatial judgments in the visually impaired is dependent on sound source distance

Blindness leads to substantial enhancements in many auditory abilities, and deficits in others. It is unknown how severe visual losses need to be before changes in auditory abilities occur, or whether the relationship between severity of visual loss and changes in auditory abilities is proportional and systematic. Here we show that greater severity of visual loss is associated with increased auditory judgments of distance and room size. On average participants with severe visual losses perceived sounds to be twice as far away, and rooms to be three times larger, than sighted controls. Distance estimates for sighted controls were most accurate for closer sounds and least accurate for farther sounds. As the severity of visual impairment increased, accuracy decreased for closer sounds and increased for farther sounds. However, it is for closer sounds that accurate judgments are needed to guide rapid motor responses to auditory events, e.g. planning a safe path through a busy street to avoid collisions with other people, and falls. Interestingly, greater visual impairment severity was associated with more accurate room size estimates. The results support a new hypothesis that crossmodal calibration of audition by vision depends on the severity of visual loss.

The Cross-Modal Effects of Sensory Deprivation on Spatial and Temporal Processes in Vision and Audition: A Systematic Review on Behavioral and Neuroimaging Research since 2000

One of the most significant effects of neural plasticity manifests in the case of sensory deprivation when cortical areas that were originally specialized for the functions of the deprived sense take over the processing of another modality. Vision and audition represent two important senses needed to navigate through space and time. Therefore, the current systematic review discusses the cross-modal behavioral and neural consequences of deafness and blindness by focusing on spatial and temporal processing abilities, respectively. In addition, movement processing is evaluated as compiling both spatial and temporal information. We examine whether the sense that is not primarily affected changes in its own properties or in the properties of the deprived modality (i.e., temporal processing as the main specialization of audition and spatial processing as the main specialization of vision). References to the metamodal organization, supramodal functioning, and the revised neural recycling theory are made to address global brain organization and plasticity principles. Generally, according to the reviewed studies, behavioral performance is enhanced in those aspects for which both the deprived and the overtaking senses provide adequate processing resources. Furthermore, the behavioral enhancements observed in the overtaking sense (i.e., vision in the case of deafness and audition in the case of blindness) are clearly limited by the processing resources of the overtaking modality. Thus, the brain regions that were previously recruited during the behavioral performance of the deprived sense now support a similar behavioral performance for the overtaking sense. This finding suggests a more input-unspecific and processing principle-based organization of the brain. Finally, we highlight the importance of controlling for and stating factors that might impact neural plasticity and the need for further research into visual temporal processing in deaf subjects.

Rapid identification of sound direction in blind footballers

Earlier studies have demonstrated that blind footballers are more accurate in identifying sound direction with less front-back confusion than sighted and blind non-football playing individuals. However, it is unknown whether blind footballers are faster than sighted footballers and nonathletes in identifying sound direction using auditory cues. Here, the present study aimed to investigate the auditory reaction times (RTs) and response accuracy of blind footballers during auditory RT tasks, including the identification of sound direction. Participants executed goal-directed stepping towards the loudspeaker as quickly and accurately as possible after identifying the sound direction. Simple, two-choice, and four-choice auditory RT tasks were completed. The results revealed that blind footballers had shorter RTs than sighted footballers in the choice RT tasks, but not in the simple RT task. These findings suggest that blind footballers are faster in identifying sound direction based on auditory cues, which is an essential perceptual-cognitive skill specific to blind football.

The Acuity of Echolocation: Spatial Resolution in Sighted Persons Compared to the Performance of an Expert who is Blind

Compared with the echolocation performance of an expert who is blind, sighted novices rapidly learned size and position discrimination with surprising precision. We used a novel task to characterize the population distribution of echolocation skills in sighted persons and report the highest-known human echolocation acuity in the expert who is blind.

Unifying Terrain Awareness for the Visually Impaired through Real-Time Semantic Segmentation

Navigational assistance aims to help visually-impaired people to ambulate the environment safely and independently. This topic becomes challenging as it requires detecting a wide variety of scenes to provide higher level assistive awareness. Vision-based technologies with monocular detectors or depth sensors have sprung up within several years of research. These separate approaches have achieved remarkable results with relatively low processing time and have improved the mobility of impaired people to a large extent. However, running all detectors jointly increases the latency and burdens the computational resources. In this paper, we put forward seizing pixel-wise semantic segmentation to cover navigation-related perception needs in a unified way. This is critical not only for the terrain awareness regarding traversable areas, sidewalks, stairs and water hazards, but also for the avoidance of short-range obstacles, fast-approaching pedestrians and vehicles. The core of our unification proposal is a deep architecture, aimed at attaining efficient semantic understanding. We have integrated the approach in a wearable navigation system by incorporating robust depth segmentation. A comprehensive set of experiments prove the qualified accuracy over state-of-the-art methods while maintaining real-time speed. We also present a closed-loop field test involving real visually-impaired users, demonstrating the effectivity and versatility of the assistive framework.

Visual sensory stimulation interferes with people's ability to echolocate object size

Echolocation is the ability to use sound-echoes to infer spatial information about the environment. People can echolocate for example by making mouth clicks. Previous research suggests that echolocation in blind people activates brain areas that process light in sighted people. Research has also shown that echolocation in blind people may replace vision for calibration of external space. In the current study we investigated if echolocation may also draw on ‘visual’ resources in the sighted brain. To this end, we paired a sensory interference paradigm with an echolocation task. We found that exposure to an uninformative visual stimulus (i.e. white light) while simultaneously echolocating significantly reduced participants’ ability to accurately judge object size. In contrast, a tactile stimulus (i.e. vibration on the skin) did not lead to a significant change in performance (neither in sighted, nor blind echo expert participants). Furthermore, we found that the same visual stimulus did not affect performance in auditory control tasks that required detection of changes in sound intensity, sound frequency or sound location. The results suggest that processing of visual and echo-acoustic information draw on common neural resources.

Blindness enhances auditory obstacle circumvention: Assessing echolocation, sensory substitution, and visual-based navigation

Performance for an obstacle circumvention task was assessed under conditions of visual, auditory only (using echolocation) and tactile (using a sensory substitution device, SSD) guidance. A Vicon motion capture system was used to measure human movement kinematics objectively. Ten normally sighted participants, 8 blind non-echolocators, and 1 blind expert echolocator navigated around a 0.6 x 2 m obstacle that was varied in position across trials, at the midline of the participant or 25 cm to the right or left. Although visual guidance was the most effective, participants successfully circumvented the obstacle in the majority of trials under auditory or SSD guidance. Using audition, blind non-echolocators navigated more effectively than blindfolded sighted individuals with fewer collisions, lower movement times, fewer velocity corrections and greater obstacle detection ranges. The blind expert echolocator displayed performance similar to or better than that for the other groups using audition, but was comparable to that for the other groups using the SSD. The generally better performance of blind than of sighted participants is consistent with the perceptual enhancement hypothesis that individuals with severe visual deficits develop improved auditory abilities to compensate for visual loss, here shown by faster, more fluid, and more accurate navigation around obstacles using sound.

Hearing Scenes: A Neuromagnetic Signature of Auditory Source and Reverberant Space Separation

Perceiving the geometry of surrounding space is a multisensory process, crucial to contextualizing object perception and guiding navigation behavior. Humans can make judgments about surrounding spaces from reverberation cues, caused by sounds reflecting off multiple interior surfaces. However, it remains unclear how the brain represents reverberant spaces separately from sound sources. Here, we report separable neural signatures of auditory space and source perception during magnetoencephalography (MEG) recording as subjects listened to brief sounds convolved with monaural room impulse responses (RIRs). The decoding signature of sound sources began at 57 ms after stimulus onset and peaked at 130 ms, while space decoding started at 138 ms and peaked at 386 ms. Importantly, these neuromagnetic responses were readily dissociable in form and time: while sound source decoding exhibited an early and transient response, the neural signature of space was sustained and independent of the original source that produced it. The reverberant space response was robust to variations in sound source, and vice versa, indicating a generalized response not tied to specific source-space combinations. These results provide the first neuromagnetic evidence for robust, dissociable auditory source and reverberant space representations in the human brain and reveal the temporal dynamics of how auditory scene analysis extracts percepts from complex naturalistic auditory signals.

Auditory Spatial Perception without Vision

Valuable insights into the role played by visual experience in shaping spatial representations can be gained by studying the effects of visual deprivation on the remaining sensory modalities. For instance, it has long been debated how spatial hearing evolves in the absence of visual input. While several anecdotal accounts tend to associate complete blindness with exceptional hearing abilities, experimental evidence supporting such claims is, however, matched by nearly equal amounts of evidence documenting spatial hearing deficits. The purpose of this review is to summarize the key findings which support either enhancements or deficits in spatial hearing observed following visual loss and to provide a conceptual framework that isolates the specific conditions under which they occur. Available evidence will be examined in terms of spatial dimensions (horizontal, vertical, and depth perception) and in terms of frames of reference (egocentric and allocentric). Evidence suggests that while early blind individuals show superior spatial hearing in the horizontal plane, they also show significant deficits in the vertical plane. Potential explanations underlying these contrasting findings will be discussed. Early blind individuals also show spatial hearing impairments when performing tasks that require the use of an allocentric frame of reference. Results obtained with late-onset blind individuals suggest that early visual experience plays a key role in the development of both spatial hearing enhancements and deficits.

From Perception to Metacognition: Auditory and Olfactory Functions in Early Blind, Late Blind, and Sighted Individuals

Although evidence is mixed, studies have shown that blind individuals perform better than sighted at specific auditory, tactile, and chemosensory tasks. However, few studies have assessed blind and sighted individuals across different sensory modalities in the same study. We tested early blind (n = 15), late blind (n = 15), and sighted (n = 30) participants with analogous olfactory and auditory tests in absolute threshold, discrimination, identification, episodic recognition, and metacognitive ability. Although the multivariate analysis of variance (MANOVA) showed no overall effect of blindness and no interaction with modality, follow-up between-group contrasts indicated a blind-over-sighted advantage in auditory episodic recognition, that was most pronounced in early blind individuals. In contrast to the auditory modality, there was no empirical support for compensatory effects in any of the olfactory tasks. There was no conclusive evidence for group differences in metacognitive ability to predict episodic recognition performance. Taken together, the results showed no evidence of an overall superior performance in blind relative sighted individuals across olfactory and auditory functions, although early blind individuals exceled in episodic auditory recognition memory. This observation may be related to an experience-induced increase in auditory attentional capacity.

Echolocation in humans: an overview

Bats and dolphins are known for their ability to use echolocation. They emit bursts of sounds and listen to the echoes that bounce back to detect the objects in their environment. What is not as well-known is that some blind people have learned to do the same thing, making mouth clicks, for example, and using the returning echoes from those clicks to sense obstacles and objects of interest in their surroundings. The current review explores some of the research that has examined human echolocation and the changes that have been observed in the brains of echolocation experts. We also discuss potential applications and assistive technology based on echolocation. Blind echolocation experts can sense small differences in the location of objects, differentiate between objects of various sizes and shapes, and even between objects made of different materials, just by listening to the reflected echoes from mouth clicks. It is clear that echolocation may enable some blind people to do things that are otherwise thought to be impossible without vision, potentially providing them with a high degree of independence in their daily lives and demonstrating that echolocation can serve as an effective mobility strategy in the blind. Neuroimaging has shown that the processing of echoes activates brain regions in blind echolocators that would normally support vision in the sighted brain, and that the patterns of these activations are modulated by the information carried by the echoes. This work is shedding new light on just how plastic the human brain is. WIREs Cogn Sci 2016, 7:382-393. doi: 10.1002/wcs.1408 For further resources related to this article, please visit the WIREs website.

Auditory spatial localization: Developmental delay in children with visual impairments

For individuals with visual impairments, auditory spatial localization is one of the most important features to navigate in the environment. Many works suggest that blind adults show similar or even enhanced performance for localization of auditory cues compared to sighted adults (Collignon, Voss, Lassonde, & Lepore, 2009). To date, the investigation of auditory spatial localization in children with visual impairments has provided contrasting results. Here we report, for the first time, that contrary to visually impaired adults, children with low vision or total blindness show a significant impairment in the localization of static sounds. These results suggest that simple auditory spatial tasks are compromised in children, and that this capacity recovers over time.

An assessment of auditory-guided locomotion in an obstacle circumvention task

This study investigated how effectively audition can be used to guide navigation around an obstacle. Ten blindfolded normally sighted participants navigated around a 0.6 × 2 m obstacle while producing self-generated mouth click sounds. Objective movement performance was measured using a Vicon motion capture system. Performance with full vision without generating sound was used as a baseline for comparison. The obstacle’s location was varied randomly from trial to trial: it was either straight ahead or 25 cm to the left or right relative to the participant. Although audition provided sufficient information to detect the obstacle and guide participants around it without collision in the majority of trials, buffer space (clearance between the shoulder and obstacle), overall movement times, and number of velocity corrections were significantly (p < 0.05) greater with auditory guidance than visual guidance. Collisions sometime occurred under auditory guidance, suggesting that audition did not always provide an accurate estimate of the space between the participant and obstacle. Unlike visual guidance, participants did not always walk around the side that afforded the most space during auditory guidance. Mean buffer space was 1.8 times higher under auditory than under visual guidance. Results suggest that sound can be used to generate buffer space when vision is unavailable, allowing navigation around an obstacle without collision in the majority of trials.

The role of head movements in the discrimination of 2-D shape by blind echolocation experts

Similar to certain bats and dolphins, some blind humans can use sound echoes to perceive their silent surroundings. By producing an auditory signal (e.g., a tongue click) and listening to the returning echoes, these individuals can obtain information about their environment, such as the size, distance, and density of objects. Past research has also hinted at the possibility that blind individuals may be able to use echolocation to gather information about 2-D surface shape, with definite results pending. Thus, here we investigated people's ability to use echolocation to identify the 2-D shape (contour) of objects. We also investigated the role played by head movements--that is, exploratory movements of the head while echolocating--because anecdotal evidence suggests that head movements might be beneficial for shape identification. To this end, we compared the performance of six expert echolocators to that of ten blind nonecholocators and ten blindfolded sighted controls in a shape identification task, with and without head movements. We found that the expert echolocators could use echoes to determine the shapes of the objects with exceptional accuracy when they were allowed to make head movements, but that their performance dropped to chance level when they had to remain still. Neither blind nor blindfolded sighted controls performed above chance, regardless of head movements. Our results show not only that experts can use echolocation to successfully identify 2-D shape, but also that head movements made while echolocating are necessary for the correct identification of 2-D shape.

A Device for Human Ultrasonic Echolocation

OBJECTIVE

We present a device that combines principles of ultrasonic echolocation and spatial hearing to provide human users with environmental cues that are 1) not otherwise available to the human auditory system, and 2) richer in object and spatial information than the more heavily processed sonar cues of other assistive devices. The device consists of a wearable headset with an ultrasonic emitter and stereo microphones with affixed artificial pinnae. The goal of this study is to describe the device and evaluate the utility of the echoic information it provides.

METHODS

The echoes of ultrasonic pulses were recorded and time stretched to lower their frequencies into the human auditory range, then played back to the user. We tested performance among naive and experienced sighted volunteers using a set of localization experiments, in which the locations of echo-reflective surfaces were judged using these time-stretched echoes.

RESULTS

Naive subjects were able to make laterality and distance judgments, suggesting that the echoes provide innately useful information without prior training. Naive subjects were generally unable to make elevation judgments from recorded echoes. However, trained subjects demonstrated an ability to judge elevation as well.

CONCLUSION

This suggests that the device can be used effectively to examine the environment and that the human auditory system can rapidly adapt to these artificial echolocation cues.

SIGNIFICANCE

Interpreting and interacting with the external world constitutes a major challenge for persons who are blind or visually impaired. This device has the potential to aid blind people in interacting with their environment.

Use of binaural and monaural cues to identify the lateral position of a virtual object using echoes

Under certain conditions, sighted and blind humans can use echoes to discern characteristics of otherwise silent objects. Previous research concluded that robust horizontal-plane object localisation ability, without using head movement, depends on information above 2 kHz. While a strong interaural level difference (ILD) cue is available, it was not clear if listeners were using that or the monaural level cue that necessarily accompanies ILD. In this experiment, 13 sighted and normal-hearing listeners were asked to identify the right-vs.-left position of an object in virtual auditory space. Sounds were manipulated to remove binaural cues (binaural vs. diotic presentation) and prevent the use of monaural level cues (using level roving). With low- (<2 kHz) and high- (>2 kHz) frequency bands of noise, performance with binaural presentation and level rove exceeded that expected from use of monaural level cues and that with diotic presentation. It is argued that a high-frequency binaural cue (most likely ILD), and not a monaural level cue, is crucial for robust object localisation without head movement.

Ranging in human sonar: effects of additional early reflections and exploratory head movements

Many blind people rely on echoes from self-produced sounds to assess their environment. It has been shown that human subjects can use echolocation for directional localization and orientation in a room, but echo-acoustic distance perception--e.g. to determine one's position in a room--has received little scientific attention, and systematic studies on the influence of additional early reflections and exploratory head movements are lacking. This study investigates echo-acoustic distance discrimination in virtual echo-acoustic space, using the impulse responses of a real corridor. Six blindfolded sighted subjects and a blind echolocation expert had to discriminate between two positions in the virtual corridor, which differed by their distance to the front wall, but not to the lateral walls. To solve this task, participants evaluated echoes that were generated in real time from self-produced vocalizations. Across experimental conditions, we systematically varied the restrictions for head rotations, the subjects' orientation in virtual space and the reference position. Three key results were observed. First, all participants successfully solved the task with discrimination thresholds below 1 m for all reference distances (0.75-4 m). Performance was best for the smallest reference distance of 0.75 m, with thresholds around 20 cm. Second, distance discrimination performance was relatively robust against additional early reflections, compared to other echolocation tasks like directional localization. Third, free head rotations during echolocation can improve distance discrimination performance in complex environmental settings. However, head movements do not necessarily provide a benefit over static echolocation from an optimal single orientation. These results show that accurate distance discrimination through echolocation is possible over a wide range of reference distances and environmental conditions. This is an important functional benefit of human echolocation, which may also play a major role in the calibration of auditory space representations.

Self-motion facilitates echo-acoustic orientation in humans

The ability of blind humans to navigate complex environments through echolocation has received rapidly increasing scientific interest. However, technical limitations have precluded a formal quantification of the interplay between echolocation and self-motion. Here, we use a novel virtual echo-acoustic space technique to formally quantify the influence of self-motion on echo-acoustic orientation. We show that both the vestibular and proprioceptive components of self-motion contribute significantly to successful echo-acoustic orientation in humans: specifically, our results show that vestibular input induced by whole-body self-motion resolves orientation-dependent biases in echo-acoustic cues. Fast head motions, relative to the body, provide additional proprioceptive cues which allow subjects to effectively assess echo-acoustic space referenced against the body orientation. These psychophysical findings clearly demonstrate that human echolocation is well suited to drive precise locomotor adjustments. Our data shed new light on the sensory-motor interactions, and on possible optimization strategies underlying echolocation in humans.

Auditory localization and precedence effect: an exploratory study in infants and toddlers with visual impairment and normal vision

The precedence effect is a spatial hearing phenomenon implicated in sound localization on reverberant environments. It occurs when a pair of sounds, with a brief delay between them, is presented from different directions; listeners give greater perceptual weight to localization cues coming from the first-arriving sound, called lead, and suppress localization cues from the later-arriving reflection, called lag. Developmental studies with sighted infants show that the first responses to precedence effect stimuli are observed at 4-5 months of life. In this exploratory study, we use the minimum audible angle (MAA) paradigm in conjunction with the observer-based psychophysical procedure to test the ability of infants and toddlers, with visual impairment and normal vision, to discriminate changes in the azimuthal position of sounds configured under precedence effect conditions. The results indicated that similar and, in some conditions, higher performances were obtained by blind toddlers when compared to sighted children of similar age, and revealed that the observer-based psychophysical procedure is a valuable method to measure auditory localization acuity in infants and toddlers with visual impairment. The video records showed auditory orienting behaviors specific of the blind children group.

Correlation between vividness of visual imagery and echolocation ability in sighted, echo-naïve people

The ability of humans to echolocate has been recognized since the 1940s. Little is known about what determines individual differences in echolocation ability, however. Although hearing ability has been suggested as an important factor in blind people and sighted-trained echolocators, there is evidence to suggest that this may not be the case for sighted novices. Therefore, non-auditory aspects of human cognition might be relevant. Previous brain imaging studies have shown activation of the early 'visual', i.e. calcarine, cortex during echolocation in blind echolocation experts, and also during visual imagery in blind and sighted people. Therefore, here we investigated the relationship between echolocation ability and vividness of visual imagery (VVI). Twenty-four sighted echolocation novices completed Marks' (Br J Psychol 1:17-24, 1973) VVI questionnaire and they also performed an echolocation size-discrimination task. Furthermore, they participated in a battery of auditory tests that determined their ability to detect fluctuations in sound frequency and intensity, as well as hearing differences between the right and left ear. A correlational analysis revealed a significant relationship between participants' VVI and echolocation ability, i.e. participants with stronger VVI also had higher echolocation ability, even when differences in auditory abilities were taken into account. In terms of underlying mechanisms, we suggest that either the use of visual imagery is a strategy for echolocation, or that visual imagery and echolocation both depend on the ability to recruit calcarine cortex for cognitive tasks that do not rely on retinal input.

A summary of research investigating echolocation abilities of blind and sighted humans

There is currently considerable interest in the consequences of loss in one sensory modality on the remaining senses. Much of this work has focused on the development of enhanced auditory abilities among blind individuals, who are often able to use sound to navigate through space. It has now been established that many blind individuals produce sound emissions and use the returning echoes to provide them with information about objects in their surroundings, in a similar manner to bats navigating in the dark. In this review, we summarize current knowledge regarding human echolocation. Some blind individuals develop remarkable echolocation abilities, and are able to assess the position, size, distance, shape, and material of objects using reflected sound waves. After training, normally sighted people are also able to use echolocation to perceive objects, and can develop abilities comparable to, but typically somewhat poorer than, those of blind people. The underlying cues and mechanisms, operable range, spatial acuity and neurological underpinnings of echolocation are described. Echolocation can result in functional real life benefits. It is possible that these benefits can be optimized via suitable training, especially among those with recently acquired blindness, but this requires further study. Areas for further research are identified.

Neural correlates of motion processing through echolocation, source hearing, and vision in blind echolocation experts and sighted echolocation novices

We have shown in previous research (Thaler L, Arnott SR, Goodale MA. PLoS One 6: e20162, 2011) that motion processing through echolocation activates temporal-occipital cortex in blind echolocation experts. Here we investigated how neural substrates of echo-motion are related to neural substrates of auditory source-motion and visual-motion. Three blind echolocation experts and twelve sighted echolocation novices underwent functional MRI scanning while they listened to binaural recordings of moving or stationary echolocation or auditory source sounds located either in left or right space. Sighted participants' brain activity was also measured while they viewed moving or stationary visual stimuli. For each of the three modalities separately (echo, source, vision), we then identified motion-sensitive areas in temporal-occipital cortex and in the planum temporale. We then used a region of interest (ROI) analysis to investigate cross-modal responses, as well as laterality effects. In both sighted novices and blind experts, we found that temporal-occipital source-motion ROIs did not respond to echo-motion, and echo-motion ROIs did not respond to source-motion. This double-dissociation was absent in planum temporale ROIs. Furthermore, temporal-occipital echo-motion ROIs in blind, but not sighted, participants showed evidence for contralateral motion preference. Temporal-occipital source-motion ROIs did not show evidence for contralateral preference in either blind or sighted participants. Our data suggest a functional segregation of processing of auditory source-motion and echo-motion in human temporal-occipital cortex. Furthermore, the data suggest that the echo-motion response in blind experts may represent a reorganization rather than exaggeration of response observed in sighted novices. There is the possibility that this reorganization involves the recruitment of “visual” cortical areas.

Echolocation versus echo suppression in humans

Several studies have shown that blind humans can gather spatial information through echolocation. However, when localizing sound sources, the precedence effect suppresses spatial information of echoes, and thereby conflicts with effective echolocation. This study investigates the interaction of echolocation and echo suppression in terms of discrimination suppression in virtual acoustic space. In the 'Listening' experiment, sighted subjects discriminated between positions of a single sound source, the leading or the lagging of two sources, respectively. In the 'Echolocation' experiment, the sources were replaced by reflectors. Here, the same subjects evaluated echoes generated in real time from self-produced vocalizations and thereby discriminated between positions of a single reflector, the leading or the lagging of two reflectors, respectively. Two key results were observed. First, sighted subjects can learn to discriminate positions of reflective surfaces echo-acoustically with accuracy comparable to sound source discrimination. Second, in the Listening experiment, the presence of the leading source affected discrimination of lagging sources much more than vice versa. In the Echolocation experiment, however, the presence of both the lead and the lag strongly affected discrimination. These data show that the classically described asymmetry in the perception of leading and lagging sounds is strongly diminished in an echolocation task. Additional control experiments showed that the effect is owing to both the direct sound of the vocalization that precedes the echoes and owing to the fact that the subjects actively vocalize in the echolocation task.

Compensatory plasticity and cross-modal reorganization following early visual deprivation

For human and non-human primates, vision is one of the most privileged sensory channels used to interact with the environment. The importance of vision is strongly embedded in the organization of the primate brain as about one third of its cortical surface is involved in visual functions. It is therefore not surprising that the absence of vision from birth, or the loss of vision later in life, has huge consequences, both anatomically and functionally. Studies in animals and humans, conducted over the past few decades, have demonstrated that the absence of vision causes massive structural changes that take place not only in the visually deprived cortex but also in other brain areas. These studies have further shown that the visually deprived cortex becomes responsive to a wide variety of non-visual sensory inputs. Recent studies even showed a role of the visually deprived cortex in cognitive processes. At the behavioral level, increases in acuity for auditory and tactile processes have been reported. The study of the congenitally blind brain also offers a unique model to gain better insights into the functioning of the normal sighted brain and to understand to what extent visual experience is necessary for the brain to develop its functional architecture. Finally, the study of the blind brain allows us to investigate how consciousness develops in the absence of vision. How does the brain of someone who has never had any visual perception form an image of the external world? In this paper, we discuss recent findings from animal studies as well as from behavioural and functional brain imaging studies in sighted and blind individuals that address these questions.

Evidence for enhanced discrimination of virtual auditory distance among blind listeners using level and direct-to-reverberant cues

Totally blind listeners often demonstrate better than normal capabilities when performing spatial hearing tasks. Accurate representation of three-dimensional auditory space requires the processing of available distance information between the listener and the sound source; however, auditory distance cues vary greatly depending upon the acoustic properties of the environment, and it is not known which distance cues are important to totally blind listeners. Our data show that totally blind listeners display better performance compared to sighted age-matched controls for distance discrimination tasks in anechoic and reverberant virtual rooms simulated using a room-image procedure. Totally blind listeners use two major auditory distance cues to stationary sound sources, level and direct-to-reverberant ratio, more effectively than sighted controls for many of the virtual distances tested. These results show that significant compensation among totally blind listeners for virtual auditory spatial distance leads to benefits across a range of simulated acoustic environments. No significant differences in performance were observed between listeners with partial non-correctable visual losses and sighted controls, suggesting that sensory compensation for virtual distance does not occur for listeners with partial vision loss.

Human echolocation: pitch versus loudness information

Blind persons emit sounds to detect objects by echolocation. Both perceived pitch and perceived loudness of the emitted sound change as they fuse with the reflections from nearby objects. Blind persons generally are better than sighted at echolocation, but it is unclear whether this superiority is related to detection of pitch, loudness, or both. We measured the ability of twelve blind and twenty-five sighted listeners to determine which of two sounds, 500 ms noise bursts, that had been recorded in the presence of a reflecting object in a room with reflecting walls using an artificial head. The sound pairs were original recordings differing in both pitch and loudness, or manipulated recordings with either the pitch or the loudness information removed. Observers responded using a 2AFC method with verbal feedback. For both blind and sighted listeners the performance declined more with the pitch information removed than with the loudness information removed. In addition, the blind performed clearly better than the sighted as long as the pitch information was present, but not when it was removed. Taken together, these results show that the ability to detect pitch is a main factor underlying high performance in human echolocation.

Ultrafine spatial acuity of blind expert human echolocators

Echolocating organisms represent their external environment using reflected auditory information from emitted vocalizations. This ability, long known in various non-human species, has also been documented in some blind humans as an aid to navigation, as well as object detection and coarse localization. Surprisingly, our understanding of the basic acuity attainable by practitioners-the most fundamental underpinning of echoic spatial perception-remains crude. We found that experts were able to discriminate horizontal offsets of stimuli as small as ~1.2° auditory angle in the frontomedial plane, a resolution approaching the maximum measured precision of human spatial hearing and comparable to that found in bats performing similar tasks. Furthermore, we found a strong correlation between echolocation acuity and age of blindness onset. This first measure of functional spatial resolution in a population of expert echolocators demonstrates precision comparable to that found in the visual periphery of sighted individuals.

Sensory rehabilitation in the plastic brain

The purpose of this review is to consider new sensory rehabilitation avenues in the context of the brain's remarkable ability to reorganize itself following sensory deprivation. Here, deafness and blindness are taken as two illustrative models. Mainly, two promising rehabilitative strategies based on opposing theoretical principles will be considered: sensory substitution and neuroprostheses. Sensory substitution makes use of the remaining intact senses to provide blind or deaf individuals with coded information of the lost sensory system. This technique thus benefits from added neural resources in the processing of the remaining senses resulting from crossmodal plasticity, which is thought to be coupled with behavioral enhancements in the intact senses. On the other hand, neuroprostheses represent an invasive approach aimed at stimulating the deprived sensory system directly in order to restore, at least partially, its functioning. This technique therefore relies on the neuronal integrity of the brain areas normally dedicated to the deprived sense and is rather hindered by the compensatory reorganization observed in the deprived cortex. Here, we stress that our understanding of the neuroplastic changes that occur in sensory-deprived individuals may help guide the design and the implementation of such rehabilitative methods.

Cross auditory-spatial learning in early-blind individuals

Cross-modal processing enables the utilization of information received via different sensory organs to facilitate more complicated human actions. We used functional MRI on early-blind individuals to study the neural processes associated with cross auditory-spatial learning. The auditory signals, converted from echoes of ultrasonic signals emitted from a navigation device, were novel to the participants. The subjects were trained repeatedly for 4 weeks in associating the auditory signals with different distances. Subjects' blood-oxygenation-level-dependent responses were captured at baseline and after training using a sound-to-distance judgment task. Whole-brain analyses indicated that the task used in the study involved auditory discrimination as well as spatial localization. The learning process was shown to be mediated by the inferior parietal cortex and the hippocampus, suggesting the integration and binding of auditory features to distances. The right cuneus was found to possibly serve a general rather than a specific role, forming an occipital-enhanced network for cross auditory-spatial learning. This functional network is likely to be unique to those with early blindness, since the normal-vision counterparts shared activities only in the parietal cortex.

Neural correlates of natural human echolocation in early and late blind echolocation experts

Background

A small number of blind people are adept at echolocating silent objects simply by producing mouth clicks and listening to the returning echoes. Yet the neural architecture underlying this type of aid-free human echolocation has not been investigated. To tackle this question, we recruited echolocation experts, one early- and one late-blind, and measured functional brain activity in each of them while they listened to their own echolocation sounds.

Results

When we compared brain activity for sounds that contained both clicks and the returning echoes with brain activity for control sounds that did not contain the echoes, but were otherwise acoustically matched, we found activity in calcarine cortex in both individuals. Importantly, for the same comparison, we did not observe a difference in activity in auditory cortex. In the early-blind, but not the late-blind participant, we also found that the calcarine activity was greater for echoes reflected from surfaces located in contralateral space. Finally, in both individuals, we found activation in middle temporal and nearby cortical regions when they listened to echoes reflected from moving targets.

Conclusions

These findings suggest that processing of click-echoes recruits brain regions typically devoted to vision rather than audition in both early and late blind echolocation experts.

Subcortical auditory input to the primary visual cortex in anophthalmic mice

Anatomical and imaging studies show ample evidence for auditory activation of the visual cortex following early onset of blindness in both humans and animal models. Anatomical studies in animal models of early blindness clearly show intermodal pathways through which auditory information can reach the primary visual cortex. There is clear evidence for intermodal corticocortical pathways linking auditory and visual cortex and also novel connections between the inferior colliculus and the visual thalamus. A recent publication [L.K. Laemle, N.L. Strominger, D.O. Carpenter, Cross-modal innervation of primary visual cortex by auditory fibers in congenitally anophthalmic mice, Neurosci. Lett. 396 (2006) 108-112] suggested the presence of a direct reciprocal connection between the inferior colliculus and the primary visual cortex (V1) in congenitally anophthalmic ZRDCT/An mice. This implies that this mutant mouse would be the only known vertebrate having a direct tectal connection with a primary sensory cortex. The presence of this peculiar pathway was reinvestigated in the ZRDCT/An mouse with highly sensitive neuronal tracers. We found the connections normally described in the ZRDCT/An mouse between: (i) the inferior colliculus and the dorsal lateral geniculate nucleus, (ii) V1 and the superior colliculus, (iii) the lateral posterior nucleus and V1 and between (iv) the inferior colliculus and the medial geniculate nucleus. We also show unambiguously that the auditory subcortical structures do not connect the primary visual cortex in the anophthalmic mouse. In particular, we find no evidence of a direct projection from the auditory mesencephalon to the cortex in this animal model of blindness.