Sensory compensation in sound localization in people with one eye

Effect of early versus late onset of partial visual loss on judgments of auditory distance

SIGNIFICANCE

It is important to know whether early-onset vision loss and late-onset vision loss are associated with differences in the estimation of distances of sound sources within the environment. People with vision loss rely heavily on auditory cues for path planning, safe navigation, avoiding collisions, and activities of daily living.

PURPOSE

Loss of vision can lead to substantial changes in auditory abilities. It is unclear whether differences in sound distance estimation exist in people with early-onset partial vision loss, late-onset partial vision loss, and normal vision. We investigated distance estimates for a range of sound sources and auditory environments in groups of participants with early- or late-onset partial visual loss and sighted controls.

METHODS

Fifty-two participants heard static sounds with virtual distances ranging from 1.2 to 13.8 m within a simulated room. The room simulated either anechoic (no echoes) or reverberant environments. Stimuli were speech, music, or noise. Single sounds were presented, and participants reported the estimated distance of the sound source. Each participant took part in 480 trials.

RESULTS

Analysis of variance showed significant main effects of visual status (p<0.05) environment (reverberant vs. anechoic, p<0.05) and also of the stimulus (p<0.05). Significant differences (p<0.05) were shown in the estimation of distances of sound sources between early-onset visually impaired participants and sighted controls for closer distances for all conditions except the anechoic speech condition and at middle distances for all conditions except the reverberant speech and music conditions. Late-onset visually impaired participants and sighted controls showed similar performance (p>0.05).

CONCLUSIONS

The findings suggest that early-onset partial vision loss results in significant changes in judged auditory distance in different environments, especially for close and middle distances. Late-onset partial visual loss has less of an impact on the ability to estimate the distance of sound sources. The findings are consistent with a theoretical framework, the perceptual restructuring hypothesis, which was recently proposed to account for the effects of vision loss on audition.

Perception of the McGurk effect in people with one eye depends on whether the eye is removed during infancy or adulthood

Background

The visual system is not fully mature at birth and continues to develop throughout infancy until it reaches adult levels through late childhood and adolescence. Disruption of vision during this postnatal period and prior to visual maturation results in deficits of visual processing and in turn may affect the development of complementary senses. Studying people who have had one eye surgically removed during early postnatal development is a useful model for understanding timelines of sensory development and the role of binocularity in visual system maturation. Adaptive auditory and audiovisual plasticity following the loss of one eye early in life has been observed for both low-and high-level visual stimuli. Notably, people who have had one eye removed early in life perceive the McGurk effect much less than binocular controls.

Methods

The current study investigates whether multisensory compensatory mechanisms are also present in people who had one eye removed late in life, after postnatal visual system maturation, by measuring whether they perceive the McGurk effect compared to binocular controls and people who have had one eye removed early in life.

Results

People who had one eye removed late in life perceived the McGurk effect similar to binocular viewing controls, unlike those who had one eye removed early in life.

Conclusion

This suggests differences in multisensory compensatory mechanisms based on age at surgical eye removal. These results indicate that cross-modal adaptations for the loss of binocularity may be dependent on plasticity levels during cortical development.

Potential trade-off between olfactory and visual discrimination learning in common marmosets (Callithrix jacchus): Implications for the assessment of age-related cognitive decline

Olfactory dysfunction has been identified as an early biomarker for dementia risk but has rarely been assessed in nonhuman primate models of human aging. To better characterize common marmosets as such models, we assessed olfactory discrimination performance in a sample of 10 animals (5 females), aged 2.5-8.9 years old. The monkeys were proficient in the discrimination and reversal of visual stimuli but naïve to odor stimuli. For olfactory discrimination, the monkeys performed a series of six discriminations of increasing difficulty between two odor stimuli. We found no evidence for an age-related decline as both young and older individuals were able to perform the discriminations in roughly the same number of trials. In addition, the older monkeys had faster responses than the younger animals. However, we noted that when adjusted for age, the speed of acquisition of the first discrimination in the olfactory modality was inversely correlated to the speed of acquisition of their first discrimination of two visual stimuli months earlier. These results suggest that marmosets may compensate for sensory deficits in one modality with higher sensory performance in another. These data have broad implications for the assessment of age-related cognitive decline and the categorization of animals as impaired or nonimpaired.

Partial visual loss disrupts the relationship between judged room size and sound source distance

Visual spatial information plays an important role in calibrating auditory space. Blindness results in deficits in a number of auditory abilities, which have been explained in terms of the hypothesis that visual information is needed to calibrate audition. When judging the size of a novel room when only auditory cues are available, normally sighted participants may use the location of the farthest sound source to infer the nearest possible distance of the far wall. However, for people with partial visual loss (distinct from blindness in that some vision is present), such a strategy may not be reliable if vision is needed to calibrate auditory cues for distance. In the current study, participants were presented with sounds at different distances (ranging from 1.2 to 13.8 m) in a simulated reverberant (T₆₀ = 700 ms) or anechoic room. Farthest distance judgments and room size judgments (volume and area) were obtained from blindfolded participants (18 normally sighted, 38 partially sighted) for speech, music, and noise stimuli. With sighted participants, the judged room volume and farthest sound source distance estimates were positively correlated (p < 0.05) for all conditions. Participants with visual losses showed no significant correlations for any of the conditions tested. A similar pattern of results was observed for the correlations between farthest distance and room floor area estimates. Results demonstrate that partial visual loss disrupts the relationship between judged room size and sound source distance that is shown by sighted participants.

It's not you, it's me - disgust sensitivity towards body odor in deaf and blind individuals

Disgust might be elicited by various sensory channels, including the sense of smell. It has been previously demonstrated that unpleasant odors emitted by an external source are more disgusting than those emitted by oneself (the source effect). As disgust's main purpose is to help organisms avoid potentially dangerous, contaminating objects, individuals with visual or hearing sensory impairment (thus, with an impeded ability to detect cues indicating pathogen threat) might have developed an increased levels of olfactory disgust sensitivity (modality compensation in disgust sensitivity). We set out to investigate disgust sensitivity in olfaction using the Body Odor Disgust Scale (BODS) on a large sample of 74 deaf and 98 blind participants, with comparison to control groups without sensory impairment (N = 199 in total). The results did not support the hypothesis of modality compensation in disgust sensitivity. Contrary to previous research, neither sex nor age influenced the outcomes. Evidence for the source effect was found. Acquired data are interpreted in the light of social desirability. The emphasis put on the olfaction by blind and deaf individuals is discussed.

Brain Activation for Audiovisual Information in People With One Eye Compared to Binocular and Eye-Patched Viewing Controls

Blindness caused by early vision loss results in complete visual deprivation and subsequent changes in the use of the remaining intact senses. We have also observed adaptive plasticity in the case of partial visual deprivation. The removal of one eye, through unilateral eye enucleation, results in partial visual deprivation and is a unique model for examining the consequences of the loss of binocularity. Partial deprivation of the visual system from the loss of one eye early in life results in behavioral and structural changes in the remaining senses, namely auditory and audiovisual systems. In the current study we use functional neuroimaging data to relate function and behavior of the audiovisual system in this rare patient group compared to controls viewing binocularly or with one eye patched. In Experiment 1, a whole brain analysis compared common regions of cortical activation between groups, for auditory, visual and audiovisual stimuli. People with one eye demonstrated a trend for increased activation for low-level audiovisual stimuli compared to patched viewing controls but did not differ from binocular viewing controls. In Experiment 2, a region of interest (ROI) analysis for auditory, visual, audiovisual and illusory McGurk stimuli revealed that people with one eye had an increased trend for left hemisphere audiovisual activation for McGurk stimuli compared to binocular viewing controls. This aligns with current behavioral analysis and previous research showing reduced McGurk Effect in people with one eye. Furthermore, there is no evidence of a correlation between behavioral performance on the McGurk Effect task and functional activation. Together with previous behavioral work, these functional data contribute to the broader understanding of cross-sensory effects of early sensory deprivation from eye enucleation. Overall, these results contribute to a better understanding of the sensory deficits experienced by people with one eye, as well as, the relationship between behavior, structure and function in order to better predict the outcome of early partial visual deafferentation.

Altered white matter structure in auditory tracts following early monocular enucleation

Purpose: Similar to early blindness, monocular enucleation (the removal of one eye) early in life results in crossmodal behavioral and morphological adaptations. Previously it has been shown that partial visual deprivation from early monocular enucleation results in structural white matter changes throughout the visual system (Wong et al., 2018). The current study investigated structural white matter of the auditory system in adults who have undergone early monocular enucleation compared to binocular control participants. Methods: We reconstructed four auditory and audiovisual tracts of interest using probabilistic tractography and compared microstructural properties of these tracts to binocularly intact controls using standard diffusion indices. Results: Although both groups demonstrated asymmetries in indices in intrahemispheric tracts, monocular enucleation participants showed asymmetries opposite to control participants in the auditory and A1-V1 tracts. Monocular enucleation participants also demonstrated significantly lower fractional anisotropy in the audiovisual projections contralateral to the enucleated eye relative to control participants. Conclusions: Partial vision loss from early monocular enucleation results in altered structural connectivity that extends into the auditory system, beyond tracts primarily dedicated to vision.

•

Does losing one eye during postnatal maturation affect auditory white matter?

•

Performed DTI of auditory and audiovisual tracts using probabilistic tractography.

•

Patients differed in diffusion indices for auditory and audiovisual tracts.

•

Early eye removal alters auditory white matter in addition to visual tracts.

Impaired Spatial Hearing in Amblyopia: Evidence for Calibration of Auditory Maps by Retinocollicular Input in Humans

Purpose

Evidence from animals and blind humans suggests that early visual experience influences the developmental calibration of auditory localization. Hypothesizing that unilateral amblyopia may involve cross-modal deficits in spatial hearing, we measured the precision and accuracy of sound localization in humans with amblyopia.

Methods

All participants passed a standard hearing test. Experiment 1 measured sound localization precision for click stimuli in 10 adults with amblyopia and 10 controls using a minimum audible angle (MAA) task. Experiment 2 measured sound localization error (i.e., accuracy) for click train stimuli in 14 adults with amblyopia and 16 controls using an absolute sound localization task.

Results

In Experiment 1, the MAA (mean ± SEM) was significantly greater in the amblyopia group compared with controls (2.75 ± 0.30° vs. 1.69 ± 0.09°, P = 0.006). In Experiment 2, the overall sound localization error was significantly greater in the amblyopia group compared with controls (P = 0.047). The amblyopia group also showed significantly greater sound localization error in the auditory hemispace ipsilateral to the amblyopic eye (P = 0.036). At a location within this auditory hemispace, the magnitude of sound localization error correlated significantly with deficits in stereo acuity (P = 0.036).

Conclusions

The precision and accuracy of sound localization are impaired in unilateral amblyopia. The asymmetric pattern of sound localization error suggests that amblyopic vision may interfere with the development of spatial hearing via the retinocollicular pathway.

Audiovisual plasticity following early abnormal visual experience: Reduced McGurk effect in people with one eye

Previously, we have shown that people who have had one eye surgically removed early in life during visual development have enhanced sound localization [1] and lack visual dominance, commonly observed in binocular and monocular (eye-patched) viewing controls [2]. Despite these changes, people with one eye integrate auditory and visual components of multisensory events optimally [3]. The current study investigates how people with one eye perceive the McGurk effect, an audiovisual illusion where a new syllable is perceived when visual lip movements do not match the corresponding sound [4]. We compared individuals with one eye to binocular and monocular viewing controls and found that they have a significantly smaller McGurk effect compared to binocular controls. Additionally, monocular controls tended to perceive the McGurk effect less often than binocular controls suggesting a small transient modulation of the McGurk effect. These results suggest altered weighting of the auditory and visual modalities with both short and long-term monocular viewing. These results indicate the presence of permanent adaptive perceptual accommodations in people who have lost one eye early in life that may serve to mitigate the loss of binocularity during early brain development.

Intact Dynamic Visual Capture in People With One Eye

Observing motion in one modality can influence the perceived direction of motion in a second modality (dynamic capture). For example observing a square moving in depth can influence the perception of a sound to increase in loudness. The current study investigates whether people who have lost one eye are susceptible to audiovisual dynamic capture in the depth plane similar to binocular and eye-patched viewing control participants. Partial deprivation of the visual system from the loss of one eye early in life results in changes in the remaining intact senses such as hearing. Linearly expanding or contracting discs were paired with increasing or decreasing tones and participants were asked to indicate the direction of the auditory stimulus. Magnitude of dynamic visual capture was measured in people with one eye compared to eye-patched and binocular viewing controls. People with one eye have the same susceptibility to dynamic visual capture as controls, where they perceived the direction of the auditory signal to be moving in the direction of the incongruent visual signal, despite previously showing a lack of visual dominance for audiovisual cues. This behaviour may be the result of directing attention to the visual modality, their partially deficient sense, in order to gain important information about approaching and receding stimuli which in the former case could be life-threatening. These results contribute to the growing body of research showing that people with one eye display unique accommodations with respect to audiovisual processing that are likely adaptive in each unique sensory situation.

Partial Visual Loss Affects Self-reports of Hearing Abilities Measured Using a Modified Version of the Speech, Spatial, and Qualities of Hearing Questionnaire

We assessed how visually impaired (VI) people perceived their own auditory abilities using an established hearing questionnaire, the Speech, Spatial, and Qualities of Hearing Scale (SSQ), that was adapted to make it relevant and applicable to VI individuals by removing references to visual aspects while retaining the meaning of the original questions. The resulting questionnaire, the SSQvi, assessed perceived hearing ability in diverse situations including the ability to follow conversations with multiple speakers, assessing how far away a vehicle is, and the ability to perceptually segregate simultaneous sounds. The SSQvi was administered to 33 VI and 33 normally sighted participants. All participants had normal hearing or mild hearing loss, and all VI participants had some residual visual ability. VI participants gave significantly higher (better) scores than sighted participants for: (i) one speech question, indicating less difficulty in following a conversation that switches from one person to another, (ii) one spatial question, indicating less difficulty in localizing several talkers, (iii) three qualities questions, indicating less difficulty with segregating speech from music, hearing music more clearly, and better speech intelligibility in a car. These findings are consistent with the perceptual enhancement hypothesis, that certain auditory abilities are improved to help compensate for loss of vision, and show that full visual loss is not necessary for perceived changes in auditory ability to occur for a range of auditory situations. For all other questions, scores were not significantly different between the two groups. Questions related to effort, concentration, and ignoring distracting sounds were rated as most difficult for VI participants, as were situations involving divided-attention contexts with multiple streams of speech, following conversations in noise and in echoic environments, judging elevation or distance, and externalizing sounds. The questionnaire has potential clinical applications in assessing the success of clinical interventions and setting more realistic goals for intervention for those with auditory and/or visual losses. The results contribute toward providing benchmark scores for VI individuals.

Auditory distance perception in humans: a review of cues, development, neuronal bases, and effects of sensory loss

Auditory distance perception plays a major role in spatial awareness, enabling location of objects and avoidance of obstacles in the environment. However, it remains under-researched relative to studies of the directional aspect of sound localization. This review focuses on the following four aspects of auditory distance perception: cue processing, development, consequences of visual and auditory loss, and neurological bases. The several auditory distance cues vary in their effective ranges in peripersonal and extrapersonal space. The primary cues are sound level, reverberation, and frequency. Nonperceptual factors, including the importance of the auditory event to the listener, also can affect perceived distance. Basic internal representations of auditory distance emerge at approximately 6 months of age in humans. Although visual information plays an important role in calibrating auditory space, sensorimotor contingencies can be used for calibration when vision is unavailable. Blind individuals often manifest supranormal abilities to judge relative distance but show a deficit in absolute distance judgments. Following hearing loss, the use of auditory level as a distance cue remains robust, while the reverberation cue becomes less effective. Previous studies have not found evidence that hearing-aid processing affects perceived auditory distance. Studies investigating the brain areas involved in processing different acoustic distance cues are described. Finally, suggestions are given for further research on auditory distance perception, including broader investigation of how background noise and multiple sound sources affect perceived auditory distance for those with sensory loss.

Evidence of multisensory plasticity: Asymmetrical medial geniculate body in people with one eye

The medial geniculate body (MGB) plays a central role in auditory processing with both efferent and afferent tracts to primary auditory cortex. People who have lost one eye early in life have enhanced sound localization, lack visual over auditory dominance and integrate auditory and visual information optimally, similar to controls, despite taking longer to localize unimodal visual stimuli. Compared to controls, people with one eye have decreased lateral geniculate nuclei (LGN) volume as expected given the 50% deafferentation of the visual system. However, LGN volume is larger than predicted contralateral to the remaining eye, indicating altered structural development likely through recruitment of deafferented LGN cells.

Purpose: the current study investigated whether structural MGB changes are also present in this group given the changes they exhibit in auditory processing.

Methods: MGB volumes were measured in adults who had undergone early unilateral eye enucleation and were compared to binocularly intact controls.

Results: unlike controls, people with one eye had a significant asymmetry with a larger left compared to right MGB, independent of eye of enucleation. MGB volume correlated positively with LGN volume in people with one eye.

Conclusions: volume asymmetry in the MGB in people with one eye may represent increased interactions between the left MGB and primary auditory cortex. This interaction could contribute to increased auditory and other left hemisphere-dominant processing, including language, as compensation for the loss of one half of visual inputs early in life. The positive correlation between MGB and LGN volume is not due to space constraints but rather indicates increased plasticity in both auditory and visual sensory systems following early eye enucleation.

•

We measured MGB volume in people with one eye with high resolution MRI.

•

People with one eye had significantly larger left compared to right MGB volume.

•

May indicate increased interactions between left MGB and primary auditory cortex.

•

Positive correlation of left MGB with LGN volume indicates cross-sensory plasticity.

•

Increased left hemisphere processing may compensate for the loss of one eye.

Sound localization in a changing world

In natural environments, neural systems must be continuously updated to reflect changes in sensory inputs and behavioral goals. Recent studies of sound localization have shown that adaptation and learning involve multiple mechanisms that operate at different timescales and stages of processing, with other sensory and motor-related inputs playing a key role. We are only just beginning to understand, however, how these processes interact with one another to produce adaptive changes at the level of neuronal populations and behavior. Because there is no explicit map of auditory space in the cortex, studies of sound localization may also provide much broader insight into the plasticity of complex neural representations that are not topographically organized.

Visual system plasticity in mammals: the story of monocular enucleation-induced vision loss

The groundbreaking work of Hubel and Wiesel in the 1960’s on ocular dominance plasticity instigated many studies of the visual system of mammals, enriching our understanding of how the development of its structure and function depends on high quality visual input through both eyes. These studies have mainly employed lid suturing, dark rearing and eye patching applied to different species to reduce or impair visual input, and have created extensive knowledge on binocular vision. However, not all aspects and types of plasticity in the visual cortex have been covered in full detail. In that regard, a more drastic deprivation method like enucleation, leading to complete vision loss appears useful as it has more widespread effects on the afferent visual pathway and even on non-visual brain regions. One-eyed vision due to monocular enucleation (ME) profoundly affects the contralateral retinorecipient subcortical and cortical structures thereby creating a powerful means to investigate cortical plasticity phenomena in which binocular competition has no vote.In this review, we will present current knowledge about the specific application of ME as an experimental tool to study visual and cross-modal brain plasticity and compare early postnatal stages up into adulthood. The structural and physiological consequences of this type of extensive sensory loss as documented and studied in several animal species and human patients will be discussed. We will summarize how ME studies have been instrumental to our current understanding of the differentiation of sensory systems and how the structure and function of cortical circuits in mammals are shaped in response to such an extensive alteration in experience. In conclusion, we will highlight future perspectives and the clinical relevance of adding ME to the list of more longstanding deprivation models in visual system research.

Increased cortical surface area and gyrification following long-term survival from early monocular enucleation

Purpose

Retinoblastoma is typically diagnosed before 5 years of age and is often treated by enucleation (surgical removal) of the cancerous eye. Here, we sought to characterize morphological changes of the cortex following long-term survival from early monocular enucleation.

Methods

Nine adults with early right-eye enucleation (≤48 months of age) due to retinoblastoma were compared to 18 binocularly intact controls. Surface area, cortical thickness, and gyrification estimates were obtained from T₁ weighted images and group differences were examined.

Results

Early monocular enucleation was associated with increased surface area and/or gyrification in visual (i.e., V1, inferior temporal), auditory (i.e., supramarginal), and multisensory (i.e., superior temporal, inferior parietal, superior parietal) cortices compared with controls. Visual cortex increases were restricted to the right hemisphere contralateral to the remaining eye, consistent with previous subcortical data showing asymmetrical lateral geniculate nucleus volume following early monocular enucleation.

Conclusions

Altered morphological development of visual, auditory, and multisensory regions occurs subsequent to long-time survival from early eye loss.

•

Cortical morphology in early monocular enucleation was assessed.

•

Enucleation resulted in increased surface area and gyrification of the cortex.

•

Visual cortex increases were exhibited contralateral to the remaining eye.

•

Non-visual cortex increases in surface area and gyrification were also found.

•

Altered cortical development occurs following early monocular enucleation.

A summary of research investigating echolocation abilities of blind and sighted humans

There is currently considerable interest in the consequences of loss in one sensory modality on the remaining senses. Much of this work has focused on the development of enhanced auditory abilities among blind individuals, who are often able to use sound to navigate through space. It has now been established that many blind individuals produce sound emissions and use the returning echoes to provide them with information about objects in their surroundings, in a similar manner to bats navigating in the dark. In this review, we summarize current knowledge regarding human echolocation. Some blind individuals develop remarkable echolocation abilities, and are able to assess the position, size, distance, shape, and material of objects using reflected sound waves. After training, normally sighted people are also able to use echolocation to perceive objects, and can develop abilities comparable to, but typically somewhat poorer than, those of blind people. The underlying cues and mechanisms, operable range, spatial acuity and neurological underpinnings of echolocation are described. Echolocation can result in functional real life benefits. It is possible that these benefits can be optimized via suitable training, especially among those with recently acquired blindness, but this requires further study. Areas for further research are identified.

Evidence for enhanced discrimination of virtual auditory distance among blind listeners using level and direct-to-reverberant cues

Totally blind listeners often demonstrate better than normal capabilities when performing spatial hearing tasks. Accurate representation of three-dimensional auditory space requires the processing of available distance information between the listener and the sound source; however, auditory distance cues vary greatly depending upon the acoustic properties of the environment, and it is not known which distance cues are important to totally blind listeners. Our data show that totally blind listeners display better performance compared to sighted age-matched controls for distance discrimination tasks in anechoic and reverberant virtual rooms simulated using a room-image procedure. Totally blind listeners use two major auditory distance cues to stationary sound sources, level and direct-to-reverberant ratio, more effectively than sighted controls for many of the virtual distances tested. These results show that significant compensation among totally blind listeners for virtual auditory spatial distance leads to benefits across a range of simulated acoustic environments. No significant differences in performance were observed between listeners with partial non-correctable visual losses and sighted controls, suggesting that sensory compensation for virtual distance does not occur for listeners with partial vision loss.