Alterations in audiovisual simultaneity perception in amblyopia

Head and Eye Movements Reveal Compensatory Strategies for Acute Binaural Deficits During Sound Localization

The present study aimed to define use of head and eye movements during sound localization in children and adults to: (1) assess effects of stationary versus moving sound and (2) define effects of binaural cues degraded through acute monaural ear plugging. Thirty-three youth (MAge = 12.9 years) and seventeen adults (MAge = 24.6 years) with typical hearing were recruited and asked to localize white noise anywhere within a horizontal arc from -60° (left) to +60° (right) azimuth in two conditions (typical binaural and right ear plugged). In each trial, sound was presented at an initial stationary position (L1) and then while moving at ∼4°/s until reaching a second position (L2). Sound moved in five conditions (±40°, ±20°, or 0°). Participants adjusted a laser pointer to indicate L1 and L2 positions. Unrestricted head and eye movements were collected with gyroscopic sensors on the head and eye-tracking glasses, respectively. Results confirmed that accurate sound localization of both stationary and moving sound is disrupted by acute monaural ear plugging. Eye movements preceded head movements for sound localization in normal binaural listening and head movements were larger than eye movements during monaural plugging. Head movements favored the unplugged left ear when stationary sounds were presented in the right hemifield and during sound motion in both hemifields regardless of the movement direction. Disrupted binaural cues have greater effects on localization of moving than stationary sound. Head movements reveal preferential use of the better-hearing ear and relatively stable eye positions likely reflect normal vestibular-ocular reflexes.

Crossmodal plasticity following short-term monocular deprivation

A brief period of monocular deprivation (MD) induces short-term plasticity of the adult visual system. Whether MD elicits neural changes beyond visual processing is yet unclear. Here, we assessed the specific impact of MD on neural correlates of multisensory processes. Neural oscillations associated with visual and audio-visual processing were measured for both the deprived and the non-deprived eye. Results revealed that MD changed neural activities associated with visual and multisensory processes in an eye-specific manner. Selectively for the deprived eye, alpha synchronization was reduced within the first 150 ms of visual processing. Conversely, gamma activity was enhanced in response to audio-visual events only for the non-deprived eye within 100-300 ms after stimulus onset. The analysis of gamma responses to unisensory auditory events revealed that MD elicited a crossmodal upweight for the non-deprived eye. Distributed source modeling suggested that the right parietal cortex played a major role in neural effects induced by MD. Finally, visual and audio-visual processing alterations emerged for the induced component of the neural oscillations, indicating a prominent role of feedback connectivity. Results reveal the causal impact of MD on both unisensory (visual and auditory) and multisensory (audio-visual) processes and, their frequency-specific profiles. These findings support a model in which MD increases excitability to visual events for the deprived eye and audio-visual and auditory input for the non-deprived eye.

Detection and Recognition of Asynchronous Auditory/Visual Speech: Effects of Age, Hearing Loss, and Talker Accent

This investigation examined age-related differences in auditory-visual (AV) integration as reflected on perceptual judgments of temporally misaligned AV English sentences spoken by native English and native Spanish talkers. In the detection task, it was expected that slowed auditory temporal processing of older participants, relative to younger participants, would be manifest as a shift in the range over which participants would judge asynchronous stimuli as synchronous (referred to as the "AV simultaneity window"). The older participants were also expected to exhibit greater declines in speech recognition for asynchronous AV stimuli than younger participants. Talker accent was hypothesized to influence listener performance, with older listeners exhibiting a greater narrowing of the AV simultaneity window and much poorer recognition of asynchronous AV foreign-accented speech compared to younger listeners. Participant groups included younger and older participants with normal hearing and older participants with hearing loss. Stimuli were video recordings of sentences produced by native English and native Spanish talkers. The video recordings were altered in 50 ms steps by delaying either the audio or video onset. Participants performed a detection task in which they judged whether the sentences were synchronous or asynchronous, and performed a recognition task for multiple synchronous and asynchronous conditions. Both the detection and recognition tasks were conducted at the individualized signal-to-noise ratio (SNR) corresponding to approximately 70% correct speech recognition performance for synchronous AV sentences. Older listeners with and without hearing loss generally showed wider AV simultaneity windows than younger listeners, possibly reflecting slowed auditory temporal processing in auditory lead conditions and reduced sensitivity to asynchrony in auditory lag conditions. However, older and younger listeners were affected similarly by misalignment of auditory and visual signal onsets on the speech recognition task. This suggests that older listeners are negatively impacted by temporal misalignments for speech recognition, even when they do not notice that the stimuli are asynchronous. Overall, the findings show that when listener performance is equated for simultaneous AV speech signals, age effects are apparent in detection judgments but not in recognition of asynchronous speech.

Binocular Enhancement of Multisensory Temporal Perception

Purpose

The goal of this study was to examine the behavioral effects and to suggest possible underlying mechanisms of binocularity on audiovisual temporal perception in normally-sighted individuals.

Methods

Participants performed two audiovisual simultaneity judgment tasks-one using simple flashes and beeps and the other using audiovisual speech stimuli-with the left eye, right eye, and both eyes. Two measures, the point of subjective simultaneity (PSS) and the temporal binding window (TBW), an index for audiovisual temporal acuity, were derived for each viewing condition, stimulus type, and participant. The data were then modeled using causal inference, allowing us to determine whether binocularity affected low-level unisensory mechanisms (i.e., sensory noise level) or high-level multisensory mechanisms (i.e., prior probability of interring a common cause, pC=1).

Results

Whereas for the PSS there was no significant effect of viewing condition, for the TBW, a significant interaction between stimulus type and viewing condition was found. Post hoc analyses revealed a significantly narrower TBW during binocular than monocular viewing (average of left and right eyes) for the flash-beep condition but no difference between the viewing conditions for the speech stimuli. Modeling results showed no significant difference in pC=1 but a significant reduction in sensory noise during binocular performance on flash-beep trials.

Conclusions

Binocular viewing was found to enhance audiovisual temporal acuity as indexed by the TBW for simple low-level audiovisual stimuli. Furthermore, modeling results suggest that this effect may stem from enhanced sensory representations evidenced as a reduction in sensory noise affecting the measurement of physical asynchrony during audiovisual temporal perception.

Brief period of monocular deprivation drives changes in audiovisual temporal perception

The human brain retains a striking degree of plasticity into adulthood. Recent studies have demonstrated that a short period of altered visual experience (via monocular deprivation) can change the dynamics of binocular rivalry in favor of the deprived eye, a compensatory action thought to be mediated by an upregulation of cortical gain control mechanisms. Here, we sought to better understand the impact of monocular deprivation on multisensory abilities, specifically examining audiovisual temporal perception. Using an audiovisual simultaneity judgment task, we discovered that 90 minutes of monocular deprivation produced opposing effects on the temporal binding window depending on the eye used in the task. Thus, in those who performed the task with their deprived eye there was a narrowing of the temporal binding window, whereas in those performing the task with their nondeprived eye there was a widening of the temporal binding window. The effect was short lived, being observed only in the first 10 minutes of postdeprivation testing. These findings indicate that changes in visual experience in the adult can rapidly impact multisensory perceptual processes, a finding that has important clinical implications for those patients with adult-onset visual deprivation and for therapies founded on monocular deprivation.

Audiovisual temporal integration: Cognitive processing, neural mechanisms, developmental trajectory and potential interventions

To integrate auditory and visual signals into a unified percept, the paired stimuli must co-occur within a limited time window known as the Temporal Binding Window (TBW). The width of the TBW, a proxy of audiovisual temporal integration ability, has been found to be correlated with higher-order cognitive and social functions. A comprehensive review of studies investigating audiovisual TBW reveals several findings: (1) a wide range of top-down processes and bottom-up features can modulate the width of the TBW, facilitating adaptation to the changing and multisensory external environment; (2) a large-scale brain network works in coordination to ensure successful detection of audiovisual (a)synchrony; (3) developmentally, audiovisual TBW follows a U-shaped pattern across the lifespan, with a protracted developmental course into late adolescence and rebounding in size again in late life; (4) an enlarged TBW is characteristic of a number of neurodevelopmental disorders; and (5) the TBW is highly flexible via perceptual and musical training. Interventions targeting the TBW may be able to improve multisensory function and ameliorate social communicative symptoms in clinical populations.

Alteration in binocular fusion modifies audiovisual integration in children

Background: In the field of multisensory integration, vision is generally thought to dominate audiovisual interactions, at least in spatial tasks, but the role of binocular fusion in audiovisual integration has not yet been studied.

Methods: Using the Maddox test, a classical ophthalmological test used to subjectively detect a latent unilateral eye deviation, we checked whether an alteration in binocular vision in young patients would be able to change audiovisual integration. The study was performed on a group of ten children (five males and five females aged 11.3±1.6 years) with normal binocular vision, and revealed a visual phenomenon consisting of stochastic disappearanceof part of a visual scene caused by auditory stimulation.

Results: Indeed, during the Maddox test, brief sounds induced transient visual scotomas (VSs) in the visual field of the eye in front of where the Maddox rod was placed. We found a significant correlation between the modification of binocular vision and VS occurrence. No significant difference was detected in the percentage or location of VS occurrence between the right and left eye using the Maddox rod test orbetween sound frequencies.

Conclusion: The results indicate a specific role of the oculomotor system in audiovisual integration in children. This convenient protocol may also have significant interest for clinical investigations of developmental pathologies where relationships between vision and hearing are specifically affected.

Impaired Spatial Hearing in Amblyopia: Evidence for Calibration of Auditory Maps by Retinocollicular Input in Humans

Purpose

Evidence from animals and blind humans suggests that early visual experience influences the developmental calibration of auditory localization. Hypothesizing that unilateral amblyopia may involve cross-modal deficits in spatial hearing, we measured the precision and accuracy of sound localization in humans with amblyopia.

Methods

All participants passed a standard hearing test. Experiment 1 measured sound localization precision for click stimuli in 10 adults with amblyopia and 10 controls using a minimum audible angle (MAA) task. Experiment 2 measured sound localization error (i.e., accuracy) for click train stimuli in 14 adults with amblyopia and 16 controls using an absolute sound localization task.

Results

In Experiment 1, the MAA (mean ± SEM) was significantly greater in the amblyopia group compared with controls (2.75 ± 0.30° vs. 1.69 ± 0.09°, P = 0.006). In Experiment 2, the overall sound localization error was significantly greater in the amblyopia group compared with controls (P = 0.047). The amblyopia group also showed significantly greater sound localization error in the auditory hemispace ipsilateral to the amblyopic eye (P = 0.036). At a location within this auditory hemispace, the magnitude of sound localization error correlated significantly with deficits in stereo acuity (P = 0.036).

Conclusions

The precision and accuracy of sound localization are impaired in unilateral amblyopia. The asymmetric pattern of sound localization error suggests that amblyopic vision may interfere with the development of spatial hearing via the retinocollicular pathway.

The prevalence of amblyopia in Iran: A systematic review

PURPOSE

The aim of this study was to determine the prevalence of amblyopia in the population of Iran.

METHODS

This article is a systematic review. A comprehensive search was conducted in PubMed, Scopus, Science Direct, Ovid, Web of Science, SID, Magiran, with appropriate terms. Information related to the sample size and the prevalence of amblyopia was extracted and summarized in tables. Analysis was performed using STATA software.

RESULTS

From 551 articles that were originally extracted from the databases, 31 articles met the criteria for entering the review. These studies were conducted in different regions of Iran. The prevalence of amblyopia in different regions varied between 0.19 and 3.69%. Study results were heterogeneous (I2 = 99.7%), and therefore, a meta-analysis was not done.

CONCLUSIONS

The prevalence of amblyopia in Iran is very different. In addition to conducting national screenings, it is necessary to report the incidence of amblyopia and its related factors in different parts of the country.