A novel concept for dynamic adjustment of auditory space

Review of Binaural Processing With Asymmetrical Hearing Outcomes in Patients With Bilateral Cochlear Implants

Bilateral cochlear implants (BiCIs) result in several benefits, including improvements in speech understanding in noise and sound source localization. However, the benefit bilateral implants provide among recipients varies considerably across individuals. Here we consider one of the reasons for this variability: difference in hearing function between the two ears, that is, interaural asymmetry. Thus far, investigations of interaural asymmetry have been highly specialized within various research areas. The goal of this review is to integrate these studies in one place, motivating future research in the area of interaural asymmetry. We first consider bottom-up processing, where binaural cues are represented using excitation-inhibition of signals from the left ear and right ear, varying with the location of the sound in space, and represented by the lateral superior olive in the auditory brainstem. We then consider top-down processing via predictive coding, which assumes that perception stems from expectations based on context and prior sensory experience, represented by cascading series of cortical circuits. An internal, perceptual model is maintained and updated in light of incoming sensory input. Together, we hope that this amalgamation of physiological, behavioral, and modeling studies will help bridge gaps in the field of binaural hearing and promote a clearer understanding of the implications of interaural asymmetry for future research on optimal patient interventions.

The role of GABAB receptors in the subcortical pathways of the mammalian auditory system

GABAB receptors are G-protein coupled receptors for the inhibitory neurotransmitter GABA. Functional GABAB receptors are formed as heteromers of GABAB1 and GABAB2 subunits, which further associate with various regulatory and signaling proteins to provide receptor complexes with distinct pharmacological and physiological properties. GABAB receptors are widely distributed in nervous tissue, where they are involved in a number of processes and in turn are subject to a number of regulatory mechanisms. In this review, we summarize current knowledge of the cellular distribution and function of the receptors in the inner ear and auditory pathway of the mammalian brainstem and midbrain. The findings suggest that in these regions, GABAB receptors are involved in processes essential for proper auditory function, such as cochlear amplifier modulation, regulation of spontaneous activity, binaural and temporal information processing, and predictive coding. Since impaired GABAergic inhibition has been found to be associated with various forms of hearing loss, GABAB dysfunction could also play a role in some pathologies of the auditory system.

Adaptation in auditory processing

Adaptation is an essential feature of auditory neurons, which reduces their responses to unchanging and recurring sounds and allows their response properties to be matched to the constantly changing statistics of sounds that reach the ears. As a consequence, processing in the auditory system highlights novel or unpredictable sounds and produces an efficient representation of the vast range of sounds that animals can perceive by continually adjusting the sensitivity and, to a lesser extent, the tuning properties of neurons to the most commonly encountered stimulus values. Together with attentional modulation, adaptation to sound statistics also helps to generate neural representations of sound that are tolerant to background noise and therefore plays a vital role in auditory scene analysis. In this review, we consider the diverse forms of adaptation that are found in the auditory system in terms of the processing levels at which they arise, the underlying neural mechanisms, and their impact on neural coding and perception. We also ask what the dynamics of adaptation, which can occur over multiple timescales, reveal about the statistical properties of the environment. Finally, we examine how adaptation to sound statistics is influenced by learning and experience and changes as a result of aging and hearing loss.

Contextual Lateralization Based on Interaural Level Differences Is Preshaped by the Auditory Periphery and Predominantly Immune Against Sequential Segregation

The perceived azimuth of a target sound is determined by the interaural time difference and the interaural level difference (ILD) and is subject to contextual effects from precursor sounds. This study characterized ILD-based precursor effects (PEs) for high-frequency stimuli in a total of seven normal-hearing listeners. In Experiment 1, precursor and target were band-pass-filtered noises approximately centered at 4 kHz (1.2- and 1-octave bandwidth, respectively) separated by a 10-ms gap. The effects of precursor location (ipsilateral, contralateral, and central) on the perceived target azimuth were measured using a head-pointing task. Relative to control trials without a precursor, ipsilateral precursors biased the perceived target azimuth toward midline (medial bias) and contralateral precursors biased it contralaterally (lateral bias). Central precursors caused a symmetric lateral bias. An auditory periphery model that determines the "internal" ILD at the auditory nerve level, including either realistic efferent compression control or auditory nerve adaptation, explained about 50% of the variance in the PEs. These within-trial PEs were accompanied by an across-trial PE, inducing medial bias. Experiment 2 studied the role of sequential segregation in the within-trial PE by introducing a pitch difference between precursor and target. Segregation conditions caused increased PE for ipsilateral, no effect for contralateral, and either no effect or reduced PE for central precursors. Overall, the ILD-based within-trial PE appears to be preshaped already in the auditory periphery and the mechanism underlying at least the ipsilateral PE appears to be immune against sequential segregation.

Hearing in Complex Environments: Auditory Gain Control, Attention, and Hearing Loss

Listening in noisy or complex sound environments is difficult for individuals with normal hearing and can be a debilitating impairment for those with hearing loss. Extracting meaningful information from a complex acoustic environment requires the ability to accurately encode specific sound features under highly variable listening conditions and segregate distinct sound streams from multiple overlapping sources. The auditory system employs a variety of mechanisms to achieve this auditory scene analysis. First, neurons across levels of the auditory system exhibit compensatory adaptations to their gain and dynamic range in response to prevailing sound stimulus statistics in the environment. These adaptations allow for robust representations of sound features that are to a large degree invariant to the level of background noise. Second, listeners can selectively attend to a desired sound target in an environment with multiple sound sources. This selective auditory attention is another form of sensory gain control, enhancing the representation of an attended sound source while suppressing responses to unattended sounds. This review will examine both “bottom-up” gain alterations in response to changes in environmental sound statistics as well as “top-down” mechanisms that allow for selective extraction of specific sound features in a complex auditory scene. Finally, we will discuss how hearing loss interacts with these gain control mechanisms, and the adaptive and/or maladaptive perceptual consequences of this plasticity.

Strongly directional responses to tones and conspecific calls in the auditory nerve of the Tokay gecko, Gekko gecko

The configuration of lizard ears, where sound can reach both surfaces of the eardrums, produces a strongly directional ear, but the subsequent processing of sound direction by the auditory pathway is unknown. We report here on directional responses from the first stage, the auditory nerve. We used laser vibrometry to measure eardrum responses in Tokay geckos and in the same animals recorded 117 auditory nerve single fiber responses to free-field sound from radially distributed speakers. Responses from all fibers showed strongly lateralized activity at all frequencies, with an ovoidal directivity that resembled the eardrum directivity. Geckos are vocal and showed pronounced nerve fiber directionality to components of the call. To estimate the accuracy with which a gecko could discriminate between sound sources, we computed the Fisher information (FI) for each neuron. FI was highest just contralateral to the midline, front and back. Thus, the auditory nerve could provide a population code for sound source direction, and geckos should have a high capacity to differentiate between midline sound sources. In brain, binaural comparisons, for example, by IE (ipsilateral excitatory, contralateral inhibitory) neurons, should sharpen the lateralized responses and extend the dynamic range of directionality.NEW & NOTEWORTHY In mammals, the two ears are unconnected pressure receivers, and sound direction is computed from binaural interactions in the brain, but in lizards, the eardrums interact acoustically, producing a strongly directional response. We show strongly lateralized responses from gecko auditory nerve fibers to directional sound stimulation and high Fisher information on either side of the midline. Thus, already the auditory nerve provides a population code for sound source direction in the gecko.

Binaural spatial adaptation as a mechanism for asymmetric trading of interaural time and level differences

A classic paradigm used to quantify the perceptual weighting of binaural spatial cues requires a listener to adjust the value of one cue, while the complementary cue is held constant. Adjustments are made until the auditory percept appears centered in the head, and the values of both cues are recorded as a trading relation (TR), most commonly in μs interaural time difference per dB interaural level difference. Interestingly, existing literature has shown that TRs differ according to the cue being adjusted. The current study investigated whether cue-specific adaptation, which might arise due to the continuous, alternating presentation of signals during adjustment tasks, could account for this poorly understood phenomenon. Three experiments measured TRs via adjustment and via lateralization of single targets in virtual reality (VR). Targets were 500 Hz pure tones preceded by silence or by adapting trains that held one of the cues constant. VR removed visual anchors and provided an intuitive response technique during lateralization. The pattern of results suggests that adaptation can account for cue-dependent TRs. In addition, VR seems to be a viable tool for psychophysical tasks.

Computational principles of neural adaptation for binaural signal integration

Adaptation to statistics of sensory inputs is an essential ability of neural systems and extends their effective operational range. Having a broad operational range facilitates to react to sensory inputs of different granularities, thus is a crucial factor for survival. The computation of auditory cues for spatial localization of sound sources, particularly the interaural level difference (ILD), has long been considered as a static process. Novel findings suggest that this process of ipsi- and contra-lateral signal integration is highly adaptive and depends strongly on recent stimulus statistics. Here, adaptation aids the encoding of auditory perceptual space of various granularities. To investigate the mechanism of auditory adaptation in binaural signal integration in detail, we developed a neural model architecture for simulating functions of lateral superior olive (LSO) and medial nucleus of the trapezoid body (MNTB) composed of single compartment conductance-based neurons. Neurons in the MNTB serve as an intermediate relay population. Their signal is integrated by the LSO population on a circuit level to represent excitatory and inhibitory interactions of input signals. The circuit incorporates an adaptation mechanism operating at the synaptic level based on local inhibitory feedback signals. The model’s predictive power is demonstrated in various simulations replicating physiological data. Incorporating the innovative adaptation mechanism facilitates a shift in neural responses towards the most effective stimulus range based on recent stimulus history. The model demonstrates that a single LSO neuron quickly adapts to these stimulus statistics and, thus, can encode an extended range of ILDs in the ipsilateral hemisphere. Most significantly, we provide a unique measurement of the adaptation efficacy of LSO neurons. Prerequisite of normal function is an accurate interaction of inhibitory and excitatory signals, a precise encoding of time and a well-tuned local feedback circuit. We suggest that the mechanisms of temporal competitive-cooperative interaction and the local feedback mechanism jointly sensitize the circuit to enable a response shift towards contra-lateral and ipsi-lateral stimuli, respectively.

Why are we more precise in localizing a sound after hearing it several times? Adaptation to the statistics of a stimulus plays a crucial role in this. The present article investigates the abilities of a neural adaptation mechanism for improved localization skills based on a neural network model. Adaptation to stimulus statistics is very prominent in sensory systems of animals and allows them to respond to a wide range of stimuli, thus is a crucial factor for survival. For example, humans are able to navigate under suddenly changing illumination conditions (driving a car into and out of a tunnel). This is possible by courtesy of adaptation abilities of our sensory organs and pathways. Certainly, adaptation is not confined to a single sense like vision but also affects other senses like audition. Especially the perception of sound source location. Compared to vision, the localization of a sound source in the horizontal plane is a rather complicated task since the location cannot be read out from the receptor surface but needs to be computed. This requires the underlying neural system to calculate differences of the intensity between the two ears which provide a distinct cue for the location of a sound source. Here, adaptation to this cue allows to focus on a specific part of auditory space and thereby facilitates improved localisation abilities. Based on recent findings that suggest that the intensity difference computation is a flexible process with distinct adaptation mechanisms, we developed a neural model that computes the intensity difference to two incoming sound signals. The model comprises a novel mechanism for adaptation to sound source locations and provides a means to investigate underlying neural principles of adaptation and compare their effectivenesses. We demonstrate that due this mechanism the perceptual range is extended and a finer resolution of auditory space is obtained. Results explain the neural basis for adaptation and indicate that the interplay between different adaptation mechanisms facilitate highly precise sound source localization in a wide range of locations.

Synthesis of Hemispheric ITD Tuning from the Readout of a Neural Map: Commonalities of Proposed Coding Schemes in Birds and Mammals

A major cue to infer sound direction is the difference in arrival time of the sound at the left and right ears, called interaural time difference (ITD). The neural coding of ITD and its similarity across species have been strongly debated. In the barn owl, an auditory specialist relying on sound localization to capture prey, ITDs within the physiological range determined by the head width are topographically represented at each frequency. The topographic representation suggests that sound direction may be inferred from the location of maximal neural activity within the map. Such topographical representation of ITD, however, is not evident in mammals. Instead, the preferred ITD of neurons in the mammalian brainstem often lies outside the physiological range and depends on the neuron's best frequency. Because of these disparities, it has been assumed that how spatial hearing is achieved in birds and mammals is fundamentally different. However, recent studies reveal ITD responses in the owl's forebrain and midbrain premotor area that are consistent with coding schemes proposed in mammals. Particularly, sound location in owls could be decoded from the relative firing rates of two broadly and inversely ITD-tuned channels. This evidence suggests that, at downstream stages, the code for ITD may not be qualitatively different across species. Thus, while experimental evidence continues to support the notion of differences in ITD representation across species and brain regions, the latest results indicate notable commonalities, suggesting that codes driving orienting behavior in mammals and birds may be comparable.

Cooperative population coding facilitates efficient sound-source separability by adaptation to input statistics

Our sensory environment changes constantly. Accordingly, neural systems continually adapt to the concurrent stimulus statistics to remain sensitive over a wide range of conditions. Such dynamic range adaptation (DRA) is assumed to increase both the effectiveness of the neuronal code and perceptual sensitivity. However, direct demonstrations of DRA-based efficient neuronal processing that also produces perceptual benefits are lacking. Here, we investigated the impact of DRA on spatial coding in the rodent brain and the perception of human listeners. Complex spatial stimulation with dynamically changing source locations elicited prominent DRA already on the initial spatial processing stage, the Lateral Superior Olive (LSO) of gerbils. Surprisingly, on the level of individual neurons, DRA diminished spatial tuning because of large response variability across trials. However, when considering single-trial population averages of multiple neurons, DRA enhanced the coding efficiency specifically for the concurrently most probable source locations. Intrinsic LSO population imaging of energy consumption combined with pharmacology revealed that a slow-acting LSO gain-control mechanism distributes activity across a group of neurons during DRA, thereby enhancing population coding efficiency. Strikingly, such “efficient cooperative coding” also improved neuronal source separability specifically for the locations that were most likely to occur. These location-specific enhancements in neuronal coding were paralleled by human listeners exhibiting a selective improvement in spatial resolution. We conclude that, contrary to canonical models of sensory encoding, the primary motive of early spatial processing is efficiency optimization of neural populations for enhanced source separability in the concurrent environment.

The efficient coding hypothesis suggests that sensory processing adapts to the stimulus statistics to maximize information while minimizing energetic costs. This study finds that an auditory spatial processing circuit distributes activity across neurons to enhance processing efficiency, focally improving spatial resolution both in neurons and in human listeners.

Computational models of auditory perception from feature extraction to stream segregation and behavior

Audition is by nature dynamic, from brainstem processing on sub-millisecond time scales, to segregating and tracking sound sources with changing features, to the pleasure of listening to music and the satisfaction of getting the beat. We review recent advances from computational models of sound localization, of auditory stream segregation and of beat perception/generation. A wealth of behavioral, electrophysiological and imaging studies shed light on these processes, typically with synthesized sounds having regular temporal structure. Computational models integrate knowledge from different experimental fields and at different levels of description. We advocate a neuromechanistic modeling approach that incorporates knowledge of the auditory system from various fields, that utilizes plausible neural mechanisms, and that bridges our understanding across disciplines.

Neural Maps of Interaural Time Difference in the American Alligator: A Stable Feature in Modern Archosaurs

Detection of interaural time differences (ITDs) is crucial for sound localization in most vertebrates. The current view is that optimal computational strategies of ITD detection depend mainly on head size and available frequencies, although evolutionary history should also be taken into consideration. In archosaurs, which include birds and crocodiles, the brainstem nucleus laminaris (NL) developed into the critical structure for ITD detection. In birds, ITDs are mapped in an orderly array or place code, whereas in the mammalian medial superior olive, the analog of NL, maps are not found. As yet, in crocodilians, topographical representations have not been identified. However, nontopographic representations of ITD cannot be excluded due to different anatomical and ethological features of birds and crocodiles. Therefore, we measured ITD-dependent responses in the NL of anesthetized American alligators of either sex and identified the location of the recording sites by lesions made after recording. The measured extracellular field potentials, or neurophonics, were strongly ITD tuned, and their preferred ITDs correlated with the position in NL. As in birds, delay lines, which compensate for external time differences, formed maps of ITD. The broad distributions of best ITDs within narrow frequency bands were not consistent with an optimal coding model. We conclude that the available acoustic cues and the architecture of the acoustic system in early archosaurs led to a stable and similar organization in today's birds and crocodiles, although physical features, such as internally coupled ears, head size, or shape, and audible frequency range, vary among the two groups.SIGNIFICANCE STATEMENT Interaural time difference (ITD) is an important cue for sound localization, and the optimal strategies for encoding ITD in neuronal populations are the subject of ongoing debate. We show that alligators form maps of ITD very similar to birds, suggesting that their common archosaur ancestor reached a stable coding solution different from mammals. Mammals and diapsids evolved tympanic hearing independently, and local optima can be reached in evolution that are not considered by global optimal coding models. Thus, the presence of ITD maps in the brainstem may reflect a local optimum in evolutionary development. Our results underline the importance of comparative animal studies and show that optimal models must be viewed in the light of evolutionary processes.

A Temporal Filter for Binaural Hearing Is Dynamically Adjusted by Sound Pressure Level

In natural environments our auditory system is exposed to multiple and diverse signals of fluctuating amplitudes. Therefore, to detect, localize, and single out individual sounds the auditory system has to process and filter spectral and temporal information from both ears. It is known that the overall sound pressure level affects sensory signal transduction and therefore the temporal response pattern of auditory neurons. We hypothesize that the mammalian binaural system utilizes a dynamic mechanism to adjust the temporal filters in neuronal circuits to different overall sound pressure levels. Previous studies proposed an inhibitory mechanism generated by the reciprocally coupled dorsal nuclei of the lateral lemniscus (DNLL) as a temporal neuronal-network filter that suppresses rapid binaural fluctuations. Here we investigated the consequence of different sound levels on this filter during binaural processing. Our in vivo and in vitro electrophysiology in Mongolian gerbils shows that the integration of ascending excitation and contralateral inhibition defines the temporal properties of this inhibitory filter. The time course of this filter depends on the synaptic drive, which is modulated by the overall sound pressure level and N-methyl-D-aspartate receptor (NMDAR) signaling. In psychophysical experiments we tested the temporal perception of humans and show that detection and localization of two subsequent tones changes with the sound pressure level consistent with our physiological results. Together our data support the hypothesis that mammals dynamically adjust their time window for sound detection and localization within the binaural system in a sound level dependent manner.