Auditory midbrain and nerve responses to sinusoidal variations in interaural correlation

Cortical temporal integration can account for limits of temporal perception: investigations in the binaural system

The auditory system has exquisite temporal coding in the periphery which is transformed into a rate-based code in central auditory structures, like auditory cortex. However, the cortex is still able to synchronize, albeit at lower modulation rates, to acoustic fluctuations. The perceptual significance of this cortical synchronization is unknown. We estimated physiological synchronization limits of cortex (in humans with electroencephalography) and brainstem neurons (in chinchillas) to dynamic binaural cues using a novel system-identification technique, along with parallel perceptual measurements. We find that cortex can synchronize to dynamic binaural cues up to approximately 10 Hz, which aligns well with our measured limits of perceiving dynamic spatial information and utilizing dynamic binaural cues for spatial unmasking, i.e. measures of binaural sluggishness. We also find that the tracking limit for frequency modulation (FM) is similar to the limit for spatial tracking, demonstrating that this sluggish tracking is a more general perceptual limit that can be accounted for by cortical temporal integration limits.

A hemispheric two-channel code accounts for binaural unmasking in humans

Sound in noise is better detected or understood if target and masking sources originate from different locations. Mammalian physiology suggests that the neurocomputational process that underlies this binaural unmasking is based on two hemispheric channels that encode interaural differences in their relative neuronal activity. Here, we introduce a mathematical formulation of the two-channel model – the complex-valued correlation coefficient. We show that this formulation quantifies the amount of temporal fluctuations in interaural differences, which we suggest underlie binaural unmasking. We applied this model to an extensive library of psychoacoustic experiments, accounting for 98% of the variance across eight studies. Combining physiological plausibility with its success in explaining behavioral data, the proposed mechanism is a significant step towards a unified understanding of binaural unmasking and the encoding of interaural differences in general.

A new model for sound localization based on encoding temporal fluctuations within two hemispheric channels is capable of accounting for an extensive set of psychoacoustic experiments.

Sound Induced Vibrations Deform the Organ of Corti Complex in the Low-Frequency Apical Region of the Gerbil Cochlea for Normal Hearing : Sound Induced Vibrations Deform the Organ of Corti Complex

Human speech primarily contains low frequencies. It is well established that such frequencies maximally excite the cochlea near its apex. But, the micromechanics that precede and are involved in this transduction are not well understood. We measured vibrations from the low-frequency, second turn in intact gerbil cochleae using optical coherence tomography (OCT). The data were used to create spatial maps that detail the sound-evoked motions across the sensory organ of Corti complex (OCC). These maps were remarkably similar across animals and showed little variation with frequency or level. We identify four, anatomically distinct, response regions within the OCC: the basilar membrane (BM), the outer hair cells (OHC), the lateral compartment (lc), and the tectorial membrane (TM). Results provide evidence that active processes in the OHC play an important role in the mechanical interplay between different OCC structures which increases the amplitude and tuning sharpness of the traveling wave. The angle between the OCT beam and the OCC makes that we captured radial motions thought to be the effective stimulus to the mechano-sensitive hair bundles. We found that TM responses were relatively weak, arguing against a role in enhancing mechanical hair bundle deflection. Rather, BM responses were found to closely resemble the frequency selectivity and sensitivity found in auditory nerve fibers (ANF) that innervate the low-frequency cochlea.

Pitch of harmonic complex tones: rate and temporal coding of envelope repetition rate in inferior colliculus of unanesthetized rabbits

Harmonic complex tones (HCTs) found in speech, music, and animal vocalizations evoke strong pitch percepts at their fundamental frequencies. The strongest pitches are produced by HCTs that contain harmonics resolved by cochlear frequency analysis, but HCTs containing solely unresolved harmonics also evoke a weaker pitch at their envelope repetition rate (ERR). In the auditory periphery, neurons phase lock to the stimulus envelope, but this temporal representation of ERR degrades and gives way to rate codes along the ascending auditory pathway. To assess the role of the inferior colliculus (IC) in such transformations, we recorded IC neuron responses to HCT and sinusoidally modulated broadband noise (SAMN) with varying ERR from unanesthetized rabbits. Different interharmonic phase relationships of HCT were used to manipulate the temporal envelope without changing the power spectrum. Many IC neurons demonstrated band-pass rate tuning to ERR between 60 and 1,600 Hz for HCT and between 40 and 500 Hz for SAMN. The tuning was not related to the pure-tone best frequency of neurons but was dependent on the shape of the stimulus envelope, indicating a temporal rather than spectral origin. A phenomenological model suggests that the tuning may arise from peripheral temporal response patterns via synaptic inhibition. We also characterized temporal coding to ERR. Some IC neurons could phase lock to the stimulus envelope up to 900 Hz for either HCT or SAMN, but phase locking was weaker with SAMN. Together, the rate code and the temporal code represent a wide range of ERR, providing strong cues for the pitch of unresolved harmonics.NEW & NOTEWORTHY Envelope repetition rate (ERR) provides crucial cues for pitch perception of frequency components that are not individually resolved by the cochlea, but the neural representation of ERR for stimuli containing many harmonics is poorly characterized. Here we show that the pitch of stimuli with unresolved harmonics is represented by both a rate code and a temporal code for ERR in auditory midbrain neurons and propose possible underlying neural mechanisms with a computational model.

Neural coding and perception of auditory motion direction based on interaural time differences

While motion is important for parsing a complex auditory scene into perceptual objects, how it is encoded in the auditory system is unclear. Perceptual studies suggest that the ability to identify the direction of motion is limited by the duration of the moving sound, yet we can detect changes in interaural differences at even shorter durations. To understand the source of these distinct temporal limits, we recorded from single units in the inferior colliculus (IC) of unanesthetized rabbits in response to noise stimuli containing a brief segment with linearly time-varying interaural time difference ("ITD sweep") temporally embedded in interaurally uncorrelated noise. We also tested the ability of human listeners to either detect the ITD sweeps or identify the motion direction. Using a point-process model to separate the contributions of stimulus dependence and spiking history to single-neuron responses, we found that the neurons respond primarily by following the instantaneous ITD rather than exhibiting true direction selectivity. Furthermore, using an optimal classifier to decode the single-neuron responses, we found that neural threshold durations of ITD sweeps for both direction identification and detection overlapped with human threshold durations even though the average response of the neurons could track the instantaneous ITD beyond psychophysical limits. Our results suggest that the IC does not explicitly encode motion direction, but internal neural noise may limit the speed at which we can identify the direction of motion.NEW & NOTEWORTHY Recognizing motion and identifying an object's trajectory are important for parsing a complex auditory scene, but how we do so is unclear. We show that neurons in the auditory midbrain do not exhibit direction selectivity as found in the visual system but instead follow the trajectory of the motion in their temporal firing patterns. Our results suggest that the inherent variability in neural firings may limit our ability to identify motion direction at short durations.

Early Binaural Hearing: The Comparison of Temporal Differences at the Two Ears

Many mammals, including humans, are exquisitely sensitive to tiny time differences between sounds at the two ears. These interaural time differences are an important source of information for sound detection, for sound localization in space, and for environmental awareness. Two brainstem circuits are involved in the initial temporal comparisons between the ears, centered on the medial and lateral superior olive. Cells in these nuclei, as well as their afferents, display a large number of striking physiological and anatomical specializations to enable submillisecond sensitivity. As such, they provide an important model system to study temporal processing in the central nervous system. We review the progress that has been made in characterizing these primary binaural circuits as well as the variety of mechanisms that have been proposed to underlie their function.

Neural binaural sensitivity at high sound speeds: Single cell responses in cat midbrain to fast-changing interaural time differences of broadband sounds

Relative motion between the body and the outside world is a rich source of information. Neural selectivity to motion is well-established in several sensory systems, but is controversial in hearing. This study examines neural sensitivity to changes in the instantaneous interaural time difference of sounds at the two ears. Midbrain neurons track such changes up to extremely high speeds, show only a coarse dependence of firing rate on speed, and lack directional selectivity. These results argue against the presence of selectivity to auditory motion at the level of the midbrain, but reveal an acuity which enables coding of fast-fluctuating binaural cues in realistic sound environments.

Spectrotemporal window of binaural integration in auditory object formation

Binaural integration of interaural temporal information is essential for sound source localization and segregation. Current models of binaural interaction have shown that accurate sound localization in the horizontal plane depends on the resolution of phase ambiguous information by across-frequency integration. However, as such models are mostly static, it is not clear how proximate in time binaural events in different frequency channels should occur to form an auditory object with a unique lateral position. The present study examined the spectrotemporal window required for effective integration of binaural cues across frequency to form the perception of a stationary position. In Experiment 1, listeners judged whether dichotic frequency-modulated (FM) sweeps with a constant large nominal interaural delay (1500 μs), whose perceived laterality was ambiguous depending on the sweep rate (1500, 3000, 6000, and 12,000 Hz/s), produced a percept of continuous motion or a stationary image. Motion detection performance, indexed by d-prime (d') values, showed a clear effect of sweep rate, with auditory motion effects most pronounced for low sweep rates, and a punctate stationary image at high rates. Experiment 2 examined the effect of modulation rate (0.5, 3, 20, and 50 Hz) on lateralizing sinusoidally frequency-modulated (SFM) tones to confirm the effect of sweep rate on motion detection, independent of signal duration. Lateralization accuracy increased with increasing modulation rate up to 20 Hz and saturated at 50 Hz, with poorest performance occurring below 3 Hz depending on modulator phase. Using the transition point where percepts changed from motion to stationary images, we estimated a spectrotemporal integration window of approximately 150 ms per octave required for effective integration of interaural temporal cues across frequency channels. A Monte Carlo simulation based on a cross-correlation model of binaural interaction predicted 90% of the variance on perceptual motion detection performance as a function of FM sweep rate. Findings suggest that the rate of frequency channel convergence of binaural cues is essential to binaural lateralization.

Neural coding of time-varying interaural time differences and time-varying amplitude in the inferior colliculus

Binaural cues occurring in natural environments are frequently time varying, either from the motion of a sound source or through interactions between the cues produced by multiple sources. Yet, a broad understanding of how the auditory system processes dynamic binaural cues is still lacking. In the current study, we directly compared neural responses in the inferior colliculus (IC) of unanesthetized rabbits to broadband noise with time-varying interaural time differences (ITD) with responses to noise with sinusoidal amplitude modulation (SAM) over a wide range of modulation frequencies. On the basis of prior research, we hypothesized that the IC, one of the first stages to exhibit tuning of firing rate to modulation frequency, might use a common mechanism to encode time-varying information in general. Instead, we found weaker temporal coding for dynamic ITD compared with amplitude modulation and stronger effects of adaptation for amplitude modulation. The differences in temporal coding of dynamic ITD compared with SAM at the single-neuron level could be a neural correlate of "binaural sluggishness," the inability to perceive fluctuations in time-varying binaural cues at high modulation frequencies, for which a physiological explanation has so far remained elusive. At ITD-variation frequencies of 64 Hz and above, where a temporal code was less effective, noise with a dynamic ITD could still be distinguished from noise with a constant ITD through differences in average firing rate in many neurons, suggesting a frequency-dependent tradeoff between rate and temporal coding of time-varying binaural information.NEW & NOTEWORTHY Humans use time-varying binaural cues to parse auditory scenes comprising multiple sound sources and reverberation. However, the neural mechanisms for doing so are poorly understood. Our results demonstrate a potential neural correlate for the reduced detectability of fluctuations in time-varying binaural information at high speeds, as occurs in reverberation. The results also suggest that the neural mechanisms for processing time-varying binaural and monaural cues are largely distinct.

Electrophysiological and psychophysical asymmetries in sensitivity to interaural correlation gaps and implications for binaural integration time

Brief deviations of interaural correlation (IAC) can provide valuable cues for detection, segregation and localization of acoustic signals. This study investigated the processing of such "binaural gaps" in continuously running noise (100-2000 Hz), in comparison to silent "monaural gaps", by measuring late auditory evoked potentials (LAEPs) and perceptual thresholds with novel, iteratively optimized stimuli. Mean perceptual binaural gap duration thresholds exhibited a major asymmetry: they were substantially shorter for uncorrelated gaps in correlated and anticorrelated reference noise (1.75 ms and 4.1 ms) than for correlated and anticorrelated gaps in uncorrelated reference noise (26.5 ms and 39.0 ms). The thresholds also showed a minor asymmetry: they were shorter in the positive than in the negative IAC range. The mean behavioral threshold for monaural gaps was 5.5 ms. For all five gap types, the amplitude of LAEP components N1 and P2 increased linearly with the logarithm of gap duration. While perceptual and electrophysiological thresholds matched for monaural gaps, LAEP thresholds were about twice as long as perceptual thresholds for uncorrelated gaps, but half as long for correlated and anticorrelated gaps. Nevertheless, LAEP thresholds showed the same asymmetries as perceptual thresholds. For gap durations below 30 ms, LAEPs were dominated by the processing of the leading edge of a gap. For longer gap durations, in contrast, both the leading and the lagging edge of a gap contributed to the evoked response. Formulae for the equivalent rectangular duration (ERD) of the binaural system's temporal window were derived for three common window shapes. The psychophysical ERD was 68 ms for diotic and about 40 ms for anti- and uncorrelated noise. After a nonlinear Z-transform of the stimulus IAC prior to temporal integration, ERDs were about 10 ms for reference correlations of ±1 and 80 ms for uncorrelated reference. Hence, a physiologically motivated peripheral nonlinearity changed the rank order of ERDs across experimental conditions in a plausible manner.

Neural coding of sound envelope in reverberant environments

Speech reception depends critically on temporal modulations in the amplitude envelope of the speech signal. Reverberation encountered in everyday environments can substantially attenuate these modulations. To assess the effect of reverberation on the neural coding of amplitude envelope, we recorded from single units in the inferior colliculus (IC) of unanesthetized rabbit using sinusoidally amplitude modulated (AM) broadband noise stimuli presented in simulated anechoic and reverberant environments. Although reverberation degraded both rate and temporal coding of AM in IC neurons, in most neurons, the degradation in temporal coding was smaller than the AM attenuation in the stimulus. This compensation could largely be accounted for by the compressive shape of the modulation input-output function (MIOF), which describes the nonlinear transformation of modulation depth from acoustic stimuli into neural responses. Additionally, in a subset of neurons, the temporal coding of AM was better for reverberant stimuli than for anechoic stimuli having the same modulation depth at the ear. Using hybrid anechoic stimuli that selectively possess certain properties of reverberant sounds, we show that this reverberant advantage is not caused by envelope distortion, static interaural decorrelation, or spectral coloration. Overall, our results suggest that the auditory system may possess dual mechanisms that make the coding of amplitude envelope relatively robust in reverberation: one general mechanism operating for all stimuli with small modulation depths, and another mechanism dependent on very specific properties of reverberant stimuli, possibly the periodic fluctuations in interaural correlation at the modulation frequency.

Auditory spatial processing in Alzheimer's disease

The location and motion of sounds in space are important cues for encoding the auditory world. Spatial processing is a core component of auditory scene analysis, a cognitively demanding function that is vulnerable in Alzheimer's disease. Here we designed a novel neuropsychological battery based on a virtual space paradigm to assess auditory spatial processing in patient cohorts with clinically typical Alzheimer's disease (n = 20) and its major variant syndrome, posterior cortical atrophy (n = 12) in relation to healthy older controls (n = 26). We assessed three dimensions of auditory spatial function: externalized versus non-externalized sound discrimination, moving versus stationary sound discrimination and stationary auditory spatial position discrimination, together with non-spatial auditory and visual spatial control tasks. Neuroanatomical correlates of auditory spatial processing were assessed using voxel-based morphometry. Relative to healthy older controls, both patient groups exhibited impairments in detection of auditory motion, and stationary sound position discrimination. The posterior cortical atrophy group showed greater impairment for auditory motion processing and the processing of a non-spatial control complex auditory property (timbre) than the typical Alzheimer's disease group. Voxel-based morphometry in the patient cohort revealed grey matter correlates of auditory motion detection and spatial position discrimination in right inferior parietal cortex and precuneus, respectively. These findings delineate auditory spatial processing deficits in typical and posterior Alzheimer's disease phenotypes that are related to posterior cortical regions involved in both syndromic variants and modulated by the syndromic profile of brain degeneration. Auditory spatial deficits contribute to impaired spatial awareness in Alzheimer's disease and may constitute a novel perceptual model for probing brain network disintegration across the Alzheimer's disease syndromic spectrum.

The interaural time difference pathway: a comparison of spectral bandwidth and correlation sensitivity at three anatomical levels

Temporal differences between the two ears are critical for spatial hearing. They can be described along axes of interaural time difference (ITD) and interaural correlation, and their processing starts in the brainstem with the convergence of monaural pathways which are tuned in frequency and which carry temporal information. In previous studies, we examined the bandwidth (BW) of frequency tuning at two stages: the auditory nerve (AN) and inferior colliculus (IC), and showed that BW depends on characteristic frequency (CF) but that there is no difference in the mean BW of these two structures when measured in a binaural, temporal framework. This suggested that there is little frequency convergence in the ITD pathway between AN and IC and that frequency selectivity determined by the cochlear filter is preserved up to the IC. Unexpectedly, we found that AN and IC neurons can be similar in CF and BW, yet responses to changes in interaural correlation in the IC were different than expected from coincidence patterns ("pseudo-binaural" responses) in the AN. To better understand this, we here examine the responses of bushy cells, which provide monaural inputs to binaural neurons. Using broadband noise, we measured BW and correlation sensitivity in the cat trapezoid body (TB), which contains the axons of bushy cells. This allowed us to compare these two metrics at three stages in the ITD pathway. We found that BWs in the TB are similar to those in the AN and IC. However, TB neurons were found to be more sensitive to changes in stimulus correlation than AN or IC neurons. This is consistent with findings that show that TB fibers are more temporally precise than AN fibers, but is surprising because it suggests that the temporal information available monaurally is not fully exploited binaurally.

Amplitude-modulation detection by gerbils in reverberant sound fields

Reverberation can dramatically reduce the depth of amplitude modulations which are critical for speech intelligibility. Psychophysical experiments indicate that humans' sensitivity to amplitude modulation in reverberation is better than predicted from the acoustic modulation depth at the receiver position. Electrophysiological studies on reverberation in rabbits highlight the contribution of neurons sensitive to interaural correlation. Here, we use a prepulse-inhibition paradigm to quantify the gerbils' amplitude modulation threshold in both anechoic and reverberant virtual environments. Data show that prepulse inhibition provides a reliable method for determining the gerbils' AM sensitivity. However, we find no evidence for perceptual restoration of amplitude modulation in reverberation. Instead, the deterioration of AM sensitivity in reverberant conditions can be quantitatively explained by the reduced modulation depth at the receiver position. We suggest that the lack of perceptual restoration is related to physical properties of the gerbil's ear input signals and inner-ear processing as opposed to shortcomings of their binaural neural processing.

Neural encoding of sound source location in the presence of a concurrent, spatially separated source

In the presence of multiple, spatially separated sound sources, the binaural cues used for sound localization in the horizontal plane become distorted from the cues from each sound in isolation, yet localization in everyday multisource acoustic environments remains robust. We examined changes in the azimuth tuning functions of inferior colliculus (IC) neurons in unanesthetized rabbits to a target broadband noise when a concurrent broadband noise interferer was presented at different locations in virtual acoustic space. The presence of an interferer generally degraded sensitivity to target azimuth and distorted the shape of the tuning function, yet most neurons remained significantly sensitive to target azimuth and maintained tuning function shapes somewhat similar to those for the target alone. Using binaural cue manipulations in virtual acoustic space, we found that single-source tuning functions of neurons with high best frequencies (BFs) were primarily determined by interaural level differences (ILDs) or monaural level, with a small influence of interaural time differences (ITDs) in some neurons. However, with a centrally located interferer, the tuning functions of most high-BF neurons were strongly influenced by ITDs as well as ILDs. Model-based analysis showed that the shapes of these tuning functions were in part produced by decorrelation of the left and right cochlea-induced envelopes that occurs with source separation. The strong influence of ITD on the tuning functions of high-BF neurons poses a challenge to the "duplex theory" of sound localization and suggests that ITD may be important for localizing high-frequency sounds in multisource environments.

Information conveyed by inferior colliculus neurons about stimuli with aligned and misaligned sound localization cues

Previous studies have demonstrated that single neurons in the central nucleus of the inferior colliculus (ICC) are sensitive to multiple sound localization cues. We investigated the hypothesis that ICC neurons are specialized to encode multiple sound localization cues that are aligned in space (as would naturally occur from a single broadband sound source). Sound localization cues including interaural time differences (ITDs), interaural level differences (ILDs), and spectral shapes (SSs) were measured in a marmoset monkey. Virtual space methods were used to generate stimuli with aligned and misaligned combinations of cues while recording in the ICC of the same monkey. Mutual information (MI) between spike rates and stimuli for aligned versus misaligned cues were compared. Neurons with best frequencies (BFs) less than ∼11 kHz mostly encoded information about a single sound localization cue, ITD or ILD depending on frequency, consistent with the dominance of ear acoustics by either ITD or ILD at those frequencies. Most neurons with BFs >11 kHz encoded information about multiple sound localization cues, usually ILD and SS, and were sensitive to their alignment. In some neurons MI between stimuli and spike responses was greater for aligned cues, while in others it was greater for misaligned cues. If SS cues were shifted to lower frequencies in the virtual space stimuli, a similar result was found for neurons with BFs <11 kHz, showing that the cue interaction reflects the spectra of the stimuli and not a specialization for representing SS cues. In general the results show that ICC neurons are sensitive to multiple localization cues if they are simultaneously present in the frequency response area of the neuron. However, the representation is diffuse in that there is not a specialization in the ICC for encoding aligned sound localization cues.

Masked detection and discrimination of tone sequences under conditions of monaural and binaural masking release

Experiment 1 examined detection and discrimination of monaural four-tone sequences composed of 400-, 500-, and 625-Hz sinusoids. In the baseline conditions, the masker was monaural composed of 25-Hz-wide bands of random noise centered on 320, 400, 500, 625, and 781 Hz. In the binaural masking release conditions, the noise was presented diotically. In the monaural masking release conditions, the noise was presented to the same ear as the signal, but it was comodulated. Tones had half-amplitude durations of 30, 60, or 150 ms. There was no delay between successive tones, so the rate of frequency change depended on tone duration. Listeners discriminated between sequences composed of 500-400-625-500 Hz and 500-625-400-500 Hz. Discrimination results were poor for rapid sequences in both monaural and binaural masking release conditions relative to baseline conditions. Results from experiment 2 indicated that poor discrimination for rapid sequences could also occur in the baseline conditions, provided that the frequency separation among tonal components was small. Sluggish processing in the present paradigm was not restricted to conditions relying on binaural cues. It is argued that sluggishness may reflect a long temporal window in monaural and binaural masking release conditions or an interaction between poor cue quality and task difficulty.

The time course of binaural masking in the inferior colliculus of guinea pig does not account for binaural sluggishness

Psychophysical studies show a slower response to changes in the specifically binaural input than to changes in the monaural input (binaural sluggishness). However, there is disagreement about the time course. Tracking changes in a target yields fast time constants, while detecting a constant target against a varying background yields the slowest. Changes in the binaural properties of a target are tracked up to high rates by cells in the midbrain. Indeed cells respond rapidly to a step change and then the firing rate slowly adapts. These experiments, though, are analogues of psychophysical experiments that give the faster time constants. Sluggishness should be more apparent physiologically in a binaural masking paradigm, detecting a short tone in a noise masker with a step change in masker correlation: the small change in firing rate due to the signal must be detected against the adapting firing rate change caused by the step change in the masker. However, in 40 inferior colliculus cells in the anesthetized guinea pig, in a direct analogue of the psychophysical masking paradigm, measuring thresholds for short tones across a transition in a binaural masker (e.g., from N0S0 to NpiS0) provided little evidence of sluggishness within individual cells despite masking level differences in these cells comparable with previous data. Previous studies of physiological correlates of binaural masking level difference suggested that different psychophysical thresholds arise from different populations of cells. This suggests the hypothesis that sluggishness may result from a change in focus between the different populations of cells signaling threshold in different binaural configurations rather than within the intrinsic properties of the cells themselves.

Selective electrical stimulation of the auditory nerve activates a pathway specialized for high temporal acuity

Deaf people who use cochlear implants show surprisingly poor sensitivity to the temporal fine structure of sounds. One possible reason is that conventional cochlear implants cannot activate selectively the auditory-nerve fibers having low characteristic frequencies (CFs), which, in normal hearing, phase lock to stimulus fine structure. Recently, we tested in animals an alternative mode of auditory prosthesis using penetrating auditory-nerve electrodes that permit frequency-specific excitation in all frequency regions. We present here measures of temporal transmission through the auditory brainstem, from pulse trains presented with various auditory-nerve electrodes to phase-locked activity of neurons in the central nucleus of the inferior colliculus (ICC). On average, intraneural stimulation resulted in significant ICC phase locking at higher pulse rates (i.e., higher "limiting rates") than did cochlear-implant stimulation. That could be attributed, however, to the larger percentage of low-CF neurons activated selectively by intraneural stimulation. Most ICC neurons with limiting rates >500 pulses per second had CFs <1.5 kHz, whereas neurons with lower limiting rates tended to have higher CFs. High limiting rates also correlated strongly with short first-spike latencies. It follows that short latencies correlated significantly with low CFs, opposite to the correlation observed with acoustical stimulation. These electrical-stimulation results reveal a high-temporal-acuity brainstem pathway characterized by low CFs, short latencies, and high-fidelity transmission of periodic stimulation. Frequency-specific stimulation of that pathway by intraneural stimulation might improve temporal acuity in human users of a future auditory prosthesis, which in turn might improve musical pitch perception and speech reception in noise.

Selective filtering to spurious localization cues in the mammalian auditory brainstem

The cues used by mammals to localize sound can become corrupted when multiple sound sources are present due to the interference of sound waves. Under such circumstances these localization cues become spurious and often fluctuate rapidly (>100 Hz). By contrast, rapid fluctuations in sound pressure level do not indicate a corrupted signal, but rather may convey important information about the sound source. It is proposed that filtering in the auditory brainstem acts to selectively attenuate signals associated with the presence of rapidly fluctuating (spurious) localization cues, but not those associated with slowly varying cues. Further it is proposed that specific inhibitory circuitry in the auditory brainstem, centered on the dorsal nucleus of the lateral lemniscus (DNLL), contributes to this selective filtering. Data from extra-cellular recordings in anesthetized Mongolian gerbils are presented to support these hypotheses for a subpopulation of DNLL neurons. These results provide new insights into how the mammalian auditory system processes information about multiple sound sources.

Interaural correlation fails to account for detection in a classic binaural task: dynamic ITDs dominate N0Spi detection

Binaural signal detection in an NoSπ task relies on interaural disparities introduced by adding an antiphasic signal to diotic noise. What metric of interaural disparity best predicts performance? Some models use interaural correlation; others differentiate between dynamic interaural time differences (ITDs) and interaural level differences (ILDs) of the effective stimulus. To examine the relative contributions of ITDs and ILDs in binaural detection, we developed a novel signal processing technique that selectively degrades different aspects (potential cues) of binaural stimuli (e.g., only ITDs are scrambled). Degrading a particular cue will affect performance only if that cue is relevant to the binaural processing underlying detection. This selective scrambling technique was applied to the stimuli of a classic N0Sπ task in which the listener had to detect an antiphasic 500-Hz signal in the presence of a diotic wideband noise masker. Data obtained from five listeners showed that (1) selective scrambling of ILDs had little effect on binaural detection, (2) selective scrambling of ITDs significantly degraded detection, and (3) combined scrambling of ILDs and ITDs had the same effect as exclusive scrambling of ITDs. Regarding the question which stimulus properties determine detection, we conclude that for this binaural task (1) dynamic ITDs dominate detection performance, (2) ILDs are largely irrelevant, and (3) interaural correlation of the stimulus is a poor predictor of detection. Two simple stimulus-based models that each reproduce all binaural aspects of the data quite well are described: (1) a single-parameter detection model using ITD variance as detection criterion and (2) a compressive transformation followed by a crosscorrelation analysis. The success of both of these contrasting models shows that our data alone cannot reveal the mechanisms underlying the dominance of ITD cues. The physiological implications of our findings are discussed.

Processing temporal modulations in binaural and monaural auditory stimuli by neurons in the inferior colliculus and auditory cortex

Processing dynamic changes in the stimulus stream is a major task for sensory systems. In the auditory system, an increase in the temporal integration window between the inferior colliculus (IC) and auditory cortex is well known for monaural signals such as amplitude modulation, but a similar increase with binaural signals has not been demonstrated. To examine the limits of binaural temporal processing at these brain levels, we used the binaural beat stimulus, which causes a fluctuating interaural phase difference, while recording from neurons in the unanesthetized rabbit. We found that the cutoff frequency for neural synchronization to the binaural beat frequency (BBF) decreased between the IC and auditory cortex, and that this decrease was associated with an increase in the group delay. These features indicate that there is an increased temporal integration window in the cortex compared to the IC, complementing that seen with monaural signals. Comparable measurements of responses to amplitude modulation showed that the monaural and binaural temporal integration windows at the cortical level were quantitatively as well as qualitatively similar, suggesting that intrinsic membrane properties and afferent synapses to the cortical neurons govern the dynamic processing. The upper limits of synchronization to the BBF and the band-pass tuning characteristics of cortical neurons are a close match to human psychophysics.

Representation of dynamic interaural phase difference in auditory cortex of awake rhesus macaques

Neurons in auditory cortex of awake primates are selective for the spatial location of a sound source, yet the neural representation of the binaural cues that underlie this tuning remains undefined. We examined this representation in 283 single neurons across the low-frequency auditory core in alert macaques, trained to discriminate binaural cues for sound azimuth. In response to binaural beat stimuli, which mimic acoustic motion by modulating the relative phase of a tone at the two ears, these neurons robustly modulate their discharge rate in response to this directional cue. In accordance with prior studies, the preferred interaural phase difference (IPD) of these neurons typically corresponds to azimuthal locations contralateral to the recorded hemisphere. Whereas binaural beats evoke only transient discharges in anesthetized cortex, neurons in awake cortex respond throughout the IPD cycle. In this regard, responses are consistent with observations at earlier stations of the auditory pathway. Discharge rate is a band-pass function of the frequency of IPD modulation in most neurons (73%), but both discharge rate and temporal synchrony are independent of the direction of phase modulation. When subjected to a receiver operator characteristic analysis, the responses of individual neurons are insufficient to account for the perceptual acuity of these macaques in an IPD discrimination task, suggesting the need for neural pooling at the cortical level.

Interaural temporal and coherence cues jointly contribute to successful sound movement perception and activation of parietal cortex

The perception of movement in the auditory modality requires dynamic changes in the input that reaches the two ears (e.g. sequential changes of interaural time differences; dynamic ITDs). However, it is still unclear as to what extent these temporal cues interact with other interaural cues to determine successful movement perception, and which brain regions are involved in sound movement processing. Here, we presented trains of white-noise bursts containing either static or dynamic ITDs, and we varied parametrically the level of binaural coherence (BC) of both types of stimuli. Behaviorally, we found that movement discrimination sensitivity decreased with decreasing levels of BC. fMRI analyses highlighted a network of temporal, frontal and parietal regions where activity decreased with decreasing BC. Critically, in the intra-parietal sulcus and the supra-marginal gyrus brain activity decreased with decreasing BC, but only for dynamic-ITD sounds (BC by ITD interaction). Thus, these regions activated selectively when the sounds contained both dynamic ITDs and high levels of BC; i.e. when subjects perceived sound movement. We conclude that sound movement perception requires both dynamic changes of the auditory input and effective sound-source localization, and that parietal cortex utilizes interaural temporal and coherence cues for the successful perception of sound movement.

Binaural sluggishness precludes temporal pitch processing based on envelope cues in conditions of binaural unmasking

Binaural sluggishness refers to the binaural system's inability to follow fast changes in the interaural configuration of the incoming sound stream. Several studies have measured binaural sluggishness by measuring signal detection in conditions of binaural unmasking when the interaural configuration of the masker is changed over time. However, it has been shown that, in conditions of binaural unmasking, binaural sluggishness also affects the perception of temporal changes in the properties of the signal (i.e., its frequency or level) and not just in the interaural configuration of the masker. By measuring the temporal modulation transfer function for sinusoidally modulated noise presented in conditions of binaural unmasking, the first experiment of the current study showed that, due to binaural sluggishness, the internal representation of binaurally unmasked sounds conveys little or no information about envelope fluctuations with rates within the pitch range (i.e., above 30 Hz). The second experiment measured the masked detection threshold for musical interval recognition in binaurally unmasked harmonic tones and showed that, in conditions of binaural unmasking, pitch wanes when the harmonics become unresolved by the cochlear filters. These results suggest that binaural sluggishness precludes temporal pitch processing based on envelope cues in binaurally unmasked sounds.

How secure is in vivo synaptic transmission at the calyx of Held?

The medial nucleus of the trapezoid body (MNTB) receives excitatory input from giant presynaptic terminals, the calyces of Held. The MNTB functions as a sign inverter giving inhibitory input to the lateral and medial superior olive, where its input is important in the generation of binaural sensitivity to cues for sound localization. Extracellular recordings from MNTB neurons show complex spikes consisting of a prepotential, thought to reflect synaptic activation, followed by a postsynaptic action potential. This makes the synapse ideal to study synaptic transmission in vivo because presynaptic and postsynaptic activity can be monitored with a single electrode. Recent in vivo and in vitro studies have observed isolated prepotentials in the MNTB suggesting that, under certain stimulus conditions, synaptic transmission fails. We investigated synaptic transmission at the calyx of Held in the MNTB of the adult cat and concluded that synaptic transmission was completely secure in terms of rate of transmitted spikes. However, synaptic transmission was found to be less secure in terms of timing. With increasing spike rate, the synaptic delay showed an increase of up to 100 micros, as well as a decrease in amplitude of the action potential. This variability in delay is of a surprisingly high magnitude given the hypothesized role of these binaural circuits in sound localization and given the fact that this is one of the largest synapses in the mammalian brain.

Psychophysical and physiological evidence for fast binaural processing

The mammalian auditory system is the temporally most precise sensory modality: To localize low-frequency sounds in space, the binaural system can resolve time differences between the ears with microsecond precision. In contrast, the binaural system appears sluggish in tracking changing interaural time differences as they arise from a low-frequency sound source moving along the horizontal plane. For a combined psychophysical and electrophysiological approach, we created a binaural stimulus, called "Phasewarp," that can transmit rapid changes in interaural timing. Using this stimulus, the binaural performance in humans is significantly better than reported previously and comparable with the monaural performance revealed with amplitude-modulated stimuli. Parallel, electrophysiological recordings of binaural brainstem neurons in the gerbil show fast temporal processing of monaural and different types of binaural modulations. In a refined electrophysiological approach that was matched to the psychophysics, the seemingly faster binaural processing of the Phasewarp was confirmed. The current data provide both psychophysical and physiological evidence against a general, hard-wired binaural sluggishness and reconcile previous contradictions of electrophysiological and psychophysical estimates of temporal binaural performance.

Coding of temporally fluctuating interaural timing disparities in a binaural processing model based on phase differences

A model of the effective processing of interaural timing disparities in the human auditory system is presented which provides modifications and extensions to existing models motivated by recent physiological findings. In particular, an established model of excitatory-inhibitory (EI) neuronal connectivity is complemented by a model that is based on a rate code derived from the interaural phase difference (IPD). The IPD model is shown to successfully simulate literature data on fine structure and envelope-based binaural detection and lateralization experiments. In order to investigate the processing of temporal fluctuations of interaural timing disparities, detection thresholds of broadband binaural-beat stimuli were measured in six normal-hearing listeners and were compared with model simulations. In a first experiment, the highest detectable beat frequency was found to be 96 Hz for a noise bandwidth of 550 Hz and 219 Hz for a bandwidth of 1100 Hz. Both models predicted lower thresholds, but performed increasingly better when the integration time constants of the binaural processors were reduced. In a second experiment, the signal-to-noise ratio at the detection threshold of binaural-beat stimuli mixed with interaurally uncorrelated noise was measured as a function of the beat frequency. The threshold increased about 1.7 dB per octave which was simulated similarly by both models. The results indicate that the primary temporal resolution of the binaural system for detecting interaural timing disparities is much higher than the temporal resolution found in higher auditory processes as supposedly involved in, e.g., masking.

Comparison of bandwidths in the inferior colliculus and the auditory nerve. I. Measurement using a spectrally manipulated stimulus

A defining feature of auditory systems across animal divisions is the ability to sort different frequency components of a sound into separate neural frequency channels. Narrowband filtering in the auditory periphery is of obvious advantage for the representation of sound spectrum and manifests itself pervasively in human psychophysical studies as the critical band. Peripheral filtering also alters coding of the temporal waveform, so that temporal responses in the auditory periphery reflect both the stimulus waveform and peripheral filtering. Temporal coding is essential for the measurement of the time delay between waveforms at the two ears-a critical component of sound localization. A number of human psychophysical studies have shown a wider effective critical bandwidth with binaural stimuli than with monaural stimuli, although other studies found no difference. Here we directly compare binaural and monaural bandwidths (BWs) in the anesthetized cat. We measure monaural BW in the auditory nerve (AN) and binaural BW in the inferior colliculus (IC) using spectrally manipulated broadband noise and response metrics that reflect spike timing. The stimulus was a pair of noise tokens that were interaurally in phase for all frequencies below a certain flip frequency (f(flip)) and that had an interaural phase difference of pi above f(flip). The response was measured as a function of f(flip) and, using a separate stimulus protocol, as a function of interaural correlation. We find that both AN and IC filter BW depend on characteristic frequency, but that there is no difference in mean BW between the AN and IC.

Neural and behavioral sensitivity to interaural time differences using amplitude modulated tones with mismatched carrier frequencies

Bilateral cochlear implantation is intended to provide the advantages of binaural hearing, including sound localization and better speech recognition in noise. In most modern implants, temporal information is carried by the envelope of pulsatile stimulation, and thresholds to interaural time differences (ITDs) are generally high compared to those obtained in normal hearing observers. One factor thought to influence ITD sensitivity is the overlap of neural populations stimulated on each side. The present study investigated the effects of acoustically stimulating bilaterally mismatched neural populations in two related paradigms: rabbit neural recordings and human psychophysical testing. The neural coding of interaural envelope timing information was measured in recordings from neurons in the inferior colliculus of the unanesthetized rabbit. Binaural beat stimuli with a 1-Hz difference in modulation frequency were presented at the best modulation frequency and intensity as the carrier frequencies at each ear were varied. Some neurons encoded envelope ITDs with carrier frequency mismatches as great as several octaves. The synchronization strength was typically nonmonotonically related to intensity. Psychophysical data showed that human listeners could also make use of binaural envelope cues for carrier mismatches of up to 2-3 octaves. Thus, the physiological and psychophysical data were broadly consistent, and suggest that bilateral cochlear implants should provide information sufficient to detect envelope ITDs even in the face of bilateral mismatch in the neural populations responding to stimulation. However, the strongly nonmonotonic synchronization to envelope ITDs suggests that the limited dynamic range with electrical stimulation may be an important consideration for ITD encoding.

A sound element gets lost in perceptual competition

Our ability to understand auditory signals depends on properly separating the mixture of sound arriving from multiple sources. Sound elements tend to belong to only one object at a time, consistent with the principle of disjoint allocation, although there are instances of duplex perception or coallocation, in which two sound objects share one sound element. Here we report an effect of "nonallocation," in which a sound element "disappears" when two ongoing objects compete for its ownership. When a target tone is presented either as one of a sequence of tones or simultaneously with a harmonic vowel complex, it is heard as part of the corresponding object. However, depending on the spatial configuration of the scene, if the target, the tones, and the vowel are all presented together, the target may not be perceived in either the tones or the vowel, even though it is not perceived as a separate entity. This finding suggests an asymmetry in the strength of the perceptual evidence required to reject vs. to include an element within the auditory foreground, a result with important implications for how we process complex auditory scenes containing ambiguous information.

A matter of time: internal delays in binaural processing

As an animal navigates its surroundings, the sounds reaching its two ears change in waveform similarity (interaural correlation) and in time of arrival (interaural time difference, ITD). Humans are exquisitely sensitive to these binaural cues, and it is generally agreed that this sensitivity involves coincidence detectors and internal delays that compensate for external acoustic delays (ITDs). Recent data show an unexpected relationship between the tuning of a neuron to frequency and to ITD, leading to several proposals for sources of internal delay and the neural coding of interaural temporal cues. We review the alternatives, and argue that an understanding of binaural mechanisms requires consideration of sensitivity not only to ITDs, but also to interaural correlation.

Detection of interaural correlation by neurons in the superior olivary complex, inferior colliculus and auditory cortex of the unanesthetized rabbit

A critical binaural cue important for sound localization and detection of signals in noise is the interaural time difference (ITD), or difference in the time of arrival of sounds at each ear. The ITD can be determined by cross-correlating the sounds at the two ears and finding the ITD where the correlation is maximal. The amount of interaural correlation is affected by properties of spaces and can therefore be used to assess spatial attributes. To examine the neural basis for sensitivity to the overall level of the interaural correlation, we identified subcollicular neurons and neurons in the inferior colliculus (IC) and auditory cortex of unanesthetized rabbits that were sensitive to ITDs and examined their responses as the interaural correlation was varied. Neurons at each brain level could show linear or non-linear responses to changes in interaural correlation. The direction of the non-linearities in most neurons was to increase the slope of the response change for correlations near 1.0. The proportion of neurons with non-linear responses was similar in subcollicular and IC neurons but increased in the auditory cortex. Non-linear response functions to interaural correlation were not related to the type of response as determined by the tuning to ITDs across frequencies. The responses to interaural correlation were also not related to the frequency tuning of the neuron, unlike the responses to ITD, which broadens for neurons tuned to lower frequencies. The neural discriminibility of the ITD using frozen noise in the best neurons was similar to the behavioral acuity in humans at a reference correlation of 1.0. However, for other reference ITDs the neural discriminibility was more linear and generally better than the human discriminibility of the interaural correlation, suggesting that stimulus rather than neural variability is the basis for the decline in human performance at lower levels of interaural correlation.

Human auditory steady-state responses to changes in interaural correlation

Steady-state responses were evoked by noise stimuli that alternated between two levels of interaural correlation rho at a frequency fm. With rho alternating between +1 and 0, responses at fm dropped steeply above 4 Hz, but persisted up to 64 Hz. Two time constants of 47 and 4.4 ms with delays of 198 and 36 ms, respectively, were obtained by fitting responses to a transfer function based on symmetric exponential windows. The longer time constant, possibly reflecting cortical integration, is consistent with perceptual binaural "sluggishness". The shorter time constant may reflect running cross-correlation in the high brainstem or primary auditory cortex. Responses at 2fm peaked with an amplitude of 848+/-479 nV (fm=4 Hz). Investigation of this robust response revealed that: (1) changes in rho and lateralization evoked similar responses, suggesting a common neural origin, (2) response was most dependent on stimulus frequencies below 1000 Hz, but frequencies up to 4000 Hz also contributed, and (3) when rho alternated between [0.2-1] and 0, response amplitude varied linearly with rho, and the physiological response threshold was close to the average behavioral threshold (rho=0.31). This steady-state response may prove useful in the objective investigation of binaural hearing.