A midline azimuthal channel in human spatial hearing

Binaural interaction in human auditory brainstem and middle-latency responses affected by sound frequency band, lateralization predictability, and attended modality

The binaural interaction component (BIC) of the auditory evoked potential is the difference between the waveforms of the binaural response and the sum of left and right monaural responses. This investigation examined BICs of the auditory brainstem (ABR) and middle-latency (MLR) responses concerning three objectives: 1) the level of the auditory system at which low-frequency dominance in BIC amplitudes begins when the binaural temporal fine structure is more influential with lower- than higher-frequency content; 2) how BICs vary as a function of frequency and lateralization predictability, as could relate to the improved lateralization of high-frequency sounds; 3) how attention affects BICs. Sixteen right-handed participants were presented with either low-passed (< 1000 Hz) or high-passed (> 2000 Hz) clicks at 30 dB SL with a 38 dB (A) masking noise, at a stimulus onset asynchrony of 180 ms. Further, this repeated-measures design manipulated stimulus presentation (binaural, left monaural, right monaural), lateralization predictability (unpredictable, predictable), and attended modality (either auditory or visual). For the objectives, respectively, the results were: 1) whereas low-frequency dominance in BIC amplitudes began during, and continued after, the Na-BIC, binaural (center) as well as summed monaural (left and right) amplitudes revealed low-frequency dominance only after the Na wave; 2) with a predictable position that was fixed, no BIC exhibited equivalent amplitudes between low- and high-passed clicks; 3) whether clicks were low- or high-passed, selective attention affected the ABR-BIC yet not MLR-BICs. These findings indicate that low-frequency dominance in lateralization begins at the Na latency, being independent of the efferent cortico-collicular pathway's influence.

Left frontal eye field encodes sound locations during passive listening

Previous studies reported that auditory cortices (AC) were mostly activated by sounds coming from the contralateral hemifield. As a result, sound locations could be encoded by integrating opposite activations from both sides of AC ("opponent hemifield coding"). However, human auditory "where" pathway also includes a series of parietal and prefrontal regions. It was unknown how sound locations were represented in those high-level regions during passive listening. Here, we investigated the neural representation of sound locations in high-level regions by voxel-level tuning analysis, regions-of-interest-level (ROI-level) laterality analysis, and ROI-level multivariate pattern analysis. Functional magnetic resonance imaging data were collected while participants listened passively to sounds from various horizontal locations. We found that opponent hemifield coding of sound locations not only existed in AC, but also spanned over intraparietal sulcus, superior parietal lobule, and frontal eye field (FEF). Furthermore, multivariate pattern representation of sound locations in both hemifields could be observed in left AC, right AC, and left FEF. Overall, our results demonstrate that left FEF, a high-level region along the auditory "where" pathway, encodes sound locations during passive listening in two ways: a univariate opponent hemifield activation representation and a multivariate full-field activation pattern representation.

Contextual Lateralization Based on Interaural Level Differences Is Preshaped by the Auditory Periphery and Predominantly Immune Against Sequential Segregation

The perceived azimuth of a target sound is determined by the interaural time difference and the interaural level difference (ILD) and is subject to contextual effects from precursor sounds. This study characterized ILD-based precursor effects (PEs) for high-frequency stimuli in a total of seven normal-hearing listeners. In Experiment 1, precursor and target were band-pass-filtered noises approximately centered at 4 kHz (1.2- and 1-octave bandwidth, respectively) separated by a 10-ms gap. The effects of precursor location (ipsilateral, contralateral, and central) on the perceived target azimuth were measured using a head-pointing task. Relative to control trials without a precursor, ipsilateral precursors biased the perceived target azimuth toward midline (medial bias) and contralateral precursors biased it contralaterally (lateral bias). Central precursors caused a symmetric lateral bias. An auditory periphery model that determines the "internal" ILD at the auditory nerve level, including either realistic efferent compression control or auditory nerve adaptation, explained about 50% of the variance in the PEs. These within-trial PEs were accompanied by an across-trial PE, inducing medial bias. Experiment 2 studied the role of sequential segregation in the within-trial PE by introducing a pitch difference between precursor and target. Segregation conditions caused increased PE for ipsilateral, no effect for contralateral, and either no effect or reduced PE for central precursors. Overall, the ILD-based within-trial PE appears to be preshaped already in the auditory periphery and the mechanism underlying at least the ipsilateral PE appears to be immune against sequential segregation.

A Search for a Cortical Map of Auditory Space

This is the story of a search for a cortical map of auditory space. The search began with a study that was reported in the first issue of The Journal of Neuroscience (Middlebrooks and Pettigrew, 1981). That paper described some unexpected features of spatial sensitivity in the auditory cortex while failing to demonstrate the expected map. In the ensuing 40 years, we have encountered the following: panoramic spatial coding by single neurons; a rich variety of response patterns that are unmasked in the absence of general anesthesia; sharpening of spatial sensitivity when an animal is engaged in a listening task; and reorganization of spatial sensitivity in the presence of competing sounds. We have not encountered a map, but not through lack of trying. On the basis of years of negative results by our group and others, and positive results that are inconsistent with static point-to-point topography, we are confident in concluding that there just ain't no map. Instead, we have come to appreciate the highly dynamic spatial properties of cortical neurons, which serve the needs of listeners in a changing sonic environment.

Synthesis of Hemispheric ITD Tuning from the Readout of a Neural Map: Commonalities of Proposed Coding Schemes in Birds and Mammals

A major cue to infer sound direction is the difference in arrival time of the sound at the left and right ears, called interaural time difference (ITD). The neural coding of ITD and its similarity across species have been strongly debated. In the barn owl, an auditory specialist relying on sound localization to capture prey, ITDs within the physiological range determined by the head width are topographically represented at each frequency. The topographic representation suggests that sound direction may be inferred from the location of maximal neural activity within the map. Such topographical representation of ITD, however, is not evident in mammals. Instead, the preferred ITD of neurons in the mammalian brainstem often lies outside the physiological range and depends on the neuron's best frequency. Because of these disparities, it has been assumed that how spatial hearing is achieved in birds and mammals is fundamentally different. However, recent studies reveal ITD responses in the owl's forebrain and midbrain premotor area that are consistent with coding schemes proposed in mammals. Particularly, sound location in owls could be decoded from the relative firing rates of two broadly and inversely ITD-tuned channels. This evidence suggests that, at downstream stages, the code for ITD may not be qualitatively different across species. Thus, while experimental evidence continues to support the notion of differences in ITD representation across species and brain regions, the latest results indicate notable commonalities, suggesting that codes driving orienting behavior in mammals and birds may be comparable.

A novel concept for dynamic adjustment of auditory space

Traditionally, the auditory system is thought to serve reliable sound localization. Stimulus-history driven feedback circuits in the early binaural pathway, however, contradict this canonical concept and raise questions about their functional significance. Here we show that stimulus-history dependent changes in absolute space perception are poorly captured by the traditional labeled-line and hemispheric-difference models of auditory space coding. We therefore developed a new decoding model incorporating recent electrophysiological findings in which sound location is initially computed in both brain hemispheres independently and combined to yield a hemispherically balanced code. This model closely captures the observed absolute localization errors caused by stimulus history, and furthermore predicts a selective dilation and compression of perceptional space. These model predictions are confirmed by improvement and degradation of spatial resolution in human listeners. Thus, dynamic perception of auditory space facilitates focal sound source segregation at the expense of absolute sound localization, questioning existing concepts of spatial hearing.

Numerical value biases sound localization

Speech recognition starts with representations of basic acoustic perceptual features and ends by categorizing the sound based on long-term memory for word meaning. However, little is known about whether the reverse pattern of lexical influences on basic perception can occur. We tested for a lexical influence on auditory spatial perception by having subjects make spatial judgments of number stimuli. Four experiments used pointing or left/right 2-alternative forced choice tasks to examine perceptual judgments of sound location as a function of digit magnitude (1–9). The main finding was that for stimuli presented near the median plane there was a linear left-to-right bias for localizing smaller-to-larger numbers. At lateral locations there was a central-eccentric location bias in the pointing task, and either a bias restricted to the smaller numbers (left side) or no significant number bias (right side). Prior number location also biased subsequent number judgments towards the opposite side. Findings support a lexical influence on auditory spatial perception, with a linear mapping near midline and more complex relations at lateral locations. Results may reflect coding of dedicated spatial channels, with two representing lateral positions in each hemispace, and the midline area represented by either their overlap or a separate third channel.

Six Degrees of Auditory Spatial Separation

The location of a sound is derived computationally from acoustical cues rather than being inherent in the topography of the input signal, as in vision. Since Lord Rayleigh, the descriptions of that representation have swung between "labeled line" and "opponent process" models. Employing a simple variant of a two-point separation judgment using concurrent speech sounds, we found that spatial discrimination thresholds changed nonmonotonically as a function of the overall separation. Rather than increasing with separation, spatial discrimination thresholds first declined as two-point separation increased before reaching a turning point and increasing thereafter with further separation. This "dipper" function, with a minimum at 6 ° of separation, was seen for regions around the midline as well as for more lateral regions (30 and 45 °). The discrimination thresholds for the binaural localization cues were linear over the same range, so these cannot explain the shape of these functions. These data and a simple computational model indicate that the perception of auditory space involves a local code or multichannel mapping emerging subsequent to the binaural cue coding.

Functional segregation of monaural and binaural selectivity in the pallid bat auditory cortex

Different fields of the auditory cortex can be distinguished by the extent and level tolerance of spatial selectivity. The mechanisms underlying the range of spatial tuning properties observed across cortical fields are unclear. Here, this issue was addressed in the pallid bat because its auditory cortex contains two segregated regions of response selectivity that serve two different behaviors: echolocation for obstacle avoidance and localization of prey-generated noise. This provides the unique opportunity to examine mechanisms of spatial properties in two functionally distinct regions. Previous studies have shown that spatial selectivity of neurons in the region selective for noise (noise-selective region, NSR) is level tolerant and shaped by interaural level difference (ILD) selectivity. In contrast, spatial selectivity of neurons in the echolocation region ('FM sweep-selective region' or FMSR) is strongly level dependent with many neurons responding to multiple distinct spatial locations for louder sounds. To determine the mechanisms underlying such level dependence, frequency, azimuth, rate-level responses and ILD selectivity were measured from the same FMSR neurons. The majority (∼75%) of FMSR neurons were monaural (ILD insensitive). Azimuth tuning curves expanded or split into multiple peaks with increasing sound level in a manner that was predicted by the rate-level response of neurons. These data suggest that azimuth selectivity of FMSR neurons depends more on monaural ear directionality and rate-level responses. The pallid bat cortex utilizes segregated monaural and binaural regions to process echoes and prey-generated noise. Together the pallid bat FMSR/NSR data provide mechanistic explanations for a broad range of spatial tuning properties seen across species.

Physiological Evidence for a Midline Spatial Channel in Human Auditory Cortex

Studies with humans and other mammals have provided support for a two-channel representation of horizontal (“azimuthal”) space in the auditory system. In this representation, location-sensitive neurons contribute activity to one of two broadly tuned channels whose responses are compared to derive an estimate of sound-source location. One channel is maximally responsive to sounds towards the left and the other to sounds towards the right. However, recent psychophysical studies of humans, and physiological studies of other mammals, point to the presence of an additional channel, maximally responsive to the midline. In this study, we used electroencephalography to seek physiological evidence for such a midline channel in humans. We measured neural responses to probe stimuli presented from straight ahead (0 °) or towards the right (+30 ° or +90 °). Probes were preceded by adapter stimuli to temporarily suppress channel activity. Adapters came from 0 ° or alternated between left and right (−30 ° and +30 ° or −90 ° and +90 °). For the +90 ° probe, to which the right-tuned channel would respond most strongly, both accounts predict greatest adaptation when the adapters are at ±90 °. For the 0 ° probe, the two-channel account predicts greatest adaptation from the ±90 ° adapters, while the three-channel account predicts greatest adaptation when the adapters are at 0 ° because these adapters stimulate the midline-tuned channel which responds most strongly to the 0 ° probe. The results were consistent with the three-channel account. In addition, a computational implementation of the three-channel account fitted the probe response sizes well, explaining 93 % of the variance about the mean, whereas a two-channel implementation produced a poor fit and explained only 61 % of the variance.

Relative sound localisation abilities in human listeners

Spatial acuity varies with sound-source azimuth, signal-to-noise ratio, and the spectral characteristics of the sound source. Here, the spatial localisation abilities of listeners were assessed using a relative localisation task. This task tested localisation ability at fixed angular separations throughout space using a two-alternative forced-choice design across a variety of listening conditions. Subjects were required to determine whether a target sound originated to the left or right of a preceding reference in the presence of a multi-source noise background. Experiment 1 demonstrated that subjects' ability to determine the relative location of two sources declined with less favourable signal-to-noise ratios and at peripheral locations. Experiment 2 assessed performance with both broadband and spectrally restricted stimuli designed to limit localisation cues to predominantly interaural level differences or interaural timing differences (ITDs). Predictions generated from topographic, modified topographic, and two-channel models of sound localisation suggest that for low-pass stimuli, where ITD cues were dominant, the two-channel model provides an adequate description of the experimental data, whereas for broadband and high frequency bandpass stimuli none of the models was able to fully account for performance. Experiment 3 demonstrated that relative localisation performance was uninfluenced by shifts in gaze direction.

The three-channel model of sound localization mechanisms: interaural time differences

Previous psychophysical work on sound localization in humans has proposed that a midline channel be added to the current two-channel model of mammalian sound localization mechanisms. Evidence for this third channel has been found in interaural time difference (ITD) studies with low-frequency tones, and interaural level difference (ILD) studies with both high- and low-frequency tones. The latter is interesting because it suggests that, despite the fact that low frequencies do not generate significant ILDs for humans in natural settings, there is a constancy of ILD coding mechanisms across the frequency domain. To complement this finding, the present study sought to determine whether the three-channel model holds for ITDs at high frequencies. In three experiments, a selective adaptation paradigm was used in combination with transposed tones to probe for the existence of three (left, right, and midline) perceptual channels for sound source azimuth. The experiments provided evidence for lateral hemifield ITD channels but little evidence for a midline ITD channel at high frequencies.

Specialization for sound localization in fields A1, DZ, and PAF of cat auditory cortex

Cortical deactivation studies in cats have implicated the primary auditory cortex (A1), the dorsal zone (DZ), and the posterior auditory field (PAF) in sound localization behavior, and physiological studies in anesthetized conditions have demonstrated clear differences in spatial sensitivity among those areas. We trained cats to perform two listening tasks and then we recorded from cortical neurons in off-task and in both on-task conditions during single recording sessions. The results confirmed some of the results from anesthetized conditions and revealed unexpected differences. Neurons in each field showed a variety of firing patterns, including onset-only, complex onset and long latency, and suppression or offset. A substantial minority of units showed sharpening of spatial sensitivity, particularly that of onset responses, during task performance: 44 %, 35 %, and 31 % of units in areas A1, DZ, and PAF, respectively, showed significant spatial sharpening. Field DZ was distinguished by a larger percentage of neurons responding best to near-midline locations, whereas the spatial preferences of PAF neurons were distributed more uniformly throughout the contralateral hemifield. Those directional biases also were evident in measures of the accuracy with which neural spike patterns could signal sound locations. Field DZ provided the greatest accuracy for midline locations. The location dependence of accuracy in PAF was orthogonal to that of DZ, with the greatest accuracy for lateral locations. The results suggest a view of spatial representation in the auditory cortex in which DZ exhibits an overrepresentation of the frontal areas around the midline, whereas PAF provides a more uniform representation of contralateral space, including areas behind the head. Spatial preferences of area A1 neurons were intermediate between those of DZ and PAF, sharpening as needed for localization tasks.

Mechanisms underlying azimuth selectivity in the auditory cortex of the pallid bat

This study focused on mechanisms underlying azimuth selectivity in the primary auditory cortex (A1) of pallid bats. The pallid bat listens to prey-generated noise (5-35 kHz) to localize and hunt terrestrial prey. The region of A1 tuned between 5 and 35 kHz consists of two clusters of neurons distinguished by interaural intensity difference (IID) selectivity: binaurally inhibited (EI) and peaked. The first aim of this study was to use sequential dichotic/free-field stimulation to test the hypothesis that IID is the primary cue underlying azimuth selectivity in neurons tuned in the prey-generated noise frequency band. IID selectivity and ear directionality at the neuron's characteristic frequency (CF) were used to predict azimuth selectivity functions. The predicted azimuth selectivity was compared with the actual azimuth selectivity from the same neurons. Prediction accuracy was similarly high for EI neurons and peaked neurons with low CF, whereas predictions were increasingly inaccurate with increasing CF among the peaked neurons. The second aim of this study was to compare azimuth selectivity obtained with noise and CF tones to determine the extent to which stimulus bandwidth influences azimuth selectivity in neurons with different binaural properties. The azimuth selectivity functions were similar for the two stimuli in the majority of EI neurons. A greater percentage of peaked neurons showed differences in their azimuth selectivity for noise and tones. This included neurons with multiple peaks when tested with tones and a single peak when tested with noise. Taken together, data from the two aims suggest that azimuth tuning of EI neurons is primarily dictated by IID sensitivity at CF. Peaked neurons, particularly those with high CF, may integrate IID sensitivity across frequency to generate azimuth selectivity for broadband sound. The data are consistent with those found in cat and ferret A1 in that binaurally facilitated neurons depend to a greater extent (compared to EI neurons) on spectral integration of binaural properties to generate azimuth selectivity for broadband stimuli.

The three-channel model of sound localization mechanisms: interaural level differences

The current understanding of mammalian sound localization is that azimuthal (horizontal) position assignments are dependent upon the relative activation of two populations of broadly-tuned hemifield neurons with overlapping medial borders. Recent psychophysical work has provided evidence for a third channel of low-frequency interaural time difference (ITD)-sensitive neurons tuned to the azimuthal midline. However, the neurophysiological data on free-field azimuth receptive fields, especially of cortical neurons, has primarily studied high-frequency cells whose receptive fields are more likely to have been shaped by interaural level differences (ILDs) than ITDs. In four experiments, a selective adaptation paradigm was used to probe for the existence of a midline channel in the domain of ILDs. If no midline channel exists, symmetrical adaptation of the lateral channels should not result in a shift in the perceived intracranial location of subsequent test tones away from the adaptors because the relative activation of the two channels will remain unchanged. Instead, results indicate a shift in perceived test tone location away from the adaptors, which supports the existence of a midline channel in the domain of ILDs. Interestingly, this shift occurs not only at high frequencies, traditionally associated with ILDs in natural settings, but at low frequencies as well.

Systematic representation of sound locations in the primary auditory cortex

The primary auditory cortex (A1) is involved in sound localization. A consistent observation in A1 is a clustered representation of binaural properties, but how spatial tuning varies within binaural clusters is unknown. Here, this issue was addressed in A1 of the pallid bat, a species that relies on passive hearing (as opposed to echolocation) to localize prey. Evidence is presented for systematic representations of sound azimuth within two binaural clusters in the pallid bat A1: the binaural inhibition (EI) and peaked (P) binaural interaction clusters. The representation is not a "point-to-point" space map as seen in the superior colliculus, but is in the form of a systematic increase in the area of activated cortex as azimuth changes from ipsilateral to contralateral locations. The underlying substrate in the EI cluster is a systematic representation of the medial boundary of azimuth receptive fields. The P cluster is activated mostly for sounds near the midline, providing a spatial acoustic fovea. Activity in the P cluster falls off systematically as the sound is moved to more lateral locations. Sensitivity to interaural intensity differences predicts azimuth tuning in the vast majority of neurons. Azimuth receptive field properties are relatively stable across intensity over a moderate range (20-40 dB above threshold) of intensities. This suggests that the maps will be similar across the intensities tested. These results challenge the current view that no systematic representation of azimuth is present in A1 and show that such representations are present locally within individual binaural clusters.

Stability of central binaural sound localization mechanisms in mammals, and the Heffner hypothesis

Heffner (2004) provided an overview of data on the evolutionary pressures on sound localization acuity in mammals. Her most important finding was that sound localization acuity was most strongly correlated with width of field of best vision. This correlation leaves unexplained the mechanism through which evolutionary pressures affect localization acuity in different mammals. A review of the neurophysiology of binaural sound localization cue coding, and the behavioural performance it supports, led us to two hypotheses. First, there is little or no evidence that the neural mechanisms for coding binaural sound location cues, or the dynamic range of the code, vary across mammals. Rather, the neural coding mechanism is remarkably constant both across species, and within species across frequency. Second, there is no need to postulate that evolutionary pressures are exerted on the cue coding mechanism itself. We hypothesize instead that the evolutionary pressure may be on the organism's ability to exploit a 'lower envelope principle' (after Barlow, 1972).