Auditory distance perception in rooms

The role of reverberation-related binaural cues in the externalization of speech

The perception of externalization of speech sounds was investigated with respect to the monaural and binaural cues available at the listeners' ears in a reverberant environment. Individualized binaural room impulse responses (BRIRs) were used to simulate externalized sound sources via headphones. The measured BRIRs were subsequently modified such that the proportion of the response containing binaural vs monaural information was varied. Normal-hearing listeners were presented with speech sounds convolved with such modified BRIRs. Monaural reverberation cues were found to be sufficient for the externalization of a lateral sound source. In contrast, for a frontal source, an increased amount of binaural cues from reflections was required in order to obtain well externalized sound images. It was demonstrated that the interaction between the interaural cues of the direct sound and the reverberation strongly affects the perception of externalization. An analysis of the short-term binaural cues showed that the amount of fluctuations of the binaural cues corresponded well to the externalization ratings obtained in the listening tests. The results further suggested that the precedence effect is involved in the auditory processing of the dynamic binaural cues that are utilized for externalization perception.

An Auditory Illusion of Proximity of the Source Induced by Sonic Crystals

In this work we report an illusion of proximity of a sound source created by a sonic crystal placed between the source and a listener. This effect seems, at first, paradoxical to naïve listeners since the sonic crystal is an obstacle formed by almost densely packed cylindrical scatterers. Even when the singular acoustical properties of these periodic composite materials have been studied extensively (including band gaps, deaf bands, negative refraction, and birrefringence), the possible perceptual effects remain unexplored. The illusion reported here is studied through acoustical measurements and a psychophysical experiment. The results of the acoustical measurements showed that, for a certain frequency range and region in space where the focusing phenomenon takes place, the sonic crystal induces substantial increases in binaural intensity, direct-to-reverberant energy ratio and interaural cross-correlation values, all cues involved in the auditory perception of distance. Consistently, the results of the psychophysical experiment revealed that the presence of the sonic crystal between the sound source and the listener produces a significant reduction of the perceived relative distance to the sound source.

Modeling distance-dependent individual head-related transfer functions in the horizontal plane using frontal projection headphones

The veracity of virtual audio is degraded by the use of non-individualized head-related transfer functions (HRTFs) due to the introduction of front-back, elevation confusions, and timbral coloration. Hence, an accurate reproduction of spatial sound demands the use of individualized HRTFs. Measuring distance-dependent individualized HRTFs can be extremely tedious, since it requires precise measurements at several distances in the proximal region (<1 m) for each individual. This paper proposes a technique to model distance-dependent individualized HRTFs in the horizontal plane using "frontal projection headphones playback" that does not require individualized measurements. The frontal projection headphones [Sunder, Tan, and Gan (2013). J. Audio Eng. Soc. 61, 989-1000] project the sound directly onto the pinnae from the front, and thus inherently create listener's idiosyncratic pinna cues at the eardrum. Perceptual experiments were conducted to investigate cues (auditory parallax and interaural level differences) that aid distance perception in anechoic conditions. Interaural level differences were identified as the prominent cue for distance perception and a spherical head model was used to model these distance-dependent features. Detailed psychophysical experiments revealed that the modeled distance-dependent individualized HRTFs exhibited localization performance close to the measured distance-dependent individualized HRTFs for all subjects.

Auditory distance coding in rabbit midbrain neurons and human perception: monaural amplitude modulation depth as a cue

Mechanisms underlying sound source distance localization are not well understood. Here we tested the hypothesis that a novel mechanism can create monaural distance sensitivity: a combination of auditory midbrain neurons' sensitivity to amplitude modulation (AM) depth and distance-dependent loss of AM in reverberation. We used virtual auditory space (VAS) methods for sounds at various distances in anechoic and reverberant environments. Stimulus level was constant across distance. With increasing modulation depth, some rabbit inferior colliculus neurons increased firing rates whereas others decreased. These neurons exhibited monotonic relationships between firing rates and distance for monaurally presented noise when two conditions were met: (1) the sound had AM, and (2) the environment was reverberant. The firing rates as a function of distance remained approximately constant without AM in either environment and, in an anechoic condition, even with AM. We corroborated this finding by reproducing the distance sensitivity using a neural model. We also conducted a human psychophysical study using similar methods. Normal-hearing listeners reported perceived distance in response to monaural 1 octave 4 kHz noise source sounds presented at distances of 35-200 cm. We found parallels between the rabbit neural and human responses. In both, sound distance could be discriminated only if the monaural sound in reverberation had AM. These observations support the hypothesis. When other cues are available (e.g., in binaural hearing), how much the auditory system actually uses the AM as a distance cue remains to be determined.

Preattentive processing of horizontal motion, radial motion, and intensity changes of sounds

Localization of sound sources is critical for an appropriate behavioral response. This is not only true for localization in the horizontal plane but also for localization in depth. Depth ranging of sound sources implicates various distance cues, among others sound intensity. In this study, we measured human electroencephalography and compared mismatch negativity (MMN) amplitudes and latencies for horizontal motion, radial motion, and pure intensity changes in the free field. We observed similar MMN latencies for horizontal and radial motion, whereas MMN responses to pure intensity changes were comparably delayed. MMN amplitudes and latencies were not different for approaching and receding sounds. Our data suggest similar fast processing for horizontal and radial motion, whereas pure intensity changes are possibly processed with less priority.

Depth cues and perceived audiovisual synchrony of biological motion

BACKGROUND

Due to their different propagation times, visual and auditory signals from external events arrive at the human sensory receptors with a disparate delay. This delay consistently varies with distance, but, despite such variability, most events are perceived as synchronic. There is, however, contradictory data and claims regarding the existence of compensatory mechanisms for distance in simultaneity judgments.

PRINCIPAL FINDINGS

In this paper we have used familiar audiovisual events--a visual walker and footstep sounds--and manipulated the number of depth cues. In a simultaneity judgment task we presented a large range of stimulus onset asynchronies corresponding to distances of up to 35 meters. We found an effect of distance over the simultaneity estimates, with greater distances requiring larger stimulus onset asynchronies, and vision always leading. This effect was stronger when both visual and auditory cues were present but was interestingly not found when depth cues were impoverished.

SIGNIFICANCE

These findings reveal that there should be an internal mechanism to compensate for audiovisual delays, which critically depends on the depth information available.

Exogenous orienting of crossmodal attention in 3-D space: support for a depth-aware crossmodal attentional system

The aim of the present study was to investigate exogenous crossmodal orienting of attention in three-dimensional (3-D) space. Most studies in which the orienting of attention has been examined in 3-D space concerned either exogenous intramodal or endogenous crossmodal attention. Evidence for exogenous crossmodal orienting of attention in depth is lacking. Endogenous and exogenous attention are behaviorally different, suggesting that they are two different mechanisms. We used the orthogonal spatial-cueing paradigm and presented auditory exogenous cues at one of four possible locations in near or far space before the onset of a visual target. Cues could be presented at the same (valid) or at a different (invalid) depth from the target (radial validity), and on the same (valid) or on a different (invalid) side (horizontal validity), whereas we blocked the depth at which visual targets were presented. Next to an overall validity effect (valid RTs < invalid RTs) in horizontal space, we observed an interaction between the horizontal and radial validity of the cue: The horizontal validity effect was present only when the cue and the target were presented at the same depth. No horizontal validity effect was observed when the cue and the target were presented at different depths. These results suggest that exogenous crossmodal attention is "depth-aware," and they are discussed in the context of the supramodal hypothesis of attention.

Environmental reverberation affects processing of sound intensity in right temporal cortex

Although sound reverberation is considered a nuisance variable in most studies investigating auditory processing, it can serve as a cue for loudness constancy, a phenomenon describing constant loudness perception in spite of changing sound source distance. In this study, we manipulated room reverberation characteristics to test their effect on psychophysical loudness constancy and we tested with magnetoencephalography on human subjects for neural responses reflecting loudness constancy. Psychophysically, we found that loudness constancy was present in strong, but not weak, reverberation conditions. In contrast, the dependence of sound distance judgment on actual distance was similar across conditions. We observed brain activity reflecting behavioral loudness constancy, i.e. inverse scaling of the evoked magnetic fields with distance for weak reverberation but constant responses across distance for strong reverberation from ~210 to 270 ms after stimulus onset. Distributed magnetoencephalography source reconstruction revealed underlying neural generators within the right middle temporal and right inferior anterior temporal lobe. Our data suggest a dissociation of loudness constancy and distance perception, implying a direct usage of reverberation cues for constructing constant loudness across distance. Furthermore, our magnetoencephalography data suggest involvement of auditory association areas in the right middle and right inferior anterior temporal cortex in this process.

Psychophysics and neuronal bases of sound localization in humans

Localization of sound sources is a considerable computational challenge for the human brain. Whereas the visual system can process basic spatial information in parallel, the auditory system lacks a straightforward correspondence between external spatial locations and sensory receptive fields. Consequently, the question how different acoustic features supporting spatial hearing are represented in the central nervous system is still open. Functional neuroimaging studies in humans have provided evidence for a posterior auditory "where" pathway that encompasses non-primary auditory cortex areas, including the planum temporale (PT) and posterior superior temporal gyrus (STG), which are strongly activated by horizontal sound direction changes, distance changes, and movement. However, these areas are also activated by a wide variety of other stimulus features, posing a challenge for the interpretation that the underlying areas are purely spatial. This review discusses behavioral and neuroimaging studies on sound localization, and some of the competing models of representation of auditory space in humans. This article is part of a Special Issue entitled Human Auditory Neuroimaging.

Evidence for enhanced discrimination of virtual auditory distance among blind listeners using level and direct-to-reverberant cues

Totally blind listeners often demonstrate better than normal capabilities when performing spatial hearing tasks. Accurate representation of three-dimensional auditory space requires the processing of available distance information between the listener and the sound source; however, auditory distance cues vary greatly depending upon the acoustic properties of the environment, and it is not known which distance cues are important to totally blind listeners. Our data show that totally blind listeners display better performance compared to sighted age-matched controls for distance discrimination tasks in anechoic and reverberant virtual rooms simulated using a room-image procedure. Totally blind listeners use two major auditory distance cues to stationary sound sources, level and direct-to-reverberant ratio, more effectively than sighted controls for many of the virtual distances tested. These results show that significant compensation among totally blind listeners for virtual auditory spatial distance leads to benefits across a range of simulated acoustic environments. No significant differences in performance were observed between listeners with partial non-correctable visual losses and sighted controls, suggesting that sensory compensation for virtual distance does not occur for listeners with partial vision loss.

The role of vision in auditory distance perception

In humans, multisensory interaction is an important strategy for improving the detection of stimuli of different nature and reducing the variability of response. It is known that the presence of visual information affects the auditory perception in the horizontal plane (azimuth), but there are few researches that study the influence of vision in the auditory distance perception. In general, the data obtained from these studies are contradictory and do not completely define the way in which visual cues affect the apparent distance of a sound source. Here psychophysical experiments on auditory distance perception in humans are performed, including and excluding visual cues. The results show that the apparent distance from the source is affected by the presence of visual information and that subjects can store in their memory a representation of the environment that later improves the perception of distance.

The impact of early reflections on binaural cues

Animals live in cluttered auditory environments, where sounds arrive at the two ears through several paths. Reflections make sound localization difficult, and it is thought that the auditory system deals with this issue by isolating the first wavefront and suppressing later signals. However, in many situations, reflections arrive too early to be suppressed, for example, reflections from the ground in small animals. This paper examines the implications of these early reflections on binaural cues to sound localization, using realistic models of reflecting surfaces and a spherical model of diffraction by the head. The fusion of direct and reflected signals at each ear results in interference patterns in binaural cues as a function of frequency. These cues are maximally modified at frequencies related to the delay between direct and reflected signals, and therefore to the spatial location of the sound source. Thus, natural binaural cues differ from anechoic cues. In particular, the range of interaural time differences is substantially larger than in anechoic environments. Reflections may potentially contribute binaural cues to distance and polar angle when the properties of the reflecting surface are known and stable, for example, for reflections on the ground.

Effect of stimulus spectrum on distance perception for nearby sources

The effects of stimulus frequency and bandwidth on distance perception were examined for nearby sources in simulated reverberant space. Sources to the side [containing reverberation-related cues and interaural level difference (ILD) cues] and to the front (without ILDs) were simulated. Listeners judged the distance of noise bursts presented at a randomly roving level from simulated distances ranging from 0.15 to 1.7 m. Six stimuli were tested, varying in center frequency (300-5700 Hz) and bandwidth (200-5400 Hz). Performance, measured as the correlation between simulated and response distances, was worse for frontal than for lateral sources. For both simulated directions, performance was inversely proportional to the low-frequency stimulus cutoff, independent of stimulus bandwidth. The dependence of performance on frequency was stronger for frontal sources. These correlation results were well summarized by considering how mean response, as opposed to response variance, changed with stimulus direction and spectrum: (1) little bias was observed for lateral sources, but listeners consistently overestimated distance for frontal nearby sources; (2) for both directions, increasing the low-frequency cut-off reduced the range of responses. These results are consistent with the hypothesis that listeners used a direction-independent but frequency-dependent mapping of a reverberation-related cue, not the ILD cue, to judge source distance.

Visual Biasing of Auditory Localization in Azimuth and Depth

Correctly integrating sensory information across different modalities is a vital task, yet there are illusions which cause the incorrect localization of multisensory stimuli. A common example of these phenomena is the “ventriloquism effect.” In this illusion, the localization of auditory signals is biased by the presence of visual stimuli. For instance, when a light and sound are simultaneously presented, observers may erroneously locate the sound closer to the light than its actual position. While this phenomenon has been studied extensively in azimuth at a single depth, little is known about the interactions of stimuli at different depth planes. In the current experiment, virtual acoustics and stereo-image displays were used to test the integration of visual and auditory signals across azimuth and depth. The results suggest that greater variability in the localization of sounds in depth may lead to a greater bias from visual stimuli in depth than in azimuth. These results offer interesting implications for understanding multisensory integration.

The psychoacoustics of binaural hearing

This paper introduces the major phenomena of binaural hearing. The sounds arriving at the two ears are rarely the same: usually one ear will be partially shadowed from the sound source by the head, and the sound will also have to travel further to get to that ear. The resulting differences in interaural level and time can be detected by the auditory system and can be used to determine the direction of the source of sound. They also facilitate improvements in the detectability of a target sound masked by some other sound from some other direction. In many circumstances there is a special emphasis to the onset of a sound, which helps to perceptually suppress the complex patterns of reflections and reverberations that are present in most listening environments; yet, the auditory system is often insensitive to-and cannot take advantage of-fast dynamic changes within a sound.

Cues for acoustic detection of prey: insect rustling sounds and the influence of walking substrate

When insects walk, they generally produce sounds. These can reveal the walkers' presence and location to potential predators such as owls, bats and nocturnal primates. Additionally, predators might extract information on taxon, palatability, size or profitability from the rustling sounds. In contrast to ear morphology, hearing physiology and psychoacoustics of acoustically oriented predators, little attention has hitherto been paid to the acoustic structure and information content of prey sounds. An important element in the ecology of acoustic prey detection remained virtually unexplored: the influence of the substrate type on rustling sounds. In this study, we analysed amplitude and frequency parameters from insects walking on various natural substrates, in both Germany (Carabus beetles) and Madagascar (various beetles and cockroaches). The data show that rustling sound amplitude and frequency content depend on substrate type. On moist substrates arthropods produced less intense and less broadband rustling sounds than on dry substrates. Sound pressure level was reduced by about 6 dB, halving the detection range for the predator. For a given insect, rustling sound amplitude increased with walking speed. Finally, we found that the previously established correlation of arthropod size and rustling amplitude holds across multiple substrates. Based on these data, we provide for the first time estimates of realistic detection distances in the field. These distances range from below 1 m to over 13 m, depending on the substrate, insect mass, walking speed and background noise level. These estimates are crucial for an understanding of the foraging ecology, foraging efficiency and sensory ecology of acoustic predators.

Reverberation challenges the temporal representation of the pitch of complex sounds

Accurate neural coding of the pitch of complex sounds is an essential part of auditory scene analysis; differences in pitch help segregate concurrent sounds, while similarities in pitch can help group sounds from a common source. In quiet, nonreverberant backgrounds, pitch can be derived from timing information in broadband high-frequency auditory channels and/or from frequency and timing information carried in narrowband low-frequency auditory channels. Recording from single neurons in the cochlear nucleus of anesthetized guinea pigs, we show that the neural representation of pitch based on timing information is severely degraded in the presence of reverberation. This degradation increases with both increasing reverberation strength and channel bandwidth. In a parallel human psychophysical pitch-discrimination task, reverberation impaired the ability to distinguish a high-pass harmonic sound from noise. Together, these findings explain the origin of perceptual difficulties experienced by both normal-hearing and hearing-impaired listeners in reverberant spaces.

On the minimum audible difference in direct-to-reverberant energy ratio

The goals of this study were to measure sensitivity to the direct-to-reverberant energy ratio (D/R) across a wide range of D/R values and to gain insight into which cues are used in the discrimination process. The main finding is that changes in D/R are discriminated primarily based on spectral cues. Temporal cues may be used but only when spectral cues are diminished or not available, while sensitivity to interaural cross-correlation is too low to be useful in any of the conditions tested. These findings are based on an acoustic analysis of these variables and the results of two psychophysical experiments. The first experiment employs wideband noise with two values for onset and offset times to determine the D/R just-noticeable difference at -10, 0, 10, and 20 dB D/R. This yielded substantially higher sensitivity to D/R at 0 and 10 dB D/R (2-3 dB) than has been reported previously, while sensitivity is much lower at -10 and 20 dB D/R. The second experiment consists of three parts where specific cues to D/R are reduced or removed, which enabled the specified rank ordering of the cues. The acoustic analysis and psychophysical experiments also provide an explanation for the "auditory horizon effect."

Object localization in cluttered acoustical environments

In nature, sounds from objects of interest arrive at the ears accompanied by sound waves from other actively emitting objects and by reflections off of nearby surfaces. Despite the fact that all of these waveforms sum at the eardrums, humans with normal hearing effortlessly segregate one sound source from another. Our laboratory is investigating the neural basis of this perceptual feat, often called the "cocktail party effect", using the barn owl as an animal model. The barn owl, renowned for its ability to localize sounds and its spatiotopic representation of auditory space, is an established model for spatial hearing. Here, we briefly review the neural basis of sound-localization of a single sound source in an anechoic environment and then generalize the ideas developed therein to cases in which there are multiple, concomitant sound sources and acoustical reflection.

Acoustic cues underlying auditory distance in barn owls

CONCLUSIONS

We conclude that: (1) among several cues examined, the monaural cue of direct-to-reverberant (D/R) ratio in the ipsilateral ear provides the most information about sound-source distance; (2) interaural level difference (ILD) provides less information about sound-source distance; and (3) a comprehensive theory of three-dimensional auditory localization must incorporate the fact that all of the major acoustic cues change with distance.

OBJECTIVE

Neural mechanisms underlying auditory localization of distance are poorly understood. The present study was an initial step toward filling this gap in knowledge.

MATERIALS AND METHODS

The binaural room impulse responses of adult barn owls were measured. The sound source was placed at various distances (up to 80 cm) and azimuths (0-90 degrees) relative to the owl's head, with the elevation kept at 0 degrees .

RESULTS

We determined the value of each cue for a 3-10 kHz band, and found that: (1) D/R ratio of signal amplitudes provided the most information about sound-source distance; (2) the ipsilateral D/R ratio represented distance more clearly than the contralateral or binaural-average D/R ratios; (3) ILD of direct signals increased with decreasing distance under certain conditions; (3) interaural time difference (ITD) of direct signals increased with decreasing distance at 90 degrees azimuth; and (4) the spectral patterns of ILD and the monaural direct signals changed with distance in complex ways.

Effect of dual sensory loss on auditory localization: implications for intervention

Our sensory systems are remarkable in several respects. They are extremely sensitive, they each perform more than one function, and they interact in a complementary way, thereby providing a high degree of redundancy that is particularly helpful should one or more sensory systems be impaired. In this article, the problem of dual hearing and vision loss is addressed. A brief description is provided on the use of auditory cues in vision loss, the use of visual cues in hearing loss, and the additional difficulties encountered when both sensory systems are impaired. A major focus of this article is the use of sound localization by normal hearing, hearing impaired, and blind individuals and the special problem of sound localization in people with dual sensory loss.

Understanding auditory distance estimation by humpback whales: a computational approach

Ranging, the ability to judge the distance to a sound source, depends on the presence of predictable patterns of attenuation. We measured long-range sound propagation in coastal waters to assess whether humpback whales might use frequency degradation cues to range singing whales. Two types of neural networks, a multi-layer and a single-layer perceptron, were trained to classify recorded sounds by distance traveled based on their frequency content. The multi-layer network successfully classified received sounds, demonstrating that the distorting effects of underwater propagation on frequency content provide sufficient cues to estimate source distance. Normalizing received sounds with respect to ambient noise levels increased the accuracy of distance estimates by single-layer perceptrons, indicating that familiarity with background noise can potentially improve a listening whale's ability to range. To assess whether frequency patterns predictive of source distance were likely to be perceived by whales, recordings were pre-processed using a computational model of the humpback whale's peripheral auditory system. Although signals processed with this model contained less information than the original recordings, neural networks trained with these physiologically based representations estimated source distance more accurately, suggesting that listening whales should be able to range singers using distance-dependent changes in frequency content.

The detection of differences in the cues to distance by elderly hearing-impaired listeners

This experiment measured the capability of hearing-impaired individuals to discriminate differences in the cues to the distance of spoken sentences. The stimuli were generated synthetically, using a room-image procedure to calculate the direct sound and first 74 reflections for a source placed in a 7 x 9 m room, and then presenting each of those sounds individually through a circular array of 24 loudspeakers. Seventy-seven listeners participated, aged 22-83 years and with hearing levels from -5 to 59 dB HL. In conditions where a substantial change in overall level due to the inverse-square law was available as a cue, the elderly hearing-impaired listeners did not perform any different from control groups. In other conditions where that cue was unavailable (so leaving the direct-to-reverberant relationship as a cue), either because the reverberant field dominated the direct sound or because the overall level had been artificially equalized, hearing-impaired listeners performed worse than controls. There were significant correlations with listeners' self-reported distance capabilities as measured by the "Speech, Spatial, and Qualities of Hearing" questionnaire [S. Gatehouse and W. Noble, Int. J. Audiol. 43, 85-99 (2004)]. The results demonstrate that hearing-impaired listeners show deficits in the ability to use some of the cues which signal auditory distance.

Chapter 14 Combining visual and auditory information

Robust perception requires that information from by our five different senses be combined at some central level to produce a single unified percept of the world. Recent theory and evidence from many laboratories suggests that the combination does not occur in a rigid, hardwired fashion, but follows flexible situation-dependent rules that allow information to be combined with maximal efficiency. In this review we discuss recent evidence from our laboratories investigating how information from auditory and visual modalities is combined. The results support the notion of Bayesian combination. We also examine temporal alignment of auditory and visual signals, and show that perceived simultaneity does not depend solely on neural latencies, but involves active processes that compensate, for example, for the physical delay introduced by the relatively slow speed of sound. Finally, we go on to show that although visual and auditory information is combined to maximize efficiency, attentional resources for the two modalities are largely independent.

Perceptual compensation for effects of reverberation in speech identification

Listeners were asked to identify modified recordings of the words "sir" and "stir," which were spoken by an adult male British-English speaker. Steps along a continuum between the words were obtained by a pointwise interpolation of their temporal-envelopes. These test words were embedded in a longer "context" utterance, and played with different amounts of reverberation. Increasing only the test-word's reverberation shifts the listener's category boundary so that more "sir"-identifications are made. This effect reduces when the context's reverberation is also increased, indicating perceptual compensation that is informed by the context. Experiment 1 finds that compensation is more prominent in rapid speech, that it varies between rooms, that it is more prominent when the test-word's reverberation is high, and that it increases with the context's reverberation. Further experiments show that compensation persists when the room is switched between the context and the test word, when presentation is monaural, and when the context is reversed. However, compensation reduces when the context's reverberation pattern is reversed, as well as when noise-versions of the context are used. "Tails" that reverberation introduces at the ends of sounds and at spectral transitions may inform the compensation mechanism about the amount of reflected sound in the signal.

Multisensory Integration: Strategies for Synchronization

Recent studies have shown that our ability to match the timing of inputs from objects that can be both seen and heard is highly adaptable and takes into account target depth and the relatively slow speed of sound.

Localizing nearby sound sources in a classroom: binaural room impulse responses

Binaural room impulse responses (BRIRs) were measured in a classroom for sources at different azimuths and distances (up to 1 m) relative to a manikin located in four positions in a classroom. When the listener is far from all walls, reverberant energy distorts signal magnitude and phase independently at each frequency, altering monaural spectral cues, interaural phase differences, and interaural level differences. For the tested conditions, systematic distortion (comb-filtering) from an early intense reflection is only evident when a listener is very close to a wall, and then only in the ear facing the wall. Especially for a nearby source, interaural cues grow less reliable with increasing source laterality and monaural spectral cues are less reliable in the ear farther from the sound source. Reverberation reduces the magnitude of interaural level differences at all frequencies; however, the direct-sound interaural time difference can still be recovered from the BRIRs measured in these experiments. Results suggest that bias and variability in sound localization behavior may vary systematically with listener location in a room as well as source location relative to the listener, even for nearby sources where there is relatively little reverberant energy.

Early- and late-onset blind individuals show supra-normal auditory abilities in far-space

Blind individuals manifest remarkable abilities in navigating through space despite their lack of vision. They have previously been shown to perform normally or even supra-normally in tasks involving spatial hearing in near space, a region that, however, can be calibrated with sensory-motor feedback. Here we show that blind individuals not only properly map auditory space beyond their peri-personal environment but also demonstrate supra-normal performance when subtle acoustic cues for target location and distance must be used to carry out the task. Moreover, it is generally postulated that such abilities rest in part on cross-modal cortical reorganizations, particularly in the immature brain, where important synaptogenesis is still possible. Nonetheless, we show for the first time that even late-onset blind subjects develop above-normal spatial abilities, suggesting that significant compensation can occur in the adult.

Synchronizing to real events: subjective audiovisual alignment scales with perceived auditory depth and speed of sound

Because of the slow speed of sound relative to light, acoustic and visual signals from a distant event often will be received asynchronously. Here, using acoustic signals with a robust cue to sound source distance, we show that judgments of perceived temporal alignment with a visual marker depend on the depth simulated in the acoustic signal. For distant sounds, a large delay of sound relative to vision is required for the signals to be perceived as temporally aligned. For nearer sources, the time lag corresponding to audiovisual alignment is smaller and scales at rate approximating the speed of sound. Thus, when robust cues to auditory distance are present, the brain can synchronize disparate audiovisual signals to external events despite considerable differences in time of arrival at the perceiver. This ability is functionally important as it allows auditory and visual signals to be synchronized to the external event that caused them.

Audiological assessment, rehabilitation, and spatial hearing considerations associated with visual impairment in adults: an overview

The purpose of this paper is to increase awareness and interest among audiologists regarding the needs of adults who have both hearing loss and visual impairment, particularly people who are blind and travel independently. Case history, audiometric testing, and rehabilitation issues are considered, and extensive discussion of spatial hearing research as it relates to orientation and mobility is provided.

Investigations of the precedence effect in budgerigars: the perceived location of auditory images

The perceived location of auditory images has been recently studied in budgerigars [Dent and Dooling, J. Acoust. Soc. Am. 113, 2146-2158 (2003)]. Those results suggested that budgerigars (Melopsittacus undulatus) perceive precedence effect stimuli in a manner similar to humans and other animals. Here we extend those experiments to include the effects of intensity on the perceived location of auditory images and the perceived location of paired stimuli from multiple locations in space. We measured the abilities of budgerigars to discriminate between paired stimuli separated in time, intensity, and/or location. Increasing the intensity of a lag stimulus disrupted localization dominance. Budgerigars also perceived simultaneously presented (away from the midline) stimuli as very similar to a single sound presented from the midline, much like the phantom image reported in humans. The perception of paired stimuli from one side of the head versus two sides of the head was also examined and showed that the spatial cues available in these stimuli are important and that echoes are not perceptually inaccessible during localization dominance conditions. The results from these experiments add further data showing the precedence effect in budgerigars is similar to that found in humans and other animals.

Modeling individual differences in ferret external ear transfer functions

Individual variations in head and outer ear size, as well as growth of these structures during development, can markedly alter the values of the binaural and monaural cues which form the basis for auditory localization. This study investigated individual differences in the directional component of the head-related transfer function of both adult and juvenile ferrets. In line with previous studies in humans and cats, intersubject spectral differences were found to be reduced by scaling one of the directional transfer functions on a log-frequency axis. The optimal scale factor correlated most highly with pinna cavity height. Optimal frequency scaling reduced interear spectral difference equally well for adult-juvenile comparisons as for comparisons between pairs of adult ears. This illustrates that the developmental changes in localization cue values should be at least partly predictable on the basis of the expected growth rate of the outer ear structures. Predictions of interaural time differences (ITDs) were also derived from the physical dimensions of the head. ITDs were found to be poorly fitted by the spherical head model, while much better predictions could be derived from a model based on von Mises spherical basis functions. Together, these findings show how more accurate estimates of spatial cue values can be made from knowledge of the dimensions of the head and outer ears, and may facilitate the generation of virtual acoustic space stimuli in the absence of acoustical measurements from individual subjects.

Direct-to-reverberant energy ratio sensitivity

Although the ratio of direct-to-reverberant sound energy is known to be an important acoustic cue to sound source distance, human sensitivity to changes in this cue is largely unknown. Here, direct-to-reverberant energy discrimination thresholds were measured for six listeners using virtual sound source techniques that allow for convenient and precise control of this stimulus parameter. Four different types of source stimuli were tested: a 50 ms noise burst with abrupt onset/offset, a 300 ms duration noise burst with gradual onset/offset, a speech syllable, and an impulse. Over a range of direct-to-reverberant ratios from 0 to 20 dB, an adaptive 2AFC procedure (3-down, 1-up) was used to measure discrimination thresholds. For all stimuli, these thresholds ranged from 5 to 6 dB. A post hoc fitting procedure confirmed that slopes of the psychometric functions were homogeneous across stimulus conditions and listeners. These threshold results suggest that direct-to-reverberant energy ratio by itself provides only a course coding of sound source distance, because threshold values correspond to greater than 2-fold changes in physical distance for the acoustic environment under examination.

Auditory peripersonal space in humans

In the present study we report neuropsychological evidence of the existence of an auditory peripersonal space representation around the head in humans and its characteristics. In a group of right brain-damaged patients with tactile extinction, we found that a sound delivered near the ipsilesional side of the head (20 cm) strongly extinguished a tactile stimulus delivered to the contralesional side of the head (cross-modal auditory-tactile extinction). By contrast, when an auditory stimulus was presented far from the head (70 cm), cross-modal extinction was dramatically reduced. This spatially specific cross-modal extinction was most consistently found (i.e., both in the front and back spaces) when a complex sound was presented, like a white noise burst. Pure tones produced spatially specific cross-modal extinction when presented in the back space, but not in the front space. In addition, the most severe cross-modal extinction emerged when sounds came from behind the head, thus showing that the back space is more sensitive than the front space to the sensory interaction of auditory-tactile inputs. Finally, when cross-modal effects were investigated by reversing the spatial arrangement of cross-modal stimuli (i.e., touch on the right and sound on the left), we found that an ipsilesional tactile stimulus, although inducing a small amount of cross-modal tactile-auditory extinction, did not produce any spatial-specific effect. Therefore, the selective aspects of cross-modal interaction found near the head cannot be explained by a competition between a damaged left spatial representation and an intact right spatial representation. Thus, consistent with neurophysiological evidence from monkeys, our findings strongly support the existence, in humans, of an integrated cross-modal system coding auditory and tactile stimuli near the body, that is, in the peripersonal space.

Assessing auditory distance perception using virtual acoustics

In most naturally occurring situations, multiple acoustic properties of the sound reaching a listener's ears change as sound source distance changes. Because many of these acoustic properties, or cues, can be confounded with variation in the acoustic properties of the source and the environment, the perceptual processes subserving distance localization likely combine and weight multiple cues in order to produce stable estimates of sound source distance. Here, this cue-weighting process is examined psychophysically, using a method of virtual acoustics that allows precise measurement and control of the acoustic cues thought to be salient for distance perception in a representative large-room environment. Though listeners' judgments of sound source distance are found to consistently and exponentially underestimate true distance, the perceptual weight assigned to two primary distance cues (intensity and direct-to-reverberant energy ratio) varies substantially as a function of both sound source type (noise and speech) and angular position (0 degrees and 90 degrees relative to the median plane). These results suggest that the cue-weighting process is flexible, and able to adapt to individual distance cues that vary as a result of source properties and environmental conditions.

Estimating sound source distance with and without vision

BACKGROUND

Visual capture is an important perceptual phenomenon in which the spatial location of a visual target influences the perceived location of a related auditory target. Little is known about visual capture in a distance dimension.

METHODS

Two groups of listeners judged the apparent distances of five loudspeaker sound sources, extending from 1 to 5 m. In one group, each listener was allowed to view the loudspeaker array. In the second group, listeners were blindfolded for the duration of the experiment.

RESULTS

No visual capture effects were observed. Instead, the addition of vision was found to both improve distance judgment accuracy and lower judgment variability compared with the auditory-only stimulus. Auditory-only accuracy was found to substantially improve over the course of the experiment, however.

CONCLUSIONS

Visual capture in distance is perhaps less general than suggested by past research, a result that has important implications for the display of spatial layout under conditions where vision is either missing or degraded.

Loudness constancy with varying sound source distance

At a listener's ears, sound source power and sound source distance are confounded in measures of acoustic intensity, a physical property long thought to be the primary determinate of loudness. Although the relationship between sound source loudness and power is well known when source distance is fixed, relatively little is known about source loudness under conditions of varying distance. Here we show a robust loudness constancy, similar in many ways to visual size constancy, that results under distance-varying conditions that produce inaccurate estimates of source distance. Our results suggest that the auditory system does not require accurate distance estimates to judge source loudness, even when distance is variable. We offer an alternative explanation of loudness constancy based solely on a reverberant sound energy cue.