Human electrophysiological examination of buildup of the precedence effect

The precedence effect in sound localization

In ordinary listening environments, acoustic signals reaching the ears directly from real sound sources are followed after a few milliseconds by early reflections arriving from nearby surfaces. Early reflections are spectrotemporally similar to their source signals but commonly carry spatial acoustic cues unrelated to the source location. Humans and many other animals, including nonmammalian and even invertebrate animals, are nonetheless able to effectively localize sound sources in such environments, even in the absence of disambiguating visual cues. Robust source localization despite concurrent or nearly concurrent spurious spatial acoustic information is commonly attributed to an assortment of perceptual phenomena collectively termed "the precedence effect," characterizing the perceptual dominance of spatial information carried by the first-arriving signal. Here, we highlight recent progress and changes in the understanding of the precedence effect and related phenomena.

The effects of preceding lead-alone and lag-alone click trains on the buildup of echo suppression

Spatial perception in echoic environments is influenced by recent acoustic history. For instance, echo suppression becomes more effective or "builds up" with repeated exposure to echoes having a consistent acoustic relationship to a temporally leading sound. Four experiments were conducted to investigate how buildup is affected by prior exposure to unpaired lead-alone or lag-alone click trains. Unpaired trains preceded lead-lag click trains designed to evoke and assay buildup. Listeners reported how many sounds they heard from the echo hemifield during the lead-lag trains. Stimuli were presented in free field (experiments 1 and 4) or dichotically through earphones (experiments 2 and 3). In experiment 1, listeners reported more echoes following a lead-alone train compared to a period of silence. In contrast, listeners reported fewer echoes following a lag-alone train; similar results were observed with earphones. Interestingly, the effects of lag-alone click trains on buildup were qualitatively different when compared to a no-conditioner trial type in experiment 4. Finally, experiment 3 demonstrated that the effects of preceding click trains on buildup cannot be explained by a change in counting strategy or perceived click salience. Together, these findings demonstrate that echo suppression is affected by prior exposure to unpaired stimuli.

The precedence effect and its buildup and breakdown in ferrets and humans

Although many studies have examined the precedence effect (PE), few have tested whether it shows a buildup and breakdown in nonhuman animals comparable to that seen in humans. These processes are thought to reflect the ability of the auditory system to adjust to a listener's acoustic environment, and their mechanisms are still poorly understood. In this study, ferrets were trained on a two-alternative forced-choice task to discriminate the azimuthal direction of brief sounds. In one experiment, pairs of noise bursts were presented from two loudspeakers at different interstimulus delays (ISDs). Results showed that localization performance changed as a function of ISD in a manner consistent with the PE being operative. A second experiment investigated buildup and breakdown of the PE by measuring the ability of ferrets to discriminate the direction of a click pair following presentation of a conditioning train. Human listeners were also tested using this paradigm. In both species, performance was better when the test clicks and conditioning train had the same ISD but deteriorated following a switch in the direction of the leading and lagging sounds between the conditioning train and test clicks. These results suggest that ferrets, like humans, experience a buildup and breakdown of the PE.

Neural time course of visually enhanced echo suppression

Auditory spatial perception plays a critical role in day-to-day communication. For instance, listeners utilize acoustic spatial information to segregate individual talkers into distinct auditory "streams" to improve speech intelligibility. However, spatial localization is an exceedingly difficult task in everyday listening environments with numerous distracting echoes from nearby surfaces, such as walls. Listeners' brains overcome this unique challenge by relying on acoustic timing and, quite surprisingly, visual spatial information to suppress short-latency (1-10 ms) echoes through a process known as "the precedence effect" or "echo suppression." In the present study, we employed electroencephalography (EEG) to investigate the neural time course of echo suppression both with and without the aid of coincident visual stimulation in human listeners. We find that echo suppression is a multistage process initialized during the auditory N1 (70-100 ms) and followed by space-specific suppression mechanisms from 150 to 250 ms. Additionally, we find a robust correlate of listeners' spatial perception (i.e., suppressing or not suppressing the echo) over central electrode sites from 300 to 500 ms. Contrary to our hypothesis, vision's powerful contribution to echo suppression occurs late in processing (250-400 ms), suggesting that vision contributes primarily during late sensory or decision making processes. Together, our findings support growing evidence that echo suppression is a slow, progressive mechanism modifiable by visual influences during late sensory and decision making stages. Furthermore, our findings suggest that audiovisual interactions are not limited to early, sensory-level modulations but extend well into late stages of cortical processing.

Spatial attention modulates the precedence effect

Communication and navigation in real environments rely heavily on the ability to distinguish objects in acoustic space. However, auditory spatial information is often corrupted by conflicting cues and noise such as acoustic reflections. Fortunately the brain can apply mechanisms at multiple levels to emphasize target information and mitigate such interference. In a rapid phenomenon known as the precedence effect, reflections are perceptually fused with the veridical primary sound. The brain can also use spatial attention to highlight a target sound at the expense of distracters. Although attention has been shown to modulate many auditory perceptual phenomena, rarely does it alter how acoustic energy is first parsed into objects, as with the precedence effect. This brief report suggests that both endogenous (voluntary) and exogenous (stimulus-driven) spatial attention have a profound influence on the precedence effect depending on where they are oriented. Moreover, we observed that both types of attention could enhance perceptual fusion while only exogenous attention could hinder it. These results demonstrate that attention, by altering how auditory objects are formed, guides the basic perceptual organization of our acoustic environment.

Manipulations of listeners' echo perception are reflected in event-related potentials

To gain information from complex auditory scenes, it is necessary to determine which of the many loudness, pitch, and timbre changes originate from a single source. Grouping sound into sources based on spatial information is complicated by reverberant energy bouncing off multiple surfaces and reaching the ears from directions other than the source's location. The ability to localize sounds despite these echoes has been explored with the precedence effect: Identical sounds presented from two locations with a short stimulus onset asynchrony (e.g., 1-5 ms) are perceived as a single source with a location dominated by the lead sound. Importantly, echo thresholds, the shortest onset asynchrony at which a listener reports hearing the lag sound as a separate source about half of the time, can be manipulated by presenting sound pairs in contexts. Event-related brain potentials elicited by physically identical sounds in contexts that resulted in listeners reporting either one or two sources were compared. Sound pairs perceived as two sources elicited a larger anterior negativity 100-250 ms after onset, previously termed the object-related negativity, and a larger posterior positivity 250-500 ms. These results indicate that the models of room acoustics listeners form based on recent experience with the spatiotemporal properties of sound modulate perceptual as well as later higher-level processing.

Effects of sound location on visual task performance and electrophysiological measures of distraction

Novel sounds embedded in a repetitive stream of auditory stimuli impair performance of the visual task at hand. Parmentier et al. suggested that this distraction effect might be because of the shifting cost of moving attention from the task-irrelevant (auditory) to the task-relevant (visual) channel, or from their shifting of spatial locations. Here, the source location of the sounds in an audio-visual distraction paradigm was varied systematically (headphones and 0, -18, -72, 18, and 72 degrees), and the results revealed significant distracting effects of novel sounds occurring in the headphone and the right location conditions. This supports the assumption that in the behavioral cost observed in the audio-visual distraction paradigm a spatial shift of attention is involved.

Right hemispheric dominance for echo suppression

When two sounds are presented sequentially within a short delay ( approximately 10ms), the listener perceives a single auditory event, the location of which is dominated by the directional information conveyed by the leading sound (the precedence effect, PE). The PE is not always instantaneous, but has been shown to build-up across repetitions of lead-lag pairs. Here, we investigated the contributions of lateralization cue (interaural time and intensity differences; ITD and IID, respectively) and the side of lateralization of the leading sound on the spatio-temporal activity associated with the PE. We applied electrical neuroimaging analyses to compare auditory evoked potentials (AEPs) in response to physically identical click pairs presented early and late within a stimulus train and perceived as two segregated events or as one fused auditory event. Significant topographic AEP modulations associated with the PE were observed over the 70-117ms post-stimulus period, with one topography characterizing fused perceptions and another segregated perceptions. The specific pattern of effects varied as a function of lateralization cue and the lateralization of the leading sound. The PE for ITD stimuli built-up during the stimulus train irrespective of the lateralization of the leading sound. The PE for IID stimuli did not exhibit build-up over the course of the stimulus train, but instead was generally affected by the lateralization of the leading sound. Source estimations further suggested that bilateral temporal networks were engaged when perceptions were segregated, whereas fused perceptions resulted in decreased activity in left temporal and increased activity in right temporo-parietal cortices.

Measurement of ERP latency differences: a comparison of single-participant and jackknife-based scoring methods

We used computer simulations to evaluate different procedures for measuring changes in the onset latency of a representative range of event-related components (the auditory and visual N1, P3, N2pc, and the frequency-related P3 difference wave). These procedures included several techniques to determine onset latencies combined with approaches using both single-participant average waveforms and jackknife-subsample average waveforms. In general, the jackknife-based approach combined with the relative criterion technique or combined with the fractional area technique (J.C. Hansen & S.A. Hillyard, 1980; S.J. Luck, 2005) provided the most accurate method and the greatest statistical power, with no inflation of Type I error rate.