The contribution of selective spatial attention to sound detection and sound localization: Evidence from event-related potentials and lateralized alpha oscillations

Tracking the Misallocation and Reallocation of Spatial Attention toward Auditory Stimuli

Completely ignoring a salient distractor presented concurrently with a target is difficult, and sometimes attention is involuntarily attracted to the distractor's location (attentional capture). Employing the N2ac component as a marker of attention allocation toward sounds, in this study we investigate the spatiotemporal dynamics of auditory attention across two experiments. Human participants (male and female) performed an auditory search task, where the target was accompanied by a distractor in two-third of the trials. For a distractor more salient than the target (Experiment 1), we observe not only a distractor N2ac (indicating attentional capture) but the full chain of attentional dynamics implied by the notion of attentional capture, namely, (1) the distractor captures attention before the target is attended, (2) allocation of attention to the target is delayed by distractor presence, and (3) the target is attended after the distractor. Conversely, for a distractor less salient than the target (Experiment 2), although responses were delayed, no attentional capture was observed. Together, these findings reveal two types of spatial attentional dynamics in the auditory modality (distraction with and without attentional capture).

Brain areas associated with visual spatial attention display topographic organization during auditory spatial attention

Spatially selective modulation of alpha power (8-14 Hz) is a robust finding in electrophysiological studies of visual attention, and has been recently generalized to auditory spatial attention. This modulation pattern is interpreted as reflecting a top-down mechanism for suppressing distracting input from unattended directions of sound origin. The present study on auditory spatial attention extends this interpretation by demonstrating that alpha power modulation is closely linked to oculomotor action. We designed an auditory paradigm in which participants were required to attend to upcoming sounds from one of 24 loudspeakers arranged in a circular array around the head. Maintaining the location of an auditory cue was associated with a topographically modulated distribution of posterior alpha power resembling the findings known from visual attention. Multivariate analyses allowed the prediction of the sound location in the horizontal plane. Importantly, this prediction was also possible, when derived from signals capturing saccadic activity. A control experiment on auditory spatial attention confirmed that, in absence of any visual/auditory input, lateralization of alpha power is linked to the lateralized direction of gaze. Attending to an auditory target engages oculomotor and visual cortical areas in a topographic manner akin to the retinotopic organization associated with visual attention.

Cross-modal interactions at the audiovisual cocktail-party revealed by behavior, ERPs, and neural oscillations

Theories of attention argue that objects are the units of attentional selection. In real-word environments such objects can contain visual and auditory features. To understand how mechanisms of selective attention operate in multisensory environments, in this pre-registered study, we created an audiovisual cocktail-party situation, in which two speakers (left and right of fixation) simultaneously articulated brief numerals. In three separate blocks, informative auditory speech was presented (a) alone or paired with (b) congruent or (c) uninformative visual speech. In all blocks, subjects localized a pre-defined numeral. While audiovisual-congruent and uninformative speech improved response times and speed of information uptake according to diffusion modeling, an ERP analysis revealed that this did not coincide with enhanced attentional engagement. Yet, consistent with object-based attentional selection, the deployment of auditory spatial attention (N2ac) was accompanied by visuo-spatial attentional orienting (N2pc) irrespective of the informational content of visual speech. Notably, an N2pc component was absent in the auditory-only condition, demonstrating that a sound-induced shift of visuo-spatial attention relies on the availability of audio-visual features evolving coherently in time. Additional exploratory analyses revealed cross-modal interactions in working memory and modulations of cognitive control.

Selective spatial attention in lateralized multi-talker speech perception: EEG correlates and the role of age

Speech comprehension under dynamic cocktail party conditions requires auditory search for relevant speech content and focusing spatial attention on the target talker. Here, we investigated the development of these cognitive processes in a population of 329 participants aged 20-70 years. We used a multi-talker speech detection and perception task in which pairs of words (each consisting of a cue and a target word) were simultaneously presented from lateralized positions. Participants attended to predefined cue words and responded to the corresponding target. Task difficulty was varied by presenting cue and target stimuli at different intensity levels. Decline in performance was observed only in the oldest group (age range 53-70 years) and only in the most difficult condition. The EEG analysis of neurocognitive correlates of lateralized auditory attention and stimulus evaluation (N2ac, LPCpc, alpha power lateralization) revealed age-associated changes in focussing on and processing of task-relevant information, while no such deficits were found on early auditory search and target segregation. Irrespective of age, more challenging listening conditions were associated with an increased allocation of attentional resources.

Sound Target Detection Under Noisy Environment Using Brain-Computer Interface

As an important means of environmental reconnaissance and regional security protection, sound target detection (STD) has been widely studied in the field of machine learning for a long time. Considering the shortcomings of the robustness and generalization performance of existing methods based on machine learning, we proposed a target detection method by an auditory brain-computer interface (BCI). We designed the experimental paradigm according to the actual application scenarios of STD, recorded the changes in Electroencephalogram (EEG) signals during the process of detecting target sound, and further extracted the features used to decode EEG signals through the analysis of neural representations, including Event-Related Potential (ERP) and Event-Related Spectral Perturbation (ERSP). Experimental results showed that the proposed method achieved good detection performance under noisy environment. As the first study of BCI applied to STD, this study shows the feasibility of this scheme in BCI and can serve as the foundation for future related applications.

Sound localization and auditory selective attention in school-aged children with ADHD

This study aimed to identify the neurophysiologic bases of auditory attention deficits in children with attention-deficit/hyperactivity disorder (ADHD), focusing on the electroencephalography component of auditory spatial selective attention [the N2 anterior contralateral component (N2ac)]. EEG data were collected from 7- to 11-year-old children with ADHD (n = 54) and age-, sex-, and IQ-matched typically developing (TD) children (n = 61), while they performed an auditory spatial selective task. For behavior, the children with ADHD showed a shorter reaction time (RT) but a higher RT coefficient of variability (RT_CV) than TD children. For ERPs, the TD group showed a significant "adult-like" N2ac component; however, the N2ac component was absent in children with ADHD. More importantly, the smaller N2ac component could predict longer RT in both groups, as well as higher severity of inattentive symptoms in children with ADHD. Our results indicated that 7- to 11-year-old TD children have developed an "adult-like" ability to balance auditory target selection and distractor suppression; the absence of N2ac in children with ADHD provided novel evidence supporting their dysfunctional auditory spatial selective attention.

Selective auditory attention modulates cortical responses to sound location change in younger and older adults

The present study measured scalp potentials in response to low-frequency, narrowband noise bursts changing location in the front, azimuthal plane. At question was whether selective auditory attention has a modulatory effect on the cortical encoding of spatial change and whether older listeners with normal-hearing thresholds would show depressed cortical representation for spatial changes relative to younger listeners. Young and older normal-hearing listeners were instructed to either passively listen to the stimulus presentation or actively attend to a single location (either 30° left or right of midline) and detect when a noise stream moved to the attended location. Prominent peaks of the electroencephalographic scalp waveforms were compared across groups, locations, and attention conditions. In addition, an opponent-channel model of spatial coding was performed to capture the effect of attention on spatial-change tuning. Younger listeners showed not only larger responses overall but a greater dynamic range in their response to location changes. Results suggest that younger listeners were acquiring and encoding key spatial cues at early cortical processing areas. On the other hand, each group exhibited modulatory effects of attention to spatial-change tuning, indicating that both younger and older listeners selectively attend to space in a manner that amplifies the available signal.NEW & NOTEWORTHY In complex acoustic scenes, listeners take advantage of spatial cues to selectively attend to sounds that are deemed immediately relevant. At the neural level, selective attention amplifies electrical responses to spatial changes. We tested whether older and younger listeners have comparable modulatory effects of attention to stimuli moving in the free field. Results indicate that although older listeners do have depressed overall responses, selective attention enhances spatial-change tuning in younger and older listeners alike.

Brain oscillations evoked by sound motion

The present study investigates the event-related oscillations underlying the motion-onset response (MOR) evoked by sounds moving at different velocities. EEG was recorded for stationary sounds and for three patterns of sound motion produced by changes in interaural time differences. We explored the effect of motion velocity on the MOR potential, and also on the event-related spectral perturbation (ERSP) and inter-trial phase coherence (ITC) calculated from the time-frequency decomposition of EEG signals. The phase coherence of slow oscillations increased with an increase in motion velocity similarly to the magnitude of cN1 and cP2 components of the MOR response. The delta-to-alpha inter-trial spectral power remained at the same level up to, but not including, the highest velocity, suggesting that gradual spatial changes within the sound did not induce non-coherent activity. Conversely, the abrupt sound displacement induced theta-alpha oscillations which had low phase consistency. The findings suggest that the MOR potential could be mainly generated by the phase resetting of slow oscillations, and the degree of phase coherence may be considered as a neurophysiological indicator of sound motion processing.

EEG correlates of spatial shifts of attention in a dynamic multi-talker speech perception scenario in younger and older adults

Speech perception under "cocktail-party" conditions critically depends on the focusing of attention toward the talker of interest. In dynamic auditory scenes, changes in talker settings require rapid shifts of attention, which is especially relevant when the position of a target talker switches from one location to another. Here, we explored electrophysiological correlates of shifts in spatial auditory attention, using a free-field speech perception task, in which sequences of short words (a company name, followed by a numeric value, e.g., "Bosch-6") were presented in the participants' left and right horizontal plane. Younger and older participants responded to the value of a pre-defined target company, while ignoring three simultaneously presented pairs of concurrent company names and values from different locations. All four stimulus pairs were spoken by different talkers, alternating from trial-to-trial. The location of the target company was within either the left or right hemisphere for a variable number of consecutive trials (between 3 and 42 trials) and then changed, switching from the left to the right hemispace or vice versa. Thus, when a switch occurred, the participants had to search for the new position of the target company among the concurrent streams of auditory information and re-focus their attention on the relevant location. As correlates of lateralized spatial auditory attention, the anterior contralateral N2 subcomponent (N2ac) and the posterior alpha power lateralization were analyzed in trials immediately before and after switches of the target location. Both measures were increased after switches, while only the increase in N2ac was related to better speech perception performance (i.e., a reduced post-switch decline in accuracy). While both age groups showed a similar pattern of switch-related attentional modulations, N2ac and alpha lateralization to the task-relevant stimulus (the target company's value) was overall greater in the younger, than older, group. The results suggest that N2ac and alpha lateralization reflect different attentional processes in multi-talker speech perception, the first being primarily associated with auditory search and the focusing of attention, and the second with the in-depth attentional processing of task-relevant information. Especially the second process appears to be prone to age-related cognitive decline.

A dual mechanism underlying retroactive shifts of auditory spatial attention: dissociating target- and distractor-related modulations of alpha lateralization

Attention can be allocated to mental representations to select information from working memory. To date, it remains ambiguous whether such retroactive shifts of attention involve the inhibition of irrelevant information or the prioritization of relevant information. Investigating asymmetries in posterior alpha-band oscillations during an auditory retroactive cueing task, we aimed at differentiating those mechanisms. Participants were cued to attend two out of three sounds in an upcoming sound array. Importantly, the resulting working memory representation contained one laterally and one centrally presented item. A centrally presented retro-cue then indicated the lateral, the central, or both items as further relevant for the task (comparing the cued item(s) to a memory probe). Time–frequency analysis revealed opposing patterns of alpha lateralization depending on target eccentricity: A contralateral decrease in alpha power in target lateral trials indicated the involvement of target prioritization. A contralateral increase in alpha power when the central item remained relevant (distractor lateral trials) suggested the de-prioritization of irrelevant information. No lateralization was observed when both items remained relevant, supporting the notion that auditory alpha lateralization is restricted to situations in which spatial information is task-relevant. Altogether, the data demonstrate that retroactive attentional deployment involves excitatory and inhibitory control mechanisms.

Neural dynamics supporting auditory long-term memory effects on target detection

Auditory long-term memory has been shown to facilitate signal detection. However, the nature and timing of the cognitive processes supporting such benefits remain equivocal. We measured neuroelectric brain activity while young adults were presented with a contextual memory cue designed to assist with the detection of a faint pure tone target embedded in an audio clip of an everyday environmental scene (e.g., the soundtrack of a restaurant). During an initial familiarization task, participants heard such audio clips, half of which included a target sound (memory cue trials) at a specific time and location (left or right ear), as well as audio clips without a target (neutral trials). Following a 1-h or 24-h retention interval, the same audio clips were presented, but now all included a target. Participants were asked to press a button as soon as they heard the pure tone target. Overall, participants were faster and more accurate during memory than neutral cue trials. The auditory contextual memory effects on performance coincided with three temporally and spatially distinct neural modulations, which encompassed changes in the amplitude of event-related potential as well as changes in theta, alpha, beta and gamma power. Brain electrical source analyses revealed greater source activity in memory than neutral cue trials in the right superior temporal gyrus and left parietal cortex. Conversely, neutral trials were associated with greater source activity than memory cue trials in the left posterior medial temporal lobe. Target detection was associated with increased negativity (N2), and a late positive (P3b) wave at frontal and parietal sites, respectively. The effect of auditory contextual memory on brain activity preceding target onset showed little lateralization. Together, these results are consistent with contextual memory facilitating retrieval of target-context associations and deployment and management of auditory attentional resources to when the target occurred. The results also suggest that the auditory cortices, parietal cortex, and medial temporal lobe may be parts of a neural network enabling memory-guided attention during auditory scene analysis.

Encoding, storage, and response preparation-Distinct EEG correlates of stimulus and action representations in working memory

Working memory (WM) allows for the active storage of stimulus- and higher level representations, such as action plans. This electroencephalography (EEG) study investigated the specific electrophysiological correlates dissociating action-related from stimulus-related representations in WM using three different experimental conditions based on the same stimulus material. In the experiment, a random sequence of single numbers (from 1 to 6) was presented and participants had to indicate whether the current number (N0 condition), the preceding number (N-1 condition), or the sum of the current and the preceding number (S-1 condition) was odd or even. Accordingly, participants had to store a stimulus representation in S-1 and an action representation in N-1 until the onset of the next stimulus. In the EEG, the storage of stimulus representations (S-1) was reflected by a fronto-central slow wave indicating the rehearsal of information that was required for the response in the following trial. In contrast, the storage of action representations (N-1) went along with a posterior positive slow wave, suggesting that the action plan was actively stored in WM until the presentation of the next stimulus. Crucially, preparing for the next response in N-1 was associated with increased contralateral mu/beta suppression, predicting the response time in the given trial. Our findings, thus, show that the WM processes for stimulus- and action representations can be clearly dissociated from each other with a distinct sequence of EEG correlates for encoding, storage, and response preparation.

Topographic specificity of alpha power during auditory spatial attention

Visual and somatosensory spatial attention both induce parietal alpha (8-14 ​Hz) oscillations whose topographical distribution depends on the direction of spatial attentional focus. In the auditory domain, contrasts of parietal alpha power for leftward and rightward attention reveal qualitatively similar lateralization; however, it is not clear whether alpha lateralization changes monotonically with the direction of auditory attention as it does for visual spatial attention. In addition, most previous studies of alpha oscillation did not consider individual differences in alpha frequency, but simply analyzed power in a fixed spectral band. Here, we recorded electroencephalography in human subjects when they directed attention to one of five azimuthal locations. After a cue indicating the direction of an upcoming target sequence of spoken syllables (yet before the target began), alpha power changed in a task-specific manner. Individual peak alpha frequencies differed consistently between central electrodes and parieto-occipital electrodes, suggesting multiple neural generators of task-related alpha. Parieto-occipital alpha increased over the hemisphere ipsilateral to attentional focus compared to the contralateral hemisphere, and changed systematically as the direction of attention shifted from far left to far right. These results showing that parietal alpha lateralization changes smoothly with the direction of auditory attention as in visual spatial attention provide further support to the growing evidence that the frontoparietal attention network is supramodal.

Unraveling the Relation between EEG Correlates of Attentional Orienting and Sound Localization Performance: A Diffusion Model Approach

Understanding the contribution of cognitive processes and their underlying neurophysiological signals to behavioral phenomena has been a key objective in recent neuroscience research. Using a diffusion model framework, we investigated to what extent well-established correlates of spatial attention in the electroencephalogram contribute to behavioral performance in an auditory free-field sound localization task. Younger and older participants were instructed to indicate the horizontal position of a predefined target among three simultaneously presented distractors. The central question of interest was whether posterior alpha lateralization and amplitudes of the anterior contralateral N2 subcomponent (N2ac) predict sound localization performance (accuracy, mean RT) and/or diffusion model parameters (drift rate, boundary separation, non-decision time). Two age groups were compared to explore whether, in older adults (who struggle with multispeaker environments), the brain-behavior relationship would differ from younger adults. Regression analyses revealed that N2ac amplitudes predicted drift rate and accuracy, whereas alpha lateralization was not related to behavioral or diffusion modeling parameters. This was true irrespective of age. The results indicate that a more efficient attentional filtering and selection of information within an auditory scene, reflected by increased N2ac amplitudes, was associated with a higher speed of information uptake (drift rate) and better localization performance (accuracy), while the underlying response criteria (threshold separation), mean RTs, and non-decisional processes remained unaffected. The lack of a behavioral correlate of poststimulus alpha power lateralization constrasts with the well-established notion that prestimulus alpha power reflects a functionally relevant attentional mechanism. This highlights the importance of distinguishing anticipatory from poststimulus alpha power modulations.

Impoverished auditory cues limit engagement of brain networks controlling spatial selective attention

Spatial selective attention enables listeners to process a signal of interest in natural settings. However, most past studies on auditory spatial attention used impoverished spatial cues: presenting competing sounds to different ears, using only interaural differences in time (ITDs) and/or intensity (IIDs), or using non-individualized head-related transfer functions (HRTFs). Here we tested the hypothesis that impoverished spatial cues impair spatial auditory attention by only weakly engaging relevant cortical networks. Eighteen normal-hearing listeners reported the content of one of two competing syllable streams simulated at roughly +30° and -30° azimuth. The competing streams consisted of syllables from two different-sex talkers. Spatialization was based on natural spatial cues (individualized HRTFs), individualized IIDs, or generic ITDs. We measured behavioral performance as well as electroencephalographic markers of selective attention. Behaviorally, subjects recalled target streams most accurately with natural cues. Neurally, spatial attention significantly modulated early evoked sensory response magnitudes only for natural cues, not in conditions using only ITDs or IIDs. Consistent with this, parietal oscillatory power in the alpha band (8-14 ​Hz; associated with filtering out distracting events from unattended directions) showed significantly less attentional modulation with isolated spatial cues than with natural cues. Our findings support the hypothesis that spatial selective attention networks are only partially engaged by impoverished spatial auditory cues. These results not only suggest that studies using unnatural spatial cues underestimate the neural effects of spatial auditory attention, they also illustrate the importance of preserving natural spatial cues in assistive listening devices to support robust attentional control.