Searching for auditory targets in external space and in working memory: Electrophysiological mechanisms underlying perceptual and retroactive spatial attention

Brain areas associated with visual spatial attention display topographic organization during auditory spatial attention

Spatially selective modulation of alpha power (8-14 Hz) is a robust finding in electrophysiological studies of visual attention, and has been recently generalized to auditory spatial attention. This modulation pattern is interpreted as reflecting a top-down mechanism for suppressing distracting input from unattended directions of sound origin. The present study on auditory spatial attention extends this interpretation by demonstrating that alpha power modulation is closely linked to oculomotor action. We designed an auditory paradigm in which participants were required to attend to upcoming sounds from one of 24 loudspeakers arranged in a circular array around the head. Maintaining the location of an auditory cue was associated with a topographically modulated distribution of posterior alpha power resembling the findings known from visual attention. Multivariate analyses allowed the prediction of the sound location in the horizontal plane. Importantly, this prediction was also possible, when derived from signals capturing saccadic activity. A control experiment on auditory spatial attention confirmed that, in absence of any visual/auditory input, lateralization of alpha power is linked to the lateralized direction of gaze. Attending to an auditory target engages oculomotor and visual cortical areas in a topographic manner akin to the retinotopic organization associated with visual attention.

Contralateral delay activity, but not alpha lateralization, indexes prioritization of information for working memory storage

Working memory is inherently limited, which makes it important to select and maintain only task-relevant information and to protect it from distraction. Previous research has suggested the contralateral delay activity (CDA) and lateralized alpha oscillations as neural candidates for such a prioritization process. While most of this work focused on distraction during encoding, we examined the effect of external distraction presented during memory maintenance. Participants memorized the orientations of three lateralized objects. After an initial distraction-free maintenance interval, distractors appeared in the same location as the targets or in the opposite hemifield. This distraction was followed by another distraction-free interval. Our results show that CDA amplitudes were stronger in the interval before compared with the interval after the distraction (i.e., CDA amplitudes were stronger in response to targets compared with distractors). This amplitude reduction in response to distractors was more pronounced in participants with higher memory accuracy, indicating prioritization and maintenance of relevant over irrelevant information. In contrast, alpha lateralization did not change from the interval before distraction compared with the interval after distraction, and we found no correlation between alpha lateralization and memory accuracy. These results suggest that alpha lateralization plays no direct role in either selective maintenance of task-relevant information or inhibition of distractors. Instead, alpha lateralization reflects the current allocation of spatial attention to the most salient information regardless of task-relevance. In contrast, CDA indicates flexible allocation of working memory resources depending on task-relevance.

Cross-modal interactions at the audiovisual cocktail-party revealed by behavior, ERPs, and neural oscillations

Theories of attention argue that objects are the units of attentional selection. In real-word environments such objects can contain visual and auditory features. To understand how mechanisms of selective attention operate in multisensory environments, in this pre-registered study, we created an audiovisual cocktail-party situation, in which two speakers (left and right of fixation) simultaneously articulated brief numerals. In three separate blocks, informative auditory speech was presented (a) alone or paired with (b) congruent or (c) uninformative visual speech. In all blocks, subjects localized a pre-defined numeral. While audiovisual-congruent and uninformative speech improved response times and speed of information uptake according to diffusion modeling, an ERP analysis revealed that this did not coincide with enhanced attentional engagement. Yet, consistent with object-based attentional selection, the deployment of auditory spatial attention (N2ac) was accompanied by visuo-spatial attentional orienting (N2pc) irrespective of the informational content of visual speech. Notably, an N2pc component was absent in the auditory-only condition, demonstrating that a sound-induced shift of visuo-spatial attention relies on the availability of audio-visual features evolving coherently in time. Additional exploratory analyses revealed cross-modal interactions in working memory and modulations of cognitive control.

Pattern reinstatement and attentional control overlap during episodic long-term memory retrieval

Episodic long-term memory (eLTM) retrieval involves the reinstatement of neural patterns from the encoding phase. However, recent evidence suggests that comparable cortical activity patterns can also be linked to attentional control processes on the level of memory representations. The current investigation assesses these two processes independently based on alpha-beta-band activity in the electroencephalogram (EEG). During encoding, subjects were presented with an object on a certain position on the screen and had to imagine it on a new position. In each trial, either the task-irrelevant presentation position or the task-relevant imagination position was lateralized. In the retrieval phase, subjects first made an old/new judgement based on centrally presented objects and then reported the imagination position. Pattern reinstatement should be reflected in similar lateralized alpha-beta activity during encoding and retrieval. Conversely, the influence of attentional control processes during retrieval would be associated with the suppression of alpha-beta power contralateral to the to-be-reported imagination position and with the increase of activity contralateral to the irrelevant presentation position. Our results support this latter pattern. This shows that an experimental differentiation between selective attention and pattern reinstatement processes is necessary when studying the neural basis of eLTM retrieval.

The impact of retro-cue validity on working memory representation: Evidence from electroencephalograms

Visual working memory (VWM) performance can be improved by retrospectively cueing an item. The validity of retro-cues has an impact on the mechanisms underlying the retro-cue effect, but how non-cued representations are handled under different retro-cue validity conditions is not yet clear. Here, we used electroencephalograms to investigate whether retro-cue validity can affect the fate of non-cued representations in VWM. The participants were required to perform a change-detection task using a retro-cue with 80% or 20% validity. Contralateral delay activity and the lateralized alpha power were used to assess memory storage and selective attention, respectively. The retro-cue could redirect selective attention to the cued item under both validity conditions; however, the participants maintained the non-cued representations under the low-validity condition but dropped them from VWM under the high-validity condition. These results suggest that the maintenance of non-cued representations in VWM is affected by the expectation of cue validity and may be partially strategically driven. DATA AVAILABILITY: The datasets generated/analyzed during this study and experimental script have been added to https://osf.io/qtwc9/.

Development of Perceptual Inhibition in Adolescents—A Critical Period?

Recent studies suggest that the developmental curves in adolescence, related to the development of executive functions, could be fitted to a non-linear trajectory of development with progressions and retrogressions. Therefore, the present study proposes to analyze the pattern of development in Perceptual Inhibition (PI), considering all stages of adolescence (early, middle, and late) in intervals of one year. To this aim, we worked with a sample of 275 participants between 10 and 25 years, who performed a joint visual and search task (to measure PI). We have fitted ex-Gaussian functions to the probability distributions of the mean response time across the sample and performed a covariance analysis (ANCOVA). The results showed that the 10- to 13-year-old groups performed similarly in the task and differ from the 14- to 19-year-old participants. We found significant differences between the older group and all the rest of the groups. We discuss the important changes that can be observed in relation to the nonlinear trajectory of development that would show the PI during adolescence.

Effects of temporal order and intentionality on reflective attention to words in noise

Speech perception in noise is a cognitively demanding process that challenges not only the auditory sensory system, but also cognitive networks involved in attention. The predictive coding theory has been influential in characterizing the influence of prior context on processing incoming auditory stimuli, with comparatively less research dedicated to "postdictive" processes and subsequent context effects on speech perception. Effects of subsequent semantic context were evaluated while manipulating the relationship of three target words presented in noise and the temporal position of targets compared to the subsequent contextual cue, demonstrating that subsequent context benefits were present regardless of whether the targets were related to each other and did not depend on the position of the target. However, participants instructed to focus on the relation between target and cue performed worse than those who did not receive this instruction, suggesting a disruption of a natural process of continuous speech recognition. We discuss these findings in relation to lexical commitment and stimulus-driven attention to short-term memory as mechanisms of subsequent context integration.

EEG correlates of spatial shifts of attention in a dynamic multi-talker speech perception scenario in younger and older adults

Speech perception under "cocktail-party" conditions critically depends on the focusing of attention toward the talker of interest. In dynamic auditory scenes, changes in talker settings require rapid shifts of attention, which is especially relevant when the position of a target talker switches from one location to another. Here, we explored electrophysiological correlates of shifts in spatial auditory attention, using a free-field speech perception task, in which sequences of short words (a company name, followed by a numeric value, e.g., "Bosch-6") were presented in the participants' left and right horizontal plane. Younger and older participants responded to the value of a pre-defined target company, while ignoring three simultaneously presented pairs of concurrent company names and values from different locations. All four stimulus pairs were spoken by different talkers, alternating from trial-to-trial. The location of the target company was within either the left or right hemisphere for a variable number of consecutive trials (between 3 and 42 trials) and then changed, switching from the left to the right hemispace or vice versa. Thus, when a switch occurred, the participants had to search for the new position of the target company among the concurrent streams of auditory information and re-focus their attention on the relevant location. As correlates of lateralized spatial auditory attention, the anterior contralateral N2 subcomponent (N2ac) and the posterior alpha power lateralization were analyzed in trials immediately before and after switches of the target location. Both measures were increased after switches, while only the increase in N2ac was related to better speech perception performance (i.e., a reduced post-switch decline in accuracy). While both age groups showed a similar pattern of switch-related attentional modulations, N2ac and alpha lateralization to the task-relevant stimulus (the target company's value) was overall greater in the younger, than older, group. The results suggest that N2ac and alpha lateralization reflect different attentional processes in multi-talker speech perception, the first being primarily associated with auditory search and the focusing of attention, and the second with the in-depth attentional processing of task-relevant information. Especially the second process appears to be prone to age-related cognitive decline.

A dual mechanism underlying retroactive shifts of auditory spatial attention: dissociating target- and distractor-related modulations of alpha lateralization

Attention can be allocated to mental representations to select information from working memory. To date, it remains ambiguous whether such retroactive shifts of attention involve the inhibition of irrelevant information or the prioritization of relevant information. Investigating asymmetries in posterior alpha-band oscillations during an auditory retroactive cueing task, we aimed at differentiating those mechanisms. Participants were cued to attend two out of three sounds in an upcoming sound array. Importantly, the resulting working memory representation contained one laterally and one centrally presented item. A centrally presented retro-cue then indicated the lateral, the central, or both items as further relevant for the task (comparing the cued item(s) to a memory probe). Time–frequency analysis revealed opposing patterns of alpha lateralization depending on target eccentricity: A contralateral decrease in alpha power in target lateral trials indicated the involvement of target prioritization. A contralateral increase in alpha power when the central item remained relevant (distractor lateral trials) suggested the de-prioritization of irrelevant information. No lateralization was observed when both items remained relevant, supporting the notion that auditory alpha lateralization is restricted to situations in which spatial information is task-relevant. Altogether, the data demonstrate that retroactive attentional deployment involves excitatory and inhibitory control mechanisms.

Unraveling the Relation between EEG Correlates of Attentional Orienting and Sound Localization Performance: A Diffusion Model Approach

Understanding the contribution of cognitive processes and their underlying neurophysiological signals to behavioral phenomena has been a key objective in recent neuroscience research. Using a diffusion model framework, we investigated to what extent well-established correlates of spatial attention in the electroencephalogram contribute to behavioral performance in an auditory free-field sound localization task. Younger and older participants were instructed to indicate the horizontal position of a predefined target among three simultaneously presented distractors. The central question of interest was whether posterior alpha lateralization and amplitudes of the anterior contralateral N2 subcomponent (N2ac) predict sound localization performance (accuracy, mean RT) and/or diffusion model parameters (drift rate, boundary separation, non-decision time). Two age groups were compared to explore whether, in older adults (who struggle with multispeaker environments), the brain-behavior relationship would differ from younger adults. Regression analyses revealed that N2ac amplitudes predicted drift rate and accuracy, whereas alpha lateralization was not related to behavioral or diffusion modeling parameters. This was true irrespective of age. The results indicate that a more efficient attentional filtering and selection of information within an auditory scene, reflected by increased N2ac amplitudes, was associated with a higher speed of information uptake (drift rate) and better localization performance (accuracy), while the underlying response criteria (threshold separation), mean RTs, and non-decisional processes remained unaffected. The lack of a behavioral correlate of poststimulus alpha power lateralization constrasts with the well-established notion that prestimulus alpha power reflects a functionally relevant attentional mechanism. This highlights the importance of distinguishing anticipatory from poststimulus alpha power modulations.

Electrophysiological evidence supports the role of sustained visuospatial attention in maintaining visual WM contents

Recent empirical and theoretical work suggests that there is a close relationship between visual working memory (WM) and visuospatial attention. Here, we investigated whether visuospatial attention was involved in maintaining object representations in visual WM. To this end, the alpha lateralization and contralateral delay activity (CDA) were analyzed as neural markers for visuospatial attention and visual WM storage, respectively. In the single-task condition, participants performed a grating change-detection task. To probe the role of visuospatial attention in maintaining WM contents, two color squares were presented above and below the fixation point during the retention interval, which remained visible until the detection display was present. In the dual-task condition, participants were required to maintain lateralized gratings while staring at the center-presented color squares, to detect possible subsequent color change. With this task, sustained visuospatial attention that guided to individual memory representations was disrupted. The behavioral data showed that, the insertion of secondary task significantly deteriorated WM performance. For electrophysiological data, we divided the retention interval into two stages, the early stage and late stage, bounded by the onset of the secondary task. We found that CDA amplitude was lower under the dual-task condition than the single-task condition during the late stage, but not the early stage, and the extent to which CDA reduced tracked the impaired memory performance at the individual level. Also, alpha lateralization only could be observed in the single-task condition of the late stage, and completely disappeared in the dual-task condition, indicating the disruption of visuospatial attention directed to memory representations. Individuals who experienced greater visuospatial attention disruption, as indicated by the alpha lateralization, had lower maintenance-associated neural activity (CDA), and suffered greater impairment of memory performance. These findings confirm that sustained visuospatial attention continues improving visual WM processing after the initial encoding phase, and most likely participates in this process by supporting the maintenance of representations in an active state.