Lateralization of frequency-specific networks for covert spatial attention to auditory stimuli

Neural responses to naturalistic audiovisual speech are related to listening demand in cochlear implant users

There is a weak relationship between clinical and self-reported speech perception outcomes in cochlear implant (CI) listeners. Such poor correspondence may be due to differences in clinical and “real-world” listening environments and stimuli. Speech in the real world is often accompanied by visual cues, background environmental noise, and is generally in a conversational context, all factors that could affect listening demand. Thus, our objectives were to determine if brain responses to naturalistic speech could index speech perception and listening demand in CI users. Accordingly, we recorded high-density electroencephalogram (EEG) while CI users listened/watched a naturalistic stimulus (i.e., the television show, “The Office”). We used continuous EEG to quantify “speech neural tracking” (i.e., TRFs, temporal response functions) to the show’s soundtrack and 8–12 Hz (alpha) brain rhythms commonly related to listening effort. Background noise at three different signal-to-noise ratios (SNRs), +5, +10, and +15 dB were presented to vary the difficulty of following the television show, mimicking a natural noisy environment. The task also included an audio-only (no video) condition. After each condition, participants subjectively rated listening demand and the degree of words and conversations they felt they understood. Fifteen CI users reported progressively higher degrees of listening demand and less words and conversation with increasing background noise. Listening demand and conversation understanding in the audio-only condition was comparable to that of the highest noise condition (+5 dB). Increasing background noise affected speech neural tracking at a group level, in addition to eliciting strong individual differences. Mixed effect modeling showed that listening demand and conversation understanding were correlated to early cortical speech tracking, such that high demand and low conversation understanding occurred with lower amplitude TRFs. In the high noise condition, greater listening demand was negatively correlated to parietal alpha power, where higher demand was related to lower alpha power. No significant correlations were observed between TRF/alpha and clinical speech perception scores. These results are similar to previous findings showing little relationship between clinical speech perception and quality-of-life in CI users. However, physiological responses to complex natural speech may provide an objective measure of aspects of quality-of-life measures like self-perceived listening demand.

The Combination of Neural Tracking and Alpha Power Lateralization for Auditory Attention Detection

Purpose The acoustic source that is attended to by the listener in a mixture can be identified with a certain accuracy on the basis of their neural response recorded during listening, and various phenomena may be used to detect attention. For example, neural tracking (NT) and alpha power lateralization (APL) may be utilized in order to obtain information concerning attention. However, these methods of auditory attention detection (AAD) are typically tested in different experimental setups, which makes it impossible to compare their accuracy. The aim of this study is to compare the accuracy of AAD based on NT, APL, and their combination for a dichotic natural speech listening task. Method Thirteen adult listeners were presented with dichotic speech stimuli and instructed to attend to one of them. Electroencephalogram of the subjects was continuously recorded during the experiment using a set of 32 active electrodes. The accuracy of AAD was evaluated for trial lengths of 50, 25, and 12.5 s. AAD was tested for various parameters of NT- and APL-based modules. Results The obtained results suggest that NT of natural running speech provides similar accuracy to APL. The statistically significant improvement of the accuracy of AAD using a combined method has been observed not only for the longest duration of test samples (50 s, p = .005) but also for shorter ones (25 s, p = .011). Conclusions It seems that the combination of standard NT and APL significantly increases the effectiveness of accurate identification of the traced signal perceived by a listener under dichotic conditions. It has been demonstrated that, under certain conditions, the combination of NT and APL may provide a benefit for AAD in cocktail party scenarios.

Text type attribution modulates pre-stimulus alpha power in sentence reading

Prior knowledge and context-specific expectations influence the perception of sensory events, e.g., speech, as well as complex higher-order cognitive operations like text reading. Here, we focused on pre-stimulus neural activity during sentence reading to examine text type-dependent attentional bias in anticipation of written stimuli, capitalizing on the functional relevance of brain oscillations in the alpha (8-12 Hz) frequency range. Two sex- and age-matched groups of participants (n = 24 each) read identical sentences on a screen at a fixed per-constituent presentation rate while their electroencephalogram was recorded; the groups were differentially instructed to read "sentences" (genre-neutral condition) or "verses from poems" (poetry condition). Relative alpha power (pre-cue vs. post-cue) in pre-stimulus time windows was greater in the poetry condition than in the genre-neutral condition. This finding constitutes initial evidence for genre-specific cognitive adjustments that precede processing proper, and potentially links current theories of discourse comprehension to current theories of brain function.

Encoding, storage, and response preparation-Distinct EEG correlates of stimulus and action representations in working memory

Working memory (WM) allows for the active storage of stimulus- and higher level representations, such as action plans. This electroencephalography (EEG) study investigated the specific electrophysiological correlates dissociating action-related from stimulus-related representations in WM using three different experimental conditions based on the same stimulus material. In the experiment, a random sequence of single numbers (from 1 to 6) was presented and participants had to indicate whether the current number (N0 condition), the preceding number (N-1 condition), or the sum of the current and the preceding number (S-1 condition) was odd or even. Accordingly, participants had to store a stimulus representation in S-1 and an action representation in N-1 until the onset of the next stimulus. In the EEG, the storage of stimulus representations (S-1) was reflected by a fronto-central slow wave indicating the rehearsal of information that was required for the response in the following trial. In contrast, the storage of action representations (N-1) went along with a posterior positive slow wave, suggesting that the action plan was actively stored in WM until the presentation of the next stimulus. Crucially, preparing for the next response in N-1 was associated with increased contralateral mu/beta suppression, predicting the response time in the given trial. Our findings, thus, show that the WM processes for stimulus- and action representations can be clearly dissociated from each other with a distinct sequence of EEG correlates for encoding, storage, and response preparation.

Unraveling the Relation between EEG Correlates of Attentional Orienting and Sound Localization Performance: A Diffusion Model Approach

Understanding the contribution of cognitive processes and their underlying neurophysiological signals to behavioral phenomena has been a key objective in recent neuroscience research. Using a diffusion model framework, we investigated to what extent well-established correlates of spatial attention in the electroencephalogram contribute to behavioral performance in an auditory free-field sound localization task. Younger and older participants were instructed to indicate the horizontal position of a predefined target among three simultaneously presented distractors. The central question of interest was whether posterior alpha lateralization and amplitudes of the anterior contralateral N2 subcomponent (N2ac) predict sound localization performance (accuracy, mean RT) and/or diffusion model parameters (drift rate, boundary separation, non-decision time). Two age groups were compared to explore whether, in older adults (who struggle with multispeaker environments), the brain-behavior relationship would differ from younger adults. Regression analyses revealed that N2ac amplitudes predicted drift rate and accuracy, whereas alpha lateralization was not related to behavioral or diffusion modeling parameters. This was true irrespective of age. The results indicate that a more efficient attentional filtering and selection of information within an auditory scene, reflected by increased N2ac amplitudes, was associated with a higher speed of information uptake (drift rate) and better localization performance (accuracy), while the underlying response criteria (threshold separation), mean RTs, and non-decisional processes remained unaffected. The lack of a behavioral correlate of poststimulus alpha power lateralization constrasts with the well-established notion that prestimulus alpha power reflects a functionally relevant attentional mechanism. This highlights the importance of distinguishing anticipatory from poststimulus alpha power modulations.

More than Meets the Mind's Eye? Preliminary Observations Hint at Heterogeneous Alpha Neuromarkers for Visual Attention

With their salient power distribution and privileged timescale for cognition and behavior, brainwaves within the 10 Hz band are special in human waking electroencephalography (EEG). From the inception of electroencephalographic technology, the contribution of alpha rhythm to attention is well-known: Its amplitude increases when visual attention wanes or visual input is removed. However, alpha is not alone in the 10 Hz frequency band. A number of other 10 Hz neuromarkers have function and topography clearly distinct from alpha. In small pilot studies, an activity that we named xi was found over left centroparietal scalp regions when subjects held their attention to spatially peripheral locations while maintaining their gaze centrally ("looking from the corner of the eyes"). I outline several potential functions for xi as a putative neuromarker of covert attention distinct from alpha. I review methodological aids to test and validate their functional role. They emphasize high spectral resolution, sufficient spatial resolution to provide topographical separation, and an acute attention to dynamics that caters to neuromarkers' transiency.

Peripheral visual localization is degraded by globally incongruent auditory-spatial attention cues

Global auditory-spatial orienting cues help the detection of weak visual stimuli, but it is not clear whether crossmodal attention cues also enhance the resolution of visuospatial discrimination. Here, we hypothesized that if anywhere, crossmodal modulations of visual localization should emerge in the periphery where the receptive fields are large. Subjects were presented with trials where a Visual Target, defined by a cluster of low-luminance dots, was shown for 220 ms at 25°-35° eccentricity in either the left or right hemifield. The Visual Target was either Uncued or it was presented 250 ms after a crossmodal Auditory Cue that was simulated either from the same or the opposite hemifield than the Visual Target location. After a whole-screen visual mask displayed for 800 ms, a pair of vertical Reference Bars was presented ipsilateral to the Visual Target. In a two-alternative forced choice task, subjects were asked to determine which of these two bars was closer to the center of the Visual Target. When the Auditory Cue and Visual Target were hemispatially incongruent, the speed and accuracy of visual localization performance was significantly impaired. However, hemispatially congruent Auditory Cues did not improve the localization of Visual Targets when compared to the Uncued condition. Further analyses suggested that the crossmodal Auditory Cues decreased the sensitivity (d') of the Visual Target localization without affecting post-perceptual decision biases. Our results suggest that in the visual periphery, the detrimental effect of hemispatially incongruent Auditory Cues is far greater than the benefit produced by hemispatially congruent cues. Our working hypothesis for future studies is that auditory-spatial attention cues suppress irrelevant visual locations in a global fashion, without modulating the local visual precision at relevant sites.

EEG rhythms lateralization patterns in children with unilateral hearing loss are different from the patterns of normal hearing controls during speech-in-noise listening

Unilateral hearing loss constitutes a field of growing interest in the scientific community. In fact, this kind of patients represent a unique and physiological way to investigate how neuroplasticity overcame unilateral deafferentation by implementing particular strategies that produce apparently next- to- normal hearing behavioural performances. This explains why such patients have been underinvestigated for a long time. Thanks to the availability of techniques able to study the cerebral activity underlying the mentioned behavioural outcomes, the aim of the present research was to elucidate whether different electroencephalographic (EEG) patterns occurred in unilateral hearing loss (UHL) children in comparison to normal hearing (NH) controls during speech-in-noise listening. Given the intrinsic lateralized nature of such patients, due to the unilateral side of hearing impairment, the experimental question was to assess whether this would reflect a different EEG pattern while performing a word in noise recognition task varying the direction of the noise source. Results showed a correlation between the period of deafness and the cortical activity asymmetry toward the hearing ear side in the frontal, parietal and occipital areas in all the experimental conditions. Concerning alpha and beta activity in the frontal and central areas highlighted that in the NH group, the lateralization was always left-sided during the Quiet condition, while it was right-sided in noise conditions; this evidence was not, however, detected also in the UHL group. In addition, focusing on the theta and alpha activity in the frontal areas (Broca area) during noise conditions, while the activity was always left-lateralized in the NH group, it was ipsilateral to the direction of the background noise in the UHL group, and of a weaker extent than in NH controls. Furthermore, in noise conditions, only the UHL group showed a higher theta activity in the temporal areas ipsilateral to the side where the background noise was directed to. Finally, in the case of bilateral noise (background noise and word signal both coming from the same two sources), the theta and alpha activity in the frontal areas (Broca area) was left-lateralized in the case of the NH group and lateralized towards the side of the better hearing ear in the case of the UHL group. Taken together, this evidence supports the establishment of a particular EEG pattern occurrence in UHL children taking place in the frontal (Broca area), temporal and parietal lobes, probably physiologically established in order to deal with different sound and noise source directions.

Decoding spatial attention with EEG and virtual acoustic space

Decoding spatial attention based on brain signals has wide applications in brain–computer interface (BCI). Previous BCI systems mostly relied on visual patterns or auditory stimulation (e.g., loudspeakers) to evoke synchronous brain signals. There would be difficulties to cover a large range of spatial locations with such a stimulation protocol. The present study explored the possibility of using virtual acoustic space and a visual‐auditory matching paradigm to overcome this issue. The technique has the flexibility of generating sound stimulation from virtually any spatial location. Brain signals of eight human subjects were obtained with a 32‐channel Electroencephalogram (EEG). Two amplitude‐modulated noise or speech sentences carrying distinct spatial information were presented concurrently. Each sound source was tagged with a unique modulation phase so that the phase of the recorded EEG signals indicated the sound being attended to. The phase‐tagged sound was further filtered with head‐related transfer functions to create the sense of virtual space. Subjects were required to pay attention to the sound source that best matched the location of a visual target. For all the subjects, the phase of a single sound could be accurately reflected over the majority of electrodes based on EEG responses of 90 s or less. The electrodes providing significant decoding performance on auditory attention were fewer and may require longer EEG responses. The reliability and efficiency of decoding with a single electrode varied with subjects. Overall, the virtual acoustic space protocol has the potential of being used in practical BCI systems.

Selective Attention Enhances Beta-Band Cortical Oscillation to Speech under "Cocktail-Party" Listening Conditions

Human listeners are able to selectively attend to target speech in a noisy environment with multiple-people talking. Using recordings of scalp electroencephalogram (EEG), this study investigated how selective attention facilitates the cortical representation of target speech under a simulated “cocktail-party” listening condition with speech-on-speech masking. The result shows that the cortical representation of target-speech signals under the multiple-people talking condition was specifically improved by selective attention relative to the non-selective-attention listening condition, and the beta-band activity was most strongly modulated by selective attention. Moreover, measured with the Granger Causality value, selective attention to the single target speech in the mixed-speech complex enhanced the following four causal connectivities for the beta-band oscillation: the ones (1) from site FT7 to the right motor area, (2) from the left frontal area to the right motor area, (3) from the central frontal area to the right motor area, and (4) from the central frontal area to the right frontal area. However, the selective-attention-induced change in beta-band causal connectivity from the central frontal area to the right motor area, but not other beta-band causal connectivities, was significantly correlated with the selective-attention-induced change in the cortical beta-band representation of target speech. These findings suggest that under the “cocktail-party” listening condition, the beta-band oscillation in EEGs to target speech is specifically facilitated by selective attention to the target speech that is embedded in the mixed-speech complex. The selective attention-induced unmasking of target speech may be associated with the improved beta-band functional connectivity from the central frontal area to the right motor area, suggesting a top-down attentional modulation of the speech-motor process.

Neurofeedback Therapy for Enhancing Visual Attention: State-of-the-Art and Challenges

We have witnessed a rapid development of brain-computer interfaces (BCIs) linking the brain to external devices. BCIs can be utilized to treat neurological conditions and even to augment brain functions. BCIs offer a promising treatment for mental disorders, including disorders of attention. Here we review the current state of the art and challenges of attention-based BCIs, with a focus on visual attention. Attention-based BCIs utilize electroencephalograms (EEGs) or other recording techniques to generate neurofeedback, which patients use to improve their attention, a complex cognitive function. Although progress has been made in the studies of neural mechanisms of attention, extraction of attention-related neural signals needed for BCI operations is a difficult problem. To attain good BCI performance, it is important to select the features of neural activity that represent attentional signals. BCI decoding of attention-related activity may be hindered by the presence of different neural signals. Therefore, BCI accuracy can be improved by signal processing algorithms that dissociate signals of interest from irrelevant activities. Notwithstanding recent progress, optimal processing of attentional neural signals remains a fundamental challenge for the development of efficient therapies for disorders of attention.

Spectral and source structural development of mu and alpha rhythms from infancy through adulthood

OBJECTIVE

To assess the developmental trajectory of spectral, topographic, and source structural properties of functional mu desynchronization (characterized during voluntary reaching/grasping movement), and investigate its spectral/topographic relation to spontaneous EEG in the developing alpha band.

METHODS

Event related desynchronization (ERD) and power spectral density spectra/topography are analyzed in 12 month-old infants, 4 year-old children, and adults. Age-matched head models derived from structural MRI are used to obtain current density reconstructions of mu desynchronization across the cortical surface.

RESULTS

Infant/child EEG contains spectral peaks evident in both the upper and lower developing alpha band, and spectral/topographic properties of functionally identified mu rhythm strongly reflect those of upper alpha in all subject groups. Source reconstructions show distributed frontoparietal patterns of cortical mu desynchronization concentrated in specific central and parietal regions which are consistent across age groups.

CONCLUSIONS

Peak frequencies of mu desynchronization and spontaneous alpha band EEG increase with age, and characteristic mu topography/source-structure is evident in development at least as early as 12 months.

SIGNIFICANCE

Results provide evidence for a cortically distributed functional mu network, with spontaneous activity measurable in the upper alpha band throughout development.

Fronto-parietal network oscillations reveal relationship between working memory capacity and cognitive control

Executive-attention theory proposes a close relationship between working memory capacity (WMC) and cognitive control abilities. However, conflicting results are documented in the literature, with some studies reporting that individual variations in WMC predict differences in cognitive control and trial-to-trial control adjustments (operationalized as the size of the congruency effect and congruency sequence effects, respectively), while others report no WMC-related differences. We hypothesized that brain network dynamics might be a more sensitive measure of WMC-related differences in cognitive control abilities. Thus, in the present study, we measured human EEG during the Simon task to characterize WMC-related differences in the neural dynamics of conflict processing and adaptation to conflict. Although high- and low-WMC individuals did not differ behaviorally, there were substantial WMC-related differences in theta (4–8 Hz) and delta (1–3 Hz) connectivity in fronto-parietal networks. Group differences in local theta and delta power were relatively less pronounced. These results suggest that the relationship between WMC and cognitive control abilities is more strongly reflected in large-scale oscillatory network dynamics than in spatially localized activity or in behavioral task performance.

Envelope responses in single-trial EEG indicate attended speaker in a 'cocktail party'

OBJECTIVE

Recent studies have shown that auditory cortex better encodes the envelope of attended speech than that of unattended speech during multi-speaker ('cocktail party') situations. We investigated whether these differences were sufficiently robust within single-trial electroencephalographic (EEG) data to accurately determine where subjects attended. Additionally, we compared this measure to other established EEG markers of attention.

APPROACH

High-resolution EEG was recorded while subjects engaged in a two-speaker 'cocktail party' task. Cortical responses to speech envelopes were extracted by cross-correlating the envelopes with each EEG channel. We also measured steady-state responses (elicited via high-frequency amplitude modulation of the speech) and alpha-band power, both of which have been sensitive to attention in previous studies. Using linear classifiers, we then examined how well each of these features could be used to predict the subjects' side of attention at various epoch lengths.

MAIN RESULTS

We found that the attended speaker could be determined reliably from the envelope responses calculated from short periods of EEG, with accuracy improving as a function of sample length. Furthermore, envelope responses were far better indicators of attention than changes in either alpha power or steady-state responses.

SIGNIFICANCE

These results suggest that envelope-related signals recorded in EEG data can be used to form robust auditory BCI's that do not require artificial manipulation (e.g., amplitude modulation) of stimuli to function.

Dynamic oscillatory processes governing cued orienting and allocation of auditory attention

In everyday listening situations, we need to constantly switch between alternative sound sources and engage attention according to cues that match our goals and expectations. The exact neuronal bases of these processes are poorly understood. We investigated oscillatory brain networks controlling auditory attention using cortically constrained fMRI-weighted magnetoencephalography/EEG source estimates. During consecutive trials, participants were instructed to shift attention based on a cue, presented in the ear where a target was likely to follow. To promote audiospatial attention effects, the targets were embedded in streams of dichotically presented standard tones. Occasionally, an unexpected novel sound occurred opposite to the cued ear to trigger involuntary orienting. According to our cortical power correlation analyses, increased frontoparietal/temporal 30-100 Hz gamma activity at 200-1400 msec after cued orienting predicted fast and accurate discrimination of subsequent targets. This sustained correlation effect, possibly reflecting voluntary engagement of attention after the initial cue-driven orienting, spread from the TPJ, anterior insula, and inferior frontal cortices to the right FEFs. Engagement of attention to one ear resulted in a significantly stronger increase of 7.5-15 Hz alpha in the ipsilateral than contralateral parieto-occipital cortices 200-600 msec after the cue onset, possibly reflecting cross-modal modulation of the dorsal visual pathway during audiospatial attention. Comparisons of cortical power patterns also revealed significant increases of sustained right medial frontal cortex theta power, right dorsolateral pFC and anterior insula/inferior frontal cortex beta power, and medial parietal cortex and posterior cingulate cortex gamma activity after cued versus novelty-triggered orienting (600-1400 msec). Our results reveal sustained oscillatory patterns associated with voluntary engagement of auditory spatial attention, with the frontoparietal and temporal gamma increases being best predictors of subsequent behavioral performance.

Top-down influences on local networks: basic theory with experimental implications

The response of a population of cortical neurons to an external stimulus depends not only on the receptive field properties of the neurons, but also the level of arousal and attention or goal-oriented cognitive biases that guide information processing. These top-down effects on cortical neurons bias the output of the neurons and affect behavioral outcomes such as stimulus detection, discrimination, and response time. In any physiological study, neural dynamics are observed in a specific brain state; the background state partly determines neuronal excitability. Experimental studies in humans and animal models have also demonstrated that slow oscillations (typically in the alpha or theta bands) modulate the fast oscillations (gamma band) associated with local networks of neurons. Cross-frequency interaction is of interest as a mechanism for top-down or bottom up interactions between systems at different spatial scales. We develop a generic model of top-down influences on local networks appropriate for comparison with EEG. EEG provides excellent temporal resolution to investigate neuronal oscillations but is space-averaged on the cm scale. Thus, appropriate EEG models are developed in terms of population synaptic activity. We used the Wilson–Cowan population model to investigate fast (gamma band) oscillations generated by a local network of excitatory and inhibitory neurons. We modified the Wilson–Cowan equations to make them more physiologically realistic by explicitly incorporating background state variables into the model. We found that the population response is strongly influenced by the background state. We apply the model to reproduce the modulation of gamma rhythms by theta rhythms as has been observed in animal models and human ECoG and EEG studies. The concept of a dynamic background state presented here using the Wilson–Cowan model can be readily applied to incorporate top-down modulation in more detailed models of specific cortical systems.

Pre- and post-stimulus alpha activity shows differential modulation with spatial attention during the processing of pain

Extensive work using magneto- and electroencephalography (M/EEG) suggests that cortical alpha activity represents a top-down controlled gating mechanism employed by processes like attention across different modalities. However, it is not yet clear to what extent this presumed gating function of alpha activity also applies to the processing of pain. In the current study, a spatial attention paradigm was employed requiring subjects to attend to painful laser stimuli on one hand while ignoring stimuli on the other hand. Simultaneously, brain activity was recorded with MEG. In order to disentangle pre- and post-stimulus effects of attention, alpha activity was analyzed during time windows in anticipation of and in response to painful laser stimulation. Painful laser stimuli led to a suppression of alpha activity over both ipsi- and contralateral primary somatosensory areas irrespective if they were attended or ignored. Spatial attention was associated with a lateralization of anticipatory pre-stimulus alpha activity. Alpha activity was lower over primary somatosensory areas when the contralateral hand was attended compared to when the ipsilateral hand was attended, in line with the notion that oscillatory alpha activity regulates the flow of incoming information by engaging and/or disengaging early sensory areas. On the contrary, post-stimulus alpha activity, for stimuli on either hand, was consistently decreased with attention over contralateral areas. Most likely, this finding reflects an increased cortical activation and enhanced alerting if a painful stimulus is attended. The present results show that spatial attention results in a modulation of both pre- and post-stimulus alpha activity associated with pain. This flexible regulation of alpha activity matches findings from other modalities. We conclude that the assumed functional role of alpha activity as a top-down controlled gating mechanism includes pain processing and most likely represents a unified mechanism used throughout the brain.