Posterior α EEG Dynamics Dissociate Current from Future Goals in Working Memory-Guided Visual Search

Neural Signatures of Competition between Voluntary and Involuntary Influences over the Focus of Attention in Visual Working Memory

Adaptive behavior relies on the selection and prioritization of relevant sensory inputs from the external environment as well as from among internal sensory representations held in working memory. Recent behavioral evidence suggests that the classic distinction between voluntary (goal-driven) and involuntary (stimulus-driven) influences over attentional allocation also applies to the selection of internal representations held in working memory. In the current EEG study, we set out to investigate the neural dynamics associated with the competition between voluntary and involuntary control over the focus of attention in visual working memory. We show that when voluntary and involuntary factors compete for the internal focus of attention, prioritization of the appropriate item is delayed-as reflected both in delayed gaze biases that track internal selection and in delayed neural beta (15-25 Hz) dynamics that track the planning for the upcoming memory-guided manual action. We further show how this competition is paralleled-possibly resolved-by an increase in frontal midline theta (4-8 Hz) activity that, moreover, predicts the speed of ensuing memory-guided behavior. Finally, because theta increased following retrocues that effectively reduced working-memory load, our data unveil how frontal theta activity during internal attentional focusing tracks demands on cognitive control over and above working-memory load. Together, these data yield new insight into the neural dynamics that govern the focus of attention in visual working memory, and disentangle the contributions of frontal midline theta activity to the processes of control versus retention in working memory.

Internal attention modulates the functional state of novel stimulus-response associations in working memory

Information in working memory (WM) is crucial for guiding behavior. However, not all WM representations are equally relevant simultaneously. Current theoretical frameworks propose a functional dissociation between 'latent' and 'active' states, in which relevant representations are prioritized into an optimal (active) state to face current demands, while relevant information that is not immediately needed is maintained in a dormant (latent) state. In this context, task demands can induce rapid and flexible prioritization of information from latent to active state. Critically, these functional states have been primarily studied using simple visual memories, with attention selecting and prioritizing relevant representations to serve as templates to guide subsequent behavior. It remains unclear whether more complex WM representations, such as novel stimulus-response associations, can also be prioritized into different functional states depending on their task relevance, and if so how these different formats relate to each other. In the present study, we investigated whether novel WM-guided actions can be brought into different functional states depending on current task demands. Our results reveal that planned actions can be flexibly prioritized when needed and show how their functional state modulates their influence on ongoing behavior. Moreover, they suggest the representations of novel actions of different functional states are maintained in WM via a non-orthogonal coding scheme, thus are prone to interference.

The reactivation of task rules triggers the reactivation of task-relevant items

Working memory (WM) describes the temporary storage of task-relevant items and procedural rules to guide action. Despite its central importance for goal-directed behavior, the interplay between WM and long-term memory (LTM) remains poorly understood. Recent studies have shown that repeated use of the same task-relevant item in WM results in a hand-off of the storage of that item to LTM, and switching to a new item reactivates WM. To further elucidate the rules governing WM-LTM interactions, we here planned to probe whether a change in task rules, independent of a switch in task-relevant items, would also lead to WM reactivation of maintained items. To this end, we used scalp-recorded electroencephalogram (EEG) data, specifically the contralateral delay activity (CDA), to track WM item storage while manipulating repetitions and changes in task rules and task-relevant items across trials in a visual WM task. We tested two rival hypotheses: If changes in task rules result in a reactivation of the target item representation, then the CDA should increase when a task change is cued even when the same target has been repeated across trials. However, if the reactivation of a task-relevant item only depends on the mnemonic availability of the item itself instead of the task it is used for, then only the changes in task-relevant items should reactivate the representations. Accordingly, the CDA amplitude should decrease for repeated task-relevant items independently of a task change. We found a larger CDA on task-switch compared to task-repeat trials, suggesting that the reactivation of task rules triggers the reactivation of task-relevant items in WM. By demonstrating that WM reactivation of LTM is interdependent for task rules and task-relevant items, this study informs our understanding of visual WM and its interplay with LTM. PREREGISTERED STAGE 1 PROTOCOL: https://osf.io/zp9e8 (date of in-principle acceptance: 19/12/2021).

The Electrophysiological Markers of Statistically Learned Attentional Enhancement: Evidence for a Saliency-based Mechanism

It is well established that attention can be sharpened through the process of statistical learning (e.g., visual search becomes faster when targets appear at high-relative-to-low probability locations). Although this process of statistically learned attentional enhancement differs behaviorally from the well-studied top-down and bottom-up forms of attention, relatively little work has been done to characterize the electrophysiological correlates of statistically learned attentional enhancement. It thus remains unclear whether statistically learned enhancement recruits any of the same cognitive mechanisms as top-down or bottom-up attention. In the current study, EEG data were collected while participants searched for an ambiguous unique shape in a visual array (the additional singleton task). Unbeknownst to the participants, targets appeared more frequently in one location in space (probability cuing). Encephalographic data were then analyzed in two phases: an anticipatory phase and a reactive phase. In the anticipatory phase preceding search stimuli onset, alpha lateralization as well as the Anterior Directing Attention Negativity and Late Directing Attention Positivity components-signs of preparatory attention known to characterize top-down enhancement-were tested. In the reactive phase, the N2pc component-a well-studied marker of target processing-was examined following stimuli onset. Our results showed that statistically learned attentional enhancement is not characterized by any of the well-known anticipatory markers of top-down attention; yet targets at high probability locations did reliably evoke larger N2pc amplitudes, a finding that is associated with bottom-up attention and saliency. Overall, our findings are consistent with the notion that statistically learned attentional enhancement increases the perceptual salience of items appearing at high-probability locations relative to low-probability locations.

Parietal cortical alpha/beta suppression during prospective memory retrieval

Prospective memory (PM) impairment is among the most frequent memory complaints, yet little is known about the underlying neural mechanisms. PM for a planned intention may be achieved through strategic monitoring of the environment for cues, involving ongoing attentional processes, or through spontaneous retrieval. We hypothesized that parietal spectral power modulation accompanies prospectively encoded intention retrieval, irrespective of PM retrieval approach. A cognitively engaging arithmetic-based ongoing task (OGT) was employed to encourage spontaneous retrieval, with a focal, internally generated PM cue to eliminate OGT/PM trial differentiation based on perceptual or conceptual PM cue features. Two PM repetition frequencies were used to vary the extent of strategic monitoring. We observed a transient parietal alpha/beta spectral power reduction directly preceding the response, which was distinguishable on a single trial basis, as revealed by an OGT/PM trial classification rate exceeding 70% using linear discriminant analysis. The alpha/beta idling rhythm reflects cortical inhibition. A disengagement of task-relevant neural assemblies from this rhythm, reflected in alpha/beta power reduction, is deemed to increase information content, facilitate information integration, and enable engagement of neural assemblies in task-related cortical networks. The observed power reduction is consistent with the Dual Pathways model, where PM strategies converge at the PM retrieval stage.

Vigilant attention mediates the association between resting EEG alpha oscillations and word learning ability

Individuals exhibit considerable variability in their capacity to learn and retain new information, including novel vocabulary. Prior research has established the importance of vigilance and electroencephalogram (EEG) alpha rhythm in the learning process. However, the interplay between vigilant attention, EEG alpha oscillations, and an individual's word learning ability (WLA) remains elusive. To address this knowledge gap, here we conducted two experiments with a total of 140 young and middle-aged adults who underwent resting EEG recordings prior to completing a paired-associate word learning task and a psychomotor vigilance test (PVT). The results of both experiments consistently revealed significant positive correlations between WLA and resting EEG alpha oscillations in the occipital and frontal regions. Furthermore, the association between resting EEG alpha oscillations and WLA was mediated by vigilant attention, as measured by the PVT. These findings provide compelling evidence supporting the crucial role of vigilant attention in linking EEG alpha oscillations to an individual's learning ability.

Pinging the brain to reveal the hidden attentional priority map using encephalography

Attention has been usefully thought of as organized in priority maps - putative maps of space where attentional priority is weighted across spatial regions in a winner-take-all competition for attentional deployment. Recent work has highlighted the influence of past experiences on the weighting of spatial priority - called selection history. Aside from being distinct from more well-studied, top-down forms of attentional enhancement, little is known about the neural substrates of history-mediated attentional priority. Using a task known to induce statistical learning of target distributions, in an EEG study we demonstrate that this otherwise invisible, latent attentional priority map can be visualized during the intertrial period using a 'pinging' technique in conjunction with multivariate pattern analyses. Our findings not only offer a method of visualizing the history-mediated attentional priority map, but also shed light on the underlying mechanisms allowing our past experiences to influence future behavior.

Turning Attention Inside Out: How Working Memory Serves Behavior

Flexible behavior requires guidance not only by sensations that are available immediately but also by relevant mental contents carried forward through working memory. Therefore, selective-attention functions that modulate the contents of working memory to guide behavior (inside-out) are just as important as those operating on sensory signals to generate internal contents (outside-in). We review the burgeoning literature on selective attention in the inside-out direction and underscore its functional, flexible, and future-focused nature. We discuss in turn the purpose (why), targets (what), sources (when), and mechanisms (how) of selective attention inside working memory, using visual working memory as a model. We show how the study of internal selective attention brings new insights concerning the core cognitive processes of attention and working memory and how considering selective attention and working memory together paves the way for a rich and integrated understanding of how mind serves behavior.

Stable decoding of working memory load through frequency bands

Numerous studies have shown that working memory modulates every frequency band's power in the human brain. Yet, the question of how the highly distributed working memory adapts to external demands remains unresolved. Here, we explored frequency band modulations underlying working memory load, taking executive control under account. We hypothesized that synchronizations underlying various cognitive functions may be sequenced in time to avoid interference and that transient modulation of decoding accuracy of task difficulty would vary with increasing difficulty. We recorded whole scalp EEG data from 12 healthy participants, while they performed a visuo-spatial n-back task with three conditions of increasing difficulty, after an initial learning phase. We analyzed evoked spectral perturbations and time-resolved decoding of individual synchronization. Surprisingly, our results provide evidence for persistent decoding above the level-of-chance (83.17% AUC) for combined frequency bands. In fact, the decoding accuracy was higher for the combined than for isolated frequency bands (AUC from 65.93% to 74.30%). However, in line with our hypothesis, frequency band clusters transiently emerged in parieto-occipital regions within two separate time windows for alpha-/beta-band (relative synchronization from approximately 200 to 600 ms) and for the delta-/theta-band (relative desynchronization from approximately 600 to 1000 ms). Overall, these findings highlight concurrent sustained and transient measurable features of working memory load. This could reflect the emergence of stability within and between functional networks of the complex working memory system. In turn, this process allows energy savings to cope with external demands.

Resting state electroencephalographic rhythms are affected by immediately preceding memory demands in cognitively unimpaired elderly and patients with mild cognitive impairment

Experiments on event-related electroencephalographic oscillations in aged people typically include blocks of cognitive tasks with a few minutes of interval between them. The present exploratory study tested the effect of being engaged on cognitive tasks over the resting state cortical arousal after task completion, and whether it differs according to the level of the participant’s cognitive decline. To investigate this issue, we used a local database including data in 30 healthy cognitively unimpaired (CU) persons and 40 matched patients with amnestic mild cognitive impairment (aMCI). They had been involved in 2 memory tasks for about 40 min and underwent resting-state electroencephalographic (rsEEG) recording after 5 min from the task end. eLORETA freeware estimated rsEEG alpha source activity as an index of general cortical arousal. In the CU but not aMCI group, there was a negative correlation between memory tasks performance and posterior rsEEG alpha source activity. The better the memory tasks performance, the lower the posterior alpha activity (i.e., higher cortical arousal). There was also a negative correlation between neuropsychological test scores of global cognitive status and alpha source activity. These results suggest that engagement in memory tasks may perturb background brain arousal for more than 5 min after the tasks end, and that this effect are dependent on participants global cognitive status. Future studies in CU and aMCI groups may cross-validate and extend these results with experiments including (1) rsEEG recordings before memory tasks and (2) post-tasks rsEEG recordings after 5, 15, and 30 min.

Long-term memory retrieval bypasses working memory

For decades, it has been assumed that when humans retrieve information from long-term memory (LTM), information need first to be brought back into working memory (WM). However, as WM capacity is limited, it is unclear what happens if information from LTM needs to be retrieved while WM is fully engaged? To address this question, observers had to retrieve colors from LTM while WM storage capacity was fully engaged. The behavioral results showed that retrieving information from LTM is possible even when WM capacity is fully occupied. Additional evidence from electroencephalogram (EEG) confirmed that WM was fully engaged as the suppression of alpha oscillation reached its maximum when memorizing the maximum amount of information into WM; yet the suppression in alpha oscillation was even further amplified when items were retrieved simultaneously from LTM, providing a neural signature of additional LTM retrieval capacity above and beyond the maximum WM capacity. Together, our findings indicate that information retrieved from LTM does not always have to be brought back into WM, but instead might be accessed through a different mechanism when WM is fully engaged.

Pattern reinstatement and attentional control overlap during episodic long-term memory retrieval

Episodic long-term memory (eLTM) retrieval involves the reinstatement of neural patterns from the encoding phase. However, recent evidence suggests that comparable cortical activity patterns can also be linked to attentional control processes on the level of memory representations. The current investigation assesses these two processes independently based on alpha-beta-band activity in the electroencephalogram (EEG). During encoding, subjects were presented with an object on a certain position on the screen and had to imagine it on a new position. In each trial, either the task-irrelevant presentation position or the task-relevant imagination position was lateralized. In the retrieval phase, subjects first made an old/new judgement based on centrally presented objects and then reported the imagination position. Pattern reinstatement should be reflected in similar lateralized alpha-beta activity during encoding and retrieval. Conversely, the influence of attentional control processes during retrieval would be associated with the suppression of alpha-beta power contralateral to the to-be-reported imagination position and with the increase of activity contralateral to the irrelevant presentation position. Our results support this latter pattern. This shows that an experimental differentiation between selective attention and pattern reinstatement processes is necessary when studying the neural basis of eLTM retrieval.

Parietal Alpha Oscillatory Peak Frequency Mediates the Effect of Practice on Visuospatial Working Memory Performance

Visuospatial working memory (WM) requires the activity of a spread network, including right parietal regions, to sustain storage capacity, attentional deployment, and active manipulation of information. Notably, while the electrophysiological correlates of such regions have been explored using many different indices, evidence for a functional involvement of the individual frequency peaks in the alpha (IAF) and theta bands (ITF) is still poor despite their relevance in many influential theories regarding WM. Interestingly, there is also a parallel lack of literature about the effect of short-term practice on WM performance. Here, we aim to clarify whether the simple repetition of a change-detection task might be beneficial to WM performance and to which degree these effects could be predicted by IAF and ITF. For this purpose, 25 healthy participants performed a change-detection task at baseline and in a retest session, while IAF and ITF were also measured. Results show that task repetition improves WM performance. In addition, right parietal IAF, but not ITF, accounts for performance gain such that faster IAF predicts higher performance gain. Our findings align with recent literature suggesting that the faster the posterior alpha, the finer the perceptual sampling rate, and the higher the WM performance gain.

Decoding Object-Based Auditory Attention from Source-Reconstructed MEG Alpha Oscillations

How do we attend to relevant auditory information in complex naturalistic scenes? Much research has focused on detecting which information is attended, without regarding underlying top-down control mechanisms. Studies investigating attentional control generally manipulate and cue specific features in simple stimuli. However, in naturalistic scenes it is impossible to dissociate relevant from irrelevant information based on low-level features. Instead, the brain has to parse and select auditory objects of interest. The neural underpinnings of object-based auditory attention remain not well understood. Here we recorded MEG while 15 healthy human subjects (9 female) prepared for the repetition of an auditory object presented in one of two overlapping naturalistic auditory streams. The stream containing the repetition was prospectively cued with 70% validity. Crucially, this task could not be solved by attending low-level features, but only by processing the objects fully. We trained a linear classifier on the cortical distribution of source-reconstructed oscillatory activity to distinguish which auditory stream was attended. We could successfully classify the attended stream from alpha (8-14 Hz) activity in anticipation of repetition onset. Importantly, attention could only be classified from trials in which subjects subsequently detected the repetition, but not from miss trials. Behavioral relevance was further supported by a correlation between classification accuracy and detection performance. Decodability was not sustained throughout stimulus presentation, but peaked shortly before repetition onset, suggesting that attention acted transiently according to temporal expectations. We thus demonstrate anticipatory alpha oscillations to underlie top-down control of object-based auditory attention in complex naturalistic scenes.SIGNIFICANCE STATEMENT In everyday life, we often find ourselves bombarded with auditory information, from which we need to select what is relevant to our current goals. Previous research has highlighted how we attend to specific highly controlled aspects of the auditory input. Although invaluable, it is still unclear how this relates to attentional control in naturalistic auditory scenes. Here we used the high precision of magnetoencephalography in space and time to investigate the brain mechanisms underlying top-down control of object-based attention in ecologically valid sound scenes. We show that rhythmic activity in auditory association cortex at a frequency of ∼10 Hz (alpha waves) controls attention to currently relevant segments within the auditory scene and predicts whether these segments are subsequently detected.

Oscillatory brain activity links experience to expectancy during associative learning

Associating a novel situation with a specific outcome involves a cascade of cognitive processes, including selecting relevant stimuli, forming predictions regarding expected outcomes, and updating memorized predictions based on experience. The present manuscript uses computational modeling and machine learning to test the hypothesis that alpha-band (8-12 Hz) oscillations are involved in the updating of expectations based on experience. Participants learned that a visual cue predicted an aversive loud noise with a probability of 50%. The Rescorla-Wagner model of associative learning explained trial-wise changes in self-reported noise expectancy as well as alpha power changes. Experience in the past trial and self-reported expectancy for the subsequent trial were accurately decoded based on the topographical distribution of alpha power at specific latencies. Decodable information during initial association formation and contingency report recurred when viewing the conditioned cue. Findings support the idea that alpha oscillations have multiple, temporally specific, roles in the formation of associations between cues and outcomes.

From "satisfaction of search" to "subsequent search misses": a review of multiple-target search errors across radiology and cognitive science

For over 50 years, the satisfaction of search effect has been studied within the field of radiology. Defined as a decrease in detection rates for a subsequent target when an initial target is found within the image, these multiple target errors are known to underlie errors of omission (e.g., a radiologist is more likely to miss an abnormality if another abnormality is identified). More recently, they have also been found to underlie lab-based search errors in cognitive science experiments (e.g., an observer is more likely to miss a target 'T' if a different target 'T' was detected). This phenomenon was renamed the subsequent search miss (SSM) effect in cognitive science. Here we review the SSM literature in both radiology and cognitive science and discuss: (1) the current SSM theories (i.e., satisfaction, perceptual set, and resource depletion theories), (2) the eye movement errors that underlie the SSM effect, (3) the existing efforts tested to alleviate SSM errors, and (4) the evolution of methodologies and analyses used when calculating the SSM effect. Finally, we present the attentional template theory, a novel mechanistic explanation for SSM errors, which ties together our current understanding of SSM errors and the attentional template literature.

Alpha oscillation during the performance of a new variant of working memory-guided saccade task: Evidence from behavioral and electroencephalographic analyses

Working memory (WM) can be considered as a limited-capacity system which is capable of saving information temporarily with the aim of processing. The aim of the present study was to establish whether eccentricity representation in WM could be decoded from eletroencephalography (EEG) alpha-band oscillation in parietal cortex during delay-period while performing memory-guided saccade (MGS) task. In this regard, we recorded EEG and Eye-tracking signals of 17 healthy volunteers in a variant version of MGS task. We designed the modified version of MGS task for the first time to investigate the effect of locating stimuli in two different positions, in a near (6°) eccentricity and far (12°) eccentricity on saccade error as a behavioral parameter. Another goal of study was to discern whether or not varying the stimuli loci can alter behavioral and eletroencephalographical data while performing the variant version of MGS task. Our findings demonstrate that saccade error for the near fixation condition is significantly smaller than the far from fixation condition. We observed an increase in alpha power in parietal lobe in near vs far conditions. In addition, the results indicate that the increase in alpha (8-12 Hz) power from fixation to memory was negatively correlated with saccade error. The novel approach of using simultaneous EEG/Eye-tracking recording in the modified MGS task provided both behavioral and electroencephalographic analyses for oscillatory activity during this new version of MGS task.

A Hierarchy of Functional States in Working Memory

Extensive research has examined how information is maintained in working memory (WM), but it remains unknown how WM is used to guide behavior. We addressed this question by combining human electrophysiology (50 subjects, male and female) with pattern analyses, cognitive modeling, and a task requiring the prolonged maintenance of two WM items and priority shifts between them. This enabled us to discern neural states coding for memories that were selected to guide the next decision from states coding for concurrently held memories that were maintained for later use, and to examine how these states contribute to WM-based decisions. Selected memories were encoded in a functionally active state. This state was reflected in spontaneous brain activity during the delay period, closely tracked moment-to-moment fluctuations in the quality of evidence integration, and also predicted when memories would interfere with each other. In contrast, concurrently held memories were encoded in a functionally latent state. This state was reflected only in stimulus-evoked brain activity, tracked memory precision at longer timescales, but did not engage with ongoing decision dynamics. Intriguingly, the two functional states were highly flexible, as priority could be dynamically shifted back and forth between memories without degrading their precision. These results delineate a hierarchy of functional states, whereby latent memories supporting general maintenance are transformed into active decision circuits to guide flexible behavior.SIGNIFICANCE STATEMENT Working memory enables maintenance of information that is no longer available in the environment. Abundant neuroscientific work has examined where in the brain working memories are stored, but it remains unknown how they are represented and used to guide behavior. Our study shows that working memories are represented in qualitatively different formats, depending on behavioral priorities. Memories that are selected for guiding behavior are encoded in an active state that transforms sensory input into decision variables, whereas other concurrently held memories are encoded in a latent state that supports precise maintenance without affecting ongoing cognition. These results dissociate mechanisms supporting memory storage and usage, and open the door to reveal not only where memories are stored but also how.

Allocation of resources in working memory: Theoretical and empirical implications for visual search

Recently, working memory (WM) has been conceptualized as a limited resource, distributed flexibly and strategically between an unlimited number of representations. In addition to improving the precision of representations in WM, the allocation of resources may also shape how these representations act as attentional templates to guide visual search. Here, we reviewed recent evidence in favor of this assumption and proposed three main principles that govern the relationship between WM resources and template-guided visual search. First, the allocation of resources to an attentional template has an effect on visual search, as it may improve the guidance of visual attention, facilitate target recognition, and/or protect the attentional template against interference. Second, the allocation of the largest amount of resources to a representation in WM is not sufficient to give this representation the status of attentional template and thus, the ability to guide visual search. Third, the representation obtaining the status of attentional template, whether at encoding or during maintenance, receives an amount of WM resources proportional to its relevance for visual search. Thus defined, the resource hypothesis of visual search constitutes a parsimonious and powerful framework, which provides new perspectives on previous debates and complements existing models of template-guided visual search.

Linking the Rapid Cascade of Visuo-Attentional Processes to Successful Memory Encoding

While it is broadly accepted that attention modulates memory, the contribution of specific rapid attentional processes to successful encoding is largely unknown. To investigate this issue, we leveraged the high temporal resolution of electroencephalographic recordings to directly link a cascade of visuo-attentional neural processes to successful encoding: namely (1) the N2pc (peaking ~200 ms), which reflects stimulus-specific attentional orienting and allocation, (2) the sustained posterior-contralateral negativity (post-N2pc), which has been associated with sustained visual processing, (3) the contralateral reduction in oscillatory alpha power (contralateral reduction in alpha > 200 ms), which has also been independently related to attentionally sustained visual processing. Each of these visuo-attentional processes was robustly predictive of successful encoding, and, moreover, each enhanced memory independently of the classic, longer-latency, conceptually related, difference-due-to memory (Dm) effect. Early latency midfrontal theta power also promoted successful encoding, with at least part of this influence being mediated by the later latency Dm effect. These findings markedly expand current knowledge by helping to elucidate the intimate relationship between attentional modulations of perceptual processing and effective encoding for later memory retrieval.

Neural mechanisms underlying distractor inhibition on the basis of feature and/or spatial expectations

A rapidly growing body of research indicates that inhibition of distracting information may not be under flexible, top-down control, but instead heavily relies on expectations derived from past experience about the likelihood of events. Yet, how expectations about distracting information influence distractor inhibition at the neural level remains unclear. To determine how expectations induced by distractor features and/or location regularities modulate distractor processing, we measured EEG while participants performed two variants of the additional singleton paradigm. Critically, in these different variants, target and distractor features either randomly swapped across trials, or were fixed, allowing for the development of distractor feature-based expectations. Moreover, the task was initially performed without any spatial regularity, after which a high probability distractor location was introduced. Our results show that both distractor feature- and location regularities contributed to distractor inhibition, as indicated by corresponding reductions in distractor costs during visual search and an earlier distractor-evoked Pd component. Yet, control analyses showed that while observers were sensitive to regularities across longer time scales, the observed effects to a large extent reflected intertrial repetition. Large individual differences further suggest a functional dissociation between early and late Pd components, with the former reflecting early sensory suppression related to intertrial priming and the latter reflecting suppression sensitive to expectations derived over a longer time scale. Also, counter to some previous findings, no increase in anticipatory alpha-band activity was observed over visual regions representing the expected distractor location, although this effect should be interpreted with caution as the effect of spatial statistical learning was also less pronounced than in other studies. Together, these findings suggest that intertrial priming and statistical learning may both contribute to distractor suppression and reveal the underlying neural mechanisms.

EEG, MEG and neuromodulatory approaches to explore cognition: Current status and future directions

Neural oscillations and their association with brain states and cognitive functions have been object of extensive investigation over the last decades. Several electroencephalography (EEG) and magnetoencephalography (MEG) analysis approaches have been explored and oscillatory properties have been identified, in parallel with the technical and computational advancement. This review provides an up-to-date account of how EEG/MEG oscillations have contributed to the understanding of cognition. Methodological challenges, recent developments and translational potential, along with future research avenues, are discussed.

Neural mechanisms underlying expectation-dependent inhibition of distracting information

Predictions based on learned statistical regularities in the visual world have been shown to facilitate attention and goal-directed behavior by sharpening the sensory representation of goal-relevant stimuli in advance. Yet, how the brain learns to ignore predictable goal-irrelevant or distracting information is unclear. Here, we used EEG and a visual search task in which the predictability of a distractor's location and/or spatial frequency was manipulated to determine how spatial and feature distractor expectations are neurally implemented and reduce distractor interference. We find that expected distractor features could not only be decoded pre-stimulus, but their representation differed from the representation of that same feature when part of the target. Spatial distractor expectations did not induce changes in preparatory neural activity, but a strongly reduced Pd, an ERP index of inhibition. These results demonstrate that neural effects of statistical learning critically depend on the task relevance and dimension (spatial, feature) of predictions.

Visual Working Memory Guides Spatial Attention: Evidence from alpha oscillations and sustained potentials

Selective attention can facilitate performance by filtering irrelevant information and temporary maintaining limited information to accomplish the current task. However, the neural substrate how attentional selection can be guided by visual working memory (vWM) is not clear. Here, we recorded electrophysiological signals during vWM retention and investigated the relationship between objects held in memorial templates and the subsequent attentional selection during visual search. We observed that sustained posterior contralateral delay activity (CDA) was present and scaled with lateral vWM loads during the whole period of vWM retention, but that it was absent when objects were bilaterally held in vWM. Surprisingly, a strikingly similar pattern emerged for modulations in the averaged posterior alpha (8-12 Hz) power during the late period but not during the early period of retention. More importantly, it was the alpha modulation, but not the CDA, that strongly predicted the subsequent biomarker of attentional selection (the memorial template-induced N2pc) during visual search. We further observed the N2pc amplitudes decreased with increasing memory loads and predicted the same gradation of the final behavioral accuracy in visual search. All these results suggested that the subsequent memorial template-induced N2pc is response to the level of top-down attentional guiding effect caused by vWM. Our results provide neurophysiological evidence that keeping multiple templates in working memory simultaneously weakens the guiding effect to the following attentional selection.

Oscillatory brain activity and maintenance of verbal and visual working memory: A systematic review

Brain oscillations likely play a significant role in the storage of information in working memory (WM). Despite the wide popularity of the topic, current attempts to summarize the research in the field are narrative reviews. We address this gap by providing a descriptive systematic review, in which we investigated oscillatory correlates of maintenance of verbal and visual information in WM. The systematic approach enabled us to challenge some common views popularized by previous research. The identified literature (100 EEG/MEG studies) highlighted the importance of theta oscillations in verbal WM: frontal midline theta enhanced with load in most verbal studies, while more equivocal results have been obtained in visual studies. Increasing WM load affected alpha activity in most studies, but the direction of the effect was inconsistent: the ratio of studies that found alpha increase versus decrease with increasing load was 80/20% in the verbal WM domain and close to 60/40% in the visual domain. Alpha asymmetry (left < right) was a common finding in both verbal and visual WM studies. Beta and gamma activity studies yielded the least convincing data: a diversity in the spatial and frequency distribution of beta activity prevented us from making a coherent conclusion; gamma rhythm was virtually neglected in verbal WM studies with no systematic support for sustained gamma changes during the delay in EEG studies in general.

Flexible Working Memory Through Selective Gating and Attentional Tagging

Working memory is essential: it serves to guide intelligent behavior of humans and nonhuman primates when task-relevant stimuli are no longer present to the senses. Moreover, complex tasks often require that multiple working memory representations can be flexibly and independently maintained, prioritized, and updated according to changing task demands. Thus far, neural network models of working memory have been unable to offer an integrative account of how such control mechanisms can be acquired in a biologically plausible manner. Here, we present WorkMATe, a neural network architecture that models cognitive control over working memory content and learns the appropriate control operations needed to solve complex working memory tasks. Key components of the model include a gated memory circuit that is controlled by internal actions, encoding sensory information through untrained connections, and a neural circuit that matches sensory inputs to memory content. The network is trained by means of a biologically plausible reinforcement learning rule that relies on attentional feedback and reward prediction errors to guide synaptic updates. We demonstrate that the model successfully acquires policies to solve classical working memory tasks, such as delayed recognition and delayed pro-saccade/anti-saccade tasks. In addition, the model solves much more complex tasks, including the hierarchical 12-AX task or the ABAB ordered recognition task, both of which demand an agent to independently store and updated multiple items separately in memory. Furthermore, the control strategies that the model acquires for these tasks subsequently generalize to new task contexts with novel stimuli, thus bringing symbolic production rule qualities to a neural network architecture. As such, WorkMATe provides a new solution for the neural implementation of flexible memory control.

Temporal Expectations Prepare Visual Working Memory for Behavior

Working memory enables us to retain past sensations in service of anticipated task demands. How we prepare for anticipated task demands during working memory retention remains poorly understood. Here, we focused on the role of time—asking how temporal expectations help prepare for ensuing memory-guided behavior. We manipulated the expected probe time in a delayed change-detection task and report that temporal expectation can have a profound influence on memory-guided behavioral performance. EEG measurements corroborated the utilization of temporal expectations: demonstrating the involvement of a classic EEG signature of temporal expectation—the contingent negative variation—in the context of working memory. We also report the influence of temporal expectations on 2 EEG signatures associated with visual working memory—the lateralization of 8- to 12-Hz alpha activity, and the contralateral delay activity. We observed a dissociation between these signatures, whereby alpha lateralization (but not the contralateral delay activity) adapted to the time of expected memory utilization. These data show how temporal expectations prepare visual working memory for behavior and shed new light on the electrophysiological markers of both temporal expectation and working memory.

One Thing Leads to Another: Anticipating Visual Object Identity Based on Associative-Memory Templates

Probabilistic associations between stimuli afford memory templates that guide perception through proactive anticipatory mechanisms. A great deal of work has examined the behavioral consequences and human electrophysiological substrates of anticipation following probabilistic memory cues that carry spatial or temporal information to guide perception. However, less is understood about the electrophysiological substrates linked to anticipating the sensory content of events based on recurring associations between successive events. Here, we demonstrate behavioral and electrophysiological signatures of using associative-memory templates to guide perception, while equating spatial and temporal anticipation (experiments 1 and 2), as well as target probability and response demands (experiment 2). By recording the electroencephalogram in the two experiments (N = 55; 24 females), we show that two markers in human electrophysiology implicated in spatial and temporal anticipation also contribute to the anticipation of perceptual identity, as follows: attenuation of alpha-band oscillations and the contingent negative variation (CNV). Together, our results show that memory-guided identity templates proactively impact perception and are associated with anticipatory states of attenuated alpha oscillations and the CNV. Furthermore, by isolating object-identity anticipation from spatial and temporal anticipation, our results suggest a role for alpha attenuation and the CNV in specific visual content anticipation beyond general changes in neural excitability or readiness.SIGNIFICANCE STATEMENT Probabilistic associations between stimuli afford memory templates that guide perception through proactive anticipatory mechanisms. The current work isolates the behavioral benefits and electrophysiological signatures of memory-guided identity-based anticipation, while equating anticipation of space, time, motor responses, and task relevance. Our results show that anticipation of the specific identity of a forthcoming percept impacts performance and is associated with states of attenuated alpha oscillations and the contingent negative variation, extending previous work implicating these neural substrates in spatial and temporal preparatory attention. Together, this work bridges fields of attention, memory, and perception, providing new insights into the neural mechanisms that support complex attentional templates.

Do we remember templates better so that we can reject distractors better?

Feature Integration Theory proposed that attention shifted between target-like representations in our visual field. However, the nature of the representations that determined what was target like received less specification than the nature of the attention shifts. In recent years, visual search research has focused on the nature of the memory representations that we use to guide our shifts of attention. Sensitive measures of memory quality indicate that the template representations are remembered better than other, merely maintained, memories. Here we tested the hypothesis that we prepare for difficult search tasks by storing a higher fidelity target representation in working memory than we do when preparing for an easy search task. To test this hypothesis, we explicitly tested participants' memory of the target color they searched for (i.e., the attentional template) versus another memory that was not used to guide attention (i.e., an accessory representation) following blocks of searches with easy-to-find targets (i.e., distractors were homogeneously colored) to blocks of searches with hard-to-find targets (i.e., distractors were heterogeneously colored). Although homogeneous-distractor searches required minimal precision for distractor rejection, we found that templates were still remembered better than accessories, just like we found in a heterogeneous-distractor search. As a consequence, we suggest that stronger memories for templates likely reflects the need to decide whether new perceptual inputs match the template, and not an attempt to create a better template representation in anticipation of difficult searches.

Oscillatory Control over Representational States in Working Memory

In the visual world, attention is guided by perceptual goals activated in visual working memory (VWM). However, planning multiple-task sequences also requires VWM to store representations for future goals. These future goals need to be prevented from interfering with the current perceptual task. Recent findings have implicated neural oscillations as a control mechanism serving the implementation and switching of different states of prioritization of VWM representations. We review recent evidence that posterior alpha-band oscillations underlie the flexible activation and deactivation of VWM representations and that frontal delta-to-theta-band oscillations play a role in the executive control of this process. That is, frontal delta-to-theta appears to orchestrate posterior alpha through long-range oscillatory networks to flexibly set up and change VWM states during multitask sequences.

Electrophysiological evidence supports the role of sustained visuospatial attention in maintaining visual WM contents

Recent empirical and theoretical work suggests that there is a close relationship between visual working memory (WM) and visuospatial attention. Here, we investigated whether visuospatial attention was involved in maintaining object representations in visual WM. To this end, the alpha lateralization and contralateral delay activity (CDA) were analyzed as neural markers for visuospatial attention and visual WM storage, respectively. In the single-task condition, participants performed a grating change-detection task. To probe the role of visuospatial attention in maintaining WM contents, two color squares were presented above and below the fixation point during the retention interval, which remained visible until the detection display was present. In the dual-task condition, participants were required to maintain lateralized gratings while staring at the center-presented color squares, to detect possible subsequent color change. With this task, sustained visuospatial attention that guided to individual memory representations was disrupted. The behavioral data showed that, the insertion of secondary task significantly deteriorated WM performance. For electrophysiological data, we divided the retention interval into two stages, the early stage and late stage, bounded by the onset of the secondary task. We found that CDA amplitude was lower under the dual-task condition than the single-task condition during the late stage, but not the early stage, and the extent to which CDA reduced tracked the impaired memory performance at the individual level. Also, alpha lateralization only could be observed in the single-task condition of the late stage, and completely disappeared in the dual-task condition, indicating the disruption of visuospatial attention directed to memory representations. Individuals who experienced greater visuospatial attention disruption, as indicated by the alpha lateralization, had lower maintenance-associated neural activity (CDA), and suffered greater impairment of memory performance. These findings confirm that sustained visuospatial attention continues improving visual WM processing after the initial encoding phase, and most likely participates in this process by supporting the maintenance of representations in an active state.

Anticipatory Distractor Suppression Elicited by Statistical Regularities in Visual Search

Salient yet irrelevant objects often capture our attention and interfere with our daily tasks. Distraction by salient objects can be reduced by suppressing the location where they are likely to appear. The question we addressed here was whether suppression of frequent distractor locations is already implemented beforehand, in anticipation of the stimulus. Using EEG, we recorded cortical activity of human participants searching for a target while ignoring a salient distractor. The distractor was presented more often at one location than at any other location. We found reduced capture for distractors at frequent locations, indicating that participants learned to avoid distraction. Critically, we found evidence for “proactive suppression” as already “prior to display onset,” there was enhanced power in parieto-occipital alpha oscillations contralateral to the frequent distractor location—a signal known to occur in anticipation of irrelevant information. Locked to display onset, ERP analysis showed a distractor suppression-related distractor positivity (PD) component for this location. Importantly, this PD was found regardless of whether distracting information was presented at the frequent location. In addition, there was an early PD component representing an early attentional index of the frequent distractor location. Our results show anticipatory (proactive) suppression of frequent distractor locations in visual search already starting prior to display onset.

EEG dynamics reveal a dissociation between storage and selective attention within working memory

Selective attention plays a prominent role in prioritizing information in working memory (WM), improving performance for attended representations. However, it remains unclear whether unattended WM representations suffer from information loss. Here we tested the hypothesis that within WM, selectively attending to an item and stopping storing other items are independent mechanisms. We recorded EEG while participants performed a WM recall task in which the item most likely to be tested was cued retrospectively during retention. By manipulating retro-cue reliability (i.e., the ratio of valid to invalid cue trials), we varied the incentive to retain non-cued items. Storage and selective attention in WM were measured during the retention interval by contralateral delay activity (CDA) and contralateral alpha power suppression, respectively. Soon after highly reliable cues, the cued item was attended, and non-cued items suffered information loss. However, for less reliable cues, initially the cued item was attended, but unattended items were kept in WM. Later during the delay, previously unattended items suffered information loss despite now attention being reallocated to their locations, presumably to strengthen their weakening traces. These results show that storage and attention in WM are distinct processes that can behave differently depending on the relative importance of representations.

Resting EEG in alpha and beta bands predicts individual differences in attentional breadth

Whether individuals focus their attention on the global level (the forest), or local elements that make up the stimulus (the trees) remains relatively stable over a period of at least 10 days in multiple global/local measures. Greater attentional approach tendencies and vigilance, which are likely reflected by lower alpha and higher beta power, are associated with narrowed attentional breadth. The current study investigated whether individual differences in the propensity for individuals to focus on the global or local levels (attentional breadth) can be predicted based on EEG power in alpha and its neighbouring frequency bands during a preceding rest period. Greater levels of posterior alpha and preponderance of alpha-to-beta power at rest were associated with greater attentional breadth during the subsequent Navon letters task. These results suggest that neural indices of attentional approach when not engaged in a goal-orientated task are associated with individual differences in attentional breadth.

Oscillatory Mechanisms of Preparing for Visual Distraction

Evidence shows that observers preactivate a target representation in preparation of a visual selection task. In this study, we addressed the question if and how preparing to ignore an anticipated distractor differs from preparing for an anticipated target. We measured EEG while participants memorized a laterally presented color, which was cued to be either a target or a distractor in two subsequent visual search tasks. Decoding the location of items in the search display from EOG channels revealed that, initially, the anticipated distractor attracted attention and could only be ignored later during the trial. This suggests that distractors could not be suppressed in advance but were represented in an active, attention-guiding format. Consistent with this, lateralized posterior alpha power did not dissociate between target and distractor templates during the delay periods, suggesting similar encoding and maintenance. However, distractor preparation did lead to relatively enhanced nonlateralized posterior alpha power, which appeared to gate sensory processing at search display onset to prevent attentional capture in general. Finally, anticipating distractors also led to enhanced midfrontal theta power during the delay period, a signal that was predictive of how strongly both target and distractor were represented in the search display. Together, our results speak against a distractor-specific advance inhibitory template, thus contrary to the preactivation of specific target templates. Rather, we demonstrate a general selection suppression mechanism, which serves to prevent initial involuntary capture by anticipated distracting input.

Learning What Is Irrelevant or Relevant: Expectations Facilitate Distractor Inhibition and Target Facilitation through Distinct Neural Mechanisms

It is well known that attention can facilitate performance by top-down biasing processing of task-relevant information in advance. Recent findings from behavioral studies suggest that distractor inhibition is not under similar direct control but strongly dependent on expectations derived from previous experience. Yet, how expectations about distracting information influence distractor inhibition at the neural level remains unclear. The current study addressed this outstanding question in three experiments in which search displays with repeating distractor or target locations across trials allowed human observers (male and female) to learn which location to selectively suppress or boost. Behavioral findings demonstrated that both distractor and target location learning resulted in more efficient search, as indexed by faster response times. Crucially, distractor learning benefits were observed without target location foreknowledge, unaffected by the number of possible target locations, and could not be explained by priming alone. To determine how distractor location expectations facilitated performance, we applied a spatial encoding model to EEG data to reconstruct activity in neural populations tuned to distractor or target locations. Target location learning increased neural tuning to target locations in advance, indicative of preparatory biasing. This sensitivity increased after target presentation. By contrast, distractor expectations did not change preparatory spatial tuning. Instead, distractor expectations reduced distractor-specific processing, as reflected in the disappearance of the Pd event-related potential component, a neural marker of distractor inhibition, and decreased decoding accuracy. These findings suggest that the brain may no longer process expected distractors as distractors, once it has learned they can safely be ignored.SIGNIFICANCE STATEMENT We constantly try hard to ignore conspicuous events that distract us from our current goals. Surprisingly, and in contrast to dominant attention theories, ignoring distracting, but irrelevant, events does not seem to be as flexible as is focusing our attention on those same aspects. Instead, distractor suppression appears to strongly rely on learned, context-dependent expectations. Here, we investigated how learning about upcoming distractors changes distractor processing and directly contrasted the underlying neural dynamics to target learning. We show that, while target learning enhanced anticipatory sensory tuning, distractor learning only modulated reactive suppressive processing. These results suggest that expected distractors may no longer be considered distractors by the brain once it has learned that they can safely be ignored.

Concurrent visual and motor selection during visual working memory guided action

Visual working memory enables us to hold onto past sensations in anticipation that these may become relevant for guiding future actions. Yet laboratory tasks have treated visual working memories in isolation from their prospective actions and have focused on the mechanisms of memory retention rather than utilization. To understand how visual memories become used for action, we linked individual memory items to particular actions and independently tracked the neural dynamics of visual and motor selection when memories became used for action. This revealed concurrent visual-motor selection, engaging appropriate visual and motor brain areas at the same time. Thus we show that items in visual working memory can invoke multiple, item-specific, action plans that can be accessed together with the visual representations that guide them, affording fast and precise memory-guided behavior.

Distinct prioritization of visual working memory representations for search and for recall

Despite the inherent limitations of visual working memory (VWM), it effectively supports numerous everyday behaviors - capabilities that are due, in part, to its flexibility. An observer can flexibly prioritize VWM representations to support at least two behavioral outcomes: An item can be prioritized to enhance its representational quality, thereby enhancing recall precision, and an item can be granted "template status," allowing it to bias attention during visual search, speeding search for matching targets. Here we examined the relationship between these two forms of prioritization. Research has shown that a byproduct of granting an item template status is that its precision is enhanced; however, it is unclear if the inverse is also true: Does prioritizing an item for enhanced representational quality cause that item to bias attention? In the present study, participants remembered the colors of two squares for a subsequent recall task, and one was cued, indicating it was 80% likely to be the target of the memory test. To assess template status, a subset of trials ended in a visual search task in which a colored singleton distractor matched the color of the cued item in memory, the non-cued item, or an unrelated color. We found that, although the cue was effective at enhancing recall precision of the cued item, it had no systematic effect on which of the two memory items was granted template status. Thus, we conclude that the two forms of prioritization in VWM - prioritization for recall and for search - are distinct.

Beta and Theta Oscillations Differentially Support Free Versus Forced Control over Multiple-Target Search

Many important situations require human observers to simultaneously search for more than one object. Despite a long history of research into visual search, the behavioral and neural mechanisms associated with multiple-target search are poorly understood. Here we test the novel theory that the efficiency of looking for multiple targets critically depends on the mode of cognitive control the environment affords to the observer. We used an innovative combination of electroencephalogram (EEG) and eye tracking while participants searched for two targets, within two different contexts: either both targets were present in the search display and observers were free to prioritize either one of them, thus enabling proactive control over selection; or only one of the two targets would be present in each search display, which requires reactive control to reconfigure selection when the wrong target has been prioritized. During proactive control, both univariate and multivariate signals of beta-band (15-35 Hz) power suppression before display onset predicted switches between target selections. This signal originated over midfrontal and sensorimotor regions and has previously been associated with endogenous state changes. In contrast, imposed target selections requiring reactive control elicited prefrontal power enhancements in the delta/theta band (2-8 Hz), but only after display onset. This signal predicted individual differences in associated oculomotor switch costs, reflecting reactive reconfiguration of target selection. The results provide compelling evidence that multiple target representations are differentially prioritized during visual search, and for the first time reveal distinct neural mechanisms underlying proactive and reactive control over multiple-target search.SIGNIFICANCE STATEMENT Searching for more than one object in complex visual scenes can be detrimental for search performance. Although perhaps annoying in daily life, this can have severe consequences in professional settings such as medical and security screening. Previous research has not yet resolved whether multiple-target search involves changing priorities in what people attend to, and how such changes are controlled. We approached these questions by concurrently measuring cortical activity and eye movements using EEG and eye tracking while observers searched for multiple possible targets. Our findings provide the first unequivocal support for the existence of two modes of control during multiple-target search, which are expressed in qualitatively distinct time-frequency signatures of the EEG both before and after visual selection.

Priority Switches in Visual Working Memory are Supported by Frontal Delta and Posterior Alpha Interactions

Visual working memory (VWM) distinguishes between representations relevant for imminent versus future perceptual goals. We investigated how the brain sequentially prioritizes visual working memory representations that serve consecutive tasks. Observers remembered two targets for a sequence of two visual search tasks, thus making one target currently relevant, and the other prospectively relevant. We show that during the retention interval prior to the first search, lateralized parieto-occipital EEG alpha (8-14 Hz) suppression is stronger for current compared with prospective search targets. Crucially, between the first and second search task, this difference in posterior alpha lateralization reverses, reflecting the change in priority states of the two target representations. Connectivity analyses indicate that this switch in posterior alpha lateralization is driven by frontal delta/low-theta (2-6 Hz) activity. Moreover, this frontal low-frequency signal also predicts task performance after the switch. We thus obtained evidence for large-scale network interactions underlying the flexible shifting between the priority states of multiple memory representations in VWM.