On the contribution of motor planning to the retroactive cuing benefit in working memory: Evidence by mu and beta oscillatory activity in the EEG

A Neural Decision Signal during Internal Sampling from Working Memory in Humans

How humans transform sensory information into decisions that steer purposeful behavior is a central question in psychology and neuroscience that is traditionally investigated during the sampling of external environmental signals. The decision-making framework of gradual information sampling toward a decision has also been proposed to apply when sampling internal sensory evidence from working memory. However, neural evidence for this proposal remains scarce. Here we show (using scalp EEG in male and female human volunteers) that sampling internal visual representations from working memory elicits a scalp EEG potential associated with gradual evidence accumulation-the central parietal positivity. Consistent with an evolving decision process, we show how this signal (1) scales with the time participants require to reach a decision about the cued memory content and (2) is amplified when having to decide among multiple contents in working memory. These results bring the electrophysiology of decision-making into the domain of working memory and suggest that variability in memory-guided behavior may be driven (at least in part) by variations in the sampling of our inner mental contents.

Neural Signatures of Competition between Voluntary and Involuntary Influences over the Focus of Attention in Visual Working Memory

Adaptive behavior relies on the selection and prioritization of relevant sensory inputs from the external environment as well as from among internal sensory representations held in working memory. Recent behavioral evidence suggests that the classic distinction between voluntary (goal-driven) and involuntary (stimulus-driven) influences over attentional allocation also applies to the selection of internal representations held in working memory. In the current EEG study, we set out to investigate the neural dynamics associated with the competition between voluntary and involuntary control over the focus of attention in visual working memory. We show that when voluntary and involuntary factors compete for the internal focus of attention, prioritization of the appropriate item is delayed-as reflected both in delayed gaze biases that track internal selection and in delayed neural beta (15-25 Hz) dynamics that track the planning for the upcoming memory-guided manual action. We further show how this competition is paralleled-possibly resolved-by an increase in frontal midline theta (4-8 Hz) activity that, moreover, predicts the speed of ensuing memory-guided behavior. Finally, because theta increased following retrocues that effectively reduced working-memory load, our data unveil how frontal theta activity during internal attentional focusing tracks demands on cognitive control over and above working-memory load. Together, these data yield new insight into the neural dynamics that govern the focus of attention in visual working memory, and disentangle the contributions of frontal midline theta activity to the processes of control versus retention in working memory.

Be prepared for interruptions: EEG correlates of anticipation when dealing with task interruptions and the role of aging

Dealing with task interruptions requires the flexible use of working memory and attentional control mechanisms, which are prone to age-related changes. We investigated effects of age on dealing with task interruptions and potential advantages of anticipating an interruption using EEG and a retrospective cueing (retro-cue) paradigm. Thirty-two young (18-30 years) and 28 older (55-70 years) participants performed a visual working memory task, where they had to report the orientation of a target following a retro-cue. Within blocks of 10 trials, they were always, never, or randomly interrupted with an arithmetic task before the onset of the retro-cue. The interruption-induced decline in primary task performance was more pronounced in older participants, while only these benefited from anticipation. The EEG analysis revealed reduced theta and alpha/beta response to the retro-cue following interruptions, especially for the older participants. In both groups, anticipated interruptions were associated with increased theta and alpha/beta power prior and during the interruption, and stronger beta suppression to the retro-cue. The results indicate that interruptions impede the refocusing of attention on the task-relevant representation of the primary task, especially in older people, while anticipation facilitates preparation for the interruption task and resumption of the primary task.

Prospection of Potential Actions during Visual Working Memory Starts Early, Is Flexible, and Predicts Behavior

For visual working memory to serve upcoming behavior, it is crucial that we prepare for the potential use of working-memory contents ahead of time. Recent studies have demonstrated how the prospection and planning for an upcoming manual action starts early after visual encoding, and occurs alongside visual retention. Here, we address whether such "output planning" in visual working memory flexibly adapts to different visual-motor mappings, and occurs even when an upcoming action will only potentially become relevant for behavior. Human participants (female and male) performed a visual-motor working memory task in which they remembered one or two colored oriented bars for later (potential) use. We linked, and counterbalanced, the tilt of the visual items to specific manual responses. This allowed us to track planning of upcoming behavior through contralateral attenuation of β band activity, a canonical motor-cortical EEG signature of manual-action planning. The results revealed how action encoding and subsequent planning alongside visual working memory (1) reflect anticipated task demands rather than specific visual-motor mappings, (2) occur even for actions that will only potentially become relevant for behavior, and (3) are associated with faster performance for the encoded item, at the expense of performance to other working-memory content. This reveals how the potential prospective use of visual working memory content is flexibly planned early on, with consequences for the speed of memory-guided behavior.SIGNIFICANCE STATEMENT It is increasingly studied how visual working memory helps us to prepare for the future, in addition to how it helps us to hold onto the past. Recent studies have demonstrated that the planning of prospective actions occurs alongside encoding and retention in working memory. We show that such early "output planning" flexibly adapts to varying visual-motor mappings, occurs both for certain and potential actions, and predicts ensuing working-memory guided behavior. These results highlight the flexible and future-oriented nature of visual working memory, and provide insight into the neural basis of the anticipatory dynamics that translate visual representations into adaptive upcoming behavior.

A data-driven network decomposition of the temporal, spatial, and spectral dynamics underpinning visual-verbal working memory processes

The brain dynamics underlying working memory (WM) unroll via transient frequency-specific large-scale brain networks. This multidimensionality (time, space, and frequency) challenges traditional analyses. Through an unsupervised technique, the time delay embedded-hidden Markov model (TDE-HMM), we pursue a functional network analysis of magnetoencephalographic data from 38 healthy subjects acquired during an n-back task. Here we show that this model inferred task-specific networks with unique temporal (activation), spectral (phase-coupling connections), and spatial (power spectral density distribution) profiles. A theta frontoparietal network exerts attentional control and encodes the stimulus, an alpha temporo-occipital network rehearses the verbal information, and a broad-band frontoparietal network with a P300-like temporal profile leads the retrieval process and motor response. Therefore, this work provides a unified and integrated description of the multidimensional working memory dynamics that can be interpreted within the neuropsychological multi-component model of WM, improving the overall neurophysiological and neuropsychological comprehension of WM functioning.

Capacity and selection in immersive visual working memory following naturalistic object disappearance

Visual working memory-holding past visual information in mind for upcoming behavior-is commonly studied following the abrupt removal of visual objects from static two-dimensional (2D) displays. In everyday life, visual objects do not typically vanish from the environment in front of us. Rather, visual objects tend to enter working memory following self or object motion: disappearing from view gradually and changing the spatial relation between memoranda and observer. Here, we used virtual reality (VR) to investigate whether two classic findings from visual working memory research-a capacity of around three objects and the reliance on space for object selection-generalize to more naturalistic modes of object disappearance. Our static reference condition mimicked traditional laboratory tasks whereby visual objects were held static in front of the participant and removed from view abruptly. In our critical flow condition, the same visual objects flowed by participants, disappearing from view gradually and behind the observer. We considered visual working memory performance and capacity, as well as space-based mnemonic selection, indexed by directional biases in gaze. Despite vastly distinct modes of object disappearance and altered spatial relations between memoranda and observer, we found comparable capacity and comparable gaze signatures of space-based mnemonic selection. This finding reveals how classic findings from visual working memory research generalize to immersive situations with more naturalistic modes of object disappearance and with dynamic spatial relations between memoranda and observer.

Active inhibition of the retro-cue effect in visual working memory: Evidence from event-related potential

This study used the event-related potential (ERP) technique to investigate whether active inhibition exists in retro-cue Effect (RCE) in visual working memory using modified retro-cue tasks. In this modified task, the participants were first asked to memorize six color blocks and then presented with directed remembering or directed forgetting cues; finally, their working memory performance was tested. For behavioral results, due to the extension of the memory interval, this study did not find RCE in accuracy but reflected it in the total reaction time. For ERP results, the frontal late positive potential (LPP) followed by the directed forgetting condition was larger than that followed by directed remembering and baseline conditions, and there was no significant difference between directed remembering and baseline conditions. There was no significant difference in parietal P3 followed by both the directed remembering and directed forgetting conditions, which were significantly larger than the baseline condition. This result reveals that active inhibition plays an important role in directed forgetting RCE. There was a correlation between parietal P3 and frontal LPP with the same time window but different scalp regions in the directed forgetting condition, indicating a potential relationship between active inhibition and retelling in directed forgetting RCE.

Cross-modal interactions at the audiovisual cocktail-party revealed by behavior, ERPs, and neural oscillations

Theories of attention argue that objects are the units of attentional selection. In real-word environments such objects can contain visual and auditory features. To understand how mechanisms of selective attention operate in multisensory environments, in this pre-registered study, we created an audiovisual cocktail-party situation, in which two speakers (left and right of fixation) simultaneously articulated brief numerals. In three separate blocks, informative auditory speech was presented (a) alone or paired with (b) congruent or (c) uninformative visual speech. In all blocks, subjects localized a pre-defined numeral. While audiovisual-congruent and uninformative speech improved response times and speed of information uptake according to diffusion modeling, an ERP analysis revealed that this did not coincide with enhanced attentional engagement. Yet, consistent with object-based attentional selection, the deployment of auditory spatial attention (N2ac) was accompanied by visuo-spatial attentional orienting (N2pc) irrespective of the informational content of visual speech. Notably, an N2pc component was absent in the auditory-only condition, demonstrating that a sound-induced shift of visuo-spatial attention relies on the availability of audio-visual features evolving coherently in time. Additional exploratory analyses revealed cross-modal interactions in working memory and modulations of cognitive control.

Neural signatures for the n-back task with different loads: An event-related potential study

The n-back task is widely used in working memory (WM) research. However, it remains unclear how the electrophysiological correlates of WM processes, the P2, N2, P300, and negative slow wave (NSW), are affected by differences in load. Specifically, while previous work has examined the P300, less attention has been paid to the other components assessing the load of the n-back paradigm. The present study aims to investigate whether other sub-processes in WM (such as inhibitory control) are as sensitive to n-back load changes as the update process by observing changes in the above event-related potential (ERP) components. The results showed poorer behavioral performance with increasing WM load. Greater NSW and smaller P300 amplitudes were elicited by n-back task with a higher load compared to that with lower load. In contrast, there was no significant effect of the n-back load on the amplitudes of P2 and N2. These findings suggest that the updating process and the maintenance process are sensitive to the n-back load change. Therefore, changes in the updating and maintenance processes should be considered when using the n-back task to manipulate the WM load in experiments. The present study may contribute to the understanding of the complexity of WM loads. Additionally, a theoretical basis for follow-up research to explore ways of improving WM performance with high load is provided.

Turning Attention Inside Out: How Working Memory Serves Behavior

Flexible behavior requires guidance not only by sensations that are available immediately but also by relevant mental contents carried forward through working memory. Therefore, selective-attention functions that modulate the contents of working memory to guide behavior (inside-out) are just as important as those operating on sensory signals to generate internal contents (outside-in). We review the burgeoning literature on selective attention in the inside-out direction and underscore its functional, flexible, and future-focused nature. We discuss in turn the purpose (why), targets (what), sources (when), and mechanisms (how) of selective attention inside working memory, using visual working memory as a model. We show how the study of internal selective attention brings new insights concerning the core cognitive processes of attention and working memory and how considering selective attention and working memory together paves the way for a rich and integrated understanding of how mind serves behavior.

Opening Questions in Visual Working Memory

In this reflective piece on visual working memory, I depart from the laboriously honed skills of writing a review. Instead of integrating approaches, synthesizing evidence, and building a cohesive perspective, I scratch my head and share niggles and puzzlements. I expose where my scholarship and understanding are stumped by findings and standard views in the literature.

No evidence that the retro-cue benefit requires reallocation of memory resources

Selective mechanisms allow us to prioritize items held in working memory. Does this reflect reallocation of working memory resources? We examined a critical prediction of this account-that reallocating more resources from one item to another should provide a greater benefit. We used a reward manipulation to create variable allocation of resources. Subsequently, a retro-cue instructed participants to drop a memory item. This retro-cue improved performance for the prioritized items relative to a neutral baseline. However, in contrast to the prevailing reallocation account, we found no difference between dropping a higher versus lower reward item. Importantly, removal of high versus low reward items led to better encoding of subsequently presented items, demonstrating that our reward manipulation was successful. While allocation of resources can influence the encoding and storage of new information into working memory, reallocation does not appear to be essential for selection effects in working memory.

Motor engagement enhances incidental memory for task-irrelevant items

Actions shape what we see and memorize. A previous study suggested the interaction between motor and memory systems by showing that memory encoding for task-irrelevant items was enhanced when presented with motor-response cues. However, in the studies on the attentional boost effect, it has been revealed that detection of the target stimulus can lead to memory enhancement without requiring overt action. Thus, the direct link between the action and memory remains unclear. To exclude the effect of the target detection process as a potential confounder, this study assessed the benefit of action for memory by separating items from the response cue in time. In our pre-registered online experiment (N = 142), participants responded to visual Go cues by pressing a key (i.e., motor task) or counting (i.e., motor-neutral cognitive task) while ignoring No-go cues. In each trial, two task-irrelevant images were sequentially presented after the cue disappearance. After encoding the Go/No-go tasks, participants performed a surprise recognition memory test for those images. Importantly, we quantified the impact of overt execution of the action by comparing memories with and without motor response and the impact of covert motor processes (e.g., preparation and planning of action) by comparing memory between the motor and cognitive tasks. The results showed no memory differences between Go and No-go trials in the motor task. This means that the execution itself was not critical for memory enhancement. However, the memory performance in the motor No-go trials was higher than that in the cognitive No-go trials, only for the items presented away from the cues in time. Therefore, engaging the motor task itself could increase incidental memory for the task-irrelevant items compared to a passive viewing situation. We added empirical evidence on the online interaction between action and memory encoding. These memory advantages could be especially brought in action preparation and planning. We believe this fact may expand our present understanding of everyday memory, such as active learning.

Theta-phase connectivity between medial prefrontal and posterior areas underlies novel instructions implementation

Implementing novel instructions is a complex and uniquely human cognitive ability, that requires the rapid and flexible conversion of symbolic content into a format that enables the execution of the instructed behavior. Preparing to implement novel instructions, as opposed to their mere maintenance, involves the activation of the instructed motor plans, and the binding of the action information to the specific context in which this should be executed. Recent evidence and prominent computational models suggest that this efficient configuration of the system might involve a central role of frontal theta oscillations in establishing top-down long-range synchronization between distant and task-relevant brain areas. In the present EEG study (human subjects, 30 females, 4 males), we demonstrate that proactively preparing for the implementation of novels instructions, as opposed to their maintenance, involves a strengthened degree of connectivity in the theta frequency range between medial prefrontal and motor/visual areas. Moreover, we replicated previous results showing oscillatory features associated specifically with implementation demands, and extended on them demonstrating the role of theta oscillations in mediating the effect of task demands on behavioral performance. Taken together, these findings support our hypothesis that the modulation of connectivity patterns between frontal and task-relevant posterior brain areas is a core factor in the emergence of a behavior-guiding format from novel instructions.Significance statementEveryday life requires the use and manipulation of currently available information to guide behavior and reach specific goals. In the present study we investigate how the same instructed content elicits different neural activity depending on the task being performed. Crucially, connectivity between medial prefrontal cortex and posterior brain areas is strengthened when novel instructions have to be implemented, rather than simply maintained. This finding suggests that theta oscillations play a role in setting up a dynamic and flexible network of task-relevant regions optimized for the execution of the instructed behavior.

Preparing for the unknown: How working memory provides a link between perception and anticipated action

What mechanisms underlie the transfer of a working memory representation into a higher-level code for guiding future actions? Electrophysiological correlates of attentional selection and motor preparation processes within working memory were investigated in two retrospective cuing tasks. In the first experiment, participants stored the orientation and location of a grating. Subsequent feature cues (selective vs. neutral) indicated which feature would be the target for later report. The oscillatory response in the mu and beta frequency range with an estimated source in the sensorimotor cortex contralateral to the responding hand was used as correlate of motor preparation. Mu/beta suppression was stronger following the selective feature cues compared to the neutral cue, demonstrating that purely feature-based selection is sufficient to form a prospective motor plan. In the second experiment, another retrospective cue was included to study whether knowledge of the task at hand is necessary to initiate motor preparation. Following the feature cue, participants were cued to either compare the stored feature(s) to a probe stimulus (recognition task) or to adjust the memory probe to match the target feature (continuous report task). An analogous suppression of mu oscillations was observed following a selective feature cue, even ahead of task specification. Further, a subsequent selective task cue again elicited a mu/beta suppression, which was stronger after a continuous report task cue. This indicates that working memory is able to flexibly store different types of information in higher-level mental codes to provide optimal prerequisites for all required action possibilities.

Using Neural Networks to Uncover the Relationship between Highly Variable Behavior and EEG during a Working Memory Task with Distractors

Value-driven attention capture (VDAC) occurs when previously rewarded stimuli capture attention and impair goal-directed behavior. In a working memory (WM) task with VDAC-related distractors, we observe behavioral variability both within and across individuals. Individuals differ in their ability to maintain relevant information and ignore distractions. These cognitive components shift over time with changes in motivation and attention, making it difficult to identify underlying neural mechanisms of individual differences. In this study, we develop the first participant-specific feedforward neural network models of reaction time from neural data during a VDAC WM task. We used short epochs of electroencephalography (EEG) data from 16 participants to develop the feedforward neural network (NN) models of RT aimed at understanding both WM and VDAC. Using general linear models (GLM), we identified 20 EEG features to predict RT across participants (r=0.53±0.08). The linear model was compared to the NN model, which improved the predicted trial-by-trial RT for all participants (r=0.87±0.04). We found that right frontal gamma-band activity and fronto-posterior functional connectivity in the alpha, beta, and gamma bands explain individual differences. Our study shows that NN models can link neural activity to highly variable behavior and can identify potential new targets for neuromodulation interventions.

Aging impairs primary task resumption and attentional control processes following interruptions

Attentional selection of working memory content is impaired after an interruption. Here we investigate the neural correlates underlying attentional selection within working memory. We focus especially on how older and younger adults differ in attentional selection processes during primary task resumption. Participants performed a working memory task, while being frequently interrupted with either a cognitively low- or high-demanding arithmetic task. Afterwards, a retrospective cue (retro-cue) indicated the working memory content required for later report. The detrimental effect of the interruption was evident in both age groups, but while younger adults were more strongly affected by a high- than by a low-demanding interruption, the performance deficit appeared independently of the cognitive requirements of the interruption task in older adults. A similar pattern was found regarding frontal-posterior connectivity in the theta frequency range, suggesting that aging decreases the ability to selectively maintain relevant information within working memory. The power of mid-frontal theta oscillations (~4-9Hz) featured a comparable effect of interruptions in both age groups. However, posterior alpha/beta power (~8-30Hz) following the retro-cue was more diminished by a preceding interruption in older adults. These results suggest an age-related deficit in the attentional selection and maintenance of primary task information following an interruption that appeared independent from the cognitive requirements of the interrupting task.

Planning the Potential Future during Multi-item Visual Working Memory

Working memory allows us to retain visual information to guide upcoming future behavior. In line with this future-oriented purpose of working memory, recent studies have shown that action planning occurs during encoding and retention of a single visual item, for which the upcoming action is certain. We asked whether and how this extends to multi-item visual working memory, when visual representations serve the potential future. Human participants performed a visual working-memory task with a memory-load manipulation (one/two/four items) and a delayed orientation-reproduction report (of one item). We measured EEG to track 15- to 25-Hz beta activity in electrodes contralateral to the required response hand-a canonical marker of action planning. We show an attenuation of beta activity, not only in Load 1 (with one certain future action) but also in Load 2 (with two potential future actions), compared with Load 4 (with low prospective-action certainty). Moreover, in Load 2, potential action planning occurs regardless whether both visual items afford similar or dissimilar manual responses, and it predicts the speed of ensuing memory-guided behavior. This shows that potential action planning occurs during multi-item visual working memory and brings the perspective that working memory helps us prepare for the potential future.

Flexible utilization of spatial- and motor-based codes for the storage of visuo-spatial information

Working memory provides flexible storage of information in service of upcoming behavioral goals. Some models propose specific fixed loci and mechanisms for the storage of visual information in working memory, such as sustained spiking in parietal and prefrontal cortex during working memory maintenance. An alternative view is that information can be remembered in a flexible format that best suits current behavioral goals. For example, remembered visual information might be stored in sensory areas for easier comparison to future sensory inputs, or might be re-coded into a more abstract action-oriented format and stored in motor areas. Here, we tested this hypothesis using a visuo-spatial working memory task where the required behavioral response was either known or unknown during the memory delay period. Using functional magnetic resonance imaging (fMRI) and multivariate decoding, we found that there was less information about remembered spatial position in early visual and parietal regions when the required response was known versus unknown. Furthermore, a representation of the planned motor action emerged in primary somatosensory, primary motor, and premotor cortex during the same task condition where spatial information was reduced in early visual cortex. These results suggest that the neural networks supporting working memory can be strategically reconfigured depending on specific behavioral requirements during a canonical visual working memory paradigm.

How to refocus attention on working memory representations following interruptions-Evidence from frontal theta and posterior alpha oscillations

Interruptions lead to a deterioration of primary task performance. Applied research usually describes a delay in primary task resumption as an essential component of this performance deficit. Here, we investigate this approach using electrophysiological correlates of the focusing of attention within working memory, a process that is fundamental to switching between different tasks. A lateralized working memory task was frequently interrupted by either a high- or low-demanding arithmetic task and a subsequent retrospective cue indicated the working memory item required for later report. The detrimental effect of interruptions on primary task performance was most pronounced for high-demanding interruptions. After retro-cue presentation, fronto-central theta power (4-7 Hz) was lowest following high-demanding interruptions and posterior alpha power (8-14 Hz) was less suppressed in the two interruption conditions. These effects might be related to a deficit in attentional control processes following the retrospective cue. Furthermore, we introduce the suppression of posterior alpha power contralateral to the remembered primary task stimuli during the interruption phase as a temporal marker for primary task resumption. Especially for cognitively demanding interruption tasks, this effect seems to overlap in time with the processing of the interruption, which should contribute to the primary task performance deficit.

Output planning at the input stage in visual working memory

Working memory serves as the buffer between past sensations and future behavior, making it vital to understand not only how we encode and retain sensory information in memory but also how we plan for its upcoming use. We ask when prospective action goals emerge alongside the encoding and retention of visual information in working memory. We show that prospective action plans do not emerge gradually during memory delays but are brought into memory early, in tandem with sensory encoding. This action encoding (i) precedes a second stage of action preparation that adapts to the time of expected memory utilization, (ii) occurs even ahead of an intervening motor task, and (iii) predicts visual memory-guided behavior several seconds later. By bringing prospective action plans into working memory at an early stage, the brain creates a dual (visual-motor) memory code that can make memories more effective and robust for serving ensuing behavior.

Neural oscillations track the maintenance and proceduralization of novel instructions

Humans are capable of flexibly converting symbolic instructions into novel behaviors. Previous evidence and theoretical models suggest that the implementation of a novel instruction requires the reformatting of its declarative content into an action-oriented code optimized for the execution of the instructed behavior. While neuroimaging research focused on identifying the brain areas involved in such a process, the temporal and electrophysiological mechanisms remain poorly understood. These mechanisms, however, can provide information about the specific cognitive processes that characterize the proceduralization of information. In the present study, we recorded EEG activity while we asked participants to either simply maintain declaratively the content of novel S-R mappings or to proactively prepare for their implementation. By means of time-frequency analyses, we isolated the oscillatory features specific to the proceduralization of instructions. Implementation of the instructed mappings elicited stronger theta activity over frontal electrodes and suppression in mu and beta activity over central electrodes. On the contrary, activity in the alpha band, which has been shown to track the attentional deployment to task-relevant items, showed no differences between tasks. Together, these results support the idea that proceduralization of information is characterized by specific component processes such as orchestrating complex task settings and configuring the motor system that are not observed when instructions are held in a declarative format.

Boosting working memory with accelerated clocks

Our perception of time varies with the degree of cognitive engagement in tasks. The perceived passage of time accelerates while working on demanding tasks, whereas time appears to drag during boring situations. Our experiment aimed at investigating whether this relationship is mutual: Can manipulated announcements of elapsed time systematically affect the attentional resources applied to a cognitive task? We measured behavioral performance and the EEG in a whole report working memory paradigm with six items of different colors that each had to be reported after a short delay period. The 32 participants were informed about the current time after each 20 trials, while the clock was running at either 100% (normal), 120% (fast), or 80% (slow) of normal clock speed depending on the experimental block. The mean number of correctly reported colors per trial was significantly increased in the fast as compared to the slow and normal clock conditions. In the EEG, we focused on neural oscillations during working memory encoding and storage. As an electrophysiological correlate of task engagement, frontal theta power during the storage interval was increased in the fast clock condition. Also, the power of frontal theta oscillations predicted the number of correctly reported colors on a single-trial basis. This shows that a covert manipulation of clock speed can lead to an improvement in cognitive performance, presumably mediated by a higher allocation of attentional resources resulting from an adaptation of the subjective passage of time during an experiment.

Don't stop me now: Hampered retrieval of action plans following interruptions

How can we retrieve action plans in working memory (WM) after being distracted or interrupted? The present EEG study investigated this question using a WM task in which a random sequence of single numbers (1-4 and 6-9) was presented. In a given trial, participants had to decide whether the number presented in the preceding trial was odd or even. Additionally, interfering stimuli were randomly presented in 25% of all trials, requiring the participants to either ignore a colored number (distraction) or respond to it (interruption) while maintaining the previously formed action plan in WM. Our results revealed a detrimental impact of interruptions on WM performance in trials after interrupting stimuli compared to trials without a preceding interference. This was reflected in decreased task accuracy and reduced stimulus- and response-locked P3b amplitudes potentially indicating a hampered reactivation of stimulus-response links. Moreover, decreased contralateral mu suppression prior to a given response highlighted an impaired response preparation following interruptions. Distractions, on the other hand, did not negatively affect task performance but were followed by faster responses in subsequent trials compared to trials without prior interference. This result pattern was supported by stronger contralateral mu suppression indicating a facilitated response preparation. Overall, these results suggest that action representations in WM are resistant to distractions but do suffer from interruptions that disrupt or interfere with their implementation. We thus propose that the possibility of adequately preparing for an upcoming response is essential for behavioral guidance in the presence of external interference.

Exploration of User's Mental State Changes during Performing Brain-Computer Interface

Substantial developments have been established in the past few years for enhancing the performance of brain–computer interface (BCI) based on steady-state visual evoked potential (SSVEP). The past SSVEP-BCI studies utilized different target frequencies with flashing stimuli in many different applications. However, it is not easy to recognize user’s mental state changes when performing the SSVEP-BCI task. What we could observe was the increasing EEG power of the target frequency from the user’s visual area. BCI user’s cognitive state changes, especially in mental focus state or lost-in-thought state, will affect the BCI performance in sustained usage of SSVEP. Therefore, how to differentiate BCI users’ physiological state through exploring their neural activities changes while performing SSVEP is a key technology for enhancing the BCI performance. In this study, we designed a new BCI experiment which combined working memory task into the flashing targets of SSVEP task using 12 Hz or 30 Hz frequencies. Through exploring the EEG activity changes corresponding to the working memory and SSVEP task performance, we can recognize if the user’s cognitive state is in mental focus or lost-in-thought. Experiment results show that the delta (1–4 Hz), theta (4–7 Hz), and beta (13–30 Hz) EEG activities increased more in mental focus than in lost-in-thought state at the frontal lobe. In addition, the powers of the delta (1–4 Hz), alpha (8–12 Hz), and beta (13–30 Hz) bands increased more in mental focus in comparison with the lost-in-thought state at the occipital lobe. In addition, the average classification performance across subjects for the KNN and the Bayesian network classifiers were observed as 77% to 80%. These results show how mental state changes affect the performance of BCI users. In this work, we developed a new scenario to recognize the user’s cognitive state during performing BCI tasks. These findings can be used as the novel neural markers in future BCI developments.

Visual working memory and action: Functional links and bi-directional influences

Working memory bridges perception to action over extended delays, enabling flexible goal-directed behaviour. To date, studies of visual working memory – concerned with detailed visual representations such as shape and colour – have considered visual memory predominantly in the context of visual task demands, such as visual identification and search. Another key purpose of visual working memory is to directly inform and guide upcoming actions. Taking this as a starting point, I review emerging evidence for the pervasive bi-directional links between visual working memory and (planned) action, and discuss these links from the perspective of their common goal of enabling flexible and precise behaviour.

Encoding, storage, and response preparation-Distinct EEG correlates of stimulus and action representations in working memory

Working memory (WM) allows for the active storage of stimulus- and higher level representations, such as action plans. This electroencephalography (EEG) study investigated the specific electrophysiological correlates dissociating action-related from stimulus-related representations in WM using three different experimental conditions based on the same stimulus material. In the experiment, a random sequence of single numbers (from 1 to 6) was presented and participants had to indicate whether the current number (N0 condition), the preceding number (N-1 condition), or the sum of the current and the preceding number (S-1 condition) was odd or even. Accordingly, participants had to store a stimulus representation in S-1 and an action representation in N-1 until the onset of the next stimulus. In the EEG, the storage of stimulus representations (S-1) was reflected by a fronto-central slow wave indicating the rehearsal of information that was required for the response in the following trial. In contrast, the storage of action representations (N-1) went along with a posterior positive slow wave, suggesting that the action plan was actively stored in WM until the presentation of the next stimulus. Crucially, preparing for the next response in N-1 was associated with increased contralateral mu/beta suppression, predicting the response time in the given trial. Our findings, thus, show that the WM processes for stimulus- and action representations can be clearly dissociated from each other with a distinct sequence of EEG correlates for encoding, storage, and response preparation.

The Application of EEG Mu Rhythm Measures to Neurophysiological Research in Stuttering

Deficits in basal ganglia-based inhibitory and timing circuits along with sensorimotor internal modeling mechanisms are thought to underlie stuttering. However, much remains to be learned regarding the precise manner how these deficits contribute to disrupting both speech and cognitive functions in those who stutter. Herein, we examine the suitability of electroencephalographic (EEG) mu rhythms for addressing these deficits. We review some previous findings of mu rhythm activity differentiating stuttering from non-stuttering individuals and present some new preliminary findings capturing stuttering-related deficits in working memory. Mu rhythms are characterized by spectral peaks in alpha (8-13 Hz) and beta (14-25 Hz) frequency bands (mu-alpha and mu-beta). They emanate from premotor/motor regions and are influenced by basal ganglia and sensorimotor function. More specifically, alpha peaks (mu-alpha) are sensitive to basal ganglia-based inhibitory signals and sensory-to-motor feedback. Beta peaks (mu-beta) are sensitive to changes in timing and capture motor-to-sensory (i.e., forward model) projections. Observing simultaneous changes in mu-alpha and mu-beta across the time-course of specific events provides a rich window for observing neurophysiological deficits associated with stuttering in both speech and cognitive tasks and can provide a better understanding of the functional relationship between these stuttering symptoms. We review how independent component analysis (ICA) can extract mu rhythms from raw EEG signals in speech production tasks, such that changes in alpha and beta power are mapped to myogenic activity from articulators. We review findings from speech production and auditory discrimination tasks demonstrating that mu-alpha and mu-beta are highly sensitive to capturing sensorimotor and basal ganglia deficits associated with stuttering with high temporal precision. Novel findings from a non-word repetition (working memory) task are also included. They show reduced mu-alpha suppression in a stuttering group compared to a typically fluent group. Finally, we review current limitations and directions for future research.

Oscillatory Control over Representational States in Working Memory

In the visual world, attention is guided by perceptual goals activated in visual working memory (VWM). However, planning multiple-task sequences also requires VWM to store representations for future goals. These future goals need to be prevented from interfering with the current perceptual task. Recent findings have implicated neural oscillations as a control mechanism serving the implementation and switching of different states of prioritization of VWM representations. We review recent evidence that posterior alpha-band oscillations underlie the flexible activation and deactivation of VWM representations and that frontal delta-to-theta-band oscillations play a role in the executive control of this process. That is, frontal delta-to-theta appears to orchestrate posterior alpha through long-range oscillatory networks to flexibly set up and change VWM states during multitask sequences.

Working memory prioritization impacts neural recovery from distraction

The ability to protect goal-relevant information from disruption over short intervals is a hallmark of working memory. Recent behavioral data suggest that high-priority items in working memory are more vulnerable to disruption. We used functional magnetic resonance imaging to evaluate the hypothesis that prioritization of working memories might impact the recovery of their neural representation(s) after distraction. A delay-period retrospective cue informed participants which of two memory items (a face or a scene) to prioritize during a first delay period. Consistent with prior work, and confirming successful prioritization, multivoxel pattern classifier evidence in perceptual brain regions was higher for cued versus uncued memory items. A distraction task was then imposed before a second retrospective cue informed participants to either "stay" remembering the previously cued item or "switch" to the previously uncued item. This allowed for the evaluation of recovery for high-priority items (on stay trials) and also low-priority items (on switch trials). Classifiers showed successful reinstatement of both high- and low-priority items after distraction, but only low-priority items recovered to their pre-distraction representational levels. Moreover, the degree of prioritization before distraction predicted the amount of disruption for high-priority items after distraction, suggesting that the more a participant prioritized the cued item, the greater the impact of distraction. Our data provide neural evidence that prioritizing working memory information in perceptual regions makes that information more vulnerable to disruption.

Retroactive Attentional Shifts Predict Performance in a Working Memory Task: Evidence by Lateralized EEG Patterns

Shifts of attention within working memory based on retroactive (retro-) cues were shown to facilitate performance in working memory tasks. Although posterior asymmetries in the EEG, such as the contralateral delay activity (CDA), have been used to study the active storage of lateralized working memory representations, results on the relation of such asymmetric effects to retro-cue benefits remain inconclusive. We recorded EEG in a retro-cue working memory task with lateralized items and a continuous performance response. Following either a selective or neutral retro-cue, participants adjusted the orientation of a central memory probe to the cued item. Selective retro-cues elicited an early posterior contralateral negativity (PCN), anterior directing attention negativity (ADAN) and a later modulation of CDA indicating that active storage was concentrated on the cued information. By dividing all trials into three within-condition performance quantiles, we could further show that high working memory accuracy was associated with a sustained increase of the CDA effect following the retro-cue. These results suggest that focusing resources on the active storage of relevant representations is an important factor regarding retro-cue benefits in working memory tasks.

Manipulating the focus of attention in working memory: Evidence for a protection of multiple items against perceptual interference

Visual working memory representations can be shielded from interference by selective attentional focusing using retroactive cues (retro-cues). However, it is not clear how many representations can be effectively cued and which neural mechanisms provide the protection from distractors. To address these questions, we manipulated the number of attended items by means of a retro-cue (one, two, or three items) and presented a distractor display during the retention of information in working memory. Analyses of the raw error and a mixture model revealed that a general performance benefit was only present when one item was retro-cued. Nevertheless, a protection of the item representations against subsequent interference occurred also after a two-item cue. ERPs revealed a modulation of the posterior negative slow wave following the retro-cues, reflecting the applied working memory resources dependent on the number of attended representations. Further, the distractor information was encoded into working memory only when the number of attended items was not changed by the retro-cues (neutral and three-item conditions), reflected by a P3b following the distractor display. These results suggest that more than one item can be effectively protected from perceptual interference. We propose that the protective effect of selective attention within working memory is based on both a reduction of the number of focused representations and the attentional refreshing of item context and features.