Attention restores discrete items to visual short-term memory

Dissecting the components of error in analogue report tasks

Over the last two decades, the analogue report task has become a standard method for measuring the fidelity of visual representations across research domains including perception, attention, and memory. Despite its widespread use, there has been no methodical investigation of the different task parameters that might contribute to response variability. To address this gap, we conducted two experiments manipulating components of a typical analogue report test of memory for colour hue. We found that human response errors were independently affected by changes in storage and maintenance requirements of the task, demonstrated by a strong effect of set size even in the absence of a memory delay. In contrast, response variability remained unaffected by physical size of the colour wheel, implying negligible contribution of motor noise to task performance, or by its chroma radius, highlighting non-uniformity of the standard colour space. Comparing analogue report to a matched forced-choice task, we found variation in adjustment criterion made a limited contribution to analogue report variability, becoming meaningful only with low representational noise. Our findings validate the analogue report task as a robust measure of representational fidelity for most purposes, while also quantifying non-representational sources of noise that would limit its reliability in specialized settings.

New Evidence for Retrospectively Cued Perception

Past research suggests a continuity between perception and memory, as reflected in influences of orienting of spatial attention by cues presented after a visual target offset (post-target cues) on target perception. Conducting two experiments, we tested and confirmed this claim. Our study revealed an elevated reliance on post-target cues for target detection with diminishing target visibility, leading to better performance in validly versus invalidly cued trials, indicative of contrast gain. We demonstrated this post-target cueing impact on target perception without a postcue response prompt, meaning that our results truly reflected a continuity between perception and memory rather than a task-specific impact of having to memorize the target due to a response prompt. While previous studies found an improvement in accuracy through valid compared to invalid cues using liminal targets, in Experiment 1, we further showed an influence of attention on participants' response time by the post-target cues with cues presented away from a clearly visible target. This suggests that visual interactions at the target location provided no better explanation of post-target cueing effects. Our results generalize prior research with liminal targets and confirm the view of a perception-memory continuum so that visual target processing is not shielded against visuospatial orienting of attention elicited by events following the offset of the visual target.

Early top-down control of internal selection induced by retrospective cues in visual working memory: advantage of peripheral over central cues

Attention can be deployed among external sensory stimuli or internal working memory (WM) representations, and recent primate studies have revealed that these external and internal selections share a common neural basis in the prefrontal cortex (PFC). However, it remains to be elucidated how PFC implements these selections, especially in humans. The present study aimed to further investigate whether PFC responded differentially to the peripheral and central retrospective cues (retro-cues) that induced attention selection among WM representations. To achieve this, we combined magnetoencephalography (MEG, Experiment 1) and transcranial magnetic stimulation (TMS, Experiment 2) with an orientation-recall paradigm. Experiment 1 found that a peripheral retro-cue with 100% reliability had a greater benefit on WM performance than a central retro-cue, while this advantage of peripheral over central cues vanished when the cue reliability dropped to 50% (non-informative). MEG source analysis indicated that the 100% peripheral retro-cue elicited earlier (∼125 ms) PFC responses than the central retro-cue (∼275 ms). Meanwhile, Granger causality analysis showed that PFC had earlier (0-200 ms) top-down signals projecting to the superior parietal lobule (SPL) and the lateral occipital cortex (LOC) after the onset of peripheral retro-cues, while these top-down signals appeared later (300-500 ms) after the onset of central retro-cues. Importantly, PFC activity within this period of 300-500 ms correlated with the peripheral advantage in behavior. Moreover, Experiment 2 applied TMS at different time points to test the causal influence of brain activity on behavior and found that stimulating PFC at 100 ms abolished the behavioral benefit of the peripheral retro-cue, as well as its advantage over the central retro-cue. Taken together, our results suggested that the advantage of peripheral over central retro-cues in the mnemonic domain is realized through faster top-down control from PFC, which challenged traditional opinions that the top-down control of attention on WM required at least 300 ms to appear. The present study highlighted that in addition to the causal role of PFC in attention selection of WM representations, timing was critical as well and faster was better.

A diffusion model analysis of age and individual differences in the retro-cue benefit

The limited capacity of working memory (WM) constrains how well we can think and act. WM capacity is reduced in old age, with one explanation for this decline being a deficit in using attention to control WM contents. The retro-cue paradigm has been used to examine the ability to focus attention in WM. So far, there are conflicting findings regarding an aging deficit in the retro-cue effect. The present study evaluated age-related changes and individual differences in the retro-cue effect through a well-established computational model that combines speed and accuracy to extract underlying psychological parameters. We applied the drift-diffusion model to the data from a large sample of younger and older adults (total N = 346) that completed four retro-cue tasks. Retro-cues increased the quality of the evidence entering the decision process, reduced the time taken for memory retrieval, and changed response conservativeness for younger and older adults. An age-related decline was observed only in the retro-cue boost for evidence quality, and this was the only parameter capturing individual differences in focusing efficiency. Our results suggest that people differ in how well they can strengthen and protect a focused representation to boost evidence-quality accumulation, and this ability declines with aging.

A recurrent neural network model of prefrontal brain activity during a working memory task

When multiple items are held in short-term memory, cues that retrospectively prioritise one item over another (retro-cues) can facilitate subsequent recall. However, the neural and computational underpinnings of this effect are poorly understood. One recent study recorded neural signals in the macaque lateral prefrontal cortex (LPFC) during a retro-cueing task, contrasting delay-period activity before (pre-cue) and after (post-cue) retrocue onset. They reported that in the pre-cue delay, the individual stimuli were maintained in independent subspaces of neural population activity, whereas in the post-cue delay, the prioritised items were rotated into a common subspace, potentially allowing a common readout mechanism. To understand how such representational transitions can be learnt through error minimisation, we trained recurrent neural networks (RNNs) with supervision to perform an equivalent cued-recall task. RNNs were presented with two inputs denoting conjunctive colour-location stimuli, followed by a pre-cue memory delay, a location retrocue, and a post-cue delay. We found that the orthogonal-to-parallel geometry transformation observed in the macaque LPFC emerged naturally in RNNs trained to perform the task. Interestingly, the parallel geometry only developed when the cued information was required to be maintained in short-term memory for several cycles before readout, suggesting that it might confer robustness during maintenance. We extend these findings by analysing the learning dynamics and connectivity patterns of the RNNs, as well as the behaviour of models trained with probabilistic cues, allowing us to make predictions for future studies. Overall, our findings are consistent with recent theoretical accounts which propose that retrocues transform the prioritised memory items into a prospective, action-oriented format.

Sustained attention required for effective dimension-based retro-cue benefit in visual working memory

In visual working memory (VWM) tasks, participants' performances can be improved through the use of dimension-based retro-cues, which direct internal attention to prioritize a particular dimension (e.g., color or orientation) of VWM representations even after the stimuli disappear. This phenomenon is known as the dimension-based retro-cue benefit (RCB). The present study investigates whether sustained attention is required for the dimension-based RCB by inserting interference or interruption between the retro-cue and the test array to distract attention. We tested the effects of perceptual interference or cognitive interruption on dimension-based RCB when the interference (Experiments 1 and 2 with masks) or interruption (Experiments 3 and 4 with an odd-even task) occurred concurrently with the stages for the maintenance of prioritized information (long cue-and-interference/interruption interstimulus interval, e.g., Experiments 1 and 3) or the deployment of attention (short cue-and-interference/interruption interstimulus interval, e.g., Experiments 2 and 4). Our results demonstrate that perceptual interference or cognitive interruption attenuates the dimension-based RCB. These findings suggest that sustained attention is necessary for the effective prioritization of a specific dimension of VWM representations.

Retrospective cue benefits in visual working memory are limited to a single location at a time

Working memory (WM) performance can be improved by an informative cue presented during storage. This effect, termed a retrocue benefit, can be used to study limits on how human observers prioritize information stored in WM for behavioral output. There is disagreement about whether retrocue benefits extend to multiple WM locations. Here, we hypothesized that multiple retrocues may improve some aspects of memory performance (e.g., a reduction in random guessing) while worsening others (e.g., an increase in the probability of reporting a feature presented at a non-probed location). We tested this possibility in three experiments. Participants remembered arrays of four orientations or colors over a brief delay, and spatial retrocues instructed participants to prioritize zero, one, two, or all four remembered orientations for possible report. At the end of the trial, participants recalled the orientation that appeared at one location. The results of this study revealed that participants' recall errors were lower during cue-one relative to cue-two and cue-four trials, and this benefit was driven primarily by a reduction in random guessing during cue-one trials. We found no evidence suggesting that multiple spatial cues (i.e., during cue-two trials) induced a trade-off between memory precision, random guessing, and non-target reports compared to neutral trials (i.e., cue-zero or cue-four). Thus, cuing participants to prioritize information appearing at multiple unique spatial positions led to no improvement in memory performance compared to neutral or no-cue trials, providing additional support for the view that retrocue benefits on WM performance are limited to a single spatial location at a time.

Spatial attention based on 2D location and relative depth order modulates visual working memory in a 3D environment

The attentional effect on visual working memory (VWM) has been a heated research topic in the past two decades. Studies show that VWM performance for an attended memory item can be improved by cueing its two-dimensional (2D) spatial location during retention. However, few studies have investigated the effect of attentional selection on VWM in a three-dimensional setting, and it remains unknown whether depth information can produce beneficial attentional effects on 2D visual representations similar to 2D spatial information. Here we conducted four experiments, displaying memory items at various stereoscopic depth planes, and examined the retro-cue effects of four types of cues - a cue would either indicate the 2D or depth location of a memory item, and either in the form of physical (directly pointing to a location) or symbolic (numerically mapping onto a location) cues. We found that retro-cue benefits were only observed for cues directly pointing to a 2D location, whereas a null effect was observed for cues directly pointing to a depth location. However, there was a retro-cue effect when cueing the relative depth order, though the effect was weaker than that for cueing the 2D location. The selective effect on VWM based on 2D spatial attention is different from depth-based attention, and the divergence suggests that an object representation is primarily bound with its 2D spatial location, weakly bound with its depth order but not with its metric depth location. This indicates that attentional selection based on memory for depth, particularly metric depth, is ineffective.

Turning Attention Inside Out: How Working Memory Serves Behavior

Flexible behavior requires guidance not only by sensations that are available immediately but also by relevant mental contents carried forward through working memory. Therefore, selective-attention functions that modulate the contents of working memory to guide behavior (inside-out) are just as important as those operating on sensory signals to generate internal contents (outside-in). We review the burgeoning literature on selective attention in the inside-out direction and underscore its functional, flexible, and future-focused nature. We discuss in turn the purpose (why), targets (what), sources (when), and mechanisms (how) of selective attention inside working memory, using visual working memory as a model. We show how the study of internal selective attention brings new insights concerning the core cognitive processes of attention and working memory and how considering selective attention and working memory together paves the way for a rich and integrated understanding of how mind serves behavior.

Distributed networks for auditory memory differentially contribute to recall precision

Re-directing attention to objects in working memory can enhance their representational fidelity. However, how this attentional enhancement of memory representations is implemented across distinct, sensory and cognitive-control brain network is unspecified. The present fMRI experiment leverages psychophysical modelling and multivariate auditory-pattern decoding as behavioral and neural proxies of mnemonic fidelity. Listeners performed an auditory syllable pitch-discrimination task and received retro-active cues to selectively attend to a to-be-probed syllable in memory. Accompanied by increased neural activation in fronto-parietal and cingulo-opercular networks, valid retro-cues yielded faster and more perceptually sensitive responses in recalling acoustic detail of memorized syllables. Information about the cued auditory object was decodable from hemodynamic response patterns in superior temporal sulcus (STS), fronto-parietal, and sensorimotor regions. However, among these regions retaining auditory memory objects, neural fidelity in the left STS and its enhancement through attention-to-memory best predicted individuals' gain in auditory memory recall precision. Our results demonstrate how functionally discrete brain regions differentially contribute to the attentional enhancement of memory representations.

The influence of attentional biases on multiple working memory precision parameters for children and adults

Working memory (WM) improves dramatically during childhood but what drives this improvement is not well understood. One influential account thus far has proposed a simple increase in storage capacity. However, recent findings have shown that multiple factors, such as differences in the ability to use attention to enhance the maintenance of internal representations, as well as changes in WM precision, also interact in influencing age-related differences in WM capacity. We aimed to examine whether and how the developing ability to orient attention retrospectively to internal representations influences WM precision. To do so, we employed a paradigm that combined the continuous-recall WM task with the partial-cueing report task. Specifically, 7-year-olds and young adults were asked to reproduce the colour of a probe item in a colour wheel. The initial memory array, which included the probe item, could be followed by a spatial cue that directed participants' attention to a location in the memory array (a 'retro-cue'). Results showed that attentional biases engendered by retro-cues facilitated overall precision compared to uncued baseline performance, for both age groups, although to a smaller degree in 7-year-olds compared to adults. Importantly, investigation of modelling parameters suggested that children demonstrate lower representational quality of items in WM but that spatial attentional cues improve overall precision by increasing the probability of target storage, maintenance and recall, and by reducing misbinding errors as well as random guessing, not by changing representational quality. These results add significantly to our knowledge on the relation between retrospective attention and WM development.

Increasing perceptual separateness affects working memory for depth - re-allocation of attention from boundaries to the fixated center

For decades, working memory (WM) has been a heated research topic in the field of cognitive psychology. However, most studies on WM presented visual stimuli on a two-dimensional plane, rarely involving depth perception. Several previous studies have investigated how depth information is stored in WM, and found that WM for depth is even more limited in capacity and the memory performance is poor compared to visual WM. In the present study, we used a change detection task to investigate whether dissociating memory items by different visual features, thereby to increase their perceptual separateness, can improve WM performance for depth. Memory items presented at various depth planes were bound with different colors (Experiments 1 and 3) or sizes (Experiment 2). The memory performance for depth locations of visual stimuli with homogeneous and heterogeneous appearances were tested and compared. The results showed a consistent pattern that although separating items with various feature values did not affect the overall memory performance, the manipulation significantly improved memory performance for the middle depth locations but impaired the performance for the boundary locations when observers fixated at the center of the whole depth volume. The memory benefits of feature separation can be attributed to enhanced individuation of memory items, therefore facilitating a more balanced allocation of attention and memory resources.

Gamma oscillations modulate working memory recall precision

Working memory (WM)—the ability to keep information in mind for short periods of time—is linked to attention and inhibitory abilities, i.e., the capacity to ignore task-irrelevant information. These abilities have been associated with brain oscillations, especially parietal gamma and alpha bands, but it is yet unknown whether these oscillations also modulate attention and inhibitory abilities. To test this, we compared parietal gamma-transcranial alternating current stimulation (tACS) to alpha-tACS and to a non-stimulation condition (Sham) in 51 young participants. Stimulation was coupled with a WM task probing memory-based attention and inhibitory abilities by means of probabilistic retrospective cues, including informative (valid), uninformative (invalid) and neutral. Our results show that relative to alpha and sham stimulation, parietal gamma-tACS significantly increased working memory recall precision. Additional post hoc analyses also revealed strong individual variability before and following stimulation; low-baseline performers showed no significant changes in performance following both gamma and alpha-tACS relative to sham. In contrast, in high-baseline performers gamma- (but not alpha) tACS selectively and significantly improved misbinding-feature errors as well as memory precision, particularly in uninformative (invalid) cues which rely more strongly on attentional abilities. We concluded that parietal gamma oscillations, therefore, modulate working memory recall processes, although baseline performance may further influence the effect of stimulation.

Individual differences in working memory capacity are unrelated to the magnitudes of retrocue benefits

Previous studies have associated visual working memory (VWM) capacity with the use of internal attention. Retrocues, which direct internal attention to a particular object or feature dimension, can improve VWM performance (i.e., retrocue benefit, RCB). However, so far, no study has investigated the relationship between VWM capacity and the magnitudes of RCBs obtained from object-based and dimension-based retrocues. The present study explored individual differences in the magnitudes of object- and dimension-based RCBs and their relationships with VWM capacity. Participants completed a VWM capacity measurement, an object-based cue task, and a dimension-based cue task. We confirmed that both object- and dimension-based retrocues could improve VWM performance. We also found a significant positive correlation between the magnitudes of object- and dimension-based RCB indexes, suggesting a partly overlapping mechanism between the use of object- and dimension-based retrocues. However, our results provided no evidence for a correlation between VWM capacity and the magnitudes of the object- or dimension-based RCBs. Although inadequate attention control is usually assumed to be associated with VWM capacity, the results suggest that the internal attention mechanism for using retrocues in VWM retention is independent of VWM capacity.

Shared mechanisms underlie the control of working memory and attention

Cognitive control guides behaviour by controlling what, when, and how information is represented in the brain¹. For example, attention controls sensory processing; top-down signals from prefrontal and parietal cortex strengthen the representation of task-relevant stimuli^2-4. A similar 'selection' mechanism is thought to control the representations held 'in mind'-in working memory^5-10. Here we show that shared neural mechanisms underlie the selection of items from working memory and attention to sensory stimuli. We trained rhesus monkeys to switch between two tasks, either selecting one item from a set of items held in working memory or attending to one stimulus from a set of visual stimuli. Neural recordings showed that similar representations in prefrontal cortex encoded the control of both selection and attention, suggesting that prefrontal cortex acts as a domain-general controller. By contrast, both attention and selection were represented independently in parietal and visual cortex. Both selection and attention facilitated behaviour by enhancing and transforming the representation of the selected memory or attended stimulus. Specifically, during the selection task, memory items were initially represented in independent subspaces of neural activity in prefrontal cortex. Selecting an item caused its representation to transform from its own subspace to a new subspace used to guide behaviour. A similar transformation occurred for attention. Our results suggest that prefrontal cortex controls cognition by dynamically transforming representations to control what and when cognitive computations are engaged.

Ventromedial Prefrontal Cortex Drives the Prioritization of Self-Associated Stimuli in Working Memory

Humans show a pervasive bias for processing self- over other-related information, including in working memory (WM), where people prioritize the maintenance of self- (over other-) associated cues. To elucidate the neural mechanisms underlying this self-bias, we paired a self- versus other-associated spatial WM task with fMRI and transcranial direct current stimulation (tDCS) of human participants of both sexes. Maintaining self- (over other-) associated cues resulted in enhanced activity in classic WM regions (frontoparietal cortex), and in superior multivoxel pattern decoding of the cue locations from visual cortex. Moreover, ventromedial PFC (VMPFC) displayed enhanced functional connectivity with WM regions during maintenance of self-associated cues, which predicted individuals' behavioral self-prioritization effects. In a follow-up tDCS experiment, we targeted VMPFC with excitatory (anodal), inhibitory (cathodal), or sham tDCS. Cathodal tDCS eliminated the self-prioritization effect. These findings provide strong converging evidence for a causal role of VMPFC in driving self-prioritization effects in WM and provide a unique window into the interaction between social, self-referential processing and high-level cognitive control processes.SIGNIFICANCE STATEMENT People have a strong tendency to attend to self-related stimuli, such as their names. This self-bias extends to the automatic prioritization of arbitrarily self-associated stimuli held in working memory. Since working memory is central to high-level cognition, this bias could influence how we make decisions. It is therefore important to understand the underlying brain mechanisms. Here, we used neuroimaging and noninvasive neurostimulation techniques to show that the source of self-bias in working memory is the ventromedial PFC, which modulates activity in frontoparietal brain regions to produce prioritized representations of self-associated stimuli in sensory cortex. This work thus reveals a brain circuit underlying the socially motivated (self-referential) biasing of high-level cognitive processing.

Effect of attentional selection on working memory for depth in a retro-cueing paradigm

Recent studies have shown that the temporary storage and manipulation of depth information (working memory for depth; WMd) is largely different from that of visual information in a 2D context (visual working memory; VWM). Although there has been abundant evidence on VWM showing that cueing a memory item during retention could bias attention to its internal representation and thus improves its memory performance (a retro-cue effect), it is unknown whether such an effect differs for WMd that is nested in a 3D context compared with that in a conventional 2D context. Here, we used a change detection task to investigate the effect of attentional selection on WMd by testing several types of retro-cue. The memory array consisted of items positioned at various stereoscopic depth planes, and a cue was presented during retention. Participants needed to make judgments on whether the depth position of target (one memory item) had changed. Our study showed reliable valid retro-cue benefits but no invalid retro-cue cost, indicating that the relational information may be registered in WMd to prevent a strategical removal of the unattended item. There was also a slight improvement in memory performance for cueing depth order compared with that for cueing other feature dimensions or 2D locations. The attentional effect on memory representation in a 3D context is different from that in a 2D context, and the divergence may suggest the distinctive nature of working memory for depth.

O Papel da Atenção na Manutenção da Informação Visuoespacial na Memória Operacional

Resumo A memória operacional ainda apresenta várias questões pouco compreendidas. O presente estudo teve como objetivo investigar a eficiência de retrodicas atentivas no processo de manutenção da informação visuoespacial na memória operacional. Foram delineados dois experimentos, definidos por uma tarefa única (memorização) ou dupla (memorização e busca visual). Os resultados sugerem que o efeito da retrodica informativa proporcionou uma melhora na probabilidade de recuperação da informação memorizada na presença ou na ausência da tarefa de busca visual, mesmo em condições que a busca era iniciada 50 ms após a apresentação da retrodica. Esse resultado é discutido em termos de um processo de múltiplas etapas no processo de alocação da atenção na memória operacional visual.

Prioritization in visual working memory enhances memory retention and speeds up processing in a comparison task

Visual working memory retains visual information for controlling behavior. We studied how information in visual working memory is prioritized for being used. In two experiments, participants memorized the stimuli of a memory display for a brief interval, followed by a retro-cue. The retro-cue was either valid, indicating which stimulus from the memory display was relevant (i.e., had priority) in the upcoming comparison with a probe, or was neutral (uninformative). Next, the probe was presented, terminated by a mask, and participants reported whether it matched a stimulus from the memory display. The presentation duration of the probe was varied. Assessing performance as a function of presentation duration allowed to disentangle two components of working memory: memory retention and the speed of processing the probe for the memory-based comparison. Compared with neutral retro-cues, valid retro-cues improved retention and at the same time accelerated processing of the probe. These findings show for the first time that prioritization in working memory impacts on distinct mechanisms: retrospectively, it supports memory retention, and prospectively, it enhances perceptual processing in upcoming comparison tasks.

Working memory for stereoscopic depth is limited and imprecise-evidence from a change detection task

Most studies on visual working memory (VWM) and spatial working memory (SWM) have employed visual stimuli presented at the fronto-parallel plane and few have involved depth perception. VWM is often considered as a memory buffer for temporarily holding and manipulating visual information that relates to visual features of an object, and SWM for holding and manipulating spatial information that concerns the spatial location of an object. Although previous research has investigated the effect of stereoscopic depth on VWM, the question of how depth positions are stored in working memory has not been systematically investigated, leaving gaps in the existing literature on working memory. Here, we explore working memory for depth by using a change detection task. The memory items were presented at various stereoscopic depth planes perpendicular to the line of sight, with one item per depth plane. Participants were asked to make judgments on whether the depth position of the target (one of the memory items) had changed. The results showed a conservative response bias that observers tended to make 'no change' responses when detecting changes in depth. In addition, we found that similar to VWM, the change detection accuracy degraded with the number of memory items presented, but the accuracy was much lower than that reported for VWM, suggesting that the storage for depth information is severely limited and less precise than that for visual information. The detection sensitivity was higher for the nearest and farthest depths and was better when the probe was presented along with the other items originally in the memory array, indicating that how well the to-be-stored depth can be stored in working memory depends on its relation with the other depth positions.

Perturbing Neural Representations of Working Memory with Task-irrelevant Interruption

Working memory maintains information so that it can be used in complex cognitive tasks. A key challenge for this system is to maintain relevant information in the face of task-irrelevant perturbations. Across two experiments, we investigated the impact of task-irrelevant interruptions on neural representations of working memory. We recorded EEG activity in humans while they performed a working memory task. On a subset of trials, we interrupted participants with salient but task-irrelevant objects. To track the impact of these task-irrelevant interruptions on neural representations of working memory, we measured two well-characterized, temporally sensitive EEG markers that reflect active, prioritized working memory representations: the contralateral delay activity and lateralized alpha power (8-12 Hz). After interruption, we found that contralateral delay activity amplitude momentarily sustained but was gone by the end of the trial. Lateralized alpha power was immediately influenced by the interrupters but recovered by the end of the trial. This suggests that dissociable neural processes contribute to the maintenance of working memory information and that brief irrelevant onsets disrupt two distinct online aspects of working memory. In addition, we found that task expectancy modulated the timing and magnitude of how these two neural signals responded to task-irrelevant interruptions, suggesting that the brain's response to task-irrelevant interruption is shaped by task context.

Retrospective Attention in Short-Term Memory Has a Lasting Effect on Long-Term Memory Across Age

OBJECTIVES

Declines in both short- and long-term memory are typical of healthy aging. Recent findings suggest that retrodictive attentional cues ("retro-cues") that indicate the location of to-be-probed items in short-term memory (STM) have a lasting impact on long-term memory (LTM) performance in young adults. Whether older adults can also use retro-cues to facilitate both STM and LTM is unknown.

METHOD

Young and older adults performed a visual STM task in which spatially informative retro-cues or noninformative neutral-cues were presented during STM maintenance of real-world objects. We tested participants' memory at both STM and LTM delays for objects that were previously cued with retrodictive or neutral-cues during STM order to measure the lasting impact of retrospective attention on LTM.

RESULTS

Older adults showed reduced STM and LTM capacity compared to young adults. However, they showed similar magnitude retro-cue memory benefits as young adults at both STM and LTM delays.

DISCUSSION

To the best of our knowledge, this is the first study to investigate whether retro-cues in STM facilitate the encoding of objects into LTM such that they are more likely to be subsequently retrieved by older adults. Our results support the idea that retrospective attention can be an effective means by which older adults can improve their STM and LTM performance, even in the context of reduced memory capacity.

High Working Memory Capacity at the Cost of Precision?

Working memory capacity (WMC) varies tremendously among individuals. Here, we investigate the possibility that subjects with high WMC use this limited resource more efficiently by reducing the precision with which they store information in demanding tasks. Task difficulty was increased by (a) presenting more objects to be memorized, (b) informing subjects only after the encoding phase about the relevant objects, and (c) delivering distracting features at retrieval. Precision was assessed by means of a continuous delayed-estimation task, in which object features had to be estimated from memory. High WMC subjects did not show a stronger drop in precision in difficult tasks. Instead, a positive correlation between precision and general WMC emerged. These findings suggest that high WMC subjects do not necessarily trade in quantity for quality when forming working memory (WM) representations under increasing demand. Instead, they seem to be able to devote more cognitive resources to support WM storage.

It is not in the details: Self-related shapes are rapidly classified but their features are not better remembered

Self-prioritization is a robust phenomenon whereby judgments concerning self-representational stimuli are faster than judgments toward other stimuli. The present paper examines if and how self-prioritization causes more vivid short-term memories for self-related objects by giving geometric shapes arbitrary identities (self, mother, stranger). In Experiment 1 participants were presented with an array of the three shapes and required to retain the location and color of each in memory. Participants were then probed regarding the identity of one of the shapes and subsequently asked to indicate the color of the probed shape or an unprobed shape on a color wheel. Results indicated no benefit for self-stimuli in either response time for the identification probe or for color fidelity in memory. Yet, a cuing benefit was observed such that the cued stimulus in the identity probe did have higher fidelity within memory. Experiments 2 and 3 reduced the cognitive load by only requiring that participants process the identity and color of one shape at a time. For Experiment 2, the identity probe was memory-based, whereas the stimulus was presented alongside the identity probe for Experiment 3. Results demonstrated a robust self-prioritization effect: self-related shapes were classified faster than non-self-shapes, but this self-advantage did not lead to an increase in the fidelity of memory for self-related shapes' colors. Overall, these results suggest that self-prioritization effects may be restricted to an improvement in the ability to recognize that the self-representational stimulus is present without devoting more perceptual and short-term memory resources to such stimuli.

The offline stream of conscious representations

When do we become conscious of a stimulus after its presentation? We would all agree that this necessarily takes time and that it is not instantaneous. Here, I would like to propose not only that conscious access is delayed relative to the external stimulation, but also that it can flexibly desynchronize from external stimulation; it can process some information 'offline', if and when it becomes relevant. Thus, in contrast with initial sensory processing, conscious experience might not strictly follow the sequence of events in the environment. In this article, I will review gathering evidence in favour of this proposition. I will argue that it offers a coherent framework for explaining a great variety of observations in the domain of perception, sensory memory and working memory: the psychological refractory period, the attentional blink, post-dictive phenomena, iconic memory, latent working memory and the newly described retro-perception phenomenon. I will integrate this proposition to the global neuronal workspace model and consider possible underlying brain mechanisms. Finally, I will argue that this capacity to process information 'offline' might have made conscious processing evolutionarily advantageous in spite of its sluggishness and capacity limitations.This article is part of the theme issue 'Perceptual consciousness and cognitive access'.

Human gaze tracks attentional focusing in memorized visual space

Brain areas that control gaze are also recruited for covert shifts of spatial attention1-9. In the external space of perception, there is a natural ecological link between the control of gaze and spatial attention, as information sampled at covertly attended locations can inform where to look next2,10,11. Attention can also be directed internally to representations held within the spatial layout of visual working memory12-16. In such cases, the incentive for using attention to direct gaze disappears, as there are no external targets to scan. Here we investigate whether the oculomotor system of the brain also participates in attention focusing within the internal space of memory. Paradoxically, we reveal this participation through gaze behaviour itself. We demonstrate that selecting an item from visual working memory biases gaze in the direction of the memorized location of that item, despite there being nothing to look at and location memory never explicitly being probed. This retrospective 'gaze bias' occurs only when an item is not already in the internal focus of attention, and it predicts the performance benefit associated with the focusing of internal attention. We conclude that the oculomotor system also participates in focusing attention within memorized space, leaving traces all the way to the eyes.

Task-dependent effects of voluntary space-based and involuntary feature-based attention on visual working memory

Previous research has shown that visual working memory (VWM) can be modulated by space-based or feature-based attentional selection. However, it remains unclear how the two modes of attention operate jointly to affect VWM, and in particular, if involuntary feature-based attention plays a role in VWM. In this study, a pre-cued change detection paradigm was employed to investigate the concurrent effects of space- and feature-based attention on VWM. Space-based attention was manipulated by informative spatial cueing and by varying the proximity between the test item and the cued (fixated) memory item, while feature-based attention was induced in an involuntary manner by having the test item to share the same color or shape with the cued item on a fraction of trials. The results showed that: (1) the memory performance for the cued items was always better than the uncued items, suggesting a beneficial effect of voluntary spatial attention; (2) with a brief duration of the memory array (250 ms), cue-test proximity benefited VWM in the shape judgment task but not in the color judgment task, whereas with a longer duration (1200 ms), no proximity effect was found for either task; (3) VWM was improved for the same-colored items regardless of the task and duration; (4) VWM was improved for the same-shaped items only in the shape judgment task with the longer duration of the memory array. A discrimination task further showed that the proximity effect associated with VWM reflects a perceptual bottleneck in memory encoding for shape but not for color with a brief display. Our results suggest that involuntary feature-based attention could be triggered by spatial cueing to modulate VWM; involuntary color-based attention facilitates VWM independently of task, whereas shape-based facilitation is task-dependent, i.e., confined only to the shape judgment task, presumably reflecting different attention-guiding potencies of the two features.

A two-level hierarchical framework of visual short-term memory

Over the last couple of decades, a vast amount of research has been dedicated to understanding the nature and the architecture of visual short-term memory (VSTM), the mechanism by which currently relevant visual information is maintained. According to discrete-capacity models, VSTM is constrained by a limited number of discrete representations held simultaneously. In contrast, shared-resource models regard VSTM as limited in resources, which can be distributed flexibly between varying numbers of representations; and a new interference model posits that capacity is limited by interference among items. In this article, we begin by reviewing benchmark findings regarding the debate over VSTM limitations, focusing on whether VSTM storage is all-or-none and on whether object complexity affects capacity. After that, we put forward a hybrid framework of VSTM architecture, arguing that this system is composed of a two-level hierarchy of memory stores, each containing a different set of representations: (1) perceptual memory, a resourcelike level containing analog automatically formed representations of visual stimuli in varying degrees of activation, and (2) visual working memory, in which a subset of three to four items from perceptual memory are bound to conceptual representations and to their locations, thus conveying discrete (digital/symbolic) information which appears quantized. While perceptual memory has a large capacity and is relatively nonselective, visual working memory is restricted in the number of items that can be maintained simultaneously, and its content is regulated by a gating mechanism.

Is refreshing in working memory impaired in older age? Evidence from the retro-cue paradigm

Impairments in refreshing have been suggested as one source of working memory (WM) deficits in older age. Retro-cues provide an important method of investigating this question: a retro-cue guides attention to one WM item, thereby arguably refreshing it and increasing its accessibility compared with a no-cue baseline. In contrast to the refreshing deficit hypothesis, intact retro-cue benefits have been found in older adults. Refreshing, however, is assumed to boost not one but several WM representations when sequentially applied to them. Hence, intact refreshing requires the flexible switching of attention among WM items. So far, it remains an open question whether older adults show this flexibility. Here, we investigated whether older adults can use multiple cues to sequentially refresh WM representations. Younger and older adults completed a continuous-color delayed-estimation task, in which the number of retro-cues (0, 1, or 2) presented during the retention interval was manipulated. The results showed a similar retro-cue benefit for younger and older adults, even in the two-cue condition in which participants had to switch attention between items to refresh representations in WM. These findings suggest that the capacity to use cues to refresh information in visual WM may be preserved with age.

The Benefit of Attention-to-Memory Depends on the Interplay of Memory Capacity and Memory Load

Humans can be cued to attend to an item in memory, which facilitates and enhances the perceptual precision in recalling this item. Here, we demonstrate that this facilitating effect of attention-to-memory hinges on the overall degree of memory load. The benefit an individual draws from attention-to-memory depends on her overall working memory performance, measured as sensitivity (d') in a retroactive cue (retro-cue) pitch discrimination task. While listeners maintained 2, 4, or 6 auditory syllables in memory, we provided valid or neutral retro-cues to direct listeners' attention to one, to-be-probed syllable in memory. Participants' overall memory performance (i.e., perceptual sensitivity d') was relatively unaffected by the presence of valid retro-cues across memory loads. However, a more fine-grained analysis using psychophysical modeling shows that valid retro-cues elicited faster pitch-change judgments and improved perceptual precision. Importantly, as memory load increased, listeners' overall working memory performance correlated with inter-individual differences in the degree to which precision improved (r = 0.39, p = 0.029). Under high load, individuals with low working memory profited least from attention-to-memory. Our results demonstrate that retrospective attention enhances perceptual precision of attended items in memory but listeners' optimal use of informative cues depends on their overall memory abilities.

A neural model of retrospective attention in visual working memory

An informative cue that directs attention to one of several items in working memory improves subsequent recall of that item. Here we examine the mechanism of this retro-cue effect using a model of short-term memory based on neural population coding. Our model describes recalled feature values as the output of an optimal decoding of spikes generated by a tuned population of neurons. This neural model provides a better account of human recall data than an influential model that assumes errors can be described as a mixture of normally distributed noise and random guesses. The retro-cue benefit is revealed to be consistent with a higher firing rate of the population encoding the cued versus uncued items, with no difference in tuning specificity. Additionally, a retro-cued item is less likely to be swapped with another item in memory, an effect that can also be explained by greater activity of the underlying population. These results provide a parsimonious account of the effects of retrospective attention on recall and demonstrate a principled method for investigating neural representations with behavioral tasks.

In search of the focus of attention in working memory: 13 years of the retro-cue effect

The concept of attention has a prominent place in cognitive psychology. Attention can be directed not only to perceptual information, but also to information in working memory (WM). Evidence for an internal focus of attention has come from the retro-cue effect: Performance in tests of visual WM is improved when attention is guided to the test-relevant contents of WM ahead of testing them. The retro-cue paradigm has served as a test bed to empirically investigate the functions and limits of the focus of attention in WM. In this article, we review the growing body of (behavioral) studies on the retro-cue effect. We evaluate the degrees of experimental support for six hypotheses about what causes the retro-cue effect: (1) Attention protects representations from decay, (2) attention prioritizes the selected WM contents for comparison with a probe display, (3) attended representations are strengthened in WM, (4) not-attended representations are removed from WM, (5) a retro-cue to the retrieval target provides a head start for its retrieval before decision making, and (6) attention protects the selected representation from perceptual interference. The extant evidence provides support for the last four of these hypotheses.

Working memory accuracy for multiple targets is driven by reward expectation and stimulus contrast with different time-courses

The richness of sensory input dictates that the brain must prioritize and select information for further processing and storage in working memory. Stimulus salience and reward expectations influence this prioritization but their relative contributions and underlying mechanisms are poorly understood. Here we investigate how the quality of working memory for multiple stimuli is determined by priority during encoding and later memory phases. Selective attention could, for instance, act as the primary gating mechanism when stimuli are still visible. Alternatively, observers might still be able to shift priorities across memories during maintenance or retrieval. To distinguish between these possibilities, we investigated how and when reward cues determine working memory accuracy and found that they were only effective during memory encoding. Previously learned, but currently non-predictive, color-reward associations had a similar influence, which gradually weakened without reinforcement. Finally, we show that bottom-up salience, manipulated through varying stimulus contrast, influences memory accuracy during encoding with a fundamentally different time-course than top-down reward cues. While reward-based effects required long stimulus presentation, the influence of contrast was strongest with brief presentations. Our results demonstrate how memory resources are distributed over memory targets and implicates selective attention as a main gating mechanism between sensory and memory systems.

Benefits of flexible prioritization in working memory can arise without costs

Most recent models conceptualize working memory (WM) as a continuous resource, divided up according to task demands. When an increasing number of items need to be remembered, each item receives a smaller chunk of the memory resource. These models predict that the allocation of attention to high-priority WM items during the retention interval should be a zero-sum game: improvements in remembering cued items come at the expense of uncued items because resources are dynamically transferred from uncued to cued representations. The current study provides empirical data challenging this model. Four precision retrocueing WM experiments assessed cued and uncued items on every trial. This permitted a test for trade-off of the memory resource. We found no evidence for trade-offs in memory across trials. Moreover, robust improvements in WM performance for cued items came at little or no cost to uncued items that were probed afterward, thereby increasing the net capacity of WM relative to neutral cueing conditions. An alternative mechanism of prioritization proposes that cued items are transferred into a privileged state within a response-gating bottleneck, in which an item uniquely controls upcoming behavior. We found evidence consistent with this alternative. When an uncued item was probed first, report of its orientation was biased away from the cued orientation to be subsequently reported. We interpret this bias as competition for behavioral control in the output-driving bottleneck. Other items in WM did not bias each other, making this result difficult to explain with a shared resource model.

This study challenges the dominant model for how we remember and prioritize pieces of information over short intervals (working memory). The dominant view is that all items in working memory share a single resource, and that we can prioritize one item by redistributing resources in its favor. This view predicts that nonprioritized memories become lost or impoverished. By testing how well participants remember both prioritized and nonprioritized items, we show that this is not the case. Our findings suggest that memories can be prioritized flexibly without necessarily jeopardizing others that may still become relevant.

Attentional Modulation of Change Detection ERP Components by Peripheral Retro-Cueing

Change detection is essential for visual perception and performance in our environment. However, observers often miss changes that should be easily noticed. A failure in any of the processes involved in conscious detection (encoding the pre-change display, maintenance of that information within working memory, and comparison of the pre and post change displays) can lead to change blindness. Given that unnoticed visual changes in a scene can be easily detected once attention is drawn to them, it has been suggested that attention plays an important role on visual awareness. In the present study, we used behavioral and electrophysiological (ERPs) measures to study whether the manipulation of retrospective spatial attention affects performance and modulates brain activity related to the awareness of a change. To that end, exogenous peripheral cues were presented during the delay period (retro-cues) between the first and the second array using a one-shot change detection task. Awareness of a change was associated with a posterior negative amplitude shift around 228–292 ms (“Visual Awareness Negativity”), which was independent of retrospective spatial attention, as it was elicited to both validly and invalidly cued change trials. Change detection was also associated with a larger positive deflection around 420–580 ms (“Late Positivity”), but only when the peripheral retro-cues correctly predicted the change. Present results confirm that the early and late ERP components related to change detection can be functionally dissociated through manipulations of exogenous retro-cueing using a change blindness paradigm.

Adverse orienting effects on visual working memory encoding and maintenance

Visual working memory (VWM) representations can be strengthened by pre-cues presented before, and retro-cues presented after, the memory display, providing evidence that attentional orienting plays a role in memory encoding and maintenance. It is unknown whether attentional orienting to VWM stimuli can also have adverse effects (known as inhibition of return; IOR), as has been found for perceptual-cueing tasks. If so, this would provide further evidence for common attentional orienting mechanisms for mnemonic and perceptual representations. In Experiment 1, we used pre-cueing and demonstrated an increased encoding probability, but not precision, at short SOAs, but probability decreased at long SOAs, reminiscent of the classic IOR findings. In Experiment 2, we used retro-cueing and showed that it improved memory performance, unless attention was cued back to the center of the display by a second cue. In this case, the deleterious effects were on precision, indicating that the item was still retained, but its quality of representation suffered. Together, these results provide further evidence for universal spatial attentional mechanisms operating on perceptual as well as mnemonic representations.

Recognition Decisions From Visual Working Memory Are Mediated by Continuous Latent Strengths

Making recognition decisions often requires us to reference the contents of working memory, the information available for ongoing cognitive processing. As such, understanding how recognition decisions are made when based on the contents of working memory is of critical importance. In this work we examine whether recognition decisions based on the contents of visual working memory follow a continuous decision process of graded information about the correct choice or a discrete decision process reflecting only knowing and guessing. We find a clear pattern in favor of a continuous latent strength model of visual working memory-based decision making, supporting the notion that visual recognition decision processes are impacted by the degree of matching between the contents of working memory and the choices given. Relation to relevant findings and the implications for human information processing more generally are discussed.

Attentional effects on orientation judgements are dependent on memory consolidation processes

Are the effects of memory and attention on perception synergistic, antagonistic, or independent? Tested separately, memory and attention have been shown to affect the accuracy of orientation judgements. When multiple stimuli are presented sequentially versus simultaneously, error variance is reduced. When a target is validly cued, precision is increased. What if they are manipulated together? We combined memory and attention manipulations in an orientation judgement task to answer this question. Two circular gratings were presented sequentially or simultaneously. On some trials a brief luminance cue preceded the stimuli. Participants were cued to report the orientation of one of the two gratings by rotating a response grating. We replicated the finding that error variance is reduced on sequential trials. Critically, we found interacting effects of memory and attention. Valid cueing reduced the median, absolute error only when two stimuli appeared together and improved it to the level of performance on uncued sequential trials, whereas invalid cueing always increased error. This effect was not mediated by cue predictiveness; however, predictive cues reduced the standard deviation of the error distribution, whereas nonpredictive cues reduced “guessing”. Our results suggest that, when the demand on memory is greater than a single stimulus, attention is a bottom-up process that prioritizes stimuli for consolidation. Thus attention and memory are synergistic.

Retro-dimension-cue benefit in visual working memory

In visual working memory (VWM) tasks, participants’ performance can be improved by a retro-object-cue. However, previous studies have not investigated whether participants’ performance can also be improved by a retro-dimension-cue. Three experiments investigated this issue. We used a recall task with a retro-dimension-cue in all experiments. In Experiment 1, we found benefits from retro-dimension-cues compared to neutral cues. This retro-dimension-cue benefit is reflected in an increased probability of reporting the target, but not in the probability of reporting the non-target, as well as increased precision with which this item is remembered. Experiment 2 replicated the retro-dimension-cue benefit and showed that the length of the blank interval after the cue disappeared did not influence recall performance. Experiment 3 replicated the results of Experiment 2 with a lower memory load. Our studies provide evidence that there is a robust retro-dimension-cue benefit in VWM. Participants can use internal attention to flexibly allocate cognitive resources to a particular dimension of memory representations. The results also support the feature-based storing hypothesis.

Retrospective Attention Interacts with Stimulus Strength to Shape Working Memory Performance

Orienting attention retrospectively to selective contents in working memory (WM) influences performance. A separate line of research has shown that stimulus strength shapes perceptual representations. There is little research on how stimulus strength during encoding shapes WM performance, and how effects of retrospective orienting might vary with changes in stimulus strength. We explore these questions in three experiments using a continuous-recall WM task. In Experiment 1 we show that benefits of cueing spatial attention retrospectively during WM maintenance (retrocueing) varies according to stimulus contrast during encoding. Retrocueing effects emerge for supraliminal but not sub-threshold stimuli. However, once stimuli are supraliminal, performance is no longer influenced by stimulus contrast. In Experiments 2 and 3 we used a mixture-model approach to examine how different sources of error in WM are affected by contrast and retrocueing. For high-contrast stimuli (Experiment 2), retrocues increased the precision of successfully remembered items. For low-contrast stimuli (Experiment 3), retrocues decreased the probability of mistaking a target with distracters. These results suggest that the processes by which retrospective attentional orienting shape WM performance are dependent on the quality of WM representations, which in turn depends on stimulus strength during encoding.

The lasting memory enhancements of retrospective attention

Behavioral research has shown that spatial cues that orient attention toward task relevant items being maintained in visual short-term memory (VSTM) enhance item memory accuracy. However, it is unknown if these retrospective attentional cues ("retro-cues") enhance memory beyond typical short-term memory delays. It is also unknown whether retro-cues affect the spatial information associated with VSTM representations. Emerging evidence suggests that processes that affect short-term memory maintenance may also affect long-term memory (LTM) but little work has investigated the role of attention in LTM. In the current event-related potential (ERP) study, we investigated the duration of retrospective attention effects and the impact of retrospective attention manipulations on VSTM representations. Results revealed that retro-cueing improved both VSTM and LTM memory accuracy and that posterior maximal ERPs observed during VSTM maintenance predicted subsequent LTM performance. N2pc ERPs associated with attentional selection were attenuated by retro-cueing suggesting that retrospective attention may disrupt maintenance of spatial configural information in VSTM. Collectively, these findings suggest that retrospective attention can alter the structure of memory representations, which impacts memory performance beyond short-term memory delays.

The Focus of Attention in Visual Working Memory: Protection of Focused Representations and Its Individual Variation

Visual working memory can be modulated according to changes in the cued task relevance of maintained items. Here, we investigated the mechanisms underlying this modulation. In particular, we studied the consequences of attentional selection for selected and unselected items, and the role of individual differences in the efficiency with which attention is deployed. To this end, performance in a visual working memory task as well as the CDA/SPCN and the N2pc, ERP components associated with visual working memory and attentional processes, were analysed. Selection during the maintenance stage was manipulated by means of two successively presented retrocues providing spatial information as to which items were most likely to be tested. Results show that attentional selection serves to robustly protect relevant representations in the focus of attention while unselected representations which may become relevant again still remain available. Individuals with larger retrocueing benefits showed higher efficiency of attentional selection, as indicated by the N2pc, and showed stronger maintenance-associated activity (CDA/SPCN). The findings add to converging evidence that focused representations are protected, and highlight the flexibility of visual working memory, in which information can be weighted according its relevance.

Selective Attention to Auditory Memory Neurally Enhances Perceptual Precision

Selective attention to a task-relevant stimulus facilitates encoding of that stimulus into a working memory representation. It is less clear whether selective attention also improves the precision of a stimulus already represented in memory. Here, we investigate the behavioral and neural dynamics of selective attention to representations in auditory working memory (i.e., auditory objects) using psychophysical modeling and model-based analysis of electroencephalographic signals. Human listeners performed a syllable pitch discrimination task where two syllables served as to-be-encoded auditory objects. Valid (vs neutral) retroactive cues were presented during retention to allow listeners to selectively attend to the to-be-probed auditory object in memory. Behaviorally, listeners represented auditory objects in memory more precisely (expressed by steeper slopes of a psychometric curve) and made faster perceptual decisions when valid compared to neutral retrocues were presented. Neurally, valid compared to neutral retrocues elicited a larger frontocentral sustained negativity in the evoked potential as well as enhanced parietal alpha/low-beta oscillatory power (9-18 Hz) during memory retention. Critically, individual magnitudes of alpha oscillatory power (7-11 Hz) modulation predicted the degree to which valid retrocues benefitted individuals' behavior. Our results indicate that selective attention to a specific object in auditory memory does benefit human performance not by simply reducing memory load, but by actively engaging complementary neural resources to sharpen the precision of the task-relevant object in memory.

SIGNIFICANCE STATEMENT

Can selective attention improve the representational precision with which objects are held in memory? And if so, what are the neural mechanisms that support such improvement? These issues have been rarely examined within the auditory modality, in which acoustic signals change and vanish on a milliseconds time scale. Introducing a new auditory memory paradigm and using model-based electroencephalography analyses in humans, we thus bridge this gap and reveal behavioral and neural signatures of increased, attention-mediated working memory precision. We further show that the extent of alpha power modulation predicts the degree to which individuals' memory performance benefits from selective attention.

Top-Down Activation of Spatiotopic Sensory Codes in Perceptual and Working Memory Search

A critical requirement of an efficient cognitive system is the selection and prioritization of relevant information. This occurs when selecting specific items from our sensory inputs, which then receive preferential status at subsequent levels of processing. Many everyday tasks also require us to select internal representations, such as a relevant item from memory. We show that both of these types of search are underpinned by the spatiotopic activation of sensory codes, using both fMRI and MEG data. When individuals searched for perceived and remembered targets, the MEG data highlighted a sensor level electrophysiological effect that reflects the contralateral organization of the visual system-namely, the N2pc. The fMRI data were used to identify a network of frontoparietal areas common to both types of search, as well as the early visual areas activated by the search display. We then combined fMRI and MEG data to explore the temporal dynamics of functional connections between the frontoparietal network and the early visual areas. Searching for a target item resulted in significantly enhanced phase-phase coupling between the frontoparietal network and the visual areas contralateral to the perceived or remembered location of that target. This enhancement of spatially specific phase-phase coupling occurred before the N2pc effect and was significantly associated with it on a trial-by-trial basis. The combination of these two imaging modalities suggests that perceptual and working memory search are underpinned by the synchronization of a frontoparietal network and the relevant sensory cortices.