Attention restores discrete items to visual short-term memory

Attention and memory protection: Interactions between retrospective attention cueing and interference

Visual working memory (VWM) and attention have a number of features in common, but despite extensive research it is still unclear how the two interact. Can focused attention improve VWM precision? Can it protect VWM from interference? Here we used a partial-report, continuous-response orientation memory task to examine how attention and interference affect different aspects of VWM and how they interact with one another. Both attention and interference were orthogonally manipulated during the retention interval. Attention was manipulated by presenting informative retro-cues, whereas interference was manipulated by introducing a secondary interfering task. Mixture-model analyses revealed that retro-cues, compared to uninformative cues, improved all aspects of performance: Attention increased recall precision and decreased guessing rate and swap-errors (reporting a wrong item in memory). Similarly, performing a secondary task impaired all aspects of the VWM task. In particular, an interaction between retro-cue and secondary task interference was found primarily for swap-errors. Together these results suggest that both the quantity and quality of VWM representations are sensitive to attention cueing and interference modulations, and they highlight the role of attention in protecting the feature-location associations needed to access the correct items in memory.

'Activity-silent' working memory in prefrontal cortex: a dynamic coding framework

•

WM is thought to depend on persistent maintenance of stationary activity states.

•

However, population-level analyses reveal that brain activity is highly dynamic.

•

Accumulating evidence implicates activity-silent neural states for WM.

•

Dynamic coding suggests that WM is encoded in patterns of functional connectivity.

Working memory (WM) provides the functional backbone to high-level cognition. Maintenance in WM is often assumed to depend on the stationary persistence of neural activity patterns that represent memory content. However, accumulating evidence suggests that persistent delay activity does not always accompany WM maintenance but instead seems to wax and wane as a function of the current task relevance of memoranda. Furthermore, new methods for measuring and analysing population-level patterns show that activity states are highly dynamic. At first glance, these dynamics seem at odds with the very nature of WM. How can we keep a stable thought in mind while brain activity is constantly changing? This review considers how neural dynamics might be functionally important for WM maintenance.

Frontoparietal and Cingulo-opercular Networks Play Dissociable Roles in Control of Working Memory

We used magnetoencephalography to characterize the spatiotemporal dynamics of cortical activity during top-down control of working memory (WM). fMRI studies have previously implicated both the frontoparietal and cingulo-opercular networks in control over WM, but their respective contributions are unclear. In our task, spatial cues indicating the relevant item in a WM array occurred either before the memory array or during the maintenance period, providing a direct comparison between prospective and retrospective control of WM. We found that in both cases a frontoparietal network activated following the cue, but following retrocues this activation was transient and was succeeded by a cingulo-opercular network activation. We also characterized the time course of top-down modulation of alpha activity in visual/parietal cortex. This modulation was transient following retrocues, occurring in parallel with the frontoparietal network activation. We suggest that the frontoparietal network is responsible for top-down modulation of activity in sensory cortex during both preparatory attention and orienting within memory. In contrast, the cingulo-opercular network plays a more downstream role in cognitive control, perhaps associated with output gating of memory.

Focused attention improves working memory: implications for flexible-resource and discrete-capacity models

Performance in working memory (WM) tasks depends on the capacity for storing objects and on the allocation of attention to these objects. Here, we explored how capacity models need to be augmented to account for the benefit of focusing attention on the target of recall. Participants encoded six colored disks (Experiment 1) or a set of one to eight colored disks (Experiment 2) and were cued to recall the color of a target on a color wheel. In the no-delay condition, the recall-cue was presented after a 1,000-ms retention interval, and participants could report the retrieved color immediately. In the delay condition, the recall-cue was presented at the same time as in the no-delay condition, but the opportunity to report the color was delayed. During this delay, participants could focus attention exclusively on the target. Responses deviated less from the target's color in the delay than in the no-delay condition. Mixture modeling assigned this benefit to a reduction in guessing (Experiments 1 and 2) and transposition errors (Experiment 2). We tested several computational models implementing flexible or discrete capacity allocation, aiming to explain both the effect of set size, reflecting the limited capacity of WM, and the effect of delay, reflecting the role of attention to WM representations. Both models fit the data better when a spatially graded source of transposition error is added to its assumptions. The benefits of focusing attention could be explained by allocating to this object a higher proportion of the capacity to represent color.

A multisensory perspective of working memory

Although our sensory experience is mostly multisensory in nature, research on working memory representations has focused mainly on examining the senses in isolation. Results from the multisensory processing literature make it clear that the senses interact on a more intimate manner than previously assumed. These interactions raise questions regarding the manner in which multisensory information is maintained in working memory. We discuss the current status of research on multisensory processing and the implications of these findings on our theoretical understanding of working memory. To do so, we focus on reviewing working memory research conducted from a multisensory perspective, and discuss the relation between working memory, attention, and multisensory processing in the context of the predictive coding framework. We argue that a multisensory approach to the study of working memory is indispensable to achieve a realistic understanding of how working memory processes maintain and manipulate information.

L. Olivers C. The time course of protecting a visual memory representation from perceptual interference

Cueing a remembered item during the delay of a visual memory task leads to enhanced recall of the cued item compared to when an item is not cued. This cueing benefit has been proposed to reflect attention within visual memory being shifted from a distributed mode to a focused mode, thus protecting the cued item against perceptual interference. Here we investigated the dynamics of building up this mnemonic protection against visual interference by systematically varying the stimulus onset asynchrony (SOA) between cue onset and a subsequent visual mask in an orientation memory task. Experiment 1 showed that a cue counteracted the deteriorating effect of pattern masks. Experiment 2 demonstrated that building up this protection is a continuous process that is completed in approximately half a second after cue onset. The similarities between shifting attention in perceptual and remembered space are discussed.

Attentional cueing by cross-modal congruency produces both facilitation and inhibition on short-term visual recognition

The attentional modulation of performance in a memory task, comparable to the one obtained in a perceptual task, is at the focus of contemporary research. We hypothesized that a biphasic effect (namely, facilitation followed by inhibition) can be obtained in visual working memory when attention is cued towards one item of the memorandum and participants must recognize a delayed probe as being identical to any item of the memorandum. In every trial, a delayed spiky/curvy probe appeared centrally, to be matched with the same-category shape maintained in visual working memory which could be either physically identical (positive trials) or only categorically similar (negative trials). To orient the participant's attention towards a selected portion of a two-item memorandum, a (tzk/wow) sound was played simultaneously with two lateral visual shapes (one spiky and one curved). Our results indicate that an exogenous attentional shift during perception of the memorandum, induced by a congruent audio-visual pairing, first facilitates and then inhibits the recognition of a cued item (but not of a non-cued item) stored in visual working memory. A coherent pattern of individual differences emerged, indicating that the amount of early facilitation in congruent-sound trials was negatively correlated with recognition sensitivity in no-sound trials (suggesting that the inverse effectiveness rule may also apply to memory) and positively correlated with later inhibition, as well as with the self-reported susceptibility to memory failures.

Temporal dynamics of attention during encoding versus maintenance of working memory: complementary views from event-related potentials and alpha-band oscillations

Working memory (WM) is strongly influenced by attention. In visual WM tasks, recall performance can be improved by an attention-guiding cue presented before encoding (precue) or during maintenance (retrocue). Although precues and retrocues recruit a similar frontoparietal control network, the two are likely to exhibit some processing differences, because precues invite anticipation of upcoming information whereas retrocues may guide prioritization, protection, and selection of information already in mind. Here we explored the behavioral and electrophysiological differences between precueing and retrocueing in a new visual WM task designed to permit a direct comparison between cueing conditions. We found marked differences in ERP profiles between the precue and retrocue conditions. In line with precues primarily generating an anticipatory shift of attention toward the location of an upcoming item, we found a robust lateralization in late cue-evoked potentials associated with target anticipation. Retrocues elicited a different pattern of ERPs that was compatible with an early selection mechanism, but not with stimulus anticipation. In contrast to the distinct ERP patterns, alpha-band (8-14 Hz) lateralization was indistinguishable between cue types (reflecting, in both conditions, the location of the cued item). We speculate that, whereas alpha-band lateralization after a precue is likely to enable anticipatory attention, lateralization after a retrocue may instead enable the controlled spatiotopic access to recently encoded visual information.

Modulation of alpha power at encoding and retrieval tracks the precision of visual short-term memory

Our ability to hold information in mind is strictly limited. We sought to understand the relationship between oscillatory brain activity and the allocation of resources within visual short-term memory (VSTM). Participants attempted to remember target arrows embedded among distracters and used a continuous method of responding to report their memory for a cued target item. Trial-to-trial variability in the absolute circular accuracy with which participants could report the target was predicted by event-related alpha synchronization during initial processing of the memoranda and by alpha desynchronization during the retrieval of those items from VSTM. Using a model-based approach, we were also able to explore further which parameters of VSTM-guided behavior were most influenced by alpha band changes. Alpha synchronization during item processing enhanced the precision with which an item could be retained without affecting the likelihood of an item being represented per se (as indexed by the guessing rate). Importantly, our data outline a neural mechanism that mirrors the precision with which items are retained; the greater the alpha power enhancement during encoding, the greater the precision with which that item can be retained.

Orienting attention in visual working memory requires central capacity: decreased retro-cue effects under dual-task conditions

The retro-cue effect (RCE) describes superior working memory performance for validly cued stimulus locations long after encoding has ended. Importantly, this happens with delays beyond the range of iconic memory. In general, the RCE is a stable phenomenon that emerges under varied stimulus configurations and timing parameters. We investigated its susceptibility to dual-task interference to determine the attentional requirements at the time point of cue onset and encoding. In Experiment 1, we compared single- with dual-task conditions. In Experiment 2, we borrowed from the psychological refractory period paradigm and compared conditions with high and low (dual-) task overlap. The secondary task was always binary tone discrimination requiring a manual response. Across both experiments, an RCE was found, but it was diminished in magnitude in the critical dual-task conditions. A previous study did not find evidence that sustained attention is required in the interval between cue offset and test. Our results apparently contradict these findings and point to a critical time period around cue onset and briefly thereafter during which attention is required.

Modulation of alpha and gamma oscillations related to retrospectively orienting attention within working memory

Selective attention mechanisms allow us to focus on information that is relevant to the current behavior and, equally important, ignore irrelevant information. An influential model proposes that oscillatory neural activity in the alpha band serves as an active functional inhibitory mechanism. Recent studies have shown that, in the same way that attention can be selectively oriented to bias sensory processing in favor of relevant stimuli in perceptual tasks, it is also possible to retrospectively orient attention to internal representations held in working memory. However, these studies have not explored the associated oscillatory phenomena. In the current study, we analysed the patterns of neural oscillatory activity recorded with magnetoencephalography while participants performed a change detection task, in which a spatial retro-cue was presented during the maintenance period, indicating which item or items were relevant for subsequent retrieval. Participants benefited from retro-cues in terms of accuracy and reaction time. Retro-cues also modulated oscillatory activity in the alpha and gamma frequency bands. We observed greater alpha activity in a ventral visual region ipsilateral to the attended hemifield, thus supporting its suppressive role, i.e. a functional disengagement of task-irrelevant regions. Accompanying this modulation, we found an increase in gamma activity contralateral to the attended hemifield, which could reflect attentional orienting and selective processing. These findings suggest that the oscillatory mechanisms underlying attentional orienting to representations held in working memory are similar to those engaged when attention is oriented in the perceptual space.

Attention biases visual activity in visual short-term memory

In the current study, we tested whether representations in visual STM (VSTM) can be biased via top-down attentional modulation of visual activity in retinotopically specific locations. We manipulated attention using retrospective cues presented during the retention interval of a VSTM task. Retrospective cues triggered activity in a large-scale network implicated in attentional control and led to retinotopically specific modulation of activity in early visual areas V1-V4. Importantly, shifts of attention during VSTM maintenance were associated with changes in functional connectivity between pFC and retinotopic regions within V4. Our findings provide new insights into top-down control mechanisms that modulate VSTM representations for flexible and goal-directed maintenance of the most relevant memoranda.

The effect of visual salience on memory-based choices

Deciding whether a stimulus is the "same" or "different" from a previous presented one involves integrating among the incoming sensory information, working memory, and perceptual decision making. Visual selective attention plays a crucial role in selecting the relevant information that informs a subsequent course of action. Previous studies have mainly investigated the role of visual attention during the encoding phase of working memory tasks. In this study, we investigate whether manipulation of bottom-up attention by changing stimulus visual salience impacts on later stages of memory-based decisions. In two experiments, we asked subjects to identify whether a stimulus had either the same or a different feature to that of a memorized sample. We manipulated visual salience of the test stimuli by varying a task-irrelevant feature contrast. Subjects chose a visually salient item more often when they looked for matching features and less often so when they looked for a nonmatch. This pattern of results indicates that salient items are more likely to be identified as a match. We interpret the findings in terms of capacity limitations at a comparison stage where a visually salient item is more likely to exhaust resources leading it to be prematurely parsed as a match.