Memory-based attentional capture by colour and shape contents in visual working memory

Feature-based attentional control for distractor suppression

To investigate whether attentional suppression is merely a byproduct of target facilitation or a result of independent mechanisms for distractor suppression, the present study examined whether attentional suppression takes place when target facilitation hardly occurs using a spatial cueing paradigm. Participants searched for target letters that were not red, i.e., a negative color. On each trial, a target color was randomly chosen among 12 colors to prevent establishing attentional control for target colors and to reduce intertrial priming for target colors. Immediately before a target display, a noninformative spatial cue was presented at one of the possible target locations. The cue was rendered in a negative color, which was to be ignored, to detect targets or the reference color, which was never presented for target and non-target letters. Experiment 1 showed that negative color cues captured attention less than reference color cues, suggesting feature-based attentional suppression. The suppression effect was replicated when the temporal interval between the onsets of the cue and target displays was reduced in Experiments 2 and 3, suggesting proactive suppression. Experiment 3 directly confirmed no attentional control settings for target colors and intertrial priming. These findings suggest that distractor features can guide attention at the pre-attentive stage when target features are not used to attend to targets.

Diminishing sensitivity and absolute difference in value-driven attention

Kim and Beck (2020b) demonstrated that value-driven attention is based on relative value rather than absolute value, suggesting that prospect theory is relevant to our understanding of value-driven attention. To further this understanding, the present study investigated the impacts of diminishing sensitivity on value-driven attention. According to diminishing sensitivity, changes in outcomes have greater impacts nearer the reference point of 0 than farther from the point. Thus, the difference between $1 and $100 looms larger than that between $901 and $1000, due to their different ratios (100/1 > 1000/901). However, according to the absolute difference hypothesis, the differences should have similar impacts due to the absolute differences being the same (100 – 1 = 1000 – 901). Experiment 1 investigated whether diminishing sensitivity operates in the modified value-driven attention paradigm while controlling the impact of absolute differences. In the training phase, 100-point and 1000-point color targets had references of 1-point and 901-point color targets, respectively. In the test phase, 100-point color distractors attracted attention more than 1000-point color distractors, supporting the diminishing sensitivity hypothesis. Experiment 2 examined the absolute difference hypothesis while controlling the impact of diminishing sensitivity. Contrary to the absolute difference hypothesis, the test phase showed that 1000-point color distractors (compared with 10-point colors for a 990 absolute difference in the training phase) failed to attract attention more than 100-point color distractors (compared with 1-point colors, for a 99 absolute difference). These results suggest that diminishing sensitivity rather than absolute difference influences value-driven attention, further supporting the relevance of prospect theory to value-driven attention.

Allocation of resources in working memory: Theoretical and empirical implications for visual search

Recently, working memory (WM) has been conceptualized as a limited resource, distributed flexibly and strategically between an unlimited number of representations. In addition to improving the precision of representations in WM, the allocation of resources may also shape how these representations act as attentional templates to guide visual search. Here, we reviewed recent evidence in favor of this assumption and proposed three main principles that govern the relationship between WM resources and template-guided visual search. First, the allocation of resources to an attentional template has an effect on visual search, as it may improve the guidance of visual attention, facilitate target recognition, and/or protect the attentional template against interference. Second, the allocation of the largest amount of resources to a representation in WM is not sufficient to give this representation the status of attentional template and thus, the ability to guide visual search. Third, the representation obtaining the status of attentional template, whether at encoding or during maintenance, receives an amount of WM resources proportional to its relevance for visual search. Thus defined, the resource hypothesis of visual search constitutes a parsimonious and powerful framework, which provides new perspectives on previous debates and complements existing models of template-guided visual search.

Bottom-up perceptual salience and top-down retro-cues concurrently determine state in visual working memory

Recent studies have demonstrated that in visual working memory (VWM), only items in an active state can guide attention. Further evidence has revealed that items with higher perceptual salience or items prioritised by a valid retro-cue in VWM tend to be in an active state. However, it is unclear which factor (perceptual salience or retro-cues) is more important for influencing the item state in VWM or whether the factors can act concurrently. Experiment 1 examined the role of perceptual salience by asking participants to hold two features with relatively different perceptual salience (colour vs. shape) in VWM while completing a visual search task. Guidance effects were found when either colour or both colour and shape in VWM matched one of the search distractors but not when shape matched. This demonstrated that the more salient feature in VWM can actively guide attention, while the less salient feature cannot. However, when shape in VWM was cued to be more relevant (prioritised) in Experiment 2, we found guidance effects in both colour-match and shape-match conditions. That is, both more salient but non-cued colour and less salient but cued shape could be active in VWM, such that attentional selection was affected by the matching colour or shape in the visual search task. This suggests that bottom-up perceptual salience and top-down retro-cues can jointly determine the active state in VWM.

Object features reinstated from episodic memory guide attentional selection

When observers search for an object in the environment, they compare the incoming sensory information to the attentional template, a representation of the target in visual working memory (VWM). Previous studies have shown that visual search is more efficient when the attentional template is precise. We pursued the hypothesis that the attentional template in VWM is automatically complemented by features from long-term memory, possibly to increase its precision. At the beginning of the experiment, observers learned associations between shape and color. Then, we tested whether selecting one of these shapes was influenced by the previously associated color. To this end, we ran a saccadic selection task consisting of a memory and choice display. In the memory display, the target shape was presented at central fixation and participants were instructed to foveate this shape in the subsequent choice display. In the choice display, the target shape appeared together with a distractor shape at eccentric positions. Importantly, the target shape was colorless (gray) in the memory display so that only shape, but not color was loaded into VWM. However, saccades went more frequently to the target shape when it was shown in the learned color than when this color was shown in the distractor. Thus, the color of the target shape was reinstated from episodic memory to complement the attentional template in VWM.

Task-Irrelevant Features in Visual Working Memory Influence Covert Attention: Evidence from a Partial Report Task

Selecting a target based on a representation in visual working memory (VWM) affords biasing covert attention towards objects with memory-matching features. Recently, we showed that even task-irrelevant features of a VWM template bias attention. Specifically, when participants had to saccade to a cued shape, distractors sharing the cue's search-irrelevant color captured the eyes. While a saccade always aims at one target location, multiple locations can be attended covertly. Here, we investigated whether covert attention is captured similarly as the eyes. In our partial report task, each trial started with a shape-defined search cue, followed by a fixation cross. Next, two colored shapes, each including a letter, appeared left and right from fixation, followed by masks. The letter inside that shape matching the preceding cue had to be reported. In Experiment 1, either target, distractor, both, or no object matched the cue's irrelevant color. Target-letter reports were most frequent in target-match trials and least frequent in distractor-match trials. Irrelevant cue and target color never matched in Experiment 2. Still, participants reported the distractor more often to the target's disadvantage, when cue and distractor color matched. Thus, irrelevant features of a VWM template can influence covert attention in an involuntarily object-based manner when searching for trial-wise varying targets.

The precision of attentional selection is far worse than the precision of the underlying memory representation

Voluntary attentional selection requires the match of sensory input to a stored representation of the target features. We compared the precision of attentional selection to the precision of the underlying memory representation of the target. To measure the precision of attentional selection, we used a cue-target paradigm where participants searched for a colored target. Typically, RTs are shorter at the cued compared to uncued locations when the cue has the same color as the target. In contrast, cueing effects are absent or even inverted when cue and target colors are dissimilar. By systematically varying the difference between cue and target color, we calculated a function relating cue color to cueing effects. The width of this function reflects the precision of attentional selection and was compared to the precision of judgments of the target color on a color wheel. The precision of the memory representation was far better than the precision of attentional selection. When the task was made more difficult by increasing the similarity between the target and the nontarget stimuli in the target display, the precision of attentional selection increased, but was still worse than the precision of memory. When the search task was made more difficult, we also observed that for dissimilar cue colors, RTs were slower at cued than at uncued locations (i.e., same location costs), suggesting that improvements in attentional selectivity were achieved by suppressing non-target colors.

Quantifying the Attentional Impact of Working Memory Matching Targets and Distractors

Various theoretical proposals have been put forward to explain how memory representations control attention during visual search. In this study, we use the first saccade on each trial as away to quantify the attentional impact of multiple types of representations held in working memory. Across two experiments, we found that a search target maintained in working memory was attended over 20 times more frequently than a non-memory-matching distractor. In addition, an item matching an additional object represented in working memory was attended 2 times more frequently than a non-memory matching distractor. These findings show that there is a measurable attentional impact of items maintained in working memory for a future task, however, such representations have a much weaker attentional impact than working memory representations of search targets.

Evaluating the Role of the Dorsolateral Prefrontal Cortex and Posterior Parietal Cortex in Memory-Guided Attention With Repetitive Transcranial Magnetic Stimulation

The contents of working memory (WM) can affect the subsequent visual search performance, resulting in either beneficial or cost effects, when the visual search target is included in or spatially dissociated from the memorized contents, respectively. The right dorsolateral prefrontal cortex (rDLPFC) and the right posterior parietal cortex (rPPC) have been suggested to be associated with the congruence/incongruence effects of the WM content and the visual search target. Thus, in the present study, we investigated the role of the dorsolateral prefrontal cortex and the PPC in controlling the interaction between WM and attention during a visual search, using repetitive transcranial magnetic stimulation (rTMS). Subjects maintained a color in WM while performing a search task. The color cue contained the target (valid), the distractor (invalid) or did not reappear in the search display (neutral). Concurrent stimulation with the search onset showed that relative to rTMS over the vertex, rTMS over rPPC and rDLPFC further decreased the search reaction time, when the memory cue contained the search target. The results suggest that the rDLPFC and the rPPC are critical for controlling WM biases in human visual attention.