Can you have multiple attentional templates? Large-scale replications of Van Moorselaar, Theeuwes, and Olivers (2014) and Hollingworth and Beck (2016)

Swift attenuation of irrelevant features through feature consistency: Evidence from a capture-probe version of the contingent-capture protocol

In the present two experiments, we explore the possibility of swift attenuation of capture by irrelevant features in the contingent-capture protocol. Some prior research suggests that feature attenuation might be most efficient for fixed, anticipated irrelevant features and that varying irrelevant features from trial to trial can undermine their successful attenuation. Here, we exploited this dependence of attenuation on feature certainty to test if attenuation contributed to contingent-capture effects in a capture-probe version of the contingent-capture protocol. In line with the swift attenuation of irrelevant features, salient but target-dissimilar singleton cues that were consistently coloured diminished recall of probes at their locations. This was in comparison to inconsistently coloured target-dissimilar singleton cues. Nonetheless, probe-recall was still better at target-dissimilar cue locations than at non-singleton locations in the cueing display, indicating attenuation of task-irrelevant features rather than their complete suppression.

The dynamics of attentional guidance by working memory contents

Working memory (WM) contents can guide attention toward matching sensory information in the environment, but there are mixed findings regarding whether only a single prioritized item or multiple items held in WM can guide attention. The present study examines the limit of WM-guided attention with a novel task procedure and mouse trajectory analysis. Specifically, we introduced a perceptual-matching task utilizing the continuous estimation procedure within the maintenance interval of a WM task for one or two colors. We found that the overall perceptual matching mouse trajectory were robustly biased toward the location of WM-match color on the color-wheel (i.e., attraction bias), but only at memory set size one. However, the analysis of circular mouse trajectory distributions, through hierarchical Bayesian modeling, revealed two separable central peaks at both memory set sizes. Furthermore, model-free analysis demonstrated that the perceptual matching mouse trajectory patterns were similar regardless of memory set sizes. Together, these results support the single-item account and highlight the utility of mouse trajectory analyses in hypothesis testing in experimental psychology.

Working memory training for reward processing in university students with subsyndromal depression: The influence of baseline severity of depression

Previous studies have tentatively suggested that working memory training (WMT) has the potential to improve reward processing, but it is not known how long this improvement lasts, whether there is a lag effect, or whether it is reflected in neurophysiological indicators. In this study, 40 university students with subsyndromal depression were randomly assigned to a training group or a control group and completed a 20-day working memory training task and a simple memory task, respectively. All participants completed the Temporal Experience of Pleasure Scale (TEPS) and a doors task with electroencephalogram (EEG) signals recorded simultaneously on a pre- and post-test and a 3-month follow-up. The reward-related positivity (RewP) amplitude, theta power, and their differences between conditions (i.e., ΔRewP and Δtheta power, respectively) in the doors task were the primary outcomes, and the score on TEPS was the secondary outcome. The results indicated no group-related effects were demonstrated in primary and secondary outcomes at post-test and 3-month follow-up. Furthermore, the differences in the pre- and post-test in Δtheta power were moderated by the baseline severity of depression. This was primarily driven by the fact that the change values in the control group increased with the severity of depression, while the change values in the training group had high homogeneity. Our findings did not provide support for the effect of WMT on reward processing across the whole sample, but without intervention, there would be high heterogeneity in the change in the cognitive control ability to loss feedback, which is detrimental to individuals with high depression severity.

Long-term memory and working memory compete and cooperate to guide attention

Multiple types of memory guide attention: Both long-term memory (LTM) and working memory (WM) effectively guide visual search. Furthermore, both types of memories can capture attention automatically, even when detrimental to performance. It is less clear, however, how LTM and WM cooperate or compete to guide attention in the same task. In a series of behavioral experiments, we show that LTM and WM reliably cooperate to guide attention: Visual search is faster when both memories cue attention to the same spatial location (relative to when only one memory can guide attention). LTM and WM competed to guide attention in more limited circumstances: Competition only occurred when these memories were in different dimensions - particularly when participants searched for a shape and held an accessory color in mind. Finally, we found no evidence for asymmetry in either cooperation or competition: There was no evidence that WM helped (or hindered) LTM-guided search more than the other way around. This lack of asymmetry was found despite differences in LTM-guided and WM-guided search overall, and differences in how two LTMs and two WMs compete or cooperate with each other to guide attention. This work suggests that, even if only one memory is currently task-relevant, WM and LTM can cooperate to guide attention; they can also compete when distracting features are salient enough. This work elucidates interactions between WM and LTM during attentional guidance, adding to the literature on costs and benefits to attention from multiple active memories.

Interactions Between Visual Working Memory, Attention, and Color Categories: A Pupillometry Study

Recent studies have found that visual working memory (VWM) for color shows a categorical bias: observers typically remember colors as more prototypical to the category they belong to than they actually are. Here, we further examine color-category effects on VWM using pupillometry. Participants remembered a color for later reproduction on a color wheel. During the retention interval, a colored probe was presented, and we measured the pupil constriction in response to this probe, assuming that the strength of constriction reflects the visual saliency of the probe. We found that the pupil initially constricted most strongly for non-matching colors that were maximally different from the memorized color; this likely reflects a lack of visual adaptation for these colors, which renders them more salient than memory-matching colors (which were shown before). Strikingly, this effect reversed later in time, such that pupil constriction was more prolonged for memory-matching colors as compared to non-matching colors; this likely reflects that memory-matching colors capture attention more strongly, and perhaps for a longer time, than non-matching colors do. We found no effects of color categories on pupil constriction: after controlling for color distance, (non-matching) colors from the same category as the memory color did not result in a different pupil response as compared to colors from a different category; however, we did find that behavioral responses were biased by color categories. In summary, we found that pupil constriction to colored probes reflects both visual adaptation and VWM content, but, unlike behavioral measures, is not notably affected by color categories.

Theta-Rhythmic Oscillation of Working Memory Performance

Representations held in working memory are crucial in guiding human attention in a goal-directed fashion. Currently, it is debated whether only a single representation or several of these representations can be active and bias behavior at any given moment. In the present study, 25 university students performed a behavioral dense-sampling experiment to produce an estimate of the temporal-activation patterns of two simultaneously held visual templates. We report two key novel results. First, performance related to both representations was not continuous but fluctuated rhythmically at 6 Hz. This corresponds to neural oscillations in the theta band, the functional importance of which in working memory is well established. Second, our findings suggest that two concurrently held representations may be prioritized in alternation, not simultaneously. Our data extend recent research on rhythmic sampling of external information by demonstrating an analogous mechanism in the cyclic activation of internal working memory representations.

Temptation shapes dishonesty and can alter working memory

This study shows that participants tend to remember an ambiguous, directional cue as biased towards stimuli associated with a high reward that can be attained dishonestly. Participants saw eight digits presented in a circular arrangement. On some trials, they were asked to report the digit (“Target Digit”) indicated by a jittery cue that was slightly biased in the direction of another digit (“Second Cued Digit”), which was either higher or lower than the Target Digit. Participants were paid based on the reported digit (higher digits meant higher pay) and not based on the accuracy of their report. In this setting, they could make self-serving mistakes by dishonestly reporting the Second Cued Digit when it was higher than the Target Digit. Replicating prior work, participants frequently made such self-serving mistakes. On other trials, after the digits disappeared, participants were asked to reproduce the direction of the jittery cue, without receiving any pay. Results showed that that participants’ reports of the cue were more biased toward high-rewarding digits than low-rewarding digits. This research provides preliminary evidence of a link between attention, dishonesty, and memory, offering an important constraint for theories in behavioral ethics.

EEG cross-frequency phase synchronization as an index of memory matching in visual search

Visual perception is influenced by our expectancies about incoming sensory information. It is assumed that mental templates of expected sensory input are created and compared to actual input, which can be matching or not. When such mental templates are held in working memory, cross-frequency phase synchronization (CFS) between theta and gamma band activity has been proposed to serve matching processes between prediction and sensation. We investigated how this is affected by the number of activated templates that could be matched by comparing conditions where participants had to keep either one or multiple templates in mind for successful visual search. We found a transient CFS between EEG theta and gamma activity in an early time window around 150 ms after search display presentation, in right hemispheric parietal cortex. Our results suggest that for single template conditions, stronger transient theta-gamma CFS at posterior sites contralateral to target presentation can be observed than for multiple templates. This can be interpreted as evidence to the idea of sequential attentional templates. But mainly, it is understood in line with previous theoretical accounts strongly arguing for transient synchronization between posterior theta and gamma phase as a neural correlate of matching incoming sensory information with contents from working memory and as evidence for limitations in memory matching during multiple template search.

Allocation of resources in working memory: Theoretical and empirical implications for visual search

Recently, working memory (WM) has been conceptualized as a limited resource, distributed flexibly and strategically between an unlimited number of representations. In addition to improving the precision of representations in WM, the allocation of resources may also shape how these representations act as attentional templates to guide visual search. Here, we reviewed recent evidence in favor of this assumption and proposed three main principles that govern the relationship between WM resources and template-guided visual search. First, the allocation of resources to an attentional template has an effect on visual search, as it may improve the guidance of visual attention, facilitate target recognition, and/or protect the attentional template against interference. Second, the allocation of the largest amount of resources to a representation in WM is not sufficient to give this representation the status of attentional template and thus, the ability to guide visual search. Third, the representation obtaining the status of attentional template, whether at encoding or during maintenance, receives an amount of WM resources proportional to its relevance for visual search. Thus defined, the resource hypothesis of visual search constitutes a parsimonious and powerful framework, which provides new perspectives on previous debates and complements existing models of template-guided visual search.

Color Can Shorten Breakthrough Times in Continuous Flash Suppression through Increased Salience and Task Relevance

Color can enhance the perception of relevant stimuli by increasing their salience and guiding visual search towards stimuli that match a task-relevant color. Using Continuous Flash Suppression (CFS), the current study investigated whether color facilitates the discrimination of targets that are difficult to perceive due to interocular suppression. Gabor patterns of two or four cycles per degree (cpd) were shown as targets to the non-dominant eye of human participants. CFS masks were presented at a rate of 10 Hz to the dominant eye, and participants had the task to report the target’s orientation as soon as they could discriminate it. The 2-cpd targets were robustly suppressed and resulted in much longer response times compared to 4-cpd targets. Moreover, only for 2-cpd targets, two color-related effects were evident. First, in trials where targets and CFS masks had different colors, targets were reported faster than in trials where targets and CFS masks had the same color. Second, targets with a known color, either cyan or yellow, were reported earlier than targets whose color was randomly cyan or yellow. The results suggest that the targets’ entry to consciousness may have been speeded by color-mediated effects relating to increased (bottom-up) salience and (top-down) task relevance.

Towards Interactive Search: Investigating Visual Search in a Novel Real-World Paradigm

An overwhelming majority of studies on visual search and selective attention were conducted using computer screens. There are arguably shortcomings in transferring knowledge from computer-based studies to real-world search behavior as findings are based on viewing static pictures on computer screens. This does not go well with the dynamic and interactive nature of vision in the real world. It is crucial to take visual search research to the real world in order to study everyday visual search processes. The aim of the present study was to develop an interactive search paradigm that can serve as a "bridge" between classical computerized search and everyday interactive search. We based our search paradigm on simple LEGO® bricks arranged on tabletop trays to ensure comparability with classical computerized visual search studies while providing room for easily increasing the complexity of the search environment. We found that targets were grasped slower when there were more distractors (Experiment 1) and there were sizable differences between various search conditions (Experiment 2), largely in line with classical visual search research and revealing similarities to research in natural scenes. Therefore, our paradigm can be seen as a valuable asset complementing visual search research in an environment between computerized search and everyday search.

Concurrent guidance of attention by multiple working memory items: Behavioral and computational evidence

During visual search, task-relevant representations in visual working memory (VWM), known as attentional templates, are assumed to guide attention. A current debate concerns whether only one (Single-Item-Template hypothesis; SIT) or multiple (Multiple-Item-Template hypothesis; MIT) items can serve as attentional templates simultaneously. The current study was designed to test these two hypotheses. Participants memorized two colors, prior to a visual-search task in which the target and the distractor could match or not match the colors held in VWM. Robust attentional guidance was observed when one of the memory colors was presented as the target (reduced response times (RTs) on target-match trials) or the distractor (increased RTs on distractor-match trials). We constructed two drift-diffusion models that implemented the MIT and SIT hypotheses, which are similar in their predictions about overall RTs, but differ in their predictions about RTs on individual trials. Critically, simulated RT distributions and error rates revealed a better match of the MIT hypothesis to the observed data than the SIT hypothesis. Taken together, our findings provide behavioral and computational evidence for the concurrent guidance of attention by multiple items in VWM.

Can you have multiple attentional templates? Large-scale replications of Van Moorselaar, Theeuwes, and Olivers (2014) and Hollingworth and Beck (2016)

Stimuli that resemble the content of visual working memory (VWM) capture attention. However, theories disagree on how many VWM items can bias attention simultaneously. According to some theories, there is a distinction between active and passive states in VWM, such that only items held in an active state can bias attention. The single-item-template hypothesis holds that only one item can be in an active state and thus can bias attention. In contrast, the multiple-item-template hypothesis posits that multiple VWM items can be in an activate state simultaneously, and thus can bias attention. Recently, Van Moorselaar, Theeuwes, and Olivers (Journal of Experimental Psychology: Human Perception and Performance, 40(4):1450, 2014) and Hollingworth and Beck (Journal of Experimental Psychology: Human Perception and Performance, 42(7):911–917, 2016) tested these accounts, but obtained seemingly contradictory results. Van Moorselaar et al. (2014) found that a distractor in a visual-search task captured attention more when it matched the content of VWM (memory-driven capture). Crucially, memory-driven capture disappeared when more than one item was held in VWM, in line with the single-item-template hypothesis. In contrast, Hollingworth and Beck (2016) found memory-driven capture even when multiple items were kept in VWM, in line with the multiple-item-template hypothesis. Considering these mixed results, we replicated both studies with a larger sample, and found that all key results are reliable. It is unclear to what extent these divergent results are due to paradigm differences between the studies. We conclude that is crucial to our understanding of VWM to determine the boundary conditions under which memory-driven capture occurs.