What not to look for: Electrophysiological evidence that searchers prefer positive templates

Similar Quality of Visual Working Memory Representations between Negative and Positive Attentional Templates

Visual working memory (VWM) plays an important role during visual search, with some theories suggesting an equivalence between working memory representations and guidance from attentional templates. However, recent work has shown that participants can also use 'negative templates', the foreknowledge of distractor-features stored in VWM, to guide attention away from distractors during visual search. These negative templates must also be represented in working memory, but the question remains whether the quality of the working memory representations underlying negative and positive templates are similar, in spite of their opposite impacts on attention. In this study, participants (N = 33) engaged in a visual search task for a shape-defined target after receiving a positive cue (target color), negative cue (distractor color) or neutral cue (non-informative). In 20% of the trials, a color-wheel probe was presented instead of a search array to measure the quality of the cue representation stored in VWM. Our results revealed that participants were more likely to guess in response to neutral cues than negative cues. Yet, the comparison between positive and negative cues showed no significant differences. However, we found no difference in memory precision for the three cue types. More interestingly, the more the VWM quality is boosted by the negative cue, the greater the ability to guide attention away from distractors. Such a pattern of results might map to recent evidence of between-individuals differences in utilization of negative cues. These findings highlight the distinction between attentional templates and simple maintenance in working memory.

Top-down suppression of negative features applies flexibly contingent on visual search goals

Visually searching for a frequently changing target is assumed to be guided by flexible working memory representations of specific features necessary to discriminate targets from distractors. Here, we tested if these representations allow selective suppression or always facilitate perception based on search goals. Participants searched for a target (i.e., a horizontal bar) defined by one of two different negative features (e.g., not red vs. not blue; Experiment 1) or a positive (e.g., blue) versus a negative feature (Experiments 2 and 3). A prompt informed participants about the target identity, and search tasks alternated or repeated randomly. We used different peripheral singleton cues presented at the same (valid condition) or a different (invalid condition) position as the target to examine if negative features were suppressed depending on current instructions. In all experiments, cues with negative features elicited slower search times in valid than invalid trials, indicating suppression. Additionally, suppression of negative color cues tended to be selective when participants searched for the target by different negative features but generalized to negative and non-matching cue colors when switching between positive and negative search criteria was required. Nevertheless, when the same color - red - was used in positive and negative search tasks, red cues captured attention or were suppressed depending on whether red was positive or negative (Experiment 3). Our results suggest that working memory representations flexibly trigger suppression or attentional capture contingent on a task-relevant feature's functional meaning during visual search, but top-down suppression operates at different levels of specificity depending on current task demands.

Can templates-for-rejection suppress real-world affective objects in visual search?

Previous evidence has suggested that feature-based templates-for-rejection can be maintained in working memory to suppress matching features in the environment. Currently, this effect has only been demonstrated using abstract neutral shapes, meaning that it is unclear whether this generalizes to real-world images, including aversive stimuli. In the current investigation, participants searched amongst an array of real-world objects for a target, after being precued with either a distractor template, target template, or a no template baseline. In Experiment 1, where both distractor and target template cues were presented randomly on a trial-by-trial basis, there was moderate evidence of increased capture by aversive distractors after the distractor template cue. In Experiment 2a, however, when distractor templates were the only available cue and more time was given to encode the cue features, there was moderate evidence of effective distractor inhibition for real-world aversive and neutral stimuli. In Experiment 2b, when the task required a slower more effortful comparison of target features to stereotypical object representations, there was weaker evidence of inhibition, though there was still modest evidence suggesting effective inhibition of aversive distractors. A Bayesian meta-analysis revealed that across Experiment 2, aversive distractors showed strong cumulative evidence of effective inhibition, but inconsistent inhibition for neutral distractors. The results are interpreted from a rational search behaviour framework, which suggests that individuals utilize informative cues when they enable the most beneficial strategy and are accessible, and apply these to distractors when they cause sufficient disruption, either to search speed or emotional state.

Neurophysiological Measures of Proactive and Reactive Control in Negative Template Use

In a visual search task, knowing features of distractors in advance leads to a more efficient visual search. Although previous studies suggested that the benefits of these negative cues rely on attentional control, it is unclear whether proactive or reactive control is involved. In this study, we analyzed the EEG data of participants performing a visual search task (n = 14). Participants searched for a shape-defined target after receiving a positive cue (target color), negative cue (distractor color), or neutral cue (non-informative). To examine proactive control, we measured EEG after the cue onset but before visual search. Our time-frequency analysis revealed a higher power of theta oscillations over frontoparietal regions after the negative cues compared with the positive and neutral cues, as well as higher theta phase synchronization within the prefrontal region, demonstrating negative cues rely more heavily on proactive control compared with other cue types. To examine reactive control, we measured EEG after the search onset. We found a lateralization of posterior alpha power toward the target side in both positive and negative cues conditions, with a later lateralization observed after negative cues. Interestingly, we observed a significant relationship between the increase of proactive theta power after negative cues and the decrease of reactive alpha power after the search. This suggests the coordination of proactive and reactive mechanisms lead to the most efficient search.

Assessing recoding accounts of negative attentional templates using behavior and eye tracking

Can we use attentional control to ignore known distractor features? Providing cues before a visual search trial about an upcoming distractor color (negative cue) can lead to reaction time benefits compared with no cue trials. This suggests top-down control may use negative templates to actively suppress distractor features, a notion that challenges the mechanisms of top-down control provided in many theories of attention. However, there is currently mixed support for this mechanism in the literature. Alternative explanations have been proposed, which do not require suppression within top-down control but instead involve recoding the negative cue into a positive template based on color or spatial layouts. In three experiments, we contrasted the predictions of active suppression and the recoding strategies. Across experiments, we found consistent evidence against a color recoding account. We also found evidence of accuracy, reaction time, and eye movement benefits when location recoding was not possible. These results suggest that prior benefits from negative cues cannot be explained exclusively by spatial or color recoding. The results indicate that active suppression likely plays a role in the attentional benefits following negative cues. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Evidence for top-down suppression of negative features in the target feature dimension

While searching for a goal-relevant object, an internal representation of the features necessary to identify the to-be-searched-for object (i.e., target) guides attention towards visual stimuli with matching properties. Recent evidence suggests that features that negatively define a target (i.e., negative features) also bias attentional allocation through top-down suppression. Since humans usually know what to look for, it will rarely, if ever, be the case that a negative feature defines a goal-relevant object alone. Thus, to better understand the relevance of top-down suppression, our participants searched for a target conjunctively defined by a positive (e.g., a blue bar) and a negative feature (e.g., a nonred bar) with both features realized within the same dimension (color in Experiments 1, 3 and 4, orientation in Experiment 2). Experiments 1 and 2 showed that reaction times were slower if cues with a negative feature preceded the target at the same versus a different position (i.e., validly vs. invalidly cued targets), indicating suppression. In contrast, cues with a task-irrelevant different-dimension feature elicited no significant reaction time difference between validly cued and invalidly cued trials. In addition, Experiment 3 showed that while negative cues were top-down suppressed, cues with a positive feature captured attention. This finding indicated that both positive and negative features guide visual attention through capture and suppression, respectively, during the search for a target defined by the presence of one and the absence of another feature from the same dimension. However, suppression seems to apply to the negative and all nontarget features in the task-relevant dimension. This was shown in Experiment 4, in which participants suppressed cues with a task-irrelevant color similarly to cues with a negative color.

Multisensory Enhancement of Cognitive Control over Working Memory Capture of Attention in Children with ADHD

Attention deficit hyperactivity disorder (ADHD) is a common neurodevelopmental disorder in school-age children. Although it has been well documented that children with ADHD are associated with impairment of executive functions including working memory (WM) and inhibitory control, there is not yet a consensus as to the relationship between ADHD and memory-driven attentional capture (i.e., representations in WM bias attention toward the WM-matched distractors). The present study herein examined whether children with ADHD have sufficient cognitive control to modulate memory-driven attentional capture. 73 school-age children (36 with ADHD and 37 matched typically developing (TD) children) were instructed to perform a visual search task while actively maintaining an item in WM. In such a paradigm, the modality and the validity of the memory sample were manipulated. The results showed that under the visual WM encoding condition, no memory-driven attentional capture was observed in TD children, but significant capture was found in children with ADHD. In addition, under the audiovisual WM encoding condition, memory-matched distractors did not capture the attention of both groups. The results indicate a deficit of cognitive control over memory-driven attentional capture in children with ADHD, which can be improved by multisensory WM encoding. These findings enrich the relationship between ADHD and cognitive control and provide new insight into the influence of cross-modal processing on attentional guidance.

Negative and positive templates: Two forms of cued attentional control

Our ability to control our attention to focus on goal-relevant information is critical for functioning in daily life. In addition to the typical attentional control driven by target enhancement described in most theories of attention, recent research has focused on our ability to use information about distractions maintained in working memory to direct our attention away from known distractors. Using these negative templates can improve the efficiency of attention, much in the same way as enhancing information matching search targets. However, these effects only occur for specific tasks or in specific circumstances. In this review, I will focus on our emerging understanding of the relationship between distractor ignoring from negative templates and target enhancement from positive templates. I will also highlight key remaining questions for further study.

Attentional priority is determined by predicted feature distributions

Visual attention is often characterized as being guided by precise memories for target objects. However, real-world search targets have dynamic features that vary over time, meaning that observers must predict how the target could look based on how features are expected to change. Despite its importance, little is known about how target feature predictions influence feature-based attention, or how these predictions are represented in the target template. In Experiment 1 (N = 60 university students), we show observers readily track the statistics of target features over time and adapt attentional priority to predictions about the distribution of target features. In Experiments 2a and 2b (N = 480 university students), we show that these predictions are encoded into the target template as a distribution of likelihoods over possible target features, which are independent of memory precision for the cued item. These results provide a novel demonstration of how observers represent predicted feature distributions when target features are uncertain and show that these predictions are used to set attentional priority during visual search. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Asymmetric visual representation of sex from facial appearance

We efficiently infer others' traits from their faces, and these inferences powerfully shape our social behaviour. Here, we investigated how sex is represented in facial appearance. Based on previous findings from sex-judgment tasks, we hypothesized that the perceptual encoding of sex is not balanced but rather polarized: for the processes that generate a sex percept, the default output is "male," and the representation of female faces extends that of the male, engaging activity over unique detectors that are not activated by male faces. We tested this hypothesis with the logic of Treisman's studies of visual search asymmetries, predicting that observers should more readily detect the presence of female faces amongst male distractors than vice versa. Across three experiments (N = 32 each), each using different face stimuli, we confirmed this prediction in response time and sensitivity measures. We apply GIST analyses to the face stimuli to exclude that the search asymmetry is explained by differences in image homogeneity. These findings demonstrate a property of the coding that links facial appearance with a significant social trait: the female face is coded as an extension of a male default. We offer a mechanistic description of perceptual detectors to account for our findings and posit that the origins of this polarized coding scheme are an outcome of biased early developmental experience.

Can enhancement and suppression concurrently guide attention? An assessment at the individual level

Background: Although people can pay attention to targets while ignoring distractors, previous research suggests that target enhancement and distractor suppression work separately and independently. Here, we sought to replicate previous findings and re-establish their independence. Methods: We employed an internet-based psychological experiment. We presented participants with a visual search task in which they searched for a specified shape with or without a singleton. We replicated the singleton-presence benefit in search performance, but this effect was limited to cases where the target color was fixed across all trials. In a randomly intermixed probe task (30% of all trials), the participants searched for a letter among colored probes; we used this task to assess how far attention was separately allocated toward the target or distractor dimensions. Results: We found a negative correlation between target enhancement and distractor suppression, indicating that the participants who paid closer attention to target features ignored distractor features less effectively and vice versa. Averaged data showed no benefit from target color or cost from distractor color, possibly because of the substantial differences in strategy across participants. Conclusions: These results suggest that target enhancement and distractor suppression guide attention in mutually dependent ways and that the relative contribution of these components depends on the participants’ search strategy.

Benefits from negative templates in easy and difficult search depend on rapid distractor rejection and enhanced guidance

While most research on attentional templates focuses on how attention can be guided toward targets, a growing body of research has been examining our ability to guide attention away from distractors using negative templates. A recent report showed larger reaction time benefits from negative templates during a difficult search task compared to an easy search task. However, it remains unclear what shifts in attentional processing led to these differences in reaction time benefits. In the current study, we tested the predictions of enhanced guidance and rapid rejection as potential explanations for the differential impact of negative templates based on search difficulty. In Experiment 1, we replicated the larger benefits from negative templates in a within-subjects design. In Experiment 2, we use eye tracking to measure the proportion of fixations directed towards target-colored distractors as an index of enhanced guidance and the dwell time on distractors as a measure of rapid rejection. We found more attentional guidance from negative templates in the difficult search condition. In addition, we found larger benefits of rapid rejection from negative templates in the difficult search condition. While we typically focus on templates as a way of guiding attention, these results highlight another key role played by attentional templates: rapid distractor rejection.

Negative cues minimize visual search specificity effects

Prior target knowledge (i.e., positive cues) improves visual search performance. However, there is considerable debate about whether distractor knowledge (i.e., negative cues) can guide search. Some studies suggest the active suppression of negatively cued search items, while others suggest the initial capture of attention by negatively cued items. Prior work has used pictorial or specific text cues but has not explicitly compared them. We build on that work by comparing positive and negative cues presented pictorially and as categorical text labels using photorealistic objects and eye movement measures. Search displays contained a target (cued on positive trials), a lure from the target category (cued on negative trials), and four categorically-unrelated distractors. Search performance with positive cues resulted in stronger attentional guidance and faster object recognition for pictorial relative to categorical cues (i.e., a pictorial advantage, suggesting specific visual details afforded by pictorial cues improved search). However, in most search performance metrics, negative cues mitigate the pictorial advantage. Given that the negatively cued items captured attention, generated target guidance but mitigated the pictorial advantage, these results are partly consistent with both existing theories. Specific visual details provided in positive cues produce a large pictorial advantage in all measures, whereas specific visual details in negative cues only produce a small pictorial advantage for object recognition but not for attentional guidance. This asymmetry in the pictorial advantage suggests that the down-weighting of specific negatively cued visual features is less efficient than the up-weighting of specific positively cued visual features.

Attentional templates are protected from retroactive interference during visual search: Converging evidence from event-related potentials

Attentional templates are stored representations of target features that guide visual search. Target features may remain fixed or change on every trial, requiring sustained or transient templates, respectively. In separate blocks of trials, two sustained templates guide visual search as efficiently as two transient templates. In mixed blocks, however, the transient template interferes with the sustained template, impairing its efficiency in guiding visual search. Here, we hypothesized that the priority of the sustained template would increase when threatened by interference, eventually restoring efficient guidance of visual search. Participants memorized two possible target colors before the onset of the search display. At encoding, we assessed attentional selection of the two possible target colors with the N2pc. During subsequent maintenance, we measured the CDA as an index of resource allocation in working memory. In Experiment 1, the CDA was smaller with sustained than transient templates in separate blocks, but similar in mixed blocks. Thus, the sustained template received more working memory resources when maintained concurrently with an interfering transient template, suggesting that it was prioritized. In Experiment 2, the priority of the sustained template was further increased as it guided visual search in 80% of cases. The N2pc to possible target colors matching the sustained template was enhanced both at encoding and during visual search, thus eliminating interference from the transient template. Therefore, sustained templates are not necessarily less efficient than transient templates. Rather, prioritization through attentional selection at encoding and resource allocation during maintenance may restore efficient guidance of visual search.

Allocation of resources in working memory: Theoretical and empirical implications for visual search

Recently, working memory (WM) has been conceptualized as a limited resource, distributed flexibly and strategically between an unlimited number of representations. In addition to improving the precision of representations in WM, the allocation of resources may also shape how these representations act as attentional templates to guide visual search. Here, we reviewed recent evidence in favor of this assumption and proposed three main principles that govern the relationship between WM resources and template-guided visual search. First, the allocation of resources to an attentional template has an effect on visual search, as it may improve the guidance of visual attention, facilitate target recognition, and/or protect the attentional template against interference. Second, the allocation of the largest amount of resources to a representation in WM is not sufficient to give this representation the status of attentional template and thus, the ability to guide visual search. Third, the representation obtaining the status of attentional template, whether at encoding or during maintenance, receives an amount of WM resources proportional to its relevance for visual search. Thus defined, the resource hypothesis of visual search constitutes a parsimonious and powerful framework, which provides new perspectives on previous debates and complements existing models of template-guided visual search.

Asymmetric visual representation of sex from human body shape

We efficiently infer others' states and traits from their appearance, and these inferences powerfully shape our social behaviour. One key trait is sex, which is strongly cued by the appearance of the body. What are the visual representations that link body shape to sex? Previous studies of visual sex judgment tasks find observers have a bias to report "male", particularly for ambiguous stimuli. This finding implies a representational asymmetry - that for the processes that generate a sex percept, the default output is "male", and "female" is determined by the presence of additional perceptual evidence. That is, female body shapes are positively coded by reference to a male default shape. This perspective makes a novel prediction in line with Treisman's studies of visual search asymmetries: female body targets should be more readily detected amongst male distractors than vice versa. Across 10 experiments (N = 32 each) we confirmed this prediction and ruled out alternative low-level explanations. The asymmetry was found with profile and frontal body silhouettes, frontal photographs, and schematised icons. Low-level confounds were controlled by balancing silhouette images for size and homogeneity, and by matching physical properties of photographs. The female advantage was nulled for inverted icons, but intact for inverted photographs, suggesting reliance on distinct cues to sex for different body depictions. Together, these findings demonstrate a principle of the perceptual coding that links bodily appearance with a significant social trait: the female body shape is coded as an extension of a male default. We conclude by offering a visual experience account of how these asymmetric representations arise in the first place.