The preview search task: Evidence for visual marking

Attenuating the 'attentional white bear' effect enhances suppressive attention

Trying to ignore an object can bias attention towards it – a phenomenon referred to as the ‘attentional white bear’ (AWB) effect. The mechanisms behind this effect remain unclear. On one hand, the AWB may reflect reactive, ‘search and destroy’ distractor suppression, which directs attention toward irrelevant objects in order to suppress further attention to them. However, another possibility is that the AWB results from failed proactive distractor suppression – attempting to suppress attention to an irrelevant object from the outset may inadvertently result in an attentional shift towards it. To distinguish these two possibilities, we developed a categorical visual search task that addresses limitations present in prior studies. In five experiments (N_total = 96), participants searched displays of naturalistic stimuli cued only with distractor categories (targets were unknown and unpredictable). We observed an AWB and later attenuated it by presenting a pre-search stimulus, likely disrupting guidance from distractor templates in working memory. We conclude that the AWB resulted from a failure of proactive suppression rather than a search and destroy process.

Examining the influence of different types of dynamic change in a visual search task

It has been repeatedly demonstrated that when performing a visual search task, items can pop out of a display such that they are identified rapidly, independent of the number of distractors present. It has been less clear whether this type of pop-out is limited to static displays (e.g., images) or whether it can also occur in scenes containing movement, more akin to how we experience the real world. Recently, Jardine and Moore (Journal of Experimental Psychology: Human Perception and Performance, 42, 617-630, 2016) examined whether pop-out also occurs in displays consisting of dynamic motion - wherein items in the display rotated continuously until a critical frame that would elicit pop-out under static presentation conditions - and found that search was greatly impaired. It remains unclear, however, whether such impairment is exerted equivalently across all types of dynamic motions or if it is specific to orientation. In the present study, we replicate the original Jardine and Moore (Journal of Experimental Psychology: Human Perception and Performance, 42, 617-630, 2016) finding and extend this examination to another dimension - color change. We also explore whether search efficiency can be improved with dynamic context if aspects of the display become predictable. The results suggest that not all types of dynamic change impair search performance. Specifically, oddball color targets continue to pop out even when the items in the display are dynamic. Interestingly, adding predictable context did not aid search accuracy as expected, rather resulting in poorer performance. Taken together, the findings suggest that the influence of dynamic context on search performance is not absolute.

Scene memory and spatial inhibition in visual search : A neural dynamic process model and new experimental evidence

Any object-oriented action requires that the object be first brought into the attentional foreground, often through visual search. Outside the laboratory, this would always take place in the presence of a scene representation acquired from ongoing visual exploration. The interaction of scene memory with visual search is still not completely understood. Feature integration theory (FIT) has shaped both research on visual search, emphasizing the scaling of search times with set size when searches entail feature conjunctions, and research on visual working memory through the change detection paradigm. Despite its neural motivation, there is no consistently neural process account of FIT in both its dimensions. We propose such an account that integrates (1) visual exploration and the building of scene memory, (2) the attentional detection of visual transients and the extraction of search cues, and (3) visual search itself. The model uses dynamic field theory in which networks of neural dynamic populations supporting stable activation states are coupled to generate sequences of processing steps. The neural architecture accounts for basic findings in visual search and proposes a concrete mechanism for the integration of working memory into the search process. In a behavioral experiment, we address the long-standing question of whether both the overall speed and the efficiency of visual search can be improved by scene memory. We find both effects and provide model fits of the behavioral results. In a second experiment, we show that the increase in efficiency is fragile, and trace that fragility to the resetting of spatial working memory.

Premembering Experience: A Hierarchy of Time-Scales for Proactive Attention

Memories are about the past, but they serve the future. Memory research often emphasizes the former aspect: focusing on the functions that re-constitute (re-member) experience and elucidating the various types of memories and their interrelations, timescales, and neural bases. Here we highlight the prospective nature of memory in guiding selective attention, focusing on functions that use previous experience to anticipate the relevant events about to unfold-to "premember" experience. Memories of various types and timescales play a fundamental role in guiding perception and performance adaptively, proactively, and dynamically. Consonant with this perspective, memories are often recorded according to expected future demands. Using working memory as an example, we consider how mnemonic content is selected and represented for future use. This perspective moves away from the traditional representational account of memory toward a functional account in which forward-looking memory traces are informationally and computationally tuned for interacting with incoming sensory signals to guide adaptive behavior.

Age-related differences in the attentional white bear

The cognitive aging literature suggests that aging populations exhibit impairments in the proactive inhibition of attention. Although proactive inhibition is often preceded by the allocation of attention toward the predicted or known spatial location of to-be-ignored stimuli, proactive allocation of attention has not been assessed in aging populations. In this study, an older and younger cohort engaged in the attentional-white-bear paradigm which measures proactive allocation of attention. In this task, on 80% of trials, participants must identify a centrally located letter surrounded by congruent or incongruent flanker letters. The flanker locations are fixed and predictable within each block of the study. On 20% of trials, they must identify which of two dots appear first on the screen. One dot appears in the same location as the flanker, and one appears in an empty location during the flanker task. The typical white-bear effect is that, despite the dots appearing at the same time, participants more often report the dot in the location of the flanker (i.e., the potentially to-be-ignored location) to appear first. The magnitude of this effect is interpreted as the magnitude of attentional allocation prior to inhibition. In Experiment 1, there was no difference in the magnitude of the attentional white bear between younger and aging cohorts. However, when the attentional system was sufficiently taxed by reducing the flanker presentation (Experiments 2a and 2b), age-related differences emerged. In particular, older participants showed a reduced white-bear effect, reflecting a potential impairment in the proactive allocation of attention toward the location of expected distractors.

Ignoring versus updating in working memory reveal differential roles of attention and feature binding

Ignoring distracting information and updating current contents are essential components of working memory (WM). Yet, although both require controlling irrelevant information, it is unclear whether they have the same effects on recall and produce the same level of misbinding errors (incorrectly joining the features of different memoranda). Moreover, the likelihood of misbinding may be affected by the feature similarity between the items already encoded into memory and the information that has to be filtered out (ignored) or updated into memory. Here, we investigate these questions. Participants were sequentially presented with two pairs of arrows. The first pair of arrows always had to be encoded into memory, but the second pair either had to be ignored (ignore condition) or allowed to displace the previously encoded items (update condition). To investigate the effect of similarity on recall, we also varied, in a factorial manner, whether the items that had to be ignored or updated were presented in the same or different colours and/or same or different spatial locations to the original memoranda. By applying a computational model, we were able to quantify the levels of misbinding. Ignoring, but not updating, increased overall recall error as well as misbinding rates, even when accounting for the retention period. This indicates that not all manipulations of attention in WM are equal in terms of their effects on recall and misbinding. Misbinding rates in the ignore condition were affected by the colour and spatial congruence of relevant and irrelevant information to a greater extent than in the update condition. This finding suggests that attentional templates are used to evaluate relevant and irrelevant information in different ways during ignoring and updating. Together, the results suggest that differences between the two functions might occur due to higher levels of attentional compartmentalisation - or protection - during updating compared to ignoring.

Subset selective search on the basis of color and preview

In the preview paradigm observers are presented with one set of elements (the irrelevant set) followed by the addition of a second set among which the target is presented (the relevant set). Search efficiency in such a preview condition has been demonstrated to be higher than that in a full-baseline condition in which both sets are simultaneously presented, suggesting that a preview of the irrelevant set reduces its influence on the search process. However, numbers of irrelevant and relevant elements are typically not independently manipulated. Moreover, subset selective search also occurs when both sets are presented simultaneously but differ in color. The aim of the present study was to investigate how numbers of irrelevant and relevant elements contribute to preview search in the absence and presence of a color difference between subsets. In two experiments it was demonstrated that a preview reduced the influence of the number of irrelevant elements in the absence but not in the presence of a color difference between subsets. In the presence of a color difference, a preview lowered the effect of the number of relevant elements but only when the target was defined by a unique feature within the relevant set (Experiment 1); when the target was defined by a conjunction of features (Experiment 2), search efficiency as a function of the number of relevant elements was not modulated by a preview. Together the results are in line with the idea that subset selective search is based on different simultaneously operating mechanisms.

Previewing distractors reduces efficiency of visual processing at previewed locations

Visual marking refers to the phenomenon in which old items in a visual search are excluded from the search when new items appear in the visual field. Visual marking may result from inhibition of irrelevant information at the location of old items before new items appear. Moreover, sensitivity to increments in contrast at the old locations has been shown to be lower than that to increments at the new locations. We used equivalent noise analysis to examine whether the reduction in sensitivity is the result of an increase in internal noise or a decrease in calculation efficiency. Following a search in which reaction time was measured, participants were asked to indicate whether a Gaussian luminance blob was present. Parameters estimated from the threshold-versus-noise contrast function indicated that calculation efficiency at old locations was lower than that at new locations, and internal noise did not increase at old locations but rather decreased slightly. Thus, the reduction in sensitivity at old locations is attributable a decrease in calculation efficiency. These data suggest that an inhibitory template for visual marking may benefit visual search by diverting limited attentional resources, such as time and resolution, away from previewed locations and reserving them for the target search.

Spreading suppression and the guidance of search by movement: evidence from negative color carry-over effects

A growing number of studies have shown that significant impairments to search and selection can occur if the target item carries a feature of the irrelevant distractors currently being ignored Braithwaite, Humphreys, and Hodsoll (Journal of Experimental Psychology: Human Perception and Performance, 29, 758-778, 2003). However, these effects have been documented only when search has been extended over time (i.e., in preview search), and not in standard search displays with simultaneously presented items. Here, we present the first evidence that similar costs to selection can occur in simultaneous displays under appropriate circumstances. In the present experiment, participants searched a display for a moving target letter among static and moving distractors. Search efficiency was significantly enhanced for a moving target when half of the letters moved (and half remained static), allowing the static items to be excluded from search. However, if the moving target then shared its color with the irrelevant static items, significant costs emerged, relative to baselines. These results are consistent with the involvement of a general feature-based suppression mechanism in selection, operating over space as well as time.

Predictive coding as a model of the V1 saliency map hypothesis

The predictive coding/biased competition (PC/BC) model is a specific implementation of the predictive coding theory that has previously been shown to provide a detailed account of the response properties of orientation tuned cells in primary visual cortex (V1). Here it is shown that the same model can successfully simulate psychophysical data relating to the saliency of unique items in search arrays, of contours embedded in random texture, and of borders between textured regions. This model thus provides a possible implementation of the hypothesis that V1 generates a bottom-up saliency map. However, PC/BC is very different from previous models of visual salience, in that it proposes that saliency results from the failure of an internal model of simple elementary image components to accurately predict the visual input. Saliency can therefore be interpreted as a mechanism by which prediction errors attract attention in an attempt to improve the accuracy of the brain's internal representation of the world.

Looking, language, and memory: bridging research from the visual world and visual search paradigms

In the visual world paradigm as used in psycholinguistics, eye gaze (i.e. visual orienting) is measured in order to draw conclusions about linguistic processing. However, current theories are underspecified with respect to how visual attention is guided on the basis of linguistic representations. In the visual search paradigm as used within the area of visual attention research, investigators have become more and more interested in how visual orienting is affected by higher order representations, such as those involved in memory and language. Within this area more specific models of orienting on the basis of visual information exist, but they need to be extended with mechanisms that allow for language-mediated orienting. In the present paper we review the evidence from these two different - but highly related - research areas. We arrive at a model in which working memory serves as the nexus in which long-term visual as well as linguistic representations (i.e. types) are bound to specific locations (i.e. tokens or indices). The model predicts that the interaction between language and visual attention is subject to a number of conditions, such as the presence of the guiding representation in working memory, capacity limitations, and cognitive control mechanisms.

Comparing segmentation by time and by motion in visual search: an FMRI investigation

Brain activity was recorded while participants engaged in a difficult visual search task for a target defined by the spatial configuration of its component elements. The search displays were segmented by time (a preview then a search display), by motion, or were unsegmented. A preparatory network showed activity to the preview display, in the time but not in the motion segmentation condition. A region of the precuneus showed (i) higher activation when displays were segmented by time or by motion, and (ii) correlated activity with larger segmentation benefits behaviorally, regardless of the cue. Additionally, the results revealed that success in temporal segmentation was correlated with reduced activation in early visual areas, including V1. The results depict partially overlapping brain networks for segmentation in search by time and motion, with both cue-independent and cue-specific mechanisms.

Effects of luminance change in preview search: offsets and onsets can be concurrently prioritized but not in isolation

Two experiments are performed to investigate how luminance change contributes to prioritized selection of new over old elements. Experiment 1 demonstrates that observers prioritize items that undergo a luminance change irrespective of the direction of that change. Experiment 2 shows that foreknowledge concerning the direction of luminance change signaling the target does not allow observers to prioritize the selection of luminance onsets over offsets and vice versa. The results suggest that prioritized selection of new over old elements is mediated by a general mechanism that is sensitive to luminance change, irrespective of its direction.

Impaired prioritization of novel onset stimuli in autism spectrum disorder

BACKGROUND

Deficiency in the adaptive allocation of attention to relevant environmental stimuli is an associated feature of autism spectrum disorder (ASD). Recent evidence suggests that individuals with ASD may be specifically impaired in attentional prioritization of novel onsets.

METHOD

We investigated modulation of attention by novel onset stimuli in 22 children with ASD and 22 age- and IQ-matched typically developing (TD) children using a preview visual search task (Donk & Theeuwes, 2003). In preview search, a subset of search stimuli (old) is presented briefly before the remaining stimuli (new) with the effect that search times for targets appearing among the new elements are typically shorter than for those appearing among the old elements.

RESULTS

Whereas the TD group exhibited faster reaction time (RT) to targets occurring as novel search elements, the ASD group performed similarly in target new and old conditions, indicating impaired attentional prioritization of novel onsets. Group differences in eye-movement behavior, including fixation frequency and saccadic error for novel onset stimuli, were consistent with the RT findings. Attentional modulation by novel onsets varied inversely with social-communicative symptom severity in the ASD group.

CONCLUSIONS

The results provide further evidence of reduced sensitivity to novel onsets in ASD, and suggest that impaired processing of dynamic stimuli, possibly associated with abnormalities in the dorsal visual processing stream, may be implicated in the core symptoms of ASD.