Modeling the effect of selection history on pop-out visual search

Target-distractor similarity predicts visual search efficiency but only for highly similar features

A major constraining factor for attentional selection is the similarity between targets and distractors. When similarity is low, target items can be identified quickly and efficiently, whereas high similarity can incur large costs on processing speed. Models of visual search contrast a fast, efficient parallel stage with a slow serial processing stage where search times are strongly modulated by the number of distractors in the display. In particular, recent work has argued that the magnitude of search slopes should be inversely proportional to target-distractor similarity. Here, we assessed the relationship between target-distractor similarity and search slopes. In our visual search tasks, participants detected an oddball color target among distractors (Experiments 1 & 2) or discriminated the direction of a triangle in the oddball color (Experiment 3). We systematically varied the similarity between target and distractor colors (along a circular CIELAB color wheel) and the number of distractors in the search array, finding logarithmic search slopes that were inversely proportional to the number of items in the array. Surprisingly, we also found that searches were highly efficient (i.e., near-zero slopes) for targets and distractors that were extremely similar (≤20° in color space). These findings indicate that visual search is systematically influenced by target-distractor similarity across different processing stages. Importantly, we found that search can be highly efficient and entirely unaffected by the number of distractors despite high perceptual similarity, in contrast to the general assumption that high similarity must lead to slow and serial search behavior.

Continuous action with a neurobiologically inspired computational approach reveals the dynamics of selection history

Everyday perception-action interaction often requires selection of a single goal from multiple possibilities. According to a recent framework of attentional control, object selection is guided not only by the well-established factors of perceptual salience and current goals but also by selection history. Yet, underlying mechanisms linking selection history and visually-guided actions are poorly understood. To examine such interplay and disentangle the impact of target and distractor history on action selection, we employed a priming-of-popout (PoP) paradigm combined with continuous tracking of reaching movements and computational modeling. Participants reached an odd-colored target among homogeneous distractors while we systematically manipulated the sequence of target and distractor colors from one trial to the next. We observed that current reach movements were significantly influenced by the interaction between attraction by the prior target feature and repulsion by the prior distractor feature. With principal component regression, we found that inhibition led by prior distractors influenced reach target selection earlier than facilitation led by the prior target. In parallel, our newly developed computational model validated that current reach target selection can be explained best by the mechanism postulating the preceded impact of previous distractors followed by a previous target. Such converging empirical and computational evidence suggests that the prior selection history triggers a dynamic interplay between target facilitation and distractor inhibition to guide goal-directed action successfully. This, in turn, highlights the necessity of an explicitly integrated approach to determine how visual attentional selection links with adaptive actions in a complex environment.

Selection history influences an attentional decision bias toward singleton targets

Selection history effects are ubiquitous findings that show how implicitly encoding a target's feature or location on a trial can facilitate target activation on the following trial. Although the target-defining feature (e.g., color) is usually unpredictable, it is often relevant to determining the target on a given trial. The present study used a feature priming task, like the three-item oddball search task, but varied the target-defining feature (shape) orthogonal to the priming feature (color) that could influence target activation. On any trial the target could be a color singleton or not, and the target's feature could repeat or switch between trials. Larger priming effects were seen when the current target was a color singleton than a nonsingleton. Importantly, diffusion analyses showed that pretrial selection bias contributed to these larger priming effects. The results suggest selection history facilitates target activation through an attentional decision bias to select the object with the most recently attended color, and this attentional decision is easier when the current target is also distinct.

Classic Visual Search Effects in an Additional Singleton Task: An Open Dataset

Visual search refers to our ability to find what we are looking for among many competing visual inputs. Here, we report the availability of a rich dataset that replicates key visual search effects and shows that these effects are robust to several changes to the experimental design. Experiment 1 replicates classic findings from an additional singleton visual search task. First, participants are captured by a salient but irrelevant color singleton, as indexed by slower response times when a color singleton distractor is present versus absent. Second, attentional capture by a color singleton is reduced when the visual search array contains heterogeneous shapes rather than homogenous shapes. Finally, attentional capture by a color singleton is reduced when the display colors are repeated rather than switched unpredictably from trial to trial. Experiment 2 demonstrates that these classic visual search effects are robust to small procedural changes such as task timing (i.e., a 2-8 second rather than ~1 second inter-trial interval). Experiment 3 demonstrates that these classic effects are likewise robust to changes to the distractor frequency (75% rather than 50%) and to fully blocking versus interleaving blocks of two task conditions. All told, this dataset includes 8 sub-experiments, 190 participants and >210,000 trials, and it will serve as a useful resource for power analyses and exploratory analyses of visual search behaviors.

Progress Toward Resolving the Attentional Capture Debate

For over 25 years, researchers have debated whether physically salient stimuli capture attention in an automatic manner, independent of the observer's goals, or whether the capture of attention depends on the match between a stimulus and the observer's task set. Recent evidence suggests an intermediate position in which salient stimuli automatically produce a priority signal, but the capture of attention can be prevented via an inhibitory mechanism that suppresses the salient stimulus. Here, proponents from multiple sides of the debate describe how their original views have changed in light of recent research, as well as remaining areas of disagreement. These perspectives highlight some emerging areas of consensus and provide new directions for future research on attentional capture.

Target activation and distractor inhibition underlie priming of pop-out: A response to Dent (this issue)

Visual search is faster when the target and distractors features repeat than when they switch on successive trials, a phenomenon known as priming of pop-out (PoP). In previous work, we suggested that two mechanisms, each indexed by a repetition benefit and a switch cost underlie PoP: target activation and distractor inhibition. Consistent with this account, we reported strong correlations between the benefit and cost indexing each mechanism and concluded that there are stable individual differences on target-activation and distractor-inhibition processes. In subsequent work, we noted flaws in our baseline for benefits and costs and suggested a different baseline. Yet, we did not explore the implications of these flaws for our previous conclusions - a gap that Dent (this issue) filled in a large-scale replication of our study. He found our reported correlations to entirely vanish when the corrected baselines are used, whereas repetition benefits were correlated and so were switching costs. He concluded that his findings invalidate the activation-inhibition account of PoP and proposed a hybrid account, according to which repetition effects reflect activation and inhibition, whereas switch costs index a conflict-resolution process. Here, we claim that failure to observe correlations between indices of the same components invalidates the claim that there are stable individual differences on these components but does not challenge the idea that target-activation and distractor inhibition underlie PoP. We reanalyzed the data from four published experiments. As Dent (this issue), we find no correlations between indices of the same component. However, we show that novel predictions of the activation-inhibition components account are supported, whereas the predictions of the conflict-resolution account are disconfirmed.

Exploring the contributions of spatial and non-spatial working memory to priming of pop-out

Priming of pop-out (PoP) refers to the facilitation of performance that occurs when a target-defining feature is repeated across consecutive trials in a pop-out oddball search task. The underlying mechanism of PoP has been poorly understood and raises important questions about how our visual system is guided by past experiences, even during bottom-up processing. Lee, Mozer, and Vecera (Attention, Perception, & Psychophysics, 71, 1059-1071, 2009) demonstrated that PoP remained unaffected by a concurrent non-spatial visual working memory (VWM) load, and they concluded that PoP occurs through feature gain modulation, essentially eliminating the contribution of memory representations in VWM to PoP. In the present study, we followed up on those results by (a) replicating the null effect of non-spatial VWM load on PoP and (b) examining the effect of spatial VWM load on PoP. The results showed that spatial VWM load does interfere with PoP, supporting the notion that spatial VWM is involved in PoP. In Experiment 2, we extended this finding by manipulating VWM load and observing its consequence on the magnitude of PoP. Increasing spatial VWM load decreased the amount of PoP observed, in a dose-dependent manner, whereas changes in non-spatial VWM load did not. Contrary to Lee et al.'s conclusions, these results suggest that VWM resources appear to contribute to the occurrence of PoP, supporting the theory that PoP is, in fact, a multilevel process in which the deployment of spatial attention, relying on VWM representations, plays an important role.

The effect of noise-induced variance on parameter recovery from reaction times

Background

Technical noise can compromise the precision and accuracy of the reaction times collected in psychological experiments, especially in the case of Internet-based studies. Although this noise seems to have only a small impact on traditional statistical analyses, its effects on model fit to reaction-time distributions remains unexplored.

Results

Across four simulations we study the impact of technical noise on parameter recovery from data generated from an ex-Gaussian distribution and from a Ratcliff Diffusion Model. Our results suggest that the impact of noise-induced variance tends to be limited to specific parameters and conditions.

Conclusions

Although we encourage researchers to adopt all measures to reduce the impact of noise on reaction-time experiments, we conclude that the typical amount of noise-induced variance found in these experiments does not pose substantial problems for statistical analyses based on model fitting.

Repetition priming in selective attention: A TVA analysis

Current behavior is influenced by events in the recent past. In visual attention, this is expressed in many variations of priming effects. Here, we investigate color priming in a brief exposure digit-recognition task. Observers performed a masked odd-one-out singleton recognition task where the target-color either repeated or changed between subsequent trials. Performance was measured by recognition accuracy over exposure durations. The purpose of the study was to replicate earlier findings of perceptual priming in brief displays and to model those results based on a Theory of Visual Attention (TVA; Bundesen, 1990). We tested 4 different definitions of a generic TVA-model and assessed their explanatory power. Our hypothesis was that priming effects could be explained by selective mechanisms, and that target-color repetitions would only affect the selectivity parameter (α) of our models. Repeating target colors enhanced performance for all 12 observers. As predicted, this was only true under conditions that required selection of a target among distractors, but not when a target was presented alone. Model fits by TVA were obtained with a trial-by-trial maximum likelihood estimation procedure that estimated 4-15 free parameters, depending on the particular model. We draw two main conclusions. Color priming can be modeled simply as a change in selectivity between conditions of repetition or swap of target color. Depending on the desired resolution of analysis; priming can accurately be modeled by a simple four parameter model, where VSTM capacity and spatial biases of attention are ignored, or more fine-grained by a 10 parameter model that takes these aspects into account.

Not all "distractor" tags are created equal: using a search asymmetry to dissociate the inter-trial effects caused by different forms of distractors

In a typical pop-out task, there is one target and a varying number of distractor stimuli. Now imagine a target-absent display in the context of a pop-out task: all items are identical, and it is decidedly easy to conclude that all items in the display are distractors, precisely because there is no target to select on that display. One may be tempted to say that, as far as the attention system is concerned, these two types of distractors are the same: target-present distractors and target-absent distractors. The present study proposes that this is actually not the case. Target-absent distractors can sometimes produce inter-trial effects that their close-cousins, the target-present distractors, cannot. We used a letters/numbers categorical oddball task to demonstrate this difference. The results are interpreted in the context of recent findings in cognitive neuroscience as well as cognitive modeling.

Trial history effects in the ventral attentional network

The ventral attentional network (VAN) is thought to drive "stimulus driven attention" [e.g., Asplund, C. L., Todd, J. J., Snyder, A. P., & Marois, R. A central role for the lateral prefrontal cortex in goal-directed and stimulus-driven attention. Nature Neuroscience, 13, 507-512, 2010; Shulman, G. L., McAvoy, M. P., Cowan, M. C., Astafiev, S. V., Tansy, A. P., D' Avossa, G., et al. Quantitative analysis of attention and detection signals during visual search. Journal of Neurophysiology, 90, 3384-3397, 2003]; in other words, it instantiates within the current stimulus environment the top-down attentional biases maintained by the dorsal attention network [e.g., Kincade, J. M., Abrams, R. A., Astafiev, S. V., Shulman, G. L., & Corbetta, M. An event-related functional magnetic resonance imaging study of voluntary and stimulus-driven orienting of attention. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience, 25, 4593-4604, 2005]. Previous work has shown that the dorsal attentional network is sensitive to trial history, such that it is challenged by changes in task goals and facilitated by repetition thereof [e.g., Kristjánsson, A., Vuilleumier, P., Schwartz, S., Macaluso, E., & Driver, J. Neural basis for priming of pop-out during visual search revealed with fMRI. Cerebral Cortex, 17, 1612-1624, 2007]. Here, we investigate whether the VAN also preserves information across trials such that it is challenged when previously rejected stimuli become task relevant. We used fMRI to investigate the sensitivity of the ventral attentional system to prior history effects as measured by the distractor preview effect. This behavioral phenomenon reflects a bias against stimuli that have historically not supported task performance. We found regions traditionally considered to be part of the VAN (right middle frontal gyrus, inferior frontal gyrus and right supramarginal gyrus) [Shulman, G. L., McAvoy, M. P., Cowan, M. C., Astafiev, S. V., Tansy, A. P., D' Avossa, G., et al. Quantitative analysis of attention and detection signals during visual search. Journal of Neurophysiology, 90, 3384-3397, 2003] to be more active when task-relevant stimuli had not supported task performance in a previous trial than when they had. Investigations of the ventral visual system suggest that this effect is more reliably driven by trial history preserved within the VAN than that preserved within the visual system per se. We conclude that VAN maintains its interactions with top-down stimulus biases and bottom-up stimulation across time, allowing previous experience with the stimulus environment to influence attentional biases under current circumstances.