Mechanisms of attentional selection: temporally modulated priority tags

Attentional shift to the newer object in the successive and simultaneous distractors previewing search

When some distractors (old items) appear before the other distractors and the target (new items) during an inefficient visual search task, the old items are effectively excluded from the search (preview benefit). Previous studies have shown that this preview benefit is observed when items are presented in two temporal stages, namely the initial and second displays. In this situation, new and old items are defined by a single time point (i.e., new items appearing), and the newness of the items is constant through the target search. However, in the real world, the newness of items is updated by the newer objects appearing, which requires more complex computations to detect relevant information among them. The present study examined whether previewing affects the attentional shift to a newer object if multiple new items appear successively. I used the modified preview-search paradigm, which contains three temporally separated displays, and examined what happens if the singleton target appears 200 ms after other distractors appear in the third display. This successive (search) condition was compared to the simultaneous (search) condition in which no distractors were presented in the initial display, and all distractors appeared simultaneously in the second display. The results showed that attentional shift to a newer object requires more time in the successive condition than in the simultaneous condition (Experiment 1). Moreover, the search cost for the newer target would not be induced by a mere difference in the onset timings (Experiment 2) and would occur when the duration of the initial distractors was short, and thus visual marking of the initial distractors might not occur maximally (Experiment 3). Therefore, previewing degrades attentional shift to a newer object when multiple new items appear successively.

Landmark cueing and exogenous (onset) cueing: How are they related?

Attentional consequences of (i) mere onset of a peripheral visual cue, and (ii)encoding spatially predictive, landmark features of that cue were studied in two experiments. Target location was associated with landmark features of peripheral cues. Cue onset elicited both attention capture (Experiment Two) and inhibition of return (Experiment One) effects. In both experiments, attentional effects of landmark features of the cues were observed early in practice, and diminished with time on task. Contrary to hypotheses based on models that liken attention to a moving spotlight or zoom lens, in both experiments attentional effects of landmark features were confined to the location where the cue was presented. To explain this, we enlist the concept of attentional priority maps, and propose that visual encoding causes attentional priorities to be updated via alternative input routes and mechanisms. We suggest that onset cueing effects are associated with retinotectal 'spatial indexing', which registers the location, but not the attributes of new stimuli, while landmark cueing effects are associated with interaction between spatial indexing and dorsal stream visual processing of attentionally relevant landmark features.

Perceptual grouping constrains inhibition in time-based visual selection

In time-based visual selection, task-irrelevant, old stimuli can be inhibited in order to allow the selective processing of new stimuli that appear at a later point in time (the preview benefit; Watson & Humphreys, 1997). The current study investigated if illusory and non-illusory perceptual groups influence the ability to inhibit old and prioritize new stimuli in time-based visual selection. Experiment 1 showed that with Kanizsa-type illusory stimuli, a preview benefit occurred only when displays contained a small number of items. Experiment 2 demonstrated that a set of Kanizsa-type illusory stimuli could be selectively searched amongst a set of non-illusory distractors with no additional preview benefit obtained by separating the two sets of stimuli in time. Experiment 3 showed that, similarly to Experiment 1, non-illusory perceptual groups also produced a preview benefit only for a small number of number of distractors. Experiment 4 demonstrated that local changes to perceptually grouped old items eliminated the preview benefit. The results indicate that the preview benefit is reduced in capacity when applied to complex stimuli that require perceptual grouping, regardless of whether the grouped elements elicit illusory contours. Further, inhibition is applied at the level of grouped objects, rather than to the individual elements making up those groups. The findings are discussed in terms of capacity limits in the inhibition of old distractor stimuli when they consist of perceptual groups, the attentional requirements of forming perceptual groups and the mechanisms and efficiency of time-based visual selection.

Preview benefit survives a three-dimensional rotation of the rigid configuration of search items

When some distractors (old items) are presented prior to others (new items) during an inefficient visual search task, search becomes easier, as though observers were able to exclude the old items from the search. This phenomenon, called preview benefit, occurs when the locations of the old items are deprioritized relative to the locations of the new items, through a process of visual marking. It has been demonstrated that preview benefit persists when the old items move on the display, if the spatial relationships among the old items remain unchanged, suggesting that the memory template for visual marking represents the spatial configuration of the old items. One remaining question is whether the configuration is coded in two- or three-dimensional coordinates. In the present study, we examined whether preview benefit was preserved when all items were graphically rendered in three-dimensional coordinates and rigidly rotated around the vertical axis at a constant angular velocity. Preview benefit occurred in this situation, suggesting that the memory template for visual marking represents the spatial configuration in three-dimensional coordinates.

The Effect of Ratio of Changing to Static Stimuli on the Attentional Capture

Studies have shown that appearing or disappearing objects attract more attention than static objects. This study examined the modulation of attention attracted by transient signals by systematically manipulating the ratio of changing (appearing/disappearing) to static stimuli. The results revealed that the effect of transient stimuli in attracting attention was diminished by simultaneously appearing (disappearing) peripheral stimuli and that the position where nothing was presented (the remaining stimulus) attracted attention when the number of appearing (disappearing) peripheral stimuli was increased. These findings suggest that the sudden change does not always capture attention, and whether changed things are attended or unchanged things are attended is determined depending on the proportion of things that change and do not change.

Colour for Behavioural Success

Colour information not only helps sustain the survival of animal species by guiding sexual selection and foraging behaviour but also is an important factor in the cultural and technological development of our own species. This is illustrated by examples from the visual arts and from state-of-the-art imaging technology, where the strategic use of colour has become a powerful tool for guiding the planning and execution of interventional procedures. The functional role of colour information in terms of its potential benefits to behavioural success across the species is addressed in the introduction here to clarify why colour perception may have evolved to generate behavioural success. It is argued that evolutionary and environmental pressures influence not only colour trait production in the different species but also their ability to process and exploit colour information for goal-specific purposes. We then leap straight to the human primate with insight from current research on the facilitating role of colour cues on performance training with precision technology for image-guided surgical planning and intervention. It is shown that local colour cues in two-dimensional images generated by a surgical fisheye camera help individuals become more precise rapidly across a limited number of trial sets in simulator training for specific manual gestures with a tool. This facilitating effect of a local colour cue on performance evolution in a video-controlled simulator (pick-and-place) task can be explained in terms of colour-based figure-ground segregation facilitating attention to local image parts when more than two layers of subjective surface depth are present, as in all natural and surgical images.

A Framework for Understanding the Allocation of Attention in Location-Precued Discrimination

The effects of attention on visual perception are assessed in the location-precuing paradigm. First, we present a review of some current metaphors for attention and relevant data. Then, a framework is suggested that provides an interpretation of the temporal sequence of external and assumed internal processes within a location-cuing trial. Cases when a precue correctly indicates the target location (valid trials) are compared to cases when the precue directs attention to the wrong location (invalid trials) with the cue location either at fixation or peripheral to the target location. Several specific hypotheses are suggested; these concern decrements in performance on invalid trials and effects of the location of a precue. For the most part, these hypotheses are supported by data in the literature and in some new studies. A gradient-filter metaphor for attention, which includes a synthesis of ideas from the gradient model and the attention gate model, is more consistent with the data than is a spotlight metaphor.

Visual Marking of Locations and Feature Maps: Evidence from Within-dimension Defined Conjunctions

Recently, Watson and Humphreys (1997, 1998) proposed that the selection of new visual events can be aided by the top-down inhibition of old information—visual marking (VM)—and that the mechanisms of marking differ for static and moving stimuli. Stationary stimuli are marked by location-based inhibition, whereas moving stimuli are marked by inhibition applied at the level of whole-feature maps. Here we provide a test of this “two-mechanism” account. We show that static items can be marked even when old and new stimuli contain the same features and so cannot be distinguished by activation within a unique feature map. However, moving old items could not be marked unless they possessed a unique feature (colour). Manipulations of grouping strength, both within and between distractor sets, did not affect the basic findings. The results support the existence of two mechanisms for VM and counter an object-based inhibition explanation of performance.

A Drastic Change in Background Luminance or Motion Degrades the Preview Benefit

When some distractors (old items) precede some others (new items) in an inefficient visual search task, the search is restricted to new items, and yields a phenomenon termed the preview benefit. It has recently been demonstrated that, in this preview search task, the onset of repetitive changes in the background disrupts the preview benefit, whereas a single transient change in the background does not. In the present study, we explored this effect with dynamic background changes occurring in the context of realistic scenes, to examine the robustness and usefulness of visual marking. We examined whether preview benefit in a preview search task survived through task-irrelevant changes in the scene, namely a luminance change and the initiation of coherent motion, both occurring in the background. Luminance change of the background disrupted preview benefit if it was synchronized with the onset of the search display. Furthermore, although the presence of coherent background motion per se did not affect preview benefit, its synchronized initiation with the onset of the search display did disrupt preview benefit if the motion speed was sufficiently high. These results suggest that visual marking can be destroyed by a transient event in the scene if that event is sufficiently drastic.

Right visual-field advantage in the attentional blink: Asymmetry in attentional gating across time and space

When two targets are presented in a rapid serial visual presentation (RSVP), recognition of the second target (T2) is usually reduced when presented 150-500 ms after the first target, demonstrating an attentional blink (AB). Previous studies have shown a left visual-field (LVF) advantage in T2 recognition, when T2 was embedded in one of two streams, demanding top-down attention for its recognition. Here, we explored the impact of bottom-up saliency on spatial asymmetry in the AB. When T2 was spatially shifted outside from the RSVP, creating an abrupt onset of T2, right T2s showed a right visual-field (RVF) advantage. In lag-1 trials, right T2s were not only better recognized, but also showed a low T1-T2 order error rate. In contrast, recognized left T2s exhibited high order error rate. Without abrupt onset, symmetrical AB was found and order error rate was similarly low in both sides. Follow-up experiments showed that, while RVF advantage was related to bottom-up saliency, order errors were affected by T1 mask. The discrepancy between LVF and RVF advantage in the AB could be resolved in terms of two mechanisms of attentional gating: top-down attentional gating, which is biased towards LVF, and bottom-up attentional gating, which is biased towards RVF.

On the Efficiency of Visual Selective Attention: Efficient Visual Search Leads to Inefficient Distractor Rejection

The ability to ignore irrelevant peripheral distractors was assessed as a function of the efficiency in visual search for a target at the center of a display Efficient target search, among dissimilar nontargets, led to greater distraction than inefficient search, among similar nontargets This seemingly paradoxical result is predicted by the recent proposal (Lavie, 1995a) that irrelevant processing can be prevented only by increasing the load for relevant processing Varying the set size of similar items in the central search task demonstrated that interference from irrelevant distractors was eliminated only with more than four relevant items These results demonstrate how capacity limits determine the efficiency of selective attention, and raise questions about some standard assumptions of most visual search models

Selection of new objects by onset capture and visual marking

Visual search is easier after looking at some distractors in advance because previewed distractors are excluded from the search (preview benefit). A dominant explanation for preview benefit is that it occurs because of the inhibition of old objects (visual marking). However, another view claims that preview benefit simply reflects automatic attentional orienting to new objects (onset capture). To address the question of whether visual marking plays any role in addition to onset capture, we compared the search performance for a target that always appeared as a new item ("marking" condition) with the performance for a target that appeared equally as a new or old item ("capture" condition). When items were presented at random positions in an invisible matrix, the slope in the "marking" condition was shallower than that in the "capture" condition, favoring the involvement of visual marking (Experiments 1 and 2). In contrast, no difference in slope was found among the search conditions regardless of changes in old items when items were arranged around the circumference of a circle (Experiment 3). These findings suggest that the contribution of visual marking depends on the configuration of search items; with complex displays, prioritizing selection for new objects is more effective if coupled with de-prioritizing de-selection for old objects.

Attentional capture by dynamic cues

Attention orients to an object that abruptly onsets, because the object's appearance alters the visual scene. In this report, the question was whether there would, similarly, be attentional prioritization of an existing object that changes its dynamic status. Attention may be deployed immediately to the object because its new dynamic status, potentially, also could alter the visual environment. This report focused on the capture capacity of an object--made up of four spots--that abruptly began rotating, thereby endowing it with two dynamic features: motion-onset, apparent when the object transitioned from stationary to moving, and its specific motion trajectory. Because the rotating spots were irrelevant to the main letter-identification task, there ought not to be top-down attentional orienting to them. We asked two questions: (a) whether the rotating object captures attention automatically, and (b) whether both its dynamic features contribute to attentional capture. Four experiments were reported. The observer's attentional set was manipulated by varying, across experiments, the target's diagnostic feature. We examined how the different attentional sets modulated capture. The results showed that the rotating object only succeeded in capturing attention when the attentional system was set to monitor dynamic features.

Previewing distractors reduces efficiency of visual processing at previewed locations

Visual marking refers to the phenomenon in which old items in a visual search are excluded from the search when new items appear in the visual field. Visual marking may result from inhibition of irrelevant information at the location of old items before new items appear. Moreover, sensitivity to increments in contrast at the old locations has been shown to be lower than that to increments at the new locations. We used equivalent noise analysis to examine whether the reduction in sensitivity is the result of an increase in internal noise or a decrease in calculation efficiency. Following a search in which reaction time was measured, participants were asked to indicate whether a Gaussian luminance blob was present. Parameters estimated from the threshold-versus-noise contrast function indicated that calculation efficiency at old locations was lower than that at new locations, and internal noise did not increase at old locations but rather decreased slightly. Thus, the reduction in sensitivity at old locations is attributable a decrease in calculation efficiency. These data suggest that an inhibitory template for visual marking may benefit visual search by diverting limited attentional resources, such as time and resolution, away from previewed locations and reserving them for the target search.

Attention capture by abrupt onsets: re-visiting the priority tag model

Abrupt onsets have been shown to strongly attract attention in a stimulus-driven, bottom-up manner. However, the precise mechanism that drives capture by onsets is still debated. According to the new object account, abrupt onsets capture attention because they signal the appearance of a new object. Yantis and Johnson (1990) used a visual search task and showed that up to four onsets can be automatically prioritized. However, in their study the number of onsets co-varied with the total number of items in the display, allowing for a possible confound between these two variables. In the present study, display size was fixed at eight items while the number of onsets was systematically varied between zero and eight. Experiment 1 showed a systematic increase in reactions times with increasing number of onsets. This increase was stronger when the target was an onset than when it was a no-onset item, a result that is best explained by a model according to which only one onset is automatically prioritized. Even when the onsets were marked in red (Experiment 2), nearly half of the participants continued to prioritize only one onset item. Only when onset and no-onset targets were blocked (Experiment 3), participants started to search selectively through the set of only the relevant target type. These results further support the finding that only one onset captures attention. Many bottom-up models of attention capture, like masking or saliency accounts, can efficiently explain this finding.

Guided Search 2.0 A revised model of visual search

An important component of routine visual behavior is the ability to find one item in a visual world filled with other, distracting items. This ability to performvisual search has been the subject of a large body of research in the past 15 years. This paper reviews the visual search literature and presents a model of human search behavior. Built upon the work of Neisser, Treisman, Julesz, and others, the model distinguishes between a preattentive, massively parallel stage that processes information about basic visual features (color, motion, various depth cues, etc.) across large portions of the visual field and a subsequent limited-capacity stage that performs other, more complex operations (e.g., face recognition, reading, object identification) over a limited portion of the visual field. The spatial deployment of the limited-capacity process is under attentional control. The heart of the guided search model is the idea that attentional deployment of limited resources isguided by the output of the earlier parallel processes. Guided Search 2.0 (GS2) is a revision of the model in which virtually all aspects of the model have been made more explicit and/or revised in light of new data. The paper is organized into four parts: Part 1 presents the model and the details of its computer simulation. Part 2 reviews the visual search literature on preattentive processing of basic features and shows how the GS2 simulation reproduces those results. Part 3 reviews the literature on the attentional deployment of limited-capacity processes in conjunction and serial searches and shows how the simulation handles those conditions. Finally, Part 4 deals with shortcomings of the model and unresolved issues.

Prioritization by transients in visual search

There is an ongoing debate as to whether prioritizing new objects over old objects (the so-called preview benefit) is the result of top-down inhibition of old objects (i.e., visual marking; Watson & Humphreys, 1997) or attentional allocation to new objects, presented with a luminance transient (Donk & Theeuwes, 2001). In the two experiments reported here, we tested whether prioritization by luminance transients alone can produce a subset-selective search similar to the preview effect. Subjects viewed multiobject displays while a subset of objects was briefly flashed. The subjects prioritized up to 14 flashed objects over at least 14 nonflashed objects. Since prioritization by luminance transients can produce a subset-selective search on its own, it may well play an important role in the preview benefit.

The role of the lateral intraparietal area in orienting attention and its implications for visual search

Orienting visual attention is of fundamental importance when viewing a visual scene. One of the areas thought to play a role in the guidance of this process is the posterior parietal cortex. In this review, we will describe the way the lateral intraparietal area (LIP) of the posterior parietal cortex acts as a priority map to help guide the allocation of covert attention and eye movements (overt attention). We will explain the concept of a priority map and then show that LIP activity is biased by both bottom-up stimulus-driven factors and top-down cognitive influences, and that this activity can be used to predict the locus of covert attention and initial saccadic latencies in simple visual search tasks. We will then describe evidence for how this system acts during covert visual search and how its activity could be used to optimize overt visual search performance.

Dilution: atheoretical burden or just load? A reply to Tsal and Benoni (2010)

Load theory of attention proposes that distractor processing is reduced in tasks with high perceptual load that exhaust attentional capacity within task-relevant processing. In contrast, tasks of low perceptual load leave spare capacity that spills over, resulting in the perception of task-irrelevant, potentially distracting stimuli. Tsal and Benoni (2010) find that distractor response competition effects can be reduced under conditions with a high search set size but low perceptual load (due to a singleton color target). They claim that the usual effect of search set size on distractor processing is not due to attentional load but instead attribute this to lower level visual interference. Here, we propose an account for their findings within load theory. We argue that in tasks of low perceptual load but high set size, an irrelevant distractor competes with the search nontargets for remaining capacity. Thus, distractor processing is reduced under conditions in which the search nontargets receive the spillover of capacity instead of the irrelevant distractor. We report a new experiment testing this prediction. Our new results demonstrate that, when peripheral distractor processing is reduced, it is the search nontargets nearest to the target that are perceived instead. Our findings provide new evidence for the spare capacity spillover hypothesis made by load theory and rule out accounts in terms of lower level visual interference (or mere "dilution") for cases of reduced distractor processing under low load in displays of high set size. We also discuss additional evidence that discounts the viability of Tsal and Benoni's dilution account as an alternative to perceptual load.

Visual marking survives graphical change if meaning is retained

When some distractors (old items) appear before others (new items) in an inefficient visual search task, the old items are excluded from the search (visual marking). Previous studies have shown that shape changes of static old items are sufficient to eliminate this effect when global luminance is maintained, suggesting that shape identity must be maintained for successful visual marking. It was unclear whether the change in meaning or shape was critical, because these changes were confounded in previous studies. The present study examined whether consistency in the semantic or the graphical identity of old items is critical for visual marking by introducing shape change in the absence of meaning change. The results indicated that visual marking survived graphical changes in old items as long as their meaning was maintained, suggesting that the memory template underlying visual marking represents the semantic identity of old items.

On the temporal relation of top-down and bottom-up mechanisms during guidance of attention

Two mechanisms are said to be responsible for guiding focal attention in visual selection: bottom-up, saliency-driven capture and top-down control. These mechanisms were examined with a paradigm that combined a visual search task with postdisplay probe detection. Two SOAs between the search display and probe onsets were introduced to investigate how attention was allocated to particular items at different points in time. The dynamic interplay between bottom-up and top-down mechanisms was investigated with ERP methodology. ERPs locked to the search displays showed that top-down control needed time to develop. N2pc indicated allocation of attention to the target item and not to the irrelevant singleton. ERPs locked to probes revealed modulations in the P1 component reflecting top-down control of focal attention at the long SOA. Early bottom-up effects were observed in the error rates at the short SOA. Taken together, the present results show that the top-down mechanism takes time to guide focal attention to the relevant target item and that it is potent enough to limit bottom-up attentional capture.

Irrelevant singletons in visual search do not capture attention but can produce nonspatial filtering costs

It is not clear how salient distractors affect visual processing. The debate concerning the issue of whether irrelevant salient items capture spatial attention [e.g., Theeuwes, J., Atchley, P., & Kramer, A. F. On the time course of top-down and bottom-up control of visual attention. In S. Monsell & J. Driver (Eds.), Attention and performance XVIII: Control of cognitive performance (pp. 105-124). Cambridge, MA: MIT Press, 2000] or produce only nonspatial interference in the form of, for example, filtering costs [Folk, Ch. L., & Remington, R. Top-down modulation of preattentive processing: Testing the recovery account of contingent capture. Visual Cognition, 14, 445-465, 2006] has not yet been settled. The present ERP study examined deployment of attention in visual search displays that contained an additional irrelevant singleton. Display-locked N2pc showed that attention was allocated to the target and not to the irrelevant singleton. However, the onset of the N2pc to the target was delayed when the irrelevant singleton was presented in the opposite hemifield relative to the same hemifield. Thus, although attention was successfully focused on the target, the irrelevant singleton produced some interference resulting in a delayed allocation of attention to the target. A subsequent probe discrimination task allowed for locking ERPs to probe onsets and investigating the dynamics of sensory gain control for probes appearing at relevant (target) or irrelevant (singleton distractor) positions. Probe-locked P1 showed sensory gain for probes positioned at the target location but no such effect for irrelevant singletons in the additional singleton condition. Taken together, the present data support the claim that irrelevant singletons do not capture attention. If they produce any interference, it is rather due to nonspatial filtering costs.

In visual search, guidance by surface type is different than classic guidance

Visual search for targets among distractors is more efficient if attention can be guided to targets by attributes like color. In real-world search, we guide attention using information about surfaces (e.g., paintings are on walls). We compare "classic" color guidance to surface guidance in "scenes" of cubes. When a target can lie on one of many surfaces, color guidance is effective but surface guidance is not (Experiments 1-3). Surface guidance works when cued surfaces are coplanar (Experiment 4) or few in number (Experiment 5). We speculate that surface guidance is slow and limited to very few surfaces at one time.

Failures to ignore entirely irrelevant distractors: the role of load

In daily life (e.g., in the work environment) people are often distracted by stimuli that are clearly irrelevant to the current task and should be ignored. In contrast, much applied distraction research has focused on task interruptions by information that requires a response and therefore cannot be ignored. Moreover, the most commonly used laboratory measures of distractibility (e.g., in the response-competition and attentional-capture paradigms), typically involve distractors that are task relevant (e.g., through response associations or location). A series of experiments assessed interference effects from stimuli that are entirely unrelated to the current task, comparing the effects of perceptual load on task-irrelevant and task-relevant (response competing) distractors. The results showed that an entirely irrelevant distractor can interfere with task performance to the same extent as a response-competing distractor and that, as with other types of distractors, the interfering effects of the irrelevant distractors can be eliminated with high perceptual load in the relevant task. These findings establish a new laboratory measure of a form of distractibility common to everyday life and highlight load as an important determinant of such distractibility.

Distractor effects during processing of words under load

The perceptual load model of attention (Lavie, 1995) suggests that processing of irrelevant distractors depends on the extent to which a relevant task engages full perceptual capacity. Word recognition models suggest that letter perception is facilitated in words relative to nonwords. These models led us to hypothesize that increasing the number of letters would increase perceptual load more for nonwords than for words, and thus would be more likely to exhaust capacity and eliminate distractor processing for nonwords than for words. In support of this hypothesis, we found that increasing the number of search letters increases RTs more for nonwords than for words and only reduces distractor interference for nonwords. Thus, although readers process words more efficiently than nonwords, they also become more prone to distraction when processing words.

A computational model of visual marking using an inter-connected network of spiking neurons: the spiking search over time & space model (sSoTS)

In the real world, visual information is selected over time as well as space, when we prioritise new stimuli for attention. Watson and Humphreys [Watson, D., Humphreys, G.W., 1997. Visual marking: prioritizing selection for new objects by top-down attentional inhibition of old objects. Psychological Review 104, 90-122] presented evidence that new information in search tasks is prioritised by (amongst other processes) active ignoring of old items - a process they termed visual marking. In this paper we present, for the first time, an explicit computational model of visual marking using biologically plausible activation functions. The "spiking search over time and space" model (sSoTS) incorporates different synaptic components (NMDA, AMPA, GABA) and a frequency adaptation mechanism based on [Ca(2+)] sensitive K(+) current. This frequency adaptation current can act as a mechanism that suppresses the previously attended items. We show that, when coupled with a process of active inhibition applied to old items, frequency adaptation leads to old items being de-prioritised (and new items prioritised) across time in search. Furthermore, the time course of these processes mimics the time course of the preview effect in human search. The results indicate that the sSoTS model can provide a biologically plausible account of human search over time as well as space.

An Onset Advantage without a Preview Benefit: Neuropsychological Evidence Separating Onset and Preview Effects in Search

Visual search is facilitated if half the distractors are presented as a preview prior to the presentation of the target and second set of distractors-the preview benefit [Watson, D. G., & Humphreys, G. W. Visual marking: Prioritizing selection for new objects by top-down attentional inhibition of old objects. Psychological Review, 104, 90-122, 1997]. On one account, the preview advantage is due to automatic capture of attention by the onsets in the second, search display [Donk, M., & Theeuwes, J. Visual marking beside the mark: Prioritizing selection by abrupt onsets. Perception & Psychophysics, 93, 891-900, 2001]. We provide a neuropsychological test of this assertion. We examined onset capture and preview benefits in search in a group of neuropsychological patients with unilateral parietal damage. We demonstrate a normal pattern of performance when patients detected targets defined by onsets relative to those defined by offsets, irrespective of whether the onset target fell contra-or ipsilateral to the lesion. In contrast, there was a normal preview benefit in search only for ipsilesional targets, and preview search was impaired in the contralesional field. The data demonstrate that the preview benefit can dissociate from the onset advantage in search, and that onsets remain strongly weighted for attention even in the contralesional field of patients with parietal lesions.

When is search for a static target among dynamic distractors efficient?

Intuitively, dynamic visual stimuli, such as moving objects or flashing lights, attract attention. Visual search tasks have revealed that dynamic targets among static distractors can indeed efficiently guide attention. The present study shows that the reverse case, a static target among dynamic distractors, allows for relatively efficient selection in certain but not all cases. A static target was relatively efficiently found among distractors that featured apparent motion, corroborating earlier findings. The important new finding was that static targets were equally easily found among distractors that blinked on and off continuously, even when each individual item blinked at a random rate. However, search for a static target was less efficient when distractors abruptly varied in luminance but did not completely disappear. The authors suggest that the division into the parvocellular pathway dealing with static visual information, on the one hand, and the magnocellular pathway common to motion and new object onset detection, on the other hand, allows for efficient filtering of dynamic and static information.

The control of visual attention and its influence on prioritized processing in a location negative priming paradigm

In a location-based negative priming paradigm, the possibility of a disengagement option of the underlying inhibitory mechanism was tested. Whereas in previous studies disengagement was observed when providing utility information about the probe trial structure, in the present study the allocation of visual attention to the stimuli was manipulated. In the first step an automatic deployment of visual attention was implemented by presenting all stimuli as abrupt onsets (Experiment 1), which demonstrated commonly observed negative priming effects. In further conditions of non-automatic allocation of visual attention in which target and distractor were presented as no-onset stimuli, negative priming effects were eliminated (Experiments 2 and 3). The preferred interpretation is that in conditions of automatic control of attention, target and distractor compete for control of action. A non-automatic control of visual attention, on the other hand, leads to a top-down modulated selection, which results in prioritized target encoding and a loss of distractor impact on the selection process. Alternative accounts and the role of no-onset distractor processing were investigated in Experiment 4.

Visual search in temporally segregated displays: Converging operations in the study of the preview benefit

Preview benefit is an attentional phenomenon that enables observers to selectively search through new information in the visual field. In a preview search task, objects are presented in two sets, separated by a time interval (preview interval), and with the second set (new objects) containing the target. Event-related brain potentials (ERPs) were used to investigate whether preview benefit occurs via maintenance of inhibition of the old objects during the preview interval. ERPs time-locked to a color probe indicated that the old objects were actively attended rather than inhibited during the preview interval. Follow-up behavioral experiments produced converging results. The results suggest that, although participants might be using inhibition at later stages of the preview interval, they are not maintaining inhibition on the old objects throughout most of the preview interval.

Visual marking: The effects of irrelevant changes on preview search

Visual search is facilitated when participants receive a preview of half of the distractors before presentation of the second distractor set (Watson & Humphreys, 1997). In seven experiments, we examined the effects of irrelevant change on this preview benefit. Experiments 1-4 showed that the benefit was not disrupted by the abrupt appearance of irrelevant distractors during the preview period unless they were the same color as the new items. However, blinking off-and-on irrelevant distractors that were present at the start of the preview period disrupted the preview benefit irrespective of their feature overlap with other items (Experiments 5-7). The data are consistent with the inhibition of old stimuli (visual marking) via a location-based template along with an anticipatory feature-based set for new stimuli.

Competition for representation is mediated by relative attentional salience

The biased competition model of attentional selection proposes that objects compete with one another for neural representation, with the competition rooted in stimulus and attentionally-based salience. Two experiments explore how the salience of a target item relative to flanking items impacts the speed of target identification. The results of two experiments suggest that spatially proximal items compete for shared, spatially dependent processing resources. In both experiments, subjects identified target elements embedded in multi-element displays. In Experiment 1, attentional salience was manipulated by using abrupt onsets (high-salience) and non-onsets (low-salience). Target identifications were slowest when the target was flanked by two high-salience stimuli (abrupt onsets) and fastest when the target was flanked by two low-salience items, (non-onsets). In Experiment 2, the attentional salience of display items was set through a probability manipulation involving the color of the target. The results mirrored those of Experiment 1, consistent with predictions of the biased competition model.

An analysis of the time course of attention in preview search

We used a probe dot procedure to examine the time course of attention in preview search (Watson & Humphreys, 1997). Participants searched for an outline red vertical bar among other new red horizontal bars and old green vertical bars, superimposed on a blue background grid. Following the reaction time response for search, the participants had to decide whether a probe dot had briefly been presented. Previews appeared for 1,000 msec and were immediately followed by search displays. In Experiment 1, we demonstrated a standard preview benefit relative to a conjunction search baseline. In Experiment 2, search was combined with the probe task. Probes were more difficult to detect when they were presented 1,200 msec, relative to 800 msec, after the preview, but at both intervals detection of probes at the locations of old distractors was harder than detection on new distractors or at neutral locations. Experiment 3A demonstrated that there was no difference in the detection of probes at old, neutral, and new locations when probe detection was the primary task and there was also no difference when all of the shapes appeared simultaneously in conjunction search (Experiment 3B). In a final experiment (Experiment 4), we demonstrated that detection on old items was facilitated (relative to neutral locations and probes at the locations of new distractors) when the probes appeared 200 msec after previews, whereas there was worse detection on old items when the probes followed 800 msec after previews. We discuss the results in terms of visual marking and attention capture processes in visual search.

Interaction of color and geometric cues in depth perception: when does "red" mean "near"?

Luminance and color are strong and self-sufficient cues to pictorial depth in visual scenes and images. The present study investigates the conditions under which luminance or color either strengthens or overrides geometric depth cues. We investigated how luminance contrast associated with the color red and color contrast interact with relative height in the visual field, partial occlusion, and interposition to determine the probability that a given figure presented in a pair is perceived as "nearer" than the other. Latencies of "near" responses were analyzed to test for effects of attentional selection. Figures in a pair were supported by luminance contrast (Experiment 1) or isoluminant color contrast (Experiment 2) and combined with one of the three geometric cues. The results of Experiment 1 show that the luminance contrast of a color (here red), when it does not interact with other colors, produces the same effects as achromatic luminance contrasts. The probability of "near" increases with the luminance contrast of the color stimulus, the latencies for "near" responses decrease with increasing luminance contrast. Partial occlusion is found to be a strong enough pictorial cue to support a weaker red luminance contrast. Interposition cues lose out against cues of spatial position and partial occlusion. The results of Experiment 2, with isoluminant displays of varying color contrast, reveal that red color contrast on a light background supported by any of the three geometric cues wins over green or white supported by any of the three geometric cues. On a dark background, red color contrast supported by the interposition cue loses out against green or white color contrast supported by partial occlusion. These findings reveal that color is not an independent depth cue, but is strongly influenced by luminance contrast and stimulus geometry. Systematically shorter response latencies for stronger "near" percepts demonstrate that selective visual attention reliably detects the most likely depth cue combination in a given configuration.

Prioritizing selection of new elements: bottom-up versus top-down control

Watson and Humphreys (1997) have proposed that prioritized selection of new over old elements occurs because observers can apply top-down inhibition to the locations of the old elements by a mechanism they refer to as visual marking. However, recent evidence has suggested that the top-down mechanism is questionable (Donk & Theeuwes, 2001). In the present study, we investigated whether prioritized selection of new over old elements occurs in a bottom-up or a top-down fashion. Observers were presented with displays containing one set of elements (old elements) followed, after a certain time interval, by a second set of elements (new elements). The observers were instructed to search for the presence of a target that was presented with equal probability among the old and the new elements (Experiments 1 and 2) or twice as often among the old elements than among the new elements (Experiment 3). The results show that new elements were prioritized for selection over old ones even though the observers had no incentive to do so. The results suggest that prioritized selection of new over old elements is not mediated by a top-down inhibition process, as was proposed by Watson and Humphreys (1997). Instead, prioritization of new elements appears to be a bottom-up process. The implications of these results are discussed in terms of models of attentional control.

Blink and Shrink: The Effect of the Attentional Blink on Spatial Processing

The detection or discrimination of the second of 2 targets in a rapid serial visual presentation (RSVP) task is often temporarily impaired-a phenomenon termed the attentional blink. This study demonstrated that the attentional blink also affects localization performance. Spatial cues pointed out the possible target positions in a subsequent visual search display. When cues were presented inside an attentional blink (as induced by an RSVP task), the observers' capacity to use them was reduced. This effect was not due to attention being highly focused, to general task switching costs, or to complete unawareness of the cues. Instead, the blink induced a systematic localization bias toward the fovea, reflecting what appears to be spatial compression.

Attentional capture by auto- and allo-cues

In a host of studies, the ability of various types of cues to capture attention has been examined. This article reviews a number of these studies by organizing them into a classification scheme based on the relationship between the putative attention-capturing item (the cue) and the item used to assess the distribution of attention (the probe). The second dimension of this taxonomy divides paradigms of attentional capture into those in which capture is indexed by performance benefits and those in which capture is indexed by performance costs. The relative methodological merits and disadvantages of the paradigms that occupy each of the cells of the resulting two-by-two matrix are discussed. A final section offers a new interpretation of the finding that dynamic cues capture attention.

Dynamics of attention in depth: evidence from multi-element tracking

We examined the allocation of attention in depth using a multi-element tracking paradigm. Observers were required to track a predefined subset of from two to eight elements in displays containing up to sixteen identical moving elements. We first show that depth cues, such as binocular disparity and occlusion through T-junctions, improve performance in a multi-element tracking task in the case where element boundaries are allowed to intersect in the depiction of motion in a single frontoparallel plane. We also show that the allocation of attention across two perceptually distinguishable planar surfaces, either frontoparallel or receding at a slanting angle and defined by coplanar elements, is easier than allocation of attention within a single surface. The same result was not found when attention was required to be deployed across items of two-color populations rather than across items of a single color. Our results suggest that, when surface information does not suffice to distinguish between targets and distractors that are embedded in these surfaces, division of attention across two surfaces aids in tracking moving targets. A final experiment with populations of elements moving within distinct volumes produced similar results, suggesting that spatial separation in three dimensions, rather than confinement to surfaces as such, may explain the improved performance for the two-surface case.

Perceived shifts of flashed stimuli by visible and invisible object motion

Perceived positions of flashed stimuli can be altered by motion signals in the visual field-position capture (Whitney and Cavanagh, 2000 Nature Neuroscience 3 954-959). We examined whether position capture of flashed stimuli depends on the spatial relationship between moving and flashed stimuli, and whether the phenomenal permanence of a moving object behind an occluding surface (tunnel effect; Michotte 1950 Acta Psychologica 7 293-322) can produce position capture. Observers saw two objects (circles) moving vertically in opposite directions, one in each visual hemifield. Two horizontal bars were simultaneously flashed at horizontally collinear positions with the fixation point at various timings. When the movement of the object was fully visible, the flashed bar appeared shifted in the motion direction of the circle. But this position-capture effect occurred only when the bar was presented ahead of or on the moving circle. Even when the motion trajectory was covered by an opaque surface and the bar was flashed after complete occlusion of the circle, the position-capture effect was still observed, though the positional asymmetry was less clear. These results show that movements of both visible and 'hidden' objects can modulate the perception of positions of flashed stimuli and suggest that a high-level representation of 'objects in motion' plays an important role in the position-capture effect.

The role of perceptual load in processing distractor faces

It has been established that successful ignoring of irrelevant distractors depends on the extent to which the current task loads attention. However, the previous load studies have typically employed neutral distractor stimuli (e.g., letters). In the experiments reported here, we examined whether the perception of irrelevant distractor faces would show the same effects. We manipulated attentional load in a relevant task of name search by varying the search set size and found that whereas congruency effects from meaningful nonface distractors were eliminated by higher search load, interference from distractor faces was entirely unaffected by search load. These results support the idea that face processing may be mandatory and generalize the load theory to the processing of meaningful and more complex nonface distractors.

Attentional focus, processing load, and Stroop interference

Although the effects of attentional focus and perceptual load on selective attention when targets and distractors are distinct objects that occupy separate locations are well known, there has been little examination of their role when both relevant and irrelevant information pertains to the same object. In four experiments, participants were shown Stroop color words or strings of letters in a task of speeded color identification. When the participants' attentional focus was manipulated via cue validity or precue size, greater Stroop interference was observed when the attentional focus was narrow than when it was broad. However, when the participants were induced to adopt a comparable attentional focus in a dual-task paradigm, the differential Stroop interference was eliminated. Furthermore, contrary to the prediction of the perceptual load hypothesis, different levels of processing load did not lead to differential Stroop interference. These results emphasize the importance of stimulus structure in understanding distractor processing. They indicate that when relevant and irrelevant information pertains to the same object, narrowing attentional focus increases distractor processing, and perceptual load has a negligible effect on the extent of distractor processing.

Visual change with moving displays: more evidence for color feature map inhibition during preview search

Preview search with moving stimuli was investigated. The stimuli moved in multiple directions, and preview items could change either their color or their shape before onset of the new (search) displays. In Experiments 1 and 2, the authors found that (a) a preview benefit occurred even when more than 5 moving items had to be ignored, and (b) color change, but not shape change, disrupted preview search in moving stimuli. In contrast, shape change, but not color change, disrupted preview search in static stimuli (Experiments 3 and 4). Results suggest that preview search with moving displays is influenced by inhibition of a color map, whereas preview search with static displays is influenced by inhibition of locations of old distractors.

Goal-driven modulation of stimulus-driven attentional capture in multiple-cue displays

Six location-cuing experiments were conducted to examine the goal-driven control of attentional capture in multiple-cue displays. In most of the experiments, the cue display consisted of the simultaneous presentation of a red direct cue that was highly predictive of the target location (the unique cue) and three gray direct cues (the standard cues) that were not predictive of the location. The results indicated that although target responses were faster at all cued locations relative to uncued locations, they were significantly faster at the unique-cue location than at the standard-cue locations. Other results suggest that the faster responses produced by direct cues may be associated with two different components: an attention-related component that can be modulated by goal-driven factors and a nonattentional component that occurs in parallel at multiple direct-cue locations and is minimally affected by the same goal-driven factors.

Visual marking: using time in visual selection

Given human capacity limitations, to behave adaptively we need to prioritise the order of visual processing to ensure that the most relevant information is available to control action. One way to do this is to prioritise processing at a particular location in space. However, there are many situations where this strategy is not possible and recent studies have shown that, in such circumstances, observers can use time as well as space to prioritise selection. We propose that selection by time can be influenced by a process of visual marking, involving an active bias applied in parallel against old items in the field. Here we describe the properties of visual marking in relation to other mechanisms of visual selection.