Object-based visual attention with endogenous orienting

The path of visual attention

Visual cuing is one paradigm often used to study object- and space-based visual selective attention. A primary finding is that shifts of attention within an object can be accomplished faster than equidistant shifts between objects. The present study used a visual cuing paradigm to examine how an object's size (i.e., internal distance) and shape, influences object- and space-based visual selective attention. The first two experiments manipulated object size and compared attentional shift performance with objects where the within-object distance between cued and uncued target locations was either equal to the between-object distance (1:1 ratio condition) or three times the between-object distance (3:1 ratio condition). Within-object shifts took longer for the larger objects, but an advantage over between-object shifts was still evident. Influences associated with the shapes of the larger objects suggested by the results of the first two experiments were tested and rejected in Experiment 3. Overall, the results indicate that within-object shifts of attention become slower as the within-object distance increases, but nevertheless are still accomplished faster than between-object shifts.

Selective attention as tuning: the case of stroke weight

It has long been demonstrated that when grouping occurs, attention transfer between grouped elements is facilitated, as compared with attention transfer between elements-similarly distant-that are not grouped. This has been shown for grouping by connectedness, by orientation, and by color. The present article extends these findings to the case of similarity in coarseness. By using spatial cuing to elements drawn with different strokes, it is shown that the visual processing of elements that sharestroke heaviness with the cued element is more efficient than that of elements that do not. Three experiments, in which cue validity regarding the target's location and/or its stroke is manipulated, show that the facilitation has both an endogenous and an exogenous component. The findings are discussed in terms of visual tuning to the features of a stimulus, with tuning being the initial stage of visual processing required for identification and discrimination. It is proposed that grouping, rather than explaining the facilitation observed, can be explained by the notion of visual tuning to features. The findings also point to potential methodological pitfalls when different stroke weights are used, unintentionally, in visual displays.

Objects Are Highlighted by Spatial Attention

Selective attention may be focused upon a region of interest within the visual surroundings, thereby improving the perceptual quality of stimuli at that location. It has been debated whether this spatially selective mechanism plays a role in the attentive selection of whole objects in a visual scene. The relationship between spatial and object-selective attention was investigated here through recordings of event-related brain potentials (ERPs) supplemented with functional magnetic brain imaging (fMRI). Subjects viewed a display consisting of two bar-shaped objects and directed attention to sequences of stimuli (brief corner offsets) at one end of one of the bars. Unattended stimuli belonging to the same object as the attended stimuli elicited spatiotemporal patterns of neural activity in the visual cortex closely resembling those elicited by the attended stimuli themselves, albeit smaller in amplitude. This enhanced neural activity associated with object-selective attention was localized by use of ERP dipole modeling and fMRI to the lateral occipital extrastriate cortex. We conclude that object-selective attention shares a common neural mechanism with spatial attention that entails the facilitation of sensory processing of stimuli within the boundaries of an attended object.

Just like new: Newly segregated old objects capture attention

Subjects searched for target letters that were either contained in or segregated from a group of distracting letters and were either moving or stationary. Subjects were faster to identify targets that had recently become segregated from the group regardless of whether the segregation was accomplished by (1) the element itself moving away from the group or (2) the group moving away from the segregated element. The results show that attention can be captured by newly apparent objects that are produced by a new grouping of an existing scene.

Grouping does not require attention

Many theories of visual perception stipulate that Gestalt grouping occurs preattentively. Subjects' failure to report perceiving even salient grouping patterns under conditions of inattention challenges this assumption (see, e.g., Mack, Tang, Tuma, Kahn, & Rock, 1992), but Moore and Egeth (1997) showed that although subjects are indeed unable to identify grouping patterns outside the focus of attention, effects of these patterns on visual perception can be observed when they are assessed using implicit, rather than explicit, measures. However, this finding, which is the only one to date demonstrating grouping effects without attention, is open to an alternative account. In the present study, we eliminated this confound and replicated Moore and Egeth's findings, using the Müller-Lyer illusion (Experiments 1 and 2). Moreover, we found converging evidence for these findings with a variant of the flanker task (Experiment 3), when the amount of available attentional resources was varied (Experiments 4 and 5). The results reinforce the idea that, although grouping outside the focus of attention cannot be the object of overt report, grouping processes can occur without attention.

Attentional selection of a peripheral ring overrules the central attentional bias

In visual search, distractors that fall between fixation and the target are more disruptive than distractors that fall at the same eccentricity as the target (Wolfe, O'Neill, & Bennett, 1998). This sensitivity to the relative eccentricity of target and distractor elements originates from a space-based bias favoring stimuli closer to the fovea. We show that this spatial bias can be overruled by cuing attention to a ring-shaped object. We rule out various space-based explanations of these findings, including (1) attention to fronto-parallel planes in depth and (2) serial attention to different portions of a ring. We suggest that attentional selection of a ring-shaped object operates independently of, and can overrule, spatial biases in selection.

Effect of endogenous attention on detection of weak gustatory and olfactory flavors

The effect of endogenous attention on the detectability of weak flavorants was examined in an absolute detection (two-alternative forced-choice) task. Attention to sucrose improved the detectability of sucrose, a gustation-based flavorant, both when the alternative was water and when it was vanillin. But attention to vanillin did not improve the detectability of vanillin, an olfaction-based flavorant, either when the alternative was water or when it was sucrose. Nor did attention improve the detectability of vanillin when the alternative was citric acid, a tastant that is qualitatively less similar to vanillin than is sucrose. Attention had no positive effect on the detection of either sucrose or vanillin when it was mixed with the other substance. These findings suggest that although it is possible to attend selectively to gustatory flavors, it may be more difficult to attend selectively to olfactory flavors--perhaps because attention to flavors, which are taken in the mouth, is directed spatially toward the tongue, where gustatory, but not olfactory, receptors are located.

Combined expectancy effects are modulated by the relation between expectancy cues

Studies of combined expectancies have shown that spatial cueing effects are reduced on trials on which participants have to respond with an unexpected motor response. In the first two experiments the range of reduced expectancy effects is examined. Advance knowledge of the likely response was combined in a trial-by-trial procedure with modality cueing, object cueing, and task cueing. Effects of modality cueing were reduced on trials on which the target requested an unexpected response. However, effects of object cueing as well as effects of task cueing were unaffected by response cueing. Comparing experiments revealed that different types of cues were used in different experiments. To test the effect of type of cue on the interaction of expectancies the third experiment combined spatial cueing with response cueing. When integrated cues were used that cued the likely target location by an arrow and the likely response by an arrow too, spatial cueing effects were reduced on trials with unexpected responses. However, spatial cueing effects remained unaffected by response cueing when separated cues were used consisting in a word cueing the response and an arrow cueing target location. An account for the modulation of combined expectancies by the relation between cues is suggested in terms of the adjusted expectancy model.

Modulation of object-based attention by spatial focus under endogenous and exogenous orienting

In R. Egly, J. Driver, and R. D. Rafal's (1994) influential double-rectangle spatial-cuing paradigm, exogenous cues consistently induce object-based attention, whereas endogenous cues generally induce space-based attention. This difference suggests an interdependency between mode of orienting (endogenous vs exogenous) and mode of selection (object based vs space based). However, mode of orienting is generally confounded with initial focus of attention: Endogenous orienting begins with attention focused on a central cue, whereas exogenous orienting begins with attention widely spread. In this study, an attentional-focusing hypothesis is examined and supported by experiments showing that for both endogenous and exogenous cuing, object-based effects are obtained under conditions that encourage spread attention, but they are attenuated under conditions that encourage focused attention. General implications for object-based attention are discussed. ((c) 2003 APA, all rights reserved)

Dynamic interaction of object- and space-based attention in retinotopic visual areas

We investigated the interaction between object- and space-based attention by measuring activity in early visual cortex. After central cueing, when subjects directed attention to a spatially defined part of an object, activity in early visual areas was enhanced at corresponding retinotopic representations but also at representations of other locations covered by the object. Different from the assumption of automatic attentional "spreading" within an object, however, activity was greater for representations of cued than of uncued locations on the same object. These findings support an interaction of object-based spatial selection with object-independent spatial mechanisms in directing attention. When the target stimulus did not appear at the expected location, we found higher activation in areas representing other locations on the same object than equidistant locations on other objects. Objects, hence, also guide spatial search, and this may account for the behaviorally observed delay in processing parts of an unattended object.

Dynamics of feature binding during object-selective attention

Objects in the environment may be attended selectively and perceived as unified ensembles of their constituent features. To investigate the timing and cortical localization of feature-integration mechanisms in object-based attention, recordings of event-related potentials and magnetic fields were combined with functional MRI while subjects attended to one of two superimposed transparent surfaces formed by arrays of dots moving in opposite directions. A spatiotemporal analysis revealed evidence for a rapid increase in neural activity localized to a color-selective region of the fusiform gyrus when the surface moving in the attended direction displayed an irrelevant color feature. These data provide support for the "integrated-competition" model of object-selective attention and point to a dynamic neural substrate for the rapid binding process that links relevant and irrelevant features to form a unified perceptual object.

Attentional capture within and between objects

The present study addressed the question whether attentional capture by abrupt onsets is affected by object-like properties of the stimulus field. Observers searched for a target circle at one of four ends of two solid rectangles. In the focused attention condition the location of the upcoming target was cued by means of a central arrowhead, whereas in the divided attention condition, the target location was not cued. Irrelevant abrupt onsets could appear either within the attended or within the non-attended object. The results showed that in the focused attention condition, onsets ceased to capture attention irrespective of whether the onset appeared within an attended object or within a non-attended object.

The effect of attentional cueing on conscious awareness of stimulus and response

Attending to a cued location in space leads to faster reaction times when a stimulus is presented there. The reasons for this attentional effect, and its specific locus in the information-processing chain between stimulus and response, remain unclear. One suggestion is that attention speeds the conscious detection of stimuli. Surprisingly, this possibility appears not to have been tested directly. To resolve this question, we asked subjects to make simple responses to lateralised targets that followed either a valid, invalid or neutral cue, and to judge the perceived time of the target onset, or of their response, by delayed report of the position of a clock hand. Our results showed that only a small and non-significant part of the attentional effect is due to delayed conscious awareness of the stimulus. The greater part of the attentional effect is localised either subsequent to conscious detection of stimuli or occurs in a separate, parallel processing stream from that which generates the motor response.

Overt and covert object-based attention

To examine the role of perceptual object representations in the control of eye movements and attention, a pair of experiments adapted the object-cuing paradigm of Egly, Driver, and Rafal (1994) to require eye movements. Displays were pairs of adjacent rectangles, each containing two characters. Observers were asked to make a speeded judgment of a target character's orientation, and a cue was provided prior to target/distractor onset to indicate the target's likely location. Gaze-contingent presentation of target and distractors was used to demand overt scanning of displays. Eye movements during task performance evinced two forms of object-based effects. First, saccades following fixation on an invalidly cued item were more likely to be made within the cued rectangle than between rectangles. Second, saccades within the cued rectangle were preceded by shorter dwell times than saccades between rectangles. Extrafoveal processing of stimuli within the cued rectangle, however, was not facilitated, suggesting that covert attention was not allocated more densely within the cued than within the uncued object.

Object-based selection within and beyond the focus of spatial attention

In a series of experiments, we examined the effect of perceptual objects on visual attentional processing in the presence of spatially cued attentional selection. Subjects made speeded judgments about two visual elements that were either both on the same object or on two different objects. Judgments were faster when the elements were on the same object than when they were on different objects, revealing an object advantage. Importantly, the object advantage remained even when either exogenous or endogenous spatial cues were used to direct the subjects' attention to a part of the display, contrary to earlier findings of other researchers. The object advantage, however, did disappear when the stimulus duration was shortened substantially. The results show that object-based selection is pervasive and is not diminished by the act of selective attention. The results are discussed in terms of their implications for the mechanisms that underlie attentional selection.

Does attention follow the motion in the "shooting line" illusion?

When a line is presented in the vicinity of a recent luminance change (peripheral cue), it is perceived to be drawn over time away from its "cued" end even though the line is actually presented all at once. This study was designed to determine whether attention, exogenously attracted to the cue, would come under the exogenous control of this illusory motion and follow the drawing motion from the cued end to its terminus. Each trial began with the display of four small squares at the corners of an imaginary square centered about fixation. On the critical trials, one of the four squares brightened briefly, after which a horizontal line was presented joining either the two upper or the two lower squares. Shortly thereafter, the distribution of attention was determined by asking the observer to indicate the nature of a change that was equally likely to occur to one of the squares. Responses to targets presented at a noncued location that was at the end of an illusorily drawn line were as fast as those to targets at the cued location and were much faster than those to targets at the remaining noncued locations. This pattern was not shown when the line preceded the cue, strongly suggesting that attention follows the motion in this illusion.

Reflexive shifts of covert attention operate in an egocentric coordinate frame

Covert shifts of attention have been shown to improve detection and discrimination thresholds for a range of visual stimuli. Although there is some evidence to suggest that the allocation of attention to a particular region of interest occurs in a retinotopic frame of reference, the importance of an allocentric, or object-based, framework has gained widespread empirical support. The current experiment investigates the nature of the spatial representation in which covert shifts of attention occur in response to a reflexive prime. Primes and targets were presented in four conditions designed to vary systematically the validity of the spatial relationship between the prime and target in egocentric or allocentric coordinate frameworks. A significant advantage, in terms of reaction time and correct identification, was found for targets located in positions previously primed in an egocentric (but not allocentric) framework whereas there was no advantage for locations primed in an allocentric (but not egocentric) framework. These results suggest that the allocation of covert spatial attention within an egocentric framework may be more important than previously thought.

Object-based selection: the role of attentional shifts

The objective of this paper was to investigate under what conditions object-based effects are observed. Recently, Watson and Kramer (1999) used a divided-attention task and showed that unless top-down factors induce a bias toward selection at a higher level, object-based effects are obtained when same-object targets belong to the same uniformly connected (single-UC) region, but not when they belong to different single-UC regions grouped into a higher order object (grouped-UC regions). We refine this claim by proposing that a critical factor in determining whether or not object-based effects with grouped-UC regions are observed is the need to shift attention. The results of four experiments support this hypothesis. Stimuli and displays were similar to those used by Egly, Driver, and Rafal (1994). Subjects had to make size judgments. Using different paradigms, we obtained object-based effects when the task required shifts of attention (spatial cuing, same vs. different judgment with asynchronous target onsets), but not when attention remained either broadly distributed (same vs. different judgment with simultaneous targets) or tightly focused (response competition paradigm).

Multisensory prior entry

Despite 2 centuries of research, the question of whether attending to a sensory modality speeds the perception of stimuli in that modality has yet to be resolved. The authors highlight weaknesses inherent in this previous research and report the results of 4 experiments in which a novel methodology was used to investigate the effects on temporal order judgments (TOJs) of attending to a particular sensory modality or spatial location. Participants were presented with pairs of visual and tactile stimuli from the left and/or right at varying stimulus onset asynchronies and were required to make unspeeded TOJs regarding which stimulus appeared first. The results provide the strongest evidence to date for the existence of multisensory prior entry and support previous claims for attentional biases toward the visual modality and toward the right side of space. These findings have important implications for studies in many areas of human and animal cognition.

Effect of object onset on the distribution of visual attention

There now exists considerable evidence to suggest that the appearance of a new object in the visual field captures visual attention. One of the consequences of this attentional capture is that the object initiates a redistribution of attentional resources across visual space. This is classically observed in the precuing paradigm in which the onset of an abrupt cue influences the processing of a subsequently presented target. The present research describes a new phenomenon that occurs as a result of a new object appearing in the visual field. A stimulus presented in a region of space adjacent to a corner of an onsetting object receives an enhancement of processing relative to a stimulus presented adjacent to one of the object's straight edges. With the use of 2 converging methods, evidence is presented that suggests that the effect is a higher order attentional phenomenon whereby greater resources become directed to the corners of objects.

Processing demand modulates the effects of spatial attention on the judged duration of a brief stimulus

How does attention influence the judged duration of a brief stimulus? In the four experiments reported here, we show that the effect of spatial attention on duration judgment depends on the processing demand of the concurrent nontemporal task. When participants had to perform a speeded letter discrimination task in addition to duration rating, the judged duration was longer at a cued location than at an uncued location, regardless of whether the cue was exogenous or endogenous. However, when the same stimuli were presented but no concurrent nontemporal task was required, duration was judged to be shorter at the cued location, as compared with the uncued locations. Furthermore, although spatial attention influenced duration judgment, no object-based attentional effects were found. These findings suggest that, although spatial attention plays an important role in the judged duration of a briefly presented stimulus, its effect is mediated by the processing demand of the task.

Visual prior entry

It has long been claimed that attended stimuli are perceived prior to unattended stimuli--doctrine of prior entry. Most, if not all, studies on which such claims have been based, however, are open to a nonattentional interpretation involving response bias, leading some researchers to assert that prior entry may not exist. Given this controversy, we introduce a novel methodology to minimize the effect of response bias by manipulating attention and response demands in orthogonal dimensions. Attention was oriented to the left or right (ie., spatially), but instead of reporting on the basis of location, observers reported the order (first or second) of vertical versus horizontal line segments. Although second-order response biases were demonstrated, effects of attention in accordance with the law of prior entry were clearly obtained following both exogenous and endogenous attentional cuing.

Computational modelling of visual attention

Five important trends have emerged from recent work on computational models of focal visual attention that emphasize the bottom-up, image-based control of attentional deployment. First, the perceptual saliency of stimuli critically depends on the surrounding context. Second, a unique 'saliency map' that topographically encodes for stimulus conspicuity over the visual scene has proved to be an efficient and plausible bottom-up control strategy. Third, inhibition of return, the process by which the currently attended location is prevented from being attended again, is a crucial element of attentional deployment. Fourth, attention and eye movements tightly interplay, posing computational challenges with respect to the coordinate system used to control attention. And last, scene understanding and object recognition strongly constrain the selection of attended locations. Insights from these five key areas provide a framework for a computational and neurobiological understanding of visual attention.