Object-based visual attention with endogenous orienting

Variability in the temporal dynamics of object-based attentional selection

Our attention can be directed to specific locations in our visual field (space-based attention), or to specific objects (object-based attention). However, object-based attention tends to be less pronounced than space-based attention and can vary greatly between individuals. Here we investigated whether the low prevalence of object-based effects is related to variability in the temporal dynamics of attentional selection. We manipulated cue-to-target intervals from 50 to 600 ms in a two-rectangle discrimination task. Space- and object-based effects were measured at the group level and for individual participants. We used bootstrapping to highlight cue-to-target intervals with maximal space- and object-based effects, and fast Fourier transform (FFT) to investigate rhythmic sampling of locations within and between objects. Whereas overall, space-based effects were robust and stable across all cue-to-target intervals for most participants, object-based effects were small and were only found for a small subset of participants in the different cue-to-target intervals. In the frequency domain, only a small number of participants exhibited significant periodicities, prompting the need for further investigation and consideration. Overall, our study suggests variability in the temporal dynamics of object-based effects underlying their low prevalence, a finding that needs to be further investigated in future studies.

Excess success in articles on object-based attention

Twenty-five years of research has explored the object-based attention effect using the two-rectangles paradigm and closely related paradigms. While reading this literature, we noticed statistical attributes that are sometimes related to questionable research practices, which can undermine the reported conclusions. To quantify these attributes, we applied the Test for Excess Success (TES) individually to 37 articles that investigate various properties of object-based attention and comprise four or more experiments. A TES analysis estimates the probability that a direct replication of the experiments in a given article with the same sample sizes would have the same success (or better) as the original article. If the probability is low, then readers should be skeptical about the conclusions that are based on those experimental results. We find that 19 of the 37 analyzed articles (51%) seem too good to be true in that they have a replication probability below 0.1. In a new large sample study, we do find evidence for the basic object-based attention effect in the two-rectangles paradigm, which this literature builds on. A power analysis using this data shows that commonly used sample sizes in studies that investigate properties of object-based attention with the two-rectangles paradigm are, in fact, much too small to reliably detect even the basic effect.

Pre-saccadic attention spreads to stimuli forming a perceptual group with the saccade target

The pre-saccadic attention shift-a rapid increase in visual sensitivity at the target-is an inevitable precursor of saccadic eye movements. Saccade targets are often parts of the objects that are of interest to the active observer. Although the link between saccades and covert attention shifts is well established, it remains unclear if pre-saccadic attention selects the location of the eye movement target or rather the entire object that occupies this location. Indeed, several neurophysiological studies suggest that attentional modulations of neural activity in visual cortex spreads across parts of objects (e.g., elements grouped by Gestalt principles) that contain the target location of a saccade. To understand the nature of pre-saccadic attentional selection, we examined how visual sensitivity, measured in a challenging orientation discrimination task, changes during saccade preparation at locations that are perceptually grouped with the saccade target. In Experiment 1, using grouping by color in a delayed-saccade task, we found no consistent spread of attention to locations that formed a perceptual group with the saccade target. However, performance depended on the side of the stimulus arrangement relative to the saccade target location, an effect we discuss with respect to attentional momentum. In Experiment 2, employing stronger perceptual grouping cues (color and motion) and an immediate-saccade task, we obtained a reliable grouping effect: Attention spread to locations that were perceptually grouped with the saccade target while saccade preparation was underway. We also replicated the side effect observed in Experiment 1. These results provide evidence that the pre-saccadic attention spreads beyond the target location along the saccade direction, and selects scene elements that-based on Gestalt criteria-are likely to belong to the same object as the saccade target.

Extending the study of visual attention to a multisensory world (Charles W. Eriksen Special Issue)

Charles W. Eriksen (1923-2018), long-time editor of Perception & Psychophysics (1971-1993) - the precursor to the present journal - undoubtedly made a profound contribution to the study of selective attention in the visual modality. Working primarily with neurologically normal adults, his early research provided both theoretical accounts for behavioral phenomena as well as robust experimental tasks, including the well-known Eriksen flanker task. The latter paradigm has been used and adapted by many researchers over the subsequent decades. While Eriksen's research interests were primarily focused on situations of unimodal visual spatially selective attention, here I review evidence from those studies that have attempted to extend Eriksen's general approach to non-visual (i.e., auditory and tactile) selection and the more realistic situations of multisensory spatial attentional selection.

Phasic pupillary responses modulate object-based attentional prioritization

Visual attention studies have demonstrated that the shape of space-based selection can be governed by salient object contours: when a portion of an enclosed space is cued, the selected region extends to the full enclosure. Although this form of object-based attention (OBA) is well established, one continuing investigation focuses on whether this selection is obligatory or under voluntary control. We attempt to dissociate between these alternatives by interrogating the locus coeruleus-norepinephrine (LC-NE) system – known to fluctuate with top-down attention – during a classic two-rectangle paradigm in a sample of healthy human participants (N = 36). An endogenous spatial pre-cue directed voluntary space-based attention (SBA) to one end of a rectangular frame. We manipulated the reliability of the cue, such that targets appearing at an uncued location within the frame occurred at low or moderate frequencies. Phasic pupillary responses time-locked to the cue display served to noninvasively measure LC-NE activity, reflecting top-down processing of the spatial cue. If OBA is controlled analogously to SBA, then object selection should emerge only when it is behaviorally expedient and when LC-NE activity reflects a high degree of top-down attention to the cue display. Our results bore this out. Thus, we conclude that OBA was voluntarily controlled, and furthermore show that phasic norepinephrine may modulate attentional strategy.

Task-Irrelevant Visual Forms Facilitate Covert and Overt Spatial Selection

Covert and overt spatial selection behaviors are guided by both visual saliency maps derived from early visual features as well as priority maps reflecting high-level cognitive factors. However, whether mid-level perceptual processes associated with visual form recognition contribute to covert and overt spatial selection behaviors remains unclear. We hypothesized that if peripheral visual forms contribute to spatial selection behaviors, then they should do so even when the visual forms are task-irrelevant. We tested this hypothesis in male and female human subjects as well as in male macaque monkeys performing a visual detection task. In this task, subjects reported the detection of a suprathreshold target spot presented on top of one of two peripheral images, and they did so with either a speeded manual button press (humans) or a speeded saccadic eye movement response (humans and monkeys). Crucially, the two images, one with a visual form and the other with a partially phase-scrambled visual form, were completely irrelevant to the task. In both manual (covert) and oculomotor (overt) response modalities, and in both humans and monkeys, response times were faster when the target was congruent with a visual form than when it was incongruent. Importantly, incongruent targets were associated with almost all errors, suggesting that forms automatically captured selection behaviors. These findings demonstrate that mid-level perceptual processes associated with visual form recognition contribute to covert and overt spatial selection. This indicates that neural circuits associated with target selection, such as the superior colliculus, may have privileged access to visual form information.SIGNIFICANCE STATEMENT Spatial selection of visual information either with (overt) or without (covert) foveating eye movements is critical to primate behavior. However, it is still not clear whether spatial maps in sensorimotor regions known to guide overt and covert spatial selection are influenced by peripheral visual forms. We probed the ability of humans and monkeys to perform overt and covert target selection in the presence of spatially congruent or incongruent visual forms. Even when completely task-irrelevant, images of visual objects had a dramatic effect on target selection, acting much like spatial cues used in spatial attention tasks. Our results demonstrate that traditional brain circuits for orienting behaviors, such as the superior colliculus, likely have privileged access to visual object representations.

Object-based biased competition during covert spatial orienting

Biased-competition models assert that spatial attention facilitates visual perception by biasing competitive interactions in favor of relevant input. In line with this view, past work has shown that the benefits of covert spatial attention are greatest when targets must compete with interfering stimuli. Here we propose a boundary condition for the resolution of interference via exogenous attention: Attention resolves visual interference between targets and distractors, but only when they can be individuated into distinct representations. Thus, we propose that biased competition may be object-based. We replicated previous observations of larger attention effects when targets were flanked by irrelevant distractors (interference-present displays) than when targets were presented alone (interference-absent displays). Critically, we then showed that this amplification of cueing effects in the presence of interference is eliminated when strong crowding hampers individuation of the targets and distractors. Likewise, when targets were embedded within a noise mask that did not evoke the percept of an individuated distractor, the attention effects were equivalent across noise and lone-target displays. Thus, we conclude that exogenous spatial attention resolves interference in an object-based fashion that depends on the perception of individuated targets and distractors.

Object-based attention is mediated by collinearity of targets

Same-object bias occurs when tasks associated with processing a single object are faster than tasks associated with two objects. Over five experiments we assessed whether same-object bias is mediated by the collinearity of the targets. Participants decided whether two targets, presented either within a single object or across two objects, were the same or different. Results showed that same-object bias only occurred when targets appeared on the same straight line within the same object. When targets appeared in the same object but were separated by an angle or corner, within-object facilitation was eliminated or greatly reduced. In a final experiment, response times to two targets that were collinear but on separate objects were responded to faster than were noncollinear targets on the same object. This suggests that collinearity between targets mediates the effect found in this paradigm, at least to a greater extent than colour grouping.

Object-based processes in the planning of goal-directed hand movements

Theories in motor control suggest that the parameters specified during the planning of goal-directed hand movements to a visual target are defined in spatial parameters like direction and amplitude. Recent findings in the visual attention literature, however, argue widely for early object-based selection processes. The present experiments were designed to examine the contributions of object-based and space-based selection processes to the preparation time of goal-directed pointing movements. Therefore, a cue was presented at a specific location. The question addressed was whether the initiation of responses to uncued target stimuli could benefit from being either within the same object (object based) or presented at the same direction (space based). Experiment 1 replicated earlier findings of object-based benefits for non-goal-directed responses. Experiment 2 confirmed earlier findings of space-based benefits for goal-directed hand pointing movements. In Experiments 3 and 4, space-based and object-based manipulations were combined while requiring goal-directed hand pointing movements. The results clearly favour the notion that the selection processes for goal-directed pointing movements are primarily object based. Implications for theories on selective attention and action planning are discussed.

Saccade latency indexes exogenous and endogenous object-based attention

Classic studies of object-based attention have utilized keypress responses as the main dependent measure. However, people typically make saccades to fixate important objects. Recent work has shown that attention may act differently when it is deployed covertly versus in advance of a saccade. We further investigated the link between saccades and attention by examining whether object-based effects can be observed for saccades. We adapted the classical double-rectangle cueing paradigm of Egly, Driver, and Rafal (1994), and measured both the first saccade latency and the keypress reaction time (RT) to a target that appeared at the end of one of the two rectangles. Our results showed that saccade latencies exhibited higher sensitivity than did RTs for detecting effects of attention. We also assessed the generality of the attention effects by testing three types of cues: hybrid (predictive and peripheral), exogenous (nonpredictive and peripheral), and endogenous (predictive and central). We found that both RTs and saccade latencies exhibited effects of both space-based and object-based attentional selection. However, saccade latencies showed a more robust attentional modulation than RTs. For the exogenous cues, we observed a spatial inhibition of return along with an object-based effect, implying that object-based attention is independent of space-based attention. Overall, our results revealed an oculomotor correlate of object-based attention, suggesting that, in addition to spatial priority, object-level priority also affects saccade planning.

Target-object integration, attention distribution, and object orientation interactively modulate object-based selection

The representational basis of attentional selection can be object-based. Various studies have suggested, however, that object-based selection is less robust than spatial selection across experimental paradigms. We sought to examine the manner by which the following factors might explain this variation: Target-Object Integration (targets 'on' vs. part 'of' an object), Attention Distribution (narrow vs. wide), and Object Orientation (horizontal vs. vertical). In Experiment 1, participants discriminated between two targets presented 'on' an object in one session, or presented as a change 'of' an object in another session. There was no spatial cue-thus, attention was initially focused widely-and the objects were horizontal or vertical. We found evidence of object-based selection only when targets constituted a change 'of' an object. Additionally, object orientation modulated the sign of object-based selection: We observed a same-object advantage for horizontal objects, but a same-object cost for vertical objects. In Experiment 2, an informative cue preceded a single target presented 'on' an object or as a change 'of' an object (thus, attention was initially focused narrowly). Unlike in Experiment 1, we found evidence of object-based selection independent of target-object integration. We again found that the sign of selection was modulated by the objects' orientation. This result may reflect a meridian effect, which emerged due to anisotropies in the cortical representations when attention is oriented endogenously. Experiment 3 revealed that object orientation did not modulate object-based selection when attention was oriented exogenously. Our findings suggest that target-object integration, attention distribution, and object orientation modulate object-based selection, but only in combination.

Voluntary Attentional Orienting in Schoolchildren

Voluntary attentional orienting is the foundation of the capacity to highlight relevant stimuli and suppress competing distractions. It plays a role in the scholastic skills. This study investigated the changes in the orienting skills in 630 schoolchildren (age range: 5.7–10.2 years old), who attended the first ( N = 205, M = 6.1, SD = 0.4), third (212 children, M = 8.2, SD = 0.6), and fifth grade (213 children, M = 10, SD = 0.4) of four primary schools in Italy. Simple attentional orienting, choice attentional orienting on written stimuli, double attentional orienting (auditory and visual), and re-orienting were investigated. The tasks required pressing a key in response to some target stimuli. The stimuli were digits, images of objects, written words, letters, geometric forms, and auditory verbal stimuli. Results showed that attentional orienting improved with age. The children's performances depended on the type of stimuli and activities required for the task. The accuracy of re-orienting with written verbal stimuli did not improve during primary school. With increasing age, children became faster but not more able to focus on written verbal stimuli when shifting of attention was required.

Voluntary Attentional Orienting in Schoolchildren: How Visual Orienting Skills Change During Primary School

Voluntary attentional orienting is the foundation of the capacity to highlight relevant stimuli and suppress competing distractions. It plays a role in the scholastic skills. This study investigated the changes in the orienting skills in 630 schoolchildren (age range: 5.7-10.2 years old), who attended the first (N = 205, M = 6.1, SD = 0.4), third (212 children, M = 8.2, SD = 0.6), and fifth grade (213 children, M = 10, SD = 0.4) of four primary schools in Italy. Simple attentional orienting, choice attentional orienting on written stimuli, double attentional orienting (auditory and visual), and re-orienting were investigated. The tasks required pressing a key in response to some target stimuli. The stimuli were digits, images of objects, written words, letters, geometric forms, and auditory verbal stimuli. Results showed that attentional orienting improved with age. The children's performances depended on the type of stimuli and activities required for the task. The accuracy of re-orienting with written verbal stimuli did not improve during primary school. With increasing age, children became faster but not more able to focus on written verbal stimuli when shifting of attention was required.

Interocular grouping without awareness

Interocular grouping occurs when different parts of an image presented to each eye bound into a coherent whole. Previous studies anticipated that these parts are visible to both eyes simultaneously (i.e., the images altered back and forth). Although this view is consistent with the general consensus of binocular rivalry (BR) that suppressed stimuli receive no processing beyond rudimentary level (i.e., adaptation), it is actually inconsistent with studies that use continuous flash suppression (CFS). CFS is a form of interocular suppression that is more stable and causes stronger suppression of stimuli than BR. In the present study, we examined whether or not interocular grouping needs to occur at a conscious level as prior studies suggested. The modified double-rectangle paradigm used by Egly, Driver, and Rafal (1994) was adopted, and object-based attention was directed for successful grouping. To induce interocular grouping, we presented complementary parts of two rectangles dichoptically for possible interocular grouping and a dynamic Mondrian in front of one eye (i.e., CFS). Two concurrent targets were presented after one of the visible parts of the rectangles was cued. Participants were asked to judge which target appeared first. We found that the target showed on the cued rectangle after interocular grouping was reported to appear first more frequently than the target on the uncued rectangle. This result was based on the majority of trials where the suppressed parts of the objects remained invisible, which indicates that interocular grouping can occur without all the to-be-grouped parts being visible and without awareness.

Exploring the relationship between object realism and object-based attention effects

Visual attention prioritizes processing of locations in space, and evidence also suggests that the benefits of attention can be shaped by the presence of objects (object-based attention). However, the prevalence of object-based attention effects has been called into question recently by evidence from a large-sampled study employing classic attention paradigms (Pilz et al., 2012). We conducted two experiments to explore factors that might determine when and if object-based attention effects are observed, focusing on the degree to which the concreteness and realism of objects might contribute to these effects. We adapted the classic attention paradigm first reported by Egly, Driver, and Rafal (1994) by replacing abstract bar stimuli in some conditions with objects that were more concrete and familiar to participants: items of silverware. Furthermore, we varied the realism of these items of silverware, presenting either cartoon versions or photo-realistic versions. Contrary to predictions, increased realism did not increase the size of object-based effects. In fact, no clear object-based effects were observed in either experiment, consistent with previous failures to replicate these effects in similar paradigms. While object-based attention may exist, and may have important influences on how we parse the visual world, these and other findings suggest that the two-object paradigm typically relied upon to study object-based effects may not be the best paradigm to investigate these issues.

The effects of sequential attention shifts within visual working memory

Previous studies have shown conflicting data as to whether it is possible to sequentially shift spatial attention among visual working memory (VWM) representations. The present study investigated this issue by asynchronously presenting attentional cues during the retention interval of a change detection task. In particular, we focused on two types of sequential attention shifts: (1) orienting attention to one location, and then withdrawing attention from it, and (2) switching the focus of attention from one location to another. In Experiment 1, a withdrawal cue was presented after a spatial retro-cue to measure the effect of withdrawing attention. The withdrawal cue significantly reduced the cost of invalid spatial cues, but surprisingly, did not attenuate the benefit of valid spatial cues. This indicates that the withdrawal cue only triggered the activation of facilitative components but not inhibitory components of attention. In Experiment 2, two spatial retro-cues were presented successively to examine the effect of switching the focus of attention. We observed equivalent benefits of the first and second spatial cues, suggesting that participants were able to reorient attention from one location to another within VWM, and the reallocation of attention did not attenuate memory at the first-cued location. In Experiment 3, we found that reducing the validity of the preceding spatial cue did lead to a significant reduction in its benefit. However, performance was still better at first-cued locations than at uncued and neutral locations, indicating that the first cue benefit might have been preserved both partially under automatic control and partially under voluntary control. Our findings revealed new properties of dynamic attentional control in VWM maintenance.

Distinct mechanisms subserve location- and object-based visual attention

Visual attention can be allocated to either a location or an object, named location- or object-based attention, respectively. Despite the burgeoning evidence in support of the existence of two kinds of attention, little is known about their underlying mechanisms in terms of whether they are achieved by enhancing signal strength or excluding external noises. We adopted the noise-masking paradigm in conjunction with the double-rectangle method to probe the mechanisms of location-based attention and object-based attention. Two rectangles were shown, and one end of one rectangle was cued, followed by the target appearing at (a) the cued location; (b) the uncued end of the cued rectangle; and (c) the equal-distant end of the uncued rectangle. Observers were required to detect the target that was superimposed at different levels of noise contrast. We explored how attention affects performance by assessing the threshold versus external noise contrast (TvC) functions and fitted them with a divisive inhibition model. Results show that location-based attention – lower threshold at cued location than at uncued location – was observed at all noise levels, a signature of signal enhancement. However, object-based attention – lower threshold at the uncued end of the cued than at the uncued rectangle – was found only in high-noise conditions, a signature of noise exclusion. Findings here shed a new insight into the current theories of object-based attention.

Object-based selection modulates top-down attentional shifts

A large body of evidence supports that visual attention – the cognitive process of selectively concentrating on a salient or task-relevant subset of visual information – often works on object-based representation. Recent studies have postulated two possible accounts for the object-specific attentional advantage: attentional spreading and attentional prioritization, each of which modulates a bottom-up signal for sensory processing and a top-down signal for attentional allocation, respectively. It is still unclear which account can explain the object-specific attentional advantage. To address this issue, we examined the influence of object-specific advantage on two types of visual search: parallel search, invoked when a bottom-up signal is fully available at a target location, and serial search, invoked when a bottom-up signal is not enough to guide target selection and a top-down control for shifting of focused attention is required. Our results revealed that the object-specific advantage is given to the serial search but not to the parallel search, suggesting that object-based attention facilitates stimulus processing by affecting the priority of attentional shifts rather than by enhancing sensory signals. Thus, our findings support the notion that the object-specific attentional advantage can be explained by attentional prioritization but not attentional spreading.

Two cognitive and neural systems for endogenous and exogenous spatial attention

Orienting of spatial attention is a family of phylogenetically old mechanisms developed to select information for further processing. Information can be selected via top-down or endogenous mechanisms, depending on the goals of the observers or on the task at hand. Moreover, salient and potentially dangerous events also attract spatial attention via bottom-up or exogenous mechanisms, allowing a rapid and efficient reaction to unexpected but important events. Fronto-parietal brain networks have been demonstrated to play an important role in supporting spatial attentional orienting, although there is no consensus on whether there is a single attentional system supporting both endogenous and exogenous attention, or two anatomical and functionally different attentional systems. In the present paper we review behavioral evidence emphasizing the differential characteristics of both systems, as well as their possible interactions for the control of the final orienting response. Behavioral studies reporting qualitative differences between the effects of both systems as well as double dissociations of the effects of endogenous and exogenous attention on information processing, suggest that they constitute two independent attentional systems, rather than a single one. Recent models of attentional orienting in humans have put forward the hypothesis of a dorsal fronto-parietal network for orienting spatial attention, and a more ventral fronto-parietal network for detecting unexpected but behaviorally relevant events. Non-invasive neurostimulation techniques, as well as neuropsychological data, suggest that endogenous and exogenous attention are implemented in overlapping, although partially segregated, brain circuits. Although more research is needed in order to refine our anatomical and functional knowledge of the brain circuits underlying spatial attention, we conclude that endogenous and exogenous spatial orienting constitute two independent attentional systems, with different behavioral effects, and partially distinct neural substrates.

Object-based attention guided by an invisible object

Evidence for object-based attention typically comes from studies using displays with visible objects, and little is known about whether object-based attention can occur with invisible objects. We investigated this issue with a modified double-rectangle cuing paradigm, which was originally developed by Egly et al. (J Exp Psychol Gen 123:161-177, 1994). In this study, low-contrast rectangles were presented very briefly, which rendered them invisible to subjects. With the invisible rectangles, we found a classical object-based attentional effect as indexed by the same-object effect. We also found the instantaneous object effect-object-based attention was dependent on the orientation of the rectangles presented with the target, providing evidence for the dynamic updating hypothesis (Ho and Yeh in Acta Psychol 132:31-39, 2009). These results suggest that object-based attention can be guided by an invisible object in an automatic way, with a minimal influence from high-level top-down control.

How prevalent is object-based attention?

Previous research suggests that visual attention can be allocated to locations in space (space-based attention) and to objects (object-based attention). The cueing effects associated with space-based attention tend to be large and are found consistently across experiments. Object-based attention effects, however, are small and found less consistently across experiments. In three experiments we address the possibility that variability in object-based attention effects across studies reflects low incidence of such effects at the level of individual subjects. Experiment 1 measured space-based and object-based cueing effects for horizontal and vertical rectangles in 60 subjects comparing commonly used target detection and discrimination tasks. In Experiment 2 we ran another 120 subjects in a target discrimination task in which rectangle orientation varied between subjects. Using parametric statistical methods, we found object-based effects only for horizontal rectangles. Bootstrapping methods were used to measure effects in individual subjects. Significant space-based cueing effects were found in nearly all subjects in both experiments, across tasks and rectangle orientations. However, only a small number of subjects exhibited significant object-based cueing effects. Experiment 3 measured only object-based attention effects using another common paradigm and again, using bootstrapping, we found only a small number of subjects that exhibited significant object-based cueing effects. Our results show that object-based effects are more prevalent for horizontal rectangles, which is in accordance with the theory that attention may be allocated more easily along the horizontal meridian. The fact that so few individuals exhibit a significant object-based cueing effect presumably is why previous studies of this effect might have yielded inconsistent results. The results from the current study highlight the importance of considering individual subject data in addition to commonly used statistical methods.

Central-Cue Discriminability Modulates Object-Based Attention by Influencing Spatial Attention

The role of central-cue discriminability in modulating object-based effects was examined using Egly, Driver, and Rafal’s (1994) “double-rectangle” spatial cueing paradigm. Based on the attentional focusing hypothesis (Goldsmith & Yeari, 2003), we hypothesized that highly discriminable central-arrow cues would be processed with attention spread across the two rectangles (potential target locations), thereby strengthening the perceptual representation of these objects so that they influence the subsequent endogenous deployment of attention, yielding object-based effects. By contrast, less discriminable central-arrow cues should induce a more narrow attentional focus to the center of the display, thereby weakening the rectangle object representations so that they no longer influence the subsequent attentional deployment. Central-arrow-cue discriminability was manipulated by size and luminance contrast. The results supported the predictions, reinforcing the attentional focusing hypothesis and highlighting the need to consider central-cue discriminability when designing experiments and in comparing experimental results.

Dos and don'ts in response priming research

Response priming is a well-understood but sparsely employed paradigm in cognitive science. The method is powerful and well-suited for exploring early visuomotor processing in a wide range of tasks and research fields. Moreover, response priming can be dissociated from visual awareness, possibly because it is based on the first sweep of feedforward processing of primes and targets. This makes it a theoretically interesting device for separating conscious and unconscious vision. We discuss the major opportunities of the paradigm and give specific recommendations (e.g., tracing the time-course of priming in parametric experiments). Also, we point out typical confounds, design flaws, and data processing artifacts.

Lexical- and perceptual-based object effects in the two-rectangle cueing paradigm

Previous studies demonstrate that attentional selection can be object-based, in which the object is defined in terms of Gestalt principles or lexical organizations. Here we investigate how attentional selection functions when the two types of objects are manipulated jointly. Experiment 1 replicated Li and Logan (2008) by showing that attentional shift between two Chinese characters is more efficient when they form a compound word than when they form a nonword. Experiment 2A presented characters either alone or within rectangles (Egly, Driver, & Rafal, 1994) and the characters in a rectangle formed either a word or a nonword. Experiment 2B differed from Experiment 2A in that the two characters forming a word were in different rectangles. Experiment 3A presented the two characters of a word either within a rectangle or in different rectangles. Experiment 3B used the same design as Experiment 3A but presented stimuli of different types in random orders, rather than in blocks as in Experiments 2A, 2B and 3A. In blocked presentation, detection responses to the target color on a character were faster when this character and the cue character formed a word than when they did not, and the size of this lexical-based object effect did not vary according to whether the two characters were presented alone or within or between rectangles. In random presentation, however, the lexical-based object effect was diminished when the two characters of a word were presented in different rectangles. Overall, these findings suggest that the processes that constrain attention deployment over conjoined objects can be strategically adjusted.

The role of the left posterior parietal lobule in top-down modulation on space-based attention: a transcranial magnetic stimulation study

Converging evidence from neuroimaging as well as lesion and transcranial magnetic stimulation (TMS) studies has been obtained for the involvement of right ventral posterior parietal cortex (PPC) in exogenous orienting. However, the contribution of dorsal PPC to attentional orienting, particularly endogenous orienting, is still under debate. In an informative peripheral cueing paradigm, in which the exogenous and endogenous orienting can be studied in relative isolation within a single task, we applied TMS over sub-regions of dorsal PPC to explore their possible distinct involvement in exogenous and endogenous processes. We found that disruption of the left posterior intraparietal sulcus (pIPS) weakened the attentional effects of endogenous orienting, but did not affect exogenous processes. In addition, TMS applied over the right superior parietal lobule (SPL) resulted in an overall increase in reaction times. The present study provides the causal evidence that the left pIPS plays a crucial role in voluntary orienting of visual attention, while right SPL is involved in the processing of arousal and/or vigilance.

Subliminal spatial cues capture attention and strengthen between-object link

According to the spreading hypothesis of object-based attention, a subliminal cue that can successfully capture attention to a location within an object should also cause attention to spread throughout the whole cued object and lead to the same-object advantage. Instead, we propose that a subliminal cue favors shifts of attention between objects and strengthens the between-object link, which is coded primarily within the dorsal pathway that governs the visual guidance of action. By adopting the two-rectangle method and using an effective subliminal cue to compare with the classic suprathreshold cue, we found a different result pattern with suprathreshold cues than with subliminal cues. The suprathreshold cue replicated the conventional location and object effects, whereas a subliminal cue led to a different-object advantage with a facilitatory location effect and a same-object advantage with an inhibitory location effect. These results support our consciousness-dependent shifting hypothesis but not the spreading hypothesis.

Multisensory conflict modulates the spread of visual attention across a multisensory object

Spatial attention to a visual stimulus that occurs synchronously with a task-irrelevant sound from a different location can lead to increased activity not only in the visual cortex, but also the auditory cortex, apparently reflecting the object-related spreading of attention across both space and modality (Busse et al., 2005). The processing of stimulus conflict, including multisensory stimulus conflict, is known to activate the anterior cingulate cortex (ACC), but the interactive influence on the sensory cortices remains relatively unexamined. Here we used fMRI to examine whether the multisensory spread of visual attention across the sensory cortices previously observed will be modulated by whether there is conceptual or object-related conflict between the relevant visual and irrelevant auditory inputs. Subjects visually attended to one of two lateralized visual letter-streams while synchronously occurring, task-irrelevant, letter sounds were presented centrally, which could be either congruent or incongruent with the visual letters. We observed significant enhancements for incongruent versus congruent letter-sound combinations in the ACC and in the contralateral visual cortex when the visual component was attended, presumably reflecting the conflict detection and the need for boosted attention to the visual stimulus during incongruent trials. In the auditory cortices, activity increased bilaterally if the spatially discordant auditory stimulation was incongruent, but only in the left, language-dominant side when congruent. We conclude that a conflicting incongruent sound, even when task-irrelevant, distracts more strongly than a congruent one, leading to greater capture of attention. This greater capture of attention in turn results in increased activity in the auditory cortex.

Modulation of spatial Stroop by object-based attention but not by space-based attention

Earlier studies have shown that the spatial Stroop effect systematically decreases when a peripheral precue is presented at the same location as the target, compared to an uncued location condition. In this study, two experiments were conducted to explore whether the cueing modulation of spatial Stroop is object based and/or space based. In Experiment 1, we found evidence favouring the view that the cueing modulation of the spatial Stroop effect is entirely object based, as no differences were found in conflict reduction for the same-location and same-object conditions. In Experiment 2, the cue was predictive, and a similar object-based modulation of spatial Stroop was still observed. However, the direction of such modulation was affected by the rectangles’ orientation. Overall, the pattern of results obtained favours the object-integration (Lupiáñez & Milliken, 1999; Lupiáñez, Milliken, Solano, Weaver, & Tipper, 2001) and referential-coding accounts (Danziger, Kingstone, & Ward, 2001) and seems to provide evidence against the attention-shift account (Rubichi, Nicoletti, Iani, & Umilta, 1997; Stoffer, 1991).

Visual streams and shifting attention

Understanding the relationship between bottom-up and top-down processing in visual perception and attention is challenging. An important part of that challenge is studying the roles the parvocellular (P) and magnocellular (M) retino-geniculo-cortical pathways play in visual processing and attention. The P pathway provides the dominant initial input to the ventral stream which plays an important role in object processing and is assumed to be relatively more involved in object-based attention. The faster responding M pathway provides the dominant initial input to the dorsal stream which plays an important role in processing movement and spatial location information and is assumed to be relatively more involved in space-based attention. To gain insight into the relationship between M/dorsal and P/ventral activity and deploying visual attention, we used a covert cuing paradigm to manipulate attention while bottom-up and top-down perceptual stimulus variables created M/dorsal and P/ventral-biased conditions. One study examined the object advantage, where responses are faster for within-relative to equidistant between-object shifts of attention. Visual stream contributions to object- and spaced-based attention were revealed using psychophysically equiluminant conditions expected to reduce M/dorsal activity. Other studies investigating visual stream contributions to location-based inhibition of return (IOR) used IOR magnitude as an indicator of the ease or difficulty of deploying spatial attention. Greater IOR was found under P/ventral-biased conditions. Less IOR was found under M/dorsal-biased conditions. The results support the use of M/dorsal and P/ventral-biased conditions as a valuable strategy for studying the relationship between visual stream activity and shifting attention.

The modulation of perceptual selection by working memory is dependent on the focus of spatial attention

Recent research suggests that visual selection can be automatically biased to those stimuli matching the contents of working memory (WM). However, a complete functional account of the interplay between WM and attention remains to be established. In particular, the boundary conditions of the WM effect on selection are unclear. Here, the authors investigate the influence of the focus of spatial attention (i.e., diffused vs. focused) by assessing the effect of spatial precues on attentional capture by WM. Experiments 1 and 2 showed that relative to a neutral condition without memory-matching stimuli, the presence of a memory distractor can trigger attentional capture despite being entirely irrelevant for the attention task but this happened only when the item was actively maintained in WM and not when it was merely repeated. Experiments 3a, 3b and 3c showed that attentional capture by WM can be modulated by endogenous spatial pre-cueing of the incoming target of selection. The authors conclude that WM-driven capture of visual selection is dependent on the focus of spatial attention.

Effects of instantaneous object input and past experience on object-based attention

Evidence for object-based attention typically comes from studies using displays with unchanged objects, and no consensus has yet been reached as to whether the object effect would be altered by changing object displays or having seen this change across-trials. We examined this by using modifications of the double-rectangle cuing paradigm of Egly et al. [Egly, R., Driver, J., & Rafal, R. D. (1994). Shifting visual attention between objects and locations: Evidence from normal and parietal lesion subjects. Journal of Experimental Psychology: General, 123, 161-177], and our results, when the objects remained unchanging, replicated the original object effect. However, no object effect was found when the rectangles disappeared from view in the last (target) frame. This was true regardless of the likelihood of the rectangles disappearing, indicating the importance of instantaneous object inputs for object-based attention. The across-trial experience of seeing a different object (boomerang), however, was found to influence the object effect when the cued rectangles persisted throughout the trial. Unlike previous studies, which emphasize one or the other, we demonstrate clearly that instantaneous object inputs and past experience interact to determine the way attention selects objects.

Objects or Locations in Vision for Action? Evidence from the MILO task

In the multi-item localization task (MILO, Thornton & Horowitz, 2004), observers are asked to find an ordered sequence of targets. We can measure the influence of both past actions and future plans on search for the current target. Our previous work with static search arrays found evidence for both retrospective and prospective memory. Responding to a target eliminated its influence on subsequent responses, while observers consistently planned ahead at least one item into the future. Here we asked whether these effects were based in location- or object-based reference frames. We used dynamic arrays in which observers had to search for multiple moving targets. Our results suggest that observers can still plan ahead effectively in this dynamic environment, indicating that future target objects can be tracked as they change position. However, memory for previous targets is essentially eliminated, suggesting that locations, not objects, were being tagged in our previous work.

Inhibition of return and object-based attentional selection

Visual attention research has revealed that attentional allocation can occur in space- and/or object-based coordinates. Using the direct and elegant design of R. Egly, J. Driver, and R. Rafal (1994), the present experiments tested whether space- and object-based inhibition of return (IOR) emerge under similar time courses. The experiments were capable of isolating both space- and object-based effects induced by peripheral and back-to-center cues. The results generally support the contention that spatially nonpredictive cues are effective in producing space-based IOR at a variety of stimulus onset asynchronies (SOAs) and under a variety of stimulus conditions. Whether facilitatory or inhibitory in direction, the object-based effects occurred over a very different time course than did the space-based effects. Reliable object-based IOR was only found under limited conditions and was tied to the time since the most recent cue (peripheral or central). The finding that object-based effects are generally determined by SOA from the most recent cue may help to resolve discrepancies in the IOR literature. These findings also have implications for the search facilitator role that IOR is purported to play in the guidance of visual attention.

Shifting attention into and out of objects: Evaluating the processes underlying the object advantage

Visual cuing studies have been widely used to demonstrate and explore contributions from both object- and location-based attention systems. A common finding has been a response advantage for shifts of attention occurring within an object, relative to shifts of an equal distance between objects. The present study examined this advantage for within-object shifts in terms of engage and disengage operations within the object- and location-based attention systems. The rationale was that shifts of attention between objects require object-based attention to disengage from one object before shifting to another, something that is not required for shifts of attention within an object or away from a location. One- and two-object displays were used to assess object-based contributions related to disengaging and engaging attention within, between, into, and out of objects. The results suggest that the "object advantage" commonly found in visual cuing experiments in which shifts of attention are required is primarily due to disengage operations associated with object-based attention.

Object and spatial representations in the corner enhancement effect

Cole, Gellatly, and Blurton have shown that targets presented adjacent to geometric corners are detected more efficiently than targets presented adjacent to straight edges. In six experiments, we examined how this corner enhancement effect is modulated by corner-of-object representations (i.e., corners that define an object's shape) and local base-level corners that occur as a result of, for instance, overlapping the straight edges of two objects. The results show that the corner phenomenon is greater for corners of object representations than for corners that do not define an object's shape. We also examined whether the corner effect persists within the contour boundaries of an object, as well as on the outside. The results showed that a spatial gradient of attention accompanies the corner effect outside the contour boundaries of an object but that processing within an object is uniform, with no corner effect occurring. We discuss these findings in relation to space-based and object-based theories of attention.

Spatial attention facilitates selection of illusory objects: evidence from event-related brain potentials

The relationship between spatial attention and object-based attention has long been debated. On the basis of behavioral evidence it has been hypothesized that these two forms of attention share a common mechanism, such that directing spatial attention to one part of an object facilitates the selection of the entire object. In a previous study (Martinez, A., Teder-Salejarvi, W., Vazquez, M., Molholm, S., Foxe, J.J., Javitt, D.C., Di Russo, F., Worden, M.S., Hillyard, S.A., 2006. "Objects are highlighted by spatial attention." J. Cogn. Neurosci. 18(2): 298-310) we used recordings of event-related potentials (ERPs) during a paradigm modeled after that of Egly et al. (Egly, R., Driver, J., Rafal, D.R., 1994. Shifting visual attention between objects and locations: evidence from normal and parietal lesion subjects. J. Exp. Psychol. Gen. 123(2) 161-77) to investigate this relationship. As reported in numerous studies of spatial attention, we found the typical pattern of enhanced neural activity in visual cortex elicited by attended stimuli. Unattended stimuli belonging to the same object as the attended stimuli elicited a very similar spatiotemporal pattern of enhanced neural activity that was localized to lateral occipital cortex (LOC). This similarity was taken as evidence that spatial- and object-selective attention share, at least in part, a common neural mechanism. In the present study we further investigate this relationship by examining whether this spread of spatial attention within attended objects can be guided by objects defined by illusory contours. Subjects viewed a display consisting of two illusory rectangular objects and directed attention to continuous sequences of stimuli (brief onsets) at one end of one of the objects. Stimuli occurring at irrelevant locations but belonging to the same attended object elicited larger posterior N1 amplitudes than that elicited by unattended objects forming part of a different object. This object-selective N1 enhancement was localized to lateral occipital cortex. The present data support the hypothesis that the allocation of spatial attention can be guided by illusory object boundaries and that this allocation strengthens the perceptual representations of attended objects at the level of visual area LOC.

Objects do not aid inhibition of return in crossing the vertical meridian

Location-based cuing experiments have shown that inhibition of return (IOR) spreads beyond a cued location but appears to be confined to the cued hemifield by the vertical meridian. Previous studies have also shown that IOR can spread across objects and here we investigate whether an object can be used to mediate the spreading of IOR into the opposite hemifield. Two experiments used a rectangular object that surrounded four target locations, two to the left and right of a central fixation point. The spreading of IOR in the presence of the object was determined and compared with a condition where the object-frame was absent. Object-present and object-absent trials were either mixed within a block (Experiment 1) or divided into separate blocks (Experiment 2). Both experiments revealed robust inhibition in the cued but not the uncued hemifield, further demonstrating the hemifield-based spreading of IOR.

The role of closure in defining the "objects" of object-based attention

Many recent studies have concluded that the underlying units of visual attention are often discrete objects whose boundaries constrain the allocation of attention. However, relatively few studies have explored the particular stimulus cues that determine what counts as an "object" of attention. We explore this issue in the context of the two-rectangles stimuli previously used by many investigators. We first show, using both spatial-cuing and divided-attention paradigms, that same-object advantages occur even when the ends of the two rectangles are not drawn. This is consistent with previous reports that have emphasized the importance of individual contours in guiding attention, and our study shows that such effects can occur in displays that also contain grouping cues. In our divided-attention experiment, however, this contour-driven same-object advantage was significantly weaker than that obtained with the standard stimulus, with the added cue of closure--demonstrating that contour-based processes are not the whole story. These results confirm and extend the observation that same-object advantages can be observed even without full-fledged objects. At the same time, however, these studies show that boundary closure-one of the most important cues to objecthood per se-can directly influence attention. We conclude that object-based attention is not an all-or-nothing phenomenon; object-based effects can be independently strengthened or weakened by multiple cues to objecthood.