Exogenously cued attention triggers competitive selection of surfaces

The Architecture of Object-Based Attention

The allocation of attention to objects raises several intriguing questions: What are objects, how does attention access them, what anatomical regions are involved? Here, we review recent progress in the field to determine the mechanisms underlying object-based attention. First, findings from unconscious priming and cueing suggest that the preattentive targets of object-based attention can be fully developed object representations that have reached the level of identity. Next, the control of object-based attention appears to come from ventral visual areas specialized in object analysis that project downward to early visual areas. How feedback from object areas can accurately target the object's specific locations and features is unknown but recent work in autoencoding has made this plausible. Finally, we suggest that the three classic modes of attention may not be as independent as is commonly considered, and instead could all rely on object-based attention. Specifically, studies show that attention can be allocated to the separated members of a group-without affecting the space between them-matching the defining property of feature-based attention. At the same time, object-based attention directed to a single small item has the properties of space-based attention. We outline the architecture of object-based attention, the novel predictions it brings, and discuss how it works in parallel with other attention pathways.

Directional Limits on Motion Transparency Assessed Through Colour-Motion Binding

Motion-defined transparency is the perception of two or more distinct moving surfaces at the same retinal location. We explored the limits of motion transparency using superimposed surfaces of randomly positioned dots defined by differences in motion direction and colour. In one experiment, dots were red or green and we varied the proportion of dots of a single colour that moved in a single direction ('colour-motion coherence') and measured the threshold direction difference for discriminating between two directions. When colour-motion coherences were high (e.g., 90% of red dots moving in one direction), a smaller direction difference was required to correctly bind colour with direction than at low coherences. In another experiment, we varied the direction difference between the surfaces and measured the threshold colour-motion coherence required to discriminate between them. Generally, colour-motion coherence thresholds decreased with increasing direction differences, stabilising at direction differences around 45°. Different stimulus durations were compared, and thresholds were higher at the shortest (150 ms) compared with the longest (1,000 ms) duration. These results highlight different yet interrelated aspects of the task and the fundamental limits of the mechanisms involved: the resolution of narrowly separated directions in motion processing and the local sampling of dot colours from each surface.

Attentional selection of levels within hierarchically organized figures is mediated by object-files

Objects frequently have a hierarchical organization (tree-branch-leaf). How do we select the level to be attended? This has been explored with compound letters: a global letter built from local letters. One explanation, backed by much empirical support, is that attentional competition is biased toward certain spatial frequency (SF) bands across all locations and objects (a SF filter). This view assumes that the global and local letters are carried respectively by low and high SF bands, and that the bias can persist over time. Here we advocate a complementary view in which perception of hierarchical level is determined by how we represent letters in object-files. Although many properties bound to an object-file (i.e., position, color, even shape) can mutate without affecting its persistence over time, we posit that same object-file cannot be used to store information from different hierarchical levels. Thus, selection of level would be independent from locations but not from the way objects are represented at each moment. These views were contrasted via an attentional blink paradigm that presented letters within compound figures, but only one level at a time. Attending to two letters in rapid succession was easier if they were at the same-compared to different-levels, as predicted by both accounts. However, only the object-file account was able to explain why it was easier to report two targets on the same moving object compared to the same targets on distinct objects. The interference of different masks on target recognition was also easier to predict by the object-file account than by an SF filter. The methods introduced here allowed us to investigate attention to hierarchical levels and to object-files within the same empirical framework. The data suggests that SF information is used to structure the internal organization of object representations, a process understood best by integrating object-file theory with previous models of hierarchical perception.

Feature integration and object representations along the dorsal stream visual hierarchy

The visual system is split into two processing streams: a ventral stream that receives color and form information and a dorsal stream that receives motion information. Each stream processes that information hierarchically, with each stage building upon the previous. In the ventral stream this leads to the formation of object representations that ultimately allow for object recognition regardless of changes in the surrounding environment. In the dorsal stream, this hierarchical processing has classically been thought to lead to the computation of complex motion in three dimensions. However, there is evidence to suggest that there is integration of both dorsal and ventral stream information into motion computation processes, giving rise to intermediate object representations, which facilitate object selection and decision making mechanisms in the dorsal stream. First we review the hierarchical processing of motion along the dorsal stream and the building up of object representations along the ventral stream. Then we discuss recent work on the integration of ventral and dorsal stream features that lead to intermediate object representations in the dorsal stream. Finally we propose a framework describing how and at what stage different features are integrated into dorsal visual stream object representations. Determining the integration of features along the dorsal stream is necessary to understand not only how the dorsal stream builds up an object representation but also which computations are performed on object representations instead of local features.

Optimal attentional modulation of a neural population

Top-down attention has often been separately studied in the contexts of either optimal population coding or biasing of visual search. Yet, both are intimately linked, as they entail optimally modulating sensory variables in neural populations according to top-down goals. Designing experiments to probe top-down attentional modulation is difficult because non-linear population dynamics are hard to predict in the absence of a concise theoretical framework. Here, we describe a unified framework that encompasses both contexts. Our work sheds light onto the ongoing debate on whether attention modulates neural response gain, tuning width, and/or preferred feature. We evaluate the framework by conducting simulations for two tasks: (1) classification (discrimination) of two stimuli s a and s b and (2) searching for a target T among distractors D. Results demonstrate that all of gain, tuning, and preferred feature modulation happen to different extents, depending on stimulus conditions and task demands. The theoretical analysis shows that task difficulty (linked to difference Δ between s a and s b , or T, and D) is a crucial factor in optimal modulation, with different effects in discrimination vs. search. Further, our framework allows us to quantify the relative utility of neural parameters. In easy tasks (when Δ is large compared to the density of the neural population), modulating gains and preferred features is sufficient to yield nearly optimal performance; however, in difficult tasks (smaller Δ), modulating tuning width becomes necessary to improve performance. This suggests that the conflicting reports from different experimental studies may be due to differences in tasks and in their difficulties. We further propose future electrophysiology experiments to observe different types of attentional modulation in a same neuron.

Top-down influences on visual processing

Re-entrant or feedback pathways between cortical areas carry rich and varied information about behavioural context, including attention, expectation, perceptual tasks, working memory and motor commands. Neurons receiving such inputs effectively function as adaptive processors that are able to assume different functional states according to the task being executed. Recent data suggest that the selection of particular inputs, representing different components of an association field, enable neurons to take on different functional roles. In this Review, we discuss the various top-down influences exerted on the visual cortical pathways and highlight the dynamic nature of the receptive field, which allows neurons to carry information that is relevant to the current perceptual demands.

Contrast dependence of smooth pursuit eye movements following a saccade to superimposed targets

Dorsal stream areas provide motion information used by the oculomotor system to generate pursuit eye movements. Neurons in these areas saturate at low levels of luminance contrast. We therefore hypothesized that during the early phase of pursuit, eye velocity would exhibit an oculomotor gain function that saturates at low luminance contrast. To test this, we recorded eye movements in two macaques trained to saccade to an aperture in which a pattern of dots moved left or right. Shortly after the end of the saccade, the eyes followed the direction of motion with an oculomotor gain that increased with contrast before saturating. The addition of a second pattern of dots, moving in the opposite direction and superimposed on the first, resulted in a rightward shift of the contrast-dependent oculomotor gain function. The magnitude of this shift increased with the contrast of the second pattern of dots. Motion was nulled when the two patterns were equal in contrast. Next, we varied contrast over time. Contrast differences that disappeared before saccade onset biased post-saccadic eye movements at short latency. Changes in contrast occurring during or after saccade termination did not influence eye movements for approximately 150 ms. Earlier studies found that eye movements can be explained by a vector average computation when both targets are equal in contrast. We suggest that this averaging computation may reflect a special case of divisive normalization, yielding saturating contrast response functions that shift to the right with opposed motion, averaging motions when targets are equated in contrast.

Color improves speed of processing but not perception in a motion illusion

When two superimposed surfaces of dots move in different directions, the perceived directions are shifted away from each other. This perceptual illusion has been termed direction repulsion and is thought to be due to mutual inhibition between the representations of the two directions. It has further been shown that a speed difference between the two surfaces attenuates direction repulsion. As speed and direction are both necessary components of representing motion, the reduction in direction repulsion can be attributed to the additional motion information strengthening the representations of the two directions and thus reducing the mutual inhibition. We tested whether bottom-up attention and top-down task demands, in the form of color differences between the two surfaces, would also enhance motion processing, reducing direction repulsion. We found that the addition of color differences did not improve direction discrimination and reduce direction repulsion. However, we did find that adding a color difference improved performance on the task. We hypothesized that the performance differences were due to the limited presentation time of the stimuli. We tested this in a follow-up experiment where we varied the time of presentation to determine the duration needed to successfully perform the task with and without the color difference. As we expected, color segmentation reduced the amount of time needed to process and encode both directions of motion. Thus we find a dissociation between the effects of attention on the speed of processing and conscious perception of direction. We propose four potential mechanisms wherein color speeds figure-ground segmentation of an object, attentional switching between objects, direction discrimination and/or the accumulation of motion information for decision-making, without affecting conscious perception of the direction. Potential neural bases are also explored.

Neural dynamics of object-based multifocal visual spatial attention and priming: object cueing, useful-field-of-view, and crowding

How are spatial and object attention coordinated to achieve rapid object learning and recognition during eye movement search? How do prefrontal priming and parietal spatial mechanisms interact to determine the reaction time costs of intra-object attention shifts, inter-object attention shifts, and shifts between visible objects and covertly cued locations? What factors underlie individual differences in the timing and frequency of such attentional shifts? How do transient and sustained spatial attentional mechanisms work and interact? How can volition, mediated via the basal ganglia, influence the span of spatial attention? A neural model is developed of how spatial attention in the where cortical stream coordinates view-invariant object category learning in the what cortical stream under free viewing conditions. The model simulates psychological data about the dynamics of covert attention priming and switching requiring multifocal attention without eye movements. The model predicts how "attentional shrouds" are formed when surface representations in cortical area V4 resonate with spatial attention in posterior parietal cortex (PPC) and prefrontal cortex (PFC), while shrouds compete among themselves for dominance. Winning shrouds support invariant object category learning, and active surface-shroud resonances support conscious surface perception and recognition. Attentive competition between multiple objects and cues simulates reaction-time data from the two-object cueing paradigm. The relative strength of sustained surface-driven and fast-transient motion-driven spatial attention controls individual differences in reaction time for invalid cues. Competition between surface-driven attentional shrouds controls individual differences in detection rate of peripheral targets in useful-field-of-view tasks. The model proposes how the strength of competition can be mediated, though learning or momentary changes in volition, by the basal ganglia. A new explanation of crowding shows how the cortical magnification factor, among other variables, can cause multiple object surfaces to share a single surface-shroud resonance, thereby preventing recognition of the individual objects.

Effect of feature-selective attention on neuronal responses in macaque area MT

Attention influences visual processing in striate and extrastriate cortex, which has been extensively studied for spatial-, object-, and feature-based attention. Most studies exploring neural signatures of feature-based attention have trained animals to attend to an object identified by a certain feature and ignore objects/displays identified by a different feature. Little is known about the effects of feature-selective attention, where subjects attend to one stimulus feature domain (e.g., color) of an object while features from different domains (e.g., direction of motion) of the same object are ignored. To study this type of feature-selective attention in area MT in the middle temporal sulcus, we trained macaque monkeys to either attend to and report the direction of motion of a moving sine wave grating (a feature for which MT neurons display strong selectivity) or attend to and report its color (a feature for which MT neurons have very limited selectivity). We hypothesized that neurons would upregulate their firing rate during attend-direction conditions compared with attend-color conditions. We found that feature-selective attention significantly affected 22% of MT neurons. Contrary to our hypothesis, these neurons did not necessarily increase firing rate when animals attended to direction of motion but fell into one of two classes. In one class, attention to color increased the gain of stimulus-induced responses compared with attend-direction conditions. The other class displayed the opposite effects. Feature-selective activity modulations occurred earlier in neurons modulated by attention to color compared with neurons modulated by attention to motion direction. Thus feature-selective attention influences neuronal processing in macaque area MT but often exhibited a mismatch between the preferred stimulus dimension (direction of motion) and the preferred attention dimension (attention to color).

Subcortical mechanisms of feature-based attention

The degree to which spatial and feature-based attention are governed by similar control mechanisms is not clear. To explore this issue, I measured, during conditions of spatial or feature-based attention, activity in the human subcortical visual nuclei, which have precise retinotopic maps and are known to play important roles in the regulation of spatial attention but have limited selectivity of nonspatial features. Subjects attended to and detected changes in separate fields of moving or colored dots. When the fields were disjoint, spatially attending to one field enhanced hemodynamic responses in the superior colliculus (SC), lateral geniculate nucleus (LGN), and two retinotopic pulvinar nuclei. When the two dot fields were spatially overlapping, feature-based attention to the moving versus colored dots enhanced responses in the pulvinar nuclei and the majority of the LGN, including the magnocellular layers, and suppressed activity in some areas within the parvocellular layers; the SC was inconsistently modulated among subjects. The results demonstrate that feature-based attention operates throughout the visual system by prioritizing neurons encoding the attended information, including broadly tuned thalamic neurons. I conclude that spatial and feature-based attention operate via a common principle, but that spatial location is a special feature in that it is widely encoded in the brain, is used for overt orienting, and uses a specialized structure, the SC.

Object-based attention to one of two superimposed surfaces alters responses in human early visual cortex

Faced with an overwhelming amount of sensory information, we are able to prioritize the processing of select spatial locations and visual features. The neuronal mechanisms underlying such spatial and feature-based selection have been studied in considerable detail. More recent work shows that attention can also be allocated to objects, even spatially superimposed objects composed of dynamically changing features that must be integrated to create a coherent object representation. Much less is known about the mechanisms underlying such object-based selection. Our goal was to investigate behavioral and neuronal responses when attention was directed to one of two objects, specifically one of two superimposed transparent surfaces, in a task designed to preclude space-based and feature-based selection. We used functional magnetic resonance imaging (fMRI) to measure changes in blood oxygen level-dependent (BOLD) signals when attention was deployed to one or the other surface. We found that visual areas V1, V2, V3, V3A, and MT+ showed enhanced BOLD responses to translations of an attended relative to an unattended surface. These results reveal that visual areas as early as V1 can be modulated by attending to objects, even objects defined by dynamically changing elements. This provides definitive evidence in humans that early visual areas are involved in a seemingly high-order process. Furthermore, our results suggest that these early visual areas may participate in object-specific feature "binding," a process that seemingly must occur for an object or a surface to be the unit of attentional selection.

Neural basis of visual selective attention

Attentional modulation along the object-recognition pathway of the cortical visual system of primates has been shown to consist of enhanced representation of the retinal input at a specific location in space, or of objects located anywhere in the visual field which possess a critical object feature. Moreover, selective attention mechanisms allow the visual system to resolve competition among multiple objects in a crowded scene in favor of the object that is relevant for the current behavior. Finally, selective attention affects the spontaneous activity of neurons as well as their visually driven responses, and it does so not only by modulating the spiking activity of individual neurons, but also by modulating the degree of coherent firing within the critical neuronal populations. WIREs Cogni Sci 2011 2 392-407 DOI: 10.1002/wcs.117 For further resources related to this article, please visit the WIREs website.

Exploring the mechanisms underlying surface-based stimulus selection

Valdes-Sosa, et al. (2000) introduced a transparent-motion design that provides evidence of surface-based processing of visual motion. We show that this design suffers from a motion-duration confound that admits an alternative explanation based on neuronal adaptation and competition. We tested this explanation by reversing the relationship between motion duration and which perceptual surface was "cued". We also examined the role of color duration. Our findings support the surface-based account and, more specifically, demonstrate that this type of surface-based selection involves selective spatial processing at the scale of the texture elements that define the transparent surfaces.

Combining spatial and feature-based attention within the receptive field of MT neurons

This study investigates the effects of feature-based attention on responses of direction-selective neurons in the middle temporal area (MT) of macaque visual cortex to attended stimuli inside the receptive field. Redirecting attention between the preferred and null direction of transparent random dot motion patterns caused a mean modulation of responses of approximately 32%, about half of what was observed when the two directions of motion in the receptive field were spatially separated allowing feature-based and spatial attention to work in concert. This is consistent with models of visual attention that interpret the attentional modulation of a neuron as the combination of all attentional influences, treating stimulus location simply as another feature.

Interacting competitive selection in attention and binocular rivalry

Visuomotor processing is selective - only a small subset of stimuli that impinge on the retinae reach perceptual awareness and/or elicit behavioral responses. Both binocular rivalry and attention involve visual selection, but affect perception quite differently. During rivalry, awareness alternates between different stimuli presented to the two eyes. In contrast, attending to one of the two stimuli impairs discrimination of the ignored stimulus, but without causing it to perceptually disappear. We review experiments demonstrating that, despite their phenomenological differences, attention and rivalry depend upon shared competitive selection mechanisms. These experiments, moreover, reveal stimulus selection that is surface-based and requires coordination between the different neuronal populations that respond as a surface changes its attributes (type of motion) over time. This surface-based selection, in turn biases interocular competition, favoring the eye whose image is consistent with the selected surface. The review ends with speculation about the role of the thalamus in mediating this dynamic coordination, as well as thoughts about what underlies the differences in the phenomenology of selective attention and rivalry.

Modeling attention to salient proto-objects

Selective visual attention is believed to be responsible for serializing visual information for recognizing one object at a time in a complex scene. But how can we attend to objects before they are recognized? In coherence theory of visual cognition, so-called proto-objects form volatile units of visual information that can be accessed by selective attention and subsequently validated as actual objects. We propose a biologically plausible model of forming and attending to proto-objects in natural scenes. We demonstrate that the suggested model can enable a model of object recognition in cortex to expand from recognizing individual objects in isolation to sequentially recognizing all objects in a more complex scene.

Stimulus-specific competitive selection in macaque extrastriate visual area V4

Macaque visual area V4 has been implicated in the selective processing of stimuli. Prior studies of selection in area V4 have used spatially separate stimuli, thus confounding selection of retinotopic location with selection of the stimulus at that location. We asked whether V4 neurons can selectively respond to one of two differently colored stimuli even when they are spatially superimposed. We find that delaying one of the two stimuli leads to selective processing of the delayed stimulus by area V4 neurons. This selective processing persists when the stimuli move together across the visual field, thereby successively activating different populations of neurons. We also find that this effect is not a spatially global form of feature-based selection. We conclude that selective processing in area V4 is neither exclusively spatial nor feature-based and may thus be surface- or object-based.

Attention in hierarchical models of object recognition

Object recognition and visual attention are tightly linked processes in human perception. Over the last three decades, many models have been suggested to explain these two processes and their interactions, and in some cases these models appear to contradict each other. We suggest a unifying framework for object recognition and attention and review the existing modeling literature in this context. Furthermore, we demonstrate a proof-of-concept implementation for sharing complex features between recognition and attention as a mode of top-down attention to particular objects or object categories.

Spatial and feature-based effects of exogenous cueing on visual motion processing

In two experiments, we investigated the effects of exogenous cueing on visual motion processing. The first experiment shows that the typical pattern of reaction time (RT) effects, namely early facilitation and later inhibition of return (IOR), can be obtained using a color change as exogenous cue and a direction change as target. In the second experiment, we manipulated the validity of the cue independently with respect to location and feature using transparent motion stimuli. Facilitation of RTs with short cue-target interstimulus-intervals (ISIs) was only evident for targets with both the valid location and the valid feature. Furthermore, at longer cue-target intervals, RTs were prolonged for targets at the cued location, irrespective of the cued feature. These results demonstrate spatial and feature-based components of early facilitation and purely spatial IOR.

Subthreshold features of visual objects: Unseen but not unbound

The object is a basic unit that is thought to organize the way in which we perceive and think about the world. According to theories of object-based attention, perception of unified objects depends on the binding together of the disparate features of each object via attention. Here we show that a visual feature that is not consciously perceived is nonetheless modulated by object-based attention: the influence of a subthreshold motion signal (prime) on subsequent motion perception depended critically on whether it was associated with the attended object or another, spatially overlapping object. These results show that invisibly weak features of attended objects are not lost, but are organized by and selected together with the object by attention.

Exogenous attentional selection of transparent superimposed surfaces modulates early event-related potentials

Using a transparent motion paradigm, [Valdes-Sosa, M., Bobes, M. A., Rodriguez, V., & Pinilla, T. (1998). Switching attention without shifting the spotlight object-based attentional modulation of brain potentials, Journal of Cognitive Neuroscience, 10, 137-151; Valdes-Sosa, M., Cobo, A., & Pinilla, T. (2000). Attention to object files defined by transparent motion, Journal of Experimental Psychological: Human Perception and Performance, 26, 488-505] found that when attention is endogenously directed to one surface, observers can more reliably report the direction of a brief translation of the cued than the uncued surface. Using a similar design [Reynolds, J. H., Alborzian, S., & Stoner, G. R. (2003). Exogenously cued attention triggers competitive selection of surfaces, Vision Research, 43, 59-66] found that even in the absence of an endogenous cue, the first translation acted as a potent exogenous cue that impaired the observer's ability to discriminate a subsequent translation of the other surface. We investigated the neural basis of this exogenous cueing effect by recording visual event-related potentials (ERPs) elicited by translations of the cued and uncued surfaces. Subjects were given the task of judging whether or not the first and second translations were identical in direction, and their performance was impaired when the second translation occurred on the uncued, as compared to the cued surface. The posterior C1 (75-110 ms) and N1 (160-210 ms) components of the ERP elicited by the second translation of the cued surface were larger than those elicited by translation of the uncued surface. These behavioral and ERP cueing effects were present even when the two surfaces were identical in color and thus could not be attributed to attention-related modulations of the gain of color channels. These findings provide evidence that exogenous cueing results in preferential selection of the cued surface at both early and intermediate stages of visual-cortical processing.

Learning to suppress task-irrelevant visual stimuli with attention

While the importance of attention in perceptual learning is widely recognized, the mechanisms through which it affects learning are poorly understood. Here we show that attentional mechanisms themselves are modified during learning. Attentional suppression of task-irrelevant stimuli becomes more efficient with practice. Attentional learning was found to be stimulus-specific and to persist for several weeks, suggesting that the plasticity of attentional mechanisms is an inherent component of visual perceptual learning.

Two-object attentional interference depends on attentional set

In this study, we explored the influence of an irrelevant translational event on the automatic capture of attention to one of two superimposed surfaces defined by transparent motion. The results showed that an irrelevant translation on one surface did not automatically capture the subjects' attention if the attentional resources have been endogenously allocated on the other surface. Moreover, the reduction in the motion-onset component of the event-related potential observed in trials where the irrelevant event affected the uncued surface supports the existence of a top-down control of early sensorial processing in this paradigm. This study provides further evidence of the interaction of stimulus-driven and goal-directed mechanisms in the control of visual attention.

A model of active visual search with object-based attention guiding scan paths

When a monkey searches for a colour and orientation feature conjunction target, the scan path is guided to target coloured locations in preference to locations containing the target orientation [Vision Res. 38 (1998b) 1805]. An active vision model, using biased competition, is able to replicate this behaviour. As object-based attention develops in extrastriate cortex, featural information is passed to posterior parietal cortex (LIP), enabling it to represent behaviourally relevant locations [J. Neurophysiol. 76 (1996) 2841] and guide the scan path. Attention evolves from an early spatial effect to being object-based later in the response of the model neurons, as has been observed in monkey single cell recordings. This is the first model to reproduce these effects with temporal precision and is reported here at the systems level allowing the replication of psychophysical scan paths.

Attentional modulation of visual processing

Single-unit recording studies in the macaque have carefully documented the modulatory effects of attention on the response properties of visual cortical neurons. Attention produces qualitatively different effects on firing rate, depending on whether a stimulus appears alone or accompanied by distracters. Studies of contrast gain control in anesthetized mammals have found parallel patterns of results when the luminance contrast of a stimulus increases. This finding suggests that attention has co-opted the circuits that mediate contrast gain control and that it operates by increasing the effective contrast of the attended stimulus. Consistent with this idea, microstimulation of the frontal eye fields, one of several areas that control the allocation of spatial attention, induces spatially local increases in sensitivity both at the behavioral level and among neurons in area V4, where endogenously generated attention increases contrast sensitivity. Studies in the slice have begun to explain how modulatory signals might cause such increases in sensitivity.

Object-based cross-feature attentional modulation from color to motion

Object-based theories of visual attention predict that attempting to direct attention to a particular attribute of a visual object will result in an automatic selection of the whole object, including all of its features. It has been assumed, but not critically tested, that the spreading of attention from one feature to another in this manner, i.e. cross-feature attentional (CFA) effects, takes place at object-level stages of processing as opposed to early, local stages. In the present study we disambiguated these options for color-to-motion CFA by contrasting attention's effect on bivectorial transparent versus bivectorial locally paired motion displays. We found that association between features at the global, but not at the local, stage of motion processing leads to cross-feature attentional effects. These findings provide strong psychophysical evidence that such effects are indeed object-based.

Object-based attention determines dominance in binocular rivalry

A question of long-standing interest to philosophers, psychologists and neuroscientists is how the brain selects which signals enter consciousness. Binocular rivalry and attention both involve selection of visual stimuli, but affect perception quite differently. During binocular rivalry, awareness alternates between two different stimuli presented to the two eyes. In contrast, attending to one of two different stimuli impairs discrimination of the ignored stimulus, but without causing it to disappear from consciousness. Here we show that despite this difference, attention and rivalry rely on shared object-based selection mechanisms. We cued attention to one of two superimposed transparent surfaces and then deleted the image of one surface from each eye, resulting in rivalry. Observers usually reported seeing only the cued surface. They were also less accurate in judging unpredictable changes in the features of the uncued surface. Our design ensured that selection of the cued surface could not have resulted from spatial, ocular or feature-based mechanisms. Rather, attention was drawn to one surface, and this caused the other surface to be perceptually suppressed during rivalry. These results raise the question of how object representations compete during these two forms of perceptual selection, even as the features of those objects change unpredictably over time.

Dynamics of feature binding during object-selective attention

Objects in the environment may be attended selectively and perceived as unified ensembles of their constituent features. To investigate the timing and cortical localization of feature-integration mechanisms in object-based attention, recordings of event-related potentials and magnetic fields were combined with functional MRI while subjects attended to one of two superimposed transparent surfaces formed by arrays of dots moving in opposite directions. A spatiotemporal analysis revealed evidence for a rapid increase in neural activity localized to a color-selective region of the fusiform gyrus when the surface moving in the attended direction displayed an irrelevant color feature. These data provide support for the "integrated-competition" model of object-selective attention and point to a dynamic neural substrate for the rapid binding process that links relevant and irrelevant features to form a unified perceptual object.

Visual attention: the where, what, how and why of saliency

Attention influences the processing of visual information even in the earliest areas of primate visual cortex. There is converging evidence that the interaction of bottom-up sensory information and top-down attentional influences creates an integrated saliency map, that is, a topographic representation of relative stimulus strength and behavioral relevance across visual space. This map appears to be distributed across areas of the visual cortex, and is closely linked to the oculomotor system that controls eye movements and orients the gaze to locations in the visual scene characterized by a high salience.

Attentional selection of superimposed surfaces cannot be explained by modulation of the gain of color channels

When two differently colored, superimposed patterns of dots rotate in opposite directions, this yields the percept of two superimposed transparent surfaces. If observers are cued to attend to one set of dots, they are impaired in making judgments about the other set. Since the two sets of dots are overlapping, the cueing effect cannot be explained by spatial attention. This has led to the interpretation that the impairment reflects surface-based attentional selection. However, recent single-unit recording studies in monkeys have found that attention can modulate the gain of neurons tuned for features such as color. Thus, rather than reflecting the selection of a surface, the behavioral effects might simply reflect a reduction in the gain of color channels selective for the color of the uncued set of dots (feature-based attention), as if viewing the surfaces through a colored filter. If so, then the impairment should be eliminated when the two surfaces are made the same color. Instead, we find that the impairment persists with no reduction in strength. Our findings thus rule out the color gain explanation.