Competition in visual cortex impedes attention to multiple items

Rethinking simultaneous suppression in visual cortex via compressive spatiotemporal population receptive fields

When multiple visual stimuli are presented simultaneously in the receptive field, the neural response is suppressed compared to presenting the same stimuli sequentially. The prevailing hypothesis suggests that this suppression is due to competition among multiple stimuli for limited resources within receptive fields, governed by task demands. However, it is unknown how stimulus-driven computations may give rise to simultaneous suppression. Using fMRI, we find simultaneous suppression in single voxels, which varies with both stimulus size and timing, and progressively increases up the visual hierarchy. Using population receptive field (pRF) models, we find that compressive spatiotemporal summation rather than compressive spatial summation predicts simultaneous suppression, and that increased simultaneous suppression is linked to larger pRF sizes and stronger compressive nonlinearities. These results necessitate a rethinking of simultaneous suppression as the outcome of stimulus-driven compressive spatiotemporal computations within pRFs, and open new opportunities to study visual processing capacity across space and time.

The object-based shift direction anisotropy is modulated by the horizontal visual field meridian

Reallocating object-based attention across the visual field meridians is significantly faster horizontally than vertically (termed the shift direction anisotropy; SDA), implicating the meridians in reorienting object-based attention. Here, we tested the modulatory role of the meridians in the emergence of the SDA by manipulating meridian local feature contrast. Considering the notion of separate pools of attentional resources in each cortical hemisphere, we hypothesised that manipulating the horizontal meridian would selectively modulate the SDA. In four experiments, participants were presented with an "L"-shaped object and detected a target that appeared at either a cued location or at one of two equidistant non-cued locations at the far end of the horizontal or vertical object arm. Meridian local feature contrast was manipulated with perceptually strong enhancements (visible lines and colour contrast borders) and perceptually weak enhancements (illusory borders from line texture patterns and inducers). Weak enhancements of the meridians did not significantly modulate SDA magnitude; however, during perceptually strong enhancements of the horizontal meridian, the SDA was significantly reduced compared with both vertical meridian enhancement and no-enhancement conditions. Moreover, horizontal and vertical shift RTs were statistically equivalent when the horizontal meridian was enhanced with a visible line, our strongest manipulation, indicating the SDA was eliminated. These results suggest that the SDA emerges due to reallocating object-based attention across the horizontal meridian. We interpret this finding as evidence in support of the theory by which anatomical segregations of the visual system determine how pools of attentional resources resolve competition between and within cortical hemispheres.

Dynamic causal interactions between occipital and parietal cortex explain how endogenous spatial attention and stimulus-driven salience jointly shape the distribution of processing priorities in 2D visual space

Visuo-spatial attention prioritizes the processing of relevant inputs via different types of signals, including current goals and stimulus salience. Complex mixtures of these signals engage in everyday life situations, but little is known about how these signals jointly modulate distributed patterns of activity across the occipital regions that represent visual space. Here, we measured spatio-topic, quadrant-specific occipital activity during the processing of visual displays containing both task-relevant targets and salient color-singletons. We computed spatial bias vectors indexing the effect of attention in 2D space, as coded by distributed activity in the occipital cortex. We found that goal-directed spatial attention biased activity towards the target and that salience further modulated this endogenous effect: salient distractors decreased the spatial bias, while salient targets increased it. Analyses of effective connectivity revealed that the processing of salient distractors relied on the modulation of the bidirectional connectivity between the occipital and the posterior parietal cortex, as well as the modulation of the lateral interactions within the occipital cortex. These findings demonstrate that goal-directed attention and salience jointly contribute to shaping processing priorities in the occipital cortex and highlight that multiple functional paths determine how spatial information about these signals is distributed across occipital regions.

Dynamics of alpha suppression and enhancement may be related to resource competition in cross-modal cortical regions

In the face of multiple sensory streams, there may be competition for processing resources in multimodal cortical area devoted to establishing representations. In such cases, alpha oscillations may serve to maintain the relevant representations and protect them from interference, whereas theta band activity may facilitate their updating when needed. It can be hypothesized that these oscillations would differ in response to an auditory stimulus when the eyes are open or closed, as intermodal resource competition may be more prominent in the former than in the latter case. Across two studies we investigated the role of alpha and theta power in multimodal competition using an auditory task with the eyes open and closed, respectively enabling and disabling visual processing in parallel with the incoming auditory stream. In a passive listening task (Study 1a), we found alpha suppression following a pip tone with both eyes open and closed, but subsequent alpha enhancement only with closed eyes. We replicated this eyes-closed alpha enhancement in an independent sample (Study 1b). In an active auditory oddball task (Study 2), we again observed the eyes open/eyes closed alpha pattern found in Study 1 and also demonstrated that the more attentionally demanding oddball trials elicit the largest oscillatory effects. Theta power did not interact with eye status in either study. We propose a hypothesis to account for the findings in which alpha may be endemic to multimodal cortical areas in addition to visual ones.

Top-down control of attention under varying task loads

The performance of a goal-directed task is often interrupted by task-irrelevant distractors. This distractor interference has well been demonstrated in a large body of studies employing the Eriksen flanker paradigm. A notable finding regarding this issue is that distractor interference is attenuated by increased perceptual load or the presence of non-target stimuli diluting distractors. Besides increased perceptual load or the presence of diluters, we hypothesized that either suppression of distractor or enhancement of target via top-down attentional control would also contribute to modulating distractor interference. To test this, we had participants identify a target stimulus while ignoring a distractor under three different conditions; under low load, only the target and distractor was presented, while under high load, the target was surrounded by non-target letters. In the dilution condition, the target was accompanied by non-targets, whose colors were distinct from the target. Importantly, following the task stimuli, a probe stimulus was presented either in the target location, non-target location, or distractor location. As results, under low load, attention was captured by the target stimulus in a bottom-up manner at the early stage of processing. By contrast, in the high load and dilution conditions, attention was focused on the target in a top-down manner. Taken together, we suggest that increasing perceptual load or presenting diluters incentivizes the establishment of top-down bias toward the target stimulus, which plays a role in attenuating distractor interference.

Hemifield-specific control of spatial attention and working memory: Evidence from hemifield crossover costs

Attentional tracking and working memory tasks are often performed better when targets are divided evenly between the left and right visual hemifields, rather than contained within a single hemifield (Alvarez & Cavanagh, 2005; Delvenne, 2005). However, this bilateral field advantage does not provide conclusive evidence of hemifield-specific control of attention and working memory, because it can be explained solely from hemifield-limited spatial interference at early stages of visual processing. If control of attention and working memory is specific to each hemifield, maintaining target information should become more difficult as targets move between the two hemifields. Observers in the present study maintained targets that moved either within or between the left and right hemifields, using either attention (Experiment 1) or working memory (Experiment 2). Maintaining spatial information was more difficult when target items moved between the hemifields compared with when target items moved within their original hemifields, consistent with hemifield-specific control of spatial attention and working memory. However, this pattern was not found for maintaining identity information (e.g., color) in working memory (Experiment 3). Together, these results provide evidence that control of spatial attention and working memory is specific to each hemifield, and that hemifield-specific control is a unique signature of spatial processing.

Limitations of concurrently representing objects within view and in visual working memory

Representing visibly present stimuli is as limited in capacity as representing invisible stimuli in visual working memory (WM). In this study, we explored whether concurrently representing stimuli within view affects representing objects in visual WM, and if so, whether this effect is modulated by the storage states (active and silent state) of memory contents? In experiment 1, participants were asked to perform the change-detect task in a simultaneous-representing condition in which WM content and the continuously-visible stimuli in view were simultaneously represented, as well as a baseline condition in which only the representations of visual WM content were maintained. The results showed that the representations in visual WM would be impaired when the continuously-visible stimuli in view were concurrently represented, revealed by the reduced CDA amplitude and the lower behavior performance. In experiment 2, a dual-serial retro-cue paradigm was adopted to guide participants to maintain memory items in two different storage states, and the results revealed that simultaneously representing the continuously-visible stimuli and the WM content would only impair the WM representations in the active state. These evidences demonstrated that only the visual WM representations that were maintained in the active state would definitely share the limited resources with the representations of continuously-visible information, and further supported the dissociation between the active state and silent state of visual WM storage.

Spatially Specific Attention Mechanisms Are Sensitive to Competition during Visual Search

Extensive studies have focused on selection mechanisms during visual search. One important influence on these mechanisms is the perceptual characteristics of the stimuli. We investigated the impact of perceptual similarity between targets and nontargets (T-N similarity) in a visual search task using EEG. Participants searched for a predefined target letter among five nontargets. The T-N similarity was manipulated with three levels: high, middle, and low. We tested for the influences of T-N similarity on an ERP (e.g., N2pc) and alpha oscillations. We observed a significant N2pc effect across all levels of similarity. The N2pc amplitude was reduced and occurred later for high similarity relative to low and middle similarities. We also showed that the N2pc amplitude was inversely correlated with the RTs across all similarities. Importantly, we found a significant alpha phase adjustment about the same time as the N2pc for high similarity; by contrast, no such effect was observed for middle and low similarities. Finally, we showed a positive correlation between the phase-locking value and the N2pc—the stronger the alpha phase-locking value, the larger the N2pc, when the T-N similarity was high. In conclusion, our results provide novel evidence for multiple competitive mechanisms during visual search.

Critical resolution: A superior measure of crowding

Visual object recognition is essential for adaptive interactions with the environment. It is fundamentally limited by crowding, a breakdown of object recognition in clutter. The spatial extent over which crowding occurs is proportional to the eccentricity of the target object, but nevertheless varies substantially depending on various stimulus factors (e.g. viewing time, contrast). However, a lack of studies jointly manipulating such factors precludes predictions of crowding in more heterogeneous scenes, such as the majority of real life situations.

To establish how such co-occurring variations affect crowding, we manipulated combinations of 1) flanker contrast and backward masking, 2) flanker contrast and presentation duration, and 3) flanker preview and pop-out while measuring participants’ ability to correctly report the orientation of a target stimulus. In all three experiments, combining two manipulations consistently modulated the spatial extent of crowding in a way that could not be predicted from an additive combination. However, a simple transformation of the measurement scale completely abolished these interactions and all effects became additive. Precise quantitative predictions of the magnitude of crowding when combining multiple manipulations are thus possible when it is expressed in terms of what we label the ‘critical resolution’. Critical resolution is proportional to the inverse of the smallest flanker free area surrounding the target object necessary for its unimpaired identification. It offers a more parsimonious description of crowding than the traditionally used critical spacing and may thus constitute a measure of fundamental importance for understanding object recognition.

Age-Related Changes in Perirhinal Cortex Sensitivity to Configuration and Part Familiarity and Connectivity to Visual Cortex

The perirhinal cortex (PRC) is a medial temporal lobe (MTL) structure known to be involved in assessing whether an object is familiar (i.e., meaningful) or novel. Recent evidence shows that the PRC is sensitive to the familiarity of both whole object configurations and their parts, and suggests the PRC may modulate part familiarity responses in V2. Here, using functional magnetic resonance imaging (fMRI), we investigated age-related decline in the PRC's sensitivity to part/configuration familiarity and assessed its functional connectivity to visual cortex in young and older adults. Participants categorized peripherally presented silhouettes as familiar ("real-world") or novel. Part/configuration familiarity was manipulated via three silhouette configurations: Familiar (parts/configurations familiar), Control Novel (parts/configurations novel), and Part-Rearranged Novel (parts familiar, configurations novel). "Real-world" judgments were less accurate than "novel" judgments, although accuracy did not differ between age groups. The fMRI data revealed differential neural activity, however: In young adults, a linear pattern of activation was observed in left hemisphere (LH) PRC, with Familiar > Control Novel > Part-Rearranged Novel. Older adults did not show this pattern, indicating age-related decline in the PRC's sensitivity to part/configuration familiarity. A functional connectivity analysis revealed a significant coupling between the PRC and V2 in the LH in young adults only. Older adults showed a linear pattern of activation in the temporopolar cortex (TPC), but no evidence of TPC-V2 connectivity. This is the first study to demonstrate age-related decline in the PRC's representations of part/configuration familiarity and its covariance with visual cortex.

Evidence for unlimited capacity processing of simple features in visual cortex

Performance in many visual tasks is impaired when observers attempt to divide spatial attention across multiple visual field locations. Correspondingly, neuronal response magnitudes in visual cortex are often reduced during divided compared with focused spatial attention. This suggests that early visual cortex is the site of capacity limits, where finite processing resources must be divided among attended stimuli. However, behavioral research demonstrates that not all visual tasks suffer such capacity limits: The costs of divided attention are minimal when the task and stimulus are simple, such as when searching for a target defined by orientation or contrast. To date, however, every neuroimaging study of divided attention has used more complex tasks and found large reductions in response magnitude. We bridged that gap by using functional magnetic resonance imaging to measure responses in the human visual cortex during simple feature detection. The first experiment used a visual search task: Observers detected a low-contrast Gabor patch within one or four potentially relevant locations. The second experiment used a dual-task design, in which observers made independent judgments of Gabor presence in patches of dynamic noise at two locations. In both experiments, blood-oxygen level-dependent (BOLD) signals in the retinotopic cortex were significantly lower for ignored than attended stimuli. However, when observers divided attention between multiple stimuli, BOLD signals were not reliably reduced and behavioral performance was unimpaired. These results suggest that processing of simple features in early visual cortex has unlimited capacity.

The Appeal of the Brain in the Popular Press

Since the advent of human neuroimaging, and of functional magnetic resonance imaging (fMRI) in particular, the popular press has shown an increasing interest in brain-related findings. In this article, I explore possible reasons behind this interest, including recent data suggesting that people find brain images and neuroscience language more convincing than results that make no reference to the brain (McCabe & Castel, 2008; Weisberg, Keil, Goodstein, Rawson, & Gray, 2008). I suggest that part of the allure of these data are the deceptively simply messages they afford, as well as general, but sometimes misguided, confidence in biological data. In addition to cataloging some misunderstandings by the press and public, I highlight the responsibilities of the research scientist in carefully conveying their work to the general public.

Neural evidence for competition-mediated suppression in the perception of a single object

Multiple objects compete for representation in visual cortex. Competition may also underlie the perception of a single object. Computational models implement object perception as competition between units on opposite sides of a border. The border is assigned to the winning side, which is perceived as an object (or "figure"), whereas the other side is perceived as a shapeless ground. Behavioral experiments suggest that the ground is inhibited to a degree that depends on the extent to which it competed for object status, and that this inhibition is relayed to low-level brain areas. Here, we used fMRI to assess activation for ground regions of task-irrelevant novel silhouettes presented in the left or right visual field (LVF or RVF) while participants performed a difficult task at fixation. Silhouettes were designed so that the insides would win the competition for object status. The outsides (grounds) suggested portions of familiar objects in half of the silhouettes and novel objects in the other half. Because matches to object memories affect the competition, these two types of silhouettes operationalized, respectively, high competition and low competition from the grounds. The results showed that activation corresponding to ground regions was reduced for high- versus low-competition silhouettes in V4, where receptive fields (RFs) are large enough to encompass the familiar objects in the grounds, and in V1/V2, where RFs are much smaller. These results support a theory of object perception involving competition-mediated ground suppression and feedback from higher to lower levels. This pattern of results was observed in the left hemisphere (RVF), but not in the right hemisphere (LVF). One explanation of the lateralized findings is that task-irrelevant silhouettes in the RVF captured attention, allowing us to observe these effects, whereas those in the LVF did not. Experiment 2 provided preliminary behavioral evidence consistent with this possibility.

Visual processing of multiple elements in the dyslexic brain: evidence for a superior parietal dysfunction

The visual attention (VA) span deficit hypothesis of developmental dyslexia posits that impaired multiple element processing can be responsible for poor reading outcomes. In VA span impaired dyslexic children, poor performance on letter report tasks is associated with reduced parietal activations for multiple letter processing. While this hints towards a non-specific, attention-based dysfunction, it is still unclear whether reduced parietal activity generalizes to other types of stimuli. Furthermore, putative links between reduced parietal activity and reduced ventral occipito-temporal (vOT) in dyslexia have yet to be explored. Using functional magnetic resonance imaging, we measured brain activity in 12 VA span impaired dyslexic adults and 12 adult skilled readers while they carried out a categorization task on single or multiple alphanumeric or non-alphanumeric characters. While healthy readers activated parietal areas more strongly for multiple than single element processing (right-sided for alphanumeric and bilateral for non-alphanumeric), similar stronger multiple element right parietal activations were absent for dyslexic participants. Contrasts between skilled and dyslexic readers revealed significantly reduced right superior parietal lobule (SPL) activity for dyslexic readers regardless of stimuli type. Using a priori anatomically defined regions of interest, we showed that neural activity was reduced for dyslexic participants in both SPL and vOT bilaterally. Finally, we used multiple regressions to test whether SPL activity was related to vOT activity in each group. In the left hemisphere, SPL activity covaried with vOT activity for both normal and dyslexic readers. In contrast, in the right hemisphere, SPL activity covaried with vOT activity only for dyslexic readers. These results bring critical support to the VA interpretation of the VA Span deficit. In addition, they offer a new insight on how deficits in automatic vOT based word recognition could arise in developmental dyslexia.

The effects of stimulus-driven competition and task set on involuntary attention

It is well established that involuntary attention—the exogenous capture of attention by salient but task-irrelevant stimuli—can strongly modulate target detection and discrimination performance. There is an ongoing debate, however, about how involuntary attention affects target performance. Some studies suggest that it results from enhanced perception of the target, whereas others indicate instead that it affects decisional stages of information processing. From a review of these studies, we hypothesized that the presence of distractors and task sets are key factors in determining the effect of involuntary attention on target perception. Consistent with this hypothesis, here we found that noninformative cues summoning involuntary attention affected perceptual identification of a target when distractors were present. This cuing effect could not be attributed to reduced target location uncertainty or decision bias. The only condition under which involuntary attention improved target perception in the absence of distractors occurred when observers did not adopt a task set to focus attention on the target location. We conclude that the perceptual effects of involuntary attention depend on distractor interference and the adoption of a task set to resolve such stimulus competition.

A new perspective on the perceptual selectivity of attention under load

The human attention system helps us cope with a complex environment by supporting the selective processing of information relevant to our current goals. Understanding the perceptual, cognitive, and neural mechanisms that mediate selective attention is a core issue in cognitive neuroscience. One prominent model of selective attention, known as load theory, offers an account of how task demands determine when information is selected and an account of the efficiency of the selection process. However, load theory has several critical weaknesses that suggest that it is time for a new perspective. Here we review the strengths and weaknesses of load theory and offer an alternative biologically plausible computational account that is based on the neural theory of visual attention. We argue that this new perspective provides a detailed computational account of how bottom-up and top-down information is integrated to provide efficient attentional selection and allocation of perceptual processing resources.

Neural substrates of visual masking by object substitution in schizophrenia

Despite a well-known behavioral finding of visual backward masking impairment in schizophrenia, its underlying neural mechanism remains obscure. This study examined neural correlates of a distinct type of visual backward masking, object substitution masking (OSM), in schizophrenia. Twenty schizophrenia patients and 26 healthy controls completed a 4-Dot OSM task and three functional localizer tasks for the lateral occipital (LO), human motion-sensitive (hMT+), and retinotopic areas in the scanner. In 4-dot masking, subjects detected a target that was followed by a mask consisting of 4 dots that surrounded a target. Stimulus-onset asynchrony (SOA) between target and mask was varied to examine the modulation of masking: (1) within three visual processing areas regions of interest (ROI) (i.e., ROI analysis) and (2) in brain regions outside the three visual processing areas (i.e., whole brain analysis). In the ROI analyses, LO and retinotopic areas showed increased peak amplitude when SOA become longer in both patients and controls. There was also an effect of ROI in that both groups showed higher activation in LO and hMT+ compared with the retinotopic areas. The whole brain analyses revealed a significantly activated area for longer SOAs vs. a short SOA in the occipital cortex in controls only, but the group contrast was not significant. Overall, this study did not find strong evidence for neural abnormalities of OSM in schizophrenia, suggesting that neural substrates of OSM in schizophrenia are not as compromised as those involved in the more common masking methods that rely on disruption of object formation.

Blinded by the load: attention, awareness and the role of perceptual load

What is the relationship between attention and conscious awareness? Awareness sometimes appears to be restricted to the contents of focused attention, yet at other times irrelevant distractors will dominate awareness. This contradictory relationship has also been reflected in an abundance of discrepant research findings leading to an enduring controversy in cognitive psychology. Lavie's load theory of attention suggests that the puzzle can be solved by considering the role of perceptual load. Although distractors will intrude upon awareness in conditions of low load, awareness will be restricted to the content of focused attention when the attended information involves high perceptual load. Here, we review recent evidence for this proposal with an emphasis on the various subjective blindness phenomena, and their neural correlates, induced by conditions of high perceptual load. We also present novel findings that clarify the role of attention in the response to stimulus contrast. Overall, this article demonstrates a critical role for perceptual load across the spectrum of perceptual processes leading to awareness, from the very early sensory responses related to contrast detection to explicit recognition of semantic content.

Neural mechanisms by which attention modulates the comparison of remembered and perceptual representations

Attention is important for effectively comparing incoming perceptual information with the contents of visual short-term memory (VSTM), such that any differences can be detected. However, how attentional mechanisms operate upon these comparison processes remains largely unknown. Here we investigate the underlying neural mechanisms by which attention modulates the comparisons between VSTM and perceptual representations using functional magnetic resonance imaging (fMRI). Participants performed a cued change detection task. Spatial cues were presented to orient their attention either to the location of an item in VSTM prior to its comparison (retro-cues), or simultaneously (simultaneous-cues) with the probe array. A no-cue condition was also included. When attention cannot be effectively deployed in advance (i.e. following the simultaneous-cues), we observed a distributed and extensive activation pattern in the prefrontal and parietal cortices in support of successful change detection. This was not the case when participants can deploy their attention in advance (i.e. following the retro-cues). The region-of-interest analyses confirmed that neural responses for successful change detection versus correct rejection in the visual and parietal regions were significantly different for simultaneous-cues compared to retro-cues. Importantly, we found enhanced functional connectivity between prefrontal and parietal cortices when detecting changes on the simultaneous-cue trials. Moreover, we demonstrated a close relationship between this functional connectivity and d′ scores. Together, our findings elucidate the attentional and neural mechanisms by which items held in VSTM are compared with incoming perceptual information.

Competition explains limited attention and perceptual resources: implications for perceptual load and dilution theories

Both perceptual load theory and dilution theory purport to explain when and why task-irrelevant information, or so-called distractors are processed. Central to both explanations is the notion of limited resources, although the theories differ in the precise way in which those limitations affect distractor processing. We have recently proposed a neurally plausible explanation of limited resources in which neural competition among stimuli hinders their representation in the brain. This view of limited capacity can also explain distractor processing, whereby the competitive interactions and bias imposed to resolve the competition determine the extent to which a distractor is processed. This idea is compatible with aspects of both perceptual load and dilution models of distractor processing, but also serves to highlight their differences. Here we review the evidence in favor of a biased competition view of limited resources and relate these ideas to both classic perceptual load theory and dilution theory.

Flexible cognitive resources: competitive content maps for attention and memory

The brain has finite processing resources so that, as tasks become harder, performance degrades. Where do the limits on these resources come from? We focus on a variety of capacity-limited buffers related to attention, recognition, and memory that we claim have a two-dimensional 'map' architecture, where individual items compete for cortical real estate. This competitive format leads to capacity limits that are flexible, set by the nature of the content and their locations within an anatomically delimited space. We contrast this format with the standard 'slot' architecture and its fixed capacity. Using visual spatial attention and visual short-term memory as case studies, we suggest that competitive maps are a concrete and plausible architecture that limits cognitive capacity across many domains.

Competition-strength-dependent ground suppression in figure-ground perception

Figure-ground segregation is modeled as inhibitory competition between objects that might be perceived on opposite sides of borders. The winner is the figure; the loser is suppressed, and its location is perceived as shapeless ground. Evidence of ground suppression would support inhibitory competition models and would contribute to explaining why grounds are shapeless near borders shared with figures, yet such evidence is scarce. We manipulated whether competition from potential objects on the ground side of figures was high (i.e., portions of familiar objects were potentially present there) or low (novel objects were potentially present). We predicted that greater competition would produce more ground suppression. The results of two experiments in which suppression was assessed via judgments of the orientation of target bars confirmed this prediction; a third experiment showed that ground suppression is short-lived. Our findings support inhibitory competition models of figure assignment, in particular, and models of visual perception entailing feedback, in general.

Anatomical constraints on attention: hemifield independence is a signature of multifocal spatial selection

Previous studies have shown independent attentional selection of targets in the left and right visual hemifields during attentional tracking (Alvarez & Cavanagh, 2005) but not during a visual search (Luck, Hillyard, Mangun, & Gazzaniga, 1989). Here we tested whether multifocal spatial attention is the critical process that operates independently in the two hemifields. It is explicitly required in tracking (attend to a subset of object locations, suppress the others) but not in the standard visual search task (where all items are potential targets). We used a modified visual search task in which observers searched for a target within a subset of display items, where the subset was selected based on location (Experiments 1 and 3A) or based on a salient feature difference (Experiments 2 and 3B). The results show hemifield independence in this subset visual search task with location-based selection but not with feature-based selection; this effect cannot be explained by general difficulty (Experiment 4). Combined, these findings suggest that hemifield independence is a signature of multifocal spatial attention and highlight the need for cognitive and neural theories of attention to account for anatomical constraints on selection mechanisms.

Independent effects of attentional gain control and competitive interactions on visual stimulus processing

Attention filters behaviorally relevant stimuli from the constant stream of sensory information comprising our environment. Research into underlying neural mechanisms in humans suggests that visual attention biases mutual suppression between stimuli resulting from competition for limited processing resources. As a consequence, processing of an attended stimulus is facilitated. This account makes 2 assumptions: 1) An attended stimulus is released from mutual suppression with competing stimuli and 2) an attended stimulus experiences greater gain in the presence of competing stimuli than when it is presented alone. Here, we tested these assumptions by recording frequency-tagged potentials elicited in early visual cortex that index stimulus-specific processing. We contrasted the processing of a given stimulus when its location was attended or unattended and in the presence or the absence of a nearby competing stimulus. At variance with previous findings, competition similarly suppressed processing of attended and unattended stimuli. Moreover, the magnitude of attentional gain was comparable in the presence or the absence of competing stimuli. We conclude that visuospatial selective attention does not directly modulate mutual suppression between stimuli but instead acts as a signal gain, which biases processing toward attended stimuli independent of competition.

Neural dynamics of object-based multifocal visual spatial attention and priming: object cueing, useful-field-of-view, and crowding

How are spatial and object attention coordinated to achieve rapid object learning and recognition during eye movement search? How do prefrontal priming and parietal spatial mechanisms interact to determine the reaction time costs of intra-object attention shifts, inter-object attention shifts, and shifts between visible objects and covertly cued locations? What factors underlie individual differences in the timing and frequency of such attentional shifts? How do transient and sustained spatial attentional mechanisms work and interact? How can volition, mediated via the basal ganglia, influence the span of spatial attention? A neural model is developed of how spatial attention in the where cortical stream coordinates view-invariant object category learning in the what cortical stream under free viewing conditions. The model simulates psychological data about the dynamics of covert attention priming and switching requiring multifocal attention without eye movements. The model predicts how "attentional shrouds" are formed when surface representations in cortical area V4 resonate with spatial attention in posterior parietal cortex (PPC) and prefrontal cortex (PFC), while shrouds compete among themselves for dominance. Winning shrouds support invariant object category learning, and active surface-shroud resonances support conscious surface perception and recognition. Attentive competition between multiple objects and cues simulates reaction-time data from the two-object cueing paradigm. The relative strength of sustained surface-driven and fast-transient motion-driven spatial attention controls individual differences in reaction time for invalid cues. Competition between surface-driven attentional shrouds controls individual differences in detection rate of peripheral targets in useful-field-of-view tasks. The model proposes how the strength of competition can be mediated, though learning or momentary changes in volition, by the basal ganglia. A new explanation of crowding shows how the cortical magnification factor, among other variables, can cause multiple object surfaces to share a single surface-shroud resonance, thereby preventing recognition of the individual objects.

Attention does more than modulate suppressive interactions: attending to multiple items

Directing attention to a visual item enhances its representations, making it more likely to guide behavior (Corbetta et al. 1991). Attention is thought to produce this enhancement by biasing suppressive interactions among multiple items in visual cortex in favor of the attended item (e.g., Desimone and Duncan 1995; Reynolds and Heeger 2009). We ask whether target enhancement and modulation of suppressive interactions are in fact inextricably linked or whether they can be decoupled. In particular, we ask whether simultaneously directing attention to multiple items may be one means of dissociating the influence of attention-related enhancement from the effects of inter-item suppression. When multiple items are attended, suppressive interactions in visual cortex limit the effectiveness with which attention may act on their representations, presumably because "biasing" the interactions in favor of a single item is no longer possible (Scalf and Beck 2010). In this experiment, we directly investigate whether applying attention to multiple competing stimulus items has any influence on either their evoked signal or their suppressive interactions. Both BOLD signal evoked by the items in V4 and behavioral responses to those items were significantly compromised by simultaneous presentation relative to simultaneous presentation, indicating that when the items appeared at the same time, they interacted in a mutually suppressive manner that compromised their ability to guide behavior. Attention significantly enhanced signal in V4. The attentional status of the items, however, had no influence on the suppressive effects of simultaneous presentation. To our knowledge, these data are the first to explicitly decouple the effects of top-down attention from those of inter-item suppression.

Interactions of top-down and bottom-up mechanisms in human visual cortex

Multiple stimuli present in the visual field at the same time compete for neural representation by mutually suppressing their evoked activity throughout visual cortex, providing a neural correlate for the limited processing capacity of the visual system. Competitive interactions among stimuli can be counteracted by top-down, goal-directed mechanisms such as attention, and by bottom-up, stimulus-driven mechanisms. Because these two processes cooperate in everyday life to bias processing toward behaviorally relevant or particularly salient stimuli, it has proven difficult to study interactions between top-down and bottom-up mechanisms. Here, we used an experimental paradigm in which we first isolated the effects of a bottom-up influence on neural competition by parametrically varying the degree of perceptual grouping in displays that were not attended. Second, we probed the effects of directed attention on the competitive interactions induced with the parametric design. We found that the amount of attentional modulation varied linearly with the degree of competition left unresolved by bottom-up processes, such that attentional modulation was greatest when neural competition was little influenced by bottom-up mechanisms and smallest when competition was strongly influenced by bottom-up mechanisms. These findings suggest that the strength of attentional modulation in the visual system is constrained by the degree to which competitive interactions have been resolved by bottom-up processes related to the segmentation of scenes into candidate objects.

Event-related potentials dissociate effects of salience and space in biased competition for visual representation

Background

Selective visual attention is the process by which the visual system enhances behaviorally relevant stimuli and filters out others. Visual attention is thought to operate through a cortical mechanism known as biased competition. Representations of stimuli within cortical visual areas compete such that they mutually suppress each others' neural response. Competition increases with stimulus proximity and can be biased in favor of one stimulus (over another) as a function of stimulus significance, salience, or expectancy. Though there is considerable evidence of biased competition within the human visual system, the dynamics of the process remain unknown.

Methodology/Principal Findings

Here, we used scalp-recorded electroencephalography (EEG) to examine neural correlates of biased competition in the human visual system. In two experiments, subjects performed a task requiring them to either simultaneously identify two targets (Experiment 1) or discriminate one target while ignoring a decoy (Experiment 2). Competition was manipulated by altering the spatial separation between target(s) and/or decoy. Both experimental tasks should induce competition between stimuli. However, only the task of Experiment 2 should invoke a strong bias in favor of the target (over the decoy). The amplitude of two lateralized components of the event-related potential, the N2pc and Ptc, mirrored these predictions. N2pc amplitude increased with increasing stimulus separation in Experiments 1 and 2. However, Ptc amplitude varied only in Experiment 2, becoming more positive with decreased spatial separation.

Conclusions/Significance

These results suggest that N2pc and Ptc components may index distinct processes of biased competition—N2pc reflecting visual competitive interactions and Ptc reflecting a bias in processing necessary to individuate task-relevant stimuli.