From reorienting of attention to biased competition: Evidence from hemifield effects

Influence of flavor information on visual search: Attentional capture by and suppression of flavor-associated colors

Numerous studies have demonstrated the impact of flavor cues on visual search, yet the underlying mechanisms remain elusive. In this experiment, we used event-related potentials (ERPs) to examine whether, and if so, how flavor information could lead to attentional capture by, and suppression of, flavor-associated colors. The participants were asked to taste certain flavored beverages and subsequently complete a shape-based visual search task, while their neural activities were simultaneously recorded. The behavioral results revealed that the participants made slower responses when a distractor in the flavor-associated color (DFAC) was present, suggesting an attentional bias toward the flavor-associated color. The ERP results revealed that the N2pc was detected if the target and the DFAC were shown in the same visual field (e.g. both target and DFCA on the right side of the screen), when the pairings between flavor cues and target colors were incongruent. However, the N2pc was not observed if the target and the DFAC were shown in the opposite visual fields (e.g. target on the right and DFCA on the left side of the screen) for the incongruent color-flavor pairings. Moreover, the distractor positivity (Pd) was observed if the target and the DFAC were shown in the opposite visual field for the congruent color-flavor pairings. These results suggest that both attentional capture and suppression are involved in the influence of flavor information on visual search. Collectively, these findings provide initial electrophysiological evidence on the mechanisms of the crossmodal influence of flavor cues on visual search.

Biased Competition between Targets and Distractors Reduces Attentional Suppression: Evidence from the Positivity Posterior Contralateral and Distractor Positivity

The biased competition account claims that competition between two stimuli increases when they are close together compared with when they are far apart. The reason is that nearby stimuli are more likely to be represented in the same receptive fields, requiring top-down or bottom-up biases to resolve the ambiguity. Consistent with biased competition, previous research showed that an index of attentional enhancement, the N2pc component, was attenuated when two targets were close together. In contrast, it is unclear whether distractor processing would also be attenuated when the distractor is close to the target. To answer this question, we used the additional singleton paradigm where a target is sometimes accompanied by a more salient, but entirely irrelevant, distractor. In the conditions of interest, the distance between the target and the distractor was systematically manipulated whereas the eccentricity to central fixation was always the same. The results showed that two indices of attentional suppression, the positivity posterior contralateral and distractor positivity components, were attenuated when the distractor was close to the target. Consistent with biased competition, attentional suppression of distractors was inhibited when the distance between target and distractor was short. The reduced attentional suppression of distractors with nearby targets may contribute to the increased behavioral interference with close distractors.

Does feature intertrial priming guide attention? The jury is still out

Our search performance is strongly influenced by our past experience. In the lab, this influence has been demonstrated by investigating a variety of phenomena, including intertrial priming, statistical learning, and reward history, and collectively referred to as selection history. The resulting findings have led researchers to claim that selection history guides attention, thereby challenging the prevailing dichotomy, according to which top-down and bottom-up factors alone determine attentional priority. Here, we re-examine this claim with regard to one selection-history phenomenon, feature intertrial priming (aka priming of pop-out). We evaluate the evidence that specifically pertains to the role of feature intertrial priming in attentional guidance, rather than in later selective processes occurring after the target is found. We distinguish between the main experimental rationales, while considering the extent to which feature intertrial priming, as studied through different protocols, shares characteristics of top-down attention. We show that there is strong evidence that feature intertrial priming guides attention when the experimental protocol departs from the canonical paradigm and encourages observers to maintain the critical feature in visual working memory or to form expectations about the upcoming target. By contrast, the current evidence regarding the standard feature intertrial priming phenomenon is inconclusive. We propose directions for future research and suggest that applying the methodology used here in order to re-evaluate of the role of other selection history phenomena in attentional guidance should clarify the mechanisms underlying the strong impact of past experience on visual search performance.

Strategic Distractor Suppression Improves Selective Control in Human Vision

Our visual environment is complicated, and our cognitive capacity is limited. As a result, we must strategically ignore some stimuli to prioritize others. Common sense suggests that foreknowledge of distractor characteristics, like location or color, might help us ignore these objects. But empirical studies have provided mixed evidence, often showing that knowing about a distractor before it appears counterintuitively leads to its attentional selection. What has looked like strategic distractor suppression in the past is now commonly explained as a product of prior experience and implicit statistical learning, and the long-standing notion the distractor suppression is reflected in α band oscillatory brain activity has been challenged by results appearing to link α to target resolution. Can we strategically, proactively suppress distractors? And, if so, does this involve α? Here, we use the concurrent recording of human EEG and eye movements in optimized experimental designs to identify behavior and brain activity associated with proactive distractor suppression. Results from three experiments show that knowing about distractors before they appear causes a reduction in electrophysiological indices of covert attentional selection of these objects and a reduction in the overt deployment of the eyes to the location of the objects. This control is established before the distractor appears and is predicted by the power of cue-elicited α activity over the visual cortex. Foreknowledge of distractor characteristics therefore leads to improved selective control, and α oscillations in visual cortex reflect the implementation of this strategic, proactive mechanism.SIGNIFICANCE STATEMENT To behave adaptively and achieve goals we often need to ignore visual distraction. Is it easier to ignore distracting objects when we know more about them? We recorded eye movements and electrical brain activity to determine whether foreknowledge of distractor characteristics can be used to limit processing of these objects. Results show that knowing the location or color of a distractor stops us from attentionally selecting it. A neural signature of this inhibition emerges in oscillatory alpha band brain activity, and when this signal is strong, selective processing of the distractor decreases. Knowing about the characteristics of task-irrelevant distractors therefore increases our ability to focus on task-relevant information, in this way gating information processing in the brain.

RT Slowing to Valid Cues on a Reflexive Attention Task in Children and Young Adults

Peripheral cueing tasks can be used to measure reflexive (automatic) attention. In these tasks, increases in response time or RT (costs) typically follow contralateral (invalid) cues as attention must move from the location of the cue to the target. Reductions in RT (benefits) to a target typically follow ipsilateral (valid) cues because the cue draws attention to where the target will appear. Two exceptions to RT benefits are inhibition of return (IOR) and masking. IOR is the tendency to respond slower to targets that appear in locations attended within the last 200–2000 ms. Masking occurs when the visibility of a target is blocked by another stimulus (e.g., the cue). Herein, we describe two experiments, both using a modified Posner task with “earth rockets” as cues and “alien spaceships” as targets. Cues were equally likely to appear on the left or right side of a display following targets. Participants were instructed to press a left or right key corresponding to a left or right target. In Experiment 1, we obtained data from 203 children (10.58–16.55 years old). We discovered unexpected costs following cues that typically provide RT benefits. In Experiment 2, we explored IOR, masking, and age differences in the occurrence of these costs. We manipulated the cue-target temporal distance (“stimulus onset asynchrony” or SOA) to explore IOR and the cue-target spatial distance to explore masking. We also considered a wider age range. Sixty-three children and 41 young adults participated. Experiment 2 revealed a three-way interaction between SOA, spatial distance, and age. At the shorter SOA (100 ms) and moderate spatial distance, unexpected costs followed valid cues for younger children (7.07–10.15 years old). These costs also occurred in young adults (18.00–23.02 years old) following far distance cues at this SOA. At the longer SOA (200 ms), these costs followed moderate and far cues for younger children and near cues for young adults. Older children (10.31–14.92 years) did not have unexpected costs. We explain the findings in terms of masking, IOR, and possible developmental mechanisms.

Active suppression of salient-but-irrelevant stimuli does not underlie resistance to visual interference

In visual search for a shape target, interference from salient-but-irrelevant color singletons can be resisted in feature search mode, but not in singleton detection mode. In singleton detection mode, we observed a contralateral positivity (P_D) after 260-340ms, suggesting that the salient distractor was suppressed. Because RTs in singleton detection mode increased when a distractor was present, we conclude that active suppression of distractors takes time. In feature search mode, no increase in RTs and no P_D to the distractor was observed, showing that resistance to interference was not accomplished by suppression. Rather, the smaller N2pc to the target in feature search than in singleton detection mode suggests that enhancement of target features avoided interference. Thus, the strong top-down set in feature search mode eliminated the need to suppress the early attend-to-me signal (corresponding to the Ppc, from 160 to 210ms) that was generated by salient stimuli independently of search mode.

Disentangling the Role of Cortico-Basal Ganglia Loops in Top-Down and Bottom-Up Visual Attention: An Investigation of Attention Deficits in Parkinson Disease

It is solidly established that top-down (goal-driven) and bottom-up (stimulus-driven) attention mechanisms depend on distributed cortical networks, including prefrontal and frontoparietal regions. On the other hand, it is less clear whether the BG also contribute to one or the other of these mechanisms, or to both. The current study was principally undertaken to clarify this issue. Parkinson disease (PD), a neurodegenerative disorder primarily affecting the BG, has proven to be an effective model for investigating the contribution of the BG to different brain functions; therefore, we set out to investigate deficits of top-down and bottom-up attention in a selected cohort of PD patients. With this objective in mind, we compared the performance on three computerized tasks of two groups of 12 parkinsonian patients (assessed without any treatment), one otherwise pharmacologically treated and the other also surgically treated, with that of a group of controls. The main behavioral tool for our study was an attentional capture task, which enabled us to tap the competition between top-down and bottom-up mechanisms of visual attention. This task was suitably combined with a choice RT and a simple RT task to isolate any specific deficit of attention from deficits in motor response selection and initiation. In the two groups of patients, we found an equivalent increase of attentional capture but also comparable delays in target selection in the absence of any salient distractor (reflecting impaired top-down mechanisms) and movement initiation compared with controls. In contrast, motor response selection processes appeared to be prolonged only in the operated patients. Our results confirm that the BG are involved in both motor and cognitive domains. Specifically, damage to the BG, as it occurs in PD, leads to a distinct deficit of top-down control of visual attention, and this can account, albeit indirectly, for the enhancement of attentional capture, reflecting weakened ability of top-down mechanisms to antagonize bottom-up control.

Automatic control of visual selection

This paper seeks out to reduce the role of the homunculus, the 'little man in the head' that is still prominent in most psychological theories regarding the control our behaviour. We argue that once engaged in a task (which is a volitional act), visual selection run off more or less in an automatic fashion. We argue that the salience map that drives automatic selection is not only determined by raw physical salience of the objects in the environment but also by the way these objects appear to the person. We provide evidence that priming (feature priming, priming by working memory and reward priming) sharpens the cortical representation of these objects such that these objects appear to be more salient above and beyond their physical salience. We demonstrate that this type of priming is not under volitional control: it occurs even if observers try to volitionally prepare for something else. In other words, looking at red prepares our brain for things that are red even if we volitionally try to prepare for green.

Flexible cognitive resources: competitive content maps for attention and memory

The brain has finite processing resources so that, as tasks become harder, performance degrades. Where do the limits on these resources come from? We focus on a variety of capacity-limited buffers related to attention, recognition, and memory that we claim have a two-dimensional 'map' architecture, where individual items compete for cortical real estate. This competitive format leads to capacity limits that are flexible, set by the nature of the content and their locations within an anatomically delimited space. We contrast this format with the standard 'slot' architecture and its fixed capacity. Using visual spatial attention and visual short-term memory as case studies, we suggest that competitive maps are a concrete and plausible architecture that limits cognitive capacity across many domains.

Mantra: an open method for object and movement tracking

Mantra is a free and open-source software package for object tracking. It is specifically designed to be used as a tool for response collection in psychological experiments and requires only a computer and a camera (a webcam is sufficient). Mantra is compatible with widely used software for creating psychological experiments. In Experiments 1 and 2, we validated the spatial and temporal precision of Mantra in realistic experimental settings. In Experiments 3 and 4, we validated the spatial precision and accuracy of Mantra more rigorously by tracking a computer controlled physical stimulus and stimuli presented on a computer screen.

Neural dynamics of object-based multifocal visual spatial attention and priming: object cueing, useful-field-of-view, and crowding

How are spatial and object attention coordinated to achieve rapid object learning and recognition during eye movement search? How do prefrontal priming and parietal spatial mechanisms interact to determine the reaction time costs of intra-object attention shifts, inter-object attention shifts, and shifts between visible objects and covertly cued locations? What factors underlie individual differences in the timing and frequency of such attentional shifts? How do transient and sustained spatial attentional mechanisms work and interact? How can volition, mediated via the basal ganglia, influence the span of spatial attention? A neural model is developed of how spatial attention in the where cortical stream coordinates view-invariant object category learning in the what cortical stream under free viewing conditions. The model simulates psychological data about the dynamics of covert attention priming and switching requiring multifocal attention without eye movements. The model predicts how "attentional shrouds" are formed when surface representations in cortical area V4 resonate with spatial attention in posterior parietal cortex (PPC) and prefrontal cortex (PFC), while shrouds compete among themselves for dominance. Winning shrouds support invariant object category learning, and active surface-shroud resonances support conscious surface perception and recognition. Attentive competition between multiple objects and cues simulates reaction-time data from the two-object cueing paradigm. The relative strength of sustained surface-driven and fast-transient motion-driven spatial attention controls individual differences in reaction time for invalid cues. Competition between surface-driven attentional shrouds controls individual differences in detection rate of peripheral targets in useful-field-of-view tasks. The model proposes how the strength of competition can be mediated, though learning or momentary changes in volition, by the basal ganglia. A new explanation of crowding shows how the cortical magnification factor, among other variables, can cause multiple object surfaces to share a single surface-shroud resonance, thereby preventing recognition of the individual objects.

Attentional Capture by Salient Distractors during Visual Search Is Determined by Temporal Task Demands

The question whether attentional capture by salient but task-irrelevant visual stimuli is triggered in a bottom–up fashion or depends on top–down task settings is still unresolved. Strong support for bottom–up capture was obtained in the additional singleton task, in which search arrays were visible until response onset. Equally strong evidence for top–down control of attentional capture was obtained in spatial cueing experiments in which display durations were very brief. To demonstrate the critical role of temporal task demands on salience-driven attentional capture, we measured ERP indicators of capture by task-irrelevant color singletons in search arrays that could also contain a shape target. In Experiment 1, all displays were visible until response onset. In Experiment 2, display duration was limited to 200 msec. With long display durations, color singleton distractors elicited an N2pc component that was followed by a late Pd component, suggesting that they triggered attentional capture, which was later replaced by location-specific inhibition. When search arrays were visible for only 200 msec, the distractor-elicited N2pc was eliminated and was replaced by a Pd component in the same time range, indicative of rapid suppression of capture. Results show that attentional capture by salient distractors can be inhibited for short-duration search displays, in which it would interfere with target processing. They demonstrate that salience-driven capture is not a purely bottom–up phenomenon but is subject to top–down control.

Modulation of shifting receptive field activity in frontal eye field by visual salience

In the monkey frontal eye field (FEF), the sensitivity of some neurons to visual stimulation changes just before a saccade. Sensitivity shifts from the spatial location of its current receptive field (RF) to the location of that field after the saccade is completed (the future field, FF). These shifting RFs are thought to contribute to the stability of visual perception across saccades, and in this study we investigated whether the salience of the FF stimulus alters the magnitude of FF activity. We reduced the salience of the usually single flashed stimulus by adding other visual stimuli. We isolated 171 neurons in the FEF of 2 monkeys and did experiments on 50 that had FF activity. In 30% of these, that activity was higher before salience was reduced by adding stimuli. The mean magnitude reduction was 16%. We then determined whether the shifting RFs were more frequent in the central visual field, which would be expected if vision across saccades were only stabilized for the visual field near the fovea. We found no evidence of any skewing of the frequency of shifting receptive fields (or the effects of salience) toward the central visual field. We conclude that the salience of the FF stimulus makes a substantial contribution to the magnitude of FF activity in FEF. In so far as FF activity contributes to visual stability, the salience of the stimulus is probably more important than the region of the visual field in which it falls for determining which objects remain perceptually stable across saccades.

Visual attention and stability

In the present review, we address the relationship between attention and visual stability. Even though with each eye, head and body movement the retinal image changes dramatically, we perceive the world as stable and are able to perform visually guided actions. However, visual stability is not as complete as introspection would lead us to believe. We attend to only a few items at a time and stability is maintained only for those items. There appear to be two distinct mechanisms underlying visual stability. The first is a passive mechanism: the visual system assumes the world to be stable, unless there is a clear discrepancy between the pre- and post-saccadic image of the region surrounding the saccade target. This is related to the pre-saccadic shift of attention, which allows for an accurate preview of the saccade target. The second is an active mechanism: information about attended objects is remapped within retinotopic maps to compensate for eye movements. The locus of attention itself, which is also characterized by localized retinotopic activity, is remapped as well. We conclude that visual attention is crucial in our perception of a stable world.

Top-down and bottom-up control of visual selection

The present paper argues for the notion that when attention is spread across the visual field in the first sweep of information through the brain visual selection is completely stimulus-driven. Only later in time, through recurrent feedback processing, volitional control based on expectancy and goal set will bias visual selection in a top-down manner. Here we review behavioral evidence as well as evidence from ERP, fMRI, TMS and single cell recording consistent with stimulus-driven selection. Alternative viewpoints that assume a large role for top-down processing are discussed. It is argued that in most cases evidence supporting top-down control on visual selection in fact demonstrates top-down control on processes occurring later in time, following initial selection. We conclude that top-down knowledge regarding non-spatial features of the objects cannot alter the initial selection priority. Only by adjusting the size of the attentional window, the initial sweep of information through the brain may be altered in a top-down way.