Salience-based selection: attentional capture by distractors less salient than the target

Tracking the Misallocation and Reallocation of Spatial Attention toward Auditory Stimuli

Completely ignoring a salient distractor presented concurrently with a target is difficult, and sometimes attention is involuntarily attracted to the distractor's location (attentional capture). Employing the N2ac component as a marker of attention allocation toward sounds, in this study we investigate the spatiotemporal dynamics of auditory attention across two experiments. Human participants (male and female) performed an auditory search task, where the target was accompanied by a distractor in two-third of the trials. For a distractor more salient than the target (Experiment 1), we observe not only a distractor N2ac (indicating attentional capture) but the full chain of attentional dynamics implied by the notion of attentional capture, namely, (1) the distractor captures attention before the target is attended, (2) allocation of attention to the target is delayed by distractor presence, and (3) the target is attended after the distractor. Conversely, for a distractor less salient than the target (Experiment 2), although responses were delayed, no attentional capture was observed. Together, these findings reveal two types of spatial attentional dynamics in the auditory modality (distraction with and without attentional capture).

Relative saliency affects attentional capture and suppression of color and face singleton distractors: evidence from event-related potential studies

Prior research has yet to fully elucidate the impact of varying relative saliency between target and distractor on attentional capture and suppression, along with their underlying neural mechanisms, especially when social (e.g. face) and perceptual (e.g. color) information interchangeably serve as singleton targets or distractors, competing for attention in a search array. Here, we employed an additional singleton paradigm to investigate the effects of relative saliency on attentional capture (as assessed by N2pc) and suppression (as assessed by PD) of color or face singleton distractors in a visual search task by recording event-related potentials. We found that face singleton distractors with higher relative saliency induced stronger attentional processing. Furthermore, enhancing the physical salience of colors using a bold color ring could enhance attentional processing toward color singleton distractors. Reducing the physical salience of facial stimuli by blurring weakened attentional processing toward face singleton distractors; however, blurring enhanced attentional processing toward color singleton distractors because of the change in relative saliency. In conclusion, the attentional processes of singleton distractors are affected by their relative saliency to singleton targets, with higher relative saliency of singleton distractors resulting in stronger attentional capture and suppression; faces, however, exhibit some specificity in attentional capture and suppression due to high social saliency.

Terms of debate: Consensus definitions to guide the scientific discourse on visual distraction

Hypothesis-driven research rests on clearly articulated scientific theories. The building blocks for communicating these theories are scientific terms. Obviously, communication - and thus, scientific progress - is hampered if the meaning of these terms varies idiosyncratically across (sub)fields and even across individual researchers within the same subfield. We have formed an international group of experts representing various theoretical stances with the goal to homogenize the use of the terms that are most relevant to fundamental research on visual distraction in visual search. Our discussions revealed striking heterogeneity and we had to invest much time and effort to increase our mutual understanding of each other's use of central terms, which turned out to be strongly related to our respective theoretical positions. We present the outcomes of these discussions in a glossary and provide some context in several essays. Specifically, we explicate how central terms are used in the distraction literature and consensually sharpen their definitions in order to enable communication across theoretical standpoints. Where applicable, we also explain how the respective constructs can be measured. We believe that this novel type of adversarial collaboration can serve as a model for other fields of psychological research that strive to build a solid groundwork for theorizing and communicating by establishing a common language. For the field of visual distraction, the present paper should facilitate communication across theoretical standpoints and may serve as an introduction and reference text for newcomers.

Little engagement of attention by salient distractors defined in a different dimension or modality to the visual search target

Singleton distractors may inadvertently capture attention, interfering with the task at hand. The underlying neural mechanisms of how we prevent or handle distractor interference remain elusive. Here, we varied the type of salient distractor introduced in a visual search task: the distractor could be defined in the same (shape) dimension as the target, a different (color) dimension, or a different (tactile) modality (intra-dimensional, cross-dimensional, and, respectively, cross-modal distractor, all matched for physical salience); and besides behavioral interference, we measured lateralized electrophysiological indicators of attentional selectivity (the N2pc, Ppc, PD , CCN/CCP, CDA, and cCDA). The results revealed the intra-dimensional distractor to produce the strongest reaction-time interference, associated with the smallest target-elicited N2pc. In contrast, the cross-dimensional and cross-modal distractors did not engender any significant interference, and the target-elicited N2pc was comparable to the condition in which the search display contained only the target singleton, thus ruling out early attentional capture. Moreover, the cross-modal distractor elicited a significant early CCN/CCP, but did not influence the target-elicited N2pc, suggesting that the tactile distractor is registered by the somatosensory system (rather than being proactively suppressed), without, however, engaging attention. Together, our findings indicate that, in contrast to distractors defined in the same dimension as the target, distractors singled out in a different dimension or modality can be effectively prevented to engage attention, consistent with dimension- or modality-weighting accounts of attentional priority computation.

Hierarchy of Intra- and Cross-modal Redundancy Gains in Visuo-tactile Search: Evidence from the Posterior Contralateral Negativity

Redundant combination of target features from separable dimensions can expedite visual search. The dimension-weighting account explains these "redundancy gains" by assuming that the attention-guiding priority map integrates the feature-contrast signals generated by targets within the respective dimensions. The present study investigated whether this hierarchical architecture is sufficient to explain the gains accruing from redundant targets defined by features in different modalities, or whether an additional level of modality-specific priority coding is necessary, as postulated by the modality-weighting account (MWA). To address this, we had observers perform a visuo-tactile search task in which targets popped out by a visual feature (color or shape) or a tactile feature (vibro-tactile frequency) as well as any combination of these features. The RT gains turned out larger for visuo-tactile versus visual redundant targets, as predicted by the MWA. In addition, we analyzed two lateralized event-related EEG components: the posterior (PCN) and central (CCN) contralateral negativities, which are associated with visual and tactile attentional selection, respectively. The CCN proved to be a stable somatosensory component, unaffected by cross-modal redundancies. In contrast, the PCN was sensitive to cross-modal redundancies, evidenced by earlier onsets and higher amplitudes, which could not be explained by linear superposition of the earlier CCN onto the later PCN. Moreover, linear mixed-effect modeling of the PCN amplitude and timing parameters accounted for approximately 25% of the behavioral RT variance. Together, these behavioral and PCN effects support the hierarchy of priority-signal computation assumed by the MWA.

Relative salience signaling within a thalamo-orbitofrontal circuit governs learning rate

Learning to predict rewards is essential for the sustained fitness of animals. Contemporary views suggest that such learning is driven by a reward prediction error (RPE)-the difference between received and predicted rewards. The magnitude of learning induced by an RPE is proportional to the product of the RPE and a learning rate. Here we demonstrate using two-photon calcium imaging and optogenetics in mice that certain functionally distinct subpopulations of ventral/medial orbitofrontal cortex (vmOFC) neurons signal learning rate control. Consistent with learning rate control, trial-by-trial fluctuations in vmOFC activity positively correlate with behavioral updating when the RPE is positive, and negatively correlates with behavioral updating when the RPE is negative. Learning rate is affected by many variables including the salience of a reward. We found that the average reward response of these neurons signals the relative salience of a reward, because it decreases after reward prediction learning or the introduction of another highly salient aversive stimulus. The relative salience signaling in vmOFC is sculpted by medial thalamic inputs. These results support emerging theoretical views that prefrontal cortex encodes and controls learning parameters.

Statistical Learning of Frequent Distractor Locations in Visual Search Involves Regional Signal Suppression in Early Visual Cortex

Observers can learn locations where salient distractors appear frequently to reduce potential interference-an effect attributed to better suppression of distractors at frequent locations. But how distractor suppression is implemented in the visual cortex and within the frontoparietal attention networks remains unclear. We used fMRI and a regional distractor-location learning paradigm with two types of distractors defined in either the same (orientation) or a different (color) dimension to the target to investigate this issue. fMRI results showed that BOLD signals in early visual cortex were significantly reduced for distractors (as well as targets) occurring at the frequent versus rare locations, mirroring behavioral patterns. This reduction was more robust with same-dimension distractors. Crucially, behavioral interference was correlated with distractor-evoked visual activity only for same- (but not different-) dimension distractors. Moreover, with different- (but not same-) dimension distractors, a color-processing area within the fusiform gyrus was activated more when a distractor was present in the rare region versus being absent and more with a distractor in the rare versus frequent locations. These results support statistical learning of frequent distractor locations involving regional suppression in early visual cortex and point to differential neural mechanisms of distractor handling with different- versus same-dimension distractors.

Fear of Missing Out Predicts Distraction by Social Reward Signals Displayed on a Smartphone in Difficult Driving Situations

Smartphones are particularly likely to elicit driver distraction with obvious negative repercussions on road safety. Recent selective attention models lead to expect that smartphones might be very effective in capturing attention due to their social reward history. Hence, individual differences in terms of Fear of Missing Out (FoMO) – i.e., of the apprehension of missing out on socially rewarding experiences – should play an important role in driver distraction. This factor has already been associated with self-reported estimations of greater attention paid to smartphones while driving, but the potential link between FoMO and smartphone-induced distraction has never been tested empirically. Therefore, we conducted a preliminary study to investigate whether FoMO would modulate attentional capture by reward distractors displayed on a smartphone. First, participants performed a classical visual search task in which neutral stimuli (colored circles) were associated with high or low social reward outcomes. Then, they had to detect a pedestrian or a roe deer in driving scenes with various levels of fog density. The social reward stimuli were displayed as distractors on the screen of a smartphone embedded in the pictures. The results showed a significant three-way interaction between FoMO, social reward distraction, and task difficulty. More precisely, under attention-demanding conditions (i.e., high-fog density), individual FoMO scores predicted attentional capture by social reward distractors, with longer reaction times (RTs) for high rather than low social reward distractors. These results highlight the importance to consider reward history and FoMO when investigating smartphone-based distraction. Limitations are discussed, notably regarding our sample characteristics (i.e., mainly young females) that might hamper the generalization of our findings to the overall population. Future research directions are provided.

Post-capture processes contribute to statistical learning of distractor locations in visual search

People can learn to ignore salient distractors that occur frequently at particular locations, making them interfere less with task performance. This effect has been attributed to learnt suppression of the likely distractor locations at a pre-selective stage of attentional-priority computation. However, rather than distractors at frequent (vs rare) locations being just less likely to capture attention, attention may possibly also be disengaged faster from such distractors - a post-selective contribution to their reduced interference. Eye-movement studies confirm that learnt suppression, evidenced by a reduced rate of oculomotor capture by distractors at frequent locations, is a major factor, whereas the evidence is mixed with regard to a role of rapid disengagement However, methodological choices in these studies limited conclusions as to the contribution of a post-capture effect. Using an adjusted design, here we positively establish the rapid-disengagement effect, while corroborating the oculomotor-capture effect. Moreover, we examine distractor-location learning effects not only for distractors defined in a different visual dimension to the search target, but also for distractors defined within the same dimension, which are known to cause particularly strong interference and probability-cueing effects. Here, we show that both oculomotor-capture and disengagement dynamics contribute to this pattern. Additionally, on distractor-absent trials, the slowed responses to targets at frequent distractor locations-that we observe only in same-, but not different-, dimension conditions-arise pre-selectively, in prolonged latencies of the very first saccade. This supports the idea that learnt suppression is implemented at a different level of priority computation with same-versus different-dimension distractors.

Graph-Based Analysis of Visual Scanning Patterns: A Developmental Study on Green and Normal Images

The present study investigated the visual scanning pattern of children with typical development in three different age groups(4-6,6-8,8-10 years old). We used a data set from one related research, which included images with different low-level features: Green and Normal. This study analyzed age-associated inter-individual differences and was intended to show that graph profiling combined with a fixation time approach could help us to better understand the developmental visual pattern. Thus, degree centrality as one of the graph theory measures was implied to analyze gaze distribution. We explored the influence of bottom-up features, comparing the first 2 s (early phase) with the interval from 4 to 6 s (late phase) of scene exploration during age development. Our results indicated that degree centrality and fixation time increased with age. Furthermore, it was found that the effects of saliency are short-lived but significant. Moreover, we found that Green images during the early phase play an important role in visual anchoring, and the children's performance was significantly different between 4-6 y and 6-8y-group. This comparative study underscores the ability of degree centrality as a developing innovative measure to perform eye-tracking data analyses.

Novelty competes with saliency for attention

A highly debated question in attention research is to what extent attention is biased by bottom-up factors such as saliency versus top-down factors as governed by the task. Visual search experiments in which participants are briefly familiarized with the task and then see a novel stimulus unannounced and for the first time support yet another factor, showing that novel and surprising features attract attention. In the present study, we tested whether gaze behavior as an indicator for attentional prioritization can be predicted accurately within displays containing both salient and novel stimuli by means of a priority map that assumes novelty as an additional source of activation. To that aim, we conducted a visual search experiment where a color singleton was presented for the first time in the surprise trial and manipulated the color-novelty of the remaining non-singletons between participants. In one group, the singleton was the only novel stimulus ("one-new"), whereas in another group, the non-singleton stimuli were likewise novel ("all-new"). The surprise trial was always target absent and designed such that top-down prioritization of any color was unlikely. The results show that the singleton in the all-new group captured the gaze less strongly, with more early fixations being directed to the novel non-singletons. Overall, the fixation pattern can accurately be explained by noisy priority maps where saliency and novelty compete for gaze control.

Distract yourself: prediction of salient distractors by own actions and external cues

Distracting sensory events can capture attention, interfering with the performance of the task at hand. We asked: is our attention captured by such events if we cause them ourselves? To examine this, we employed a visual search task with an additional salient singleton distractor, where the distractor was predictable either by the participant's own (motor) action or by an endogenous cue; accordingly, the task was designed to isolate the influence of motor and non-motor predictive processes. We found both types of prediction, cue- and action-based, to attenuate the interference of the distractor-which is at odds with the "attentional white bear" hypothesis, which states that prediction of distracting stimuli mandatorily directs attention towards them. Further, there was no difference between the two types of prediction. We suggest this pattern of results may be better explained by theories postulating general predictive mechanisms, such as the framework of predictive processing, as compared to accounts proposing a special role of action-effect prediction, such as theories based on optimal motor control. However, rather than permitting a definitive decision between competing theories, our study highlights a number of open questions, to be answered by these theories, with regard to how exogenous attention is influenced by predictions deriving from the environment versus our own actions.

Early Visual Processing of Feature Saliency Tasks: A Review of Psychophysical Experiments

The visual system is constantly bombarded with information originating from the outside world, but it is unable to process all the received information at any given time. In fact, the most salient parts of the visual scene are chosen to be processed involuntarily and immediately after the first glance along with endogenous signals in the brain. Vision scientists have shown that the early visual system, from retina to lateral geniculate nucleus (LGN) and then primary visual cortex, selectively processes the low-level features of the visual scene. Everything we perceive from the visual scene is based on these feature properties and their subsequent combination in higher visual areas. Different experiments have been designed to investigate the impact of these features on saliency and understand the relative visual mechanisms. In this paper, we review the psychophysical experiments which have been published in the last decades to indicate how the low-level salient features are processed in the early visual cortex and extract the most important and basic information of the visual scene. Important and open questions are discussed in this review as well and one might pursue these questions to investigate the impact of higher level features on saliency in complex scenes or natural images.

Polarity-dependent Effects of Biparietal Transcranial Direct Current Stimulation on the Interplay between Target Location and Distractor Saliency in Visual Attention

Visual attention allows the allocation of limited neural processing resources to stimuli based on their behavioral priorities. The selection of task-relevant visual targets entails the processing of multiple competing stimuli and the suppression of distractors that may be either perceptually salient or perceptually similar to targets. The posterior parietal cortex controls the interaction between top-down (task-driven) and bottom-up (stimulus-driven) processes competing for attentional selection, as well as spatial distribution of attention. Here, we examined whether biparietal transcranial direct current stimulation (tDCS) would modulate the interaction between top-down and bottom-up processes in visual attention. Visual attention function was assessed with a visual discrimination task, in which a lateralized target was presented alone or together with a contralateral, similar or salient, distractor. The accuracy and RTs were measured before and during three stimulation sessions (sham, right anodal/left cathodal, left anodal/right cathodal). The analyses demonstrated (i) polarity-dependent effects of tDCS on the accuracy of target discrimination, but only when the target was presented with a similar distractor; (ii) the tDCS-triggered effects on the accuracy of discriminating targets, accompanied by a similar distractor, varied according to the target location; and (iii) overall detrimental effects of tDCS on RTs were observed, regardless of target location, distractor type, and polarity of the stimulation. We conclude that the observed polarity, distractor type, and target location-dependent effects of biparietal tDCS on the accuracy of target detection resulted from both a modulation of the interaction between top-down and bottom-up attentional processes and the interhemispheric competition mechanisms guiding attentional selection and spatial deployment of attention.

Practice reduces set-specific capture costs only superficially

Contingent attentional capture costs are doubled or tripled under certain conditions when multiple attentional sets guide visual search (e.g., "search for green letters" and "search for orange letters"). Such "set-specific" capture occurs when a potential target that matches one attentional set (e.g., a green stimulus) impairs the ability to identify a temporally proximal target that matches another attentional set (e.g., an orange stimulus). In the present study, we examined whether these severe set-specific capture effects could be attenuated through training. In Experiment 1, half of participants experienced training consisting of mostly trials involving a set switch from distractor to target, while the other half experienced training consisting of mostly trials in which a set switch was not required. Upon test, participants trained on set switches produced greatly reduced set-specific capture effects compared to their own pretraining levels and compared to participants trained on trials without a set switch. However, in Experiments 2 and 3, we found that these training effects did not transfer to a new color context or even a single new target color, indicating that they were specific and involved low-level associative learning. We concluded that set-specific capture is pervasive and largely immutable, even with practice.

The influence of a scene preview on eye movement behavior in natural scenes

Rich contextual and semantic information can be extracted from only a brief presentation of a natural scene. This is presumed to be activated quickly enough to guide initial eye movements into a scene. However, early, short-latency eye movements in natural scenes have been shown to be dependent on the salience distribution across the image (Anderson, Ort, Kruijne, Meeter, & Donk, 2015). In the present work, we manipulated the salience distribution across a natural scene by changing the global contrast. We showed participants a brief real or nonsense preview of the scene and examined the time-course of eye movement guidance. A real preview decreased the latency and increased the amplitude of initial saccades into the image, suggesting that the preview allowed observers to obtain additional contextual information that would otherwise not be available. However, the preview did not completely override the initial tendency for short-latency saccades to be guided by the underlying salience distribution of the image. We discuss these findings in the context of oculomotor selection based on the integration of contextual information and low-level features in a natural scene.

Salient object changes influence overt attentional prioritization and object-based targeting in natural scenes

A change to an object in natural scenes attracts attention when it occurs during a fixation. However, when a change occurs during a saccade, and is masked by saccadic suppression, it typically does not capture the gaze in a bottom-up manner. In the present work, we investigated how the type and direction of salient changes to objects affect the prioritization and targeting of objects in natural scenes. We asked observers to look around a scene in preparation for a later memory test. After a period of time, an object in the scene was increased or decreased in salience either during a fixation (with a transient signal) or during a saccade (without transient signal), or it was not changed at all. Changes that were made during a fixation attracted the eyes both when the change involved an increase and a decrease in salience. However, changes that were made during a saccade only captured the eyes when the change was an increase in salience, relative to the baseline no-change condition. These results suggest that the prioritization of object changes can be influenced by the underlying salience of the changed object. In addition, object changes that occurred with a transient signal (which is itself a salient signal) resulted in more central object targeting. Taken together, our results suggest that salient signals in a natural scene are an important component in both object prioritization and targeting in natural scene viewing, insofar as they align with object locations.

Modeling Visual Exploration in Rhesus Macaques with Bottom-Up Salience and Oculomotor Statistics

There is a growing interest in studying biological systems in natural settings, in which experimental stimuli are less artificial and behavior is less controlled. In primate vision research, free viewing of complex images has elucidated novel neural responses, and free viewing in humans has helped discover attentional and behavioral impairments in patients with neurological disorders. In order to fully interpret data collected from free viewing of complex scenes, it is critical to better understand what aspects of the stimuli guide viewing behavior. To this end, we have developed a novel viewing behavior model called a Biased Correlated Random Walk (BCRW) to describe free viewing behavior during the exploration of complex scenes in monkeys. The BCRW can predict fixation locations better than bottom-up salience. Additionally, we show that the BCRW can be used to test hypotheses regarding specific attentional mechanisms. For example, we used the BCRW to examine the source of the central bias in fixation locations. Our analyses suggest that the central bias may be caused by a natural tendency to reorient the eyes toward the center of the stimulus, rather than a photographer's bias to center salient items in a scene. Taken together these data suggest that the BCRW can be used to further our understanding of viewing behavior and attention, and could be useful in optimizing stimulus and task design.

Occipital TMS at phosphene detection threshold captures attention automatically

Strong stimuli may capture attention automatically, suggesting that attentional selection is determined primarily by physical stimulus properties. The mechanisms underlying capture remain controversial, in particular, whether feedforward subcortical processes are its main source. Also, it remains unclear whether only physical stimulus properties determine capture strength. Here, we demonstrate strong capture in the absence of feedforward input to subcortical structures such as the superior colliculus, by using transcranial magnetic stimulation (TMS) over occipital visual cortex as an attention cue. This implies that the feedforward sweep through subcortex is not necessary for capture to occur but rather provides an additional source of capture. Furthermore, seen cues captured attention more strongly than (physically identical) unseen cues, suggesting that the momentary state of the nervous system modulates attentional selection. In summary, we demonstrate the existence of several sources of attentional capture, and that both physical stimulus properties and the state of the nervous system influence capture.

Reactive cognitive-control processes in free-report consonant-vowel dichotic listening

The relevance of cognitive-control processes has been frequently discussed and studied in the context of dichotic listening. Experimental and clinical studies indicate that directing attention to either of the two simultaneously presented phonological stimuli, but especially to the left-ear stimulus increases the requirements for cognitive-control processes. Here, we extend this view by reporting the results of a behavioural and a functional magnetic-resonance imaging (fMRI) experiment designed to analyse the involvement of cognitive-control processes also in a free-report dichotic-listening paradigm. It was hypothesised that dichotically presented pairs of stop-consonant-vowel syllables would provide different demands for cognitive-control processes as a function of the spectro-temporal overlap of the two stimuli. Accordingly, in Experiment 1 it was shown that dichotic syllables of high (e.g., /ba/ and /ga/) as opposed to low spectro-temporal overlap (e.g., /ba/ and /ka/) produce significantly faster and more correct answers, and are more often perceived as one syllable. In Experiment 2 it was further shown that pairs of low as compared to high spectro-temporal overlap trigger a more pronounced activation predominately in left-hemispheric, speech-associated brain regions, namely left posterior inferior sulcus/gyrus, bilaterally in pre-supplementary motor and mid-cingulate cortex as well as in the inferior parietal lobe. Taken together, behavioural and functional data indicate a stronger involvement of reactive cognitive control in the processing of low-overlap as opposed to high-overlap stimulus pairs. This supports the notion that higher-order, speech-related cognitive-control processes also are involved in a free-report dichotic-listening paradigm.

Distractors less salient than targets capture attention rather than producing non-spatial filtering costs

Distractors that are less salient than the target evoke reaction time interference in the distractor search paradigm. Here, we investigated whether this interference indeed results from spatial attentional capture or merely from non-spatial filtering costs. Target and distractor salience was manipulated parametrically and the modulation of reaction time interference by the distance between both stimuli was taken as an indicator of attentional capture. For distractors that were less salient than the target, we found distance to be predictive of reaction time interference. Moreover, this relationship was modulated by the difference in relative salience of target and distractor: the less salient the distractor was compared to the target, the weaker was the influence of distance. These results are in accordance with the sequential sampling model of salience-based selection by Zehetleitner et al. (Zehetleitner, M., Koch, A.I., Goschy, H., Müller, H.J., 2013. Salience-based selection: Interference by distractors less salient than the target. PLoS ONE 8: e52595.). This model assumes the salience map to be computed by noisy accumulation of sensory evidence. As a result, the salience map output fluctuates around its true value and less salient locations can be denoted as most salient. A distractor less salient than the target can therefore capture attention with a certain probability. We conclude that reaction time interference by less salient distractors in the distractor search paradigm is a result of attentional capture in a proportion of trials, rather than a result of non-spatial filtering costs.