The attentional effects of single cues and color singletons on visual sensitivity

A dynamic 1/f noise protocol to assess visual attention without biasing perceptual processing

Psychophysical paradigms measure visual attention via localized test items to which observers must react or whose features have to be discriminated. These items, however, potentially interfere with the intended measurement, as they bias observers' spatial and temporal attention to their location and presentation time. Furthermore, visual sensitivity for conventional test items naturally decreases with retinal eccentricity, which prevents direct comparison of central and peripheral attention assessments. We developed a stimulus that overcomes these limitations. A brief oriented discrimination signal is seamlessly embedded into a continuously changing 1/f noise field, such that observers cannot anticipate potential test locations or times. Using our new protocol, we demonstrate that local orientation discrimination accuracy for 1/f filtered signals is largely independent of retinal eccentricity. Moreover, we show that items present in the visual field indeed shape the distribution of visual attention, suggesting that classical studies investigating the spatiotemporal dynamics of visual attention via localized test items may have obtained a biased measure. We recommend our protocol as an efficient method to evaluate the behavioral and neurophysiological correlates of attentional orienting across space and time.

Shifting Attention in Feature Space: Fast Facilitation of the To-Be-Attended Feature Is Followed by Slow Inhibition of the To-Be-Ignored Feature

In an explorative study, we investigated the time course of attentional selection shifts in feature-based attention in early visual cortex by means of steady-state visual evoked potentials (SSVEPs). To this end, we presented four flickering random dot kinematograms with red/blue, horizontal/vertical bars, respectively. Given the oscillatory nature of SSVEPs, we were able to investigate neural temporal dynamics of facilitation and inhibition/suppression when participants shifted attention either within (i.e., color to color) or between feature dimensions (i.e., color to orientation). Extending a previous study of our laboratory [Müller, M. M., Trautmann, M., & Keitel, C. Early visual cortex dynamics during top-down modulated shifts of feature-selective attention. Journal of Cognitive Neuroscience, 28, 643-655, 2016] to a full factorial design, we replicated a critical finding of our previous study: Facilitation of color was quickest, regardless of the origin of the shift (from color or orientation). Furthermore, facilitation of the newly to-be-attended and inhibition/suppression of the then to-be-ignored feature is not a time-invariant process that occurs instantaneously, but a biphasic one with longer time delays between the two processes. Interestingly, inhibition/suppression of the to-be-ignored feature after the shifting cue had a much longer latency with between- compared to within-dimensional shifts (by about 130-150 msec). The exploratory nature of our study is reasoned by two limiting factors: (a) Identical to our precursor study, we found no attentional SSVEP amplitude time course modulation for orientation, and (b) the signal-to-noise ratio for single trials was too poor to allow for reliable statistical testing of the latencies that were obtained with running t tests of averaged data.

Flexible weighting of target features based on distractor context

Models of attention posit that attentional priority is established by summing the saliency and relevancy signals from feature-selective maps. The dimension-weighting account further hypothesizes that information from each feature-selective map is weighted based on expectations of how informative each dimension will be. In the current studies, we investigated the question of whether attentional biases to the features of a conjunction target (color and orientation) differ when one dimension is expected to be more diagnostic of the target. In a series of color-orientation conjunction search tasks, observers saw an exact cue for the upcoming target, while the probability of distractors sharing a target feature in each dimension was manipulated. In one context, distractors were more likely to share the target color, and in another, distractors were more likely to share the target orientation. The results indicated that despite an overall bias toward color, attentional priority to each target feature was flexibly adjusted according to distractor context: RT and accuracy performance was better when the diagnostic feature was expected than unexpected. This occurred both when the distractor context was learned implicitly and explicitly. These results suggest that feature-based enhancement can occur selectively for the dimension expected to be most informative in distinguishing the target from distractors.

Specific Visual Subregions of TPJ Mediate Reorienting of Spatial Attention

The temporo-parietal junction (TPJ) has been associated with various cognitive and social functions, and is critical for attentional reorienting. Attention affects early visual processing. Neuroimaging studies dealing with such processes have thus far concentrated on striate and extrastriate areas. Here, we investigated whether attention orienting or reorienting modulate activity in visually driven TPJ subregions. For each observer we identified 3 visually responsive subregions within TPJ: 2 bilateral (vTPJant and vTPJpost) and 1 right lateralized (vTPJcent). Cortical activity in these subregions was measured using fMRI while observers performed a 2-alternative forced-choice orientation discrimination task. Covert spatial endogenous (voluntary) or exogenous (involuntary) attention was manipulated using either a central or a peripheral cue with task, stimuli and observers constant. Both endogenous and exogenous attention increased activity for invalidly cued trials in right vTPJpost; only endogenous attention increased activity for invalidly cued trials in left vTPJpost and in right vTPJcent; and neither type of attention modulated either right or left vTPJant. These results demonstrate that vTPJpost and vTPJcent mediate the reorientation of covert attention to task relevant stimuli, thus playing a critical role in visual attention. These findings reveal a differential reorienting cortical response after observers' attention has been oriented to a given location voluntarily or involuntarily.

Examining the Role of Attention and Sensory Stimulation in the Attentional Repulsion Effect

It has been suggested that visual attention warps space, such that stimuli appearing near its locus are perceived as farther away than they actually are. This is known as the attentional repulsion effect (ARE). Recent data challenge the role of attention as the sole factor responsible for the ARE, suggesting instead that the ARE is, at least in part, a product of low level sensory interactions between a peripheral orienting cue and the Vernier target stimulus used to measure the effect. Here, we directly test whether attentional orienting, without a cue in peripheral vision to guide attention, is sufficient for generating an ARE. In Experiment 1, attention was guided to the visual periphery by a central symbolic cue that reliably indicated the locations of to-be-identified targets in peripheral vision. On a subset of trials, we probed for an ARE with Vernier targets. Reaction time (RT) data revealed that the cue guided attention but there was no trace of an ARE. In Experiment 2, we ensured that the Vernier targets were sensitive to the ARE by using the standard spatially uninformative peripheral cue to guide attention instead of the central symbolic cue. RT data again revealed that the cue guided attention, while the Vernier targets revealed an ARE. Collectively, these data suggest that attentional orienting without peripheral sensory stimulation is not sufficient for generating an ARE.

Cue frequency modulates cuing effect either in the presence or in the absence of distractors

A novel, salient stimulus, even though it is not related to a concurrent goal-directed behavior, powerfully captures people's attention. While this stimulus-driven attentional capture has long been presumed to take place in a purely bottom-up or automatic manner, growing evidence shows that a number of top-down factors modulate the stimulus-driven capture of attention. Recent studies pointed out the cue presentation frequency is such a factor; the capture of attention by a salient, task-irrelevant cue increased as its presentation frequency decreased. Expanding these studies, we investigated how the modulatory effect of the cue frequency differs depending on the level of competition between multiple stimuli. As results, we found that an infrequently presented cue exerted stronger capture effect than a frequently presented cue, either in the presence or in the absence of distractors. Importantly, in the absence of distractors, performance difference elicited by the frequently present cue was due to non-attentional sensory artifacts or decisional noise. However, the same frequent cue evoked genuine attentional effect when multiple distractors accompanied the target, evoking stimulus-driven competition. Taken together, these results demonstrate that the effect of attentional cue is modulated by cue frequency, and this modulation is also affected by stimulus-driven competition.

Dynamics of Feature-based Attentional Selection during Color–Shape Conjunction Search

Feature-based attentional selection is accomplished by increasing the gain of sensory neurons encoding target-relevant features while decreasing that of other features. But how do these mechanisms work when targets and distractors share features? We investigated this in a simplified color–shape conjunction search task using ERP components (N2pc, PD, and SPCN) that index lateralized attentional processing. In Experiment 1, we manipulated the presence and frequency of color distractors while holding shape distractors constant. We tested the hypothesis that the color distractor would capture attention, requiring active suppression such that processing of the target can continue. Consistent with this hypothesis, we found that color distractors consistently captured attention, as indexed by a significant N2pc, but were reactively suppressed (indexed by PD). Interestingly, when the color distractor was present, target processing was sustained (indexed by SPCN), suggesting that the dynamics of attentional competition involved distractor suppression interlinked with sustained target processing. In Experiment 2, we examined the contribution of shape to the dynamics of attentional competition under similar conditions. In contrast to color distractors, shape distractors did not reliably capture attention, even when the color distractor was very frequent and attending to target shape would be beneficial. Together, these results suggest that target-colored objects are prioritized during color–shape conjunction search, and the ability to select the target is delayed while target-colored distractors are actively suppressed.

Endogenous spatial attention during perceptual learning facilitates location transfer

Covert attention and perceptual learning enhance perceptual performance. The relation between these two mechanisms is largely unknown. Previously, we showed that manipulating involuntary, exogenous spatial attention during training improved performance at trained and untrained locations, thus overcoming the typical location specificity. Notably, attention-induced transfer only occurred for high stimulus contrasts, at the upper asymptote of the psychometric function (i.e., via response gain). Here, we investigated whether and how voluntary, endogenous attention, the top-down and goal-based type of covert visual attention, influences perceptual learning. Twenty-six participants trained in an orientation discrimination task at two locations: half of participants received valid endogenous spatial precues (attention group), while the other half received neutral precues (neutral group). Before and after training, all participants were tested with neutral precues at two trained and two untrained locations. Within each session, stimulus contrast varied on a trial basis from very low (2%) to very high (64%). Performance was fit by a Weibull psychometric function separately for each day and location. Performance improved for both groups at the trained location, and unlike training with exogenous attention, at the threshold level (i.e., via contrast gain). The neutral group exhibited location specificity: Thresholds decreased at the trained locations, but not at the untrained locations. In contrast, participants in the attention group showed significant location transfer: Thresholds decreased to the same extent at both trained and untrained locations. These results indicate that, similar to exogenous spatial attention, endogenous spatial attention induces location transfer, but influences contrast gain instead of response gain.

Feature singletons attract spatial attention independently of feature priming

People perform better in visual search when the target feature repeats across trials (intertrial feature priming [IFP]). Here, we investigated whether repetition of a feature singleton's color modulates stimulus-driven shifts of spatial attention by presenting a probe stimulus immediately after each singleton display. The task alternated every two trials between a probe discrimination task and a singleton search task. We measured both stimulus-driven spatial attention (via the distance between the probe and singleton) and IFP (via repetition of the singleton's color). Color repetition facilitated search performance (IFP effect) when the set size was small. When the probe appeared at the singleton's location, performance was better than at the opposite location (stimulus-driven attention effect). The magnitude of this attention effect increased with the singleton's set size (which increases its saliency) but did not depend on whether the singleton's color repeated across trials, even when the previous singleton had been attended as a search target. Thus, our findings show that repetition of a salient singleton's color affects performance when the singleton is task relevant and voluntarily attended (as in search trials). However, color repetition does not affect performance when the singleton becomes irrelevant to the current task, even though the singleton does capture attention (as in probe trials). Therefore, color repetition per se does not make a singleton more salient for stimulus-driven attention. Rather, we suggest that IFP requires voluntary selection of color singletons in each consecutive trial.

Evidence for unlimited capacity processing of simple features in visual cortex

Performance in many visual tasks is impaired when observers attempt to divide spatial attention across multiple visual field locations. Correspondingly, neuronal response magnitudes in visual cortex are often reduced during divided compared with focused spatial attention. This suggests that early visual cortex is the site of capacity limits, where finite processing resources must be divided among attended stimuli. However, behavioral research demonstrates that not all visual tasks suffer such capacity limits: The costs of divided attention are minimal when the task and stimulus are simple, such as when searching for a target defined by orientation or contrast. To date, however, every neuroimaging study of divided attention has used more complex tasks and found large reductions in response magnitude. We bridged that gap by using functional magnetic resonance imaging to measure responses in the human visual cortex during simple feature detection. The first experiment used a visual search task: Observers detected a low-contrast Gabor patch within one or four potentially relevant locations. The second experiment used a dual-task design, in which observers made independent judgments of Gabor presence in patches of dynamic noise at two locations. In both experiments, blood-oxygen level-dependent (BOLD) signals in the retinotopic cortex were significantly lower for ignored than attended stimuli. However, when observers divided attention between multiple stimuli, BOLD signals were not reliably reduced and behavioral performance was unimpaired. These results suggest that processing of simple features in early visual cortex has unlimited capacity.

Detection costs and contingent attentional capture

Peripheral cues reduce reaction times (RTs) to targets at the cued location with short cue-target SOAs (cueing benefits) but increase RTs at long SOAs (cueing costs or inhibition of return). In detection tasks, cueing costs occur at shorter SOAs and are larger compared with identification tasks. To account for effects of task, detection cost theory claims that the integration of cue and target into an object file makes it more difficult to detect the target as a new event, which is the principal task-requirement in detection tasks. The integration of cue and target is expected to increase when cue and target are similar. We provided evidence for detection cost theory in the modified spatial cueing paradigm. Two types of cues (onset, color) were paired with two types of targets (onset, color) in separate blocks of trials. In the identification task, we found cueing benefits with matching (i.e., similar) cue-target pairs (onset-onset, color-color) and no cueing effects with nonmatching cue-target pairs (onset-color, color-onset), which replicates previous work. In the detection task, cueing effects with matching cues were reduced and even turned into cueing costs for onset cues with onset targets, suggesting that cue-target integration made it more difficult to detect targets at the cued location as new events. In contrast, the results for nonmatching cue-target pairs were not affected by task. Furthermore, the pattern of false alarms in the detection task provides a measure of similarity that may explain the size of cueing benefits and costs.

Automaticity of phasic alertness: Evidence for a three-component model of visual cueing

The automaticity of phasic alertness is investigated using the attention network test. Results show that the cueing effect from the alerting cue-double cue-is strongly enhanced by the task relevance of visual cues, as determined by the informativeness of the orienting cue-single cue-that is being mixed (80 % vs. 50 % valid in predicting where the target will appear). Counterintuitively, the cueing effect from the alerting cue can be negatively affected by its visibility, such that masking the cue from awareness can reveal a cueing effect that is otherwise absent when the cue is visible. Evidently, then, top-down influences-in the form of contextual relevance and cue awareness-can have opposite influences on the cueing effect from the alerting cue. These findings lead us to the view that a visual cue can engage three components of attention-orienting, alerting, and inhibition-to determine the behavioral cueing effect. We propose that phasic alertness, particularly in the form of specific response readiness, is regulated by both internal, top-down expectation and external, bottom-up stimulus properties. In contrast to some existing views, we advance the perspective that phasic alertness is strongly tied to temporal orienting, attentional capture, and spatial orienting. Finally, we discuss how translating attention research to clinical applications would benefit from an improved ability to measure attention. To this end, controlling the degree of intraindividual variability in the attentional components and improving the precision of the measurement tools may prove vital.

Deconstructing Interocular Suppression: Attention and Divisive Normalization

In interocular suppression, a suprathreshold monocular target can be rendered invisible by a salient competitor stimulus presented in the other eye. Despite decades of research on interocular suppression and related phenomena (e.g., binocular rivalry, flash suppression, continuous flash suppression), the neural processing underlying interocular suppression is still unknown. We developed and tested a computational model of interocular suppression. The model included two processes that contributed to the strength of interocular suppression: divisive normalization and attentional modulation. According to the model, the salient competitor induced a stimulus-driven attentional modulation selective for the location and orientation of the competitor, thereby increasing the gain of neural responses to the competitor and reducing the gain of neural responses to the target. Additional suppression was induced by divisive normalization in the model, similar to other forms of visual masking. To test the model, we conducted psychophysics experiments in which both the size and the eye-of-origin of the competitor were manipulated. For small and medium competitors, behavioral performance was consonant with a change in the response gain of neurons that responded to the target. But large competitors induced a contrast-gain change, even when the competitor was split between the two eyes. The model correctly predicted these results and outperformed an alternative model in which the attentional modulation was eye specific. We conclude that both stimulus-driven attention (selective for location and feature) and divisive normalization contribute to interocular suppression.

In interocular suppression, a visible target presented in one eye can be rendered invisible by a competing image (the competitor) presented in the other eye. This phenomenon is a striking demonstration of the discrepancy between physical inputs to the visual system and perception, and it also allows neuroscientists to study how perceptual systems regulate competing information. Interocular suppression has been explained by mutually suppressive interactions (modeled by divisive normalization) between neurons that respond differentially to the two eyes. Attention, which selects relevant information in natural viewing condition, has also been found to play a role in interocular suppression. But the specific role of attentional modulation is still an open question. In this study, we proposed a computational model of interocular suppression integrating both attentional modulation and divisive normalization. By modeling the hypothetical neural responses and fitting the model to psychophysical data, we showed that interocular suppression involves an attentional modulation selective for the orientation of the competitor, and covering the spatial extent of the competitor. We conclude that both attention and divisive normalization contribute to interocular suppression, and that their impacts are distinguishable.

Integration trumps selection in object recognition

Finding and recognizing objects is a fundamental task of vision. Objects can be defined by several "cues" (color, luminance, texture, etc.), and humans can integrate sensory cues to improve detection and recognition [1-3]. Cortical mechanisms fuse information from multiple cues [4], and shape-selective neural mechanisms can display cue invariance by responding to a given shape independent of the visual cue defining it [5-8]. Selective attention, in contrast, improves recognition by isolating a subset of the visual information [9]. Humans can select single features (red or vertical) within a perceptual dimension (color or orientation), giving faster and more accurate responses to items having the attended feature [10, 11]. Attention elevates neural responses and sharpens neural tuning to the attended feature, as shown by studies in psychophysics and modeling [11, 12], imaging [13-16], and single-cell and neural population recordings [17, 18]. Besides single features, attention can select whole objects [19-21]. Objects are among the suggested "units" of attention because attention to a single feature of an object causes the selection of all of its features [19-21]. Here, we pit integration against attentional selection in object recognition. We find, first, that humans can integrate information near optimally from several perceptual dimensions (color, texture, luminance) to improve recognition. They cannot, however, isolate a single dimension even when the other dimensions provide task-irrelevant, potentially conflicting information. For object recognition, it appears that there is mandatory integration of information from multiple dimensions of visual experience. The advantage afforded by this integration, however, comes at the expense of attentional selection.

The effects of stimulus-driven competition and task set on involuntary attention

It is well established that involuntary attention—the exogenous capture of attention by salient but task-irrelevant stimuli—can strongly modulate target detection and discrimination performance. There is an ongoing debate, however, about how involuntary attention affects target performance. Some studies suggest that it results from enhanced perception of the target, whereas others indicate instead that it affects decisional stages of information processing. From a review of these studies, we hypothesized that the presence of distractors and task sets are key factors in determining the effect of involuntary attention on target perception. Consistent with this hypothesis, here we found that noninformative cues summoning involuntary attention affected perceptual identification of a target when distractors were present. This cuing effect could not be attributed to reduced target location uncertainty or decision bias. The only condition under which involuntary attention improved target perception in the absence of distractors occurred when observers did not adopt a task set to focus attention on the target location. We conclude that the perceptual effects of involuntary attention depend on distractor interference and the adoption of a task set to resolve such stimulus competition.