The role of cueing in attentional capture

Attentional Tunneling in Pilots During a Visual Tracking Task With a Head Mounted Display

OBJECTIVE

We examined whether active head aiming with a Helmet Mounted Display (HMD) can draw the pilot's attention away from a primary flight task. Furthermore, we examined whether visual clutter increases this effect.

BACKGROUND

Head up display symbology can result in attentional tunneling, and clutter makes it difficult to identify objects.

METHOD

Eighteen military pilots had to simultaneously perform an attitude control task while flying in clouds and a head aiming task in a fixed-base flight simulator. The former consisted of manual compensation for roll disturbances of the aircraft, while the latter consisted of keeping a moving visual target inside a small or large head-referenced circle. A "no head aiming" condition served as a baseline. Furthermore, all conditions were performed with or without visual clutter.

RESULTS

Head aiming led to deterioration of the attitude control task performance and an increase of the amount of roll-reversal errors (RREs). This was even the case when head aiming required minimal effort. Head aiming accuracy was significantly lower when the roll disturbances in the attitude control task were large compared to when they were small. Visual clutter had no effect on both tasks.

CONCLUSION

We suggest that active head aiming of HMD symbology can cause attentional tunneling, as expressed by an increased number of RREs and less accuracy on a simultaneously performed attitude control task.

APPLICATION

This study improves our understanding in the perceptual and cognitive effects of (military) HMDs, and has implications for operational use and possibly (re)design of HMDs.

Endogenous control is insufficient for preventing attentional capture in children and adults

Adults are known to have developed the ability to selectively focus their attention in a goal-driven (endogenous) manner but it is less clear at what stage in development (5-6 & 9-11 years) children can endogenously control their attention and whether they behave similarly to adults when managing distractions. In this study we administered a child-adapted cued visual search task to three age-groups: five- to six-year-olds (N = 45), nine- to eleven-year-olds (N = 42) and adults (N = 42). Participants were provided with a cue which either guided their attention towards or away from an upcoming target. On some trials, a singleton distracter was presented which participants needed to ignore. Participants completed three conditions where the cues were: 1) usually helpful (High Predictive), 2) usually unhelpful (Low Predictive) and 3) never helpful (Baseline) in guiding attention towards the target. We found that endogenous cue-utilisation develops with increasing age. Overall, nine- to eleven-year-olds and adults, but not five- to six-year-olds, utilised the endogenous cues in the High Predictive condition. However, all age-groups were unable to ignore the singleton distracter even when using endogenous control. Moreover, we found better cue-maintenance ability was related to poorer distracter-inhibition ability in early-childhood, but these skills were no longer related further on in development. We conclude that overall endogenous control is still developing in early-childhood, but an adult-like form of this skill has been acquired by mid-childhood. Furthermore, endogenous cue-utilisation was shown as insufficient for preventing attentional capture in both children and adults.

Information-optimal local features automatically attract covert and overt attention

In fast vision, local spatial properties of the visual scene can automatically capture the observer's attention. We used specific local features, predicted by a constrained maximum-entropy model to be optimal information-carriers, as candidate "salient features''. Previous studies showed that participants choose these optimal features as "more salient" if explicitly asked. Here, we investigated the implicit saliency of these optimal features in two attentional tasks. In a covert-attention experiment, we measured the luminance-contrast threshold for discriminating the orientation of a peripheral gabor. In a gaze-orienting experiment, we analyzed latency and direction of saccades towards a peripheral target. In both tasks, two brief peripheral cues, differing in saliency according to the model, preceded the target, presented on the same (valid trials) or the opposite side (invalid trials) of the optimal cue. Results showed reduced contrast thresholds, saccadic latencies, and direction errors in valid trials, and the opposite in invalid trials, compared to baseline values obtained with equally salient cues. Also, optimal features triggered more anticipatory saccades. Similar effects emerged in a luminance-control condition. Overall, in fast vision, optimal features automatically attract covert and overt attention, suggesting that saliency is determined by information maximization criteria coupled with computational limitations.

Implicitly and explicitly encoded features can guide attention in free viewing

It is well known that priming, probably by the contents of working memory, can influence subsequent visual task performance. How ubiquitous is this effect? Can incidental exposure to visual stimuli influence the deployment of attention when there is no explicit visual task? Results of two experiments show that a preceding stimulus can influence free-viewing eye movements. A simple change detection task was used as the cover task. The initial memory display was the priming display, while subsequent filler display constituted the free-viewing display of our interest. In Experiment 1, subjects were asked to memorize the number of items in the priming display. Subjects were not explicitly instructed to attend to features, but these might still be implicitly encoded. In Experiment 2, a more complex change detection task required subjects to memorize the number, color, and shape of priming items. Here, prime features were attended and, presumably, explicitly encoded. We were interested to know whether incidentally or explicitly encoded features of prime items would influence attention distribution in the filler display. In both experiments, items sharing color and shape with the prime were attended more often than predicted by chance. Items sharing neither color nor shape were attended less often. Items sharing either color or shape (not both) could also attract attention showing that the priming need not be based on a bound representation of the primed item. Effects were stronger in Experiment 2. No intention or top-down control appears to be needed to produce this priming.

Learned prioritization yields attentional biases through selection history

While numerous studies have provided evidence for selection history as a robust influence on attentional allocation, it is unclear precisely which behavioral factors can result in this form of attentional bias. In the current study, we focus on “learned prioritization” as an underlying mechanism of selection history and its effects on selective attention. We conducted two experiments, each starting with a training phase to ensure that participants learned different stimulus priorities. This was accomplished via a visual search task in which a specific color was consistently more relevant when presented together with another given color. In Experiment 1, one color was always prioritized over another color and inferior to a third color, such that each color had an equal overall priority by the end of the training session. In Experiment 2, the three different colors had unequal priorities at the end of the training session. A subsequent testing phase in which participants had to search for a shape-defined target showed that only stimuli with unequal overall priorities (Experiment 2) affected attentional selection, with increased reaction times when a distractor was presented in a previously high-priority compared with a low-priority color. These results demonstrate that adopting an attentional set where certain stimuli are prioritized over others can result in a lingering attentional bias and further suggest that selection history does not equally operate on all previously selected stimuli. Finally, we propose that findings in value-driven attention studies where high-value and low-value signaling stimuli differentially capture attention may be a result of learned prioritization rather than reward.

Changes (but not differences) in motion direction fail to capture attention

In this study we investigated under what conditions motion direction changes pop out in continuously moving target/distractor environments. Participants were presented with vertically oriented Gabor patches whose carrier components drifted at a constant speed from left to right and then reversed direction. On any given trial, one of these elements was nominated as the target and the remaining elements were distractors. Distractor elements all changed direction simultaneously. The distractors either moved in a homogeneous manner (i.e. all moved in the same direction), or in a heterogeneous manner (i.e. direction was randomized). The target moved with a similar spatio-temporal trajectory as the distractors from left to right (or vice versa), but changed direction asynchronously with respect to the distracting elements. The participants' task was to locate this deviant (target) Gabor patch. We show that a motion direction change pops out (as indicated by the absence of a set size effect) when the surrounding distractors move in a homogeneous direction. When the distractors moved in heterogenous directions, a similar pop out effect was observed when the set size was small (≤5 elements), but not when it was large. This suggests that motion direction changes capture attention only when the change results in a unique direction of motion. Consistent with this finding we also show that a moving target (without direction change) captures attention in cases in which all distractors recently changed direction. This corroborates the idea that, in addition to direction cues, the temporal uniqueness of a change in an object's direction (or absence, thereof) relative to surrounding objects is a cue capable of capturing attention.

Feature-based attention: it is all bottom-up priming

Feature-based attention (FBA) enhances the representation of image characteristics throughout the visual field, a mechanism that is particularly useful when searching for a specific stimulus feature. Even though most theories of visual search implicitly or explicitly assume that FBA is under top-down control, we argue that the role of top-down processing in FBA may be limited. Our review of the literature indicates that all behavioural and neuro-imaging studies investigating FBA suffer from the shortcoming that they cannot rule out an effect of priming. The mere attending to a feature enhances the mandatory processing of that feature across the visual field, an effect that is likely to occur in an automatic, bottom-up way. Studies that have investigated the feasibility of FBA by means of cueing paradigms suggest that the role of top-down processing in FBA is limited (e.g. prepare for red). Instead, the actual processing of the stimulus is needed to cause the mandatory tuning of responses throughout the visual field. We conclude that it is likely that all FBA effects reported previously are the result of bottom-up priming.

Cross-modal associations between vision, touch, and audition influence visual search through top-down attention, not bottom-up capture

Recently, Guzman-Martinez, Ortega, Grabowecky, Mossbridge, and Suzuki (Current Biology : CB, 22(5), 383-388, 2012) reported that observers could systematically match auditory amplitude modulations and tactile amplitude modulations to visual spatial frequencies, proposing that these cross-modal matches produced automatic attentional effects. Using a series of visual search tasks, we investigated whether informative auditory, tactile, or bimodal cues can guide attention toward a visual Gabor of matched spatial frequency (among others with different spatial frequencies). These cues improved visual search for some but not all frequencies. Auditory cues improved search only for the lowest and highest spatial frequencies, whereas tactile cues were more effective and frequency specific, although less effective than visual cues. Importantly, although tactile cues could produce efficient search when informative, they had no effect when uninformative. This suggests that cross-modal frequency matching occurs at a cognitive rather than sensory level and, therefore, influences visual search through voluntary, goal-directed behavior, rather than automatic attentional capture.

On the limits of top-down control of visual selection

In the present study, observers viewed displays in which two equally salient color singletons were simultaneously present. Before each trial, observers received a word cue (e.g., the word red, or green) or a symbolic cue (a circle colored red or green) telling them which color singleton to select on the upcoming trial. Even though many theories of visual search predict that observers should be able to selectively attend the target color singleton, the results of the present study show that observers could not select the target singleton without interference from the irrelevant color singleton. The results indicate that the irrelevant color singleton captured attention. Only when the color of the target singleton remained the same from one trial to the next was selection perfect—an effect that is thought to be the result of passive automatic intertrial priming. The results of the present study demonstrate the limits of top-down attentional control.

Does hallucination affect vigilance performance in schizophrenia? An exploratory study

The present study investigates the role of "auditory verbal hallucination" (AVH) in the attentional processes of individuals diagnosed with schizophrenia compared with healthy participants. The sample consisted of 26 participants diagnosed with schizophrenia divided into - "schizophrenia with hallucination" (N=12) and "schizophrenia without hallucination" (N=14). 13 matched healthy participants were taken. A general health questionnaire was used to screen out psychiatric morbidity in healthy participants. The presence and/or absence of AVH were substantiated through the administration of the Positive and Negative Syndrome Scale (PANSS). Only individuals having higher composite scores in the positive scale were included. Edinburgh Handedness Inventory was administered to all participants. Software designed to measure vigilance was used to assess attentional deficits in the three groups included in the study. The complexity of the "vigilance task" was varied across three parameters: (1) spatial position of the target stimulus and buffer, (2) frequency of the target stimulus and buffer and (3) colour of target stimulus and buffer. The performances of the 3 groups were compared statistically in terms of Hit, Miss and False Alarm scores. Results revealed that schizophrenia patients are deficient as compared to their healthy counterparts in the ability to focus on a specific target while inhibiting non-relevant information across all conditions. Also, schizophrenia patients who have AVH are relatively more deficient as compared to the schizophrenia patients without AVH. It can be concluded that perceptual abnormality in schizophrenia patients with hallucination has an additional negative impact on attentional processes.

Looking, language, and memory: bridging research from the visual world and visual search paradigms

In the visual world paradigm as used in psycholinguistics, eye gaze (i.e. visual orienting) is measured in order to draw conclusions about linguistic processing. However, current theories are underspecified with respect to how visual attention is guided on the basis of linguistic representations. In the visual search paradigm as used within the area of visual attention research, investigators have become more and more interested in how visual orienting is affected by higher order representations, such as those involved in memory and language. Within this area more specific models of orienting on the basis of visual information exist, but they need to be extended with mechanisms that allow for language-mediated orienting. In the present paper we review the evidence from these two different - but highly related - research areas. We arrive at a model in which working memory serves as the nexus in which long-term visual as well as linguistic representations (i.e. types) are bound to specific locations (i.e. tokens or indices). The model predicts that the interaction between language and visual attention is subject to a number of conditions, such as the presence of the guiding representation in working memory, capacity limitations, and cognitive control mechanisms.

Top-down and bottom-up control of visual selection

The present paper argues for the notion that when attention is spread across the visual field in the first sweep of information through the brain visual selection is completely stimulus-driven. Only later in time, through recurrent feedback processing, volitional control based on expectancy and goal set will bias visual selection in a top-down manner. Here we review behavioral evidence as well as evidence from ERP, fMRI, TMS and single cell recording consistent with stimulus-driven selection. Alternative viewpoints that assume a large role for top-down processing are discussed. It is argued that in most cases evidence supporting top-down control on visual selection in fact demonstrates top-down control on processes occurring later in time, following initial selection. We conclude that top-down knowledge regarding non-spatial features of the objects cannot alter the initial selection priority. Only by adjusting the size of the attentional window, the initial sweep of information through the brain may be altered in a top-down way.

The limits of top-down control of visual attention

The extent to which spatial selection is driven by the goals of the observer and by the properties of the environment is one of the major issues in the field of visual attention. Here we review recent experimental evidence from behavioral and eye movement studies suggesting that top-down control has temporal and spatial limits. More specifically, we argue that the first feedforward sweep of information is bottom-up, and that top-down control can influence selection only after the sweep is completed. In addition, top-down control can limit spatial selection through adjusting the size of attentional window, an area of visual space which receives priority in information sampling. Finally, we discuss the evidence found using brain imaging techniques for top-down control in an attempt to reconcile it with behavioral findings. We conclude by discussing theoretical implications of these results for the current models of visual selection.

Interactions between working memory, attention and eye movements

This paper reviews the recent findings on working memory, attention and eye movements. We discuss the research that shows that many phenomena related to visual attention taking place when selecting relevant information from the environment are similar to processes needed to keep information active in working memory. We discuss new data that show that when retrieving information from working memory, people may allocate visual spatial attention to the empty location in space that used to contain the information that has to be retrieved. Moreover, we show that maintaining a location in working memory not only may involve attention rehearsal, but might also recruit the oculomotor system. Recent findings seem to suggest that remembering a location may involve attention-based rehearsal in higher brain areas, while at the same time there is inhibition of specific motor programs at lower brain areas. We discuss the possibility that working memory functions do not reside at a special area in the brain, but emerge from the selective recruitment of brain areas that are typically involved in spatial attention and motor control.

On the generality of the contingent orienting hypothesis

The contingent-orienting hypothesis states that attentional capture by a task-irrelevant stimulus is contingent on whether that stimulus shares a feature property that is critical to the task at hand [Folk, C. L., Remington, R. W., & Johnston, J. C. (1992). Involuntary covert orienting is contingent on attentional control settings. Journal of Experimental Psychology: Human Perception and Performance, 18, 1030-1044]. Studies supporting this hypothesis have mostly used set size four displays throughout the experiment and thus constrict its ecological validity, since conclusions drawn from experiments using fixed set-size displays may not be generalized to other conditions with different set sizes. We used a spatial cueing paradigm in which a non-informative onset or color cue preceded an onset or a color target, and manipulated set size as a within- or between-subject factor. In four experiments, the original finding of Folk et al. (1992) was replicated only when a fixed set size (four) was used throughout. When both set-size four and eight were used in an experiment, stimulus-driven capture by onset in search of a color target was found even for set-size four displays. These results raise doubts as to the generality of the contingent-orienting hypothesis and help to delineate the boundary conditions on this hypothesis.