Unique Temporal Change Is the Key to Attentional Capture

Catalyzing social change: Does concentration encourage action?

Countless social problems demand solutions, from climate change and gun control to poverty and systemic racism. But while some of these problems inspire action (e.g., "Black Lives Matter" and "Me Too" movements), most fail to gain traction or inspire new policy. Why do some problems garner more attention and response? We suggest that the relative timing of related events may play an important role. Specifically, action may be more likely when related events are concentrated in time. A multi-method investigation tests this possibility. Study 1 borrows a modeling strategy from the economics and marketing literatures to examine a particularly important domain: gun control. Analysis of over 40 years of gun control legislation finds that, even after controlling for the frequency of mass shootings, bills are more likely to be proposed (and passed) when shootings are concentrated in time. Study 2 further tests concentration's causal impact and demonstrates that concentration increases support against sexual assault. These findings illustrate how a modeling approach commonly used to study advertising goodwill can be applied to a broader set of situations, suggest why some social problems are more likely to catalyze action, and shed light on drivers of social movements and collective action.

AtAwAR Translate: Attention-Aware Language Translation Application in Augmented Reality for Mobile Phones

As lightweight, low-cost EEG headsets emerge, the feasibility of consumer-oriented brain-computer interfaces (BCI) increases. The combination of portable smartphones and easy-to-use EEG dry electrode headbands offers intriguing new applications and methods of human-computer interaction. In previous research, augmented reality (AR) scenarios have been identified to profit from additional user state information-such as that provided by a BCI. In this work, we implemented a system that integrates user attentional state awareness into a smartphone application for an AR written language translator. The attentional state of the user is classified in terms of internally and externally directed attention by using the Muse 2 electroencephalography headband with four frontal electrodes. The classification results are used to adapt the behavior of the translation app, which uses the smartphone's camera to display translated text as augmented reality elements. We present the first mobile BCI system that uses a smartphone and a low-cost EEG device with few electrodes to provide attention awareness to an AR application. Our case study with 12 participants did not fully support the assumption that the BCI improves usability. However, we are able to show that the classification accuracy and ease of setup are promising paths toward mobile consumer-oriented BCI usage. For future studies, other use cases, applications, and adaptations will be tested for this setup to explore the usability.

Automatic capture of attention by flicker

Visual motion captures attention, but little is known about the automaticity of these effects. Here, we tested if deviant flicker frequencies, as one form of motion, automatically capture attention. Observers searched for a vertical target among tilted distractors. Prior to the target display, a cue array of sinusoidally modulating (flickering) annuli, each surrounding one location of the subsequent target(-plus-distractors) display was presented for variable durations. Annuli either flickered all at 1 Hz (neutral condition, no-singleton cue), or a single annulus flickered at a unique frequency of 5 Hz, 10 Hz, or 15 Hz. The location of this singleton-frequency cue was uncorrelated with target location. Thus, we could measure benefits (target at cued location) and costs (target ≠ cued location) for cues of different frequencies and durations. The results showed that deviant flicker frequencies capture attention, as we observed benefits and costs, falsifying that nonspatial filtering accounted for the cueing effect. In line with automatic capture, cueing was effective in singleton (Experiment 1) and nonsingleton search tasks (Experiment 2), and is thus not dependent on (“top-down”) singleton detection mode. Moreover, analysis of results ruled out trial-by-trial “swapping” of flicker frequencies from preceding target to subsequent distractor locations. Results also revealed increasing cueing effects with higher cue flicker frequency and longer duration. This indicates a significantly longer period of automatic capture by sinusoidal flicker than the typical inhibition of return observed around 250 ms after the onset of uninformative static or single-transient cues.

Attentional dwelling and capture by color singletons

Can salient stimuli-such as color singletons and abrupt onsets-involuntarily capture spatial attention? We previously reported evidence that abrupt onsets can capture attention, but the effects of this capture can become latent under easy visual search. The present experiments examined whether a similar pattern of latent capture occurs for task-irrelevant color singletons. Participants searched for a perfect circle among oval distractors. We manipulated search difficulty by varying the width of the oval distractors, making them more or less target-like (i.e., more or less circular). With search displays of homogeneous distractors, cue validity effects increased linearly with search difficulty, indicating capture by color singletons (Experiments 1 and 2). With heterogeneous distractors, however, discouraging the use of singleton-detection mode to find the target circle, cue validity effects from color singletons were negligible at all difficulty levels (Experiment 3). Using these exact same heterogeneous search displays, meanwhile, abrupt onsets produced very large cue validity effects (Experiment 4). We conclude that whereas abrupt onsets can capture attention based purely on salience, static color singletons capture attention only when made task-relevant by promoting singleton-detection mode (i.e., contingent capture). The data further support an attentional dwelling account of capture costs and reinforce the recommendation that, to ensure sensitivity to detect the presence (or absence) of attention capture, capture experiments should employ a difficult visual search.

Utilitarian Attention by Children with Autism Spectrum Disorder on a Filtering Task

The findings are evidence that persons with ASD benefit more than typically developing (TD) persons from spatial framing cues in focusing their attention on a visual target. Participants were administered a forced-choice task to assess visual filtering. A target stimulus was presented on a screen and flanker stimuli were presented simultaneously with or after the target, with varying stimuli onset asynchronies (SOAs). Regardless of SOA, TD children showed the expected distracting effects with slower reaction times (RTs) when flankers were at closer distances from the target. However, children with ASD displayed shorter RTs in the conditions in which the stimuli were presented simultaneously or with a short SOA. These findings are interpreted as reflecting utilitarian attention among children with ASD.

The Effect of Ratio of Changing to Static Stimuli on the Attentional Capture

Studies have shown that appearing or disappearing objects attract more attention than static objects. This study examined the modulation of attention attracted by transient signals by systematically manipulating the ratio of changing (appearing/disappearing) to static stimuli. The results revealed that the effect of transient stimuli in attracting attention was diminished by simultaneously appearing (disappearing) peripheral stimuli and that the position where nothing was presented (the remaining stimulus) attracted attention when the number of appearing (disappearing) peripheral stimuli was increased. These findings suggest that the sudden change does not always capture attention, and whether changed things are attended or unchanged things are attended is determined depending on the proportion of things that change and do not change.

Change perception and change interference within and across feature dimensions

The ability to perceive a change in a visual object is reduced when that change is presented in competition with other changes which are task-irrelevant. We performed two experiments which investigate the basis of this change interference effect. We tested whether change interference occurs as a consequence of some form of attentional capture, or whether the interference occurs at a stage prior to attentional selection of the task-relevant change. A modified probe-detection task was used to explore this issue. Observers were required to report the presence/absence of a specified change-type (colour, shape) in the probe, in a context in which - on certain trials - irrelevant changes occur in non-probe items. There were two key variables in these experiments: the attentional state of the observer, and the dimensional congruence of changes in the probe and non-probe items. Change interference was strongest when the irrelevant changes were the same as those on the report dimension. However the interference pattern persisted even when observers did not know the report dimension at the time the changes occurred. These results seem to rule out attention as a factor. Our results fit best with an interpretation in which change interference produces feature-specific sensory noise which degrades the signal quality of the target change.

Spatio-temporal dynamics of action-effect associations in oculomotor control

While there is ample evidence that actions are guided by anticipating their effects (ideomotor control) in the manual domain, much less is known about the underlying characteristics and dynamics of effect-based oculomotor control. Here, we address three open issues. 1) Is action-effect anticipation in oculomotor control reflected in corresponding spatial saccade characteristics in inanimate environments? 2) Does the previously reported dependency of action latency on the temporal effect delay (action-effect interval) also occur in the oculomotor domain? 3) Which temporal effect delay is optimally suited to develop strong action-effect associations over time in the oculomotor domain? Participants executed left or right free-choice saccades to peripheral traffic lights, causing an (immediate or delayed) action-contingent light switch in the upper vs. lower part of the traffic light. Results indicated that saccades were spatially shifted toward the location of the upcoming change, indicating anticipation of the effect (location). Saccade latency was affected by effect delay, suggesting that corresponding time information is integrated into event representations. Finally, delayed (vs. immediate) effects were more effective in strengthening action-effect associations over the course of the experiment, likely due to greater saliency of perceptual changes occurring during target fixation as opposed to changes during saccades (saccadic suppression). Overall, basic principles underlying ideomotor control appear to generalize to the oculomotor domain.

The role of unique color changes and singletons in attention capture

Previous studies have shown that a sudden color change is typically less salient in capturing attention than the onset of a new object. Von Mühlenen, Rempel, and Enns (Psychological Science 16: 979-986, 2005) showed that a color change can capture attention as effectively as the onset of a new object given that it occurs during a period of temporal calm, where no other display changes happen. The current study presents a series of experiments that further investigate the conditions under which a change in color captures attention, by disentangling the change signal from the onset of a singleton. The results show that the item changing color receives attentional priority irrespective of whether this change goes along with the appearance of a singleton or not.

Attentive Motion Discrimination Recruits an Area in Inferotemporal Cortex

Attentional selection requires the interplay of multiple brain areas. Theoretical accounts of selective attention predict different areas with different functional properties to support endogenous covert attention. To test these predictions, we devised a demanding attention task requiring motion discrimination and spatial selection and performed whole-brain imaging in macaque monkeys. Attention modulated the early visual cortex, motion-selective dorsal stream areas, the lateral intraparietal area, and the frontal eye fields. This pattern of activation supports early selection, feature-based, and biased-competition attention accounts, as well as the frontoparietal theory of attentional control. While high-level motion-selective dorsal stream areas did not exhibit strong attentional modulation, ventral stream areas V4d and the dorsal posterior inferotemporal cortex (PITd) did. The PITd in fact was, consistently across task variations, the most significantly and most strongly attention-modulated area, even though it did not exhibit signs of motion selectivity. Thus the recruitment of the PITd in attention tasks involving different kinds of motion analysis is not predicted by any theoretical account of attention. These functional data, together with known anatomical connections, suggest a general and possibly critical role of the PITd in attentional selection.

SIGNIFICANCE STATEMENT

Attention is the key cognitive function that selects sensory information relevant to the current goals, relegating other information to the shadows of consciousness. To better understand the neural mechanisms of this interplay between sensory processing and internal cognitive state, we must learn more about the brain areas supporting attentional selection. Here, to test theoretical accounts of attentional selection, we used a novel task requiring sustained attention to motion. We found that, surprisingly, among the most strongly attention-modulated areas is one that is neither selective for the sensory feature relevant for current goals nor one hitherto thought to be involved in attentional control. This discovery suggests a need for an extension of current theoretical accounts of the brain circuits for attentional selection.

Grasping remaps the distribution of visuospatial attention and enhances competing action activation

We examined how action goals influence the distribution of visuospatial attention near the body (Experiment 1) and how the temporal relationship between distractors and targets modifies shifts in visuospatial attention (Experiment 2). Targets were light emitting diodes (LEDs) in the left and right hemispace of a visual display. Following left or right target illumination, participants reached to point-to or grasp target object in blocked trials. Coincident with target onset, a distractor LED illuminated in the same or opposite hemispace between the initiation point and target, or no distractor appeared. In Experiment 1, during grasping there was a larger temporal interference effect (slower reach initiation) than with pointing. When grasping versus pointing, participants deviated more towards same-side distractors and away from opposite-side distractors. In Experiment 2, distractors onset 200ms prior to (-200-ms), coincident with (0 ms), or 200ms following (+200 ms) the target. For both reach types, -200-ms distractors had greater onset temporal interference than 0 ms and +200-ms distractors. For grasping, +200 ms distractors had larger temporal interference than 0 ms distractors. For -200-ms, reach trajectories deviated more towards opposite-side distractors and away from same-side distractors, the reverse of the pattern for 0 ms and +200-ms distractors.

Emotion biases voluntary vertical action only with visible cues

Emotional information influences our bodily experiences according to the space-valence metaphor (positive/negative is up/down). In the present study, we examined whether visible and invisible emotional stimuli could also modulate voluntary action. After observing an emotional image (e.g., positive, neutral, or negative), participants used a joystick to arbitrarily position a dot stimulus in a display. The emotional image was either masked (masked condition) or not (unmasked condition) via a continuous flash suppression technique, i.e., dynamic interocular masking. We found that in the unmasked condition, the placed position of the dot was significantly higher after observing the positive image compared with the negative image, but this difference was not present in the masked condition. Our findings suggest that conscious emotional information is necessary for activating sensorimotor representations of vertical directions, and voluntary action is performed based on these activations.

Oculomotor capture by irrelevant onsets with and without color contrast

It is widely known that irrelevant onsets (i.e., items appearing in previously empty locations) can automatically capture attention and attract our gaze. Some studies have shown that onset capture is stronger when the onset distractor matches the target feature, indicating that onset capture can be modulated by feature-based (top-down) tuning to the target. However, it is less clear whether and to what extent the perceptual saliency of the distractor can further modulate this effect. This study examined the effects of target similarity, competition between target and distractor, and bottom-up color contrast on the ability of onset distractor to capture the gaze, by varying the color (contrast) and stimulus-onset asynchrony of the onset distractor. The results clearly show that competition and feature-based attention modulate capture by the irrelevant onset to a large extent, whereas bottom-up color contrasts do not modulate onset capture. These results indicate the need to revise current accounts of gaze control.

The role of flicker and abrupt displacement in attention capture by motion onsets

Sunny and von Mühlenen (Psychonomic Bulletin & Review, 18, 1050-1056, 2011) showed that an onset of motion captured attention only when the motion was jerky (refreshed at 8 or 17 Hz), but not when it was smooth (33 or 100 Hz). However, it remained unclear why the onset of jerky motion captures attention. In the present study, we systematically tested the role of different aspects of jerky motion in capturing attention. Simple flicker without motion did not capture attention in the same way as jerky motion (Exp. 1). An abrupt displacement between 0.26° and 1.05° captured attention, irrespective of whether the stimulus subsequently continued to move smoothly (Exp. 2) or whether it remained stationary (Exps. 3 and 4). A displaced stimulus that was preceded briefly at the new location by a figure-8 placeholder did not capture attention (Exp. 5). These results are explained within a masking account, according to which abrupt onsets and abrupt displacements receive a processing advantage because they escape forward masking by the preceding figure-8 placeholders.

Seeing while acting: hand movements can modulate attentional capture by motion onset

The onset of new motion has been shown to be a very robust cause of attentional capture, generating a processing advantage for the location of motion onset regardless of the observer's concurrent goal. The present study, motivated by the common-coding account of action and perception, examined whether the effect of motion onset on visual attention can be modulated by the observer's mode of action. Specifically, the common-coding account predicts that preparing an action can render the features that are used in the action plan less available for visual processes. Consistent with this hypothesis, in Experiment 1 the magnitude of attentional capture caused by a single motion onset was reduced when this motion was similar to the observer's response (i.e., along the same axis). Similarly, in Experiment 2 the onset of a response-different motion gained a processing advantage over the response-similar motion onset when the two were presented simultaneously. Since both types of motion were present in every trial, the results of Experiment 2 suggest that response similarity affected visual-attentional processes rather than motor processes. Together, these results suggest that the processes of attentional prioritization caused by motion onset can be modulated by the observer's concurrent action.

Individual differences in distraction by motion predicted by neural activity in MT/V5

Individuals differ substantially in their susceptibility to distraction by irrelevant visual information. Previous research has uncovered how individual variability in the goal-driven component of attentional control influences distraction, yet it remains unknown whether other sources of variability between individuals also predict distraction. In this fMRI study, we showed that an individual's inherent sensitivity to passively viewed visual motion predicts his/her susceptibility to distraction by motion. Bilateral MT/V5 was localized in participants during passive viewing of moving stimuli, affording a baseline measure of motion sensitivity. Next, participants performed a visual search task with an irrelevant motion singleton distractor, and both behavioral and neural indices of distraction were recorded. Results revealed that both of these indices were predicted by the independent index of motion sensitivity. An additional analysis of moment-to-moment fluctuations in distraction within individuals revealed that distraction could be predicted by pretrial fMRI activity in several brain regions, including MT+, which likely reflected the observer's momentary propensity to process motion. Together, these results shed light on how variability in factors other than goal-driven processing, both within and between individuals, affects attentional control and one's perception of the visual world.

Novelty and saliency in attentional capture by unannounced motion singletons

The present study examined attentional capture by an unannounced motion singleton in a visual search task. The results showed that a motion singleton only captured attention on its first unannounced occurrence when the observers had not encountered moving items before in the experiment, whereas it failed to capture when observers were familiar with moving items. This indicates that motion can capture attention independently of top-down attentional control settings, but only when motion as a feature is unexpected and new. An additional experiment tested whether salient items can capture attention when all stimuli possess new and unexpected features, and novelty information cannot guide attention. The results showed that attention was shifted to the location of the salient item when all items were new and unexpected, reinforcing the view that salient items receive attentional priority. The implications of these results for current theories of attention are discussed.

Poke and pop: tactile-visual synchrony increases visual saliency

The majority of studies investigating interactions between vision and touch have typically explored single events, presenting one object at a time. The present study investigates how tactile-visual interactions affect competition between multiple visual objects in more dynamic cluttered environments. Participants searched for a horizontal or vertical line segment among distractor line segments of various orientations, all continuously changing color. Search times and search slopes were substantially reduced when the target color change was accompanied by a tactile signal. These benefits were observed even though the tactile signal was uninformative about the location, orientation, or color of the visual target. We conclude that tactile-visual synchrony guides attention in multiple object environments by increasing the saliency of the visual event.

Color singleton pop-out does not always poop out: an alternative to visual search

Folk psychology suggests that when an observer views a scene, a unique item will stand out and draw attention to itself. This belief stands in contrast to numerous studies in visual search that have found that a unique target item (e.g., a unique color) is not identified more quickly than a nonunique target. We hypothesized that this finding is the result of task demands of visual search, and that when the task does not involve visual search, uniqueness will pop out. We tested this hypothesis in a task in which observers were presented an array of letters and asked to respond aloud, as quickly as possible, with the identity of any one of the letters. The observers were significantly more likely to respond with a uniquely colored letter than would be expected by chance. In a task in which observers blurt out the first thing that they see, unique pop-out does not poop out.