Dissociating between the N2pc and attentional shifting: An attentional blink study

A dissociation between the effects of expectations and attention in selective visual processing

It is often claimed that probabilistic expectations affect visual perception directly, without mediation by selective attention. However, these claims have been disputed, as effects of expectation and attention are notoriously hard to dissociate experimentally. In this study, we used a new approach to separate expectations from attention. In four experiments (N = 60), participants searched for a target in a rapid serial visual presentation (RSVP) stream and had to identify a digit or a letter defined by a low-level cue (colour or shape). Expectations about the target's alphanumeric category were probabilistically manipulated. Since category membership is a high-level feature and since the target was embedded among many distractors that shared its category, targets from the expected category should not attract attention more than targets from the unexpected category. In the first experiment, these targets were more likely to be identified relative to targets from the unexpected category. Importantly, in the following experiments, we also included behavioural and electrophysiological indices of attentional guidance and engagement. This allowed us to examine whether expectations also modulated these or earlier attentional processes. Results showed that category-based expectations had no modulatory effects on attention, and only affected processing at later encoding-related stages. Alternative interpretation of expectation effects in terms of repetition priming or response bias were also ruled out. These observations provide new evidence for direct attention-independent expectation effects on perception. We suggest that expectations can adjust the threshold required for encoding expectations-congruent information, thereby affecting the speed with which target objects are encoded in working memory.

A computational account of conflict processing during mental imagery

Previous studies examining conflict processing within the context of a color-word Stroop task have focused on both stimulus and response conflicts. However, it has been unclear whether conflict can emerge independently of stimulus conflict. In this study, a novel arrow-gaze mental-rotation Stroop task was introduced to explore the interplay between conflict processing and mental rotation. A modelling approach was utilized to provide a process-level account of the findings. The results of our Stroop task indicate that conflict can emerge from mental rotation in the absence of stimulus conflict. The strength of this imagery conflict effect decreases and even reverses as mental rotation angles increase. Additionally, it was observed that participants responded more quickly and with greater accuracy to small rather than large face orientations. A comparison of three conflict diffusion models-the diffusion model for conflict tasks (DMC), the dual-stage two-phase model (DSTP), and the shrinking spotlight model (SSP)-yielded consistent support for the DSTP over the DMC and SSP in the majority of instances. The DSTP account of the experimental results revealed an increased nondecision time with increasing mental rotation, a reduction in interference from incompatible stimuli, and an improved drift rate in response selection phase, which suggests enhanced cognitive control. The findings from the model-based analysis provide evidence for a novel interaction between cognitive control and mental rotation.

Transient Attention Gates Access Consciousness: Coupling N2pc and P3 Latencies Using Dynamic Time Warping

The N2pc and P3 event-related potentials (ERPs), used to index selective attention and access to working memory and conscious awareness, respectively, have been important tools in cognitive sciences. Although it is likely that these two components and the underlying cognitive processes are temporally and functionally linked, such links have not yet been convincingly demonstrated. Adopting a novel methodological approach based on dynamic time warping (DTW), we provide evidence that the N2pc and P3 ERP components are temporally linked. We analyzed data from an experiment where 23 participants (16 women) monitored bilateral rapid serial streams of letters and digits in order to report a target digit indicated by a shape cue, separately for trials with correct responses and trials where a temporally proximal distractor was reported instead (distractor intrusion). DTW analyses revealed that N2pc and P3 latencies were correlated in time, both when the target or a distractor was reported. Notably, this link was weaker on distractor intrusion trials. This N2pc-P3 association is discussed with respect to the relationship between attention and access consciousness. Our results demonstrate that our novel method provides a valuable approach for assessing temporal links between two cognitive processes and their underlying modulating factors. This method allows to establish links and their modulator for any two time-series across all domains of the field (general-purpose MATLAB functions and a Python module are provided alongside this paper).

Terms of debate: Consensus definitions to guide the scientific discourse on visual distraction

Hypothesis-driven research rests on clearly articulated scientific theories. The building blocks for communicating these theories are scientific terms. Obviously, communication - and thus, scientific progress - is hampered if the meaning of these terms varies idiosyncratically across (sub)fields and even across individual researchers within the same subfield. We have formed an international group of experts representing various theoretical stances with the goal to homogenize the use of the terms that are most relevant to fundamental research on visual distraction in visual search. Our discussions revealed striking heterogeneity and we had to invest much time and effort to increase our mutual understanding of each other's use of central terms, which turned out to be strongly related to our respective theoretical positions. We present the outcomes of these discussions in a glossary and provide some context in several essays. Specifically, we explicate how central terms are used in the distraction literature and consensually sharpen their definitions in order to enable communication across theoretical standpoints. Where applicable, we also explain how the respective constructs can be measured. We believe that this novel type of adversarial collaboration can serve as a model for other fields of psychological research that strive to build a solid groundwork for theorizing and communicating by establishing a common language. For the field of visual distraction, the present paper should facilitate communication across theoretical standpoints and may serve as an introduction and reference text for newcomers.

Little engagement of attention by salient distractors defined in a different dimension or modality to the visual search target

Singleton distractors may inadvertently capture attention, interfering with the task at hand. The underlying neural mechanisms of how we prevent or handle distractor interference remain elusive. Here, we varied the type of salient distractor introduced in a visual search task: the distractor could be defined in the same (shape) dimension as the target, a different (color) dimension, or a different (tactile) modality (intra-dimensional, cross-dimensional, and, respectively, cross-modal distractor, all matched for physical salience); and besides behavioral interference, we measured lateralized electrophysiological indicators of attentional selectivity (the N2pc, Ppc, PD , CCN/CCP, CDA, and cCDA). The results revealed the intra-dimensional distractor to produce the strongest reaction-time interference, associated with the smallest target-elicited N2pc. In contrast, the cross-dimensional and cross-modal distractors did not engender any significant interference, and the target-elicited N2pc was comparable to the condition in which the search display contained only the target singleton, thus ruling out early attentional capture. Moreover, the cross-modal distractor elicited a significant early CCN/CCP, but did not influence the target-elicited N2pc, suggesting that the tactile distractor is registered by the somatosensory system (rather than being proactively suppressed), without, however, engaging attention. Together, our findings indicate that, in contrast to distractors defined in the same dimension as the target, distractors singled out in a different dimension or modality can be effectively prevented to engage attention, consistent with dimension- or modality-weighting accounts of attentional priority computation.

Social processing modulates the initial allocation of attention towards angry faces: evidence from the N2pc component

Previous research has shown that attentional bias towards angry faces is moderated by the activation of a social processing mode. More specifically, reliable cueing effects for angry face cues in the dot-probe task only occurred when participants performed a task that required social processing of the target stimuli. However, cueing effects are a rather distal measure of covert shifts in spatial attention. Thus, it remains unclear whether the social processing mode modulates initial allocation of attention to or attentional disengagement from angry faces. In the present study, we used the N2pc, an event-related potential component, as an index of attentional shifts towards angry faces. Participants performed a dot-probe task with two different target conditions while the electroencephalogram (EEG) was recorded. In the social target condition, target stimuli were socially meaningful (schematic faces), and in the non-social target condition, they were meaningless (scrambled schematic faces). The amplitude of the N2pc component elicited by angry face cues was significantly larger in the social target condition than in the non-social target condition. This pattern also occurred for behavioural cueing effects. These results suggest that the activation of a social processing mode due to current task demands affects the initial allocation of attention towards angry faces.

On preventing capture: Does greater salience cause greater suppression?

It has been proposed that salient objects have high potential to disrupt target performance, and so people learn to proactively suppress them, thereby preventing these salient distractors from capturing attention in the future. Consistent with this hypothesis, Gaspar et al. (Proceedings of the National Academy of Sciences, 113(13), 3693-3698, 2016) reported that the PD (believed to index suppression) was larger for high-salient color distractors than for low-salient color distractors. The present study looked for converging evidence that salience triggers suppression using established behavior measures of suppression. Following Gaspar et al., our participants searched for a yellow target circle among nine background circles, which sometimes included one circle with a unique color. The distractor was either high or low in salience with respect to the background circles. The question was whether the high-salient color would be proactively suppressed more strongly than the low-salient color. This was assessed using the capture-probe paradigm. On 33% of trials, probe letters appeared inside colored circles and participants were to report those letters. If high-salient colors are more strongly suppressed, then probe recall accuracy should be lower at locations with the high-salient color than those with the low-salient color. Experiment 1 found no such effect. A similar finding was observed in Experiment 2 after addressing possible floor effects. These findings suggest that proactive suppression is not caused by salience. We propose that the PD reflects not only proactive suppression but also reactive suppression.

The Distractor Positivity Component and the Inhibition of Distracting Stimuli

There has been a long-lasting debate about whether salient stimuli, such as uniquely colored objects, have the ability to automatically distract us. To resolve this debate, it has been suggested that salient stimuli do attract attention but that they can be suppressed to prevent distraction. Some research supporting this viewpoint has focused on a newly discovered ERP component called the distractor positivity (PD), which is thought to measure an inhibitory attentional process. This collaborative review summarizes previous research relying on this component with a specific emphasis on how the PD has been used to understand the ability to ignore distracting stimuli. In particular, we outline how the PD component has been used to gain theoretical insights about how search strategy and learning can influence distraction. We also review alternative accounts of the cognitive processes indexed by the PD component. Ultimately, we conclude that the PD component is a useful tool for understanding inhibitory processes related to distraction and may prove to be useful in other areas of study related to cognitive control.

Cross-modal enhancement of spatially unpredictable visual target discrimination during the attentional blink

The attentional blink can be substantially reduced by delivering a task-irrelevant sound synchronously with the second target (T2) embedded in a rapid serial visual presentation stream, which is further modulated by the semantic congruency between the sound and T2. The present study extended the cross-modal boost during attentional blink and the modulation of audiovisual semantic congruency in the spatial domain by showing that a spatially uninformative, semantically congruent (but not incongruent) sound could even improve the discrimination of spatially unpredictable T2 during attentional blink. T2-locked event-related potential (ERP) data yielded that the early cross-modal P195 difference component (184-234 ms) over the occipital scalp contralateral to the T2 location was larger preceding accurate than inaccurate discriminations of semantically congruent, but not incongruent, audiovisual T2s. Interestingly, the N2pc component (194-244 ms) associated with visual-spatial attentional allocation was enlarged for incongruent audiovisual T2s relative to congruent audiovisual and unisensory visual T2s only when they were accurately discriminated. These ERP findings suggest that the spatially extended cross-modal boost during attentional blink involves an early cross-modal interaction strengthening the perceptual processing of T2, without any sound-induced enhancement of visual-spatial attentional allocation toward T2. In contrast, the absence of an accuracy decrease in response to semantically incongruent audiovisual T2s may originate from the semantic mismatch capturing extra visual-spatial attentional resources toward T2.

Tuning to non-veridical features in attention and perceptual decision-making: An EEG study

When searching for a lost item, we tune attention to the known properties of the object. Previously, it was believed that attention is tuned to the veridical attributes of the search target (e.g., orange), or an attribute that is slightly shifted away from irrelevant features towards a value that can more optimally distinguish the target from the distractors (e.g., red-orange; optimal tuning). However, recent studies showed that attention is often tuned to the relative feature of the search target (e.g., redder), so that all items that match the relative features of the target equally attract attention (e.g., all redder items; relational account). Optimal tuning was shown to occur only at a later stage of identifying the target. However, the evidence for this division mainly relied on eye tracking studies that assessed the first eye movements. The present study tested whether this division can also be observed when the task is completed with covert attention and without moving the eyes. We used the N2pc in the EEG of participants to assess covert attention, and found comparable results: Attention was initially tuned to the relative colour of the target, as shown by a significantly larger N2pc to relatively matching distractors than a target-coloured distractor. However, in the response accuracies, a slightly shifted, "optimal" distractor interfered most strongly with target identification. These results confirm that early (covert) attention is tuned to the relative properties of an item, in line with the relational account, while later decision-making processes may be biased to optimal features.

Is covert attention necessary for programming accurate saccades? Evidence from saccade-locked event-related potentials

For decades, researchers have assumed that shifts of covert attention mandatorily occur prior to eye movements to improve perceptual processing of objects before they are fixated. However, recent research suggests that the N2pc component-a neural measure of covert attentional allocation-does not always precede eye movements. The current study investigated whether the N2pc component mandatorily precedes eye movements and assessed its role in the accuracy of gaze control. In three experiments, participants searched for a letter of a specific color (e.g., red) and directed gaze to it as a response. Electroencephalograms and eye movements were coregistered to determine whether neural markers of covert attention preceded the initial shift of gaze. The results showed that the presaccadic N2pc only occurred under limited conditions: when there were many potential target locations and distractors. Crucially, there was no evidence that the presence or magnitude of the presaccadic N2pc was associated with improved eye movement accuracy in any of the experiments. Interestingly, ERP decoding analyses were able to classify the target location well before the eyes started to move, which likely reflects a presaccadic cognitive process that is distinct from the attentional process measured by the N2pc. Ultimately, we conclude that the covert attentional mechanism indexed by the N2pc is not necessary for precise gaze control.

Distinct roles of theta and alpha oscillations in the process of contingent attentional capture

Introduction

Visual spatial attention can be captured by a salient color singleton that is contingent on the target feature. A previous study reported that theta (4-7 Hz) and alpha (8-14 Hz) oscillations were related to contingent attentional capture, but the corresponding attentional mechanisms of these oscillations remain unclear.

Methods

In this study, we analyzed the electroencephalogram data of our previous study to investigate the roles of capture-related theta and alpha oscillation activities. Different from the previous study that used color-changed placeholders as irrelevant cues, the present study adopted abrupt onsets of color singleton cues which tend to elicit phase-locked neural activities. In Experiment 1, participants completed a peripheral visual search task in which spatially uninformative color singleton cues were inside the spatial attentional window and a central rapid serial visual presentation (RSVP) task in which the same cues were outside the spatial attentional window. In Experiment 2, participants completed a color RSVP task and a size RSVP task in which the peripheral color singleton cues were contingent and not contingent on target feature, respectively.

Results

In Experiment 1, spatially uninformative color singleton cues elicited lateralized theta activities when they were contingent on target feature, irrespective of whether they were inside or outside the spatial attentional window. In contrast, the same color singleton cues elicited alpha lateralization only when they were inside the spatial attentional window. In Experiment 2, we further found that theta lateralization vanished if the color singleton cues were not contingent on target feature.

Discussion

These results suggest distinct roles of theta and alpha oscillations in the process of contingent attentional capture initiated by abrupt onsets of singleton cues. Theta activities may reflect global enhancement of target feature, while alpha activities may be related to attentional engagement to spatially relevant singleton cues. These lateralized neural oscillations, together with the distractor-elicited N2pc component, might consist of multiple stages of attentional processes during contingent attentional capture.

Integrated effects of top-down attention and statistical learning during visual search: An EEG study

The present study aims to investigate how the competition between visual elements is solved by top-down and/or statistical learning (SL) attentional control (AC) mechanisms when active together. We hypothesized that the "winner" element that will undergo further processing is selected either by one AC mechanism that prevails over the other, or by the joint activity of both mechanisms. To test these hypotheses, we conducted a visual search experiment that combined an endogenous cueing protocol (valid vs. neutral cue) and an imbalance of target frequency distribution across locations (high- vs. low-frequency location). The unique and combined effects of top-down control and SL mechanisms were measured on behaviour and amplitudes of three evoked-response potential (ERP) components (i.e., N2pc, P1, CNV) related to attentional processing. Our behavioural results showed better performance for validly cued targets and for targets in the high-frequency location. The two factors were found to interact, so that SL effects emerged only in the absence of top-down guidance. Whereas the CNV and P1 only displayed a main effect of cueing, for the N2pc we observed an interaction between cueing and SL, revealing a cueing effect for targets in the low-frequency condition, but not in the high-frequency condition. Thus, our data support the view that top-down control and SL work in a conjoint, integrated manner during target selection. In particular, SL mechanisms are reduced or even absent when a fully reliable top-down guidance of attention is at play.

One turn at a time: Behavioral and ERP evidence for two types of rotations in the classical mental rotation task

We perform mental rotations in many everyday situations, such as reading a map or following furniture assembling instructions. In a classical mental rotation task, participants are asked to judge whether a rotated stimulus is presented in its mirrored form or its canonical form. Previous results have indicated a degree effect: RT is longer as the angle of rotation increases, and this effect is traditionally explained by arguing that this judgment requires rotating the stimulus back to its upright form. Importantly, in half of the trials, the stimuli are rotated on both the page plane and mirror plane. Namely, we argue that in previous research the task actually involved two different rotation processes. To provide a clear dissociation between these two rotations, we collected EEG data and used the Contralateral Delay Activity (CDA) as an indicator of visual working memory (VWM) load. The results of Experiment 1 suggested different VWM involvement according to the degrees rotations when the item was not mirrored, such that the CDA amplitude generally increased as the degree of rotation was higher. Mirrored trials were all at ceiling in terms of CDA, regardless of their rotation degree. Experiment 2 showed increased CDA amplitude uniquely related to the flip rotation. Thus, we provided ERP evidence that the canonical mental rotation task involves two types of rotations that can be dissociated based on the load they imposed on VWM.

Effects of top-down and bottom-up attention on post-selection posterior contralateral negativity

We examined the effect of combined top-down and bottom-up attentional control sources in easy and difficult visual search tasks. Applying a new analysis on previously acquired data, we focused on the sustained posterior contralateral negativity (SPCN) and the response-locked posterior contralateral negativity (RLpcN), to better understand processes following target selection. We used the signed-area approach to measure the negative area, where the signal was either locked to the target or the response onsets. We further split the RLpcN into an early and a late segment to capture the dynamics of selection and post-selection processes. In Experiment 1, participants reported the orientation of a uniquely tilted target. In Experiment 2, participants reported the position of a small gap within the uniquely tilted target. In both experiments, endogenous cues manipulated top-down attention (valid vs. neutral), and salient color singletons (either the target or a distractor) manipulated bottom-up attention. We hypothesized that the SPCN and the later segment of the RLpcN would be modulated by task difficulty and target salience, as they are associated with post-selection processes, such as response selection and working memory. The early segment of the RLpcN was hypothesized to be modulated by the cueing manipulation and presence of a salient distractor, as they affect target selection. An effect of distractor presence was observed on the early segment of the RLpcN, and our results further supported the hypotheses regarding the SPCN and the later segment of the RLpcN, providing novel insights into post-selection processes in visual search.

The temporal dynamics of selective attention are reflected by distractor intrusions

When observers have to identify an object embedded in a rapid serial visual presentation (RSVP) stream, they often erroneously report the identity of a distractor instead of the target (distractor intrusion). In two experiments, we examined whether these intrusion errors are associated with the speed of attentional engagement. Participants reported the identity of target digits indicated by shape selection cues. To manipulate the speed of engagement, targets appeared either within a single RSVP stream or unpredictably in one of two streams. Objects that followed the selection cue were reported more frequently when engagement was delayed (two streams), whereas the probability of reporting objects preceding the cue was higher when engagement was faster (single stream). These results show that distractor intrusions are closely linked to the allocation of selective attention in time, making the intrusion paradigm a useful tool for research into the temporal dynamics of attention. They also provide new evidence for the idea that attentional selectivity operates within brief periods of perceptual enhancement (attentional episodes), facilitating the processing of all objects within this period, regardless of their status as targets or distractors.

Multisensory Rather than Unisensory Representations Contribute to Statistical Context Learning in Tactile Search

Using a combination of behavioral and EEG measures in a tactile odd-one-out search task with collocated visual items, we investigated the mechanisms underlying facilitation of search by repeated (vs. nonrepeated) spatial distractor-target configurations ("contextual cueing") when either the tactile (same-modality) or the visual array (different-modality) context was predictive of the location of the tactile singleton target. Importantly, in both conditions, the stimulation was multisensory, consisting of tactile plus visual items, although the target was singled out in the tactile modality and so the visual items were task-irrelevant. We found that when the predictive context was tactile, facilitation of search RTs by repeated configurations was accompanied by, and correlated with, enhanced lateralized ERP markers of pre-attentive (N1, N2) and, respectively focal-attentional processing (contralateral delay activity) not only over central ("somatosensory"), but also posterior ("visual") electrode sites, although the ERP effects were less marked over visual cortex. A similar pattern-of facilitated RTs and enhanced lateralized (N2 and contralateral delay activity) ERP components-was found when the predictive context was visual, although the ERP effects were less marked over somatosensory cortex. These findings indicate that both somatosensory and visual cortical regions contribute to the more efficient processing of the tactile target in repeated stimulus arrays, although their involvement is differentially weighted depending on the sensory modality that contains the predictive information.

The impact of retro-cue validity on working memory representation: Evidence from electroencephalograms

Visual working memory (VWM) performance can be improved by retrospectively cueing an item. The validity of retro-cues has an impact on the mechanisms underlying the retro-cue effect, but how non-cued representations are handled under different retro-cue validity conditions is not yet clear. Here, we used electroencephalograms to investigate whether retro-cue validity can affect the fate of non-cued representations in VWM. The participants were required to perform a change-detection task using a retro-cue with 80% or 20% validity. Contralateral delay activity and the lateralized alpha power were used to assess memory storage and selective attention, respectively. The retro-cue could redirect selective attention to the cued item under both validity conditions; however, the participants maintained the non-cued representations under the low-validity condition but dropped them from VWM under the high-validity condition. These results suggest that the maintenance of non-cued representations in VWM is affected by the expectation of cue validity and may be partially strategically driven. DATA AVAILABILITY: The datasets generated/analyzed during this study and experimental script have been added to https://osf.io/qtwc9/.

Cross-modal contextual memory guides selective attention in visual-search tasks

Visual search is speeded when a target item is positioned consistently within an invariant (repeatedly encountered) configuration of distractor items ("contextual cueing"). Contextual cueing is also observed in cross-modal search, when the location of the-visual-target is predicted by distractors from another-tactile-sensory modality. Previous studies examining lateralized waveforms of the event-related potential (ERP) with millisecond precision have shown that learned visual contexts improve a whole cascade of search-processing stages. Drawing on ERPs, the present study tested alternative accounts of contextual cueing in tasks in which distractor-target contextual associations are established across, as compared to, within sensory modalities. To this end, we devised a novel, cross-modal search task: search for a visual feature singleton, with repeated (and nonrepeated) distractor configurations presented either within the same (visual) or a different (tactile) modality. We found reaction times (RTs) to be faster for repeated versus nonrepeated configurations, with comparable facilitation effects between visual (unimodal) and tactile (crossmodal) context cues. Further, for repeated configurations, there were enhanced amplitudes (and reduced latencies) of ERPs indexing attentional allocation (PCN) and postselective analysis of the target (CDA), respectively; both components correlated positively with the RT facilitation. These effects were again comparable between uni- and crossmodal cueing conditions. In contrast, motor-related processes indexed by the response-locked LRP contributed little to the RT effects. These results indicate that both uni- and crossmodal context cues benefit the same, visual processing stages related to the selection and subsequent analysis of the search target.

Visual field inhomogeneous in brain-computer interfaces based on rapid serial visual presentation

OBJECTIVE

Visual attention is not homogeneous across the visual field, while how to mine the effective EEG characteristics that are sensitive to the inhomogeneous of visual attention and further explore applications such as the performance of brain-computer interface (BCI) are still distressing explorative scientists.

APPROACH

Images were encoded into a rapid serial visual presentation (RSVP) paradigm, and were presented in three visuospatial patterns (central, left/right, upper/lower) at the stimulation frequencies of 10Hz, 15Hz and 20Hz. The comparisons among different visual fields were conducted in the dimensions of subjective behavioral and EEG characteristics. Furthermore, the effective features (e.g. SSVEP, N2pc and P300) that sensitive to visual-field asymmetry were also explored.

RESULTS

The visual fields had significant influences on the performance of RSVP target detection, in which the performance of central was better than that of peripheral visual field, the performance of horizontal meridian was better than that of vertical meridian, the performance of left visual field was better than that of right visual field, and the performance of upper visual field was better than that of lower visual field. Furthermore, stimuli of different visual fields had significant effects on the spatial distributions of EEG, in which N2pc and P300 showed left-right asymmetry in occipital and frontal regions, respectively. In addition, the evidences of SSVEP characteristics indicated that there was obvious overlap of visual fields on the horizontal meridian, but not on the vertical meridian.

SIGNIFICANCE

The conclusions of this study provide insights into the relationship between visual field inhomogeneous and EEG characteristics. In addition, this study has the potential to achieve precise positioning of the target's spatial orientation in RSVP-BCIs.

The diachronic account of attentional selectivity

Many models of attention assume that attentional selection takes place at a specific moment in time that demarcates the critical transition from pre-attentive to attentive processing of sensory input. We argue that this intuitively appealing standard account of attentional selectivity is not only inaccurate, but has led to substantial conceptual confusion. As an alternative, we offer a 'diachronic' framework that describes attentional selectivity as a process that unfolds over time. Key to this view is the concept of attentional episodes, brief periods of intense attentional amplification of sensory representations that regulate access to working memory and response-related processes. We describe how attentional episodes are linked to earlier attentional mechanisms and to recurrent processing at the neural level. We review studies that establish the existence of attentional episodes, delineate the factors that determine if and when they are triggered, and discuss the costs associated with processing multiple events within a single episode. Finally, we argue that this framework offers new solutions to old problems in attention research that have never been resolved. It can provide a unified and conceptually coherent account of the network of cognitive and neural processes that produce the goal-directed selectivity in perceptual processing that is commonly referred to as 'attention'.

Does feature intertrial priming guide attention? The jury is still out

Our search performance is strongly influenced by our past experience. In the lab, this influence has been demonstrated by investigating a variety of phenomena, including intertrial priming, statistical learning, and reward history, and collectively referred to as selection history. The resulting findings have led researchers to claim that selection history guides attention, thereby challenging the prevailing dichotomy, according to which top-down and bottom-up factors alone determine attentional priority. Here, we re-examine this claim with regard to one selection-history phenomenon, feature intertrial priming (aka priming of pop-out). We evaluate the evidence that specifically pertains to the role of feature intertrial priming in attentional guidance, rather than in later selective processes occurring after the target is found. We distinguish between the main experimental rationales, while considering the extent to which feature intertrial priming, as studied through different protocols, shares characteristics of top-down attention. We show that there is strong evidence that feature intertrial priming guides attention when the experimental protocol departs from the canonical paradigm and encourages observers to maintain the critical feature in visual working memory or to form expectations about the upcoming target. By contrast, the current evidence regarding the standard feature intertrial priming phenomenon is inconclusive. We propose directions for future research and suggest that applying the methodology used here in order to re-evaluate of the role of other selection history phenomena in attentional guidance should clarify the mechanisms underlying the strong impact of past experience on visual search performance.

Inter-trial effects in priming of pop-out: Comparison of computational updating models

In visual search tasks, repeating features or the position of the target results in faster response times. Such inter-trial ‘priming’ effects occur not just for repetitions from the immediately preceding trial but also from trials further back. A paradigm known to produce particularly long-lasting inter-trial effects–of the target-defining feature, target position, and response (feature)–is the ‘priming of pop-out’ (PoP) paradigm, which typically uses sparse search displays and random swapping across trials of target- and distractor-defining features. However, the mechanisms underlying these inter-trial effects are still not well understood. To address this, we applied a modeling framework combining an evidence accumulation (EA) model with different computational updating rules of the model parameters (i.e., the drift rate and starting point of EA) for different aspects of stimulus history, to data from a (previously published) PoP study that had revealed significant inter-trial effects from several trials back for repetitions of the target color, the target position, and (response-critical) target feature. By performing a systematic model comparison, we aimed to determine which EA model parameter and which updating rule for that parameter best accounts for each inter-trial effect and the associated n-back temporal profile. We found that, in general, our modeling framework could accurately predict the n-back temporal profiles. Further, target color- and position-based inter-trial effects were best understood as arising from redistribution of a limited-capacity weight resource which determines the EA rate. In contrast, response-based inter-trial effects were best explained by a bias of the starting point towards the response associated with a previous target; this bias appeared largely tied to the position of the target. These findings elucidate how our cognitive system continually tracks, and updates an internal predictive model of, a number of separable stimulus and response parameters in order to optimize task performance.

In many perceptual tasks, performance is faster and more accurate when critical stimulus attributes are repeated from trial to trial compared to when they change. Priming of pop-out (PoP), visual search with sparse search displays and random swapping of the target feature between trials, is a paradigm in which such inter-trial effects can be traced back over several recent trial episodes. While many studies have explored PoP paradigms, the mechanisms underlying priming of the search-critical target feature, the target position, and the response-critical information are not yet fully understood. Here, we addressed this question by applying evidence accumulation (EA) decision models to the data from a previously published PoP study. The modeling framework combines evidence accumulation with Bayesian updating of the model parameters. Comparison of (> 1000) different combinations of decision models and updating rules revealed that the featural and positional priming effects were best explained by assuming that attentional “weight” resources are dynamically redistributed based on the recent history of target color and position, whereas response decisions are biased based on the recent history of the response-critical property of targets occuring at a particular (and nearby) position(s). These findings confirm that our cognitive system continually tracks, and updates an internal predictive model of, a number of separable stimulus and response parameters in order to optimize task performance.

Serial or parallel proactive control of components of task-set? A task-switching investigation with concurrent EEG and eye-tracking

Among the issues examined by studies of cognitive control in multitasking is whether processes underlying performance in the different tasks occur serially or in parallel. Here we ask a similar question about processes that pro-actively control task-set. In task-switching experiments, several indices of task-set preparation have been extensively documented, including anticipatory orientation of gaze to the task-relevant location (an unambiguous marker of reorientation of attention), and a positive polarity brain potential over the posterior cortex (whose functional significance is less well understood). We examine whether these markers of preparation occur in parallel or serially, and in what order. On each trial a cue required participants to make a semantic classification of one of three digits presented simultaneously, with the location of each digit consistently associated with one of three classification tasks (e.g., if the task was odd/even, the digit at the top of the display was relevant). The EEG positivity emerged following, and appeared time-locked to, the anticipatory fixation on the task-relevant location, which might suggest serial organisation. However, the fixation-locked positivity was not better defined than the cue-locked positivity; in fact, for the trials with the earliest fixations the positivity was better time-locked to the cue onset. This is more consistent with (re)orientation of spatial attention occurring in parallel with, but slightly before, the reconfiguration of other task-set components indexed by the EEG positivity.

What processes are disrupted during the attentional blink? An integrative review of event-related potential research

Reporting the second of two targets is impaired when these appear in close succession, a phenomenon known as the attentional blink (AB). Despite decades of research, what factors limit our ability to process multiple sequentially presented events remains unclear. Specifically, two central issues remain open: does failure to report the second target (T2) reflect a structural limitation in working memory (WM) encoding or a disruption to attentional processes? And is perceptual processing of the stimulus that we fail to report impaired, or only processes that occur after this stimulus is identified? We address these questions by reviewing event-related potential (ERP) studies of the AB, after providing a brief overview of the theoretical landscape relevant to these debates and clarifying key concepts essential for interpreting ERP studies. We show that failure to report the second target is most often associated with disrupted attentional engagement (associated with a smaller and delayed N2pc component). This disruption occurs after early processing of T2 (associated with an intact P1 component), weakens its semantic processing (typically associated with a smaller N400 component), and prevents its encoding into WM (associated with absent P3b). However, failure to encode T2 in WM can occur despite intact attentional engagement and semantic processing. We conclude that the AB phenomenon, which reflects our limited ability to process sequential events, emerges from the disruption of both attentional engagement and WM encoding.

Eye movements are not mandatorily preceded by the N2pc component

Researchers typically distinguish between two mechanisms of attentional selection in vision: overt and covert attention. A commonplace assumption is that overt eye movements are automatically preceded by shifts of covert attention during visual search. Although the N2pc component is a putative index of covert attentional orienting, little is currently known about its relationship with overt eye movements. This is because most previous studies of the N2pc component prohibit overt eye movements. The current study assessed this relationship by concurrently measuring covert attention (via the N2pc) and overt eye movements (via eye tracking). Participants searched displays for a lateralized target stimulus and were allowed to generate overt eye movements during the search. We then assessed whether overt eye movements were preceded by the N2pc component. The results indicated that saccades were preceded by an N2pc component, but only when participants were required to carefully inspect the target stimulus before initiating the eye movement. When participants were allowed to make naturalistic eye movements in service of visual search, there was no evidence of an N2pc component before eye movements. These findings suggest that the N2pc component does not always precede overt eye movements during visual search. Implications for understanding the relationship between covert and overt attention are discussed.

Controlling the Flow of Distracting Information in Working Memory

Visual working memory (WM) must maintain relevant information, despite the constant influx of both relevant and irrelevant information. Attentional control mechanisms help determine which of this new information gets access to our capacity-limited WM system. Previous work has treated attentional control as a monolithic process-either distractors capture attention or they are suppressed. Here, we provide evidence that attentional capture may instead be broken down into at least two distinct subcomponent processes: (1) Spatial capture, which refers to when spatial attention shifts towards the location of irrelevant stimuli and (2) item-based capture, which refers to when item-based WM representations of irrelevant stimuli are formed. To dissociate these two subcomponent processes of attentional capture, we utilized a series of electroencephalography components that track WM maintenance (contralateral delay activity), suppression (distractor positivity), item individuation (N2pc), and spatial attention (lateralized alpha power). We show that new, relevant information (i.e., a task-relevant distractor) triggers both spatial and item-based capture. Irrelevant distractors, however, only trigger spatial capture from which ongoing WM representations can recover more easily. This fractionation of attentional capture into distinct subcomponent processes provides a refined framework for understanding how distracting stimuli affect attention and WM.

Attentional Templates Are Sharpened through Differential Signal Enhancement, Not Differential Allocation of Attention

In visual search, the internal representation of the target feature is referred to as the attentional template. The attentional template can be broad or precise depending on the task requirements. In singleton search, the attentional template is broad because the target is the only colored element in the display. In feature search, a precise attentional template is required because the target is in a specific color in an array of varied colors. To measure the precision of the attentional template, we used a cue-target paradigm where cueing benefits decrease when the cue color differs from the target color. Consistent with broad and precise attentional templates, the decrease of cueing effects was stronger in feature than in singleton search. Measurements of ERPs showed that the N2pc elicited by the cue decreased with increasing color difference, suggesting that attention was more strongly captured by cues that were similar to the target. However, the cue-elicited N2pc did not differ between feature and singleton search, making it unlikely to reflect the mechanism underlying attentional template precision. Furthermore, there was no evidence for attentional suppression as there was no cue-elicited P_D, even in conditions where the cueing benefit turned into a same-location cost. However, an index of signal enhancement, the contralateral positivity, reflected attention template precision. In general, there was sensory enhancement of the stimulus appearing at the cued location in the search display. With broad attentional templates, any stimulus at the cued location was enhanced, whereas enhancement was restricted to target-matching colors with precise attentional templates.

Neural Evidence Suggests Both Interference and Facilitation from Embedding Regularity into Visual Search

In this work, we relied on electrophysiological methods to characterize the processing stages that are affected by the presence of regularity in a visual search task. EEG was recorded for 72 participants while they completed a visual search task. Depending on the group, the task contained a consistent-mapping condition, a random-mapping condition, or both consistent and random conditions intermixed (mixed group). Contrary to previous findings, the control groups allowed us to demonstrate that the contextual cueing effect that was observed in the mixed group resulted from interference, not facilitation, to the target selection, response selection, and response execution processes (N2-posterior-contralateral, stimulus-locked lateralized readiness potential [LRP], and response-locked LRP components). When the regularity was highly valid (consistent-only group), the presence of regularity drove performance beyond general practice effects, through facilitation in target selection and response selection (N2-posterior-contralateral and stimulus-locked LRP components). Overall, we identified two distinct effects created by the presence of regularity: a global effect of validity that dictates the degree to which all information is taken into account and a local effect of activating the information on every trial. We conclude that, when considering the influence of regularity on behavior, it is vital to assess how the overall reliability of the incoming information is affected.

The self-face captures attention without consciousness: Evidence from the N2pc ERP component analysis

It is well established that stimuli representing or associated with ourselves, like our own name or an image of our own face, benefit from preferential processing. However, two key questions concerning the self-prioritization mechanism remain to be addressed. First, does it operate in an automatic manner during the early processing, or rather in a more controlled fashion at later processing stages? Second, is it specific to the self-related stimuli, or can it be activated also by other stimuli that are familiar or salient? We conducted a dot-probe experiment to investigate the mechanism behind the attentional prioritization of the self-face image and to tackle both questions. The former, by employing a backwards masking procedure to isolate the early and preconscious processing stages. The latter, by investigating whether a face that becomes visually familiar due to repeated presentations is able to capture attention in a similar manner as the self-face. Analysis of the N2pc ERP component revealed that the self-face image automatically captures attention, both when processed consciously and unconsciously. In contrast, the visually familiar face did not attract attention, neither in the conscious, nor in the unconscious condition. We conclude that the self-prioritization mechanism is early and automatic, and is not triggered by mere visual familiarity. More generally, our results provide further evidence for efficient unconscious processing of faces, and for dissociation between attention and consciousness.

Neural mechanisms underlying expectation-dependent inhibition of distracting information

Predictions based on learned statistical regularities in the visual world have been shown to facilitate attention and goal-directed behavior by sharpening the sensory representation of goal-relevant stimuli in advance. Yet, how the brain learns to ignore predictable goal-irrelevant or distracting information is unclear. Here, we used EEG and a visual search task in which the predictability of a distractor's location and/or spatial frequency was manipulated to determine how spatial and feature distractor expectations are neurally implemented and reduce distractor interference. We find that expected distractor features could not only be decoded pre-stimulus, but their representation differed from the representation of that same feature when part of the target. Spatial distractor expectations did not induce changes in preparatory neural activity, but a strongly reduced Pd, an ERP index of inhibition. These results demonstrate that neural effects of statistical learning critically depend on the task relevance and dimension (spatial, feature) of predictions.

Automatic Guidance (and Misguidance) of Visuospatial Attention by Acquired Scene Memory: Evidence From an N1pc Polarity Reversal

Visual search is facilitated when the target is repeatedly encountered at a fixed position within an invariant (vs. randomly variable) distractor layout—that is, when the layout is learned and guides attention to the target, a phenomenon known as contextual cuing. Subsequently changing the target location within a learned layout abolishes contextual cuing, which is difficult to relearn. Here, we used lateralized event-related electroencephalogram (EEG) potentials to explore memory-based attentional guidance (N = 16). The results revealed reliable contextual cuing during initial learning and an associated EEG-amplitude increase for repeated layouts in attention-related components, starting with an early posterior negativity (N1pc, 80–180 ms). When the target was relocated to the opposite hemifield following learning, contextual cuing was effectively abolished, and the N1pc was reversed in polarity (indicative of persistent misguidance of attention to the original target location). Thus, once learned, repeated layouts trigger attentional-priority signals from memory that proactively interfere with contextual relearning after target relocation.

Social anxiety and attention to dynamic disgust facial expression: No more attention captured from evidence of N2pc

In this study we investigated the role of stimulus-driven attention in the attentional bias in individuals with social anxiety using electrophysiological technique. For this purpose, we employed static and dynamic facial expressions as stimuli in a dot-probe task. The results revealed that in behavior high socially anxious (HSA) group had longer response time in incongruent trials than congruent trials, and showed higher trial level-bias score variability than low socially anxious (LSA) group. In electrophysiology, we found that compared to LSA group, HSA group showed an enhanced N2pc amplitude to disgust facial expressions in static condition, whereas this difference was eliminated in dynamic facial expression condition. The results suggest the faces with peak emotion intensity are more likely to capture initial attention of individuals with social anxiety.

No identification of abrupt onsets that capture attention: evidence against a unified model of spatial attention

Many studies have reported that spatial attention can be involuntarily captured by salient stimuli such as abrupt onsets. These involuntary shifts are often assumed to have the same effects on feature extraction as voluntary shifts: there are two different ways of moving the same attentional mechanism. According to this unified model of spatial attention, all shifts of attention should enhance the identification of attended objects. We directly tested this assumption using compatibility effects in a series of spatial cueing experiments. Participants searched a display and indicated whether the target number was greater or less than five. The salient precues were also numbers, allowing measurement of compatibility effects between the precue and the target. Precues that reliably predicted the target location produced compatibility effects (e.g., the precue "1" facilitated responding to the target "one"), indicating enhanced identification of the precue. Compatibility effects were also found for precues that were nonpredictive but had the target-finding feature (i.e., contingent capture). Critically, however, four separate experiments failed to find compatibility effects for salient abrupt onsets that were neither predictive nor task-relevant. This is surprising given that these same precues produced enormous cue validity effects (up to 186 ms), suggesting salience-based attention capture. Our findings argue against the unified model: salience-based attention capture recruits different attentional mechanisms than contingent capture or voluntary shifts in attention.

Capture by Context Elements, Not Attentional Suppression of Distractors, Explains the PD with Small Search Displays

Top–down control of attention allows us to resist attentional capture by salient stimuli that are irrelevant to our current goals. Recently, it was proposed that attentional suppression of salient distractors contributes to top–down control by biasing attention away from the distractor. With small search displays, attentional suppression of salient distractors may even result in reduced RTs on distractor-present trials. In support of attentional suppression, electrophysiological measures revealed a positivity between 200 and 300 msec contralateral to the distractor, which has been referred to as distractor positivity (PD). We reexamined distractor benefits with small search displays and found that the positivity to the distractor was followed by a negativity to the distractor. The negativity, referred to as N2pc, is considered an index of attentional selection of the contralateral element. Thus, attentional suppression of the distractor (PD) preceded attentional capture (N2pc) by the distractor, which is at odds with the idea that attentional suppression avoids attentional capture by the distractor. Instead, we suggest that the initial “PD” is not a positivity to the distractor but rather a negativity (N2pc) to the contralateral context element, suggesting that, initially, the context captured attention. Subsequently, the distractor was selected because, paradoxically, participants searched all lateral target positions (even when irrelevant) before they examined the vertical positions. Consistent with this idea, search times were shorter for lateral than vertical targets. In summary, the early voltage difference in small search displays is unrelated to distractor suppression but may reflect capture by the context.

Automatic Attention Capture by Threatening, But Not by Semantically Incongruent Natural Scene Images

Visual objects are typically perceived as parts of an entire visual scene, and the scene’s context provides information crucial in the object recognition process. Fundamental insights into the mechanisms of context-object integration have come from research on semantically incongruent objects, which are defined as objects with a very low probability of occurring in a given context. However, the role of attention in processing of the context-object mismatch remains unclear, with some studies providing evidence in favor, but other against an automatic capture of attention by incongruent objects. Therefore, in the present study, 25 subjects completed a dot-probe task, in which pairs of scenes—congruent and incongruent or neutral and threatening—were presented as task-irrelevant distractors. Importantly, threatening scenes are known to robustly capture attention and thus were included in the present study to provide a context for interpretation of results regarding incongruent scenes. Using N2 posterior-contralateral ERP component as a primary measure, we revealed that threatening images indeed capture attention automatically and rapidly, but semantically incongruent scenes do not benefit from an automatic attentional selection. Thus, our results suggest that identification of the context-object mismatch is not preattentive.

Covert Spatial Attention Speeds Target Individuation

Covert spatial attention has long been thought to speed visual processing. Psychophysics studies have shown that target information accrues faster at attended locations than at unattended locations. However, with behavioral evidence alone, it is difficult to determine whether attention speeds visual processing of the target or subsequent postperceptual stages of processing (e.g., converting sensory responses into decision signals). Moreover, although many studies have shown that attention can boost the amplitude of visually evoked neural responses, no robust effect has been observed on the latency of those neural responses. Here, we offer new evidence that may reconcile the neural and behavioral findings. We examined whether covert attention influenced the latency of the N2pc component, an electrophysiological marker of visual selection that has been linked with object individuation-the formation of an object representation that is distinct from the background and from other objects in the scene. To this end, we manipulated whether or not human observers (male and female) covertly attended the location of an impending search target. We found that the target evoked N2pc onset ∼20 ms earlier when the target location was cued than when it was not cued. In a second experiment, we provided a direct replication of this effect, confirming that the effect of attention on N2pc latency is robust. Thus, although attention may not speed the earliest stages of sensory processing, attention does speed the critical transition between raw sensory encoding and the formation of individuated object representations.SIGNIFICANCE STATEMENT Covert spatial attention improves processing at attended locations. Past behavioral studies have shown that information about visual targets accrues faster at attended than at unattended locations. However, it has remained unclear whether attention speeds perceptual analysis or subsequent postperceptual stages of processing. Here, we present robust evidence that attention speeds the N2pc, an electrophysiological signal that indexes the formation of individuated object representations. Our findings show that attention speeds a relatively early stage of perceptual processing while also elucidating the specific perceptual process that is speeded.

Attentional Access to Multiple Target Objects in Visual Search

Most investigations of visual search have focused on the discrimination between a search target and other task-irrelevant distractor objects (selection). The attentional limitations that arise when multiple target objects in the same display have to be processed simultaneously (access) remain poorly understood. Here, we employed behavioral and electrophysiological measures to investigate the factors that determine whether multiple target objects can be accessed in parallel. Performance and N2pc components were measured for search displays that contained either a single target or two target objects. When two target objects were present, they either had the same or different target-defining features. Participants reported whether search displays contained a single target, two targets with shared features, or two targets with different features. There were performance costs as well as reduced N2pc amplitudes for two-target/different relative to two-target/same displays, suggesting that access to multiple target objects defined by different features was impaired. These behavioral and electrophysiological costs were also observed in a task where all search display objects were physically different, but not during color or shape singleton search, confirming that they do not reflect a low-level perceptual grouping of physically identical targets. These results demonstrate strong feature-specific limitations of visual access, as proposed by the Boolean map theory of visual attention. They suggest that multiple target objects can be accessed in parallel only when they share task-relevant features and demonstrate that mechanisms of visual access can be studied with electrophysiological markers.