What processes are disrupted during the attentional blink? An integrative review of event-related potential research

Transient Attention Gates Access Consciousness: Coupling N2pc and P3 Latencies Using Dynamic Time Warping

The N2pc and P3 event-related potentials (ERPs), used to index selective attention and access to working memory and conscious awareness, respectively, have been important tools in cognitive sciences. Although it is likely that these two components and the underlying cognitive processes are temporally and functionally linked, such links have not yet been convincingly demonstrated. Adopting a novel methodological approach based on dynamic time warping (DTW), we provide evidence that the N2pc and P3 ERP components are temporally linked. We analyzed data from an experiment where 23 participants (16 women) monitored bilateral rapid serial streams of letters and digits in order to report a target digit indicated by a shape cue, separately for trials with correct responses and trials where a temporally proximal distractor was reported instead (distractor intrusion). DTW analyses revealed that N2pc and P3 latencies were correlated in time, both when the target or a distractor was reported. Notably, this link was weaker on distractor intrusion trials. This N2pc-P3 association is discussed with respect to the relationship between attention and access consciousness. Our results demonstrate that our novel method provides a valuable approach for assessing temporal links between two cognitive processes and their underlying modulating factors. This method allows to establish links and their modulator for any two time-series across all domains of the field (general-purpose MATLAB functions and a Python module are provided alongside this paper).

Distrust before first sight? Examining knowledge- and appearance-based effects of trustworthiness on the visual consciousness of faces

The present EEG study with 32 healthy participants investigated whether affective knowledge about a person influences the visual awareness of their face, additionally considering the impact of facial appearance. Faces differing in perceived trustworthiness based on appearance were associated with negative or neutral social information and shown as target stimuli in an attentional blink task. As expected, participants showed enhanced awareness of faces associated with negative compared to neutral social information. On the neurophysiological level, this effect was connected to differences in the time range of the early posterior negativity (EPN)-a component associated with enhanced attention and facilitated processing of emotional stimuli. The findings indicate that the social-affective relevance of a face based on emotional knowledge is accessed during a phase of attentional enhancement for conscious perception and can affect prioritization for awareness. In contrast, no clear evidence for influences of facial trustworthiness during the attentional blink was found.

The dissociation of semantically congruent and incongruent cross-modal effects on the visual attentional blink

Introduction

Recent studies have found that the sound-induced alleviation of visual attentional blink, a well-known phenomenon exemplifying the beneficial influence of multisensory integration on time-based attention, was larger when that sound was semantically congruent relative to incongruent with the second visual target (T2). Although such an audiovisual congruency effect has been attributed mainly to the semantic conflict carried by the incongruent sound restraining that sound from facilitating T2 processing, it is still unclear whether the integrated semantic information carried by the congruent sound benefits T2 processing.

Methods

To dissociate the congruence-induced benefit and incongruence-induced reduction in the alleviation of visual attentional blink at the behavioral and neural levels, the present study combined behavioral measures and event-related potential (ERP) recordings in a visual attentional blink task wherein the T2-accompanying sound, when delivered, could be semantically neutral in addition to congruent or incongruent with respect to T2.

Results

The behavioral data clearly showed that compared to the neutral sound, the congruent sound improved T2 discrimination during the blink to a higher degree while the incongruent sound improved it to a lesser degree. The T2-locked ERP data revealed that the early occipital cross-modal N195 component (192-228 ms after T2 onset) was uniquely larger in the congruent-sound condition than in the neutral-sound and incongruent-sound conditions, whereas the late parietal cross-modal N440 component (400-500 ms) was prominent only in the incongruent-sound condition.

Discussion

These findings provide strong evidence that the modulating effect of audiovisual semantic congruency on the sound-induced alleviation of visual attentional blink contains not only a late incongruence-induced cost but also an early congruence-induced benefit, thereby demonstrating for the first time an unequivocal congruent-sound-induced benefit in alleviating the limitation of time-based visual attention.

Temporal deployment of attention in musicians: Evidence from an attentional blink paradigm

The generalization of music training to unrelated nonmusical domains is well established and may reflect musicians' superior ability to regulate attention. We investigated the temporal deployment of attention in musicians and nonmusicians using scalp-recording of event-related potentials in an attentional blink (AB) paradigm. Participants listened to rapid sequences of stimuli and identified target and probe sounds. The AB was defined as a probe identification deficit when the probe closely follows the target. The sequence of stimuli was preceded by a neutral or informative cue about the probe position within the sequence. Musicians outperformed nonmusicians in identifying the target and probe. In both groups, cueing improved target and probe identification and reduced the AB. The informative cue elicited a sustained potential, which was more prominent in musicians than nonmusicians over left temporal areas and yielded a larger N1 amplitude elicited by the target. The N1 was larger in musicians than nonmusicians, and its amplitude over the left frontocentral cortex of musicians correlated with accuracy. Together, these results reveal musicians' superior ability to regulate attention, allowing them to prepare for incoming stimuli, thereby improving sound object identification. This capacity to manage attentional resources to optimize task performance may generalize to nonmusical activities.

The role of distractors in rapid serial visual presentation reveals the mechanism of attentional blink by EEG-based univariate and multivariate analyses

Attentional blink pertains to the performance of participants with a severe decline in identifying the second target presented after the first target reported correctly within 200-500 ms in a rapid serial visual presentation. The current study was conducted to investigate the neural mechanism of the effect of the distractor (D1) that immediately follows first target to attentional blink by altering whether D1 was substituted with a blank with electroencephalography recording. The results showed that D1 interfered with the attentional enhancement and working memory encoding in both single-target rapid serial visual presentation task and dual-target rapid serial visual presentation task, which were mainly manifested in delayed and attenuated P3a and diminished P3b of first target. Single-trial analysis indicated that first target and second target will compete with each other for working memory encoding resources in short lag, but not in the long lag. In addition, D1 interfered with the working memory encoding of second target under short lag rather than long lag in the dual-target rapid serial visual presentation task. These results suggested that attentional blink can be attributed to the limited working memory encoding resource, whereas the amount of available resources is subject to modulation by attention. The D1 hinders the attention enhancement of first target, thereby exacerbating attentional blink.

Prioritized Identification of Fearful Eyes during the Attentional Blink Is Not Automatic

The eye region conveys considerable information regarding an individual's emotions, motivations, and intentions during interpersonal communication. Evidence suggests that the eye regions of an individual expressing emotions can capture attention more rapidly than the eye regions of an individual in a neutral affective state. However, how attentional resources affect the processing of emotions conveyed by the eye regions remains unclear. Accordingly, the present study employed a dual-target rapid serial visual presentation task: happy, neutral, or fearful eye regions were presented as the second target, with a temporal lag between two targets of 232 or 696 ms. Participants completed two tasks successively: Task 1 was to identify which species the upright eye region they had seen belonged to, and Task 2 was to identify what emotion was conveyed in the upright eye region. The behavioral results showed that the accuracy for fearful eye regions was lower than that for neutral eye regions under the condition of limited attentional resources; however, accuracy differences across the three types of eye regions did not reach significance under the condition of adequate attentional resources. These findings indicate that preferential processing of fearful expressions is not automatic but is modulated by available attentional resources.

A key role of the hippocampal P3 in the attentional blink

The attentional blink (AB) refers to an impaired identification of target stimuli (T2), which are presented shortly after a prior target (T1) within a rapid serial visual presentation (RSVP) stream. It has been suggested that the AB is related to a failed transfer of T2 into working memory and that hippocampus (HC) and entorhinal cortex (EC) are regions crucial for this transfer. Since the event-related P3 component has been linked to inhibitory processes, we hypothesized that the hippocampal P3 elicited by T1 may impact on T2 processing within HC and EC. To test this hypothesis, we reanalyzed microwire data from 21 patients, who performed an RSVP task, during intracranial recordings for epilepsy surgery assessment (Reber et al., 2017). We identified T1-related hippocampal P3 components in the local field potentials (LFPs) and determined the temporal onset of T2 processing in HC/EC based on single-unit response onset activity. In accordance with our hypothesis, T1-related single-trial P3 amplitudes at the onset of T2 processing were clearly larger for unseen compared to seen T2-stimuli. Moreover, increased T1-related single-trial P3 peak latencies were found for T2[unseen] versus T2[seen] trials in case of lags 1 to 3, which was in line with our predictions. In conclusion, our findings support inhibition models of the AB and indicate that the hippocampal P3 elicited by T1 plays a central role in the AB.

Conscious interpretation: A distinct aspect for the neural markers of the contents of consciousness

Progress in the science of consciousness depends on the experimental paradigms and varieties of contrastive analysis available to researchers. Here we highlight paradigms where the object is represented in consciousness as a set of its features but the interpretation of this set alternates in consciousness. We group experimental paradigms with this property under the label "conscious interpretation". We compare the paradigms studying conscious interpretation of the already consciously perceived objects with other types of experimental paradigms. We review previous and recent studies investigating this interpretative aspect of consciousness and propose future directions. We put forward the hypothesis that there are types of stimuli with a hierarchy of interpretations for which the rule applies: conscious experience is drawn towards higher-level interpretation and reverting back to the lower level of interpretation is impossible. We discuss how theories of consciousness might incorporate knowledge and constraints arising from the characteristics of conscious interpretation.

The temporal dynamics of selective attention are reflected by distractor intrusions

When observers have to identify an object embedded in a rapid serial visual presentation (RSVP) stream, they often erroneously report the identity of a distractor instead of the target (distractor intrusion). In two experiments, we examined whether these intrusion errors are associated with the speed of attentional engagement. Participants reported the identity of target digits indicated by shape selection cues. To manipulate the speed of engagement, targets appeared either within a single RSVP stream or unpredictably in one of two streams. Objects that followed the selection cue were reported more frequently when engagement was delayed (two streams), whereas the probability of reporting objects preceding the cue was higher when engagement was faster (single stream). These results show that distractor intrusions are closely linked to the allocation of selective attention in time, making the intrusion paradigm a useful tool for research into the temporal dynamics of attention. They also provide new evidence for the idea that attentional selectivity operates within brief periods of perceptual enhancement (attentional episodes), facilitating the processing of all objects within this period, regardless of their status as targets or distractors.

It's time for attentional control: Temporal expectation in the attentional blink

The attentional blink (AB) reveals a limitation in conscious processing of sequential targets. Although it is widely held that the AB derives from a structural bottleneck of central capacity, how the central processing is constrained is still unclear. As the AB reflects the dilemma of deploying attentional resources in the time dimension, research on temporal allocation provides an important avenue for understanding the mechanism. Here we reviewed studies regarding the role of temporal expectation in modulating the AB performance primarily based on two temporal processing strategies: interval-based and rhythm-based timings. We showed that both temporal expectations can help to organize limited resources among multiple attentional episodes, thereby mitigating the AB effect. As it turns out, scrutinizing on the AB from a temporal perspective is a promising way to comprehend the mechanisms behind the AB and conscious cognition. We also highlighted some unresolved issues and discussed potential directions for future research.

Expectation modulates the preferential processing of task-irrelevant fear in the attentional blink: evidence from event-related potentials

Background

Reporting the second of the two targets is impaired when it occurs 200–500 ms after the first, the phenomenon in the study of consciousness is the attentional blink (AB). In the AB task, both the emotional salience and the expectation of the second target increase the likelihood of that target being consciously reported. Yet, little is known about how expectations modulate the prioritized processing of affective stimuli. We examined the role of expecting fearful expression when processing fear in an AB task. Participants were presented with an AB task where the 2nd target (T2) is either a fearful face or a neutral face, and had to report the target's gender. The frequency of fearful to neutral faces on a given block was manipulated, such that participants could either expect more or less fearful faces.

Results

In the Experiment 1, we found that fearful faces were more likely to be recognized than neutral faces during the blink period (lag3) when participants were not expecting a fearful face (low fear-expectation); however, high fear-expectation increased the discrimination of fearful T2 than neutral T2 outside the blink period (lag8). In the Experiment 2, we assessed ERP brain activity in response to perceived T2 during the blink period. The results revealed that fearful faces elicited larger P300 amplitudes compared to neutral faces, but only in the low fear-expectation condition, suggesting that expecting a fearful expression can suppress the processing of task-irrelevant facial expression and unexpected fearful expression can break through this suppression. Fearful T2 elicited larger vertex positive potential (VPP) amplitudes than neutral T2, and this affective effect was independent of fear-expectation. Since no effect of expectation was found on the VPP amplitude while P300 exhibited significant interaction between expectation and expression, this suggests that expectations modulate emotional processing at a later stage, after the fearful face has been differentially processed.

Conclusions

These results provided clear evidence for the contribution of the expectation to the prioritized processing of second affective stimuli in the AB.

Neural correlates of consciousness in an attentional blink paradigm with uncertain target relevance

Several event-related potentials (ERPs) have been proposed as neural correlates of consciousness (NCC), most prominently the early visual awareness negativity (VAN) and the late P3b component. Highly influential support for the P3b comes from studies utilizing the attentional blink (AB), where conscious perception of a first visual target (T1) impairs reporting a second target (T2) presented shortly afterwards. Recent no-report studies using other paradigms suggest that the P3b component may reflect post-perceptual processes associated with decision-making rather than awareness. However, no-report studies are limited in their awareness assessment, and their conclusions have not been tested in an AB paradigm. The present study (N = 38) addressed these issues using a novel AB paradigm, which reduced decision-making processes by omitting a discrimination task on T2 stimuli and rendering their relevance uncertain. Nevertheless, awareness was assessed trial by trial. Comparing ERPs in response to seen versus unseen T2 stimuli revealed a VAN but no enhanced P3b regardless of whether they were marked as distinct from distractor stimuli or not. Our results corroborate the VAN and challenge the P3b as NCC despite rigorous trial-by-trial assessment of conscious perception. Thus, they support the idea that awareness emerges during early sensory processing.

Grounding the Attentional Boost Effect in Events and the Efficient Brain

Attention and memory for everyday experiences vary over time, wherein some moments are better attended and subsequently better remembered than others. These effects have been demonstrated in naturalistic viewing tasks with complex and relatively uncontrolled stimuli, as well as in more controlled laboratory tasks with simpler stimuli. For example, in the attentional boost effect (ABE), participants perform two tasks at once: memorizing a series of briefly presented stimuli (e.g., pictures of outdoor scenes) for a later memory test, and responding to other concurrently presented cues that meet pre-defined criteria (e.g., participants press a button for a blue target square and do nothing for a red distractor square). However, rather than increasing dual-task interference, attending to a target cue boosts, rather than impairs, subsequent memory for concurrently presented information. In this review we describe current data on the extent and limitations of the attentional boost effect and whether it may be related to activity in the locus coeruleus neuromodulatory system. We suggest that insight into the mechanisms that produce the attentional boost effect may be found in recent advances in the locus coeruleus literature and from understanding of how the neurocognitive system handles stability and change in everyday events. We consequently propose updates to an early account of the attentional boost effect, the dual-task interaction model, to better ground it in what is currently known about event cognition and the role that the LC plays in regulating brain states.

The diachronic account of attentional selectivity

Many models of attention assume that attentional selection takes place at a specific moment in time that demarcates the critical transition from pre-attentive to attentive processing of sensory input. We argue that this intuitively appealing standard account of attentional selectivity is not only inaccurate, but has led to substantial conceptual confusion. As an alternative, we offer a 'diachronic' framework that describes attentional selectivity as a process that unfolds over time. Key to this view is the concept of attentional episodes, brief periods of intense attentional amplification of sensory representations that regulate access to working memory and response-related processes. We describe how attentional episodes are linked to earlier attentional mechanisms and to recurrent processing at the neural level. We review studies that establish the existence of attentional episodes, delineate the factors that determine if and when they are triggered, and discuss the costs associated with processing multiple events within a single episode. Finally, we argue that this framework offers new solutions to old problems in attention research that have never been resolved. It can provide a unified and conceptually coherent account of the network of cognitive and neural processes that produce the goal-directed selectivity in perceptual processing that is commonly referred to as 'attention'.