Implicit temporal expectation attenuates auditory attentional blink

Temporal deployment of attention in musicians: Evidence from an attentional blink paradigm

The generalization of music training to unrelated nonmusical domains is well established and may reflect musicians' superior ability to regulate attention. We investigated the temporal deployment of attention in musicians and nonmusicians using scalp-recording of event-related potentials in an attentional blink (AB) paradigm. Participants listened to rapid sequences of stimuli and identified target and probe sounds. The AB was defined as a probe identification deficit when the probe closely follows the target. The sequence of stimuli was preceded by a neutral or informative cue about the probe position within the sequence. Musicians outperformed nonmusicians in identifying the target and probe. In both groups, cueing improved target and probe identification and reduced the AB. The informative cue elicited a sustained potential, which was more prominent in musicians than nonmusicians over left temporal areas and yielded a larger N1 amplitude elicited by the target. The N1 was larger in musicians than nonmusicians, and its amplitude over the left frontocentral cortex of musicians correlated with accuracy. Together, these results reveal musicians' superior ability to regulate attention, allowing them to prepare for incoming stimuli, thereby improving sound object identification. This capacity to manage attentional resources to optimize task performance may generalize to nonmusical activities.

Attention in flux

Selective attention comprises essential infrastructural functions supporting cognition-anticipating, prioritizing, selecting, routing, integrating, and preparing signals to guide adaptive behavior. Most studies have examined its consequences, systems, and mechanisms in a static way, but attention is at the confluence of multiple sources of flux. The world advances, we operate within it, our minds change, and all resulting signals progress through multiple pathways within the dynamic networks of our brains. Our aim in this review is to raise awareness of and interest in three important facets of how timing impacts our understanding of attention. These include the challenges posed to attention by the timing of neural processing and psychological functions, the opportunities conferred to attention by various temporal structures in the environment, and how tracking the time courses of neural and behavioral modulations with continuous measures yields surprising insights into the workings and principles of attention.

It's time for attentional control: Temporal expectation in the attentional blink

The attentional blink (AB) reveals a limitation in conscious processing of sequential targets. Although it is widely held that the AB derives from a structural bottleneck of central capacity, how the central processing is constrained is still unclear. As the AB reflects the dilemma of deploying attentional resources in the time dimension, research on temporal allocation provides an important avenue for understanding the mechanism. Here we reviewed studies regarding the role of temporal expectation in modulating the AB performance primarily based on two temporal processing strategies: interval-based and rhythm-based timings. We showed that both temporal expectations can help to organize limited resources among multiple attentional episodes, thereby mitigating the AB effect. As it turns out, scrutinizing on the AB from a temporal perspective is a promising way to comprehend the mechanisms behind the AB and conscious cognition. We also highlighted some unresolved issues and discussed potential directions for future research.

Expectation modulates the preferential processing of task-irrelevant fear in the attentional blink: evidence from event-related potentials

Background

Reporting the second of the two targets is impaired when it occurs 200–500 ms after the first, the phenomenon in the study of consciousness is the attentional blink (AB). In the AB task, both the emotional salience and the expectation of the second target increase the likelihood of that target being consciously reported. Yet, little is known about how expectations modulate the prioritized processing of affective stimuli. We examined the role of expecting fearful expression when processing fear in an AB task. Participants were presented with an AB task where the 2nd target (T2) is either a fearful face or a neutral face, and had to report the target's gender. The frequency of fearful to neutral faces on a given block was manipulated, such that participants could either expect more or less fearful faces.

Results

In the Experiment 1, we found that fearful faces were more likely to be recognized than neutral faces during the blink period (lag3) when participants were not expecting a fearful face (low fear-expectation); however, high fear-expectation increased the discrimination of fearful T2 than neutral T2 outside the blink period (lag8). In the Experiment 2, we assessed ERP brain activity in response to perceived T2 during the blink period. The results revealed that fearful faces elicited larger P300 amplitudes compared to neutral faces, but only in the low fear-expectation condition, suggesting that expecting a fearful expression can suppress the processing of task-irrelevant facial expression and unexpected fearful expression can break through this suppression. Fearful T2 elicited larger vertex positive potential (VPP) amplitudes than neutral T2, and this affective effect was independent of fear-expectation. Since no effect of expectation was found on the VPP amplitude while P300 exhibited significant interaction between expectation and expression, this suggests that expectations modulate emotional processing at a later stage, after the fearful face has been differentially processed.

Conclusions

These results provided clear evidence for the contribution of the expectation to the prioritized processing of second affective stimuli in the AB.

Immediate Temporal Information Modulates the Target Identification in the Attentional Blink

It has been shown that learned temporal information can be exploited to help facilitate the target identification in the attentional blink task. Here, we tested whether similar exploitation also worked on short-term temporal information, even when it did not reliably predict the target onset. In two experiments, we randomly manipulated either the interval between targets (T1 and T2; Experiment 1) or the temporal regularity of stimulus presentation (Experiment 2) in each trial. The results revealed evidence of effects of immediate temporal experience mainly on T2 performances but also occasionally on T1 performances. In general, the accuracy of T2 was enhanced when a longer inter-target interval was explicitly processed in the preceding trial (Experiment 1) or the temporal regularity, regardless of being explicitly or implicitly processed, was present in the stimulus stream, especially after T1 (Experiment 2). These results suggest that, under high temporal uncertainty, both interval and rhythmic cues can still be exploited to regulate the allocation of processing resources, thus, modulating the target identification in the attentional blink task, consistent with the view of flexible attentional allocation, and further highlighting the importance of the interplay between temporal processing and attentional control in the conscious visual perception.

Minimal interplay between explicit knowledge, dynamics of learning and temporal expectations in different, complex uni- and multisensory contexts

While temporal expectations (TE) generally improve reactions to temporally predictable events, it remains unknown how the learning of temporal regularities (one time point more likely than another time point) and explicit knowledge about temporal regularities contribute to performance improvements; and whether any contributions generalise across modalities. Here, participants discriminated the frequency of diverging auditory, visual or audio-visual targets embedded in auditory, visual or audio-visual distractor sequences. Temporal regularities were manipulated run-wise (early vs. late target within sequence). Behavioural performance (accuracy, RT) plus measures from a computational learning model all suggest that learning of temporal regularities occurred but did not generalise across modalities, and that dynamics of learning (size of TE effect across runs) and explicit knowledge have little to no effect on the strength of TE. Remarkably, explicit knowledge affects performance-if at all-in a context-dependent manner: Only under complex task regimes (here, unknown target modality) might it partially help to resolve response conflict while it is lowering performance in less complex environments.

Explicitly versus implicitly driven temporal expectations: No evidence for altered perceptual processing due to top-down modulations

Learning the statistical regularities of environmental events is a powerful tool for enhancing performance. However, it remains unclear whether this often implicit type of behavioral facilitation can be proactively modulated by explicit knowledge about temporal regularities. Only recently, Menceloglu and colleagues (Attention, Perception & Psychophysics, 79(1), 169-179, 2017) tested for differences between implicit versus explicit statistical learning of temporal regularities by using a within-paradigm manipulation of metacognitive temporal knowledge. The authors reported that temporal expectations were enhanced if participants had explicit knowledge about temporal regularities. Here, we attempted to replicate and extend their results, and to provide a mechanistic framework for any effects by means of computational modelling. Participants performed a letter-discrimination task, with target letters embedded in congruent or incongruent flankers. Temporal predictability was manipulated block-wise, with targets occurring more often after either a short or a long delay period. During the delay a sound was presented in half of the trials. Explicit knowledge about temporal regularities was manipulated by changing instructions: Participants received no information (implicit), information about the most likely cue-target delay (explicit), or received 100% valid cues on each trial (highly explicit). We replicated previous effects of target-flanker congruence and sound presence. However, no evidence was found for an effect of explicit knowledge on temporal expectations using Bayesian statistics. Concordantly, computational modelling suggested that explicit knowledge may only influence non-perceptual processing such as response criteria. Together, our results indicate that explicit metacognitive knowledge does not necessarily alter sensory representations or temporal expectations but rather affects response strategies.

No Evidence for an Auditory Attentional Blink for Voices Regardless of Musical Expertise

Background: Attending to goal-relevant information can leave us metaphorically "blind" or "deaf" to the next relevant information while searching among distracters. This temporal cost lasting for about a half a second on the human selective attention has been long explored using the attentional blink paradigm. Although there is evidence that certain visual stimuli relating to one's area of expertise can be less susceptible to attentional blink effects, it remains unexplored whether the dynamics of temporal selective attention vary with expertise and objects types in the auditory modality. Methods: Using the auditory version of the attentional blink paradigm, the present study investigates whether certain auditory objects relating to musical and perceptual expertise could have an impact on the transient costs of selective attention. In this study, expert cellists and novice participants were asked to first identify a target sound, and then to detect instrumental timbres of cello or organ, or human voice as a second target in a rapid auditory stream. Results: The results showed moderate evidence against the attentional blink effect for voices independent of participants' musical expertise. Experts outperformed novices in their overall accuracy levels of target identification and detection, reflecting a clear benefit of musical expertise. Importantly, the musicianship advantage disappeared when the human voices served as the second target in the stream. Discussion: The results are discussed in terms of stimulus salience, the advantage of voice processing, as well as perceptual and musical expertise in relation to attention and working memory performances.

Cortical sources of the auditory attentional blink

Attentional blink (AB) refers to the situation where correctly identifying a target impairs the processing of a subsequent probe in a sequence of stimuli. Although the AB often coincides with a modulation of scalp-recorded cognitive event-related potentials (ERPs), the neural sources of this effect remain unclear. In two separate experiments, we used classical LORETA analysis recursively applied (CLARA) to estimate the neural sources of ERPs elicited by an auditory probe when it immediately followed an auditory target (i.e., AB condition), when no auditory target was present (i.e., no-AB condition), and when the probe followed an auditory target but occurred outside of the AB time window (i.e., no-AB condition). We observed a processing deficit when the probe immediately followed the target, and this auditory AB was accompanied by reduced P3b amplitude. Contrasting brain electrical source activity from the AB and no-AB conditions revealed reduced source activity in the medial temporal region as well as in the temporoparietal junction (extending into inferior parietal lobe), ventromedial prefrontal cortex, left anterior thalamic nuclei, mammillary body, and left cerebellum. The results indicate that successful probe identification following a target relies on a widely distributed brain network and further support the suggestion that the auditory AB reflects the failure of the probe to reach short-term consolidation. NEW & NOTEWORTHY Within a rapid succession of auditory stimuli, the perception of a predefined target sound often impedes listeners' ability to detect another target sound that is presented close in succession. This attentional blink may be related to activity in brain areas supporting attention and memory. We show that the auditory attentional blink is associated with brain activity changes in a network including the medial temporal lobe, parietal cortex, and prefrontal cortex. This study suggests that a problem in the interaction between attention and memory underlies the auditory attentional blink.

Global Repetition Influences Contextual Cueing

Our visual system has a striking ability to improve visual search based on the learning of repeated ambient regularities, an effect named contextual cueing. Whereas most of the previous studies investigated contextual cueing effect with the same number of repeated and non-repeated search displays per block, the current study focused on whether a global repetition frequency formed by different presentation ratios between the repeated and non-repeated configurations influence contextual cueing effect. Specifically, the number of repeated and non-repeated displays presented in each block was manipulated: 12:12, 20:4, 4:20, and 4:4 in Experiments 1-4, respectively. The results revealed a significant contextual cueing effect when the global repetition frequency is high (≥1:1 ratio) in Experiments 1, 2, and 4, given that processing of repeated displays was expedited relative to non-repeated displays. Nevertheless, the contextual cueing effect reduced to a non-significant level when the repetition frequency reduced to 4:20 in Experiment 3. These results suggested that the presentation frequency of repeated relative to the non-repeated displays could influence the strength of contextual cueing. In other words, global repetition statistics could be a crucial factor to mediate contextual cueing effect.

Comparing the effects of implicit and explicit temporal expectation on choice response time and response conflict

People can use temporally structured sensory information to anticipate future events. Temporal information can be presented implicitly through probability manipulation without participants' awareness of the manipulation, or explicitly conveyed through instructions. We examined how implicit and explicit temporal information established temporal expectations that influenced choice response times and response conflict (measured as flanker effects). We implicitly manipulated temporal structure by block-wise varying the likely timing of a target. In the short-interval block, a target was presented frequently (80 % of trials) after a short (400 ms) cue-to-target interval and infrequently (20 % of trials) after a long (1200 ms) interval; the probability assignment was reversed in the long-interval block. Building on this baseline condition (Experiment 1), we augmented the temporal information by filling the cue-to-target intervals with tones (Experiment 2), explicitly informed participants of the prevalent time interval (Experiment 3) and provided trial-by-trial reminders of the prevalent time interval (Experiment 4). The temporal probability manipulation alone (of which participants were unaware) influenced choice response times but only when the temporal information was augmented with tones, whereas providing the explicit knowledge of the temporal manipulation, with or without trial-by-trial reminders, robustly influenced choice response times. Response conflict was unaffected by these conditions. These results suggest that temporal expectation can be established by the implicit learning of a temporal structure given that sufficiently strong temporal information is presented as well as by the explicit knowledge of the temporal structure. This established temporal expectation influences choice response times without necessarily affecting the strength of response conflict.

Temporal cuing modulates alpha oscillations during auditory attentional blink

Attentional blink (AB) refers to the phenomenon whereby the correct identification of a visual or auditory target impairs processing of a subsequent probe. Although it has been shown that knowing in advance, when the probe would be presented, reduces the attentional blink and increases the amplitude of event-related potential (ERP) elicited by the probe, the neural mechanism by which attention mitigates the AB remains unclear. Here, we used time-frequency analysis to further explore the mechanism of the auditory attentional blink. Participants were presented a series of rapid auditory stimuli and asked to indicate whether a target and a probe were present in the sequence. In half of the trials, participants were cued to the probe position relative to the target ('Early' or 'Late'). Probe detection and ERP amplitude elicited by the probe decreased when the probe was presented shortly after the target compared to when it was presented later after the target. Importantly, the behavioral and ERP correlates of probe discrimination significantly improved when the 'Early' cue was presented. The improvement in processing the probe in the cued condition was accompanied by the decrease in alpha activity (8-13 Hz) after the time when the probe was expected; suggesting that successfully directing attention to time window where the probe would likely occur reduces the processing resources needed to suppress distractors. This in turn freed up available processing resources for the target and probe at the short-term consolidation stage, which ultimately reduced the auditory attentional blink.

Adjustment to Subtle Time Constraints and Power Law Learning in Rapid Serial Visual Presentation

We investigated whether attention could be modulated through the implicit learning of temporal information in a rapid serial visual presentation (RSVP) task. Participants identified two target letters among numeral distractors. The stimulus-onset asynchrony immediately following the first target (SOA1) varied at three levels (70, 98, and 126 ms) randomly between trials or fixed within blocks of trials. Practice over 3 consecutive days resulted in a continuous improvement in the identification rate for both targets and attenuation of the attentional blink (AB), a decrement in target (T2) identification when presented 200-400 ms after another target (T1). Blocked SOA1s led to a faster rate of improvement in RSVP performance and more target order reversals relative to random SOA1s, suggesting that the implicit learning of SOA1 positively affected performance. The results also reveal "power law" learning curves for individual target identification as well as the reduction in the AB decrement. These learning curves reflect the spontaneous emergence of skill through subtle attentional modulations rather than general attentional distribution. Together, the results indicate that implicit temporal learning could improve high level and rapid cognitive processing and highlights the sensitivity and adaptability of the attentional system to subtle constraints in stimulus timing.

Training and the attentional blink: limits overcome or expectations raised?

The attentional blink (AB) refers to a deficit in reporting the second of two sequentially presented targets when they are separated by less than 500 ms. Two decades of research has suggested that the AB is a robust phenomenon that is likely attributable to a fundamental limit in sequential object processing. This assumption, however, has recently been undermined by a demonstration that the AB can be eliminated after only a few hundred training trials (Choi, Chang, Shibata, Sasaki, & Watanabe in Proceedings of the National Academy of Sciences 109:12242-12247, 2012). In the present work, we examined whether this training benefited performance directly, by eliminating processing limitations as claimed, or indirectly, by creating expectations about when targets would appear. Consistent with the latter option, when temporal expectations were reduced, training-related improvements declined significantly. This suggests that whereas training may ameliorate the AB indirectly, the processing limits evidenced in the AB cannot be directly eliminated by brief exposure to the task.

The "serendipitous brain": Low expectancy and timing uncertainty of conscious events improve awareness of unconscious ones (evidence from the Attentional Blink)

To anticipate upcoming sensory events, the brain picks-up and exploits statistical regularities in the sensory environment. However, it is untested whether cumulated predictive knowledge about consciously seen stimuli improves the access to awareness of stimuli that usually go unseen. To explore this issue, we exploited the Attentional Blink (AB) effect, where conscious processing of a first visual target (T1) hinders detection of early following targets (T2). We report that timing uncertainty and low expectancy about the occurrence of consciously seen T2s presented outside the AB period, improve detection of early and otherwise often unseen T2s presented inside the AB. Recording of high-resolution Event Related Potentials (ERPs) and the study of their intracranial sources showed that the brain achieves this improvement by initially amplifying and extending the pre-conscious storage of T2s' traces signalled by the N2 wave originating in the extra-striate cortex. This enhancement in the N2 wave is followed by specific changes in the latency and amplitude of later components in the P3 wave (P3a and P3b), signalling access of the sensory trace to the network of parietal and frontal areas modulating conscious processing. These findings show that the interaction between conscious and unconscious processing changes adaptively as a function of the probabilistic properties of the sensory environment and that the combination of an active attentional state with loose probabilistic and temporal expectancies on forthcoming conscious events favors the emergence to awareness of otherwise unnoticed visual events. This likely provides an insight on the attentional conditions that predispose an active observer to unexpected "serendipitous" findings.

Combining spatial and temporal expectations to improve visual perception

The importance of temporal expectations in modulating perceptual functions is increasingly recognized. However, the means through which temporal expectations can bias perceptual information processing remains ill understood. Recent theories propose that modulatory effects of temporal expectations rely on the co-existence of other biases based on receptive-field properties, such as spatial location. We tested whether perceptual benefits of temporal expectations in a perceptually demanding psychophysical task depended on the presence of spatial expectations. Foveally presented symbolic arrow cues indicated simultaneously where (location) and when (time) target events were more likely to occur. The direction of the arrow indicated target location (80% validity), while its color (pink or blue) indicated the interval (80% validity) for target appearance. Our results confirmed a strong synergistic interaction between temporal and spatial expectations in enhancing visual discrimination. Temporal expectation significantly boosted the effectiveness of spatial expectation in sharpening perception. However, benefits for temporal expectation disappeared when targets occurred at unattended locations. Our findings suggest that anticipated receptive-field properties of targets provide a natural template upon which temporal expectations can operate in order to help prioritize goal-relevant events from early perceptual stages.

Attention to memory: orienting attention to sound object representations

Despite a growing acceptance that attention and memory interact, and that attention can be focused on an active internal mental representation (i.e., reflective attention), there has been a paucity of work focusing on reflective attention to 'sound objects' (i.e., mental representations of actual sound sources in the environment). Further research on the dynamic interactions between auditory attention and memory, as well as its degree of neuroplasticity, is important for understanding how sound objects are represented, maintained, and accessed in the brain. This knowledge can then guide the development of training programs to help individuals with attention and memory problems. This review article focuses on attention to memory with an emphasis on behavioral and neuroimaging studies that have begun to explore the mechanisms that mediate reflective attentional orienting in vision and more recently, in audition. Reflective attention refers to situations in which attention is oriented toward internal representations rather than focused on external stimuli. We propose four general principles underlying attention to short-term memory. Furthermore, we suggest that mechanisms involved in orienting attention to visual object representations may also apply for orienting attention to sound object representations.