Ignorance is bliss: the role of observer expectation in dynamic spatial tuning of the attentional focus

Listening to trees in the forest: Attentional set influences how semantic and acoustic factors interact in auditory perception

Studies of auditory object perception claim that semantic properties dominate acoustic properties in determining identification accuracy. Yet the direction of the semantic effect is mixed, with some studies showing an advantage for detecting incongruent sounds and others reporting a congruent sound advantage. Here we examine the role of the participant's attentional set when identifying auditory objects in naturalistic soundscapes. We varied the acoustic and semantic properties of the sounds orthogonally in two experiments. In Experiment 1 participants tuned their attention broadly to detect any change between two successive soundscapes (e.g., two restaurant soundscapes, with and without a child coughing). In Experiment 2 they tuned attention more narrowly to a probe presented after a soundscape (e.g., a restaurant soundscape with a child coughing, followed by the coughing sound alone). In both experiments, semantic relations between the objects and backgrounds helped to disambiguate objects that blended acoustically with the background. When attending globally (Experiment 1), objects that were acoustically similar yet semantically incongruent tended to be missed (e.g., bouncing basketball on a construction site), as though camouflaged by the gist of the soundscape. When attending locally (Experiment 2), semantically congruent foil objects led to false positive reports under acoustically similar conditions (hammering sounds on a construction site), as though the gist of the soundscape contributed to their plausible inclusion. In summary, although attentional set had a strong influence on the specific kinds of errors made, both results pointed to participants using a semantically congruent high-level schema to report the sounds they heard.

Inaccessible time to visual awareness during attentional blinks in macaques and humans

Even when we attend to successive visual events, we often cannot notice an event occurring during a certain temporal window. Such an inaccessible time for visual awareness is known as "attentional blink" (AB). Whether AB is a phenomenon unique to humans or exists also in other animals is unclear. Using a dual-task paradigm shared between macaques and humans, we here demonstrate a nonhuman primate model of AB. Although macaques also showed behavioral signatures of AB, their AB effect lasted longer than that of humans. To map the relation between macaque and human ABs, we introduced a time warping analysis. The analysis revealed a formal structure behind the interspecies difference of AB; the temporal window of macaque AB was scaled from that of human AB. The present study opens the door to combining the approaches of neuroscience, psychophysics, and theoretical models to further identify a scale-invariant biological substrate of visual awareness.

Spatial distribution of emotional attentional blink under top-down attentional control

Emotion-induced blindness (EIB) refers to the impaired perception of a neutral target that follows an emotional distractor within the time gap of 100-500 ms. Recent studies on EIB show that EIB is spatially localized. Blink occurs when both target and emotional distractor appear in the same stream but not the opposite. However, the influence of top-down attentional control over the dual-stream EIB remains poorly understood. Examining the role of top-down control in EIB will help understand the impact of attentional control over the spatial distribution of EIB and in understanding the Attentional Blink (AB) and EIB distinction. Hence, in the present study, we used dual-stream and manipulated the attentional control by changing the relevance of the emotional image and asking participants to report both emotional and neutral targets. Our results show a similar level of blink irrespective of the spatial location of the emotional T1, suggesting the role of attentional control on the spatial distribution of EIB and in the AB-EIB distinction. Results have implications for the theoretical understanding of EIB.

Spatial attention shifting to fearful faces depends on visual awareness in attentional blink: An ERP study

It remains unclear to date whether spatial attention towards emotional faces is contingent on, or independent of visual awareness. To investigate this question, a bilateral attentional blink paradigm was used in which lateralised fearful faces were presented at various levels of detectability. Twenty-six healthy participants were presented with two rapid serial streams of human faces, while they attempted to detect a pair of target faces (T2) displayed in close or distant succession of a first target pair (T1). Spatial attention shifting to the T2 fearful faces, indexed by the N2-posterior-contralateral component, was dependent on visual awareness and its magnitude covaried with the visual awareness negativity, a neural marker of awareness at the perceptual level. Additionally, information consolidation in working memory, indexed by the sustained posterior contralateral negativity, positively correlated with the level of visual awareness and spatial attention shifting. These findings demonstrate that spatial attention shifting to fearful faces depends on visual awareness, and these early processes are closely linked to information maintenance in working memory.

Flexible attention system: Appearance time of split attention changes in accordance with the task difficulty level

Although it is often assumed that spatial attention exists in the form of a unitary focus, the split-attention hypothesis proposes that attention can be simultaneously divided into two spatially noncontiguous positions and that the space in between can be ignored. However, whether split attention occurs directly based on the generation of attentional benefit or whether it requires a gradual divide from a unitary focus over time has not been clarified. In the present study, by using two spatial salient cues to direct the attention allocation of participants, we aimed to investigate whether attention requires time to divide from a unitary focus and whether the appearance time of split attention varies when the task difficulty level increases between experiments. The results showed that attention required time to divide from a unitary focus, and the position between the two cued positions was not excluded by attention when the stimulus-onset asynchrony (SOA) was 60 ms. However, as the task difficulty increased between experiments, the appearance time of split attention was earlier. These findings suggest that the appearance time of split attention has a certain flexibility and can be changed according to the task requirement, thus implying that split attention and unitary attention present some common attention mechanisms and that a split or unitary mode can be flexibly selected for an attention system.

What factors influence the switch from unitary to divided attention?

The focus of attention can be either unitary or divided and can transition from unitary to divided while performing a task. In Experiment 1, we investigated whether alerting hastens the transition from unitary to divided attention. To this end, we employed a dual-RSVP-stream Attentional Blink task (AB; impaired perception of the second of two rapidly sequential targets) with two pairs of letter targets (T1-pair and T2-pair). One component of the AB known as Lag-1 sparing (unimpaired perception of the T2-pair when it is presented directly after the T1-pair) occurs only when the T2-pair falls in an attended location. When the T2-pair falls in an unattended location, the converse pattern occurs (Lag-1 deficit). Accordingly, we used the incidence of Lag-1 sparing/deficit to index whether a location was attended or unattended. We found that presenting a brief brightening flash of the screen (alerting) just before the T1-pair hastened the transition from the initial unitary focus to a divided focus. In Experiment 2, we pitted the hastening account against an alternative hypothesis that the flash triggers phasic activation of the Locus Coeruleus-norepinephrine neuromodulatory system, thus resetting the underlying neural networks that mediate the distribution of attention, triggering a switch from unitary to divided attention. The results of Experiment 2 were incompatible with the hastening account, but consistent with the network-reset account.

First unitary, then divided: the temporal dynamics of dividing attention

Whether focused visual attention can be divided has been the topic of much investigation, and there is a compelling body of evidence showing that, at least under certain conditions, attention can be divided and deployed as two independent foci. Three experiments were conducted to examine whether attention can be deployed in divided form from the outset, or whether it is first deployed as a unitary focus before being divided. To test this, we adapted the methodology of Jefferies, Enns, and Di Lollo (Journal of Experimental Psychology: Human Perception and Performance 40: 465, 2014), who used a dual-stream Attentional Blink paradigm and two letter-pair targets. One aspect of the AB, Lag-1 sparing, has been shown to occur only if the second target pair appears within the focus of attention. By presenting the second target pair at various spatial locations and assessing the magnitude of Lag-1 sparing, we probed the spatial distribution of attention. By systematically manipulating the stimulus-onset-asynchrony between the targets, we also tracked changes to the spatial distribution of attention over time. The results showed that even under conditions which encourage the division of attention, the attentional focus is first deployed in unitary form before being divided. It is then maintained in divided form only briefly before settling on a single location.

The exogenous and endogenous control of attentional focusing

Selective visual attention involves prioritizing both the location (orienting) and distribution (focusing) of processing. To date, much more research has examined attentional orienting than focusing. One of the most well-established findings is that orienting can be exogenous, as when a unique change in luminance draws attention to a spatial location (e.g., Theeuwes in Atten Percept Psychophys 51:599-606, 1992; Yantis and Jonides in J Exp Psychol Hum Percept Perform 10:601, 1984), and endogenous, as when a red distractor shape diverts attention when one is looking for a red target (e.g., Bacon and Egeth in Percept Psychophys 55:485-496, 1994; Folk et al. in J Exp Psychol Hum Percept Perform 18:1030, 1992). Here we ask whether attentional focusing-the broadening and contracting of prioritized processing-is influenced by the same two factors. Our methodology involved a dual-stream attentional blink task; participants monitored two spatially separated streams of items for two targets that could appear unpredictably either in the same stream or in opposite streams. The spatial distribution of attention was assessed by examining second-target accuracy in relation to inter-target lag and target location (same or opposite streams). In Experiment 1, we found that attentional contracting was more rapid when the targets differed in luminance from the distractor items. In Experiments 2 and 3, we found that the rate of attentional contracting was slower when there were task-relevant distractors in the stream opposite the first target. These results indicate that the rate of attentional focusing, like orienting, can be modulated by both exogenous and endogenous mechanisms.

Right visual-field advantage in the attentional blink: Asymmetry in attentional gating across time and space

When two targets are presented in a rapid serial visual presentation (RSVP), recognition of the second target (T2) is usually reduced when presented 150-500 ms after the first target, demonstrating an attentional blink (AB). Previous studies have shown a left visual-field (LVF) advantage in T2 recognition, when T2 was embedded in one of two streams, demanding top-down attention for its recognition. Here, we explored the impact of bottom-up saliency on spatial asymmetry in the AB. When T2 was spatially shifted outside from the RSVP, creating an abrupt onset of T2, right T2s showed a right visual-field (RVF) advantage. In lag-1 trials, right T2s were not only better recognized, but also showed a low T1-T2 order error rate. In contrast, recognized left T2s exhibited high order error rate. Without abrupt onset, symmetrical AB was found and order error rate was similarly low in both sides. Follow-up experiments showed that, while RVF advantage was related to bottom-up saliency, order errors were affected by T1 mask. The discrepancy between LVF and RVF advantage in the AB could be resolved in terms of two mechanisms of attentional gating: top-down attentional gating, which is biased towards LVF, and bottom-up attentional gating, which is biased towards RVF.

Target Type Modulates the Effect of Task Demand on Reflexive Focal Attention

Focusing attention on a limited space within the environment allows us to concentrate our resources selectively on that location while ignoring the rest of the space. In this study we investigated how the deployment of the focal attention in foveal vision can be affected by task and stimuli specificity. In particular, we measured the cue-size effect in four experiments: shape detection (Experiment 1), shape discrimination (Experiment 2), letter detection (Experiment 3), and letter discrimination (Experiment 4). Our results highlight that, although the focal component can be elicited by different tasks (i.e., detection or discrimination) and by using different types of stimuli (i.e., shapes or letters), those effects interact with each other. Specifically, the effect of focal attention is more noticeable when letter stimuli are used in the case of a detection task, while no difference between letters and geometrical shapes is observed in the discrimination task. Furthermore, the analysis of the cue-size effect across the four experiments confirmed that the deployment of focal attention in foveal vision is mainly reflexive.

Target enhancement and distractor inhibition affect transitory surround suppression in dual tasks using multiple rapid serial visual presentation streams

Few studies have investigated the interaction between temporal and spatial dimensions on selective attention using dual tasks in the multiple rapid serial visual presentation (RSVP) paradigm. A phenomenon that the surround suppression in space changes over time (termed transitory surround suppression, TSS, in the present study) has been observed, suggesting the existence of this time-space interaction. However, it is still unclear whether target enhancement or distractor inhibition modulates TSS. Four behavioural experiments were conducted to investigate the mechanism of TSS by manipulating the temporal lag and spatial distance factors between two targets embedded in six RSVP streams. The TSS effect was replicated in a study that eliminated confounds of perceptual effects and attentional switch (Experiment 1). However, the TSS disappeared when two targets shared the same colour in a between-subjects design (Experiment 2a) and a within-subject design (Experiment 2b), suggesting the impact of target enhancement on TSS. Moreover, the TSS was larger for within-category than for between-category distractors (Experiment 3), indicating the impact of distractor inhibition on TSS. These two influences on TSS under different processing demands of target and distractor processing were further confirmed in a skeletal design (Experiment 4). Overall, combinative effects of target enhancement and distractor suppression contribute to the mechanisms of time-space interaction in selective attention during visual search.

Attending to illusory differences in object size

Focused visual attention can be shifted between objects and locations (attentional orienting) or expanded and contracted in spatial extent (attentional focusing). Although orienting and focusing both modulate visual processing, they have been shown to be distinct, independent modes of attentional control. Objects play a central role in visual attention, and it is known that high-level object representations guide attentional orienting. It not known, however, whether attentional focusing is driven by low-level object representations (which code object size in terms of retinotopic extent) or by high-level representations (which code perceived size). We manipulated the perceived size of physically identical objects by using line drawings or photographs that induced the Ponzo illusion, in a task requiring the detection of a target within these objects. The distribution of attention was determined by the perceived size and not by the retinotopic size of an attended object, indicating that attentional focusing is guided by high-level object representations.

Spatial distribution of attention during attentional blink is influenced by eye movements

The present study examined three factors that might influence the spatial distribution of attention after the identification of a first target during attentional blink: the maximum distance between the two targets, the spatial configuration of stimuli, and eye movements. Results showed that the U-shaped distribution of attention during attentional blink persisted in the circular configuration of stimuli irrespective of the radius of the circle. In addition, the U-shaped distribution of attention during attentional blink depends on the circular configuration of stimuli and the central fixation. When two targets appeared in noncircular configurations and eye movements were not strictly restrained, a large proportion of observers showed a gradient for the accuracy of the second target (T2) during attentional blink. However, when observers kept fixating on the central cross in a noncircular configuration, they showed a U-shaped distribution of T2 performance during attentional blink. Furthermore, observers are more likely to show a gradient distribution of T2 performance during attentional blink as their probability of fixating the first target (T1) increases. These results suggest that maintaining equal eccentricity for each stimulus is critical for producing the U-shaped distribution of attention during attentional blink.

Spatial distribution of the attentional blink

In the present study subjects viewed streams of rapid serially presented characters and searched for a target digit. After presentation of the target digit, a second target consisting of an orientation singleton (Experiment 1) or a second digit (Experiment 2) was presented at one of several distances from the first target. The attentional blink (AB) impaired performance on the second target with the effect being strongest at distances somewhat removed from the first target location. These results are consistent with lateral inhibition theory and help to resolve some fundamental questions about the spatial distribution of the AB.

Time course of visual attention across perceptual levels and objects

Theories of shifts of visual attention based on attentional blink or dwell time do not directly address shifts of attention across different levels (global or local) involving multiple objects. Two experiments were conducted employing the attentional dwell time paradigm to investigate the shifts of visual attention between objects selected at same or different levels. Participants were instructed to identify two successive compound stimuli at a pre-specified level (global or local) presented at two different locations with variable SOA. The initial pair of locations in which the stimulus was presented was fixed in Experiment 1 but not in Experiment 2. Experiment 1 results showed very little impairment for second target identification when both the targets were at the global level. Attentional shift was better with both targets at the same level compared to different levels. Experiment 2 results showed that local followed by global target identification is difficult at short SOAs compared to other conditions. The results indicate that scope of attention affects the time course of visual attention. Global processing could be performed with very little capacity limitation simultaneously with distributed attention. The default mode of attention might be distributed and attention becomes focused for target identification. Different mechanisms may underlie shifts in focused attention between different locations and changes in attentional set required by changes in perceptual levels.

Attenuation of neural responses in primary visual cortex during the attentional blink

Information-processing bottlenecks are characteristic of many cognitive and neural systems. One such bottleneck is revealed by tasks in which rapidly successive stimulus events must be reported. Here, observers missed the second of two visual targets if it occurred within 700 ms of the first [an "attentional blink" (AB)], even though this second target could be reported accurately when the first item was ignored. Isolating neural responses to such rapid events has proven difficult because current magnetic resonance imaging methods rely on relatively sluggish changes in the brain's physiological response to sensory inputs. Here, we overcame this limitation by presenting successive visual targets at different spatial locations, thereby exploiting the retinotopic organization of early cortical visual areas to distinguish neural activity associated with successive target events. We show that neural activity in primary visual cortex is significantly modulated during the AB, and that this activity mirrors behavioral measures of target identification accuracy. The findings suggest that the neural signature of perceptual suppression during processing of rapidly successive stimuli is evident at the earliest stages of cortical sensory processing.

Object continuity enhances selective auditory attention

In complex scenes, the identity of an auditory object can build up across seconds. Given that attention operates on perceptual objects, this perceptual buildup may alter the efficacy of selective auditory attention over time. Here, we measured identification of a sequence of spoken target digits presented with distracter digits from other directions to investigate the dynamics of selective attention. Performance was better when the target location was fixed rather than changing between digits, even when listeners were cued as much as 1 s in advance about the position of each subsequent digit. Spatial continuity not only avoided well known costs associated with switching the focus of spatial attention, but also produced refinements in the spatial selectivity of attention across time. Continuity of target voice further enhanced this buildup of selective attention. Results suggest that when attention is sustained on one auditory object within a complex scene, attentional selectivity improves over time. Similar effects may come into play when attention is sustained on an object in a complex visual scene, especially in cases where visual object formation requires sustained attention.