Feature- and category-specific attentional control settings are differently affected by attentional engagement in contingent attentional capture

Measuring attentional selection of object categories using hierarchical frequency tagging

In the present study, we used Hierarchical Frequency Tagging (Gordon et al., 2017) to investigate in electroencephalography how different levels of the neural processing hierarchy interact with category-selective attention during visual object recognition. We constructed stimulus sequences of cyclic wavelet scrambled face and house stimuli at two different frequencies (f1 = 0.8 Hz and f2 = 1 Hz). For each trial, two stimulus sequences of different frequencies were superimposed and additionally augmented by a sinusoidal contrast modulation with f3 = 12.5 Hz. This allowed us to simultaneously assess higher level processing using semantic wavelet-induced frequency-tagging (SWIFT) and processing in earlier visual levels using steady-state visually evoked potentials (SSVEPs), along with their intermodulation (IM) components. To investigate the category specificity of the SWIFT signal, we manipulated the category congruence between target and distractor by superimposing two sequences containing stimuli from the same or different object categories. Participants attended to one stimulus (target) and ignored the other (distractor). Our results showed successful tagging of different levels of the cortical hierarchy. Using linear mixed-effects modeling, we detected different attentional modulation effects on lower versus higher processing levels. SWIFT and IM components were substantially increased for target versus distractor stimuli, reflecting attentional selection of the target stimuli. In addition, distractor stimuli from the same category as targets elicited stronger SWIFT signals than distractor stimuli from a different category indicating category-selective attention. In contrast, for IM components, this category-selective attention effect was largely absent, indicating that IM components probably reflect more stimulus-specific processing.

The time course of category-based attentional template pre-activation depends on the category framework

When searching for a target defined by a set of objects, attention can be directed toward task-relevant objects by creating a category-based attentional template (CAT). Previous studies have found that CAT can be activated before the onset of the target. However, the time course of CAT pre-activation and whether the category framework (prototypical or semantic) can modulate it remain unclear. To explore the time course of CAT pre-activation, we employed a rapid serial probe presentation paradigm (RSPP) with event-related potentials (ERPs). To investigate the effect of the category framework on the time course of CAT pre-activation, the target category was defined as the prototypical category (Experiment 1) or the semantic category (Experiment 2). The results showed that the prototype-based CAT was pre-activated 300 ms prior to the target, whereas the semantics-based CAT was pre-activated 1500 ms before the onset of the target. The difference in the time course of pre-activation between the two CAT types indicates that the category framework can modulate the time course of CAT pre-activation. Additionally, during the attentional selection phase, an overall comparison of the target revealed that a larger N2pc was elicited by the prototype-based CAT than by the semantics-based CAT, suggesting that the prototype-based CAT could capture more attention than the semantics-based CAT. The findings on the difference between the two CAT frameworks in the preparatory and attentional selection phases provide more evidence for categorical information in visual search and extend our understanding of the mechanism of categorical attentional selection.

Distinct roles of theta and alpha oscillations in the process of contingent attentional capture

Introduction

Visual spatial attention can be captured by a salient color singleton that is contingent on the target feature. A previous study reported that theta (4-7 Hz) and alpha (8-14 Hz) oscillations were related to contingent attentional capture, but the corresponding attentional mechanisms of these oscillations remain unclear.

Methods

In this study, we analyzed the electroencephalogram data of our previous study to investigate the roles of capture-related theta and alpha oscillation activities. Different from the previous study that used color-changed placeholders as irrelevant cues, the present study adopted abrupt onsets of color singleton cues which tend to elicit phase-locked neural activities. In Experiment 1, participants completed a peripheral visual search task in which spatially uninformative color singleton cues were inside the spatial attentional window and a central rapid serial visual presentation (RSVP) task in which the same cues were outside the spatial attentional window. In Experiment 2, participants completed a color RSVP task and a size RSVP task in which the peripheral color singleton cues were contingent and not contingent on target feature, respectively.

Results

In Experiment 1, spatially uninformative color singleton cues elicited lateralized theta activities when they were contingent on target feature, irrespective of whether they were inside or outside the spatial attentional window. In contrast, the same color singleton cues elicited alpha lateralization only when they were inside the spatial attentional window. In Experiment 2, we further found that theta lateralization vanished if the color singleton cues were not contingent on target feature.

Discussion

These results suggest distinct roles of theta and alpha oscillations in the process of contingent attentional capture initiated by abrupt onsets of singleton cues. Theta activities may reflect global enhancement of target feature, while alpha activities may be related to attentional engagement to spatially relevant singleton cues. These lateralized neural oscillations, together with the distractor-elicited N2pc component, might consist of multiple stages of attentional processes during contingent attentional capture.

Category-based attentional capture can be influenced by color- and shape-dimensions independently in the conjunction search task

Attention can be involuntarily attracted by a distractor that matches the current attentional control settings (ACSs). However, it remains unclear whether two category-specific ACSs can operate independently. By defining a target as a combination of two prototype-based categories, the present event-related potential (ERP) study investigated how color-category and shape-category ACSs operate within a search task paradigm and the effects of temporal task demands on these ACSs. The matching level between target and distractor was manipulated to separate the effects of each ACS. The relative position between target and distractor was employed to isolate the attentional processing of the distractor from the target. Furthermore, two display durations were used to manipulate the temporal task demands, including a short fixed window (800 ms) and a dynamic window extended until the user responded. Our results support a two-stage selection scenario. In early stage, the color- and shape-ACS independently guided attention to task-relevant property (N2pc components) and suppressed attention toward task-irrelevant properties (P_D components). In late stage, these two independent ACSs were integrated into a holistic ACS to interfere with the consolidation (contralateral delay activity components) and behavioral performance (accuracy and RTs) of target identification. Moreover, an early N1/P1 component might reflect a preattentive enhancement of relevant information or a preattentive suppression of irrelevant objects. These two category-specific ACSs weights differently in varied temporal task demands. These findings support the idea that independent early processing is followed by integrated late processing, which can be applied to category-based attentional capture with different temporal task demands.

Investigating the role of verbal templates in contingent capture by color

To investigate if top-down contingent capture by color cues relies on verbal or semantic templates, we combined different stimuli representing colors physically or semantically in six contingent-capture experiments. In contingent capture, only cues that match the top-down search templates lead to validity effects (shorter search times and fewer errors for validly than for invalidly cued targets) resulting from attentional capture by the cue. We compared validity effects of color cues and color-word cues in top-down search for color targets (Experiment 1a) and color-word targets (Experiment 2). We also compared validity effects of color cues and color-associated symbolic cues during search for color targets (Experiment 1b) and of color-word cues during search for both color and color-word targets (Experiment 3). Only cues of the same stimulus category as the target (either color or color-word cues) captured attention. This makes it unlikely that color search is based on verbal or semantic search templates. Additionally, the validity effect of matching color-word cues during search for color-word targets was neither changed by cue-target graphic (font) similarity versus dissimilarity (Experiment 4) nor by articulatory suppression (Experiment 5). These results suggested either a phonological long-term memory template or an orthographically mediated effect of the color-word cues during search for color-words. Altogether, our findings are in line with a pronounced role of color-based templates during contingent capture by color and do not support semantic or verbal influences in this situation.

Contingent capture during search for alphanumerical characters: A case of feature-based capture or of conceptual category membership?

To distinguish if search for alphanumerical characters is based on features or on conceptual category membership, we conducted two experiments where we presented upright and inverted characters as cues in a contingent-capture protocol. Here, only cues matching the top-down search template (e.g., a letter cue when searching for target letters) capture attention and lead to validity effects: shorter search times and fewer errors for validly than invalidly cued targets. Top-down nonmatching cues (e.g., a number cue when searching for target letters) do not capture attention. To tell a feature-based explanation from one based on conceptual category membership, we used both upright (canonical) and inverted characters as cues. These cues share the same features, but inverted cues cannot be conceptually categorized as easily as upright cues. Thus, we expected no difference between upright and inverted cues when search is feature-based, whereas inverted cues would elicit no or at least considerably weaker validity effects if search relies on conceptual category membership. Altogether, the results of both experiments (with overlapping and with separate sets of characters for cues and targets) provide evidence for search based on feature representations, as among other things, significant validity effects were found with upright and inverted characters as cues. However, an influence of category membership was also evident, as validity effects of inverted characters were diminished.

Practice reduces set-specific capture costs only superficially

Contingent attentional capture costs are doubled or tripled under certain conditions when multiple attentional sets guide visual search (e.g., "search for green letters" and "search for orange letters"). Such "set-specific" capture occurs when a potential target that matches one attentional set (e.g., a green stimulus) impairs the ability to identify a temporally proximal target that matches another attentional set (e.g., an orange stimulus). In the present study, we examined whether these severe set-specific capture effects could be attenuated through training. In Experiment 1, half of participants experienced training consisting of mostly trials involving a set switch from distractor to target, while the other half experienced training consisting of mostly trials in which a set switch was not required. Upon test, participants trained on set switches produced greatly reduced set-specific capture effects compared to their own pretraining levels and compared to participants trained on trials without a set switch. However, in Experiments 2 and 3, we found that these training effects did not transfer to a new color context or even a single new target color, indicating that they were specific and involved low-level associative learning. We concluded that set-specific capture is pervasive and largely immutable, even with practice.

The different roles of category- and feature-specific attentional control settings on attentional enhancement and inhibition

Contingent attentional capture suggests that top-down attentional control settings (ACS) can enhance attentional processing of task-relevant properties and inhibit attentional processing of task-irrelevant properties. However, it remains unclear how ACS operates when a distractor has both task-relevant and task-irrelevant characteristics. In the present study, two lateralized ERP components, N2pc and distractor positivity (Pd), were employed as markers of attentional enhancement and inhibition, respectively. The degree of matching between a distractor and a conjunctively defined target was manipulated to illustrate attentional guidance by category-specific ACS (cACS) and feature-specific ACS (fACS), and the relative position between the distractor and the target was manipulated to isolate the processing of the distractor and the target. Experiment 1 showed that, with a long display duration for searching, a reliable N2pc component was elicited by a distractor that was feature-matched but category-mismatched (C-F+) relative to the target-defined properties, suggesting an enhancing effect of fACS. In contrast, Experiment 2 demonstrated that, with a short display duration, a Pd component was elicited by a distractor that was feature-mismatched but category-matched (C+F-) relative to the target-defined properties, suggesting an inhibitory effect of fACS. Moreover, both attentional enhancement and inhibition were only triggered by fACS but not by cACS. In summary, ACS can enhance target-relevant properties or inhibit target-irrelevant properties in response to the display duration, and fACS affects both enhancement and inhibition more than cACS.