Alpha-Band Lateralization and Microsaccades Elicited by Exogenous Cues Do Not Track Attentional Orienting

We explore the world by constantly shifting our focus of attention toward salient stimuli and then disengaging from them in search of new ones. The alpha rhythm (8-13 Hz) has been suggested as a pivotal neural substrate of these attentional shifts, due to its local synchronization and desynchronization that suppress irrelevant cortical areas and facilitate relevant areas, a phenomenon called alpha lateralization. Whether alpha lateralization tracks the focus of attention from orienting toward a salient stimulus to disengaging from it is still an open question. We addressed it by leveraging the phenomenon of inhibition of return (IOR), consisting of an initial facilitation in response times (RTs) for stimuli appearing at an exogenously cued location, followed by a suppression of that location. Our behavioral data from human participants showed a typical IOR effect with both early facilitation and subsequent inhibition. In contrast, alpha lateralized in the cued direction after the behavioral facilitation effect and never re-lateralized compatibly with the behavioral inhibition. Furthermore, we analyzed the interaction between alpha lateralization and microsaccades: while alpha was lateralized toward the cued location, microsaccades were mostly oriented away from it. Crucially, the two phenomena showed a significant positive correlation. These results indicate that alpha lateralization reflects primarily the processing of salient stimuli, challenging the view that alpha lateralization is directly involved in exogenous attentional orienting per se. We discuss the relevance of the present findings for an oculomotor account of alpha lateralization as a modulator of cortical excitability in preparation of a saccade.

Cross-modal enhancement of spatially unpredictable visual target discrimination during the attentional blink

The attentional blink can be substantially reduced by delivering a task-irrelevant sound synchronously with the second target (T2) embedded in a rapid serial visual presentation stream, which is further modulated by the semantic congruency between the sound and T2. The present study extended the cross-modal boost during attentional blink and the modulation of audiovisual semantic congruency in the spatial domain by showing that a spatially uninformative, semantically congruent (but not incongruent) sound could even improve the discrimination of spatially unpredictable T2 during attentional blink. T2-locked event-related potential (ERP) data yielded that the early cross-modal P195 difference component (184-234 ms) over the occipital scalp contralateral to the T2 location was larger preceding accurate than inaccurate discriminations of semantically congruent, but not incongruent, audiovisual T2s. Interestingly, the N2pc component (194-244 ms) associated with visual-spatial attentional allocation was enlarged for incongruent audiovisual T2s relative to congruent audiovisual and unisensory visual T2s only when they were accurately discriminated. These ERP findings suggest that the spatially extended cross-modal boost during attentional blink involves an early cross-modal interaction strengthening the perceptual processing of T2, without any sound-induced enhancement of visual-spatial attentional allocation toward T2. In contrast, the absence of an accuracy decrease in response to semantically incongruent audiovisual T2s may originate from the semantic mismatch capturing extra visual-spatial attentional resources toward T2.

The effects of attention in auditory-visual integration revealed by time-varying networks

Attention and audiovisual integration are crucial subjects in the field of brain information processing. A large number of previous studies have sought to determine the relationship between them through specific experiments, but failed to reach a unified conclusion. The reported studies explored the relationship through the frameworks of early, late, and parallel integration, though network analysis has been employed sparingly. In this study, we employed time-varying network analysis, which offers a comprehensive and dynamic insight into cognitive processing, to explore the relationship between attention and auditory-visual integration. The combination of high spatial resolution functional magnetic resonance imaging (fMRI) and high temporal resolution electroencephalography (EEG) was used. Firstly, a generalized linear model (GLM) was employed to find the task-related fMRI activations, which was selected as regions of interesting (ROIs) for nodes of time-varying network. Then the electrical activity of the auditory-visual cortex was estimated via the normalized minimum norm estimation (MNE) source localization method. Finally, the time-varying network was constructed using the adaptive directed transfer function (ADTF) technology. Notably, Task-related fMRI activations were mainly observed in the bilateral temporoparietal junction (TPJ), superior temporal gyrus (STG), primary visual and auditory areas. And the time-varying network analysis revealed that V1/A1↔STG occurred before TPJ↔STG. Therefore, the results supported the theory that auditory-visual integration occurred before attention, aligning with the early integration framework.

No evidence for rhythmic sampling in inhibition of return

When exogenously cued, attention reflexively reorients towards the cued position. After a brief dwelling time, attention is released and then persistently inhibited from returning to this position for up to three seconds, a phenomenon coined 'inhibition of return' (IOR). This inhibitory interpretation has shaped our understanding of the spatio-temporal dynamics of the attentional spotlight after an exogenous visual cue for more than three decades. However, a recent theory refines this traditional view and predicts that attention rhythmically alternates between possible target locations at a theta frequency, implying occasional returns of attention to the cued position. Unfortunately, previous IOR studies have only probed performance at a few, temporally wide-spread cue-target onset asynchronies (CTOAs) rendering a comparison of these contradictory predictions impossible. We therefore used a temporally fine-grained adaptation of the Posner paradigm with 25 equally and densely spaced CTOAs, which yielded a robust IOR effect in the reaction time difference between valid and invalidly cued trials. We modelled the time course of this effect across CTOAs as a linear or exponential decay (traditional IOR model), sinusoidal rhythm (rhythmic model) and a combination of both (hybrid model). Model comparison by means of goodness-of-fit indices provided strong evidence in favor of traditional IOR models, and against theta-rhythmic attentional sampling contributing to IOR. This finding was supported by an FFT analysis, which also revealed no significant theta rhythm. We therefore conclude that the spatio-temporal dynamics of attention following an exogenous cue cannot be explained by rhythmic attentional sampling.

Multisensory integration attenuates visually induced oculomotor inhibition of return

Inhibition of return (IOR) is a mechanism of the attention system involving bias toward novel stimuli and delayed generation of responses to targets at previously attended locations. According to the two-component theory, IOR consists of a perceptual component and an oculomotor component (oculomotor IOR [O-IOR]) depending on whether the eye movement system is activated. Previous studies have shown that multisensory integration weakens IOR when paying attention to both visual and auditory modalities. However, it remains unclear whether the O-IOR effect attenuated by multisensory integration also occurs when the oculomotor system is activated. Here, using two eye movement experiments, we investigated the effect of multisensory integration on O-IOR using the exogenous spatial cueing paradigm. In Experiment 1, we found a greater visual O-IOR effect compared with audiovisual and auditory O-IOR in divided modality attention. The relative multisensory response enhancement (rMRE) and violations of Miller's bound showed a greater magnitude of multisensory integration in the cued location compared with the uncued location. In Experiment 2, the magnitude of the audiovisual O-IOR effect was significantly less than that of the visual O-IOR in single visual modality selective attention. Implications for the effect of multisensory integration on O-IOR were discussed under conditions of oculomotor system activation, shedding new light on the two-component theory of IOR.

Inhibition of return in time-lapse: Brain Rhythms during grip force control for spatial attention

The inhibition of return (IoR) is the observable slowed response to a target at a cued position for cue-target intervals of longer than 300 ms; when there has been enough time to disengage from a previously-cued location, an inhibitory after-effect can be observed. Studies aimed at understanding whether mechanisms underlying IoR act at a perceptual/attentional or a later response-execution stage have offered divergent results. Though focusing on the brain's responses to cue-target intervals can offer significant information on the nature of IoR, few studies have investigated neural activity during this interval; these studies suggest the generation of inhibitory tags on the spatial coordinates of the previously attended position which, in turn, inhibit motor programming toward that position. As such, a cue-target task was administered in this study; the rhythmic activity of EEG signals on the entire cue-target interval was measured to determine whether IoR is referred to early or late response processing stages. A visually-guided force variation during isometric contraction, instead of a key press response, was required to reduce the effect of motor response initiation. Our results indicated the prominent involvement of the fronto-parietal and occipital cortical areas post-cue appearance, with a peculiar theta band modulation characterizing the posterior parietal cortex. Theta activity in this region was enhanced post-cue onset, decreased over time, and was enhanced again when a target appeared in an unexpected location rather than in a cued position. This suggests that the mechanism that generates IoR sequentially affects perceptual/attentional processing and motor preparation rather than response execution.

Electrophysiological evidence of different neural processing between visual and audiovisual inhibition of return

Inhibition of return (IOR) refers to the slower response to targets appearing on the same side as the cue (valid locations) than to targets appearing on the opposite side as the cue (invalid locations). Previous behaviour studies have found that the visual IOR is larger than the audiovisual IOR when focusing on both visual and auditory modalities. Utilising the high temporal resolution of the event-related potential (ERP) technique we explored the possible neural correlates with the behaviour IOR difference between visual and audiovisual targets. The behavioural results revealed that the visual IOR was larger than the audiovisual IOR. The ERP results showed that the visual IOR effect was generated from the P1 and N2 components, while the audiovisual IOR effect was derived only from the P3 component. Multisensory integration (MSI) of audiovisual targets occurred on the P1, N1 and P3 components, which may offset the reduced perceptual processing due to audiovisual IOR. The results of early and late differences in the neural processing of the visual IOR and audiovisual IOR imply that the two target types may have different inhibitory orientation mechanisms.

Exploring the temporal dynamics of inhibition of return using steady-state visual evoked potentials

Inhibition of return is characterized by delayed responses to previously attended locations when the interval between stimuli is long enough. The present study employed steady-state visual evoked potentials (SSVEPs) as a measure of attentional modulation to explore the nature and time course of input- and output-based inhibitory cueing mechanisms that each slow response times at previously stimulated locations under different experimental conditions. The neural effects of behavioral inhibition were examined by comparing post-cue SSVEPs between cued and uncued locations measured across two tasks that differed only in the response modality (saccadic or manual response to targets). Grand averages of SSVEP amplitudes for each condition showed a reduction in amplitude at cued locations in the window of 100-500 ms post-cue, revealing an early, short-term decrease in the responses of neurons that can be attributed to sensory adaptation, regardless of response modality. Because primary visual cortex has been found to be one of the major sources of SSVEP signals, the results suggest that the SSVEP modulations observed were caused by input-based inhibition that occurred in V1, or visual areas earlier than V1, as a consequence of reduced visual input activity at previously cued locations. No SSVEP modulations were observed in either response condition late in the cue-target interval, suggesting that neither late input- nor output-based IOR modulates SSVEPs. These findings provide further electrophysiological support for the theory of multiple mechanisms contributing to behavioral cueing effects.

Human electrophysiology reveals delayed but enhanced selection in inhibition of return

Visual environment tends to be stable over the short run. An immediately visited location often doesn't provide new information and can be safely inhibited, as exemplified by inhibition of return (IOR)-attention takes longer to return to a previously cued location. Attention selection at this inhibited location has been widely characterized as inferior, in which the target at the cued location has diminished salience, with lower rate of accumulation in the priority map for attention selection. We demonstrate here that an electrophysiology index of visual selection-the N2pc component-is delayed but enhanced at the cued than uncued location, and this enhancement in the N2pc amplitude predicts reduction in the behavioral IOR effect. By isolating a pure target N2pc, these results reveal an active attention enhancement mechanism that facilitates adaptive allocation of attention when a target appears at a previously cued location, potentially acting as a compensation mechanism for inhibition.

Cross-modal nonspatial repetition inhibition: An ERP study

Previous studies have demonstrated that nonspatial repetition inhibition can occur across modalities. However, the underlying mechanism of such cross-modal nonspatial repetition inhibition is unknown. The present experiment adopted a cross-modal prime-neutral cue-target paradigm in which in consecutive trials the prime and the target were matched or mismatched, not only in identity but also in modality. Meanwhile, event-related potentials (ERPs) to visual and auditory targets were recorded. The present study aimed to answer two questions: which ERP components reflect nonspatial repetition inhibition across modalities, and is the ERP component modality specific or supramodal? The results showed that for visual targets, robust nonspatial repetition inhibition occurred similarly for both unimodal (visual-visual) and cross-modal (audio-visual) target pairings, as indexed by an N400 repetition-induced increment in the typical N400 window but null effects during the N2 epoch. For auditory targets, similar modulation of cross-modal nonspatial repetition inhibition on the auditory-evoked N400 repetition-induced increment was observed. These results suggest that the N400 repetition-induced increment occurs during the N400 epoch that underlies cross-modal nonspatial repetition inhibition and that this N400 component is a supramodal component.

What Neuroscientific Studies Tell Us about Inhibition of Return

An inhibitory aftermath of orienting, inhibition of return (IOR), has intrigued scholars since its discovery about 40 years ago. Since then, the phenomenon has been subjected to a wide range of neuroscientific methods and the results of these are reviewed in this paper. These include direct manipulations of brain structures (which occur naturally in brain damage and disease or experimentally as in TMS and lesion studies) and measurements of brain activity (in humans using EEG and fMRI and in animals using single unit recording). A variety of less direct methods (e.g., computational modeling, developmental studies, etc.) have also been used. The findings from this wide range of methods support the critical role of subcortical and cortical oculomotor pathways in the generation and nature of IOR.

From alternation to repetition: Spatial attention biases contribute to sequential effects in a choice reaction-time task

Observers often take longer to respond to a visual target when it appears at a recently stimulated location than when it appears at a new location in the visual field. This behavioral impairment - known as inhibition of return (IOR) - is mirrored by a reduction of an event-related potential (ERP) component called the N2pc that has been associated with attentional selection. Together, these findings indicate that the mechanism underlying IOR operates to bias covert attention against re-visiting the most recently attended location. The goal of the present study was to determine how this inhibitory attention bias evolves across successive trials of a two-item search task. Initially, targets appearing at previously attended locations were associated with behavioral IOR and a concomitant reduction of the N2pc. After several successive trials, this initial inhibitory bias was superseded by expectancy-based biases associated with "predictable" inter-trial patterns of location repeats or location changes, in some cases leading to faster responses and a larger N2pc when the target location repeated (facilitation of return).  These results provide evidence that biases in the covert deployment of attention are updated dynamically according to the recent selection history and contribute to well-known sequential effects in serial choice reaction-time tasks.

Different visual and auditory latencies affect cross-modal non-spatial repetition inhibition

The present study examined the effect of different latencies for processing visual and auditory stimuli in cross-modal non-spatial repetition inhibition. In two experiments, the cue validity of modality and identity between the prime and the target was manipulated in a "prime-neutral cue-target" paradigm. A distinct neutral event was presented after the prime and before the onset of the target. The prime probe was visual in Experiment 1 and auditory in Experiment 2. The results in both experiments showed that RTs for identity-cued trials were significantly slower than RTs for identity-cued trials regardless of whether the modality of the target was visual or auditory. In addition, RTs for visual trials were significantly faster than RTs for auditory trials, indicating different latencies of processing visual and auditory stimuli. This latency difference affects cross-modal non-spatial repetition inhibition in two aspects: 1) creating a new representation (identity uncued) that is delivered via visual modality is easier under audio-visual conditions, and 2) retrieving an inhibited representation (identity cued) that is delivered via auditory modality is more difficult under visual-audio conditions. We propose that cross-modal non-spatial repetition inhibition, which is distinct from unimodal repetition inhibition, can be easily influenced by different latencies of processing visual and auditory stimuli.

Bimodal-divided attention attenuates visually induced inhibition of return with audiovisual targets

Inhibition of return (IOR) refers to the slower response to a target appearing at a previously attended location in a cue-target paradigm. It has been greatly explored in the visual or auditory modality. This study investigates differences between the IOR of audiovisual targets and the IOR of visual targets under conditions of modality-specific selective attention (Experiment 1) and divided-modalities attention (Experiment 2). We employed an exogenous spatial cueing paradigm and manipulated the modalities of targets, including visual, auditory, or audiovisual modalities. The participants were asked to detect targets in visual modality or both visual and auditory modalities, which were presented on the same (cued) or opposite (uncued) side as the preceding visual peripheral cues. In Experiment 1, we found the comparable IOR with visual and audiovisual targets when participants were asked to selectively focus on visual modality. In Experiment 2, however, there was a smaller magnitude of IOR with audiovisual targets as compared with visual targets when paying attention to both visual and auditory modalities. We also observed a reduced multisensory response enhancement effect and race model inequality violation at cued locations relative to uncued locations. These results provide the first evidence of the IOR with audiovisual targets. Furthermore, IOR with audiovisual targets decreases when paying attention to both modalities. The interaction between exogenous spatial attention and audiovisual integration is discussed.

Electrophysiological Correlates of the Effect of Task Difficulty on Inhibition of Return

Inhibition of return (IOR) refers to slower responses to targets that occur at a previously attended location than to those at control locations. Previous studies on the impact of task difficulty on IOR have shown conflicting results. However, these studies failed to match low-level characteristics of stimuli (e.g., size, color, and luminance) across difficulty levels, and so might have confounded the effect of task difficulty with that of stimulus characteristics. Hence, whether and how task difficulty modulates IOR remain largely unknown. This study utilized the event-related potentials (ERPs) technique in combination with a cue-target paradigm to tackle this question. Task difficulty was manipulated by changing the position of a gap in a rectangle stimulus, while stimulus size, color, and luminance were precisely matched. IOR was observed in reaction times across all difficulty levels but was found in accuracy at the medium level only. The modulation effect of task difficulty on IOR was also evident in the N1 and P2 ERP components, which showed significantly weaker IOR effects at the medium difficulty level than at the easy and hard levels. It is suggested that the modulation of IOR by task difficulty involves both perceptual and post-perceptual processes.

Electrophysiological evidence of an attentional bias in crossmodal inhibition of return

Inhibition of return (IOR) refers to a delay in responding to targets when they appear at recently attended locations, relative to unattended locations. Within the visual modality, this attentional bias has been associated with a reduction in the N2pc event-related potential (ERP) component at previously attended locations. The present study examined whether a similar attentional bias was observed in crossmodal audio-visual IOR. Our results demonstrate that for visual targets, the attentional component of IOR behaves similarly for both unimodal and crossmodal target pairs, as indexed by a reduction in the N2pc component for targets appearing at previously attended locations. Further, similar IOR-related modulations on the auditory-evoked N2ac indicated that an attentional bias can be observed for auditory targets as well. Finally, we identified two additional ERP components - the ACOP and VCAN - that appear to reflect biasing of attention in the currently unattended sensory modality. These results suggest that the inhibitory attentional bias that underlies the IOR effect may be supramodal and bias attention away from previously attended locations regardless of sensory modality.

Time course of inhibition of return in a spatial cueing paradigm with distractors

Studies of endogenous and exogenous attentional orienting in spatial cueing paradigms have been used to investigate inhibition of return, a behavioral phenomenon characterized by delayed reaction time in response to recently attended locations. When eye movements are suppressed, attention is covertly oriented to central or peripheral stimuli. Overt orienting, on the other hand, requires explicit eye movements to the stimuli. The present study examined the time course of slowed reaction times to previously attended locations when distractors are introduced into overt and covert orienting tasks. In a series of experiments, manual responses were required to targets following central and peripheral cues at three different cue-target intervals, with and without activated oculomotor systems. The results demonstrate that, when eye movements are suppressed, behavioral inhibition is reduced or delayed in magnitude by the presence of a distractor relative to conditions without distractors. However, the time course of behavioral inhibition when eye movements are required remains similar with or without distractors.

Evidence for an attentional component of inhibition of return in visual search

Inhibition of return (IOR) is typically described as an inhibitory bias against returning attention to a recently attended location as a means of promoting efficient visual search. Most studies examining IOR, however, either do not use visual search paradigms or do not effectively isolate attentional processes, making it difficult to conclusively link IOR to a bias in attention. Here, we recorded ERPs during a simple visual search task designed to isolate the attentional component of IOR to examine whether an inhibitory bias of attention is observed and, if so, how it influences visual search behavior. Across successive visual search displays, we found evidence of both a broad, hemisphere-wide inhibitory bias of attention along with a focal, target location-specific facilitation. When the target appeared in the same visual hemifield in successive searches, responses were slower and the N2pc component was reduced, reflecting a bias of attention away from the previously attended side of space. When the target occurred at the same location in successive searches, responses were facilitated and the P1 component was enhanced, likely reflecting spatial priming of the target. These two effects are combined in the response times, leading to a reduction in the IOR effect for repeated target locations. Using ERPs, however, these two opposing effects can be isolated in time, demonstrating that the inhibitory biasing of attention still occurs even when response-time slowing is ameliorated by spatial priming.

Is Inhibition of Return Modulated by Involuntary Orienting of Spatial Attention: An ERP Study

Inhibition of return (IOR) is a mechanism that indicates individuals’ faster responses or higher accuracy to targets appearing in the novel location relative to the cued location. According to the “reorienting hypothesis,” disengagement from the cued location is necessary for the generation of IOR. However, more and more studies have questioned this theory because of dissociation between voluntary or involuntary spatial orienting and the IOR effect. To further explore the “reorienting hypothesis” of IOR, the present experiment employed an atypical cue-target paradigm which combined a spatially non-predictive peripheral cue that was presumed to trigger IOR with a spatially non-predictive central cue that was used to reflexively trigger a shift of attention. The results showed that a significant IOR effect did not interact with automatic spatial orienting as measured in mean RTs and accuracy as well as the Nd component. These findings suggested that the IOR effect triggered by peripheral cue was independent of automatic orienting generated by a central cue. Therefore, the present study provided evidence from location task and neural aspects, which again challenged the “reorienting hypothesis” of IOR.

Visually Induced Inhibition of Return Affects the Integration of Auditory and Visual Information

Multisensory integration (MSI) and exogenous spatial attention can both speedup responses to perceptual events. Recently, it has been shown that audiovisual integration at exogenously attended locations is reduced relative to unattended locations. This effect was observed at short cue-target intervals (200–250 ms). At longer intervals, however, the initial benefits of exogenous shifts of spatial attention at the cued location are often replaced by response time (RT) costs (also known as Inhibition of Return, IOR). Given these opposing cueing effects at shorter versus longer intervals, we decided to investigate whether MSI would also be affected by IOR. Uninformative exogenous visual spatial cues were presented between 350 and 450 ms prior to the onset of auditory, visual, and audiovisual targets. As expected, IOR was observed for visual targets (invalid cue RT < valid cue RT). For auditory and audiovisual targets, neither IOR nor any spatial cueing effects were observed. The amount of relative multisensory response enhancement and race model inequality violation was larger for uncued as compared with cued locations indicating that IOR reduces MSI. The results are discussed in the context of changes in unisensory signal strength at cued as compared with uncued locations.

The Role of Color in Search Templates for Real-world Target Objects

During visual search, target representations (attentional templates) control the allocation of attention to template-matching objects. The activation of new attentional templates can be prompted by verbal or pictorial target specifications. We measured the N2pc component of the ERP as a temporal marker of attentional target selection to determine the role of color signals in search templates for real-world search target objects that are set up in response to word or picture cues. On each trial run, a word cue (e.g., "apple") was followed by three search displays that contained the cued target object among three distractors. The selection of the first target was based on the word cue only, whereas selection of the two subsequent targets could be controlled by templates set up after the first visual presentation of the target (picture cue). In different trial runs, search displays either contained objects in their natural colors or monochromatic objects. These two display types were presented in different blocks (Experiment 1) or in random order within each block (Experiment 2). RTs were faster, and target N2pc components emerged earlier for the second and third display of each trial run relative to the first display, demonstrating that pictures are more effective than word cues in guiding search. N2pc components were triggered more rapidly for targets in the second and third display in trial runs with colored displays. This demonstrates that when visual target attributes are fully specified by picture cues, the additional presence of color signals in target templates facilitates the speed with which attention is allocated to template-matching objects. No such selection benefits for colored targets were found when search templates were set up in response to word cues. Experiment 2 showed that color templates activated by word cues can even impair the attentional selection of noncolored targets. Results provide new insights into the status of color during the guidance of visual search for real-world target objects. Color is a powerful guiding feature when the precise visual properties of these objects are known but seems to be less important when search targets are specified by word cues.

Prism Adaptation Alters Electrophysiological Markers of Attentional Processes in the Healthy Brain

Neglect patients typically show a rightward attentional orienting bias and a strong disengagement deficit, such that they are especially slow in responding to left-sided targets after right-sided cues (Posner et al., 1984). Prism adaptation (PA) can reduce diverse debilitating neglect symptoms and it has been hypothesized that PA's effects are so generalized that they might be mediated by attentional mechanisms (Pisella et al., 2006; Redding and Wallace, 2006). In neglect patients, performance on spatial attention tasks improves after rightward-deviating PA (Jacquin-Courtois et al., 2013). In contrast, in healthy subjects, although there is evidence that leftward-deviating PA induces neglect-like performance on some visuospatial tasks, behavioral studies of spatial attention tasks have mostly yielded negative results (Morris et al., 2004; Bultitude et al., 2013). We hypothesized that these negative behavioral findings might reflect the limitations of behavioral measures in healthy subjects. Here we exploited the sensitivity of event-related potentials to test the hypothesis that electrophysiological markers of attentional processes in the healthy human brain are affected by PA. Leftward-deviating PA generated asymmetries in attentional orienting (reflected in the cue-locked N1) and in attentional disengagement for invalidly cued left targets (reflected in the target-locked P1). This is the first electrophysiological demonstration that leftward-deviating PA in healthy subjects mimics attentional patterns typically seen in neglect patients. Significance statement: Prism adaptation (PA) is a promising tool for ameliorating many deficits in neglect patients and inducing neglect-like behavior in healthy subjects. The mechanisms underlying PA's effects are poorly understood but one hypothesis suggests that it acts by modulating attention. To date, however, there has been no successful demonstration of attentional modulation in healthy subjects. We provide the first electrophysiological evidence that PA acts on attention in healthy subjects by mimicking the attentional pattern typically reported in neglect patients: both a rightward attentional orienting bias (reflected in the cue-locked N1) and a deficit in attentional disengagement from the right hemispace (reflected in the target-locked P1). This study makes an important contribution to refining current models of the mechanisms underlying PA's cognitive effects.

Does response selection contribute to inhibition of return?

Inhibition of return (IOR) means delayed responses for targets at a cued compared to targets at an uncued location. It is assumed to reflect delayed reallocation of attention toward a previously attended location. Besides an attentional mechanism, IOR could also be due to a cue-evoked inhibition to respond toward a cued target. In the present study, IOR with simple, compatible, and incompatible choice responses was compared and tracked by means of event-related EEG activity. IOR was amplified with simple responses but did not differ between compatible and incompatible responses. Attention-related ERP correlates were constant across cue target onset asynchronies as were, in part, behavioral effects. Early, rather sensory ERP components varied with time, reflecting sensory or attentional interaction of cue and target processing. None of these effects varied with response requirements, indicating that response selection does not contribute to IOR in manual choice response tasks.

Just passing through? Inhibition of return in saccadic sequences

Responses tend to be slower to previously fixated spatial locations, an effect known as “inhibition of return” (IOR). Saccades cannot be assumed to be independent, however, and saccade sequences programmed in parallel differ from independent eye movements. We measured the speed of both saccadic and manual responses to probes appearing in previously fixated locations when those locations were fixated as part of either parallel or independent saccade sequences. Saccadic IOR was observed in independent but not parallel saccade sequences, while manual IOR was present in both parallel and independent sequence types. Saccadic IOR was also short-lived, and dissipated with delays of more than ∼1500 ms between the intermediate fixation and the probe onset. The results confirm that the characteristics of IOR depend critically on the response modality used for measuring it, with saccadic and manual responses giving rise to motor and attentional forms of IOR, respectively. Saccadic IOR is relatively short-lived and is not observed at intermediate locations of parallel saccade sequences, while attentional IOR is long-lasting and consistent for all sequence types.

Stimulus-Locked and Response-Locked ERP Correlates of Spatial Inhibition of Return (IOR) in Old Age

Behavioral research has shown that Inhibition of Return (IOR) is preserved in old age although at longer time intervals between cue and target, which has been interpreted as reflecting a later disengagement from the cue. A recent event-related potential (ERP) study attributed this age-related pattern to an enhanced processing of the cue. Previous ERP research in young samples indicates that target and response processing are also affected by IOR, which makes interesting to study the ERP correlates of IOR from cue presentation to response execution. In this regard, in the present study stimulus-locked (cue-locked and target-locked) and response-locked ERPs were explored in healthy young and older participants. The behavioral results indicated preserved IOR in the older participants. The cue-locked ERPs could suggest that the older participants processed the cue as a warning signal to prepare for the upcoming target stimulus. Under IOR, target-locked ERPs of both age groups showed lower N1 amplitudes suggesting a suppression/inhibition of cued targets. During the P3 rising period, in young subjects a negative shift (Nd effect) to cued targets was observed in the lower visual field (LVF), and a positive shift (Pd effect) in the upper visual field. However, in the older group the Nd effect was absent suggesting a reduction of attentional resolution in the LVF. The older group showed enhanced motor activation to prepare correct responses, although IOR effects on response-locked lateralized readiness potential LRP indicated reduced response preparation to cued targets in both age groups. In general, results suggest that the older adults inhibit or reduce the visual processing of targets appearing at cued locations, and the preparation to respond to them, but with the added cost of allocating more attentional resources onto the cue and of maintaining a more effortful processing during the sequence of stimuli within the trial.

What pops out in positional priming of pop-out: insights from event-related EEG lateralizations

It is well established that, in visual pop-out search, reaction time (RT) performance is influenced by cross-trial repetitions versus changes of target-defining attributes. One instance of this is referred to as “positional priming of pop-out” (pPoP; Maljkovic and Nakayama, 1996). In positional PoP paradigms, the processing of the current target is examined depending on whether it occurs at the previous target or a previous distractor location, relative to a previously empty location (“neutral” baseline), permitting target facilitation and distractor inhibition to be dissociated. The present study combined RT measures with specific sensory- and motor-driven event-related lateralizations to track the time course of four distinct processing levels as a function of the target’s position across consecutive trials. The results showed that, relative to targets at previous target and “neutral” locations, the appearance of a target at a previous distractor location was associated with a delayed build-up of the posterior contralateral negativity wave, indicating that distractor positions are suppressed at early stages of visual processing. By contrast, presentation of a target at a previous target, relative to “neutral” and distractor locations, modulated the elicitation of the subsequent stimulus-locked lateralized readiness potential wave, indicating that post-selective response selection is facilitated if the target occurred at the same position as on the previous trial. Overall, the results of present study provide electrophysiological evidence for the idea that target location priming (RT benefits) does not originate from an enhanced coding of target saliency at repeated (target) locations; instead, they arise (near-) exclusively from processing levels subsequent to focal-attentional target selection.

The Temporal Cascade of Neural Processes Underlying Target Detection and Attentional Processing During Auditory Search

The posterior visual event-related potential (ERP) component, the N2pc, has been widely used to study lateralized shifts of attention within visual arrays. Recently, Gamble and Luck (2011) reported an auditory analog of this activity (the fronto-central "N2ac"), reflecting the lateralized focusing of attention toward a Target sound among 2 simultaneous auditory stimuli. Here, we directed an electrophysiological approach toward understanding auditory Target search within a more complex auditory environment in which rapidly occurring sounds were distributed across both time and space. Trials consisted of ten 40-ms monaural sounds rapidly presented to the 2 ears: 8 medium-pitch tones and 2 deviant sounds (one high and one low). For each block, one deviant type was designated as the Target, which participants needed to identify within each trial to discriminate its tonal quality. The extracted electrophysiological results included a very early enhancement, starting at approximately 50 ms, of a bilateral negative-polarity auditory brain response to the designated Target Deviant (compared with the Nontarget Deviant), followed at approximately 130 ms by the N2ac activity reflecting the lateralized focusing of attention toward that Target. The results delineate the tightly orchestrated sequence of neural processes underlying the detection of, and focusing of attention toward, Target sounds in complex auditory scenes.

Behavioral and neural interaction between spatial inhibition of return and the Simon effect

It has been well documented that the anatomically independent attention networks in the human brain interact functionally to achieve goal-directed behaviors. By combining spatial inhibition of return (IOR) which implicates the orienting network with some executive function tasks (e.g., the Stroop and the flanker tasks) which implicate the executive network, researchers consistently found that the interference effects are significantly reduced at cued compared to uncued locations, indicating the functional interaction between the two attention networks. However, a unique, but consistent effect is observed when spatial IOR is combined with the Simon effect: the Simon effect is significantly larger at the cued than uncued locations. To investigate the neural substrates underlying this phenomenon, we orthogonally combined the spatial IOR with the Simon effect in the present event-related fMRI study. Our behavioral data replicated previous results by showing larger Simon effect at the cued location. At the neural level, we found shared spatial representation system between spatial IOR and the Simon effect in bilateral posterior parietal cortex (PPC); spatial IOR specifically activated bilateral superior parietal cortex while the Simon effect specifically activated bilateral middle frontal cortex. Moreover, left precentral gyrus was involved in the neural interaction between spatial IOR and the Simon effect by showing significantly higher neural activity in the "Cued_Congruent" condition. Taken together, our results suggest that due to the shared spatial representation system in the PPC, responses were significantly facilitated when spatial IOR and the Simon effect relied on the same spatial representations, i.e., in the "Cued_Congruent" condition. Correspondingly, the sensorimotor system was significantly involved in the "Cued_Congruent" condition to fasten the responses, which indirectly resulted in the enhanced Simon effect at the cued location.

Value associations of emotional faces can modify the anger superiority effect: behavioral and electrophysiological evidence

Although several paradigms have shown that threatening faces are processed preferentially, no study to date has investigated whether this preferential processing can be manipulated by value associations. Using schematic faces, this study was divided into three phases in order to investigate the effects of associating high values with happy faces and low values with angry faces. The baseline phase, in which elicited a shorter RT and a larger N2pc for angry faces than for happy faces, demonstrated that the preferential processing of angry faces could be obtained in the discrimination task. After the training phase, which established associations between different face targets and their respective values, the anger superiority effect remained absent in a subsequent test phase despite the fact that participants clearly understood that no reward (gain) or punishment (loss) would be provided. Our investigation shows that the 'anger superiority effect' can be modified by value associations and that the value effect, rather than the impact of endogenous attention, played a more crucial role in manipulating the preferential processing of angry faces.

Interhemispheric transfer of spatial and semantic information: electrophysiological evidence

The goal of this study was to cast light on the existence of functional callosal channels for the interhemispheric transfer (IHT) of spatial and semantic information. To do so, we recorded event-related potentials in healthy humans while performing a primed odd-even discrimination task. Targets were visually presented numbers preceded by single-letter primes signaling the probable presentation of an odd or an even number. Primes and targets could appear either in the same or in different visual fields, thus requiring an IHT in the latter case. The P1 and N2 components were influenced by IHT of spatial information only, whereas the later N400 was influenced by IHT of both spatial and semantic information. This was not the case for the P3b, which was modulated by semantic validity only. These results provide novel evidence of the existence of a temporally separated interhemispheric exchange of spatial and semantic information.

N1pc reversal following repeated eccentric visual stimulation

Early event-related potential (ERP) hemispheric asymmetries recorded at occipitoparietal sites are usually observed following the sudden onset of a lateral peripheral stimulus. This is usually reflected in an onset-locked larger N1 over the posterior contralateral hemisphere relative to the ipsilateral hemisphere, an early ERP asymmetry labeled N1pc. When the peripheral sudden onset is followed by a central stimulus, or by a bilaterally balanced visual array of stimuli, these events evoke a reversed N1pc, that is, a larger N1 over the hemisphere ipsilateral to the peripheral sudden onset. This N1pc reversal has been taken as evidence for a remapping of the visual space from an absolute, retinally based frame of reference to a relative, attentionally based frame of reference that codes the spatial positions of objects relative to the peripheral sudden onset, rather than relative to the fovea. Here, we pit the reference frame-remapping account against an alternative account based on reduced neural reactivity following the peripheral sudden onset. In three experiments, we varied the spatial location of an object relative to a preceding sudden onset, and tested the opposite predictions generated by the frame-remapping and the reduced neural reactivity accounts. Taken together, the results from the present experiments were consistent with the reduced neural reactivity account and inconsistent with the frame-remapping account.

Emotional and hemispheric asymmetries in shifts of attention: an ERP study

Inhibition of return (IOR) refers to the larger response time to cued targets appearing at long cue-to-target intervals. Given emotion-attention interactions and associated visual field (VF) asymmetries, we examined the effects of emotions and hemispheric processing on object- and location-based IOR. We expected reduced IOR and right hemispheric bias accompanied by differences in event-related potentials (ERPs) including lack of suppression of cued N1 and enhancement of Nd components for sad targets. Reaction times and ERPs were recorded in an exogenous cuing detection task using happy and sad schematic faces. Results revealed reduced IOR for left compared to right VF with sad faces but no such asymmetry for happy faces. Cued N1 amplitudes were suppressed for happy targets but not for sad targets presented to the left VF. Nd amplitudes were enhanced for right-hemispheric sad faces especially with object-based IOR. The results indicate right-hemispheric advantage in the capture of attention by negative emotion especially with object-based selection.

The face is more than its parts--brain dynamics of enhanced spatial attention to schematic threat

A rapid response to environmental threat is crucial for survival and requires an appropriate attention allocation toward its location. Visual search paradigms have provided evidence for the enhanced capture of attention by threatening faces. In two EEG experiments, we sought to determine whether the detection of threat requires complete faces or salient features underlying the facial expression. Measuring the N2pc component as an electrophysiological indicator of attentional selection we investigated participants searching for either a complete discrepant schematic threatening or friendly face within an array of neutral faces, or single features (eyebrows and eyes vs. eyebrows) of threatening and friendly faces. Threatening faces were detected faster compared to friendly faces. In accordance, threatening angry targets showed a more pronounced occipital N2pc between 200 and 300 ms than friendly facial targets. Moreover, threatening configurations, were detected more rapidly than friendly-related features when the facial configuration contained eyebrows and eyes. No differences were observed when only a single feature (eyebrows) had to be detected. Threatening-related and friendly-related features did not show any differences in the N2pc across all configuration conditions. Taken together, the findings provide direct electrophysiological support for rapid prioritized attention to facial threat, an advantage that seems not to be driven by low level visual features.

N2ac: an ERP component associated with the focusing of attention within an auditory scene

Humans must often focus attention onto relevant sensory signals in the presence of simultaneous irrelevant signals. This type of attention has been explored in vision with the N2pc component, and the present study sought to find an analogous auditory effect. In Experiment 1, two 750-ms sounds were presented simultaneously, one from each of two lateral speakers. On each trial, participants indicated whether one of the two sounds was a pre-defined target. We found that targets elicited an N2ac component: a negativity in the N2 latency range at anterior contralateral electrodes. We also observed a later and more posterior contralateral positivity. Experiment 2 replicated these effects and demonstrated that they arose from competition between attended and unattended tones rather than reflecting lateralized effects of attention for individual tones. The N2ac component may provide a useful tool for studying selective attention within auditory scenes.

Mental rotation requires visual short-term memory: evidence from human electric cortical activity

The purpose of the present study was to seek evidence that mental rotation is accomplished by transforming a representation held in visual short-term memory (VSTM). In order to accomplish this goal, we utilized the sustained posterior contralateral negativity (SPCN), an electrophysiological index of the maintenance of information in VSTM. We hypothesized that if mental rotation is accomplished by transforming a representation held in VSTM, then the duration that this representation is maintained in VSTM should be related to the degree to which the representation must be rotated to reach the desired orientation. Therefore, the SPCN should offset at progressively longer latencies as the degree of rotation required increases. We tested this prediction in two experiments utilizing rotated alphanumeric characters. Experiment 1 utilized a normal versus mirror discrimination task that is known to require mental rotation. Experiment 2 utilized a letter versus digit discrimination, a task that does not require mental rotation. In Experiment 1, the offset latency of the SPCN wave increased with increases in the angle of rotation of the target. This effect indicates that targets were maintained in VSTM for longer durations as the angle of rotation increased. Experiment 2 revealed that target orientation did not affect SPCN offset latency when subjects did not adopt a mental rotation strategy, confirming that the effects on the SPCN latency effects observed in Experiment 1 were not due to the mere presentation of rotated patterns. Thus, these two experiments provide clear evidence that mental rotation involves representations maintained in VSTM.

Reorienting of spatial attention in gaze cuing is reflected in N2pc

Research has shown that gaze cuing of attention is reflected in the modulation of P1 and N1 components of ERPs time-locked to target onset. Studies focusing on cue-locked analyses have produced mixed results. The present study examined ERP reflections of gaze cuing in further detail by recording electric brain activity from the scalp of participants engaged in a spatial cuing paradigm with noninformative gaze cues embedded in fearful, disgusted, or neutral faces. Unlike previous work, we focused on N2pc, a recent ERP index of attention shifting over space. Behavioral data showed that gaze-driven orienting was not influenced by facial expression. Importantly, electrophysiological data showed a significant amplitude modulation of the N2pc time-locked to target onset as a function of cue--target spatial congruence. This pattern, however, was independent of facial expression. The results are interpreted as evidence that N2pc can be used as a marker of reorienting of attention in spatially incongruent trials due to gaze cuing. The overall findings support the idea that the effects of facial expression on gaze cuing are weak and likely context-dependent.

Object-substitution masking modulates spatial attention deployment and the encoding of information in visual short-term memory: insights from occipito-parietal ERP components

If object-substitution masking (OSM) arises from mask representations replacing target representations, OSM should impede the formation of representations in visual short-term memory (VSTM). We utilized event-related potentials to examine the effect of OSM on target processing. An N2pc was observed on trials with delayed-offset masks, indicating that focused attention was directed to the target. The sustained posterior contralateral negativity (SPCN), an index of VSTM storage, was observed in delayed-offset trials only on trials with correct responses. This supports the hypothesis that inaccurate performance on delayed-offset trials arises from a failure to encode the target in VSTM. On co-termination trials, accuracy was high and neither the N2pc nor SPCN was observed. This indicates that, in the absence of masking, the task was accomplished by maintaining a diffuse attentional state that enabled the joint encoding of the potential target items.