Biasing the organism for novelty: A pervasive property of the attention system

Non-spatial inhibition of return attenuates audiovisual integration owing to modality disparities

Although previous studies have investigated the relationship between inhibition of return (IOR) and multisensory integration, the influence of non-spatial has not been explored. The present study aimed to investigate the influence of non-spatial IOR on audiovisual integration by using a "prime-neutral cue-target" paradigm. In Experiment 1, which manipulated prime validity and target modality, the targets were positioned centrally, revealing significant non-spatial IOR effects in the visual, auditory, and audiovisual modalities. Analysis of relative multisensory response enhancement (rMRE) indicated substantial audiovisual integration enhancement in both valid and invalid target conditions. Furthermore, the enhancement was weaker for valid targets than for invalid targets. In Experiment 2, the targets were positioned above and below to rule out repetition blindness (RB); this experiment successfully replicated the results observed in Experiment 1. Notably, Experiments 1 and 2 consistently found that the correlation between modality differences and rMRE for valid targets indicated that differences in signal strength between visual and auditory modalities contributed to a reduction in audiovisual integration. However, the absence of correlation with the invalid target suggests that attention, as a key factor, may play a significant role in this process. The present study highlights how non-spatial IOR reduces audiovisual integration and sheds light on the complex interaction between attention and multisensory integration.

Does the construction retrieval account apply to cross‐modal inhibition of return in semantic context?

The traditional attentional reorienting hypothesis is insufficient to explain spatial and nonspatial inhibition of return (IOR). Therefore, a construction retrieval account that includes the influence of top-down attentional sets has been proposed and can explain both spatial and nonspatial IOR. However, it remains unknown whether the construction retrieval account can be applied to non-surface features of stimuli, as well as whether its construction and retrieval mechanisms are supra-modal. The present study manipulated semantic feature congruency and spatial location congruency between the prime and the target in cross-modal audio-visual and visual-audio experimental conditions, respectively, by orthogonally combining spatial and nonspatial IOR paradigms. Our results showed that there was an interaction between semantic feature congruency and spatial location congruency controlled by the attentional sets, and that this interaction was consistent in cross-modal audio-visual and visual-audio conditions. These results suggest that the construction retrieval account can be applied to abstract semantic features and that its construction and retrieval mechanisms are supra-modal. The present study extends the application scope of the construction retrieval account and promotes the interpretation of IOR under a unified theoretical framework.

Levels of neuroticism can predict attentional performance during cross-modal nonspatial repetition inhibition

Inhibition of return (IOR) refers to the slower response to targets presented at previously attended locations, and such repetition-induced inhibition has been found to be differentially associated with personality traits. Although it has been well documented how personality traits affect spatial IOR, a mechanism associated with the attentional orienting network, there is not yet a consensus as to the relationship between personality traits and nonspatial repetition inhibition, a mechanism associated with the attentional executive network. The present study herein examined how the Big Five personality traits relate to cross-modal nonspatial repetition inhibition. Participants completed the NEO-PI-R and performed a cross-modal nonspatial repetition inhibition task built on the prime-neutral cue-target paradigm, in which the relationships of the identities and modalities between the prime and the target were manipulated. The results showed a significant nonspatial inhibitory effect and the effect was larger under the visual-auditory condition than under the auditory-visual condition. More importantly, neuroticism was associated with decreased cross-modal nonspatial inhibitory effect, presumably due to impaired attentional control. However, such a result was only found in the visual-auditory condition. We propose that retrieving previous prime representations under the visual-auditory condition requires a large consumption of cognitive resources, making inhibitory control more difficult for individuals with high neuroticism. These findings provide new insight into the influence of personality traits on attentional performance requiring nonspatial inhibitory control and enrich the relationship between neuroticism and repetition-induced inhibition.

Reward makes the rhythmic sampling of spatial attention emerge earlier

A growing body of evidence demonstrates a rhythmic characteristic of spatial attention, with the corresponding behavioral performance fluctuating periodically. Here, we investigate whether and how the rhythmic characteristic of spatial attention is affected by reward-an important factor in attentional selection. We adopted the classic spatial cueing paradigm with a time-resolved stimulus-onset-asynchrony (SOA) between the spatial cue and the target such that responses to the target in different phases could be examined. The color of the spatial cue was associated with either a high or low level of reward. Results showed that in the low-frequency band (<2 Hz) where classic exogenous spatial attention effects (i.e., facilitation and inhibition of return; IOR) appeared, reward enhanced the late IOR effect through facilitating behavioral responses to the target at the uncued location. Recurring lower alpha power (alpha inhibition) which fluctuated in a low-theta frequency (2-3 Hz) was observed at the cued location relative to the uncued location, irrespective of the reward level of the cue. Importantly, the recurring alpha inhibition emerged earlier (~120 ms) in the high-reward condition relative to the low-reward condition. We propose that the recurring alpha inhibition at the cued location implies a recurring attention sampling at the cued location and the expectation of a high reward makes the periodic attention sampling emerge earlier.

The role of chronotype in the interaction between the alerting and the executive control networks

Chronotype refers to the time of day preferred by individuals to perform daily activities according to their circadian rhythm. We asked whether synchrony effects, that is, the difference in performance between the optimal and non-optimal time of day as a function of chronotype, are observed in two tasks that differently involve the endogenous component of the alerting network, the psychomotor visual task (PVT) and the flanker task. From an initial sample of 132 students that filled in the Morningness-Eveningness Questionnaire (MEQ), 18 were classified as Morning-types and 16 as Evening-types. Evening-types showed synchrony effects in both tasks, whereas Morning-types failed to show synchrony effects in the flanker task and when the PVT was first performed at the non-optimal time of day. Thus, Morning-types might have seen increased their vigilant attention at their non-optimal time of day due to the cognitive demands of the flanker task and to the novelty with the PVT. Phasic alerting generated by alerting tones increased conflict score in the flanker task, but time of day did not modulate the congruence effect. Chronotype determines vigilant attention more decisively in Evening-types than in Morning-types individuals. Also, exogenous but not endogenous alerting exerts a deleterious effect on conflict resolution.

Neurophysiological Activations of Predictive and Non-predictive Exogenous Cues: A Cue-Elicited EEG Study on the Generation of Inhibition of Return

In cueing tasks, predictive and non-predictive exogenous spatial cues produce distinct patterns of behavioral effects. Although both cues initially attract attention, only non-predictive cues lead to inhibitory effects (worse performance at the cued location as compared to the uncued location) if the time elapsed between the cue and the target is long enough. However, the process/processes leading to the later inhibitory effect, named inhibition of return (IOR), are still under debate. In the present study, we used cue-elicited EEG activations from predictive and non-predictive exogenous spatial cues to further investigate the neural processes involved in IOR. Unlike previous similar studies, we intermixed both types of cues in a block of trials, in an attempt to identify the unique neurophysiological activations associated with the generation of IOR. We found that predictive and non-predictive cues significantly differed in activation just at 400-470 ms post-cue window. Activation was greater for non-predictive cues in the intraparietal sulcus (IPS), and this activation correlated significantly with IOR effects. These findings support the hypothesis that the posterior parietal cortex plays a crucial role in the generation of IOR.

Bimodal-divided attention attenuates visually induced inhibition of return with audiovisual targets

Inhibition of return (IOR) refers to the slower response to a target appearing at a previously attended location in a cue-target paradigm. It has been greatly explored in the visual or auditory modality. This study investigates differences between the IOR of audiovisual targets and the IOR of visual targets under conditions of modality-specific selective attention (Experiment 1) and divided-modalities attention (Experiment 2). We employed an exogenous spatial cueing paradigm and manipulated the modalities of targets, including visual, auditory, or audiovisual modalities. The participants were asked to detect targets in visual modality or both visual and auditory modalities, which were presented on the same (cued) or opposite (uncued) side as the preceding visual peripheral cues. In Experiment 1, we found the comparable IOR with visual and audiovisual targets when participants were asked to selectively focus on visual modality. In Experiment 2, however, there was a smaller magnitude of IOR with audiovisual targets as compared with visual targets when paying attention to both visual and auditory modalities. We also observed a reduced multisensory response enhancement effect and race model inequality violation at cued locations relative to uncued locations. These results provide the first evidence of the IOR with audiovisual targets. Furthermore, IOR with audiovisual targets decreases when paying attention to both modalities. The interaction between exogenous spatial attention and audiovisual integration is discussed.

Dissociable identity- and modality-specific neural representations as revealed by cross-modal nonspatial inhibition of return

There are ongoing debates on whether object concepts are coded as supramodal identity-based or modality-specific representations in the human brain. In this fMRI study, we adopted a cross-modal "prime-neutral cue-target" semantic priming paradigm, in which the prime-target relationship was manipulated along both the identity and the modality dimensions. The prime and the target could refer to either the same or different semantic identities, and could be delivered via either the same or different sensory modalities. By calculating the main effects and interactions of this 2 (identity cue validity: "Identity_Cued" vs. "Identity_Uncued") × 2 (modality cue validity: "Modality_Cued" vs. "Modality_Uncued") factorial design, we aimed at dissociating three neural networks involved in creating novel identity-specific representations independent of sensory modality, in creating modality-specific representations independent of semantic identity, and in evaluating changes of an object along both the identity and the modality dimensions, respectively. Our results suggested that bilateral lateral occipital cortex was involved in creating a new supramodal semantic representation irrespective of the input modality, left dorsal premotor cortex, and left intraparietal sulcus were involved in creating a new modality-specific representation irrespective of its semantic identity, and bilateral superior temporal sulcus was involved in creating a representation when the identity and modality properties were both cued or both uncued. In addition, right inferior frontal gyrus showed enhanced neural activity only when both the identity and the modality of the target were new, indicating its functional role in novelty detection.

Behavioral and neural interaction between spatial inhibition of return and the Simon effect

It has been well documented that the anatomically independent attention networks in the human brain interact functionally to achieve goal-directed behaviors. By combining spatial inhibition of return (IOR) which implicates the orienting network with some executive function tasks (e.g., the Stroop and the flanker tasks) which implicate the executive network, researchers consistently found that the interference effects are significantly reduced at cued compared to uncued locations, indicating the functional interaction between the two attention networks. However, a unique, but consistent effect is observed when spatial IOR is combined with the Simon effect: the Simon effect is significantly larger at the cued than uncued locations. To investigate the neural substrates underlying this phenomenon, we orthogonally combined the spatial IOR with the Simon effect in the present event-related fMRI study. Our behavioral data replicated previous results by showing larger Simon effect at the cued location. At the neural level, we found shared spatial representation system between spatial IOR and the Simon effect in bilateral posterior parietal cortex (PPC); spatial IOR specifically activated bilateral superior parietal cortex while the Simon effect specifically activated bilateral middle frontal cortex. Moreover, left precentral gyrus was involved in the neural interaction between spatial IOR and the Simon effect by showing significantly higher neural activity in the "Cued_Congruent" condition. Taken together, our results suggest that due to the shared spatial representation system in the PPC, responses were significantly facilitated when spatial IOR and the Simon effect relied on the same spatial representations, i.e., in the "Cued_Congruent" condition. Correspondingly, the sensorimotor system was significantly involved in the "Cued_Congruent" condition to fasten the responses, which indirectly resulted in the enhanced Simon effect at the cued location.