Eliminating inhibition of return by changing salient nonspatial attributes in a complex environment

Responding, fast and slow: Visual detection and localization performance is unaffected by retrieval

According to action control theories, responding to a stimulus leads to the binding of the response and stimulus features into an event file. Repeating any component of the latter retrieves previous information, affecting ongoing performance. Based on years of attentional orienting research, recent boundaries of such binding theories have been proposed as binding effects are fully absent in visual detection (e.g., Schöpper et al., 2020, Attention, Perception, & Psychophysics, 82(4), 2085-2097) and localization (e.g., Schöpper & Frings, 2022; Visual Cognition, 30(10), 641-658) performance. While this can be attributed to specific task demands, the possibility remains that retrieval of previous event files is hampered in such tasks due to overall fast responding. In the current study we instructed participants to signal the detection (Experiment 1) and location (Experiment 2) of dots orthogonally repeating or changing their nonspatial identity and location. Crucially, the dots were either hard or easy to perceive. As expected, making targets hard to perceive drastically slowed down detection and localization response speed. Importantly, binding effects were absent irrespective of perceptibility. In contrast, discriminating the nonspatial identity of targets (Experiment 3) showed strong binding effects. These results highlight the impact of task-dependence for binding approaches in action control.

Bound to a spider without its web: Task-type modulates the retrieval of affective information in subsequent responses

Action control theories assume that upon responding to a stimulus response and stimulus features are integrated into a short episodic memory trace; repeating any component spurs on retrieval, affecting subsequent performance. The resulting so-called "binding effects" are reliably observed in discrimination tasks. In contrast, in localization performance, these effects are absent and only inhibition of return (IOR) emerges - a location change benefit. Affective information has been found to modulate binding effects; yet a modulation of IOR has led to mixed results, with many finding no influence at all. In the current study, participants discriminated letters (Experiment 1) or localized dots (Experiment 2) on a touchpad in prime-probe sequences. During the prime display two images - one with fruits and one with a spider - appeared, one of which spatially congruent with the to-be-touched area. In the discrimination task, previously touching a spider compared to a fruit slowed down response repetitions. In contrast, the localization task only showed IOR. This suggests that task-irrelevant valence is integrated with the response and affects subsequent responses due to retrieval. However, this is not ubiquitous but depends on task type. The results shed further light on the impact of affective information on actions.

Detection cost: A nonnegligible factor contributing to inhibition of return in the discrimination task under the cue-target paradigm

The three-factor model argues that the spatial orienting benefit triggered by the cue, the spatial selection benefit of cue-target matching, and the detection cost of distinguishing the cue from the target contribute to the measured inhibition of return (IOR) effect. According to the three-factor model, the spatial selection benefit dominates the occurrence of the IOR effect in the discrimination task, while the detection cost is negligible. The present study verified the three-factor model in the discrimination task under the cue-target paradigm by manipulating the spatial location and nonspatial feature consistency of the cue and the target as well as the promotion or hindrance of attentional disengagement from the cued location with a central reorienting cue. The results indicated that the three factors of the three-factor model contributed to the measured IOR effect in the discrimination task. Interestingly, the IOR effect was stable when the cue and target were perfectly repeated and attention was maintained at the cued location, implying that detection cost was not a negligible factor. The current study supported the contribution of all three factors in the three-factor model to the measured IOR effect; however, we argue that the role of detection cost in the discrimination task under different paradigms should be further refined.

Same, but different: Binding effects in auditory, but not visual detection performance

Responding to a stimulus leads to the integration of response and stimulus' features into an event file. Upon repetition of any of its features, the previous event file is retrieved, thereby affecting ongoing performance. Such integration-retrieval explanations exist for a number of sequential tasks (that measure these processes as 'binding effects') and are thought to underlie all actions. However, based on attentional orienting literature, Schöpper, Hilchey, et al. (2020) could show that binding effects are absent when participants detect visual targets in a sequence: In visual detection performance, there is simply a benefit for target location changes (inhibition of return). In contrast, Mondor and Leboe (2008) had participants detect auditory targets in a sequence, and found a benefit for frequency repetition - presumably reflecting a binding effect in auditory detection performance. In the current study, we conducted two experiments, that only differed in the modality of the target: Participants signaled the detection of a sound (N = 40) or of a visual target (N = 40). Whereas visual detection performance showed a pattern incongruent with binding assumptions, auditory detection performance revealed a non-spatial feature repetition benefit, suggesting that frequency was bound to the response. Cumulative reaction time distributions indicated that the absence of a binding effect in visual detection performance was not caused by overall faster responding. The current results show a clear limitation to binding accounts in action control: Binding effects are not only limited by task demands, but can entirely depend on target modality.

Does the construction retrieval account apply to cross‐modal inhibition of return in semantic context?

The traditional attentional reorienting hypothesis is insufficient to explain spatial and nonspatial inhibition of return (IOR). Therefore, a construction retrieval account that includes the influence of top-down attentional sets has been proposed and can explain both spatial and nonspatial IOR. However, it remains unknown whether the construction retrieval account can be applied to non-surface features of stimuli, as well as whether its construction and retrieval mechanisms are supra-modal. The present study manipulated semantic feature congruency and spatial location congruency between the prime and the target in cross-modal audio-visual and visual-audio experimental conditions, respectively, by orthogonally combining spatial and nonspatial IOR paradigms. Our results showed that there was an interaction between semantic feature congruency and spatial location congruency controlled by the attentional sets, and that this interaction was consistent in cross-modal audio-visual and visual-audio conditions. These results suggest that the construction retrieval account can be applied to abstract semantic features and that its construction and retrieval mechanisms are supra-modal. The present study extends the application scope of the construction retrieval account and promotes the interpretation of IOR under a unified theoretical framework.

Location-response binding and inhibition of return in a detection task

In the present study, we investigated the binding of location and response in a detection task of the target-target paradigm of inhibition of return (IOR). Results showed a cost of responding to a target at the repeated location (IOR) when the response was not repeated and an effect of facilitation of return (FOR) when the response was repeated. These findings suggest that when responding to a target, its location and the response to it are integrated together. In addition, an analysis of the Vincentized cumulative response time (RT) distribution further showed that memory retrieval of event representations requires time to operate. These findings were discussed according to the theoretical framework of event files.

Contextual Similarity Between Successive Targets Modulates Inhibition of Return in the Target-Target Paradigm

Inhibition of return (IOR) refers to slower responses to a target presented at a previously cued vs. uncued location. The present study investigated the role of memory retrieval in IOR by manipulating the contextual similarity between two successive targets in the target-target IOR paradigm. Successive targets were presented in either the same color (same-context condition) or different colors (different-context condition). Results of two experiments showed that IOR was greater in the same-context than the different-context condition. In addition, Experiment 2 showed that this context effect occurs with long response times (RTs), suggesting that memory retrieval, which requires time to manifest, plays an important role in IOR.

Coordinating the interaction between past and present: Visual working memory for feature bindings overwritten by subsequent action to matching features

The object-file framework forwarded by Kaheman, Treisman, and Gibbs (1992) has been enormously influential in our understanding of how the visual system links together prior visual content with a current input. Although this framework was initially developed to account for the perceptual benefits associated with feature conjunction repetitions, the present series of experiments examines how the core processes of this framework may also help explain behavior in tasks that require explicit remembering of visual information over the short term. Building off our previous work (Fiacconi & Milliken, 2012, 2013), here we introduce a procedure that affords the opportunity to examine the contributions of object-file review processes to both speeded performance and visual short-term memory (VWM) within the same task. Across two experiments we demonstrate a novel coupling between memory accuracy and speeded performance, such that the conditions that promote faster performance also tend to produce better memory, and vice versa. These findings are discussed in relation to the object-file framework and suggest that the object-file review processes known to guide behavior in speeded performance tasks may also have important mnemonic consequences. Together, these findings unite two lines of research to which Anne Treisman made indelible contributions.

On the putative role of intervening events in exogenous attention

In exogenous attention, two main behavioural effects are usually observed across time: facilitation at short cue-target onset asynchronies (CTOAs), and Inhibition of Return (IOR) at longer CTOAs. The presentation of an intervening event (IE)-i.e., a cue presented at fixation between the peripheral cue and target period-favours the appearance of IOR. However, although there is a general consensus on this empirical modulation, there is no agreement about the putative role of IEs and/or the mechanism/s underlying their effect. While some authors consider IEs as a "cue-back", automatically reorienting attention to fixation, thus allowing IOR to occur, others have considered IEs as events modulating cue-target integration processes, consequently affecting exogenous cueing. Even in this later case, it is not clear whether IEs modulate cueing by inducing an attentional set (top-down) modulation or by inducing a trial-by-trial (bottom-up) online modulation. To disentangle this issue, in two experiments, we manipulated the proportion of trials in which the IE was presented, thus being able to measure the effect of the presence/absence and proportion of IEs. We observed a gradual influence of the % of IEs over cueing effects, which becomes less positive or more negative as the % of IEs increases. This pattern of findings fits well with the idea that facilitation and IOR depend on cue-target integration processes, and presents critical implications for the open debate about the mechanism/s underlying exogenous spatial cueing effects.

The causal role of the left parietal lobe in facilitation and inhibition of return

Following non-informative peripheral cues, responses are facilitated at the cued compared to the uncued location at short cue-target intervals. This effect reverses at longer intervals, giving rise to Inhibition of Return (IOR). The integration-segregation hypothesis (Lupiáñez, 2010) suggests that peripheral cues always produce an onset-detection cost regardless the behavioral cueing effect that is measured - either facilitation or IOR. In the present study, we used transcranial magnetic stimulation (TMS) to investigate the causal contribution of this detection cost to performance. We used a cueing paradigm with a target discrimination task that was preceded by a non-informative peripheral cue. The presence-absence of a central intervening event was manipulated. Online TMS to the left superior parietal lobe (compared to an active vertex stimulation) lead to an overall more positive effect (faster responses for cued as compared to uncued trials), by putatively impairing the detection cost contribution to performance. The data revealed a strong association between overall RT and the TMS effect, and also between overall RT and the integrity of the first branch of the left superior longitudinal fascicule. These results have critical implications not only for the open debate about the mechanism/s underlying spatial orienting effects, but also for the growing literature demonstrating that white matter connectivity is crucial for explaining inter-individual behavioral variability.

Yellow is for safety: perceptual and affective perspectives

Is there a link between color and safety? Yellow is often used in safety contexts. Using the Singapore accident record datasets, Ho et al. provided evidence that yellow taxis have fewer accidents than blue taxis (Ho et al. in Proc Natl Acad Sci 114(12):3074-3078, 2017). Does yellow differentially influence attention and action and if so is this related to purely visual or affective factors? Here, we examined the visual priority of yellow relative to luminance matched colors at opposing ends of the wavelength spectrum (i.e., red and blue), using a temporal order judgment task, between color pairs. Despite being matched in arousal, when yellow and blue were pitted against each other, yellow was consistently seen as occurring first, even when objectively appearing second at short stimulus onset asynchronies. Despite being matched in valence, yellow again showed a larger temporal priority when it was pitted against red. Yellow temporal priority bias was modulated by individual differences in regulatory focus, highlighting a potential affective-motivational origin. These results support that yellow is a safety color, having a temporal advantage, and further evidence that colors have special influences on cognition, perception and behavior.

Reward priming eliminates color-driven affect in perception

Brain and behavior evidence suggests that colors have distinct affective properties. Here, we investigated how reward influences color-driven affect in perception. In Experiment 1, we assessed competition between blue and red patches during a temporal-order judgment (TOJ) across a range of stimulus onset asynchronies (SOAs). During the value reinforcement, reward was linked to either blue (version 1) or red (version 2) in the experiment. The same stimuli then served as test ones in the following unrewarded, unspeeded TOJ task. Our analysis showed that blue patches were consistently seen as occurring first, even when objectively appearing 2nd at short SOAs. This accelerated perception of blue over red was disrupted by prior primes related to reward (vs. neutral) but not perceptional (blue vs. red) priming. Experiment 2 replicated the findings of Experiment 1 while uncoupling action and stimulus values. These results are consistent with the blue-approach and red-avoidance motivation hypothesis and highlight an active nature of the association of reward priming and color processing. Together, the present study implies a link between reward and color affect and contributes to the understanding of how reward influences color affect in visual processing.

Cognitive control activity is modulated by the magnitude of interference and pre-activation of monitoring mechanisms

The Simon task is used to study interference from irrelevant spatial information. Interference is manifested by longer reaction times when the required response -based on non-spatial features- is spatially incompatible with stimulus position. Interference is greater when incompatible trials are preceded by compatible trials (compatible-incompatible sequence) than when they are preceded by incompatible trials (incompatible-incompatible sequence). However, the relationships between spatial attention, interference and cognitive control have not been investigated. In the present study, we distinguished three experimental conditions according to sequential effects: same mappings (SM, compatible-compatible/incompatible-incompatible sequences: low interference), opposite mappings (OM, compatible-incompatible/incompatible-compatible sequences: high interference) and unrelated mappings (UM, central-compatible/central-incompatible sequences: intermediate interference). The negativity central contralateral (N2cc, a correlate of prevention of spatial response tendencies) was larger in OM than in SM, indicating greater cognitive control for greater interference. Furthermore, N2cc was larger in UM than in SM/OM, indicating lower neural efficiency for suppressing spatial tendencies of the response after central trials. Attentional processes (negativity posterior contralateral) were also delayed in UM relative to SM/OM, suggesting attentional facilitation by similar sets of attentional shifts in successive trials. Overall, the present findings showed that cognitive control is modulated by the magnitude of interference and pre-activation of monitoring mechanisms.

Detection costs and contingent attentional capture

Peripheral cues reduce reaction times (RTs) to targets at the cued location with short cue-target SOAs (cueing benefits) but increase RTs at long SOAs (cueing costs or inhibition of return). In detection tasks, cueing costs occur at shorter SOAs and are larger compared with identification tasks. To account for effects of task, detection cost theory claims that the integration of cue and target into an object file makes it more difficult to detect the target as a new event, which is the principal task-requirement in detection tasks. The integration of cue and target is expected to increase when cue and target are similar. We provided evidence for detection cost theory in the modified spatial cueing paradigm. Two types of cues (onset, color) were paired with two types of targets (onset, color) in separate blocks of trials. In the identification task, we found cueing benefits with matching (i.e., similar) cue-target pairs (onset-onset, color-color) and no cueing effects with nonmatching cue-target pairs (onset-color, color-onset), which replicates previous work. In the detection task, cueing effects with matching cues were reduced and even turned into cueing costs for onset cues with onset targets, suggesting that cue-target integration made it more difficult to detect targets at the cued location as new events. In contrast, the results for nonmatching cue-target pairs were not affected by task. Furthermore, the pattern of false alarms in the detection task provides a measure of similarity that may explain the size of cueing benefits and costs.

S-ketamine influences strategic allocation of attention but not exogenous capture of attention

We investigated whether s-ketamine differentially affects strategic allocation of attention. In Experiment 1, (1) a less visible cue was weakly masked by the onsets of competing placeholders or (2) a better visible cue was not masked because it was presented in isolation. Both types of cue appeared more often opposite of the target (75%) than at target position (25%). With this setup, we tested for strategic attention shifts to the opposite side of the cues and for exogenous attentional capture toward the cue's side in a short cue-target interval, as well as for (reverse) cueing effects in a long cue-target interval after s-ketamine and after placebo treatment in a double-blind within-participant design. We found reduced strategic attention shifts after cues presented without placeholders for the s-ketamine compared to the placebo treatment in the short interval, indicating an early effect on the strategic allocation of attention. No differences between the two treatments were found for exogenous attentional capture by less visible cues, suggesting that s-ketamine does not affect exogenous attentional capture in the presence of competing distractors. Experiment 2 confirmed that the competing onsets of the placeholders prevented the strategic cueing effect. Taken together, the results indicate that s-ketamine affects strategic attentional capture, but not exogenous attentional capture. The findings point to a more prominent role of s-ketamine during top-down controlled forms of attention that require suppression of automatic capture than during automatic capture itself.

Nonspecific competition underlies transient attention

Cueing a target by abrupt visual stimuli enhances its perception in a rapid but short-lived fashion, an effect known as transient attention. Our recent study showed that when targets are cued at a constant, central location, the emergence of the transient performance pattern was dependent on the presence of competing distractors, whereas targets presented in isolation were enhanced in a sustained manner (Wilschut et al., PLoS ONE, 6:e27661, 2011). The current study examined in more detail whether the transience depends on the specific nature of the competition. We first replicated and extended the competition-dependent transient pattern for peripheral and variable target locations. We then investigated the role of feature similarity, compatibility, and proximity. Both competition by feature similarity and compatibility between the target and distractors were found to impair performance, but effects were additive with the effects of the cueing interval and did not change the transient performance function. Varying the spatial distance between target and distractors yielded mixed evidence, but here too a transient pattern could be observed for targets flanked by both close and far distractors. The results thus show that the presence or absence of competition determines whether attention appears transient or sustained, while the specific nature of the competition (in terms of location or feature) affects selection independent of time.

Multiple cueing dissociates location- and feature-based repetition effects

There is an extensive literature on the phenomenon of inhibition of return (IOR): When attention is drawn to a peripheral location and then removed, response time is delayed if a target appears in the previously inspected location. Recent research suggests that non-spatial attribute repetition (i.e., if a target shares a feature like color with the earlier, cueing, stimulus) can have a similar inhibitory effect, at least when the target appears in the previously cued location. What remains unknown is whether location- and feature-based inhibitory effects can be dissociated. In the present study, we used a multiple cueing approach to investigate the properties of location- and feature-based repetition effects. In two experiments (detection, and discrimination), location-based IOR was absent but feature-based inhibition was consistently observed. Thus, the present results indicate that feature- and location-based inhibitory effects are dissociable. The results also provide support for the view that the attentional consequences of multiple cues reflect the overall center of gravity of the cues. We suggest that the repetition costs associated with feature and location repetition may be best understood as a consequence of the pattern of activation for object files associated with the stimuli present in the displays.

Beyond the inhibition of return of attention: reduced habituation to threatening faces in schizophrenia

Attention deficits are prominent among the core symptoms of schizophrenia. A recent meta-analysis has suggested that patients with schizophrenia have a deficit in endogenous disengagement of attention. In this research, we used a standard spatial cueing paradigm to examine whether the attention deficit of such patients is due to impaired attentional disengagement or defective novelty detection/habituation processes. In a spatial cueing procedure with peripheral non-predictive cues and a detection task, we manipulated the valence of either the cue or the target (i.e., a threatening vs. scrambled face) in two separate experiments. The control group exhibited a smaller inhibition of return (IOR) effect only when the target had an emotional load, not when the cue had an emotional load. In the patient group, a larger emotional effect appeared when the threatening face was the target; by contrast, no effect of valence was observed when the threatening face was the cue: IOR was delayed or completely absent independently of valence. The present findings are in conflict with the hypothesis that IOR is due to the disengagement of attention and the subsequent inhibition to return. Instead, they seem to suggest a cost in detecting new information at a previously cued location. From this perspective, it seems that patients with schizophrenia might have a deficit in detecting new information and considering it as new in the current context.

Effects of display complexity on location and feature inhibition

Inhibition of return refers to the lengthening of reaction times (RTs) to a target when a preceding stimulus has occupied the same location in space. Recently, we observed a robust inhibitory effect for color and shape in moderately complex displays: It is more difficult to detect a target with a particular nonspatial attribute if a stimulus with the same attribute was recently the focus of attention. Such nonspatial inhibitory effects have not generally been found in simpler displays. In the present study, we test how location-based and nonspatial inhibitory effects vary as a function of display complexity (eight, six, four, and two locations). The results demonstrated that (1) location-based inhibition effects were much stronger in more complex displays, whereas the nonspatial inhibition was only slightly stronger in more complex displays; (2) nonspatial inhibitory effects emerged at longer stimulus onset asynchronies than did location-based effects; and (3) nonspatial inhibition appeared only when cues and targets occurred in the same locations, confirming that pure feature repetition does not produce a cost. Taken together, the results are consistent with perceptual processes based on object files that are organized by spatial location. Using somewhat more complex displays than are most commonly employed provides a more sensitive method for observing the role of inhibitory processes in facilitating visual search. In addition, using a relatively wide set of cue-target timing relationships is necessary in order to clearly see how inhibitory effects operate.

Is “Inhibition of Return” due to the inhibition of the return of attention?

Inhibition of Return (IOR) is usually explained in terms of orienting–reorienting of attention, emphasizing an underlying mechanism that inhibits the return of attention to previously selected locations. Recent data challenge this explanation to the extent that the IOR effect is observed at the location where attention is oriented to, where no reorienting of attention is needed. To date, these studies have involved endogenous attentional selection of attention and thus indicate a dissociation between the voluntary attention of spatial attention and the IOR effect. The present work demonstrates a dissociation between the involuntary orienting of spatial attention and the IOR effect. We combined nonpredictive peripheral cues with nonpredictive central orienting cues (either arrows or gaze). The IOR effect was observed to operate independent of involuntary spatial orienting. These data speak against the “ reorienting hypothesis” of IOR. We suggest an alternative explanation whereby the IOR effect reflects a cost in detecting a new event (the target) at the location where another event (a cue) was coded before.

Unconscious Cueing via the Superior Colliculi: Evidence from Searching for Onset and Color Targets

According to the bottom-up theory of attention, unconscious abrupt onsets are highly salient and capture attention via the Superior Colliculi (SC). Crucially, abrupt onsets increase the perceived contrast. In line with the SC hypothesis, unconscious abrupt-onset cues capture attention regardless of the cue color when participants search for abrupt-onset targets (Experiment 1). Also, stronger cueing effects occur for higher than lower contrast cues (Experiment 2) and for temporally, rather than nasally, presented stimuli (Experiment 3). However, in line with the known color-insensitivity of the SC, the SC pathway is shunted and unconscious abrupt-onset cues no longer capture attention when the participants have to search for color-defined targets (Experiment 4) or color-singleton targets (Experiment 5). When using color change cues instead of abrupt-onset cues, the cueing effect also vanishes (Experiment 6). Together the results support the assumption that unconscious cues can capture attention in different ways, depending on the exact task of the participants, but that one way is attentional capture via the SC. The present findings also offer a reconciliation of conflicting results in the domain of unconscious attention.

Facilitation versus inhibition in non-spatial attribute discrimination tasks

Inhibition of Return is a delay in initiating attentional shifts to previously inspected locations. It has been explained as a mechanism to facilitate visual search of a scene by inhibiting the allocation of attention to locations that have already been examined. We (Hu, Samuel, & Chan, Journal of Experimental Psychology: General, 2010) recently demonstrated that similar processing costs can appear when a non-spatial attribute (color or shape) repeats-detection of a target stimulus was slower if the target shared color or shape with a recently presented cue. In the current study, we test whether such inhibitory effects occur for non-spatial attribute repetition when observers must make a discrimination judgment about targets. We found two independent effects: First, there was a standard location-based IOR effect-target discrimination was slower when the target appeared in the same location as a preceding cue. Second, reaction times were faster if the target's color or shape matched the cue's color or shape; this facilitation effect contrasts with both the location-based inhibition that was present in the current experiments, and with the inhibitory effect of feature repetition in our previous detection task study. The data are best accounted for by a three-factor model recently suggested by Lupiáñez (Attention and time, 2010).