Supporting the attentional momentum view of IOR: Is attention biased to go right?

Invariant representations in abstract concept grounding - the physical world in grounded cognition

Grounded cognition states that mental representations of concepts consist of experiential aspects. For example, the concept "cup" consists of the sensorimotor experiences from interactions with cups. Typical modalities in which concepts are grounded are: The sensorimotor system (including interoception), emotion, action, language, and social aspects. Here, we argue that this list should be expanded to include physical invariants (unchanging features of physical motion; e.g., gravity, momentum, friction). Research on physical reasoning consistently demonstrates that physical invariants are represented as fundamentally as other grounding substrates, and therefore should qualify. We assess several theories of concept representation (simulation, conceptual metaphor, conceptual spaces, predictive processing) and their positions on physical invariants. We find that the classic grounded cognition theories, simulation and conceptual metaphor theory, have not considered physical invariants, while conceptual spaces and predictive processing have. We conclude that physical invariants should be included into grounded cognition theories, and that the core mechanisms of simulation and conceptual metaphor theory are well suited to do this. Furthermore, conceptual spaces and predictive processing are very promising and should also be integrated with grounded cognition in the future.

Same, but different: Binding effects in auditory, but not visual detection performance

Responding to a stimulus leads to the integration of response and stimulus' features into an event file. Upon repetition of any of its features, the previous event file is retrieved, thereby affecting ongoing performance. Such integration-retrieval explanations exist for a number of sequential tasks (that measure these processes as 'binding effects') and are thought to underlie all actions. However, based on attentional orienting literature, Schöpper, Hilchey, et al. (2020) could show that binding effects are absent when participants detect visual targets in a sequence: In visual detection performance, there is simply a benefit for target location changes (inhibition of return). In contrast, Mondor and Leboe (2008) had participants detect auditory targets in a sequence, and found a benefit for frequency repetition - presumably reflecting a binding effect in auditory detection performance. In the current study, we conducted two experiments, that only differed in the modality of the target: Participants signaled the detection of a sound (N = 40) or of a visual target (N = 40). Whereas visual detection performance showed a pattern incongruent with binding assumptions, auditory detection performance revealed a non-spatial feature repetition benefit, suggesting that frequency was bound to the response. Cumulative reaction time distributions indicated that the absence of a binding effect in visual detection performance was not caused by overall faster responding. The current results show a clear limitation to binding accounts in action control: Binding effects are not only limited by task demands, but can entirely depend on target modality.

Two Cultural Processing Asymmetries Drive Spatial Attention

Cultural routines, such as reading and writing direction (script direction), channel attention orientation. Depending on one's native language habit, attention is biased from left-to-right (LR) or from right-to-left (RL). Here, we further document this bias, as it interacts with the spatial directionality that grounds time concepts. We used a spatial cueing task to test whether script direction and the grounding of time in Portuguese (LR, Exp. 1) and Arabic (RL, Exp. 2) shape visuomotor performance in target discrimination. Temporal words (e.g., tomorrow, yesterday) were presented as cues in two modalities: visual (Exp. 1-2) and auditory (Exp. 1). Gaze movement (Exp. 1) and speed of discrimination decisions (Exp. 1-2) of targets presented to the left or right sides of the screen were assessed. As predicted, the interaction between target location and time concepts was significant across both modalities and linguistic communities. Additionally, LR participants detected the target on the right side of the screen faster after a future word than the target on the left side of the screen after a past word cue. In contrast, RL participants detected the target on the left side of the screen faster when the cue word was a future word than the target on the right side of the screen cued by a past word. In both modalities, the initial eye-gaze movement (Exp. 1) was responsive to the cue's time referent, further confirming that time orients attention. An additional bias was observed for the first fixation onset, which landed earlier on the target set that matched habitualized spatial routines. We conclude that scanning regularities are shaped by writing habits and bodily grounded categorical features.

Pre-saccadic attention spreads to stimuli forming a perceptual group with the saccade target

The pre-saccadic attention shift-a rapid increase in visual sensitivity at the target-is an inevitable precursor of saccadic eye movements. Saccade targets are often parts of the objects that are of interest to the active observer. Although the link between saccades and covert attention shifts is well established, it remains unclear if pre-saccadic attention selects the location of the eye movement target or rather the entire object that occupies this location. Indeed, several neurophysiological studies suggest that attentional modulations of neural activity in visual cortex spreads across parts of objects (e.g., elements grouped by Gestalt principles) that contain the target location of a saccade. To understand the nature of pre-saccadic attentional selection, we examined how visual sensitivity, measured in a challenging orientation discrimination task, changes during saccade preparation at locations that are perceptually grouped with the saccade target. In Experiment 1, using grouping by color in a delayed-saccade task, we found no consistent spread of attention to locations that formed a perceptual group with the saccade target. However, performance depended on the side of the stimulus arrangement relative to the saccade target location, an effect we discuss with respect to attentional momentum. In Experiment 2, employing stronger perceptual grouping cues (color and motion) and an immediate-saccade task, we obtained a reliable grouping effect: Attention spread to locations that were perceptually grouped with the saccade target while saccade preparation was underway. We also replicated the side effect observed in Experiment 1. These results provide evidence that the pre-saccadic attention spreads beyond the target location along the saccade direction, and selects scene elements that-based on Gestalt criteria-are likely to belong to the same object as the saccade target.

Asymmetric practices of reading and writing shape visuospatial attention and discrimination

Movement is generally conceived of as unfolding laterally in the writing direction that one is socialized into. In ‘Western’ languages, this is a left-to-right bias contributing to an imbalance in how attention is distributed across space. We propose that the rightward attentional bias exercises an additional unidirectional influence on discrimination performance thus shaping the congruency effect typically observed in Posner-inspired cueing tasks. In two studies, we test whether faces averted laterally serve as attention orienting cues and generate differences in both target discrimination latencies and gaze movements across left and right hemifields. Results systematically show that right-facing faces (i.e. aligned with the script direction) give rise to an advantage for cue-target pairs pertaining to the right (versus left) side of space. We report an asymmetry between congruent conditions in the form of right-sided facilitation for: (a) response time in discrimination decisions (experiment 1–2) and (b) eye-gaze movements, namely earlier onset to first fixation in the respective region of interest (experiment 2). Left and front facing cues generated virtually equal exploration patterns, confirming that the latter did not prime any directionality. These findings demonstrate that visuospatial attention and consequent discrimination are highly dependent on the asymmetric practices of reading and writing.

Predictions from masked motion with and without obstacles

Predicting the future is essential for organisms like Homo sapiens, who live in a dynamic and ever-changing world. Previous research has established that conscious stimuli can lead to non-conscious predictions. Here we examine whether masked stimuli can also induce such predictions. We use masked movement-with and without obstacles-to examine predictions from masked stimuli. In six experiments a moving object was masked using continuous flash suppression (CFS). A few hundred milliseconds after the object had disappeared, a conscious probe appeared in a location that was either consistent with the masked stimulus or not. In Experiments 1-3 the movement was linear, and reaction times (RTs) indicated predictions that were based on direction and speed of movement. In Experiment 4, the masked moving object collided with an obstacle and then disappeared. Predictions in this case should reflect deflection, and indeed reaction times revealed predictions on the deflection route. In Experiments 5 and 6 we introduce an innovative way of using eye-tracking during continuous flash suppression (CFS) and report physiological evidence-in the forms of eye-movements-for masked stimuli induced predictions. We thus conclude that humans can use dynamic masked stimuli to generate active predictions about the future, and use these predictions to guide behavior. We also discuss the possible interpretations of these findings in light of the current scientific discussion regarding the relation between masked presentation, subliminal perception and awareness measurement methods.

From alternation to repetition: Spatial attention biases contribute to sequential effects in a choice reaction-time task

Observers often take longer to respond to a visual target when it appears at a recently stimulated location than when it appears at a new location in the visual field. This behavioral impairment - known as inhibition of return (IOR) - is mirrored by a reduction of an event-related potential (ERP) component called the N2pc that has been associated with attentional selection. Together, these findings indicate that the mechanism underlying IOR operates to bias covert attention against re-visiting the most recently attended location. The goal of the present study was to determine how this inhibitory attention bias evolves across successive trials of a two-item search task. Initially, targets appearing at previously attended locations were associated with behavioral IOR and a concomitant reduction of the N2pc. After several successive trials, this initial inhibitory bias was superseded by expectancy-based biases associated with "predictable" inter-trial patterns of location repeats or location changes, in some cases leading to faster responses and a larger N2pc when the target location repeated (facilitation of return).  These results provide evidence that biases in the covert deployment of attention are updated dynamically according to the recent selection history and contribute to well-known sequential effects in serial choice reaction-time tasks.

RT Slowing to Valid Cues on a Reflexive Attention Task in Children and Young Adults

Peripheral cueing tasks can be used to measure reflexive (automatic) attention. In these tasks, increases in response time or RT (costs) typically follow contralateral (invalid) cues as attention must move from the location of the cue to the target. Reductions in RT (benefits) to a target typically follow ipsilateral (valid) cues because the cue draws attention to where the target will appear. Two exceptions to RT benefits are inhibition of return (IOR) and masking. IOR is the tendency to respond slower to targets that appear in locations attended within the last 200–2000 ms. Masking occurs when the visibility of a target is blocked by another stimulus (e.g., the cue). Herein, we describe two experiments, both using a modified Posner task with “earth rockets” as cues and “alien spaceships” as targets. Cues were equally likely to appear on the left or right side of a display following targets. Participants were instructed to press a left or right key corresponding to a left or right target. In Experiment 1, we obtained data from 203 children (10.58–16.55 years old). We discovered unexpected costs following cues that typically provide RT benefits. In Experiment 2, we explored IOR, masking, and age differences in the occurrence of these costs. We manipulated the cue-target temporal distance (“stimulus onset asynchrony” or SOA) to explore IOR and the cue-target spatial distance to explore masking. We also considered a wider age range. Sixty-three children and 41 young adults participated. Experiment 2 revealed a three-way interaction between SOA, spatial distance, and age. At the shorter SOA (100 ms) and moderate spatial distance, unexpected costs followed valid cues for younger children (7.07–10.15 years old). These costs also occurred in young adults (18.00–23.02 years old) following far distance cues at this SOA. At the longer SOA (200 ms), these costs followed moderate and far cues for younger children and near cues for young adults. Older children (10.31–14.92 years) did not have unexpected costs. We explain the findings in terms of masking, IOR, and possible developmental mechanisms.

Long-Term Inhibition of Return for Spatial Locations: Evidence for a Memory Retrieval Account

It has generally been accepted that attention is inhibited from returning to previously attended locations, and that this inhibition of return (IOR) lasts just two or three seconds. Recently, Tipper, Grison, and Kessler (2003) showed that IOR can occur over much longer periods of time provided the inhibition is encoded with a context-rich event. Here we examine standard (i.e., typical time range) and long-term IOR within the same experimental paradigm as a means to compare their properties. Experiment 1 used the simple displays typical of cueing paradigms and revealed that both standard and long-term IOR can be obtained under such conditions. Experiment 2 showed that both standard and long-term IOR occurred when there was incongruence between the required response on the current trial and that stored in memory. Furthermore, IOR was not produced when there was incongruence between a target feature (colour) of the current trial and that stored in memory. These results are consistent with a memory retrieval account of IOR and suggest that the same inhibitory mechanism may underlie both standard and long-term IOR.

Saccade latency indexes exogenous and endogenous object-based attention

Classic studies of object-based attention have utilized keypress responses as the main dependent measure. However, people typically make saccades to fixate important objects. Recent work has shown that attention may act differently when it is deployed covertly versus in advance of a saccade. We further investigated the link between saccades and attention by examining whether object-based effects can be observed for saccades. We adapted the classical double-rectangle cueing paradigm of Egly, Driver, and Rafal (1994), and measured both the first saccade latency and the keypress reaction time (RT) to a target that appeared at the end of one of the two rectangles. Our results showed that saccade latencies exhibited higher sensitivity than did RTs for detecting effects of attention. We also assessed the generality of the attention effects by testing three types of cues: hybrid (predictive and peripheral), exogenous (nonpredictive and peripheral), and endogenous (predictive and central). We found that both RTs and saccade latencies exhibited effects of both space-based and object-based attentional selection. However, saccade latencies showed a more robust attentional modulation than RTs. For the exogenous cues, we observed a spatial inhibition of return along with an object-based effect, implying that object-based attention is independent of space-based attention. Overall, our results revealed an oculomotor correlate of object-based attention, suggesting that, in addition to spatial priority, object-level priority also affects saccade planning.

Toward a general theory of momentum-like effects

The future actions, behaviors, and outcomes of objects, individuals, and processes can often be anticipated, and some of these anticipations have been hypothesized to result from momentum-like effects. Five types of momentum-like effects (representational momentum, operational momentum, attentional momentum, behavioral momentum, psychological momentum) are briefly described. Potential similarities involving properties of momentum-like effects (continuation, coherence, role of chance or guessing, role of sensory processing, imperviousness to practice or error feedback, shifts in memory for position, effects of changes in velocity, rapid occurrence, effects of retention interval, attachment to an object rather than an abstract frame of reference, nonrigid transformation) are described, and potential constraints on a future theory of momentum-like effects (dynamic representation, nature of extrapolation, sensitivity to environmental contingencies, bridging gaps between stimulus and response, increasing adaptiveness to the environment, serving as a heuristic for perception and action, insensitivity to stimulus format, importance of subjective consequences, role of knowledge and belief, automaticity of occurrence, properties of functional architecture) are discussed. The similarity and ubiquity of momentum-like effects suggests such effects might result from a single or small number of mechanisms that operate over different dimensions, modalities, and time-scales and provide a fundamental adaptation for perception and action.

The Left-to-Right Bias in Inhibition of Return Is Due to the Direction of Reading

Previous research has shown a left-to-right bias in the inhibition-of-return effect. This bias was found in a sample of English-speaking participants who read in a predominantly left-to-right manner. The goal of the current study was to examine the role that the direction of text reading plays in this bias. The findings replicated the left-to-right bias with an English sample, but showed the opposite bias in an Arabic sample, who read text from right to left. Thus, the regularity of shifting attention in a particular way during text reading seems to be the cause of the bias observed.

A Direct Assessment of the Role of Expectation in Inhibition of Return

An object hidden among distractors can be found more efficiently if previously searched locations are not reinspected. The inhibition-of-return (IOR) phenomenon indexes the tendency to avoid reinspections. Two accounts of IOR, that it is due to inhibition and that it is due to expectation, are generally regarded as incompatible. The relevant evidence to date, however, has been indirect: Inhibition or expectation has been inferred from response times or similar indirect measures. This article reports the first direct measure of IOR, obtained by asking observers to predict the location of the next target in a display containing eight possible locations on an imaginary circle. On any given trial, the previously cued location was chosen less frequently (impairment)—and the opposite location was chosen more frequently (facilitation)—than chance (choice of all other locations was at chance). The impairment is consistent with both inhibition and expectation accounts; the facilitation is consistent only with expectation accounts. This work also shows that inhibition and expectation are not necessarily incompatible: Implementing expectations may entail inhibiting previously cued locations.

Further evidence against a momentum explanation for IOR

Reaction times to targets presented in the same location as a preceding cue are greater than those to targets presented opposite the cued location. This observation can be explained as a result of inhibition at the attended location (IOR), or as facilitation at the location opposite the cue (opposite facilitation effect or OFE). Past research has demonstrated that IOR is observed reliably, whereas OFE is observed only occasionally. The present series of four experiments allows us to determine whether or not OFE can be explained by eye movements as suggested by previous authors. Participants' eye movements were monitored as they were presented with an array of four placeholders aligned with the four cardinal axes. Exogenous cues and targets were presented successively. Participants (N=37) completed either: i.) cue-manual and cue-saccade experiments, ignoring the cue and then responding with a keypress or saccade, respectively, or ii.) manual-manual and saccade-saccade experiments, responding to both the cue and the target with a keypress or saccade respectively. Results demonstrated a reliable IOR effect in each of the four experiments (reaction time greater for same versus adjacent and opposite cue-target trials). None of the four experiments demonstrated evidence of an OFE (reaction times were not significantly lower for opposite versus adjacent cue-target trials). These results are inconsistent with a momentum-based account of cue-target task performance, and furthermore suggest that the OFE cannot be attributed to occasional eye movements to the cue and/or target in previous studies.

Stepping into a map: initial heading direction influences spatial memory flexibility

Learning a novel environment involves integrating first-person perceptual and motoric experiences with developing knowledge about the overall structure of the surroundings. The present experiments provide insights into the parallel development of these egocentric and allocentric memories by intentionally conflicting body- and world-centered frames of reference during learning, and measuring outcomes via online and offline measures. Results of two experiments demonstrate faster learning and increased memory flexibility following route perspective reading (Experiment 1) and virtual navigation (Experiment 2) when participants begin exploring the environment on a northward (vs. any other direction) allocentric heading. We suggest that learning advantages due to aligning body-centered (left/right/forward/back) with world-centered (NSEW) reference frames are indicative of three features of spatial memory development and representation. First, memories for egocentric and allocentric information develop in parallel during novel environment learning. Second, cognitive maps have a preferred orientation relative to world-centered coordinates. Finally, this preferred orientation corresponds to traditional orientation of physical maps (i.e., north is upward), suggesting strong associations between daily perceptual and motor experiences and the manner in which we preferentially represent spatial knowledge.

Evidence for an attentional component in saccadic inhibition of return

After presentation of a peripheral cue, facilitation at the cued location is followed by inhibition of return (IOR). It has been recently proposed that IOR may originate at different processing stages for manual and ocular responses, with manual IOR resulting from inhibited attentional orienting, and ocular IOR resulting form inhibited motor preparation. Contrary to this interpretation, we found an effect of target contrast on saccadic IOR. The effect of contrast decreased with increasing reaction times (RTs) for saccades, but not for manual key-press responses. This may have masked the effect of contrast on IOR with saccades in previous studies (Hunt and Kingstone in J Exp Psychol Hum Percept Perform 29:1068-1074, 2003) because only mean RTs were considered. We also found that background luminance strongly influenced the effects of gap and target contrast on IOR.

Inhibition of return in subliminal letter priming

The present study combined exogenous spatial cueing with masked repetition priming to study attentional influences on the processing of subliminal stimuli. Participants performed an alphabetic decision task (letter versus pseudo-letter classification) with central targets and briefly presented peripherally located primes that were either cued or not cued by an abrupt onset. A relatively long delay between cue and prime was used to investigate the effect of inhibition of return (IOR) on the processing of subliminal masked primes. Primes presented to the left visual field showed standard effects of Cue Validity and no IOR (significant priming with valid cues only). Primes presented to the right visual field showed no priming from valid cues (an IOR effect), and priming with invalid cues that depended on hand of response to letter targets (right-hand in Experiment 1, left-hand in Experiment 2). The results are interpreted in terms of a differential speed of engagement and disengagement of attention to the right and left visual fields for alphabetic stimuli, coupled with a complex interaction that arises between Prime Relatedness and response-hand.

Gaze motion clustering in scan-path estimation

Visual attention is considered nowadays a paramount ability both in Cognitive Sciences and in Cognitive Vision to bridge the gap between perception and higher level reasoning functions, such as scene interpretation and decision making. Bottom-up gaze shifting is the main mechanism used by humans when exploring a scene without a specific task. In this paper we investigated which criteria allow for the generation of plausible fixation clusters by analysing experimental data of human subjects. We suggest that fixations should be grouped in cliques whose saliency can be assessed through an innovation factor encompassing bottom-up cues, proximity, direction and memory components.

The time required for perceptual (nonmotoric) processing in IOR

In an inhibition of return (IOR) paradigm, we used a threshold-tracking procedure combined with backward masking to measure the speed of perceptual processing in IOR independent of motoric factors. Instead of the conventional reaction time measure, this procedure yielded the critical exposure duration (DURc) that is required in order for a target to be identified reliably before the onset of a trailing mask. In Experiment 1, the facilitation effects conventionally found at short cue-target onset asynchrony (CTOA) were evidenced by shorter values of DURc at cued relative to uncued locations. Conversely, the retardation effects conventionally found at long CTOA were evidenced by correspondingly longer values of DURc. In Experiment 2, the DURc results strongly suggest that the directional reading bias previously observed in IOR studies is due, at least in part, to perceptual rather than motoric factors.

Nomadic inhibition of attention and motor responses

Klein and MacInnes [Klein, R. M., & MacInnes, W. J. (1999). Inhibition of return is a foraging facilitator in visual search. Psychological Science, 10, 346-352] posited that the function of a phenomenon known as the inhibition of return (IOR) [Posner, M. I., & Cohen, Y. (1984). Components of visual orienting. In H. Bouma, & D. G. Bouwhuis (Eds.), Attention and performance X: Control of language processes (pp. 531-554). Hillsdale, NJ: Erlbaum] is to facilitate the foraging of food and objects in the environment. Once a target object has been identified either the location of that target in space or a movement to that target is inhibited in order to allow the performer to shift his/her attention to something new. Interestingly, in the majority of IOR studies, participants begin their search from a central home position. This research examined IOR in a nomadic target-target paradigm in which the home position randomly appeared at one of three target locations and attentional shifts/movements progressed to other locations. In Experiment 1, participants executed simple manual button presses in response to the sequential presentation of a home position and then two target stimuli. In Experiment 2, participants made manual-aiming movements in response to the same type of presentation. Results obtained from both experiments implicate perceptual-motor mechanisms over and above the inhibition of a specific target location or response. Inhibitory effects appear to be associated with both perceptual and motor processes, and depend not only on the temporal and spatial relations between potential targets, but also on the actions required to detect or engage the targets.

A Clockwork Orange: Compensation opposing momentum in memory for location

Libet, Gleason, Wright, and Pearl's (1983; Libet, 1985) influential work using a clock-watching task suggests that voluntary actions are initiated in motor cortex prior to the point where the participant claims to have initiated that action. Joordens, van Duijn, and Spalek (2002) showed that a bias exists in this task with respect to the participants' reports of initiation times. Joordens et al. assumed that this bias was primarily due to motion cues that are very much like those used to elicit phenomena such as representational momentum. In the present Experiment 1, it is demonstrated that this bias disappears when a mouse-click response is used in place of a temporal-order judgment. This finding, however, is actually more confusing than clarifying given that the procedural parallels with representational momentum are still present and should be supporting a bias. In the three subsequent experiments the view that a bias is indeed present, but that it is opposed by an opposite-acting compensation process, is proposed and tested. Implications for both representational momentum and for the general use of clock-watching tasks (e.g., Libet et al., 1983) are highlighted.