When are attention and saccade preparation dissociated?

Fixation offset decreases manual inhibition of return (IOR) in detection and discrimination tasks

Attention can be covertly shifted to peripheral stimuli to improve their processing. However, attention is also then inhibited against returning to the previously attended location; thus, both detection and discrimination of a stimulus presented at that location decrease (the inhibition of return [IOR] effect). The after-effect of the covert orienting hypothesis postulates a close link between attention shifting, IOR, and oculomotor control. The fixation offset, which improves the generation of saccades, decreases IOR in detection tasks, suggesting a close link between IOR and oculomotor control. However, according to some alternative views (e.g., the input-based IOR hypothesis and the object files segregation/integration hypothesis), IOR may be related to some sensory rather than motor processes. Some studies support that view and show that IOR may occur differently in detection and discrimination tasks and that oculomotor processes do not affect IOR in tasks where manual responses are required and eye movements are suppressed. Two experiments presented in this article show that removing the fixation point decreases manual IOR in detection and discrimination tasks. The results are discussed in terms of various theoretical approaches.

Coupling of saccade plans to endogenous attention during urgent choices

The neural mechanisms that willfully direct attention to specific locations in space are closely related to those for generating targeting eye movements (saccades). However, the degree to which the voluntary deployment of attention to a location is necessarily accompanied by a corresponding saccade plan remains unclear. One problem is that attention and saccades are both automatically driven by salient sensory events; another is that the underlying processes unfold within tens of milliseconds only. Here, we use an urgent task design to resolve the evolution of a visuomotor choice on a moment-by-moment basis while independently controlling the endogenous (goal-driven) and exogenous (salience-driven) contributions to performance. Human participants saw a peripheral cue and, depending on its color, either looked at it (prosaccade) or looked at a diametrically opposite, uninformative non-cue (antisaccade). By varying the luminance of the stimuli, the exogenous contributions could be cleanly dissociated from the endogenous process guiding the choice over time. According to the measured timecourses, generating a correct antisaccade requires about 30 ms more processing time than generating a correct prosaccade based on the same perceptual signal. The results indicate that saccade plans are biased toward the location where attention is endogenously deployed, but the coupling is weak and can be willfully overridden very rapidly.

Alterations to foveal crowding with microsaccade preparation

Visual stimuli presented around the time of a saccade have been shown to be perceived differently by the visual system, including a reduction in the harmful impact of flankers (crowding). However, whether the effects observed are due strictly to crowding remains controversial, and the effects have only been measured with large saccades in peripheral vision. Here we investigate how crowded stimuli placed 20 arc minutes from the center of gaze are affected by an upcoming microsaccade. The stimulus consisted of a rotated T of size 6.25 arcminutes that was either unflanked, surrounded by four flankers (Experiment 1), or surrounded by two flankers that were positioned either radially or tangentially (Experiments 2 and 3). In 80 % of trials, subjects made voluntary microsaccades to the target when cued, and in the remaining 20 % of the trials subjects continued to maintain fixation. In Experiments 1 and 2, subjects were required to saccade to the same location as the target, while in Experiment 3 subjects saccaded to a different location ∼ 20 arc min to the upper left of the target. Thus, we provide evidence for two separable pre-saccadic benefits for crowded parafoveal targets: one isotropizes the crowding zone for stimuli presented 200 to 125 ms before microsaccadic onset, and another provides a benefit exclusively for microsaccade targets surrounded by tangential flankers in the presence of imminent microsaccades. Two possible mechanisms are attentional enhancement and predictive remapping of receptive fields, respectively.

Fixation offset decreases pupillary inhibition of return

Inhibition of return (IOR) is reflected as a slower manual or saccadic response to a cued rather than an uncued target (manual IOR and saccadic IOR, respectively), and as a pupillary dilation when a bright, relative to a dark side of a display is cued (pupillary IOR). The aim of this study was to investigate the relation between an IOR and oculomotor system. According to the predominant view, only the saccadic IOR is strictly related to the visuomotor process, and the manual and pupillary IORs depend on non-motor factors (e.g., short-term visual depression). Alternatively, the after-effect of the covert-orienting hypothesis postulates that IOR is strictly related to the oculomotor system. As fixation offset affects oculomotor processes, this study investigated whether fixation offset also affects pupillary and manual IORs. The results show that fixation offset decreased IOR in pupillary but not manual responses, and provides support for the hypothesis that at least the pupillary IOR is tightly linked to eye movement preparation.

A Narrative Literature Review About the Role of Microsaccades in Sports

In many daily and sport situations, people have to simultaneously perceive and process multiple objects and scenes in a short amount of time. A wrong decision may lead to a disadvantage for a team or for a single athlete, and during daily life (i.e., driving, surgery), it could have more dangerous consequences. Considering the results of different studies, the ability to distribute visual attention depends on different levels of expertise and environment-related constraints. This article is a narrative review of the current scientific evidence in the field of eye movements in sports, focusing on the role of microsaccades in sporting task situations. Over the past 10 years, microsaccades have become one of the most increasing areas of research in visual and oculomotor studies and even in the area of sport science. Here, we review the latest findings and discuss the relationships between microsaccades and attention, perception, and action in sports.

Memory-driven eye movements prospectively predict dementia in people at risk of Alzheimer's disease

Introduction

Oculomotor behaviors linked to cognitive performance revealed neurocognitive features of Alzheimer's disease (AD) that can enhance the accuracy of its assessment and diagnosis.

Methods

A sample of 107 participants (i.e., 65 mild cognitive impairment [MCI] and 42 controls) were recruited and followed up for 40 months. At baseline, they underwent assessment with the ViewMind digital biomarker, which draws cognitive-related patterns of eye movement while people perform the visual short-term memory binding task.

Results

Baseline data predicted that 36 patients with MCI would progress to the AD clinical syndrome (ADS Progressing). The remaining 29 MCI patients were predicted to remain as MCI or progress to other forms of dementia. After 40 months of follow-up, 94% of ADS Progressing patients had received a diagnosis of dementia, whereas none of the non-ADS Progressing had.

Discussion

The analysis of eye movement behavior combined with cognitive markers for AD can effectively predict progression to ADS among patients with MCI.

To Grasp the World at a Glance: The Role of Attention in Visual and Semantic Associative Processing

Associative relations among words, concepts and percepts are the core building blocks of high-level cognition. When viewing the world ‘at a glance’, the associative relations between objects in a scene, or between an object and its visual background, are extracted rapidly. The extent to which such relational processing requires attentional capacity, however, has been heavily disputed over the years. In the present manuscript, I review studies investigating scene–object and object–object associative processing. I then present a series of studies in which I assessed the necessity of spatial attention to various types of visual–semantic relations within a scene. Importantly, in all studies, the spatial and temporal aspects of visual attention were tightly controlled in an attempt to minimize unintentional attention shifts from ‘attended’ to ‘unattended’ regions. Pairs of stimuli—either objects, scenes or a scene and an object—were briefly presented on each trial, while participants were asked to detect a pre-defined target category (e.g., an animal, a nonsense shape). Response times (RTs) to the target detection task were registered when visual attention spanned both stimuli in a pair vs. when attention was focused on only one of two stimuli. Among non-prioritized stimuli that were not defined as to-be-detected targets, findings consistently demonstrated rapid associative processing when stimuli were fully attended, i.e., shorter RTs to associated than unassociated pairs. Focusing attention on a single stimulus only, however, largely impaired this relational processing. Notably, prioritized targets continued to affect performance even when positioned at an unattended location, and their associative relations with the attended items were well processed and analyzed. Our findings portray an important dissociation between unattended task-irrelevant and task-relevant items: while the former require spatial attentional resources in order to be linked to stimuli positioned inside the attentional focus, the latter may influence high-level recognition and associative processes via feature-based attentional mechanisms that are largely independent of spatial attention.

To look or not to look: dissociating presaccadic and covert spatial attention

Attention is a central neural process that enables selective and efficient processing of visual information. Individuals can attend to specific visual information either overtly, by making an eye movement to an object of interest, or covertly, without moving their eyes. We review behavioral, neuropsychological, neurophysiological, and computational evidence of presaccadic attentional modulations that occur while preparing saccadic eye movements, and highlight their differences from those of covert spatial endogenous (voluntary) and exogenous (involuntary) attention. We discuss recent studies and experimental procedures on how these different types of attention impact visual performance, alter appearance, differentially modulate the featural representation of basic visual dimensions (orientation and spatial frequency), engage different neural computations, and recruit partially distinct neural substrates. We conclude that presaccadic attention and covert attention are dissociable.

Psychophysical dual-task setups do not measure pre-saccadic attention but saccade-related strengthening of sensory representations

Visual attention and saccadic eye movements are linked in a tight, yet flexible fashion. In humans, this link is typically studied with dual‐task setups. Participants are instructed to execute a saccade to some target location, while a discrimination target is flashed on a screen before the saccade can be made. Participants are also instructed to report a specific feature of this discrimination target at the trial end. Discrimination performance is usually better if the discrimination target occurred at the same location as the saccade target compared to when it occurred at a different location, which is explained by the mandatory shift of attention to the saccade target location before saccade onset. This pre‐saccadic shift of attention presumably enhances the perception of the discrimination target if it occurred at the same, but not if it occurred at a different location. It is, however, known that a dual‐task setup can alter the primary process under investigation. Here, we directly compared pre‐saccadic attention in single‐task versus dual‐task setups using concurrent electroencephalography (EEG) and eye‐tracking. Our results corroborate the idea of a pre‐saccadic shift of attention. They, however, question that this shift leads to the same‐position discrimination advantage. The relation of saccade and discrimination target position affected the EEG signal only after saccade onset. Our results, thus, favor an alternative explanation based on the role of saccades for the consolidation of sensory and short‐term memory. We conclude that studies with dual‐task setups arrived at a valid conclusion despite not measuring exactly what they intended to measure.

In humans, the relation between visual attention and saccadic eye movements is usually studied with psychophysical dual‐task setups. Here, we employ concurrent EEG and eye‐tracking to directly compare dual‐task to single‐task setups and conclude in line with previous research that attention precedes saccades. However, our results suggest that dual‐task setups do not measure what they are supposed to measure, that is, the pre‐saccadic shift of attention.

Information stored in memory affects abductive reasoning

Abductive reasoning describes the process of deriving an explanation from given observations. The theory of abductive reasoning (TAR; Johnson and Krems, Cognitive Science 25:903-939, 2001) assumes that when information is presented sequentially, new information is integrated into a mental representation, a situation model, the central data structure on which all reasoning processes are based. Because working memory capacity is limited, the question arises how reasoning might change with the amount of information that has to be processed in memory. Thus, we conducted an experiment (N = 34) in which we manipulated whether previous observation information and previously found explanations had to be retrieved from memory or were still visually present. Our results provide evidence that people experience differences in task difficulty when more information has to be retrieved from memory. This is also evident in changes in the mental representation as reflected by eye tracking measures. However, no differences are found between groups in the reasoning outcome. These findings suggest that individuals construct their situation model from both information in memory as well as external memory stores. The complexity of the model depends on the task: when memory demands are high, only relevant information is included. With this compensation strategy, people are able to achieve similar reasoning outcomes even when faced with tasks that are more difficult. This implies that people are able to adapt their strategy to the task in order to keep their reasoning successful.

On the link between attentional search and the oculomotor system: Is preattentive search restricted to the range of eye movements?

It has been proposed that covert visual search can be fast, efficient, and stimulus driven, particularly when the target is defined by a salient single feature, or slow, inefficient, and effortful when the target is defined by a nonsalient conjunction of features. This distinction between fast, stimulus-driven orienting and slow, effortful orienting can be related to the distinction between exogenous spatial attention and endogenous spatial attention. Several studies have shown that exogenous, covert orienting is limited to the range of saccadic eye movements, whereas covert endogenous orienting is independent of the range of saccadic eye movements. The current study examined whether covert visual search is affected in a similar way. Experiment 1 showed that covert visual search for feature singletons was impaired when stimuli were presented beyond the range of saccadic eye movements, whereas conjunction search was unaffected by array position. Experiment 2 replicated and extended this effect by measuring search times at 6 eccentricities. The impairment in covert feature search emerged only when stimuli crossed the effective oculomotor range and remained stable for locations further into the periphery, ruling out the possibility that the results of Experiment 1 were due to a failure to fully compensate for the effects of cortical magnification. The findings are interpreted in terms of biased competition and oculomotor theories of spatial attention. It is concluded that, as with covert exogenous orienting, biological constraints on overt orienting in the oculomotor system constrain covert, preattentive search.

Understanding the underlying mechanisms of Quiet Eye: The role of microsaccades, small saccades and pupil-size before final movement initiation in a soccer penalty kick

Experts keep a steady final fixation at a specific location just before final movement initiation, the so-called "quiet eye" (QE). However, the eyes are rarely "quiet", and small eye movements occur during visual fixation. The current research investigated the subtle eye movements and underlying mechanisms immediately prior to and during QE. The gaze behaviour of 8 intermediate-level goalkeepers was recorded as they moved (either left or right) in an attempt to predict the future direction of the ball during a soccer penalty kick. Goalkeepers were more likely to predict the direction of the penalty, which was coupled with delaying movement initiation. The temporal sequence of microsaccade rates dropped ∼1000 ms before goalkeepers' final movement initiation. Saccade rates increased, reaching a peak ∼500 ms before final movement initiation, concomitant with microsaccades reduction. Microsaccades predicted the goalkeepers' direction, oriented to the right when goalkeepers moved to the right, and conversely to the left when they moved to the left. Microsaccades may be modulated by attention and appear functionally related to saccadic intrusions. Pupil-size increased proportionally with the lead up to the instance of the penalty being kicked, reaching a plateau at final movement initiation. In conclusion, microsaccades and small saccades could improve the perception of the soccer penalty kick, helping athletes during the period that precedes the critical movement initiation, shifting from covert to overt attention for identifying the useful cues necessary to guide the action.

Shared attention for action selection and action monitoring in goal-directed reaching

Dual-task studies have shown higher sensitivity for stimuli presented at the targets of upcoming actions. We examined whether attention is directed to action targets for the purpose of action selection, or if attention is directed to these locations because they are expected to provide feedback about movement outcomes. In our experiment, endpoint accuracy feedback was spatially separated from the action targets to determine whether attention would be allocated to (a) the action targets, (b) the expected source of feedback, or (c) to both locations. Participants reached towards a location indicated by an arrow while identifying a discrimination target that could appear in any one of eight possible locations. Discrimination target accuracy was used as a measure of attention allocation. Participants were unable to see their hand during reaching and were provided with a small monetary reward for each accurate movement. Discrimination target accuracy was best at action targets but was also enhanced at the spatially separated feedback locations. Separating feedback from the reaching targets did not diminish discrimination accuracy at the movement targets but did result in delayed movement initiation and reduced reaching accuracy, relative to when feedback was presented at the reaching target. The results suggest attention is required for both action planning and monitoring movement outcomes. Dividing attention between these functions negatively impacts action performance.

Examining the Role of Eye Movements During Conversational Listening in Noise

Speech comprehension is often thought of as an entirely auditory process, but both normal hearing and hearing-impaired individuals sometimes use visual attention to disambiguate speech, particularly when it is difficult to hear. Many studies have investigated how visual attention (or the lack thereof) impacts the perception of simple speech sounds such as isolated consonants, but there is a gap in the literature concerning visual attention during natural speech comprehension. This issue needs to be addressed, as individuals process sounds and words in everyday speech differently than when they are separated into individual elements with no competing sound sources or noise. Moreover, further research is needed to explore patterns of eye movements during speech comprehension – especially in the presence of noise – as such an investigation would allow us to better understand how people strategically use visual information while processing speech. To this end, we conducted an experiment to track eye-gaze behavior during a series of listening tasks as a function of the number of speakers, background noise intensity, and the presence or absence of simulated hearing impairment. Our specific aims were to discover how individuals might adapt their oculomotor behavior to compensate for the difficulty of the listening scenario, such as when listening in noisy environments or experiencing simulated hearing loss. Speech comprehension difficulty was manipulated by simulating hearing loss and varying background noise intensity. Results showed that eye movements were affected by the number of speakers, simulated hearing impairment, and the presence of noise. Further, findings showed that differing levels of signal-to-noise ratio (SNR) led to changes in eye-gaze behavior. Most notably, we found that the addition of visual information (i.e. videos vs. auditory information only) led to enhanced speech comprehension – highlighting the strategic usage of visual information during this process.

The eye that binds: Feature integration is not disrupted by saccadic eye movements

Feature integration theory proposes that visual features, such as shape and color, can only be combined into a unified object when spatial attention is directed to their location in retinotopic maps. Eye movements cause dramatic changes on our retinae, and are associated with obligatory shifts in spatial attention. In two experiments, we measured the prevalence of conjunction errors (that is, reporting an object as having an attribute that belonged to another object), for brief stimulus presentation before, during, and after a saccade. Planning and executing a saccade did not itself disrupt feature integration. Motion did disrupt feature integration, leading to an increase in conjunction errors. However, retinal motion of an equal extent but caused by saccadic eye movements is spared this disruption, and showed similar rates of conjunction errors as a condition with static stimuli presented to a static eye. The results suggest that extra-retinal signals are able to compensate for the motion caused by saccadic eye movements, thereby preserving the integrity of objects across saccades and preventing their features from mixing or mis-binding.

Updating spatial working memory in a dynamic visual environment

The present review describes recent developments regarding the role of the eye movement system in representing spatial information and keeping track of locations of relevant objects. First, we discuss the active vision perspective and why eye movements are considered crucial for perception and attention. The second part focuses on the question of how the oculomotor system is used to represent spatial attentional priority, and the role of the oculomotor system in maintenance of this spatial information. Lastly, we discuss recent findings demonstrating rapid updating of information across saccadic eye movements. We argue that the eye movement system plays a key role in maintaining and rapidly updating spatial information. Furthermore, we suggest that rapid updating emerges primarily to make sure actions are minimally affected by intervening eye movements, allowing us to efficiently interact with the world around us.

The Limits of Predictive Remapping of Attention Across Eye Movements

With every eye movement, visual input projected onto our retina changes drastically. The fundamental question of how we keep track of relevant objects and movement targets has puzzled scientists for more than a century. Recent advances suggested that this can be accomplished through the process of predictive remapping of visual attention to the future post-saccadic locations of relevant objects. Evidence for the existence of predictive remapping of attention was first provided by Rolfs et al. (2011) (Nature Neuroscience, 14, 252–256). However, they used a single distant control location away from the task-relevant locations, which could have biased the allocation of visual attention. In this study we used a similar experimental paradigm as Rolfs et al. (2011), but probed attention equally likely at all possible locations. Our results showed that discrimination performance was higher at the remapped location than at a distant control location, but not compared to the other two control locations. A re-analysis of the results obtained by Rolfs et al. (2011) revealed a similar pattern. Together, these findings suggest that it is likely that previous reports of the predictive remapping of attention were due to a diffuse spread of attention to the task-relevant locations rather than to a specific shift toward the target’s future retinotopic location.

Associations and Dissociations between Oculomotor Readiness and Covert Attention

The idea that covert mental processes such as spatial attention are fundamentally dependent on systems that control overt movements of the eyes has had a profound influence on theoretical models of spatial attention. However, theories such as Klein’s Oculomotor Readiness Hypothesis (OMRH) and Rizzolatti’s Premotor Theory have not gone unchallenged. We previously argued that although OMRH/Premotor theory is inadequate to explain pre-saccadic attention and endogenous covert orienting, it may still be tenable as a theory of exogenous covert orienting. In this article we briefly reiterate the key lines of argument for and against OMRH/Premotor theory, then evaluate the Oculomotor Readiness account of Exogenous Orienting (OREO) with respect to more recent empirical data. These studies broadly confirm the importance of oculomotor preparation for covert, exogenous attention. We explain this relationship in terms of reciprocal links between parietal ‘priority maps’ and the midbrain oculomotor centres that translate priority-related activation into potential saccade endpoints. We conclude that the OMRH/Premotor theory hypothesis is false for covert, endogenous orienting but remains tenable as an explanation for covert, exogenous orienting.

The gap effect reduces both manual and saccadic inhibition of return (IOR)

Inhibition of return (IOR) is the effect of slower responses to validly than invalidly cued targets. The discovery of IOR raised controversy as to whether it has two “flavors”, i.e., attentional/perceptual and motoric, or whether it is a homogeneous visual-motor phenomenon that should be understood in terms of the preparation of different effectors (mainly eye movement). Since manipulation of fixation offset (0 and 200 ms gap) is believed to affect the latency of saccades, we measured its influence on saccadic and manual IOR with a simple keypress response when eye movements were forbidden. In the two experiments which we carried out, the fixation offset decreased IOR in both the saccadic and the manual conditions. The results suggest the limitations of the attentional hypothesis, which assumes that manual IOR is independent of the motoric component; they are also in line with the tenets of the oculomotor hypothesis of IOR.

Implicit processing during change blindness revealed with mouse-contingent and gaze-contingent displays

People often miss salient events that occur right in front of them. This phenomenon, known as change blindness, reveals the limits of visual awareness. Here, we investigate the role of implicit processing in change blindness using an approach that allows partial dissociation of covert and overt attention. Traditional gaze-contingent paradigms adapt the display in real time according to current gaze position. We compare such a paradigm with a newly designed mouse-contingent paradigm where the visual display changes according to the real-time location of a user-controlled mouse cursor, effectively allowing comparison of change detection with mainly overt attention (gaze-contingent display; Experiment 2) and untethered overt and covert attention (mouse-contingent display; Experiment 1). We investigate implicit indices of target detection during change blindness in eye movement and behavioral data, and test whether affective devaluation of unnoticed targets may contribute to change blindness. The results show that unnoticed targets are processed implicitly, but that the processing is shallower than if the target is consciously detected. Additionally, the partial untethering of covert attention with the mouse-contingent display changes the pattern of search and leads to faster detection of the changing target. Finally, although it remains possible that the deployment of covert attention is linked to implicit processing, the results fall short of establishing a direct connection.

Saccade selection and inhibition: motor and attentional components

Motor responses are fundamentally spatial in their function and neural organization. However, studies of inhibitory motor control, focused on global stopping of all actions, have ignored whether inhibitory control can be exercised selectively for specific actions. We used a new approach to elicit and measure motor inhibition by asking human participants to either look at (select) or avoid looking at (inhibit) a location in space. We found that instructing a location to be avoided resulted in an inhibitory bias specific to that location. When compared with the facilitatory bias observed in the Look task, it differed significantly in both its spatiotemporal dynamics and its modulation of attentional processing. While action selection was evident in oculomotor system and interacted with attentional processing, action inhibition was evident mainly in the oculomotor system. Our findings suggest that action inhibition is implemented by spatially specific mechanisms that are separate from action selection. NEW & NOTEWORTHY We show that cognitive control of saccadic responses evokes separable action selection and inhibition processes. Both action selection and inhibition are represented in the saccadic system, but only action selection interacts with the attentional system.

The Relationship Between Spatial Attention and Eye Movements

The nature of the relationship between spatial attention and eye movements has been the subject of intense debate for more than 40 years. Two ideas have dominated this debate. First is the idea that spatial attention shares common neural mechanisms with eye movement programming, characterizing attention as an eye movement that has been prepared but not executed. Second, based on the observation that attention shifts to saccade targets, several theories have proposed that saccade programming necessarily recruits attentional resources. In this chapter, we review the evidence for each of these ideas and discuss some of the limitations and challenges in confirming their predictions. Although they are clearly dependent under some circumstances, dissociations between spatial attention and eye movements, and clear differences in their basic functions, point to the existence of two interconnected, but separate, systems.

The Effect of the Embodied Guidance in the Insight Problem Solving: An Eye Movement Study

Insight is an important cognitive process in creative thinking. The present research applied embodied cognitive perspective to explore the effect of embodied guidance on insight problem solving and its underlying mechanisms by two experiments. Experiment 1 used the matchstick arithmetic problem to explore the role of embodied gestures guidance in problem solving. The results showed that the embodied gestures facilitate the participants’ performance. Experiment 2 investigated how embodied attention guidance affects insight problem solving. The results showed that participants performed better in prototypical guidance condition. Experiment 2a adopted the Duncker’s radiation problem to explore how embodied behavior and prototypical guidance influence problem solving by attention tracing techniques. Experiment 2b aimed to further examine whether implicit attention transfer was the real cause which resulted in participants over-performing in prototypical guidance condition in Experiment 2a. The results demonstrated that overt physical motion was unnecessary for individuals to experience the benefits of embodied guidance in problem solving, which supported the reciprocal relation hypothesis of saccades and attention. In addition, the questionnaire completed after experiments showed that participants did not realize the relation between guidance and insight problem solving. Taken together, the current study provided further evidence for that embodied gesture and embodied attention both facilitated the insight problem solving and the facilitation is implicit.

Model of Multiple Identity Tracking (MOMIT) 2.0: Resolving the serial vs. parallel controversy in tracking

The present study investigated whether during tracking of multiple moving objects with distinct identities only one identity is tracked at each moment (serial tracking) or whether multiple identities can be tracked simultaneously (parallel tracking). By adopting the gaze-contingent display change technique, we manipulated in real time the presence/absence of object identities during tracking. The data on performance accuracy revealed a serial tracking pattern for facial images and a parallel pattern for color discs: when tracking faces, the presence/absence of only the currently foveated identity impacted the performance, whereas when tracking colors, the presence of multiple identities across the visual field led to improved tracking performance. This pattern is consistent with the identifiability of the different types of objects in the visual field. The eye movements during MIT showed a bias towards visiting and dwelling on individual targets when facial identities were present and towards visiting the blank areas between targets when color identities were present. Nevertheless, the eye visits were predominately on individual targets regardless of the type of objects and the presence of object identities. The eye visits to targets were beneficial for target tracking, particularly in face tracking. We propose the Model of Multiple Identity Tracking (MOMIT) 2.0 which accounts for the results and reconcile the serial vs. parallel controversy. The model suggests that observers cooperatively use attention, eye movements, perception, and working memory for dynamic tracking. Tracking appears more serial when high-resolution information needs to be sampled and maintained for discriminating the targets, whereas it appears more parallel when low-resolution information is sufficient.

The effect of offset cues on saccade programming and covert attention

Salient peripheral events trigger fast, “exogenous” covert orienting. The influential premotor theory of attention argues that covert orienting of attention depends upon planned but unexecuted eye-movements. One problem with this theory is that salient peripheral events, such as offsets, appear to summon attention when used to measure covert attention (e.g., the Posner cueing task) but appear not to elicit oculomotor preparation in tasks that require overt orienting (e.g., the remote distractor paradigm). Here, we examined the effects of peripheral offsets on covert attention and saccade preparation. Experiment 1 suggested that transient offsets summoned attention in a manual detection task without triggering motor preparation planning in a saccadic localisation task, although there were a high proportion of saccadic capture errors on “no-target” trials, where a cue was presented but no target appeared. In Experiment 2, “no-target” trials were removed. Here, transient offsets produced both attentional facilitation and faster saccadic responses on valid cue trials. A third experiment showed that the permanent disappearance of an object also elicited attentional facilitation and faster saccadic reaction times. These experiments demonstrate that offsets trigger both saccade programming and covert attentional orienting, consistent with the idea that exogenous, covert orienting is tightly coupled with oculomotor activation. The finding that no-go trials attenuates oculomotor priming effects offers a way to reconcile the current findings with previous claims of a dissociation between covert attention and oculomotor control in paradigms that utilise a high proportion of catch trials.

Distractor displacements during saccades are reflected in the time-course of saccade curvature

Every time we make a saccade we form a prediction about where objects are going to be when the eye lands. This is crucial since the oculomotor system is retinotopically organized and every saccade drastically changes the projection of objects on the retina. We investigated how quickly the oculomotor system accommodates new spatial information when a distractor is displaced during a saccade. Participants performed sequences of horizontal and vertical saccades and oculomotor competition was induced by presenting a task-irrelevant distractor before the first saccade. On half of the trials the distractor remained in the same location after the first saccade and on the other half the distractor moved during the first saccade. Curvature of the second saccade was used to track target-distractor competition. At short intersaccadic intervals, saccades curved away from the original distractor location, confirming that in the oculomotor system spatiotopic representations emerge rapidly and automatically. Approximately 190 ms after the first saccade, second saccades curved away from the new distractor location. These results show that after a saccade the oculomotor system is initially driven by the spatial prediction made before the saccade, but it is able to quickly update these spatial predictions based on new visual information.

Rapid updating of spatial working memory across saccades

Each time we make an eye movement, positions of objects on the retina change. In order to keep track of relevant objects their positions have to be updated. The situation becomes even more complex if the object is no longer present in the world and has to be held in memory. In the present study, we used saccadic curvature to investigate the time-course of updating a memorized location across saccades. Previous studies have shown that a memorized location competes with a saccade target for selection on the oculomotor map, which leads to saccades curving away from it. In our study participants performed a sequence of two saccades while keeping a location in memory. The trajectory of the second saccade was used to measure when the memorized location was updated after the first saccade. The results showed that the memorized location was rapidly updated with the eyes curving away from its spatial coordinates within 130 ms after the first eye movement. The time-course of updating was comparable to the updating of an exogenously attended location, and depended on how well the location was memorized.

Don't let it distract you: how information about the availability of reward affects attentional selection

Previous research has shown that attentional selection is affected by reward contingencies: previously selected and rewarded stimuli continue to capture attention even if the reward contingencies are no longer in place. In the current study, we investigated whether attentional selection also is affected by stimuli that merely signal the magnitude of reward available on a given trial but, crucially, have never had instrumental value. In a series of experiments, we show that a stimulus signaling high reward availability captures attention even when that stimulus is and was never physically salient or part of the task set, and selecting it is harmful for obtaining reward. Our results suggest that irrelevant reward-signaling stimuli capture attention, because participants have learned about the relationship between the stimulus and reward. Importantly, we only observed learning after initial attentional prioritization of the reward signaling stimulus. We conclude that nonsalient, task-irrelevant but reward-signaling stimuli can affect attentional selection above and beyond top-down or bottom-up attentional control, however, only after such stimuli were initially prioritized for selection.

Perisaccadic Updating of Visual Representations and Attentional States: Linking Behavior and Neurophysiology

During natural vision, saccadic eye movements lead to frequent retinal image changes that result in different neuronal subpopulations representing the same visual feature across fixations. Despite these potentially disruptive changes to the neural representation, our visual percept is remarkably stable. Visual receptive field remapping, characterized as an anticipatory shift in the position of a neuron's spatial receptive field immediately before saccades, has been proposed as one possible neural substrate for visual stability. Many of the specific properties of remapping, e.g., the exact direction of remapping relative to the saccade vector and the precise mechanisms by which remapping could instantiate stability, remain a matter of debate. Recent studies have also shown that visual attention, like perception itself, can be sustained across saccades, suggesting that the attentional control system can also compensate for eye movements. Classical remapping could have an attentional component, or there could be a distinct attentional analog of visual remapping. At this time we do not yet fully understand how the stability of attentional representations relates to perisaccadic receptive field shifts. In this review, we develop a vocabulary for discussing perisaccadic shifts in receptive field location and perisaccadic shifts of attentional focus, review and synthesize behavioral and neurophysiological studies of perisaccadic perception and perisaccadic attention, and identify open questions that remain to be experimentally addressed.

Evidence from the eyes: Threatening postures hold attention

Efficient detection of threat provides obvious survival advantages and has resulted in a fast and accurate threat-detection system. Although beneficial under normal circumstances, this system may become hypersensitive and cause threat-processing abnormalities. Past research has shown that anxious individuals have difficulty disengaging attention from threatening faces, but it is unknown whether other forms of threatening social stimuli also influence attentional orienting. Much like faces, human body postures are salient social stimuli, because they are informative of one's emotional state and next likely action. Additionally, postures can convey such information in situations in which another's facial expression is not easily visible. Here we investigated whether there is a threat-specific effect for high-anxious individuals, by measuring the time that it takes the eyes to leave the attended stimulus, a task-irrelevant body posture. The results showed that relative to nonthreating postures, threat-related postures hold attention in anxious individuals, providing further evidence of an anxiety-related attentional bias for threatening information. This is the first study to demonstrate that attentional disengagement from threatening postures is affected by emotional valence in those reporting anxiety.

Common Priority Map for Selection History, Reward and Emotion in the Oculomotor System

In natural scenes, many objects compete for visual selection. However, it is not always clear why certain objects win this competition. I will demonstrate that the eye movement system lives in a constant state of competition among different oculomotor programs. This competition is not limited to the competition between the current goals of the observer and salient objects in the environment but incorporates independent influences from memory, reward, and emotional systems. These involuntary and automatic biases often overcome the goal-directed selection and expose severe limits in goal-driven control. There is also a striking similarity in the way that these very different sources of bias activate the oculomotor system and compete for representation. The inputs from various information sources are integrated in the common map in the oculomotor system for the sole purpose of improving the efficiency of oculomotor selection.

Effects of spatial congruency on saccade and visual discrimination performance in a dual-task paradigm

The present study investigated the coupling of selection-for-perception and selection-for-action during saccadic eye movement planning in three dual-task experiments. We focused on the effects of spatial congruency of saccade target (ST) location and discrimination target (DT) location and the time between ST-cue and Go-signal (SOA) on saccadic eye movement performance. In two experiments, participants performed a visual discrimination task at a cued location while programming a saccadic eye movement to a cued location. In the third experiment, the discrimination task was not cued and appeared at a random location. Spatial congruency of ST-location and DT-location resulted in enhanced perceptual performance irrespective of SOA. Perceptual performance in spatially incongruent trials was above chance, but only when the DT-location was cued. Saccade accuracy and precision were also affected by spatial congruency showing superior performance when the ST- and DT-location coincided. Saccade latency was only affected by spatial congruency when the DT-cue was predictive of the ST-location. Moreover, saccades consistently curved away from the incongruent DT-locations. Importantly, the effects of spatial congruency on saccade parameters only occurred when the DT-location was cued; therefore, results from experiments 1 and 2 are due to the endogenous allocation of attention to the DT-location and not caused by the salience of the probe. The SOA affected saccade latency showing decreasing latencies with increasing SOA. In conclusion, our results demonstrate that visuospatial attention can be voluntarily distributed upon spatially distinct perceptual and motor goals in dual-task situations, resulting in a decline of visual discrimination and saccade performance.

Orienting of attention: Then and now

It is nearly 35 years since I gave the 7th Sir Frederick Bartlett lecture at Oxford University. This was published as a paper entitled "Orienting of attention in the quarterly journal". The topic was then primarily in psychology, but now equally often in neuroscience. This paper summarizes the background of the reaction time methods used in the original paper and findings that emerged later on the sensory consequences of orienting, mainly in the visual system. It then discusses the brain network that is the source of the sensory amplification and other brain networks that are involved in attention. Next, it reviews studies of the development of attentional networks in early life. Finally, it indicates how the new tools available to explore the human brain can lead to further progress.

Salient distractors can induce saccade adaptation

When saccadic eye movements consistently fail to land on their intended target, saccade accuracy is maintained by gradually adapting the movement size of successive saccades. The proposed error signal for saccade adaptation has been based on the distance between where the eye lands and the visual target (retinal error). We studied whether the error signal could alternatively be based on the distance between the predicted and actual locus of attention after the saccade. Unlike conventional adaptation experiments that surreptitiously displace the target once a saccade is initiated towards it, we instead attempted to draw attention away from the target by briefly presenting salient distractor images on one side of the target after the saccade. To test whether less salient, more predictable distractors would induce less adaptation, we separately used fixed random noise distractors. We found that both visual attention distractors were able to induce a small degree of downward saccade adaptation but significantly more to the more salient distractors. As in conventional adaptation experiments, upward adaptation was less effective and salient distractors did not significantly increase amplitudes. We conclude that the locus of attention after the saccade can act as an error signal for saccade adaptation.

Selective Age Effects on Visual Attention and Motor Attention during a Cued Saccade Task

Objective. Visual information is often used to guide purposeful movement. However, older adults have impaired responses to visual information, leading to increased risk for injuries and potential loss of independence. We evaluated distinct visual and motor attention contributions to a cued saccade task to determine the extent to which aging selectively affects these processes. Methods. Nineteen healthy young (18–28 years) and 20 older (60–90 years) participants performed a cued saccade task under two conditions. We challenged motor attention by changing the number of possible saccade targets (1 or 6). Results. Older adults had difficulty in inhibiting unwanted eye movements and had greater eye movement inaccuracy in the hard condition when compared to the younger adults and to the easy condition. Also, an inverse relation existed between performance on the visual and motor components of the task in older adults, unlike younger adults. Conclusions. Older adults demonstrated difficulty in both inhibiting irrelevant saccade targets and selecting correct saccade endpoints during more complex tasks. The shift in relations among attention measures between the younger and older participants may indicate a need to prioritize attentional resources with age. These changes may impact an older adult's ability to function in complex environments.

Investigating the role of visual and auditory search in reading and developmental dyslexia

It has been suggested that auditory and visual sequential processing deficits contribute to phonological disorders in developmental dyslexia. As an alternative explanation to a phonological deficit as the proximal cause for reading disorders, the visual attention span hypothesis (VA Span) suggests that difficulties in processing visual elements simultaneously lead to dyslexia, regardless of the presence of a phonological disorder. In this study, we assessed whether deficits in processing simultaneously displayed visual or auditory elements is linked to dyslexia associated with a VA Span impairment. Sixteen children with developmental dyslexia and 16 age-matched skilled readers were assessed on visual and auditory search tasks. Participants were asked to detect a target presented simultaneously with 3, 9, or 15 distracters. In the visual modality, target detection was slower in the dyslexic children than in the control group on a “serial” search condition only: the intercepts (but not the slopes) of the search functions were higher in the dyslexic group than in the control group. In the auditory modality, although no group difference was observed, search performance was influenced by the number of distracters in the control group only. Within the dyslexic group, not only poor visual search (high reaction times and intercepts) but also low auditory search performance (d′) strongly correlated with poor irregular word reading accuracy. Moreover, both visual and auditory search performance was associated with the VA Span abilities of dyslexic participants but not with their phonological skills. The present data suggests that some visual mechanisms engaged in “serial” search contribute to reading and orthographic knowledge via VA Span skills regardless of phonological skills. The present results further open the question of the role of auditory simultaneous processing in reading as well as its link with VA Span skills.

Saccades curve away from previously inhibited locations: evidence for the role of priming in oculomotor competition

The oculomotor system serves as the basis for representing concurrently competing motor programs. Here, we examine whether the oculomotor system also keeps track of the outcome of competition between target and distractor on the previous trial. Participants had to perform a simple task of making a saccade toward a predefined direction. On two-thirds of the trials, an irrelevant distractor was presented to either the left or right of the fixation. On one-third of the trials, no distractor was present. The results show that on trials without a distractor, saccades curved away from the empty location that was occupied by a distractor on the previous trial. This result was replicated and extended to cases when different saccade directions were used. In addition, we show that repetition of distractor location on the distractor-present trials results in a stronger curvature away and in a shorter saccade latency to the target. Taken together, these results provide strong evidence that the oculomotor system automatically codes and retains locations that had been ignored in the past to bias future behavior.

Adaptive deployment of spatial and feature-based attention before saccades

What you see depends not only on where you are looking but also on where you will look next. The pre-saccadic attention shift is an automatic enhancement of visual sensitivity at the target of the next saccade. We investigated whether and how perceptual factors independent of the oculomotor plan modulate pre-saccadic attention within and across trials. Observers made saccades to one (the target) of six patches of moving dots and discriminated a brief luminance pulse (the probe) that appeared at an unpredictable location. Sensitivity to the probe was always higher at the target's location (spatial attention), and this attention effect was stronger if the previous probe appeared at the previous target's location. Furthermore, sensitivity was higher for probes moving in directions similar to the target's direction (feature-based attention), but only when the previous probe moved in the same direction as the previous target. Therefore, implicit cognitive processes permeate pre-saccadic attention, so that-contingent on recent experience-it flexibly distributes resources to potentially relevant locations and features.

Postural control in strabismic children versus non strabismic age-matched children

BACKGROUND

Several studies have shown that achieving a dual task modifies postural control; however, their results are conflicting. The goal of the present study is to compare the effect of a simple task (eye fixation) to the effect of a dual task (saccadic eye movements) on postural balance in strabismic and in non strabismic children.

METHODS

Postural stability was recorded with a platform (Techno Concept©) in ten strabismic children aged from 5.4 to 13.8 years (mean age: 8.8 ± 2.5 years). Data were compared to that of ten age-matched non strabismic control children. We analyzed the surface area, the length and the mean speed of the center of pressure (CoP).

RESULTS

Strabismic children are more instable than control children. The surface (340 mm(2)), the length (402 mm) and the mean speed (16 mm/s) of the CoP are significantly higher in strabismic children than in control children (160 mm(2), 280 mm and 11 mm/s, respectively). In addition, both strabismic and control children have a better postural control during saccades than during a fixation task. Surface, length and mean speed of the CoP are significantly reduced during the saccade task (214 mm(2), 306 mm and 12.5 mm/s, respectively) than during the fixation task (285 mm(2), 376 mm and 14.8 mm/s, respectively).

CONCLUSIONS

Abnormal postural control in strabismic children could be due to their visual deficits. The postural improvement observed in a dual task (saccades) vs. a simple task (fixation) might be due to the fact that postural control becomes more automatic during saccadic eye movements.

Differing effects of prosaccades and antisaccades on postural stability

The goal of the study was to examine the effect of different types of eye movements on postural stability. Ten healthy young adults (25 ± 3 years) participated in the study. Postural control was measured by the TechnoConcept© platform and recorded in Standard Romberg and Tandem Romberg conditions while participants performed five oculomotor tasks: two fixation tasks (central fixation cross, without and with distractors), two prosaccade tasks toward peripheral targets displayed 4° to the left or to the right of the fixation cross (reactive saccades induced by a gap 0 ms paradigm and voluntary saccades induced by an overlap 600 ms paradigm) and one antisaccade task (voluntary saccade made in the opposite direction of the visual target). The surface, the length, and the mean speed of the center of pressure were analyzed. We found that saccadic eye movements improved postural stability with respect to the fixation tasks. Furthermore, antisaccades were found to decrease postural stability compared to prosaccades (reactive as well as voluntary saccades). This result is in line with the U-shaped nonlinear model described by Lacour et al. (Neurophysiol Clin 38:411-421, 2008), showing that a secondary task performed during a postural task could increase (prosaccade task) or decrease (antisacade task) postural stability depending on its complexity. We suggest that the different degree of attentional resources needed for performing prosaccade or antisaccade tasks are, most likely, responsible for the different effect on postural control.

Automatic control of visual selection

This paper seeks out to reduce the role of the homunculus, the 'little man in the head' that is still prominent in most psychological theories regarding the control our behaviour. We argue that once engaged in a task (which is a volitional act), visual selection run off more or less in an automatic fashion. We argue that the salience map that drives automatic selection is not only determined by raw physical salience of the objects in the environment but also by the way these objects appear to the person. We provide evidence that priming (feature priming, priming by working memory and reward priming) sharpens the cortical representation of these objects such that these objects appear to be more salient above and beyond their physical salience. We demonstrate that this type of priming is not under volitional control: it occurs even if observers try to volitionally prepare for something else. In other words, looking at red prepares our brain for things that are red even if we volitionally try to prepare for green.

Rapid simultaneous enhancement of visual sensitivity and perceived contrast during saccade preparation

Humans and other animals with foveate vision make saccadic eye movements to prioritize the visual analysis of behaviorally relevant information. Even before movement onset, visual processing is selectively enhanced at the target of a saccade, presumably gated by brain areas controlling eye movements. Here we assess concurrent changes in visual performance and perceived contrast before saccades, and show that saccade preparation enhances perception rapidly, altering early visual processing in a manner akin to increasing the physical contrast of the visual input. Observers compared orientation and contrast of a test stimulus, appearing briefly before a saccade, to a standard stimulus, presented previously during a fixation period. We found simultaneous progressive enhancement in both orientation discrimination performance and perceived contrast as time approached saccade onset. These effects were robust as early as 60 ms after the eye movement was cued, much faster than the voluntary deployment of covert attention (without eye movements), which takes ∼300 ms. Our results link the dynamics of saccade preparation, visual performance, and subjective experience and show that upcoming eye movements alter visual processing by increasing the signal strength.