Eye movement trajectories and what they tell us

Coupling of saccade plans to endogenous attention during urgent choices

The neural mechanisms that willfully direct attention to specific locations in space are closely related to those for generating targeting eye movements (saccades). However, the degree to which the voluntary deployment of attention to a location necessarily activates a corresponding saccade plan remains unclear. One problem is that attention and saccades are both automatically driven by salient sensory events; another is that the underlying processes unfold within tens of milliseconds only. Here, we use an urgent task design to resolve the evolution of a visuomotor choice on a moment-by-moment basis while independently controlling the endogenous (goal-driven) and exogenous (salience-driven) contributions to performance. Human participants saw a peripheral cue and, depending on its color, either looked at it (prosaccade) or looked at a diametrically opposite, uninformative non-cue (antisaccade). By varying the luminance of the stimuli, the exogenous contributions could be cleanly dissociated from the endogenous process guiding the choice over time. According to the measured timecourses, generating a correct antisaccade requires about 30 ms more processing time than generating a correct prosaccade based on the same perceptual signal. The results indicate that saccade plans elaborated during fixation are biased toward the location where attention is endogenously deployed, but the coupling is weak and can be willfully overridden very rapidly.

Identifying a distractor produces object-based inhibition in an allocentric reference frame for saccade planning

We investigated whether distractor inhibition occurs relative to the target or fixation in a perceptual decision-making task using a purely saccadic response. Previous research has shown that during the process of discriminating a target from distractor, saccades made to a target deviate towards the distractor. Once discriminated, the distractor is inhibited, and trajectories deviate away from the distractor. Saccade deviation magnitudes provide a sensitive measure of target-distractor competition dependent on the distance between them. While saccades are planned in an egocentric reference frame (locations represented relative to fixation), object-based inhibition has been shown to occur in an allocentric reference frame (objects represented relative to each other independent of fixation). By varying the egocentric and allocentric distances of the target and distractor, we found that only egocentric distances contributed to saccade trajectories shifts towards the distractor during active decision-making. When the perceptual decision-making process was complete, and the distractor was inhibited, both ego- and allocentric distances independently contributed to saccade trajectory shifts away from the distractor. This is consistent with independent spatial and object-based inhibitory mechanisms. Therefore, we suggest that distractor inhibition is maintained in cortical visual areas with allocentric maps which then feeds into oculomotor areas for saccade planning.

The adaptive global effect: Luminance contrast modulates the global effect zone

When two peripheral objects are presented in close proximity, saccades towards one of these objects land at a weighted average location between the two objects. This phenomenon, known as the 'global effect' or 'saccade averaging', disappears when the distance between the objects increases. When objects are further apart, outside the averaging zone, saccades land on one of the objects with little or no saccade averaging. Although it is known that the strength of the global effect is dependent on the specific features of the two objects, it is unclear if the size of the zone in which averaging can occur (i.e., the averaging zone) is adaptive. The aim of the current study was to investigate whether the size of the averaging zone adapts to variations in object luminance contrast of the objects. In order to systematically assess changes in the averaging zone, in two experiments, observers made saccadic eye movements while the luminance of the target and the distractor varied. We report three major findings: 1) When a distractor was more luminant relative to the target, the averaging zone increased (Exp. 1). Notably, saccade averaging never entirely ceased to exist, even for remote distractors. 2) When target and distractor were equiluminant, the averaging zone did not change with absolute luminance (Exp. 2). 3) Higher (relative and absolute) luminance increased the averaging zone especially for shorter saccadic response times (SRT). We conclude that the averaging zone is adaptive and becomes larger with increasing relative luminance and especially when SRTs are short.

Increased Semantic Memorization in Children with ADHD during a Paradigm of Motor Priming: Exploratory Findings

AIM

The aim was to evaluate the effect of body actions on learning process, particularly semantic memory capabilities in drug-naïve children with attention deficit hyperactivity disorder (ADHD).

METHOD

Thirty children had to listen to a story which was repeated three times in a row and then a fourth time five minutes later. After each listen, the child was asked what she/he remembered from the story. The whole sample was split randomly into three subgroups of equal IQ (mean 102.2 ± 12.7), age (mean age 8 ± 0.6 years), sex (ratio female to male 1:5) and severity of ADHD symptoms (34.2 ± 7.4); a G1 "Freeze" subgroup, which implied listening to the story while sitting on a chair without moving; a G2 "Minimal" subgroup, which implied listening to the story while sitting on a chair but free movement was allowed; a G3 "Prescribed movement" subgroup, which implied listening to the story standing up, while copying the experimenter movements that mimicked the actions told in the story.

RESULTS

Although our sample was limited in size, interestingly, children in the G3 subgroup showed the highest short-term semantic memory retention compared to G1. In all subgroups, repetition allowed an increase in performance.

CONCLUSIONS

Our exploratory findings stress the positive role of movement in children with ADHD to increase semantic memorization. Hyperactivity may counteract the deficit of memorization related to attention impairment in children with ADHD. Our results may encourage parents or teachers to allow children with ADHD to move around during short-term memory-retention tasks.

A mobile device-based game prototype for ADHD: development and preliminary feasibility testing

This research aimed to devise and assess a mobile game therapy software for children with Attention-Deficit/Hyperactivity Disorder (ADHD), as well as evaluating its suitability and effectiveness in improving the cognitive ability of typically developing children. The study encompassed 55 children diagnosed with ADHD and 55 neurotypical children. Initial assessments involved ADHD-related scales, computerized tests for information processing, and physiological-psychological evaluations. After a 4-week home-based game intervention, participants underwent re-evaluation using baseline measures and provided feedback on treatment satisfaction. Considering the small proportion of study participants who dropped out, data was analyzed using both the Intention-to-Treat (ITT) analysis and the Per-protocol (PP) analysis. The trial was registered at ClinicalTrials.gov (NCT06181747). In ITT analysis, post-intervention analysis using linear mixed models indicated that the ADHD group improved significantly more than the neurotypical group particularly in Continuous Performance Test (CPT) accuracy (B = -23.92, p < 0.001) and reaction time (B = 86.08, p < 0.01), along with enhancements in anti-saccade (B = -10.65, p < 0.05) and delayed-saccade tasks (B = 0.34, p < 0.05). A reduction in parent-rated SNAP-IV scores was also observed (B = 0.43, p < 0.01). In PP analysis, paired-sample t-tests suggested that the ADHD group had significant changes pre- and post-intervention, in terms of CPT Accuracy (t = -7.62, p < 0.01), Anti-saccade task Correct Rate (t = -3.90, p < 0.01) and SNAP-IV scores (t = -4,64, p < 0.01). However, no significant changes post-intervention were observed in the neurotypical group. Survey feedback highlighted a strong interest in the games across both groups, though ADHD participants found the game more challenging. Parents of ADHD children reported perceived benefits and a willingness to continue the game therapy, unlike the neurotypical group's parents. The findings advocated for the integration of serious video games as a complementary tool in ADHD treatment strategies, demonstrating the potential to augment attentional abilities and alleviate clinical symptoms. However, a randomized controlled trial (RCT) is needed to further verify its efficacy.

Oculomotor behavior can be adjusted on the basis of artificial feedback signals indicating externally caused errors

Whether a saccade is accurate and has reached the target cannot be evaluated during its execution, but relies on post-saccadic feedback. If the eye has missed the target object, a secondary corrective saccade has to be made to align the fovea with the target. If a systematic post-saccadic error occurs, adaptive changes to the oculomotor behavior are made, such as shortening or lengthening the saccade amplitude. Systematic post-saccadic errors are typically attributed internally to erroneous motor commands. The corresponding adaptive changes to the motor command reduce the error and the need for secondary corrective saccades, and, in doing so, restore accuracy and efficiency. However, adaptive changes to the oculomotor behavior also occur if a change in saccade amplitude is beneficial for task performance, or if it is rewarded. Oculomotor learning thus is more complex than reducing a post-saccadic position error. In the current study, we used a novel oculomotor learning paradigm and investigated whether human participants are able to adapt their oculomotor behavior to improve task performance even when they attribute the error externally. The task was to indicate the intended target object among several objects to a simulated human-machine interface by making eye movements. The participants were informed that the system itself could make errors. The decoding process depended on a distorted landing point of the saccade, resulting in decoding errors. Two different types of visual feedback were added to the post-saccadic scene and we compared how participants used the different feedback types to adjust their oculomotor behavior to avoid errors. We found that task performance improved over time, regardless of the type of feedback. Thus, error feedback from the simulated human-machine interface was used for post-saccadic error evaluation. This indicates that 1) artificial visual feedback signals and 2) externally caused errors might drive adaptive changes to oculomotor behavior.

Self-Organization of Nonlinearly Coupled Neural Fluctuations Into Synergistic Population Codes

Neural activity in the brain exhibits correlated fluctuations that may strongly influence the properties of neural population coding. However, how such correlated neural fluctuations may arise from the intrinsic neural circuit dynamics and subsequently affect the computational properties of neural population activity remains poorly understood. The main difficulty lies in resolving the nonlinear coupling between correlated fluctuations with the overall dynamics of the system. In this study, we investigate the emergence of synergistic neural population codes from the intrinsic dynamics of correlated neural fluctuations in a neural circuit model capturing realistic nonlinear noise coupling of spiking neurons. We show that a rich repertoire of spatial correlation patterns naturally emerges in a bump attractor network and further reveals the dynamical regime under which the interplay between differential and noise correlations leads to synergistic codes. Moreover, we find that negative correlations may induce stable bound states between two bumps, a phenomenon previously unobserved in firing rate models. These noise-induced effects of bump attractors lead to a number of computational advantages including enhanced working memory capacity and efficient spatiotemporal multiplexing and can account for a range of cognitive and behavioral phenomena related to working memory. This study offers a dynamical approach to investigating realistic correlated neural fluctuations and insights to their roles in cortical computations.

Saccadic trajectories deviate toward or away from optimally informative visual features

The saccades' path is influenced by visual distractors, making their trajectory curve away or toward them. Previous research suggested that the more salient the distractor, the more pronounced is the curvature. We investigate the saliency of spatial visual features, predicted by a constrained maximum entropy model to be optimal or non-optimal information carriers in fast vision, by using them as distractors in a saccadic task. Their effect was compared to that of luminance-based control distractors. Optimal features evoke a larger saccadic curvature compared to non-optimal features, and the magnitude and direction of deviation change as a function of the delay between distractor and saccade onset. Effects were similar to those found with high-luminance versus low-luminance distractors. Therefore, model-predicted information optimal features interfere with target-oriented saccades, following a dynamic attraction-repulsion pattern. This suggests that the visuo-oculomotor system rapidly and automatically processes optimally informative features while programming visually guided eye movements.

Motor Capabilities in Children with ADHD Are Improved after Brief Visuopostural Training

Children with ADHD show poor motor control. The aim of the present study was to test whether children with ADHD improved their motor performances (oculomotor as well as posture) after a short visuopostural training period. Two groups (G1 trained and G2 non-trained), each comprising 15 children with ADHD matched in IQ (intelligence quotient), sex, and age, participated in the study. Eye movements and postural sway were measured before (T1) and after (T2) 10 min of visuopostural training for the trained group and after 10 min of resting for the non-trained group. Training consisted of a visual search task performed while the child was standing on an unstable platform. At T1, oculomotor and postural abilities were statistically similar for both groups of children with ADHD (trained and non-trained). At T2, significant improvements in both oculomotor and postural capabilities were observed for the trained group but not for the non-trained group. These findings suggest that a short visuopostural training period could help children with ADHD to learn how to focus their visual attention in order to improve motor performance. Visuopostural training could allow a better integration of sensory inputs via central mechanisms, leading to improvement in both oculomotor and postural control. Further studies on a larger number of children with ADHD will be needed to confirm these findings and explore the eventual possible persistence of the training effect.

Distractor-induced saccade trajectory curvature reveals visual contralateral bias with respect to the dominant eye

The functional consequences of the visual system lateralization referred to as "eye dominance" remain poorly understood. We previously reported shorter hand reaction times for targets appearing in the contralateral visual hemifield with respect to the dominant eye (DE). Here, we further explore this contralateral bias by studying the influence of laterally placed visual distractors on vertical saccade trajectories, a sensitive method to assess visual processing. In binocular conditions, saccade trajectory curvature was larger toward a distractor placed in the contralateral hemifield with respect to the DE (e.g., in the left visual hemifield for a participant with a right dominant eye) than toward one presented in the ipsilateral hemifield (in the right visual hemifield in our example). When two distractors were present at the same time, the vertical saccade showed curvature toward the contralateral side. In monocular conditions, when one distractor was presented, a similar larger influence of the contralateral distractor was observed only when the viewing eye was the DE. When the non dominant eye (NDE) was viewing, curvature was symmetric for both distractor sides. Interestingly, this curvature was as large as the one obtained for the contralateral distractor when the DE was viewing, suggesting that eye dominance consequences rely on inhibition mechanisms present when the DE is viewing. Overall, these results demonstrate that DE influences visual integration occurring around saccade production and support a DE-based contralateral visual bias.

Exploring the Social Environment with the Eyes: A Review of the Impact of Facial Stimuli on Saccadic Trajectories

Eye movement parameters can be highly informative regarding how people explore the social environment around them. This theoretical review examines how human faces and their features (e.g., eye-gaze direction, emotional expressions) can modulate saccadic trajectories. In the first part, studies in which facial stimuli were presented in a central location, such as during a face-to-face social interaction, are illustrated. The second part focuses on studies in which facial stimuli were placed in the periphery. Together, these works confirm the presence of an intriguing link between eye movements and facial processing, and invite consideration of saccadic trajectories as a useful (and still underused) opportunity to track ongoing mechanisms that support the social vision. Some directions for future research are also discussed.

Oculomotor system can differentially process red and green colors during saccade programming in the presence of a competing distractor

Selective attention filters irrelevant information entering our brain to allow for fine-tuning of the relevant information processing. In the visual domain, shifts of attention are most often followed by a saccadic eye movement to objects and places of high relevance. Recent studies have shown that the stimulus color can affect saccade target selection and saccade trajectories. While those saccade modulations are based on perceptual color space, the level in the visual processing hierarchy at which color selection biases saccade programming remains unclear. As color has also been shown to influence manual response inhibition which is a key function of the prefrontal cortex, we hypothesized that the effects of color on executive functions would also inherently affect saccade programming. To test this hypothesis, we measured behavioral performance and saccade metrics during a modified saccadic Stroop task which reflects competition between color words ("RED" and "GREEN") and their color at the level of the prefrontal cortex. Our results revealed that the oculomotor system can differentially process red and green colors when planning a saccade in the presence of a competing distractor.

On the Use of Eye Movements in Symptom Validity Assessment of Feigned Schizophrenia

Assessing the credibility of reported mental health problems is critical in a variety of assessment situations, particularly in forensic contexts. Previous research has examined how the assessment of performance validity can be improved through the use of bio-behavioral measures (e.g., eye movements). To date, however, there is a paucity of literature on the use of eye tracking technology in assessing the validity of presented symptoms of schizophrenia, a disorder that is known to be associated with oculomotor abnormalities. Thus, we collected eye tracking data from 83 healthy individuals during the completion of the Inventory of Problems – 29 and investigated whether the oculomotor behavior of participants instructed to feign schizophrenia would differ from those of control participants asked to respond honestly. Results showed that feigners had a longer dwell time and a greater number of fixations in the feigning-keyed response options, regardless of whether they eventually endorsed those options (d > 0.80). Implications on how eye tracking technology can deepen comprehension on simulation strategies are discussed, as well as the potential of investigating eye movements to advance the field of symptom validity assessment.

Eye-tracking training improves the learning and memory of children with learning difficulty

Children who experience difficulty in learning at mainstream schools usually are provided with remediation classes after school to facilitate their learning. The present study aims to evaluate an innovative eye-tracking training as possible alternative remediation. Our previous findings showed that children who received eye-tracking training demonstrated improved attention and inhibitory control, and the present randomized controlled study aims to evaluate if eye-tracking training can also enhance the learning and memory of children. Fifty-three primary school students with learning difficulty (including autism spectrum disorder, attention-deficit/hyperactivity disorder, specific learning disorder, specific language impairment and borderline intellectual functioning) were recruited and randomly assigned to either the Eye-tracking Training group or the after-school remediation class. They were assessed on their learning and memory using the Hong Kong List Learning Test before and after 8-month training. Twenty weekly parallel sessions of training, 50 min per session, were provided to each group. Children who received the eye-tracking training, not those in the control group, showed a significant improvement in memory as measured by the delayed recall. In addition, the Eye-Tracking Training group showed significantly faster learning than the control group. Also, the two groups showed a significant improvement in their reading abilities. In sum, eye-tracking training may be effective training for enhancing the learning and memory of children with learning difficulties.

Trial-by-trial mouse trajectory predicts variance in precision across working memory representations: A critical reanalysis of Hao et al. (2021)

Multiple representations in visual working memory (VWM) can vary in mnemonic precision. This inhomogeneity of VWM precision has received some support from recent studies with the whole-report procedure, in which all memory items are recalled in free or forced orders. Recently, Hao et al. (2021, Cognition, 214, 104739) added a novel item-selection stage before each memory recall and found smaller between-trial variance in mouse trajectory during the selection stage in free-recall condition as compared with forced recall, which was taken as evidence for less between-item interference and the resulting precision benefit under free recall. Here, we reanalyzed the original dataset with a different analytic approach and attempted independent hypothesis testing focusing on within-trial trajectory deviations. We found that the direction of trial-by-trial trajectory bias for the first to-be-recalled item was predictive of the relative mnemonic precision of the remaining items. Critically, this relationship was only present for forced recall but not for free recall. Hierarchical Bayesian modeling of recall errors further identified that this relationship was selectively driven by VWM precision. Together, our reanalysis provides evidence for the source of between-item interference and its direct association with variable precision of VWM representations, and further highlights the novel methodological benefits of probing memory decisional processes using mouse trajectory data.

A constellation of eye-tracking measures reveals social attention differences in ASD and the broad autism phenotype

Background

Social attention differences, expressed through gaze patterns, have been documented in autism spectrum disorder (ASD), with subtle differences also reported among first-degree relatives, suggesting a shared genetic link. Findings have mostly been derived from standard eye-tracking methods (total fixation count or total fixation duration). Given the dynamics of visual attention, these standard methods may obscure subtle, yet core, differences in visual attention mechanisms, particularly those presenting sub-clinically. This study applied a constellation of eye-tracking analyses to gaze data from individuals with ASD and their parents.

Methods

This study included n = 156 participants across groups, including ASD (n = 24) and control (n = 32) groups, and parents of individuals with ASD (n = 61) and control parents (n = 39). A complex scene with social/non-social elements was displayed and gaze tracked via an eye tracker. Eleven analytic methods from the following categories were analyzed: (1) standard variables, (2) temporal dynamics (e.g., gaze over time), (3) fixation patterns (e.g., perseverative or regressive fixations), (4) first fixations, and (5) distribution patterns. MANOVAs, growth curve analyses, and Chi-squared tests were applied to examine group differences. Finally, group differences were examined on component scores derived from a principal component analysis (PCA) that reduced variables to distinct dimensions.

Results

No group differences emerged among standard, first fixation, and distribution pattern variables. Both the ASD and ASD parent groups demonstrated on average reduced social attention over time and atypical perseverative fixations. Lower social attention factor scores derived from PCA strongly differentiated the ASD and ASD parent groups from controls, with parent findings driven by the subset of parents demonstrating the broad autism phenotype.

Limitations

To generalize these findings, larger sample sizes, extended viewing contexts (e.g., dynamic stimuli), and even more eye-tracking analytical methods are needed.

Conclusions

Fixations over time and perseverative fixations differentiated ASD and the ASD parent groups from controls, with the PCA most robustly capturing social attention differences. Findings highlight their methodological utility in studies of the (broad) autism spectrum to capture nuanced visual attention differences that may relate to clinical symptoms in ASD, and reflect genetic liability in clinically unaffected relatives. This proof-of-concept study may inform future studies using eye tracking across populations where social attention is impacted.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13229-022-00490-w.

Irrelevant Robot Signals in a Categorization Task Induce Cognitive Conflict in Performance, Eye Trajectories, the N2 ERP-EEG Component, and Frontal Theta Oscillations

Understanding others' nonverbal behavior is essential for social interaction, as it allows, among others, to infer mental states. Although gaze communication, a well-established nonverbal social behavior, has shown its importance in inferring others' mental states, not much is known about the effects of irrelevant gaze signals on cognitive conflict markers during collaborative settings. Here, participants completed a categorization task where they categorized objects based on their color while observing images of a robot. On each trial, participants observed the robot iCub grasping an object from a table and offering it to them to simulate a handover. Once the robot "moved" the object forward, participants were asked to categorize the object according to its color. Before participants were allowed to respond, the robot made a lateral head/gaze shift. The gaze shifts were either congruent or incongruent with the object's color. We expected that incongruent head cues would induce more errors (Study 1), would be associated with more curvature in eye-tracking trajectories (Study 2), and induce larger amplitude in electrophysiological markers of cognitive conflict (Study 3). Results of the three studies show more oculomotor interference as measured in error rates (Study 1), larger curvatures eye-tracking trajectories (Study 2), and higher amplitudes of the N2 ERP of the EEG signals as well as higher event-related spectral perturbation amplitudes (Study 3) for incongruent trials compared with congruent trials. Our findings reveal that behavioral, ocular, and electrophysiological markers can index the influence of irrelevant signals during goal-oriented tasks.

Does feature intertrial priming guide attention? The jury is still out

Our search performance is strongly influenced by our past experience. In the lab, this influence has been demonstrated by investigating a variety of phenomena, including intertrial priming, statistical learning, and reward history, and collectively referred to as selection history. The resulting findings have led researchers to claim that selection history guides attention, thereby challenging the prevailing dichotomy, according to which top-down and bottom-up factors alone determine attentional priority. Here, we re-examine this claim with regard to one selection-history phenomenon, feature intertrial priming (aka priming of pop-out). We evaluate the evidence that specifically pertains to the role of feature intertrial priming in attentional guidance, rather than in later selective processes occurring after the target is found. We distinguish between the main experimental rationales, while considering the extent to which feature intertrial priming, as studied through different protocols, shares characteristics of top-down attention. We show that there is strong evidence that feature intertrial priming guides attention when the experimental protocol departs from the canonical paradigm and encourages observers to maintain the critical feature in visual working memory or to form expectations about the upcoming target. By contrast, the current evidence regarding the standard feature intertrial priming phenomenon is inconclusive. We propose directions for future research and suggest that applying the methodology used here in order to re-evaluate of the role of other selection history phenomena in attentional guidance should clarify the mechanisms underlying the strong impact of past experience on visual search performance.

MouseView.js: Reliable and valid attention tracking in web-based experiments using a cursor-directed aperture

Psychological research is increasingly moving online, where web-based studies allow for data collection at scale. Behavioural researchers are well supported by existing tools for participant recruitment, and for building and running experiments with decent timing. However, not all techniques are portable to the Internet: While eye tracking works in tightly controlled lab conditions, webcam-based eye tracking suffers from high attrition and poorer quality due to basic limitations like webcam availability, poor image quality, and reflections on glasses and the cornea. Here we present MouseView.js, an alternative to eye tracking that can be employed in web-based research. Inspired by the visual system, MouseView.js blurs the display to mimic peripheral vision, but allows participants to move a sharp aperture that is roughly the size of the fovea. Like eye gaze, the aperture can be directed to fixate on stimuli of interest. We validated MouseView.js in an online replication (N = 165) of an established free viewing task (N = 83 existing eye-tracking datasets), and in an in-lab direct comparison with eye tracking in the same participants (N = 50). Mouseview.js proved as reliable as gaze, and produced the same pattern of dwell time results. In addition, dwell time differences from MouseView.js and from eye tracking correlated highly, and related to self-report measures in similar ways. The tool is open-source, implemented in JavaScript, and usable as a standalone library, or within Gorilla, jsPsych, and PsychoJS. In sum, MouseView.js is a freely available instrument for attention-tracking that is both reliable and valid, and that can replace eye tracking in certain web-based psychological experiments.

A change in perspective: The interaction of saccadic and pursuit eye movements in oculomotor control and perception

Due to the close relationship between oculomotor behavior and visual processing, eye movements have been studied in many different areas of research over the last few decades. While these studies have brought interesting insights, specialization within each research area comes at the potential cost of a narrow and isolated view of the oculomotor system. In this review, we want to expand this perspective by looking at the interactions between the two most important types of voluntary eye movements: saccades and pursuit. Recent evidence indicates multiple interactions and shared signals at the behavioral and neurophysiological level for oculomotor control and for visual perception during pursuit and saccades. Oculomotor control seems to be based on shared position- and velocity-related information, which leads to multiple behavioral interactions and synergies. The distinction between position- and velocity-related information seems to be also present at the neurophysiological level. In addition, visual perception seems to be based on shared efferent signals about upcoming eye positions and velocities, which are to some degree independent of the actual oculomotor response. This review suggests an interactive perspective on the oculomotor system, based mainly on different types of sensory input, and less so on separate subsystems for saccadic or pursuit eye movements.

Motor planning under uncertainty

Actions often require the selection of a specific goal amongst a range of possibilities, like when a softball player must precisely position her glove to field a fast-approaching ground ball. Previous studies have suggested that during goal uncertainty the brain prepares for all potential goals in parallel and averages the corresponding motor plans to command an intermediate movement that is progressively refined as additional information becomes available. Although intermediate movements are widely observed, they could instead reflect a neural decision about the single best action choice given the uncertainty present. Here we systematically dissociate these possibilities using novel experimental manipulations and find that when confronted with uncertainty, humans generate a motor plan that optimizes task performance rather than averaging potential motor plans. In addition to accurate predictions of population-averaged changes in motor output, a novel computational model based on this performance-optimization theory accounted for a majority of the variance in individual differences between participants. Our findings resolve a long-standing question about how the brain selects an action to execute during goal uncertainty, providing fundamental insight into motor planning in the nervous system.

Strategic Distractor Suppression Improves Selective Control in Human Vision

Our visual environment is complicated, and our cognitive capacity is limited. As a result, we must strategically ignore some stimuli to prioritize others. Common sense suggests that foreknowledge of distractor characteristics, like location or color, might help us ignore these objects. But empirical studies have provided mixed evidence, often showing that knowing about a distractor before it appears counterintuitively leads to its attentional selection. What has looked like strategic distractor suppression in the past is now commonly explained as a product of prior experience and implicit statistical learning, and the long-standing notion the distractor suppression is reflected in α band oscillatory brain activity has been challenged by results appearing to link α to target resolution. Can we strategically, proactively suppress distractors? And, if so, does this involve α? Here, we use the concurrent recording of human EEG and eye movements in optimized experimental designs to identify behavior and brain activity associated with proactive distractor suppression. Results from three experiments show that knowing about distractors before they appear causes a reduction in electrophysiological indices of covert attentional selection of these objects and a reduction in the overt deployment of the eyes to the location of the objects. This control is established before the distractor appears and is predicted by the power of cue-elicited α activity over the visual cortex. Foreknowledge of distractor characteristics therefore leads to improved selective control, and α oscillations in visual cortex reflect the implementation of this strategic, proactive mechanism.SIGNIFICANCE STATEMENT To behave adaptively and achieve goals we often need to ignore visual distraction. Is it easier to ignore distracting objects when we know more about them? We recorded eye movements and electrical brain activity to determine whether foreknowledge of distractor characteristics can be used to limit processing of these objects. Results show that knowing the location or color of a distractor stops us from attentionally selecting it. A neural signature of this inhibition emerges in oscillatory alpha band brain activity, and when this signal is strong, selective processing of the distractor decreases. Knowing about the characteristics of task-irrelevant distractors therefore increases our ability to focus on task-relevant information, in this way gating information processing in the brain.

Vision as oculomotor reward: cognitive contributions to the dynamic control of saccadic eye movements

Humans and other primates are equipped with a foveated visual system. As a consequence, we reorient our fovea to objects and targets in the visual field that are conspicuous or that we consider relevant or worth looking at. These reorientations are achieved by means of saccadic eye movements. Where we saccade to depends on various low-level factors such as a targets' luminance but also crucially on high-level factors like the expected reward or a targets' relevance for perception and subsequent behavior. Here, we review recent findings how the control of saccadic eye movements is influenced by higher-level cognitive processes. We first describe the pathways by which cognitive contributions can influence the neural oculomotor circuit. Second, we summarize what saccade parameters reveal about cognitive mechanisms, particularly saccade latencies, saccade kinematics and changes in saccade gain. Finally, we review findings on what renders a saccade target valuable, as reflected in oculomotor behavior. We emphasize that foveal vision of the target after the saccade can constitute an internal reward for the visual system and that this is reflected in oculomotor dynamics that serve to quickly and accurately provide detailed foveal vision of relevant targets in the visual field.

OpenEDS2020 Challenge on Gaze Tracking for VR: Dataset and Results

This paper summarizes the OpenEDS 2020 Challenge dataset, the proposed baselines, and results obtained by the top three winners of each competition: (1) Gaze prediction Challenge, with the goal of predicting the gaze vector 1 to 5 frames into the future based on a sequence of previous eye images, and (2) Sparse Temporal Semantic Segmentation Challenge, with the goal of using temporal information to propagate semantic eye labels to contiguous eye image frames. Both competitions were based on the OpenEDS2020 dataset, a novel dataset of eye-image sequences captured at a frame rate of 100 Hz under controlled illumination, using a virtual-reality head-mounted display with two synchronized eye-facing cameras. The dataset, which we make publicly available for the research community, consists of 87 subjects performing several gaze-elicited tasks, and is divided into 2 subsets, one for each competition task. The proposed baselines, based on deep learning approaches, obtained an average angular error of 5.37 degrees for gaze prediction, and a mean intersection over union score (mIoU) of 84.1% for semantic segmentation. The winning solutions were able to outperform the baselines, obtaining up to 3.17 degrees for the former task and 95.2% mIoU for the latter.

Recent updates of eye movement abnormalities in patients with schizophrenia: A scoping review

AIM

Although eye-tracking technology expands beyond capturing eye data just for the sole purpose of ensuring participants maintain their gaze at the presented fixation cross, gaze technology remains of less importance in clinical research. Recently, impairments in visual information encoding processes indexed by novel gaze metrics have been frequently reported in patients with schizophrenia. This work undertakes a scoping review of research on saccadic dysfunctions and exploratory eye movement deficits among patients with schizophrenia. It gathers promising pieces of evidence of eye movement abnormalities in attention-demanding tasks on the schizophrenia spectrum that have mounted in recent years and their outcomes as potential biological markers.

METHODS

The protocol was drafted based on PRISMA for scoping review guidelines. Electronic databases were systematically searched to identify articles published between 2010 and 2020 that examined visual processing in patients with schizophrenia and reported eye movement characteristics as potential biomarkers for this mental illness.

RESULTS

The use of modern eye-tracking instrumentation has been reported by numerous neuroscientific studies to successfully and non-invasively improve the detection of visual information processing impairments among the screened population at risk of and identified with schizophrenia.

CONCLUSIONS

Eye-tracking technology has the potential to contribute to the process of early intervention and more apparent separation of the diagnostic entities, being put together by the syndrome-based approach to the diagnosis of schizophrenia. However, context-processing paradigms should be conducted and reported in equally accessible publications to build comprehensive models.

Modulation of saccade trajectories during sequential saccades

The planning and execution of sequential saccades can overlap in time, and abrupt changes in neural activity in the oculomotor system can alter the normal trajectory of saccades. In this study, we analyzed saccade trajectories to assess the combined programming of sequential saccades. In two separate psychophysical experiments, subjects were instructed to make a sequence of two saccades. The results showed modulation of saccade curvature by the direction and amplitude of both the preceding and following saccade: saccade curvature is modulated in the direction of preceding saccades and away from the direction of following saccades. Moreover, larger preceding and following saccades have stronger effects on curvature. These results support the idea that sequential saccades are programmed concurrently. Finally, the amount of saccade curvature is correlated with the deviation of saccade start and end points, and the time of maximum deviation of saccade trajectories is highly consistent in both experiments. Based on this, we propose a novel benefit for the modulation of saccade trajectories by the oculomotor system: minimizing the saccadic error in sequential saccades.NEW & NOTEWORTHY We show that in saccade sequences, saccade trajectory is modulated in the direction of the preceding saccade and away from the following saccade. The magnitude of this effect is correlated with preceding and following saccade amplitude. This confirms that programming of sequential saccades overlaps. Curvature is also correlated with the deviation of saccade start and end points. Thus, we propose a novel benefit for the modulation of saccade trajectories: minimizing end point error in sequential saccades.

Sounds are remapped across saccades

To achieve visual space constancy, our brain remaps eye-centered projections of visual objects across saccades. Here, we measured saccade trajectory curvature following the presentation of visual, auditory, and audiovisual distractors in a double-step saccade task to investigate if this stability mechanism also accounts for localized sounds. We found that saccade trajectories systematically curved away from the position at which either a light or a sound was presented, suggesting that both modalities are represented in eye-centered oculomotor centers. Importantly, the same effect was observed when the distractor preceded the execution of the first saccade. These results suggest that oculomotor centers keep track of visual, auditory and audiovisual objects by remapping their eye-centered representations across saccades. Furthermore, they argue for the existence of a supra-modal map which keeps track of multi-sensory object locations across our movements to create an impression of space constancy.

Learning to avoid looking: Competing influences of reward on overt attentional selection

Pairing a stimulus with large reward increases the likelihood that it will capture attention and eye-gaze, even when such capture has negative consequences. This suggests that a stimulus’s signalling relationship with reward (the co-occurrence of that stimulus and reward) has a powerful influence on attentional selection. In the present study, we demonstrate that a stimulus’s response relationship with reward (the reward-related consequences of attending to that stimulus) can also exert an independent, competing influence on selection. Participants completed a visual search task in which they made a saccade to a target shape to earn reward. The colour of a distractor signalled the magnitude of reward available on each trial. For one group of participants, there was a negative response relationship between making a saccade to the distractor and reward delivery: looking at the distractor caused the reward to be cancelled. For a second group, there was no negative response relationship, but an equivalent distractor–reward signalling relationship was maintained via a yoking procedure. Participants from both groups were more likely to have their gaze captured by the distractor that signalled high reward versus low reward, demonstrating an influence of the signalling relationship on attention. However, participants who experienced a negative response relationship showed a reduced influence of signal value on capture, and specifically less capture by the high-reward distractor. These findings demonstrate that reward can have a multifaceted influence on attentional selection through different, learned stimulus-reward relationships, and thus that the relationship between reward and attention is more complex than previously thought.

Graph-Based Analysis of Visual Scanning Patterns: A Developmental Study on Green and Normal Images

The present study investigated the visual scanning pattern of children with typical development in three different age groups(4-6,6-8,8-10 years old). We used a data set from one related research, which included images with different low-level features: Green and Normal. This study analyzed age-associated inter-individual differences and was intended to show that graph profiling combined with a fixation time approach could help us to better understand the developmental visual pattern. Thus, degree centrality as one of the graph theory measures was implied to analyze gaze distribution. We explored the influence of bottom-up features, comparing the first 2 s (early phase) with the interval from 4 to 6 s (late phase) of scene exploration during age development. Our results indicated that degree centrality and fixation time increased with age. Furthermore, it was found that the effects of saliency are short-lived but significant. Moreover, we found that Green images during the early phase play an important role in visual anchoring, and the children's performance was significantly different between 4-6 y and 6-8y-group. This comparative study underscores the ability of degree centrality as a developing innovative measure to perform eye-tracking data analyses.

Eye movement characteristics in schizophrenia: A recent update with clinical implications

Eye movements are indispensable for the collection of visual information in everyday life. Many findings regarding the neural basis of eye movements have been accumulated from neurophysiological and psychophysical studies. In the field of psychiatry, studies on eye movement characteristics in mental illnesses have been conducted since the early 1900s. Participants with schizophrenia are known to have characteristic eye movements during smooth pursuit, saccade control, and visual search. Recently, studies evaluating eye movement characteristics as biomarkers for schizophrenia have attracted considerable attention. In this article, we review the neurophysiological basis of eye movement control and eye movement characteristics in schizophrenia. Furthermore, we discuss the prospects for eye movements as biomarkers for mental illnesses.

The spatial dynamics of mouse-tracking reveal that attention capture is stimulus-driven rather than contingent upon top-down goals

There has been a longstanding debate over why stimuli capture attention. Some argue that capture is driven by stimulus salience, while others believe that capture only occurs when the features of a stimulus match what we are searching for. This debate has recently focused on attentional disengagement, with the stimulus-driven camp claiming that all salient stimuli capture attention but attention is quickly disengaged from items dissimilar from our target, producing little cost in terms of response time. We used mouse-tracking to examine the spatial effect of cues that either matched or mismatched an observer's target. Experiment 1 demonstrated that a cue mismatching the feature defining the target initially produced a spatial effect that was rapidly resolved, consistent with quick disengagement. Experiment 2 was a preregistered replication with double the sample size that replicated the results of Experiment 1. Overall, computer mouse-tracking provided a direct observation of attentional disengagement, supporting stimulus-driven capture. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Motoric Mechanisms for the Emergence of Non-local Phonological Patterns

Non-local phonological patterns can be difficult to analyze in the context of speech production models. Some patterns - e.g., vowel harmonies, nasal harmonies - can be readily analyzed to arise from temporal extension of articulatory gestures (i.e., spreading); such patterns can be viewed as articulatorily local. However, there are other patterns - e.g., nasal consonant harmony, laryngeal feature harmony - which cannot be analyzed as spreading; instead these patterns appear to enforce agreement between features of similar segments without affecting intervening segments. Indeed, there are numerous typological differences between spreading harmonies and agreement harmonies, and this suggests that there is a mechanistic difference in the ways that spreading and agreement harmonies arise. This paper argues that in order to properly understand spreading and agreement patterns, the gestural framework of Articulatory Phonology must be enriched with respect to how targets of the vocal tract are controlled in planning and production. Specifically, it is proposed that production models should distinguish between excitatory and inhibitory articulatory gestures, and that gestures which are below a selection threshold can influence the state of the vocal tract, despite not being active. These ideas are motivated by several empirical phenomena, which include anticipatory posturing before production of a word form, and dissimilatory interactions in distractor-target response paradigms. Based on these ideas, a model is developed which provides two distinct mechanisms for the emergence of non-local phonological patterns.

The temporal and spatial constraints of saccade planning to double-step target displacements

The double-step paradigm investigates the characteristics of planning and execution when the motor system must rapidly adjust for a new goal location. Studies have provided detailed temporal information based on the duration available for the motor system to prepare a new movement trajectory (here referred to as re-preparation time). However, previous work has largely examined single displacement sizes, limiting the spatiotemporal understanding of movement planning and execution. The lack of a description of this behavioral timecourse across increasing displacement sizes is true for saccades, rapid eye movements that redirect the fovea. Furthermore, during the double-step paradigm, the primary saccade often fails to accurately foveate the final target location and a secondary saccade brings the target onto the fovea. However, it is also unknown how this compensation is concurrently modified with the exposure duration and displacement of the movement goal. Here, we examined the amount of time required to change the initial saccade direction to a new target location for relatively small (20°, 30°, and 40°) and large (60° and 90°) target spatial separations. Interestingly, we found a clear relationship between the saccade direction and the amount of time allowed to redirect the movement; across separations, intermediate saccades occurred when approximately 60-140 ms was available to readjust the movement plan. Additionally, there was a consistent relationship between the timing of the secondary saccade and the re-preparation time across jump sizes, suggesting that concurrent movement correction planning was dependent on the amount of exposure to the final movement goal.

Classification of vestibular signs and examination techniques: Nystagmus and nystagmus-like movements

This paper presents a classification and definitions for types of nystagmus and other oscillatory eye movements relevant to evaluation of patients with vestibular and neurological disorders, formulated by the Classification Committee of the Bárány Society, to facilitate identification and communication for research and clinical care. Terminology surrounding the numerous attributes and influencing factors necessary to characterize nystagmus are outlined and defined. The classification first organizes the complex nomenclature of nystagmus around phenomenology, while also considering knowledge of anatomy, pathophysiology, and etiology. Nystagmus is distinguished from various other nystagmus-like movements including saccadic intrusions and oscillations.

View accompanying videos at http://www.jvr-web.org/ICVD.html

Associations and Dissociations between Oculomotor Readiness and Covert Attention

The idea that covert mental processes such as spatial attention are fundamentally dependent on systems that control overt movements of the eyes has had a profound influence on theoretical models of spatial attention. However, theories such as Klein’s Oculomotor Readiness Hypothesis (OMRH) and Rizzolatti’s Premotor Theory have not gone unchallenged. We previously argued that although OMRH/Premotor theory is inadequate to explain pre-saccadic attention and endogenous covert orienting, it may still be tenable as a theory of exogenous covert orienting. In this article we briefly reiterate the key lines of argument for and against OMRH/Premotor theory, then evaluate the Oculomotor Readiness account of Exogenous Orienting (OREO) with respect to more recent empirical data. These studies broadly confirm the importance of oculomotor preparation for covert, exogenous attention. We explain this relationship in terms of reciprocal links between parietal ‘priority maps’ and the midbrain oculomotor centres that translate priority-related activation into potential saccade endpoints. We conclude that the OMRH/Premotor theory hypothesis is false for covert, endogenous orienting but remains tenable as an explanation for covert, exogenous orienting.

Approach to the Examination and Classification of Nystagmus

BACKGROUND AND PURPOSE

Physical therapists caring for patients with neurologic or vestibular disorders must routinely examine and characterize nystagmus and other oscillatory eye movements. Often, the diagnosis hinges on proper interpretation of the nystagmus pattern. This requires understanding the terminology surrounding the numerous attributes and influencing factors of nystagmus, a systematic approach to the examination, and a classification structure that guides practitioners to the specific nystagmus type and subsequent evaluation and management.

SUMMARY OF KEY POINTS

Nystagmus is an involuntary, rapid, rhythmic, oscillatory eye movement with at least 1 slow phase. Jerk nystagmus has a slow phase and a fast phase. Pendular nystagmus has only slow phases. Nystagmus is distinguished from other types of oscillatory eye movements, such as saccadic intrusions or oscillations. Characterizing nystagmus requires clearly describing its trajectory. This includes choosing a reference frame to describe the axes or planes and direction of eye movements. Several attributes are used to describe nystagmus: binocularity, conjugacy, velocity, waveform, frequency, amplitude, intensity, temporal profile, and age at first appearance. Several factors may influence nystagmus, including gaze position, visual fixation, vergence, and a variety of provocative maneuvers. Classification of nystagmus may be organized by physiologic or pathologic nystagmus versus other nystagmus-like movements. Pathologic nystagmus may be spontaneous, gaze-evoked, or triggered by provocative maneuvers. The combination of attributes allows differentiation between the many peripheral and central forms.

RECOMMENDATIONS FOR CLINICAL PRACTICE

Therapists should carefully examine and characterize the trajectory and other attributes and influencing factors of nystagmus to accurately classify it and arrive at the correct diagnosis.

Gaze Trajectory Index (GTI): A novel metric to quantify saccade trajectory deviation using eye tracking

BACKGROUND

Many different indexes have been proposed to quantify saccade curvature based on geometric properties of the saccade trajectory projected on the 2D plane. We introduce the Gaze Trajectory Index (GTI), a novel metric to quantify saccade trajectory deviation based on calculation of the rotational eye movements performed in 3D space while following a 2D saccade trajectory recorded with eye tracking (ET).

METHODS

We provided a description of GTI calculation. In 13 subjects with normal binocular vision we assessed GTI in single-target tests, then we evaluated GTI against previously proposed metrics (Maximum Deviation,MD; Area Curvature,AC; Quadratic Curvature,QC; Initial Direction,ID) using a distractor paradigm that elicited two types of saccade deviations, i.e."inner-curved" and "outer-curved" saccades.

RESULTS

In single-target tests GTI showed that saccade curvature was significantly higher for oblique than for vertical saccades (0.86°±0.32 vs 0.55°±0.60,p < 0.05) and higher for vertical than for horizontal saccades (0.55°±0.60 vs 0.23°±0.17,p < 0.05), in accordance with previous studies. In distractor-based tests, for inner-curved saccades, GTI strongly correlated with MD (r = 0.965,p < 0.01), AC (r = 0.940,p < 0.01), QC (r = 0.866,p < 0.01), and Principal Component Analysis (PCA) confirmed that all these metrics reflect the same underlying phenomenon. For outer-curved trajectories, GTI showed poor correlation with MD and AC (r = 0.291 and 0.416,p < 0.01), however PCA included the three metrics in the same first component group. For outer-curved trajectories, GTI was the only metric showing strong correlation (r = 0.950,p < 0.05) with the overshoot degree of the trajectory.

CONCLUSION

The novel GTI seems to have adjunctive potential, particularly for outer-curved trajectories, in the estimation of the absolute amount of saccade trajectory deviation.

When Watching Video, Many Saccades Are Curved and Deviate From a Velocity Profile Model

Commonly, saccades are thought to be ballistic eye movements, not modified during flight, with a straight path and a well-described velocity profile. However, they do not always follow a straight path and studies of saccade curvature have been reported previously. In a prior study, we developed a real-time, saccade-trajectory prediction algorithm to improve the updating of gaze-contingent displays and found that saccades with a curved path or that deviated from the expected velocity profile were not well fit by our saccade-prediction algorithm (velocity-profile deviation), and thus had larger updating errors than saccades that had a straight path and had a velocity profile that was fit well by the model. Further, we noticed that the curved saccades and saccades with high velocity-profile deviations were more common than we had expected when participants performed a natural-viewing task. Since those saccades caused larger display updating errors, we sought a better understanding of them. Here we examine factors that could affect curvature and velocity profile of saccades using a pool of 218,744 saccades from 71 participants watching “Hollywood” video clips. Those factors included characteristics of the participants (e.g., age), of the videos (importance of faces for following the story, genre), of the saccade (e.g., magnitude, direction), time during the session (e.g., fatigue) and presence and timing of scene cuts. While viewing the video clips, saccades were most likely horizontal or vertical over oblique. Measured curvature and velocity-profile deviation had continuous, skewed frequency distributions. We used mixed-effects regression models that included cubic terms and found a complex relationship between curvature, velocity-profile deviation and saccade duration (or magnitude). Curvature and velocity-profile deviation were related to some video-dependent features such as lighting, face presence, or nature and human figure content. Time during the session was a predictor for velocity profile deviations. Further, we found a relationship for saccades that were in flight at the time of a scene cut to have higher velocity-profile deviations and lower curvature in univariable models. Saccades characteristics vary with a variety of factors, which suggests complex interactions between oculomotor control and scene content that could be explored further.

Measuring visual attention to faces with cleft deformity

BACKGROUND

Limited data are available regarding observers' visual attention to faces with congenital difference. We implemented eye tracking technology to examine this issue, as it pertains particularly to faces with cleft deformity.

METHOD

Four hundred three observers assessed 273 clinical images, while their eye movements were unobtrusively tracked using an infrared sensor. Forty-one facial images of the repaired cleft lip, 137 images of other facial conditions, and 95 images of matched controls were assessed. Twenty facial regions of interest ("lookzones") were considered for all images observed. A separate cohort of 720 raters evaluated the images for attractiveness. Observer and image demographic information was collected. Visual fixation counts and durations were computed across all 20 lookzones for all images. The effect of a variety of variables on lookzone fixation was analyzed using factorial ANOVA testing.

RESULTS

Cleft-repaired faces were rated as less attractive and drew observers' attention preferentially to the affected upper lip lookzone (p<.001). Images rated as less attractive garnered greater visual attention in the cleft-affected lookzones (p<.001). The eye tracking methodology demonstrated exquisite sensitivity to laterality of cleft deformity (p<.001). Individuals reporting a personal or a family history of facial deformity fixated more on the perioral region of cleft-repaired faces than did naïve observers (p<.001).

CONCLUSION

These findings highlight the utility of eye tracking measures for understanding critical variables that influence the visual processing of faces with cleft deformity. The data may provide analytical tools for assessing surgical outcome and direct priority setting during surgeons' conversations with patients.

Trypophobic images induce oculomotor capture and inhibition

It is known that unpleasant images capture our attention. However, the causes of the emotions evoked by these images can vary. Trypophobia is the fear of clustered objects. A recent study claimed that this phobia is elicited by the specific power spectrum of such images. In the present study, we measured saccade trajectories to examine how trypophobic images possessing a characteristic power spectrum affect visual attention. The participants' task was to make a saccade in the direction that was indicated by a cue. Four irrelevant images with different emotional content were presented as periphery distractors at 0 ms, 150 ms, and 450 ms in terms of cue-image onset asynchrony. The irrelevant images consisted of trypophobic, fearful, or neutral scenes. The presence of saccade trajectory deviations induced by trypophobic images suggest that intact trypophobic images oriented attention to their location. Moreover, when the images were phase scrambled, the saccade curved away from the trypophobic images, suggesting that trypophobic power spectra also triggered attentional capture, which was weak and then led to inhibition. These findings suggest that not only the power spectral characteristics but also the gist of a trypophobic image affect attentional deployment.

Salience drives overt selection of two equally relevant visual targets

In the present study, we investigated whether salience determines the sequence of selection when participants search for two equally relevant visual targets. To do this, attentional selection was tracked overtly as observers inspected two items of differing physical salience: one a highly salient color singleton, and the other a less salient shape singleton. Participants were instructed to make natural eye movements in order to determine whether two line segments contained within the two singletons were oriented in the same or in different directions. Because both singleton items were task-relevant, participants had no reason to inspect one item before the other. As expected, observers fixated both targets on the majority of trials. Critically, saccades to the color singleton preceded saccades to the less salient shape singleton on the majority of trials. This demonstrates that the order of attentional object selection is largely determined by stimulus salience when task relevance is equated.

Luminance gradient at object borders communicates object location to the human oculomotor system

The locations of objects in our environment constitute arguably the most important piece of information our visual system must convey to facilitate successful visually guided behaviour. However, the relevant objects are usually not point-like and do not have one unique location attribute. Relatively little is known about how the visual system represents the location of such large objects as visual processing is, both on neural and perceptual level, highly edge dominated. In this study, human observers made saccades to the centres of luminance defined squares (width 4 deg), which appeared at random locations (8 deg eccentricity). The phase structure of the square was manipulated such that the points of maximum luminance gradient at the square's edges shifted from trial to trial. The average saccade endpoints of all subjects followed those shifts in remarkable quantitative agreement. Further experiments showed that the shifts were caused by the edge manipulations, not by changes in luminance structure near the centre of the square or outside the square. We conclude that the human visual system programs saccades to large luminance defined square objects based on edge locations derived from the points of maximum luminance gradients at the square's edges.

Saccades and reaches curve away from the other effector’s target in simultaneous eye and hand movements

Simultaneous eye and hand movements are highly coordinated and tightly coupled. This raises the question whether the selection of eye and hand targets relies on a shared attentional mechanism or separate attentional systems. Previous studies have revealed conflicting results by reporting evidence for both a shared as well as separate systems. Movement properties such as movement curvature can provide novel insights into this question as they provide a sensitive measure for attentional allocation during target selection. In the current study, participants performed simultaneous eye and hand movements to the same or different visual target locations. We show that both saccade and reaching movements curve away from the other effector’s target location when they are simultaneously performed to spatially distinct locations. We argue that there is a shared attentional mechanism involved in selecting eye and hand targets that may be found on the level of effector-independent priority maps.

NEW & NOTEWORTHY Movement properties such as movement curvature have been widely neglected as important sources of information in investigating whether the attentional systems underlying target selection for eye and hand movements are separate or shared. We convincingly show that movement curvature is influenced by the other effector’s target location in simultaneous eye and hand movements to spatially distinct locations. Our results provide evidence for shared attentional systems involved in the selection of saccade and reach targets.

Effects of central and peripheral cueing on perceptual and saccade performance

Previous research on the spatiotemporal dynamics of exogenous and endogenous attentional allocation during saccade preparation yielded conflicting results. We hypothesize that this can be explained by the cueing type used to orient attention in a perceptual task. We investigated the time-course of attentional allocation as a function of cueing type (central vs peripheral), spatial congruency of the cued perceptual and saccade task locations, and cue validity in a dual-task paradigm. Participants performed a visual discrimination task during saccade preparation. We found that central and peripheral cues differentially affected the time-course of attentional allocation depending on spatial congruency and cue validity. Peripheral cues quickly and transiently oriented attention to the cued location. In the congruent condition, attention was maintained by the pre-saccadic attention shift, but declined in the spatially incongruent condition. Central cues slowly oriented attention to the cued location. In the congruent condition, attention was boosted by the pre-saccadic attention shift compared to a slower increase in the spatially incongruent condition. The pre-saccadic attention shift - the automatic and obligatory shift of attention to the saccade target - observed in the invalid spatially incongruent condition was not differentially affected by the cueing type orienting attention away from it. Our results suggest that exogenous and endogenous attention is dynamically and flexibly allocated to cued locations during saccade preparation while pre-saccadic attentional resources are progressively shifted to the saccade target irrespective of the cueing type. We argue that attentional selection for perception represents a partially independent process in contrast to the pre-saccadic attention shift.

Attention modulates trans-saccadic integration

With every saccade, humans must reconcile the low resolution peripheral information available before a saccade, with the high resolution foveal information acquired after the saccade. While research has shown that we are able to integrate peripheral and foveal vision in a near-optimal manner, it is still unclear which mechanisms may underpin this important perceptual process. One potential mechanism that may moderate this integration process is visual attention. Pre-saccadic attention is a well documented phenomenon, whereby visual attention shifts to the location of an upcoming saccade before the saccade is executed. While it plays an important role in other peri-saccadic processes such as predictive remapping, the role of attention in the integration process is as yet unknown. This study aimed to determine whether the presentation of an attentional distractor during a saccade impaired trans-saccadic integration, and to measure the time-course of this impairment. Results showed that presenting an attentional distractor impaired integration performance both before saccade onset, and during the saccade, in selected subjects who showed integration in the absence of a distractor. This suggests that visual attention may be a mechanism that facilitates trans-saccadic integration.

Inhibition in movement plan competition: reach trajectories curve away from remembered and task-irrelevant present but not from task-irrelevant past visual stimuli

The current study investigated the role of automatic encoding and maintenance of remembered, past, and present visual distractors for reach movement planning. The previous research on eye movements showed that saccades curve away from locations actively kept in working memory and also from task-irrelevant perceptually present visual distractors, but not from task-irrelevant past distractors. Curvature away has been associated with an inhibitory mechanism resolving the competition between multiple active movement plans. Here, we examined whether reach movements underlie a similar inhibitory mechanism and thus show systematic modulation of reach trajectories when the location of a previously presented distractor has to be (a) maintained in working memory or (b) ignored, or (c) when the distractor is perceptually present. Participants performed vertical reach movements on a computer monitor from a home to a target location. Distractors appeared laterally and near or far from the target (equidistant from central fixation). We found that reaches curved away from the distractors located close to the target when the distractor location had to be memorized and when it was perceptually present, but not when the past distractor had to be ignored. Our findings suggest that automatically encoding present distractors and actively maintaining the location of past distractors in working memory evoke a similar response competition resolved by inhibition, as has been previously shown for saccadic eye movements.

Conditional control in visual selection

Attention and eye movements provide a window into the selective processing of visual information. Evidence suggests that selection is influenced by various factors and is not always under the strategic control of the observer. The aims of this tutorial review are to give a brief introduction to eye movements and attention and to outline the conditions that help determine control. Evidence suggests that the ability to establish control depends on the complexity of the display as well as the point in time at which selection occurs. Stimulus-driven selection is more probable in simple displays than in complex natural scenes, but it critically depends on the timing of the response: Salience determines selection only when responses are triggered quickly following display presentation, and plays no role in longer-latency responses. The time course of selection is also important for the relationship between attention and eye movements. Specifically, attention and eye movements appear to act independently when oculomotor selection is quick, whereas attentional processes are able to influence oculomotor control when saccades are triggered only later in time. This relationship may also be modulated by whether the eye movement is controlled in a voluntary or an involuntary manner. To conclude, we present evidence that shows that visual control is limited in flexibility and that the mechanisms of selection are constrained by context and time. The outcome of visual selection changes with the situational context, and knowing the constraints of control is necessary to understanding when and how visual selection is truly controlled by the observer.