The time course of presaccadic attention shifts

Presaccadic preview shapes postsaccadic processing more where perception is poor

The presaccadic preview of a peripheral target enhances the efficiency of its postsaccadic processing, termed the extrafoveal preview effect. Peripheral visual performance-and thus the quality of the preview-varies around the visual field, even at isoeccentric locations: It is better along the horizontal than vertical meridian and along the lower than upper vertical meridian. To investigate whether these polar angle asymmetries influence the preview effect, we asked human participants to preview four tilted gratings at the cardinals, until a central cue indicated which one to saccade to. During the saccade, the target orientation either remained or slightly changed (valid/invalid preview). After saccade landing, participants discriminated the orientation of the (briefly presented) second grating. Stimulus contrast was titrated with adaptive staircases to assess visual performance. Expectedly, valid previews increased participants' postsaccadic contrast sensitivity. This preview benefit, however, was inversely related to polar angle perceptual asymmetries; largest at the upper, and smallest at the horizontal meridian. This finding reveals that the visual system compensates for peripheral asymmetries when integrating information across saccades, by selectively assigning higher weights to the less-well perceived preview information. Our study supports the recent line of evidence showing that perceptual dynamics around saccades vary with eye movement direction.

Saccade size predicts onset time of object processing during visual search of an open world virtual environment

OBJECTIVE

To date the vast majority of research in the visual neurosciences have been forced to adopt a highly constrained perspective of the vision system in which stimuli are processed in an open-loop reactive fashion (i.e., abrupt stimulus presentation followed by an evoked neural response). While such constraints enable high construct validity for neuroscientific investigation, the primary outcomes have been a reductionistic approach to isolate the component processes of visual perception. In electrophysiology, of the many neural processes studied under this rubric, the most well-known is, arguably, the P300 evoked response. There is, however, relatively little known about the real-world corollary of this component in free-viewing paradigms where visual stimuli are connected to neural function in a closed-loop. While growing evidence suggests that neural activity analogous to the P300 does occur in such paradigms, it is an open question when this response occurs and what behavioral or environmental factors could be used to isolate this component.

APPROACH

The current work uses convolutional networks to decode neural signals during a free-viewing visual search task in a closed-loop paradigm within an open-world virtual environment. From the decoded activity we construct fixation-locked response profiles that enable estimations of the variable latency of any P300 analogue around the moment of fixation. We then use these estimates to investigate which factors best reduce variable latency and, thus, predict the onset time of the response. We consider measurable, search-related factors encompassing top-down (i.e., goal driven) and bottom-up (i.e., stimulus driven) processes, such as fixation duration and salience. We also consider saccade size as an intermediate factor reflecting the integration of these two systems.

MAIN RESULTS

The results show that of these factors only saccade size reliably determines the onset time of P300 analogous activity for this task. Specifically, we find that for large saccades the variability in response onset is small enough to enable analysis using traditional ensemble averaging methods.

SIGNIFICANCE

The results show that P300 analogous activity does occur during closed-loop, free-viewing visual search while highlighting distinct differences between the open-loop version of this response and its real-world analogue. The results also further establish saccades, and saccade size, as a key factor in real-world visual processing.

Training enables substantial decoupling of visual attention and saccade preparation

Visual attention is typically shifted toward the targets of upcoming saccadic eye movements. This observation is commonly interpreted in terms of an obligatory coupling between attentional selection and oculomotor programming. Here, we investigated whether this coupling is facilitated by a habitual expectation of spatial congruence between visual and motor targets. To this end, we conducted a dual-task (i.e., concurrent saccade task and visual discrimination task) experiment in which male and female participants were trained to either anticipate spatial congruence or incongruence between a saccade target and an attention probe stimulus. To assess training-induced effects of expectation on premotor attention allocation, participants subsequently completed a test phase in which the attention probe position was randomized. Results revealed that discrimination performance was systematically biased toward the expected attention probe position, irrespective of whether this position matched the saccade target or not. Overall, our findings demonstrate that visual attention can be substantially decoupled from ongoing oculomotor programming and suggest an important role of habitual expectations in the attention-action coupling.

Pre-saccadic Preview Shapes Post-Saccadic Processing More Where Perception is Poor

The pre-saccadic preview of a peripheral target enhances the efficiency of its post-saccadic processing, termed the extrafoveal preview effect. Peripheral visual performance -and thus the quality of the preview- varies around the visual field, even at iso-eccentric locations: it is better along the horizontal than vertical meridian and along the lower than upper vertical meridian. To investigate whether these polar angle asymmetries influence the preview effect, we asked human participants (to preview four tilted gratings at the cardinals, until a central cue indicated to which one to saccade. During the saccade, the target orientation either remained or slightly changed (valid/invalid preview). After saccade landing, participants discriminated the orientation of the (briefly presented) second grating. Stimulus contrast was titrated with adaptive staircases to assess visual performance. Expectedly, valid previews increased participants' post-saccadic contrast sensitivity. This preview benefit, however, was inversely related to polar angle perceptual asymmetries; largest at the upper, and smallest at the horizontal meridian. This finding reveals that the visual system compensates for peripheral asymmetries when integrating information across saccades, by selectively assigning higher weights to the less-well perceived preview information. Our study supports the recent line of evidence showing that perceptual dynamics around saccades vary with eye movement direction.

What can evidence accumulation modelling tell us about human social cognition?

Evidence accumulation models are a series of computational models that provide an account for speeded decision-making. These models have been used extensively within the cognitive psychology literature to great success, allowing inferences to be drawn about the psychological processes that underlie cognition that are sometimes not available in a traditional analysis of accuracy or reaction time (RT). Despite this, there have been only a few applications of these models within the domain of social cognition. In this article, we explore several ways in which the study of human social information processing would benefit from application of evidence accumulation modelling. We begin first with a brief overview of the evidence accumulation modelling framework and their past success within the domain of cognitive psychology. We then highlight five ways in which social cognitive research would benefit from an evidence accumulation approach. This includes (1) greater specification of assumptions, (2) unambiguous comparisons across blocked task conditions, (3) quantifying and comparing the magnitude of effects in standardised measures, (4) a novel approach for studying individual differences, and (5) improved reproducibility and accessibility. These points are illustrated using examples from the domain of social attention. Finally, we outline several methodological and practical considerations, which should help researchers use evidence accumulation models productively. Ultimately, it will be seen that evidence accumulation modelling offers a well-developed, accessible, and commonly understood framework that can reveal inferences about cognition that may otherwise be out of reach in a traditional analysis of accuracy and RT. This approach, therefore, has the potential to substantially revise our understanding of social cognition.

Pre-saccadic shifts of attention in individuals diagnosed with schizophrenia

INTRODUCTION

Pathophysiological theories of schizophrenia (SZ) symptoms posit an abnormality in using predictions to guide behavior. One such prediction is based on imminent movements, via corollary discharge signals (CD) that relay information about planned movement kinematics to sensory brain regions. Empirical evidence suggests a reduced influence of sensorimotor predictions in individuals with SZ within multiple sensory systems, including in the visual system. One function of CD in the visual system is to selectively enhance visual sensitivity at the location of planned eye movements (pre-saccadic attention), thus enabling a prediction of the to-be-foveated stimulus. We expected pre-saccadic attention shifts to be less pronounced in individuals with SZ than in healthy controls (HC), resulting in unexpected sensory consequences of eye movements, which may relate to symptoms than can be explained in the context of altered allocation of attention.

METHODS

We examined this question by testing 30 SZ and 30 HC on a pre-saccadic attention task. On each trial participants made a saccade to a cued location in an array of four stimuli. A discrimination target that was either congruent or incongruent with the cued location was briefly presented after the cue, during saccade preparation. Pre-saccadic attention was quantified by comparing accuracy on congruent trials to incongruent trials within the interval preceding the saccade.

RESULTS

Although SZs were less accurate overall, the magnitude of the pre-saccadic attention effect generally did not differ across groups nor show a convincing relationship with symptom severity. We did, however, observe that SZ had reduced pre-saccadic attention effects when the discrimination target (probe) was presented at early stages of saccade planning, when pre-saccadic attention effects first emerged in HC.

CONCLUSION

These findings suggest generally intact pre-saccadic shifts of attention in SZ, albeit slightly delayed. Results contribute to our understanding of altered sensory predictions in people with schizophrenia.

Transient attention does not alter the eccentricity effect in estimation of duration

Previous research investigating the influence of stimulus eccentricity on perceived duration showed an increasing duration underestimation with increasing eccentricity. Based on studies showing that precueing the stimulus location prolongs perceived duration, one might assume that this eccentricity effect is influenced by spatial attention. In the present study, we assessed the influence of transient covert attention on the eccentricity effect in duration estimation in two experiments, one online and one in a laboratory setting. In a duration estimation task, participants judged whether a comparison stimulus presented near or far from fixation with a varying duration was shorter or longer than a standard stimulus presented foveally with a constant duration. To manipulate transient covert attention, either a transient luminance cue was used (valid cue) to direct attention to the position of the subsequent peripheral comparison stimulus or all positions were marked by luminance (neutral cue). Results of both experiments yielded a greater underestimation of duration for the far than for the near stimulus, replicating the eccentricity effect. Although cueing was effective (i.e., shorter response latencies for validly cued stimuli), cueing did not alter the eccentricity effect on estimation of duration. This indicates that cueing leads to covert attentional shifts but does not account for the eccentricity effect in perceived duration.

Pre-saccadic Neural Enhancements in Marmoset Area MT

Each time we make an eye movement, attention moves before the eyes, resulting in a perceptual enhancement at the target. Recent psychophysical studies suggest that this pre-saccadic attention enhances the visual features at the saccade target, whereas covert attention causes only spatially selective enhancements. While previous nonhuman primate studies have found that pre-saccadic attention does enhance neural responses spatially, no studies have tested whether changes in neural tuning reflect an automatic feature enhancement. Here we examined pre-saccadic attention using a saccade foraging task developed for marmoset monkeys (one male and one female). We recorded from neurons in the middle temporal area with peripheral receptive fields that contained a motion stimulus, which would either be the target of a saccade or a distracter as a saccade was made to another location. We established that marmosets, like macaques, show enhanced pre-saccadic neural responses for saccades toward the receptive field, including increases in firing rate and motion information. We then examined if the specific changes in neural tuning might support feature enhancements for the target. Neurons exhibited diverse changes in tuning but predominantly showed additive and multiplicative increases that were uniformly applied across motion directions. These findings confirm that marmoset monkeys, like macaques, exhibit pre-saccadic neural enhancements during saccade foraging tasks with minimal training requirements. However, at the level of individual neurons, the lack of feature-tuned enhancements is similar to neural effects reported during covert spatial attention.

Alterations to foveal crowding with microsaccade preparation

Visual stimuli presented around the time of a saccade have been shown to be perceived differently by the visual system, including a reduction in the harmful impact of flankers (crowding). However, whether the effects observed are due strictly to crowding remains controversial, and the effects have only been measured with large saccades in peripheral vision. Here we investigate how crowded stimuli placed 20 arc minutes from the center of gaze are affected by an upcoming microsaccade. The stimulus consisted of a rotated T of size 6.25 arcminutes that was either unflanked, surrounded by four flankers (Experiment 1), or surrounded by two flankers that were positioned either radially or tangentially (Experiments 2 and 3). In 80 % of trials, subjects made voluntary microsaccades to the target when cued, and in the remaining 20 % of the trials subjects continued to maintain fixation. In Experiments 1 and 2, subjects were required to saccade to the same location as the target, while in Experiment 3 subjects saccaded to a different location ∼ 20 arc min to the upper left of the target. Thus, we provide evidence for two separable pre-saccadic benefits for crowded parafoveal targets: one isotropizes the crowding zone for stimuli presented 200 to 125 ms before microsaccadic onset, and another provides a benefit exclusively for microsaccade targets surrounded by tangential flankers in the presence of imminent microsaccades. Two possible mechanisms are attentional enhancement and predictive remapping of receptive fields, respectively.

Looking away to see: The acquisition of a search habit away from the saccade direction

Growing evidence has shown that attention can be habit-like, unconsciously and persistently directed toward locations that have frequently contained search targets in the past. The attentional preference typically arises when the eye gaze aligns with the attended location. Here we tested whether this spatial alignment is necessary for the acquisition of a search habit. To divert eye movements away from an attended location, we used gaze-contingent eye tracking, restricting the visible portion of the screen to an area opposite to the current gaze. Participants searched for a T target amidst a circular array of L distractors. Unbeknownst to them, the target appeared more frequently in one screen quadrant. Despite fixating on a location diametrically opposite to the visible, attended region, participants acquired probability cuing, producing quicker responses when the target appeared in the high-probability quadrant. They also showed a speed advantage in the diagonal quadrant. The attentional preference for the high-probability quadrant persisted during a testing phase in which the target's location was unbiased, but only when participants continued to search with the restricted view. These results indicate that a search habit can be acquired even when participants are required to look away from the high-probability locations. The finding suggests that the learned search habit is not solely a result of oculomotor learning.

Dissociable roles of human frontal eye fields and early visual cortex in presaccadic attention

Shortly before saccadic eye movements, visual sensitivity at the saccade target is enhanced, at the expense of sensitivity elsewhere. Some behavioral and neural correlates of this presaccadic shift of attention resemble those of covert attention, deployed during fixation. Microstimulation in non-human primates has shown that presaccadic attention modulates perception via feedback from oculomotor to visual areas. This mechanism also seems plausible in humans, as both oculomotor and visual areas are active during saccade planning. We investigated this hypothesis by applying TMS to frontal or visual areas during saccade preparation. By simultaneously measuring perceptual performance, we show their causal and differential roles in contralateral presaccadic attention effects: Whereas rFEF+ stimulation enhanced sensitivity opposite the saccade target throughout saccade preparation, V1/V2 stimulation reduced sensitivity at the saccade target only shortly before saccade onset. These findings are consistent with presaccadic attention modulating perception through cortico-cortical feedback and further dissociate presaccadic and covert attention.

The role of color in transsaccadic object correspondence

With each saccade, visual information is disrupted, and the visual system is tasked with establishing object correspondence between the presaccadic and postsaccadic representations of the saccade target. There is substantial evidence that the visual system consults spatiotemporal continuity when determining object correspondence across saccades. The evidence for surface feature continuity, however, is mixed. Surface features that are integral to the saccade target object's identity (e.g., shape and contrast polarity) are informative of object continuity, but features that may only imply the state of the object (e.g., orientation) are ignored. The present study tested whether color information is consulted to determine transsaccadic object continuity. We used two variations of the intrasaccadic target displacement task. In Experiments 1 and 2, participants reported the direction of the target displacement. In Experiments 3 and 4, they instead reported whether they detected any target movement. In all experiments, we manipulated the saccade target's continuity by removing it briefly (i.e., blanking) and by changing its color. We found that large color changes can disrupt stability and increase sensitivity to displacements for both direction and movement reports, although not as strongly as long blank durations (250 ms). Interestingly, even smaller color changes, but not blanking, reduced response biases. These results indicate that disrupting surface feature continuity may impact the process of transsaccadic object correspondence more strongly than spatiotemporal disruptions by both increasing the sensitivity and decreasing the response bias.

Dissociable roles of human frontal eye fields and early visual cortex in presaccadic attention - evidence from TMS

Shortly before each saccadic eye movement, presaccadic attention improves visual sensitivity at the saccade target 1-5 at the expense of lowered sensitivity at non-target locations 6-11 . Some behavioral and neural correlates of presaccadic attention and covert attention -which likewise enhances sensitivity, but during fixation 12 -are similar 13 . This resemblance has led to the debatable 13-18 notion that presaccadic and covert attention are functionally equivalent and rely on the same neural circuitry 19-21 . At a broad scale, oculomotor brain structures (e.g., FEF) are also modulated during covert attention 22-24 - yet by distinct neuronal subpopulations 25-28 . Perceptual benefits of presaccadic attention rely on feedback from oculomotor structures to visual cortices 29,30 ( Fig. 1a ); micro-stimulation of FEF in non-human primates affects activity in visual cortex 31-34 and enhances visual sensitivity at the movement field of the stimulated neurons 35-37 . Similar feedback projections seem to exist in humans: FEF+ activation precedes occipital activation during saccade preparation 38,39 and FEF TMS modulates activity in visual cortex 40-42 and enhances perceived contrast in the contralateral hemifield 40 . We investigated presaccadic feedback in humans by applying TMS to frontal or visual areas during saccade preparation. By simultaneously measuring perceptual performance, we show the causal and differential roles of these brain regions in contralateral presaccadic benefits at the saccade target and costs at non-targets: Whereas rFEF+ stimulation reduced presaccadic costs throughout saccade preparation, V1/V2 stimulation reduced benefits only shortly before saccade onset. These effects provide causal evidence that presaccadic attention modulates perception through cortico-cortical feedback and further dissociate presaccadic and covert attention.

Selectivity for local orientation information in visual mirror symmetry perception

Mirror symmetry is a global percept formed from specific arrangements of matching local information. It has been shown that some features of this local information can interact with the global percept, interfering with symmetry perception. One such feature is orientation; it is well established that the orientation of the symmetry axis has a significant impact on symmetry perception, but the role of local orientation of individual elements is still equivocal. Some studies have argued for no role of local orientation in symmetry perception, while other studies have shown a detrimental effect of certain local orientation combinations. Using dynamic stimuli composed of oriented Gabor elements with increasing temporal delay (SOA) between the onset of the first and second element in a symmetric pair, we systematically map how orientation variation within and between symmetric pairs affected the temporal integration of symmetric patterns in five observers. This method allows consideration of both sensitivity to symmetry (threshold, or T₀) as well as the duration of visible persistence of each condition through the visual system (P). Our results show a clear role for local orientation in symmetry perception and highlight the importance of local orientation in symmetry perception. Our findings reinforce the need for more nuanced perceptual models incorporating local element orientation, which is currently unaccounted for.

Pre-saccadic attention relies more on suppression than does covert attention

During covert and pre-saccadic attentional shifts, it is unclear how facilitation and suppression processes interact for target selection. A recent countermanding task pointed to greater suppression at unattended locations during trials with saccades compared to trials without saccades (i.e., fixation and successful stop trials), whereas target facilitation did not differ. It is unknown whether this finding is restricted to countermanding paradigms that involve inhibitory processes. To test this, we adapted Gaspelin and colleagues (2015)'s attention capture task where, within the same block, one location was primed with frequent line discrimination trials, and all locations were occasionally probed using letters report trials. Participants also performed a baseline condition without priming. We tested 15 participants and examined how performance at non-primed locations was affected by covert versus pre-saccadic attention in blocks of four or six items, as well as by position from the primed location and timing from saccade onset. For both attention conditions, letter report at non-primed locations was worse compared to baseline, demonstrating suppression, and letter report at primed location was better, demonstrating facilitation. In saccades trials, letter report was better at primed locations and worse at non-primed locations compared to fixation trials. The timing of this additional pre-saccadic suppression differed from saccadic suppression. In both attention conditions, suppression was greater when primed and non-primed locations were within the same hemifield or in diagonal opposite quadrants. These results confirmed that attention preceding saccade execution suppressed non-primed locations to a larger extent than covert attention, with the same spatial quadrant effect.

Development and validation of a new methodological platform to measure behavioral, cognitive, and physiological responses to food interventions in real time

To fully understand the causes and mechanisms involved in overeating and obesity, measures of both cognitive and physiological determinants of eating behavior need to be integrated. Effectively synchronizing behavioral measures such as meal micro-structure (e.g., eating speed), cognitive processing of sensory stimuli, and metabolic parameters, can be complex. However, this step is central to understanding the impact of food interventions on body weight. In this paper, we provide an overview of the existing gaps in eating behavior research and describe the development and validation of a new methodological platform to address some of these issues. As part of a controlled trial, 76 men and women self-served and consumed food from a buffet, using a portion-control plate with visual stimuli for appropriate amounts of main food groups, or a conventional plate, on two different days, in a random order. In both sessions participants completed behavioral and cognitive tests using a novel methodological platform that measured gaze movement (as a proxy for visual attention), eating rate and bite size, memory for portion sizes, subjective appetite and portion-size perceptions. In a sub-sample of women, hormonal secretion in response to the meal was also measured. The novel platform showed a significant improvement in meal micro-structure measures from published data (13 vs. 33% failure rate) and high comparability between an automated gaze mapping protocol vs. manual coding for eye-tracking studies involving an eating test (ICC between methods 0.85; 90% CI 0.74, 0.92). This trial was registered at Clinical Trials.gov with Identifier NCT03610776.

Temporal order judgments and presaccadic shifts of attention: What can prior entry teach us about the premotor theory?

A temporal order judgment (TOJ) 2-alternative forced choice design was used to examine presaccadic shifts of attention. Prior work on the premotor theory of attention (PTA) has predominantly focused on single-target discrimination tasks as a tool to measure accuracy and shifts of attention. It is important to demonstrate that the PTA is effective across attentional tasks that have been shown to be reliable in other contexts. Therefore, it was decided to use a perceptual task that probes multiple locations simultaneously and can equally be used to examine spatial spread of attention in more detail. In typical TOJ studies, prior entry is the metric used to measure an attentional effect. Prior entry is the biasing of temporal perception toward an attentionally cued location. This generally manifests as observers processing events at the cued location more rapidly, altering their perspective of temporal order. Participants were required to prepare saccades toward one of four targets, two of which would light up either synchronously or sequentially after a GO signal but before saccadic execution. Results demonstrated that in conditions with critical stimulus onset asynchronies, saccade preparation had a significant effect on performance. Prior entry effects were observed at saccade congruent locations with probes at these locations being typically perceived earlier than probes presented at a neutral location. These effects were not observed in control trials without a saccade. A further spatial effect was demonstrated for the attentional modulation, suggesting that this effect is restricted predominantly to horizontal configurations. Overall, results demonstrated that presaccadic attention is effective at eliciting a prior entry effect in TOJ designs and that such effects are more pronounced when the probes are distributed across the two lateral hemifields.

Structural and functional MRI evidence for significant contribution of precentral gyrus to flexible oculomotor control: evidence from the antisaccade task

Antisaccade task requires inhibition of a prepotent prosaccade to a peripheral target and initiation of a saccade to the opposite location, and, therefore, is used as a tool to investigate behavioral adjustment. The frontal and parietal cortices are both known for their activation during saccade generation, but it is unclear whether their neuroanatomical characteristics also contribute to antisaccades. Here, we took antisaccade cost (antisaccade latency minus prosaccade latency) as an index for additional time for generating antisaccades. Fifty-eight participants conducted pro and antisaccade tasks outside the magnetic resonance imaging (MRI) scanner and their structural MRI (sMRI) data were also collected to explore brain regions neuroanatomically related to antisaccade cost. Then, twelve participants performed saccade tasks in the scanner and their task-state functional MRI (fMRI) data were collected to verify the activation of structurally identified brain regions during the saccade generation. Voxel-based morphometry (VBM) results revealed that gray matter volume (GMV) of the left precentral gyrus and the left insula were positively correlated with the antisaccade cost, which was validated by the prediction analysis. Brain activation results showed the activation of the precentral during both pro and antisaccade execution period, but not the insula. Our results suggest that precentral gyrus and insula play vital roles to antisaccade cost, but possibly in different ways. The insula, a key node of the salience network, possibly regulates the saliency processing of the target, while the precentral gyrus possibly mediates the generation of saccades. Our study especially highlights an outstanding role of the precentral gyrus in flexible oculomotor control.

Toward a Theory of Visual Information Acquisition in Driving

OBJECTIVE

The aim of this study is to describe information acquisition theory, explaining how drivers acquire and represent the information they need.

BACKGROUND

While questions of what drivers are aware of underlie many questions in driver behavior, existing theories do not directly address how drivers in particular and observers in general acquire visual information. Understanding the mechanisms of information acquisition is necessary to build predictive models of drivers' representation of the world and can be applied beyond driving to a wide variety of visual tasks.

METHOD

We describe our theory of information acquisition, looking to questions in driver behavior and results from vision science research that speak to its constituent elements. We focus on the intersection of peripheral vision, visual attention, and eye movement planning and identify how an understanding of these visual mechanisms and processes in the context of information acquisition can inform more complete models of driver knowledge and state.

RESULTS

We set forth our theory of information acquisition, describing the gap in understanding that it fills and how existing questions in this space can be better understood using it.

CONCLUSION

Information acquisition theory provides a new and powerful way to study, model, and predict what drivers know about the world, reflecting our current understanding of visual mechanisms and enabling new theories, models, and applications.

APPLICATION

Using information acquisition theory to understand how drivers acquire, lose, and update their representation of the environment will aid development of driver assistance systems, semiautonomous vehicles, and road safety overall.

Eye and hand movements disrupt attentional control

Voluntary attentional control is the ability to selectively focus on a subset of visual information in the presence of other competing stimuli–a marker of cognitive control enabling flexible, goal-driven behavior. To test its robustness, we contrasted attentional control with the most common source of attentional orienting in daily life: attention shifts prior to goal-directed eye and hand movements. In a multi-tasking paradigm, human participants attended at a location while planning eye or hand movements elsewhere. Voluntary attentional control suffered with every simultaneous action plan, even under reduced task difficulty and memory load–factors known to interfere with attentional control. Furthermore, the performance cost was limited to voluntary attention: We observed simultaneous attention benefits at two movement targets without attentional competition between them. This demonstrates that the visual system allows for the concurrent representation of multiple attentional foci. Since attentional control is extremely fragile and dominated by premotor attention shifts, we propose that action-driven selection plays the superordinate role for visual selection.

During natural viewing, neural processing of visual targets continues throughout saccades

Relatively little is known about visual processing during free-viewing visual search in realistic dynamic environments. Free-viewing is characterized by frequent saccades. During saccades, visual processing is thought to be suppressed, yet we know that the presaccadic visual content can modulate postsaccadic processing. To better understand these processes in a realistic setting, we study here saccades and neural responses elicited by the appearance of visual targets in a realistic virtual environment. While subjects were being driven through a 3D virtual town, they were asked to discriminate between targets that appear on the road. Using a system identification approach, we separated overlapping and correlated activity evoked by visual targets, saccades, and button presses. We found that the presence of a target enhances early occipital as well as late frontocentral saccade-related responses. The earlier potential, shortly after 125 ms post-saccade onset, was enhanced for targets that appeared in the peripheral vision as compared to the central vision, suggesting that fast peripheral processing initiated before saccade onset. The later potential, at 195 ms post-saccade onset, was strongly modulated by the visibility of the target. Together these results suggest that, during natural viewing, neural processing of the presaccadic visual stimulus continues throughout the saccade, apparently unencumbered by saccadic suppression.

Post-saccadic changes disrupt attended pre-saccadic object memory

Trans-saccadic memory consists of keeping track of objects’ locations and features across saccades; pre-saccadic information is remembered and compared with post-saccadic information. It has been shown to have limited resources and involve attention with respect to the selection of objects and features. In support, a previous study showed that recognition of distinct post-saccadic objects in the visual scene is impaired when pre-saccadic objects are relevant and thus already encoded in memory (Poth, Herwig, Schneider, 2015). Here, we investigated the inverse (i.e. how the memory of pre-saccadic objects is affected by abrupt but irrelevant changes in the post-saccadic visual scene). We also modulated the amount of attention to the relevant pre-saccadic object by having participants either make a saccade to it or elsewhere and observed that pre-saccadic attentional facilitation affected how much post-saccadic changes disrupted trans-saccadic memory of pre-saccadic objects.

Participants identified a flashed symbol (d, b, p, or q, among distracters), at one of six placeholders (figures “8”) arranged in circle around fixation while planning a saccade to one of them. They reported the identity of the symbol after the saccade. We changed the post-saccadic scene in Experiment one by removing the entire scene, only the placeholder where the pre-saccadic symbol was presented, or all other placeholders except this one. We observed reduced identification performance when only the saccade-target placeholder disappeared after the saccade. In Experiment two, we changed one placeholder location (inward/outward shift or rotation re. saccade vector) after the saccade and observed that identification performance decreased with increased shift/rotation of the saccade-target placeholder. We conclude that pre-saccadic memory is disrupted by abrupt attention-capturing post-saccadic changes of visual scene, particularly when these changes involve the object prioritized by being the goal of a saccade. These findings support the notion that limited trans-saccadic memory resources are disrupted when object correspondence at saccadic goal is broken through removal or location change.

The temporal integration windows for visual mirror symmetry

Symmetry perception in dot patterns is tolerant to temporal delays of up to 60 ms within and between element pairs. However, it is not known how factors effecting symmetry discrimination in static patterns might affect temporal integration in dynamic patterns. One such feature is luminance polarity. Using dynamic stimuli with increasing temporal delay (SOA) between the onset of the first and second element in a symmetric pair, we investigated how four different luminance-polarity conditions affected the temporal integration of symmetric patterns. All four luminance polarity conditions showed similar upper temporal limits of approximately 60 ms. However psychophysical performance over all delay durations showed significantly higher symmetry thresholds for unmatched-polarity patterns at short delays, but also significantly less sensitivity to increasing temporal delay relative to matched-polarity patterns. These varying temporal windows are consistent with the involvement of a fast, sensitive first-order mechanism for matched-polarity patterns, and a slower, more robust second-order mechanism for unmatched-polarity patterns. Temporal integration windows for unmatched-polarity patterns were not consistent with performance expected from attentional mechanisms alone, and instead supports the involvement of second-order mechanisms that combines information from ON and OFF channels.

To look or not to look: dissociating presaccadic and covert spatial attention

Attention is a central neural process that enables selective and efficient processing of visual information. Individuals can attend to specific visual information either overtly, by making an eye movement to an object of interest, or covertly, without moving their eyes. We review behavioral, neuropsychological, neurophysiological, and computational evidence of presaccadic attentional modulations that occur while preparing saccadic eye movements, and highlight their differences from those of covert spatial endogenous (voluntary) and exogenous (involuntary) attention. We discuss recent studies and experimental procedures on how these different types of attention impact visual performance, alter appearance, differentially modulate the featural representation of basic visual dimensions (orientation and spatial frequency), engage different neural computations, and recruit partially distinct neural substrates. We conclude that presaccadic attention and covert attention are dissociable.

Assessment of Color Perception and Preference with Eye-Tracking Analysis in a Dental Treatment Environment

Nowadays, medical facilities are developing their treatment environment to provide better services to their patients. In particular, dental hospitals have been considered uncomfortable and uninviting spaces, which needs to change so that people can visit easily and feel more relaxed. However, only a few systematic studies have reported on the demand for building a comfortable space. This study aimed to investigate gaze characteristics based on a color preference survey of the dental unit chair, which has the most influence on spatial perception in the dental treatment environment, using an eye tracking technique for color. The results of this study showed that the color perception by eye tracking and the color preference by survey did not tend to match. The color most viewed by a majority of subjects was pink, which attracted a high level of attention, regardless of personal preference. In addition, for the psychological color images associated with color preference, the subjects tended to prefer images such as warmth, friendliness, and calmness. This appeared to reflect the psychology of the subjects who wished to replace their feelings of anxiety or fear when going to the dental hospital with comfort and tranquility. Therefore, colors that can provide comfort and tranquility to patients should be considered first as visual elements (e.g., brown) in creating a dental treatment environment.

Impaired pre-saccadic shifts of attention in neglect patients

Every saccade is generally preceded by a mandatory shift of attention to the saccade endpoint, allowing us to process visual information more effectively. Whether this 'pre-saccadic shift of attention' is still intact in hemispatial neglect is unknown. Whereas neglect patients exhibit lateralized impairments of attention and often show impaired saccadic behaviour, it is not yet clear how the pre-saccadic shift of attention is affected during accurately executed eye movements. In this study, we used a gaze contingent visual discrimination task, in which neglect patients had to discriminate a probe presented before saccade onset. Results revealed an imbalance in discrimination performance between the two hemifields with poor performance to probes in the contralesional compared to the ipsilesional hemifield when accounting for saccadic impairments. These results suggest that attention and eye movements are both unique impairments of neglect patients. We hypothesize that the impaired pre-saccadic shift of attention could be one of the key problems of neglect and might underlie other spatial and non-spatial deficits often reported in neglect patients.

Confirmation of age-related alterations in inhibitory control using a modified minimally delayed oculomotor response (MDOR) task

Considerable effort has been made to measure and understand the effects of ageing on inhibitory control using a range of behavioural tasks. In the minimally delayed oculomotor response (MDOR) task, participants are presented with a simple visual target step with variable target display duration (TDD), and instructed to saccade to the target not when it appears (a prosaccade response), but when it disappears (i.e., on target offset). Using this task, we recently found higher error rates and longer latencies for correct responses in older compared to younger participants. Here we have used a modified MDOR task, in which participants were presented with static placeholders identifying potential target positions (increasing spatial information), and three TDDs rather than two (reducing temporal predictability). We found that the yield of analysable trials was generally higher with this modified task and in 28 older (mean ± SD age: 65 ± 7 y) and 25 younger (26 ± 7 y) participants the total overall error rate was again higher in the older group (30 ± 18% vs. 16 ± 11%). An analysis of the temporal distribution of responses demonstrated a pronounced peak in error production around 150 ms (young) or 200 ms (old) after target onset. When we recalculated the error rate focusing on these errors, it was again significantly higher in the older group. The latency of correct responses (to offsets) was significantly increased in the older group, although much of this increase was accounted for by expected age-related visuomotor slowing. However, both latency and distribution data suggested that while older participants could generate increased levels of inhibition, they could not maintain these levels as efficiently as the younger participants. In 24 participants (15 old, 9 young) who completed both versions of the MDOR task, neither latency nor error rates differed significantly between versions. These results confirm an inhibitory control deficit in healthy older participants, and suggest that the dynamics of inhibitory control are also affected by ageing. The modified MDOR task yields more data while not altering basic performance parameters.

Different computations underlie overt presaccadic and covert spatial attention

Perception and action are tightly coupled: visual responses at the saccade target are enhanced right before saccade onset. This phenomenon, presaccadic attention, is a form of overt attention-deployment of visual attention with concurrent eye movements. Presaccadic attention is well-documented, but its underlying computational process remains unknown. This is in stark contrast to covert attention-deployment of visual attention without concurrent eye movements-for which the computational processes are well characterized by a normalization model. Here, a series of psychophysical experiments reveal that presaccadic attention modulates visual performance only via response gain changes. A response gain change was observed even when attention field size increased, violating the predictions of a normalization model of attention. Our empirical results and model comparisons reveal that the perceptual modulations by overt presaccadic and covert spatial attention are mediated through different computations.

Pre-saccadic attention spreads to stimuli forming a perceptual group with the saccade target

The pre-saccadic attention shift-a rapid increase in visual sensitivity at the target-is an inevitable precursor of saccadic eye movements. Saccade targets are often parts of the objects that are of interest to the active observer. Although the link between saccades and covert attention shifts is well established, it remains unclear if pre-saccadic attention selects the location of the eye movement target or rather the entire object that occupies this location. Indeed, several neurophysiological studies suggest that attentional modulations of neural activity in visual cortex spreads across parts of objects (e.g., elements grouped by Gestalt principles) that contain the target location of a saccade. To understand the nature of pre-saccadic attentional selection, we examined how visual sensitivity, measured in a challenging orientation discrimination task, changes during saccade preparation at locations that are perceptually grouped with the saccade target. In Experiment 1, using grouping by color in a delayed-saccade task, we found no consistent spread of attention to locations that formed a perceptual group with the saccade target. However, performance depended on the side of the stimulus arrangement relative to the saccade target location, an effect we discuss with respect to attentional momentum. In Experiment 2, employing stronger perceptual grouping cues (color and motion) and an immediate-saccade task, we obtained a reliable grouping effect: Attention spread to locations that were perceptually grouped with the saccade target while saccade preparation was underway. We also replicated the side effect observed in Experiment 1. These results provide evidence that the pre-saccadic attention spreads beyond the target location along the saccade direction, and selects scene elements that-based on Gestalt criteria-are likely to belong to the same object as the saccade target.

Studying Spatial Visual Attention: The Attention-Window Task as a Measurement Tool for the Shape and Maximum Spread of the Attention Window

Visual attentional processes have been an important topic in psychological research for years. Over the last few decades, new methods have been developed, aiming to explore the characteristics of the focus of attention in more detail. Studies that applied the "Attention-Window Task" (AWT) quantified the maximum extent of the "Attention Window" (AW) along its horizontal, vertical, and diagonal meridians, when subjects were required to perceive two peripheral stimuli simultaneously. In three experiments using the AWT, we investigated the effects of cue validity (Experiment 1), stimulus-onset asynchrony (SOA) (i.e., the interval between the onset of the cues and the onset of the target stimuli), and target stimuli complexity (Experiment 3) on the size and shape of the AW. Results showed that the AW was greater under valid cue conditions compared to invalid conditions, when the locations of cue and target stimuli differed. Furthermore, the AW decreased when the SOA between the cue and targets was reduced and also when the task complexity was higher and more objects within the target stimuli had to be classified. Overall, it can be stated that the AWT with its possible task changes and adjustments can be considered as a potential standard tool to measure the maximum spread and shape of the spatial AW.

The growing sensory suppression on visual perception during head-rotation preparation

Sensory perception is often impaired by self-generated movements. This effect of sensory suppression has been commonly observed in voluntary hand-movement-induced tactile sensation during the period of motor preparation and execution. However, it remains unclear whether such suppression also occurs in the visual domain and if it can be induced by the preparation of other body movements. To extend our knowledge about sensory suppression, the present study investigated visual sensitivity during the preparation of head rotation. Participants wore virtual reality goggles and rotated their heads horizontally according to a visual cue presented on the goggles screens. Before the start of head rotation, a target of Landolt C was displayed at a peripheral location that was directed by the head-rotation cue or a symmetric location in the opposite visual field. After each head rotation, participants reported the target's orientation, allowing the measurement of the discrimination threshold. Besides, the discrimination sensitivity was also measured in two head-still conditions with or without the presentation of a visual cue. The results showed that the discrimination performance was largely impaired by the preparation of head rotation. This effect of sensory attenuation increased with the approach of head-motion onset. However, the attenuation was not found on the discrimination of auditory stimuli during the preparation of head rotation, thus excluding the account of general dual-task requirement. In contrast to the previous findings of improved perception by preparation of saccade or reach, our findings indicate that sensory suppression rather than attention shift plays a major role during the preparation of head movement.

The peripheral sensitivity profile at the saccade target reshapes during saccade preparation

Goal-directed eye movements (saccades) bring peripheral objects of interest into high-acuity foveal vision. In preparation for the incoming foveal image, the perception of the saccade target may sharpen gradually before the eye movement is executed. Indeed, previous studies suggest that pre-saccadic attention shifts enhance sensitivity to high spatial frequencies (SFs) more than sensitivity to lower SFs. This pattern, however, was observed within a narrow frequency range and may reflect local changes in the shape of a broader underlying sensitivity profile. Depending on the development of the profile's shape, SFs above the previously examined range may profit less from saccade preparation. To assess the impact of saccade preparation on the shape of a broader sensitivity profile, we prompted observers to discriminate the orientation of a sinusoidal grating (the probe) presented briefly at the target of an impending saccade, at 10 dva (degree of visual angle) eccentricity. The probe's SF ranged from 1 to 5.5 cycles per dva (cpd) and was unpredictable on a given trial. We fitted observers' response accuracies across SFs with a log-parabolic, that is, inverted U-shaped function. Long before saccade onset, the profile peaked at .6 cpd and dropped off towards lower and higher SFs with broad bandwidth. During saccade preparation, the peak of the profile increased and shifted towards higher SFs while the bandwidth of the profile decreased. As a consequence of this reshaping process, pre-saccadic enhancement increased with SF up to 2.5 cpd, corroborating previous findings. Sensitivities to higher SFs, however, profited less from saccade preparation. We conclude that the extent of pre-saccadic enhancement to a particular SF is governed by its position on a broader sensitivity profile which reshapes substantially during saccade preparation. The shift of the profile's peak towards higher SFs increases resolution at the saccade target even when the features of relevant visual information are unpredictable.

Separable neuronal contributions to covertly attended locations and movement goals in macaque frontal cortex

We investigated the spatial representation of covert attention and movement planning in monkeys performing a task that used symbolic cues to decouple the locus of covert attention from the motor target. In the three frontal areas studied, most spatially tuned neurons reflected either where attention was allocated or the planned saccade. Neurons modulated by both covert attention and the motor plan were in the minority. Such dual-purpose neurons were especially rare in premotor and prefrontal cortex but were more common just rostral to the arcuate sulcus. The existence of neurons that indicate where the monkey was attending but not its movement goal runs counter to the idea that the control of spatial attention is entirely reliant on the neuronal circuits underlying motor planning. Rather, the presence of separate neuronal populations for each cognitive process suggests that endogenous attention is under flexible control and can be dissociated from motor intention.

Spatial Attention and Saccade Preparation Both Independently Contribute to the Discrimination of Oblique Orientations

The extent to which the preparation of an eye movement and spatial attention both independently influence performance within the same task has long been debated. In a recent study that combined computational modelling with a dual-task, both saccade preparation and spatial cueing were revealed to separately contribute to the discrimination of targets oriented along the cardinal axis (horizontal and vertical). However, it remains to be seen whether and to what degree the same holds true when different perceptual stimuli are used. In the present study, we combined evidence accumulation modelling with a dual-task paradigm to assess the extent to which both saccade preparation and spatial attention contribute to the discrimination of full contrast targets oriented along the oblique axis (diagonal). The results revealed a separate and quantifiable contribution of both types of orienting to discrimination performance. Comparison of the magnitude of these effects to those obtained for cardinal orientation discrimination revealed the influence of saccade preparation and spatial attention to be six times smaller for oblique orientations. Importantly, the results revealed a separate and quantifiable contribution of both saccade preparation and spatial attention regardless of perceptual stimuli or stimulus contrast.

Exploring the temporal dynamics of inhibition of return using steady-state visual evoked potentials

Inhibition of return is characterized by delayed responses to previously attended locations when the interval between stimuli is long enough. The present study employed steady-state visual evoked potentials (SSVEPs) as a measure of attentional modulation to explore the nature and time course of input- and output-based inhibitory cueing mechanisms that each slow response times at previously stimulated locations under different experimental conditions. The neural effects of behavioral inhibition were examined by comparing post-cue SSVEPs between cued and uncued locations measured across two tasks that differed only in the response modality (saccadic or manual response to targets). Grand averages of SSVEP amplitudes for each condition showed a reduction in amplitude at cued locations in the window of 100-500 ms post-cue, revealing an early, short-term decrease in the responses of neurons that can be attributed to sensory adaptation, regardless of response modality. Because primary visual cortex has been found to be one of the major sources of SSVEP signals, the results suggest that the SSVEP modulations observed were caused by input-based inhibition that occurred in V1, or visual areas earlier than V1, as a consequence of reduced visual input activity at previously cued locations. No SSVEP modulations were observed in either response condition late in the cue-target interval, suggesting that neither late input- nor output-based IOR modulates SSVEPs. These findings provide further electrophysiological support for the theory of multiple mechanisms contributing to behavioral cueing effects.

Perisaccadic remapping: What? How? Why?

About 25 years ago, the discovery of receptive field (RF) remapping in the parietal cortex of nonhuman primates revealed that visual RFs, widely assumed to have a fixed retinotopic organization, can change position before every saccade. Measuring such changes can be deceptively difficult. As a result, studies that followed have generated a fascinating but somewhat confusing picture of the phenomenon. In this review, we describe how observations of RF remapping depend on the spatial and temporal sampling of visual RFs and saccade directions. Further, we summarize some of the theories of how remapping might occur in neural circuitry. Finally, based on neurophysiological and psychophysical observations, we discuss the ways in which remapping information might facilitate computations in downstream brain areas.

Modulations of foveal vision associated with microsaccade preparation

It is known that attention shifts prior to a saccade to start processing the saccade target before it lands in the foveola, the high-resolution region of the retina. Yet, once the target is foveated, microsaccades, tiny saccades maintaining the fixated object within the fovea, continue to occur. What is the link between these eye movements and attention? There is growing evidence that these eye movements are associated with covert shifts of attention in the visual periphery, when the attended stimuli are presented far from the center of gaze. Yet, microsaccades are primarily used to explore complex foveal stimuli and to optimize fine spatial vision in the foveola, suggesting that the influences of microsaccades on attention may predominantly impact vision at this scale. To address this question we tracked gaze position with high precision and briefly presented high-acuity stimuli at predefined foveal locations right before microsaccade execution. Our results show that visual discrimination changes prior to microsaccade onset. An enhancement occurs at the microsaccade target location. This modulation is highly selective and it is coupled with a drastic impairment at the opposite foveal location, just a few arcminutes away. This effect is strongest when stimuli are presented closer to the eye movement onset time. These findings reveal that the link between attention and microsaccades is deeper than previously thought, exerting its strongest effects within the foveola. As a result, during fixation, foveal vision is constantly being reshaped both in space and in time with the occurrence of microsaccades.

Where and when to look: Sequential effects at the millisecond level

Learning and imitating a complex motor action requires to visually follow complex movements, but conscious perception seems too slow for such tasks. Recent findings suggest that visual perception has a higher temporal resolution at an unconscious than at a conscious level. Here we investigate whether high-temporal resolution in visual perception relies on prediction mechanisms and attention shifts based on recently experienced sequences of visual information. To that aim we explore sequential effects during four different simultaneity/asynchrony discrimination tasks. Two stimuli are displayed on each trial with varying stimulus onset asynchronies (SOA). Subjects decide whether the stimuli are simultaneous or asynchronous and give manual responses. The main finding is an advantage for different-order over same-order trials, when subjects decided that stimuli had been simultaneous on Trial t - 1 , and when Trial t is with an SOA slightly larger than Trial t - 1, or equivalent. The advantage for different-order trials disappears when the stimuli change eccentricity but not direction between trials (Experiment 2), and persists with stimuli displayed in the centre and unlikely to elicit a sense of direction (Experiment 4). It is still observed when asynchronies on Trial t - 1 are small and undetected (Experiment 3). The findings can be explained by an attention shift that is precisely planned in time and space and that incidentally allows subjects to detect an isolated stimulus on the screen, thus helping them to detect an asynchrony.

Presaccadic motion integration drives a predictive postsaccadic following response

Saccadic eye movements sample the visual world and ensure high acuity across the visual field. To compensate for delays in processing, saccades to moving targets require predictions: The eyes must intercept the target's future position to then pursue its direction of motion. Although prediction is crucial to voluntary pursuit, it is unclear whether it is an obligatory feature of saccade planning. Saccade planning involves an involuntary enhanced processing of the target, called presaccadic attention. Does this presaccadic attention recruit smooth eye movements automatically? To test this, we had human participants perform a saccade to one of four apertures, which were static, but each contained a random dot field with motion tangential to the required saccade. In this task, saccades were deviated along the direction of target motion, and the eyes exhibited a following response upon saccade landing. This postsaccadic following response (PFR) increased with spatial uncertainty of the target position and persisted even when we removed the motion stimulus in midflight of the saccade, confirming that it relied on presaccadic information. Motion from 50-100 ms prior to the saccade had the strongest influence on PFR, consistent with the time course of perceptual enhancements reported in presaccadic attention. Finally, the PFR magnitude related linearly to the logarithm of stimulus velocity and generally had low gain, similar to involuntary ocular following movements commonly observed after sudden motion onsets. These results suggest that presaccadic attention selects motion features of targets predictively, presumably to ensure successful immediate tracking of saccade targets in motion.

Post-Saccadic Face Processing Is Modulated by Pre-Saccadic Preview: Evidence from Fixation-Related Potentials

Humans actively sample their environment with saccadic eye movements to bring relevant information into high-acuity foveal vision. Despite being lower in resolution, peripheral information is also available before each saccade. How the pre-saccadic extrafoveal preview of a visual object influences its post-saccadic processing is still an unanswered question. The current study investigated this question by simultaneously recording behavior and fixation-related brain potentials while human subjects made saccades to face stimuli. We manipulated the relationship between pre-saccadic "previews" and post-saccadic images to explicitly isolate the influences of the former. Subjects performed a gender discrimination task on a newly foveated face under three preview conditions: scrambled face, incongruent face (different identity from the foveated face), and congruent face (same identity). As expected, reaction times were faster after a congruent-face preview compared with a scrambled-face preview. Importantly, intact face previews (either incongruent or congruent) resulted in a massive reduction of post-saccadic neural responses. Specifically, we analyzed the classic face-selective N170 component at occipitotemporal electroencephalogram electrodes, which was still present in our experiments with active looking. However, the post-saccadic N170 was strongly attenuated following intact-face previews compared with the scrambled condition. This large and long-lasting decrease in evoked activity is consistent with a trans-saccadic mechanism of prediction that influences category-specific neural processing at the start of a new fixation. These findings constrain theories of visual stability and show that the extrafoveal preview methodology can be a useful tool to investigate its underlying mechanisms.SIGNIFICANCE STATEMENT Neural correlates of object recognition have traditionally been studied by flashing stimuli to the central visual field. This procedure differs in fundamental ways from natural vision, where viewers actively sample the environment with eye movements and also obtain a low-resolution preview of soon-to-be-fixated objects. Here we show that the N170, a classic electrophysiological marker of the structural encoding of faces, also occurs during a more natural viewing condition but is strongly reduced due to extrafoveal preprocessing (preview benefit). Our results therefore highlight the importance of peripheral vision during trans-saccadic processing in building a coherent and stable representation of the world around us.

The spatial and temporal properties of attentional selectivity for saccades and reaches

The preparation and execution of saccades and goal-directed movements elicits an accompanying shift in attention at the locus of the impending movement. However, some key aspects of the spatiotemporal profile of this attentional shift between eye and hand movements are not resolved. While there is evidence that attention is improved at the target location when making a reach, it is not clear how attention shifts over space and time around the movement target as a saccade and a reach are made to that target. Determining this spread of attention is an important aspect in understanding how attentional resources are used in relation to movement planning and guidance in real world tasks. We compared performance on a perceptual discrimination paradigm during a saccade-alone task, reach-alone task, and a saccade-plus-reach task to map the temporal profile of the premotor attentional shift at the goal of the movement and at three surrounding locations. We measured performance relative to a valid baseline level to determine whether motor planning induces additional attentional facilitation compared to mere covert attention. Sensitivity increased relative to movement onset at the target and at the surrounding locations, for both the saccade-alone and saccade-plus-reach conditions. The results suggest that the temporal profile of the attentional shift is similar for the two tasks involving saccades (saccade-alone and saccade-plus-reach tasks), but is very different when the influence of the saccade is removed. In this case, performance in the saccade-plus-reach task reflects the lower sensitivity observed when a reach-alone task is being conducted. In addition, the spatial profile of this spread of attention is not symmetrical around the target. This suggests that when a saccade and reach are being planned together, the saccade drives the attentional shift, and the reach-alone carries little attentional weight.

The spread of presaccadic attention depends on the spatial configuration of the visual scene

When preparing a saccade, attentional resources are focused at the saccade target and its immediate vicinity. Here we show that this does not hold true when saccades are prepared toward a recently extinguished target. We obtained detailed maps of orientation sensitivity when participants prepared a saccade toward a target that either remained on the screen or disappeared before the eyes moved. We found that attention was mainly focused on the immediate surround of the visible target and spread to more peripheral locations as a function of the distance from the cue and the delay between the target's disappearance and the saccade. Interestingly, this spread was not accompanied with a spread of the saccade endpoint. These results suggest that presaccadic attention and saccade programming are two distinct processes that can be dissociated as a function of their interaction with the spatial configuration of the visual scene.

The interdependence of attention, working memory and gaze control: behavior and neural circuitry

Visual attention, visual working memory, and gaze control are basic functions that all select a subset of visual input to guide immediate or subsequent behavior. In this review, we focus on the relationship between these three functions and describe evidence, both at the behavioral and neural circuit levels that they are heavily interdependent. We start with the demonstration that gaze control - or saccade preparation in particular - leads to spatial attention. Next, we show that spatial attention and working memory interact at the behavioral level and rely on a common set of neural mechanisms. Next, we discuss the evidence that gaze control mechanisms are involved in spatial working memory. Lastly, we highlight the links between gaze control and non-spatial memory.

Spatial and temporal dynamics of presaccadic attentional facilitation before pro- and antisaccades

The premotor theory of attention and the visual attention model make different predictions about the temporal and spatial allocation of presaccadic attentional facilitation. The current experiment investigated the spatial and temporal dynamics of presaccadic attentional facilitation during pro- and antisaccade planning; we investigated whether attention shifts only to the saccade goal location or to the target location or elsewhere, and when. Participants performed a dual-task paradigm with blocks of either anti- or prosaccades and also discriminated symbols appearing at different locations before saccade onset (measure of attentional allocation). In prosaccades blocks, correct prosaccade discrimination was best at the target location, while during errors, discrimination was best at the location opposite to the target location. This pattern was inversed in antisaccades blocks, although discrimination remained high opposite to the target location. In addition, we took the benefit of a large range of saccadic landing positions and showed that performance across both types of saccades was best at the actual saccade goal location (where the eye will actually land) rather than at the instructed position. Finally, temporal analyses showed that discrimination remained highest at the saccade goal location, from long before to closer to saccade onset, increasing slightly for antisaccades closer to saccade onset. These findings are in line with the premises of the premotor theory of attention, showing that attentional allocation is primarily linked both temporally and spatially to the saccade goal location.

Associations and Dissociations between Oculomotor Readiness and Covert Attention

The idea that covert mental processes such as spatial attention are fundamentally dependent on systems that control overt movements of the eyes has had a profound influence on theoretical models of spatial attention. However, theories such as Klein’s Oculomotor Readiness Hypothesis (OMRH) and Rizzolatti’s Premotor Theory have not gone unchallenged. We previously argued that although OMRH/Premotor theory is inadequate to explain pre-saccadic attention and endogenous covert orienting, it may still be tenable as a theory of exogenous covert orienting. In this article we briefly reiterate the key lines of argument for and against OMRH/Premotor theory, then evaluate the Oculomotor Readiness account of Exogenous Orienting (OREO) with respect to more recent empirical data. These studies broadly confirm the importance of oculomotor preparation for covert, exogenous attention. We explain this relationship in terms of reciprocal links between parietal ‘priority maps’ and the midbrain oculomotor centres that translate priority-related activation into potential saccade endpoints. We conclude that the OMRH/Premotor theory hypothesis is false for covert, endogenous orienting but remains tenable as an explanation for covert, exogenous orienting.

Feature prediction across eye movements is location specific and based on retinotopic coordinates

With each saccadic eye movement, internal object representations change their retinal position and spatial resolution. Recently, we suggested that the visual system deals with these saccade-induced changes by predicting visual features across saccades based on transsaccadic associations of peripheral and foveal input (Herwig & Schneider, 2014). Here we tested the specificity of feature prediction by asking (a) whether it is spatially restricted to the previous learning location or the saccade target location, and (b) whether it is based on retinotopic (eye-centered) or spatiotopic (world-centered) coordinates. In a preceding acquisition phase, objects systematically changed their spatial frequency during saccades. In the following test phases of two experiments, participants had to judge the frequency of briefly presented peripheral objects. These objects were presented either at the previous learning location or at new locations and were either the target of a saccadic eye movement or not (Experiment 1). Moreover, objects were presented either in the same or different retinotopic and spatiotopic coordinates (Experiment 2). Spatial frequency perception was biased toward previously associated foveal input indicating transsaccadic learning and feature prediction. Importantly, while this pattern was not bound to the saccade target location, it was seen only at the previous learning location in retinotopic coordinates, suggesting that feature prediction probably affects low- or mid-level perception.

Threats to the validity of eye-movement research in psychology

Eyetracking research in psychology has grown exponentially over the past decades, as equipment has become cheaper and easier to use. The surge in eyetracking research has not, however, been equaled by a growth in methodological awareness, and practices that are best avoided have become commonplace. We describe nine threats to the validity of eyetracking research and provide, whenever possible, advice on how to avoid or mitigate these challenges. These threats concern both internal and external validity and relate to the design of eyetracking studies, to data preprocessing, to data analysis, and to the interpretation of eyetracking data.