Pre-saccadic perception: Separate time courses for enhancement and spatial pooling at the saccade target

Saccadic "inhibition" unveils the late influence of image content on oculomotor programming

Image content is prioritized in the visual system. Faces are a paradigmatic example, receiving preferential processing along the visual pathway compared to other visual stimuli. Moreover, face prioritization manifests also in behavior. People tend to look at faces more frequently and for longer periods, and saccadic reaction times can be faster when targeting a face as opposed to a phase-scrambled control. However, it is currently not clear at which stage image content affects oculomotor planning and execution. It can be hypothesized that image content directly influences oculomotor signal generation. Alternatively, the image content could exert its influence on oculomotor planning and execution at a later stage, after the image has been processed. Here we aim to disentangle these two alternative hypotheses by measuring the frequency of saccades toward a visual target when the latter is followed by a visual transient in the central visual field. Behaviorally, this paradigm leads to a reduction in saccade frequency that happens about 90 ms after any visual transient event, also known as saccadic "inhibition". In two experiments, we measured occurrence of saccades in visually guided saccades as well as microsaccades during fixation, using face and noise-matched visual stimuli. We observed that while the reduction in saccade occurrence was similar for both stimulus types, face stimuli lead to a prolonged reduction in eye movements. Moreover, saccade kinematics were altered by both stimulus types, showing an amplitude reduction without change in peak velocity for the earliest saccades. Taken together, our experiments imply that face stimuli primarily affect the later stages of the behavioral phenomenon of saccadic "inhibition". We propose that while some stimulus features are processed at an early stage and can quickly influence eye movements, a delayed signal conveying image content information is necessary to further inhibit/delay activity in the oculomotor system to trigger eye movements.

Presaccadic preview shapes postsaccadic processing more where perception is poor

The presaccadic preview of a peripheral target enhances the efficiency of its postsaccadic processing, termed the extrafoveal preview effect. Peripheral visual performance-and thus the quality of the preview-varies around the visual field, even at isoeccentric locations: It is better along the horizontal than vertical meridian and along the lower than upper vertical meridian. To investigate whether these polar angle asymmetries influence the preview effect, we asked human participants to preview four tilted gratings at the cardinals, until a central cue indicated which one to saccade to. During the saccade, the target orientation either remained or slightly changed (valid/invalid preview). After saccade landing, participants discriminated the orientation of the (briefly presented) second grating. Stimulus contrast was titrated with adaptive staircases to assess visual performance. Expectedly, valid previews increased participants' postsaccadic contrast sensitivity. This preview benefit, however, was inversely related to polar angle perceptual asymmetries; largest at the upper, and smallest at the horizontal meridian. This finding reveals that the visual system compensates for peripheral asymmetries when integrating information across saccades, by selectively assigning higher weights to the less-well perceived preview information. Our study supports the recent line of evidence showing that perceptual dynamics around saccades vary with eye movement direction.

Pre-saccadic Preview Shapes Post-Saccadic Processing More Where Perception is Poor

The pre-saccadic preview of a peripheral target enhances the efficiency of its post-saccadic processing, termed the extrafoveal preview effect. Peripheral visual performance -and thus the quality of the preview- varies around the visual field, even at iso-eccentric locations: it is better along the horizontal than vertical meridian and along the lower than upper vertical meridian. To investigate whether these polar angle asymmetries influence the preview effect, we asked human participants (to preview four tilted gratings at the cardinals, until a central cue indicated to which one to saccade. During the saccade, the target orientation either remained or slightly changed (valid/invalid preview). After saccade landing, participants discriminated the orientation of the (briefly presented) second grating. Stimulus contrast was titrated with adaptive staircases to assess visual performance. Expectedly, valid previews increased participants' post-saccadic contrast sensitivity. This preview benefit, however, was inversely related to polar angle perceptual asymmetries; largest at the upper, and smallest at the horizontal meridian. This finding reveals that the visual system compensates for peripheral asymmetries when integrating information across saccades, by selectively assigning higher weights to the less-well perceived preview information. Our study supports the recent line of evidence showing that perceptual dynamics around saccades vary with eye movement direction.

Pre-saccadic shifts of attention in individuals diagnosed with schizophrenia

INTRODUCTION

Pathophysiological theories of schizophrenia (SZ) symptoms posit an abnormality in using predictions to guide behavior. One such prediction is based on imminent movements, via corollary discharge signals (CD) that relay information about planned movement kinematics to sensory brain regions. Empirical evidence suggests a reduced influence of sensorimotor predictions in individuals with SZ within multiple sensory systems, including in the visual system. One function of CD in the visual system is to selectively enhance visual sensitivity at the location of planned eye movements (pre-saccadic attention), thus enabling a prediction of the to-be-foveated stimulus. We expected pre-saccadic attention shifts to be less pronounced in individuals with SZ than in healthy controls (HC), resulting in unexpected sensory consequences of eye movements, which may relate to symptoms than can be explained in the context of altered allocation of attention.

METHODS

We examined this question by testing 30 SZ and 30 HC on a pre-saccadic attention task. On each trial participants made a saccade to a cued location in an array of four stimuli. A discrimination target that was either congruent or incongruent with the cued location was briefly presented after the cue, during saccade preparation. Pre-saccadic attention was quantified by comparing accuracy on congruent trials to incongruent trials within the interval preceding the saccade.

RESULTS

Although SZs were less accurate overall, the magnitude of the pre-saccadic attention effect generally did not differ across groups nor show a convincing relationship with symptom severity. We did, however, observe that SZ had reduced pre-saccadic attention effects when the discrimination target (probe) was presented at early stages of saccade planning, when pre-saccadic attention effects first emerged in HC.

CONCLUSION

These findings suggest generally intact pre-saccadic shifts of attention in SZ, albeit slightly delayed. Results contribute to our understanding of altered sensory predictions in people with schizophrenia.

Alterations to foveal crowding with microsaccade preparation

Visual stimuli presented around the time of a saccade have been shown to be perceived differently by the visual system, including a reduction in the harmful impact of flankers (crowding). However, whether the effects observed are due strictly to crowding remains controversial, and the effects have only been measured with large saccades in peripheral vision. Here we investigate how crowded stimuli placed 20 arc minutes from the center of gaze are affected by an upcoming microsaccade. The stimulus consisted of a rotated T of size 6.25 arcminutes that was either unflanked, surrounded by four flankers (Experiment 1), or surrounded by two flankers that were positioned either radially or tangentially (Experiments 2 and 3). In 80 % of trials, subjects made voluntary microsaccades to the target when cued, and in the remaining 20 % of the trials subjects continued to maintain fixation. In Experiments 1 and 2, subjects were required to saccade to the same location as the target, while in Experiment 3 subjects saccaded to a different location ∼ 20 arc min to the upper left of the target. Thus, we provide evidence for two separable pre-saccadic benefits for crowded parafoveal targets: one isotropizes the crowding zone for stimuli presented 200 to 125 ms before microsaccadic onset, and another provides a benefit exclusively for microsaccade targets surrounded by tangential flankers in the presence of imminent microsaccades. Two possible mechanisms are attentional enhancement and predictive remapping of receptive fields, respectively.

Saccade execution increases the preview effect with faces: An EEG and eye-tracking coregistration study

Under naturalistic viewing conditions, humans conduct about three to four saccadic eye movements per second. These dynamics imply that in real life, humans rarely see something completely new; there is usually a preview of the upcoming foveal input from extrafoveal regions of the visual field. In line with results from the field of reading research, we have shown with EEG and eye-tracking coregistration that an extrafoveal preview also affects postsaccadic visual object processing and facilitates discrimination. Here, we ask whether this preview effect in the fixation-locked N170, and in manual responses to the postsaccadic target face (tilt discrimination), requires saccade execution. Participants performed a gaze-contingent experiment in which extrafoveal face images could change their orientation during a saccade directed to them. In a control block, participants maintained stable gaze throughout the experiment and the extrafoveal face reappeared foveally after a simulated saccade latency. Compared with this no-saccade condition, the neural and the behavioral preview effects were much larger in the saccade condition. We also found shorter first fixation durations after an invalid preview, which is in contrast to reading studies. We interpret the increased preview effect under saccade execution as the result of the additional sensorimotor processes that come with gaze behavior compared with visual perception under stable fixation. In addition, our findings call into question whether EEG studies with fixed gaze capture key properties and dynamics of active, natural vision.

Peri-Saccadic Orientation Identification Performance and Visual Neural Sensitivity Are Higher in the Upper Visual Field

Visual neural processing is distributed among a multitude of sensory and sensory-motor brain areas exhibiting varying degrees of functional specializations and spatial representational anisotropies. Such diversity raises the question of how perceptual performance is determined, at any one moment in time, during natural active visual behavior. Here, exploiting a known dichotomy between the primary visual cortex (V1) and superior colliculus (SC) in representing either the upper or lower visual fields, we asked whether peri-saccadic orientation identification performance is dominated by one or the other spatial anisotropy. Humans (48 participants, 29 females) reported the orientation of peri-saccadic upper visual field stimuli significantly better than lower visual field stimuli, unlike their performance during steady-state gaze fixation, and contrary to expected perceptual superiority in the lower visual field in the absence of saccades. Consistent with this, peri-saccadic superior colliculus visual neural responses in two male rhesus macaque monkeys were also significantly stronger in the upper visual field than in the lower visual field. Thus, peri-saccadic orientation identification performance is more in line with oculomotor, rather than visual, map spatial anisotropies.SIGNIFICANCE STATEMENT Different brain areas respond to visual stimulation, but they differ in the degrees of functional specializations and spatial anisotropies that they exhibit. For example, the superior colliculus (SC) both responds to visual stimulation, like the primary visual cortex (V1), and controls oculomotor behavior. Compared with the primary visual cortex, the superior colliculus exhibits an opposite pattern of upper/lower visual field anisotropy, being more sensitive to the upper visual field. Here, we show that human peri-saccadic orientation identification performance is better in the upper compared with the lower visual field. Consistent with this, monkey superior colliculus visual neural responses to peri-saccadic stimuli follow a similar pattern. Our results indicate that peri-saccadic perceptual performance reflects oculomotor, rather than visual, map spatial anisotropies.

Microsaccadic correlates of covert attention and crowding

Spatial crowding occurs when an object is cluttered among other objects in space and is a ubiquitous factor affecting object recognition in the peripheral visual field. Crowding is typically tested by presenting crowded stimuli at an eccentric location while having observers fixate at a point in space. However, even during fixation, our eyes are not perfectly steady but instead make small-scale eye movements (microsaccades) that have recently been suggested to be affected by shifts in attentional allocation. In the current study, we monitored microsaccadic behavior (a possible attentional correlate) to understand naturally occurring shifts in attention that occur following the presentation of a crowded stimulus. A tracking scanning laser ophthalmoscope (TSLO) was used to image the right eye of each observer during a psychophysical task. The stimuli consisted of Sloan numbers (0-9) presented briefly, either unflanked or surrounded by Sloan numbers at one of four nominal spacings. The extent of crowding was found to decrease by 26% on trials with the presence of incongruent microsaccades (proposed to suggest attentional capture). These findings complement the existing body of literature on the beneficial impact of explicit shifts of spatial attention to the location of a crowded stimulus.

Time-dependent inhibition of covert shifts of attention

Visual transients can interrupt overt orienting by abolishing the execution of a planned eye movement due about 90 ms later, a phenomenon known as saccadic inhibition (SI). It is not known if the same inhibitory process might influence covert orienting in the absence of saccades, and consequently alter visual perception. In Experiment 1 (n = 14), we measured orientation discrimination during a covert orienting task in which an uninformative exogenous visual cue preceded the onset of an oriented probe by 140-290 ms. In half of the trials, the onset of the probe was accompanied by a brief irrelevant flash, a visual transient that would normally induce SI. We report a time-dependent inhibition of covert orienting in which the irrelevant flash impaired orientation discrimination accuracy when the probe followed the cue by 190 and 240 ms. The interference was more pronounced when the cue was incongruent with the probe location, suggesting an impact on the reorienting component of the attentional shift. In Experiment 2 (n = 12), we tested whether the inhibitory effect of the flash could occur within an earlier time range, or only within the later, reorienting range. We presented probes at congruent cue locations in a time window between 50 and 200 ms. Similar to Experiment 1, discrimination performance was altered at 200 ms after the cue. We suggest that covert attention may be susceptible to similar inhibitory mechanisms that generate SI, especially in later stages of attentional shifting (> 200 ms after a cue), typically associated with reorienting.

The extrafoveal preview paradigm as a measure of predictive, active sampling in visual perception

A key feature of visual processing in humans is the use of saccadic eye movements to look around the environment. Saccades are typically used to bring relevant information, which is glimpsed with extrafoveal vision, into the high-resolution fovea for further processing. With the exception of some unusual circumstances, such as the first fixation when walking into a room, our saccades are mainly guided based on this extrafoveal preview. In contrast, the majority of experimental studies in vision science have investigated "passive" behavioral and neural responses to suddenly appearing and often temporally or spatially unpredictable stimuli. As reviewed here, a growing number of studies have investigated visual processing of objects under more natural viewing conditions in which observers move their eyes to a stationary stimulus, visible previously in extrafoveal vision, during each trial. These studies demonstrate that the extrafoveal preview has a profound influence on visual processing of objects, both for behavior and neural activity. Starting from the preview effect in reading research we follow subsequent developments in vision research more generally and finally argue that taking such evidence seriously leads to a reconceptualization of the nature of human visual perception that incorporates the strong influence of prediction and action on sensory processing. We review theoretical perspectives on visual perception under naturalistic viewing conditions, including theories of active vision, active sensing, and sampling. Although the extrafoveal preview paradigm has already provided useful information about the timing of, and potential mechanisms for, the close interaction of the oculomotor and visual systems while reading and in natural scenes, the findings thus far also raise many new questions for future research.

The peripheral sensitivity profile at the saccade target reshapes during saccade preparation

Goal-directed eye movements (saccades) bring peripheral objects of interest into high-acuity foveal vision. In preparation for the incoming foveal image, the perception of the saccade target may sharpen gradually before the eye movement is executed. Indeed, previous studies suggest that pre-saccadic attention shifts enhance sensitivity to high spatial frequencies (SFs) more than sensitivity to lower SFs. This pattern, however, was observed within a narrow frequency range and may reflect local changes in the shape of a broader underlying sensitivity profile. Depending on the development of the profile's shape, SFs above the previously examined range may profit less from saccade preparation. To assess the impact of saccade preparation on the shape of a broader sensitivity profile, we prompted observers to discriminate the orientation of a sinusoidal grating (the probe) presented briefly at the target of an impending saccade, at 10 dva (degree of visual angle) eccentricity. The probe's SF ranged from 1 to 5.5 cycles per dva (cpd) and was unpredictable on a given trial. We fitted observers' response accuracies across SFs with a log-parabolic, that is, inverted U-shaped function. Long before saccade onset, the profile peaked at .6 cpd and dropped off towards lower and higher SFs with broad bandwidth. During saccade preparation, the peak of the profile increased and shifted towards higher SFs while the bandwidth of the profile decreased. As a consequence of this reshaping process, pre-saccadic enhancement increased with SF up to 2.5 cpd, corroborating previous findings. Sensitivities to higher SFs, however, profited less from saccade preparation. We conclude that the extent of pre-saccadic enhancement to a particular SF is governed by its position on a broader sensitivity profile which reshapes substantially during saccade preparation. The shift of the profile's peak towards higher SFs increases resolution at the saccade target even when the features of relevant visual information are unpredictable.

Enumeration strategy differences revealed by saccade-terminated eye tracking

Brain regions involved in saccadic eye movements partially overlap with a frontoparietal network implicated in encoding numerosities. Eye movement patterns may plausibly reflect strategic scanning behaviours to resolve the open-ended task of efficiently enumerating visual arrays. If so, these patterns may help explain individual differences in enumeration acuity in terms of well-understood visual attention mechanisms. Most enumeration eye-tracking paradigms, however, do not allow for direct manipulation of eye movement behaviours to test these claims. In the current study we terminated trials after a specified number of saccades to systematically probe the time course of enumeration strategies. Fifteen adults (11 naïve, 4 informed) enumerated random dot arrays under three conditions: (1) a novel saccade-terminated design where arrays were visible until one, two or four saccades had occurred; (2) a duration-terminated design where arrays were shown for 250, 500 or 1000 ms; and (3) a response-terminated design where arrays were visible until a response. Participants gave more accurate responses when enumerating saccade-terminated trials despite taking a similar time as in the duration-terminated trials. When participants were informed how trials would terminate, their saccade onset latencies shifted to match task demands. Rotating saccade vectors to align with salient image locations accounted for variability in the orientation of saccade trajectories. These findings (1) show a combination of stimulus-derived visual processing and task-based strategic demands account for enumeration eye movements patterns, (2) validate a novel saccade-contingent trial termination procedure for studying sequences of enumeration eye movements, and (3) highlight the need to include analyses of spatial and temporal eye movement patterns into models of visual enumeration strategies.

Post-Saccadic Face Processing Is Modulated by Pre-Saccadic Preview: Evidence from Fixation-Related Potentials

Humans actively sample their environment with saccadic eye movements to bring relevant information into high-acuity foveal vision. Despite being lower in resolution, peripheral information is also available before each saccade. How the pre-saccadic extrafoveal preview of a visual object influences its post-saccadic processing is still an unanswered question. The current study investigated this question by simultaneously recording behavior and fixation-related brain potentials while human subjects made saccades to face stimuli. We manipulated the relationship between pre-saccadic "previews" and post-saccadic images to explicitly isolate the influences of the former. Subjects performed a gender discrimination task on a newly foveated face under three preview conditions: scrambled face, incongruent face (different identity from the foveated face), and congruent face (same identity). As expected, reaction times were faster after a congruent-face preview compared with a scrambled-face preview. Importantly, intact face previews (either incongruent or congruent) resulted in a massive reduction of post-saccadic neural responses. Specifically, we analyzed the classic face-selective N170 component at occipitotemporal electroencephalogram electrodes, which was still present in our experiments with active looking. However, the post-saccadic N170 was strongly attenuated following intact-face previews compared with the scrambled condition. This large and long-lasting decrease in evoked activity is consistent with a trans-saccadic mechanism of prediction that influences category-specific neural processing at the start of a new fixation. These findings constrain theories of visual stability and show that the extrafoveal preview methodology can be a useful tool to investigate its underlying mechanisms.SIGNIFICANCE STATEMENT Neural correlates of object recognition have traditionally been studied by flashing stimuli to the central visual field. This procedure differs in fundamental ways from natural vision, where viewers actively sample the environment with eye movements and also obtain a low-resolution preview of soon-to-be-fixated objects. Here we show that the N170, a classic electrophysiological marker of the structural encoding of faces, also occurs during a more natural viewing condition but is strongly reduced due to extrafoveal preprocessing (preview benefit). Our results therefore highlight the importance of peripheral vision during trans-saccadic processing in building a coherent and stable representation of the world around us.

Presaccadic attention improves or impairs performance by enhancing sensitivity to higher spatial frequencies

Right before we move our eyes, visual performance and neural responses for the saccade target are enhanced. This effect, presaccadic attention, is considered to prioritize the saccade target and to enhance behavioral performance for the saccade target. Recent evidence has shown that presaccadic attention modulates the processing of feature information. Hitherto, it remains unknown whether presaccadic modulations on feature information are flexible, to improve performance for the task at hand, or automatic, so that they alter the featural representation similarly regardless of the task. Using a masking procedure, here we report that presaccadic attention can either improve or impair performance depending on the spatial frequency content of the visual input. These counterintuitive modulations were significant at a time window right before saccade onset. Furthermore, merely deploying covert attention within the same temporal interval without preparing a saccade did not affect performance. This study reveals that presaccadic attention not only prioritizes the saccade target, but also automatically modifies its featural representation.