Effect of previously fixated locations on saccade trajectory during free visual search

Identifying a distractor produces object-based inhibition in an allocentric reference frame for saccade planning

We investigated whether distractor inhibition occurs relative to the target or fixation in a perceptual decision-making task using a purely saccadic response. Previous research has shown that during the process of discriminating a target from distractor, saccades made to a target deviate towards the distractor. Once discriminated, the distractor is inhibited, and trajectories deviate away from the distractor. Saccade deviation magnitudes provide a sensitive measure of target-distractor competition dependent on the distance between them. While saccades are planned in an egocentric reference frame (locations represented relative to fixation), object-based inhibition has been shown to occur in an allocentric reference frame (objects represented relative to each other independent of fixation). By varying the egocentric and allocentric distances of the target and distractor, we found that only egocentric distances contributed to saccade trajectories shifts towards the distractor during active decision-making. When the perceptual decision-making process was complete, and the distractor was inhibited, both ego- and allocentric distances independently contributed to saccade trajectory shifts away from the distractor. This is consistent with independent spatial and object-based inhibitory mechanisms. Therefore, we suggest that distractor inhibition is maintained in cortical visual areas with allocentric maps which then feeds into oculomotor areas for saccade planning.

Modulation of saccade trajectories during sequential saccades

The planning and execution of sequential saccades can overlap in time, and abrupt changes in neural activity in the oculomotor system can alter the normal trajectory of saccades. In this study, we analyzed saccade trajectories to assess the combined programming of sequential saccades. In two separate psychophysical experiments, subjects were instructed to make a sequence of two saccades. The results showed modulation of saccade curvature by the direction and amplitude of both the preceding and following saccade: saccade curvature is modulated in the direction of preceding saccades and away from the direction of following saccades. Moreover, larger preceding and following saccades have stronger effects on curvature. These results support the idea that sequential saccades are programmed concurrently. Finally, the amount of saccade curvature is correlated with the deviation of saccade start and end points, and the time of maximum deviation of saccade trajectories is highly consistent in both experiments. Based on this, we propose a novel benefit for the modulation of saccade trajectories by the oculomotor system: minimizing the saccadic error in sequential saccades.NEW & NOTEWORTHY We show that in saccade sequences, saccade trajectory is modulated in the direction of the preceding saccade and away from the following saccade. The magnitude of this effect is correlated with preceding and following saccade amplitude. This confirms that programming of sequential saccades overlaps. Curvature is also correlated with the deviation of saccade start and end points. Thus, we propose a novel benefit for the modulation of saccade trajectories: minimizing end point error in sequential saccades.

Trajectory curvature in saccade sequences: spatiotopic influences vs. residual motor activity

When decisions drive saccadic eye movements, traces of the decision process can be inferred from the movement trajectories. For example, saccades can curve away from distractor stimuli, which was thought to reflect cortical inhibition biasing activity in the superior colliculus. Recent neurophysiological work does not support this theory, and two recent models have replaced top-down inhibition with lateral interactions in the superior colliculus or neural fatigue in the brainstem saccadic burst generator. All current models operate in retinotopic coordinates and are based on single saccade paradigms. To extend these models to sequences of saccades, we assessed whether and how saccade curvature depends on previously fixated locations and the direction of previous saccades. With a two-saccade paradigm, we first demonstrated that second saccades curved away from the initial fixation stimulus. Furthermore, by varying the time from fixation offset and the intersaccadic duration, we distinguished the extent of curvature originating from the spatiotopic representation of the previous fixation location or residual motor activity of the previous saccade. Results suggest that both factors drive curvature, and we discuss how these effects could be implemented in current models. In particular, we propose that the collicular retinotopic maps receive an excitatory spatiotopic update from the lateral interparial region.NEW & NOTEWORTHY Saccades curve away from locations of previous fixation. Varying stimulus timing demonstrates the effects of both 1) spatiotopic representation and 2) motor residual activity from previous saccades. The spatiotopic effect can be explained if current models are augmented with an excitatory top-down spatiotopic signal.

Do object refixations during scene viewing indicate rehearsal in visual working memory?

Do refixations serve a rehearsal function in visual working memory (VWM)? We analyzed refixations from observers freely viewing multiobject scenes. An eyetracker was used to limit the viewing of a scene to a specified number of objects fixated after the target (intervening objects), followed by a four-alternative forced choice recognition test. Results showed that the probability of target refixation increased with the number of fixated intervening objects, and these refixations produced a 16% accuracy benefit over the first five intervening-object conditions. Additionally, refixations most frequently occurred after fixations on only one to two other objects, regardless of the intervening-object condition. These behaviors could not be explained by random or minimally constrained computational models; a VWM component was required to completely describe these data. We explain these findings in terms of a monitor-refixate rehearsal system: The activations of object representations in VWM are monitored, with refixations occurring when these activations decrease suddenly.

Recent advances in the study of saccade trajectory deviations

In recent years, the number of studies that have used deviations of saccade trajectories as a measure has rapidly increased. This review discusses these recent studies and summarizes advances in this field. A division can be made into studies that have used saccade deviations to measure the amount of attention allocated in space and studies that have measured the strength of the activity of a distractor. Saccade deviations have also been used to measure target selection in special populations. Most importantly, recent studies have revealed novel knowledge concerning the spatial tuning and temporal dynamics of target selection in the oculomotor system. Deviations in saccade trajectories have shown to constitute a valuable measure of various processes that control and influence our behavior which can be applied to multiple domains.

Overt and covert visual search in primates: reaction times and gaze shift strategies

In order to investigate the search performance and strategies of nonhuman primates, two macaque monkeys were trained to search for a target template among differently oriented distractors in both free-gaze and fixed-gaze viewing conditions (overt and covert search). In free-gaze search, reaction times (RT) and eye movements revealed the theoretically predicted characteristics of exhaustive and self-terminating serial search, with certain exceptions that are also observed in humans. RT was linearly related to the number of fixations but not necessarily to the number of items on display. Animals scanned the scenes in a nonrandom manner spending notably more time on targets and items inspected last (just before reaction). The characteristics of free-gaze search were then compared with search performance under fixed gaze (covert search) and with the performance of four human subjects tested in similar experiments. By and large the performance characteristics of both groups were similar; monkeys were slightly faster, and humans more accurate. Both species produced shorter RT in fixed-gaze than in free-gaze search. But while RT slopes of the human subjects still showed the theoretically predicted difference between hits and rejections, slopes of the two monkeys appeared to collapse. Despite considerable priming and short-term learning when similar tests were continuously repeated, no substantial long-term training effects were seen when test conditions and set sizes were frequently varied. Altogether, the data reveal many similarities between human and monkey search behavior but indicate that search is not necessarily restricted to exclusively serial processes.

Visual processing, learning and feedback in the primate eye movement system

We present an overview of recent paradigms used for studying visual information and reward processing in the human and monkey oculomotor pathways. Current evidence indicates that eye movements made during visual search tasks rely on neural computations similar to those employed when eye movements are planned and executed to obtain explicit rewards. These data suggest that human eye movements originate from the processing of (predominantly visual) sensory information, feedback about previous errors, and expectations about factors, such as reward. We conclude that these properties make the saccadic system an ideal model for studying both the behavioral and neural mechanisms for human voluntary and involuntary choice behavior.

[Effect of object consistency in a spatial contextual cueing paradigm]

Previous studies demonstrated that attention can be quickly guided to a target location in a visual search task when the spatial configurations of search items and/or the object identities were repeated in the previous trials. This phenomenon is termed contextual cueing. Recently, it was reported that spatial configuration learning and object identity learning occurred independently, when novel contours were used as search items. The present study examined whether this learning occurred independently even when the search items were meaningful. The results showed that the contextual cueing effect was observed even if the relationships between the spatial locations and object identities were jumbled (Experiment 1). However, it disappeared when the search items were changed into geometric patterns (Experiment 2). These results suggest that the spatial configuration can be learned independent of the object identities; however, the use of the learned configuration is restricted by the learning situations.

Saccade trajectory under simultaneous inhibition for two locations

A saccade trajectory often curves away from the location of a non-target stimulus that appears before saccade execution. Spatial inhibition may prevent the saccade from moving toward the non-target stimulus. However, little is known about how simultaneous inhibition for multiple locations affects saccade trajectories. In this study, we examined the effects from two inhibited locations on saccade trajectories. The results show that the saccade trajectories depend on the inhibited locations, and the effect of inhibiting two locations on the trajectory was a summation of the effect of inhibiting each location. A simulation study using the initial interference model also suggests that the effect of each inhibition was summed up to modulate the initial saccade direction.