The urgency to look: prompt saccades to the benefit of perception

Controlling the trajectory of a moving object substantially shortens the latency of motor responses to visual stimuli

Motor responses to visual stimuli have shorter latencies for controlling than for initiating movement. The shorter latencies observed for movement control are notably believed to reflect the involvement of forward models when controlling moving limbs. We assessed whether controlling a moving limb is a "requisite" to observe shortened response latencies. The latency of button-press responses to a visual stimulus was compared between conditions involving or not involving the control of a moving object, but never involving any actual control of a body segment. When the motor response controlled a moving object, response latencies were significantly shorter and less variable, probably reflecting a faster sensorimotor processing (as assessed fitting a LATER model to our data). These results suggest that when the task at hand entails a control component, the sensorimotor processing of visual information is hastened, and this even if the task does not require to actually control a moving limb.

Where and when matter in visual recognition

Our perceptual system processes only a selected subset of an incoming stream of stimuli due to sensory biases and limitations in spatial and temporal attention and working memory capacity. In this study, we investigated perceptual access to sensory information that was temporally predictable or unpredictable and spread across the visual field. In a visual recognition task, participants were presented with an array of different number of alphabetical stimuli that were followed by a probe with a delay. They had to indicate whether the probe was included in the stimulus-set or not. To test the impact of temporal attention, coloured cues that were displayed before the visual stimuli indicated the presentation onset of the stimulus-set. We found that temporal predictability of stimulus onset yields higher performance. In addition, recognition performance was biased across the visual field with higher performance for stimuli that were presented on the upper and right visual quadrants. Our findings demonstrate that recognition accuracy is enhanced by temporal cues and has an inherently asymmetric shape across the visual field.

Saccadic initiation biased by fixational activity

Both the gap and overlap paradigm may reveal the interaction between fixating and moving the eyes, but the effects of the overlap paradigm have not been fully characterized yet. Here we present a series of experiments probing how an overlap paradigm, combined with the manipulation of stimuli durations, saliency and transient changes might modulate saccadic reaction time distributions. We recorded saccadic reaction time in four participants in six experiments in which a saccade-target appeared at a pseudo-random amplitude after a fixation period. First, we parametrically manipulated the duration of the overlap using a range of intervals (from 0 to 200 ms). In a second experiment we probed the interaction of various foreperiod intervals (i.e. the duration of the fixation period prior to saccade-target onset) and overlap using two overlap intervals (20 or 140 ms). In two additional experiments we manipulated either the stimuli sizes or their contrast ratio in overlap paradigms (20 or 140 ms). Lastly, we introduced a visual transient during the overlap interval via two manipulations (both with a range of SOA): either a distractor ring appeared around the fixation-target, or a dynamic random noise patch replaced the fixation-target. Results show reliable modifications in the latency distributions depending on the overlap interval as well as idiosyncratic differences. Additional experimental manipulations also affected the latency distributions revealing strong interacting inhibitory processes. We conclude that the effects of overlap intervals may combine with the influence of other stimuli properties affecting decision process.

Motivation by reward jointly improves speed and accuracy, whereas task-relevance and meaningful images do not

Visual selection is characterized by a trade-off between speed and accuracy. Speed or accuracy of the selection process can be affected by higher level factors—for example, expecting a reward, obtaining task-relevant information, or seeing an intrinsically relevant target. Recently, motivation by reward has been shown to simultaneously increase speed and accuracy, thus going beyond the speed–accuracy-trade-off. Here, we compared the motivating abilities of monetary reward, task-relevance, and image content to simultaneously increase speed and accuracy. We used a saccadic distraction task that required suppressing a distractor and selecting a target. Across different blocks successful target selection was followed either by (i) a monetary reward, (ii) obtaining task-relevant information, or (iii) seeing the face of a famous person. Each block additionally contained the same number of irrelevant trials lacking these consequences, and participants were informed about the upcoming trial type. We found that postsaccadic vision of a face affected neither speed nor accuracy, suggesting that image content does not affect visual selection via motivational mechanisms. Task relevance increased speed but decreased selection accuracy, an observation compatible with a classical speed–accuracy trade-off. Motivation by reward, however, simultaneously increased response speed and accuracy. Saccades in all conditions deviated away from the distractor, suggesting that the distractor was suppressed, and this deviation was strongest in the reward block. Drift-diffusion modelling revealed that task-relevance affected behavior by affecting decision thresholds, whereas motivation by reward additionally increased the rate of information uptake. The present findings thus show that the three consequences differ in their motivational abilities.

Speed-accuracy tradeoffs influence the main sequence of saccadic eye movements

Several studies have proposed that an optimal speed-accuracy tradeoff underlies the stereotyped relationship between amplitude, duration and peak velocity of saccades (main sequence). To test this theory, we asked 8 participants to make saccades to Gaussian-blurred spots and manipulated the task’s accuracy constraints by varying target size (1, 3, and 5°). The largest targets indeed yielded more endpoint scatter (and lower gains) than the smallest targets, although this effect subsided with target eccentricity. The main sequence depended on several interacting factors: saccade latency, saccade gain and target size. Early saccades, which were faster than amplitude-matched late saccades, followed the target-size dependency one would expect from a speed-accuracy tradeoff process. They had higher peak velocities and shorter durations for larger targets than for smaller targets. For late saccades, however, the opposite was found. Deviations from the main sequence also covaried with saccade gain, in line with the idea that motor noise underlies part of the endpoint variability. Thus, our data provide partial evidence that the saccadic system weighs the detrimental effects of motor noise on saccade accuracy against movement duration and speed, but other factors also modulate the kinematics. We discuss the possible involvement of parallel saccade pathways to account for our findings.

Vision as oculomotor reward: cognitive contributions to the dynamic control of saccadic eye movements

Humans and other primates are equipped with a foveated visual system. As a consequence, we reorient our fovea to objects and targets in the visual field that are conspicuous or that we consider relevant or worth looking at. These reorientations are achieved by means of saccadic eye movements. Where we saccade to depends on various low-level factors such as a targets' luminance but also crucially on high-level factors like the expected reward or a targets' relevance for perception and subsequent behavior. Here, we review recent findings how the control of saccadic eye movements is influenced by higher-level cognitive processes. We first describe the pathways by which cognitive contributions can influence the neural oculomotor circuit. Second, we summarize what saccade parameters reveal about cognitive mechanisms, particularly saccade latencies, saccade kinematics and changes in saccade gain. Finally, we review findings on what renders a saccade target valuable, as reflected in oculomotor behavior. We emphasize that foveal vision of the target after the saccade can constitute an internal reward for the visual system and that this is reflected in oculomotor dynamics that serve to quickly and accurately provide detailed foveal vision of relevant targets in the visual field.

Perceptual Difficulty Persistently Increases Dominance in Binocular Rivalry-Even Without a Task

A major objective of perception is the reduction of uncertainty about the outside world. Eye-movement research has demonstrated that attention and oculomotor control can subserve the function of decreasing uncertainty in vision. Here, we ask whether a similar effect exists for awareness in binocular rivalry, when two distinct stimuli presented to the two eyes compete for awareness. We tested whether this competition can be biased by uncertainty about the stimuli and their relevance for a perceptual task. Specifically, we have stimuli that are perceptually difficult (i.e., carry high perceptual uncertainty) compete with stimuli that are perceptually easy (low perceptual uncertainty). Using a no-report paradigm and reading the dominant stimulus continuously from the observers' eye movements, we find that the perceptually difficult stimulus becomes more dominant than the easy stimulus. This difference is enhanced by the stimuli's relevance for the task. In trials with task, the difference in dominance emerges quickly, peaks before the response, and then persists throughout the trial (further 10 s). However, the difference is already present in blocks before task instruction and still observable when the stimuli have ceased to be task relevant. This shows that perceptual uncertainty persistently increases perceptual dominance, and this is magnified by task relevance.

Perception of saccadic reaction time

That saccadic reaction times (SRTs) may depend on reinforcement contingencies has been repeatedly demonstrated. It follows that one must be able to discriminate one’s latencies to adequately assign credit to one’s actions, which is to connect behaviour to its consequence. To quantify the ability to perceive one’s SRT, we used an adaptive procedure to train sixteen participants in a stepping visual target saccade paradigm. Subsequently, we measured their RTs perceptual threshold at 75% in a conventional constant stimuli procedure. For each trial, observers had to saccade to a stepping target. Then, in a 2-AFC task, they had to choose one value representing the actual SRT, while the other value proportionally differed from the actual SRT. The relative difference between the two alternatives was computed by either adding or subtracting from the actual SRT a percent-difference value randomly chosen among a fixed set. Feedback signalling the correct choice was provided after each response. Overall, our results showed that the 75% SRT perceptual threshold averaged 23% (about 40 ms). The ability to discriminate small SRT differences provides support for the possibility that the credit assignment problem may be solved even for short reaction times.

Stronger saccadic suppression of displacement and blanking effect in children

Humans do not notice small displacements to objects that occur during saccades, termed saccadic suppression of displacement (SSD), and this effect is reduced when a blank is introduced between the pre- and postsaccadic stimulus (Bridgeman, Hendry, & Stark, 1975; Deubel, Schneider, & Bridgeman, 1996). While these effects have been studied extensively in adults, it is unclear how these phenomena are characterized in children. A potentially related mechanism, saccadic suppression of contrast sensitivity-a prerequisite to achieve a stable percept-is stronger for children (Bruno, Brambati, Perani, & Morrone, 2006). However, the evidence for how transsaccadic stimulus displacements may be suppressed or integrated is mixed. While they can integrate basic visual feature information from an early age, they cannot integrate multisensory information (Gori, Viva, Sandini, & Burr, 2008; Nardini, Jones, Bedford, & Braddick, 2008), suggesting a failure in the ability to integrate more complex sensory information. We tested children 7 to 12 years old and adults 19 to 23 years old on their ability to perceive intrasaccadic stimulus displacements, with and without a postsaccadic blank. Results showed that children had stronger SSD than adults and a larger blanking effect. Children also had larger undershoots and more variability in their initial saccade endpoints, indicating greater intrinsic uncertainty, and they were faster in executing corrective saccades to account for these errors. Together, these results suggest that children may have a greater internal expectation or prediction of saccade error than adults; thus, the stronger SSD in children may be due to higher intrinsic uncertainty in target localization or saccade execution.

Prediction and final temporal errors are used for trial-to-trial motor corrections

Many daily life situations (e.g. dodging an approaching object or hitting a moving target) require people to correct planning of future movements based on previous temporal errors. However, the actual temporal error can be difficult to perceive: imagine a baseball batter that swings and misses a fastball. Here we show that in such situations people can use an internal error signal to make corrections in the next trial. This signal is based on the discrepancy between the actual and the planned action onset time: the prediction error. In this study, we used three interception tasks: reaching movements, saccadic eye movements and a button press that released a cursor moving ballistically for a fixed time. We found that action onset depended on the previous temporal error in the arm movement experiment only and not in the saccadic and button press experiments. However, this dependency was modulated by the movement time: faster arm movements depended less on the previous actual temporal error. An analysis using a Kalman filter confirmed that people used the prediction error rather than the previous temporal error for trial-by-trial corrections in fast arm movements, saccades and button press.

Saccades under Mental Load in Infantile Nystagmus Syndrome and Controls

SIGNIFICANCE

This study compares saccades and visual task performance in patients with infantile nystagmus syndrome (INS) with that in normally sighted individuals under mental load. The results highlighted that to more completely evaluate INS therapies recognition time should also be measured with mental load, resembling real-world conditions.

PURPOSE

Patients with INS may complain of "being slow to see." Stress is reported to worsen nystagmus and to prolong visual recognition time. We hypothesized that the effects of mental load on timing indices of visual recognition, for example, saccade latency, target acquisition time, target viewing time, and subjects' reaction time, differ between the INS and control groups.

METHODS

Eye movements were recorded when participants (INS group, n = 15; controls, n = 25) reported the direction of tumbling-E targets presented randomly across ±25°. The task was repeated with both mental arithmetic and time restriction to impose high mental load, confirmed through subjective ratings and heart rate measurement.

RESULTS

Mental load increased saccade latency (mean, 32.69 milliseconds; 95% confidence interval [CI], 21.17 to 44.20 milliseconds; P < .001) and target acquisition time (57.00 milliseconds; 95% CI, 34 to 81 milliseconds; P < .001). Patients with INS showed longer saccade latency (39.79 milliseconds; 95% CI, 23.98 to 55.62 milliseconds; P < .001) and target acquisition time (134.00 milliseconds; 95% CI, 96 to 172 milliseconds; P < .001) compared with controls. The interaction between task and group was significant for saccade gain (0.11; 95% CI, 0.02 to 0.19; P = .015), target acquisition time (37.93 milliseconds; 95% CI, 36.91 to 38.96 milliseconds; P = .011), and subjects' reaction time (95.37 milliseconds; 95% CI, 65.91 to 124.84 milliseconds; P = .043). There was an inverse correlation between the changes in subjects' response errors and target viewing time with mental load only for controls (r = -0.484, P = .014). Total foveation exposure time and target viewing time remained unchanged.

CONCLUSIONS

Mental load worsens "being slow to see" in INS because of delayed target acquisition and possibly because efficiency of visual processing decreases more in patients with INS compared with controls. To investigate outcomes of INS therapies, visual recognition time should be also measured with mental load.

Discriminative control of saccade latencies

Recent studies have demonstrated that saccadic reaction times (SRTs) are influenced by the temporal regularities of dynamic environments (Vullings & Madelain, 2018). Here, we ask whether discriminative control (i.e., the possibility to use external stimuli signaling the future state of the environment) of latencies in a search task might be established using reinforcement contingencies. Eight participants made saccades within 80-750 ms toward a target displayed among distractors. We constructed two latency classes, "short" and "long," using the first and last quartiles of the individual baseline distributions. We then used a latency-contingent display paradigm in which finding the visual target among other items was made contingent upon specific SRTs. For a first group, the postsaccadic target was displayed only following short latencies with leftward saccades, and following long latencies with rightward saccades. The opposite was true for a second group. When short- and long-latency saccades were reinforced (i.e., the target was displayed) depending on the saccade direction, median latencies differed by 74 ms on average (all outside the 98% null hypothesis confidence intervals). Posttraining, in the absence of reinforcement, we still observed strong differences in latency distributions, averaging 64 ms for leftward versus rightward saccades. Our results demonstrate the discriminative control of SRTs, further supporting the effects of reinforcement learning for saccade. This study reveals that saccade triggering is finely controlled by learned temporal and spatial properties of the environment using predictive mechanisms.

High-Acuity Information Is Retained through the Cortical Visual Hierarchy of Primates

Vision requires perception of both coarse layout and fine details of objects. In this issue of Neuron, Lu et al. (2018) describe a possible basis for the latter: neuronal clusters in area V4 coding high-acuity information, despite the tendency along the visual hierarchy to generate global representations of objects.

Reinforcement reduces the size-latency phenomenon: A cost-benefit evaluation of saccade triggering

Saccadic latencies are known to change as a function of target eccentricity and size. Recently, it has been shown that latencies consistently change according to the amplitude of the step in proportion to the size of the target (Madelain, Krauzlis, & Wallman, 2005; Harwood, Madelain, Krauzlis, & Wallman, 2008; De Vries, Azadi, & Harwood, 2016). This effect, called the size-latency phenomenon, might be seen as a function of a cost-benefit relationship: Longer latencies might be explained by the lower benefit of making a saccade while the target mostly remains within the attentional field. Here, we probe this hypothesis by manipulating the cost-benefit relationship using a reinforcement procedure. Participants tracked a target stepping horizontally with varying amplitudes and sizes such that the step-to-size ratio was equal to either 0.3 or 1.5. We used a dynamic-reinforcement criterion in the blocked conditions. In the 0.3-ratio condition, any latency shorter than the criterion was reinforced. In the 1.5-ratio condition, any latency longer than the criterion was reinforced. During baseline, we observed the size-latency effect with large differences in latencies depending on the ratio in force (229 and 161 ms, respectively, for 0.3 and 1.5). After learning, distributions shifted toward the shorter or longer value (198 and 236 ms, respectively, for 0.3 and 1.5). On average, latencies decreased by 31 ms and increased by 75 ms according to the ongoing reinforcement contingencies. Our results indicate that reinforcement contingencies can considerably affect saccadic-latency distributions, and support the idea of a cost-benefit evaluation of saccade triggering.

Calibration of peripheral perception of shape with and without saccadic eye movements

The cortical representations of a visual object differ radically across saccades. Several studies claim that the visual system adapts the peripheral percept to better match the subsequent foveal view. Recently, Herwig, Weiß, and Schneider (2015, Annals of the New York Academy of Sciences, 1339(1), 97-105) found that the perception of shape demonstrates a saccade-dependent learning effect. Here, we ask whether this learning actually requires saccades. We replicated Herwig et al.'s (2015) study and introduced a fixation condition. In a learning phase, participants were exposed to objects whose shape systematically changed during a saccade, or during a displacement from peripheral to foveal vision (without a saccade). In a subsequent test, objects were perceived as less (more) curved if they previously changed from more circular (triangular) in the periphery to more triangular (circular) in the fovea. Importantly, this pattern was seen both with and without saccades. We then tested whether a variable delay between the presentations of the peripheral and foveal objects would affect their association-hypothetically weakening it at longer delays. Again, we found that shape judgments depended on the changes experienced during the learning phase and that they were similar in both the saccade and fixation conditions. Surprisingly, they were not affected by the delay between the peripheral and foveal presentations over the range we tested. These results suggest that a general associative process, independent of saccade execution, contributes to the perception of shape across viewpoints.

A review of eye tracking for understanding and improving diagnostic interpretation

Inspecting digital imaging for primary diagnosis introduces perceptual and cognitive demands for physicians tasked with interpreting visual medical information and arriving at appropriate diagnoses and treatment decisions. The process of medical interpretation and diagnosis involves a complex interplay between visual perception and multiple cognitive processes, including memory retrieval, problem-solving, and decision-making. Eye-tracking technologies are becoming increasingly available in the consumer and research markets and provide novel opportunities to learn more about the interpretive process, including differences between novices and experts, how heuristics and biases shape visual perception and decision-making, and the mechanisms underlying misinterpretation and misdiagnosis. The present review provides an overview of eye-tracking technology, the perceptual and cognitive processes involved in medical interpretation, how eye tracking has been employed to understand medical interpretation and promote medical education and training, and some of the promises and challenges for future applications of this technology.

Control of saccadic latency in a dynamic environment: allocation of saccades in time follows the matching law

When exploring the visual environment, one uses saccades to shift gaze and fixation to gather spatially and temporally localized information. We propose that the temporal structure of our environment should constrain the temporal allocation of saccades. Here we probe the possibility of learning to control saccadic latencies in a choice paradigm. Six participants made saccades within 80–300 ms following a target horizontally stepping by 10° between two fixed locations. For each participant we constructed two classes of latencies, “short” and “long,” using the first and last quartiles of the individual baseline distribution (e.g., [80;152] ms and [185;300] ms, respectively). We then concurrently reinforced each class in three blocked conditions across ~60 experimental sessions per participant, using different reinforcement probabilities such that the relative ratio of reinforcement rates for short vs. long latencies was 9/1, 1/9, or 1/1. Latency distributions followed the reinforcement conditions: distributions shifted toward the shorter or longer values or became strongly bimodal. Moreover, the relative rates of short over long latencies matched the relative rates of reinforcers earned for the corresponding latencies (slope up to 0.95), which reveals the ability to choose when to saccade. Our results reveal that learned contingencies considerably affect the allocation of saccades in time and are in line with recent studies on the temporal adjustment of behavior to dynamic environments. This study provides strong evidence for fine operant control of saccadic latency, supporting the hypothesis of a cost-benefit control of saccade latencies.

NEW & NOTEWORTHY Saccades may be regarded as an information-foraging behavior mostly concerned with the spatial localization of objects, yet our world is dynamic and environmental temporal regularities should also affect saccade decisions. We present behavioral data from a choice task establishing that humans can learn to choose their saccadic latencies depending on the reinforcement contingencies. This suggests a cost-benefit-based policy that takes into account the learned temporal properties of the environmental contingencies for controlling saccade triggering.

Saccadic foraging: reduced reaction time to informative targets

The study of saccadic reaction times has revealed a great deal about the neural mechanisms underlying neural decision, in terms of Bayesian factors such as prior probability and information supply. In addition, recent work has shown that saccades are faster to visual targets associated with conventional monetary or food rewards. However, because the purpose of saccades is to acquire information, it could be argued that this is an unnatural situation: the most natural and fundamental reward is the amount of information supplied by a target. Here, we report the results of a study investigating the hypothesis that a saccade to a target whose colour provides information about the location of a subsequent target is faster than to one that does not. We show that the latencies of saccades to a location that provides reliable information about the location of a future target are indeed shorter, their distributions being shifted in a way that implies that the rate of rise of the underlying decision signal is increased. In a race between alternative targets, this means that expected information will be an important factor in deciding where to look, so that 'foraging' saccades are more likely to be made to useful targets.

Disentangling the Role of Cortico-Basal Ganglia Loops in Top-Down and Bottom-Up Visual Attention: An Investigation of Attention Deficits in Parkinson Disease

It is solidly established that top-down (goal-driven) and bottom-up (stimulus-driven) attention mechanisms depend on distributed cortical networks, including prefrontal and frontoparietal regions. On the other hand, it is less clear whether the BG also contribute to one or the other of these mechanisms, or to both. The current study was principally undertaken to clarify this issue. Parkinson disease (PD), a neurodegenerative disorder primarily affecting the BG, has proven to be an effective model for investigating the contribution of the BG to different brain functions; therefore, we set out to investigate deficits of top-down and bottom-up attention in a selected cohort of PD patients. With this objective in mind, we compared the performance on three computerized tasks of two groups of 12 parkinsonian patients (assessed without any treatment), one otherwise pharmacologically treated and the other also surgically treated, with that of a group of controls. The main behavioral tool for our study was an attentional capture task, which enabled us to tap the competition between top-down and bottom-up mechanisms of visual attention. This task was suitably combined with a choice RT and a simple RT task to isolate any specific deficit of attention from deficits in motor response selection and initiation. In the two groups of patients, we found an equivalent increase of attentional capture but also comparable delays in target selection in the absence of any salient distractor (reflecting impaired top-down mechanisms) and movement initiation compared with controls. In contrast, motor response selection processes appeared to be prolonged only in the operated patients. Our results confirm that the BG are involved in both motor and cognitive domains. Specifically, damage to the BG, as it occurs in PD, leads to a distinct deficit of top-down control of visual attention, and this can account, albeit indirectly, for the enhancement of attentional capture, reflecting weakened ability of top-down mechanisms to antagonize bottom-up control.

Adaptation of naturally paced saccades

In the natural environment, humans make saccades almost continuously. In many eye movement experiments, however, observers are required to fixate for unnaturally long periods of time. The resulting long and monotonous experimental sessions can become especially problematic when collecting data in a clinical setting, where time can be scarce and subjects easily fatigued. With this in mind, we tested whether the well-studied motor learning process of saccade adaptation could be induced with a dramatically shortened intertrial interval. Observers made saccades to targets that stepped left or right either ∼250 ms or ∼1,600 ms after the saccade landed. In experiment I, we tested baseline saccade parameters to four different target amplitudes (5°, 10°, 15°, and 20°) in the two timing settings. In experiments II and III, we adapted 10° saccades via 2° intrasaccadic steps either backwards or forwards, respectively. Seven subjects performed eight separate adaptation sessions (2 intertrial timings × 2 adaptation direction × 2 session trial lengths). Adaptation proceeded remarkably similarly in both timing conditions across the multiple sessions. In the faster-paced sessions, robust adaptation was achieved in under 2 min, demonstrating the efficacy of our approach to streamlining saccade adaptation experiments. Although saccade amplitudes were similar between conditions, the faster-paced condition unexpectedly resulted in significantly higher peak velocities in all subjects. This surprising finding demonstrates that the stereotyped "main sequence" relationship between saccade amplitude and peak velocity is not as fixed as originally thought.

The influence of attention and target identification on saccadic eye movements depends on prior target location

Saccadic latency is reduced by a temporal gap between fixation point and target, by identification of a target feature, and by movement in a new direction (inhibition of saccadic return, ISR). A simple additive model was compared with a shared resources model that predicts a three-way interaction. Twenty naïve participants made horizontal saccades to targets left and right of fixation in a randomised block design. There was a significant three-way interaction among the factors on saccade latency. This was revealed in a two-way interaction between feature identification and the gap versus no gap factor which was only apparent when the saccade was in the same direction as the previous saccade. No interaction was apparent when the saccade was in the opposite direction. This result supports an attentional inhibitory effect that is present during ISR to a previous location which is only partly released by the facilitative effect of feature identification and gap. Together, anticipatory error data and saccade latency interactions suggest a source of ISR at a higher level of attention, possibly localised in the dorsolateral prefrontal cortex and involving tonic activation.

Saccade reaction time asymmetries during task-switching in pursuit tracking

We investigate how smooth pursuit eye movements affect the latencies of task-switching saccades. Participants had to alternate their foveal vision between a continuous pursuit task in the display center and a discrete object discrimination task in the periphery. The pursuit task was either carried out by following the target with the eyes only (ocular) or by steering an on-screen cursor with a joystick (oculomanual). We measured participants' saccadic reaction times (SRTs) when foveal vision was shifted from the pursuit task to the discrimination task and back to the pursuit task. Our results show asymmetries in SRTs depending on the movement direction of the pursuit target: SRTs were generally shorter in the direction of pursuit. Specifically, SRTs from the pursuit target were shorter when the discrimination object appeared in the motion direction. SRTs to pursuit were shorter when the pursuit target moved away from the current fixation location. This result was independent of the type of smooth pursuit behavior that was performed by participants (ocular/oculomanual). The effects are discussed in regard to asymmetries in attention and processes that suppress saccades at the onset of pursuit.

A model of reward- and effort-based optimal decision making and motor control

Costs (e.g. energetic expenditure) and benefits (e.g. food) are central determinants of behavior. In ecology and economics, they are combined to form a utility function which is maximized to guide choices. This principle is widely used in neuroscience as a normative model of decision and action, but current versions of this model fail to consider how decisions are actually converted into actions (i.e. the formation of trajectories). Here, we describe an approach where decision making and motor control are optimal, iterative processes derived from the maximization of the discounted, weighted difference between expected rewards and foreseeable motor efforts. The model accounts for decision making in cost/benefit situations, and detailed characteristics of control and goal tracking in realistic motor tasks. As a normative construction, the model is relevant to address the neural bases and pathological aspects of decision making and motor control.

Having to identify a target reduces antisaccade latencies in mixed saccadic paradigms: A top-down effect released by tonic prefrontal activation?

Instructing participants to "identify a target" dramatically reduces saccadic reaction times in prosaccade tasks (PS). However, it has been recently shown that this effect disappears in antisaccade tasks (AS). The instruction effect observed in PS may result from top-down processes, mediated by pathways connecting the prefrontal cortex (PFC) to the superior colliculus. In AS, the PFC's prior involvement is in competition with the instruction process, annulling its effect. This study aims to discover whether the instruction effect persists in mixed paradigms. According to Dyckman's fMRI study (2007), the difficulty of mixed tasks leads to PFC involvement. The antisaccade-related PFC activation observed on comparison of blocked AS and PS therefore disappears when the two are compared in mixed paradigms. However, we continued to observe the instruction effect for both PS and AS. We therefore posit different types of PFC activation: phasic during blocked AS, and tonic during mixed saccadic experiments.

Reinforcing saccadic amplitude variability

Saccadic endpoint variability is often viewed as the outcome of neural noise occurring during sensorimotor processing. However, part of this variability might result from operant learning. We tested this hypothesis by reinforcing dispersions of saccadic amplitude distributions, while maintaining constant their medians. In a first experiment we reinforced the least frequent saccadic amplitudes to increase variability, and then reinforced the central part of the amplitude distributions to reduce variability. The target was placed at a constant distance from the fovea after the saccade to maintain the postsaccadic visual signal constant and an auditory reinforcement was delivered depending on saccadic amplitude. The second experiment tested the effects of the contingency. We reinforced high levels of variability in 4 participants, whereas 4 other participants were assigned to a yoked control group. On average, saccadic amplitude standard deviations were doubled while the medians remained mostly unchanged in the experimental participants in both experiments, and variability returned to baseline level when low variability was reinforced. In the control group no consistent changes in amplitude distributions were observed. These results, showing that variability can be reinforced, challenge the idea of a stochastic neural noise. We instead propose that selection processes constrain saccadic amplitude distributions.

Modification of saccadic gain by reinforcement

Control of saccadic gain is often viewed as a simple compensatory process in which gain is adjusted over many trials by the postsaccadic retinal error, thereby maintaining saccadic accuracy. Here, we propose that gain might also be changed by a reinforcement process not requiring a visual error. To test this hypothesis, we used experimental paradigms in which retinal error was removed by extinguishing the target at the start of each saccade and either an auditory tone or the vision of the target on the fovea was provided as reinforcement after those saccades that met an amplitude criterion. These reinforcement procedures caused a progressive change in saccade amplitude in nearly all subjects, although the rate of adaptation differed greatly among subjects. When we reversed the contingencies and reinforced those saccades landing closer to the original target location, saccade gain changed back toward normal gain in most subjects. When subjects had saccades adapted first by reinforcement and a week later by conventional intrasaccadic step adaptation, both paradigms yielded similar degrees of gain changes and similar transfer to new amplitudes and to new starting positions of the target step as well as comparable rates of recovery. We interpret these changes in saccadic gain in the absence of postsaccadic retinal error as showing that saccade adaptation is not controlled by a single error signal. More generally, our findings suggest that normal saccade adaptation might involve general learning mechanisms rather than only specialized mechanisms for motor calibration.

Sensory processing of motor inaccuracy depends on previously performed movement and on subsequent motor corrections: a study of the saccadic system

When goal-directed movements are inaccurate, two responses are generated by the brain: a fast motor correction toward the target and an adaptive motor recalibration developing progressively across subsequent trials. For the saccadic system, there is a clear dissociation between the fast motor correction (corrective saccade production) and the adaptive motor recalibration (primary saccade modification). Error signals used to trigger corrective saccades and to induce adaptation are based on post-saccadic visual feedback. The goal of this study was to determine if similar or different error signals are involved in saccadic adaptation and in corrective saccade generation. Saccadic accuracy was experimentally altered by systematically displacing the visual target during motor execution. Post-saccadic error signals were studied by manipulating visual information in two ways. First, the duration of the displaced target after primary saccade termination was set at 15, 50, 100 or 800 ms in different adaptation sessions. Second, in some sessions, the displaced target was followed by a visual mask that interfered with visual processing. Because they rely on different mechanisms, the adaptation of reactive saccades and the adaptation of voluntary saccades were both evaluated. We found that saccadic adaptation and corrective saccade production were both affected by the manipulations of post-saccadic visual information, but in different ways. This first finding suggests that different types of error signal processing are involved in the induction of these two motor corrections. Interestingly, voluntary saccades required a longer duration of post-saccadic target presentation to reach the same amount of adaptation as reactive saccades. Finally, the visual mask interfered with the production of corrective saccades only during the voluntary saccades adaptation task. These last observations suggest that post-saccadic perception depends on the previously performed action and that the differences between saccade categories of motor correction and adaptation occur at an early level of visual processing.

Eye movements during transitive action observation have sequential structure

In this paper, we explore how observers of a reach-to-grasp action can identify and distinguish between the agent and patient (i.e. target) of the action. We investigate the hypothesis that there is a characteristic sequential structure to the observer's pattern of saccades, with the agent being fixated first, and then the target. We report an experiment which indicates that this sequence of saccades, while not ubiquitous, is overwhelmingly more likely than chance. The experiment also sheds some light on the mechanisms which allow the observer to saccade from the agent of the action to the target.

The intrinsic value of visual information affects saccade velocities

Let us assume that the purpose of any movement is to position our body in a more advantageous or rewarding state. For example, we might make a saccade to foveate an image because our brain assigns an intrinsic value to the information that it expects to acquire at the endpoint of that saccade. Different images might have different intrinsic values. Optimal control theory predicts that the intrinsic value that the brain assigns to targets of saccades should be reflected in the trajectory of the saccade. That is, in anticipation of foveating a highly valued image, our brain should produce a saccade with a higher velocity and shorter duration. Here, we considered four types of images: faces, objects, inverted faces, and meaningless visual noise. Indeed, we found that reflexive saccades that were made to a laser light in anticipation of viewing an image of a face had the highest velocities and shortest durations. The intrinsic value of visual information appears to have a small but significant influence on the motor commands that guide saccades.

Having to identify a target reduces latencies in prosaccades but not in antisaccades

In a princeps study, Trottier and Pratt (2005) showed that saccadic latencies were dramatically reduced when subjects were instructed to not simply look at a peripheral target (reflexive saccade) but to identify some of its properties. According to the authors, the shortening of saccadic reactions times may arise from a top-down disinhibition of the superior colliculus (SC), potentially mediated by the direct pathway connecting frontal/prefrontal cortex structures to the SC. Using a "cue paradigm" (a cue preceded the appearance of the target), the present study tests if the task instruction (Identify vs. Glance) also reduces the latencies of antisaccades (AS), which involve prefrontal structures. We show that instruction reduces latencies for prosaccade but not for AS. An AS requires two processes: the inhibition of a reflexive saccade and the generation of a voluntary saccade. To separate these processes and to better understand the task effect we also test the effect of the task instruction only on voluntary saccades. The effect still exists but it is much weaker than for reflexive saccades. The instruction effect closely depends on task demands in executive resources.

The spatial scale of attention strongly modulates saccade latencies

We have previously shown that when a stimulus consisting of two concentric rings moves, saccade latencies are much longer (by 150 ms) when attention is directed to the larger ring than to the smaller ring. Here, we investigated whether this effect can be explained by a deferral of the "cost" of making a saccade while the target remains inside the attentional field, or by purely visual factors (eccentricity or contrast). We found 1) latencies were shorter when attention was directed to small features irrespective of retinal eccentricity; 2) saccade latency distributions were systematically determined by the ratio between the amplitude of the stimulus step and the diameter of the attended ring: stimulus steps that were larger than the attended ring resulted in short latencies, whereas steps smaller than the attended ring resulted in proportionally longer and more variable latencies; 3) this effect was not seen in manual reaction times to the same target movement; and 4) suprathreshold changes in the contrast of targets, mimicking possible attentional effects on perceived contrast and saliency, had little effect on latency. We argue that the spatial scale of attention determines the urgency of saccade motor preparation processes by changing the rate and rate variability of the underlying decision signal, to defer the cost of saccades that result in little visual benefit.

Control of sensorimotor variability by consequences

Studies of reaction-time distributions provide a useful quantitative approach to understand decision processes at the neural level and at the behavioral level. A strong relationship between the spread of latencies and the median is generally accepted even though there has been no attempt to disentangle experimentally these two parameters. Here we test the ability to independently control the median and the variability in reaction times. Reaction times were measured in human subjects instructed to make a discrimination between a target and a distractor in a 2AFC task. In a first experiment, saccadic latencies were measured. In a second experiment, we used manual response reaction times. Subjects were trained to produce four different reaction-time distributions. A reinforcing feedback was given depending on both the variability and the median of the latency distributions. When low variability was reinforced, the standard deviation (SD) of reaction-time distributions were reduced by a factor of two and when high variability was reinforced, the SD returned to baseline level. Our procedure independently affected the spread and the median of the distribution patterns. By fitting the latency distributions using the Reddi and Carpenter LATER model, we found that these effects could be simulated by changing the distribution of the noise affecting the decision process. Our results demonstrate that learned contingencies can affect reaction time variability and support the view that the so-called noise level in decision processes can undergo long-term changes.