Oculomotor inhibition reflects temporal expectations

Eyes on the past: Gaze stability differs between temporal expectation and temporal attention

Temporal expectation and temporal attention distinctly improve performance and gaze stability, and interact at the behavioral and neural levels. Foreperiod-the interval between the preparatory signal and stimulus onset-facilitates temporal expectation. Preceding foreperiod-the foreperiod in the previous trial-modulates expectation at behavioral and oculomotor levels. Here, we investigated whether preceding foreperiod guides temporal attention. Regardless of the preceding foreperiod, temporal attention improved performance, particularly at early moments,and consistently accelerated gaze stability onset and offset by shifting microsaccade timing. However, only with preceding expected foreperiods, attention inhibited microsaccade rates. Moreover, preceding late foreperiods weakened expectation effects on microsaccade rates, but such a weakening was overridden by attention. Altogether, these findings reveal that the oculomotor system's flexibility does not translate to performance, and suggest that although selection history can be utilized as one of the sources of expectation in subsequent trials, it does not necessarily determine, strengthen, or guide attentional deployment.

Do microsaccades vary with discriminability around the visual field?

Microsaccades-tiny fixational eye movements-improve discriminability in high-acuity tasks in the foveola. To investigate whether they help compensate for low discriminability at the perifovea, we examined microsaccade characteristics relative to the adult visual performance field, which is characterized by two perceptual asymmetries: horizontal-vertical anisotropy (better discrimination along the horizontal than vertical meridian) and vertical meridian asymmetry (better discrimination along the lower than upper vertical meridian). We investigated whether and to what extent microsaccade directionality varies when stimuli are at isoeccentric locations along the cardinals under conditions of heterogeneous discriminability (Experiment 1) and homogeneous discriminability, equated by adjusting stimulus contrast (Experiment 2). Participants performed a two-alternative forced-choice orientation discrimination task. In both experiments, performance was better on trials without microsaccades between ready signal onset and stimulus offset than on trials with microsaccades. Across the trial sequence, the microsaccade rate and directional pattern were similar across locations. Our results indicate that microsaccades were similar regardless of stimulus discriminability and target location, except during the response period-once the stimuli were no longer present and target location no longer uncertain-when microsaccades were biased toward the target location. Thus, this study reveals that microsaccades do not flexibly adapt as a function of varying discriminability in a basic visual task around the visual field.

Task demand mediates the interaction of spatial and temporal attention

Psychophysical studies typically test attentional mechanisms in isolation, but in everyday life they interact to optimize human behavior. We investigated whether spatial and temporal attention interact in two orientation discrimination experiments that vary in task demand. We manipulated temporal and spatial attention separately and conjointly with well-established methods for testing each spatial or temporal attention. We assessed sensitivity (d') and reaction time for every combination of spatial and timing cues, each of which was valid, neutral, or invalid. Spatial attention modulated sensitivity (d') and speed (reaction time) across temporal attention conditions. Temporal attention modulated sensitivity and speed under high- but not low- task demands. Furthermore, spatial and temporal attention interacted for the high-demand task. This study reveals that task demand matters; in a simple task spatial attention suffices to improve performance, whereas in a more demanding task both spatial and temporal attention interact to boost performance, albeit in a subadditive fashion.

Exposure to temporal variability promotes subsequent adaptation to new temporal regularities

Noise is intuitively thought to interfere with perceptual learning; However, human and machine learning studies suggest that, in certain contexts, variability may reduce overfitting and improve generalizability. Whereas previous studies have examined the effects of variability in learned stimuli or tasks, it is hitherto unknown what are the effects of variability in the temporal environment. Here, we examined this question in two groups of adult participants (N = 40) presented with visual targets at either random or fixed temporal routines and then tested on the same type of targets at a new nearly-fixed temporal routine. Findings reveal that participants of the random group performed better and adapted quicker following a change in the timing routine, relative to participants of the fixed group. Corroborated with eye-tracking and computational modeling, these findings suggest that prior exposure to temporal variability promotes the formation of new temporal expectations and enhances generalizability in a dynamic environment. We conclude that noise plays an important role in promoting perceptual learning in the temporal domain: rather than interfering with the formation of temporal expectations, noise enhances them. This counterintuitive effect is hypothesized to be achieved through eliminating overfitting and promoting generalizability.

When temporal attention interacts with expectation

Temporal attention is voluntarily deployed at specific moments, whereas temporal expectation is deployed according to timing probabilities. When the target appears at an expected moment in a sequence, temporal attention improves performance at the attended moments, but the timing and the precision of the attentional window remain unknown. Here we independently and concurrently manipulated temporal attention-via behavioral relevance-and temporal expectation-via session-wise precision and trial-wise hazard rate-to investigate whether and how these mechanisms interact to improve perception. Our results reveal that temporal attention interacts with temporal expectation-the higher the precision, the stronger the attention benefit, but surprisingly this benefit decreased with delayed onset despite the increasing probability of stimulus appearance. When attention was suboptimally deployed to earlier than expected moments, it could not be reoriented to a later time point. These findings provide evidence that temporal attention and temporal expectation are different mechanisms, and highlight their interplay in optimizing visual performance.

Microsaccades reflect attention shifts: a mini review of 20 years of microsaccade research

Microsaccades are small, involuntary eye movements that occur during fixation. Since the 1950s, researchers have conducted extensive research on the role of microsaccades in visual information processing, and found that they also play an important role in human advanced visual cognitive activities. Research over the past 20 years further suggested that there is a close relationship between microsaccades and visual attention, yet lacking a timely review. The current article aims to provide a state-of-the-art review and bring microsaccades studies into the sight of attention research. We firstly introduce basic characteristics about microsaccades, then summarized the empirical evidence supporting the view that microsaccades can reflect both external (perception) and internal (working memory) attention shifts. We finally conclude and highlight three promising avenues for future research.

Temporal unpredictability increases error monitoring as revealed by EEG-EMG investigation

Reacting in an unpredictable context increases error monitoring as evidenced by greater error-related negativity (ERN), an electrophysiological marker linked to an evaluation of response outcomes. We investigated whether ERN also increased when participants evaluated their responses to events that appeared in unpredictable versus predictable moments in time. We complemented electroencephalographic (EEG) analysis of cortical activity by measuring performance monitoring processes at the peripheral level using electromyography (EMG). Specifically, we used EMG data to quantify how temporal unpredictability would affect motor time (MT), the interval between the onset of muscle activity, and the mechanical response. MT increases following errors, indexing online error detection, and an attempt to stop incorrect actions. In our temporally cued version of the stop-signal task, symbolic cues predicted (temporally predictable condition) or not (temporally unpredictable condition) the onset of a target. In 25% of trials, an auditory signal occurred shortly after the target presentation, informing participants that they should inhibit their response completely. Response times were slower, and fewer inhibitory errors were made during temporally unpredictable than predictable trials, indicating enhanced control of unwanted actions when target onset time was unknown. Importantly, the ERN to inhibitory errors was greater in temporally unpredictable relative to temporally predictable conditions. Similarly, EMG data revealed prolonged MT when reactions to temporally unpredictable targets had not been stopped. Taken together, our results show that a temporally unpredictable environment increases the control of unwanted actions, both at cortical and peripheral levels, suggesting a higher subjective cost of maladaptive responses to temporally uncertain events.

Oculomotor inhibition markers of working memory load

Involuntary eye movements occur constantly even during fixation and were shown to convey information about cognitive processes. They are inhibited momentarily in response to external stimuli (oculomotor inhibition, OMI), with a time and magnitude that depend on stimulus saliency, attention, and expectations. It was recently shown that the working memory load for numbers modulates the microsaccade rate; however, the generality of the effect and its temporal properties remain unclear. Our goal was to investigate the relationship between OMI and the working memory load for simple colored shapes. Participants (N = 26) maintained their fixation while their eyes were tracked; they viewed briefly flashed colored shapes accompanied by small arrows indicating the shapes to be memorized (1/2/3). After a retention period, a probe shape appeared for matching. The microsaccade rate modulation and temporal properties were analyzed for the memory encoding, maintenance, and retrieval phases. Microsaccade inhibition was stronger when more shapes were memorized, and performance improved when microsaccades were suppressed during maintenance and retrieval. This occurred even though the physical stimuli were identical in number under all conditions. Thus, oculomotor inhibition may play a role in silencing the visual input while processing current stimuli and is generally related to processing time and load.

Do microsaccades vary with discriminability around the visual field?

Microsaccades-tiny fixational eye movements- improve discriminability in high acuity tasks in the foveola. To investigate whether they help compensate for low discriminability at perifovea, we examined MS characteristics relative to the adult visual performance field, which is characterized by two perceptual asymmetries: Horizontal-Vertical Anisotropy (better discrimination along the horizontal than vertical meridian), and Vertical Meridian Asymmetry (better discrimination along the lower- than upper-vertical meridian). We investigated whether and to what extent microsaccade directionality varies when stimuli are at isoeccentric locations along the cardinals under conditions of heterogeneous discriminability (Experiment 1) and homogeneous discriminability, equated by adjusting stimulus contrast (Experiment 2). Participants performed a two-alternative forced-choice orientation discrimination task. In both experiments, performance was better on trials without microsaccades between ready signal onset and stimulus offset than on trials with microsaccades. Across the trial sequence the microsaccade rate and directional pattern were similar across locations. Our results indicate that microsaccades were similar regardless of stimulus discriminability and target location, except during the response period-once the stimuli were no longer present and target location no longer uncertain-when microsaccades were biased toward the target location. Thus, this study reveals that microsaccades do not flexibly adapt as a function of varying discriminability in a basic visual task around the visual field.

Microsaccades Track Location-Based Object Rehearsal in Visual Working Memory

Besides controlling eye movements, the brain's oculomotor system has been implicated in the control of covert spatial attention and the rehearsal of spatial information in working memory. We investigated whether the oculomotor system also contributes to rehearsing visual objects in working memory when object location is never asked about. To address this, we tracked the incidental use of locations for mnemonic rehearsal via directional biases in microsaccades while participants maintained two visual objects (colored oriented gratings) in working memory. By varying the stimulus configuration (horizontal, diagonal, and vertical) at encoding, we could quantify whether microsaccades were more aligned with the configurational axis of the memory contents, as opposed to the orthogonal axis. Experiment 1 revealed that microsaccades continued to be biased along the axis of the memory content several seconds into the working memory delay. In Experiment 2, we confirmed that this directional microsaccade bias was specific to memory demands, ruling out lingering effects from passive and attentive encoding of the same visual objects in the same configurations. Thus, by studying microsaccade directions, we uncover oculomotor-driven rehearsal of visual objects in working memory through their associated locations.

The Motor of Time: Coupling Action to Temporally Predictable Events Heightens Perception

Timing and motor function share neural circuits and dynamics, which underpin their close and synergistic relationship. For instance, the temporal predictability of a sensory event optimizes motor responses to that event. Knowing when an event is likely to occur lowers response thresholds, leading to faster and more efficient motor behavior though in situations of response conflict can induce impulsive and inappropriate responding. In turn, through a process of active sensing, coupling action to temporally predictable sensory input enhances perceptual processing. Action not only hones perception of the event's onset or duration, but also boosts sensory processing of its non-temporal features such as pitch or shape. The effects of temporal predictability on motor behavior and sensory processing involve motor and left parietal cortices and are mediated by changes in delta and beta oscillations in motor areas of the brain.

Sequential effect and temporal orienting in prestimulus oculomotor inhibition

When faced with unfamiliar circumstances, we often turn to our past experiences with similar situations to shape our expectations. This results in the well-established sequential effect, in which previous trials influence the expectations of the current trial. Studies have revealed that, in addition to the classical behavioral metrics, the inhibition of eye movement could be used as a biomarker to study temporal expectations. This prestimulus oculomotor inhibition is found a few hundred milliseconds prior to predictable events, with a stronger inhibition for predictable than unpredictable events. The phenomenon has been found to occur in various temporal structures, such as rhythms, cue-association, and conditional probability, yet it is still unknown whether it reflects local sequential information of the previous trial. To explore this, we examined the relationship between the sequential effect and the prestimulus oculomotor inhibition. Our results (N = 40) revealed that inhibition was weaker when the previous trial was longer than the current trial, in line with findings of behavioral metrics. These findings indicate that the prestimulus oculomotor inhibition covaries with expectation based on local sequential information, demonstrating the tight connection between this phenomenon and expectation and providing a novel measurement for studying sequential effects in temporal expectation.

Visual perceptual learning modulates microsaccade rate and directionality

Microsaccades, incessant "fixational eye movements" (< 1°), are an important window into cognitive functions. Yet, its role in visual perceptual learning (VPL)-improvements in visual discrimination due to practice-remains practically unexplored. Here we investigated whether and how microsaccades change in VPL. Human observers performed a Landolt acuity task for 5 consecutive days and were assigned to the Neutral or Attention group. On each trial, two peripheral Landolt squares were presented briefly along a diagonal. Observers reported the gap side of the target stimulus. Training improved acuity and modified the microsaccade rate; with training, the rate decreased during the fixation period but increased during the response cue. Furthermore, microsaccade direction during the response cue was biased toward the target location, and training enhanced and sped up this bias. Finally, the microsaccade rate during a task-free fixation period correlated with observers' initial acuity threshold, indicating that the fewer the microsaccades during fixation the better the individual visual acuity. All these results, which were similar for both the Neutral and Attention groups and at both trained and untrained locations, suggest that microsaccades could serve as a physiological marker reflecting functional dynamics in human perceptual learning.

Prior knowledge about events depicted in scenes decreases oculomotor exploration

The visual input that the eyes receive usually contains temporally continuous information about unfolding events. Therefore, humans can accumulate knowledge about their current environment. Typical studies on scene perception, however, involve presenting multiple unrelated images and thereby render this accumulation unnecessary. Our study, instead, facilitated it and explored its effects. Specifically, we investigated how recently-accumulated prior knowledge affects gaze behavior. Participants viewed sequences of static film frames that contained several 'context frames' followed by a 'critical frame'. The context frames showed either events from which the situation depicted in the critical frame naturally followed, or events unrelated to this situation. Therefore, participants viewed identical critical frames while possessing prior knowledge that was either relevant or irrelevant to the frames' content. In the former case, participants' gaze behavior was slightly more exploratory, as revealed by seven gaze characteristics we analyzed. This result demonstrates that recently-gained prior knowledge reduces exploratory eye movements.

Electrophysiological signatures of temporal context in the bisection task

Despite having relatively accurate timing, subjective time can be influenced by various contexts, such as stimulus spacing and sample frequency. Several electroencephalographic (EEG) components have been associated with timing, including the contingent negative variation (CNV), offset P2, and late positive component of timing (LPCt). However, the specific role of these components in the contextual modulation of perceived time remains unclear. In this study, we conducted two temporal bisection experiments to investigate this issue. Participants had to judge whether a test duration was close to a short or long standard. Unbeknownst to them, we manipulated the stimulus spacing (Experiment 1) and sample frequency (Experiment 2) to create short and long contexts while maintaining consistent test ranges and standards across different sessions. The results revealed that the bisection threshold shifted towards the ensemble mean, and both CNV and LPCt were sensitive to context modulation. In the short context, the CNV exhibited an increased climbing rate compared to the long context, whereas the LPCt displayed reduced amplitude and latency. These findings suggest that the CNV represents an expectancy wave preceding a temporal decision process, while the LPCt reflects the decision-making process itself, with both components influenced by the temporal context.

Microsaccades and temporal attention at different locations of the visual field

Temporal attention, the prioritization of information at specific points in time, improves performance in behavioral tasks but cannot ameliorate the perceptual asymmetries that exist across the visual field. That is, even after attentional deployment, performance is better along the horizontal than vertical meridian and worse at the upper than lower vertical meridian. Here we asked whether and how microsaccades-tiny fixational eye-movements-could mirror or alternatively attempt to compensate for these performance asymmetries by assessing temporal profiles and direction of microsaccades as a function of visual field location. Observers were asked to report the orientation of one of two targets presented at different time points, in one of three blocked locations (fovea, right horizontal meridian, upper vertical meridian). We found the following: (1) Microsaccade occurrence did not affect either task performance or the magnitude of the temporal attention effect. (2) Temporal attention modulated the microsaccade temporal profiles, and this modulation varied with polar angle location. At all locations, microsaccade rates were significantly more suppressed in anticipation of the target when temporally cued than in the neutral condition. Moreover, microsaccade rates were more suppressed during target presentation in the fovea than in the right horizontal meridian. (3) Across locations and attention conditions, there was a pronounced bias toward the upper hemifield. Overall, these results reveal that temporal attention benefits performance similarly around the visual field, microsaccade suppression is more pronounced for attention than expectation (neutral trials) across locations, and the directional bias toward the upper hemifield could reflect an attempt to compensate for typical poor performance at the upper vertical meridian.

Microsaccades transiently lateralise EEG alpha activity

The lateralisation of 8-12 Hz alpha activity is a canonical signature of human spatial cognition that is typically studied under strict fixation requirements. Yet, even during attempted fixation, the brain produces small involuntary eye movements known as microsaccades. Here we report how spontaneous microsaccades - made in the absence of incentives to look elsewhere - can themselves drive transient lateralisation of EEG alpha power according to microsaccade direction. This transient lateralisation of posterior alpha power occurs similarly following start and return microsaccades and is, at least for start microsaccades, driven by increased alpha power ipsilateral to microsaccade direction. This reveals new links between spontaneous microsaccades and human electrophysiological brain activity. It highlights how microsaccades are an important factor to consider in studies relating alpha activity - including spontaneous fluctuations in alpha activity - to spatial cognition, such as studies on visual attention, anticipation, and working memory.

Enhanced temporal resolution of vision in action video game players

Video game play has been suggested to improve visual and attention processing. Nevertheless, while action video game play is highly dynamic, there is scarce research on how information is temporally discriminated at the millisecond level. This cross-sectional study investigates whether temporal discrimination at the millisecond level in vision varies across action video game players (VGPs; N = 23) and non-video game players (NVGPs; N = 23). Participants discriminated synchronous from asynchronous onsets of two visual targets in virtual reality, while their EEG and oculomotor movements were recorded. Results show an increased sensitivity to short asynchronies (11, 33 and 66 ms) in VGPs compared with NVGPs, which was especially marked at the start of the task, suggesting better temporal discrimination abilities. Pre-targets oculomotor freezing - the inhibition of small fixational saccades - was associated with correct temporal discrimination, probably revealing attentional preparation. However, this parameter did not differ between groups. EEG and reconstruction analyses suggest that the enhancement of temporal discrimination in VGPs during temporal discrimination is related to parieto-occipital processing, and a reduction of alpha-band (8-14 Hz) power and inter-trial phase coherence. Overall, the study reveals an enhanced ability in action video game players to discriminate in time visual events in close temporal proximity combined with reduced alpha-band oscillatory activities. Consequently, playing action video games is associated with an improved temporal resolution of vision.

Exogenous temporal attention varies with temporal uncertainty

Temporal attention is the selection and prioritization of information at a specific moment. Exogenous temporal attention is the automatic, stimulus driven deployment of attention. The benefits and costs of exogenous temporal attention on performance have not been isolated. Previous experimental designs have precluded distinguishing the effects of attention and expectation about stimulus timing. Here, we manipulated exogenous temporal attention and the uncertainty of stimulus timing independently and investigated visual performance at the attended and unattended moments with different levels of temporal uncertainty. In each trial, two Gabor patches were presented consecutively with a variable stimulus onset. To drive exogenous attention and test performance at attended and unattended moments, a task-irrelevant, brief cue was presented 100 ms before target onset, and an independent response cue was presented at the end of the trial. Exogenous temporal attention slightly improved accuracy, and the effects varied with temporal uncertainty, suggesting a possible interaction of temporal attention and expectations in time.

Microsaccades as a long-term oculomotor correlate in visual perceptual learning

Human perceptual learning, experience-induced gains in sensory discrimination, typically yields long-term performance improvements. Recent research revealed long-lasting transfer at the untrained location enabled by feature-based attention (FBA), reminiscent of its global effect (Hung & Carrasco, Scientific Reports, 11(1), 13914, (2021)). Visual Perceptual Learning (VPL) is typically studied while observers maintain fixation, but the role of fixational eye movements is unknown. Microsaccades - the largest of fixational eye movements - provide a continuous, online, physiological measure from the oculomotor system that reveals dynamic processing, which is unavailable from behavioral measures alone. We investigated whether and how microsaccades change after training in an orientation discrimination task. For human observers trained with or without FBA, microsaccade rates were significantly reduced during the response window in both trained and untrained locations and orientations. Critically, consistent with long-term training benefits, this microsaccade-rate reduction persisted over a year. Furthermore, microsaccades were biased toward the target location prior to stimulus onset and were more suppressed for incorrect than correct trials after observers' responses. These findings reveal that fixational eye movements and VPL are tightly coupled and that learning-induced microsaccade changes are long lasting. Thus, microsaccades reflect functional dynamics of the oculomotor system during information encoding, maintenance and readout, and may serve as a reliable long-term physiological correlate in VPL.

Temporal attention affects contrast response function by response gain

Orienting attention to a specific point in time has been shown to improve the contrast sensitivity at the attended time point and impair it earlier or later. This phenomenon could be explained by temporal attention increasing the effective contrast of the target presented at the attended time point which leads to changes in contrast psychometric function by contrast gain. Another explanation is that temporal attention multiplicatively amplifies the amplitude of behavioral or neural response to contrast, resulting in alterations in contrast psychometric function by response gain. To explore the underlying mechanism, we adopted a temporal cueing orientation discrimination task using audio pre-cues composed of different frequency components to induce different attentional allocations in the time domain and targets of various contrast intensities to measure contrast psychometric functions. Obtained psychometric functions for contrast sensitivity were fitted for different conditions with discrepant attentional states in time. We found that temporal attention manipulated by cue affected contrast psychometric function by response gain, indicating that multiplying the contrast response of the visual target occurring at the selected point in time by a fixed factor is a crucial way for temporal attention to modulate perceptual processing.

Neurocognitive analyses reveal that video game players exhibit enhanced implicit temporal processing

Winning in action video games requires to predict timed events in order to react fast enough. In these games, repeated waiting for enemies may help to develop implicit (incidental) preparation mechanisms. We compared action video game players and non-video game players in a reaction time task involving both implicit time preparations and explicit (conscious) temporal attention cues. Participants were immersed in virtual reality and instructed to respond to a visual target appearing at variable delays after a warning signal. In half of the trials, an explicit cue indicated when the target would occur after the warning signal. Behavioral, oculomotor and EEG data consistently indicate that, compared with non-video game players, video game players better prepare in time using implicit mechanisms. This sheds light on the neglected role of implicit timing and related electrophysiological mechanisms in gaming research. The results further suggest that game-based interventions may help remediate implicit timing disorders found in psychiatric populations.

A cross-sectional EEG study reveals that individuals who consistently play action video games exhibit improved performance in a reaction time task involving implicit time preparations, compared with participants who did not normally play video games

Non-zero mean alpha oscillations revealed with computational model and empirical data

Ongoing oscillations and evoked responses are two main types of neuronal activity obtained with diverse electrophysiological recordings (EEG/MEG/iEEG/LFP). Although typically studied separately, they might in fact be closely related. One possibility to unite them is to demonstrate that neuronal oscillations have non-zero mean which predicts that stimulus- or task-triggered amplitude modulation of oscillations can contribute to the generation of evoked responses. We validated this mechanism using computational modelling and analysis of a large EEG data set. With a biophysical model, we indeed demonstrated that intracellular currents in the neuron are asymmetric and, consequently, the mean of alpha oscillations is non-zero. To understand the effect that neuronal currents exert on oscillatory mean, we varied several biophysical and morphological properties of neurons in the network, such as voltage-gated channel densities, length of dendrites, and intensity of incoming stimuli. For a very large range of model parameters, we observed evidence for non-zero mean of oscillations. Complimentary, we analysed empirical rest EEG recordings of 90 participants (50 young, 40 elderly) and, with spatio-spectral decomposition, detected at least one spatially-filtred oscillatory component of non-zero mean alpha oscillations in 93% of participants. In order to explain a complex relationship between the dynamics of amplitude-envelope and corresponding baseline shifts, we performed additional simulations with simple oscillators coupled with different time delays. We demonstrated that the extent of spatial synchronisation may obscure macroscopic estimation of alpha rhythm modulation while leaving baseline shifts unchanged. Overall, our results predict that amplitude modulation of neural oscillations should at least partially explain the generation of evoked responses. Therefore, inference about changes in evoked responses with respect to cognitive conditions, age or neuropathologies should be constructed while taking into account oscillatory neuronal dynamics.

Fixation-related saccadic inhibition in free viewing in response to stimulus saliency

Microsaccades that occur during fixation were studied extensively in response to transient stimuli, showing a typical inhibition (Oculomotor Inhibition, OMI), and a later release with a latency that depends on stimulus saliency, attention, and expectations. Here, we investigated the hypothesis that in free viewing every saccade provides a new transient stimulation that should result in a stimulus-dependent OMI like a flashed presentation during fixation. Participants (N = 16) freely inspected static displays of randomly oriented Gabor texture images, with varied contrast and spatial frequency (SF) for periods of 10 s each. Eye tracking recordings were divided into epochs triggered by saccade landing (> 1 dva), and microsaccade latency relative to fixation onset was computed (msRT). We found that the msRT in free viewing was shorter for more salient stimuli (higher contrast or lower SF), as previously found for flashed stimuli. It increased with saccade size and decreased across successive saccades, but only for higher contrast, suggesting contrast-dependent repetition enhancement in free viewing. Our results indicate that visual stimulus-dependent inhibition of microsaccades also applies to free viewing. These findings are in agreement with the similarity found between event-related and fixation-related potentials and open the way for studies combining both approaches to study natural vision.

Involuntary oculomotor inhibition markers of saliency and deviance in response to auditory sequences

Our eyes move constantly but are often inhibited momentarily in response to external stimuli (oculomotor inhibition [OMI]), depending on the stimulus saliency, anticipation, and attention. Previous studies have shown prolonged OMI for auditory oddballs; however, they required counting the oddballs, possibly reflecting voluntary attention. Here, we investigated whether the “passive” OMI response to auditory deviants can provide a quantitative measure of deviance strength (pitch difference) and studied its dependence on the inter-trial interval (ITI). Participants fixated centrally and passively listened to repeated short sequences of pure tones that contained a deviant tone either regularly or with 20% probability (oddballs). In an “active” control experiment, participants counted the deviant or the standard. As in previous studies, the results showed prolonged microsaccade inhibition and increased pupil dilation following the rare deviant tone. Earlier inhibition onset was found in proportion to the pitch deviance (the saliency effect), and a later release was found for oddballs, but only for ITI <2.5 seconds. The active control experiment showed similar results when counting the deviant but longer OMI for the standard when counting it. Taken together, these results suggest that OMI provides involuntary markers of saliency and deviance, which can be obtained without the participant's response.

Oculomotor freezing indicates conscious detection free of decision bias

The appearance of a salient stimulus rapidly and automatically inhibits saccadic eye movements. Curiously, this "oculomotor freezing" response is triggered only by stimuli that the observer reports seeing. It remains unknown, however, whether oculomotor freezing is linked to the observer's sensory experience or their decision that a stimulus was present. To dissociate between these possibilities, we manipulated decision criterion via monetary payoffs and stimulus probability in a detection task. These manipulations greatly shifted observers' decision criteria but did not affect the degree to which microsaccades were inhibited by stimulus presence. Moreover, the link between oculomotor freezing and explicit reports of stimulus presence was stronger when the criterion was conservative rather than liberal. We conclude that the sensory threshold for oculomotor freezing is independent of decision bias. Provided that conscious experience is also unaffected by such bias, oculomotor freezing is an implicit indicator of sensory awareness.NEW & NOTEWORTHY Sometimes a visual stimulus reaches awareness, and sometimes it does not. To understand why, we need objective, bias-free measures of awareness. We discovered that a reflexive freezing of small eye movements indicates when an observer detects a stimulus. Furthermore, when we biased observers' decisions to report seeing the stimulus, the oculomotor response was unaltered. This suggests that the threshold for conscious perception is independent of the decision criterion and is revealed by oculomotor freezing.

Expectations of the timing and intensity of a stimulus propagate to the auditory periphery through the medial olivocochlear reflex

Expectations concerning the timing of a stimulus enhance attention at the time at which the event occurs, which confers significant sensory and behavioral benefits. Herein, we show that temporal expectations modulate even the sensory transduction in the auditory periphery via the descending pathway. We measured the medial olivocochlear reflex (MOCR), a sound-activated efferent feedback that controls outer hair cell motility and optimizes the dynamic range of the sensory system. MOCR was noninvasively assessed using otoacoustic emissions. We found that the MOCR was enhanced by a visual cue presented at a fixed interval before a sound but was unaffected if the interval was changing between trials. The MOCR was also observed to be stronger when the learned timing expectation matched with the timing of the sound but remained unvaried when these two factors did not match. This implies that the MOCR can be voluntarily controlled in a stimulus- and goal-directed manner. Moreover, we found that the MOCR was enhanced by the expectation of a strong but not a weak, sound intensity. This asymmetrical enhancement could facilitate antimasking and noise protective effects without disrupting the detection of faint signals. Therefore, the descending pathway conveys temporal and intensity expectations to modulate auditory processing.

Combined influences of strategy and selection history on attentional control

Visual attention is guided by top-down mechanisms and pre-stimulus task preparation, but also by selection history (i.e., the bias to prioritize previously attended items). Here we examine how these influences combine. Two groups of participants completed two intermingled tasks. One task involved categorization of a unique target; one group categorized the target based on color, and the other based on shape. The other task involved searching for a target defined by unique shape while ignoring a distractor defined by unique color. Our expectation was that the search task would be difficult for the color-categorization group because their categorization task required attentional resolution of color, but the search task required that they ignore color. In some experimental blocks, trials from the two tasks appeared predictably, giving the color-categorization group an opportunity to strategically prepare by switching between color-prioritizing and shape-prioritizing attentional templates. We looked to pre-stimulus oscillatory activity as a direct index of this preparation, and to reaction times and post-stimulus ERPs for markers of resultant change in attentional deployment. Results showed that preparation in the color-categorization group optimized attentional templates, such that these participants became less sensitive to the color distractor in the search task. But preparation was not sufficient to entirely negate the influence of selection history, and participants in the color-categorization group continued to show a propensity to attend to the color distractor. These results indicate that preparatory effort can be scaled to the anticipated attentional requirements, but attention is nevertheless considerably biased by selection history.

Microsaccadic Eye Movements but not Pupillary Dilation Response Characterizes the Crossmodal Freezing Effect

In typical spatial orienting tasks, the perception of crossmodal (e.g., audiovisual) stimuli evokes greater pupil dilation and microsaccade inhibition than unisensory stimuli (e.g., visual). The characteristic pupil dilation and microsaccade inhibition has been observed in response to "salient" events/stimuli. Although the "saliency" account is appealing in the spatial domain, whether this occurs in the temporal context remains largely unknown. Here, in a brief temporal scale (within 1 s) and with the working mechanism of involuntary temporal attention, we investigated how eye metric characteristics reflect the temporal dynamics of perceptual organization, with and without multisensory integration. We adopted the crossmodal freezing paradigm using the classical Ternus apparent motion. Results showed that synchronous beeps biased the perceptual report for group motion and triggered the prolonged sound-induced oculomotor inhibition (OMI), whereas the sound-induced OMI was not obvious in a crossmodal task-free scenario (visual localization without audiovisual integration). A general pupil dilation response was observed in the presence of sounds in both visual Ternus motion categorization and visual localization tasks. This study provides the first empirical account of crossmodal integration by capturing microsaccades within a brief temporal scale; OMI but not pupillary dilation response characterizes task-specific audiovisual integration (shown by the crossmodal freezing effect).

Microsaccades and attention in a high-acuity visual alignment task

While aiming and shooting, we make tiny eye movements called microsaccades that shift gaze between task-relevant objects within a small region of the visual field. However, in the brief period before pressing the trigger, microsaccades are suppressed. This might be due to the lack of a requirement to shift gaze as the retinal images of the two objects begin to overlap on the fovea. Alternatively, we might actively suppress microsaccades to prevent any disturbances in visual perception caused by microsaccades around the time of their occurrence and their subsequent effect on shooting performance. In this study we looked at microsaccade rates while participants performed a simulated shooting task under two conditions: a normal condition in which they moved their eyes freely, and an eccentric condition in which they maintained gaze on a fixed target while performing the shooting task at 5° eccentricity. As expected, microsaccade rate dropped near the end of the task in the normal viewing condition. However, we also found the same decrease for the eccentric condition in which microsaccades did not shift gaze between the task objects. Microsaccades are also produced in response to shifts in covert attention. To test whether disengagement of covert attention from the eccentric shooting location caused the drop in microsaccade rate, we monitored the location of participants' spatial attention by using a Rapid Serial Visual Presentation (RSVP) task simultaneously at a location opposite to the shooting task. Target letter detection at the RSVP location did not improve during the drop in microsaccade rate, suggesting that covert attention was maintained at the shooting task location. We conclude that in addition to their usual gaze-shifting function, microsaccades during fine-acuity tasks might be modulated by cognitive processes other than spatial attention.

Prestimulus inhibition of eye movements reflects temporal expectation rather than time estimation

Eye movements are inhibited prior to the occurrence of temporally predictable events. This 'oculomotor inhibition effect' has been demonstrated with various tasks and modalities. Specifically, it was shown that when intervals between cue and target are fixed, saccade rate prior to the target is lower than when they are varied. However, it is still an open question whether this effect is linked to temporal expectation to the predictable target, or to the duration estimation of the interval preceding it. Here, we examined this question in 20 participants while they performed an implicit temporal expectation and an explicit time estimation task. In each trial, following cue onset, two consecutive grating patches were presented, each preceded by an interval. Temporal expectation was manipulated by setting the first interval duration to be either fixed or varied within each block. Participants were requested to compare either the durations of the two intervals (time estimation), or the tilts of the two grating patches (temporal expectation). Saccade rate, measured prior to the first grating, was lower in the fixed relative to the varied condition of both tasks. This suggests that the inhibition effect is elicited by target predictability and indicates that it is linked to temporal expectation, rather than to time estimation processes. Additionally, this finding suggests that the oculomotor inhibition is independent of motor readiness, as it was elicited even when no response was required. We conclude that the prestimulus oculomotor inhibition effect can be used as a marker of temporal expectation, and discuss its potential underlying mechanisms.

Learning to silence saccadic suppression

Sensory systems often suppress self-generated sensations in order to discriminate them from those arising in the environment. The suppression of visual sensitivity during rapid eye movements is well established, and although functionally beneficial most of the time, it can limit the performance of certain tasks. Here, we show that with repeated practice, mechanisms that suppress visual signals during eye movements can be modified. People trained to detect brief visual patterns learn to turn off suppression around the expected time of the target. These findings demonstrate an elegant form of plasticity, capable of improving the visibility of behaviorally relevant stimuli without compromising the wider functional benefits of suppression.

Perceptual stability is facilitated by a decrease in visual sensitivity during rapid eye movements, called saccadic suppression. While a large body of evidence demonstrates that saccadic programming is plastic, little is known about whether the perceptual consequences of saccades can be modified. Here, we demonstrate that saccadic suppression is attenuated during learning on a standard visual detection-in-noise task, to the point that it is effectively silenced. Across a period of 7 days, 44 participants were trained to detect brief, low-contrast stimuli embedded within dynamic noise, while eye position was tracked. Although instructed to fixate, participants regularly made small fixational saccades. Data were accumulated over a large number of trials, allowing us to assess changes in performance as a function of the temporal proximity of stimuli and saccades. This analysis revealed that improvements in sensitivity over the training period were accompanied by a systematic change in the impact of saccades on performance—robust saccadic suppression on day 1 declined gradually over subsequent days until its magnitude became indistinguishable from zero. This silencing of suppression was not explained by learning-related changes in saccade characteristics and generalized to an untrained retinal location and stimulus orientation. Suppression was restored when learned stimulus timing was perturbed, consistent with the operation of a mechanism that temporarily reduces or eliminates saccadic suppression, but only when it is behaviorally advantageous to do so. Our results indicate that learning can circumvent saccadic suppression to improve performance, without compromising its functional benefits in other viewing contexts.

A passive BCI for monitoring the intentionality of the gaze-based moving object selection

OBJECTIVE

The use of an electroencephalogram (EEG) anticipation-related component, the expectancy wave (E-wave), in brain-machine interaction was proposed more than 50 years ago. This possibility was not explored for decades, but recently it was shown that voluntary attempts to select items using eye fixations, but not spontaneous eye fixations, are accompanied by the E-wave. Thus, the use of the E-wave detection was proposed for the enhancement of gaze interaction technology, which has a strong need for a mean to decide if a gaze behaviour is voluntary or not. Here, we attempted at estimating whether this approach can be used in the context of moving object selection through smooth pursuit eye movements.

APPROACH

18 participants selected, one by one, items which moved on a computer screen, by gazing at them. In separate runs, the participants performed tasks not related to voluntary selection but also provoking smooth pursuit. A low-cost consumer-grade eye tracker was used for item selection.

MAIN RESULTS

A component resembling the E-wave was found in the averaged EEG segments time-locked to voluntary selection events of every participant. Linear discriminant analysis with shrinkage regularization (sLDA) classified the intentional and spontaneous smooth pursuit eye movements, using single-trial 300 ms long EEG segments, significantly above chance in eight participants. When the classifier output was averaged over ten subsequent data segments, median group ROC AUC of 0.75 was achieved.

SIGNIFICANCE

The results suggest the possible usefulness of the E-wave detection in the gaze-based selection of moving items, e.g., in video games. This technique might be more effective when trial data can be averaged, thus it could be considered for use in passive interfaces, for example, in estimating the degree of the user's involvement during gaze-based interaction.

Modeling pupil responses to rapid sequential events

Pupil size is an easily accessible, noninvasive online indicator of various perceptual and cognitive processes. Pupil measurements have the potential to reveal continuous processing dynamics throughout an experimental trial, including anticipatory responses. However, the relatively sluggish (~2 s) response dynamics of pupil dilation make it challenging to connect changes in pupil size to events occurring close together in time. Researchers have used models to link changes in pupil size to specific trial events, but such methods have not been systematically evaluated. Here we developed and evaluated a general linear model (GLM) pipeline that estimates pupillary responses to multiple rapid events within an experimental trial. We evaluated the modeling approach using a sample dataset in which multiple sequential stimuli were presented within 2-s trials. We found: (1) Model fits improved when the pupil impulse response function (PuRF) was fit for each observer. PuRFs varied substantially across individuals but were consistent for each individual. (2) Model fits also improved when pupil responses were not assumed to occur simultaneously with their associated trial events, but could have non-zero latencies. For example, pupil responses could anticipate predictable trial events. (3) Parameter recovery confirmed the validity of the fitting procedures, and we quantified the reliability of the parameter estimates for our sample dataset. (4) A cognitive task manipulation modulated pupil response amplitude. We provide our pupil analysis pipeline as open-source software (Pupil Response Estimation Toolbox: PRET) to facilitate the estimation of pupil responses and the evaluation of the estimates in other datasets.

Pre-target oculomotor inhibition reflects temporal orienting rather than certainty

Recent studies suggested that eye movements are linked to temporal predictability. These studies manipulated predictability by setting the cue-target interval (foreperiod) to be fixed or random throughout the block. Findings showed that pre-target oculomotor behavior was reduced in the fixed relative to the random condition. This effect was interpreted as reflecting the formation of temporal expectation. However, it is unknown whether the effect is driven by target-specific temporal orienting, or rather a result of a more context-dependent state of certainty that participants may experience during blocks with a high predictability rate. In this study we dissociated certainty and orienting in a tilt-discrimination task. In each trial, a temporal cue (fixation color change) was followed by a tilted grating-patch. The foreperiod distribution was varied between blocks to be either fully fixed (same foreperiod in 100% of trials), mostly fixed (80% of trials with one foreperiod and 20% with another) or random (five foreperiods in equal probabilities). The two hypotheses led to different prediction models which were tested against the experimental data. Results were consistent with the orienting hypothesis and inconsistent with the certainty hypothesis, supporting the link between oculomotor inhibition and temporal orienting and its validity as a temporal expectations marker.

Oculomotor inhibition precedes temporally expected auditory targets

Eye movements are inhibited prior to the onset of temporally-predictable visual targets. This oculomotor inhibition effect could be considered a marker for the formation of temporal expectations and the allocation of temporal attention in the visual domain. Here we show that eye movements are also inhibited before predictable auditory targets. In two experiments, we manipulate the period between a cue and an auditory target to be either predictable or unpredictable. The findings show that although there is no perceptual gain from avoiding gaze-shifts in this procedure, saccades and blinks are inhibited prior to predictable relative to unpredictable auditory targets. These findings show that oculomotor inhibition occurs prior to auditory targets. This link between auditory expectation and oculomotor behavior reveals a multimodal perception action coupling, which has a central role in temporal expectations.

Oculomotor freezing reflects tactile temporal expectation and aids tactile perception

The oculomotor system keeps the eyes steady in expectation of visual events. Here, recording microsaccades while people performed a tactile, frequency discrimination task enabled us to test whether the oculomotor system shows an analogous preparatory response for unrelated tactile events. We manipulated the temporal predictability of tactile targets using tactile cues, which preceded the target by either constant (high predictability) or variable (low predictability) time intervals. We find that microsaccades are inhibited prior to tactile targets and more so for constant than variable intervals, revealing a tight crossmodal link between tactile temporal expectation and oculomotor action. These findings portray oculomotor freezing as a marker of crossmodal temporal expectation. Moreover, microsaccades occurring around the tactile target presentation are associated with reduced task performance, suggesting that oculomotor freezing mitigates potential detrimental, concomitant effects of microsaccades and revealing a crossmodal coupling between tactile perception and oculomotor action.

Dissociable influences of implicit temporal expectation on attentional performance and mind wandering

Mind wandering at critical moments during a cognitive task degrades performance. At other moments, mind wandering could serve to conserve task-relevant resources, allowing a brief mental respite. Recent research has shown that, if target timing is predictable, mind wandering episodes coincide with moments of low target likelihood. Conversely, mind wandering can be avoided at moments when targets are expected. In the current study, we tested whether mind wandering can be guided by implicit temporal expectations when target timing is less predictable. In two experiments (Experiment 1: N = 37, Experiment 2: N = 61), participants performed a sustained attention task in which target events were preceded by a variable pre-target interval (foreperiod). As time passes over the foreperiod duration, implicit target expectation increases, given that it has not yet appeared. In Experiment 1, all foreperiod durations were equally probable (uniform distribution: 2-10 s). This resulted in faster responses when targets were preceded by long compared to short foreperiods (foreperiod-effect). In contrast, mind wandering, assessed by thought probes inserted following short or long foreperiods, did not follow this pattern. In Experiment 2, alterations in the foreperiod distribution (left or right-skewed) resulted in changes in the behavioral foreperiod-effect, but mind wandering was unaffected. Our findings indicate that implicit timing strongly affects behavioral response to target events, but has no bearing on the mind wandering. Contrastingly, mind wandering did correlate with performance deterioration due to fatigue (time-on-task), suggesting that the thought probe method was sufficiently sensitive to behaviorally relevant changes in mental state.

Directing Voluntary Temporal Attention Increases Fixational Stability

Our visual input is constantly changing, but not all moments are equally relevant. Visual temporal attention, the prioritization of visual information at specific points in time, increases perceptual sensitivity at behaviorally relevant times. The dynamic processes underlying this increase are unclear. During fixation, humans make small eye movements called microsaccades, and inhibiting microsaccades improves perception of brief stimuli. Here, we investigated whether temporal attention changes the pattern of microsaccades in anticipation of brief stimuli. Human observers (female and male) judged stimuli presented within a short sequence. Observers were given either an informative precue to attend to one of the stimuli, which was likely to be probed, or an uninformative (neutral) precue. We found strong microsaccadic inhibition before the stimulus sequence, likely due to its predictable onset. Critically, this anticipatory inhibition was stronger when the first target in the sequence (T1) was precued (task-relevant) than when the precue was uninformative. Moreover, the timing of the last microsaccade before T1 and the first microsaccade after T1 shifted such that both occurred earlier when T1 was precued than when the precue was uninformative. Finally, the timing of the nearest pre- and post-T1 microsaccades affected task performance. Directing voluntary temporal attention therefore affects microsaccades, helping to stabilize fixation at the most relevant moments over and above the effect of predictability. Just as saccading to a relevant stimulus can be an overt correlate of the allocation of spatial attention, precisely timed gaze stabilization can be an overt correlate of the allocation of temporal attention.SIGNIFICANCE STATEMENT We pay attention at moments in time when a relevant event is likely to occur. Such temporal attention improves our visual perception, but how it does so is not well understood. Here, we discovered a new behavioral correlate of voluntary, or goal-directed, temporal attention. We found that the pattern of small fixational eye movements called microsaccades changes around behaviorally relevant moments in a way that stabilizes the position of the eyes. Microsaccades during a brief visual stimulus can impair perception of that stimulus. Therefore, such fixation stabilization may contribute to the improvement of visual perception at attended times. This link suggests that, in addition to cortical areas, subcortical areas mediating eye movements may be recruited with temporal attention.

Temporal attention improves perception similarly at foveal and parafoveal locations

Temporal attention, the prioritization of information at a specific point in time, improves visual performance, but it is unknown whether it does so to the same extent across the visual field. This knowledge is necessary to establish whether temporal attention compensates for heterogeneities in discriminability and speed of processing across the visual field. Discriminability and rate of information accrual depend on eccentricity as well as on polar angle, a characteristic known as performance fields. Spatial attention improves speed of processing more at locations at which discriminability is lower and information accrual is slower, but it improves discriminability to the same extent across isoeccentric locations. Here we asked whether temporal attention benefits discriminability in a similar or differential way across the visual field. Observers were asked to report the orientation of one of two targets presented at different points in time at the same spatial location (fovea, right horizontal meridian, or upper vertical meridian, blocked). Temporal attention improved discriminability and shortened reaction times at the foveal and each parafoveal location similarly. These results provide evidence that temporal attention is similarly effective at multiple locations in the visual field. Consequently, at the tested locations, performance fields are preserved with temporal orienting of attention.