Analysis of microsaccades and pupil dilation reveals a common decisional origin during visual search

Sense of agency at a temporally-delayed gaze-contingent display

The subjective feeling of being the author of one's actions and the subsequent consequences is referred to as a sense of agency. Such a feeling is crucial for usability in human-computer interactions, where eye movement has been adopted, yet this area has been scarcely investigated. We examined how the temporal action-feedback discrepancy affects the sense of agency concerning eye movement. Participants conducted a visual search for an array of nine Chinese characters within a temporally-delayed gaze-contingent display, blurring the peripheral view. The relative delay between each eye movement and the subsequent window movement varied from 0 to 4,000 ms. In the control condition, the window played a recorded gaze behavior. The mean authorship rating and the proportion of "self" responses in the categorical authorship report ("self," "delayed self," and "other") gradually decreased as the temporal discrepancy increased, with "other" being rarely reported, except in the control condition. These results generally mirror those of prior studies on hand actions, suggesting that sense of agency extends beyond the effector body parts to other modalities, and two different types of sense of agency that have different temporal characteristics are simultaneously operating. The mode of fixation duration shifted as the delay increased under 200-ms delays and was divided into two modes at 200-500 ms delays. The frequency of 0-1.5° saccades exhibited an increasing trend as the delay increased. These results demonstrate the influence of perceived action-effect discrepancy on action refinement and task strategy.

Pupillary dilations in a Target/Distractor visual task paradigm and attention deficit hyperactivity disorder (ADHD)

ADHD is a neurocognitive disorder characterized by attention difficulties, hyperactivity, and impulsivity, often persisting into adulthood with substantial personal and societal consequences. Despite the importance of neurophysiological assessment and treatment monitoring tests, their availability outside of research settings remains limited. Cognitive neuroscience investigations have identified distinct components associated with ADHD, including deficits in sustained attention, inefficient enhancement of attended Targets, and altered suppression of ignored Distractors. In this study, we examined pupil activity in control and ADHD subjects during a sustained visual attention task specifically designed to evaluate the mechanisms underlying Target enhancement and Distractor suppression. Our findings revealed some distinguishing factors between the two groups which we discuss in light of their neurobiological implications.

A Narrative Literature Review About the Role of Microsaccades in Sports

In many daily and sport situations, people have to simultaneously perceive and process multiple objects and scenes in a short amount of time. A wrong decision may lead to a disadvantage for a team or for a single athlete, and during daily life (i.e., driving, surgery), it could have more dangerous consequences. Considering the results of different studies, the ability to distribute visual attention depends on different levels of expertise and environment-related constraints. This article is a narrative review of the current scientific evidence in the field of eye movements in sports, focusing on the role of microsaccades in sporting task situations. Over the past 10 years, microsaccades have become one of the most increasing areas of research in visual and oculomotor studies and even in the area of sport science. Here, we review the latest findings and discuss the relationships between microsaccades and attention, perception, and action in sports.

Building a decoder of perceptual decisions from microsaccades and pupil size

Many studies have reported neural correlates of visual awareness across several brain regions, including the sensory, parietal, and frontal areas. In most of these studies, participants were instructed to explicitly report their perceptual experience through a button press or verbal report. It is conceivable, however, that explicit reporting itself may trigger specific neural responses that can confound the direct examination of the neural correlates of visual awareness. This suggests the need to assess visual awareness without explicit reporting. One way to achieve this is to develop a technique to predict the visual awareness of participants based on their peripheral responses. Here, we used eye movements and pupil sizes to decode trial-by-trial changes in the awareness of a stimulus whose visibility was deteriorated due to adaptation-induced blindness (AIB). In the experiment, participants judged whether they perceived a target stimulus and rated the confidence they had in their perceptual judgment, while their eye movements and pupil sizes were recorded. We found that not only perceptual decision but also perceptual confidence can be separately decoded from the eye movement and pupil size. We discuss the potential of this technique with regard to assessing visual awareness in future neuroimaging experiments.

Saccade rate is associated with recall of items in working memory

Working memory has been shown to rely on theta oscillations' phase synchronicity for item encoding and recall. At the same time, saccadic eye movements during visual exploration have been observed to trigger theta-phase resets, raising the question of whether the neuronal substrates of mnemonic processing rely on motor-evoked responses. To quantify the relationship between saccades and working memory load, we recorded eye tracking and behavioral data from human participants simultaneously performing an n-back Sternberg auditory task and a hue-based catch detection task. In addition to task-specific interference in performance, we also found that saccade rate was modulated by working memory load in the Sternberg task's preresponse stage. Our results support the possibility of interplay between saccades and hippocampal theta during working memory retrieval of items.

Microsaccadic modulation evoked by emotional events

Saccadic eye movements can allude to emotional states and visual attention. Recent studies have shown that microsaccadic responses (i.e., small fixational eye movements) reflect advanced brain activity during attentional and cognitive tasks. Moreover, the microsaccadic activity related to emotional attention provides new insights into this field. For example, emotional pictures attenuate the microsaccadic rate, and microsaccadic responses to covert attention occur in the direction opposite to a negative emotional target. However, the effects of various emotional events on microsaccadic activity remain debatable. This review introduces visual attention and eye movement studies that support findings on the modulation of microsaccadic responses to emotional events, comparing them with typical microsaccadic responses. This review also discusses the brain neuronal mechanisms governing microsaccadic responses to the attentional shifts triggered by emotion-related stimuli. It is hard to reveal the direct brain pathway of the microsaccadic modulation, especially in advanced (e.g., sustained anger, envy, distrust, guilt, frustration, delight, attraction, trust, and love), but also in basic human emotions (i.e., anger, disgust, fear, happiness, sadness, and surprise). However, non-human primates and human studies can uncover the possible brain pathways of emotional attention and microsaccades, thus providing future research directions. In particular, the facilitated (or reduced) attention is common evidence that microsaccadic activities change under a variety of social modalities (e.g., cognition, music, mental illness, and working memory) that elicit emotions and feelings.

Using Microsaccades to Estimate Task Difficulty During Visual Search of Layered Surfaces

We develop an approach to using microsaccade dynamics for the measurement of task difficulty/cognitive load imposed by a visual search task of a layered surface. Previous studies provide converging evidence that task difficulty/cognitive load can influence microsaccade activity. We corroborate this notion. Specifically, we explore this relationship during visual search for features embedded in a terrain-like surface, with the eyes allowed to move freely during the task. We make two relevant contributions. First, we validate an approach to distinguishing between the ambient and focal phases of visual search. We show that this spectrum of visual behavior can be quantified by a single previously reported estimator, known as Krejtz's K coefficient. Second, we use ambient/focal segments based on K as a moderating factor for microsaccade analysis in response to task difficulty. We find that during the focal phase of visual search (a) microsaccade magnitude increases significantly, and (b) microsaccade rate decreases significantly, with increased task difficulty. We conclude that the combined use of K and microsaccade analysis may be helpful in building effective tools that provide an indication of the level of cognitive activity within a task while the task is being performed.

Component processes in free-viewing visual search: Insights from fixation-aligned pupillary response averaging

Pupil size changes during a visual search may reflect cognitive processes, such as effort and memory accumulation, but methodological confounds and the general lack of literature in this area leave the reliability of findings open to question. We used a novel synthesis of experimental methods and averaging techniques to explore how cognitive processing unfolds during free-viewing visual search for multiple targets. Twenty-seven participants completed 152 searches across two separate 1-hour sessions. The number of targets present (Targets: 0, 1, 2, and 3) in each trial was the main manipulation and the task was to "find all of the targets" and report the total via mouse-click at the end of the trial. Search time lasted for 10 seconds or until the participant purported to have found all of the targets, in which case they could terminate the search via keypress. Whole-trial pupil analysis revealed a significant effect of button pressing as well as a significant main effect of targets for trials that were not self-terminated via button press. Fixation-aligned pupil responses revealed transient modulations in pupil size following initial fixations on targets but not distractors and refixations on both targets and distractors. Owing to rigorous control over experimental confounds and a detailed analysis and correction of eye-movement-related measurement error, we confidently discuss these findings in terms of task-related processing and underlying brain activity.

VisME: Visual Microsaccades Explorer

This work presents a visual analytics approach to explore microsaccade distributions in high-frequency eye tracking data. Research studies often apply filter algorithms and parameter values for microsaccade detection. Even when the same algorithms are employed, different parameter values might be adopted across different studies. In this paper, we present a visual analytics system (VisME) to promote reproducibility in the data analysis of microsaccades. It allows users to interactively vary the parametric values for microsaccade filters and evaluate the resulting influence on microsaccade behavior across individuals and on a group level. In particular, we exploit brushing-and-linking techniques that allow the microsaccadic properties of space, time, and movement direction to be extracted, visualized, and compared across multiple views. We demonstrate in a case study the use of our visual analytics system on data sets collected from natural scene viewing and show in a qualitative usability study the usefulness of this approach for eye tracking researchers. We believe that interactive tools such as VisME will promote greater transparency in eye movement research by providing researchers with the ability to easily understand complex eye tracking data sets; such tools can also serve as teaching systems. VisME is provided as open source software.

Microsaccadic rate and pupil size dynamics in pro-/anti-saccade preparation: the impact of intermixed vs. blocked trial administration

Prolonged fixation can lead to the generation of tiny and fast eye movements called microsaccades, whose dynamics can be associated with higher cognitive mechanisms. Saccade preparation is also reflected in microsaccadic activity, but the few studies on this topic provided mixed results. For instance, fewer microsaccades have been observed when participants were asked to prepare for an anti-saccade (i.e., a saccade in the opposite direction to the target) as compared to a pro-saccade (i.e., a saccade executed towards a target), but null results have also been reported. In the attempt to shed new light on this topic, two experiments were carried out in which the context of presentation of pro- and anti-saccade trials was manipulated. Pupil size was also recorded, as a further index of cognitive load. In Experiment 1, participants were asked to prepare and perform pro- and anti-saccades in response to a peripheral target, according to a central instruction cue provided at the beginning of each trial (intermixed condition). In Experiment 2, the same task was employed, but pro- and anti-saccade trials were delivered in two distinct blocks (blocked condition). In both experiments, greater saccadic latencies and lower accuracy emerged for anti- than for pro-saccades. However, in the intermixed condition, a lower microsaccadic rate and a greater pupil size emerged when participants prepared for anti- rather than pro-saccades, whereas these differences disappeared in the blocked condition. These results suggest that contextual factors may play a key role in shaping oculomotor dynamics linked to saccade preparation.

Psychophysical evaluation of individual low-level feature influences on visual attention

In this study we provide the analysis of eye movement behavior elicited by low-level feature distinctiveness with a dataset of synthetically-generated image patterns. Design of visual stimuli was inspired by the ones used in previous psychophysical experiments, namely in free-viewing and visual searching tasks, to provide a total of 15 types of stimuli, divided according to the task and feature to be analyzed. Our interest is to analyze the influences of low-level feature contrast between a salient region and the rest of distractors, providing fixation localization characteristics and reaction time of landing inside the salient region. Eye-tracking data was collected from 34 participants during the viewing of a 230 images dataset. Results show that saliency is predominantly and distinctively influenced by: 1. feature type, 2. feature contrast, 3. temporality of fixations, 4. task difficulty and 5. center bias. This experimentation proposes a new psychophysical basis for saliency model evaluation using synthetic images.

Pupil dilation but not microsaccade rate robustly reveals decision formation

Pupil dilation, an indicator of arousal that is generally regarded as unspecific, amongst others reflects decision formation and reveals choice. Employing letter selection in a Go/NoGo task, we show that choice can robustly be predicted by the pupillary signal, even under the presence of strong interfering factors such as changes in brightness or motor execution. In addition, a larger difference in pupil dilation between target and distractor conditions for NoGo compared to Go was demonstrated, underlining the particular appropriateness of the paradigm for decision research. Incorporating microsaccades, a variable that is suggested to covary with pupil diameter, we show that decision formation can only be observed in pupil diameter. However, microsaccade rate and pupil size covaried for motor execution and both reflected choice after key press with smaller effect size for microsaccade rate. We argue that combining pupil dilation and microsaccade rate may help dissociating decision-related changes in pupil diameter from interfering factors. Considering the interlinked main neural correlates of pupil dilation and microsaccade generation, these findings point to a selective role of locus coeruleus compared to superior colliculus in decision formation.

Discrete states of attention during active visual fixation revealed by Markovian analysis of the time series of intrusive saccades

The frequency of intrusive saccades during maintenance of active visual fixation has been used as a measure of sustained visual attention in studies of healthy subjects as well as of neuropsychiatric patient populations. In this study, the mechanism that generates intrusive saccades during active visual fixation was investigated in a population of young healthy men performing three sustained fixation tasks (fixation to a visual target, fixation to a visual target with visual distracters, and fixation straight ahead in the dark). Markov Chain modeling of inter-saccade intervals (ISIs) was utilized. First- and second-order Markov modeling provided indications for the existence of a non-random pattern in the production of intrusive saccades. Accordingly, the system of intrusive saccade generation may operate in two "attractor" states, one in which intrusive saccades occur at short consecutive ISIs and another in which intrusive saccades occur at long consecutive ISIs. These states might correspond to two distinct states of the attention system, one of low focused - high distractibility and another of high focused - low distractibility, such as those proposed in the adaptive gain theory for the control of attention by the noradrenergic system in the brain. To the authors knowledge, this is the first time that Markov Chain modeling has been applied to the analysis of the ISIs of intrusive saccades.

A compact field guide to the study of microsaccades: Challenges and functions

Following a period of quiescence at the end of last century, the study of microsaccades has now regained strong impetus and broad attention within the vision research community. This wave of interest, partly fueled by the advent of user-friendly high-resolution eyetrackers, has attracted researchers and led to novel ideas. Old hypothesis have been revisited and new ones formulated. This article is designed to serve as a practical guide for researchers in the field. Because of the history of the field and the difficulty of measuring very small eye movements, the study of microsaccades presents peculiar challenges. Here, we summarize some of the main challenges and describe methods for assessing and improving the quality of the recordings. Furthermore, we examine how these experimental challenges have influenced analysis of the visual functions of microsaccades and critically review current evidence on three long-debated proposals: the maintenance of fixation, the prevention of visual fading, and the exploration of fine spatial detail.