Investigating Arousal, Saccade Preparation, and Global Luminance Effects on Microsaccade Behavior

Understanding mental fatigue and its detection: a comparative analysis of assessments and tools

Mental fatigue has shown to be one of the root causes of decreased productivity and overall cognitive performance, by decreasing an individual's ability to inhibit responses, process information and concentrate. The effects of mental fatigue have led to occupational errors and motorway accidents. Early detection of mental fatigue can prevent the escalation of symptoms that may lead to chronic fatigue syndrome and other disorders. To date, in clinical settings, the assessment of mental fatigue and stress is done through self-reported questionnaires. The validity of these questionnaires is questionable, as they are highly subjective measurement tools and are not immune to response biases. This review examines the wider presence of mental fatigue in the general population and critically compares its various detection techniques (i.e., self-reporting questionnaires, heart rate variability, salivary cortisol levels, electroencephalogram, and saccadic eye movements). The ability of these detection tools to assess inhibition responses (which are sensitive enough to be manifested in a fatigue state) is specifically evaluated for a reliable marker in identifying mentally fatigued individuals. In laboratory settings, antisaccade tasks have been long used to assess inhibitory control and this technique can potentially serve as the most promising assessment tool to objectively detect mental fatigue. However, more studies need to be conducted in the future to validate and correlate this assessment with other existing measures of mental fatigue detection. This review is intended for, but not limited to, mental health professionals, digital health scientists, vision researchers, and behavioral scientists.

Fatigue and Arousal Modulations Revealed by Saccade and Pupil Dynamics

Saccadic eye movements are directed to the objects of interests and enable high-resolution visual images in the exploration of the visual world. There is a trial-to-trial variation in saccade dynamics even in a simple task, possibly attributed to arousal fluctuations. Previous studies have showed that an increase of fatigue level over time, also known as time-on-task, can be revealed by saccade peak velocity. In addition, pupil size, controlled by the autonomic nervous system, has long been used as an arousal index. However, limited research has been done with regards to the relation between pupil size and saccade behavior in the context of trial-to-trial variation. To investigate fatigue and arousal effects on saccadic and pupillary responses, we used bright and emotional stimuli to evoke pupillary responses in tasks requiring reactive and voluntary saccade generation. Decreased voluntary saccade peak velocities, reduced tonic pupil size and phasic pupillary responses were observed as time-on-task increased. Moreover, tonic pupil size affected saccade latency and dynamics, with steeper saccade main sequence slope as tonic pupil size increased. In summary, saccade dynamics and tonic pupil size were sensitive to fatigue and arousal level, together providing valuable information for the understanding of human behavior.

A unified model of the task-evoked pupil response

The pupil dilates and reconstricts following task events. It is popular to model this task-evoked pupil response as a linear transformation of event-locked impulses, whose amplitudes are used as estimates of arousal. We show that this model is incorrect and propose an alternative model based on the physiological finding that a common neural input drives saccades and pupil size. The estimates of arousal from our model agreed with key predictions: Arousal scaled with task difficulty and behavioral performance but was invariant to small differences in trial duration. Moreover, the model offers a unified explanation for a wide range of phenomena: entrainment of pupil size and saccades to task timing, modulation of pupil response amplitude and noise with task difficulty, reaction time-dependent modulation of pupil response timing and amplitude, a constrictory pupil response time-locked to saccades, and task-dependent distortion of this saccade-locked pupil response.

Linking Pupil Size Modulated by Global Luminance and Motor Preparation to Saccade Behavior

Saccades are rapid eye movements that are used to move the high acuity fovea in a serial manner in the exploration of the visual scene. Stimulus contrast is known to modulate saccade latency and metrics possibly via changing visual activity in the superior colliculus (SC), a midbrain structure causally involved in saccade generation. However, the quality of visual signals should also be modulated by the amount of lights projected onto the retina, which is gated by the size of the pupil. Although absolute pupil size should modulate visual signals and in turn affect saccade responses, research examining this relationship is very limited. Besides, pupil size is associated with motor preparation. However, the role of pupil dilation in saccade metrics remains unexplored. Through varying peripheral background luminance level and target visual contrast in the saccade task, we investigated the role of absolute pupil size and baseline-corrected pupil dilation in saccade latency and metrics. Higher target detection accuracy was obtained with lower background luminance level, and larger absolute pupil diameter correlated with smaller saccade amplitude and higher saccade peak velocities. More interestingly, the comparable modulation between pupil dilation and stimulus contrast was obtained, showing larger pupil dilation (or higher contrast stimuli) correlating with faster saccade latencies, larger amplitude, higher peak velocities, and smaller endpoint deviation. Together, our results demonstrated the influence of absolute pupil size induced by global luminance level and baseline-corrected pupil dilation associated with motor preparation on saccade latency and metrics, implicating the role of the SC in this behavior.

Differentiating global luminance, arousal and cognitive signals on pupil size and microsaccades

Pupil size reflects a proxy for neural activity associated with global luminance, arousal and cognitive processing. Microsaccades are also modulated by arousal and cognitive processing. Are these effects of arousal and cognitive signals on pupil size and microsaccades coordinated? If so, via what neural mechanisms? We hypothesized that if pupil size and microsaccades are coordinately modulated by these processes, pupil size immediately before microsaccade onset, as an index for ongoing cognitive and arousal processing, should correlate with microsaccade responses during tasks alternating these signals. Here, we examined the relationship between pupil size and microsaccade responses in tasks that included variations in global luminance, arousal and inhibitory control. Higher microsaccade peak velocities correlated with larger pre-microsaccade pupil response related to arousal and inhibitory control signals. In contrast, pupil responses evoked by global luminance signals did not correlate with microsaccade responses. Given the central role of the superior colliculus in microsaccade generation, these results suggest the critical involvement of the superior colliculus to coordinate pupil and microsaccade responses for arousal and inhibitory control modulations, but not for the pupil luminance modulation.

Role of the frontal eye field in human microsaccade responses: A TMS study

Microsaccade is a type of fixational eye movements that is modulated by various sensory and cognitive processes, and impact our visual perception. Although studies in monkeys have demonstrated a functional role for the superior colliculus and frontal eye field (FEF) in controlling microsaccades, our understanding of the neural mechanisms underlying the generation of microsaccades is still limited. By applying continuous theta-burst stimulation (cTBS) over the right FEF and the vertex, we investigated the role of the FEF in generating human microsaccade responses evoked by salient stimuli or by changes in background luminance. We observed higher microsaccade rates prior to target appearance, and larger rebound in microsaccade occurrence following salient stimuli, when disruptive cTBS was applied over FEF compared to vertex stimulation. Moreover, the microsaccade direction modulation after changes in background luminance was disrupted with FEF stimulation. Together, our results constitute the first evidence of FEF modulation in human microsaccade responses.