Microsaccade production during saccade cancelation in a stop-signal task

Eye Movements as a Window into Decision-Making

For over 100 years, eye movements have been studied and used as indicators of human sensory and cognitive functions. This review evaluates how eye movements contribute to our understanding of the processes that underlie decision-making. Eye movement metrics signify the visual and task contexts in which information is accumulated and weighed. They indicate the efficiency with which we evaluate the instructions for decision tasks, the timing and duration of decision formation, the expected reward associated with a decision, the accuracy of the decision outcome, and our ability to predict and feel confident about a decision. Because of their continuous nature, eye movements provide an exciting opportunity to probe decision processes noninvasively in real time. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

The role of fixation disengagement and oculomotor preparation in gap saccade task is gap-duration dependent

The influence of internal brain state on behavioral performance is well illustrated by the gap-saccade task, in which saccades might be initiated with short latency (express saccade) or with long latency (regular saccade) even though the external visual condition is identical. Accumulated evidence has demonstrated that the internal brain state is different before the initiation of an express saccade than of a regular saccade. However, the reported origin of the fluctuation of internal brain state is disputed among previous studies, e.g., the fixation disengagement theory versus the oculomotor preparation theory. In the present study, we examined these two theories by analyzing the rate and direction of fixational saccades, i.e., small amplitude saccades during fixation period, because they could be modulated by internal brain state. Since fixation disengagement is not spatially tuned, it might affect the rate but not direction of fixational saccade. In contrast, oculomotor preparation can contain the spatial information for upcoming saccade, thus, it might have a distinct effect on fixational saccade direction. We found that the different spatiotemporal characteristics of fixational saccades among tasks with different gap durations reveals different driven force to change the internal brain state. Under short gap duration (100 ms), fixation disengagement plays a primary role in switching internal brain state. Conversely, under medium (200 ms) and long (400 ms) gap durations, oculomotor preparation plays a primary role. These results suggest that both fixation disengagement and oculomotor preparation can change the internal brain state, but their relative contributions are gap-duration dependent.

The unknown but knowable relationship between Presaccadic Accumulation of activity and Saccade initiation

The goal of this short review is to call attention to a yawning gap of knowledge that separates two processes essential for saccade production. On the one hand, knowledge about the saccade generation circuitry within the brainstem is detailed and precise - push-pull interactions between gaze-shifting and gaze-holding processes control the time of saccade initiation, which begins when omnipause neurons are inhibited and brainstem burst neurons are excited. On the other hand, knowledge about the cortical and subcortical premotor circuitry accomplishing saccade initiation has crystalized around the concept of stochastic accumulation - the accumulating activity of saccade neurons reaching a fixed value triggers a saccade. Here is the gap: we do not know how the reaching of a threshold by premotor neurons causes the critical pause and burst of brainstem neurons that initiates saccades. Why this problem matters and how it can be addressed will be discussed. Closing the gap would unify two rich but curiously disconnected empirical and theoretical domains.

Dissociation of Medial Frontal β-Bursts and Executive Control

The neural mechanisms of executive and motor control concern both basic researchers and clinicians. In human studies, preparation and cancellation of movements are accompanied by changes in the β-frequency band (15-29 Hz) of electroencephalogram (EEG). Previous studies with human participants performing stop signal (countermanding) tasks have described reduced frequency of transient β-bursts over sensorimotor cortical areas before movement initiation and increased β-bursting over medial frontal areas with movement cancellation. This modulation has been interpreted as contributing to the trial-by-trial control of behavior. We performed identical analyses of EEG recorded over the frontal lobe of macaque monkeys (one male, one female) performing a saccade countermanding task. While we replicate the occurrence and modulation of β-bursts associated with initiation and cancellation of saccades, we found that β-bursts occur too infrequently to account for the observed stopping behavior. We also found β-bursts were more common after errors, but their incidence was unrelated to response time (RT) adaptation. These results demonstrate the homology of this EEG signature between humans and macaques but raise questions about the current interpretation of β band functional significance.SIGNIFICANCE STATEMENT The finding of increased β-bursting over medial frontal cortex with movement cancellation in humans is difficult to reconcile with the finding of modulation too late to contribute to movement cancellation in medial frontal cortex of macaque monkeys. To obtain comparable measurement scales, we recorded electroencephalogram (EEG) over medial frontal cortex of macaques performing a stop signal (countermanding) task. We replicated the occurrence and modulation of β-bursts associated with the cancellation of movements, but we found that β-bursts occur too infrequently to account for observed stopping behavior. Unfortunately, this finding raises doubts whether β-bursts can be a causal mechanism of response inhibition, which impacts future applications in devices such as brain-machine interfaces.

Microsaccadic modulation evoked by emotional events

Saccadic eye movements can allude to emotional states and visual attention. Recent studies have shown that microsaccadic responses (i.e., small fixational eye movements) reflect advanced brain activity during attentional and cognitive tasks. Moreover, the microsaccadic activity related to emotional attention provides new insights into this field. For example, emotional pictures attenuate the microsaccadic rate, and microsaccadic responses to covert attention occur in the direction opposite to a negative emotional target. However, the effects of various emotional events on microsaccadic activity remain debatable. This review introduces visual attention and eye movement studies that support findings on the modulation of microsaccadic responses to emotional events, comparing them with typical microsaccadic responses. This review also discusses the brain neuronal mechanisms governing microsaccadic responses to the attentional shifts triggered by emotion-related stimuli. It is hard to reveal the direct brain pathway of the microsaccadic modulation, especially in advanced (e.g., sustained anger, envy, distrust, guilt, frustration, delight, attraction, trust, and love), but also in basic human emotions (i.e., anger, disgust, fear, happiness, sadness, and surprise). However, non-human primates and human studies can uncover the possible brain pathways of emotional attention and microsaccades, thus providing future research directions. In particular, the facilitated (or reduced) attention is common evidence that microsaccadic activities change under a variety of social modalities (e.g., cognition, music, mental illness, and working memory) that elicit emotions and feelings.

Express saccades during a countermanding task

Express saccades are unusually short latency, visually guided saccadic eye movements. They are most commonly observed when the fixation spot disappears at a consistent, short interval before a target spot appears at a repeated location. The saccade countermanding task includes no fixation-target gap, variable target presentation times, and the requirement to withhold saccades on some trials. These testing conditions should discourage production of express saccades. However, two macaque monkeys performing the saccade countermanding task produced consistent, multimodal distributions of saccadic latencies. These distributions consisted of a longer mode extending from 200 ms to as much as 600 ms after target presentation and another consistently less than 100 ms after target presentation. Simulations revealed that, by varying express saccade production, monkeys could earn more reward. If express saccades were not rewarded, they were rarely produced. The distinct mechanisms producing express and longer saccade latencies were revealed further by the influence of regularities in the duration of the fixation interval preceding target presentation on saccade latency. Temporal expectancy systematically affected the latencies of regular but not of express saccades. This study highlights that cognitive control can integrate information across trials and strategically elicit intermittent very short latency saccades to acquire more reward.NEW & NOTEWORTHY A serendipitous discovery that macaque monkeys produce express saccades under conditions that should discourage them reveals how cognitive control can adapt behavior to maximize reward.

Deep learning can be used to train naïve, nonprofessional observers to detect diagnostic visual patterns of certain cancers in mammograms: a proof-of-principle study

The scientific, clinical, and pedagogical significance of devising methodologies to train nonprofessional subjects to recognize diagnostic visual patterns in medical images has been broadly recognized. However, systematic approaches to doing so remain poorly established. Using mammography as an exemplar case, we use a series of experiments to demonstrate that deep learning (DL) techniques can, in principle, be used to train naïve subjects to reliably detect certain diagnostic visual patterns of cancer in medical images. In the main experiment, subjects were required to learn to detect statistical visual patterns diagnostic of cancer in mammograms using only the mammograms and feedback provided following the subjects' response. We found not only that the subjects learned to perform the task at statistically significant levels, but also that their eye movements related to image scrutiny changed in a learning-dependent fashion. Two additional, smaller exploratory experiments suggested that allowing subjects to re-examine the mammogram in light of various items of diagnostic information may help further improve DL of the diagnostic patterns. Finally, a fourth small, exploratory experiment suggested that the image information learned was similar across subjects. Together, these results prove the principle that DL methodologies can be used to train nonprofessional subjects to reliably perform those aspects of medical image perception tasks that depend on visual pattern recognition expertise.

Distinct population codes for attention in the absence and presence of visual stimulation

Visual neurons respond more vigorously to an attended stimulus than an unattended one. How the brain prepares for response gain in anticipation of that stimulus is not well understood. One prominent proposal is that anticipation is characterized by gain-like modulations of spontaneous activity similar to gains in stimulus responses. Here we test an alternative idea: anticipation is characterized by a mixture of both increases and decreases of spontaneous firing rates. Such a strategy would be adaptive as it supports a simple linear scheme for disentangling internal, modulatory signals from external, sensory inputs. We recorded populations of V4 neurons in monkeys performing an attention task, and found that attention states are signaled by different mixtures of neurons across the population in the presence or absence of a stimulus. Our findings support a move from a stimulation-invariant account of anticipation towards a richer view of attentional modulation in a diverse neuronal population.

Attention affects stimulus response gain, but its impact without sensory drive is less known. Here, the authors show that attention is coded diversely in a population and is distinct between unstimulated and stimulated contexts, providing a contrast to normalized gain models of attention.

A stop-signal task for sheep: introduction and validation of a direct measure for the stop-signal reaction time

Huntington's disease (HD) patients show reduced flexibility in inhibiting an already-started response. This can be quantified by the stop-signal task. The aim of this study was to develop and validate a sheep version of the stop-signal task that would be suitable for monitoring the progression of cognitive decline in a transgenic sheep model of HD. Using a semi-automated operant system, sheep were trained to perform in a two-choice discrimination task. In 22% of the trials, a stop-signal was presented. Upon the stop-signal presentation, the sheep had to inhibit their already-started response. The stopping behaviour was captured using an accelerometer mounted on the back of the sheep. This set-up provided a direct read-out of the individual stop-signal reaction time (SSRT). We also estimated the SSRT using the conventional approach of subtracting the stop-signal delay (i.e., time after which the stop-signal is presented) from the ranked reaction time during a trial without a stop-signal. We found that all sheep could inhibit an already-started response in 91% of the stop-trials. The directly measured SSRT (0.974 ± 0.04 s) was not significantly different from the estimated SSRT (0.938 ± 0.04 s). The sheep version of the stop-signal task adds to the repertoire of tests suitable for investigating both cognitive dysfunction and efficacy of therapeutic agents in sheep models of neurodegenerative disease such as HD, as well as neurological conditions such as attention deficit hyperactivity disorder.

Models of inhibitory control

We survey models of response inhibition having different degrees of mathematical, computational and neurobiological specificity and generality. The independent race model accounts for performance of the stop-signal or countermanding task in terms of a race between GO and STOP processes with stochastic finishing times. This model affords insights into neurophysiological mechanisms that are reviewed by other authors in this volume. The formal link between the abstract GO and STOP processes and instantiating neural processes is articulated through interactive race models consisting of stochastic accumulator GO and STOP units. This class of model provides quantitative accounts of countermanding performance and replicates the dynamics of neural activity producing that performance. The interactive race can be instantiated in a network of biophysically plausible spiking excitatory and inhibitory units. Other models seek to account for interactions between units in frontal cortex, basal ganglia and superior colliculus. The strengths, weaknesses and relationships of the different models will be considered. We will conclude with a brief survey of alternative modelling approaches and a summary of problems to be addressed including accounting for differences across effectors, species, individuals, task conditions and clinical deficits.This article is part of the themed issue 'Movement suppression: brain mechanisms for stopping and stillness'.

Microsaccade production during saccade cancelation in a stop-signal task

We obtained behavioral data to evaluate two alternative hypotheses about the neural mechanisms of gaze control. The "fixation" hypothesis states that neurons in rostral superior colliculus (SC) enforce fixation of gaze. The "microsaccade" hypothesis states that neurons in rostral SC encode microsaccades rather than fixation per se. Previously reported neuronal activity in monkey SC during the saccade stop-signal task leads to specific, dissociable behavioral predictions of these two hypotheses. When subjects are required to cancel partially-prepared saccades, imbalanced activity spreads across rostral and caudal SC with a reliable temporal profile. The microsaccade hypothesis predicts that this imbalance will lead to elevated microsaccade production biased toward the target location, while the fixation hypothesis predicts reduced microsaccade production. We tested these predictions by analyzing the microsaccades produced by 4 monkeys while they voluntarily canceled partially prepared eye movements in response to explicit stop signals. Consistent with the fixation hypothesis and contradicting the microsaccade hypothesis, we found that each subject produced significantly fewer microsaccades when normal saccades were successfully canceled. The few microsaccades escaping this inhibition tended to be directed toward the target location. We additionally investigated interactions between initiating microsaccades and inhibiting normal saccades. Reaction times were longer when microsaccades immediately preceded target presentation. However, pre-target microsaccade production did not affect stop-signal reaction time or alter the probability of canceling saccades following stop signals. These findings demonstrate that imbalanced activity within SC does not necessarily produce microsaccades and add to evidence that saccade preparation and cancelation are separate processes.