Functional distinction between visuomovement and movement neurons in macaque frontal eye field during saccade countermanding

Pre-saccadic attention relies more on suppression than does covert attention

During covert and pre-saccadic attentional shifts, it is unclear how facilitation and suppression processes interact for target selection. A recent countermanding task pointed to greater suppression at unattended locations during trials with saccades compared to trials without saccades (i.e., fixation and successful stop trials), whereas target facilitation did not differ. It is unknown whether this finding is restricted to countermanding paradigms that involve inhibitory processes. To test this, we adapted Gaspelin and colleagues (2015)'s attention capture task where, within the same block, one location was primed with frequent line discrimination trials, and all locations were occasionally probed using letters report trials. Participants also performed a baseline condition without priming. We tested 15 participants and examined how performance at non-primed locations was affected by covert versus pre-saccadic attention in blocks of four or six items, as well as by position from the primed location and timing from saccade onset. For both attention conditions, letter report at non-primed locations was worse compared to baseline, demonstrating suppression, and letter report at primed location was better, demonstrating facilitation. In saccades trials, letter report was better at primed locations and worse at non-primed locations compared to fixation trials. The timing of this additional pre-saccadic suppression differed from saccadic suppression. In both attention conditions, suppression was greater when primed and non-primed locations were within the same hemifield or in diagonal opposite quadrants. These results confirmed that attention preceding saccade execution suppressed non-primed locations to a larger extent than covert attention, with the same spatial quadrant effect.

Influence of the Location of a Decision Cue on the Dynamics of Pupillary Light Response

The pupils of the eyes reflexively constrict in light and dilate in dark to optimize retinal illumination. Non-visual cognitive factors, like attention, arousal, decision-making, etc., also influence pupillary light response (PLR). During passive viewing, the eccentricity of a stimulus modulates the pupillary aperture size driven by spatially weighted corneal flux density (CFD), which is the product of luminance and the area of the stimulus. Whether the scope of attention also influences PLR remains unclear. In this study, we contrasted the pupil dynamics between diffused and focused attentional conditions during decision-making, while the global CFD remained the same in the two conditions. A population of 20 healthy humans participated in a pair of forced choice tasks. They distributed attention to the peripheral decision cue in one task, and concentrated at the center in the other to select the target from four alternatives for gaze orientation. The location of this cue did not influence participants' reaction time (RT). However, the magnitude of constriction was significantly less in the task that warranted attention to be deployed at the center than on the periphery. We observed similar pupil dynamics when participants either elicited or canceled a saccadic eye movement, which ruled out pre-saccadic obligatory attentional orientation contributing to PLR. We further addressed how the location of attentional deployment might have influenced PLR. We simulated a biomechanical model of PLR with visual stimulation of different strengths as inputs corresponding to the two attentional conditions. In this homeomorphic model, the computational characteristic of each element was derived from the physiological and/or mechanical properties of the corresponding biological element. The simulation of this model successfully mimicked the observed data. In contrast to common belief that the global ambient luminosity drives pupillary response, the results of our study suggest that the effective CFD (eCFD) determined via the luminance multiplied by the size of the stimulus at the location of deployed attention in the visual space is critical for the magnitude of pupillary constriction.

A neuro-computational model of visual attention with multiple attentional control sets

In numerous activities, humans need to attend to multiple sources of visual information at the same time. Although several recent studies support the evidence of this ability, the mechanism of multi-item attentional processing is still a matter of debate and has not been investigated much by previous computational models. Here, we present a neuro-computational model aiming to address specifically the question of how subjects attend to two items that deviate defined by feature and location. We simulate the experiment of Adamo et al. (2010) which required subjects to use two different attentional control sets, each a combination of color and location. The structure of our model is composed of two components "attention" and "decision-making". The important aspect of our model is its dynamic equations that allow us to simulate the time course of processes at a neural level that occur during different stages until a decision is made. We analyze in detail the conditions under which our model matches the behavioral and EEG data from human subjects. Consistent with experimental findings, our model supports the hypothesis of attending to two control settings concurrently. In particular, our model proposes that initially, feature-based attention operates in parallel across the scene, and only in ongoing processing, a selection by the location takes place.

Neural mechanisms underlying the temporal control of sequential saccade planning in the frontal eye field

Sequences of saccadic eye movements are instrumental in navigating our visual environment. While neural activity has been shown to ramp up to a threshold before single saccades, the neural underpinnings of multiple saccades is unknown. To understand the neural control of saccade sequences, we recorded from the frontal eye field (FEF) of macaque monkeys while they performed a sequential saccade task. We show that the concurrent planning of two saccade plans brings forth processing bottlenecks, specifically by decreasing the growth rate and increasing the threshold of saccade-related ramping activity. The rate disruption affected both saccade plans, and a computational model, wherein activity related to the two saccade plans mutually and asymmetrically inhibited each other, predicted the behavioral and neural results observed experimentally. Borrowing from models in psychology, our results demonstrate a capacity-sharing mechanism of processing bottlenecks, wherein multiple saccade plans in a sequence compete for the processing capacity by the perturbation of the saccade-related ramping activity. Finally, we show that, in contrast to movement-related neurons, visual activity in FEF neurons is not affected by the presence of multiple saccade targets, indicating that, for perceptually simple tasks, inhibition within movement-related neurons mainly instantiates capacity sharing. Taken together, we show how psychology-inspired models of capacity sharing can be mapped onto neural responses to understand the control of rapid saccade sequences.

Intracellular Properties of Deep-Layer Pyramidal Neurons in Frontal Eye Field of Macaque Monkeys

Although many details remain unknown, several positive statements can be made about the laminar distribution of primate frontal eye field (FEF) neurons with different physiological properties. Most certainly, pyramidal neurons in the deep layer of FEF that project to the brainstem carry movement and fixation signals but clear evidence also support that at least some deep-layer pyramidal neurons projecting to the superior colliculus carry visual responses. Thus, deep-layer neurons in FEF are functionally heterogeneous. Despite the useful functional distinctions between neuronal responses in vivo, the underlying existence of distinct cell types remain uncertain, mostly due to methodological limitations of extracellular recordings in awake behaving primates. To substantiate the functionally defined cell types encountered in the deep layer of FEF, we measured the biophysical properties of pyramidal neurons recorded intracellularly in brain slices issued from macaque monkey biopsies. Here, we found that biophysical properties recorded in vitro permit us to distinguish two main subtypes of regular-spiking neurons, with, respectively, low-resistance and low excitability vs. high-resistance and strong excitability. These results provide useful constraints for cognitive models of visual attention and saccade production by indicating that at least two distinct populations of deep-layer neurons exist.

Pupil dynamics: A potential proxy of neural preparation for goal-directed eye movement

The pupils reflexively constrict or dilate to regulate the influx of light on the retinae. Pupillary light reflex (PLR) is susceptible to many non-visual cognitive processes including covert orientation of attention and planning rapid saccadic eye movement. The frontal eye field (FEF) and superior colliculus (SC), which also send projections to the PLR pathway, are two important areas in primate's brain for planning saccade and orientation of attention. The saccadic reaction time (SRT) and the rate of increase in activity of movement neurons in these areas are inversely correlated. This study addressed how pupil dynamics, activity in the FEF and SC and SRT are related in a saccadic decision-making task. The rate of visually evoked pupil constriction was found inversely related to SRT. This was further verified by simulating a homeomorphic biomechanical model of pupillary muscle plants, wherein we projected signals similar to build-up activity in the FEF and SC to the parasympathetic (constriction) and sympathetic (dilation) division of the PLR pathway, respectively. A striking similarity between simulated and observed dynamics of pupil constriction suggests that PLR is a potential proxy of saccade planning by movement neurons in the FEF and SC. Indistinguishable pupil dynamics when planned saccades were elicited versus when they were cancelled eliminated the possibility that the obligatory pre-saccadic shift of attention alone influenced the rate of pupil constriction. Our study envisages a mechanism of how the oculomotor system influences the autonomic activity in an attempt to timely minimize saccadic visual transients by regulating the influx of light.

Efficacy of inhibitory control depends on procrastination and deceleration in saccade planning

A goal-directed flexible behavior warrants our ability to timely inhibit impending movements deemed inappropriate due to an abrupt change in the context. Race model of countermanding rapid saccadic eye movement posits a competition between a preparatory GO process and an inhibitory STOP process rising to reach a fixed threshold. Stop-signal response time (SSRT), which is the average time STOP takes to rise to the threshold, is widely used as a metric to assess the ability to revoke a movement. A reliable estimation of SSRT critically depends on the assumption of independence between GO and STOP process, which has been violated in many studies. In addition, the physiological correlate of stochastic rise of STOP process to a threshold remains unsubstantiated thus far. Here, we introduce a method to estimate the efficacy of inhibitory control on the premise of an alternative model that assumes deceleration of GO process following the stop-signal onset. The average reaction time increased exponentially with the increase in the maximum duration available to attenuate GO process by the stop-signal. Our method estimates saccade procrastination in anticipation of the stop-signal, and the rate of increase in attenuation on GO process. Unlike SSRT, these new metrics are independent of how the stopping performance varies with the delay between go- and stop-signal onsets. We reckon that these metrics together qualify to be considered as an efficient alternative to SSRT for the estimation of individuals' ability to countermand saccades, especially in cases when the assumptions of race model are no longer valid.

Spatiotemporal transformations for gaze control

Sensorimotor transformations require spatiotemporal coordination of signals, that is, through both time and space. For example, the gaze control system employs signals that are time-locked to various sensorimotor events, but the spatial content of these signals is difficult to assess during ordinary gaze shifts. In this review, we describe the various models and methods that have been devised to test this question, and their limitations. We then describe a new method that can (a) simultaneously test between all of these models during natural, head-unrestrained conditions, and (b) track the evolving spatial continuum from target (T) to future gaze coding (G, including errors) through time. We then summarize some applications of this technique, comparing spatiotemporal coding in the primate frontal eye field (FEF) and superior colliculus (SC). The results confirm that these areas preferentially encode eye-centered, effector-independent parameters, and show-for the first time in ordinary gaze shifts-a spatial transformation between visual and motor responses from T to G coding. We introduce a new set of spatial models (T-G continuum) that revealed task-dependent timing of this transformation: progressive during a memory delay between vision and action, and almost immediate without such a delay. We synthesize the results from our studies and supplement it with previous knowledge of anatomy and physiology to propose a conceptual model where cumulative transformation noise is realized as inaccuracies in gaze behavior. We conclude that the spatiotemporal transformation for gaze is both local (observed within and across neurons in a given area) and distributed (with common signals shared across remote but interconnected structures).

Cognitive control and automatic interference in mind and brain: A unified model of saccadic inhibition and countermanding

Countermanding behavior has long been seen as a cornerstone of executive control-the human ability to selectively inhibit undesirable responses and change plans. However, scattered evidence implies that stopping behavior is entangled with simpler automatic stimulus-response mechanisms. Here we operationalize this idea by merging the latest conceptualization of saccadic countermanding with a neural network model of visuo-oculomotor behavior that integrates bottom-up and top-down drives. This model accounts for all fundamental qualitative and quantitative features of saccadic countermanding, including neuronal activity. Importantly, it does so by using the same architecture and parameters as basic visually guided behavior and automatic stimulus-driven interference. Using simulations and new data, we compare the temporal dynamics of saccade countermanding with that of saccadic inhibition (SI), a hallmark effect thought to reflect automatic competition within saccade planning areas. We demonstrate how SI accounts for a large proportion of the saccade countermanding process when using visual signals. We conclude that top-down inhibition acts later, piggy-backing on the quicker automatic inhibition. This conceptualization fully accounts for the known effects of signal features and response modalities traditionally used across the countermanding literature. Moreover, it casts different light on the concept of top-down inhibition, its timing and neural underpinning, as well as the interpretation of stop-signal reaction time (RT), the main behavioral measure in the countermanding literature. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Distinct Sources of Variability Affect Eye Movement Preparation

The sequence of events leading to an eye movement to a target begins the moment visual information has reached the brain, well in advance of the eye movement itself. The process by which visual information is encoded and used to generate a motor plan has been the focus of substantial interest partly because of the rapid and reproducible nature of saccadic eye movements, and the key role that they play in primate behavior. Signals related to eye movements are present in much of the primate brain, yet most neurophysiological studies of the transition from vision to eye movements have measured the activity of one neuron at a time. Less is known about how the coordinated action of populations of neurons contribute to the initiation of eye movements. One cortical area of particular interest in this process is the frontal eye fields, a region of prefrontal cortex that has descending projections to oculomotor control centers. We recorded from populations of frontal eye field neurons in macaque monkeys engaged in a memory-guided saccade task. We found a variety of neurons with visually evoked responses, saccade-aligned responses, and mixtures of both. We took advantage of the simultaneous nature of the recordings to measure variability in individual neurons and pairs of neurons from trial-to-trial, as well as the moment-to-moment population activity structure. We found that these measures were related to saccadic reaction times, suggesting that the population-level organization of frontal eye field activity is important for the transition from perception to movement.SIGNIFICANCE STATEMENT The transition from perception to action involves coordination among neurons across the brain. In the case of eye movements, visual and motor signals coexist in individual neurons as well as in neighboring neurons. We used a task designed to compartmentalize the visual and motor aspects of this transition and studied populations of neurons in the frontal eye fields, a key cortical area containing neurons that are implicated in the transition from vision to eye movements. We found that the time required for subjects to produce an eye movement could be predicted from the statistics of the neuronal response of populations of frontal eye field neurons, suggesting that these neurons coordinate their activity to optimize the transition from perception to action.

Neurally constrained modeling of speed-accuracy tradeoff during visual search: gated accumulation of modulated evidence

Stochastic accumulator models account for response times and errors in perceptual decision making by assuming a noisy accumulation of perceptual evidence to a threshold. Previously, we explained saccade visual search decision making by macaque monkeys with a stochastic multiaccumulator model in which accumulation was driven by a gated feed-forward integration to threshold of spike trains from visually responsive neurons in frontal eye field that signal stimulus salience. This neurally constrained model quantitatively accounted for response times and errors in visual search for a target among varying numbers of distractors and replicated the dynamics of presaccadic movement neurons hypothesized to instantiate evidence accumulation. This modeling framework suggested strategic control over gate or over threshold as two potential mechanisms to accomplish speed-accuracy tradeoff (SAT). Here, we show that our gated accumulator model framework can account for visual search performance under SAT instructions observed in a milestone neurophysiological study of frontal eye field. This framework captured key elements of saccade search performance, through observed modulations of neural input, as well as flexible combinations of gate and threshold parameters necessary to explain differences in SAT strategy across monkeys. However, the trajectories of the model accumulators deviated from the dynamics of most presaccadic movement neurons. These findings demonstrate that traditional theoretical accounts of SAT are incomplete descriptions of the underlying neural adjustments that accomplish SAT, offer a novel mechanistic account of decision-making mechanisms during speed-accuracy tradeoff, and highlight questions regarding the identity of model and neural accumulators. NEW & NOTEWORTHY A gated accumulator model is used to elucidate neurocomputational mechanisms of speed-accuracy tradeoff. Whereas canonical stochastic accumulators adjust strategy only through variation of an accumulation threshold, we demonstrate that strategic adjustments are accomplished by flexible combinations of both modulation of the evidence representation and adaptation of accumulator gate and threshold. The results indicate how model-based cognitive neuroscience can translate between abstract cognitive models of performance and neural mechanisms of speed-accuracy tradeoff.

Detectability of stop-signal determines magnitude of deceleration in saccade planning

An inhibitory control is exerted when the context in which a movement has been planned changes abruptly making the impending movement inappropriate. Neurons in the frontal eye field and superior colliculus steadily increase activity before a saccadic eye movement, but cease the rise below a threshold when an impending saccade is withheld in response to an unexpected stop-signal. This type of neural modulation has been majorly considered as an outcome of a race between preparatory and inhibitory processes ramping up to reach a decision criterion. An alternative model claims that the rate of saccade planning is diminished exclusively when the stop-signal is detected within a stipulated period. However, due to a dearth of empirical evidence in support of the latter model, it remains unclear how the detectability of the stop-signal influences saccade inhibition. In our study, human participants selected a visual target to look at by discriminating a go-cue. Infrequently they cancelled saccade and reported whether they saw the stop-signal. The go-cue and stop-signal both were embedded in a stream of irrelevant stimuli presented in rapid succession. Participants exhibited difficulty in detection of the stop-signal when presented almost immediately after the go-cue. We found a robust relationship between the detectability of the stop-signal and the odds of saccade inhibition. Saccade latency increased exponentially with the maximum time available for processing the stop-signal before gaze shifted. A model in which the stop-signal onset spontaneously decelerated progressive saccade planning with the magnitude proportional to its detectability accounted for the data.

Functional Categories of Visuomotor Neurons in Macaque Frontal Eye Field

Frontal eye field (FEF) in macaque monkeys contributes to visual attention, visual-motor transformations and production of eye movements. Traditionally, neurons in FEF have been classified by the magnitude of increased discharge rates following visual stimulus presentation, during a waiting period, and associated with eye movement production. However, considerable heterogeneity remains within the traditional visual, visuomovement, and movement categories. Cluster analysis is a data-driven method of identifying self-segregating groups within a dataset. Because many cluster analysis techniques exist and outcomes vary with analysis assumptions, consensus clustering aggregates over multiple analyses, identifying robust groups. To describe more comprehensively the neuronal composition of FEF, we applied a consensus clustering technique for unsupervised categorization of patterns of spike rate modulation measured during a memory-guided saccade task. We report 10 functional categories, expanding on the traditional 3 categories. Categories were distinguished by latency, magnitude, and sign of visual response; the presence of sustained activity; and the dynamics, magnitude and sign of saccade-related modulation. Consensus clustering can include other metrics and can be applied to datasets from other brain regions to provide better information guiding microcircuit models of cortical function.

Corrective response times in a coordinated eye-head-arm countermanding task

Inhibition of motor responses has been described as a race between two competing decision processes of motor initiation and inhibition, which manifest as the reaction time (RT) and the stop signal reaction time (SSRT); in the case where motor initiation wins out over inhibition, an erroneous movement occurs that usually needs to be corrected, leading to corrective response times (CRTs). Here we used a combined eye-head-arm movement countermanding task to investigate the mechanisms governing multiple effector coordination and the timing of corrective responses. We found a high degree of correlation between effector response times for RT, SSRT, and CRT, suggesting that decision processes are strongly dependent across effectors. To gain further insight into the mechanisms underlying CRTs, we tested multiple models to describe the distribution of RTs, SSRTs, and CRTs. The best-ranked model (according to 3 information criteria) extends the LATER race model governing RTs and SSRTs, whereby a second motor initiation process triggers the corrective response (CRT) only after the inhibition process completes in an expedited fashion. Our model suggests that the neural processing underpinning a failed decision has a residual effect on subsequent actions. NEW & NOTEWORTHY Failure to inhibit erroneous movements typically results in corrective movements. For coordinated eye-head-hand movements we show that corrective movements are only initiated after the erroneous movement cancellation signal has reached a decision threshold in an accelerated fashion.

Neural mechanisms of speed-accuracy tradeoff of visual search: saccade vigor, the origin of targeting errors, and comparison of the superior colliculus and frontal eye field

Balancing the speed-accuracy tradeoff (SAT) is necessary for successful behavior. Using a visual search task with interleaved cues emphasizing speed or accuracy, we recently reported diverse contributions of frontal eye field (FEF) neurons instantiating salience evidence and response preparation. Here, we report replication of visual search SAT performance in two macaque monkeys, new information about variation of saccade dynamics with SAT, extension of the neurophysiological investigation to describe processes in the superior colliculus (SC), and a description of the origin of search errors in this task. Saccade vigor varied idiosyncratically across SAT conditions and monkeys but tended to decrease with response time. As observed in the FEF, speed-accuracy tradeoff was accomplished through several distinct adjustments in the superior colliculus. In "Accurate" relative to "Fast" trials, visually responsive neurons in SC as in FEF had lower baseline firing rates and later target selection. The magnitude of these adjustments in SC was indistinguishable from that in FEF. Search errors occurred when visual salience neurons in the FEF and the SC treated distractors as targets, even in the Accurate condition. Unlike FEF, the magnitude of visual responses in the SC did not vary across SAT conditions. Also unlike FEF, the activity of SC movement neurons when saccades were initiated was equivalent in Fast and Accurate trials. Saccade-related neural activity in SC, but not FEF, varied with saccade peak velocity. These results extend our understanding of the cortical and subcortical contributions to SAT. NEW & NOTEWORTHY Neurophysiological mechanisms of speed-accuracy tradeoff (SAT) have only recently been investigated. This article reports the first replication of SAT performance in nonhuman primates, the first report of variation of saccade dynamics with SAT, the first description of superior colliculus contributions to SAT, and the first description of the origin of errors during SAT. These results inform and constrain new models of distributed decision making.

Neural control of visual search by frontal eye field: chronometry of neural events and race model processes

We investigated the chronometry of neural processes in frontal eye fields of macaques performing double-step saccade visual search in which a conspicuous target changes location in the array on a random fraction of trials. Durations of computational processes producing a saccade to original and final target locations (GO1 and GO2, respectively) are derived from response times (RT) on different types of trials. In these data, GO2 tended to be faster than GO1, demonstrating that inhibition of the initial saccade did not delay production of the compensated saccade. Here, we measured the dynamics of visual, visuomovement, and movement neuron activity in relation to these processes by examining trials when neurons instantiated either process. First, we verified that saccades were initiated when the discharge rate of movement neurons reached a threshold that was invariant across RT and trial type. Second, the time when visual and visuomovement neurons selected the target and when movement neuron activity began to accumulate were not significantly different across trial type. Third, the interval from the beginning of accumulation to threshold of movement-related activity was significantly shorter when instantiating the GO2 relative to the GO1 process. Differences observed between monkeys are discussed. Fourth, random variation of RT was accounted for to some extent by random variation in both the onset and duration of selective activity of each neuron type but mostly by variation of movement neuron accumulation duration. These findings offer new insights into the sources of control of target selection and saccade production in dynamic environments.

Microsaccade production during saccade cancelation in a stop-signal task

We obtained behavioral data to evaluate two alternative hypotheses about the neural mechanisms of gaze control. The "fixation" hypothesis states that neurons in rostral superior colliculus (SC) enforce fixation of gaze. The "microsaccade" hypothesis states that neurons in rostral SC encode microsaccades rather than fixation per se. Previously reported neuronal activity in monkey SC during the saccade stop-signal task leads to specific, dissociable behavioral predictions of these two hypotheses. When subjects are required to cancel partially-prepared saccades, imbalanced activity spreads across rostral and caudal SC with a reliable temporal profile. The microsaccade hypothesis predicts that this imbalance will lead to elevated microsaccade production biased toward the target location, while the fixation hypothesis predicts reduced microsaccade production. We tested these predictions by analyzing the microsaccades produced by 4 monkeys while they voluntarily canceled partially prepared eye movements in response to explicit stop signals. Consistent with the fixation hypothesis and contradicting the microsaccade hypothesis, we found that each subject produced significantly fewer microsaccades when normal saccades were successfully canceled. The few microsaccades escaping this inhibition tended to be directed toward the target location. We additionally investigated interactions between initiating microsaccades and inhibiting normal saccades. Reaction times were longer when microsaccades immediately preceded target presentation. However, pre-target microsaccade production did not affect stop-signal reaction time or alter the probability of canceling saccades following stop signals. These findings demonstrate that imbalanced activity within SC does not necessarily produce microsaccades and add to evidence that saccade preparation and cancelation are separate processes.

Saccade execution suppresses discrimination at distractor locations rather than enhancing the saccade goal location

As we have limited processing abilities with respect to the plethora of visual information entering our brain, spatial selection mechanisms are crucial. These mechanisms result in both enhancing processing at a location of interest and in suppressing processing at other locations; together, they enable successful further processing of locations of interest. It has been suggested that saccade planning modulates these spatial selection mechanisms; however, the precise influence of saccades on the distribution of spatial resources underlying selection remains unclear. To this end, we compared discrimination performance at different locations (six) within a work space during different saccade tasks. We used visual discrimination performance as a behavioral measure of enhancement and suppression at the different locations. A total of 14 participants performed a dual discrimination/saccade countermanding task, which allowed us to specifically isolate the consequences of saccade execution. When a saccade was executed, discrimination performance at the cued location was never better than when fixation was maintained, suggesting that saccade execution did not enhance processing at a location more than knowing the likelihood of its appearance. However, discrimination was consistently lower at distractor (uncued) locations in all cases where a saccade was executed compared with when fixation was maintained. Based on these results, we suggest that saccade execution specifically suppresses distractor locations, whereas attention shifts (with or without an accompanying saccade) are involved in enhancing perceptual processing at the goal location.

Region-Specific Summation Patterns Inform the Role of Cortical Areas in Selecting Motor Plans

Given an instruction regarding which effector to move and what location to move to, simply adding the effector and spatial signals together will not lead to movement selection. For this, a nonlinearity is required. Thresholds, for example, can be used to select a particular response and reject others. Here we consider another useful nonlinearity, a supralinear multiplicative interaction. To help select a motor plan, spatial and effector signals could multiply and thereby amplify each other. Such an amplification could constitute one step within a distributed network involved in response selection, effectively boosting one response while suppressing others. We therefore asked whether effector and spatial signals sum supralinearly for planning eye versus arm movements from the parietal reach region (PRR), the lateral intraparietal area (LIP), the frontal eye field (FEF), and a portion of area 5 (A5) lying just anterior to PRR. Unlike LIP neurons, PRR, FEF, and, to a lesser extent, A5 neurons show a supralinear interaction. Our results suggest that selecting visually guided eye versus arm movements is likely to be mediated by PRR and FEF but not LIP.

Inhibitory control in mind and brain 2.0: blocked-input models of saccadic countermanding

The interactive race model of saccadic countermanding assumes that response inhibition results from an interaction between a go unit, identified with gaze-shifting neurons, and a stop unit, identified with gaze-holding neurons, in which activation of the stop unit inhibits the growth of activation in the go unit to prevent it from reaching threshold. The interactive race model accounts for behavioral data and predicts physiological data in monkeys performing the stop-signal task. We propose an alternative model that assumes that response inhibition results from blocking the input to the go unit. We show that the blocked-input model accounts for behavioral data as accurately as the original interactive race model and predicts aspects of the physiological data more accurately. We extend the models to address the steady-state fixation period before the go stimulus is presented and find that the blocked-input model fits better than the interactive race model. We consider a model in which fixation activity is boosted when a stop signal occurs and find that it fits as well as the blocked input model but predicts very high steady-state fixation activity after the response is inhibited. We discuss the alternative linking propositions that connect computational models to neural mechanisms, the lessons to be learned from model mimicry, and generalization from countermanding saccades to countermanding other kinds of responses.

Visual-Motor Transformations Within Frontal Eye Fields During Head-Unrestrained Gaze Shifts in the Monkey

A fundamental question in sensorimotor control concerns the transformation of spatial signals from the retina into eye and head motor commands required for accurate gaze shifts. Here, we investigated these transformations by identifying the spatial codes embedded in visually evoked and movement-related responses in the frontal eye fields (FEFs) during head-unrestrained gaze shifts. Monkeys made delayed gaze shifts to the remembered location of briefly presented visual stimuli, with delay serving to dissociate visual and movement responses. A statistical analysis of nonparametric model fits to response field data from 57 neurons (38 with visual and 49 with movement activities) eliminated most effector-specific, head-fixed, and space-fixed models, but confirmed the dominance of eye-centered codes observed in head-restrained studies. More importantly, the visual response encoded target location, whereas the movement response mainly encoded the final position of the imminent gaze shift (including gaze errors). This spatiotemporal distinction between target and gaze coding was present not only at the population level, but even at the single-cell level. We propose that an imperfect visual–motor transformation occurs during the brief memory interval between perception and action, and further transformations from the FEF's eye-centered gaze motor code to effector-specific codes in motor frames occur downstream in the subcortical areas.

Saliency and saccade encoding in the frontal eye field during natural scene search

The frontal eye field (FEF) plays a central role in saccade selection and execution. Using artificial stimuli, many studies have shown that the activity of neurons in the FEF is affected by both visually salient stimuli in a neuron's receptive field and upcoming saccades in a certain direction. However, the extent to which visual and motor information is represented in the FEF in the context of the cluttered natural scenes we encounter during everyday life has not been explored. Here, we model the activities of neurons in the FEF, recorded while monkeys were searching natural scenes, using both visual and saccade information. We compare the contribution of bottom-up visual saliency (based on low-level features such as brightness, orientation, and color) and saccade direction. We find that, while saliency is correlated with the activities of some neurons, this relationship is ultimately driven by activities related to movement. Although bottom-up visual saliency contributes to the choice of saccade targets, it does not appear that FEF neurons actively encode the kind of saliency posited by popular saliency map theories. Instead, our results emphasize the FEF's role in the stages of saccade planning directly related to movement generation.

A mechanism for decision rule discrimination by supplementary eye field neurons

A decision to select an action from alternatives is often guided by rules that flexibly map sensory inputs to motor outputs when certain conditions are satisfied. However, the neural mechanisms underlying rule-based decision making remain poorly understood. Two complementary types of neurons in the supplementary eye field (SEF) of macaques have been identified that modulate activity differentially to interpret rules in an ocular go-nogo task, which stipulates that the animal either visually pursue a moving object if it intersects a visible zone ('go'), or maintain fixation if it does not ('nogo'). These neurons discriminate between go and nogo rule-states by increasing activity to signal their preferred (agonist) rule-state and decreasing activity to signal their non-preferred (antagonist) rule-state. In the current study, we found that SEF neurons decrease activity in anticipation of the antagonist rule-state, and do so more rapidly when the rule-state is easier to predict. This rapid decrease in activity could underlie a process of elimination in which trajectories that do not invoke the preferred rule-state receive no further computational resources. Furthermore, discrimination between difficult and easy trials in the antagonist rule-state occurs prior to when discrimination within the agonist rule-state occurs. A winner-take-all like model that incorporates a pair of mutually inhibited integrators to accumulate evidence in favor of either the decision to pursue or the decision to continue fixation accounts for the observed neural phenomena.

No perisaccadic mislocalization with abruptly cancelled saccades

Every saccadic eye movement that we make changes the image of the world on our retina. Yet, despite these retinal shifts, we still perceive our visual world to be stable. Efference copy from the oculomotor system to the visual system has been suggested to contribute to this stable percept, enabling the brain to anticipate the retinal image shifts by remapping the neural image. A psychophysical phenomenon that has been linked to this predictive remapping is the mislocalization of a stimulus flashed around the time of a saccade. If this mislocalization is initiated by saccade preparation, one should also observe localization errors when a saccade is planned, but abruptly aborted just before its execution. We tested this hypothesis in human subjects using a novel paradigm that combines a flash localization task with a countermanding component that occasionally requires saccade cancellation. Surprisingly, we found no trace of mislocalization, even for saccades cancelled close to the point of no return. This strongly suggests that the actual execution of the saccade is a prerequisite for the typical localization errors, which rejects various models and constrains neural substrates. We conclude that perisaccadic mislocalization is not a direct consequence of saccade preparation, but arises after saccade execution when the flash location is constructed from memory.

Separate evaluation of target facilitation and distractor suppression in the activity of macaque lateral intraparietal neurons during visual search

During visual search, neurons in the lateral intraparietal area (LIP) discriminate the target from distractors by exhibiting stronger activation when the target appears within the receptive field than when it appears outside the receptive field. It is generally thought that such target-discriminative activity is produced by the combination of target-related facilitation and distractor-related suppression. However, little is known about how the target-discriminative activity is constituted by these two types of neural modulation. To address this issue, we recorded activity from LIP of monkeys performing a visual search task that consisted of target-present and target-absent trials. Monkeys had to make a saccade to a target in the target-present trials, whereas they had to maintain fixation in the target-absent trials, in which only distractors were presented. By introducing the activity from the latter trials as neutral activity, we were able to separate the target-discriminative activity into target-related elevation and distractor-related reduction components. We found that the target-discriminative activity of most LIP neurons consisted of the combination of target-related elevation and distractor-related reduction or only target-related elevation. In contrast, target-discriminative activity composed of only distractor-related reduction was observed for very few neurons. We also found that, on average, target-related elevation was stronger and occurred earlier compared with distractor-related reduction. Finally, we consider possible underlying mechanisms, including lateral inhibitory interactions, responsible for target-discriminative activity in visual search. The present findings provide insight into how neuronal modulations shape target-discriminative activity during visual search.

Queuing of concurrent movement plans by basal ganglia

How the brain converts parallel representations of movement goals into sequential movements is not known. We tested the role of basal ganglia (BG) in the temporal control of movement sequences by a convergent approach involving inactivation of the BG by muscimol injections into the caudate nucleus of monkeys and assessing behavior of Parkinson's disease patients, performing a modified double-step saccade task. We tested a critical prediction of a class of competitive queuing models that explains serial behavior as the outcome of a selection of concurrently activated goals. In congruence with these models, we found that inactivation or impairment of the BG unmasked the parallel nature of goal representations such that a significantly greater extent of averaged saccades, curved saccades, and saccade sequence errors were observed. These results suggest that the BG perform a form of competitive queuing, holding the second movement plan in abeyance while the first movement is being executed, allowing the proper temporal control of movement sequences.

The countermanding task revisited: fast stimulus detection is a key determinant of psychophysical performance

The countermanding task is a standard method for assessing cognitive/inhibitory control over action and for investigating its neural correlates. In it, the subject plans a movement and either executes it, if no further instruction is given, or attempts to prevent it, if a stop signal is shown. Through various experimental manipulations, many studies have sought to characterize the inhibitory mechanisms thought to be at work in the task, typically using an inferred, model-dependent metric called the stop-signal reaction time. This approach has consistently overlooked the impact of perceptual evaluation on performance. Through analytical work and computer simulations, here we show that psychophysical performance in the task can be easily understood as the result of an ongoing motor plan that is modified (decelerated) by the outcome of a rapid sensory detection process. Notably, no specific assumptions about hypothetical inhibitory mechanisms are needed. This modeling framework achieves four things: (1) it replicates and reconciles behavioral results in numerous variants of the countermanding task; (2) it provides a new, objective metric for characterizing task performance that is more effective than the stop-signal reaction time; (3) it shows that the time window over which detection of a high-visibility stimulus effectively occurs is extremely short (∼20 ms); and (4) it indicates that modulating neuronal latencies and the buildup rates of developing motor plans are two key neural mechanisms for controlling action. The results suggest that manipulations of the countermanding task often cause changes in perceptual detection processes, and not necessarily in inhibition.

Neural mechanisms of speed-accuracy tradeoff

Intelligent agents balance speed of responding with accuracy of deciding. Stochastic accumulator models commonly explain this speed-accuracy tradeoff by strategic adjustment of response threshold. Several laboratories identify specific neurons in prefrontal and parietal cortex with this accumulation process, yet no neurophysiological correlates of speed-accuracy tradeoff have been described. We trained macaque monkeys to trade speed for accuracy on cue during visual search and recorded the activity of neurons in the frontal eye field. Unpredicted by any model, we discovered that speed-accuracy tradeoff is accomplished through several distinct adjustments. Visually responsive neurons modulated baseline firing rate, sensory gain, and the duration of perceptual processing. Movement neurons triggered responses with activity modulated in a direction opposite of model predictions. Thus, current stochastic accumulator models provide an incomplete description of the neural processes accomplishing speed-accuracy tradeoffs. The diversity of neural mechanisms was reconciled with the accumulator framework through an integrated accumulator model constrained by requirements of the motor system.

Is saccade averaging determined by visual processing or movement planning?

Saccadic averaging that causes subjects' gaze to land between the location of two targets when faced with simultaneously or sequentially presented stimuli has been often used as a probe to investigate the nature of computations that transform sensory representations into an oculomotor plan. Since saccadic movements involve at least two processing stages-a visual stage that selects a target and a movement stage that prepares the response-saccade averaging can either occur due to interference in visual processing or movement planning. By having human subjects perform two versions of a saccadic double-step task, in which the stimuli remained the same, but different instructions were provided (REDIRECT gaze to the later-appearing target vs. FOLLOW the sequence of targets in their order of appearance), we tested two alternative hypotheses. If saccade averaging were due to visual processing alone, the pattern of saccade averaging is expected to remain the same across task conditions. However, whereas subjects produced averaged saccades between two targets in the FOLLOW condition, they produced hypometric saccades in the direction of the initial target in the REDIRECT condition, suggesting that the interaction between competing movement plans produces saccade averaging.

Current advances and pressing problems in studies of stopping

The stop-signal task probes agents' ability to inhibit responding. A well-known race model affords estimation of the duration of the inhibition process. This powerful approach has yielded numerous insights into the neural circuitry underlying response control, the specificity of inhibition across effectors and response strategies, and executive processes such as performance monitoring. Translational research between human and non-human primates has been particularly useful in this venture. Continued progress with the stop-signal paradigm is contingent upon appreciating the dynamics of entire cortical and subcortical neural circuits and obtaining neurophysiological data from each node in the circuit. Progress can also be anticipated on extensions of the race model to account for selective stopping; we expect this will entail embedding behavioral inhibition in the broader context of executive control.

Understanding how the brain changes its mind: microstimulation in the macaque frontal eye field reveals how saccade plans are changed

Accumulator models that integrate incoming sensory information into motor plans provide a robust framework to understand decision making. However, their applicability to situations that demand a change of plan raises an interesting problem for the brain. This is because interruption of the current motor plan must occur by a competing motor plan, which is necessarily weaker in strength. To understand how changes of mind get expressed in behavior, we used a version of the double-step task called the redirect task, in which monkeys were trained to modify a saccade plan. We microstimulated the frontal eye fields during redirect behavior and systematically measured the deviation of the evoked saccade from the response field to causally track the changing saccade plan. Further, to identify the underlying mechanisms, eight different computational models of redirect behavior were assessed. It was observed that the model that included an independent, spatially specific inhibitory process, in addition to the two accumulators representing the preparatory processes of initial and final motor plans, best predicted the performance and the pattern of saccade deviation profile in the task. Such an inhibitory process suppressed the preparation of the initial motor plan, allowing the final motor plan to proceed unhindered. Thus, changes of mind are consistent with the notion of a spatially specific, inhibitory process that inhibits the current inappropriate plan, allowing expression of the new plan.

From salience to saccades: multiple-alternative gated stochastic accumulator model of visual search

We describe a stochastic accumulator model demonstrating that visual search performance can be understood as a gated feedforward cascade from a salience map to multiple competing accumulators. The model quantitatively accounts for behavior and predicts neural dynamics of macaque monkeys performing visual search for a target stimulus among different numbers of distractors. The salience accumulated in the model is equated with the spike trains recorded from visually responsive neurons in the frontal eye field. Accumulated variability in the firing rates of these neurons explains choice probabilities and the distributions of correct and error response times with search arrays of different set sizes if the accumulators are mutually inhibitory. The dynamics of the stochastic accumulators quantitatively predict the activity of presaccadic movement neurons that initiate eye movements if gating inhibition prevents accumulation before the representation of stimulus salience emerges. Adjustments in the level of gating inhibition can control trade-offs in speed and accuracy that optimize visual search performance.

Cell-type-specific synchronization of neural activity in FEF with V4 during attention

Shifts of gaze and shifts of attention are closely linked and it is debated whether they result from the same neural mechanisms. Both processes involve the frontal eye fields (FEF), an area which is also a source of top-down feedback to area V4 during covert attention. To test the relative contributions of oculomotor and attention-related FEF signals to such feedback, we recorded simultaneously from both areas in a covert attention task and in a saccade task. In the attention task, only visual and visuomovement FEF neurons showed enhanced responses, whereas movement cells were unchanged. Importantly, visual, but not movement or visuomovement cells, showed enhanced gamma frequency synchronization with activity in V4 during attention. Within FEF, beta synchronization was increased for movement cells during attention but was suppressed in the saccade task. These findings support the idea that the attentional modulation of visual processing is not mediated by movement neurons.

Neural basis of adaptive response time adjustment during saccade countermanding

Humans and macaque monkeys adjust their response time adaptively in stop-signal (countermanding) tasks, responding slower after stop-signal trials than after control trials with no stop signal. We investigated the neural mechanism underlying this adaptive response time adjustment in macaque monkeys performing a saccade countermanding task. Earlier research showed that movements are initiated when the random accumulation of presaccadic movement-related activity reaches a fixed threshold. We found that a systematic delay in response time after stop-signal trials was accomplished not through a change of threshold, baseline, or accumulation rate, but instead through a change in the time when activity first began to accumulate. The neurons underlying movement initiation have been identified with stochastic accumulator models of response time performance. Therefore, this new result provides surprising new insights into the neural instantiation of stochastic accumulator models and the mechanisms through which executive control can be exerted.

Neural mechanisms of saccade target selection: gated accumulator model of the visual-motor cascade

We review a new computational model developed to understand how evidence about stimulus salience in visual search is translated into a saccade command. The model uses the activity of visually responsive neurons in the frontal eye field as evidence for stimulus salience that is accumulated in a network of stochastic accumulators to produce accurate and timely saccades. We discovered that only when the input to the accumulation process was gated could the model account for the variability in search performance and predict the dynamics of movement neuron discharge rates. This union of cognitive modeling and neurophysiology indicates how the visual-motor transformation can occur, and provides a concrete mapping between neuron function and specific cognitive processes.

Split of spatial attention as predicted by a systems-level model of visual attention

Can we attend to multiple distinct spatial locations at the same time? According to a recent psychophysical study [J. Dubois et al. (2009)Journal of Vision, 9, 3.1-11] such a split of spatial attention might be limited to short periods of time. Following N. P. Bichot et al. [(1999)Perception & Psychophysics, 61, 403-423] subjects had to report the identity of multiple letters that were briefly presented at different locations, while two of these locations (targets) were relevant for a concurrent shape comparison task. In addition to the design used by Bichot et al. stimulus onset asynchrony between shape onset and letters was systematically varied. In general, the performance of subjects was superior at target locations. Furthermore, for short stimulus onset asynchronies, performance was simultaneously increasing at both target locations. For longer stimulus onset asynchronies, however, performance deteriorated at one of the target locations while increasing at the other target location. It was hypothesized that this dynamic deployment of attention might be caused by competitive processes in saccade-related structures such as the frontal eye field. Here we simulated the task of Dubois et al. using a systems-level model of attention. Our results are consistent with recent findings in the frontal eye field obtained during covert visual search, and they support the view of a transient deployment of spatial attention to multiple stimuli in the early epoch of target selection.

Neural correlates of cognitive control of reaching movements in the dorsal premotor cortex of rhesus monkeys

Canceling a pending movement is a hallmark of voluntary behavioral control because it allows us to quickly adapt to unattended changes either in the external environment or in our thoughts. The countermanding paradigm allows the study of inhibitory processes of motor acts by requiring the subject to withhold planned movements in response to an infrequent stop-signal. At present the neural processes underlying the inhibitory control of arm movements are mostly unknown. We recorded the activity of single units in the rostral and caudal portion of the dorsal premotor cortex (PMd) of monkeys trained in a countermanding reaching task. We found that among neurons with a movement-preparatory activity, about one-third exhibit a modulation before the behavioral estimate of the time it takes to cancel a planned movement. Hence these neurons exhibit a pattern of activity suggesting that PMd plays a critical role in the brain networks involved in the control of arm movement initiation and suppression.

Neural correlates of perceptual decision making before, during, and after decision commitment in monkey frontal eye field

Perceptual decision making requires a complex set of computations to implement, evaluate, and adjust the conversion of sensory input into a categorical judgment. Little is known about how the specific underlying computations are distributed across and within different brain regions. Using a reaction-time (RT) motion direction-discrimination task, we show that a unique combination of decision-related signals is represented in monkey frontal eye field (FEF). Some responses were modulated by choice, motion strength, and RT, consistent with a temporal accumulation of sensory evidence. These responses converged to a threshold level prior to behavioral responses, reflecting decision commitment. Other responses continued to be modulated by motion strength even after decision commitment, possibly providing a memory trace to help evaluate and adjust the decision process with respect to rewarding outcomes. Both response types were encoded by FEF neurons with both narrow- and broad-spike waveforms, presumably corresponding to inhibitory interneurons and excitatory pyramidal neurons, respectively, and with diverse visual, visuomotor, and motor properties, albeit with different frequencies. Thus, neurons throughout FEF appear to make multiple contributions to decision making that only partially overlap with contributions from other brain regions. These results help to constrain how networks of brain regions interact to generate perceptual decisions.

Measurement of the extraocular spike potential during saccade countermanding

The stop signal task is used to investigate motor inhibition. Several groups have reported partial electromyogram (EMG) activation when subjects successfully withhold manual responses and have used this finding to define the nature of response inhibition properties in the spinal motor system. It is unknown whether subthreshold EMG activation from extraocular muscles can be detected in the saccadic response version of the stop signal task. The saccadic spike potential provides a way to examine extraocular EMG activation associated with eye movements in electroencephalogram (EEG) recordings. We used several techniques to isolate extraocular EMG activation from anterior electrode locations of EEG recorded from macaque monkeys. Robust EMG activation was present when eye movements were made, but no activation was detected when saccades were deemed canceled. This work highlights a key difference between the spinal motor system and the saccade system.

Neurally constrained modeling of perceptual decision making

Stochastic accumulator models account for response time in perceptual decision-making tasks by assuming that perceptual evidence accumulates to a threshold. The present investigation mapped the firing rate of frontal eye field (FEF) visual neurons onto perceptual evidence and the firing rate of FEF movement neurons onto evidence accumulation to test alternative models of how evidence is combined in the accumulation process. The models were evaluated on their ability to predict both response time distributions and movement neuron activity observed in monkeys performing a visual search task. Models that assume gating of perceptual evidence to the accumulating units provide the best account of both behavioral and neural data. These results identify discrete stages of processing with anatomically distinct neural populations and rule out several alternative architectures. The results also illustrate the use of neurophysiological data as a model selection tool and establish a novel framework to bridge computational and neural levels of explanation.

Performance monitoring local field potentials in the medial frontal cortex of primates: supplementary eye field

We describe intracranial local field potentials (LFPs) recorded in the supplementary eye field (SEF) of macaque monkeys performing a saccade countermanding task. The most prominent feature at 90% of the sites was a negative-going polarization evoked by a contralateral visual target. At roughly 50% of sites a negative-going polarization was observed preceding saccades, but in stop signal trials this polarization was not modulated in a manner sufficient to control saccade initiation. When saccades were canceled in stop signal trials, LFP modulation increased with the inferred magnitude of response conflict derived from the coactivation of gaze-shifting and gaze-holding neurons. At 30% of sites, a pronounced negative-going polarization occurred after errors. This negative polarity did not appear in unrewarded correct trials. Variations of response time with trial history were not related to any features of the LFP. The results provide new evidence that error-related and conflict-related but not feedback-related signals are conveyed by the LFP in the macaque SEF and are important for identifying the generator of the error-related negativity.

Role of supplementary eye field in saccade initiation: executive, not direct, control

The goal of this study was to determine whether the activity of neurons in the supplementary eye field (SEF) is sufficient to control saccade initiation in macaque monkeys performing a saccade countermanding (stop signal) task. As previously observed, many neurons in the SEF increase the discharge rate before saccade initiation. However, when saccades are canceled in response to a stop signal, effectively no neurons with presaccadic activity display discharge rate modulation early enough to contribute to saccade cancellation. Moreover, SEF neurons do not exhibit a specific threshold discharge rate that could trigger saccade initiation. Yet, we observed more subtle relations between SEF activation and saccade production. The activity of numerous SEF neurons was correlated with response time and varied with sequential adjustments in response latency. Trials in which monkeys canceled or produced a saccade in a stop signal trial were distinguished by a modest difference in discharge rate of these SEF neurons before stop signal or target presentation. These findings indicate that neurons in the SEF, in contrast to counterparts in the frontal eye field and superior colliculus, do not contribute directly and immediately to the initiation of visually guided saccades. However the SEF may proactively regulate saccade production by biasing the balance between gaze-holding and gaze-shifting based on prior performance and anticipated task requirements.