Functional Categories of Visuomotor Neurons in Macaque Frontal Eye Field

Multiunit Frontal Eye Field Activity Codes the Visuomotor Transformation, But Not Gaze Prediction or Retrospective Target Memory, in a Delayed Saccade Task

Single-unit (SU) activity-action potentials isolated from one neuron-has traditionally been employed to relate neuronal activity to behavior. However, recent investigations have shown that multiunit (MU) activity-ensemble neural activity recorded within the vicinity of one microelectrode-may also contain accurate estimations of task-related neural population dynamics. Here, using an established model-fitting approach, we compared the spatial codes of SU response fields with corresponding MU response fields recorded from the frontal eye fields (FEFs) in head-unrestrained monkeys (Macaca mulatta) during a memory-guided saccade task. Overall, both SU and MU populations showed a simple visuomotor transformation: the visual response coded target-in-eye coordinates, transitioning progressively during the delay toward a future gaze-in-eye code in the saccade motor response. However, the SU population showed additional secondary codes, including a predictive gaze code in the visual response and retention of a target code in the motor response. Further, when SUs were separated into regular/fast spiking neurons, these cell types showed different spatial code progressions during the late delay period, only converging toward gaze coding during the final saccade motor response. Finally, reconstructing MU populations (by summing SU data within the same sites) failed to replicate either the SU or MU pattern. These results confirm the theoretical and practical potential of MU activity recordings as a biomarker for fundamental sensorimotor transformations (e.g., target-to-gaze coding in the oculomotor system), while also highlighting the importance of SU activity for coding more subtle (e.g., predictive/memory) aspects of sensorimotor behavior.

Conflict detection and resolution in macaque frontal eye fields

Stimulus-induced conflicts in decision-making tasks produce both behavioral and neuronal congruency effects. However, how and when conflicts are detected and resolved at the neuronal level remains largely unclear. To address these issues, we recorded from single neurons in the frontal eye fields of two macaques performing a conflict task. Although the temporal dynamics of the neuronal congruency effects are independent of the specific task rules, they are substantially different in target- and distractor-encoding neurons. Conflicts were detected ~100 ms after the conflict-inducing cue (20-30 ms after the visual response), which is much faster than predicted based on human EEG results. This suggests that conflict detection relies on a fast mechanism in frontal eye fields. Resolving the conflict at the neuronal level, however, requires between <400 ms to ~1000 ms, and shows profound interindividual differences and depends on task rules, indicating that it is a more complex and top-down driven process. Our findings illuminate the neuronal mechanisms underlying decision-making when a conflict is present, a crucial cognitive process playing a role in basic survival and high-level cognitive functions.

Resilience of FEF neuronal saccade code to V4 perturbations

The frontal eye field (FEF) plays a key role in initiating rapid eye movements known as saccades. Accumulation models have been proposed to explain the dynamic of these neurons and how they may enable the initiation of saccades. To update the scope of the viability of this model, we studied single neurons recorded from the FEF of two rhesus monkeys while they performed a memory-guided saccade task. We evaluated the degree to which each type of FEF neuron complied with these models by quantifying how precisely their discharge predicted an imminent saccade based on their immediate presaccadic activity. We found that decoders trained on single neurons with a stronger motor component performed better than decoders trained on neurons with a stronger visual component in predicting the saccade. Importantly, despite a dramatic effect on the reaction times, the perturbations delivered to the FEF neurons via area V4 did not impact their saccade predictability. Our results demonstrate a high degree of resilience of the FEF neuronal presaccadic discharge patterns, fulfilling the predictions of accumulation models.NEW & NOTEWORTHY We studied neurons in the brain's frontal eye field (FEF) to understand how these neurons predict swift eye shifts called saccades. We found that neurons with more movement-related activity were better at predicting saccades than those with sensory-related activity. Interestingly, electrical disruptions of this region strongly impacted saccade onset times but did not affect the individual neuron's saccade predictability, consistent with models suggesting that a specific threshold in neural activity triggers the saccade.

Individual prefrontal neurons contribute to sensory-to-motor information transformation by rotating reference frames during spatial working memory performance

Performing working memory tasks correctly requires not only the temporary maintenance of information but also the visual-to-motor transformation of information. Although sustained delay-period activity is known to be a mechanism for temporarily maintaining information, the mechanism for information transformation is not well known. An analysis using a population of delay-period activities recorded from prefrontal neurons visualized a gradual change of maintained information from sensory to motor as the delay period progressed. However, the contributions of individual prefrontal neurons to this process are not known. In the present study, we used a version of the delayed-response task, in which monkeys needed to make a saccade 90o clockwise from a visual cue after a 3-s delay, and examined the temporal change in the preferred directions of delay-period activity during the delay period for individual neurons. One group of prefrontal neurons encoded the cue direction by a retinotopic reference frame and either maintained it throughout the delay period or rotated it 90o counterclockwise to adjust visual information to saccade information, whereas other groups of neurons encoded the cue direction by a saccade-based reference frame and rotated it 90o clockwise. The results indicate that visual-to-motor information transformation is achieved by manipulating the reference frame to adjust visual coordinates to motor coordinates.

Accurate localization and coactivation profiles of the frontal eye field and inferior frontal junction: an ALE and MACM fMRI meta-analysis

The frontal eye field (FEF) and the inferior frontal junction (IFJ) are prefrontal structures involved in mediating multiple aspects of goal-driven behavior. Despite being recognized as prominent nodes of the networks underlying spatial attention and oculomotor control, and working memory and cognitive control, respectively, the limited quantitative evidence on their precise localization has considerably impeded the detailed understanding of their structure and connectivity. In this study, we performed an activation likelihood estimation (ALE) fMRI meta-analysis by selecting studies that employed standard paradigms to accurately infer the localization of these regions in stereotaxic space. For the FEF, we found the highest spatial convergence of activations for prosaccade and antisaccade paradigms at the junction of the precentral sulcus and superior frontal sulcus. For the IFJ, we found consistent activations across oddball/attention, working memory, task-switching and Stroop paradigms at the junction of the inferior precentral sulcus and inferior frontal sulcus. We related these clusters to previous meta-analyses, sulcal/gyral neuroanatomy, and a comprehensive brain parcellation, highlighting important differences compared to their results and taxonomy. Finally, we leveraged the ALE peak coordinates as seeds to perform a meta-analytic connectivity modeling (MACM) analysis, which revealed systematic coactivation patterns spanning the frontal, parietal, and temporal cortices. We decoded the behavioral domains associated with these coactivations, suggesting that these may allow FEF and IFJ to support their specialized roles in flexible behavior. Our study provides the meta-analytic groundwork for investigating the relationship between functional specialization and connectivity of two crucial control structures of the prefrontal cortex.

Spike rates of frontal eye field neurons predict reaction times in a spatial attention task

Which neuronal signal(s) predict reaction times when subjects respond to a target at covertly attended locations? Although recent studies showed that spike rates are not predictive, it remains a highly contested question. Therefore, we record single-unit activity from frontal eye field (FEF) neurons while macaques are performing a covert spatial attention task. We find that the attentional modulation of spike rates of FEF neurons is strongly correlated with behavioral reaction times. Moreover, this correlation already emerges 1 s before target dimming, which triggers the behavioral responses. This prediction of reaction times by spike rates is found in neurons showing attention-dependent enhanced and suppressed activity for targets and distractors, respectively, yet in varying degrees across subjects. Thus, spike rates of FEF neurons can predict reaction times persistently and well before the operant behavior during selective attention tasks. Such long prediction windows will be useful for developing spike-based brain-machine interfaces.

Frontal eye fields in macaque monkeys: prefrontal and premotor contributions to visually guided saccades

Neuronal spiking was sampled from the frontal eye field (FEF) and from the rostral part of area 6 that reaches to the superior limb of the arcuate sulcus, dorsal to the arcuate spur when present (F2vr) in macaque monkeys performing memory-guided saccades and visually guided saccades for visual search. Neuronal spiking modulation in F2vr resembled that in FEF in many but not all respects. A new consensus clustering algorithm of neuronal modulation patterns revealed that F2vr and FEF contain a greater variety of modulation patterns than previously reported. The areas differ in the proportions of visuomotor neuron types, the proportions of neurons discriminating a target from distractors during visual search, and the consistency of modulation patterns across tasks. However, between F2vr and FEF we found no difference in the magnitude of delay period activity, the timing of the peak discharge rate relative to saccades, or the time of search target selection. The observed similarities and differences between the 2 cortical regions contribute to other work establishing the organization of eye fields in the frontal lobe and may help explain why FEF in monkeys is identified within granular prefrontal area 8 but in humans is identified within agranular premotor area 6.

Cortical neural dynamics unveil the rhythm of natural visual behavior in marmosets

Numerous studies have shown that the visual system consists of functionally distinct ventral and dorsal streams; however, its exact spatial-temporal dynamics during natural visual behavior remain to be investigated. Here, we report cerebral neural dynamics during active visual exploration recorded by an electrocorticographic array covering the entire lateral surface of the marmoset cortex. We found that the dorsal stream was activated before the primary visual cortex with saccades and followed by the alteration of suppression and activation signals along the ventral stream. Similarly, the signal that propagated from the dorsal to ventral visual areas was accompanied by a travelling wave of low frequency oscillations. Such signal dynamics occurred at an average of 220 ms after saccades, which corresponded to the timing when whole-brain activation returned to background levels. We also demonstrated that saccades could occur at any point of signal flow, indicating the parallel computation of motor commands. Overall, this study reveals the neural dynamics of active vision, which are efficiently linked to the natural rhythms of visual exploration.

Pop-out search instigates beta-gated feature selectivity enhancement across V4 layers

Visual search is a workhorse for investigating how attention interacts with processing of sensory information. Attentional selection has been linked to altered cortical sensory responses and feature preferences (i.e., tuning). However, attentional modulation of feature selectivity during search is largely unexplored. Here we map the spatiotemporal profile of feature selectivity during singleton search. Monkeys performed a search where a pop-out feature determined the target of attention. We recorded laminar neural responses from visual area V4. We first identified "feature columns" which showed preference for individual colors. In the unattended condition, feature columns were significantly more selective in superficial relative to middle and deep layers. Attending a stimulus increased selectivity in all layers but not equally. Feature selectivity increased most in the deep layers, leading to higher selectivity in extragranular layers as compared to the middle layer. This attention-induced enhancement was rhythmically gated in phase with the beta-band local field potential. Beta power dominated both extragranular laminar compartments, but current source density analysis pointed to an origin in superficial layers, specifically. While beta-band power was present regardless of attentional state, feature selectivity was only gated by beta in the attended condition. Neither the beta oscillation nor its gating of feature selectivity varied with microsaccade production. Importantly, beta modulation of neural activity predicted response times, suggesting a direct link between attentional gating and behavioral output. Together, these findings suggest beta-range synaptic activation in V4's superficial layers rhythmically gates attentional enhancement of feature tuning in a way that affects the speed of attentional selection.

Roles of P300 and Late Positive Potential in Initial Romantic Attraction

Initial romantic attraction (IRA) refers to a series of positive reactions to potential romantic partners at the initial encounter; it evolved to promote mate selection, allowing individuals to focus their mating efforts on their preferred potential mates. After decades of effort, we now have a deeper understanding of the evolutionary value and dominant factors of IRA; however, little is known regarding the brain mechanisms related to its generation and evaluation. In this study, we combined classic event-related potential analysis with dipole-source analysis to examine electroencephalogram (EEG) signals generated while participants assessed their romantic interest in potential partners. The EEG signals were categorized into IRA-engendered and unengendered conditions based on behavioral indicators. We found that the faces elicited multiple late positivities, including P300 over the occipital-parietal regions and late positive potentials (LPPs) over the anterior regions. When compared to faces that did not engender IRA, faces that did engender IRA elicited (1) enhanced P300 over the parietal regions and heightened neural activity in the insula and cingulate cortex and (2) larger LPPs over the anterior regions and heightened neural activity in the orbitofrontal cortex, dorsolateral prefrontal cortex, cingulate cortex, frontal eye field, visual cortex, and insula. These results suggest IRA is generated and evaluated by an extensive brain network involved in emotion processing, attention control, and social evaluations. Furthermore, these findings indicate that P300 and LPP may represent different cognitive processes during IRA.

Intracellular Properties of Deep-Layer Pyramidal Neurons in Frontal Eye Field of Macaque Monkeys

Although many details remain unknown, several positive statements can be made about the laminar distribution of primate frontal eye field (FEF) neurons with different physiological properties. Most certainly, pyramidal neurons in the deep layer of FEF that project to the brainstem carry movement and fixation signals but clear evidence also support that at least some deep-layer pyramidal neurons projecting to the superior colliculus carry visual responses. Thus, deep-layer neurons in FEF are functionally heterogeneous. Despite the useful functional distinctions between neuronal responses in vivo, the underlying existence of distinct cell types remain uncertain, mostly due to methodological limitations of extracellular recordings in awake behaving primates. To substantiate the functionally defined cell types encountered in the deep layer of FEF, we measured the biophysical properties of pyramidal neurons recorded intracellularly in brain slices issued from macaque monkey biopsies. Here, we found that biophysical properties recorded in vitro permit us to distinguish two main subtypes of regular-spiking neurons, with, respectively, low-resistance and low excitability vs. high-resistance and strong excitability. These results provide useful constraints for cognitive models of visual attention and saccade production by indicating that at least two distinct populations of deep-layer neurons exist.

The functional roles of neural remapping in cortex

Remapping is a property of some cortical and subcortical neurons that update their responses around the time of an eye movement to account for the shift of stimuli on the retina due to the saccade. Physiologically, remapping is traditionally tested by briefly presenting a single stimulus around the time of the saccade and looking at the onset of the response and the locations in space to which the neuron is responsive. Here we suggest that a better way to understand the functional role of remapping is to look at the time at which the neural signal emerges when saccades are made across a stable scene. Based on data obtained using this approach, we suggest that remapping in the lateral intraparietal area is sufficient to play a role in maintaining visual stability across saccades, whereas in the frontal eye field, remapped activity carries information that affects future saccadic choices and, in a separate subset of neurons, is used to maintain a map of locations in the scene that have been previously fixated.

Different computations underlie overt presaccadic and covert spatial attention

Perception and action are tightly coupled: visual responses at the saccade target are enhanced right before saccade onset. This phenomenon, presaccadic attention, is a form of overt attention-deployment of visual attention with concurrent eye movements. Presaccadic attention is well-documented, but its underlying computational process remains unknown. This is in stark contrast to covert attention-deployment of visual attention without concurrent eye movements-for which the computational processes are well characterized by a normalization model. Here, a series of psychophysical experiments reveal that presaccadic attention modulates visual performance only via response gain changes. A response gain change was observed even when attention field size increased, violating the predictions of a normalization model of attention. Our empirical results and model comparisons reveal that the perceptual modulations by overt presaccadic and covert spatial attention are mediated through different computations.

Visuomotor Transformations Are Modulated by Focused Ultrasound over Frontal Eye Field

Neuromodulation with focused ultrasound (FUS) is being widely explored as a non-invasive tool to stimulate focal brain regions because of its superior spatial resolution and coverage compared with other neuromodulation methods. The precise effects of FUS stimulation on specific regions of the brain are not yet fully understood. Here, we characterized the behavioral effects of FUS stimulation directly applied through a craniotomy over the macaque frontal eye field (FEF). In macaque monkeys making directed eye movements to perform visual search tasks with direct or arbitrary responses, focused ultrasound was applied through a craniotomy over the FEF. Saccade response times (RTs) and error rates were determined for trials without or with FUS stimulation with pulses at a peak negative pressure of either 250 or 425 kPa. Both RTs and error rates were affected by FUS. Responses toward a target located contralateral to the FUS stimulation were approximately 3 ms slower in the presence of FUS in both monkeys studied, while only one exhibited a slowing of responses for ipsilateral targets. Error rates were lower in one monkey in this study. In another search task requiring making eye movements toward a target (pro-saccades) or in the opposite direction (anti-saccades), the RT for pro-saccades increased in the presence of FUS stimulation. Our results indicate the effectiveness of FUS to modulate saccadic responses when stimulating FEF in awake, behaving non-human primates.

Neural mechanism of priming in visual search

Selective attention affords scrutinizing items in our environment. However, attentional selection changes over time and across space. Empirically, repetition of visual search conditions changes attentional processing. Priming of pop-out is a vivid example. Repeatedly searching for the same pop-out search feature is accomplished with faster response times and fewer errors. We review the psychophysical background of priming of pop-out, focusing on the hypothesis that it arises through changes in visual selective attention. We also describe research done with macaque monkeys to understand the neural mechanisms supporting visual selective attention and priming of pop-out, and survey research on priming of pop-out using noninvasive brain measures with humans. We conclude by hypothesizing three alternative neural mechanisms and highlighting open questions.

Spatiotemporal transformations for gaze control

Sensorimotor transformations require spatiotemporal coordination of signals, that is, through both time and space. For example, the gaze control system employs signals that are time-locked to various sensorimotor events, but the spatial content of these signals is difficult to assess during ordinary gaze shifts. In this review, we describe the various models and methods that have been devised to test this question, and their limitations. We then describe a new method that can (a) simultaneously test between all of these models during natural, head-unrestrained conditions, and (b) track the evolving spatial continuum from target (T) to future gaze coding (G, including errors) through time. We then summarize some applications of this technique, comparing spatiotemporal coding in the primate frontal eye field (FEF) and superior colliculus (SC). The results confirm that these areas preferentially encode eye-centered, effector-independent parameters, and show-for the first time in ordinary gaze shifts-a spatial transformation between visual and motor responses from T to G coding. We introduce a new set of spatial models (T-G continuum) that revealed task-dependent timing of this transformation: progressive during a memory delay between vision and action, and almost immediate without such a delay. We synthesize the results from our studies and supplement it with previous knowledge of anatomy and physiology to propose a conceptual model where cumulative transformation noise is realized as inaccuracies in gaze behavior. We conclude that the spatiotemporal transformation for gaze is both local (observed within and across neurons in a given area) and distributed (with common signals shared across remote but interconnected structures).

Priming of Attentional Selection in Macaque Visual Cortex: Feature-Based Facilitation and Location-Based Inhibition of Return

Visual search performance varies with stimulus and response history. Priming of pop-out refers to increased accuracy and reduced response time with repeated presentation of particular singleton and distractor features (e.g., a red target among green distractor stimuli), which are abruptly impaired when singleton and distractor features swap (e.g., green target among red distractors). Meanwhile, inhibition of return refers to the slowing of response time when target location repeats. Neurophysiological correlates of both these phenomena have been reported in the frontal eye field (FEF), an area in the frontal lobe contributing to attentional selection and eye movement planning. To understand the mechanistic origin of these adaptive behaviors, we investigated visual cortical area V4, an area providing input to and receiving feedback from FEF, during feature-based priming of pop-out and location-based inhibition of return. Performing a color pop-out task, monkeys exhibited pronounced priming of pop-out and inhibition of return. Neural spiking from V4 revealed earlier target selection associated with priming of pop-out and delayed selection associated with inhibition of return. These results demonstrate substantial involvement of extrastriate visual cortex in behavioral priming and inhibition of return.

Right frontal eye field has perceptual and oculomotor functions during optokinetic stimulation and nystagmus

The right frontal eye field (rFEF) is associated with visual perception and eye movements. rFEF is activated during optokinetic nystagmus (OKN), a reflex that moves the eye in response to visual motion (optokinetic stimulation, OKS). It remains unclear whether rFEF plays causal perceptual and/or oculomotor roles during OKS and OKN. To test this, participants viewed a leftward-moving visual scene of vertical bars and judged whether a flashed dot was moving. Single pulses of transcranial magnetic stimulation (TMS) were applied to rFEF on half of trials. In half of blocks, to explore oculomotor control, participants performed an OKN in response to the OKS. rFEF TMS, during OKN, made participants more accurate on trials when the dot was still, and it slowed eye movements. In separate blocks, participants fixated during OKS. This not only controlled for eye movements but also allowed the use of EEG to explore the FEF's role in visual motion discrimination. In these blocks, by contrast, leftward dot motion discrimination was impaired, associated with a disruption of the frontal-posterior balance in alpha-band oscillations. None of these effects occurred in a control site (M1) experiment. These results demonstrate multiple related yet dissociable causal roles of the right FEF during optokinetic stimulation.NEW & NOTEWORTHY This study demonstrates causal roles of the right frontal eye field (FEF) in motion discrimination and eye movement control during visual scene motion: previous work had only examined other stimuli and eye movements such as saccades. Using combined transcranial magnetic stimulation and EEG and a novel optokinetic stimulation motion-discrimination task, we find evidence for multiple related yet dissociable causal roles within the FEF: perceptual processing during optokinetic stimulation, generation of the optokinetic nystagmus, and the maintenance of alpha oscillations.

Accumulators, Neurons, and Response Time

The marriage of cognitive neurophysiology and mathematical psychology to understand decision-making has been exceptionally productive. This interdisciplinary area is based on the proposition that particular neurons or circuits instantiate the accumulation of evidence specified by mathematical models of sequential sampling and stochastic accumulation. This linking proposition has earned widespread endorsement. Here, a brief survey of the history of the proposition precedes a review of multiple conundrums and paradoxes concerning the accuracy, precision, and transparency of that linking proposition. Correctly establishing how abstract models of decision-making are instantiated by particular neural circuits would represent a remarkable accomplishment in mapping mind to brain. Failing would reveal challenging limits for cognitive neuroscience. This is such a vigorous area of research because so much is at stake.

Selective Influence and Sequential Operations: A Research Strategy for Visual Search

We discuss the problem of elucidating mechanisms of visual search. We begin by considering the history, logic, and methods of relating behavioral or cognitive processes with neural processes. We then survey briefly the cognitive neurophysiology of visual search and essential aspects of the neural circuitry supporting this capacity. We introduce conceptually and empirically a powerful but underutilized experimental approach to dissect the cognitive processes supporting performance of a visual search task with factorial manipulations of singleton-distractor identifiability and stimulus-response cue discriminability. We show that systems factorial technology can distinguish processing architectures from the performance of macaque monkeys. This demonstration offers new opportunities to distinguish neural mechanisms through selective manipulation of visual encoding, search selection, rule encoding, and stimulus-response mapping.