Impact of Experience on the Representation of Object-Centered Space in the Macaque Supplementary Eye Field

Position- and scale-invariant object-centered spatial localization in monkey frontoparietal cortex dynamically adapts to cognitive demand

Egocentric encoding is a well-known property of brain areas along the dorsal pathway. Different to previous experiments, which typically only demanded egocentric spatial processing during movement preparation, we designed a task where two male rhesus monkeys memorized an on-the-object target position and then planned a reach to this position after the object re-occurred at variable location with potentially different size. We found allocentric (in addition to egocentric) encoding in the dorsal stream reach planning areas, parietal reach region and dorsal premotor cortex, which is invariant with respect to the position, and, remarkably, also the size of the object. The dynamic adjustment from predominantly allocentric encoding during visual memory to predominantly egocentric during reach planning in the same brain areas and often the same neurons, suggests that the prevailing frame of reference is less a question of brain area or processing stream, but more of the cognitive demands.

Surprise signals in the supplementary eye field: rectified prediction errors drive exploration-exploitation transitions

Visual search is coordinated adaptively by monitoring and predicting the environment. The supplementary eye field (SEF) plays a role in oculomotor control and outcome evaluation. However, it is not clear whether the SEF is involved in adjusting behavioral modes based on preceding feedback. We hypothesized that the SEF drives exploration-exploitation transitions by generating "surprise signals" or rectified prediction errors, which reflect differences between predicted and actual outcomes. To test this hypothesis, we introduced an oculomotor two-target search task in which monkeys were required to find two valid targets among four identical stimuli. After they detected the valid targets, they exploited their knowledge of target locations to obtain a reward by choosing the two valid targets alternately. Behavioral analysis revealed two distinct types of oculomotor search patterns: exploration and exploitation. We found that two types of SEF neurons represented the surprise signals. The error-surprise neurons showed enhanced activity when the monkey received the first error feedback after the target pair change, and this activity was followed by an exploratory oculomotor search pattern. The correct-surprise neurons showed enhanced activity when the monkey received the first correct feedback after an error trial, and this increased activity was followed by an exploitative, fixed-type search pattern. Our findings suggest that error-surprise neurons are involved in the transition from exploitation to exploration and that correct-surprise neurons are involved in the transition from exploration to exploitation.

Frames of reference for eye-head gaze shifts evoked during frontal eye field stimulation

The frontal eye field (FEF), in the prefrontal cortex, participates in the transformation of visual signals into saccade motor commands and in eye-head gaze control. The FEF is thought to show eye-fixed visual codes in head-restrained monkeys, but it is not known how it transforms these inputs into spatial codes for head-unrestrained gaze commands. Here, we tested if the FEF influences desired gaze commands within a simple eye-fixed frame, like the superior colliculus (SC), or in more complex egocentric frames like the supplementary eye fields (SEFs). We electrically stimulated 95 FEF sites in two head-unrestrained monkeys to evoke 3D eye-head gaze shifts and then mathematically rotated these trajectories into various reference frames. In theory, each stimulation site should specify a specific spatial goal when the evoked gaze shifts are plotted in the appropriate frame. We found that these motor output frames varied site by site, mainly within the eye-to-head frame continuum. Thus, consistent with the intermediate placement of the FEF within the high-level circuits for gaze control, its stimulation-evoked output showed an intermediate trend between the multiple reference frame codes observed in SEF-evoked gaze shifts and the simpler eye-fixed reference frame observed in SC-evoked movements. These results suggest that, although the SC, FEF and SEF carry eye-fixed information at the level of their unit response fields, this information is transformed differently in their output projections to the eye and head controllers.

Thinking in spatial terms: decoupling spatial representation from sensorimotor control in monkey posterior parietal areas 7a and LIP

Perhaps the simplest and most complete description of the cerebral cortex is that it is a sensorimotor controller whose primary purpose is to represent stimuli and movements, and adaptively control the mapping between them. However, in order to think, the cerebral cortex has to generate patterns of neuronal activity that encode abstract, generalized information independently of ongoing sensorimotor events. A critical question confronting cognitive systems neuroscience at present therefore is how neural signals encoding abstract information emerge within the sensorimotor control networks of the brain. In this review, we approach that question in the context of the neural representation of space in posterior parietal cortex of non-human primates. We describe evidence indicating that parietal cortex generates a hierarchy of spatial representations with three basic levels: including (1) sensorimotor signals that are tightly coupled to stimuli or movements, (2) sensorimotor signals modified in strength or timing to mediate cognition (examples include attention, working memory, and decision-processing), as well as (3) signals that encode frankly abstract spatial information (such as spatial relationships or categories) generalizing across a wide diversity of specific stimulus conditions. Here we summarize the evidence for this hierarchy, and consider data showing that signals at higher levels derive from signals at lower levels. That in turn could help characterize neural mechanisms that derive a capacity for abstraction from sensorimotor experience.

Asymmetric Influence of Egocentric Representation onto Allocentric Perception

Objects in the visual world can be represented in both egocentric and allocentric coordinates. Previous studies have found that allocentric representation can affect the accuracy of spatial judgment relative to an egocentric frame, but not vice versa. Here we asked whether egocentric representation influenced the processing speed of allocentric perception. We measured the manual reaction time of human subjects in a position discrimination task in which the behavioral response purely relied on the target's allocentric location, independent of its egocentric position. We used two conditions of stimulus location: the compatible condition-allocentric left and egocentric left or allocentric right and egocentric right; the incompatible condition-allocentric left and egocentric right or allocentric right and egocentric left. We found that egocentric representation markedly influenced allocentric perception in three ways. First, in a given egocentric location, allocentric perception was significantly faster in the compatible condition than in the incompatible condition. Second, as the target became more eccentric in the visual field, the speed of allocentric perception gradually slowed down in the incompatible condition but remained unchanged in the compatible condition. Third, egocentric-allocentric incompatibility slowed allocentric perception more in the left egocentric side than the right egocentric side. These results cannot be explained by interhemispheric visuomotor transformation and stimulus-response compatibility theory. Our findings indicate that each hemisphere preferentially processes and integrates the contralateral egocentric and allocentric spatial information, and the right hemisphere receives more ipsilateral egocentric inputs than left hemisphere does.

Bayesian nonparametric analysis of neuronal intensity rates

We propose a flexible hierarchical Bayesian nonparametric modeling approach to compare the spiking patterns of neurons recorded under multiple experimental conditions. In particular, we showcase the application of our statistical methodology using neurons recorded from the supplementary eye field region of the brains of two macaque monkeys trained to make delayed eye movements to three different types of targets. The proposed Bayesian methodology can be used to perform either a global analysis, allowing for the construction of posterior comparative intervals over the entire experimental time window, or a pointwise analysis for comparing the spiking patterns locally, in a predetermined portion of the experimental time window. By developing our nonparametric Bayesian model we are able to analyze neuronal data from three or more conditions while avoiding the computational expenses typically associated with more traditional analysis of physiological data.

Role of supplementary eye field in saccade initiation: executive, not direct, control

The goal of this study was to determine whether the activity of neurons in the supplementary eye field (SEF) is sufficient to control saccade initiation in macaque monkeys performing a saccade countermanding (stop signal) task. As previously observed, many neurons in the SEF increase the discharge rate before saccade initiation. However, when saccades are canceled in response to a stop signal, effectively no neurons with presaccadic activity display discharge rate modulation early enough to contribute to saccade cancellation. Moreover, SEF neurons do not exhibit a specific threshold discharge rate that could trigger saccade initiation. Yet, we observed more subtle relations between SEF activation and saccade production. The activity of numerous SEF neurons was correlated with response time and varied with sequential adjustments in response latency. Trials in which monkeys canceled or produced a saccade in a stop signal trial were distinguished by a modest difference in discharge rate of these SEF neurons before stop signal or target presentation. These findings indicate that neurons in the SEF, in contrast to counterparts in the frontal eye field and superior colliculus, do not contribute directly and immediately to the initiation of visually guided saccades. However the SEF may proactively regulate saccade production by biasing the balance between gaze-holding and gaze-shifting based on prior performance and anticipated task requirements.

Combination of neuronal signals representing object-centered location and saccade direction in macaque supplementary eye field

Neurons in the macaque supplementary eye field (SEF) fire at different rates in conjunction with planning saccades in different directions. They also exhibit object-centered spatial selectivity, firing at different rates when the target of the saccade is at the left or right end of a horizontal bar. To compare the rate of incidence of the two kinds of signal, and to determine how they combine, we recorded from SEF neurons while monkeys performed a task in which the target (a dot or the left or right end of a horizontal bar) could appear in any visual field quadrant. During the period when the target was visible on the screen and the monkey was preparing to make a saccade, many neurons exhibited selectivity for saccade direction, firing at a rate determined by the direction of the impending saccade irrespective of whether the target was a dot or the end of a bar. On bar trials, many of the same neurons exhibited object-centered selectivity, firing more strongly when the target was at the preferred end of the bar regardless of saccade direction. The rate of incidence of object-centered selectivity (33%) was lower overall than that of saccade-direction selectivity (56%). Signals related to saccade direction and the object-centered location of the target tended to combine additively. The results suggest that the SEF is at a transitional stage between representing the object-centered command and specifying the parameters of the saccade.