Positive and Negative Modulation of Motor Response in Primate Superior Colliculus by Reward Expectation

The olivary input to the cerebellum dissociates sensory events from movement plans

Neurons in the inferior olive are thought to anatomically organize the Purkinje cells (P-cells) of the cerebellum into computational modules, but what is computed by each module? Here, we designed a saccade task in marmosets that dissociated sensory events from motor events and then recorded the complex and simple spikes of hundreds of P-cells. We found that when a visual target was presented at a random location, the olive reported the direction of that sensory event to one group of P-cells, but not to a second group. However, just before movement onset, it reported the direction of the planned movement to both groups, even if that movement was not toward the target. At the end of the movement if the subject experienced an error but chose to withhold the corrective movement, only the first group received information about the sensory prediction error. We organized the P-cells based on the information content of their olivary input and found that in the group that received sensory information, the simple spikes were suppressed during fixation, then produced a burst before saccade onset in a direction consistent with assisting the movement. In the second group, the simple spikes were not suppressed during fixation but burst near saccade deceleration in a direction consistent with stopping the movement. Thus, the olive differentiated the P-cells based on whether they would receive sensory or motor information, and this defined their contributions to control of movements as well as holding still.

Distinct context- and content-dependent population codes in superior colliculus during sensation and action

Sensorimotor transformation is the process of first sensing an object in the environment and then producing a movement in response to that stimulus. For visually guided saccades, neurons in the superior colliculus (SC) emit a burst of spikes to register the appearance of stimulus, and many of the same neurons discharge another burst to initiate the eye movement. We investigated whether the neural signatures of sensation and action in SC depend on context. Spiking activity along the dorsoventral axis was recorded with a laminar probe as Rhesus monkeys generated saccades to the same stimulus location in tasks that require either executive control to delay saccade onset until permission is granted or the production of an immediate response to a target whose onset is predictable. Using dimensionality reduction and discriminability methods, we show that the subspaces occupied during the visual and motor epochs were both distinct within each task and differentiable across tasks. Single-unit analyses, in contrast, show that the movement-related activity of SC neurons was not different between tasks. These results demonstrate that statistical features in neural activity of simultaneously recorded ensembles provide more insight than single neurons. They also indicate that cognitive processes associated with task requirements are multiplexed in SC population activity during both sensation and action and that downstream structures could use this activity to extract context. Additionally, the entire manifolds associated with sensory and motor responses, respectively, may be larger than the subspaces explored within a certain set of experiments.

Inhibitory tagging in the superior colliculus during visual search

Inhibitory tagging is an important feature of many models of saccade target selection, in particular those that are based on the notion of a neural priority map. The superior colliculus (SC) has been suggested as a potential site of such a map, yet it is unknown whether inhibitory tagging is represented in the SC during visual search. In this study, we tested the hypothesis that SC neurons represent inhibitory tagging during search, as might be expected if they contribute to a priority map. To do so, we recorded the activity of SC neurons in a multisaccade visual-search task. On each trial, a single reward-bearing target was embedded in an array of physically identical, potentially reward-bearing targets and physically distinct, non-reward-bearing distractors. The task was to fixate the reward-bearing target. We found that, in the context of this task, the activity of many SC neurons was greater when their response field stimulus was a target than when it was a distractor and was reduced when it had been previously fixated relative to when it had not. Moreover, we found that the previous-fixation-related reduction of activity was larger for targets than for distractors and decreased with increasing time (or number of saccades) since fixation. Taken together, the results suggest that fixated stimuli are transiently inhibited in the SC during search, consistent with the notion that inhibitory tagging plays an important role in visual search and that SC neurons represent this inhibition as part of a priority map used for saccade target selection.NEW & NOTEWORTHY Searching a cluttered scene for an object of interest is a ubiquitous task in everyday life, which we often perform relatively quickly and efficiently. It has been suggested that to achieve such speed and efficiency an inhibitory-tagging mechanism inhibits saccades to objects in the scene once they have been searched and rejected. Here, we demonstrate that the superior colliculus represents this type of inhibition during search, consistent with its role in saccade target selection.

Sensory tuning in neuronal movement commands

Movement control is critical for successful interaction with our environment. However, movement does not occur in complete isolation of sensation, and this is particularly true of eye movements. Here, we show that the neuronal eye movement commands emitted by the superior colliculus (SC), a structure classically associated with oculomotor control, encompass a robust visual sensory representation of eye movement targets. Thus, similar saccades toward different images are associated with different saccade-related "motor" bursts. Such sensory tuning in SC saccade motor commands appeared for all image manipulations that we tested, from simple visual features to real-life object images, and it was also strongest in the most motor neurons in the deeper collicular layers. Visual-feature discrimination performance in the motor commands was also stronger than in visual responses. Comparing SC motor command feature discrimination performance to that in the primary visual cortex during steady-state gaze fixation revealed that collicular motor bursts possess a reliable perisaccadic sensory representation of the peripheral saccade target's visual appearance, exactly when retinal input is expected to be most uncertain. Our results demonstrate that SC neuronal movement commands likely serve a fundamentally sensory function.

Reward-driven modulation of spatial attention in the human frontal eye-field

Attentional selection and the decision of where to make an eye-movement are driven by various factors such as the representation of salience, task goal, and stimulus relevance, as well as expectations or predictions based on past experience. Brain systems implicated in these processes recruit cortico-subcortical areas including the Frontal Eye-Field (FEF), parietal cortex, or superior colliculus. How these areas interact to govern attention remains elusive. Priority maps of space have been observed in several brain regions, but the neural substrates where different sources of information are combined and integrated to guide attentional selection has not been elucidated. We investigated here the neural mechanisms subserving how reward cues influence the voluntary deployment of attention, in conditions where stimulus-driven capture and task-related goals compete for attention selection. Using fMRI in a visual search task in n = 23 participants, we found a selective modulation of FEF by the reward value of distractors during attentional shifts, particularly after high-predictive cueing to invalid locations. Reward information also modulated FEF connectivity to superior colliculus, striatum, and visual cortex. We conclude that FEF may occupy a central position within brain circuits integrating different sources of top-down biases for the generation of spatial saliency maps and guidance of selective attention.

Vision as oculomotor reward: cognitive contributions to the dynamic control of saccadic eye movements

Humans and other primates are equipped with a foveated visual system. As a consequence, we reorient our fovea to objects and targets in the visual field that are conspicuous or that we consider relevant or worth looking at. These reorientations are achieved by means of saccadic eye movements. Where we saccade to depends on various low-level factors such as a targets' luminance but also crucially on high-level factors like the expected reward or a targets' relevance for perception and subsequent behavior. Here, we review recent findings how the control of saccadic eye movements is influenced by higher-level cognitive processes. We first describe the pathways by which cognitive contributions can influence the neural oculomotor circuit. Second, we summarize what saccade parameters reveal about cognitive mechanisms, particularly saccade latencies, saccade kinematics and changes in saccade gain. Finally, we review findings on what renders a saccade target valuable, as reflected in oculomotor behavior. We emphasize that foveal vision of the target after the saccade can constitute an internal reward for the visual system and that this is reflected in oculomotor dynamics that serve to quickly and accurately provide detailed foveal vision of relevant targets in the visual field.

Bilateral control of interceptive saccades: evidence from the ipsipulsion of vertical saccades after caudal fastigial inactivation

The caudal fastigial nuclei (cFN) are the output nuclei by which the medio-posterior cerebellum influences the production of saccades toward a visual target. On the basis of the organization of their efferences to the premotor burst neurons and the bilateral control of saccades, the hypothesis was proposed that the same unbalanced activity accounts for the dysmetria of all saccades during cFN unilateral inactivation, regardless of whether the saccade is horizontal, oblique, or vertical. We further tested this hypothesis by studying, in two head-restrained macaques, the effects of unilaterally inactivating the caudal fastigial nucleus on saccades toward a target moving vertically with a constant, increasing or decreasing speed. After local muscimol injection, vertical saccades were deviated horizontally toward the injected side with a magnitude that increased with saccade size. The ipsipulsion indeed depended on the tested target speed but not its instantaneous value because it did not increase (decrease) when the target accelerated (decelerated). By subtracting the effect on contralesional horizontal saccades from the effect on ipsilesional ones, we found that the net bilateral effect on horizontal saccades was strongly correlated with the effect on vertical saccades. We explain how this correlation corroborates the bilateral hypothesis and provide arguments against the suggestion that the instantaneous saccade velocity would somehow be "encoded" by the discharge of Purkinje cells in the oculomotor vermis.NEW & NOTEWORTHY Besides causing dysmetric horizontal saccades, unilateral inactivation of caudal fastigial nucleus causes an ipsipulsion of vertical saccades. This study is the first to quantitatively describe this ipsipulsion during saccades toward a moving target. By subtracting the effects on contralesional (hypometric) and ipsilesional (hypermetric) horizontal saccades, we find that this net bilateral effect is strongly correlated with the ipsipulsion of vertical saccades, corroborating the suggestion that a common disorder affects all saccades.

A dynamic, imperturbable link between midbrain activity and saccade velocity

We make a saccadic eye movement once every few hundred milliseconds; however, the neural control of saccade execution is not fully understood. Dynamic, moment-by-moment variations in saccade velocity are typically thought to be controlled by neurons in the lower, but not the upper regions of the brainstem. In a recent report, Smalianchuk et al. (Smalianchuk I, Jagadisan UK, Gandhi NJ. J Neurosci 38: 10156-10167, 2018) provided strong evidence for a role of the superior colliculus, a midbrain structure, in the instantaneous control of saccade velocity, suggesting the revision of long-standing models of oculomotor control.

Discriminative control of saccade latencies

Recent studies have demonstrated that saccadic reaction times (SRTs) are influenced by the temporal regularities of dynamic environments (Vullings & Madelain, 2018). Here, we ask whether discriminative control (i.e., the possibility to use external stimuli signaling the future state of the environment) of latencies in a search task might be established using reinforcement contingencies. Eight participants made saccades within 80-750 ms toward a target displayed among distractors. We constructed two latency classes, "short" and "long," using the first and last quartiles of the individual baseline distributions. We then used a latency-contingent display paradigm in which finding the visual target among other items was made contingent upon specific SRTs. For a first group, the postsaccadic target was displayed only following short latencies with leftward saccades, and following long latencies with rightward saccades. The opposite was true for a second group. When short- and long-latency saccades were reinforced (i.e., the target was displayed) depending on the saccade direction, median latencies differed by 74 ms on average (all outside the 98% null hypothesis confidence intervals). Posttraining, in the absence of reinforcement, we still observed strong differences in latency distributions, averaging 64 ms for leftward versus rightward saccades. Our results demonstrate the discriminative control of SRTs, further supporting the effects of reinforcement learning for saccade. This study reveals that saccade triggering is finely controlled by learned temporal and spatial properties of the environment using predictive mechanisms.

Influence of reward learning on visual attention and eye movements in a naturalistic environment: A virtual reality study

Rewards constitute crucial signals that motivate approach behavior and facilitate the perceptual processing of objects associated with favorable outcomes in past encounters. Reward-related influences on perception and attention have been reliably observed in studies where a reward is paired with a unidimensional low-level visual feature, such as the color or orientation of a line in visual search tasks. However, our environment is drastically different and composed of multidimensional and changing visual features, encountered in complex and dynamic scenes. Here, we designed an immersive virtual reality (VR) experiment using a 4-frame CAVE system to investigate the impact of rewards on attentional orienting and gaze patterns in a naturalistic and ecological environment. Forty-one healthy participants explored a virtual forest and responded to targets appearing on either the left or right side of their path. To test for reward-induced biases in spatial orienting, targets on one side were associated with high reward, whereas those on the opposite side were paired with a low reward. Eye-movements recording showed that left-side high rewards led to subsequent increase of eye gaze fixations towards this side of the path, but no such asymmetry was found after exposure to right-sided high rewards. A milder spatial bias was also observed after left-side high rewards during subsequent exploration of a virtual castle yard, but not during route turn choices along the forest path. Our results indicate that reward-related influences on attention and behavior may be better learned in left than right space, in line with a right hemisphere dominance, and could generalize to another environment to some extent, but not to spatial choices in another decision task, suggesting some domain- or context-specificity. This proof-of-concept study also outlines the advantages and the possible drawbacks of the use of the 3D CAVE immersive platform for VR in neuroscience.

Cross-modal integration during value-driven attentional capture

A growing body of evidence suggests that reward may be a powerful determinant of attentional selection. To date, the study of value-based attentional capture has been mainly focused on the visual sensory modality. It is yet unknown how reward information is communicated and integrated across the different senses in order to resolve between competing choices during selective attention. Our study investigated the interference produced by an auditory reward-associated distractor when a semantically-related visual target was concurrently presented. We measured both manual and saccadic response times towards a target image (drum or trumpet), while an irrelevant sound (congruent or incongruent instrument) was heard. Each sound was previously associated with either a high or a low reward. We found that manual responses were slowed by a high-reward auditory distractor when sound and image were semantically congruent. A similar effect was observed for saccadic responses, but only for participants aware of the past reward contingencies. Auditory events associated with reward value were thus capable of involuntarily capturing attention in the visual modality. This reward effect can mitigate cross-modal semantic integration and appears to be differentially modulated by awareness for saccadic vs. manual responses. Together, our results extend previous work on value-driven attentional biases in perception by showing that these may operate across sensory modalities and override cross-modal integration for semantically-related stimuli. This study sheds new light on the potential implication of brain regions underlying value-driven attention across sensory modalities.

Control of saccadic latency in a dynamic environment: allocation of saccades in time follows the matching law

When exploring the visual environment, one uses saccades to shift gaze and fixation to gather spatially and temporally localized information. We propose that the temporal structure of our environment should constrain the temporal allocation of saccades. Here we probe the possibility of learning to control saccadic latencies in a choice paradigm. Six participants made saccades within 80–300 ms following a target horizontally stepping by 10° between two fixed locations. For each participant we constructed two classes of latencies, “short” and “long,” using the first and last quartiles of the individual baseline distribution (e.g., [80;152] ms and [185;300] ms, respectively). We then concurrently reinforced each class in three blocked conditions across ~60 experimental sessions per participant, using different reinforcement probabilities such that the relative ratio of reinforcement rates for short vs. long latencies was 9/1, 1/9, or 1/1. Latency distributions followed the reinforcement conditions: distributions shifted toward the shorter or longer values or became strongly bimodal. Moreover, the relative rates of short over long latencies matched the relative rates of reinforcers earned for the corresponding latencies (slope up to 0.95), which reveals the ability to choose when to saccade. Our results reveal that learned contingencies considerably affect the allocation of saccades in time and are in line with recent studies on the temporal adjustment of behavior to dynamic environments. This study provides strong evidence for fine operant control of saccadic latency, supporting the hypothesis of a cost-benefit control of saccade latencies.

NEW & NOTEWORTHY Saccades may be regarded as an information-foraging behavior mostly concerned with the spatial localization of objects, yet our world is dynamic and environmental temporal regularities should also affect saccade decisions. We present behavioral data from a choice task establishing that humans can learn to choose their saccadic latencies depending on the reinforcement contingencies. This suggests a cost-benefit-based policy that takes into account the learned temporal properties of the environmental contingencies for controlling saccade triggering.

In vivo structural imaging in rats reveals neuroanatomical correlates of behavioral sub-dimensions of cocaine addiction

Cocaine addiction is a multi-dimensional behavioral disorder characterized by a loss of control over cocaine taking despite of detrimental consequences. Structural MRI studies have revealed association between cocaine consumption and gray matter volume (GMV) in cocaine-addicted patients. However, the behavioral correlates of GMV in cocaine addiction are poorly understood. Here, we used a DSM-IV-based rat model of cocaine addiction with high face validity for structural imaging. According to three behavioral sub-dimensions of addiction, rats were separated into two groups showing either addict-like or non-addict-like behavior. These behavioral sub-dimensions were (1) the inability to refrain from drug-seeking and taking, (2) high motivation for the drug, and (3) maintained drug use despite negative consequences. In these rats, we performed structural MRI with voxel-based morphometry and analyzed the interaction of GMV with behavioral sub-dimensions in cocaine-addicted rats. Our major findings are that GMV differentially correlate with the inability to refrain from drug-seeking and taking in addict-like and non-addict-like rats within the somatosensory cortices and the amygdala. High motivation for the drug differentially correlates with GMV in addict-like and non-addict-like rats within the medial prefrontal cortex, and maintained drug use despite negative consequences differentially correlates with GMV in these two groups of rats within the periaqueductal gray. Our results demonstrate that the behavioral differences characterizing addict-like and non-addict-like rats in each behavioral sub-dimension of addiction are reflected by divergent covariance with GMV. We conclude that structural imaging provides specific neuroanatomical correlates of behavioral sub-dimensions of addiction.

Action history influences subsequent movement via two distinct processes

The characteristics of goal-directed actions tend to resemble those of previously executed actions, but it is unclear whether such effects depend strictly on action history, or also reflect context-dependent processes related to predictive motor planning. Here we manipulated the time available to initiate movements after a target was specified, and studied the effects of predictable movement sequences, to systematically dissociate effects of the most recently executed movement from the movement required next. We found that directional biases due to recent movement history strongly depend upon movement preparation time, suggesting an important contribution from predictive planning. However predictive biases co-exist with an independent source of bias that depends only on recent movement history. The results indicate that past experience influences movement execution through a combination of temporally-stable processes that are strictly use-dependent, and dynamically-evolving and context-dependent processes that reflect prediction of future actions.

How Does Awareness Modulate Goal-Directed and Stimulus-Driven Shifts of Attention Triggered by Value Learning?

In order to behave adaptively, attention can be directed in space either voluntarily (i.e., endogenously) according to strategic goals, or involuntarily (i.e., exogenously) through reflexive capture by salient or novel events. The emotional or motivational value of stimuli can also strongly influence attentional orienting. However, little is known about how reward-related effects compete or interact with endogenous and exogenous attention mechanisms, particularly outside of awareness. Here we developed a visual search paradigm to study subliminal value-based attentional orienting. We systematically manipulated goal-directed or stimulus-driven attentional orienting and examined whether an irrelevant, but previously rewarded stimulus could compete with both types of spatial attention during search. Critically, reward was learned without conscious awareness in a preceding phase where one among several visual symbols was consistently paired with a subliminal monetary reinforcement cue. Our results demonstrated that symbols previously associated with a monetary reward received higher attentional priority in the subsequent visual search task, even though these stimuli and reward were no longer task-relevant, and despite reward being unconsciously acquired. Thus, motivational processes operating independent of conscious awareness may provide powerful influences on mechanisms of attentional selection, which could mitigate both stimulus-driven and goal-directed shifts of attention.

How motivation and reward learning modulate selective attention

Motivational stimuli such as rewards elicit adaptive responses and influence various cognitive functions. Notably, increasing evidence suggests that stimuli with particular motivational values can strongly shape perception and attention. These effects resemble both selective top-down and stimulus-driven attentional orienting, as they depend on internal states but arise without conscious will, yet they seem to reflect attentional systems that are functionally and anatomically distinct from those classically associated with frontoparietal cortical networks in the brain. Recent research in human and nonhuman primates has begun to reveal how reward can bias attentional selection, and where within the cognitive system the signals providing attentional priority are generated. This review aims at describing the different mechanisms sustaining motivational attention, their impact on different behavioral tasks, and current knowledge concerning the neural networks governing the integration of motivational influences on attentional behavior.

Role of expected reward in frontal eye field during natural scene search

When a saccade is expected to result in a reward, both neural activity in oculomotor areas and the saccade itself (e.g., its vigor and latency) are altered (compared with when no reward is expected). As such, it is unclear whether the correlations of neural activity with reward indicate a representation of reward beyond a movement representation; the modulated neural activity may simply represent the differences in motor output due to expected reward. Here, to distinguish between these possibilities, we trained monkeys to perform a natural scene search task while we recorded from the frontal eye field (FEF). Indeed, when reward was expected (i.e., saccades to the target), FEF neurons showed enhanced responses. Moreover, when monkeys accidentally made eye movements to the target, firing rates were lower than when they purposively moved to the target. Thus, neurons were modulated by expected reward rather than simply the presence of the target. We then fit a model that simultaneously included components related to expected reward and saccade parameters. While expected reward led to shorter latency and higher velocity saccades, these behavioral changes could not fully explain the increased FEF firing rates. Thus, FEF neurons appear to encode motivational factors such as reward expectation, above and beyond the kinematic and behavioral consequences of imminent reward.

Dopamine Neurons Encoding Long-Term Memory of Object Value for Habitual Behavior

Dopamine neurons promote learning by processing recent changes in reward values, such that reward may be maximized. However, such a flexible signal is not suitable for habitual behaviors that are sustained regardless of recent changes in reward outcome. We discovered a type of dopamine neuron in the monkey substantia nigra pars compacta (SNc) that retains past learned reward values stably. After reward values of visual objects are learned, these neurons continue to respond differentially to the objects, even when reward is not expected. Responses are strengthened by repeated learning and are evoked upon presentation of the objects long after learning is completed. These "sustain-type" dopamine neurons are confined to the caudal-lateral SNc and project to the caudate tail, which encodes long-term value memories of visual objects and guides gaze automatically to stably valued objects. This population of dopamine neurons thus selectively promotes learning and retention of habitual behavior.

Complex Multiplexing of Reward-Cue- and Licking-Movement-Related Activity in Single Midline Thalamus Neurons

Midline thalamus is implicated in linking visceral and exteroceptive sensory information with behavior. However, whether neuronal activity is modulated with temporal precision by cues and actions in real time is unknown. Using single-neuron recording and a Pavlovian visual-cue/liquid-reward association task in rats, we discovered phasic responses to sensory cues, appropriately timed to modify information processing in output targets, as well as tonic modulations within and between trials that were differentially reward modulated, which may have distinct arousal functions. Many of the cue-responsive neurons also responded to repetitive licks, consistent with sensorimotor integration. Further, some lick-related neurons were activated only by the first rewarded lick and only if that lick were also part of a conditioned response sequence initiated earlier, consistent with binding action decisions to their ensuing outcome. This rich repertoire of responses provides electrophysiological evidence for midline thalamus as a site of complex information integration for reward-mediated behavior.

SIGNIFICANCE STATEMENT

Disparate brain circuits are involved in sensation, movement, and reward information. These must interact in order for the relationships between cues, actions, and outcomes to be learned. We found that responses of single neurons in midline thalamus to sensory cues are increased when associated with reward. This output may amplify similar signals generated in parallel by the dopamine system. In addition, some neurons coded a three-factor decision in which the neuron fired only if there was a movement, if it was the first one after the reward becoming available, and if it was part of a sequence triggered in response to a preceding cue. These data highlight midline thalamus as an important node integrating multiple types of information for linking sensation, actions, and rewards.

Modulation of Saccade Vigor during Value-Based Decision Making

During value-based decision-making, individuals consider the various options and select the one that provides the maximum subjective value. Although the brain integrates abstract information to compute and compare these values, the only behavioral outcome is often the decision itself. However, if the options are visual stimuli, during deliberation the brain moves the eyes from one stimulus to the other. Previous work suggests that saccade vigor, i.e., peak velocity as a function of amplitude, is greater if reward is associated with the visual stimulus. This raises the possibility that vigor during the free viewing of options may be influenced by the valuation of each option. Here, humans chose between a small, immediate monetary reward and a larger but delayed reward. As the deliberation began, vigor was similar for the saccades made to the two options but diverged 0.5 s before decision time, becoming greater for the preferred option. This difference in vigor increased as a function of the difference in the subjective values that the participant assigned to the delayed and immediate options. After the decision was made, participants continued to gaze at the options, but with reduced vigor, making it possible to infer timing of the decision from the sudden drop in vigor. Therefore, the subjective value that the brain assigned to a stimulus during decision-making affected the motor system via the vigor with which the eyes moved toward that stimulus.

SIGNIFICANCE STATEMENT

We find that, as individuals deliberate between two rewarding options and arrive at a decision, the vigor with which they make saccades to each option reflects a real-time evaluation of that option. With deliberation, saccade vigor diverges between the two options, becoming greater for the option that the individual will eventually choose. The results suggest a shared element between the network that assigns value to a stimulus during the process of decision-making and the network that controls vigor of movements toward that stimulus.

How does reward compete with goal-directed and stimulus-driven shifts of attention?

In order to behave adaptively, attention can be directed in space either voluntarily (i.e. endogenously) according to strategic goals, or involuntarily (i.e. exogenously) through reflexive capture by salient or novel events. The emotional or motivational values of stimuli can also influence attentional orienting. However, little is known about how reward-related effects compete or interact with endogenous and exogenous attention mechanisms. Here we designed a visual search paradigm in which goal-driven and stimulus-driven shifts of attention were manipulated by classic spatial cueing procedures, while an irrelevant, but previously rewarded stimulus also appeared as a distractor and hence competed with both types of spatial attention during search. Our results demonstrated that stimuli previously associated with a high monetary reward received higher attentional priority in the subsequent visual search task, even though these stimuli and reward were no longer task-relevant, mitigating the attentional orienting induced by both endogenous and exogenous cues.

Rewards modulate saccade latency but not exogenous spatial attention

The eye movement system is sensitive to reward. However, whilst the eye movement system is extremely flexible, the extent to which changes to oculomotor behavior induced by reward paradigms persist beyond the training period or transfer to other oculomotor tasks is unclear. To address these issues we examined the effects of presenting feedback that represented small monetary rewards to spatial locations on the latency of saccadic eye movements, the time-course of learning and extinction of the effects of rewarding saccades on exogenous spatial attention and oculomotor inhibition of return. Reward feedback produced a relative facilitation of saccadic latency in a stimulus driven saccade task which persisted for three blocks of extinction trials. However, this hemifield-specific effect failed to transfer to peripheral cueing tasks. We conclude that rewarding specific spatial locations is unlikely to induce long-term, systemic changes to the human oculomotor or attention systems.

Vigor of movements and the cost of time in decision making

If we assume that the purpose of a movement is to acquire a rewarding state, the duration of the movement carries a cost because it delays acquisition of reward. For some people, passage of time carries a greater cost, as evidenced by how long they are willing to wait for a rewarding outcome. These steep discounters are considered impulsive. Is there a relationship between cost of time in decision making and cost of time in control of movements? Our theory predicts that people who are more impulsive should in general move faster than subjects who are less impulsive. To test our idea, we considered elementary voluntary movements: saccades of the eye. We found that in humans, saccadic vigor, assessed using velocity as a function of amplitude, was as much as 50% greater in one subject than another; that is, some people consistently moved their eyes with high vigor. We measured the cost of time in a decision-making task in which the same subjects were given a choice between smaller odds of success immediately and better odds if they waited. We measured how long they were willing to wait to obtain the better odds and how much they increased their wait period after they failed. We found that people that exhibited greater vigor in their movements tended to have a steep temporal discount function, as evidenced by their waiting patterns in the decision-making task. The cost of time may be shared between decision making and motor control.

Past rewards capture spatial attention and action choices

The desire to increase rewards and minimize punishing events is a powerful driver in behaviour. Here, we assess how the value of a location affects subsequent deployment of goal-directed attention as well as involuntary capture of attention on a trial-to-trial basis. By tracking eye position, we investigated whether the ability of an irrelevant, salient visual stimulus to capture gaze (stimulus-driven attention) is modulated by that location’s previous value. We found that distractors draw attention to them significantly more if they appear at a location previously associated with a reward, even when gazing towards them now leads to punishments. Within the same experiment, it was possible to demonstrate that a location associated with a reward can also bias subsequent goal-directed attention (indexed by action choices) towards it. Moreover, individuals who were vulnerable to being distracted by previous reward history, as indexed by oculomotor capture, were also more likely to direct their actions to those locations when they had a free choice. Even when the number of initial responses was made to be rewarded and punished stimuli were equalized, the effects of previous reward history on both distractibility and action choices remained. Finally, a covert attention task requiring button-press responses rather than overt gaze shifts demonstrated the same pattern of findings. Thus, past rewards can act to modulate both subsequent stimulus-driven as well as goal-directed attention. These findings reveal that there can be surprising short-term costs of using reward cues to regulate behaviour. They show that current valence information, if maintained inappropriately, can have negative subsequent effects, with attention and action choices being vulnerable to capture and bias, mechanisms that are of potential importance in understanding distractibility and abnormal action choices.

Organization of the gymnotiform fish pallium in relation to learning and memory: II. Extrinsic connections

This study describes the extrinsic connections of the dorsal telencephalon (pallium) of gymnotiform fish. We show that the afferents to the dorsolateral and dorsomedial pallial subdivisions of gymnotiform fish arise from the preglomerular complex. The preglomerular complex receives input from four clearly distinct regions: (1) descending input from the pallium itself (dorsomedial and dorsocentral subdivisions and nucleus taenia); (2) other diencephalic nuclei (centroposterior, glomerular, and anterior tuberal nuclei and nucleus of the posterior tuberculum); (3) mesencephalic sensory structures (optic tectum, dorsal and ventral torus semicircularis); and (4) basal forebrain, preoptic area, and hypothalamic nuclei. Previous studies have implicated the majority of the diencephalic and mesencephalic nuclei in electrosensory, visual, and acousticolateral functions. Here we discuss the implications of preglomerular/pallial electrosensory-associated afferents with respect to a major functional dichotomy of the electric sense. The results allow us to hypothesize that a functional distinction between electrocommunication vs. electrolocation is maintained within the input and output pathways of the gymnotiform pallium. Electrocommunication information is conveyed to the pallium through complex indirect pathways that originate in the nucleus electrosensorius, whereas electrolocation processing follows a conservative pathway inherent to all vertebrates, through the optic tectum. We hypothesize that cells responsive to communication signals do not converge onto the same targets in the preglomerular complex as cells responsive to moving objects. We also hypothesize that efferents from the dorsocentral (DC) telencephalon project to the dorsal torus semicircularis to regulate processing of electrocommunication signals, whereas DC efferents to the tectum modulate sensory control of movement.

A flexible user-interface for audiovisual presentation and interactive control in neurobehavioral experiments

A major problem facing behavioral neuroscientists is a lack of unified, vendor-distributed data acquisition systems that allow stimulus presentation and behavioral monitoring while recording neural activity. Numerous systems perform one of these tasks well independently, but to our knowledge, a useful package with a straightforward user interface does not exist. Here we describe the development of a flexible, script-based user interface that enables customization for real-time stimulus presentation, behavioral monitoring and data acquisition. The experimental design can also incorporate neural microstimulation paradigms. We used this interface to deliver multimodal, auditory and visual (images or video) stimuli to a nonhuman primate and acquire single-unit data. Our design is cost-effective and works well with commercially available hardware and software. Our design incorporates a script, providing high-level control of data acquisition via a sequencer running on a digital signal processor to enable behaviorally triggered control of the presentation of visual and auditory stimuli. Our experiments were conducted in combination with eye-tracking hardware. The script, however, is designed to be broadly useful to neuroscientists who may want to deliver stimuli of different modalities using any animal model.

The role of a midbrain network in competitive stimulus selection

A midbrain network interacts with the well-known frontoparietal forebrain network to select stimuli for gaze and spatial attention. The midbrain network, containing the superior colliculus (SC; optic tectum, OT, in non-mammalian vertebrates) and the isthmic nuclei, helps evaluate the relative priorities of competing stimuli and encodes them in a topographic map of space. Behavioral experiments in monkeys demonstrate an essential contribution of the SC to stimulus selection when the relative priorities of competing stimuli are similar. Neurophysiological results from the owl OT demonstrate a neural correlate of this essential contribution of the SC/OT. The multi-layered, spatiotopic organization of the midbrain network lends itself to the analysis and modeling of the mechanisms underlying stimulus selection for gaze and spatial attention.

Neural substrate of spatial memory in the superior colliculus after damage to the primary visual cortex

In the primate brain, the primary visual cortex (V1) is a major source of visual information processing in the cerebral cortex, although some patients and monkeys with damage to the V1 show visually guided behaviors in the visual field affected by the damage. Until now, behaviors of the surviving brain regions after damage to V1 and their contribution to the residual visual functions remain unclear. Here, we report that the monkeys with a unilateral lesion of V1 can make not only visually guided saccades but also memory-guided saccades (MGS) into the affected visual field. Furthermore, while the monkeys were performing the MGS task, sustained activity was observed in a large fraction of the neurons in the superior colliculus ipsilateral to the lesion, which has been supposed as a key node for recovery after damage to V1. These neurons maintained the spatial information throughout the delay period regardless of whether they exhibited saccadic bursts or not, which was not the case on the intact side. Error analysis revealed that the sustained activity was correlated with monkeys' behavioral outcome. These results suggest that the ipsilesional SC might function as a neural substrate for spatial memory in the affected visual field. Our findings provide new insight into the understanding of the compensatory mechanisms after damage to V1.

Operant conditioning of primate prefrontal neurons

An operant is a behavioral act that has an impact on the environment to produce an outcome, constituting an important component of voluntary behavior. Because the environment can be volatile, the same action may cause different consequences. Thus to obtain an optimal outcome, it is crucial to detect action-outcome relationships and adapt the behavior accordingly. Although prefrontal neurons are known to change activity depending on expected reward, it remains unknown whether prefrontal activity contributes to obtaining reward. We investigated this issue by setting variable relationships between levels of single-neuron activity and rewarding outcomes. Lateral prefrontal neurons changed their spiking activity according to the specific requirements for gaining reward, without the animals making a motor response. Thus spiking activity constituted an operant response. Data from a control task suggested that these changes were unlikely to reflect simple reward predictions. These data demonstrate a remarkable capacity of prefrontal neurons to adapt to specific operant requirements at the single-neuron level.

Functional imaging of the human superior colliculus: an optimised approach

Effective functional imaging of the human Superior Colliculus (SC) has often been regarded as difficult because of the small size of the SC and its proximity to sources of pulsatile (cardiac) noise. An optimised approach to functional imaging of the SC with fMRI is presented, based upon the novel finding that visually-induced BOLD responses in the SC are qualitatively different from responses in both cortical (V1) and sub-cortical (LGN) comparison areas. An optimised model with a Haemodynamic Response Function (HRF) which peaks early (4-5 s) and then falls rapidly is shown to be best suited for revealing SC responses, while a model peaking at 6 s and falling more slowly was most sensitive in the two comparison areas. Additionally, a method of correcting for the noise characteristics of fMRI responses proposed recently by de Zwart et al. (de Zwart, J. A., van Gelderen, P., Fukunaga, M., & Duyn, J. H. (2008). Reducing correlated noise in fMRI data. Magn Reson Med, 59, 939-945) is modified for use in the SC, and shown to be highly effective at further improving the statistical detectability of responses by modelling out noise. Together these methods represent a significant advance over previous approaches to functional imaging of the human SC. They permit the routine detection of strong SC activity in single subjects at standard spatial resolutions.

Having to identify a target reduces latencies in prosaccades but not in antisaccades

In a princeps study, Trottier and Pratt (2005) showed that saccadic latencies were dramatically reduced when subjects were instructed to not simply look at a peripheral target (reflexive saccade) but to identify some of its properties. According to the authors, the shortening of saccadic reactions times may arise from a top-down disinhibition of the superior colliculus (SC), potentially mediated by the direct pathway connecting frontal/prefrontal cortex structures to the SC. Using a "cue paradigm" (a cue preceded the appearance of the target), the present study tests if the task instruction (Identify vs. Glance) also reduces the latencies of antisaccades (AS), which involve prefrontal structures. We show that instruction reduces latencies for prosaccade but not for AS. An AS requires two processes: the inhibition of a reflexive saccade and the generation of a voluntary saccade. To separate these processes and to better understand the task effect we also test the effect of the task instruction only on voluntary saccades. The effect still exists but it is much weaker than for reflexive saccades. The instruction effect closely depends on task demands in executive resources.

A neural correlate of motivational conflict in the superior colliculus of the macaque

Behavior is controlled by both external instructions and internal motives, but the actions demanded by each may be different. A common consequence of such a conflict is a delay in decision making and subsequent motor responses. It is unknown, however, what neural mechanisms underlie motivational conflict and associated response delay. To answer this question, we recorded single-neuron activity in the superior colliculus (SC) as macaque monkeys performed a visually guided, asymmetrically rewarded saccade task. A peripheral spot of light at one of two opposing positions was illuminated to indicate a saccade target. In a given block of trials, one position was associated with a big reward and the other with a small reward. The big-reward position was alternated across blocks. Behavioral analyses revealed that small-reward trials created a conflict between the instructed saccade to one position and the internally motivated, yet invalid saccade to the opposite position. We found that movement neurons in the SC temporally exhibited bursting activity after the appearance of the small-reward target opposite their movement field. This transient activity predicted the amount of response delay for upcoming saccades. Our data suggest that motivational conflict activates movement neurons in both colliculi, thereby delaying saccade initiation through intercollicular inhibitory interactions.

Recruitment of a head-turning synergy by low-frequency activity in the primate superior colliculus

Low-frequency activity within the oculomotor system helps bridge sensation and action. Given ocular stability, low-frequency activity sustained by some neurons within the intermediate and deep superior colliculus (dSC) is assumed to be separated from motor output. However, the dSC is an orienting structure and the influence of low-frequency dSC activity at other effectors remains untested. We studied this by simultaneously recording activity from saccade-related dSC neurons and electromyographic (EMG) activity from neck muscles that turn the head. Monkeys performed a gap-saccade paradigm with varying levels of reward expectancy. Despite head restraint and even for relatively small target eccentricities (<or=10 degrees ), increasing reward expectancy for a given target increased the level of low-frequency activity on dSC neurons encoding saccades to the rewarded target and increased the recruitment of a neck muscle synergy that would turn the head toward the target. The magnitude of neck muscle recruitment correlated positively on a trial-by-trial basis with the level of low-frequency dSC activity, and such correlations were optimized when neck muscle activity was shifted about 20 ms later to account for delays in the tecto-reticulo-spinal pathway. Further, dSC activity discriminated about the side of target presentation approximately 11 ms earlier than neck EMG activity. Considered alongside neck EMG responses evoked causally by SC stimulation, our results are consistent with low-frequency dSC activity recruiting a head-turning synergy. Our results support a brain stem circuit wherein the magnitude of neck muscle recruitment reflects the difference in comparative low-frequency activation across both dSCs, perhaps because of mutually inhibitory interactions within downstream head premotor circuits.