Monetary reward speeds up voluntary saccades

Atypical attention and saccade vigor in post-traumatic stress disorder

Effective attention control is essential for behavioral adaptation to different environmental contexts. In Post-traumatic Stress Disorder (PTSD) altered attention has been described in trauma-related and other emotional contexts. Nevertheless, atypical attention is also seen with neutral stimuli. The mechanisms of attention alterations in PTSD associated with neutral stimuli are poorly understood. The present study investigates alerting and orienting responses in PTSD participants using emotionally neutral stimuli in a saccade eye movement task incorporating both spatially predictable and temporally unpredictable conditions. We studied 23 PTSD patients and 27 Non-PTSD controls, using repeated-measures mixed modeling to estimate group and task condition differences in behavioral and psychophysiological measures. We explored the relationships among saccade characteristics, pupil size, and PTSD symptoms, including CAPS hypervigilance scores. PTSD, compared to Non-PTSD, participants showed differences in their saccade 'main sequence', reflected by higher peak velocities adjusted for amplitude. PTSD participants had smaller primary position errors in the unpredictable saccade condition. They also exhibited greater hyperarousal, reflected by larger pupil size during fixation that was greater in the unpredictable condition. Our results suggest that a heightened state of arousal and hypervigilance in PTSD leads to a state of atypical attention bias, even in emotionally neutral contexts. These differences may reflect higher saccade vigor. The observed differences suggest atypical attention in PTSD, which goes beyond possible distraction associated with emotional or threat-related stimuli.

Behind mouse eyes: The function and control of eye movements in mice

The mouse visual system has become the most popular model to study the cellular and circuit mechanisms of sensory processing. However, the importance of eye movements only started to be appreciated recently. Eye movements provide a basis for predictive sensing and deliver insights into various brain functions and dysfunctions. A plethora of knowledge on the central control of eye movements and their role in perception and behaviour arose from work on primates. However, an overview of various eye movements in mice and a comparison to primates is missing. Here, we review the eye movement types described to date in mice and compare them to those observed in primates. We discuss the central neuronal mechanisms for their generation and control. Furthermore, we review the mounting literature on eye movements in mice during head-fixed and freely moving behaviours. Finally, we highlight gaps in our understanding and suggest future directions for research.

Saccade vigor reflects the rise of decision variables during deliberation

During deliberation, as we quietly consider our options, the neural activities representing the decision variables that reflect the goodness of each option rise in various regions of the cerebral cortex.1,2,3,4,5,6,7 If the options are depicted visually, we make saccades, focusing gaze on each option. Do the kinematics of these saccades reflect the state of the decision variables? To test this idea, we engaged human participants in a decision-making task in which they considered two effortful options that required walking across various distances and inclines. As they deliberated, they made saccades between the symbolic representations of their options. These deliberation period saccades had no bearing on the effort they would later expend, yet saccade velocities increased gradually and differentially: the rate of rise was faster for saccades toward the option that they later indicated as their choice. Indeed, the rate of rise encoded the difference in the subjective value of the two options. Importantly, the participants did not reveal their choice at the conclusion of deliberation, but rather waited during a delay period, and finally expressed their choice by making another saccade. Remarkably, vigor for this saccade dropped to baseline and no longer encoded subjective value. Thus, saccade vigor appeared to provide a real-time window to the otherwise hidden process of option evaluation during deliberation.

Motivation by reward jointly improves speed and accuracy, whereas task-relevance and meaningful images do not

Visual selection is characterized by a trade-off between speed and accuracy. Speed or accuracy of the selection process can be affected by higher level factors—for example, expecting a reward, obtaining task-relevant information, or seeing an intrinsically relevant target. Recently, motivation by reward has been shown to simultaneously increase speed and accuracy, thus going beyond the speed–accuracy-trade-off. Here, we compared the motivating abilities of monetary reward, task-relevance, and image content to simultaneously increase speed and accuracy. We used a saccadic distraction task that required suppressing a distractor and selecting a target. Across different blocks successful target selection was followed either by (i) a monetary reward, (ii) obtaining task-relevant information, or (iii) seeing the face of a famous person. Each block additionally contained the same number of irrelevant trials lacking these consequences, and participants were informed about the upcoming trial type. We found that postsaccadic vision of a face affected neither speed nor accuracy, suggesting that image content does not affect visual selection via motivational mechanisms. Task relevance increased speed but decreased selection accuracy, an observation compatible with a classical speed–accuracy trade-off. Motivation by reward, however, simultaneously increased response speed and accuracy. Saccades in all conditions deviated away from the distractor, suggesting that the distractor was suppressed, and this deviation was strongest in the reward block. Drift-diffusion modelling revealed that task-relevance affected behavior by affecting decision thresholds, whereas motivation by reward additionally increased the rate of information uptake. The present findings thus show that the three consequences differ in their motivational abilities.

The effect of subliminal incentives on goal-directed eye movements

Over the last decades, several studies have demonstrated that conscious and unconscious reward incentives both affect performance in physical and cognitive tasks, suggesting that goal-pursuit can arise from an unconscious will. Whether the planning of goal-directed saccadic eye movements during an effortful task can also be affected by subliminal reward cues has not been systematically investigated. We employed a novel task where participants made several eye movements back and forth between a fixation point and a number of peripheral targets. The total number of targets visited by the eyes in a fixed amount of time determined participants' monetary gain. The magnitude of the reward at stake was briefly shown at the beginning of each trial and masked by pattern images superimposed in time so that at shorter display durations participants perceived reward incentives subliminally. We found a main effect of reward across all display durations as higher reward enhanced participants' oculomotor effort measured as the frequency and peak velocity of saccades. This effect was strongest for consciously perceived rewards but also occurred when rewards were subliminally perceived. Although we did not find a statistically significant dissociation between the reward-related modulation of different saccadic parameters, across two experiments the most robust effect of subliminal rewards was observed for the modulation of the saccadic frequency but not the peak velocity. These results suggest that multiple indices of oculomotor effort can be incentivized by subliminal rewards and that saccadic frequency may provide the most sensitive indicator of subliminal incentivization of eye movements.

Vision as oculomotor reward: cognitive contributions to the dynamic control of saccadic eye movements

Humans and other primates are equipped with a foveated visual system. As a consequence, we reorient our fovea to objects and targets in the visual field that are conspicuous or that we consider relevant or worth looking at. These reorientations are achieved by means of saccadic eye movements. Where we saccade to depends on various low-level factors such as a targets' luminance but also crucially on high-level factors like the expected reward or a targets' relevance for perception and subsequent behavior. Here, we review recent findings how the control of saccadic eye movements is influenced by higher-level cognitive processes. We first describe the pathways by which cognitive contributions can influence the neural oculomotor circuit. Second, we summarize what saccade parameters reveal about cognitive mechanisms, particularly saccade latencies, saccade kinematics and changes in saccade gain. Finally, we review findings on what renders a saccade target valuable, as reflected in oculomotor behavior. We emphasize that foveal vision of the target after the saccade can constitute an internal reward for the visual system and that this is reflected in oculomotor dynamics that serve to quickly and accurately provide detailed foveal vision of relevant targets in the visual field.

Reward sensitivity and action in Parkinson's disease patients with and without apathy

Clinical apathy results in dysfunction of goal directed behaviour, a key component of which is the initiation of action. Previous work has suggested that blunting of reward sensitivity is an important mechanism underlying apathy. However, an additional component might be impoverished initiation of action itself. This study aims to investigate the link between motivation and motor output and its association with apathy and dopamine. An oculomotor task that measures pupillary and saccadic response to monetary incentives was used to assess reward sensitivity, first in 23 young and 18 elderly controls, and then in 22 patients with Parkinson's disease tested ON and OFF dopaminergic medication. To distinguish between pupillary responses to anticipated reward alone versus responses associated with motor preparation, a saccadic 'go/no-go' task was performed. Half of the trials required a saccade to be initiated to receive a reward and in the remaining trials no action was required but reward was still obtained. No significant difference in pupil response was demonstrated between the two conditions in all groups tested, suggesting pupillary responses to rewards are not contingent upon motor preparation in Parkinson's disease. Being ON or OFF dopamine did not influence this response either. Previous work demonstrated associations between apathy and pupillary reward insensitivity in Parkinson's disease. Here we observed this effect only when an action was required to receive a reward, and only in the ON state. These findings suggest that apathy in Parkinson's disease is linked to reduced reward sensitivity and that this is most prominently observed when actions have to be initiated to rewarding goals, with the effect modulated by being ON dopaminergic medication. OFF medication, there was no such strong relationship, and similarly in the 'no-go' conditions, either ON or OFF dopaminergic drugs. The results provide preliminary data which suggest that apathy in Parkinson's disease is associated with a reduction in reward sensitivity and this is most evident when associated with initiation of goal directed actions in the presence of adequate dopamine.

Dopamine and reward hypersensitivity in Parkinson's disease with impulse control disorder

Impulse control disorders in Parkinson's disease are common neuropsychiatric complications associated with dopamine replacement therapy. Some patients treated with dopamine agonists develop pathological behaviours, such as gambling, compulsive eating, shopping, or disinhibited sexual behaviours, which can have a severe impact on their lives and that of their families. In this study we investigated whether hypersensitivity to reward might contribute to these pathological behaviours and how this is influenced by dopaminergic medication. We asked participants to shift their gaze to a visual target as quickly as possible, in order to obtain reward. Critically, the reward incentive on offer varied over trials. Motivational effects were indexed by pupillometry and saccadic velocity, and patients were tested ON and OFF dopaminergic medication, allowing us to measure the effect of dopaminergic medication changes on reward sensitivity. Twenty-three Parkinson's disease patients with a history of impulse control disorders were compared to 26 patients without such behaviours, and 31 elderly healthy controls. Intriguingly, behavioural apathy was reported alongside impulsivity in the majority of patients with impulse control disorders. Individuals with impulse control disorders also exhibited heightened sensitivity to exogenous monetary rewards cues both ON and OFF (overnight withdrawal) dopamine medication, as indexed by pupillary dilation in anticipation of reward. Being OFF dopaminergic medication overnight did not modulate pupillary reward sensitivity in impulse control disorder patients, whereas in control patients reward sensitivity was significantly reduced when OFF dopamine. These effects were independent of cognitive impairment or total levodopa equivalent dose. Although dopamine agonist dose did modulate pupillary responses to reward, the pattern of results was replicated even when patients with impulse control disorders on dopamine agonists were excluded from the analysis. The findings suggest that hypersensitivity to rewards might be a contributing factor to the development of impulse control disorders in Parkinson's disease. However, there was no difference in reward sensitivity between patient groups when ON dopamine medication, suggesting that impulse control disorders may not emerge simply because of a direct effect of dopaminergic drug level on reward sensitivity. The pupillary reward sensitivity measure described here provides a means to differentiate, using a physiological measure, Parkinson's disease patients with impulse control disorder from those who do not experience such symptoms. Moreover, follow-up of control patients indicated that increased pupillary modulation by reward can be predictive of the risk of future emergence of impulse control disorders and may thereby provide the potential for early identification of patients who are more likely to develop these symptoms.

Voluntary modulation of saccadic peak velocity associated with individual differences in motivation

Saccadic peak velocity increases in a stereotyped manner with the amplitude of eye movements. This relationship, known as the main sequence, has classically been considered to be fixed, although several recent studies have demonstrated that velocity can be modulated to some extent by external incentives. However, the ability to voluntarily control saccadic velocity and its association with motivation has yet to be investigated. Here, in three separate experimental paradigms, we measured the effects of incentivisation on saccadic velocity, reaction time and preparatory pupillary changes in 53 young healthy participants. In addition, the ability to voluntarily modulate saccadic velocity with and without incentivisation was assessed. Participants varied in their ability to increase and decrease the velocity of their saccades when instructed to do so. This effect correlated with motivation level across participants, and was further modulated by addition of monetary reward and avoidance of loss. The findings show that a degree of voluntary control of saccadic velocity is possible in some individuals, and that the ability to modulate peak velocity is associated with intrinsic levels of motivation.

Reward learning biases the direction of saccades

The role of associative reward learning in guiding feature-based attention and spatial attention is well established. However, no studies have looked at the extent to which reward learning can modulate the direction of saccades during visual search. Here, we introduced a novel reward learning paradigm to examine whether reward-associated directions of eye movements can modulate performance in different visual search tasks. Participants had to fixate a peripheral target before fixating one of four disks that subsequently appeared in each cardinal position. This was followed by reward feedback contingent upon the direction chosen, where one direction consistently yielded a high reward. Thus, reward was tied to the direction of saccades rather than the absolute location of the stimulus fixated. Participants selected the target in the high-value direction on the majority of trials, demonstrating robust learning of the task contingencies. In an untimed visual foraging task that followed, which was performed in extinction, initial saccades were reliably biased in the previously rewarded-associated direction. In a second experiment, following the same training procedure, eye movements in the previously high-value direction were facilitated in a saccade-to-target task. Our findings suggest that rewarding directional eye movements biases oculomotor search patterns in a manner that is robust to extinction and generalizes across stimuli and task.

Strategic allocation of working memory resource

Visual working memory (VWM), the brief retention of past visual information, supports a range of cognitive functions. One of the defining, and largely studied, characteristics of VWM is how resource-limited it is, raising questions about how this resource is shared or split across memoranda. Since objects are rarely equally important in the real world, we ask how people split this resource in settings where objects have different levels of importance. In a psychophysical experiment, participants remembered the location of four targets with different probabilities of being tested after a delay. We then measured their memory accuracy of one of the targets. We found that participants allocated more resource to memoranda with higher priority, but underallocated resource to high- and overallocated to low-priority targets relative to the true probability of being tested. These results are well explained by a computational model in which resource is allocated to minimize expected estimation error. We replicated this finding in a second experiment in which participants bet on their memory fidelity after making the location estimate. The results of this experiment show that people have access to and utilize the quality of their memory when making decisions. Furthermore, people again allocate resource in a way that minimizes memory errors, even in a context in which an alternative strategy was incentivized. Our study not only shows that people are allocating resource according to behavioral relevance, but suggests that they are doing so with the aim of maximizing memory accuracy.

It Pays to Prepare: Human Motor Preparation Depends on the Relative Value of Potential Response Options

Alternative motor responses can be prepared in parallel. Here, we used electroencephalography (EEG) to test whether the parallel preparation of alternative response options is modulated by their relative value. Participants performed a choice response task with three potential actions: isometric contraction of the left, the right, or both wrists. An imperative stimulus (IS) appeared after a warning cue, such that the initiation time of a required action was predictable, but the specific action was not. To encourage advanced preparation, the target was presented 200 ms prior to the IS, and only correct responses initiated within ±100 ms of the IS were rewarded. At baseline, all targets were equally rewarded and probable. Then, responses with one hand were made more valuable, either by increasing the probability that the left or right target would be required (Exp. 1; n = 31) or by increasing the reward magnitude of one target (Exp. 2, n = 36). We measured reaction times, movement vigor, and an EEG correlate of action preparation (value-based lateralized readiness potential) prior to target presentation. Participants responded earlier to more frequent and more highly rewarded targets, and movements to highly rewarded targets were more vigorous. The EEG was more negative over the hemisphere contralateral to the more repeated/rewarded hand, implying an increased neural preparation of more valuable actions. Thus, changing the value of alternative response options can lead to greater preparation of actions associated with more valuable outcomes. This preparation asymmetry likely contributes to behavioral biases that are typically observed toward repeated or rewarded targets.

The pathophysiological mechanisms of motivational deficits in Parkinson's disease

Parkinson's disease (PD) is a progressive degenerative disorder that leads to disabling motor symptoms and a wide variety of neuropsychiatric symptoms. Apathy is the most common psychiatric disorder in the early stages of untreated PD and can be defined as a hypodopaminergic syndrome, which also includes anxiety and depression. Apathy is also considered the core feature of the parkinsonian triad (apathy, anxiety and depression) of behavioural non-motor signs, including a motivational deficit. Moreover, apathy is recognised as a distinct chronic neuropsychiatric behavioural disorder based on specific diagnostic criteria. Given the prevalence of apathy in approximately 40% of the general Parkinson's disease population, this appears to be a contributing factor to dementia in PD; also, apathy symptoms are factors that potentially contribute to morbidity, leading to a major impairment of health-related quality of life, thus stressing the importance of understanding the pathophysiology of this disease. Several studies have clearly established a prominent role for DA-mediated signals in PD apathy. However, synergistic interaction between dopaminergic impairment resulting from the neurodegenerative process and deep brain stimulation of the subthalamic nucleus may cause or exacerbate apathy. Furthermore, serotoninergic mechanism signalling is also likely to be of importance in this pathophysiology.

Multiple reward-cue contingencies favor expectancy over uncertainty in shaping the reward-cue attentional salience

Reward-predicting cues attract attention because of their motivational value. A debated question regards the conditions under which the cue's attentional salience is governed more by reward expectancy rather than by reward uncertainty. To help shedding light on this relevant issue, here, we manipulated expectancy and uncertainty using three levels of reward-cue contingency, so that, for example, a high level of reward expectancy (p = .8) was compared with the highest level of reward uncertainty (p = .5). In Experiment 1, the best reward-cue during conditioning was preferentially attended in a subsequent visual search task. This result was replicated in Experiment 2, in which the cues were matched in terms of response history. In Experiment 3, we implemented a hybrid procedure consisting of two phases: an omission contingency procedure during conditioning, followed by a visual search task as in the previous experiments. Crucially, during both phases, the reward-cues were never task relevant. Results confirmed that, when multiple reward-cue contingencies are explored by a human observer, expectancy is the major factor controlling both the attentional and the oculomotor salience of the reward-cue.

The necessity to choose causes the effects of reward on saccade preparation

When humans have to choose between different options, they can maximize their payoff by choosing the option that yields the highest reward. Information about reward is not only used to optimize decisions but also for movement preparation to minimize reaction times to rewarded targets. Here, we show that this is especially true in contexts in which participants additionally have to choose between different options. We probed eye movement preparation by measuring saccade latencies to differently rewarded single targets (single-trial) appearing left or right from fixation. In choice-trials, both targets were displayed and participants were free to decide for one target to receive the corresponding reward. In blocks without choice-trials, single-trial latencies were not or only weakly affected by reward. With choice-trials present, the influence of reward increased with the proportion and difficulty of choices and decreased when a cue indicated that no choice will be necessary. Choices caused a delay in subsequent single-trial responses to the non-chosen option. Taken together, our results suggest that reward affects saccade preparation mainly when the outcome is uncertain and depends on the participants’ behavior, for instance when they have to choose between targets differing in reward.

The necessity to choose causes reward-related anticipatory biasing: Parieto-occipital alpha-band oscillations reveal suppression of low-value targets

Positive outcome of actions can be maximized by choosing the option with the highest reward. For saccades, it has recently been suggested that the necessity to choose is, in fact, an important factor mediating reward effects: latencies to single low-reward targets increased with an increasing proportion of interleaved choice-trials, in which participants were free to choose between two targets to obtain either a high or low reward. Here, we replicate this finding for manual responses, demonstrating that this effect of choice is a more general, effector-independent phenomenon. Oscillatory activity in the alpha and beta band in the preparatory period preceding target onset was analysed for a parieto-occipital and a centrolateral region of interest to identify an anticipatory neural biasing mechanism related to visuospatial attention or motor preparation. When the proportion of interleaved choices was high, an increase in lateralized posterior alpha power indicated that the hemifield associated with a low reward was suppressed in preparation for reward-maximizing target selection. The larger the individual increase in lateralized alpha power, the slower the reaction times to low-reward targets. At a broader level, these findings support the notion that reward only affects responses when behaviour can be optimized to maximize positive outcome.

Distinct Motivational Effects of Contingent and Noncontingent Rewards

When rewards are available, people expend more energy, increasing their motivational vigor. In theory, incentives might drive behavior for two distinct reasons: First, they increase expected reward; second, they increase the difference in subjective value between successful and unsuccessful performance, which increases contingency—the degree to which action determines outcome. Previous studies of motivational vigor have never compared these directly. Here, we indexed motivational vigor by measuring the speed of eye movements toward a target after participants heard a cue indicating how outcomes would be determined. Eye movements were faster when the cue indicated that monetary rewards would be contingent on performance than when the cue indicated that rewards would be random. But even when the cue indicated that a reward was guaranteed regardless of speed, movement was still faster than when no reward was available. Motivation by contingent and certain rewards was uncorrelated across individuals, which suggests that there are two separable, independent components of motivation. Contingent motivation generated autonomic arousal, and unlike noncontingent motivation, was effective with penalties as well as rewards.

Reward sensitivity deficits modulated by dopamine are associated with apathy in Parkinson's disease

Apathy is a debilitating and under-recognized condition that has a significant impact in many neurodegenerative disorders. In Parkinson's disease, it is now known to contribute to worse outcomes and a reduced quality of life for patients and carers, adding to health costs and extending disease burden. However, despite its clinical importance, there remains limited understanding of mechanisms underlying apathy. Here we investigated if insensitivity to reward might be a contributory factor and examined how this relates to severity of clinical symptoms. To do this we created novel ocular measures that indexed motivation level using pupillary and saccadic response to monetary incentives, allowing reward sensitivity to be evaluated objectively. This approach was tested in 40 patients with Parkinson's disease, 31 elderly age-matched control participants and 20 young healthy volunteers. Thirty patients were examined ON and OFF their dopaminergic medication in two counterbalanced sessions, so that the effect of dopamine on reward sensitivity could be assessed. Pupillary dilation to increasing levels of monetary reward on offer provided quantifiable metrics of motivation in healthy subjects as well as patients. Moreover, pupillary reward sensitivity declined with age. In Parkinson's disease, reduced pupillary modulation by incentives was predictive of apathy severity, and independent of motor impairment and autonomic dysfunction as assessed using overnight heart rate variability measures. Reward sensitivity was further modulated by dopaminergic state, with blunted sensitivity when patients were OFF dopaminergic drugs, both in pupillary response and saccadic peak velocity response to reward. These findings suggest that reward insensitivity may be a contributory mechanism to apathy and provide potential new clinical measures for improved diagnosis and monitoring of apathy.media-1vid110.1093/brain/aww188_video_abstractaww188_video_abstract.