Human prosaccades and antisaccades under risk: effects of penalties and rewards on visual selection and the value of actions

The Limitations of Reward Effects on Saccade Latencies: An Exploration of Task-Specificity and Strength

Saccadic eye movements are simple, visually guided actions. Operant conditioning of specific saccade directions can reduce the latency of eye movements in the conditioned direction. However, it is not clear to what extent this learning transfers from the conditioned task to novel tasks. The purpose of this study was to investigate whether the effects of operant conditioning of prosaccades to specific spatial locations would transfer to more complex oculomotor behaviours, specifically, prosaccades made in the presence of a distractor (Experiment 1) and antisaccades (Experiment 2). In part 1 of each experiment, participants were rewarded for making a saccade to one hemifield. In both experiments, the reward produced a significant facilitation of saccadic latency for prosaccades directed to the rewarded hemifield. In part 2, rewards were withdrawn, and the participant made a prosaccade to targets that were accompanied by a contralateral distractor (Experiment 1) or an antisaccade (Experiment 2). There were no hemifield-specific effects of the reward on saccade latency on the remote distractor effect or antisaccades, although the reward was associated with an overall slowing of saccade latency in Experiment 1. These data indicate that operant conditioning of saccadic eye movements does not transfer to similar but untrained tasks. We conclude that rewarding specific spatial locations is unlikely to induce long-term, systemic changes to the human oculomotor system.

Efficient Avoidance of the Penalty Zone in Human Eye Movements

People use eye movements extremely effectively to find objects of interest in a cluttered visual scene. Distracting, task-irrelevant attention capturing regions in the visual field should be avoided as they jeopardize the efficiency of search. In the current study, we used eye tracking to determine whether people are able to avoid making saccades to a predetermined visual area associated with a financial penalty, while making fast and accurate saccades towards stimuli placed near the penalty area. We found that in comparison to the same task without a penalty area, the introduction of a penalty area immediately affected eye movement behaviour: the proportion of saccades to the penalty area was immediately reduced. Also, saccadic latencies increased, but quite modestly, and mainly for saccades towards stimuli near the penalty area. We conclude that eye movement behaviour is under efficient cognitive control and thus quite flexible: it can immediately be adapted to changing environmental conditions to improve reward outcome.

Alterations in the functional neural circuitry supporting flexible choice behavior in autism spectrum disorders

Restricted and repetitive behaviors, and a pronounced preference for behavioral and environmental consistency, are distinctive characteristics of autism spectrum disorder (ASD). Alterations in frontostriatal circuitry that supports flexible behavior might underlie this behavioral impairment. In an functional magnetic resonance imaging study of 17 individuals with ASD, and 23 age-, gender- and IQ-matched typically developing control participants, reversal learning tasks were used to assess behavioral flexibility as participants switched from one learned response choice to a different response choice when task contingencies changed. When choice outcome after reversal was uncertain, the ASD group demonstrated reduced activation in both frontal cortex and ventral striatum, in the absence of task performance differences. When the outcomes of novel responses were certain, there was no difference in brain activation between groups. Reduced activation in frontal cortex and ventral striatum suggest problems in decision-making and response planning, and in processing reinforcement cues, respectively. These processes, and their integration, are essential for flexible behavior. Alterations in these systems may therefore contribute to a rigid adherence to preferred behavioral patterns in individuals with an ASD. These findings provide an additional impetus for the use of reversal learning paradigms as a translational model for treatment development targeting the domain of restricted and repetitive behaviors in ASD.

Network dynamics underlying speed-accuracy trade-offs in response to errors

The ability to dynamically and rapidly adjust task performance based on its outcome is fundamental to adaptive, flexible behavior. Over trials of a task, responses speed up until an error is committed and after the error responses slow down. These dynamic adjustments serve to optimize performance and are well-described by the speed-accuracy trade-off (SATO) function. We hypothesized that SATOs based on outcomes reflect reciprocal changes in the allocation of attention between the internal milieu and the task-at-hand, as indexed by reciprocal changes in activity between the default and dorsal attention brain networks. We tested this hypothesis using functional MRI to examine the pattern of network activation over a series of trials surrounding and including an error. We further hypothesized that these reciprocal changes in network activity are coordinated by the posterior cingulate cortex (PCC) and would rely on the structural integrity of its white matter connections. Using diffusion tensor imaging, we examined whether fractional anisotropy of the posterior cingulum bundle correlated with the magnitude of reciprocal changes in network activation around errors. As expected, reaction time (RT) in trials surrounding errors was consistent with predictions from the SATO function. Activation in the default network was: (i) inversely correlated with RT, (ii) greater on trials before than after an error and (iii) maximal at the error. In contrast, activation in the right intraparietal sulcus of the dorsal attention network was (i) positively correlated with RT and showed the opposite pattern: (ii) less activation before than after an error and (iii) the least activation on the error. Greater integrity of the posterior cingulum bundle was associated with greater reciprocity in network activation around errors. These findings suggest that dynamic changes in attention to the internal versus external milieu in response to errors underlie SATOs in RT and are mediated by the PCC.

Sensitivity and bias in decision-making under risk: evaluating the perception of reward, its probability and value

Background

There are few clinical tools that assess decision-making under risk. Tests that characterize sensitivity and bias in decisions between prospects varying in magnitude and probability of gain may provide insights in conditions with anomalous reward-related behaviour.

Objective

We designed a simple test of how subjects integrate information about the magnitude and the probability of reward, which can determine discriminative thresholds and choice bias in decisions under risk.

Design/Methods

Twenty subjects were required to choose between two explicitly described prospects, one with higher probability but lower magnitude of reward than the other, with the difference in expected value between the two prospects varying from 3 to 23%.

Results

Subjects showed a mean threshold sensitivity of 43% difference in expected value. Regarding choice bias, there was a ‘risk premium’ of 38%, indicating a tendency to choose higher probability over higher reward. An analysis using prospect theory showed that this risk premium is the predicted outcome of hypothesized non-linearities in the subjective perception of reward value and probability.

Conclusions

This simple test provides a robust measure of discriminative value thresholds and biases in decisions under risk. Prospect theory can also make predictions about decisions when subjective perception of reward or probability is anomalous, as may occur in populations with dopaminergic or striatal dysfunction, such as Parkinson's disease and schizophrenia.