Magnitude effects for experienced rewards at short delays in the escalating interest task

Temporal expectations in delay of gratification

We examined how temporal expectations influence preference reversals in a delay of gratification task for rats based on a hypothesis of Rachlin (2000), who suggested that preference for a larger-later reward may shift in favor of a smaller-immediate reward as a result of changes in when that larger reward is expected. To explore Rachlin's hypothesis, we preexposed two groups of rats to the delays associated with a larger-later reinforcer from a delay of gratification task. One group experienced the delays as a function of their choices in an intertemporal choice task and the other group experienced delays yoked from the first group (independent of their behavior) in an exposure training procedure. In addition, we included a third group of rats that were not exposed to delays during preexposure training as a comparison to the other two groups. Overall, the two groups of rats that experienced delays during preexposure training tended to make fewer defection responses than the comparison group during the delay of gratification task. Consistent with Rachlin's hypothesis, our results suggest that temporal learning may influence preference reversals in a delay of gratification task, providing a number of future directions for research in this area.

Testing delay of gratification in rats using a within-session increasing-delay task

In delay discounting, preference reversals refer to shifts in preference from a larger-later reward to a smaller-sooner reward. Steep hyperbolic discounting predicts a preference reversal when a smaller-sooner and larger-later reward both become temporally proximal; prior research is consistent with this prediction. Hyperbolic discounting does not predict a preference reversal, however, after an individual chooses a larger-later reward over a smaller-immediate reward; prior research is inconsistent with this prediction. We sought to replicate and extend these findings using a delay of gratification task in rats. The task included a defection response which allowed rats to reverse their preference after choosing a larger-later sucrose reinforcer to instead obtain a smaller-immediate sucrose reinforcer. In Experiment 1, we found that rats would defect on their choice of the larger-later reinforcer, systematically replicating prior research. We also found that experience on the delay of gratification task led to decreases in defection responses. In Experiment 2, we found that prior experience on an intertemporal choice task, with no opportunity to defect, also led to few defection responses on the delay of gratification task. We discuss our findings in the context of whether inhibitory control or temporal learning could be involved in delay of gratification.

Learning when to wait and when to act

Choosing how long to wait in order to optimize reward is a complex decision. We embedded these decisions within a video-game environment in which the amount of reward smoothly increased the longer one waited. The availability of external cues varied in order to determine how they affected the decision to wait to achieve the goal of maximizing the reward rate. As a group, people were most optimal when they could directly observe the growth in reward, and this information overshadowed a static color cue that did not require extended observation. These results were considered within the context of improving the choice between acting versus waiting in order to maximize reward rates.

Females in the forefront: time-based intervention effects on impulsive choice and interval timing in female rats

Impulsive choice has been implicated in substance abuse, gambling, obesity, and other maladaptive behaviors. Deficits in interval timing may increase impulsive choices, and therefore, could serve as an avenue through which suboptimal impulsive choices can be moderated. Temporal interventions have successfully attenuated impulsive choices in male rats, but the efficacy of a temporal intervention has yet to be assessed in female rats. As such, this experiment examined timing and choice behavior in female rats, and evaluated the ability of a temporal intervention to mitigate impulsive choice behavior. The temporal intervention administered in this study was successful in reducing impulsive choices compared to a control group. Results of a temporal bisection task indicated that the temporal intervention increased long responses at the shorter durations. Further, results from the peak trials within the choice task combined with the progressive interval task suggest that the intervention increased sensitivity to delay and enhanced timing confidence. Overall, these results indicate that a temporal intervention can be a successful avenue for reducing impulsive choice behavior in female rats, and could contribute to the development of behavioral interventions to prevent impulsive choice and maladaptive behaviors that can be applied to both sexes.

Hot under the collar: The impact of heat on game play

High temperatures have been documented to affect behavior in a variety of ways depending on the nature of the task. We extended this prior research by examining the effects of dynamically changing temperature on various aspects of performance in a video game task. In the span of approximately an hour, temperature was gradually increased, stayed constant for a period of time, and gradually decreased to baseline. The gaming task was a variation on one used to assess impulsivity in participants thus allowing the possibility of assessing the effects of temperature on impulsive choice. Rather than heat increasing impulsivity and thus decreasing wait times, participants showed increases in wait times as temperature increased which either suggests that participants were becoming more self-controlled under heat or that the documented negative impact of heat on motor functioning was dominating their performance. Importantly, the participant's sensitivity to the changing task requirements was not affected by changes in temperature.

Learning to wait for more likely or just more: greater tolerance to delays of reward with increasingly longer delays

Little research has focused on training greater tolerance to delays of rewards in the context of delayed gratification. In delayed gratification, waiting for a delayed outcome necessitates the ability to resist defection for a continuously available smaller, immediate outcome. The present research explored the use of a fading procedure for producing greater waiting in a video-game based, delayed gratification task. Participants were assigned to conditions in which either the reward magnitude, or the probability of receiving a reward, was a function of time waited and the delay to the maximum reward was gradually increased throughout this training. Waiting increased for all participants but less for those waiting for a greater reward magnitude than a greater reward probability. All participants showed a tendency to wait in a final testing phase, but training with probabilistic outcomes produced a significantly greater likelihood of waiting during testing. The behavioral requirements of delay discounting versus delay gratification are discussed, as well as the benefits of training greater self-control in a variety of contexts.

Sex differences in the inference and perception of causal relations within a video game

The learning of immediate causation within a dynamic environment was examined. Participants encountered seven decision points in which they needed to choose, which of three possible candidates was the cause of explosions in the environment. Each candidate was firing a weapon at random every few seconds, but only one of them produced an immediate effect. Some participants showed little learning, but most demonstrated increases in accuracy across time. On average, men showed higher accuracy and shorter latencies that were not explained by differences in self-reported prior video game experience. This result suggests that prior reports of sex differences in causal choice in the game are not specific to situations involving delayed or probabilistic causal relations.

Outcome probability versus magnitude: when waiting benefits one at the cost of the other

Using a continuous impulsivity and risk platform (CIRP) that was constructed using a video game engine, choice was assessed under conditions in which waiting produced a continuously increasing probability of an outcome with a continuously decreasing magnitude (Experiment 1) or a continuously increasing magnitude of an outcome with a continuously decreasing probability (Experiment 2). Performance in both experiments reflected a greater desire for a higher probability even though the corresponding wait times produced substantive decreases in overall performance. These tendencies are considered to principally reflect hyperbolic discounting of probability, power discounting of magnitude, and the mathematical consequences of different response rates. Behavior in the CIRP is compared and contrasted with that in the Balloon Analogue Risk Task (BART).

Sensitivity to changing contingencies in an impulsivity task

Using a video-game-based escalating interest task, participants repeatedly encountered a reward that gradually increased in value over a 10-second interval. Responding early in the interval netted less immediate reward than responding later in the interval. Each participant experienced four different reward contingencies for waiting. These contingencies were changed three times as the experiment proceeded. Behavior tracked these changing contingencies, but wait times reflected long-term carryover from the previously assigned contingencies. Both the tendency to respond slowly and the optimality of behavior were affected by the order of contingencies experienced. Demographic variables only weakly predicted behavior, and delay discounting rate in a hypothetical money choice task predicted choice only when the contingencies in the game were weaker.