Impulsive choice and pre-exposure to delays: III. Four-month test-retest outcomes in male wistar rats

Active and passive waiting in impulsive choice: Effects of fixed-interval and fixed-time delays

Behavioral interventions to improve self-control, preference for a larger-later (LL) reward over a smaller-sooner (SS) reward, involve experience with delayed rewards. Whether they involve timing processes remains controversial. In rats, there have been inconsistent results on whether timing processes may be involved in intervention-induced improvements in self-control. Interventions that improved self-control with corresponding timing improvements used fixed-interval (FI) delays, whereas interventions that failed to find corresponding timing improvements used fixed-time (FT) delays. The FI schedule includes a response contingency (active waiting), whereas the FT schedule delivers reward automatically (passive waiting). The present study compared the effects of FI and FT schedules in interventions and impulsive choice tasks to evaluate effects on self-control and timing behavior. The impulsive choice task evaluated preference for an SS option (one pellet after 10-, 15-, 20-, 25-, and 30-s delays) versus an LL option (two pellets after a 30-s delay). The intervention task included forced-choice SS (one pellet after 10 s) and LL (two pellets after 30 s) sessions under FI or FT schedules. FI schedules produced greater sensitivity to SS delay in the impulsive choice task. Both FI and FT interventions increased LL choices. Following choice testing, temporal bisection and peak interval tasks revealed better timing precision for rats with an FI delay experience. Overall, the FI choice contingency was associated with improved temporal attention and timing precision.

Hyperbolae

Hyperbolic relations between independent and dependent variables are ubiquitous in the experimental analysis of behavior, mentioned in over 150 articles in the Journal of the Experimental Analysis of Behavior. There are two principal forms of hyperbolae: The first describes the relation between response rate and reinforcement rate on variable-interval schedules of reinforcement; it rises asymptotically toward a maximum. The second describes the relation between the current equivalent value of an incentive and its delay or (im)probability; it falls from a maximum toward an asymptote of 0. Where do these come from? What do their parameters mean? How are they related? This article answers the first two questions and addresses the last.

Mechanisms of impulsive choice: Experiments to explore and models to map the empirical terrain

Impulsive choice is preference for a smaller-sooner (SS) outcome over a larger-later (LL) outcome when LL choices result in greater reinforcement maximization. Delay discounting is a model of impulsive choice that describes the decaying value of a reinforcer over time, with impulsive choice evident when the empirical choice-delay function is steep. Steep discounting is correlated with multiple diseases and disorders. Thus, understanding the processes underlying impulsive choice is a popular topic for investigation. Experimental research has explored the conditions that moderate impulsive choice, and quantitative models of impulsive choice have been developed that elegantly represent the underlying processes. This review spotlights experimental research in impulsive choice covering human and nonhuman animals across the domains of learning, motivation, and cognition. Contemporary models of delay discounting designed to explain the underlying mechanisms of impulsive choice are discussed. These models focus on potential candidate mechanisms, which include perception, delay and/or reinforcer sensitivity, reinforcement maximization, motivation, and cognitive systems. Although the models collectively explain multiple mechanistic phenomena, there are several cognitive processes, such as attention and working memory, that are overlooked. Future research and model development should focus on bridging the gap between quantitative models and empirical phenomena.

Temporal expectations in delay of gratification

We examined how temporal expectations influence preference reversals in a delay of gratification task for rats based on a hypothesis of Rachlin (2000), who suggested that preference for a larger-later reward may shift in favor of a smaller-immediate reward as a result of changes in when that larger reward is expected. To explore Rachlin's hypothesis, we preexposed two groups of rats to the delays associated with a larger-later reinforcer from a delay of gratification task. One group experienced the delays as a function of their choices in an intertemporal choice task and the other group experienced delays yoked from the first group (independent of their behavior) in an exposure training procedure. In addition, we included a third group of rats that were not exposed to delays during preexposure training as a comparison to the other two groups. Overall, the two groups of rats that experienced delays during preexposure training tended to make fewer defection responses than the comparison group during the delay of gratification task. Consistent with Rachlin's hypothesis, our results suggest that temporal learning may influence preference reversals in a delay of gratification task, providing a number of future directions for research in this area.

Reducing impulsive choice: VIII. Effects of delay-exposure training in female rats

Impulsive choice may play an important role in serious health-related decisions, like addiction tendencies. Thus, there is merit in exploring interventions that reduce impulsive choice. Delay-exposure training involves extended experience with delayed reinforcement. Following training, delay-exposed rats make fewer impulsive choices than control rats. The reducing effects of delay exposure training on impulsive choice have been replicated in male rats seven times. For the first time, this study evaluated the effects of delay exposure training in female rats. Thirty-six rats were randomly assigned to either delay-exposure or immediacy-exposure training. Then, rats underwent two impulsive choice assessments in which they chose between one immediate pellet or three delayed pellets. In the first assessment, delays increased within-sessions, across trial blocks from 0, 8, 16, to 32 s. In the second assessment, delays to the larger reward increased between-sessions, from 8, 16, 32, to 4 s. Unlike findings with male rats, delay-exposure training produced a reduction in impulsive choice only in the initial five sessions in female rats. Possible reasons for the lack of lasting effect in female rats are discussed and future research directions are identified.

Generalizability of time-based interventions: Effects of choice procedure and smaller-sooner delay

Interventions exposing rats to delayed-reward contingencies attenuate suboptimal impulsive choices, a preference for a smaller-sooner (SS) over a larger-later (LL) reward. Interventions may potentially improve delay-tolerance, timing of delays, and/or discrimination of reward magnitudes. Generalization from the intervention to impulsive choice under different procedures can provide insights into the processes that underlie the intervention effects. Experiment 1 tested intervention effects on systematic-delay (SYS) and adjusting-delay (ADJ) procedures, predicting that intervention effects would be more effective on the SYS procedure with predictable delays. The ADJ procedure did not benefit significantly from intervention, but the SYS procedure, unexpectedly, showed greater impulsive choices following intervention. Experiment 2 tested whether short (5 s) SS intervention delays may have promoted greater impulsivity in the SYS impulsive choice procedure in Experiment 1. Short SS delays in choice and intervention procedures increased impulsive choices in comparison to longer (10 s) delays. Incongruent SS delays in the intervention/choice procedures resulted in negative intervention effects. The results suggest that short SS delays are detrimental to self-control and that specific temporal information generalizes from the intervention to the SYS choice task, but not the ADJ choice task.

Effects of immediate-reinforcement training on delay discounting behavior in rats

Chronic exposure to delayed reinforcement has been shown to increase choice for larger, later reinforcement in a subsequent delay discounting task. In the 3 experiments presented in this paper, the opposite was tested: effects of chronic exposure to immediate reinforcement on choice in a subsequent delay discounting task. In Experiment 1, larger, later reinforcement choice was significantly reduced as a result of exposure to immediate reinforcement, compared to a maturation/handle control group, in experienced, male Lewis rats. In Experiment 2, with naive male and female Wistar rats, and Experiment 3, with naïve male Long Evans rats, the impact of exposure to immediate reinforcement was less robust, but directionally consistent with results from Experiment 1. These results align with some previous work reporting that exposure to immediate reinforcement may decrease choice for larger, later reinforcement in a delay discounting task, and/or blunt maturational increases in choice for larger, later reinforcement. These findings have implications for future research investigating experience-based interventions to manipulate delay discounting behavior. They also have clinical implications for understanding and treating disorders involving maladaptive choice.

Hazard function effects on promoting self-control in variable interval time-based interventions in rats

The present experiments investigated properties of time-based interventions used to increase self-control. Rats received impulsive-choice assessments before and after interventions that consisted of different distributions of delays to reinforcement. In Experiment 1, rats received an intervention with an increasing hazard function where delays were more evenly distributed, a decreasing hazard function where delays were mostly short, or a constant hazard function where delays were exponentially distributed. Surprisingly, rats that received the decreasing hazard function made the most self-controlled choices. Response rates during intervention trials showed that rats anticipated reinforcement based on the shape of the distributions they received. In Experiment 2, rats received an intervention with a decreasing hazard function with a steep slope or a shallow slope. Both time-based interventions increased self-control and produced similar response-rate patterns, indicating that the slope of the decreasing hazard function may not play a strong role in intervention efficacy. While this research aligns with previous literature showing that time-based interventions improved self-control, exposure to short delays produced the biggest improvements. Ultimately, exposure to short delays may increase the subjective value of the larger-later choice while occasional long delays may promote the ability to wait, which may have important implications for translational applications.

Discounting of food and water in rats shows trait- and state-like characteristics

Delay discounting is the loss in value of an outcome as a function of its delay. The present study focused on examining a trait-like characteristic of delay discounting in a preclinical animal model. Specifically, we were interested in whether there was a positive relation between discounting of 2 different outcomes in rats. That is, would rats that discount delayed food steeply also discount delayed water steeply? In addition, we examined how session-to-session variability in discounting could be attributed to differences between subjects (trait variability) and to differences within subjects (state variability). Finally, we measured discounting from early- to mid-adulthood, allowing us to examine changes in discounting as a function of age. Overall, we found a moderate, positive correlation between discounting of food and discounting of water in rats, providing further evidence that the relative consistency with which individuals discount different outcomes is a trait-like characteristic. In addition, we found a high degree of within-subject variability in discounting, indicating strong state-like differences from session to session. Finally, overall, discounting decreased as a function of age; however, individual-subject data showed variability in how discounting changed across time. Overall, our results show that differences in delay discounting between individuals reflect variability in both trait- and state-like characteristics.

Reducing impulsive choice VII: effects of duration of delay-exposure training

Impulsive choice is related to substance use disorders, obesity, and other behaviors that negatively impact human health. Reducing impulsive choice may prove beneficial in ameliorating these maladaptive behaviors. Preclinical research in rats indicates that one reliable method for producing large and lasting reductions in impulsive choice is delay-exposure (DE) training. In all six of the prior DE-training experiments, rats were given extensive experience (~ 120 training sessions) with a delayed reinforcement contingency. The present experiment evaluated if similar large and lasting reductions in impulsive choice could be achieved with less training. The duration of DE training between groups of male Wistar rats was 0 sessions (training ended after a lever-pressing acquisition criterion was met), 30, 60, or 120 sessions. Comparison groups were given the same durations of training with immediate reinforcement. A post-training assessment of impulsive choice was completed using an increasing-delay procedure. For rats assigned to the 60-session condition, impulsive choice was reassessed at a 120-day follow-up. DE training reduced impulsive choice but, contrary to expectation, reductions in impulsive choice did not increase with DE-training duration (no significant training-duration by group interaction). Importantly, 60 sessions of DE training produced reductions in impulsive choice that were comparable to prior published findings and this effect remained significant at the 120-day follow-up. Procedural elements that may be responsible for the DE-training effect, and how they could be improved in future experiments, are discussed.

The role of impulsivity as predisposing behavioural trait in different aspects of alcohol self-administration in rats

BACKGROUND

Therapeutic interventions to promote abstinence and prevent relapse in alcohol use disorder (AUD) are limitedly available. Therefore, targeting risk factors in the onset and maintenance of AUD could pose an interesting alternative treatment strategy. In this regard, over the last decade trait impulsivity has received considerable attention as such a risk factor predisposing substance dependence both in clinical populations and preclinical rodent studies. This study investigated whether different forms of impulsivity (action versus choice) predict distinct stages of instrumental alcohol self-administration, extinction and cue-induced relapse.

METHODS

Two cohorts of n = 48 rats each were trained in an operant tasks for either impulsive action or impulsive choice. Subsequently, high and low impulsive rats were then tested in an alcohol self-administration and relapse model and following this retested in the impulsivity tasks to evaluate possible changes in impulsivity levels.

RESULTS

The current data show that neither impulsive action, nor impulsive choice predict the extent to which rats consume alcohol and the extent to which rats are motivated to self-administer alcohol. Moreover, extinction of responding for alcohol and cue-induced relapse was not predicted by impulsivity. Interestingly, rats and most prominently low impulsive rats became more impulsive after the alcohol self-administration procedure. Although due to employed experimental design it is not clear whether this resulted from alcohol consumption or alcohol abstinence.

CONCLUSION

Together, these findings lend further support for the notion of a unidirectional relationship between self-administration of the depressant drug alcohol and impulsivity.

A time-based intervention to treat impulsivity in male and female rats

Time-based interventions have emerged as promising treatments for disorders associated with impulsivity. These interventions can be implemented to test their efficacy in preventing or treating impulsive choice in animal models of diseases related to impulsivity such as drug abuse. Impulsive choice is typically defined as choosing a smaller-sooner (SS) reward over a larger-later (LL) reward when the LL is relatively more optimal. Previous research has shown that these interventions promote LL choices in males and females, but sex differences have not been assessed. Because sex differences can complicate the application of therapies, it is critical to compare the effects of the intervention in males and females. The intervention group received exposure to 10-s and 30-s interval schedules, and the control rats received no delay to reward. Different impulsive choice tasks were used to assess the intervention efficacy across the two experiments. Following the intervention, reductions in impulsive choice were found in male and female rats, but the degree of improvement was inconsistent across sex and task. Bayesian analyses that combined the results revealed robust evidence of an overall intervention effect with the intervention group showing greater self-control, but there was no evidence for the intervention affecting males and females differently. Taken together, these results suggest that time-based interventions are effective tools to treat impulsivity in both males and females and offer promising translational capability to humans.

Global Tactile Coding in Rat Barrel Cortex in the Absence of Local Cues

Although whisker-related perception is based predominantly on local, near-instantaneous coding, global, intensive coding, which integrates the vibrotactile signal over time, has also been shown to play a role given appropriate behavioral conditions. Here, we study global coding in isolation by studying head-fixed rats that identified pulsatile stimuli differing in pulse frequency but not in pulse waveforms, thus abolishing perception based on local coding. We quantified time locking and spike counts as likely variables underpinning the 2 coding schemes. Both neurometric variables contained substantial stimulus information, carried even by spikes of single barrel cortex neurons. To elucidate which type of information is actually used by the rats, we systematically compared psychometric with neurometric sensitivity based on the 2 coding schemes. Neurometric performance was calculated by using a population-encoding model incorporating the properties of our recorded neuron sample. We found that sensitivity calculated from spike counts sampled over long periods (>1 s) matched the performance of rats better than the one carried by spikes time-locked to the stimulus. We conclude that spike counts are more relevant to tactile perception when instantaneous kinematic parameters are not available.

Reducing impulsive choice: VI. Delay-exposure training reduces aversion to delay-signaling stimuli

Delay-exposure (DE) training consistently and robustly reduces impulsive choice in rats, but the behavioral mechanisms behind this effect are not yet understood. The present study evaluated if DE training works by mitigating aversion to delay-signaling stimuli-those encountered when rats chose the larger-later reward in impulsive choice assessments. Fifty-seven rats were randomly assigned to 120 days of training with delayed reinforcement, training with immediate reinforcement (IE), or to a no-training Control group. Consistent with prior experiments, DE rats made significantly fewer impulsive choices than IE or Control rats. Subsequently, in a separate assessment of delay aversion, rats were given the opportunity to press a lever to temporarily escape from stimuli correlated with long or short time-intervals to food. When these escape opportunities terminated delay-signaling stimuli in the impulsive-choice task, DE rats escaped significantly less than IE and Control rats. When escapes terminated FI-signaling stimuli (a procedure in which there is no response-reinforcer delay), the difference only approached significance. These results support the hypothesis that DE training reduces impulsive choice, in part, by reducing aversion to delay-signaling stimuli. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

Development of a Spatial Discount Task to Measure Impulsive Choices in Dogs

Simple Summary

Impulsivity is believed to play a role in problematic behaviors in dogs. In this study, we developed a test to assess dogs’ tendency to make impulsive choices, that is their preference for smaller immediate reward instead of larger, but harder to obtain ones. Dogs were first trained that a bowl presented on a certain side always contained a large food amount, whereas the one presented on the opposite side (although at the same distance from the dog) contained less food. Then, the bowl with less food was progressively placed closer to the dog. As expected, dogs’ choices to feed from the bowl with less food increased as the distance of the latter decreased. Choices did not depend on factors that could interfere, such as dogs’ level of motivation for food, training experience, or learning ability. This indicates that the test is likely to be actually assessing impulsivity, not other traits. Also, female dogs were more likely to make impulsive choices than males, in accordance with what is known in humans and rodents, supporting the validity of the test. The test was completed in less than 1 h, making it a valid option to assess impulsivity in dogs in various contexts.

Abstract

Impulsive choices reflect an individual’s tendency to prefer a smaller immediate reward over a larger delayed one. Here, we have developed a behavioural test which can be easily applied to assess impulsive choices in dogs. Dogs were trained to associate one of two equidistant locations with a larger food amount when a smaller amount was presented in the other location, then the smaller amount was placed systematically closer to the dog. Choices of the smaller amount, as a function of distance, were considered a measure of the dog’s tendency to make impulsive choices. All dogs (N = 48) passed the learning phase and completed the entire assessment in under 1 h. Choice of the smaller food amount increased as this was placed closer to the dog. Choices were independent from food motivation, past training, and speed of learning the training phase; supporting the specificity of the procedure. Females showed a higher probability of making impulsive choices, in agreement with analogue sex differences found in human and rodent studies, and supporting the external validity of our assessment. Overall, the findings support the practical applicability and represent a first indication of the validity of this method, making it suitable for investigations into impulsivity in dogs.

Cognitive and behavioral training interventions to promote self-control

This review article discusses various cognitive and behavioral interventions that have been developed with the goal of promoting self-controlled responding. Self-control can exert a significant impact on human health and impulsive behaviors are associated with a wide range of diseases and disorders, leading to the suggestion that impulsivity is a trans-disease process. The self-control interventions include effort exposure, reward discrimination, reward bundling, interval schedules of reinforcement, impulse control training, and mindfulness training. Most of the interventions have been consistently shown to increase self-control, except for mindfulness training. Some of the successful interventions are long-lasting, whereas others may be transient. Most interventions are domain-specific, targeting specific cognitive and behavioral processes that relate to self-control rather than targeting overall self-control. For example, effort exposure appears to primarily increase effort tolerance, which in turn can improve self-control. Similarly, interval schedules primarily target interval timing, which promotes self-controlled responses. A diagram outlining a proposed set of intervention effects on self-control is introduced to motivate further research in this area. The diagram suggests that the individual target processes of the interventions may potentially summate to produce general self-control, or perhaps even produce synergistic effects. In addition, it is suggested that developing a self-control profile may be advantageous for aligning specific interventions to mitigate specific deficits. Overall, the results indicate that interventions are a promising avenue for promoting self-control and may help to contribute to changing health outcomes associated with a wide variety of diseases and disorders. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Changing Delay Discounting and Impulsive Choice: Implications for Addictions, Prevention, and Human Health

Delay discounting describes the tendency to devalue delayed consequences or future prospects. The degree to which an individual discounts delayed events appears trait-like in that it is stable over time and across functionally similar situations. Steeply discounting delayed rewards is correlated with most substance-use disorders, the severity of these disorders, rates of relapse to drug use, and a host of other maladaptive decisions impacting human health. Longitudinal data suggest steep delay discounting and high levels of impulsive choice are predictive of subsequent drug taking, which suggests (though does not establish) that reducing delay discounting could have a preventive health-promoting effect. Experimental manipulations that produce momentary or long-lasting reductions in delay discounting or impulsive choice are reviewed, and behavioral mechanisms that may underlie these effects are discussed. Shortcomings of each manipulation technique are discussed and areas for future research are identified. While much work remains, it is clear that impulsive decision-making can be reduced, despite its otherwise trait-like qualities. Such findings invite technique refinement, translational research, and hope.

Interventions aimed at changing impulsive choice in rats: Effects of immediate and relatively long delay to reward training

A relatively strong preference for smaller-sooner rewards (SSR) over larger-later rewards (LLR) is associated with a host of maladaptive behavioral patterns. As such, the clinical implications for increasing preference for LLR are profound. There is a growing body of literature that suggests extended exposure to delayed reward may increase preference for LLR in rats. However, questions remain about the underlying mechanism driving this effect and the extent to which extended exposure to immediate rewards may decrease LLR choice. In Experiment 1, we tested effects of a differential-reinforcement-of-low-rates schedule (DRL) to increase LLR choice using a pretest/posttest design with Wistar rats as subjects. We compared this group to a group of rats exposed to a differential-reinforcement-of-high-rates schedule (DRH). The DRH intervention has never been employed in this research context, but explicitly programs an immediate response-reinforcement requirement. In Experiment 2, we tested effects of an intervention with a delay longer than those used in the delay discounting pretest and posttest. No previous research has tested effects of an intervention delay this long, relative to the delay discounting task. We compared this group to a group exposed to a delay that was part of the delay discounting pretest and posttest and to a group exposed to a traditional no-delay, fixed-ratio (FR) 2 control intervention. In both experiments, we found that exposure to delayed rewards in the intervention phase significantly increased LLR choice relative to pretest performance. These findings replicate and extend a growing body of literature showing that delay exposure increases preference for LLR. We also found significant decreases in LLR choice from pretest to posttest in the DRH and no-delay intervention groups in Experiments 1 and 2, respectively. This is the first report of such an effect and has implications for understanding and interpreting effects of delay exposure training in past and future research. Our results also suggested no relationship between improved temporal tracking of reward and increases in LLR choice as a result of delay exposure training.

Females in the forefront: time-based intervention effects on impulsive choice and interval timing in female rats

Impulsive choice has been implicated in substance abuse, gambling, obesity, and other maladaptive behaviors. Deficits in interval timing may increase impulsive choices, and therefore, could serve as an avenue through which suboptimal impulsive choices can be moderated. Temporal interventions have successfully attenuated impulsive choices in male rats, but the efficacy of a temporal intervention has yet to be assessed in female rats. As such, this experiment examined timing and choice behavior in female rats, and evaluated the ability of a temporal intervention to mitigate impulsive choice behavior. The temporal intervention administered in this study was successful in reducing impulsive choices compared to a control group. Results of a temporal bisection task indicated that the temporal intervention increased long responses at the shorter durations. Further, results from the peak trials within the choice task combined with the progressive interval task suggest that the intervention increased sensitivity to delay and enhanced timing confidence. Overall, these results indicate that a temporal intervention can be a successful avenue for reducing impulsive choice behavior in female rats, and could contribute to the development of behavioral interventions to prevent impulsive choice and maladaptive behaviors that can be applied to both sexes.

Reducing impulsive choice: V. The role of timing in delay-exposure training

Impulsive decision-making is common in addiction-related disorders, with some research suggesting it plays a causal role in their development. Therefore, reducing impulsive decision-making may prevent or reduce addiction-related behaviors. Recent research shows that prolonged experience with response-contingent delayed reward (delay exposure [DE] training) reduces impulsive choice in rats, but it is unclear what behavioral mechanisms underlie this effect. The present study evaluated whether improvements in interval timing mediate the effects of DE training on impulsive choice. Thirty-nine Long-Evans rats were randomly assigned to groups completing DE, immediacy-, or no-exposure training, followed by impulsive-choice and timing tasks (temporal bisection). Despite replicating the DE effect on impulsive choice, timing accuracy and precision were unaffected by DE training and unrelated to impulsive choice. The present findings did not replicate previous reports that timing precision and impulsive choice are related, which may be due to between-laboratory differences in impulsive choice tasks. Continued research to identify candidate behavioral mechanisms of DE training may assist in improving training efficacy and facilitating translational efforts.

Impulsive choice and pre-exposure to delays: iv. effects of delay- and immediacy-exposure training relative to maturational changes in impulsivity

Impulsive choice describes preference for smaller, sooner rewards over larger, later rewards. Excessive delay discounting (i.e., rapid devaluation of delayed rewards) underlies some impulsive choices, and is observed in many maladaptive behaviors (e.g., substance abuse, gambling). Interventions designed to reduce delay discounting may provide therapeutic gains. One such intervention provides rats with extended training with delayed reinforcers. When compared to a group given extended training with immediate reinforcers, delay-exposed rats make significantly fewer impulsive choices. To what extent is this difference due to delay-exposure training shifting preference toward self-control or immediacy-exposure training (the putative control group) shifting preference toward impulsivity? The current study compared the effects of delay- and immediacy-exposure training to a no-training control group and evaluated within-subject changes in impulsive choice across 51 male Wistar rats. Delay-exposed rats made significantly fewer impulsive choices than immediacy-exposed and control rats. Between-group differences in impulsive choice were not observed in the latter two groups. While delay-exposed rats showed large, significant pre- to posttraining reductions in impulsive choice, immediacy-exposed and control rats showed small reductions in impulsive choice. These results suggest that extended training with delayed reinforcers reduces impulsive choice, and that extended training with immediate reinforcers does not increase impulsive choice.

Differential reinforcement of low rates differentially decreased timing precision

Timing processes have been implicated as potential mechanisms that underlie self-controlled choice. To investigate the impact of an intervention that has been shown to increase self-controlled choice on timing processes, accuracy and precision of temporal discrimination were assessed in an 18-s peak procedure (18-s fixed interval trials; 54-s peak trials). During an intervention phase, mice in three treatment groups experienced differential reinforcement of low rate (DRL) schedules of reinforcement of 27 s, 18 s, or 9 s. A fourth group received continued exposure to the peak procedure. After the DRL intervention, timing was reassessed using the peak procedure. In contrast to previous reports, the DRL intervention resulted in less precise timing as indicated by increased peak spread and disrupted single-trial measures of temporal control. These effects were only detected just after the DRL intervention suggesting a transient effect of DRL exposure on timing. The increase in peak spread in the present experiment suggests delay exposure via DRL schedules may produce a "dose-dependent" effect on temporal discrimination, which may also increase self-controlled choice.

Durability and generalizability of time-based intervention effects on impulsive choice in rats

Impulsive choice involves choosing a smaller-sooner (SS) reward over a larger-later (LL) reward. Due to the importance of timing processes in impulsive choice, time-based interventions have been developed to decrease impulsive choice. The present set of experiments assessed the durability and generalizability of time-based interventions. Experiment 1 assessed fixed interval (FI) or variable interval (VI) intervention efficacy over 9 months. The FI intervention decreased impulsive choice, and this effect persisted over time, but the VI intervention effects were only apparent when tested immediately after the intervention. Experiment 2 examined the generalizability of the FI and VI interventions on choice tasks manipulating the SS delay, LL delay, or LL magnitude. The FI intervention decreased sensitivity to delay, promoting LL choices in both delay tasks, but the VI intervention only altered choices when manipulating the SS delay. Experiment 3 further examined the FI intervention effects on tasks that manipulated the LL delay or magnitude immediately following the intervention. The intervention decreased sensitivity to both delay and magnitude. The experiments indicate that the FI intervention is effective at decreasing impulsive choice behavior for an extended period across changing delays and magnitudes, suggesting a relatively broad effect on choice behavior.

Choice between delayed food and immediate opioids in rats: treatment effects and individual differences

RATIONALE

Addiction involves maladaptive choice behavior in which immediate drug effects are valued more than delayed nondrug rewards.

OBJECTIVES AND METHODS

To model this behavior and extend our earlier work with the prescription opioid oxycodone, we allowed rats to choose between immediate intravenous delivery of the short-acting opioid remifentanil and delayed delivery of highly palatable food pellets. Treatment drugs were tested on a baseline where remifentanil was preferred over food.

RESULTS

Treatment with a high dose of the opioid antagonist naltrexone decreased but did not reverse the preference for remifentanil. Treatment with the serotonin 5-HT_2C agonist lorcaserin decreased remifentanil and food self-administration nonselectively. Across conditions in which the alternative to delayed food was either a moderate dose of oxycodone, a moderate or high dose of remifentanil, a smaller more immediate delivery of food, or timeout with no primary reinforcement, choice was determined by both the length of the delay and the nature of the alternative option. Delayed food was discounted most steeply when the alternative was a high dose of remifentanil, which was preferred over food when food was delayed by 30 s or more. Within-subject comparisons showed no evidence for trait-like impulsivity or sensitivity to delay across these conditions.

CONCLUSIONS

Choice was determined more by the current contingencies of reinforcement than by innate individual differences. This finding suggests that people might develop steep delay-discounting functions because of the contingencies in their environment, and it supports the use of contingency management to enhance the relative value of delayed nondrug reinforcers.