Do the adjusting-delay and increasing-delay tasks measure the same construct: delay discounting?

Neural basis of cognitive control signals in anterior cingulate cortex during delay discounting

Cognitive control involves allocating cognitive effort according to internal needs and task demands and the Anterior Cingulate Cortex (ACC) is hypothesized to play a central role in this process. We investigated the neural basis of cognitive control in the ACC of rats performing an adjusting-amount delay discounting task. Decision-making in this this task can be guided by using either a lever-value tracking strategy, requiring a 'resource-based' form of cognitive effort or a lever-biased strategy requiring a 'resistance-based' form of cognitive effort. We found that ACC ensembles always tightly tracked lever value on each trial, indicative of a resource-based control signal. These signals were prevalent in the neural recordings and were influenced by the delay. A shorter delay was associated with devaluing of the immediate option and a longer delay was associated with overvaluing of the immediate option. In addition, ACC theta (6-12Hz) oscillations were observed at the choice point of rats exhibiting a resistance-based strategy. These data provide candidates of neural activity patterns in the ACC that underlie the use of 'resource-based' and 'resistance-based' cognitive effort. Furthermore, these data illustrate how strategies can be engaged under different conditions in individual subjects.

Active and passive waiting in impulsive choice: Effects of fixed-interval and fixed-time delays

Behavioral interventions to improve self-control, preference for a larger-later (LL) reward over a smaller-sooner (SS) reward, involve experience with delayed rewards. Whether they involve timing processes remains controversial. In rats, there have been inconsistent results on whether timing processes may be involved in intervention-induced improvements in self-control. Interventions that improved self-control with corresponding timing improvements used fixed-interval (FI) delays, whereas interventions that failed to find corresponding timing improvements used fixed-time (FT) delays. The FI schedule includes a response contingency (active waiting), whereas the FT schedule delivers reward automatically (passive waiting). The present study compared the effects of FI and FT schedules in interventions and impulsive choice tasks to evaluate effects on self-control and timing behavior. The impulsive choice task evaluated preference for an SS option (one pellet after 10-, 15-, 20-, 25-, and 30-s delays) versus an LL option (two pellets after a 30-s delay). The intervention task included forced-choice SS (one pellet after 10 s) and LL (two pellets after 30 s) sessions under FI or FT schedules. FI schedules produced greater sensitivity to SS delay in the impulsive choice task. Both FI and FT interventions increased LL choices. Following choice testing, temporal bisection and peak interval tasks revealed better timing precision for rats with an FI delay experience. Overall, the FI choice contingency was associated with improved temporal attention and timing precision.

Relationship between two forms of impulsivity in mice at baseline and under acute and sub-chronic atomoxetine treatment

RATIONALE

Impulsivity is a symptom of various mental disorders, including attention deficit hyperactivity disorder (ADHD), bipolar disorder, and addiction. Impulsivity is not a unitary construct, but is present in different forms, yet only a few rodent studies have explored the relationship between these forms within individual subjects.

OBJECTIVES

In this study, we compared behaviors representing two impulsivity forms, delay discounting (choice impulsivity) and premature responding (waiting impulsivity), within the same mice.

METHODS

C57BL/6J male mice were concurrently trained and tested in the delay discounting task and the rodent continuous performance test in a counterbalanced design. The effects of the ADHD medication atomoxetine were tested in both tasks, after both acute (0.3-5.0 mg/kg) and sub-chronic (0.3 mg/kg twice daily for seven days) administration.

RESULTS

There was no correlation between the two impulsivity forms at baseline. Acute atomoxetine treatment (1, 3, and 5 mg/kg) significantly reduced premature responding. Furthermore, sub-chronic treatment with 0.3 mg/kg of atomoxetine caused a stable decrease in premature responding. Atomoxetine had no significant effect on delay discounting after acute or sub-chronic administration, although the acute administration of 1 mg/kg showed a trend towards increasing delay discounting.

CONCLUSIONS

The present results support that delay discounting and premature responding represent two different forms of impulsivity that show dissimilar responses to atomoxetine treatment. The consistency with findings in humans lends support to the translatability of the results in mice.

Mechanisms of impulsive choice: Experiments to explore and models to map the empirical terrain

Impulsive choice is preference for a smaller-sooner (SS) outcome over a larger-later (LL) outcome when LL choices result in greater reinforcement maximization. Delay discounting is a model of impulsive choice that describes the decaying value of a reinforcer over time, with impulsive choice evident when the empirical choice-delay function is steep. Steep discounting is correlated with multiple diseases and disorders. Thus, understanding the processes underlying impulsive choice is a popular topic for investigation. Experimental research has explored the conditions that moderate impulsive choice, and quantitative models of impulsive choice have been developed that elegantly represent the underlying processes. This review spotlights experimental research in impulsive choice covering human and nonhuman animals across the domains of learning, motivation, and cognition. Contemporary models of delay discounting designed to explain the underlying mechanisms of impulsive choice are discussed. These models focus on potential candidate mechanisms, which include perception, delay and/or reinforcer sensitivity, reinforcement maximization, motivation, and cognitive systems. Although the models collectively explain multiple mechanistic phenomena, there are several cognitive processes, such as attention and working memory, that are overlooked. Future research and model development should focus on bridging the gap between quantitative models and empirical phenomena.

Selective chemogenetic inactivation of corticoaccumbal projections disrupts trait choice impulsivity

Impulsive choice has enduring trait-like characteristics and is defined by preference for small immediate rewards over larger delayed ones. Importantly, it is a determining factor in the development and persistence of substance use disorder (SUD). Emerging evidence from human and animal studies suggests frontal cortical regions exert influence over striatal reward processing areas during decision-making in impulsive choice or delay discounting (DD) tasks. The goal of this study was to examine how these circuits are involved in decision-making in animals with defined trait impulsivity. To this end, we trained adolescent male rats to stable behavior on a DD procedure and then re-trained them in adulthood to assess trait-like, conserved impulsive choice across development. We then used chemogenetic tools to selectively and reversibly target corticostriatal projections during performance of the DD task. The prelimbic region of the medial prefrontal cortex (mPFC) was injected with a viral vector expressing inhibitory designer receptors exclusively activated by designer drugs (Gi-DREADD), and then mPFC projections to the nucleus accumbens core (NAc) were selectively suppressed by intra-NAc administration of the Gi-DREADD actuator clozapine-n-oxide (CNO). Inactivation of the mPFC-NAc projection elicited a robust increase in impulsive choice in rats with lower vs. higher baseline impulsivity. This demonstrates a fundamental role for mPFC afferents to the NAc during choice impulsivity and suggests that maladaptive hypofrontality may underlie decreased executive control in animals with higher levels of choice impulsivity. Results such as these may have important implications for the pathophysiology and treatment of impulse control, SUDs, and related psychiatric disorders.

Sequential delay and probability discounting tasks in mice reveal anchoring effects partially attributable to decision noise

Delay discounting and probability discounting decision making tasks in rodent models have high translational potential. However, it is unclear whether the discounted value of the large reward option is the main contributor to variability in animals' choices in either task, which may limit translation to humans. Male and female mice underwent sessions of delay and probability discounting in sequence to assess how choice behavior adapts over experience with each task. To control for "anchoring" (persistent choices based on the initial delay or probability), mice experienced "Worsening" schedules where the large reward was offered under initially favorable conditions that became less favorable during testing, followed by "Improving" schedules where the large reward was offered under initially unfavorable conditions that improved over a session. During delay discounting, both male and female mice showed elimination of anchoring effects over training. In probability discounting, both sexes of mice continued to show some anchoring even after months of training. One possibility is that "noisy", exploratory choices could contribute to these persistent anchoring effects, rather than constant fluctuations in value discounting. We fit choice behavior in individual animals using models that included both a value-based discounting parameter and a decision noise parameter that captured variability in choices deviating from value maximization. Changes in anchoring behavior over time were tracked by changes in both the value and decision noise parameters in delay discounting, but by the decision noise parameter in probability discounting. Exploratory decision making was also reflected in choice response times that tracked the degree of conflict caused by both uncertainty and temporal cost, but was not linked with differences in locomotor activity reflecting chamber exploration. Thus, variable discounting behavior in mice can result from changes in exploration of the decision options rather than changes in reward valuation.

Generalizability of time-based interventions: Effects of choice procedure and smaller-sooner delay

Interventions exposing rats to delayed-reward contingencies attenuate suboptimal impulsive choices, a preference for a smaller-sooner (SS) over a larger-later (LL) reward. Interventions may potentially improve delay-tolerance, timing of delays, and/or discrimination of reward magnitudes. Generalization from the intervention to impulsive choice under different procedures can provide insights into the processes that underlie the intervention effects. Experiment 1 tested intervention effects on systematic-delay (SYS) and adjusting-delay (ADJ) procedures, predicting that intervention effects would be more effective on the SYS procedure with predictable delays. The ADJ procedure did not benefit significantly from intervention, but the SYS procedure, unexpectedly, showed greater impulsive choices following intervention. Experiment 2 tested whether short (5 s) SS intervention delays may have promoted greater impulsivity in the SYS impulsive choice procedure in Experiment 1. Short SS delays in choice and intervention procedures increased impulsive choices in comparison to longer (10 s) delays. Incongruent SS delays in the intervention/choice procedures resulted in negative intervention effects. The results suggest that short SS delays are detrimental to self-control and that specific temporal information generalizes from the intervention to the SYS choice task, but not the ADJ choice task.

Discounting of food and water in rats shows trait- and state-like characteristics

Delay discounting is the loss in value of an outcome as a function of its delay. The present study focused on examining a trait-like characteristic of delay discounting in a preclinical animal model. Specifically, we were interested in whether there was a positive relation between discounting of 2 different outcomes in rats. That is, would rats that discount delayed food steeply also discount delayed water steeply? In addition, we examined how session-to-session variability in discounting could be attributed to differences between subjects (trait variability) and to differences within subjects (state variability). Finally, we measured discounting from early- to mid-adulthood, allowing us to examine changes in discounting as a function of age. Overall, we found a moderate, positive correlation between discounting of food and discounting of water in rats, providing further evidence that the relative consistency with which individuals discount different outcomes is a trait-like characteristic. In addition, we found a high degree of within-subject variability in discounting, indicating strong state-like differences from session to session. Finally, overall, discounting decreased as a function of age; however, individual-subject data showed variability in how discounting changed across time. Overall, our results show that differences in delay discounting between individuals reflect variability in both trait- and state-like characteristics.

The Neurobiology of Impulsive Decision-Making and Reinforcement Learning in Nonhuman Animals

Impulsive decisions are those that favor immediate over delayed rewards, involve the acceptance of undue risk or uncertainty, or fail to adapt to environmental changes. Pathological levels of impulsive decision-making have been observed in individuals with mental illness, but there may be substantial heterogeneity in the processes that drive impulsive choices. Understanding this behavioral heterogeneity may be critical for understanding associated diverseness in the neural mechanisms that give rise to impulsivity. The application of reinforcement learning algorithms in the deconstruction of impulsive decision-making phenotypes can help bridge the gap between biology and behavior and provide insights into the biobehavioral heterogeneity of impulsive choice. This chapter will review the literature on the neurobiological mechanisms of impulsive decision-making in nonhuman animals; specifically, the role of the amine neuromodulatory systems (dopamine, serotonin, norepinephrine, and acetylcholine) in impulsive decision-making and reinforcement learning processes is discussed. Ultimately, the integration of reinforcement learning algorithms with sophisticated behavioral and neuroscience techniques may be critical for advancing the understanding of the neurochemical basis of impulsive decision-making.

Ventral striatum supports Methylphenidate therapeutic effects on impulsive choices expressed in temporal discounting task

Methylphenidate (MPH) is a dopamine transporter (DAT) inhibitor used to treat attention-deficit/hyperactivity-disorder (ADHD). ADHD patients make impulsive choices in delay discounting tasks (DDT) and MPH reduces such impulsivity, but its therapeutic site of action remains unknown. Based on the high density of DAT in the striatum, we hypothesized that the striatum, especially the ventral striatum (VS) and caudate nucleus which both encode temporal discounting, can be preferential MPH action sites. To determine whether one of these striatal territories is predominantly involved in the effect of MPH, we trained monkeys to make choices during DDT. First, consistent with clinical observations, we found an overall reduction of impulsive choices with a low dose of MPH administered via intramuscular injections, whereas we reported sedative-like effects with a higher dose. Then, using PET-imaging, we found that the therapeutic reduction of impulsive choices was associated with selective DAT occupancy of MPH in the VS. Finally, we confirmed the selective involvement of the VS in the effect of MPH by testing the animals’ impulsivity with microinjections of the drug in distinct striatal territories. Together, these results show that the therapeutic effect of MPH on impulsive decisions is mainly restricted to its action in the VS.

The anterior caudate nucleus supports impulsive choices triggered by pramipexole

BACKGROUND

Pramipexole is a dopamine agonist used as a treatment in PD and restless legs syndrome to reduce motor symptoms, but it often induces impulse control disorders. In particular, patients with impulse control disorders tend to make more impulsive choices in the delay discounting task, that is, they choose small immediate rewards over larger delayed ones more often than patients without impulse control disorders and healthy subjects do. Yet the site of action of pramipexole that produces these impulsive choices remains unknown. Based on the heterogeneity of corticostriatal projections and the massive dopamine innervation of the striatum, we hypothesized that impulsive choices triggered by dopamine treatments may be supported by a specific striatal territory.

OBJECTIVES

This study aims to determine by which anteriorstriatum territory the Pramipexole trigger impulsive choices; the caudate nucleus, the ventral striatum or the putamen.

METHODS

We compared pramipexole intramuscular injections to intracerebral microinjections within the three striatal territories in healthy monkeys trained to execute the delay discounting task, a behavioral paradigm typically used to evaluate impulsive choices.

RESULTS

We found that pramipexole intramuscular injections induced impulsive choices in all monkeys. Local microinjections were performed inside the anterior caudate nucleus, ventral striatum, and anterior putamen and reproduced those impulsive choices when pramipexole was directly injected into the caudate nucleus, whereas injections into the ventral striatum or putamen had no effect on monkeys' choices.

CONCLUSIONS

These results, consistent with clinical studies, suggest that impulsive choices triggered by pramipexole are supported by the caudate nucleus, allowing us to emphasize the importance of dopamine modulation inside this striatal territory in decision processes underlying impulsive behaviors. © 2019 International Parkinson and Movement Disorder Society.

Developmental history, energetic state and choice impulsivity in European starlings, Sturnus vulgaris

Impulsivity—the extent to which a reward is devalued by the amount of time until it is realized—can be affected by an individual’s current energetic state and long-term developmental history. In European starlings (Sturnus vulgaris), a previous study found that birds that were lighter for their skeletal size, and birds that had undergone greater shortening of erythrocyte telomeres over the course of development, were more impulsive as adults. Here, we studied the impulsivity of a separate cohort of 29 starlings hand-reared under different combinations of food amount and begging effort. The task involved repeated choice between a key yielding one pellet after 3 s and another key yielding two pellets after 8 s. Impulsivity was operationalised as the proportion of choices for the short-delay option. We found striking variation in impulsivity. We did not replicate the results of the previous study concerning developmental telomere attrition, though combining all the evidence to date in a meta-analysis did support that robustness of that association. We also found that early-life conditions and mass for skeletal size interacted in predicting impulsivity. Specifically, birds that had experienced the combination of high begging effort and low food amount were less impulsive than other groups, and the usual negative relationship between impulsivity and body mass was abolished in birds that had experienced high begging effort. We discuss methodological differences between our study and studies that measure impulsivity using an adjusting-delay procedure.

Integrating Preclinical and Clinical Models of Negative Urgency

Overwhelming evidence suggests that negative urgency is robustly associated with rash, ill-advised behavior, and this trait may hamper attempts to treat patients with substance use disorder. Research applying negative urgency to clinical treatment settings has been limited, in part, due to the absence of an objective, behavioral, and translational model of negative urgency. We suggest that development of such a model will allow for determination of prime neurological and physiological treatment targets, the testing of treatment effectiveness in the preclinical and the clinical laboratory, and, ultimately, improvement in negative-urgency-related treatment response and effectiveness. In the current paper, we review the literature on measurement of negative urgency and discuss limitations of current attempts to assess this trait in human models. Then, we review the limited research on animal models of negative urgency and make suggestions for some promising models that could lead to a translational measurement model. Finally, we discuss the importance of applying objective, behavioral, and translational models of negative urgency, especially those that are easily administered in both animals and humans, to treatment development and testing and make suggestions on necessary future work in this field. Given that negative urgency is a transdiagnostic risk factor that impedes treatment success, the impact of this work could be large in reducing client suffering and societal costs.

Trait determinants of impulsive behavior: a comprehensive analysis of 188 rats

Impulsivity is a naturally occurring behavior that, when accentuated, can be found in a variety of neuropsychiatric disorders. The expression of trait impulsivity has been shown to change with a variety of factors, such as age and sex, but the existing literature does not reflect widespread consensus regarding the influence of modulating effects. We designed the present study to investigate, in a cohort of significant size (188 rats), the impact of four specific parameters, namely sex, age, strain and phase of estrous cycle, using the variable delay-to-signal (VDS) task. This cohort included (i) control animals from previous experiments; (ii) animals specifically raised for this study; and (iii) animals previously used for breeding purposes. Aging was associated with a general decrease in action impulsivity and an increase in delay tolerance. Females generally performed more impulsive actions than males but no differences were observed regarding delay intolerance. In terms of estrous cycle, no differences in impulsive behavior were observed and regarding strain, Wistar Han animals were, in general, more impulsive than Sprague-Dawley. In addition to further confirming, in a substantial study cohort, the decrease in impulsivity with age, we have demonstrated that both the strain and sex influences modulate different aspects of impulsive behavior manifestations.

Value-based decision-making battery: A Bayesian adaptive approach to assess impulsive and risky behavior

Using simple mathematical models of choice behavior, we present a Bayesian adaptive algorithm to assess measures of impulsive and risky decision making. Practically, these measures are characterized by discounting rates and are used to classify individuals or population groups, to distinguish unhealthy behavior, and to predict developmental courses. However, a constant demand for improved tools to assess these constructs remains unanswered. The algorithm is based on trial-by-trial observations. At each step, a choice is made between immediate (certain) and delayed (risky) options. Then the current parameter estimates are updated by the likelihood of observing the choice, and the next offers are provided from the indifference point, so that they will acquire the most informative data based on the current parameter estimates. The procedure continues for a certain number of trials in order to reach a stable estimation. The algorithm is discussed in detail for the delay discounting case, and results from decision making under risk for gains, losses, and mixed prospects are also provided. Simulated experiments using prescribed parameter values were performed to justify the algorithm in terms of the reproducibility of its parameters for individual assessments, and to test the reliability of the estimation procedure in a group-level analysis. The algorithm was implemented as an experimental battery to measure temporal and probability discounting rates together with loss aversion, and was tested on a healthy participant sample.

An improved within-session self-adjusting delay discounting procedure for the study of choice impulsivity in rats

RATIONALE

Delay-discounting procedures involving choice between small immediate rewards and large delayed rewards are used to study impulsivity in rodents. Improving existing procedures may provide new insights into the neurobiological mechanisms underlying decision-making processes.

OBJECTIVES

To develop a novel delay-discounting procedure that adjusts the delay value within individual sessions based on the rat's most recent choices.

METHODS

Compared to previously developed procedure, we required a more consistent demonstration of preference, five consecutive choices of the large or small reward, a criterion that is more likely to reflect deliberate choice by the animal, as opposed to two consecutive choices. In addition, delays were changed in steps of 5 s (rather than 1 s), because 5-s increments should be more easily discriminated and may produce a more distinct effect on choice. We characterized the procedure behaviorally by manipulating the duration of the session and the consecutive choice criterion, and we investigated the stability of the behavior upon interruption of training. We also characterized the procedure pharmacologically by investigating the effects of dopaminergic compounds.

RESULTS

Our procedures allowed obtaining two complementary measures of delay discounting: (1) the percentage of choices of the delay option and (2) the mean adjusting delay, an index of the delay that animals choose more frequently. We found that our procedure rapidly establishes a baseline of choice behavior that remains stable over time and is highly sensitive to manipulations of the dopaminergic system.

CONCLUSIONS

This procedure may provide a useful tool for investigating the neurobiology of inter-temporal choice and decision-making.

Dissecting drug effects in preclinical models of impulsive choice: emphasis on glutamatergic compounds

RATIONALE

Impulsive choice is often measured with delay discounting paradigms. Because there are multiple discounting procedures, as well as different statistical analyses that can be applied to data generated from these paradigms, there are some inconsistencies in the literature regarding drug effects on impulsive choice.

OBJECTIVES

The goal of the current paper is to review the methodological and analytic approaches used to measure discounting and to discuss how these differences can account for differential drug effects observed across studies.

RESULTS

Because some procedures/analyses use a single data point as the dependent variable, changes in this value following pharmacological treatment may be interpreted as alterations in sensitivity to delayed reinforcement, but when other procedures/analyses are used, no changes in behavior are observed. Even when multiple data points are included, some studies show that the statistical analysis (e.g., ANOVA on raw proportion of responses vs. using hyperbolic/exponential functions) can lead to different interpretations. Finally, procedural differences (e.g., delay presentation order, signaling the delay to reinforcement, etc.) in the same discounting paradigm can alter how drugs affect sensitivity to delayed reinforcement.

CONCLUSIONS

Future studies should utilize paradigms that allow one to observe alterations in responding at each delay (e.g., concurrent-chains schedules). Concerning statistical analyses, using parameter estimates derived from nonlinear functions or incorporating the generalized matching law can allow one to determine if drugs affect sensitivity to delayed reinforcement or impair discrimination of the large and small magnitude reinforcers. Using these approaches can help further our understanding of the neurochemical underpinnings of delay discounting.

Premature responses in the five-choice serial reaction time task reflect rodents' temporal strategies: evidence from no-light and pharmacological challenges

RATIONALE

The five-choice serial reaction time task (5-CSRTT) is regularly used to study attention and impulsivity. In the 5-CSRTT, rodents initiate a trial, then after an inter-trial interval (ITI), a light appears in one of five holes. Responding in the lit vs. unlit hole reflects attention (accuracy), while responding prematurely before a light appears is suggested to reflect impulsivity/response disinhibition. Comparison of rat and mouse 5-CSRTT performance has raised questions on the validity of premature responses as measuring impulsivity/response inhibition. To minimize effort, rodents may use a temporal strategy, enabling their "timing" of the ITI, minimizing the need to attend during this delay. Greater reliance on this strategy could result in premature responses due to "guesses" if their timing was poor/altered.

OBJECTIVES

To assess the degree to which rats and/or mice utilize a temporal strategy, we challenged performance using infrequent no-light trials during 5-CSRTT performance.

RESULTS

Even when no light appeared when one was expected, rats responded ~60 % compared to ~40 % in mice, indicating a greater reliance on a temporal strategy by rats than by mice. Consistent with this hypothesis, rats made more premature responses than mice. Additional studies using a temporal discrimination task and a 5-CSRTT variant demonstrated that delta-9-tetrahydrocannabinol, the active ingredient in cannabis, slowed temporal perception and reduced premature responses.

CONCLUSIONS

These data provide behavioral and pharmacological evidence indicating that premature responses are heavily influenced by temporal perception. Hence, they may reflect an aspect of waiting impulsivity, but not response disinhibition, an important distinction for translational clinical research.

Reinforcer magnitude affects delay discounting and influences effects of d-amphetamine in rats

Impulsive choice in humans can be altered by changing reinforcer magnitude; however, this effect has not been found in rats. Current levels of impulsive choice can also influence effects of d-amphetamine. This study used a within-subject assessment to determine if impulsive choice is sensitive to changes in reinforcer magnitude, and whether effects of d-amphetamine are related to current levels of impulsive choice. A discounting procedure in which choice was for a smaller reinforcer available immediately or a larger reinforcer available after a delay that increased within session was used. Reinforcer magnitude was manipulated between conditions and impulsive choice was quantified using area under the curve (AUC). In the Smaller-Magnitude (SM) Condition, choice was between one food pellet and three food pellets. In the Larger-Magnitude (LM) Condition, choice was between two food pellets and six food pellets. Impulsive choice was greater in the SM Condition compared to the LM Condition. Further, effects of d-amphetamine (0.1-1.8mg/kg) were related to differences in impulsive choice. d-Amphetamine increased impulsive choice in the LM Condition, but had no effect on impulsive choice in the SM Condition. Overall, these results show that impulsive choice in rats is sensitive to changes in reinforcer magnitude, and that effects of d-amphetamine are influenced by current levels of impulsive choice.

Discrepant effects of acute cocaine on impulsive choice (delay discounting) in female rats during an increasing- and adjusting-delay procedure

RATIONALE

The relationship between impulsive choice and cocaine use in humans has been well established, although the causal role between these variables is complex. To disentangle this relationship, studies using rats have focused on how acute or chronic cocaine alters impulsive choice. A predominance of studies has focused on chronic cocaine regimens, but few have assessed acute cocaine's effects on impulsive choice.

OBJECTIVE

The current study assessed if acute cocaine administrations alter delay discounting of rats in two common impulsive choice procedures.

METHOD

Baseline delay discounting rates were determined in female rats using both an increasing- and adjusting-delay procedure. Once stable, a range of acute cocaine injections (2, 5, and 15 mg/kg i.p.) was administered prior to both procedures.

RESULTS

Baseline delay discounting rates were positively correlated between the increasing- and adjusting-delay procedures. Acute administrations of cocaine produced a dose-dependent decrease in preference for the large alternative in the increasing-delay procedure but had no effect in the adjusting-delay procedure.

CONCLUSIONS

The concordance of delay discounting rates across the two choice procedures suggests that both quantify the same underlying components of impulsive choice. However, manipulations that disrupt large alternative preference may not be readily detected under the adjusting-delay procedure unless control conditions are employed.

Impulsive choice predicts anxiety-like behavior, but not alcohol or sucrose consumption, in male Long-Evans rats

BACKGROUND

Prior human research indicates robust, positive relations between impulsive choice (i.e., preference for smaller, immediate over larger, delayed rewards) and alcohol use disorders. However, varied findings in the nonhuman literature reveal a relatively ambiguous relation between impulsive choice and alcohol consumption in rodents. In addition, few rodent studies have investigated potential relations between impulsive choice and common covariates of alcohol consumption (e.g., avidity for sweet substances or anxiety-like behavior).

METHODS

Ninety-two male Long-Evans rats completed an impulsive-choice task. From this larger sample, extreme high- and low-impulsive groups (n = 30 each) were retained for further testing. In separate tests, subsequent open-field behavior and consumption of oral alcohol (12% w/v) and isocaloric sucrose were examined. Impulsive choice was then retested to examine whether behavior remained stable over the course of the experiment.

RESULTS

No significant relations emerged between impulsive choice and either alcohol or sucrose consumption. However, impulsive choice predicted greater anxiety-like behavior (avoidance of the center field, defecation) in the open-field test. In turn, greater anxiety predicted lower alcohol and sucrose consumption. Finally, choice remained generally stable across the experiment, although high-impulsive rats tended toward less impulsive choice in the retest.

CONCLUSIONS

Although impulsive choice and alcohol consumption appear to share some variance with anxiety-like behavior, the present data offer no support for a relation between impulsive choice and alcohol consumption in Long-Evans rats. Together with mixed rodent data from prior reports, these findings attenuate cross-species comparisons to human relations between impulsive choice and alcohol use disorders.

Working-memory training: effects on delay discounting in male Long Evans rats

Delay discounting describes the devaluation of a reward as the delay to the receipt of the reward increases. Because steep delay discounting is robustly correlated with a number of behavioral problems (e.g., substance dependence, gambling) and some evidence suggests steep discounting precedes and predicts drug-taking in humans and rats, this study sought to experimentally reduce rats' delay discounting. Human stimulant-dependent participants given working-memory training reportedly decreased their rates of discounting relative to a sham-training group (Bickel, Yi, Landes, Hill, & Baxter, 2011). To evaluate the cross-species generality of this effect, 38 male Long-Evans rats, matched on pretraining delay-discounting rates, were randomly assigned to receive 140 sessions of working-memory training or sham training (which required no memory of the sample stimulus). Large between-group differences in working memory were observed after training; however, posttraining delay-discounting rates were undifferentiated across groups. Potential explanations for these findings are discussed.

Impulsive choice, alcohol consumption, and pre-exposure to delayed rewards: II. Potential mechanisms

In a prior study (Stein et al., 2013), we reported that rats pre-exposed to delayed rewards made fewer impulsive choices, but consumed more alcohol (12% wt/vol), than rats pre-exposed to immediate rewards. To understand the mechanisms that produced these findings, we again pre-exposed rats to either delayed (17.5 s; n=32) or immediate (n=30) rewards. In posttests, delay-exposed rats made significantly fewer impulsive choices at 15- and 30-s delays to a larger, later food reward than the immediacy-exposed comparison group. Behavior in an open-field test provided little evidence of differential stress exposure between groups. Further, consumption of either 12% alcohol or isocaloric sucrose in subsequent tests did not differ between groups. Because Stein et al. introduced alcohol concentration gradually (3-12%), we speculate that their group differences in 12% alcohol consumption were not determined by alcohol's pharmacological effects, but by another variable (e.g., taste) that was preserved as an artifact from lower concentrations. We conclude that pre-exposure to delayed rewards generalizes beyond the pre-exposure delay; however, this same experimental variable does not robustly influence alcohol consumption.

Measurement of impulsive choice in rats: same- and alternate-form test-retest reliability and temporal tracking

Impulsive choice is typically measured by presenting smaller-sooner (SS) versus larger-later (LL) rewards, with biases towards the SS indicating impulsivity. The current study tested rats on different impulsive choice procedures with LL delay manipulations to assess same-form and alternate-form test-retest reliability. In the systematic-GE procedure (Green & Estle, 2003), the LL delay increased after several sessions of training; in the systematic-ER procedure (Evenden & Ryan, 1996), the delay increased within each session; and in the adjusting-M procedure (Mazur, 1987), the delay changed after each block of trials within a session based on each rat's choices in the previous block. In addition to measuring choice behavior, we also assessed temporal tracking of the LL delays using the median times of responding during LL trials. The two systematic procedures yielded similar results in both choice and temporal tracking measures following extensive training, whereas the adjusting procedure resulted in relatively more impulsive choices and poorer temporal tracking. Overall, the three procedures produced acceptable same form test-retest reliability over time, but the adjusting procedure did not show significant alternate form test-retest reliability with the other two procedures. The results suggest that systematic procedures may supply better measurements of impulsive choice in rats.

Impulsivity, risk-taking, and distractibility in rats exhibiting robust conditioned orienting behaviors

When a neutral cue is followed by a significant event such as food delivery, some animals become engaged with the cue itself and acquire cue-directed behaviors. One type of cue-directed behavior is observed following insertion of a lever used as a conditioned stimulus (CS). Rats showing robust approach behavior to the lever also display impulsivity and altered attention, as compared to rats showing behavior directed toward the reward delivery location. The current study used a light CS to categorize rats' propensity for cue-directed behavior, and assessed whether individual differences in impulsivity and related behaviors still emerged. During the light-food pairings, some rats displayed enhanced rearing or orienting to the light (Orienters) prior to showing food cup approach behavior, while other rats only showed food cup approach behavior (Nonorienters). Our results showed that Orienters made more impulsive and risky decisions in two different choice tasks, and were quicker to leave a familiar dark environment to enter a novel bright field. Orienters also showed less accurate target detection when a visual distractor was introduced during an attentional challenge. Our current study suggests that light CS-induced rearing/orienting behavior might not necessarily share an identical mechanism with lever CS-approach behavior in predicting impulsivity-related behaviors.