Intake-dependent effects of cocaine self-administration on impulsive choice in a delay discounting task

Prior cocaine self-administration does not impair the ability to delay gratification in rats during diminishing returns

Previous exposure to drugs of abuse produces impairments in studies of reversal learning, delay discounting and response inhibition tasks. While these studies contribute to the understanding of normal decision-making and how it is impaired by drugs of abuse, they do not fully capture how decision-making impacts the ability to delay gratification for greater long-term benefit. To address this issue, we used a diminishing returns task to study decision-making in rats that had previously self-administered cocaine. This task was designed to test the ability of the rat to choose to delay gratification in the short-term to obtain more reward over the course of the entire behavioral session. Rats were presented with two choices. One choice had a fixed amount of time delay needed to obtain reward [i.e. fixed delay (FD)], while the other choice had a progressive delay (PD) that started at 0 s and progressively increased by 1 s each time the PD option was selected. During the 'reset' variation of the task, rats could choose the FD option to reset the time delay associated with the PD option. Consistent with previous results, we found that prior cocaine exposure reduced rats' overall preference for the PD option in post-task reversal testing during 'no-reset' sessions, suggesting that cocaine exposure made rats more sensitive to the increasing delay of the PD option. Surprisingly, however, we found that rats that had self-administered cocaine 1-month prior, adapted behavior during 'reset' sessions by delaying gratification to obtain more reward in the long run similar to control rats.

Cocaine intake correlates with risk-taking behavior and affects estrous cycling in female Sprague-Dawley rats

Navigating complex decisions and considering their relative risks and rewards is an important cognitive ability necessary for survival. However, use of and dependence on illicit drugs can result in long-lasting changes to this risk/reward calculus in individuals with substance use disorder. Recent work has shown that chronic exposure to cocaine causes long-lasting increases in risk taking in male and female rats, but there are still significant gaps in our understanding of the relationship between cocaine use and changes in risk taking. For example, it is unclear whether the magnitude of cocaine intake dictates the extent to which risk taking is altered. To address this, male and female Sprague-Dawley rats underwent cocaine (or sucrose) self-administration and, following a period of abstinence, were trained and tested in a rodent model of risky decision making. In this behavioral task, rats made discrete-trial choices between a lever associated with a small food reward (i.e., "safe" option) and a lever associated with a larger food reward accompanied by a variable risk of footshock delivery (i.e., "risky" option). Surprisingly, and in contrast to prior work in Long-Evans rats, there were no effects of cocaine self-administration on choice of the large, risky reward (i.e., risk taking) during abstinence in males or females. There was, however, a significant relationship between cocaine intake and risk taking in female rats, with greater intake associated with greater preference for the large, risky reward. Relative to their sucrose counterparts, female rats in the cocaine group also exhibited irregular estrous cycles, characterized by prolonged estrus and/or diestrus phases. Collectively, these data suggest that there may be strain differences in the effects of cocaine on risk taking and highlight the impact that chronic cocaine exposure has on hormonal cyclicity in females. Future work will focus on understanding the neural mechanisms underlying cocaine's intake-dependent effects on risk taking in females, and whether this is directly related to cocaine-induced alterations in neuroendocrine function.

Interactions between impulsivity and MDPV self-administration in rats

Synthetic cathinones, such as 3,4-methylenedioxypyrovalerone (MDPV), are recreational drugs of abuse often identified in 'bath salts' preparations. Humans report compulsive patterns of bath salts use, and previous work suggests that a subset of rats develop unusually high levels of MDPV self-administration. This study aims to test the hypothesis that high levels of impulsivity (e.g., inability to withhold responding for a sucrose reward) will predispose rats to high levels of MDPV self-administration relative to rats with lower levels of impulsivity. The 1-choice serial reaction time task (1-CSRTT) was used to assess impulsivity (i.e., premature responding) in 10 female and 10 male Sprague Dawley rats. Rats were then allowed to self-administer 0.032 mg/kg/inf MDPV or 0.32 mg/kg/inf cocaine, after which full dose-response curves for MDPV (0.001-0.1 mg/kg/inf) or cocaine (0.01-1 mg/kg/inf) were generated under a FR5 schedule of reinforcement. After a history of self-administering MDPV or cocaine, impulsivity was reassessed under the 1-CSRTT, prior to evaluating the acute effects of MDPV (0.032-0.32 mg/kg) or cocaine (0.1-1 mg/kg) on impulsivity. Level of impulsivity was not correlated with subsequent levels of either MDPV or cocaine self-administration, and level of drug self-administration was also not correlated with subsequent levels of impulsivity, although acute administration of MDPV and cocaine did increase premature responding. In failing to find direct relationships between either impulsivity and subsequent drug-taking behaviour, or drug-taking behaviour and subsequent assessments of impulsivity, these findings highlight the complexity inherent in the associations between impulsive behaviour and drug-taking behaviour in both animal models and humans.

Animal Models of the Behavioral Symptoms of Substance Use Disorders

To more effectively manage substance use disorders, it is imperative to understand the neural, genetic, and psychological underpinnings of addictive behavior. To contribute to this understanding, considerable efforts have been made to develop translational animal models that capture key behavioral characteristics of addiction on the basis of DSM5 criteria of substance use disorders. In this review, we summarize empirical evidence for the occurrence of addiction-like behavior in animals. These symptoms include escalation of drug use, neurocognitive deficits, resistance to extinction, exaggerated motivation for drugs, increased reinstatement of drug seeking after extinction, preference for drugs over nondrug rewards, and resistance to punishment. The occurrence of addiction-like behavior in laboratory animals has opened the opportunity to investigate the neural, genetic, and psychological background of key aspects of addiction, which may ultimately contribute to the prevention and treatment of substance use disorders.

Noninvasive Brain Stimulation Rescues Cocaine-Induced Prefrontal Hypoactivity and Restores Flexible Behavior

BACKGROUND

To obtain desirable goals, individuals must predict the outcome of specific choices, use that information to direct appropriate actions, and adjust behavior accordingly in changing environments (behavioral flexibility). Substance use disorders are marked by impairments in behavioral flexibility along with decreased prefrontal cortical function that limits the efficacy of treatment strategies. Restoring prefrontal hypoactivity, ideally in a noninvasive manner, is an intriguing target for improving flexible behavior and treatment outcomes.

METHODS

A behavioral flexibility task was used in Long-Evans male rats (n = 97) in conjunction with electrophysiology, optogenetics, and a novel rat model of transcranial alternating current stimulation (tACS) to examine the prelimbic cortex (PrL) to nucleus accumbens (NAc) core circuit in behavioral flexibility and determine whether tACS can restore cocaine-induced neural and cognitive dysfunction.

RESULTS

Optogenetic inactivation revealed that the PrL-NAc core circuit is necessary for the ability to learn strategies to flexibly shift behavior. Cocaine self-administration history caused aberrant PrL-NAc core neural encoding and deficits in flexibility. Optogenetics that selectively activated the PrL-NAc core pathway prior to learning rescued cocaine-induced cognitive flexibility deficits. Remarkably, tACS prior to learning the task reestablished adaptive signaling in the PrL-NAc circuit and restored flexible behavior in a relatively noninvasive and frequency-specific manner.

CONCLUSIONS

We establish a role of NAc core-projecting PrL neurons in behavioral flexibility and provide a novel noninvasive brain stimulation method in rats to rescue cocaine-induced frontal hypofunction and restore flexible behavior, supporting a role of tACS as a therapeutic to treat cognitive deficits in substance use disorders.

Effects of vapourized THC and voluntary alcohol drinking during adolescence on cognition, reward, and anxiety-like behaviours in rats

Cannabis and alcohol co-use is prevalent in adolescence, but the long-term behavioural effects of this co-use remain largely unexplored. The aim of this study is to investigate the effects of adolescent alcohol and Δ⁹-tetrahydracannabinol (THC) vapour co-exposure on cognitive- and reward-related behaviours. Male Sprague-Dawley rats received vapourized THC (10 mg vapourized THC/four adolescent rats) or vehicle every other day (from post-natal day (PND) 28-42) and had continuous voluntary access to ethanol (10% volume/volume) in adolescence. Alcohol intake was measured during the exposure period to assess the acute effects of THC on alcohol consumption. In adulthood (PND 56+), rats underwent behavioural testing. Adolescent rats showed higher alcohol preference, assessed using the two-bottle choice test, on days on which they were not exposed to THC vapour. In adulthood, rats that drank alcohol as adolescents exhibited short-term memory deficits and showed decreased alcohol preference; on the other hand, rats exposed to THC vapour showed learning impairments in the delay-discounting task. Vapourized THC, alcohol or their combination had no effect on anxiety-like behaviours in adulthood. Our results show that although adolescent THC exposure acutely affects alcohol drinking, adolescent alcohol and cannabis co-use may not produce long-term additive effects.

Effects of a high-fat diet on impulsive choice in rats

INTRODUCTION

Obesity and binge eating disorder are associated with high levels of impulsivity, but the causal role of eating and palatable food in these associations is unclear. Studies in rodents show that a high-fat diet can increase one aspect of impulsivity (impulsive action); it is less clear, however, whether a dissociable aspect of impulsivity (impulsive choice) is similarly affected. Hence, the aim of this study was to ascertain whether chronic exposure to a high-fat diet would alter impulsive choice.

METHODS

Male rats were maintained on either a high-fat or control chow diet for two weeks ad libitum. They then underwent equi-caloric food restriction for the duration of the experiment, with each group maintained on their respective diet. To measure impulsive choice, rats were trained on a delay discounting task (DDT) in which they made discrete choices between a lever that delivered a small food reward immediately and a lever that delivered a large food reward accompanied by systematically increasing delays. Upon reaching stable performance on the DDT, rats were given acute systemic injections of amphetamine prior to testing in the DDT to determine whether increased monoamine transmission affected impulsive choice differently in the two diet groups. Lastly, subjects were tested on a progressive ratio schedule of reinforcement to assess motivation for a sucrose reward.

RESULTS

There was no significant effect of the high-fat diet on impulsive choice. Further, amphetamine decreased choice of the large, delayed reward (increased impulsive choice) to the same extent in both groups. Exposure to the high-fat diet did, however, increase motivation to obtain a sucrose reward.

CONCLUSIONS

These experiments reveal that, under conditions that do not promote weight gain, a chronic high-fat diet does not affect impulsive choice in a delay discounting task. The data are surprising in light of findings showing that this same diet alters impulsive action, and highlight the necessity of further research to elucidate relationships between palatable food consumption and impulsivity.

Delay and probability discounting in cocaine use disorder: Comprehensive examination of money, cocaine, and health outcomes using gains and losses at multiple magnitudes

Understanding factors associated with cocaine use disorder is important given its public health impact. One factor is delay discounting (devaluation of future consequences). Cocaine users have shown greater delay discounting of money rewards than non-cocaine users. But underexamined are factors known to affect discounting, such as the sign (reward vs. loss), magnitude (e.g., $10 vs. $1,000), and commodity (e.g., money vs. health) of the consequence. Also underexamined is probability discounting (devaluation of uncertain consequences). We conducted a comprehensive group-comparison study of discounting processes by comparing sign, magnitude, and commodity effects between demographically matched cocaine users (n = 23) and never users (n = 24) for delay discounting and sign and magnitude effects for probability discounting. Participants completed delay and probability discounting tasks spanning rewards and losses; money, cocaine, and health outcomes; and magnitudes of $10, $100, and $1,000. Four primary findings emerged when controlling for other drug use. First, cocaine users pervasively discounted delayed consequences more than never users regardless of sign, magnitude, or commodity, with the possible exception of delay discounting of $1,000 health equivalences. Second, both groups discounted delayed rewards more than losses, with a similar trend for probability discounting. Third, magnitude effects in cocaine users for delayed and probabilistic outcomes were similar to those previously observed in never users and other-drug users. Fourth, cocaine users discounted cocaine-related outcomes more than money and health, with variable results comparing money and health. These data suggest that the behavioral processes of delay and probability discounting are qualitatively similar for cocaine users and never users. However, quantitatively, cocaine users generally showed greater delay discounting and similar probability discounting compared with never users. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Steep Discounting of Future Rewards as an Impulsivity Phenotype: A Concise Review

This chapter provides an overview over the behavioral economic index of impulsivity known as delay discounting. Specifically, delay discounting refers to an individual's preference for smaller immediate rewards over a larger delayed rewards. The more precipitously an individual discounts future rewards, the more impulsive they are considered to be. First, the chapter reviews the nature of delay discounting as a psychological process and juxtaposes it with nominally similar processes, including other facets of impulsivity. Second, the chapter reviews the links between delay discounting and numerous health behaviors, including addiction, attention deficit/hyperactivity disorder, and obesity. Third, the determinants of individual variation in delay discounting are discussed, including both genetic and environmental contributions. Finally, the chapter evaluates delay discounting as a potentially modifiable risk factor and the status of clinical interventions designed to reduce delay discounting to address deficits in self-control in a variety of maladaptive behaviors.

Adolescent-onset vs. adult-onset cocaine use: Impact on cognitive functioning in animal models and opportunities for translation

Animal models are poised to make key contributions to the study of cognitive deficits associated with chronic cocaine use in people. Advantages of animal models include use of a longitudinal experimental design that can control for drug use history and onset-age, sex, drug consumption, and abstinence duration. Twenty-two studies were reviewed (13 in adult male rats, 5 in adolescent vs. adult male rats, 3 in adult male monkeys, and 1 in adult female monkeys), and it was demonstrated repeatedly that male animals with adult-onset cocaine self-administration exposure had impairments in sustained attention, decision making, stimulus-reward learning, working memory, and cognitive flexibility, but not habit learning and spatial learning and memory. These findings have translational relevance because adult cocaine users exhibit a similar range of cognitive deficits. In the limited number of studies available, male rats self-administering cocaine during adolescence were less susceptible than adults to impairment in cognitive flexibility, stimulus-reward learning, and decision making, but were more susceptible than adults to impairment in working memory, a finding also reported in the few studies performed in early-onset cocaine users. These findings suggest that animal models can help fill an unmet need for investigating important but yet-to-be-fully-addressed research questions in people. Research priorities include further investigation of differences between adolescents and adults as well as between males and females following chronic cocaine self-administration. A comprehensive understanding of the broad range of cognitive consequences of chronic cocaine use and the role of developmental plasticity can be of value for improving neuropsychological recovery efforts.

Prior cocaine self-administration impairs attention signals in anterior cingulate cortex

Although maladaptive decision-making is a defining feature of drug abuse and addiction, we have yet to ascertain how cocaine self-administration disrupts neural signals in anterior cingulate cortex (ACC), a brain region thought to contribute to attentional control. To address this issue, rats were trained on a reward-guided decision-making task; reward value was manipulated by independently varying the size of or the delay to reward over several trial blocks. Subsequently, rats self-administered either a cocaine (experimental group) or sucrose (control) during 12 consecutive days, after which they underwent a 1-month withdrawal period. Upon completion of this period, rats performed the previously learned reward-guided decision-making task while we recorded from single neurons in ACC. We demonstrate that prior cocaine self-administration attenuates attention and attention-related ACC signals in an intake-dependent manner, and that changes in attention are decoupled from ACC firing. These effects likely contribute to the impaired decision-making-typified by chronic substance abuse and relapse-observed after drug use.

Distinct relationships between risky decision making and cocaine self-administration under short- and long-access conditions

Substance use is strongly associated with impaired decision making, with cocaine use particularly linked to elevated risky and impulsive choice. It is not clear, however, whether such maladaptive decision making is a consequence of cocaine use or instead precedes and predisposes individuals to cocaine use. The current study was designed to specifically address the latter possibility with respect to risky choice in both male and female rats. Rats were first trained in a "Risky Decision-making Task" (RDT), in which they made discrete choices between a small, "safe" food reward and a large, "risky" food reward accompanied by increasing probabilities of mild footshock punishment. After reaching stable performance, rats underwent jugular catheter surgery followed by either short-access cocaine self-administration sessions (2 h, 0.5 mg/kg/infusion) for 5 days or long-access cocaine self-administration sessions (6 h, 0.5 mg/kg/infusion) for 14 days. Under short-access conditions, there was no relationship between risk preference and changes in cocaine intake over time, but greater risk aversion in females predicted greater overall cocaine intake. Under long-access conditions, heightened risk taking predicted greater escalation of cocaine intake over the course of self-administration, supporting the notion that pre-existing risk-taking behavior predicts cocaine intake. Collectively, results from these experiments have implications for understanding and identifying pre-existing vulnerabilities to substance use, which may lead to strategies to prevent development of substance use disorders.

Using rodent models to understand interactions between gambling and substance use

Substance use is strongly associated with gambling, but the nature of this association can be difficult to determine. Rodents offer the opportunity to test causal models of these relationships through isolation of individual variables of interest. This review describes recent research in rodents showing: a) predisposing factors for both gambling-like behavior and substance use; b) exposure to drugs of abuse increasing gambling-like behavior; c) experience with gambling-like behavior increasing substance use; and d) links between gambling-like behavior and substance use in models of Parkinson's disease therapies. These findings reveal novel relationships between gambling and substance use, and highlight the utility of rodent models for future work in this area.

Ethanol pre-exposure does not increase delay discounting in P rats, but does impair the ability to dynamically adapt behavioral allocation to changing reinforcer contingencies

Increased subjective discounting of delayed rewards is associated with substance abuse, and individuals tend to discount their drug of choice at a greater rate compared to monetary rewards. While there is evidence indicating that increased delay discounting (DD) is a risk factor for substance abuse, some results suggest that exposure to drugs of abuse also increases DD, but effects are mixed. The current study examined whether ethanol pre-exposure increases DD and if an ethanol reinforcer would be discounted at a greater rate than sucrose. Alcohol preferring (P) rats were pre-exposed to either ethanol or sucrose using an intermittent access protocol (IAP) for 8 weeks. Then animals completed an operant fixed choice procedure where each pre-exposure group was split into either an ethanol or sucrose reinforcer group. Afterwards, animals completed an adjusting delay DD task using the same groups as the fixed choice task. Animals that received access to ethanol in the IAP showed increased delayed reward preference in a delay and session dependent manner. Specifically, ethanol pre-exposed animals took more sessions to decrease their preference for the delayed reward at longer delays. In the adjusting delay task, no differences in mean adjusting delays were seen, but ethanol pre-exposure impaired animals' ability to reach stability criteria. The observed results are not consistent with ethanol pre-exposure causing a change in DD. Rather they indicate ethanol pre-exposure impaired animals' ability to reallocate their behavior in response to a change in reinforcer contingencies. The current findings extend prior results showing alcohol naïve P rats exhibit both increased DD and decreased response inhibition (Beckwith and Czachowski 2014, 2016) by demonstrating that after alcohol exposure they exhibit a form of behavioral inflexibility. Hence, a "two-hit" genetic vulnerability/environmental acceleration of addictive behavior is supported.

Genomic basis of delayed reward discounting

Delayed reward discounting (DRD) is a behavioral economic measure of impulsivity, reflecting how rapidly a reward loses value based on its temporal distance. In humans, more impulsive DRD is associated with susceptibility to a number of psychiatric diseases (e.g., addiction, ADHD), health outcomes (e.g., obesity), and lifetime outcomes (e.g., educational attainment). Although the determinants of DRD are both genetic and environmental, this review focuses on its genetic basis. Both rodent studies using inbred strains and human twin studies indicate that DRD is moderately heritable, a conclusion that was further supported by a recent human genome-wide association study (GWAS) that used single nucleotide polymorphisms (SNP) to estimate heritability. The GWAS of DRD also identified genetic correlations with psychiatric diagnoses, health outcomes, and measures of cognitive performance. Future research priorities include rodent studies probing putative genetic mechanisms of DRD and human GWASs using larger samples and non-European cohorts. Continuing to characterize genomic influences on DRD has the potential to yield important biological insights with implications for a variety of medically and socially important outcomes.

Genetic influences on delayed reward discounting: A genome-wide prioritized subset approach

Delayed reward discounting (DRD) is a behavioral economic measure of impulsivity that has been consistently associated with addiction. It has also been identified as a promising addiction endophenotype, linking specific sources of genetic variation to individual risk. A challenge in the studies to date is that levels of DRD are often confounded with prior drug use, and previous studies have also had limited genomic scope. The current investigation sought to address these issues by studying DRD in healthy young adults with low levels of substance use (N = 986; 62% female, 100% European ancestry) and investigating genetic variation genome-wide. The genome-wide approach used a prioritized subset design, organizing the tests into theoretically and empirically informed categories and apportioning power accordingly. Three subsets were used: (a) a priori loci implicated by previous studies; (b) high-value addiction (HVA) markers from the recently developed SmokeScreen array; and (c) an atheoretical genome-wide scan. Among a priori loci, a nominally significant association was present between DRD and rs521674 in ADRA2A. No significant HVA loci were detected. One statistically significant genome-wide association was detected (rs13395777, p = 2.8 × 10-8), albeit in an intergenic region of unknown function. These findings are generally not supportive of the previous candidate gene studies and suggest that DRD has a complex genetic architecture that will require considerably larger samples to identify genetic associations more definitively. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Impulsive choice does not predict binge-like eating in rats

Binge eating disorder is an addiction-like disorder characterized by recurrent, excessive food consumption within discrete periods of time, and it has been linked to increased trait impulsivity. Within impulsivity components, while impulsive action was shown to predict binge-like and addictive-like eating, the role of impulsive choice is instead unknown. The goal of this study was to determine if impulsive choice predicted, or was altered by binge-like eating of a sugary, highly palatable diet. We utilized a modified adjusting delay task procedure in free-fed rats to assess impulsive choice behavior, that is. the tendency to respond for a larger, delayed reward over a lesser, immediate reward. We found that baseline impulsive choice was not a predictor of binge-like eating in 1-h sessions of palatable diet operant self-administration. Furthermore, binge-like eating of the same palatable diet had no effect on later impulsive choice behavior. Thus, our data suggest that, unlike impulsive action, impulsive choice behavior does not predict binge-like eating in rats.

The impact of drugs of abuse on executive function: characterizing long-term changes in neural correlates following chronic drug exposure and withdrawal in rats

Addiction has long been characterized by diminished executive function, control, and impulsivity management. In particular, these deficits often manifest themselves as impairments in reversal learning, delay discounting, and response inhibition. Understanding the neurobiological substrates of these behavioral deficits is of paramount importance to our understanding of addiction. Within the cycle of addiction, periods during and after withdrawal represent a particularly difficult point of intervention in that the negative physical symptoms associated with drug removal and drug craving increase the likelihood that the patient will relapse and return to drug use in order to abate these symptoms. Moreover, it is often during this time that drug induced deficits in executive function hinder the ability of the patient to refrain from drug use. Thus, it is necessary to understand the physiological and behavioral changes associated with withdrawal and drug craving-largely manifesting as deficits in executive control-to develop more effective treatment strategies. In this review, we address the long-term impact that drugs of abuse have on the behavioral and neural correlates that give rise to executive control as measured by reversal learning, delay discounting, and stop-signal tasks, focusing particularly on our work using rats as a model system.

Functional Connectivity of Chronic Cocaine Use Reveals Progressive Neuroadaptations in Neocortical, Striatal, and Limbic Networks

Brain imaging studies indicate that chronic cocaine users display altered functional connectivity between prefrontal cortical, thalamic, striatal, and limbic regions; however, the use of cross-sectional designs in these studies precludes measuring baseline brain activity prior to cocaine use. Animal studies can circumvent this limitation by comparing functional connectivity between baseline and various time points after chronic cocaine use. In the present study, adult male Long–Evans rats were trained to self-administer cocaine intravenously for 6 h sessions daily over 14 consecutive days. Two additional groups serving as controls underwent sucrose self-administration or exposure to the test chambers alone. Functional magnetic resonance imaging was conducted before self-administration and after 1 and 14 d of abstinence (1d and 14d Abs). After 1d Abs from cocaine, there were increased clustering coefficients in brain areas involved in reward seeking, learning, memory, and autonomic and affective processing, including amygdala, hypothalamus, striatum, hippocampus, and thalamus. Similar changes in clustering coefficient after 1d Abs from sucrose were evident in predominantly thalamic brain regions. Notably, there were no changes in strength of functional connectivity at 1 or 14 d after either cocaine or sucrose self-administration. The results suggest that cocaine and sucrose can change the arrangement of functional connectivity of brain regions involved in cognition and emotion, but that these changes dissipate across the early stages of abstinence. The study also emphasizes the importance of including baseline measures in longitudinal functional neuroimaging designs seeking to assess functional connectivity in the context of substance use.

An improved within-session self-adjusting delay discounting procedure for the study of choice impulsivity in rats

RATIONALE

Delay-discounting procedures involving choice between small immediate rewards and large delayed rewards are used to study impulsivity in rodents. Improving existing procedures may provide new insights into the neurobiological mechanisms underlying decision-making processes.

OBJECTIVES

To develop a novel delay-discounting procedure that adjusts the delay value within individual sessions based on the rat's most recent choices.

METHODS

Compared to previously developed procedure, we required a more consistent demonstration of preference, five consecutive choices of the large or small reward, a criterion that is more likely to reflect deliberate choice by the animal, as opposed to two consecutive choices. In addition, delays were changed in steps of 5 s (rather than 1 s), because 5-s increments should be more easily discriminated and may produce a more distinct effect on choice. We characterized the procedure behaviorally by manipulating the duration of the session and the consecutive choice criterion, and we investigated the stability of the behavior upon interruption of training. We also characterized the procedure pharmacologically by investigating the effects of dopaminergic compounds.

RESULTS

Our procedures allowed obtaining two complementary measures of delay discounting: (1) the percentage of choices of the delay option and (2) the mean adjusting delay, an index of the delay that animals choose more frequently. We found that our procedure rapidly establishes a baseline of choice behavior that remains stable over time and is highly sensitive to manipulations of the dopaminergic system.

CONCLUSIONS

This procedure may provide a useful tool for investigating the neurobiology of inter-temporal choice and decision-making.

Dissecting drug effects in preclinical models of impulsive choice: emphasis on glutamatergic compounds

RATIONALE

Impulsive choice is often measured with delay discounting paradigms. Because there are multiple discounting procedures, as well as different statistical analyses that can be applied to data generated from these paradigms, there are some inconsistencies in the literature regarding drug effects on impulsive choice.

OBJECTIVES

The goal of the current paper is to review the methodological and analytic approaches used to measure discounting and to discuss how these differences can account for differential drug effects observed across studies.

RESULTS

Because some procedures/analyses use a single data point as the dependent variable, changes in this value following pharmacological treatment may be interpreted as alterations in sensitivity to delayed reinforcement, but when other procedures/analyses are used, no changes in behavior are observed. Even when multiple data points are included, some studies show that the statistical analysis (e.g., ANOVA on raw proportion of responses vs. using hyperbolic/exponential functions) can lead to different interpretations. Finally, procedural differences (e.g., delay presentation order, signaling the delay to reinforcement, etc.) in the same discounting paradigm can alter how drugs affect sensitivity to delayed reinforcement.

CONCLUSIONS

Future studies should utilize paradigms that allow one to observe alterations in responding at each delay (e.g., concurrent-chains schedules). Concerning statistical analyses, using parameter estimates derived from nonlinear functions or incorporating the generalized matching law can allow one to determine if drugs affect sensitivity to delayed reinforcement or impair discrimination of the large and small magnitude reinforcers. Using these approaches can help further our understanding of the neurochemical underpinnings of delay discounting.

Low distress tolerance predicts heightened drug seeking and taking after extended abstinence from cocaine self-administration

Distress tolerance (DT), defined as the ability to persist in goal-directed behavior while experiencing psychological distress, is associated with greater frequency of substance use and poor treatment outcomes. To examine a potential causal role substance use may play in DT, we developed a rodent model of DT in which rats had to press a lever within a continuously decreasing time window for reward while receiving negative feedback on failure trials. DT was defined as the time rats continued to seek reward before quitting the task. We assessed the relationship of DT with cocaine seeking/taking by measuring DT before cocaine self-administration (SA), and after 1 week and 1 month of drug abstinence. We found that DT prior to cocaine SA did not predict cocaine seeking/taking, yet DT measured after 1 month abstinence significantly predicted subsequent high levels of early session cocaine taking. Additionally, high DT measured after abstinence protected against high cocaine seeking, but this protective effect was blocked in rats with high impulsivity. Finally, while a decrease in 1 month-abstinent DT was observed following SA across treatment conditions, among cocaine-exposed rats, greater cocaine SA correlated with a steeper decrease in DT. These results show that low DT after drug abstinence is associated with heightened levels of cocaine seeking and taking behavior and that impulsivity influences this effect. Collectively, these results support the validity of our rodent DT model while extending the human literature and set the foundation for future animal studies designed to determine neural mechanisms underlying DT.

Sex differences in animal models of decision making

The ability to weigh the costs and benefits of various options to make an adaptive decision is critical to an organism's survival and wellbeing. Many psychiatric diseases are characterized by maladaptive decision making, indicating a need for better understanding of the mechanisms underlying this process and the ways in which it is altered under pathological conditions. Great strides have been made in uncovering these mechanisms, but the majority of what is known comes from studies conducted solely in male subjects. In recent years, decision-making research has begun to include female subjects to determine whether sex differences exist and to identify the mechanisms that contribute to such differences. This Mini-Review begins by describing studies that have examined sex differences in animal (largely rodent) models of decision making. Possible explanations, both theoretical and biological, for such differences in decision making are then considered. The Mini-Review concludes with a discussion of the implications of sex differences in decision making for understanding psychiatric conditions. © 2016 Wiley Periodicals, Inc.

Methamphetamine-induced impulsivity during chronic methamphetamine treatment in rats: Effects of the TAAR 1 agonist RO5263397

Impulsivity is an important personality trait associated with several clinical syndromes including drug abuse. While repeated drug exposure is known to increase certain behavioral responses, such as locomotion, to subsequent drug exposure, few studies have examined whether such sensitization develops for impulsive behavior. In the current study we tested the effects of methamphetamine acutely, during the course of, and upon discontinuation of chronic methamphetamine treatment on impulsive behavior in two models, the 5-choice serial reaction time task (5-CSRTT) and the delay-discounting task which measure impulsive action and impulsive choice, respectively. We also examined whether the trace amine-associated receptor 1 (TAAR1) agonist RO5263397 attenuated methamphetamine-induced effects in parallel tests. Acute methamphetamine dose-dependently increased premature responses in the 5-CSRTT and shifted the delay function upward in delay discounting. Up to 40 days of methamphetamine treatment did not significantly alter the dose-effect curve of methamphetamine-induced premature responses, but produced a significant effect in the delay-discounting task. RO5263397 attenuated acute methamphetamine-induced premature responses, but this effect became non-significant over the course of chronic treatment. RO5263397 did not significantly alter the delay-discounting performance. Discontinuation of methamphetamine treatment increased premature responses, which was attenuated by RO5263397, but did not significantly alter the delay discounting function. These results suggest that acute discontinuation from prolonged methamphetamine treatment increases impulsivity, which can be reduced by a TAAR1 agonist.

Risk-preferring rats make worse decisions and show increased incubation of craving after cocaine self-administration

Maladaptive decision-making may play an integral role in the development and maintenance of an addiction. Substance-dependent individuals make riskier choices on the Iowa Gambling Task, and these deficits persist during withdrawal and are predictive of relapse. However, it is unclear from clinical studies whether this cognitive impairment is a cause or consequence of drug use. We trained male Long-Evans rats on the rat Gambling Task, a rodent analogue of the Iowa Gambling Task, to determine how choice preference influenced, and was influenced by, cocaine self-administration, withdrawal and incubation of craving. Rats that exhibited a preference for the risky, disadvantageous options at baseline were uniquely and adversely affected by cocaine self-administration. Risky choice was exacerbated in these rats when decision-making was assessed during the same diurnal period as cocaine self-administration, whereas the choice pattern of optimal decision-makers was unaffected. This decision-making deficit was maintained during 30 days of withdrawal and correlated with greater cue-induced incubation of craving. Risk-preferring rats also made more drug-seeking responses during cocaine self-administration. These data demonstrate that poor decision-making prior to contact with addictive drugs is associated with a pro-addictive behavioural phenotype, characterized by further increased risky choice and heightened responding for drug both during cocaine self-administration and withdrawal. Such findings indicate that the elevated risky decision-making observed in substance-dependent populations is not merely circumstantial, but makes an important contribution to addiction vulnerability and severity that can now be effectively modelled in laboratory rats.

Impulsive Rats Exhibit Blunted Dopamine Release Dynamics during a Delay Discounting Task Independent of Cocaine History

The inability to wait for a large, delayed reward when faced with a small, immediate one, known as delay discounting, has been implicated in a number of disorders including substance abuse. Individual differences in impulsivity on the delay discounting task are reflected in differences in neural function, including in the nucleus accumbens (NAc) core. We examined the role of a history of cocaine self-administration, as well as individual differences in impulsivity, on rapid dopamine (DA) release dynamics in the NAc core. Rats with a history of cocaine or water/saline self-administration were tested on delay discounting while being simultaneously assayed for rapid DA release using electrochemical methods. In controls, we found that cue DA release was modulated by reward delay and magnitude, consistent with prior reports. A history of cocaine had no effect on either delay discounting or DA release dynamics. Nonetheless, independent of drug history, individual differences in impulsivity were related to DA release in the NAc core. First, high impulsive animals exhibited dampened cue DA release during the delay discounting task. Second, reward delay and magnitude in high impulsive animals failed to robustly modulate changes in cue DA release. Importantly, these two DAergic mechanisms were uncorrelated with each other and, together, accounted for a high degree of variance in impulsive behavior. Collectively, these findings demonstrate two distinct mechanisms by which rapid DA signaling may influence impulsivity, and illustrate the importance of NAc core DA release dynamics in impulsive behavior.

Effects of nucleus accumbens amphetamine administration on performance in a delay discounting task

Chronic administration of cocaine can cause pronounced and enduring cognitive alterations such as increases in impulsive choice. Chronic cocaine can also result in enhanced dopamine (DA) release in the nucleus accumbens (NAc) in response to reward-related cues. It is possible that this enhanced DA release in the NAc is a mechanism by which cocaine increases impulsive choice. To date, however, the specific role of DA in the NAc in impulsive choice is unclear. To begin to address this, rats received acute microinjections of the indirect DA agonist amphetamine directly into the NAc prior to testing in a delay discounting task in which rats chose between a small, immediate and a large, delayed food reward. When delays to the large reward increased within test sessions, amphetamine increased choice of the large reward. When delays decreased within test sessions, however, amphetamine decreased choice of the large reward. These findings suggest that, rather than specifically mediating impulsive choice, DA neurotransmission in the NAc is necessary for flexible adaptation of choice strategies in the presence of shifting reward contingencies. These results further indicate that enhancements in NAc DA release likely do not account for lasting increases in impulsive choice caused by chronic cocaine.

Sex differences in the reduction of impulsive choice (delay discounting) for cocaine in rats with atomoxetine and progesterone

RATIONALE

Impulsive choice, or an inability to delay immediate gratification, has been strongly linked to the development and persistence of drug abuse. Indeed, delaying drug use itself may underlie drug addiction and relapse. Thus, employing treatments that are efficacious in reducing impulsive choice (atomoxetine; ATO) or drug-seeking behavior (progesterone; PRO) may be an effective means of treating drug addiction.

OBJECTIVE

The current study assessed sex differences in the effects of PRO, ATO, and their combination in a delay discounting paradigm for cocaine and for sucrose pellets.

METHOD

Male and female rats chose between a small-immediate or a large-delayed (0, 7.5, 15, 30, 60 s) outcome in an impulsive choice procedure for sucrose pellets (1 vs. 3 pellets) or for iv cocaine infusions (0.3 vs. 0.9 mg/kg). Following baseline assessment of impulsive choice, rats received daily treatment of vehicle (VEH), PRO (0.5 mg/kg), ATO (1.5 mg/kg), or a combination (PRO + ATO) until a second assessment of impulsive choice was determined.

RESULTS

Compared to the VEH group, females were less impulsive for cocaine following PRO or the PRO + ATO combined treatment, whereas males were less impulsive for cocaine following ATO. No treatment effects were observed on impulsive choice for sucrose pellets.

CONCLUSIONS

The present results indicate that impulsive choice for cocaine is reduced by PRO in females and by ATO in males. These findings suggest both treatments may be an effective intervention in treating cocaine abuse, but that their effectiveness differs by sex.

Interrelationships among parental family history of substance misuse, delay discounting, and personal substance use

RATIONALE

Despite consistent evidence of the familiality of substance misuse, the mechanisms by which family history (FH) increases the risk of addiction are not well understood. One behavioral trait that may mediate the risk for substance use and addiction is delay discounting (DD), which characterizes an individual's preferences for smaller immediate rewards compared to larger future rewards.

OBJECTIVES

The aim of this study is to examine the interrelationships among FH, DD, and diverse aspects of personal substance use, and to test DD as a mediator of the relationship between FH and personal substance use.

METHODS

The study used crowdsourcing to recruit a community sample of adults (N = 732). Family history was assessed using a brief assessment of perceived parental substance use problems, personal substance use was assessed using the Alcohol Use Disorders Identification Test and a measure of frequency of use, and delay discounting was assessed using a latent index of discounting preferences across six reward magnitudes.

RESULTS

Steeper discounting was significantly associated with personal alcohol, tobacco, and marijuana use, and level of substance experimentation. Steeper DD was also associated with a denser parental FH of alcohol, tobacco, and overall substance misuse. Parental FH density was significantly associated with several aspects of personal substance use, and these relationships were partially mediated by DD.

CONCLUSIONS

The current study suggests that impulsivity, as measured by DD, is one proximal mechanism by which parental FH increases substance use later in life. The causal role of DD in this relationship will need to be established in future longitudinal studies.

Discrepant effects of acute cocaine on impulsive choice (delay discounting) in female rats during an increasing- and adjusting-delay procedure

RATIONALE

The relationship between impulsive choice and cocaine use in humans has been well established, although the causal role between these variables is complex. To disentangle this relationship, studies using rats have focused on how acute or chronic cocaine alters impulsive choice. A predominance of studies has focused on chronic cocaine regimens, but few have assessed acute cocaine's effects on impulsive choice.

OBJECTIVE

The current study assessed if acute cocaine administrations alter delay discounting of rats in two common impulsive choice procedures.

METHOD

Baseline delay discounting rates were determined in female rats using both an increasing- and adjusting-delay procedure. Once stable, a range of acute cocaine injections (2, 5, and 15 mg/kg i.p.) was administered prior to both procedures.

RESULTS

Baseline delay discounting rates were positively correlated between the increasing- and adjusting-delay procedures. Acute administrations of cocaine produced a dose-dependent decrease in preference for the large alternative in the increasing-delay procedure but had no effect in the adjusting-delay procedure.

CONCLUSIONS

The concordance of delay discounting rates across the two choice procedures suggests that both quantify the same underlying components of impulsive choice. However, manipulations that disrupt large alternative preference may not be readily detected under the adjusting-delay procedure unless control conditions are employed.

Recent Insights into the Neurobiology of Impulsivity

Impulsivity is associated with various psychopathologies, and elevated impulsivity is typically disadvantageous. This manuscript reviews recent investigations into the neurobiology of impulsivity using human imaging techniques and animal models. Both human imaging and preclinical pharmacological manipulations have yielded important insights into the neurobiological underpinnings of impulsivity. A more thorough understanding of the complex neurobiology underlying aspects of impulsivity may provide insight into new treatment options that target elevated impulsivity and psychopathologies such as addictions.

Adolescent risk taking, cocaine self-administration, and striatal dopamine signaling

Poor decision making and elevated risk taking, particularly during adolescence, have been strongly linked to drug use; however the causal relationships among these factors are not well understood. To address these relationships, a rat model (the Risky Decision-making Task; RDT) was used to determine whether individual differences in risk taking during adolescence predict later propensity for cocaine self-administration and/or whether cocaine self-administration causes alterations in risk taking. In addition, the RDT was used to determine how risk taking is modulated by dopamine signaling, particularly in the striatum. Results from these experiments indicated that greater risk taking during adolescence predicted greater intake of cocaine during acquisition of self-administration in adulthood, and that adult cocaine self-administration in turn caused elevated risk taking that was present following 6 weeks of abstinence. Greater adolescent risk taking was associated with lower striatal D2 receptor mRNA expression, and pharmacological activation of D2/3 receptors in the ventral, but not dorsal, striatum induced a decrease in risk taking. These findings indicate that the relationship between elevated risk taking and cocaine self-administration is bi-directional, and that low striatal D2 receptor expression may represent a predisposing factor for both maladaptive decision making and cocaine use. Furthermore, these findings suggest that striatal D2 receptors represent a therapeutic target for attenuating maladaptive decision making when choices include risk of adverse consequences.