Cocaine exposure causes long-term increases in impulsive choice

Involvement of dopamine D3 receptor in impulsive choice decision-making in male rats

Impulsive decision-making has been linked to impulse control disorders and substance use disorders. However, the neural mechanisms underlying impulsive choice are not fully understood. While previous PET imaging and autoradiography studies have shown involvement of dopamine and D2/3 receptors in impulsive behavior, the roles of distinct D1, D2, and D3 receptors in impulsive decision-making remain unclear. In this study, we used a food reward delay-discounting task (DDT) to identify low- and high-impulsive rats, in which low-impulsive rats exhibited preference for large delayed reward over small immediate rewards, while high-impulsive rats showed the opposite preference. We then examined D1, D2, and D3 receptor gene expression using RNAscope in situ hybridization assays. We found that high-impulsive male rats exhibited lower levels of D2 and D3, and particularly D3, receptor expression in the nucleus accumbens (NAc), with no significant changes in the insular, prelimbic, and infralimbic cortices. Based on these findings, we further explored the role of the D3 receptor in impulsive decision-making. Systemic administration of a selective D3 receptor agonist (FOB02-04) significantly reduced impulsive choices in high-impulsive rats but had no effects in low-impulsive rats. Conversely, a selective D3 receptor antagonist (VK4-116) produced increased both impulsive and omission choices in both groups of rats. These findings suggest that impulsive decision-making is associated with a reduction in D3 receptor expression in the NAc. Selective D3 receptor agonists, but not antagonists, may hold therapeutic potentials for mitigating impulsivity in high-impulsive subjects.

Cocaine disrupts action flexibility via glucocorticoid receptors

Many addictive drugs increase stress hormone levels. They also alter the propensity of organisms to prospectively select actions based on long-term consequences. We hypothesized that cocaine causes inflexible action by increasing circulating stress hormone levels, activating the glucocorticoid receptor (GR). We trained mice to generate two nose pokes for food and then required them to update action-consequence associations when one response was no longer reinforced. Cocaine delivered in adolescence or adulthood impaired the capacity of mice to update action strategies, and inhibiting CORT synthesis rescued action flexibility. Next, we reduced Nr3c1, encoding GR, in the orbitofrontal cortex (OFC), a region of the brain responsible for interlacing new information into established routines. Nr3c1 silencing preserved action flexibility and dendritic spine abundance on excitatory neurons, despite cocaine. Spines are often considered substrates for learning and memory, leading to the discovery that cocaine degrades the representation of new action memories, obstructing action flexibility.

Behavioral mechanisms of oxycodone's effects in female and male rats: Reinforcement delay and impulsive choice

μ-Opioid agonists (e.g., morphine) typically increase impulsive choice, which has been interpreted as an opioid-induced increase in sensitivity to reinforcement delay. Relatively little research has been done with opioids other than morphine (e.g., oxycodone), or on sex differences in opioid effects, on impulsive choice. The present study investigated the effects of acute (0.1-1.0 mg/kg) and chronic (1.0 mg/kg twice/day) administration of oxycodone on choice controlled by reinforcement delay, a primary mechanism implicated in impulsive choice, in female and male rats. Rats responded under a concurrent-chains procedure designed to quantify the effects of reinforcement delay on choice within each session. For both sexes, choice was sensitive to delay under this procedure. Sensitivity to delay under baseline was slightly higher for males than females, suggesting more impulsive choice with males. When given acutely, intermediate and higher doses of oxycodone decreased sensitivity to delay; this effect was larger and more reliable in males than females. When given chronically, sex differences were also observed: tolerance developed to the sensitivity-decreasing effects in females, whereas sensitization developed in males. These data suggest that reinforcement delay may play an important role in sex differences in impulsive choice, as well as in the effects of acute and chronic administration of opioids in impulsive choice. However, drug-induced changes in impulsive choice could be related to at least two potential behavioral mechanisms: reinforcement delay and/or reinforcement magnitude. Effects of oxycodone on sensitivity to reinforcement magnitude remain to be fully characterized. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Divergent risky decision-making and impulsivity behaviors in Lewis rat substrains with low genetic difference

Substance use disorder (SUD) is associated with a cluster of cognitive disturbances that engender vulnerability to ongoing drug seeking and relapse. Two of these endophenotypes-risky decision-making and impulsivity-are amplified in individuals with SUD and are augmented by repeated exposure to illicit drugs. Identifying genetic factors underlying variability in these behavioral patterns is critical for early identification, prevention, and treatment of SUD-vulnerable individuals. Here, we compared risky decision-making and different facets of impulsivity between two fully inbred substrains of Lewis rats-LEW/NCrl and LEW/NHsd. We performed whole genome sequencing of both substrains to identify almost all relevant variants. We observed substantial differences in risky decision-making and impulsive behaviors. Relative to LEW/NHsd, the LEW/NCrl substrain accepts higher risk options in a decision-making task and higher rates of premature responses in the differential reinforcement of low rates of responding task. These phenotypic differences were more pronounced in females than males. We defined a total of ∼9,000 polymorphisms between these substrains at 40× whole genome short-read coverage. Roughly half of variants are located within a single 1.5 Mb region of Chromosome 8, but none impact protein-coding regions. In contrast, other variants are widely distributed, and of these, 38 are predicted to cause protein-coding variants. In conclusion, Lewis rat substrains differ significantly in risk-taking and impulsivity and only a small number of easily mapped variants are likely to be causal. Sequencing combined with a reduced complexity cross should enable identification of one or more variants underlying multiple complex addiction-relevant behaviors. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

The Effects of the Inhalant Toluene on Cognitive Function and Behavioral Flexibility: A Review of Recent Findings

Substance use disorder (SUD) is characterized, in part, by lack of control over drug seeking and taking. The prefrontal cortex (PFC) is highly involved in control of behavior and deficits in PFC structure and function have been demonstrated in clinical and preclinical studies of SUD. Of the various classes of drugs associated with the development of SUD, inhalants are among the least studied despite their widespread use among adolescents and children. In this work, we review what is currently known regarding the sites and mechanisms of action of inhalants with a focus on the volatile solvent toluene that is contained in a wide variety of legal and easily obtained products. We then describe how inhalants including toluene affect various behaviors with an emphasis on those associated with PFC function and how chronic use of inhalants alters brain structure and neuronal signaling. Findings from these studies highlight advances made in recent years that have expanded our understanding of the effects of inhalants on brain structure and reinforce the need for continued work in this field.

Increased Risky Choice and Reduced CHRNB2 Expression in Adult Male Rats Exposed to Nicotine Vapor

While the cognitive enhancing effects of nicotine use have been well documented, it has also been shown to impair decision making. The goal of this study was to determine if exposure to nicotine vapor increases risky decision making. The study also aims to investigate possible long-term effects of nicotine vapor exposure on the expression of genes coding for cholinergic and dopaminergic receptors in brain. Thirty-two adult male Sprague Dawley rats were exposed to 24 mg/mL nicotine vapor or vehicle control, immediately followed by testing in the probability discounting task for 10 consecutive days. Fifty-four days after the 10-day vapor exposure, animals were sacrificed and expression of genes coding for the α4 and β2 cholinergic receptor subunits, and dopamine D1 and D2 receptors, were analyzed using RT-PCR. Exposure to nicotine vapor caused an immediate and transient increase in risky choice. Analyses of gene expression identified significant reductions in CHRNB2 and DRD1 in the nucleus accumbens core and CHRNB2 and DRD2 in the medial prefrontal cortex of rats previously exposed to nicotine vapor, relative to vehicle controls. Results provide data on the negative cognitive effects of nicotine vapor exposure and identify cholinergic and dopaminergic mechanisms that may affected with repeated use.

Impulsivity in cocaine users compared to matched controls: Effects of sex and preferred route of cocaine use

BACKGROUND

Impulsivity has been identified as playing a role in cocaine use. The purpose of this study was to explore self-report measures of impulsivity in large groups of male and female cocaine users and matched controls and to determine if differences in impulsivity measures within a group of cocaine users related to self-reported money spent on cocaine and route of cocaine use.

METHODS

Eight self-report impulsivity measures yielding 34 subscales were obtained in 230 cocaine users (180 M, 50 F) and a matched group of 119 healthy controls (89 M, 30 F). Correlational analysis of the questionnaires revealed 2 factors: Impulsive Action (Factor 1) consisting of many traditional impulsivity measures and Thrill-seeking (Factor 2) consisting of delay discounting, sensation and thrill seeking.

RESULTS

Sex influenced within group comparisons. Impulsive Action scores did not vary as a function of sex within either group. But, male controls and male cocaine users had greater Thrill-seeking scores than females within the same group. Sex also influenced between group comparisons. Male cocaine users had greater Impulsive Action scores while female cocaine users had greater Thrill-seeking scores than their sex-matched controls. Among cocaine users, individuals who preferred insufflating ("snorting") cocaine had greater Thrill-seeking scores and lower Impulsive Action scores than individuals who preferred smoking cocaine. Individuals who insufflate cocaine also spent less money on cocaine.

CONCLUSIONS

Greater Impulsive Action scores in males and Thrill-seeking scores in females were associated with cocaine use relative to controls.

Exposure to nicotine vapor produced by an electronic nicotine delivery system causes short-term increases in impulsive choice in adult male rats

INTRODUCTION

Traditional cigarette use influences cost-benefit decision making by promoting impulsive choice. However, the impact of exposure via electronic nicotine delivery systems on impulsive choice remains unclear. Hence, the present study examined the short- and long-term effects of nicotine vapor on impulsive choice.

METHODS

Twenty-four adult male rats were trained in the delay discounting task, to choose between small, immediate food rewards or large, delayed food rewards. After 24 days of training in the task, rats were exposed to vapor containing either 0, 12, or 24 mg/mL of nicotine, for ten days. To validate inhalation of nicotine vapor, serum cotinine levels were analyzed on exposure days 1, 5, and 10 using enzyme-linked immunosorbent assay (ELISA). Following vapor exposure, rats were retrained in the discounting task until rats displayed stable responding, and the effects of nicotine vapor on choice preference were assessed.

RESULTS

Rats exposed to 12 and 24 mg/mL nicotine vapor displayed higher serum cotinine levels than control rats exposed to 0 mg/mL vapor. There were no differences in impulsive choice between any vapor exposure groups when tested 15 days after exposure, across 6 days of stable responding, suggesting that nicotine vapor does not have long lasting effects on impulsive choice. Interestingly, a subsequent nicotine vapor challenge revealed short-term increases in impulsive choice immediately following a single exposure to 24 mg/mL nicotine vapor, relative to choice preference immediately following exposure to 0 mg/mL vapor.

CONCLUSIONS

These results suggest that exposure to nicotine vapor causes immediate, short-term increases in impulsive choice.

IMPLICATIONS

E-cigarette use is increasing at an alarming rate, particularly among adolescents and young adults. This is concerning given the lack of research into the effects of nicotine vapor exposure on the brain and behavior. The present study describes a viable rodent model of human e-cigarette use and suggest that exposure to nicotine vapor produces short-term increases in impulsive choice.

Reward/Punishment-Based Decision Making in Rodents

Deficits in decision making are at the heart of many psychiatric diseases, such as substance abuse disorders and attention deficit hyperactivity disorder. Consequently, rodent models of decision making are germane to understanding the neural mechanisms underlying adaptive choice behavior and how such mechanisms can become compromised in pathological conditions. A critical factor that must be integrated with reward value to ensure optimal decision making is the occurrence of consequences, which can differ based on probability (risk of punishment) and temporal contiguity (delayed punishment). This article will focus on two models of decision making that involve explicit punishment, both of which recapitulate different aspects of consequences during human decision making. We will discuss each behavioral protocol, the parameters to consider when designing an experiment, and finally how such animal models can be utilized in studies of psychiatric disease. © 2020 Wiley Periodicals LLC. Basic Protocol 1: Behavioral training Support Protocol: Equipment testing Alternate Protocol: Reward discrimination Basic Protocol 2: Risky decision-making task (RDT) Basic Protocol 3: Delayed punishment decision-making task (DPDT).

Prior Cocaine Exposure Increases Firing to Immediate Reward While Attenuating Cue and Context Signals Related to Reward Value in the Insula

The insula contributes to behavioral control and is disrupted by substance abuse, yet we know little about the neural signals underlying these functions or how they are disrupted after chronic drug self-administration. Here, male and female rats self-administered either cocaine (experimental group) or sucrose (control) for 12 consecutive days. After a 1 month withdrawal period, we recorded from insula while rats performed a previously learned reward-guided decision-making task. Cocaine-exposed rats were more sensitive to value manipulations and were faster to respond. These behavioral changes were accompanied by elevated counts of neurons in the insula that increased firing to reward. These neurons also fired more strongly at the start of long-delay trials, when a more immediate reward would be expected, and fired less strongly in anticipation of the actual delivery of delayed rewards. Although reward-related firing to immediate reward was enhanced after cocaine self-administration, reward-predicting cue and context signals were attenuated. In addition to revealing novel firing patterns unique to insula, our data suggest changes in such neural activity likely contribute to impaired decision making observed after drug use.SIGNIFICANCE STATEMENT The insula plays a clear role in drug addiction and drug-induced impairments of decision making, yet there is little understanding of its underlying neural signals. We found that chronic cocaine self-administration reduces cue and context encoding in insula while enhancing signals related to immediate reward. These changes in neural activity likely contribute to impaired decision making and impulsivity observed after drug use.

Neural Substrates and Circuits of Drug Addiction

Drug addiction is a chronic relapsing disorder, and a significant amount of research has been devoted to understand the factors that contribute to the development, loss of control, and persistence of compulsive addictive behaviors. In this review, we provide an overview of various theories of addiction to drugs of abuse and the neurobiology involved in elements of the addiction cycle. Specific focus is devoted to the role of the mesolimbic pathway in acute drug reinforcement and occasional drug use, the role of the mesocortical pathway and associated areas (e.g., the dorsal striatum) in escalation/dependence, and the contribution of these pathways and associated circuits to conditioned responses, drug craving, and loss of behavioral control that may underlie drug relapse. By enhancing the understanding of the neurobiological factors that mediate drug addiction, continued preclinical and clinical research will aid in the development of novel therapeutic interventions that can serve as effective long-term treatment strategies for drug-dependent individuals.

A double-blind sham-controlled phase 1 clinical trial of tDCS of the dorsolateral prefrontal cortex in cocaine inpatients: Craving, sleepiness, and contemplation to change

Impaired inhibitory control accompanied by enhanced salience attributed to drug-related cues, both associated with function of the dorsolateral prefrontal cortex (dlPFC), are hallmarks of drug addiction, contributing to worse symptomatology including craving. dlPFC modulation with transcranial direct current stimulation (tDCS) previously showed craving reduction in inpatients with cocaine use disorder (CUD). Our study aimed at assessing feasibility of a longer tDCS protocol in CUD (15 versus the common five/10 sessions) and replicability of previous results. In a randomized double-blind sham-controlled protocol, 17 inpatients with CUD were assigned to either a real-tDCS (right anodal/left cathodal) or a sham-tDCS condition for 15 sessions. Following the previous report, primary outcome measures were self-reported craving, anxiety, depression, and quality of life. Secondary measures included sleepiness, readiness to change drug use, and affect. We also assessed cognitive function including impulsivity. An 88% retention rate demonstrated feasibility. Partially supporting the previous results, there was a trend for self-reported craving to decrease in the real-tDCS group more than the sham-group, an effect that would reach significance with 15 subjects per group. Quality of life and impulsivity improved over time in treatment in both groups. Daytime sleepiness and readiness to change drug use showed significant Group × Time interactions whereby improvements were noted only in the real-tDCS group. One-month follow-up suggested transient effects of tDCS on sleepiness and craving. These preliminary results suggest the need for including more subjects to show a unique effect of real-tDCS on craving and examine the duration of this effect. After replication in larger sample sizes, increased vigilance and motivation to change drug use in the real-tDCS group may suggest fortification of dlPFC-supported executive functions.

Effects of a high-fat diet on impulsive choice in rats

INTRODUCTION

Obesity and binge eating disorder are associated with high levels of impulsivity, but the causal role of eating and palatable food in these associations is unclear. Studies in rodents show that a high-fat diet can increase one aspect of impulsivity (impulsive action); it is less clear, however, whether a dissociable aspect of impulsivity (impulsive choice) is similarly affected. Hence, the aim of this study was to ascertain whether chronic exposure to a high-fat diet would alter impulsive choice.

METHODS

Male rats were maintained on either a high-fat or control chow diet for two weeks ad libitum. They then underwent equi-caloric food restriction for the duration of the experiment, with each group maintained on their respective diet. To measure impulsive choice, rats were trained on a delay discounting task (DDT) in which they made discrete choices between a lever that delivered a small food reward immediately and a lever that delivered a large food reward accompanied by systematically increasing delays. Upon reaching stable performance on the DDT, rats were given acute systemic injections of amphetamine prior to testing in the DDT to determine whether increased monoamine transmission affected impulsive choice differently in the two diet groups. Lastly, subjects were tested on a progressive ratio schedule of reinforcement to assess motivation for a sucrose reward.

RESULTS

There was no significant effect of the high-fat diet on impulsive choice. Further, amphetamine decreased choice of the large, delayed reward (increased impulsive choice) to the same extent in both groups. Exposure to the high-fat diet did, however, increase motivation to obtain a sucrose reward.

CONCLUSIONS

These experiments reveal that, under conditions that do not promote weight gain, a chronic high-fat diet does not affect impulsive choice in a delay discounting task. The data are surprising in light of findings showing that this same diet alters impulsive action, and highlight the necessity of further research to elucidate relationships between palatable food consumption and impulsivity.

Delay and probability discounting in cocaine use disorder: Comprehensive examination of money, cocaine, and health outcomes using gains and losses at multiple magnitudes

Understanding factors associated with cocaine use disorder is important given its public health impact. One factor is delay discounting (devaluation of future consequences). Cocaine users have shown greater delay discounting of money rewards than non-cocaine users. But underexamined are factors known to affect discounting, such as the sign (reward vs. loss), magnitude (e.g., $10 vs. $1,000), and commodity (e.g., money vs. health) of the consequence. Also underexamined is probability discounting (devaluation of uncertain consequences). We conducted a comprehensive group-comparison study of discounting processes by comparing sign, magnitude, and commodity effects between demographically matched cocaine users (n = 23) and never users (n = 24) for delay discounting and sign and magnitude effects for probability discounting. Participants completed delay and probability discounting tasks spanning rewards and losses; money, cocaine, and health outcomes; and magnitudes of $10, $100, and $1,000. Four primary findings emerged when controlling for other drug use. First, cocaine users pervasively discounted delayed consequences more than never users regardless of sign, magnitude, or commodity, with the possible exception of delay discounting of $1,000 health equivalences. Second, both groups discounted delayed rewards more than losses, with a similar trend for probability discounting. Third, magnitude effects in cocaine users for delayed and probabilistic outcomes were similar to those previously observed in never users and other-drug users. Fourth, cocaine users discounted cocaine-related outcomes more than money and health, with variable results comparing money and health. These data suggest that the behavioral processes of delay and probability discounting are qualitatively similar for cocaine users and never users. However, quantitatively, cocaine users generally showed greater delay discounting and similar probability discounting compared with never users. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Testicular hormones mediate robust sex differences in impulsive choice in rats

Impairments in choosing optimally between immediate and delayed rewards are associated with numerous psychiatric disorders. Such ‘intertemporal’ choice is influenced by genetic and experiential factors; however, the contributions of biological sex are understudied and data to date are largely inconclusive. Rats were used to determine how sex and gonadal hormones influence choices between small, immediate and large, delayed rewards. Females showed markedly greater preference than males for small, immediate over large, delayed rewards (greater impulsive choice). This difference was neither due to differences in food motivation or reward magnitude perception, nor was it affected by estrous cycle. Ovariectomies did not affect choice in females, whereas orchiectomies increased impulsive choice in males. These data show that male rats exhibit less impulsive choice than females and that this difference is at least partly maintained by testicular hormones. These differences in impulsive choice could be linked to gender differences across multiple neuropsychiatric conditions.

Prior cocaine self-administration impairs attention signals in anterior cingulate cortex

Although maladaptive decision-making is a defining feature of drug abuse and addiction, we have yet to ascertain how cocaine self-administration disrupts neural signals in anterior cingulate cortex (ACC), a brain region thought to contribute to attentional control. To address this issue, rats were trained on a reward-guided decision-making task; reward value was manipulated by independently varying the size of or the delay to reward over several trial blocks. Subsequently, rats self-administered either a cocaine (experimental group) or sucrose (control) during 12 consecutive days, after which they underwent a 1-month withdrawal period. Upon completion of this period, rats performed the previously learned reward-guided decision-making task while we recorded from single neurons in ACC. We demonstrate that prior cocaine self-administration attenuates attention and attention-related ACC signals in an intake-dependent manner, and that changes in attention are decoupled from ACC firing. These effects likely contribute to the impaired decision-making-typified by chronic substance abuse and relapse-observed after drug use.

Effects of oxycodone on sensitivity to reinforcement magnitude: implications for effects of opioids on impulsive and risky choice

Opioid addiction/dependence is associated with impulsive and risky behavior. Moreover, opioids can increase impulsive choice in preclinical studies with nonhumans. The objective of this study was to investigate a potential behavioral mechanism of opioids: a change in the impact of reinforcement magnitude on choice. Rats (n = 7) chose between smaller and larger reinforcers under a continuous-choice (concurrent-chains) procedure. The levers associated with the smaller and larger reinforcers alternated every five sessions. During baseline under this procedure, rats showed a reliable preference for the larger reinforcer. Effects of several doses (0.1-1.7 mg/kg, s.c.) of the prescription opioid, oxycodone, were examined on preference based upon reinforcement magnitude. Oxycodone dose-dependently decreased preference for the larger reinforcer (i.e. decreased sensitivity to reinforcement magnitude). The decrease in sensitivity to reinforcement magnitude was selective in that the intermediate doses did not affect, or had minimal impact on, other measures of performance (e.g. on general motivation to respond). These data suggest that a decrease in the sensitivity to reinforcement magnitude is a reliable outcome of μ-opioid administration, an effect that has important implications for the impact of these drugs on both impulsive and risky behavior.

Risky decision-making predicts dopamine release dynamics in nucleus accumbens shell

The risky decision-making task (RDT) measures risk-taking in a rat model by assessing preference between a small, safe reward and a large reward with increasing risk of punishment (mild foot shock). It is well-established that dopaminergic drugs modulate risk-taking; however, little is known about how differences in baseline phasic dopamine signaling drive individual differences in risk preference. Here, we used in vivo fixed potential amperometry in male Long-Evans rats to test if phasic nucleus accumbens shell (NACs) dopamine dynamics are associated with risk-taking. We observed a positive correlation between medial forebrain bundle-evoked dopamine release in the NACs and risky decision-making, suggesting that risk-taking is associated with elevated dopamine sensitivity. Moreover, "risk-taking" subjects were found to demonstrate greater phasic dopamine release than "risk-averse" subjects. Risky decision-making also predicted enhanced sensitivity to the dopamine reuptake inhibitor nomifensine, and elevated autoreceptor function. Importantly, this hyperdopaminergic phenotype was selective for risky decision-making, as delay discounting performance was not predictive of phasic dopamine release or dopamine supply. These data identify phasic NACs dopamine release as a possible therapeutic target for alleviating the excessive risk-taking observed across multiple forms of psychopathology.

Ethanol pre-exposure does not increase delay discounting in P rats, but does impair the ability to dynamically adapt behavioral allocation to changing reinforcer contingencies

Increased subjective discounting of delayed rewards is associated with substance abuse, and individuals tend to discount their drug of choice at a greater rate compared to monetary rewards. While there is evidence indicating that increased delay discounting (DD) is a risk factor for substance abuse, some results suggest that exposure to drugs of abuse also increases DD, but effects are mixed. The current study examined whether ethanol pre-exposure increases DD and if an ethanol reinforcer would be discounted at a greater rate than sucrose. Alcohol preferring (P) rats were pre-exposed to either ethanol or sucrose using an intermittent access protocol (IAP) for 8 weeks. Then animals completed an operant fixed choice procedure where each pre-exposure group was split into either an ethanol or sucrose reinforcer group. Afterwards, animals completed an adjusting delay DD task using the same groups as the fixed choice task. Animals that received access to ethanol in the IAP showed increased delayed reward preference in a delay and session dependent manner. Specifically, ethanol pre-exposed animals took more sessions to decrease their preference for the delayed reward at longer delays. In the adjusting delay task, no differences in mean adjusting delays were seen, but ethanol pre-exposure impaired animals' ability to reach stability criteria. The observed results are not consistent with ethanol pre-exposure causing a change in DD. Rather they indicate ethanol pre-exposure impaired animals' ability to reallocate their behavior in response to a change in reinforcer contingencies. The current findings extend prior results showing alcohol naïve P rats exhibit both increased DD and decreased response inhibition (Beckwith and Czachowski 2014, 2016) by demonstrating that after alcohol exposure they exhibit a form of behavioral inflexibility. Hence, a "two-hit" genetic vulnerability/environmental acceleration of addictive behavior is supported.

Genomic basis of delayed reward discounting

Delayed reward discounting (DRD) is a behavioral economic measure of impulsivity, reflecting how rapidly a reward loses value based on its temporal distance. In humans, more impulsive DRD is associated with susceptibility to a number of psychiatric diseases (e.g., addiction, ADHD), health outcomes (e.g., obesity), and lifetime outcomes (e.g., educational attainment). Although the determinants of DRD are both genetic and environmental, this review focuses on its genetic basis. Both rodent studies using inbred strains and human twin studies indicate that DRD is moderately heritable, a conclusion that was further supported by a recent human genome-wide association study (GWAS) that used single nucleotide polymorphisms (SNP) to estimate heritability. The GWAS of DRD also identified genetic correlations with psychiatric diagnoses, health outcomes, and measures of cognitive performance. Future research priorities include rodent studies probing putative genetic mechanisms of DRD and human GWASs using larger samples and non-European cohorts. Continuing to characterize genomic influences on DRD has the potential to yield important biological insights with implications for a variety of medically and socially important outcomes.

Genetic influences on delayed reward discounting: A genome-wide prioritized subset approach

Delayed reward discounting (DRD) is a behavioral economic measure of impulsivity that has been consistently associated with addiction. It has also been identified as a promising addiction endophenotype, linking specific sources of genetic variation to individual risk. A challenge in the studies to date is that levels of DRD are often confounded with prior drug use, and previous studies have also had limited genomic scope. The current investigation sought to address these issues by studying DRD in healthy young adults with low levels of substance use (N = 986; 62% female, 100% European ancestry) and investigating genetic variation genome-wide. The genome-wide approach used a prioritized subset design, organizing the tests into theoretically and empirically informed categories and apportioning power accordingly. Three subsets were used: (a) a priori loci implicated by previous studies; (b) high-value addiction (HVA) markers from the recently developed SmokeScreen array; and (c) an atheoretical genome-wide scan. Among a priori loci, a nominally significant association was present between DRD and rs521674 in ADRA2A. No significant HVA loci were detected. One statistically significant genome-wide association was detected (rs13395777, p = 2.8 × 10-8), albeit in an intergenic region of unknown function. These findings are generally not supportive of the previous candidate gene studies and suggest that DRD has a complex genetic architecture that will require considerably larger samples to identify genetic associations more definitively. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Recent Updates in Modeling Risky Decision Making in Rodents

Excessive preference for risky over safe options is a hallmark of several psychiatric disorders. Here we describe a behavioral task that models such risky decision making in rats. In this task, rats are given choices between small, safe rewards and large rewards accompanied by risk of footshock punishment. The risk of punishment changes within a test session, allowing quantification of decision making at different levels of risk. Importantly, this task can yield a wide degree of reliable individual variability, allowing the characterization of rats as "risk-taking" or "risk-averse." The task has been demonstrated to be effective for testing the effects of pharmacological agents and neurobiological manipulations, and the individual variability (which mimics the human population) allows assessment of behavioral and neurobiological distinctions among subjects based on their risk-taking profile.

Adolescent morphine exposure induces immediate and long-term increases in impulsive behavior

RATIONALE

Adolescence in humans represents a unique and critical developmental time point associated with increased risk-taking behavior. Converging clinical and epidemiological studies report a peak of drug use during adolescence, leading to the hypothesis that the developing adolescents brain is at risk to lose control over drug intake. Both adolescence and drug abuse are associated with significant cognitive and psychological changes such as lack of impulse control. A simple definition for impulsive behavior is the tendency to act prematurely without foresight. Increase in impulsivity is evident in acute morphine consumption, but to date, little is known with respect to subchronic morphine administration in impulsive behavior, particularly comparing time-dependent effects in adults, young adults, and adolescents.

METHODS

To evaluate this, adult, young adult, and adolescent rats were treated with a subchronic regimen of morphine or saline during 5 days (s.c.). Thereafter, we examined impulsive behavioral effects of morphine administration, 24 h and 25 days after administration in rats, while responding under a five-choice serial reaction time task (5-CSRTT).

RESULTS

Subchronic morphine administration increased premature responding 24 h after the last injection of morphine in adult, young adult, and adolescent rats without increasing motor activity but a significant change in motivation in adult and young adult rats only. After 25 days of abstinence, premature responses were significantly increased in comparison with baseline in adolescent rats but not in adults and young adults.

CONCLUSION

The main conclusion of this study is that morphine exposure in adolescents has a long-term profound effect on motor impulsive behavior later in adulthood. An implication of our findings might be that we should be especially careful about consuming and prescribing opioid drugs in adolescents.

Neurochemical and Behavioral Dissections of Decision-Making in a Rodent Multistage Task

Flexible decision-making in dynamic environments requires both retrospective appraisal of reinforced actions and prospective reasoning about the consequences of actions. These complementary reinforcement-learning systems can be characterized computationally with model-free and model-based algorithms, but how these processes interact at a neurobehavioral level in normal and pathological states is unknown. Here, we developed a translationally analogous multistage decision-making (MSDM) task to independently quantify model-free and model-based behavioral mechanisms in rats. We provide the first direct evidence that male rats, similar to humans, use both model-free and model-based learning when making value-based choices in the MSDM task and provide novel analytic approaches for independently quantifying these reinforcement-learning strategies. Furthermore, we report that ex vivo dopamine tone in the ventral striatum and orbitofrontal cortex correlate with model-based, but not model-free, strategies, indicating that the biological mechanisms mediating decision-making in the multistage task are conserved in rats and humans. This new multistage task provides a unique behavioral platform for conducting systems-level analyses of decision-making in normal and pathological states.SIGNIFICANCE STATEMENT Decision-making is influenced by both a retrospective "model-free" system and a prospective "model-based" system in humans, but the biobehavioral mechanisms mediating these learning systems in normal and disease states are unknown. Here, we describe a translationally analogous multistage decision-making task to provide a behavioral platform for conducting neuroscience studies of decision-making in rats. We provide the first evidence that choice behavior in rats is influenced by model-free and model-based systems and demonstrate that model-based, but not model-free, learning is associated with corticostriatal dopamine tone. This novel behavioral paradigm has the potential to yield critical insights into the mechanisms mediating decision-making alterations in mental disorders.

Previous cocaine self-administration disrupts reward expectancy encoding in ventral striatum

The nucleus accumbens core (NAc) is important for integrating and providing information to downstream areas about the timing and value of anticipated reward. Although NAc is one of the first brain regions to be affected by drugs of abuse, we still do not know how neural correlates related to reward expectancy are affected by previous cocaine self-administration. To address this issue, we recorded from single neurons in the NAc of rats that had previously self-administered cocaine or sucrose (control). Neural recordings were then taken while rats performed an odor-guided decision-making task in which we independently manipulated value of expected reward by changing the delay to or size of reward across a series of trial blocks. We found that previous cocaine self-administration made rats more impulsive, biasing choice behavior toward more immediate reward. Further, compared to controls, cocaine-exposed rats showed significantly fewer neurons in the NAc that were responsive during odor cues and reward delivery, and in the reward-responsive neurons that remained, diminished directional and value encoding was observed. Lastly, we found that after cocaine exposure, reward-related firing during longer delays was reduced compared to controls. These results demonstrate that prior cocaine self-administration alters reward-expectancy encoding in NAc, which could contribute to poor decision making observed after chronic cocaine use.

Impulsive choice does not predict binge-like eating in rats

Binge eating disorder is an addiction-like disorder characterized by recurrent, excessive food consumption within discrete periods of time, and it has been linked to increased trait impulsivity. Within impulsivity components, while impulsive action was shown to predict binge-like and addictive-like eating, the role of impulsive choice is instead unknown. The goal of this study was to determine if impulsive choice predicted, or was altered by binge-like eating of a sugary, highly palatable diet. We utilized a modified adjusting delay task procedure in free-fed rats to assess impulsive choice behavior, that is. the tendency to respond for a larger, delayed reward over a lesser, immediate reward. We found that baseline impulsive choice was not a predictor of binge-like eating in 1-h sessions of palatable diet operant self-administration. Furthermore, binge-like eating of the same palatable diet had no effect on later impulsive choice behavior. Thus, our data suggest that, unlike impulsive action, impulsive choice behavior does not predict binge-like eating in rats.

The impact of drugs of abuse on executive function: characterizing long-term changes in neural correlates following chronic drug exposure and withdrawal in rats

Addiction has long been characterized by diminished executive function, control, and impulsivity management. In particular, these deficits often manifest themselves as impairments in reversal learning, delay discounting, and response inhibition. Understanding the neurobiological substrates of these behavioral deficits is of paramount importance to our understanding of addiction. Within the cycle of addiction, periods during and after withdrawal represent a particularly difficult point of intervention in that the negative physical symptoms associated with drug removal and drug craving increase the likelihood that the patient will relapse and return to drug use in order to abate these symptoms. Moreover, it is often during this time that drug induced deficits in executive function hinder the ability of the patient to refrain from drug use. Thus, it is necessary to understand the physiological and behavioral changes associated with withdrawal and drug craving-largely manifesting as deficits in executive control-to develop more effective treatment strategies. In this review, we address the long-term impact that drugs of abuse have on the behavioral and neural correlates that give rise to executive control as measured by reversal learning, delay discounting, and stop-signal tasks, focusing particularly on our work using rats as a model system.

An improved within-session self-adjusting delay discounting procedure for the study of choice impulsivity in rats

RATIONALE

Delay-discounting procedures involving choice between small immediate rewards and large delayed rewards are used to study impulsivity in rodents. Improving existing procedures may provide new insights into the neurobiological mechanisms underlying decision-making processes.

OBJECTIVES

To develop a novel delay-discounting procedure that adjusts the delay value within individual sessions based on the rat's most recent choices.

METHODS

Compared to previously developed procedure, we required a more consistent demonstration of preference, five consecutive choices of the large or small reward, a criterion that is more likely to reflect deliberate choice by the animal, as opposed to two consecutive choices. In addition, delays were changed in steps of 5 s (rather than 1 s), because 5-s increments should be more easily discriminated and may produce a more distinct effect on choice. We characterized the procedure behaviorally by manipulating the duration of the session and the consecutive choice criterion, and we investigated the stability of the behavior upon interruption of training. We also characterized the procedure pharmacologically by investigating the effects of dopaminergic compounds.

RESULTS

Our procedures allowed obtaining two complementary measures of delay discounting: (1) the percentage of choices of the delay option and (2) the mean adjusting delay, an index of the delay that animals choose more frequently. We found that our procedure rapidly establishes a baseline of choice behavior that remains stable over time and is highly sensitive to manipulations of the dopaminergic system.

CONCLUSIONS

This procedure may provide a useful tool for investigating the neurobiology of inter-temporal choice and decision-making.

Dissecting drug effects in preclinical models of impulsive choice: emphasis on glutamatergic compounds

RATIONALE

Impulsive choice is often measured with delay discounting paradigms. Because there are multiple discounting procedures, as well as different statistical analyses that can be applied to data generated from these paradigms, there are some inconsistencies in the literature regarding drug effects on impulsive choice.

OBJECTIVES

The goal of the current paper is to review the methodological and analytic approaches used to measure discounting and to discuss how these differences can account for differential drug effects observed across studies.

RESULTS

Because some procedures/analyses use a single data point as the dependent variable, changes in this value following pharmacological treatment may be interpreted as alterations in sensitivity to delayed reinforcement, but when other procedures/analyses are used, no changes in behavior are observed. Even when multiple data points are included, some studies show that the statistical analysis (e.g., ANOVA on raw proportion of responses vs. using hyperbolic/exponential functions) can lead to different interpretations. Finally, procedural differences (e.g., delay presentation order, signaling the delay to reinforcement, etc.) in the same discounting paradigm can alter how drugs affect sensitivity to delayed reinforcement.

CONCLUSIONS

Future studies should utilize paradigms that allow one to observe alterations in responding at each delay (e.g., concurrent-chains schedules). Concerning statistical analyses, using parameter estimates derived from nonlinear functions or incorporating the generalized matching law can allow one to determine if drugs affect sensitivity to delayed reinforcement or impair discrimination of the large and small magnitude reinforcers. Using these approaches can help further our understanding of the neurochemical underpinnings of delay discounting.

Decline of prefrontal cortical-mediated executive functions but attenuated delay discounting in aged Fischer 344 × brown Norway hybrid rats

Despite the fact that prefrontal cortex (PFC) function declines with age, aged individuals generally show an enhanced ability to delay gratification, as evident by less discounting of delayed rewards in intertemporal choice tasks. The present study was designed to evaluate relationships between 2 aspects of PFC-dependent cognition (working memory and cognitive flexibility) and intertemporal choice in young (6 months) and aged (24 months) Fischer 344 × brown Norway F1 hybrid rats. Rats were also evaluated for motivation to earn rewards using a progressive ratio task. As previously reported, aged rats showed attenuated discounting of delayed rewards, impaired working memory, and impaired cognitive flexibility compared with young. Among aged rats, greater choice of delayed reward was associated with preserved working memory, impaired cognitive flexibility, and less motivation to work for food. These relationships suggest that age-related changes in PFC and incentive motivation contribute to variance in intertemporal choice within the aged population. Cognitive impairments mediated by PFC are unlikely, however, to fully account for the enhanced ability to delay gratification that accompanies aging.

Steep effort discounting of a preferred reward over a freely-available option in prolonged methamphetamine withdrawal in male rats

RATIONALE

Drug addiction can be described as aberrant allocation of effort toward acquiring drug, despite associated costs. It is unclear if this behavioral pattern results from an overvaluation of reward or to an altered sensitivity to costs.

OBJECTIVE

Present experiments assessed reward sensitivity and effortful choice in rats following 1 week of withdrawal from methamphetamine (mAMPH).

METHODS

Rats were treated with either saline or an escalating dose mAMPH regimen, then tested after a week without the drug. In experiment 1, rats were given a free choice between water and various concentrations of sucrose solution to assess general reward sensitivity. In experiment 2, rats were presented with a choice between lever-pressing for sucrose pellets on a progressive ratio schedule or consuming freely-available chow.

RESULTS

In experiment 1, we found no differences in sucrose preference between mAMPH- and saline-pretreated rats. In experiment 2, when selecting between two options, mAMPH-pretreated rats engaged in less lever-pressing for sucrose pellets (p < 0.01) and switched from this preferred reward to the chow sooner than saline-pretreated rats (p < 0.05). This effect was not consistent with general reward devaluation or loss of motivation.

CONCLUSIONS

These findings demonstrate that mAMPH exposure and withdrawal lead to steeper discounting of reward value by effort, an effect that is consistent with the effect of mAMPH on discounting by delay, and which may reflect an underlying shared mechanism.

Prior Cocaine Self-Administration Increases Response-Outcome Encoding That Is Divorced from Actions Selected in Dorsal Lateral Striatum

Dorsal lateral striatum (DLS) is a highly associative structure that encodes relationships among environmental stimuli, behavioral responses, and predicted outcomes. DLS is known to be disrupted after chronic drug abuse; however, it remains unclear what neural signals in DLS are altered. Current theory suggests that drug use enhances stimulus-response processing at the expense of response-outcome encoding, but this has mostly been tested in simple behavioral tasks. Here, we investigated what neural correlates in DLS are affected by previous cocaine exposure as rats performed a complex reward-guided decision-making task in which predicted reward value was independently manipulated by changing the delay to or size of reward associated with a response direction across a series of trial blocks. After cocaine self-administration, rats exhibited stronger biases toward higher-value reward and firing in DLS more strongly represented action-outcome contingencies independent from actions subsequently taken rather than outcomes predicted by selected actions (chosen-outcome contingencies) and associations between stimuli and actions (stimulus-response contingencies). These results suggest that cocaine self-administration strengthens action-outcome encoding in rats (as opposed to chosen-outcome or stimulus-response encoding), which abnormally biases behavior toward valued reward when there is a choice between two options during reward-guided decision-making.SIGNIFICANCE STATEMENT Current theories suggest that the impaired decision-making observed in individuals who chronically abuse drugs reflects a decrease in goal-directed behaviors and an increase in habitual behaviors governed by neural representations of response-outcome (R-O) and stimulus-response associations, respectively. We examined the impact that prior cocaine self-administration had on firing in dorsal lateral striatum (DLS), a brain area known to be involved in habit formation and affected by drugs of abuse, during performance of a complex reward-guided decision-making task. Surprisingly, we found that previous cocaine exposure enhanced R-O associations in DLS. This suggests that there may be more complex consequences of drug abuse than current theories have explored, especially when examining brain and behavior in the context of a complex two-choice decision-making task.

Behavioral Inefficiency on a Risky Decision-Making Task in Adulthood after Adolescent Intermittent Ethanol Exposure in Rats

Adolescence is a period of development in neural circuits that are critical for adult functioning. There is a relationship between alcohol exposure and risky decision-making, though the enduring effects of adolescent ethanol exposure on risky decision-making in adulthood have not been fully explored. Studies using positive reinforcement have shown that adolescent intermittent ethanol (AIE) exposure results in higher levels of risky decision-making in adulthood, but the effects of AIE on punishment-mediated decision-making have not been explored. Adolescent rats were exposed to AIE or saline vehicle across a 16-day period, and then allowed to mature into adulthood. They were then trained to lever press for food reward and were assessed for risky decision-making by pairing increased levels of food reward with the probability of footshock punishment. AIE did not alter punishment-mediated risky decision-making. However, it did result in a significant increase in the delay to lever pressing. This finding is consistent with previous reports, using other behavioral tasks, which show decreased behavioral efficiency in adulthood after AIE. These findings indicate that AIE increases behavioral inefficiency, but not punishment-mediated risk-taking, in adulthood. Thus they contribute to a more nuanced understanding of the long-term effects of AIE on adult behavior.

Impulsive Rats Exhibit Blunted Dopamine Release Dynamics during a Delay Discounting Task Independent of Cocaine History

The inability to wait for a large, delayed reward when faced with a small, immediate one, known as delay discounting, has been implicated in a number of disorders including substance abuse. Individual differences in impulsivity on the delay discounting task are reflected in differences in neural function, including in the nucleus accumbens (NAc) core. We examined the role of a history of cocaine self-administration, as well as individual differences in impulsivity, on rapid dopamine (DA) release dynamics in the NAc core. Rats with a history of cocaine or water/saline self-administration were tested on delay discounting while being simultaneously assayed for rapid DA release using electrochemical methods. In controls, we found that cue DA release was modulated by reward delay and magnitude, consistent with prior reports. A history of cocaine had no effect on either delay discounting or DA release dynamics. Nonetheless, independent of drug history, individual differences in impulsivity were related to DA release in the NAc core. First, high impulsive animals exhibited dampened cue DA release during the delay discounting task. Second, reward delay and magnitude in high impulsive animals failed to robustly modulate changes in cue DA release. Importantly, these two DAergic mechanisms were uncorrelated with each other and, together, accounted for a high degree of variance in impulsive behavior. Collectively, these findings demonstrate two distinct mechanisms by which rapid DA signaling may influence impulsivity, and illustrate the importance of NAc core DA release dynamics in impulsive behavior.

Cocaine administration dose-dependently increases sexual desire and decreases condom use likelihood: The role of delay and probability discounting in connecting cocaine with HIV

OBJECTIVES

Although cocaine use has been linked to sexual HIV risk behavior for decades, the direct effects of cocaine on sexual desire and sexual decision-making are unexamined. Research suggests delay discounting (devaluation of future outcomes) and probability discounting (devaluation of uncertain outcomes) play roles in condom use decisions. This study examined the effect of cocaine administration on sexual desire, hypothetical condom use, and discounting tasks.

METHODS

This double-blind, within-subjects study compared the effects of 0, 125, and 250 mg/70 kg oral cocaine HCl in 12 cocaine users. Measures included sexual desire and other subjective ratings, the Sexual Delay Discounting Task, the Sexual Probability Discounting Task, and monetary delay and probability discounting tasks.

RESULTS

Cocaine caused dose-related increases in sexual desire and prototypical stimulant abuse-liability ratings. Relative to placebo, cocaine did not significantly alter condom use likelihood when condoms were immediately available or when sex was associated with 100% certainty of sexually transmitted infection (STI). In contrast, cocaine dose-dependently strengthened the effect of delay (sexual delay discounting) and STI uncertainty (sexual probability discounting) in decreasing condom use likelihood. Cocaine caused no significant change in monetary delay and probability discounting.

CONCLUSION

This is the first study showing that cocaine administration increases sexual desire. Detrimental effects of cocaine on sexual risk were only observed when safer sex required delay, or STI risk was uncertain (representative of many real-world scenarios), suggesting a critical role of discounting processes. Lack of monetary effects highlights the importance of studying clinically relevant outcomes when examining drug effects on behavioral processes.

Effects of N-methyl-D-aspartate receptor ligands on sensitivity to reinforcer magnitude and delayed reinforcement in a delay-discounting procedure

RATIONALE

The N-methyl-D-aspartate (NMDA) receptor has been recently identified as an important mediator of impulsive choice, as assessed in delay discounting. Although discounting is independently influenced by sensitivity to reinforcer magnitude and delayed reinforcement, few studies have examined how NMDA receptor ligands differentially affect these parameters.

OBJECTIVES

The current study examined the effects of various NMDA receptor ligands on sensitivity to reinforcer magnitude and delayed reinforcement in a delay-discounting procedure.

METHODS

Following behavioral training, rats received treatments of the following NMDA receptor ligands: the uncompetitive antagonists ketamine (0, 1.0, 5.0, or 10.0 mg/kg; i.p.), MK-801 (0, 0.003, 0.01, or 0.03 mg/kg; s.c.), and memantine (0, 2.5, 5.0, or 10.0 mg/kg; i.p.), the competitive antagonist CGS 19755 (0, 5.0, 10.0, or 20.0 mg/kg; s.c.), the non-competitive NR2B subunit-selective antagonist ifenprodil (0, 1.0, 3.0, or 10.0 mg/kg; i.p), and the partial agonist D-cycloserine (0, 3.25, 15.0, or 30.0 mg/kg; s.c.).

RESULTS

When an exponential model was used to describe discounting, CGS 19755 (5.0 mg/kg) increased impulsive choice without altering sensitivity to reinforcer magnitude. Conversely, ketamine (10.0 mg/kg), memantine (5.0 mg/kg), and ifenprodil (10.0 mg/kg) decreased sensitivity to reinforcer magnitude without altering impulsive choice. MK-801 and D-cycloserine did not alter delay-discounting performance, although two-way ANOVA analyses indicated D-cycloserine (15.0 mg/kg) decreased impulsive choice.

CONCLUSIONS

The behavioral changes observed in delay discounting following administration of NMDA receptor antagonists do not always reflect an alteration in impulsive choice. These results emphasize the utility in employing quantitative methods to assess drug effects in delay discounting.

The latent structure of impulsivity: impulsive choice, impulsive action, and impulsive personality traits

RATIONALE

Impulsivity has been strongly linked to addictive behaviors, but can be operationalized in a number of ways that vary considerably in overlap, suggesting multidimensionality.

OBJECTIVE

This study tested the hypothesis that the latent structure among multiple measures of impulsivity would reflect the following three broad categories: impulsive choice, reflecting discounting of delayed rewards; impulsive action, reflecting ability to inhibit a prepotent motor response; and impulsive personality traits, reflecting self-reported attributions of self-regulatory capacity.

METHODS

The study used a cross-sectional confirmatory factor analysis of multiple impulsivity assessments. Participants were 1252 young adults (62 % female) with low levels of addictive behavior, who were assessed in individual laboratory rooms at the University of Chicago and the University of Georgia. The battery comprised a Delay (replace hyphen with space) Discounting Task, Monetary Choice Questionnaire, Conners' Continuous Performance Test, Go/NoGo Task, Stop Signal Task, Barratt Impulsiveness Scale, and the UPPS-P Impulsive Behavior Scale.

RESULTS

The hypothesized three-factor model provided the best fit to the data, although sensation seeking was excluded from the final model. The three latent factors were largely unrelated to each other and were variably associated with substance use.

CONCLUSIONS

These findings support the hypothesis that diverse measures of impulsivity can broadly be organized into three categories that are largely distinct from one another. These findings warrant investigation among individuals with clinical levels of addictive behavior and may be applied to understanding the underlying biological mechanisms of these categories.

Sex differences in the reduction of impulsive choice (delay discounting) for cocaine in rats with atomoxetine and progesterone

RATIONALE

Impulsive choice, or an inability to delay immediate gratification, has been strongly linked to the development and persistence of drug abuse. Indeed, delaying drug use itself may underlie drug addiction and relapse. Thus, employing treatments that are efficacious in reducing impulsive choice (atomoxetine; ATO) or drug-seeking behavior (progesterone; PRO) may be an effective means of treating drug addiction.

OBJECTIVE

The current study assessed sex differences in the effects of PRO, ATO, and their combination in a delay discounting paradigm for cocaine and for sucrose pellets.

METHOD

Male and female rats chose between a small-immediate or a large-delayed (0, 7.5, 15, 30, 60 s) outcome in an impulsive choice procedure for sucrose pellets (1 vs. 3 pellets) or for iv cocaine infusions (0.3 vs. 0.9 mg/kg). Following baseline assessment of impulsive choice, rats received daily treatment of vehicle (VEH), PRO (0.5 mg/kg), ATO (1.5 mg/kg), or a combination (PRO + ATO) until a second assessment of impulsive choice was determined.

RESULTS

Compared to the VEH group, females were less impulsive for cocaine following PRO or the PRO + ATO combined treatment, whereas males were less impulsive for cocaine following ATO. No treatment effects were observed on impulsive choice for sucrose pellets.

CONCLUSIONS

The present results indicate that impulsive choice for cocaine is reduced by PRO in females and by ATO in males. These findings suggest both treatments may be an effective intervention in treating cocaine abuse, but that their effectiveness differs by sex.

Acute ethanol effects on neural encoding of reward size and delay in the nucleus accumbens

Acute ethanol administration can cause impulsivity, resulting in increased preference for immediately available rewards over delayed but more valuable alternatives. The manner in which reward size and delay are represented in neural firing is not fully understood, and very little is known about ethanol effects on this encoding. To address this issue, we used in vivo electrophysiology to characterize neural firing in the core of the nucleus accumbens (NAcc) in rats responding for rewards that varied in size or delay after vehicle or ethanol administration. The NAcc is a central element in the circuit that governs decision-making and importantly, promotes choice of delayed rewards. We found that NAcc firing in response to reward-predictive cues encoded anticipated reward value after vehicle administration, but ethanol administration disrupted this encoding, resulting in a loss of discrimination between immediate and delayed rewards in cue-evoked neural responses. In addition, NAcc firing occurring at the time of the operant response (lever pressing) was inversely correlated with behavioral response latency, such that increased firing rates were associated with decreased latencies to lever press. Ethanol administration selectively attenuated this lever press-evoked firing when delayed but not immediate rewards were expected. These effects on neural firing were accompanied by increased behavioral latencies to respond for delayed rewards. Our results suggest that ethanol effects on NAcc cue- and lever press-evoked encoding may contribute to ethanol-induced impulsivity.

Cocaine Self-Administration Experience Induces Pathological Phasic Accumbens Dopamine Signals and Abnormal Incentive Behaviors in Drug-Abstinent Rats

Chronic exposure to drugs of abuse is linked to long-lasting alterations in the function of limbic system structures, including the nucleus accumbens (NAc). Although cocaine acts via dopaminergic mechanisms within the NAc, less is known about whether phasic dopamine (DA) signaling in the NAc is altered in animals with cocaine self-administration experience or if these animals learn and interact normally with stimuli in their environment. Here, separate groups of rats self-administered either intravenous cocaine or water to a receptacle (controls), followed by 30 d of enforced abstinence. Next, all rats learned an appetitive Pavlovian discrimination and voltammetric recordings of real-time DA release were taken in either the NAc core or shell of cocaine and control subjects. Cocaine experience differentially impaired DA signaling in the core and shell relative to controls. Although phasic DA signals in the shell were essentially abolished for all stimuli, in the core, DA did not distinguish between cues and was abnormally biased toward reward delivery. Further, cocaine rats were unable to learn higher-order associations and even altered simple conditioned approach behaviors, displaying enhanced preoccupation with cue-associated stimuli (sign-tracking; ST) but diminished time at the food cup awaiting reward delivery (goal-tracking). Critically, whereas control DA signaling correlated with ST behaviors, cocaine experience abolished this relationship. These findings show that cocaine has persistent, differential, and pathological effects on both DA signaling and DA-dependent behaviors and suggest that psychostimulant experience may remodel the very circuits that bias organisms toward repeated relapse.

SIGNIFICANCE STATEMENT

Relapsing to drug abuse despite periods of abstinence and sincere attempts to quit is one of the most pernicious facets of addiction. Unfortunately, little is known about how the dopamine (DA) system functions after periods of drug abstinence, particularly its role in behavior in nondrug situations. Here, rats learned about food-paired stimuli after prolonged abstinence from cocaine self-administration. Using voltammetry, we found that real-time DA signals in cocaine-experienced rats were strikingly altered relative to controls. Further, cocaine-experienced animals found reward-predictive stimuli abnormally salient and spent more time interacting with cues. Therefore, cocaine induces neuroplastic changes in the DA system that biases animals toward salient stimuli (including reward-associated cues), putting addicts at increasing risk to relapse as addiction increases in severity.

Discrepant effects of acute cocaine on impulsive choice (delay discounting) in female rats during an increasing- and adjusting-delay procedure

RATIONALE

The relationship between impulsive choice and cocaine use in humans has been well established, although the causal role between these variables is complex. To disentangle this relationship, studies using rats have focused on how acute or chronic cocaine alters impulsive choice. A predominance of studies has focused on chronic cocaine regimens, but few have assessed acute cocaine's effects on impulsive choice.

OBJECTIVE

The current study assessed if acute cocaine administrations alter delay discounting of rats in two common impulsive choice procedures.

METHOD

Baseline delay discounting rates were determined in female rats using both an increasing- and adjusting-delay procedure. Once stable, a range of acute cocaine injections (2, 5, and 15 mg/kg i.p.) was administered prior to both procedures.

RESULTS

Baseline delay discounting rates were positively correlated between the increasing- and adjusting-delay procedures. Acute administrations of cocaine produced a dose-dependent decrease in preference for the large alternative in the increasing-delay procedure but had no effect in the adjusting-delay procedure.

CONCLUSIONS

The concordance of delay discounting rates across the two choice procedures suggests that both quantify the same underlying components of impulsive choice. However, manipulations that disrupt large alternative preference may not be readily detected under the adjusting-delay procedure unless control conditions are employed.

Effects of prior cocaine versus morphine or heroin self-administration on extinction learning driven by overexpectation versus omission of reward

BACKGROUND

Addiction is characterized by an inability to stop using drugs, despite adverse consequences. One contributing factor to this compulsive drug taking could be the impact of drug use on the ability to extinguish drug seeking after changes in expected outcomes. Here, we compared effects of cocaine, morphine, and heroin self-administration on two forms of extinction learning: standard extinction driven by reward omission and extinction driven by reward overexpectation.

METHODS

In experiment 1, we trained rats to self-administer cocaine, morphine, or sucrose for 3 hours per day (limited access). In experiment 2, we trained rats to self-administer heroin or sucrose for 12 hours per day (extended access). Three weeks later, we trained the rats to associate several cues with palatable food reward, after which we assessed extinction of the learned Pavlovian response, first by pairing two cues together in the overexpectation procedure and later by omitting the food reward.

RESULTS

Rats trained under limited access conditions to self-administer sucrose or morphine demonstrated normal extinction in response to both overexpectation and reward omission, whereas cocaine-experienced rats or rats trained to self-administer heroin under extended access conditions exhibited normal extinction in response to reward omission but failed to show extinction in response to overexpectation.

CONCLUSIONS

Here we show that cocaine and heroin can induce long-lasting deficits in the ability to extinguish reward seeking. These deficits were not observed in a standard extinction procedure but instead only affected extinction learning driven by a more complex phenomenon of overexpectation.

Translatable and Back-Translatable Measurement of Impulsivity and Compulsivity: Convergent and Divergent Processes

Impulsivity and compulsivity have emerged as important dimensional constructs that challenge traditional psychiatric classification systems. Both are present in normal healthy populations where the need to act quickly and repeatedly without hesitation can be highly advantageous. However, when excessively expressed, impulsive and compulsive behavior can lead to adverse consequences and spectrum disorders exemplified by attention-deficit/hyperactivity disorder (ADHD), obsessive compulsive disorder (OCD), autism, and drug addiction. Impulsive individuals have difficulty in deferring gratification and are inclined to 'jump the gun' and respond prematurely before sufficient information is gathered. Compulsivity involves repetitive behavior often motivated by the need to reduce or prevent anxiety, thus leading to the maladaptive perseveration of behavior. Defined in this way, impulsivity and compulsivity could be viewed as separate entities or 'traits' but overwhelming evidence indicates that both may be present in the same disorder, either concurrently or even separately at different time points. Herein we discuss the neural and cognitive heterogeneity of impulsive and compulsive endophenotypes. These constructs map onto distinct fronto-striatal neural and neurochemical structures interacting both at nodal convergent points and as opponent processes highlighting both the heterogeneity and the commonalities of function. We focus on discoveries made using both translational research methodologies and studies exclusively in humans, and implications for treatment intervention in disorders in which impulsive and compulsive symptoms prevail. We emphasize the relevance of these constructs for understanding dimensional psychiatry.

Neural processing of reward in adolescent rodents

•

The adolescent brain processes rewards differently than in adults.

•

These differences occur even when behavior is similar between age groups.

•

DS was the locus of substantial developmental differences in reward activity.

•

Surprisingly, differences were not as pronounced in VS.

•

These differences may have implications for adolescent psychiatric vulnerability.

Immaturities in adolescent reward processing are thought to contribute to poor decision making and increased susceptibility to develop addictive and psychiatric disorders. Very little is known; however, about how the adolescent brain processes reward. The current mechanistic theories of reward processing are derived from adult models. Here we review recent research focused on understanding of how the adolescent brain responds to rewards and reward-associated events. A critical aspect of this work is that age-related differences are evident in neuronal processing of reward-related events across multiple brain regions even when adolescent rats demonstrate behavior similar to adults. These include differences in reward processing between adolescent and adult rats in orbitofrontal cortex and dorsal striatum. Surprisingly, minimal age related differences are observed in ventral striatum, which has been a focal point of developmental studies. We go on to discuss the implications of these differences for behavioral traits affected in adolescence, such as impulsivity, risk-taking, and behavioral flexibility. Collectively, this work suggests that reward-evoked neural activity differs as a function of age and that regions such as the dorsal striatum that are not traditionally associated with affective processing in adults may be critical for reward processing and psychiatric vulnerability in adolescents.

The behavioral economics of substance use disorders: reinforcement pathologies and their repair

The field of behavioral economics has made important inroads into the understanding of substance use disorders through the concept of reinforcer pathology. Reinforcer pathology refers to the joint effects of (a) the persistently high valuation of a reinforcer, broadly defined to include tangible commodities and experiences, and/or (b) the excessive preference for the immediate acquisition or consumption of a commodity despite long-term negative outcomes. From this perspective, reinforcer pathology results from the recursive interactions of endogenous person-level variables and exogenous environment-level factors. The current review describes the basic principles of behavioral economics that are central to reinforcer pathology, the processes that engender reinforcer pathology, and the approaches and procedures that can repair reinforcement pathologies. The overall goal of this review is to present a new understanding of substance use disorders as viewed by recent advances in behavioral economics.