Impulsivity predicts the escalation of cocaine self-administration in rats

Selective chemogenetic inactivation of corticoaccumbal projections disrupts trait choice impulsivity

Impulsive choice has enduring trait-like characteristics and is defined by preference for small immediate rewards over larger delayed ones. Importantly, it is a determining factor in the development and persistence of substance use disorder (SUD). Emerging evidence from human and animal studies suggests frontal cortical regions exert influence over striatal reward processing areas during decision-making in impulsive choice or delay discounting (DD) tasks. The goal of this study was to examine how these circuits are involved in decision-making in animals with defined trait impulsivity. To this end, we trained adolescent male rats to stable behavior on a DD procedure and then re-trained them in adulthood to assess trait-like, conserved impulsive choice across development. We then used chemogenetic tools to selectively and reversibly target corticostriatal projections during performance of the DD task. The prelimbic region of the medial prefrontal cortex (mPFC) was injected with a viral vector expressing inhibitory designer receptors exclusively activated by designer drugs (Gi-DREADD), and then mPFC projections to the nucleus accumbens core (NAc) were selectively suppressed by intra-NAc administration of the Gi-DREADD actuator clozapine-n-oxide (CNO). Inactivation of the mPFC-NAc projection elicited a robust increase in impulsive choice in rats with lower vs. higher baseline impulsivity. This demonstrates a fundamental role for mPFC afferents to the NAc during choice impulsivity and suggests that maladaptive hypofrontality may underlie decreased executive control in animals with higher levels of choice impulsivity. Results such as these may have important implications for the pathophysiology and treatment of impulse control, SUDs, and related psychiatric disorders.

Divergent risky decision-making and impulsivity behaviors in Lewis rat substrains with low genetic difference

Substance use disorder (SUD) is associated with a cluster of cognitive disturbances that engender vulnerability to ongoing drug seeking and relapse. Two of these endophenotypes-risky decision-making and impulsivity-are amplified in individuals with SUD and are augmented by repeated exposure to illicit drugs. Identifying genetic factors underlying variability in these behavioral patterns is critical for early identification, prevention, and treatment of SUD-vulnerable individuals. Here, we compared risky decision-making and different facets of impulsivity between two fully inbred substrains of Lewis rats-LEW/NCrl and LEW/NHsd. We performed whole genome sequencing of both substrains to identify almost all relevant variants. We observed substantial differences in risky decision-making and impulsive behaviors. Relative to LEW/NHsd, the LEW/NCrl substrain accepts higher risk options in a decision-making task and higher rates of premature responses in the differential reinforcement of low rates of responding task. These phenotypic differences were more pronounced in females than males. We defined a total of ∼9,000 polymorphisms between these substrains at 40× whole genome short-read coverage. Roughly half of variants are located within a single 1.5 Mb region of Chromosome 8, but none impact protein-coding regions. In contrast, other variants are widely distributed, and of these, 38 are predicted to cause protein-coding variants. In conclusion, Lewis rat substrains differ significantly in risk-taking and impulsivity and only a small number of easily mapped variants are likely to be causal. Sequencing combined with a reduced complexity cross should enable identification of one or more variants underlying multiple complex addiction-relevant behaviors. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Motor impulsivity but not risk-related impulsive choice is associated to drug intake and drug-primed relapse

Introduction

Motor impulsivity and risk-related impulsive choice have been proposed as vulnerability factors for drug abuse, due to their high prevalence in drug abusers. However, how these two facets of impulsivity are associated to drug abuse remains unclear. Here, we investigated the predictive value of both motor impulsivity and risk-related impulsive choice on characteristics of drug abuse including initiation and maintenance of drug use, motivation for the drug, extinction of drug-seeking behavior following drug discontinuation and, finally, propensity to relapse.

Methods

We used the Roman High- (RHA) and Low- Avoidance (RLA) rat lines, which display innate phenotypical differences in motor impulsivity, risk-related impulsive choice, and propensity to self-administer drugs. Individual levels of motor impulsivity and risk-related impulsive choice were measured using the rat Gambling task. Then, rats were allowed to self-administer cocaine (0.3 mg/kg/infusion; 14 days) to evaluate acquisition and maintenance of cocaine self-administration, after which motivation for cocaine was assessed using a progressive ratio schedule of reinforcement. Subsequently, rats were tested for their resistance to extinction, followed by cue-induced and drug-primed reinstatement sessions to evaluate relapse. Finally, we evaluated the effect of the dopamine stabilizer aripiprazole on reinstatement of drug-seeking behaviors.

Results

We found that motor impulsivity and risk-related impulsive choice were positively correlated at baseline. Furthermore, innate high levels of motor impulsivity were associated with higher drug use and increased vulnerability to cocaine-primed reinstatement of drug-seeking. However, no relationships were observed between motor impulsivity and the motivation for the drug, extinction or cue-induced reinstatement of drug-seeking. High levels of risk-related impulsive choice were not associated to any aspects of drug abuse measured in our study. Additionally, aripiprazole similarly blocked cocaine-primed reinstatement of drug-seeking in both high- and low-impulsive animals, suggesting that aripiprazole acts as a D_2/3R antagonist to prevent relapse independently of the levels of impulsivity and propensity to self-administer drugs.

Discussion

Altogether, our study highlights motor impulsivity as an important predictive factor for drug abuse and drug-primed relapse. On the other hand, the involvement of risk-related impulsive choice as a risk factor for drug abuse appears to be limited.

Learned industriousness as a translational mechanism in anorexia nervosa

It remains unexplained why some behaviours persist despite being non-hedonic and ostensibly aversive. This phenomenon is especially baffling when such behaviours are taken to excess in the form of psychopathology. Anorexia nervosa is one psychiatric disorder in which effortful behaviours that most people find unpleasant (suchas restrictive eating) are persistently performed. We propose thatthe social psychology theory of learned industriousness providesa novel mechanistic account for such phenomena. This theoryposits that high-effort behaviour can be conditioned to acquire secondary reinforcing properties through repeated pairing with reward. Accordingly, effort sensations become less aversive andmore appetitive, increasing willingness to engage in effortful behaviour. In this Perspective, we review pre-clinical behaviouraland biological data that support learned industriousness, contrast learned industriousness with other models of non-hedonic persistence (such as habit learning), highlight evidence that supports learned industriousness in individuals with anorexia nervosa and consider implications of the model, including translation to other psychiatric presentations.

Sex differences in addiction-relevant behavioral outcomes in rodents following early life stress

In humans, exposure to early life stress (ELS) is an established risk factor for the development of substance use disorders (SUDs) during later life. Similarly, rodents exposed to ELS involving disrupted mother-infant interactions, such as maternal separation (MS) or adverse caregiving due to scarcity-adversity induced by limited bedding and nesting (LBN) conditions, also exhibit long-term alterations in alcohol and drug consumption. In both humans and rodents, there is a range of addiction-related behaviors that are associated with drug use and even predictive of subsequent SUDs. In rodents, these include increased anxiety-like behavior, impulsivity, and novelty-seeking, altered alcohol and drug intake patterns, as well as disrupted reward-related processes involving consummatory and social behaviors. Importantly, the expression of these behaviors often varies throughout the lifespan. Moreover, preclinical studies suggest that sex differences play a role in how exposure to ELS impacts reward and addiction-related phenotypes as well as underlying brain reward circuitry. Here, addiction-relevant behavioral outcomes and mesolimbic dopamine (DA) dysfunction resulting from ELS in the form of MS and LBN are discussed with a focus on age- and sex-dependent effects. Overall, these findings suggest that ELS may increase susceptibility for later life drug use and SUDs by interfering with the normal maturation of reward-related brain and behavioral function.

Behavioral phenotypes revealed during reversal learning are linked with novel genetic loci in diversity outbred mice

Impulsive behavior and impulsivity are heritable phenotypes that are strongly associated with risk for substance use disorders. Identifying the neurogenetic mechanisms that influence impulsivity may also reveal novel biological insights into addiction vulnerability. Our past studies using the BXD and Collaborative Cross (CC) recombinant inbred mouse panels have revealed that behavioral indicators of impulsivity measured in a reversal-learning task are heritable and are genetically correlated with aspects of intravenous cocaine self-administration. Genome-wide linkage studies in the BXD panel revealed a quantitative trait locus (QTL) on chromosome 10, but we expect to identify additional QTL by testing in a population with more genetic diversity. To this end, we turned to Diversity Outbred (DO) mice; 392 DO mice (156 males, 236 females) were phenotyped using the same reversal learning test utilized previously. Our primary indicator of impulsive responding, a measure that isolates the relative difficulty mice have with reaching performance criteria under reversal conditions, revealed a genome-wide significant QTL on chromosome 7 (max LOD score = 8.73, genome-wide corrected p<0.05). A measure of premature responding akin to that implemented in the 5-choice serial reaction time task yielded a suggestive QTL on chromosome 17 (max LOD score = 9.14, genome-wide corrected <0.1). Candidate genes were prioritized (2900076A07Rik, Wdr73 and Zscan2) based upon expression QTL data we collected in DO and CC mice and analyses using publicly available gene expression and phenotype databases. These findings may advance understanding of the genetics that drive impulsive behavior and enhance risk for substance use disorders.

Logical fallacies and misinterpretations that hinder progress in translational addiction neuroscience

Substance use disorders (SUDs) are heterogeneous and complex, making the development of translationally predictive rodent and nonhuman primate models to uncover their neurobehavioral underpinnings difficult. Neuroscience-focused outcomes have become highly prevalent, and with this, the notion that SUDs are disorders of the brain embraced as a dominant theoretical orientation to understand SUD etiology and treatment. These efforts, however, have led to few efficacious pharmacotherapies, and in some cases (as with cocaine or methamphetamine), no pharmacotherapies have translated from preclinical models for clinical use. In this theoretical commentary, we first describe the development of animal models of substance use behaviors from a historical perspective. We then define and discuss three logical fallacies including 1) circular explanation, 2) affirming the consequent, and 3) reification that can apply to developed models. We then provide three case examples in which conceptual or logical issues exist in common methods (i.e., behavioral economic demand, escalation, and reinstatement). Alternative strategies to refocus behavioral models are suggested for the field to better bridge the translational divide between animal models, the clinical condition of SUDs, and current and future regulatory pathways for intervention development.

Interactions between impulsivity and MDPV self-administration in rats

Synthetic cathinones, such as 3,4-methylenedioxypyrovalerone (MDPV), are recreational drugs of abuse often identified in 'bath salts' preparations. Humans report compulsive patterns of bath salts use, and previous work suggests that a subset of rats develop unusually high levels of MDPV self-administration. This study aims to test the hypothesis that high levels of impulsivity (e.g., inability to withhold responding for a sucrose reward) will predispose rats to high levels of MDPV self-administration relative to rats with lower levels of impulsivity. The 1-choice serial reaction time task (1-CSRTT) was used to assess impulsivity (i.e., premature responding) in 10 female and 10 male Sprague Dawley rats. Rats were then allowed to self-administer 0.032 mg/kg/inf MDPV or 0.32 mg/kg/inf cocaine, after which full dose-response curves for MDPV (0.001-0.1 mg/kg/inf) or cocaine (0.01-1 mg/kg/inf) were generated under a FR5 schedule of reinforcement. After a history of self-administering MDPV or cocaine, impulsivity was reassessed under the 1-CSRTT, prior to evaluating the acute effects of MDPV (0.032-0.32 mg/kg) or cocaine (0.1-1 mg/kg) on impulsivity. Level of impulsivity was not correlated with subsequent levels of either MDPV or cocaine self-administration, and level of drug self-administration was also not correlated with subsequent levels of impulsivity, although acute administration of MDPV and cocaine did increase premature responding. In failing to find direct relationships between either impulsivity and subsequent drug-taking behaviour, or drug-taking behaviour and subsequent assessments of impulsivity, these findings highlight the complexity inherent in the associations between impulsive behaviour and drug-taking behaviour in both animal models and humans.

Testing delay of gratification in rats using a within-session increasing-delay task

In delay discounting, preference reversals refer to shifts in preference from a larger-later reward to a smaller-sooner reward. Steep hyperbolic discounting predicts a preference reversal when a smaller-sooner and larger-later reward both become temporally proximal; prior research is consistent with this prediction. Hyperbolic discounting does not predict a preference reversal, however, after an individual chooses a larger-later reward over a smaller-immediate reward; prior research is inconsistent with this prediction. We sought to replicate and extend these findings using a delay of gratification task in rats. The task included a defection response which allowed rats to reverse their preference after choosing a larger-later sucrose reinforcer to instead obtain a smaller-immediate sucrose reinforcer. In Experiment 1, we found that rats would defect on their choice of the larger-later reinforcer, systematically replicating prior research. We also found that experience on the delay of gratification task led to decreases in defection responses. In Experiment 2, we found that prior experience on an intertemporal choice task, with no opportunity to defect, also led to few defection responses on the delay of gratification task. We discuss our findings in the context of whether inhibitory control or temporal learning could be involved in delay of gratification.

Reward-Related Decision-Making in Current and Past Disordered Gambling: Implications for Impulsive Choice and Risk Preference in the Maintenance of Gambling Disorder

Impulsive reward-related decision-making (RRDM) is robustly associated with gambling disorder (GD), although its role in the development and perpetuation of GD is still being investigated. This project sought to examine the possible roles of impulsive and risky choice, two aspects of RRDM, in the perpetuation of GD. Additionally, the potential moderating role of comorbid substance misuse was considered. A total of 434 participants with symptoms of current GD and symptoms of concurrent substance use disorder (SUD; n = 105), current GD with past SUD (n = 98), past GD with current SUD (n = 53), or past GD with past substance use disorder (SUD; n = 92), and 96 healthy controls were recruited through MTurk. Participants completed a randomly adjusting delay discounting (a measure of impulsive choice) and probabilistic discounting (a measure of risky choice) task and self-report questionnaires of gambling participation, GD and SUD symptomology, and trait impulsivity. Although control participants showed significantly greater delay discounting compared to individuals with a current or history of GD, no significant group differences emerged between individuals with current GD or a history of GD. Individuals with current GD showed significantly less probabilistic discounting compared to individuals with a history of GD and control participants showed the greatest rates of probabilistic discounting. These effects remained after controlling for lifetime gambling symptom severity and trait impulsivity. Overall, these findings suggest a potential maintaining role of risky choice in gambling disorder, but do not support a maintaining role for impulsive choice.

Effects of immediate-reinforcement training on delay discounting behavior in rats

Chronic exposure to delayed reinforcement has been shown to increase choice for larger, later reinforcement in a subsequent delay discounting task. In the 3 experiments presented in this paper, the opposite was tested: effects of chronic exposure to immediate reinforcement on choice in a subsequent delay discounting task. In Experiment 1, larger, later reinforcement choice was significantly reduced as a result of exposure to immediate reinforcement, compared to a maturation/handle control group, in experienced, male Lewis rats. In Experiment 2, with naive male and female Wistar rats, and Experiment 3, with naïve male Long Evans rats, the impact of exposure to immediate reinforcement was less robust, but directionally consistent with results from Experiment 1. These results align with some previous work reporting that exposure to immediate reinforcement may decrease choice for larger, later reinforcement in a delay discounting task, and/or blunt maturational increases in choice for larger, later reinforcement. These findings have implications for future research investigating experience-based interventions to manipulate delay discounting behavior. They also have clinical implications for understanding and treating disorders involving maladaptive choice.

The association between risky decision making and cocaine conditioned place preference is moderated by sex

BACKGROUND

Excessive risk taking is a characteristic trait of several psychiatric conditions, including substance use disorders. High risk-taking (HiR) rats self-administer more cocaine compared to low risk-taking (LoR) rats. However, research has not determined if risk taking is associated with enhanced cocaine conditioned place preference (CPP).

METHODS

Male and female Sprague Dawley rats (n = 48 each sex) were first tested in the risky decision task (RDT), in which a response on one lever resulted in safe delivery of one food pellet, and a response on a different lever resulted in delivery of two pellets and probabilistic delivery of foot shock. Following RDT training, rats were tested for cocaine CPP. The first session was a pretest that measured rats' preference for three compartments that provided different visual and tactile cues. Rats then learned to associate one compartment with cocaine (either 10.0 mg/kg or 20.0 mg/kg; i.p.) and one compartment with saline (1.0 ml/kg; i.p.) across eight conditioning sessions. Finally, rats explored all three compartments in a drug-free state.

RESULTS

Sex significantly moderated the association between risky decision making and cocaine CPP. While increased risk aversion was somewhat positively associated with cocaine CPP in males, increased risk taking was positively correlated with cocaine CPP in females.

CONCLUSIONS

These results highlight the moderating role of sex on the relationship between risky decision making and cocaine reward.

Individual differences in dopamine uptake in the dorsomedial striatum prior to cocaine exposure predict motivation for cocaine in male rats

A major theme of addiction research has focused on the neural substrates of individual differences in the risk for addiction; however, little is known about how vulnerable populations differ from those that are relatively protected. Here, we prospectively measured dopamine (DA) neurotransmission prior to cocaine exposure to predict the onset and course of cocaine use. Using in vivo voltammetry, we first generated baseline profiles of DA release and uptake in the dorsomedial striatum (DMS) and nucleus accumbens of drug-naïve male rats prior to exposing them to cocaine using conditioned place preference (CPP) or operant self-administration. We found that the innate rate of DA uptake in the DMS strongly predicted motivation for cocaine and drug-primed reinstatement, but not CPP, responding when "price" was low, or extinction. We then assessed the impact of baseline variations in DA uptake on cocaine potency in the DMS using ex vivo voltammetry in naïve rats and in rats with DA transporter (DAT) knockdown. DA uptake in the DMS of naïve rats predicted the neurochemical response to cocaine, such that rats with innately faster rates of DA uptake demonstrated higher cocaine potency at the DAT and rats with DAT knockdown displayed reduced potency compared to controls. Together, these data demonstrate that inherent variability in DA uptake in the DMS predicts the behavioral response to cocaine, potentially by altering the apparent potency of cocaine.

Spontaneously Hypertensive Rat substrains show differences in model traits for addiction risk and cocaine self-administration: Implications for a novel rat reduced complexity cross

Forward genetic mapping of F2 crosses between closely related substrains of inbred rodents - referred to as a reduced complexity cross (RCC) - is a relatively new strategy for accelerating the pace of gene discovery for complex traits, such as drug addiction. RCCs to date were generated in mice, but rats are thought to be optimal for addiction genetic studies. Based on past literature, one inbred Spontaneously Hypertensive Rat substrain, SHR/NCrl, is predicted to exhibit a distinct behavioral profile as it relates to cocaine self-administration traits relative to another substrain, SHR/NHsd. Direct substrain comparisons are a necessary first step before implementing an RCC. We evaluated model traits for cocaine addiction risk and cocaine self-administration behaviors using a longitudinal within-subjects design. Impulsive-like and compulsive-like traits were greater in SHR/NCrl than SHR/NHsd, as were reactivity to sucrose reward, sensitivity to acute psychostimulant effects of cocaine, and cocaine use studied under fixed-ratio and tandem schedules of cocaine self-administration. Compulsive-like behavior correlated with the acute psychostimulant effects of cocaine, which in turn correlated with cocaine taking under the tandem schedule. Compulsive-like behavior also was the best predictor of cocaine seeking responses. Heritability estimates indicated that 22 %-40 % of the variances for the above phenotypes can be explained by additive genetic factors, providing sufficient genetic variance to conduct genetic mapping in F2 crosses of SHR/NCrl and SHR/NHsd. These results provide compelling support for using an RCC approach in SHR substrains to uncover candidate genes and variants that are of relevance to cocaine use disorders.

Transition to substance use disorders: impulsivity for reward and learning from reward

Substance dependence constitutes a profound societal burden. Although large numbers of individuals use licit or illicit substances, few transition to dependence. The specific factors influencing this transition are not well understood. Substance-dependent individuals tend to be swayed by the immediate rewards of drug taking, but are often insensitive to delayed negative consequences of their behavior. Dependence is consequently associated with impulsivity for reward and atypical learning from feedback. Behavioral impulsivity is indexed using tasks measuring spontaneous decision-making and capacity to control impulses. While evidence indicates drug taking exacerbates behavioral impulsivity for reward, animal and human studies of drug naïve populations demonstrate it might precede any drug-related problems. Research suggests dependent individuals are also more likely to learn from rewarding (relative to punishing) feedback. This may partly explain why substance-dependent individuals fail to modify their behavior in response to negative outcomes. This enhanced learning from reward may constitute a further pre-existing risk factor for substance dependence. Although impulsivity for reward and preferential learning from rewarding feedback are both underpinned by a compromised dopaminergic system, few studies have examined the relationship between these two mechanisms. The interplay of these processes may help enrich understanding of why some individuals transition to substance dependence.

Neurochemical substrates linked to impulsive and compulsive phenotypes in addiction: A preclinical perspective

Drug compulsion manifests in some but not all individuals and implicates multifaceted processes including failures in top-down cognitive control as drivers for the hazardous pursuit of drug use in some individuals. As a closely related construct, impulsivity encompasses rash or risky behaviour without foresight and underlies most forms of drug taking behaviour, including drug use during adverse emotional states (i.e., negative urgency). While impulsive behavioural dimensions emerge from drug-induced brain plasticity, burgeoning evidence suggests that impulsivity also predates the emergence of compulsive drug use. Although the neural substrates underlying the apparently causal relationship between trait impulsivity and drug compulsion are poorly understood, significant advances have come from the interrogation of defined limbic cortico-striatal circuits involved in motivated behaviour and response inhibition, together with chemical neuromodulatory influences from the ascending neurotransmitter systems. We review what is presently known about the neurochemical mediation of impulsivity, in its various forms, and ask whether commonalities exist in the neurochemistry of compulsive drug-motivated behaviours that might explain individual risk for addiction.

Lateral habenula cannabinoid CB1 receptor involvement in drug-associated impulsive behavior

Animal and human studies show that cannabis or its derivatives can increase relapse to cocaine seeking following withdrawal. Moreover, cannabis use in humans is associated with impulse control deficits and animal studies implicate endogenous cannabinoids (eCB) in several impulsivity constructs. However, the brain areas where cannabinoids might control impulsivity or cocaine seeking are largely unknown. Here, we assess Lateral Habenula (LHb) involvement on performance in the 5-choice serial reaction time task (5CSRTT) in rats and investigate whether LHb cannabinoid CB1 receptors (CB1R) are involved in these effects. Systemic cocaine increased premature responding, a measure of impulsivity, at a dose (5 mg/kg) that did not alter other measures of task performance. Intra-LHb infusion of the CB1R antagonist AM251 blocked this effect. Systemic injection of the psychoactive constituent of cannabis, Δ⁹-tetrahydrocannabinol (Δ⁹-THC, 1 mg/kg), also increased 5CSRTT premature responding at a dose that did not otherwise disrupt task performance. This was blocked by intra-LHb infusion of AM251 in a subgroup of rats showing the largest increases in Δ⁹-THC-evoked premature responses. Systemic Δ⁹-THC also prompted impulsive cocaine seeking in a Go/NoGo cocaine self-administration task and this was blocked by intra-LHb AM251. These data show that LHb CB1Rs are involved in deficits in impulse control initiated by cocaine and Δ⁹-THC, as assessed by the 5CSRTT, and play a role in impulsive cocaine seeking during cocaine self-administration. This suggests that the LHb eCB system contributes to the control of impulsive behavior, and thus represents a potential target for therapeutic treatment of substance use disorders (SUDs) in humans.

Behavioral predictors of individual differences in opioid addiction vulnerability as measured using i.v. self-administration in rats

BACKGROUND

Like other forms of psychopathology, vulnerability to opioid addiction is subject to wide individual differences. Animal behavioral models are valuable in advancing our understanding of mechanisms underlying vulnerability to the disorder's development and amenability to treatment.

METHODS

This review provides an overview of preclinical work on behavioral predictors of opioid addiction vulnerability as measured using the intravenous (i.v.) self-administration (SA) model in rats. We also highlight several new approaches to studying individual differences in opioid addiction vulnerability in preclinical models that could have greater sensitivity and lead to more clinically relevant findings.

RESULTS AND CONCLUSIONS

Evidence for the relationship between various behavioral traits and opioid SA in the preclinical literature is limited. With the possible exceptions of sensitivity to opioid agonist/withdrawal effects and stress reactivity, predictors of individual differences in SA of other drugs of abuse (e.g. sensation-seeking, impulsivity) do not predict vulnerability to opioid SA in rats. Refinement of SA measures and the use of multivariate designs and statistics could help identify predictors of opioid SA and lead to more clinically relevant studies on opioid addiction vulnerability.

Discounting of food and water in rats shows trait- and state-like characteristics

Delay discounting is the loss in value of an outcome as a function of its delay. The present study focused on examining a trait-like characteristic of delay discounting in a preclinical animal model. Specifically, we were interested in whether there was a positive relation between discounting of 2 different outcomes in rats. That is, would rats that discount delayed food steeply also discount delayed water steeply? In addition, we examined how session-to-session variability in discounting could be attributed to differences between subjects (trait variability) and to differences within subjects (state variability). Finally, we measured discounting from early- to mid-adulthood, allowing us to examine changes in discounting as a function of age. Overall, we found a moderate, positive correlation between discounting of food and discounting of water in rats, providing further evidence that the relative consistency with which individuals discount different outcomes is a trait-like characteristic. In addition, we found a high degree of within-subject variability in discounting, indicating strong state-like differences from session to session. Finally, overall, discounting decreased as a function of age; however, individual-subject data showed variability in how discounting changed across time. Overall, our results show that differences in delay discounting between individuals reflect variability in both trait- and state-like characteristics.

Effects of a high-fat diet on impulsive choice in rats

INTRODUCTION

Obesity and binge eating disorder are associated with high levels of impulsivity, but the causal role of eating and palatable food in these associations is unclear. Studies in rodents show that a high-fat diet can increase one aspect of impulsivity (impulsive action); it is less clear, however, whether a dissociable aspect of impulsivity (impulsive choice) is similarly affected. Hence, the aim of this study was to ascertain whether chronic exposure to a high-fat diet would alter impulsive choice.

METHODS

Male rats were maintained on either a high-fat or control chow diet for two weeks ad libitum. They then underwent equi-caloric food restriction for the duration of the experiment, with each group maintained on their respective diet. To measure impulsive choice, rats were trained on a delay discounting task (DDT) in which they made discrete choices between a lever that delivered a small food reward immediately and a lever that delivered a large food reward accompanied by systematically increasing delays. Upon reaching stable performance on the DDT, rats were given acute systemic injections of amphetamine prior to testing in the DDT to determine whether increased monoamine transmission affected impulsive choice differently in the two diet groups. Lastly, subjects were tested on a progressive ratio schedule of reinforcement to assess motivation for a sucrose reward.

RESULTS

There was no significant effect of the high-fat diet on impulsive choice. Further, amphetamine decreased choice of the large, delayed reward (increased impulsive choice) to the same extent in both groups. Exposure to the high-fat diet did, however, increase motivation to obtain a sucrose reward.

CONCLUSIONS

These experiments reveal that, under conditions that do not promote weight gain, a chronic high-fat diet does not affect impulsive choice in a delay discounting task. The data are surprising in light of findings showing that this same diet alters impulsive action, and highlight the necessity of further research to elucidate relationships between palatable food consumption and impulsivity.

Early environmental enrichment and impoverishment differentially affect addiction-related behavioral traits, cocaine-taking, and dopamine D2/3 receptor signaling in a rat model of vulnerability to drug abuse

RATIONALE

Risk factors for drug addiction include genetics, environment, and behavioral traits such as impulsivity and novelty preference (NP), which have been related to deficits in striatal dopamine (DA) D_2/3-receptors (D_2/3R) and heightened amphetamine (AMPH)-induced DA release. However, the influence of the early rearing environment on these behavioral and neurochemical variables is not clear.

OBJECTIVES

We investigated the influence of early rearing environment on striatal D_2/3R availabilities and AMPH-induced DA release in relation to impulsivity, NP, and propensity to drug self-administration (SA) in "addiction-prone" Roman high- (RHA) and "addiction-resistant" Roman low-avoidance (RLA) rats.

METHODS

Animals were reared post-weaning in either environmental enrichment (EE) or impoverishment (EI) and were assessed at adulthood for impulsivity, NP, and propensity to cocaine SA. EE and EI rats were also scanned using single-photon emission computed tomography to concurrently measure in vivo striatal D_2/3R availability and AMPH-induced DA release.

RESULTS

EE vs. EI was associated with heightened impulsivity and a lack of NP in both rat lines. Higher dorsal striatal D_2/3R densities were found in RHA EE and higher AMPH-induced DA release in RLA EE. Both impulsivity and NP were negatively correlated to dorsal striatal D_2/3R availabilities and positively correlated with AMPH-induced DA release in EI but not in EE. EE vs. EI was related to a faster rate of cocaine intake and elevated active timeout responses in RHAs.

CONCLUSION

Our results suggest non-monotonic, environment-dependent, relationships between impulsivity, NP, and D_2/3R-mediated signaling, and suggest that EI vs. EE may decrease the reinforcing effects of psychostimulants in predisposed individuals.

Bidirectional causality between addiction and cognitive deficits

Cognitive deficits are highly comorbid with substance use disorders. Deficits span multiple cognitive domains, are associated with disease severity across substance classes, and persist long after cessation of substance use. Furthermore, recovery of cognitive function during protracted abstinence is highly predictive of treatment adherence, relapse, and overall substance use disorder prognosis, suggesting that addiction may be best characterized as a disease of executive dysfunction. While the association between cognitive deficits and substance use disorders is clear, determining causalities is made difficult by the complex interplay between these variables. Cognitive dysfunction present prior to first drug use can act as a risk factor for substance use initiation, likelihood of pathology, and disease trajectory. At the same time, substance use can directly cause cognitive impairments even in individuals without preexisting deficits. Thus, parsing preexisting risk factors from substance-induced adaptations, and how they may interact, poses significant challenges. Here, focusing on psychostimulants and alcohol, we review evidence from clinical literature implicating cognitive deficits as a risk factor for addiction, a consequence of substance use, and the role the prefrontal cortex plays in these phenomena. We then review corresponding preclinical literature, highlighting the high degree of congruency between animal and human studies, and emphasize the unique opportunity that animal models provide to test causality between cognitive phenotypes and substance use, and to investigate the underlying neurobiology at a cellular and molecular level. Together, we provide an accessible resource for assessing the validity and utility of forward- and reverse-translation between these clinical and preclinical literatures.

Steep Discounting of Future Rewards as an Impulsivity Phenotype: A Concise Review

This chapter provides an overview over the behavioral economic index of impulsivity known as delay discounting. Specifically, delay discounting refers to an individual's preference for smaller immediate rewards over a larger delayed rewards. The more precipitously an individual discounts future rewards, the more impulsive they are considered to be. First, the chapter reviews the nature of delay discounting as a psychological process and juxtaposes it with nominally similar processes, including other facets of impulsivity. Second, the chapter reviews the links between delay discounting and numerous health behaviors, including addiction, attention deficit/hyperactivity disorder, and obesity. Third, the determinants of individual variation in delay discounting are discussed, including both genetic and environmental contributions. Finally, the chapter evaluates delay discounting as a potentially modifiable risk factor and the status of clinical interventions designed to reduce delay discounting to address deficits in self-control in a variety of maladaptive behaviors.

Reducing impulsive choice VII: effects of duration of delay-exposure training

Impulsive choice is related to substance use disorders, obesity, and other behaviors that negatively impact human health. Reducing impulsive choice may prove beneficial in ameliorating these maladaptive behaviors. Preclinical research in rats indicates that one reliable method for producing large and lasting reductions in impulsive choice is delay-exposure (DE) training. In all six of the prior DE-training experiments, rats were given extensive experience (~ 120 training sessions) with a delayed reinforcement contingency. The present experiment evaluated if similar large and lasting reductions in impulsive choice could be achieved with less training. The duration of DE training between groups of male Wistar rats was 0 sessions (training ended after a lever-pressing acquisition criterion was met), 30, 60, or 120 sessions. Comparison groups were given the same durations of training with immediate reinforcement. A post-training assessment of impulsive choice was completed using an increasing-delay procedure. For rats assigned to the 60-session condition, impulsive choice was reassessed at a 120-day follow-up. DE training reduced impulsive choice but, contrary to expectation, reductions in impulsive choice did not increase with DE-training duration (no significant training-duration by group interaction). Importantly, 60 sessions of DE training produced reductions in impulsive choice that were comparable to prior published findings and this effect remained significant at the 120-day follow-up. Procedural elements that may be responsible for the DE-training effect, and how they could be improved in future experiments, are discussed.

The role of impulsivity as predisposing behavioural trait in different aspects of alcohol self-administration in rats

BACKGROUND

Therapeutic interventions to promote abstinence and prevent relapse in alcohol use disorder (AUD) are limitedly available. Therefore, targeting risk factors in the onset and maintenance of AUD could pose an interesting alternative treatment strategy. In this regard, over the last decade trait impulsivity has received considerable attention as such a risk factor predisposing substance dependence both in clinical populations and preclinical rodent studies. This study investigated whether different forms of impulsivity (action versus choice) predict distinct stages of instrumental alcohol self-administration, extinction and cue-induced relapse.

METHODS

Two cohorts of n = 48 rats each were trained in an operant tasks for either impulsive action or impulsive choice. Subsequently, high and low impulsive rats were then tested in an alcohol self-administration and relapse model and following this retested in the impulsivity tasks to evaluate possible changes in impulsivity levels.

RESULTS

The current data show that neither impulsive action, nor impulsive choice predict the extent to which rats consume alcohol and the extent to which rats are motivated to self-administer alcohol. Moreover, extinction of responding for alcohol and cue-induced relapse was not predicted by impulsivity. Interestingly, rats and most prominently low impulsive rats became more impulsive after the alcohol self-administration procedure. Although due to employed experimental design it is not clear whether this resulted from alcohol consumption or alcohol abstinence.

CONCLUSION

Together, these findings lend further support for the notion of a unidirectional relationship between self-administration of the depressant drug alcohol and impulsivity.

Personality driven alcohol and drug abuse: New mechanisms revealed

While the majority of the regular consumers of alcohol controls their consumption well over life span and even takes instrumentalization benefits from it, a minority, but yet high total number of users develops an alcohol addiction. It has long been known that particular personality types are more addiction prone than others. Here we review recent progress in the understanding of neurobiological pathways that determine personality and facilitate drug abuse. Novel approaches to characterize personality traits leading to addiction proneness in social settings in mice are discussed. A common genetic and neurobiological base for the behavioural traits of sensation seeking or a depressed phenotype and escalating alcohol consumption are reviewed. Furthermore, recent progress on how social and cognitive factors, including impulsivity and decision making, act at brain level to make an individual more vulnerable to alcohol abuse, are discussed. Altogether, this review provides an update on brain mechanisms underlying a broad spectrum of personality traits that make an individual more prone to alcohol and drug abuse and addiction.

Impaired decision making following escalation of cocaine self-administration predicts vulnerability to relapse in rats

Impairments in cost‐benefit decision making represent a cardinal feature of drug addiction. However, whether these alterations predate drug exposure, thereby contributing to facilitating loss of control over drug intake, or alternatively arise as a result of drug use and subsequently confer vulnerability to relapse has yet to be determined. Male Sprague‐Dawley rats were trained to self‐administer (SA) cocaine during 19 daily long‐access (12‐h) sessions; conditions reliably shown to promote escalation. One week after cocaine SA, rats underwent an extinction/relapse test immediately followed by conditioned stimuli–, stress‐, and drug‐primed reinstatement challenges. The influence of escalated cocaine intake on decision making was measured over time by four test sessions of a rodent analogue of the Iowa Gambling Task (rGT), once prior to cocaine exposure and then 1 day, 1 week, and 1 month after the last SA session. Substantial individual variability was observed in the influence of escalated cocaine SA on decision‐making performance. A subset of rats displayed pronounced deficits, while others showed unaffected or even improved performance on the rat Gambling Task (rGT) 24 hours after the last SA session. When challenged with a relapse test after 1 week of forced abstinence, animals that showed impaired decision making following SA displayed an increased propensity to respond for cocaine under extinction. These data suggest that decision‐making deficits in individuals with drug addiction are not antecedent to—but arise as a consequence of—drug exposure. Moreover, these data indicate that susceptibility to the deleterious effects of drugs on decision making confers vulnerability toward relapse.

Distinct relationships between risky decision making and cocaine self-administration under short- and long-access conditions

Substance use is strongly associated with impaired decision making, with cocaine use particularly linked to elevated risky and impulsive choice. It is not clear, however, whether such maladaptive decision making is a consequence of cocaine use or instead precedes and predisposes individuals to cocaine use. The current study was designed to specifically address the latter possibility with respect to risky choice in both male and female rats. Rats were first trained in a "Risky Decision-making Task" (RDT), in which they made discrete choices between a small, "safe" food reward and a large, "risky" food reward accompanied by increasing probabilities of mild footshock punishment. After reaching stable performance, rats underwent jugular catheter surgery followed by either short-access cocaine self-administration sessions (2 h, 0.5 mg/kg/infusion) for 5 days or long-access cocaine self-administration sessions (6 h, 0.5 mg/kg/infusion) for 14 days. Under short-access conditions, there was no relationship between risk preference and changes in cocaine intake over time, but greater risk aversion in females predicted greater overall cocaine intake. Under long-access conditions, heightened risk taking predicted greater escalation of cocaine intake over the course of self-administration, supporting the notion that pre-existing risk-taking behavior predicts cocaine intake. Collectively, results from these experiments have implications for understanding and identifying pre-existing vulnerabilities to substance use, which may lead to strategies to prevent development of substance use disorders.

High trait impulsivity potentiates the effects of chronic pain on impulsive behavior

•

We explored a potential relation between trait and chronic pain-induced impulsivity.

•

Low trait impulsivity rats with neuropathic pain perform similarly to controls.

•

High trait impulsivity rats are delay intolerant in chronic pain conditions.

•

Trait characteristics influence chronic pain comorbid manifestations.

Preclinical studies on impulsive decision-making in chronic pain conditions are sparse and often contradictory. Outbred rat populations are heterogeneous regarding trait impulsivity manifestations and therefore we hypothesized that chronic pain-related alterations depend on individual traits. To test this hypothesis, we used male Wistar-Han rats in two independent experiments. Firstly, we tested the impact of spared nerve injury (SNI) in impulsive behavior evaluated by the variable delay-to-signal test (VDS). In the second experiment, SNI impact on impulsivity was again tested, but in groups previously categorized as high (HI) and low (LI) trait impulsivity in the VDS.

Results showed that in an heterogenous population SNI-related impact on motor impulsivity and delay intolerance cannot be detected. However, when baseline impulsivity was considered, HI showed a significantly higher delay intolerance than the respective controls more prevalent in left-lesioned animals and appearing to result from a response correction on prematurity from VDS I to VDS II, which was present in Sham and right-lesioned animals.

In conclusion, baseline differences should be more often considered when analyzing chronic pain impact. While this study pertained to impulsive behavior, other reports indicate that this can be generalized to other behavioral dimensions and that trait differences can influence not only the manifestation of comorbid behaviors but also pain itself in a complex and not totally understood manner.

Escalation of drug use in persons dually diagnosed with opioid and cocaine dependence: Gender comparison and dimensional predictors

BACKGROUND

Persons dually diagnosed with opioid and cocaine dependence (OD + CD) present a clinical challenge and are at risk of morbidity and mortality. The time of escalation of heroin and cocaine exposure in persons with OD + CD remain understudied, and the influence of gender and other variables have not been examined. This observational study focused on the time of escalation of heroin and cocaine in volunteers with OD + CD, examining gender and exposure to other drugs (e.g., cannabis or alcohol) as predictors. Ages of first use and of onset of heaviest use of each drug were collected (in whole years). Time of escalation was defined as the interval between age of first use and onset of heaviest use.

VOLUNTEERS

sequentially ascertained adult volunteers recruited from the New York Metropolitan area, of which n = 297 were diagnosed with OD + CD.

METHODS

Instruments administered were the SCID-I diagnostic interview (DSM-IV criteria), BIS-11 impulsiveness scale, and KMSK scales, dimensional measures of maximal exposure to specific drugs.

RESULTS

In volunteers with OD + CD, ages of onset of heaviest use of cannabis (median age = 15) and alcohol (median age = 19) were in adolescence or emerging adulthood and preceded those for heroin and cocaine (median ages = 26 and 25, respectively). Maximal levels of cannabis and alcohol exposure were high, in volunteers with OD + CD. In adjusted Cox regressions, gender was not a significant predictor of time of heroin or cocaine escalation. However, more rapid time of alcohol escalation was a predictor of more rapid time of escalation of both heroin and cocaine, in volunteers with OD + CD.

Ethanol pre-exposure does not increase delay discounting in P rats, but does impair the ability to dynamically adapt behavioral allocation to changing reinforcer contingencies

Increased subjective discounting of delayed rewards is associated with substance abuse, and individuals tend to discount their drug of choice at a greater rate compared to monetary rewards. While there is evidence indicating that increased delay discounting (DD) is a risk factor for substance abuse, some results suggest that exposure to drugs of abuse also increases DD, but effects are mixed. The current study examined whether ethanol pre-exposure increases DD and if an ethanol reinforcer would be discounted at a greater rate than sucrose. Alcohol preferring (P) rats were pre-exposed to either ethanol or sucrose using an intermittent access protocol (IAP) for 8 weeks. Then animals completed an operant fixed choice procedure where each pre-exposure group was split into either an ethanol or sucrose reinforcer group. Afterwards, animals completed an adjusting delay DD task using the same groups as the fixed choice task. Animals that received access to ethanol in the IAP showed increased delayed reward preference in a delay and session dependent manner. Specifically, ethanol pre-exposed animals took more sessions to decrease their preference for the delayed reward at longer delays. In the adjusting delay task, no differences in mean adjusting delays were seen, but ethanol pre-exposure impaired animals' ability to reach stability criteria. The observed results are not consistent with ethanol pre-exposure causing a change in DD. Rather they indicate ethanol pre-exposure impaired animals' ability to reallocate their behavior in response to a change in reinforcer contingencies. The current findings extend prior results showing alcohol naïve P rats exhibit both increased DD and decreased response inhibition (Beckwith and Czachowski 2014, 2016) by demonstrating that after alcohol exposure they exhibit a form of behavioral inflexibility. Hence, a "two-hit" genetic vulnerability/environmental acceleration of addictive behavior is supported.

Effects of morphine/CP55940 mixtures on an impulsive choice task in rhesus monkeys

µ-Opioid receptor agonists are commonly used to treat pain despite their adverse effects. In preclinical studies, cannabinoid receptor agonists increase the potency of opioids for producing antinociceptive but not reinforcing effects. It is unknown whether other adverse effects of these drugs, such as impairment of complex behavior, are enhanced by their co-administration. This study characterized the effects of morphine (µ-opioid receptor agonist; 0.32-5.6 mg/kg, subcutaneously) and CP55940 (CB1/CB2 cannabinoid receptor agonist; 0.0032-0.32 mg/kg, subcutaneously), alone and in mixtures, in monkeys (n=3) choosing between one pellet delivered immediately and two pellets delivered after a delay. Two consecutive choices of the immediate or delayed reward decreased or increased, respectively, the delay. The median adjusted delay, indicating indifference between the immediate and delayed reinforcers, was increased by morphine (3.2 mg/kg) and CP55940 (0.01-0.032 mg/kg). Performance after administration of morphine (0.32 and 1 mg/kg)/CP55940 (0.0032-0.032 mg/kg) mixtures was not different from performance after CP55940 alone. Neither morphine, CP55940, nor mixtures decreased the median adjusted delay (i.e. increased impulsivity). These findings failed to confirm previous studies showing that morphine increases impulsivity, perhaps because of procedural differences among studies. Treatment of pain often requires repeated drug administration; thus, it remains to be determined whether the present findings predict the effects of chronically administered morphine/CP5540 mixtures on impulsive choice.

Shared Behavioral and Neurocircuitry Disruptions in Drug Addiction, Obesity, and Binge Eating Disorder: Focus on Group I mGluRs in the Mesolimbic Dopamine Pathway

Accumulated data from clinical and preclinical studies suggest that, in drug addiction and states of overeating, such as obesity and binge eating disorder (BED), there is an imbalance in circuits that are critical for motivation, reward saliency, executive function, and self-control. Central to these pathologies and the extensive topic of this Review are the aberrations in dopamine (DA) and glutamate (Glu) within the mesolimbic pathway. Group I metabotropic glutamate receptors (mGlus) are highly expressed in the mesolimbic pathway and are poised in key positions to modulate disruptions in synaptic plasticity and neurotransmitter release observed in drug addiction, obesity, and BED. The use of allosteric modulators of group I mGlus has been studied in drug addiction, as they offer several advantages over traditional orthosteric agents. However, they have yet to be studied in obesity or BED. With the substantial overlap between the neurocircuitry involved in drug addiction and eating disorders, group I mGlus may also provide novel targets for obesity and BED.

Changing Delay Discounting and Impulsive Choice: Implications for Addictions, Prevention, and Human Health

Delay discounting describes the tendency to devalue delayed consequences or future prospects. The degree to which an individual discounts delayed events appears trait-like in that it is stable over time and across functionally similar situations. Steeply discounting delayed rewards is correlated with most substance-use disorders, the severity of these disorders, rates of relapse to drug use, and a host of other maladaptive decisions impacting human health. Longitudinal data suggest steep delay discounting and high levels of impulsive choice are predictive of subsequent drug taking, which suggests (though does not establish) that reducing delay discounting could have a preventive health-promoting effect. Experimental manipulations that produce momentary or long-lasting reductions in delay discounting or impulsive choice are reviewed, and behavioral mechanisms that may underlie these effects are discussed. Shortcomings of each manipulation technique are discussed and areas for future research are identified. While much work remains, it is clear that impulsive decision-making can be reduced, despite its otherwise trait-like qualities. Such findings invite technique refinement, translational research, and hope.

A dual process perspective on advances in cognitive science and alcohol use disorder

There is a tremendous global and national (US) burden associated with alcohol misuse and alcohol use disorder (AUD). Further, of the mental health disorders, AUD has the widest treatment gap. Thus, there is a critical need for improved understanding of the etiology, maintenance, and treatment of AUD. The application of cognitive science to the study of AUD has a longstanding history of attempting to meet this need. In this selective review, we identified and focused on four domains of recent (i.e., in the last decade) applications of cognitive science to the study of AUD: implicit cognitive biases, executive function, behavioral economic approaches to alcohol decision making, and functional connectivity neuroimaging. We highlighted advances within these four domains and considered them in the context of dual process models of addiction, which focus on the contribution and interplay of two complementary neurocognitive systems (impulsive and control systems). Findings across the domains were generally consistent with dual process models. They also suggest the need for further model refinements, including integrating behavioral economic approaches and findings from functional connectivity neuroimaging studies. Research evaluating candidate interventions associated with these domains is emergent but promising, suggesting important directions for future research.

Juvenile exposure to methylphenidate and guanfacine in rats: effects on early delay discounting and later cocaine-taking behavior

RATIONALE

Both methylphenidate (MPH), a catecholamine reuptake blocker, and guanfacine, an alpha2A agonist, are used to treat attention-deficit hyperactivity disorder (ADHD). Childhood impulsivity, including delay discounting, is associated with increased substance use during adolescence. These effects can be mitigated by juvenile exposure to MPH, but less is known about the long-term effects of developmental exposure to guanfacine in males and females.

OBJECTIVE

This study aims to determine sex differences and dose-dependent effects of juvenile exposure to MPH or guanfacine on delay-discounting and later cocaine self-administration.

METHODS

The dose-dependent effects of vehicle, MPH (0.5, 1, and 2 mg/kg p.o.) or guanfacine (0.003, 0.03, and 0.3 mg/kg, i.p.) on discounting were determined in male and female Sprague-Dawley rats beginning at postnatal day (P)20. At P90, the amount, motivation, and sensitivity to cocaine following early drug exposure were determined with self-administration.

RESULTS

Guanfacine, but not MPH, significantly reduced weight by 22.9 ± 4.6% in females. MPH dose dependently decreased delay discounting in both juvenile males and females, while guanfacine was only effective in males. Discounting was associated with cocaine self-administration in vehicle males (R² = -0.4, P < 0.05) and self-administration was reduced by guanfacine treatment (0.3 mg/kg). Guanfacine significantly decreased cocaine sensitivity in both sexes.

CONCLUSIONS

These data suggest that MPH is effective in reducing delay discounting in both sexes. Due to both weight loss and ineffectiveness on discounting in females, guanfacine should be used only in males to reduce delay discounting and later cocaine use.

Trait determinants of impulsive behavior: a comprehensive analysis of 188 rats

Impulsivity is a naturally occurring behavior that, when accentuated, can be found in a variety of neuropsychiatric disorders. The expression of trait impulsivity has been shown to change with a variety of factors, such as age and sex, but the existing literature does not reflect widespread consensus regarding the influence of modulating effects. We designed the present study to investigate, in a cohort of significant size (188 rats), the impact of four specific parameters, namely sex, age, strain and phase of estrous cycle, using the variable delay-to-signal (VDS) task. This cohort included (i) control animals from previous experiments; (ii) animals specifically raised for this study; and (iii) animals previously used for breeding purposes. Aging was associated with a general decrease in action impulsivity and an increase in delay tolerance. Females generally performed more impulsive actions than males but no differences were observed regarding delay intolerance. In terms of estrous cycle, no differences in impulsive behavior were observed and regarding strain, Wistar Han animals were, in general, more impulsive than Sprague-Dawley. In addition to further confirming, in a substantial study cohort, the decrease in impulsivity with age, we have demonstrated that both the strain and sex influences modulate different aspects of impulsive behavior manifestations.

Sex Differences in Context-Driven Reinstatement of Methamphetamine Seeking is Associated with Distinct Neuroadaptations in the Dentate Gyrus

The present study examined differences in operant responses in adult male and female rats during distinct phases of addiction. Males and females demonstrated escalation in methamphetamine (0.05 mg/kg, i.v.) intake with females showing enhanced latency to escalate, and bingeing. Following protracted abstinence, females show reduced responses during extinction, and have greater latency to extinguish compared with males, indicating reduced craving. Females demonstrated lower context-driven reinstatement compared to males, indicating that females have less motivational significance to the context associated with methamphetamine. Whole-cell patch-clamp recordings on dentate gyrus (DG) granule cell neurons (GCNs) were performed in acute brain slices from controls and methamphetamine experienced male and female rats, and neuronal excitability was evaluated from GCNs. Reinstatement of methamphetamine seeking reduced spiking in males, and increased spiking in females compared to controls, demonstrating distinct neuroadaptations in intrinsic excitability of GCNs in males and females. Reduced excitability of GCNs in males was associated with enhanced levels of neural progenitor cells, expression of plasticity-related proteins including CaMKII, and choline acetyltransferase in the DG. Enhanced excitability in females was associated with an increased GluN2A/2B ratio, indicating changes in postsynaptic GluN subunit composition in the DG. Altered intrinsic excitability of GCNs was associated with reduced mossy fiber terminals in the hilus and pyramidal projections, demonstrating compromised neuroplasticity in the DG in both sexes. The alterations in excitability, plasticity-related proteins, and mossy fiber density were correlated with enhanced activation of microglial cells in the hilus, indicating neuroimmune responses in both sexes. Together, the present results indicate sexually dimorphic adaptive biochemical changes in excitatory neurotransmitter systems in the DG and highlight the importance of including sex as a biological variable in exploring neuroplasticity and neuroimmune changes that predict enhanced relapse to methamphetamine-seeking behaviors.

Interventions aimed at changing impulsive choice in rats: Effects of immediate and relatively long delay to reward training

A relatively strong preference for smaller-sooner rewards (SSR) over larger-later rewards (LLR) is associated with a host of maladaptive behavioral patterns. As such, the clinical implications for increasing preference for LLR are profound. There is a growing body of literature that suggests extended exposure to delayed reward may increase preference for LLR in rats. However, questions remain about the underlying mechanism driving this effect and the extent to which extended exposure to immediate rewards may decrease LLR choice. In Experiment 1, we tested effects of a differential-reinforcement-of-low-rates schedule (DRL) to increase LLR choice using a pretest/posttest design with Wistar rats as subjects. We compared this group to a group of rats exposed to a differential-reinforcement-of-high-rates schedule (DRH). The DRH intervention has never been employed in this research context, but explicitly programs an immediate response-reinforcement requirement. In Experiment 2, we tested effects of an intervention with a delay longer than those used in the delay discounting pretest and posttest. No previous research has tested effects of an intervention delay this long, relative to the delay discounting task. We compared this group to a group exposed to a delay that was part of the delay discounting pretest and posttest and to a group exposed to a traditional no-delay, fixed-ratio (FR) 2 control intervention. In both experiments, we found that exposure to delayed rewards in the intervention phase significantly increased LLR choice relative to pretest performance. These findings replicate and extend a growing body of literature showing that delay exposure increases preference for LLR. We also found significant decreases in LLR choice from pretest to posttest in the DRH and no-delay intervention groups in Experiments 1 and 2, respectively. This is the first report of such an effect and has implications for understanding and interpreting effects of delay exposure training in past and future research. Our results also suggested no relationship between improved temporal tracking of reward and increases in LLR choice as a result of delay exposure training.

Kappa opioid receptors mediate yohimbine-induced increases in impulsivity in the 5-choice serial reaction time task

Dynorphin (DYN), and its receptor, the kappa opioid receptor (KOR) are involved in drug seeking and relapse but the mechanisms are poorly understood. One hypothesis is that DYN/KOR activation promotes drug seeking through increased impulsivity, because many stimuli that induce DYN release increase impulsivity. Here, we systematically compare the effects of drugs that activate DYN/KOR on performance on the 5-choice serial reaction time task (5-CSRTT), a test of sustained attention and impulsivity. In Experiment 1, we determined the effects of U50,488 (0, 2.5, 5 mg/kg), yohimbine (0, 1.25, 2.5 mg/kg), and nicotine (0, 0.15, 0.3 mg/kg) on 5-CSRTT performance. In Experiment 2, we determined the effects of alcohol (0, 0.5, 1.0, 1.5 g/kg) on 5-CSRTT performance before and after voluntary, intermittent alcohol exposure. In Experiment 3, we determined the potential role of KOR in the pro-impulsive effects of yohimbine (1.25 mg/kg) and nicotine (0.3 mg/kg) by the prior administration of the KOR antagonist nor-BNI (10 mg/kg). Premature responding, the primary measure of impulsivity, was reduced by U50,488 and alcohol, but these drugs had a general suppressive effect. Yohimbine and nicotine increased premature responding. Yohimbine-, but not nicotine-induced increases in premature responding were blocked by nor-BNI, suggesting that impulsivity induced by yohimbine is KOR dependent. This may suggests a potential role for KOR-mediated increases in impulsivity in yohimbine-induced reinstatement.

Experimental reductions of delay discounting and impulsive choice: A systematic review and meta-analysis

Many behaviors posing significant risks to public health are characterized by repeated decisions to forego better long-term outcomes in the face of immediate temptations. Steeply discounting the value of delayed outcomes often underlies a pattern of impulsive choice. Steep delay discounting is correlated with addictions (e.g., substance abuse, obesity) and behaviors such as seatbelt use and risky sexual activity. As evidence accumulates suggesting steep delay discounting plays a causal role in these maladaptive behaviors, researchers have begun testing methods for reducing discounting. In this first systematic and comprehensive review of this literature, the findings of 92 articles employing different methodologies to reduce discounting are evaluated narratively and meta-analytically. Although most of the methods reviewed produced significant reductions in discounting, they varied in effect sizes. Most methods were ideal for influencing one-off choices (e.g., framing and priming manipulations), although other successful manipulations, such as episodic future thinking, could be incorporated into existing therapies designed to produce longer-lasting changes in decision-making. The largest and longest-lasting effects were produced by learning-based manipulations, although translational research is needed to determine the generality and clinical utility of these methods. Methodological shortcomings in the existing literature and suggestions for ameliorating these issues are discussed. This review reveals a variety of methods with translational potential, which, through continued refinement, may prove effective in reducing impulsive choice and its associated maladaptive decisions that negatively impact quality of life. (PsycINFO Database Record

Impulsive choice and pre-exposure to delays: iv. effects of delay- and immediacy-exposure training relative to maturational changes in impulsivity

Impulsive choice describes preference for smaller, sooner rewards over larger, later rewards. Excessive delay discounting (i.e., rapid devaluation of delayed rewards) underlies some impulsive choices, and is observed in many maladaptive behaviors (e.g., substance abuse, gambling). Interventions designed to reduce delay discounting may provide therapeutic gains. One such intervention provides rats with extended training with delayed reinforcers. When compared to a group given extended training with immediate reinforcers, delay-exposed rats make significantly fewer impulsive choices. To what extent is this difference due to delay-exposure training shifting preference toward self-control or immediacy-exposure training (the putative control group) shifting preference toward impulsivity? The current study compared the effects of delay- and immediacy-exposure training to a no-training control group and evaluated within-subject changes in impulsive choice across 51 male Wistar rats. Delay-exposed rats made significantly fewer impulsive choices than immediacy-exposed and control rats. Between-group differences in impulsive choice were not observed in the latter two groups. While delay-exposed rats showed large, significant pre- to posttraining reductions in impulsive choice, immediacy-exposed and control rats showed small reductions in impulsive choice. These results suggest that extended training with delayed reinforcers reduces impulsive choice, and that extended training with immediate reinforcers does not increase impulsive choice.

Durability and generalizability of time-based intervention effects on impulsive choice in rats

Impulsive choice involves choosing a smaller-sooner (SS) reward over a larger-later (LL) reward. Due to the importance of timing processes in impulsive choice, time-based interventions have been developed to decrease impulsive choice. The present set of experiments assessed the durability and generalizability of time-based interventions. Experiment 1 assessed fixed interval (FI) or variable interval (VI) intervention efficacy over 9 months. The FI intervention decreased impulsive choice, and this effect persisted over time, but the VI intervention effects were only apparent when tested immediately after the intervention. Experiment 2 examined the generalizability of the FI and VI interventions on choice tasks manipulating the SS delay, LL delay, or LL magnitude. The FI intervention decreased sensitivity to delay, promoting LL choices in both delay tasks, but the VI intervention only altered choices when manipulating the SS delay. Experiment 3 further examined the FI intervention effects on tasks that manipulated the LL delay or magnitude immediately following the intervention. The intervention decreased sensitivity to both delay and magnitude. The experiments indicate that the FI intervention is effective at decreasing impulsive choice behavior for an extended period across changing delays and magnitudes, suggesting a relatively broad effect on choice behavior.

Dissecting drug effects in preclinical models of impulsive choice: emphasis on glutamatergic compounds

RATIONALE

Impulsive choice is often measured with delay discounting paradigms. Because there are multiple discounting procedures, as well as different statistical analyses that can be applied to data generated from these paradigms, there are some inconsistencies in the literature regarding drug effects on impulsive choice.

OBJECTIVES

The goal of the current paper is to review the methodological and analytic approaches used to measure discounting and to discuss how these differences can account for differential drug effects observed across studies.

RESULTS

Because some procedures/analyses use a single data point as the dependent variable, changes in this value following pharmacological treatment may be interpreted as alterations in sensitivity to delayed reinforcement, but when other procedures/analyses are used, no changes in behavior are observed. Even when multiple data points are included, some studies show that the statistical analysis (e.g., ANOVA on raw proportion of responses vs. using hyperbolic/exponential functions) can lead to different interpretations. Finally, procedural differences (e.g., delay presentation order, signaling the delay to reinforcement, etc.) in the same discounting paradigm can alter how drugs affect sensitivity to delayed reinforcement.

CONCLUSIONS

Future studies should utilize paradigms that allow one to observe alterations in responding at each delay (e.g., concurrent-chains schedules). Concerning statistical analyses, using parameter estimates derived from nonlinear functions or incorporating the generalized matching law can allow one to determine if drugs affect sensitivity to delayed reinforcement or impair discrimination of the large and small magnitude reinforcers. Using these approaches can help further our understanding of the neurochemical underpinnings of delay discounting.

Sex differences in animal models of decision making

The ability to weigh the costs and benefits of various options to make an adaptive decision is critical to an organism's survival and wellbeing. Many psychiatric diseases are characterized by maladaptive decision making, indicating a need for better understanding of the mechanisms underlying this process and the ways in which it is altered under pathological conditions. Great strides have been made in uncovering these mechanisms, but the majority of what is known comes from studies conducted solely in male subjects. In recent years, decision-making research has begun to include female subjects to determine whether sex differences exist and to identify the mechanisms that contribute to such differences. This Mini-Review begins by describing studies that have examined sex differences in animal (largely rodent) models of decision making. Possible explanations, both theoretical and biological, for such differences in decision making are then considered. The Mini-Review concludes with a discussion of the implications of sex differences in decision making for understanding psychiatric conditions. © 2016 Wiley Periodicals, Inc.

Modeling the development of drug addiction in male and female animals

An increasing emphasis has been placed on the development and use of animal models of addiction that capture defining features of human drug addiction, including escalation/binge drug use, enhanced motivation for the drug, preference for the drug over other reward options, use despite negative consequences, and enhanced drug-seeking/relapse vulnerability. The need to examine behavior in both males and females has also become apparent given evidence demonstrating that the addiction process occurs differently in males and females. This review discusses the procedures that are used to model features of addiction in animals, as well as factors that influence their development. Individual differences are also discussed, with a particular focus on sex differences. While no one procedure consistently produces all characteristics, different models have been developed to focus on certain characteristics. A history of escalating/binge patterns of use appears to be critical for producing other features characteristic of addiction, including an enhanced motivation for the drug, enhanced drug seeking, and use despite negative consequences. These characteristics tend to emerge over abstinence, and appear to increase rather than decrease in magnitude over time. In females, these characteristics develop sooner during abstinence and/or following less drug exposure as compared to males, and for psychostimulant addiction, may require estradiol. Although preference for the drug over other reward options has been demonstrated in non-human primates, it has been more difficult to establish in rats. Future research is needed to define the parameters that optimally induce each of these features of addiction in the majority of animals. Such models are essential for advancing our understanding of human drug addiction and its treatment in men and women.

Lateral Habenula Involvement in Impulsive Cocaine Seeking

The lateral habenula (LHb) is a brain structure receiving inputs from limbic forebrain areas and innervating major midbrain monoaminergic nuclei. Evidence indicates LHb involvement in sleep control, reward-based decision making, avoidance of punishment, and responses to stress. Additional work has established that the LHb mediates negative feedback in response to aversive events. As a hallmark of drug addiction is the inability to limit drug use despite negative consequences, we hypothesize that LHb dysfunction may have a role in the lack of control over drug seeking. Here we examine the effects of LHb inactivation in control over drug seeking in several cocaine self-administration (SA) paradigms in rats. We find that inhibition of the LHb with GABAergic agonists did not alter cocaine SA under progressive ratio or seeking/taking chained reinforcement schedules, or during punishment-induced suppression of cocaine-reinforced responding. In contrast, LHb inhibition increased cocaine seeking when the drug was not available in rats trained to discriminate its presence using an environmental cue. This effect of LHb inhibition was selective for cocaine, as it did not impair responding for sucrose reinforcement. The effect of LHb injection of GABA agonists was mimicked by intra-LHb muscarinic cholinergic (mACh) antagonist injection, and activation of mACh receptors excited a majority of LHb neurons in in vitro electrophysiology experiments. These results indicate that the LHb participates in the suppression of impulsive responding for cocaine through the activation of a cholinergic circuit, and they suggest that LHb dysfunction may contribute to impaired impulse control associated with drug addiction.

Impulsive Rats Exhibit Blunted Dopamine Release Dynamics during a Delay Discounting Task Independent of Cocaine History

The inability to wait for a large, delayed reward when faced with a small, immediate one, known as delay discounting, has been implicated in a number of disorders including substance abuse. Individual differences in impulsivity on the delay discounting task are reflected in differences in neural function, including in the nucleus accumbens (NAc) core. We examined the role of a history of cocaine self-administration, as well as individual differences in impulsivity, on rapid dopamine (DA) release dynamics in the NAc core. Rats with a history of cocaine or water/saline self-administration were tested on delay discounting while being simultaneously assayed for rapid DA release using electrochemical methods. In controls, we found that cue DA release was modulated by reward delay and magnitude, consistent with prior reports. A history of cocaine had no effect on either delay discounting or DA release dynamics. Nonetheless, independent of drug history, individual differences in impulsivity were related to DA release in the NAc core. First, high impulsive animals exhibited dampened cue DA release during the delay discounting task. Second, reward delay and magnitude in high impulsive animals failed to robustly modulate changes in cue DA release. Importantly, these two DAergic mechanisms were uncorrelated with each other and, together, accounted for a high degree of variance in impulsive behavior. Collectively, these findings demonstrate two distinct mechanisms by which rapid DA signaling may influence impulsivity, and illustrate the importance of NAc core DA release dynamics in impulsive behavior.