Impact of strain and D-amphetamine on impulsivity (delay discounting) in inbred mice

Adult and adolescent antipsychotic exposure increases delay discounting and diminishes behavioral flexibility in male C57BL/6 mice

Second-generation antipsychotics are frequently prescribed to adolescents, but the long-term consequences of their use remain understudied. These medications work via monoamine neurotransmitter systems, especially dopamine and serotonin, which undergo considerable development and pruning during adolescence. Dopamine and serotonin are linked to a wide host of behaviors, including impulsive choice and behavioral plasticity. In a murine model of adolescent antipsychotic use, male C57BL/6 mice were exposed to either 2.5 mg/kg/day risperidone or 5 mg/kg/day olanzapine via drinking water from postnatal days 22-60. To determine whether the adolescent period was uniquely sensitive to antipsychotic exposure, long-term effects on behavior were compared to an equivalently exposed group of adults where mice were exposed to 2.5 mg/kg risperidone from postnatal days 101-138. Motor activity and body weight in adolescent animals were assessed. Thirty days after exposure terminated animal's behavioral flexibility and impulsive choice were assessed using spatial discrimination reversal and delay discounting. Antipsychotic exposure produced a modest change in behavior flexibility during the second reversal. There was a robust and reproducible difference in impulsive choice: exposed animals devalued the delayed alternative reward substantially more than controls. This effect was observed both following adolescent and adult exposure, indicating that an irreversible change in impulsive choice occurs regardless of the age of exposure.

Pharmacological Modulation of Temporal Discounting: A Systematic Review

Temporal discounting is a phenomenon where a reward loses its value as a function of time (e.g., a reward is more valuable immediately than when it delays in time). This is a type of intertemporal decision-making that has an association with impulsivity and self-control. Many pathologies exhibit higher discounting rates, meaning they discount more the values of rewards, such as addictive behaviors, bipolar disorder, attention-deficit/hyperactivity disorders, social anxiety disorders, and major depressive disorder, among others; thus, many studies look for the mechanism and neuromodulators of these decisions. This systematic review aims to investigate the association between pharmacological administration and changes in temporal discounting. A search was conducted in PubMed, Scopus, Web of Science, Science Direct and Cochrane. We used the PICO strategy: healthy humans (P-Participants) that received a pharmacological administration (I-Intervention) and the absence of a pharmacological administration or placebo (C-Comparison) to analyze the relationship between the pharmacological administration and the temporal discounting (O-outcome). Nineteen studies fulfilled the inclusion criteria. The most important findings were the involvement of dopamine modulation in a U-shape for choosing the delayed outcome (metoclopradime, haloperidol, and amisulpride). Furthermore, administration of tolcapone and high doses of d-amphetamine produced a preference for the delayed option. There was a time-dependent hydrocortisone effect in the preference for the immediate reward. Thus, it can be concluded that dopamine is a crucial modulator for temporal discounting, especially the D2 receptor, and cortisol also has an important time-dependent role in this type of decision. One of the limitations of this systematic review is the heterogeneity of the drugs used to assess the effect of temporal discounting.

Sequential delay and probability discounting tasks in mice reveal anchoring effects partially attributable to decision noise

Delay discounting and probability discounting decision making tasks in rodent models have high translational potential. However, it is unclear whether the discounted value of the large reward option is the main contributor to variability in animals' choices in either task, which may limit translation to humans. Male and female mice underwent sessions of delay and probability discounting in sequence to assess how choice behavior adapts over experience with each task. To control for "anchoring" (persistent choices based on the initial delay or probability), mice experienced "Worsening" schedules where the large reward was offered under initially favorable conditions that became less favorable during testing, followed by "Improving" schedules where the large reward was offered under initially unfavorable conditions that improved over a session. During delay discounting, both male and female mice showed elimination of anchoring effects over training. In probability discounting, both sexes of mice continued to show some anchoring even after months of training. One possibility is that "noisy", exploratory choices could contribute to these persistent anchoring effects, rather than constant fluctuations in value discounting. We fit choice behavior in individual animals using models that included both a value-based discounting parameter and a decision noise parameter that captured variability in choices deviating from value maximization. Changes in anchoring behavior over time were tracked by changes in both the value and decision noise parameters in delay discounting, but by the decision noise parameter in probability discounting. Exploratory decision making was also reflected in choice response times that tracked the degree of conflict caused by both uncertainty and temporal cost, but was not linked with differences in locomotor activity reflecting chamber exploration. Thus, variable discounting behavior in mice can result from changes in exploration of the decision options rather than changes in reward valuation.

The effects of early life stress on impulsivity

Elevated impulsivity is a symptom shared by various psychiatric disorders such as substance use disorder, bipolar disorder, and attention-deficit/hyperactivity disorder. However, impulsivity is not a unitary construct and impulsive behaviors fall into two subcategories: impulsive action and impulsive choice. Impulsive choice refers to the tendency to prefer immediate, small rewards over delayed, large rewards, whereas impulsive action involves difficulty inhibiting rash, premature, or mistimed behaviors. These behaviors are mediated by the mesocorticolimbic dopamine (DA) system, which consists of projections from the ventral tegmental area to the nucleus accumbens and prefrontal cortex. Early life stress (ELS) alters both impulsive choice and impulsive action in rodents. ELS also changes DA receptor expression, transmission, and activity within the mesocorticolimbic system. This review integrates the dopamine, impulsivity, and ELS literature to provide evidence that ELS alters impulsivity via inducing changes in the mesocorticolimbic DA system. Understanding how ELS affects brain circuits associated with impulsivity can help advance treatments aimed towards reducing impulsivity symptoms in a variety of psychiatric disorders.

Impulsivity and risk-seeking as Bayesian inference under dopaminergic control

Bayesian models successfully account for several of dopamine (DA)'s effects on contextual calibration in interval timing and reward estimation. In these models, tonic levels of DA control the precision of stimulus encoding, which is weighed against contextual information when making decisions. When DA levels are high, the animal relies more heavily on the (highly precise) stimulus encoding, whereas when DA levels are low, the context affects decisions more strongly. Here, we extend this idea to intertemporal choice and probability discounting tasks. In intertemporal choice tasks, agents must choose between a small reward delivered soon and a large reward delivered later, whereas in probability discounting tasks, agents must choose between a small reward that is always delivered and a large reward that may be omitted with some probability. Beginning with the principle that animals will seek to maximize their reward rates, we show that the Bayesian model predicts a number of curious empirical findings in both tasks. First, the model predicts that higher DA levels should normally promote selection of the larger/later option, which is often taken to imply that DA decreases 'impulsivity,' and promote selection of the large/risky option, often taken to imply that DA increases 'risk-seeking.' However, if the temporal precision is sufficiently decreased, higher DA levels should have the opposite effect-promoting selection of the smaller/sooner option (higher impulsivity) and the small/safe option (lower risk-seeking). Second, high enough levels of DA can result in preference reversals. Third, selectively decreasing the temporal precision, without manipulating DA, should promote selection of the larger/later and large/risky options. Fourth, when a different post-reward delay is associated with each option, animals will not learn the option-delay contingencies, but this learning can be salvaged when the post-reward delays are made more salient. Finally, the Bayesian model predicts correlations among behavioral phenotypes: Animals that are better timers will also appear less impulsive.

The Effects of Drug Treatments for ADHD in Measures of Cognitive Performance

Based on core symptoms of inattention and deficient impulse control, and the identification of effective pharmacotherapies such as amphetamine (AMP; Adderall^®), methylphenidate (MPH; Ritalin^®), and atomoxetine (ATX; Strattera^®), ADHD is a clinical condition which provides opportunity for translational research. Neuropsychological tests such as the 5-Choice and Continuous Performance Tasks, which measure aspects of attention and impulse control in animals and humans, provide scope for both forward (animal to human) and reverse (human to animal) translation. Rodent studies support pro-attentive effects of AMP and MPH and effectiveness in controlling some forms of impulsive behavior. In contrast, any pro-attentive effects of ATX appear to be less consistent, the most reliable effects of ATX are recorded in tests of impulsivity. These differences may account for AMP and MPH being recognized as first-line treatments for ADHD with a higher efficacy relative to ATX. DSM-5 classifies three "presentations" of ADHD: predominantly inattentive type (ADHD-I), predominantly hyperactive/impulsive type (ADHD-HI), or combined (ADHD-C). Presently, it is unclear whether AMP, MPH, or ATX has differential levels of efficacy across these presentation types. Nonetheless, these studies encourage confidence for the forward translation of NCEs in efforts to identify newer pharmacotherapies for ADHD.

Zebrafish choice behavior is sensitive to reinforcer rate, immediacy, and magnitude ratios

Behavioral flexibility has, in part, been defined by choice behavior changing as a function of changes in reinforcer payoffs. We examined whether the generalized matching law quantitatively described changes in choice behavior in zebrafish when relative reinforcer rates, delays/immediacy, and magnitudes changed between two alternatives across conditions. Choice was sensitive to each of the three reinforcer properties. Sensitivity estimates to changes in relative reinforcer rates were greater when 2 variable-interval schedules were arranged independently between alternatives (Experiment 1a) than when a single schedule pseudorandomly arranged reinforcers between alternatives (Experiment 1b). Sensitivity estimates for changes in relative reinforcer immediacy (Experiment 2) and magnitude (Experiment 3) were similar but lower than estimates for reinforcer rates. These differences in sensitivity estimates are consistent with studies examining other species, suggesting flexibility in zebrafish choice behavior in the face of changes in payoff as described by the generalized matching law.

Contrasting effects of d-amphetamine and atomoxetine on measures of impulsive action and choice

Amphetamine (AMP) and atomoxetine (ATX) represent two of the most widely studied drug treatments used in the investigation of impulsive behaviour. While both drugs have relatively well defined effects in tests designed to investigate impulsive action (e.g. 5-choice task; 5-CSRTT), the effects of both drugs in tests of impulsive choice (e.g. delay discounting) are less consistent. In the present study both AMP and ATX were tested in a rodent gambling task (rGT) and delay discounting in rats separately trained to either an ascending or descending delay schedule. Effects of both drugs were compared to measures of impulsive action (premature (PREM) responses) and perseverative (PSV) responses measured in the 5-choice and rGT tasks. Consistent with previous studies, AMP (0.1-1 mg/kg) increased both PREM and PSV responses, and ATX (0.5-2 mg/kg) reduced both measures in the 5-choice and rGT tasks. At equivalent doses ATX had no reliable effect on choice behaviour in either the rGT or delay discounting suggesting a null effect of this drug on impulsive choice and risky decision making. The effects of AMP were more complex, with a subtle shift in preference to a low risk (P1) choice in the rGT, and an effect on discounting that was unrelated to reinforcer value, but instead dependent on delay sequence and baseline choice preference. One aspect to these outcomes is to highlight the importance of multiple methodological factors when assessing drug effects on complex behaviours such as impulsive choice, and question what are the most appropriate test conditions under which to examine these drugs on discounting.

Delay discounting rate by a surrogate decision maker depends on the smoking status of the recipient

The tendency to devalue future rewards is known as delay discounting. Discounting is measured using a series of intertemporal choices between smaller, sooner outcomes and larger, later outcomes. We used a surrogate delay discounting task to explore whether such choices would differ if a hypothetical recipient was a smoker or was an individual with good health habits. Across three studies, the descriptions of the recipient included only information about smoking status (n = 66), smoking status and equal annual income (n = 47), and smoking status and equal weekly expenditures (n = 42). Higher rates of delay discounting for the smoker recipient compared to the nonsmoker recipient were observed across all three studies. These results parallel previous findings showing group differences in discounting between actual smokers and nonsmokers. We discuss the similarities between the present results and previous studies in light of an extension of Bem's (1967) self-perception theory, which posits that choices in laboratory-based delay discounting tasks are informed by observation of real-world intertemporal choice. The theory asserts that there is no fundamental difference between a first-person account of such knowledge and a third-person account. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Reducing impulsive choice VII: effects of duration of delay-exposure training

Impulsive choice is related to substance use disorders, obesity, and other behaviors that negatively impact human health. Reducing impulsive choice may prove beneficial in ameliorating these maladaptive behaviors. Preclinical research in rats indicates that one reliable method for producing large and lasting reductions in impulsive choice is delay-exposure (DE) training. In all six of the prior DE-training experiments, rats were given extensive experience (~ 120 training sessions) with a delayed reinforcement contingency. The present experiment evaluated if similar large and lasting reductions in impulsive choice could be achieved with less training. The duration of DE training between groups of male Wistar rats was 0 sessions (training ended after a lever-pressing acquisition criterion was met), 30, 60, or 120 sessions. Comparison groups were given the same durations of training with immediate reinforcement. A post-training assessment of impulsive choice was completed using an increasing-delay procedure. For rats assigned to the 60-session condition, impulsive choice was reassessed at a 120-day follow-up. DE training reduced impulsive choice but, contrary to expectation, reductions in impulsive choice did not increase with DE-training duration (no significant training-duration by group interaction). Importantly, 60 sessions of DE training produced reductions in impulsive choice that were comparable to prior published findings and this effect remained significant at the 120-day follow-up. Procedural elements that may be responsible for the DE-training effect, and how they could be improved in future experiments, are discussed.

Animal models of liability to post-traumatic stress disorder: going beyond fear memory

In this review, we advocate a dimensional approach on the basis of candidate endophenotypes to the development of animal models of post-traumatic stress disorder (PTSD) capable of including genetic liability factors, variations in symptoms profile and underlying neurobiological mechanisms, and specific comorbidities. Results from the clinical literature pointed to two candidate endophenotypes of PTSD: low sensory gating and high waiting impulsivity. Findings of comparative studies in mice of two inbred strains characterized by different expressions of the two candidate endophenotypes showed different strain-specific neural and behavioral effects of stress experiences. Thus, mice of the standard C57BL/6J strain show stress-induced helplessness, stress-learned helplessness, and stress-extinction-resistant conditioned freezing. Instead, mice of the genetically unrelated DBA/2J strain, expressing both candidate endophenotypes, show stress-induced extinction-resistant avoidance and neural and behavioral phenotypes promoted by prolonged exposure to addictive drugs. These strain differences are in line with evidence of associations between genetic variants and specific stress-promoted pathological profiles in PTSD, support a role of genotype in determining different PTSD comorbidities, and offer the means to investigate specific pathogenic processes.

Risk taking and impulsive behaviour: fundamental discoveries, theoretical perspectives and clinical implications

Our willingness to take risks, our ability to wait or the speed with which to make decisions are central features of our personality. However, it is now recognized that impulsive and risk-taking behaviours are not a unitary construct, and different aspects can be both psychologically and neurally dissociated. The range of neurochemicals and brain systems that govern these behaviours is extensive, and this may be a contributing factor to the phenotypic range seen in the human population. However, this variety can also be pathological as extremes in risk-taking and impulsive behaviours are characteristics of many neuropsychiatric and indeed neurodegenerative disorders. This spans obsessive-compulsive disorder, where behaviour becomes ridged and non-spontaneous, to the nonsensical risk-taking seen in gambling and drug taking. This article is part of the theme issue 'Risk taking and impulsive behaviour: fundamental discoveries, theoretical perspectives and clinical implications'.

Translational tests involving non-reward: methodological considerations

This review is concerned with methods for assessing the processing of unrewarded responses in experimental animals and the mechanisms underlying performance of these tasks. A number of clinical populations, including Parkinson's disease, depression, compulsive disorders, and schizophrenia demonstrate either abnormal processing or learning from non-rewarded responses in laboratory-based reinforcement learning tasks. These effects are hypothesized to result from disturbances in modulatory neurotransmitter systems, including dopamine and serotonin. Parallel work in experimental animals has revealed consistent behavioral patterns associated with non-reward and, consistent with the human literature, modulatory roles for specific neurotransmitters. Classical tests involving an important reward omission component include appetitive extinction, ratio schedules of responding, reversal learning, and delay and probability discounting procedures. In addition, innovative behavioral tests have recently been developed leverage probabilistic feedback to specifically assay accommodation of, and learning from, non-rewarded responses. These procedures will be described and reviewed with discussion of the behavioral and neural determinants of performance. A final section focusses specifically on the benefits of trial-by-trial analysis of responding during such tasks, and the implications of such analyses for the translation of findings to clinical studies.

Dopaminergic Neurotransmission in Patients With Parkinson's Disease and Impulse Control Disorders: A Systematic Review and Meta-Analysis of PET and SPECT Studies

Background: Around 30% Parkinson's disease (PD) patients develop impulse control disorders (ICDs) to D_2/3 dopamine agonists and, to a lesser extent, levodopa. We aim to investigate striatal dopaminergic function in PD patients with and without ICD.

Methods: PubMed, Science Direct, EBSCO, and ISI Web of Science databases were searched (from inception to March 7, 2018) to identify PET or SPECT studies reporting striatal dopaminergic function in PD patients with ICD (ICD+) compared to those without ICD (ICD–). Studies which included drug naïve patients, explored non-pharmacological procedures (e.g., deep brain stimulation), and those using brain blood perfusion or non-dopaminergic markers were excluded. Standardized mean difference (SDM) was used and random-effect models were applied. Separate meta-analyses were performed for dopamine transporter level, dopamine release, and dopamine receptors availability in the putamen, caudate, dorsal, and ventral striatum.

Results: A total of 238 studies were title and abstract screened, of which 19 full-texts were assessed. Nine studies (ICD+: N = 117; ICD–: N = 175 patients) were included in the analysis. ICD+ showed a significant reduction of dopamine transporter binding in the putamen (SDM = −0.46; 95% CI: −0.80, −0.11; Z = 2.61; p = 0.009), caudate (SDM = −0.38; 95% CI: −0.73, −0.04; Z = 2.18; p = 0.03) and dorsal striatum (SDM = −0.45; 95% CI: −0.77, −0.13; Z = 2.76; p = 0.006), and increased dopamine release to reward-related stimuli/gambling tasks in the ventral striatum (SDM = −1.04; 95% CI: −1.73, −0.35; Z = 2.95; p = 0.003). Dopamine receptors availability did not differ between groups. Heterogeneity was low for dopamine transporter in the dorsal striatum (I² = 0%), putamen (I² = 0%) and caudate (I² = 0%), and pre-synaptic dopamine release in the dorsal (I² = 0%) and ventral striatum (I² = 0%); heterogeneity was high for dopamine transporter levels in the ventral striatum (I² = 80%), and for dopamine receptors availability in the ventral (I² = 89%) and dorsal (I² = 86%) striatum, putamen (I² = 93%), and caudate (I² = 71%).

Conclusions: ICD+ patients show lower dopaminergic transporter levels in the dorsal striatum and increased dopamine release in the ventral striatum when engaged in reward-related stimuli/gambling tasks. This dopaminergic imbalance might represent a biological substrate for ICD in PD. Adequately powered longitudinal studies with drug naïve patients are needed to understand whether these changes may represent biomarkers of premorbid vulnerability to ICD.

Towards validation of delay discounting in the pigeon

A series of procedures were conducted in an attempt to assess various forms of validity related to the use of pigeons in research on delay discounting. In separate experimental arrangements, pigeons pressed a treadle, pecked a lit key, pecked a darkened key, or pecked a lit key with a hold as the required response. First, the obtained results were consistent with what would be necessary if the construct of delay discounting were being measured, which provides evidence of face validity. Second, criterion validity was assessed by comparing individual differences in rates of discounting across procedures. Third, to assess internal validity, each pigeon repeated the Treadle, Key Peck, and Dark Key procedures. Again, at both the aggregate and individual levels, the obtained indifference points did not differ systematically between replications. Finally, to assess external validity, discounting was observed regardless of the procedure, where the patterns of data at the aggregate level, and generally at the individual level, were orderly and well described by a hyperbolic function. In addition, rates of discounting were similar when pigeons pecked a lit key, a dark key, or a key with a hold; and each of those rates of discounting tended to be steeper than when treadle pressing. Generally speaking, pigeons that discounted relatively steeply on one procedure also tended to discount relatively steeply on the other procedures. The procedures evidence some of the necessary elements involved with the use of pigeons in research on delay discounting.

Dissecting drug effects in preclinical models of impulsive choice: emphasis on glutamatergic compounds

RATIONALE

Impulsive choice is often measured with delay discounting paradigms. Because there are multiple discounting procedures, as well as different statistical analyses that can be applied to data generated from these paradigms, there are some inconsistencies in the literature regarding drug effects on impulsive choice.

OBJECTIVES

The goal of the current paper is to review the methodological and analytic approaches used to measure discounting and to discuss how these differences can account for differential drug effects observed across studies.

RESULTS

Because some procedures/analyses use a single data point as the dependent variable, changes in this value following pharmacological treatment may be interpreted as alterations in sensitivity to delayed reinforcement, but when other procedures/analyses are used, no changes in behavior are observed. Even when multiple data points are included, some studies show that the statistical analysis (e.g., ANOVA on raw proportion of responses vs. using hyperbolic/exponential functions) can lead to different interpretations. Finally, procedural differences (e.g., delay presentation order, signaling the delay to reinforcement, etc.) in the same discounting paradigm can alter how drugs affect sensitivity to delayed reinforcement.

CONCLUSIONS

Future studies should utilize paradigms that allow one to observe alterations in responding at each delay (e.g., concurrent-chains schedules). Concerning statistical analyses, using parameter estimates derived from nonlinear functions or incorporating the generalized matching law can allow one to determine if drugs affect sensitivity to delayed reinforcement or impair discrimination of the large and small magnitude reinforcers. Using these approaches can help further our understanding of the neurochemical underpinnings of delay discounting.

Amphetamine Modestly Improves Conners' Continuous Performance Test Performance in Healthy Adults

OBJECTIVES

Amphetamine improves vigilance as assessed by continuous performance tests (CPT) in children and adults with attention deficit hyperactivity disorder (ADHD). Less is known, however, regarding amphetamine effects on vigilance in healthy adults. Thus, it remains unclear whether amphetamine produces general enhancement of vigilance or if these effects are constrained to the remediation of deficits in patients with ADHD.

METHODS

We tested 69 healthy adults (35 female) on a standardized CPT (Conner's CPT-2) after receiving 10- or 20-mg d-amphetamine or placebo. To evaluate potential effects on learning, impulsivity, and perseveration, participants were additionally tested on the Iowa Gambling Task (IGT) and Wisconsin Card Sorting Task (WCST).

RESULTS

Participants receiving placebo exhibited the classic vigilance decrement, demonstrated by a significant reduction in attention (D') across the task. This vigilance decrement was not observed, however, after either dose of amphetamine. Consistent with enhanced vigilance, the 20-mg dose also reduced reaction time variability across the task and the ADHD confidence index. The effects of amphetamine appeared to be selective to vigilance since no effects were observed on the IGT, WCST, or response inhibition/perseveration measures from the CPT.

CONCLUSIONS

The present data support the premise that amphetamine improves vigilance irrespective of disease state. Given that amphetamine is a norepinephrine/dopamine transporter inhibitor and releaser, these effects are informative regarding the neurobiological substrates of attentional control. (JINS, 2018, 24, 283-293).

Pharmacotherapies for decreasing maladaptive choice in drug addiction: Targeting the behavior and the drug

Drug addiction can be conceptualized as a disorder of maladaptive decision making in which drugs are chosen at the expense of pro-social, nondrug alternatives. The study of decision making in drug addiction has focused largely on the role of impulsivity as a facilitator of addiction, in particular the tendency for drug abusers to choose small, immediate gains over larger but delayed outcomes (i.e., delay discounting). A parallel line of work, also focused on decision making in drug addiction, has focused on identifying the determinants underlying the choice to take drugs over nondrug alternatives (i.e., drug vs. nondrug choice). Both tracks of research have been valuable tools in the development of pharmacotherapies for treating maladaptive decision making in drug addiction, and a number of common drugs have been studied in both designs. However, we have observed that there is little uniformity in the administration regimens of potential treatments between the designs, which hinders congruence in the development of single treatment strategies to reduce both impulsive behavior and drug choice. The current review provides an overview of the drugs that have been tested in both delay-discounting and drug-choice designs, and focuses on drugs that reduced the maladaptive choice in both designs. Suggestions to enhance congruence between the findings in future studies are provided. Finally, we propose the use of a hybridized, experimental approach that may enable researchers to test the effectiveness of therapeutics at decreasing impulsive and drug choice in a single design.

Methylphenidate and Atomoxetine-Responsive Prefrontal Cortical Genetic Overlaps in "Impulsive" SHR/NCrl and Wistar Rats

Impulsivity, the predisposition to act prematurely without foresight, is associated with a number of neuropsychiatric disorders, including attention-deficit/hyperactivity disorder (ADHD). Identifying genetic underpinnings of impulsive behavior may help decipher the complex etiology and neurobiological factors of disorders marked by impulsivity. To identify potential genetic factors of impulsivity, we examined common differentially expressed genes (DEGs) in the prefrontal cortex (PFC) of adolescent SHR/NCrl and Wistar rats, which showed marked decrease in preference for the large but delayed reward, compared with WKY/NCrl rats, in the delay discounting task. Of these DEGs, we examined drug-responsive transcripts whose mRNA levels were altered following treatment (in SHR/NCrl and Wistar rats) with drugs that alleviate impulsivity, namely, the ADHD medications methylphenidate and atomoxetine. Prefrontal cortical genetic overlaps between SHR/NCrl and Wistar rats in comparison with WKY/NCrl included genes associated with transcription (e.g., Btg2, Fos, Nr4a2), synaptic plasticity (e.g., Arc, Homer2), and neuron apoptosis (Grik2, Nmnat1). Treatment with methylphenidate and/or atomoxetine increased choice of the large, delayed reward in SHR/NCrl and Wistar rats and changed, in varying degrees, mRNA levels of Nr4a2, Btg2, and Homer2, genes with previously described roles in neuropsychiatric disorders characterized by impulsivity. While further studies are required, we dissected potential genetic factors that may influence impulsivity by identifying genetic overlaps in the PFC of "impulsive" SHR/NCrl and Wistar rats. Notably, these are also drug-responsive transcripts which may be studied further as biomarkers to predict response to ADHD drugs, and as potential targets for the development of treatments to improve impulsivity.

Mouse strain differences in punished ethanol self-administration

Determining the neural factors contributing to compulsive behaviors such as alcohol-use disorders (AUDs) has become a significant focus of current preclinical research. Comparison of phenotypic differences across genetically distinct mouse strains provides one approach to identify molecular and genetic factors contributing to compulsive-like behaviors. Here we examine a rodent assay for punished ethanol self-administration in four widely used inbred strains known to differ on ethanol-related behaviors: C57BL/6J (B6), DBA/2J (D2), 129S1/SvImJ (S1), and BALB/cJ (BALB). Mice were trained in an operant task (FR1) to reliably lever-press for 10% ethanol using a sucrose-fading procedure. Once trained, mice received a punishment session in which lever pressing resulted in alternating ethanol reward and footshock, followed by tests to probe the effects of punishment on ethanol self-administration. Results indicated significant strain differences in training performance and punished attenuation of ethanol self-administration. S1 and BALB showed robust attenuation of ethanol self-administration after punishment, whereas behavior in B6 was attenuated only when the punishment and probe tests were conducted in the same contexts. By contrast, D2 were insensitive to punishment regardless of context, despite receiving more shocks during punishment and exhibiting normal footshock reactivity. Additionally, B6, but not D2, reduced operant self-administration when ethanol was devalued with a bitter tastant. B6 and D2 showed devaluation of sucrose self-administration, and punished suppression of sucrose seeking was context dependent in both the strains. While previous studies have demonstrated avoidance of ethanol in D2, particularly when ethanol is orally available from a bottle, current findings suggest this strain may exhibit heightened compulsive-like self-administration of ethanol, although there are credible alternative explanations for the phenotype of this strain. In sum, these findings offer a foundation for future studies examining the neural and genetic factors underlying AUDs.

Premature responses in the five-choice serial reaction time task reflect rodents' temporal strategies: evidence from no-light and pharmacological challenges

RATIONALE

The five-choice serial reaction time task (5-CSRTT) is regularly used to study attention and impulsivity. In the 5-CSRTT, rodents initiate a trial, then after an inter-trial interval (ITI), a light appears in one of five holes. Responding in the lit vs. unlit hole reflects attention (accuracy), while responding prematurely before a light appears is suggested to reflect impulsivity/response disinhibition. Comparison of rat and mouse 5-CSRTT performance has raised questions on the validity of premature responses as measuring impulsivity/response inhibition. To minimize effort, rodents may use a temporal strategy, enabling their "timing" of the ITI, minimizing the need to attend during this delay. Greater reliance on this strategy could result in premature responses due to "guesses" if their timing was poor/altered.

OBJECTIVES

To assess the degree to which rats and/or mice utilize a temporal strategy, we challenged performance using infrequent no-light trials during 5-CSRTT performance.

RESULTS

Even when no light appeared when one was expected, rats responded ~60 % compared to ~40 % in mice, indicating a greater reliance on a temporal strategy by rats than by mice. Consistent with this hypothesis, rats made more premature responses than mice. Additional studies using a temporal discrimination task and a 5-CSRTT variant demonstrated that delta-9-tetrahydrocannabinol, the active ingredient in cannabis, slowed temporal perception and reduced premature responses.

CONCLUSIONS

These data provide behavioral and pharmacological evidence indicating that premature responses are heavily influenced by temporal perception. Hence, they may reflect an aspect of waiting impulsivity, but not response disinhibition, an important distinction for translational clinical research.

Dopamine D2/3- and μ-opioid receptor antagonists reduce cue-induced responding and reward impulsivity in humans

Increased responding to drug-associated stimuli (cue reactivity) and an inability to tolerate delayed gratification (reward impulsivity) have been implicated in the development and maintenance of drug addiction. Whereas data from animal studies suggest that both the dopamine and opioid system are involved in these two reward-related processes, their role in humans is less clear. Moreover, dopaminergic and opioidergic drugs have not been directly compared with regard to these functions, even though a deeper understanding of the underlying mechanisms might inform the development of specific treatments for elevated cue reactivity and reward impulsivity. In a randomized, double-blind, between-subject design we administered the selective dopamine D2/D3 receptor antagonist amisulpride (400 mg, n=41), the unspecific opioid receptor antagonist naltrexone (50 mg, n=40) or placebo (n=40) to healthy humans and measured cue-induced responding with a Pavlovian-instrumental transfer task and reward impulsivity with a delay discounting task. Mood was assessed using a visual analogue scale. Compared with placebo, amisulpride significantly suppressed cue-induced responding and reward impulsivity. The effects of naltrexone were similar, although less pronounced. Both amisulpride and naltrexone decreased average mood ratings compared with placebo. Our results demonstrate that a selective blockade of dopamine D2/D3 receptors reduces cue-induced responding and reward impulsivity in healthy humans. Antagonizing μ-opioid receptors has similar effects for cue-induced responding and to a lesser extent for reward impulsivity.

Determinants of choice, and vulnerability and recovery in addiction

Addiction may be viewed as choice governed by competing contingencies. One factor impacting choice, particularly as it relates to addiction, is sensitivity to delayed rewards. Discounting of delayed rewards influences addiction vulnerability because of competition between relatively immediate gains of drug use, e.g. intoxication, versus relatively remote gains of abstinence, e.g. family stability. Factors modifying delay sensitivity can be modeled in the laboratory. For instance, increased delay sensitivity can be similarly observed in adolescent humans and non-human animals. Similarly, genetic factors influence delay sensitivity in humans and animals. Recovery from addiction may also be viewed as choice behavior. Thus, reinforcing alternative behavior facilitates recovery because reinforcing alternative behavior decreases the frequency of using drugs. How reinforcing alternative behavior influences recovery can also be modeled in the laboratory. For instance, relapse risk decreases as abstinence duration increases, and this decreasing risk can be modeled in animals using choice procedures. In summary, addiction in many respects can be conceptualized as a problem of choice. Animal models of choice disorders stand to increase our understanding of the core processes that establish and maintain addiction and serve as a proving ground for development of novel treatments.

Role of prefrontal 5-HT in the strain-dependent variation in sign-tracking behavior of C57BL/6 and DBA/2 mice

RATIONALE

The expression of sign-tracking (ST) phenotype over goal-tracking (GT) phenotype has been associated to different aspects of impulsive behavior, and depletions of brain serotonin (5-HT) have been shown to selectively increase impulsive action as well as ST.

OBJECTIVES

The present study aimed at testing the relationship between reduced brain 5-HT availability and expression of ST phenotype in a genetic model of individual variation in brain 5-HT functionality. Inbred DBA/2J (DBA) mice are homozygous for the allelic variant of the TPH-2 gene causing lower brain 5-HT function in comparison with C57BL/6J (C57) inbred mice.

MATERIALS

Young adult (10 weeks) and adult (14 weeks) C57 and DBA mice were trained in a Pavlovian conditioned approach (PCA) paradigm. Lever-directed (ST) and magazine-directed (GT) responses were measured in 12 daily conditioning sessions. In a second experiment, effect of the medial prefrontal cortex (mPFC) 5-HT depletion by the neurotoxin 5,7-dihydroxytryptamine (5,7-DHT) was assessed on acquisition of ST phenotype in adult C57 mice, according to their higher 5-HT functionality compared to DBA mice.

RESULTS

Young adult mice of both strains developed ST phenotype, but only adult DBA mice developed ST phenotype. 5-HT depletion in the mPFC of adult C57 mice completely changed their phenotype, as shown by their increased ST.

CONCLUSIONS

These findings indicate that ST phenotype can be the expression of a transitory late developmental stage and that genetic factors determine persistence of this phenotype in adulthood. These findings also support a role of 5-HT transmission in PFC in constraining development of ST phenotype.

Repeated ethanol exposure during early and late adolescence: double dissociation of effects on waiting and choice impulsivity

BACKGROUND

A strong association exists between impulsivity and binge drinking, and between adolescent alcohol exposure and alcohol abuse in humans. To understand the extent to which early-life alcohol exposure contributes to increased impulsivity, we developed an animal model of binge drinking using 2 strains of mice, C57BL/6J (B6) and DBA2/J (D2), that differ in both motor impulsivity and alcohol drinking.

METHODS

Mice were treated with 2 g/kg ethanol (EtOH) during their early (intermittent ethanol exposure [IEE]_Early; postnatal day [PND]30 to 45) or late (IEE_Late; PND45 to 60) adolescence or with saline (control group [CON]) throughout the adolescence period. To determine the consequences IEE on waiting impulsivity and attentional function, the number of premature responses and omissions, respectively, were evaluated in adulthood using the 5-choice serial reaction time task (5-CSRTT). To examine the effects of IEE on choice impulsivity, risky decision making was assessed in adulthood using a mouse version of the Iowa Gambling Task (mIGT). Additionally, the acute effects of EtOH in adulthood on waiting impulsivity and choice preference were investigated.

RESULTS

We provide experimental evidence that IEE during late, but not early, adolescence disrupts waiting impulsivity and attentional abilities in the 5-CSRTT. In contrast, IEE during early, but not late, adolescence altered risky decision making in the mIGT. D2 mice consistently showed lower premature responding than B6 mice in both the mIGT and the 5-CSRTT, but greater risky decision making on the mIGT. IEE and CON mice showed similar responsiveness to the acute EtOH effects on premature responding, but increased risky choices only in B6_IEE_Early mice.

CONCLUSIONS

Our observations suggest a direct effect of IEE during adolescence on waiting and choice impulsivity and attention later in life.

Delay-specific stimuli and genotype interact to determine temporal discounting in a rapid-acquisition procedure

The importance of delay discounting to many socially important behavior problems has stimulated investigations of biological and environmental mechanisms responsible for variations in the form of the discount function. The extant experimental research, however, has yielded disparate results, raising important questions regarding Gene X Environment interactions. The present study determined the influence of stimuli that uniquely signal delays to reinforcement on delay discounting in two inbred mouse strains using a rapid-acquisition procedure. BALB/c and C57BL/6 mice responded under a six-component, concurrent-chained schedule in which the terminal-link delays preceding the larger-reinforcer were presented randomly across components of an individual session. Across conditions, components were presented either with or without delay-specific auditory stimuli, i.e., as multiple or mixed schedules. A generalized matching-based model was used to incorporate the impact of current and previous component reinforcer-delay ratios on current component response allocation. Sensitivity to reinforcer magnitude and delay were higher for BALB/c mice, but within-component preference reached final levels faster for C57Bl/6 mice. For BALB/c mice, acquisition of preference across blocks of a component was faster under the multiple than the mixed schedule, but final levels of sensitivity to reinforcement were unaffected by schedule. The speed of acquisition of preference was not different across schedules for C57Bl/6 mice, but sensitivity to reinforcement was higher under the multiple than the mixed schedule. Overall, differences in the acquisition and final form of the discount function were determined by a Gene X Environment interaction, but the presence of delay-specific stimuli attenuated genotype-dependent differences in magnitude and delay sensitivity.

Choice impulsivity: Definitions, measurement issues, and clinical implications

Impulsivity critically relates to many psychiatric disorders. Given the multifaceted construct that impulsivity represents, defining core aspects of impulsivity is vital for the assessment and understanding of clinical conditions. Choice impulsivity (CI), involving the preferential selection of smaller sooner rewards over larger later rewards, represents one important type of impulsivity. The International Society for Research on Impulsivity (InSRI) convened to discuss the definition and assessment of CI and provide recommendations regarding measurement across species. Commonly used preclinical and clinical CI behavioral tasks are described, and considerations for each task are provided to guide CI task selection. Differences in assessment of CI (self-report, behavioral) and calculating CI indices (e.g., area-under-the-curve, indifference point, and steepness of discounting curve) are discussed along with properties of specific behavioral tasks used in preclinical and clinical settings. The InSRI group recommends inclusion of measures of CI in human studies examining impulsivity. Animal studies examining impulsivity should also include assessments of CI and these measures should be harmonized in accordance with human studies of the disorders being modeled in the preclinical investigations. The choice of specific CI measures to be included should be based on the goals of the study and existing preclinical and clinical literature using established CI measures.

Alleviating waiting impulsivity and perseverative responding by μ-opioid receptor antagonism in two inbred mouse strains

RATIONALE

Recent evidence has implicated the opioid system in exaggerated ethanol consumption and impulsivity deficits. The opioid receptor antagonist naltrexone (NTX) has proven efficient in reducing alcohol consumption; however, its role on impulsive behaviour is not fully characterised.

OBJECTIVE

The aim of this study was to investigate the effects of NTX on two measures of impulsive behaviour in two inbred mouse strains that differ in ethanol preference and impulsive phenotype.

METHODS

Two separate groups of C57BL/6J (B6, n = 24) and DBA2/J (D2, n = 24) male mice were exposed to intermittent ethanol (IEE; 2 g/kg) during early (PND 30-45, IEE_Early) or late (PND 45-60, IEE_Late) adolescence or the respective saline control. The ability of NTX (10 mg/kg) alone, or co-administered with ethanol (0.5 g/kg), to diminish waiting impulsivity in the five-choice serial reaction time task (5-CSRTT), or improve decision-making in a mouse version of the Iowa Gambling Task (mIGT), was examined in adulthood.

RESULTS

In the 5-CSRTT, NTX diminished impulsivity in both strains of mice, irrespective of previous ethanol experience. In the mIGT, NTX failed to alter risky decision-making but decreased perseverative responding.

CONCLUSIONS

Blocking the actions of endogenous opioids may attenuate waiting impulsivity, in addition to alleviating perseverative responding. In a broader context, μ-opiate antagonism may be of potential interest for impulse-control disorders.

Impulsive choice predicts anxiety-like behavior, but not alcohol or sucrose consumption, in male Long-Evans rats

BACKGROUND

Prior human research indicates robust, positive relations between impulsive choice (i.e., preference for smaller, immediate over larger, delayed rewards) and alcohol use disorders. However, varied findings in the nonhuman literature reveal a relatively ambiguous relation between impulsive choice and alcohol consumption in rodents. In addition, few rodent studies have investigated potential relations between impulsive choice and common covariates of alcohol consumption (e.g., avidity for sweet substances or anxiety-like behavior).

METHODS

Ninety-two male Long-Evans rats completed an impulsive-choice task. From this larger sample, extreme high- and low-impulsive groups (n = 30 each) were retained for further testing. In separate tests, subsequent open-field behavior and consumption of oral alcohol (12% w/v) and isocaloric sucrose were examined. Impulsive choice was then retested to examine whether behavior remained stable over the course of the experiment.

RESULTS

No significant relations emerged between impulsive choice and either alcohol or sucrose consumption. However, impulsive choice predicted greater anxiety-like behavior (avoidance of the center field, defecation) in the open-field test. In turn, greater anxiety predicted lower alcohol and sucrose consumption. Finally, choice remained generally stable across the experiment, although high-impulsive rats tended toward less impulsive choice in the retest.

CONCLUSIONS

Although impulsive choice and alcohol consumption appear to share some variance with anxiety-like behavior, the present data offer no support for a relation between impulsive choice and alcohol consumption in Long-Evans rats. Together with mixed rodent data from prior reports, these findings attenuate cross-species comparisons to human relations between impulsive choice and alcohol use disorders.

Endophenotypes for Alcohol Use Disorder: An Update on the Field

The endophenotype concept was first proposed as a strategy to use (purportedly) genetically simpler phenotypes in gene identification studies for psychiatric disorders, and is distinct from the closely related concept of intermediate phenotypes. In the area of alcohol use disorder (AUD) research, two candidate endophenotypes have produced replicable genetic associations: level of response to alcohol and neurophysiology markers (e.g., event-related oscillations and event-related potentials). Additional candidate endophenotypes from the cognitive, sensory, and neuroimaging literatures show promise, although more evidence is needed to fully evaluate their potential utility. Translational approaches to AUD endophenotypes have helped characterize the underlying neurobiology and genetics of AUD endophenotypes and identified relevant pharmacological interventions. Future research that capitalizes on the polygenic nature of endophenotypes and emphasizes endophenotypes that may change across development will enhance the usefulness of this concept to understand the genetically-influenced pathways toward AUD.

Impulsive actions and choices in laboratory animals and humans: effects of high vs. low dopamine states produced by systemic treatments given to neurologically intact subjects

Increases and decreases in dopamine (DA) transmission have both been suggested to influence reward-related impulse-control. The present literature review suggests that, in laboratory animals, the systemic administration of DA augmenters preferentially increases susceptibility to premature responding; with continued DA transmission, reward approach behaviors are sustained. Decreases in DA transmission, in comparison, diminish the appeal of distal and difficult to obtain rewards, thereby increasing susceptibility to temporal discounting and other forms of impulsive choice. The evidence available in humans is not incompatible with this model but is less extensive.

Exaggerated waiting impulsivity associated with human binge drinking, and high alcohol consumption in mice

There are well-established links between impulsivity and alcohol use in humans and animal models; however, whether exaggerated impulsivity is a premorbid risk factor or a consequence of alcohol intake remains unclear. In a first approach, human young (18-25 years) social binge and non-binge drinkers were tested for motor impulsivity and attentional abilities in a human version of the Five-Choice Serial Reaction Time Task (Sx-5CSRTT), modeled on the rodent 5CSRTT. Participants completed four variants of the Sx-5CSRT, in addition to being screened for impulsive traits (BIS-11 questionnaire) and impulsive behavior (by means of the Delay Discounting Questionnaire, Two-Choice Impulsivity Paradigm (TCIP), Stop Signal Reaction Time, and Time Estimation Task). Using a second approach, we compared one of these impulsivity measures, 5CSRTT performance, in two inbred strains of mice known to differ in alcohol intake. Compared with non-bingers (NBD; n=22), binge drinkers (BD, n=22) showed robust impairments in attention and premature responding when evaluated under increased attentional load, in addition to presenting deficits in decision making using the TCIP. The best predictors for high binge drinking score were premature responding in the Sx-5CSRTT, trait impulsivity in the BIS-11, and decision making in the TCIP. Alcohol-naïve C57BL/6J (B6) mice (alcohol preferring) were more impulsive in the 5CSRTT than DBA2/J (D2) mice (alcohol averse); the degree of impulsivity correlated with subsequent alcohol consumption. Homologous measures in animal and human studies indicate increased premature responding in young social BD and in the ethanol-preferring B6 strain of mice.

Neuregulin-3 in the mouse medial prefrontal cortex regulates impulsive action

BACKGROUND

A deficit in impulse control is a prominent, heritable symptom in several psychiatric disorders, such as addiction, attention-deficit/hyperactivity disorder, and schizophrenia. Here, we aimed to identify genes regulating impulsivity, specifically of impulsive action, in mice.

METHODS

Using the widely used 5-choice serial reaction time task, we measured impulsive action in 1) a panel of 41 BXD recombinant inbred strains of mice (n = 13.7 ± .8 per strain; n = 654 total) to detect underlying genetic loci; 2) congenic mice (n = 23) to replicate the identified locus; 3) mice overexpressing the Nrg3 candidate gene in the medial prefrontal cortex (n = 21); and 4) a Nrg3 loss-of-function mutant (n = 59) to functionally implicate the Nrg3 candidate gene in impulsivity.

RESULTS

Genetic mapping of impulsive action in the BXD panel identified a locus on chromosome 14 (34.5-41.4 Mb), syntenic with the human 10q22-q23 schizophrenia-susceptibility locus. Congenic mice carrying the impulsivity locus (Impu1) confirmed its influence on impulsive action. Increased impulsivity was associated with increased Nrg3 gene expression in the medial prefrontal cortex (mPFC). Viral overexpression of Nrg3 in the mPFC increased impulsivity, whereas a constitutive Nrg3 loss-of-function mutation decreased it.

CONCLUSIONS

The causal relation between Nrg3 expression in the mPFC and level of impulsive action shown here provides a mechanism by which polymorphism in NRG3 in humans contributes to a specific cognitive deficit seen in several psychiatric diseases, such as addiction, attention-deficit/hyperactivity disorder, and schizophrenia.

Convergent pharmacological mechanisms in impulsivity and addiction: insights from rodent models

Research over the last two decades has widely demonstrated that impulsivity, in its various forms, is antecedent to the development of drug addiction and an important behavioural trait underlying the inability of addicts to refrain from continued drug use. Impulsivity describes a variety of rapidly and prematurely expressed behaviours that span several domains from impaired response inhibition to an intolerance of delayed rewards, and is a core symptom of attention deficit hyperactivity disorder (ADHD) and other brain disorders. Various theories have been advanced to explain how impulsivity interacts with addiction both causally and as a consequence of chronic drug abuse; these acknowledge the strong overlaps in neural circuitry and mechanisms between impulsivity and addiction and the seemingly paradoxical treatment of ADHD with stimulant drugs with high abuse potential. Recent years have witnessed unprecedented progress in the elucidation of pharmacological mechanisms underpinning impulsivity. Collectively, this work has significantly improved the prospect for new therapies in ADHD as well as our understanding of the neural mechanisms underlying the shift from recreational drug use to addiction. In this review, we consider the extent to which pharmacological interventions that target impulsive behaviour are also effective in animal models of addiction. We highlight several promising examples of convergence based on empirical findings in rodent-based studies.

An overview of measuring impulsive behavior in mice

Impulsive behavior is a key constituent of many psychiatric illnesses, with maladaptive response control being a feature of disorders such as ADHD, schizophrenia, mania, and addiction. In order to understand the neurological underpinnings of impulsivity, a number of behavioral tasks have been developed for use with animal models. Data from studies with rats and other animals have led to the idea of the existence of dissociable components of impulsivity, which in turn informs studies of human disorders and potentially the development of specific therapies. Increasingly, mouse models are being used to investigate the known genetic contribution to psychiatric disorders in which abnormal response control leads to altered impulsive behaviors. In order to maximize the potential of these mouse models, it is important that researchers take into account the non-unitary nature of response control and impulsivity. In this article, we briefly review the tasks available to behavioral neuroscientists and how these can be used in order to tease apart the contribution of a specific genetic lesion into the discrete aspects of impulsive behavior.

Strains and stressors: an analysis of touchscreen learning in genetically diverse mouse strains

Touchscreen-based systems are growing in popularity as a tractable, translational approach for studying learning and cognition in rodents. However, while mouse strains are well known to differ in learning across various settings, performance variation between strains in touchscreen learning has not been well described. The selection of appropriate genetic strains and backgrounds is critical to the design of touchscreen-based studies and provides a basis for elucidating genetic factors moderating behavior. Here we provide a quantitative foundation for visual discrimination and reversal learning using touchscreen assays across a total of 35 genotypes. We found significant differences in operant performance and learning, including faster reversal learning in DBA/2J compared to C57BL/6J mice. We then assessed DBA/2J and C57BL/6J for differential sensitivity to an environmental insult by testing for alterations in reversal learning following exposure to repeated swim stress. Stress facilitated reversal learning (selectively during the late stage of reversal) in C57BL/6J, but did not affect learning in DBA/2J. To dissect genetic factors underlying these differences, we phenotyped a family of 27 BXD strains generated by crossing C57BL/6J and DBA/2J. There was marked variation in discrimination, reversal and extinction learning across the BXD strains, suggesting this task may be useful for identifying underlying genetic differences. Moreover, different measures of touchscreen learning were only modestly correlated in the BXD strains, indicating that these processes are comparatively independent at both genetic and phenotypic levels. Finally, we examined the behavioral structure of learning via principal component analysis of the current data, plus an archival dataset, totaling 765 mice. This revealed 5 independent factors suggestive of "reversal learning," "motivation-related late reversal learning," "discrimination learning," "speed to respond," and "motivation during discrimination." Together, these findings provide a valuable reference to inform the choice of strains and genetic backgrounds in future studies using touchscreen-based tasks.

Assessing delay discounting in mice

Delay discounting (also intertemporal choice or impulsive choice) is the process by which delayed outcomes, such as delayed food delivery, are valued less than the same outcomes delivered immediately or with a shorter delay. This process is of interest because many psychopathologies, including substance dependence, pathological gambling, attention deficit hyperactivity disorder, and conduct disorder, are characterized by heightened levels of delay discounting. Some of these disorders are heritable, and data indicate that delay discounting also has a genetic component. To identify the genes underlying the delay discounting decision-making process and genetic correlates of heightened discounting, researchers have used mouse models. This unit describes a protocol for generating delay discounting behavior in mice and discusses analysis techniques for such behavior.

The significance of meaning: why do over 90% of behavioral neuroscience results fail to translate to humans, and what can we do to fix it?

The vast majority of drugs entering human trials fail. This problem (called "attrition") is widely recognized as a public health crisis, and has been discussed openly for the last two decades. Multiple recent reviews argue that animals may be just too different physiologically, anatomically, and psychologically from humans to be able to predict human outcomes, essentially questioning the justification of basic biomedical research in animals. This review argues instead that the philosophy and practice of experimental design and analysis is so different in basic animal work and human clinical trials that an animal experiment (as currently conducted) cannot reasonably predict the outcome of a human trial. Thus, attrition does reflect a lack of predictive validity of animal experiments, but it would be a tragic mistake to conclude that animal models cannot show predictive validity. A variety of contributing factors to poor validity are reviewed. The need to adopt methods and models that are highly specific (i.e., which can identify true negative results) in order to complement the current preponderance of highly sensitive methods (which are prone to false positive results) is emphasized. Concepts in biomarker-based medicine are offered as a potential solution, and changes in the use of animal models required to embrace a translational biomarker-based approach are outlined. In essence, this review advocates a fundamental shift, where we treat every aspect of an animal experiment that we can as if it was a clinical trial in a human population. However, it is unrealistic to expect researchers to adopt a new methodology that cannot be empirically justified until a successful human trial. "Validation with known failures" is proposed as a solution. Thus new methods or models can be compared against existing ones using a drug that has translated (a known positive) and one that has failed (a known negative). Current methods should incorrectly identify both as effective, but a more specific method should identify the negative compound correctly. By using a library of known failures we can thereby empirically test the impact of suggested solutions such as enrichment, controlled heterogenization, biomarker-based models, or reverse-translated measures.

Compared with DBA/2J mice, C57BL/6J mice demonstrate greater preference for saccharin and less avoidance of a cocaine-paired saccharin cue

Rats avoid intake of a saccharin cue when paired with a drug of abuse. While this is true for most subjects, the degree of avoidance of the drug-paired cue depends upon many factors including an individual rat's preference for rewards. That said, the direction of this effect is complex. For example, reward-preferring Lewis rats exhibit greater cocaine-induced avoidance of a saccharin cue relative to Fischer 344 rats; while reward-preferring mice that overexpress ΔFosB (NSE-tTA × TetOp-ΔFosB) exhibit less avoidance of the drug-paired taste cue compared to controls. The aim here was to use two strains of commonly used mice, C57BL/6J and DBA/2J, to determine whether known differences in sensitivity to rewards will facilitate or attenuate drug-induced suppression of intake of a drug-paired taste cue. The results of Experiment 1 demonstrate that C57BL/6J mice, compared with DBA/2J mice, exhibit attenuated suppression of saccharin intake when it is paired with cocaine. The results of Experiment 2 demonstrate that strain differences in impulsivity are not likely to account for these differences. It is proposed that, while the C57BL/6J mice typically are more responsive to drug, they also are more responsive to natural rewards (in this case saccharin), and the stronger preference for saccharin serves to militate against drug.

Differential effects of dopamine transporter inhibitors in the rodent Iowa gambling task: relevance to mania

RATIONALE

The Iowa Gambling Task (IGT) can be used to quantify impulsive and risky choice behaviors in psychiatric patients, e.g., bipolar disorder (BD) sufferers. Although developing treatments for these behaviors is important, few predictive animal models exist. Inhibition of the dopamine transporter (DAT) can model profiles of altered motor activity and exploration seen in patients with BD. The effect of DAT inhibition on impulsive choices related to BD has received limited study however. We used a rodent IGT to elucidate the effects of similarly acting drugs on risky choice behavior.

OBJECTIVES

We hypothesized that (1) C57BL/6 mice could adopt the "safe" choice options in the IGT and (2) DAT inhibition would alter risk preference.

METHODS

Mice were trained in the IGT to a stable risk-preference and then administered the norepinephrine/DAT inhibitor amphetamine, or the more selective DAT inhibitors modafinil or GBR12909.

RESULTS

Mice developed a preference for the "safe" option, which was potentiated by amphetamine administration. GBR12909 or modafinil administration increased motor impulsivity, motivation significantly, and risk preference subtly.

CONCLUSIONS

The rodent IGT can measure different impulse-related behaviors and differentiate similarly acting BD-related drugs. The contrasting effects of amphetamine and modafinil in mice are similar to effects in rats and humans in corresponding IGT tasks, supporting the translational validity of the task. GBR12909 and modafinil elicited similar behaviors in the IGT, likely through a shared mechanism. Future studies using a within-session IGT are warranted to confirm the suitability of DAT inhibitors to model risk-preference in BD.

A quantitative analysis of the effects of qualitatively different reinforcers on fixed ratio responding in inbred strains of mice

Previous studies of inbred mouse strains have shown reinforcer-strain interactions that may potentially mask differences among strains in memory performance. The present research examined the effects of two qualitatively different reinforcers (heterogeneous mix of flavored pellets and sweetened-condensed milk) on responding maintained by fixed-ratio schedules of reinforcement in three inbred strains of mice (BALB/c, C57BL/6, and DBA/2). Responses rates for all strains were a bitonic (inverted U) function of the size of the fixed-ratio schedule and were generally higher when responding was maintained by milk. For the DBA/2 and C57BL/6 and to a lesser extent the BALB/c, milk primarily increased response rates at moderate fixed ratios, but not at the largest fixed ratios tested. A formal model of ratio-schedule performance, Mathematical Principles of Reinforcement (MPR), was applied to the response rate functions of individual mice. According to MPR, the differences in response rates maintained by pellets and milk were mostly due to changes in motoric processes as indicated by changes in the minimum response time (δ) produced by each reinforcer type and not specific activation (a), a model term that represents value and is correlated with reinforcer magnitude and the break point obtained under progressive ratio schedules. MPR also revealed that, although affected by reinforcer type, a parameter interpreted as the rate of saturation of working memory (λ), differed among the strains.

Pregabalin- and topiramate-mediated regulation of cognitive and motor impulsivity in DBA/2 mice

BACKGROUND AND PURPOSE

Impulsivity is a core symptom in many neuropsychiatric disorders. The main objective of this study was to evaluate the effects of topiramate and pregabalin on the modulation of different impulsivity dimensions in DBA/2 mice.

EXPERIMENTAL APPROACH

The effects of acute and chronic administration of pregabalin (10, 20 and 40 mg·kg(-1) ) and topiramate (12.5, 25 and 50 mg·kg(-1) ) were evaluated in the light-dark box (LDB), hole board test (HBT) and delayed reinforcement task (DRT). α(2A) -Adrenoceptor, D(2) -receptor and TH gene expression were evaluated by real-time PCR in the prefrontal cortex (PFC), accumbens (ACC) and ventral tegmental area (VTA), respectively.

KEY RESULTS

Acute pregabalin administration showed a clear anxiolytic-like effect (LDB) but did not modify novelty-seeking behaviour (HBT). In contrast, topiramate produced an anxiolytic effect only at the highest dose, whereas it reduced novelty seeking at all doses tested. In the DRT, acute pregabalin had no effect, whereas topiramate only reduced motor impulsivity. Chronically, pregabalin significantly increased motor impulsivity and topiramate diminished cognitive impulsivity. Pregabalin decreased α(2A) -adrenoceptor and D(2) -receptor gene expression in the PFC and ACC, respectively, and increased TH in the VTA. In contrast, chronic administration of topiramate increased α(2A) -adrenoceptor and D(2) -receptor gene expression in the PFC and ACC, respectively, and also increased TH in the VTA.

CONCLUSIONS AND IMPLICATIONS

These results suggest that the usefulness of pregabalin in impulsivity-related disorders is related to its anxiolytic properties, whereas topiramate modulates impulsivity. These differences could be linked to their opposite effects on α(2A) -adrenoceptor and D(2) -receptor gene expression in the PFC and ACC, respectively.

Integrating behavioral economics and behavioral genetics: delayed reward discounting as an endophenotype for addictive disorders

Delayed reward discounting is a behavioral economic index of impulsivity, referring to how much an individual devalues a reward based on its delay in time. As a behavioral process that varies considerably across individuals, delay discounting has been studied extensively as a model for self-control, both in the general population and in clinical samples. There is growing interest in genetic influences on discounting and, in particular, the prospect of discounting as an endophenotype for addictive disorders (i.e., a heritable mechanism partially responsible for conferring genetic risk). This review assembles and critiques the evidence supporting this hypothesis. Via numerous cross-sectional studies and a small number of longitudinal studies, there is considerable evidence that impulsive discounting is associated with addictive behavior and appears to play an etiological role. Moreover, there is increasing evidence from diverse methodologies that impulsive delay discounting is temporally stable, heritable, and that elevated levels are present in nonaffected family members. These findings suggest that impulsive discounting meets the criteria for being considered an endophenotype. In addition, recent findings suggest that genetic variation related to dopamine neurotransmission is significantly associated with variability in discounting preferences. A significant caveat, however, is that the literature is modest in some domains and, in others, not all the findings have been supportive or consistent. In addition, important methodological considerations are necessary in future studies. Taken together, although not definitive, there is accumulating support for the hypothesis of impulsive discounting as an endophenotype for addictive behavior and a need for further systematic investigation.

Effects of intoxicating free-choice alcohol consumption during adolescence on drinking and impulsivity during adulthood in selectively bred high-alcohol preferring mice

BACKGROUND

Abuse of alcohol during adolescence continues to be a problem, and it has been shown that earlier onset of drinking predicts increased alcohol abuse problems later in life. High levels of impulsivity have been demonstrated to be characteristic of alcoholics, and impulsivity has also been shown to predict later alcohol use in teenage subjects, showing that impulsivity may precede the development of alcohol use disorders. These experiments examined adolescent drinking in a high-drinking, relatively impulsive mouse population and assessed its effects on adult drinking and adult impulsivity.

METHODS

Experiment 1: Selectively bred high-alcohol preferring (HAPII) mice were given either alcohol (free-choice access) or water only for 2 weeks during middle adolescence or adulthood. All mice were given free-choice access to alcohol 30 days later, in adulthood. Experiment 2: Adolescent HAPII mice drank alcohol and water, or water alone, for 2 weeks, and were then trained to perform a delay discounting task as adults to measure impulsivity. In each experiment, effects of volitional ethanol (EtOH) consumption on later behavior were assessed. We expected adolescent alcohol exposure to increase subsequent drinking and impulsivity.

RESULTS

Mice consumed significant quantities of EtOH, reaching average blood ethanol concentrations (BECs) of 142 mg/dl (adolescent) or 154 mg/dl (adult) in Experiment 1. Adolescent mice in Experiment 2 reached an average of 108 mg/dl. Mice exposed to alcohol in either adolescence or adulthood showed a transient increase in EtOH consumption, but we observed no differences in impulsivity in adult mice as a function of whether mice drank alcohol during adolescence.

CONCLUSIONS

These findings indicate that HAPII mice drink intoxicating levels of alcohol during both adolescence and adulthood and that this volitional intake has long-term effects on subsequent drinking behavior. Nonetheless, this profound exposure to alcohol during adolescence does not increase impulsivity in adulthood, indicating that long-term changes in drinking are mediated by mechanisms other than impulsivity.

Dopamine, serotonin and impulsivity

Impulsive people have a strong urge to act without thinking. It is sometimes regarded as a positive trait but rash impulsiveness is also widely present in clinical disorders such as attention deficit hyperactivity disorder (ADHD), drug dependence, mania, and antisocial behaviour. Contemporary research has begun to make major inroads into unravelling the brain mechanisms underlying impulsive behaviour with a prominent focus on the limbic cortico-striatal systems. With this progress has come the understanding that impulsivity is a multi-faceted behavioural trait involving neurally and psychologically diverse elements. We discuss the significance of this heterogeneity for clinical disorders expressing impulsive behaviour and the pivotal contribution made by the brain dopamine and serotonin systems in the aetiology and treatment of behavioural syndromes expressing impulsive symptoms.

Delay discounting in C57BL/6J and DBA/2J mice: adolescent-limited and life-persistent patterns of impulsivity

Impulsivity is a defining characteristic of adolescence. Compared to adults, for example, adolescents engage in higher rates of drug and alcohol experimentation, risky sexual practices, and criminal activity. Such behavior may reflect reduced sensitivity to long-term consequences of behavior during adolescence. Recently, our lab has attempted to refine mouse procedures to study developmental trends in decision making in the laboratory. In the present experiment, we examined sensitivity to delayed rewards in C57BL/6J (B6) and DBA/2J (D2) mice during adolescence and adulthood using an adaptation of a 2-week delay discounting procedure developed by Adriani and Laviola (2003). During training, mice could choose between a 20- or 100-μl drop of milk delivered after a 1-s delay. During testing, the delay to the large drop of milk was increased from 1 to 100 seconds. As the delay to the larger volume increased, preference shifted to the smaller, more immediate option. In adolescence, both strains showed similar shifts in preference. In contrast, adult B6 mice were less sensitive to increasing delays than were adult D2 mice, who continued to perform much as their adolescent counterparts. A subsequent resistance-to-extinction test ruled out the possibility that the slower change in the adult B6 mice was due to perseverative responding. The present findings suggest that B6 and D2 strains may be differentially suited to uncovering the biological mechanism of short-term and long-term patterns of impulsive behavior.