Steady-state assessment of impulsive choice in Lewis and Fischer 344 rats: between-condition delay manipulations

Noradrenergic modulation of play in Sprague-Dawley and F344 rats

RATIONALE

For many mammals, engaging in social play behavior as a juvenile is important for cognitive, social, and emotional health as an adult. A playful phenotype reflects a dynamic interplay between genetic framework and experiences that operate on hard-wired brain systems so the relative lack of play in an otherwise playful species may be useful for identifying neural substrates that modulate play behavior. The inbred F344 rat has been identified as a strain that is consistently less playful than other strains commonly used in behavioral research. Norepinephrine (NE) acting on alpha-2 receptors has an inhibitory effect on play and F344 rats differ from a number of other strains in NE functioning. As such, the F344 rat may be particularly useful for gaining insight into NE involvement in play.

OBJECTIVE

The objective of this study was to determine whether the F344 rat is differentially sensitive to compounds that affect NE functioning and that are known to affect play behavior.

METHODS

Using pouncing and pinning to quantify play, the effects of the NE reuptake inhibitor atomoxetine, the NE alpha-2 receptor agonist guanfacine, and the NE alpha-2 receptor antagonist RX821002 on play behavior were assessed in juvenile Sprague-Dawley (SD) and F344 rats.

RESULTS

Atomoxetine and guanfacine reduced play in both SD and F344 rats. RX821002 increased pinning to a comparable extent in both strains but F344 rats were more sensitive to the play-enhancing effects of RX821002 on pounces.

CONCLUSIONS

Strain differences in NE alpha-2 receptor dynamics may contribute to the lower levels of play in F344 rats.

Effects of methylphenidate on impulsive choice and delay aversion in Lewis rats

Attention-deficit/hyperactivity disorder (ADHD), a common behavioral disorder in children and young adults, is characterized by symptoms of impulsivity, inattention, and hyperactivity. The purpose of this study was to evaluate the Lewis rat strain as a model of ADHD by testing their impulsive choices. Lewis rats were compared to their source strain, the Wistar rat, on an impulsive choice task. Rats completed the tasks on and off methylphenidate, a commonly prescribed medication for ADHD. Off methylphenidate, Lewis rats made more impulsive choices than Wistar rats. Analyses of acquisition of choice behavior suggested that both strains were able to discriminate reward sizes, but Lewis rats still chose the smaller-sooner option more than the larger-later (LL) option when the delays to reward were the same. This may be due to an aversion to the LL lever, which was associated with the longest delays to reward. Higher doses of methylphenidate increased LL choices in Lewis rats but decreased LL choices in Wistar rats. Altogether, these results suggest Lewis rats may be a viable model for ADHD in individuals whose symptoms are characterized by impulsive choices.

Steep Discounting of Future Rewards as an Impulsivity Phenotype: A Concise Review

This chapter provides an overview over the behavioral economic index of impulsivity known as delay discounting. Specifically, delay discounting refers to an individual's preference for smaller immediate rewards over a larger delayed rewards. The more precipitously an individual discounts future rewards, the more impulsive they are considered to be. First, the chapter reviews the nature of delay discounting as a psychological process and juxtaposes it with nominally similar processes, including other facets of impulsivity. Second, the chapter reviews the links between delay discounting and numerous health behaviors, including addiction, attention deficit/hyperactivity disorder, and obesity. Third, the determinants of individual variation in delay discounting are discussed, including both genetic and environmental contributions. Finally, the chapter evaluates delay discounting as a potentially modifiable risk factor and the status of clinical interventions designed to reduce delay discounting to address deficits in self-control in a variety of maladaptive behaviors.

Differential effects of d-amphetamine and atomoxetine on risk-based decision making of Lewis and Fischer 344 rats

Individuals with attention-deficit/hyperactivity disorder tend to make risker choices during probabilistic-discounting procedures. Thus, how common attention-deficit/hyperactivity disorder medications affect probabilistic discounting is of interest. In general, d-amphetamine increases risk-taking while atomoxetine has produced mixed effects in rats. Results from previous studies may result from genetic factors. Lewis and F344 rats have neurochemical differences that may be relevant to probabilistic discounting and how drugs affect such behavior. In this study, we evaluated dose-dependent effects of d-amphetamine and atomoxetine on probabilistic discounting of Lewis and F344. Male Lewis and F344 chose between one food pellet delivered 100% of the time and three food pellets delivered following decreasing probabilities of delivery (i.e. 100%, 66.7%, 33.3%, 16.5%, and 8.25%). Saline, d-amphetamine (0.1-1.8 mg/kg), and atomoxetine (0.1-7.8 mg/kg) were tested acutely. Lewis and F344 did not differ in choice at baseline. d-Amphetamine increased risky choice for both rat strains at low-to-moderate doses, although it did so at a lower dose (0.1 and 0.3 mg/kg) for F344 as compared to Lewis (0.3 mg/kg only). At high doses (1.0 and 1.8 mg/kg), d-amphetamine disrupted choice, increased frequencies of omitted trials, and reduced reinforcer sensitivity. Although atomoxetine increased frequencies of omitted trials at high doses (5.6 and 7.8 mg/kg), it had no effect on probabilistic discounting for either rat strain. Although Lewis and F344 differ in various types of impulsivity (i.e. motor, choice), with Lewis being the more impulsive of the two, the present results suggest that Lewis and F344 do not differ in risk-based decision-making. Effects of d-amphetamine on probabilistic discounting may be biology-dependent and differ from effects of atomoxetine.

Genomic basis of delayed reward discounting

Delayed reward discounting (DRD) is a behavioral economic measure of impulsivity, reflecting how rapidly a reward loses value based on its temporal distance. In humans, more impulsive DRD is associated with susceptibility to a number of psychiatric diseases (e.g., addiction, ADHD), health outcomes (e.g., obesity), and lifetime outcomes (e.g., educational attainment). Although the determinants of DRD are both genetic and environmental, this review focuses on its genetic basis. Both rodent studies using inbred strains and human twin studies indicate that DRD is moderately heritable, a conclusion that was further supported by a recent human genome-wide association study (GWAS) that used single nucleotide polymorphisms (SNP) to estimate heritability. The GWAS of DRD also identified genetic correlations with psychiatric diagnoses, health outcomes, and measures of cognitive performance. Future research priorities include rodent studies probing putative genetic mechanisms of DRD and human GWASs using larger samples and non-European cohorts. Continuing to characterize genomic influences on DRD has the potential to yield important biological insights with implications for a variety of medically and socially important outcomes.

Genetic influences on delayed reward discounting: A genome-wide prioritized subset approach

Delayed reward discounting (DRD) is a behavioral economic measure of impulsivity that has been consistently associated with addiction. It has also been identified as a promising addiction endophenotype, linking specific sources of genetic variation to individual risk. A challenge in the studies to date is that levels of DRD are often confounded with prior drug use, and previous studies have also had limited genomic scope. The current investigation sought to address these issues by studying DRD in healthy young adults with low levels of substance use (N = 986; 62% female, 100% European ancestry) and investigating genetic variation genome-wide. The genome-wide approach used a prioritized subset design, organizing the tests into theoretically and empirically informed categories and apportioning power accordingly. Three subsets were used: (a) a priori loci implicated by previous studies; (b) high-value addiction (HVA) markers from the recently developed SmokeScreen array; and (c) an atheoretical genome-wide scan. Among a priori loci, a nominally significant association was present between DRD and rs521674 in ADRA2A. No significant HVA loci were detected. One statistically significant genome-wide association was detected (rs13395777, p = 2.8 × 10-8), albeit in an intergenic region of unknown function. These findings are generally not supportive of the previous candidate gene studies and suggest that DRD has a complex genetic architecture that will require considerably larger samples to identify genetic associations more definitively. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Trait determinants of impulsive behavior: a comprehensive analysis of 188 rats

Impulsivity is a naturally occurring behavior that, when accentuated, can be found in a variety of neuropsychiatric disorders. The expression of trait impulsivity has been shown to change with a variety of factors, such as age and sex, but the existing literature does not reflect widespread consensus regarding the influence of modulating effects. We designed the present study to investigate, in a cohort of significant size (188 rats), the impact of four specific parameters, namely sex, age, strain and phase of estrous cycle, using the variable delay-to-signal (VDS) task. This cohort included (i) control animals from previous experiments; (ii) animals specifically raised for this study; and (iii) animals previously used for breeding purposes. Aging was associated with a general decrease in action impulsivity and an increase in delay tolerance. Females generally performed more impulsive actions than males but no differences were observed regarding delay intolerance. In terms of estrous cycle, no differences in impulsive behavior were observed and regarding strain, Wistar Han animals were, in general, more impulsive than Sprague-Dawley. In addition to further confirming, in a substantial study cohort, the decrease in impulsivity with age, we have demonstrated that both the strain and sex influences modulate different aspects of impulsive behavior manifestations.

Impulsive choice and pre-exposure to delays: iv. effects of delay- and immediacy-exposure training relative to maturational changes in impulsivity

Impulsive choice describes preference for smaller, sooner rewards over larger, later rewards. Excessive delay discounting (i.e., rapid devaluation of delayed rewards) underlies some impulsive choices, and is observed in many maladaptive behaviors (e.g., substance abuse, gambling). Interventions designed to reduce delay discounting may provide therapeutic gains. One such intervention provides rats with extended training with delayed reinforcers. When compared to a group given extended training with immediate reinforcers, delay-exposed rats make significantly fewer impulsive choices. To what extent is this difference due to delay-exposure training shifting preference toward self-control or immediacy-exposure training (the putative control group) shifting preference toward impulsivity? The current study compared the effects of delay- and immediacy-exposure training to a no-training control group and evaluated within-subject changes in impulsive choice across 51 male Wistar rats. Delay-exposed rats made significantly fewer impulsive choices than immediacy-exposed and control rats. Between-group differences in impulsive choice were not observed in the latter two groups. While delay-exposed rats showed large, significant pre- to posttraining reductions in impulsive choice, immediacy-exposed and control rats showed small reductions in impulsive choice. These results suggest that extended training with delayed reinforcers reduces impulsive choice, and that extended training with immediate reinforcers does not increase impulsive choice.

Pair Housing Alters Delay Discounting in Lewis and Fischer 344 Rats

Impulsive choice underlies several psychological disorders and can be assessed in laboratory rats using delay-discounting tasks, in which choice is for either one food pellet immediately or three food pellets after a delay. Choice for the smaller, immediate reinforcer is considered the impulsive choice. Lewis (LEW) and Fischer 344 (F344) rats differ in the number of impulsive choices made during this task when singly housed, with LEW choosing the impulsive option more often. Due to increasing recommendations to provide environmental enrichment as a component of animal-husbandry practices, a systematic replication of two previous studies was conducted using pair-housed LEW and F344. Delay discounting was assessed with pair-housed LEW and F344 and compared to previous data from singly housed LEW and F344 collected from the same laboratory. Results showed that differences in impulsive choice between the two strains were attenuated with pair housing. The main result driving this change appears to be an increase in impulsive choice in pair-housed F344 relative to singly housed F344.

Reduction in delay discounting due to nicotine and its attenuation by cholinergic antagonists in Lewis and Fischer 344 rats

RATIONALE

Nicotine acts as an agonist for nicotinic acetylcholine receptors (nAChRs), and mecamylamine, a nonselective nAChR antagonist, attenuates effects of nicotine on delay discounting in some rat strains; whether nicotine's attenuation is specific to nAChR antagonism is unknown.

OBJECTIVE

During experiment 1, we evaluated dose-dependent effects of nicotine on delay discounting of pair-housed Lewis (LEW) and Fischer 344 (F344) rats. During experiment 2, we examined the sensitivity of nicotine's effects on delay discounting to pharmacological antagonism of nAChRs or muscarinic AChRs (mAChRs).

MATERIALS AND METHODS

Male LEW and F344 were trained to choose between one food pellet delivered immediately and three food pellets delivered after an increasing delay. During experiment 1, saline and nicotine (0.1-1.0 mg/kg) were tested acutely. During experiment 2, mecamylamine (0.25-1.0 mg/kg) or a nonselective mAChR antagonist, scopolamine (0.01-0.056 mg/kg), was administered prior to nicotine administration.

RESULTS

Nicotine dose dependently reduced delay discounting for both rat strains, and no strain differences were observed (ΔAUC = + 107% for 1.0 mg/kg and + 69.6% for 0.3 mg/kg relative to saline). At some doses, pretreatment with mecamylamine (range ΔAUC = - 27.6 to - 7.3%) or scopolamine (range ΔAUC = - 0.74 to - 51.6%) significantly attenuated the nicotine-induced reduction in some measures of delay discounting for both strains.

CONCLUSIONS

Results from experiment 1 suggest that when LEW and F344 are pair housed, there are no strain differences in delay discounting in response to nicotine. Results from experiment 2 suggest that attenuation of nicotine's effects on delay discounting may not be specific to nAChR antagonism.

Aversive properties of negative incentive shifts in Fischer 344 and Lewis rats

Research on incentive contrast highlights that reward value is not absolute but rather is based upon comparisons we make to rewards we have received and expect to receive. Both human and nonhuman studies on incentive contrast show that shifting from a larger more-valued reward to a smaller less-valued reward is associated with long periods of nonresponding - a negative contrast effect. In this investigation, we used two different genetic rat strains, Fischer 344 and Lewis rats that putatively differ in their sensitivity to aversive stimulation, to assess the aversive properties of large-to-small reward shifts (negative incentive shifts). Additionally, we examined the extent to which increasing cost (fixed-ratio requirements) modulates negative contrast effects. In the presence of a cue that signaled the upcoming reward magnitude, lever pressing was reinforced with one of two different magnitudes of food (large or small). This design created two contrast shifts (small-to-large, large-to-small) and two shifts used as control conditions (small-to-small, large-to-large). Results showed a significant interaction between rat strain and cost requirements only during the negative incentive shift with the emotionally reactive Fischer 344 rats exhibiting significantly longer response latencies with increasing cost, highlighting greater negative contrast. These findings are more consistent with emotionality accounts of negative contrast and results of neurophysiological research that suggests shifting from a large to a small reward is aversive. Findings also highlight how subjective reward value and motivation is a product of gene-environment interactions.

Fischer 344 and Lewis Rat Strains as a Model of Genetic Vulnerability to Drug Addiction

Today it is well acknowledged that both nature and nurture play important roles in the genesis of psychopathologies, including drug addiction. Increasing evidence suggests that genetic factors contribute for at least 40–60% of the variation in liability to drug dependence. Human genetic studies suggest that multiple genes of small effect, rather than single genes, contribute to the genesis of behavioral psychopathologies. Therefore, the use of inbred rat strains might provide a valuable tool to identify differences, linked to genotype, important in liability to addiction and related disorders. In this regard, Lewis and Fischer 344 inbred rats have been proposed as a model of genetic vulnerability to drug addiction, given their innate differences in sensitivity to the reinforcing and rewarding effects of drugs of abuse, as well their different responsiveness to stressful stimuli. This review will provide evidence in support of this model for the study of the genetic influence on addiction vulnerability, with particular emphasis on differences in mesolimbic dopamine (DA) transmission, rewarding and emotional function. It will be highlighted that Lewis and Fischer 344 rats differ not only in several indices of DA transmission and adaptive changes following repeated drug exposure, but also in hypothalamic-pituitary-adrenal (HPA) axis responsiveness, influencing not only the ability of the individual to cope with stressful events, but also interfering with rewarding and motivational processes, given the influence of corticosteroids on dopamine neuron functionality. Further differences between the two strains, as impulsivity or anxiousness, might contribute to their different proneness to addiction, and likely these features might be linked to their different DA neurotransmission plasticity. Although differences in other neurotransmitter systems might deserve further investigation, results from the reviewed studies might open new vistas in understanding aberrant deviations in reward and motivational functions.

Strain and cocaine-induced differential opioid gene expression may predispose Lewis but not Fischer rats to escalate cocaine self-administration

The aim of the present study was to investigate alterations in gene expression of opioid system components induced by extended access (18 h) cocaine self-administration and to determine the impact of genetic background in the vulnerability to escalate cocaine intake. Comparing two inbred rat strains, we previously reported that Lewis rats progressively escalated cocaine consumption compared to Fischer rats, in a new translational model of intravenous cocaine self-administration, which included 14 sessions of 18-h operant sessions in which rats were allowed to select the cocaine unit dose to self-administer. We compare here Fischer and Lewis rats in the gene expression of endogenous opioid peptides (Pomc, Penk, Pdyn) and cognate receptors (Oprm, Oprk and Oprd) in reward-related brain regions, after exposure to either cocaine self-administration or yoked-saline, in the aforementioned translational paradigm. We performed a correlation analysis between the mRNA level, found in the Dorsal Striatum (DS), Nucleus accumbens (NAcc) shell and core respectively, and individual cocaine intake. Our findings show that the gene expression of all the aforementioned opioid genes exhibit strain-dependent differences in the DS, in absence of cocaine exposure. Also, different strain-specific cocaine-induced mRNA expression of Oprm and Oprk was found in DS. Only few differences were found in the ventral parts of the striatum. Moreover, gene expression level of Pdyn, Penk, Oprk, and Oprm in the DS was significantly correlated with cocaine intake only in Fischer rats. Overall, these data shed light on potential genetic differences which may predispose of subjects to initiate and escalate cocaine consumption.

I can't wait: Methods for measuring and moderating individual differences in impulsive choice

Impulsive choice behavior occurs when individuals make choices without regard for future consequences. This behavior is often maladaptive and is a common symptom in many disorders, including drug abuse, compulsive gambling, and obesity. Several proposed mechanisms may influence impulsive choice behavior. These mechanisms provide a variety of pathways that may provide the basis for individual differences that are often evident when measuring choice behavior. This review provides an overview of these different pathways to impulsive choice, and the behavioral intervention strategies being developed to moderate impulsive choice. Because of the compelling link between impulsive choice behavior and the near-epidemic pervasiveness of obesity in the United States, we focus on the relationship between impulsive choice behavior and obesity as a test case for application of the multiple pathways approach. Choosing immediate gratification over healthier long term food choices is a contributing factor to the obesity crisis. Behavioral interventions can lead to more self controlled choices in a rat pre-clinical model, suggesting a possible gateway for translation to human populations. Designing and implementing effective impulsive choice interventions is crucial to improving the overall health and well-being of impulsive individuals.

Genetic influences on delay discounting in smokers: examination of a priori candidates and exploration of dopamine-related haplotypes

RATIONALE

Delay discounting is a behavioral economic index of impulsivity that reflects a person's relative preference for small immediate rewards versus larger delayed rewards. Elevated delay discounting is robustly linked to addictive disorders and has been increasingly investigated as a viable endophenotype for genetic influences on addiction.

OBJECTIVE

The aim of this study is to examine associations between delay discounting and two a priori loci, rs4680 in COMT and rs1800497 in ANKK1, and three exploratory haplotypes proximal to rs1800497 in a sample of daily smokers.

METHODS

Participants were 713 (60.2 % male) daily smokers of European ancestry who completed a delay discounting assessment and provided a DNA sample.

RESULTS

Significant associations were detected between greater discounting of medium magnitude rewards (~$55) and the G allele of rs4680, as well as the T allele of rs1800497. Exploratory haplotype analyses identified two haplotypes (rs1160467/rs1800497; rs6277/rs1079597) significantly associated with delay discounting rates. However, the rs1160467/rs1800497 haplotype associations appeared to be entirely attributable to variation in rs1800497, suggesting that the association of rs1800497 with discounting is best understood at the individual SNP level. Similarly, the rs6277/rs1079597 haplotype findings suggested that the association was specific to rs1079597.

CONCLUSIONS

This study provides further evidence that rs4680 and rs1800497 genotypes are significantly associated with delay discounting preferences and does so among smokers for the first time. The study also provides evidence of specificity for the rs1800497 association and identifies a novel locus, rs1079597, as a genetic contributor to higher delay discounting rates.

Impulsive delayed reward discounting as a genetically-influenced target for drug abuse prevention: a critical evaluation

This review evaluates the viability of delayed reward discounting (DRD), an index of how much an individual devalues a future reward based on its delay in time, for genetically-informed drug abuse prevention. A review of the literature suggests that impulsive DRD is robustly associated with drug addiction and meets most of the criteria for being an endophenotype, albeit with mixed findings for specific molecular genetic influences. Several modes of experimental manipulation have been demonstrated to reduce DRD acutely. These include behavioral strategies, such as mindfulness, reward bundling, and episodic future thinking; pharmacological interventions, including noradrenergic agonists, adrenergic agonists, and multiple monoamine agonists; and neuromodulatory interventions, such as transcranial magnetic stimulation and transcranial direct current stimulation. However, the generalization of these interventions to positive clinical outcomes remains unclear and no studies to date have examined interventions on DRD in the context of prevention. Collectively, these findings suggest it would be premature to target DRD for genetically-informed prevention. Indeed, given the evidence of environmental contributions to impulsive DRD, whether genetically-informed secondary prevention would ever be warranted is debatable. Progress in identifying polymorphisms associated with DRD profiles could further clarify the underlying biological systems for pharmacological and neuromodulatory interventions, and, as a qualitatively different risk factor from existing prevention programs, impulsive DRD is worthy of investigation at a more general level as a novel and promising drug abuse prevention target.

Mechanisms of impulsive choice: II. Time-based interventions to improve self-control

Impulsive choice behavior has been proposed as a primary risk factor for other maladaptive behaviors (e.g., gambling, substance abuse). Recent research has suggested that timing processes may play a key role in impulsive choice behavior, and could provide an avenue for altering impulsive choice. Accordingly, the current experiments assessed a set of time-based behavioral interventions to increase self-control while simultaneously assessing effects on timing processes within the impulsive choice task. Three experiments assessed temporal interventions using a differential reinforcement of low rates task (Experiment 1) and exposure to either a variable or fixed interval schedule (Experiments 2-3). The efficacy of the interventions was assessed in Sprague-Dawley (Experiments 1-2) and Lewis (Experiment 3) rat strains. Impulsive choice behavior was assessed by measuring preferences of a smaller-sooner (SS) versus a larger-later (LL) reward, while timing of the SS and LL durations was measured during peak trials within the impulsive choice procedure. The rats showed an increased preference for the LL following all three time-based interventions and also displayed increased temporal precision. These results add to the increasing evidence that supports a possible role for temporal processing in impulsive choice behavior and supply novel behavioral interventions to decrease impulsive behavior.

Using Behavior Economics to Understand Alcohol Use Disorders: A Concise Review and Identification of Research Priorities

We review recent advances in the application of behavioral economics to alcohol use disorders (AUDs). Specifically, we review individual differences in alcohol demand (i.e., the relative reinforcing value of alcohol) and delayed reward discounting (i.e., impulsive decision making) in relation to AUDs. Additionally, we review the efficacy of reinforcement-based clinical applications. What emerges from the literature is an extensive body of cross-sectional research implicating alcohol demand and delayed reward discounting with alcohol misuse. However, more research is needed to examine these domains across the lifespan in order to understand their longitudinal trajectories. Similarly, clinical research is consistently supportive of reinforcement-based clinical interventions, but the number of randomized controlled trials to date is relatively small and there has been limited examination of the putative mechanisms of behavior change.

Mechanisms of Individual Differences in Impulsive and Risky Choice in Rats

Individual differences in impulsive and risky choice are key risk factors for a variety of maladaptive behaviors such as drug abuse, gambling, and obesity. In our rat model, ordered individual differences are stable across choice parameters, months of testing, and span a broad spectrum, suggesting that rats, like humans, exhibit trait-level impulsive and risky choice behaviors. In addition, impulsive and risky choices are highly correlated, suggesting a degree of correlation between these two traits. An examination of the underlying cognitive mechanisms has suggested an important role for timing processes in impulsive choice. In addition, in an examination of genetic factors in impulsive choice, the Lewis rat strain emerged as a possible animal model for studying disordered impulsive choice, with this strain demonstrating deficient delay processing. Early rearing environment also affected impulsive behaviors, with rearing in an enriched environment promoting adaptable and more self-controlled choices. The combined results with impulsive choice suggest an important role for timing and reward sensitivity in moderating impulsive behaviors. Relative reward valuation also affects risky choice, with manipulation of objective reward value (relative to an alternative reference point) resulting in loss chasing behaviors that predicted overall risky choice behaviors. The combined results are discussed in relation to domain-specific versus domain-general subjective reward valuation processes and the potential neural substrates of impulsive and risky choice.

Everywhere and everything: The power and ubiquity of time

Anticipatory timing plays a critical role in many aspects of human and non-human animal behavior. Timing has been consistently observed in the range of milliseconds to hours, and demonstrates a powerful influence on the organization of behavior. Anticipatory timing is acquired early in associative learning and appears to guide association formation in important ways. Importantly, timing participates in regulating goal-directed behaviors in many schedules of reinforcements, and plays a critical role in value-based decision making under concurrent schedules. In addition to playing a key role in fundamental learning processes, timing often dominates when temporal cues are available concurrently with other stimulus dimensions. Such control by the passage of time has even been observed when other cues provide more accurate information and can lead to sub-optimal behaviors. The dominance of temporal cues in governing anticipatory behavior suggests that time may be inherently more salient than many other stimulus dimensions. Discussions of the interface of the timing system with other cognitive processes are provided to demonstrate the powerful and primitive nature of time as a stimulus dimension.

Effects of acute and repeated nicotine administration on delay discounting in Lewis and Fischer 344 rats

Biological differences may underlie individual differences in impulsive behavior, such as choice for a smaller, more immediate reinforcer over a larger, more delayed reinforcer. Repeated exposure to drugs of abuse may have different effects on such behavior. To evaluate the acute and repeated effects of nicotine on impulsive choice, two strains of rats that have been shown to differ in impulsive choice were tested in a delay-discounting paradigm. Eight Lewis and eight Fischer 344 rats were allowed to choose between one food pellet delivered immediately and three food pellets delivered after a delay. The delay systematically increased in blocks of trials within each session, and the delay value at which the choice for the two alternatives was equal (i.e. the indifference point) was interpolated. Effects of nicotine (0.1-1.0 mg/kg, subcutaneous) on percent choice and indifference points were determined during the acute-testing phase and during the redetermination of effects of each dose after at least 30 sessions of repeated 1.0 mg/kg nicotine exposure. The Lewis rats had shorter indifference points (i.e. made fewer larger-reinforcer choices) compared with the Fischer 344 rats. Acute nicotine administration increased the mean larger-reinforcer choices at the 0.3 mg/kg dose in the Lewis rats and at the 1.0 mg/kg dose in the Fischer 344 rats. After repeated exposure to nicotine, indifference points returned to near-baseline (predrug) levels for both the strains. Strain differences were observed in the rates of delay discounting, and nicotine may decrease the impulsive choice acutely, but this effect does not seem to be long lasting.

Measurement of impulsive choice in rats: same- and alternate-form test-retest reliability and temporal tracking

Impulsive choice is typically measured by presenting smaller-sooner (SS) versus larger-later (LL) rewards, with biases towards the SS indicating impulsivity. The current study tested rats on different impulsive choice procedures with LL delay manipulations to assess same-form and alternate-form test-retest reliability. In the systematic-GE procedure (Green & Estle, 2003), the LL delay increased after several sessions of training; in the systematic-ER procedure (Evenden & Ryan, 1996), the delay increased within each session; and in the adjusting-M procedure (Mazur, 1987), the delay changed after each block of trials within a session based on each rat's choices in the previous block. In addition to measuring choice behavior, we also assessed temporal tracking of the LL delays using the median times of responding during LL trials. The two systematic procedures yielded similar results in both choice and temporal tracking measures following extensive training, whereas the adjusting procedure resulted in relatively more impulsive choices and poorer temporal tracking. Overall, the three procedures produced acceptable same form test-retest reliability over time, but the adjusting procedure did not show significant alternate form test-retest reliability with the other two procedures. The results suggest that systematic procedures may supply better measurements of impulsive choice in rats.

Impulsivity and cigarette smoking: discounting of monetary and consumable outcomes in current and non-smokers

RATIONALE

In delay discounting, temporally remote rewards have less value. Cigarette smoking is associated with steeper discounting of delayed money. The generality of this to nonmonetary outcomes, however, is unknown.

OBJECTIVES

We sought to determine whether cigarette smokers also show steep discounting of other delayed outcomes.

METHODS

Sixty-five participants (32 smokers and 33 non-smokers) completed four delay-discounting tasks, each involving different hypothetical outcomes. In the monetary task, participants indicated their preference for a smaller amount of money available immediately (titrated across trials) and $100 awarded at delays ranging from 1 week to 25 years (tested in blocks). In the three other discounting tasks the larger-later reward was $100 worth of a favorite food, alcoholic drink, or a favorite form of entertainment. All other aspects of these discounting tasks were identical to the monetary discounting task.

RESULTS

As previously shown, smokers discounted delayed money more steeply than non-smokers did. In addition, smokers discounted delayed food and entertainment rewards more steeply than did nonsmokers. A person's discounting of one outcome was correlated with discounting of other outcomes. Non-smokers discounted money less steeply than all other outcomes; smokers discounted money significantly less than food.

CONCLUSIONS

When compared to nonsmokers, cigarette smokers more steeply discount several types of delayed outcomes. This result, together with the finding that cross-commodity discounting rates were correlated within subjects, suggests that delay discounting is a trait that extends across domains.

Lewis rats have greater response impulsivity than Fischer rats

Impulsivity, a tendency toward immediate action without consideration of future consequences, is associated with a wide array of problematic behaviors. Response impulsivity, a type of behaviorally-assessed impulsivity characterized by behavioral disinhibition, is also associated with health risk behaviors. Response impulsivity is distinct from choice impulsivity, which is characterized by intolerance for delay. Lewis rats have higher levels of choice impulsivity than Fischer rats (Anderson & Woolverton, 2005; Madden et al., 2008; Stein et al., 2012). However, no studies have examined whether Lewis and Fischer rats have different levels of response impulsivity. The present research examined response impulsivity in the two rat strains. Subjects were 16 male Lewis and Fischer rats. Rats' response impulsivity was measured using the Five Choice Serial Reaction Time Task (5-CSRTT). In addition, their locomotor activity was measured in locomotor activity chambers. Lewis rats had more premature responses than Fischer rats during the 5-CSRTT assessment [F(1, 14)=5.34, p<0.05], indicating higher levels of response impulsivity. Locomotor activity did not differ between rat strain groups [F(1, 14)=3.05, p=.10], suggesting that overall movement did not account for group differences in response impulsivity on the 5-CSRTT. It can be concluded from this research that Lewis rats have higher levels of response impulsivity than Fischer rats, and therefore provide a valid rat model of individual differences in impulsivity.

Genetic basis of delay discounting in frequent gamblers: examination of a priori candidates and exploration of a panel of dopamine-related loci

INTRODUCTION

Delay discounting is a behavioral economic index of impulsivity that reflects preferences for small immediate rewards relative to larger delayed rewards. It has been consistently linked to pathological gambling and other forms of addictive behavior, and has been proposed to be a behavioral characteristic that may link genetic variation and risk of developing addictive disorders (i.e., an endophenotype). Studies to date have revealed significant associations with polymorphisms associated with dopamine neurotransmission. The current study examined associations between delay discounting and both previously linked variants and a novel panel of dopamine-related variants in a sample of frequent gamblers.

METHODS

Participants were 175 weekly gamblers of European ancestry who completed the Monetary Choice Questionnaire to assess delay discounting preferences and provided a DNA via saliva.

RESULTS

In a priori tests, two loci previously associated with delayed reward discounting (rs1800497 and rs4680) were not replicated, however, the long form of DRD4 VNTR was significantly associated with lower discounting of delayed rewards. Exploratory analysis of the dopamine-related panel revealed 11 additional significant associations in genes associated with dopamine synthesis, breakdown, reuptake, and receptor function (DRD3, SLC6A3, DDC, DBH, and SLC18A2). An aggregate genetic risk score from the nominally significant loci accounted for 17% of the variance in discounting. Mediational analyses largely supported the presence of indirect effects between the associated loci, delay discounting, and pathological gambling severity.

CONCLUSIONS

These findings do not replicate previously reported associations but identify several novel candidates and provide preliminary support for a systems biology approach to understand the genetic basis of delay discounting.

Effects of different fixed-ratio requirements on delay discounting in rats

In delay discounting, choice is between two reinforcers that differ in amount and delay, and the subjective value of either reinforcer decreases as a function of delay to its receipt. The steepness of the discounting function is thought to reflect the degree of impulsive choice. Many factors can influence impulsive choice, including the addition of a constant delay or response requirement to the smaller sooner (SS) and larger later (LL) reinforcers. A delay-discounting procedure developed by Evenden and Ryan (1996) is commonly used in behavioral research, yet effects of adding a response requirement to both alternatives with this procedure has not been examined. If different delay-discounting procedures are measuring the same phenomenon, preference reversals should occur with the Evenden and Ryan procedure as they do with other procedures with an added response requirement. The current experiment used an Evenden and Ryan procedure, and choice was examined when the response requirement was a small, intermediate, and large fixed ratio (FR). Fewer LL choices occurred with the small FR, and more LL choices occurred with the intermediate and large FR. The present experiment extends preference-reversal findings to a different and commonly used delay-discounting procedure.

Strong genetic influences on measures of behavioral-regulation among inbred rat strains

A fundamental challenge for any complex nervous system is to regulate behavior in response to environmental challenges. Three measures of behavioral-regulation were tested in a panel of eight inbred rat strains. These measures were: (1) sensation seeking as assessed by locomotor response to novelty and the sensory reinforcing effects of light onset, (2) attention and impulsivity, as measured by a choice reaction time task and (3) impulsivity as measured by a delay discounting task. Deficient behavioral-regulation has been linked to a number of psychopathologies, including ADHD, Schizophrenia, Autism, drug abuse and eating disorders. Eight inbred rat strains (August Copenhagen Irish, Brown Norway, Buffalo, Fischer 344, Wistar Kyoto, Spontaneous Hypertensive Rat, Lewis, Dahl Salt Sensitive) were tested. With n = 9 for each strain, we observed robust strain differences for all tasks; heritability was estimated between 0.43 and 0.66. Performance of the eight inbred rat strains on the choice reaction time task was compared to the performance of outbred Sprague Dawley (n = 28) and Heterogeneous strain rats (n = 48). The results indicate a strong genetic influence on complex tasks related to behavioral-regulation and indicate that some of the measures tap common genetically driven processes. Furthermore, our results establish the potential for future studies aimed at identifying specific alleles that influence variability for these traits. Identification of such alleles could contribute to our understanding of the molecular genetic basis of behavioral-regulation, which is of fundamental importance and likely contributes to multiple psychiatric disorders.

Impulsive choice behavior in four strains of rats: evaluation of possible models of Attention-Deficit/Hyperactivity Disorder

Several studies have examined impulsive choice behavior in spontaneously hypertensive rats (SHRs) as a possible pre-clinical model for Attention-Deficit/Hyperactivity Disorder (ADHD). However, this strain was not specifically selected for the traits of ADHD and as a result their appropriateness as a model has been questioned. The present study investigated whether SHRs would exhibit impulsive behavior in comparison to their control strain, Wistar Kyoto (WKY) rats. In addition, we evaluated a strain that has previously shown high levels of impulsive choice, the Lewis (LEW) rats and compared them with their source strain, Wistar (WIS) rats. In the first phase, rats could choose between a smaller-sooner (SS) reward of 1 pellet after 10 s and a larger-later (LL) reward of 2 pellets after 30 s. Subsequently, the rats were exposed to increases in LL reward magnitude and SS delay. These manipulations were designed to assess sensitivity to magnitude and delay within the choice task to parse out possible differences in using the strains as models of specific deficits associated with ADHD. The SHR and WKY strains did not differ in their choice behavior under either delay or magnitude manipulations. In comparison to WIS, LEW showed deficits in choice behavior in the delay manipulation, and to a lesser extent in the magnitude manipulation. An examination of individual differences indicated that the SHR strain may not be sufficiently homogeneous in their impulsive choice behavior to be considered as a viable model for impulse control disorders such as ADHD. The LEW strain may be worthy of further consideration for their suitability as an animal model.

Individual differences in impulsive choice and timing in rats

Individual differences in impulsive choice behavior have been linked to a variety of behavioral problems including substance abuse, smoking, gambling, and poor financial decision-making. Given the potential importance of individual differences in impulsive choice as a predictor of behavioral problems, the present study sought to measure the extent of individual differences in a normal sample of hooded Lister rats. Three experiments utilized variations of a delay discounting task to measure the degree of variation in impulsive choice behavior across individual rats. The individual differences accounted for 22-55% of the variance in choice behavior across the three experiments. In Experiments 2 and 3, the individual differences were still apparent when behavior was measured across multiple choice points. Large individual differences in the rate of responding, and modest individual differences in timing of responding were also observed during occasional peak trials. The individual differences in timing and rate, however, did not correlate consistently with individual differences in choice behavior. This suggests that a variety of factors may affect choice behavior, response rate, and response timing.

Integrating behavioral economics and behavioral genetics: delayed reward discounting as an endophenotype for addictive disorders

Delayed reward discounting is a behavioral economic index of impulsivity, referring to how much an individual devalues a reward based on its delay in time. As a behavioral process that varies considerably across individuals, delay discounting has been studied extensively as a model for self-control, both in the general population and in clinical samples. There is growing interest in genetic influences on discounting and, in particular, the prospect of discounting as an endophenotype for addictive disorders (i.e., a heritable mechanism partially responsible for conferring genetic risk). This review assembles and critiques the evidence supporting this hypothesis. Via numerous cross-sectional studies and a small number of longitudinal studies, there is considerable evidence that impulsive discounting is associated with addictive behavior and appears to play an etiological role. Moreover, there is increasing evidence from diverse methodologies that impulsive delay discounting is temporally stable, heritable, and that elevated levels are present in nonaffected family members. These findings suggest that impulsive discounting meets the criteria for being considered an endophenotype. In addition, recent findings suggest that genetic variation related to dopamine neurotransmission is significantly associated with variability in discounting preferences. A significant caveat, however, is that the literature is modest in some domains and, in others, not all the findings have been supportive or consistent. In addition, important methodological considerations are necessary in future studies. Taken together, although not definitive, there is accumulating support for the hypothesis of impulsive discounting as an endophenotype for addictive behavior and a need for further systematic investigation.

Delay discounting in Lewis and Fischer 344 rats: steady-state and rapid-determination adjusting-amount procedures

Lewis rats have been shown to make more impulsive choices than Fischer 344 rats in discrete-trial choice procedures that arrange fixed (i.e., nontitrating) reinforcement parameters. However, nontitrating procedures yield only gross estimates of preference, as choice measures in animal subjects are rarely graded at the level of the individual subject. The present study was designed to examine potential strain differences in delay discounting using an adjusting-amount procedure, in which distributed (rather than exclusive) choice is observed due to dynamic titration of reinforcer magnitude across trials. Using a steady-state version of the adjusting-amount procedure in which delay was manipulated between experimental conditions, steeper delay discounting was observed in Lewis rats compared to Fischer 344 rats; further, delay discounting in both strains was well described by the traditional hyperbolic discounting model. However, upon partial completion of the present study, a study published elsewhere (Wilhelm & Mitchell, 2009) demonstrated no difference in delay discounting between these strains with the use of a more rapid version of the adjusting-amount procedure (i.e., in which delay is manipulated daily). Thus, following completion of the steady-state assessment in the present study, all surviving Lewis and Fischer 344 rats completed an approximation of this rapid-determination procedure in which no strain difference in delay discounting was observed.

Delay discounting: I'm a k, you're a k

Delay discounting is the decline in the present value of a reward with delay to its receipt. Across a variety of species, populations, and reward types, value declines hyperbolically with delay. Value declines steeply with shorter delays, but more shallowly with longer delays. Quantitative modeling provides precise measures to characterize the form of the discount function. These measures may be regarded as higher-order dependent variables, intervening variables, or hypothetical constructs. I suggest the degree of delay discounting may be a personality trait. In the end, the ontological status of measures of delay discounting is irrelevant. Whatever delay discounting may be, its study has provided the field of behavior analysis and other areas measures with robust generality and predictive validity for a variety of significant human problems. Research on moderating the degree of delay discounting has the potential to produce substantial societal benefits.

Strain differences in delay discounting between Lewis and Fischer 344 rats at baseline and following acute and chronic administration of d-amphetamine

Stimulant drugs have been shown either to increase or decrease rates of delay discounting (impulsive choice). These mixed findings may result from genetic, neurochemical, or environmental factors. Lewis (LEW) and Fischer 344 (F344) rats have neurochemical and behavioral differences that may be relevant to delay discounting and were used to examine effects of acute and chronic administration of d-amphetamine (d-AMP) on impulsive choice using a within-session delay-discounting procedure. Male LEW (n=8) and F344 (n=8) rats chose between one food pellet delivered immediately and three food pellets delivered after an increasing delay. Saline and d-AMP (0.1, 0.3, 1.0, and 1.7 mg/kg) were tested acutely and during chronic d-AMP exposure. Choice for the larger reinforcer decreased as the delay to its presentation increased for both strains at baseline. LEW rats made more impulsive choices than F344 rats as indicated by shorter indifference points, and this is consistent with previous research. Acute administration of d-AMP dose dependently increased larger-reinforcer choice and area under the curve (AUC) for LEW, but not F344 rats. During chronic exposure to d-AMP, larger-reinforcer choice and AUC increased relative to acute administration for F344 rats responding in shorter delay series, but not for F344 rats responding in longer delay series or for LEW rats. Differential effects of acute and chronic administration of d-AMP on impulsive choice in LEW and F344 rats may be a result of various factors, including genetic, neurochemical, and environmental variables. Future research should attempt to tease apart the relative contribution of each of these factors on impulsive choice.

Delay discounting: trait variable?

Delay discounting refers to the tendency for outcomes that are remote in time to have less value than more immediate outcomes. Steep discounting of delayed outcomes is associated with a variety of social maladies. The degree of sensitivity to delayed outcomes may be a stable and pervasive individual characteristic. In analyses of archival data, the present study found positive correlations between the degree of delay discounting for one outcome (as measured by the Area Under the Curve), and the degree of discounting for other outcomes. Along with additional evidence reviewed, these data suggest that delay discounting may be considered a personality trait. Recent research in epigenetics, neuroscience, and behavior suggests delay discounting may prove to be a beneficial target for therapeutic attempts to produce global reductions in impulsivity related to delay discounting.

The genetic basis of delay discounting and its genetic relationship to alcohol dependence

Delay discounting is steeper for individuals who drink heavily or are alcohol dependent, but the reasons for this are unclear. Given the substantial genetic component for alcohol dependence it is not unreasonable to ask whether discounting and alcohol dependence have a genetic relationship. For there to be a genetic relationship, delay discounting must have a genetic component (heritability). A review of the human and animal literature suggests that this is the case. Other literature examining whether discounting is a correlated phenotype in individuals who are genetically predisposed to drink (family history positive individuals and selected lines of rats and mice) is mixed, suggesting that networks of genes are critical for the relationship to be seen. The identities of the genes in this network are not yet known, but research examining polymorphisms associated with differences in discounting is beginning to address this issue.

Delay discounting and gambling

Delay discounting describes the decline in the value of a reinforcer as the delay to that reinforcer increases. A review of the available studies revealed that steep delay discounting is positively correlated with problem or pathological gambling. One hypothesis regarding this correlation derives from the discounting equation proposed by Mazur (1989). According to the equation, steeper discounting renders the difference between fixed-delayed rewards and gambling-like variable-delayed rewards larger; with the latter being more valuable. The present study was designed to test this prediction by first assessing rats' impulsive choices across four delays to a larger-later reinforcer. A second condition quantified strength of preference for mixed- over fixed-delays, with the duration of the latter adjusted between sessions to achieve indifference. Strength of preference for the mixed-delay alternative is given by the fixed delay at indifference (lower fixed-delay values reflect stronger preferences). Percent impulsive choice was not correlated with the value of the fixed delay at indifference and, therefore, the prediction of the hyperbolic model of gambling was not supported. A follow-up assessment revealed a significant decrease in impulsive choice after the second condition. This shift in impulsive choice could underlie the failure to observe the predicted correlation between impulsive choice and degree of preference for mixed- over fixed delays.

Novelty seeking, incentive salience and acquisition of cocaine self-administration in the rat

It has been suggested that incentive salience plays a major role in drug abuse and the development of addiction. Additionally, novelty seeking has been identified as a significant risk factor for drug abuse. However, how differences in the readiness to attribute incentive salience relate to novelty seeking and drug abuse vulnerability has not been explored. The present experiments examined how individual differences in incentive salience attribution relate to novelty seeking and acquisition of cocaine self-administration in a preclinical model. Rats were first assessed in an inescapable novelty task and a novelty place preference task (measures of novelty seeking), followed by a Pavlovian conditioned approach task for food (a measure of incentive salience attribution). Rats then were trained to self-administer cocaine (0.3 or 1.0 mg/kg/infusion) using an autoshaping procedure. The results demonstrate that animals that attributed incentive salience to a food-associated cue were higher novelty seekers and acquired cocaine self-administration more quickly at the lower dose. The results suggest that novelty-seeking behavior may be a mediator of incentive salience attribution and that incentive salience magnitude may be an indicator of drug reward.

The role of the nucleus accumbens core in impulsive choice, timing, and reward processing

The present series of experiments aimed to pinpoint the source of nucleus accumbens core (AcbC) effects on delay discounting. Rats were trained with an impulsive choice procedure between an adjusting smaller sooner reward and a fixed larger later reward. The AcbC-lesioned rats produced appropriate choice behavior when the reward magnitude was equal. An increase in reward magnitude resulted in a failure to increase preference for the larger later reward in the AcbC-lesioned rats, whereas a decrease in the larger later reward duration resulted in normal alterations in choice behavior in AcbC-lesioned rats. Subsequent experiments with a peak timing (Experiments 2 and 3) and a behavioral contrast (Experiment 4) indicated that the AcbC-lesioned rats suffered from decreased incentive motivation during changes in reward magnitude (Experiments 2 and 4) and when expected rewards were omitted (Experiments 2 and 3), but displayed intact anticipatory timing of reward delays (Experiments 2 and 3). The results indicate that the nucleus accumbens core is critical for determining the incentive value of rewards, but does not participate in the timing of reward delays.

Intrastrain differences in seizure susceptibility, pharmacological response and basal neurochemistry of Wistar rats

Reliable well-characterised animal models of seizures are necessary in order to better understand the underlying pathophysiological mechanisms as well as to screen potential anticonvulsant drugs. We currently use the focal pilocarpine model as an acute limbic seizure model. Due to breeding problems at the vendor, and apparent changes in pilocarpine-induced seizure susceptibility, we were forced to change breeding locations and vendors over a period of 2 years. Male Wistar rats were either purchased from two breeding locations of Charles River Laboratories (France and Germany), or obtained from Harlan Laboratories (The Netherlands). In the present retrospective study we evaluated the impact of these vendor changes on ketamine dosing to establish anaesthesia, on pilocarpine-induced seizure susceptibility, and on basal extracellular hippocampal noradrenaline, dopamine, serotonin, gamma-amino butyric acid, and glutamate levels of all pilocarpine-treated rats included in our studies. Significant differences were present in all of the parameters analyzed. This study clearly illustrates that intrastrain differences do exist from one vendor/breeding location to another, or even between rats from the same breeding location.