Delay discounting in Lewis and Fischer 344 rats: steady-state and rapid-determination adjusting-amount procedures

Hyperbolae

Hyperbolic relations between independent and dependent variables are ubiquitous in the experimental analysis of behavior, mentioned in over 150 articles in the Journal of the Experimental Analysis of Behavior. There are two principal forms of hyperbolae: The first describes the relation between response rate and reinforcement rate on variable-interval schedules of reinforcement; it rises asymptotically toward a maximum. The second describes the relation between the current equivalent value of an incentive and its delay or (im)probability; it falls from a maximum toward an asymptote of 0. Where do these come from? What do their parameters mean? How are they related? This article answers the first two questions and addresses the last.

Zebrafish choice behavior is sensitive to reinforcer rate, immediacy, and magnitude ratios

Behavioral flexibility has, in part, been defined by choice behavior changing as a function of changes in reinforcer payoffs. We examined whether the generalized matching law quantitatively described changes in choice behavior in zebrafish when relative reinforcer rates, delays/immediacy, and magnitudes changed between two alternatives across conditions. Choice was sensitive to each of the three reinforcer properties. Sensitivity estimates to changes in relative reinforcer rates were greater when 2 variable-interval schedules were arranged independently between alternatives (Experiment 1a) than when a single schedule pseudorandomly arranged reinforcers between alternatives (Experiment 1b). Sensitivity estimates for changes in relative reinforcer immediacy (Experiment 2) and magnitude (Experiment 3) were similar but lower than estimates for reinforcer rates. These differences in sensitivity estimates are consistent with studies examining other species, suggesting flexibility in zebrafish choice behavior in the face of changes in payoff as described by the generalized matching law.

Individual Differences in Intertemporal Choice

Intertemporal choice involves deciding between smaller, sooner and larger, later rewards. People tend to prefer smaller rewards that are available earlier to larger rewards available later, a phenomenon referred to as temporal or delay discounting. Despite its ubiquity in human and non-human animals, temporal discounting is subject to considerable individual differences. Here, we provide a critical narrative review of this literature and make suggestions for future work. We conclude that temporal discounting is associated with key socio-economic and health-related variables. Regarding personality, large-scale studies have found steeper temporal discounting to be associated with higher levels of self-reported impulsivity and extraversion; however, effect sizes are small. Temporal discounting correlates negatively with future-oriented cognitive styles and inhibitory control, again with small effect sizes. There are consistent associations between steeper temporal discounting and lower intelligence, with effect sizes exceeding those of personality or cognitive variables, although socio-demographic moderator variables may play a role. Neuroimaging evidence of brain structural and functional correlates is not yet consistent, neither with regard to areas nor directions of effects. Finally, following early candidate gene studies, recent Genome Wide Association Study (GWAS) approaches have revealed the molecular genetic architecture of temporal discounting to be more complex than initially thought. Overall, the study of individual differences in temporal discounting is a maturing field that has produced some replicable findings. Effect sizes are small-to-medium, necessitating future hypothesis-driven work that prioritizes large samples with adequate power calculations. More research is also needed regarding the neural origins of individual differences in temporal discounting as well as the mediating neural mechanisms of associations of temporal discounting with personality and cognitive variables.

Analyzing the magnitude effect in spontaneously hypertensive (SHR) and wistar Kyoto (WKY) rats

We analyzed the magnitude effect in Spontaneously Hypertensive (SHR) and Wistar Kyoto (WKY) rats choosing between a smaller-sooner (SSF) and a larger-later food (LLF) in the initial link of a concurrent-chains procedure. The SSF was delivered immediately in one terminal link and the LLF delayed 0.01, 5, 10, 20, 40, or 80 s in the other terminal link. An ABABA design varied food amount, 1 vs. 4 and 3 vs. 8 food-pellets in conditions A and B, respectively. The SHRs made more impulsive choices than the WKYs. The hyperbolic-decay model and the Generalized Matching Law fitted the data well. Discounting rate (k) and the area under the discounting curve (AUC) for the choices made by the SHRs in conditions A, were like those in conditions B. For the choices that the individual WKYs made, k was slightly higher and AUC smaller in conditions B than in conditions A. For both strains sensitivity to the immediacy of the LLF (s) was slightly higher in conditions A than in conditions B. Thus, we found no conclusive, compelling evidence either supporting or discarding the magnitude effect in the SHRs and scarce evidence supporting an effect opposite to the magnitude effect in the WKYs.

Reducing impulsive choice VII: effects of duration of delay-exposure training

Impulsive choice is related to substance use disorders, obesity, and other behaviors that negatively impact human health. Reducing impulsive choice may prove beneficial in ameliorating these maladaptive behaviors. Preclinical research in rats indicates that one reliable method for producing large and lasting reductions in impulsive choice is delay-exposure (DE) training. In all six of the prior DE-training experiments, rats were given extensive experience (~ 120 training sessions) with a delayed reinforcement contingency. The present experiment evaluated if similar large and lasting reductions in impulsive choice could be achieved with less training. The duration of DE training between groups of male Wistar rats was 0 sessions (training ended after a lever-pressing acquisition criterion was met), 30, 60, or 120 sessions. Comparison groups were given the same durations of training with immediate reinforcement. A post-training assessment of impulsive choice was completed using an increasing-delay procedure. For rats assigned to the 60-session condition, impulsive choice was reassessed at a 120-day follow-up. DE training reduced impulsive choice but, contrary to expectation, reductions in impulsive choice did not increase with DE-training duration (no significant training-duration by group interaction). Importantly, 60 sessions of DE training produced reductions in impulsive choice that were comparable to prior published findings and this effect remained significant at the 120-day follow-up. Procedural elements that may be responsible for the DE-training effect, and how they could be improved in future experiments, are discussed.

Delay discounting of different outcomes: Review and theory

Steep delay discounting is characterized by a preference for small immediate outcomes relative to larger delayed outcomes and is predictive of drug abuse, risky sexual behaviors, and other maladaptive behaviors. Nancy M. Petry was a pioneer in delay discounting research who demonstrated that people discount delayed monetary gains less steeply than they discount substances with abuse liability. Subsequent research found steep discounting for not only drugs, but other nonmonetary outcomes such as food, sex, and health. In this systematic review, we evaluate the hypotheses proposed to explain differences in discounting as a function of the type of outcome and explore the trait- and state-like nature of delay discounting. We found overwhelming evidence for the state-like quality of delay discounting: Consistent with Petry and others' work, nonmonetary outcomes are discounted more steeply than monetary outcomes. We propose two hypotheses that together may account for this effect: Decreasing Future Preference and Decreasing Future Worth. We also found clear evidence that delay discounting has trait-like qualities: People who steeply discount monetary outcomes steeply discount nonmonetary outcomes as well. The implication is that changing delay discounting for one outcome could change discounting for other outcomes.

Bidding for delayed rewards: Accumulation as delay discounting, delay discounting as regulation, demand functions as corollary

In the accumulation paradigm animals press one manipulandum to accumulate pellets or seconds of access to food, and then press another manipulandum, or run some distance, to collect it. The accumulation may be interpreted as delay discounting, with the animals adjusting the distal amount to compensate for its distance or delay. The amount accumulated before being collected is a linear function of the distance or time that the experimental paradigm stipulates for collecting it. That linear function follows from the Unit-Price/Unit-Amount axiom. The inverse of the linear compensation functions gives a delay-discount hyperbola. The advantages of the accumulation paradigm and analytic framework for delay discounting studies are noted. Compensation functions are then derived from a behavioral regulation model, which generalizes them to contexts where the individual's budget for response cost becomes over-taxed. In turn, such compensation/regulation models lead directly to representative demand functions. In sum, regulation models provide a theoretical grounding for demand functions, compensation functions, and delay discounting hyperbolas. The parameter that links them is the unit amount k, the slope of the compensation function and of the discount function, the setpoint for consumption in a regulation model, and the ideal quantity consumed at minimal price in a demand analysis.

Differential effects of d-amphetamine and atomoxetine on risk-based decision making of Lewis and Fischer 344 rats

Individuals with attention-deficit/hyperactivity disorder tend to make risker choices during probabilistic-discounting procedures. Thus, how common attention-deficit/hyperactivity disorder medications affect probabilistic discounting is of interest. In general, d-amphetamine increases risk-taking while atomoxetine has produced mixed effects in rats. Results from previous studies may result from genetic factors. Lewis and F344 rats have neurochemical differences that may be relevant to probabilistic discounting and how drugs affect such behavior. In this study, we evaluated dose-dependent effects of d-amphetamine and atomoxetine on probabilistic discounting of Lewis and F344. Male Lewis and F344 chose between one food pellet delivered 100% of the time and three food pellets delivered following decreasing probabilities of delivery (i.e. 100%, 66.7%, 33.3%, 16.5%, and 8.25%). Saline, d-amphetamine (0.1-1.8 mg/kg), and atomoxetine (0.1-7.8 mg/kg) were tested acutely. Lewis and F344 did not differ in choice at baseline. d-Amphetamine increased risky choice for both rat strains at low-to-moderate doses, although it did so at a lower dose (0.1 and 0.3 mg/kg) for F344 as compared to Lewis (0.3 mg/kg only). At high doses (1.0 and 1.8 mg/kg), d-amphetamine disrupted choice, increased frequencies of omitted trials, and reduced reinforcer sensitivity. Although atomoxetine increased frequencies of omitted trials at high doses (5.6 and 7.8 mg/kg), it had no effect on probabilistic discounting for either rat strain. Although Lewis and F344 differ in various types of impulsivity (i.e. motor, choice), with Lewis being the more impulsive of the two, the present results suggest that Lewis and F344 do not differ in risk-based decision-making. Effects of d-amphetamine on probabilistic discounting may be biology-dependent and differ from effects of atomoxetine.

Linking Delay Discounting and Substance Use Disorders: Genotypes and Phenotypes

Research supports the idea that "delay discounting," also known as temporal discounting, intertemporal choice, or impulsive choice, is a transdisease process with a strong connection to substance use disorders (SUDs) and other psychopathologies, like attention deficit hyperactivity disorder and depression. This article briefly reviews the evidence used to conclude that delay discounting is heritable and should be considered to be an endophenotype, as well as evidence of its behavioral and genetic associations with SUDs. It also discusses the limitations that should be considered when evaluating the strength of these associations. Finally, this article briefly describes research examining relationships among delay discounting and SUD-associated intermediate phenotypes to better understand the conceptual relationships underlying the links between SUDs and delay discounting, and identifies research gaps that should be addressed.

Genetic influences on delayed reward discounting: A genome-wide prioritized subset approach

Delayed reward discounting (DRD) is a behavioral economic measure of impulsivity that has been consistently associated with addiction. It has also been identified as a promising addiction endophenotype, linking specific sources of genetic variation to individual risk. A challenge in the studies to date is that levels of DRD are often confounded with prior drug use, and previous studies have also had limited genomic scope. The current investigation sought to address these issues by studying DRD in healthy young adults with low levels of substance use (N = 986; 62% female, 100% European ancestry) and investigating genetic variation genome-wide. The genome-wide approach used a prioritized subset design, organizing the tests into theoretically and empirically informed categories and apportioning power accordingly. Three subsets were used: (a) a priori loci implicated by previous studies; (b) high-value addiction (HVA) markers from the recently developed SmokeScreen array; and (c) an atheoretical genome-wide scan. Among a priori loci, a nominally significant association was present between DRD and rs521674 in ADRA2A. No significant HVA loci were detected. One statistically significant genome-wide association was detected (rs13395777, p = 2.8 × 10-8), albeit in an intergenic region of unknown function. These findings are generally not supportive of the previous candidate gene studies and suggest that DRD has a complex genetic architecture that will require considerably larger samples to identify genetic associations more definitively. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Trait determinants of impulsive behavior: a comprehensive analysis of 188 rats

Impulsivity is a naturally occurring behavior that, when accentuated, can be found in a variety of neuropsychiatric disorders. The expression of trait impulsivity has been shown to change with a variety of factors, such as age and sex, but the existing literature does not reflect widespread consensus regarding the influence of modulating effects. We designed the present study to investigate, in a cohort of significant size (188 rats), the impact of four specific parameters, namely sex, age, strain and phase of estrous cycle, using the variable delay-to-signal (VDS) task. This cohort included (i) control animals from previous experiments; (ii) animals specifically raised for this study; and (iii) animals previously used for breeding purposes. Aging was associated with a general decrease in action impulsivity and an increase in delay tolerance. Females generally performed more impulsive actions than males but no differences were observed regarding delay intolerance. In terms of estrous cycle, no differences in impulsive behavior were observed and regarding strain, Wistar Han animals were, in general, more impulsive than Sprague-Dawley. In addition to further confirming, in a substantial study cohort, the decrease in impulsivity with age, we have demonstrated that both the strain and sex influences modulate different aspects of impulsive behavior manifestations.

Dissecting drug effects in preclinical models of impulsive choice: emphasis on glutamatergic compounds

RATIONALE

Impulsive choice is often measured with delay discounting paradigms. Because there are multiple discounting procedures, as well as different statistical analyses that can be applied to data generated from these paradigms, there are some inconsistencies in the literature regarding drug effects on impulsive choice.

OBJECTIVES

The goal of the current paper is to review the methodological and analytic approaches used to measure discounting and to discuss how these differences can account for differential drug effects observed across studies.

RESULTS

Because some procedures/analyses use a single data point as the dependent variable, changes in this value following pharmacological treatment may be interpreted as alterations in sensitivity to delayed reinforcement, but when other procedures/analyses are used, no changes in behavior are observed. Even when multiple data points are included, some studies show that the statistical analysis (e.g., ANOVA on raw proportion of responses vs. using hyperbolic/exponential functions) can lead to different interpretations. Finally, procedural differences (e.g., delay presentation order, signaling the delay to reinforcement, etc.) in the same discounting paradigm can alter how drugs affect sensitivity to delayed reinforcement.

CONCLUSIONS

Future studies should utilize paradigms that allow one to observe alterations in responding at each delay (e.g., concurrent-chains schedules). Concerning statistical analyses, using parameter estimates derived from nonlinear functions or incorporating the generalized matching law can allow one to determine if drugs affect sensitivity to delayed reinforcement or impair discrimination of the large and small magnitude reinforcers. Using these approaches can help further our understanding of the neurochemical underpinnings of delay discounting.

Pair Housing Alters Delay Discounting in Lewis and Fischer 344 Rats

Impulsive choice underlies several psychological disorders and can be assessed in laboratory rats using delay-discounting tasks, in which choice is for either one food pellet immediately or three food pellets after a delay. Choice for the smaller, immediate reinforcer is considered the impulsive choice. Lewis (LEW) and Fischer 344 (F344) rats differ in the number of impulsive choices made during this task when singly housed, with LEW choosing the impulsive option more often. Due to increasing recommendations to provide environmental enrichment as a component of animal-husbandry practices, a systematic replication of two previous studies was conducted using pair-housed LEW and F344. Delay discounting was assessed with pair-housed LEW and F344 and compared to previous data from singly housed LEW and F344 collected from the same laboratory. Results showed that differences in impulsive choice between the two strains were attenuated with pair housing. The main result driving this change appears to be an increase in impulsive choice in pair-housed F344 relative to singly housed F344.

Reduction in delay discounting due to nicotine and its attenuation by cholinergic antagonists in Lewis and Fischer 344 rats

RATIONALE

Nicotine acts as an agonist for nicotinic acetylcholine receptors (nAChRs), and mecamylamine, a nonselective nAChR antagonist, attenuates effects of nicotine on delay discounting in some rat strains; whether nicotine's attenuation is specific to nAChR antagonism is unknown.

OBJECTIVE

During experiment 1, we evaluated dose-dependent effects of nicotine on delay discounting of pair-housed Lewis (LEW) and Fischer 344 (F344) rats. During experiment 2, we examined the sensitivity of nicotine's effects on delay discounting to pharmacological antagonism of nAChRs or muscarinic AChRs (mAChRs).

MATERIALS AND METHODS

Male LEW and F344 were trained to choose between one food pellet delivered immediately and three food pellets delivered after an increasing delay. During experiment 1, saline and nicotine (0.1-1.0 mg/kg) were tested acutely. During experiment 2, mecamylamine (0.25-1.0 mg/kg) or a nonselective mAChR antagonist, scopolamine (0.01-0.056 mg/kg), was administered prior to nicotine administration.

RESULTS

Nicotine dose dependently reduced delay discounting for both rat strains, and no strain differences were observed (ΔAUC = + 107% for 1.0 mg/kg and + 69.6% for 0.3 mg/kg relative to saline). At some doses, pretreatment with mecamylamine (range ΔAUC = - 27.6 to - 7.3%) or scopolamine (range ΔAUC = - 0.74 to - 51.6%) significantly attenuated the nicotine-induced reduction in some measures of delay discounting for both strains.

CONCLUSIONS

Results from experiment 1 suggest that when LEW and F344 are pair housed, there are no strain differences in delay discounting in response to nicotine. Results from experiment 2 suggest that attenuation of nicotine's effects on delay discounting may not be specific to nAChR antagonism.

Spontaneously hypertensive (SHR) rats choose more impulsively than Wistar-Kyoto (WKY) rats on a delay discounting task

Indications of Attention Deficit Hyperactivity Disorder (ADHD) in the spontaneously hypertensive rat (SHR) are not consistent across different tests of impulsivity, questioning the SHR's validity as a rodent model of ADHD. This study used a concurrent-chains procedure to examine possible differences in impulsive choice between SHRs and control-normotensive Wistar Kyoto (WKY) rats. The aim was to extend the generality of findings showing regularities between the hyperbolic-decay model and the generalized matching law fitting delay discounting data from nonhuman animals. The objectives were to: (1) examine differences in impulsive choice between SHRs and WKYs; (2) add evidence suggesting that the SHR is a suitable model of ADHD; (3) demonstrate that concurrent-chains procedures requiring locomotion detect differences in impulsive choice between SHRs and WKYs; (4) support the idea that impulsivity in nonhuman animals increases with training. The initial link used two non-independent random interval schedules arranging entries to the terminal links, where one fixed-time (FT) schedule delayed 1-food pellet and the other FT 4-food pellets. The FT delaying the former was kept constant at 0.1s and that delaying the latter changed after every 10 food deliveries, defining six delay components (0.1, 5, 10, 20, 40, and 80s) presented in random order each session. Results showed that the SHRs choose more impulsively than the WKYs, adding to the body of evidence suggesting that the SHR may be a suitable model of ADHD. Both models of choice fitted the impulsive choices of the SHRs and WKYs well; positive correlations between estimates of parameters k and s suggested compatibility between models of choice showing that impulsivity increases with training.

Minor Functional Deficits in Basic Response Patterns for Reinforcement after Frontal Traumatic Brain Injury in Rats

Traumatic brain injury (TBI) is a major contributor to numerous psychiatric conditions and chronic behavioral dysfunction. Recent studies in experimental brain injury have begun to adopt operant methodologies to assess these deficits, all of which rely on the process of reinforcement. No studies have directly examined how reinforced behaviors are affected by TBI, however. The current study assessed performance under the four most common schedules of reinforcement (fixed ratio, variable ratio, fixed interval, variable interval) and one higher order schedule assessing motivation (progressive ratio) after bilateral, pre-frontal controlled cortical impact injury. TBI-induced differences on the basic schedules were minor, with the exception of the variable ratio, where increased efficacy (more reinforcers, higher response rates, lower interresponse times) at higher requirements was observed as a result of brain injury. Performance on the progressive ratio schedule showed some gross differences between the groups, in that sham rats became more efficient under this schedule while injured rats perseverated in lever pressing. Further, injured rats were specifically impaired at lower response requirements on the progressive ratio. Taken together, these findings indicate that simple reinforced behaviors are mostly unaffected after TBI, except in the case of variable ratio schedules, but the altered performance on the higher-order progressive ratio schedule suggests changes involving motivation or potentially perseveration. These findings validate operant measures of more complex behaviors for brain injury, all of which rely on reinforcement and can be taken into consideration when adapting and developing novel functional assessments.

Fischer 344 and Lewis Rat Strains as a Model of Genetic Vulnerability to Drug Addiction

Today it is well acknowledged that both nature and nurture play important roles in the genesis of psychopathologies, including drug addiction. Increasing evidence suggests that genetic factors contribute for at least 40–60% of the variation in liability to drug dependence. Human genetic studies suggest that multiple genes of small effect, rather than single genes, contribute to the genesis of behavioral psychopathologies. Therefore, the use of inbred rat strains might provide a valuable tool to identify differences, linked to genotype, important in liability to addiction and related disorders. In this regard, Lewis and Fischer 344 inbred rats have been proposed as a model of genetic vulnerability to drug addiction, given their innate differences in sensitivity to the reinforcing and rewarding effects of drugs of abuse, as well their different responsiveness to stressful stimuli. This review will provide evidence in support of this model for the study of the genetic influence on addiction vulnerability, with particular emphasis on differences in mesolimbic dopamine (DA) transmission, rewarding and emotional function. It will be highlighted that Lewis and Fischer 344 rats differ not only in several indices of DA transmission and adaptive changes following repeated drug exposure, but also in hypothalamic-pituitary-adrenal (HPA) axis responsiveness, influencing not only the ability of the individual to cope with stressful events, but also interfering with rewarding and motivational processes, given the influence of corticosteroids on dopamine neuron functionality. Further differences between the two strains, as impulsivity or anxiousness, might contribute to their different proneness to addiction, and likely these features might be linked to their different DA neurotransmission plasticity. Although differences in other neurotransmitter systems might deserve further investigation, results from the reviewed studies might open new vistas in understanding aberrant deviations in reward and motivational functions.

Genetic influences on delay discounting in smokers: examination of a priori candidates and exploration of dopamine-related haplotypes

RATIONALE

Delay discounting is a behavioral economic index of impulsivity that reflects a person's relative preference for small immediate rewards versus larger delayed rewards. Elevated delay discounting is robustly linked to addictive disorders and has been increasingly investigated as a viable endophenotype for genetic influences on addiction.

OBJECTIVE

The aim of this study is to examine associations between delay discounting and two a priori loci, rs4680 in COMT and rs1800497 in ANKK1, and three exploratory haplotypes proximal to rs1800497 in a sample of daily smokers.

METHODS

Participants were 713 (60.2 % male) daily smokers of European ancestry who completed a delay discounting assessment and provided a DNA sample.

RESULTS

Significant associations were detected between greater discounting of medium magnitude rewards (~$55) and the G allele of rs4680, as well as the T allele of rs1800497. Exploratory haplotype analyses identified two haplotypes (rs1160467/rs1800497; rs6277/rs1079597) significantly associated with delay discounting rates. However, the rs1160467/rs1800497 haplotype associations appeared to be entirely attributable to variation in rs1800497, suggesting that the association of rs1800497 with discounting is best understood at the individual SNP level. Similarly, the rs6277/rs1079597 haplotype findings suggested that the association was specific to rs1079597.

CONCLUSIONS

This study provides further evidence that rs4680 and rs1800497 genotypes are significantly associated with delay discounting preferences and does so among smokers for the first time. The study also provides evidence of specificity for the rs1800497 association and identifies a novel locus, rs1079597, as a genetic contributor to higher delay discounting rates.

Impulsive delayed reward discounting as a genetically-influenced target for drug abuse prevention: a critical evaluation

This review evaluates the viability of delayed reward discounting (DRD), an index of how much an individual devalues a future reward based on its delay in time, for genetically-informed drug abuse prevention. A review of the literature suggests that impulsive DRD is robustly associated with drug addiction and meets most of the criteria for being an endophenotype, albeit with mixed findings for specific molecular genetic influences. Several modes of experimental manipulation have been demonstrated to reduce DRD acutely. These include behavioral strategies, such as mindfulness, reward bundling, and episodic future thinking; pharmacological interventions, including noradrenergic agonists, adrenergic agonists, and multiple monoamine agonists; and neuromodulatory interventions, such as transcranial magnetic stimulation and transcranial direct current stimulation. However, the generalization of these interventions to positive clinical outcomes remains unclear and no studies to date have examined interventions on DRD in the context of prevention. Collectively, these findings suggest it would be premature to target DRD for genetically-informed prevention. Indeed, given the evidence of environmental contributions to impulsive DRD, whether genetically-informed secondary prevention would ever be warranted is debatable. Progress in identifying polymorphisms associated with DRD profiles could further clarify the underlying biological systems for pharmacological and neuromodulatory interventions, and, as a qualitatively different risk factor from existing prevention programs, impulsive DRD is worthy of investigation at a more general level as a novel and promising drug abuse prevention target.

Delay-specific stimuli and genotype interact to determine temporal discounting in a rapid-acquisition procedure

The importance of delay discounting to many socially important behavior problems has stimulated investigations of biological and environmental mechanisms responsible for variations in the form of the discount function. The extant experimental research, however, has yielded disparate results, raising important questions regarding Gene X Environment interactions. The present study determined the influence of stimuli that uniquely signal delays to reinforcement on delay discounting in two inbred mouse strains using a rapid-acquisition procedure. BALB/c and C57BL/6 mice responded under a six-component, concurrent-chained schedule in which the terminal-link delays preceding the larger-reinforcer were presented randomly across components of an individual session. Across conditions, components were presented either with or without delay-specific auditory stimuli, i.e., as multiple or mixed schedules. A generalized matching-based model was used to incorporate the impact of current and previous component reinforcer-delay ratios on current component response allocation. Sensitivity to reinforcer magnitude and delay were higher for BALB/c mice, but within-component preference reached final levels faster for C57Bl/6 mice. For BALB/c mice, acquisition of preference across blocks of a component was faster under the multiple than the mixed schedule, but final levels of sensitivity to reinforcement were unaffected by schedule. The speed of acquisition of preference was not different across schedules for C57Bl/6 mice, but sensitivity to reinforcement was higher under the multiple than the mixed schedule. Overall, differences in the acquisition and final form of the discount function were determined by a Gene X Environment interaction, but the presence of delay-specific stimuli attenuated genotype-dependent differences in magnitude and delay sensitivity.

Mechanisms of impulsive choice: II. Time-based interventions to improve self-control

Impulsive choice behavior has been proposed as a primary risk factor for other maladaptive behaviors (e.g., gambling, substance abuse). Recent research has suggested that timing processes may play a key role in impulsive choice behavior, and could provide an avenue for altering impulsive choice. Accordingly, the current experiments assessed a set of time-based behavioral interventions to increase self-control while simultaneously assessing effects on timing processes within the impulsive choice task. Three experiments assessed temporal interventions using a differential reinforcement of low rates task (Experiment 1) and exposure to either a variable or fixed interval schedule (Experiments 2-3). The efficacy of the interventions was assessed in Sprague-Dawley (Experiments 1-2) and Lewis (Experiment 3) rat strains. Impulsive choice behavior was assessed by measuring preferences of a smaller-sooner (SS) versus a larger-later (LL) reward, while timing of the SS and LL durations was measured during peak trials within the impulsive choice procedure. The rats showed an increased preference for the LL following all three time-based interventions and also displayed increased temporal precision. These results add to the increasing evidence that supports a possible role for temporal processing in impulsive choice behavior and supply novel behavioral interventions to decrease impulsive behavior.

Using Behavior Economics to Understand Alcohol Use Disorders: A Concise Review and Identification of Research Priorities

We review recent advances in the application of behavioral economics to alcohol use disorders (AUDs). Specifically, we review individual differences in alcohol demand (i.e., the relative reinforcing value of alcohol) and delayed reward discounting (i.e., impulsive decision making) in relation to AUDs. Additionally, we review the efficacy of reinforcement-based clinical applications. What emerges from the literature is an extensive body of cross-sectional research implicating alcohol demand and delayed reward discounting with alcohol misuse. However, more research is needed to examine these domains across the lifespan in order to understand their longitudinal trajectories. Similarly, clinical research is consistently supportive of reinforcement-based clinical interventions, but the number of randomized controlled trials to date is relatively small and there has been limited examination of the putative mechanisms of behavior change.

Mechanisms of Individual Differences in Impulsive and Risky Choice in Rats

Individual differences in impulsive and risky choice are key risk factors for a variety of maladaptive behaviors such as drug abuse, gambling, and obesity. In our rat model, ordered individual differences are stable across choice parameters, months of testing, and span a broad spectrum, suggesting that rats, like humans, exhibit trait-level impulsive and risky choice behaviors. In addition, impulsive and risky choices are highly correlated, suggesting a degree of correlation between these two traits. An examination of the underlying cognitive mechanisms has suggested an important role for timing processes in impulsive choice. In addition, in an examination of genetic factors in impulsive choice, the Lewis rat strain emerged as a possible animal model for studying disordered impulsive choice, with this strain demonstrating deficient delay processing. Early rearing environment also affected impulsive behaviors, with rearing in an enriched environment promoting adaptable and more self-controlled choices. The combined results with impulsive choice suggest an important role for timing and reward sensitivity in moderating impulsive behaviors. Relative reward valuation also affects risky choice, with manipulation of objective reward value (relative to an alternative reference point) resulting in loss chasing behaviors that predicted overall risky choice behaviors. The combined results are discussed in relation to domain-specific versus domain-general subjective reward valuation processes and the potential neural substrates of impulsive and risky choice.

Everywhere and everything: The power and ubiquity of time

Anticipatory timing plays a critical role in many aspects of human and non-human animal behavior. Timing has been consistently observed in the range of milliseconds to hours, and demonstrates a powerful influence on the organization of behavior. Anticipatory timing is acquired early in associative learning and appears to guide association formation in important ways. Importantly, timing participates in regulating goal-directed behaviors in many schedules of reinforcements, and plays a critical role in value-based decision making under concurrent schedules. In addition to playing a key role in fundamental learning processes, timing often dominates when temporal cues are available concurrently with other stimulus dimensions. Such control by the passage of time has even been observed when other cues provide more accurate information and can lead to sub-optimal behaviors. The dominance of temporal cues in governing anticipatory behavior suggests that time may be inherently more salient than many other stimulus dimensions. Discussions of the interface of the timing system with other cognitive processes are provided to demonstrate the powerful and primitive nature of time as a stimulus dimension.

Measurement of impulsive choice in rats: same- and alternate-form test-retest reliability and temporal tracking

Impulsive choice is typically measured by presenting smaller-sooner (SS) versus larger-later (LL) rewards, with biases towards the SS indicating impulsivity. The current study tested rats on different impulsive choice procedures with LL delay manipulations to assess same-form and alternate-form test-retest reliability. In the systematic-GE procedure (Green & Estle, 2003), the LL delay increased after several sessions of training; in the systematic-ER procedure (Evenden & Ryan, 1996), the delay increased within each session; and in the adjusting-M procedure (Mazur, 1987), the delay changed after each block of trials within a session based on each rat's choices in the previous block. In addition to measuring choice behavior, we also assessed temporal tracking of the LL delays using the median times of responding during LL trials. The two systematic procedures yielded similar results in both choice and temporal tracking measures following extensive training, whereas the adjusting procedure resulted in relatively more impulsive choices and poorer temporal tracking. Overall, the three procedures produced acceptable same form test-retest reliability over time, but the adjusting procedure did not show significant alternate form test-retest reliability with the other two procedures. The results suggest that systematic procedures may supply better measurements of impulsive choice in rats.

Lewis rats have greater response impulsivity than Fischer rats

Impulsivity, a tendency toward immediate action without consideration of future consequences, is associated with a wide array of problematic behaviors. Response impulsivity, a type of behaviorally-assessed impulsivity characterized by behavioral disinhibition, is also associated with health risk behaviors. Response impulsivity is distinct from choice impulsivity, which is characterized by intolerance for delay. Lewis rats have higher levels of choice impulsivity than Fischer rats (Anderson & Woolverton, 2005; Madden et al., 2008; Stein et al., 2012). However, no studies have examined whether Lewis and Fischer rats have different levels of response impulsivity. The present research examined response impulsivity in the two rat strains. Subjects were 16 male Lewis and Fischer rats. Rats' response impulsivity was measured using the Five Choice Serial Reaction Time Task (5-CSRTT). In addition, their locomotor activity was measured in locomotor activity chambers. Lewis rats had more premature responses than Fischer rats during the 5-CSRTT assessment [F(1, 14)=5.34, p<0.05], indicating higher levels of response impulsivity. Locomotor activity did not differ between rat strain groups [F(1, 14)=3.05, p=.10], suggesting that overall movement did not account for group differences in response impulsivity on the 5-CSRTT. It can be concluded from this research that Lewis rats have higher levels of response impulsivity than Fischer rats, and therefore provide a valid rat model of individual differences in impulsivity.

Genetic basis of delay discounting in frequent gamblers: examination of a priori candidates and exploration of a panel of dopamine-related loci

INTRODUCTION

Delay discounting is a behavioral economic index of impulsivity that reflects preferences for small immediate rewards relative to larger delayed rewards. It has been consistently linked to pathological gambling and other forms of addictive behavior, and has been proposed to be a behavioral characteristic that may link genetic variation and risk of developing addictive disorders (i.e., an endophenotype). Studies to date have revealed significant associations with polymorphisms associated with dopamine neurotransmission. The current study examined associations between delay discounting and both previously linked variants and a novel panel of dopamine-related variants in a sample of frequent gamblers.

METHODS

Participants were 175 weekly gamblers of European ancestry who completed the Monetary Choice Questionnaire to assess delay discounting preferences and provided a DNA via saliva.

RESULTS

In a priori tests, two loci previously associated with delayed reward discounting (rs1800497 and rs4680) were not replicated, however, the long form of DRD4 VNTR was significantly associated with lower discounting of delayed rewards. Exploratory analysis of the dopamine-related panel revealed 11 additional significant associations in genes associated with dopamine synthesis, breakdown, reuptake, and receptor function (DRD3, SLC6A3, DDC, DBH, and SLC18A2). An aggregate genetic risk score from the nominally significant loci accounted for 17% of the variance in discounting. Mediational analyses largely supported the presence of indirect effects between the associated loci, delay discounting, and pathological gambling severity.

CONCLUSIONS

These findings do not replicate previously reported associations but identify several novel candidates and provide preliminary support for a systems biology approach to understand the genetic basis of delay discounting.

Impulsive choice behavior in four strains of rats: evaluation of possible models of Attention-Deficit/Hyperactivity Disorder

Several studies have examined impulsive choice behavior in spontaneously hypertensive rats (SHRs) as a possible pre-clinical model for Attention-Deficit/Hyperactivity Disorder (ADHD). However, this strain was not specifically selected for the traits of ADHD and as a result their appropriateness as a model has been questioned. The present study investigated whether SHRs would exhibit impulsive behavior in comparison to their control strain, Wistar Kyoto (WKY) rats. In addition, we evaluated a strain that has previously shown high levels of impulsive choice, the Lewis (LEW) rats and compared them with their source strain, Wistar (WIS) rats. In the first phase, rats could choose between a smaller-sooner (SS) reward of 1 pellet after 10 s and a larger-later (LL) reward of 2 pellets after 30 s. Subsequently, the rats were exposed to increases in LL reward magnitude and SS delay. These manipulations were designed to assess sensitivity to magnitude and delay within the choice task to parse out possible differences in using the strains as models of specific deficits associated with ADHD. The SHR and WKY strains did not differ in their choice behavior under either delay or magnitude manipulations. In comparison to WIS, LEW showed deficits in choice behavior in the delay manipulation, and to a lesser extent in the magnitude manipulation. An examination of individual differences indicated that the SHR strain may not be sufficiently homogeneous in their impulsive choice behavior to be considered as a viable model for impulse control disorders such as ADHD. The LEW strain may be worthy of further consideration for their suitability as an animal model.

Integrating behavioral economics and behavioral genetics: delayed reward discounting as an endophenotype for addictive disorders

Delayed reward discounting is a behavioral economic index of impulsivity, referring to how much an individual devalues a reward based on its delay in time. As a behavioral process that varies considerably across individuals, delay discounting has been studied extensively as a model for self-control, both in the general population and in clinical samples. There is growing interest in genetic influences on discounting and, in particular, the prospect of discounting as an endophenotype for addictive disorders (i.e., a heritable mechanism partially responsible for conferring genetic risk). This review assembles and critiques the evidence supporting this hypothesis. Via numerous cross-sectional studies and a small number of longitudinal studies, there is considerable evidence that impulsive discounting is associated with addictive behavior and appears to play an etiological role. Moreover, there is increasing evidence from diverse methodologies that impulsive delay discounting is temporally stable, heritable, and that elevated levels are present in nonaffected family members. These findings suggest that impulsive discounting meets the criteria for being considered an endophenotype. In addition, recent findings suggest that genetic variation related to dopamine neurotransmission is significantly associated with variability in discounting preferences. A significant caveat, however, is that the literature is modest in some domains and, in others, not all the findings have been supportive or consistent. In addition, important methodological considerations are necessary in future studies. Taken together, although not definitive, there is accumulating support for the hypothesis of impulsive discounting as an endophenotype for addictive behavior and a need for further systematic investigation.