A long-term study of the impulsive choices of Lewis and Fischer 344 rats

The association between risky decision making and cocaine conditioned place preference is moderated by sex

BACKGROUND

Excessive risk taking is a characteristic trait of several psychiatric conditions, including substance use disorders. High risk-taking (HiR) rats self-administer more cocaine compared to low risk-taking (LoR) rats. However, research has not determined if risk taking is associated with enhanced cocaine conditioned place preference (CPP).

METHODS

Male and female Sprague Dawley rats (n = 48 each sex) were first tested in the risky decision task (RDT), in which a response on one lever resulted in safe delivery of one food pellet, and a response on a different lever resulted in delivery of two pellets and probabilistic delivery of foot shock. Following RDT training, rats were tested for cocaine CPP. The first session was a pretest that measured rats' preference for three compartments that provided different visual and tactile cues. Rats then learned to associate one compartment with cocaine (either 10.0 mg/kg or 20.0 mg/kg; i.p.) and one compartment with saline (1.0 ml/kg; i.p.) across eight conditioning sessions. Finally, rats explored all three compartments in a drug-free state.

RESULTS

Sex significantly moderated the association between risky decision making and cocaine CPP. While increased risk aversion was somewhat positively associated with cocaine CPP in males, increased risk taking was positively correlated with cocaine CPP in females.

CONCLUSIONS

These results highlight the moderating role of sex on the relationship between risky decision making and cocaine reward.

Analyzing the magnitude effect in spontaneously hypertensive (SHR) and wistar Kyoto (WKY) rats

We analyzed the magnitude effect in Spontaneously Hypertensive (SHR) and Wistar Kyoto (WKY) rats choosing between a smaller-sooner (SSF) and a larger-later food (LLF) in the initial link of a concurrent-chains procedure. The SSF was delivered immediately in one terminal link and the LLF delayed 0.01, 5, 10, 20, 40, or 80 s in the other terminal link. An ABABA design varied food amount, 1 vs. 4 and 3 vs. 8 food-pellets in conditions A and B, respectively. The SHRs made more impulsive choices than the WKYs. The hyperbolic-decay model and the Generalized Matching Law fitted the data well. Discounting rate (k) and the area under the discounting curve (AUC) for the choices made by the SHRs in conditions A, were like those in conditions B. For the choices that the individual WKYs made, k was slightly higher and AUC smaller in conditions B than in conditions A. For both strains sensitivity to the immediacy of the LLF (s) was slightly higher in conditions A than in conditions B. Thus, we found no conclusive, compelling evidence either supporting or discarding the magnitude effect in the SHRs and scarce evidence supporting an effect opposite to the magnitude effect in the WKYs.

Pair housing, but not using a controlled reinforcer frequency procedure, attenuates the modulatory effect of probability presentation order on amphetamine-induced changes in risky choice

Probability discounting is often measured with independent schedules. Independent schedules have several limitations, such as confounding preference for one alternative with frequency of reward presentation and generating ceiling/floor effects at certain probabilities. To address this potential caveat, a controlled reinforcer frequency schedule can be used, in which the manipulandum that leads to reinforcement is pseudo-randomly determined before each trial. This schedule ensures subjects receive equal presentations of the small and large magnitude reinforcers across each block of trials. A total of 24 pair-housed and 11 individually housed female Sprague Dawley rats were tested in a controlled reinforcer frequency procedure. For half of the rats, the odds against (OA) receiving the large magnitude reinforcer increased across the session (ascending schedule); the OA decreased across the session for half of the rats (descending schedule). Following training, rats received treatments of amphetamine (AMPH; 0, 0.25, 0.5, 1.0 mg/kg; s.c.). For pair-housed rats, AMPH (0.5 mg/kg) increased risky choice, regardless of probability presentation order, whereas a higher dose of AMPH (1.0 mg/kg) decreased discriminability of reinforcer magnitude for rats trained on the descending schedule only. For individually housed rats, probability presentation order modulated the effects of AMPH on probability discounting, as AMPH (0.25 and 0.5 mg/kg) increased risky choice in rats trained on the ascending schedule but not on the descending schedule. These results show that pair-housing animals, but not using a controlled reinforcer frequency procedure, attenuates the modulatory effects of probability presentation order on drug effects on risky choice.

Using a dependent schedule to measure risky choice in male rats: Effects of d-amphetamine, methylphenidate, and methamphetamine

Risky choice is the tendency to choose a large, uncertain reward over a small, certain reward, and is typically measured with probability discounting, in which the probability of obtaining the large reinforcer decreases across blocks of trials. One caveat to traditional procedures is that independent schedules are used, in which subjects can show exclusive preference for one alternative relative to the other. For example, some rats show exclusive preference for the small, certain reinforcer as soon as delivery of the large reinforcer becomes probabilistic. Therefore, determining if a drug increases risk aversion (i.e., decreases responding for the probabilistic alternative) is difficult (due to floor effects). The overall goal of this experiment was to use a concurrent-chains procedure that incorporated a dependent schedule during the initial link, thus preventing animals from showing exclusive preference for one alternative relative to the other. To determine how pharmacological manipulations alter performance in this task, male Sprague-Dawley rats (n = 8) received injections of amphetamine (0, 0.25, 0.5, 1.0 mg/kg), methylphenidate (0, 0.3, 1.0, 3.0 mg/kg), and methamphetamine (0, 0.5, 1.0, 2.0 mg/kg). Amphetamine (0.25 mg/kg) and methylphenidate (3.0 mg/kg) selectively increased risky choice, whereas higher doses of amphetamine (0.5 and 1.0 kg/mg) and each dose of methamphetamine impaired stimulus control (i.e., flattened the discounting function). These results show that dependent schedules can be used to measure risk-taking behavior and that psychostimulants promote suboptimal choice when this schedule is used. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Differential effects of d-amphetamine and atomoxetine on risk-based decision making of Lewis and Fischer 344 rats

Individuals with attention-deficit/hyperactivity disorder tend to make risker choices during probabilistic-discounting procedures. Thus, how common attention-deficit/hyperactivity disorder medications affect probabilistic discounting is of interest. In general, d-amphetamine increases risk-taking while atomoxetine has produced mixed effects in rats. Results from previous studies may result from genetic factors. Lewis and F344 rats have neurochemical differences that may be relevant to probabilistic discounting and how drugs affect such behavior. In this study, we evaluated dose-dependent effects of d-amphetamine and atomoxetine on probabilistic discounting of Lewis and F344. Male Lewis and F344 chose between one food pellet delivered 100% of the time and three food pellets delivered following decreasing probabilities of delivery (i.e. 100%, 66.7%, 33.3%, 16.5%, and 8.25%). Saline, d-amphetamine (0.1-1.8 mg/kg), and atomoxetine (0.1-7.8 mg/kg) were tested acutely. Lewis and F344 did not differ in choice at baseline. d-Amphetamine increased risky choice for both rat strains at low-to-moderate doses, although it did so at a lower dose (0.1 and 0.3 mg/kg) for F344 as compared to Lewis (0.3 mg/kg only). At high doses (1.0 and 1.8 mg/kg), d-amphetamine disrupted choice, increased frequencies of omitted trials, and reduced reinforcer sensitivity. Although atomoxetine increased frequencies of omitted trials at high doses (5.6 and 7.8 mg/kg), it had no effect on probabilistic discounting for either rat strain. Although Lewis and F344 differ in various types of impulsivity (i.e. motor, choice), with Lewis being the more impulsive of the two, the present results suggest that Lewis and F344 do not differ in risk-based decision-making. Effects of d-amphetamine on probabilistic discounting may be biology-dependent and differ from effects of atomoxetine.

Trait determinants of impulsive behavior: a comprehensive analysis of 188 rats

Impulsivity is a naturally occurring behavior that, when accentuated, can be found in a variety of neuropsychiatric disorders. The expression of trait impulsivity has been shown to change with a variety of factors, such as age and sex, but the existing literature does not reflect widespread consensus regarding the influence of modulating effects. We designed the present study to investigate, in a cohort of significant size (188 rats), the impact of four specific parameters, namely sex, age, strain and phase of estrous cycle, using the variable delay-to-signal (VDS) task. This cohort included (i) control animals from previous experiments; (ii) animals specifically raised for this study; and (iii) animals previously used for breeding purposes. Aging was associated with a general decrease in action impulsivity and an increase in delay tolerance. Females generally performed more impulsive actions than males but no differences were observed regarding delay intolerance. In terms of estrous cycle, no differences in impulsive behavior were observed and regarding strain, Wistar Han animals were, in general, more impulsive than Sprague-Dawley. In addition to further confirming, in a substantial study cohort, the decrease in impulsivity with age, we have demonstrated that both the strain and sex influences modulate different aspects of impulsive behavior manifestations.

Effects of GluN2B-selective antagonists on delay and probability discounting in male rats: Modulation by delay/probability presentation order

The contribution of the GluN2B subunit of the NMDA receptor to impulsivity has recently been examined. Ro 63-1908, a highly selective antagonist for the GluN2B, decreases impulsive choice. Because the order in which delays are presented modulates drug effects in discounting procedures, one goal of the current study was to determine the effects of Ro 63-1908 in delay discounting procedures in which the delays to obtaining the large reinforcer either increase or decrease across the session. We also determined if Ro 63-1908 differentially alters risky choice in probability discounting procedures that use ascending/descending schedules. Male rats were trained in either delay (n = 24) or probability (n = 24) discounting in which the delay to/odds against reinforcement were presented in either ascending or descending order (n = 12 each schedule). Following training, rats received the GluN2B antagonists Ro 63-1908 (0-1.0 mg/kg) and CP-101,606 (0-3.0 mg/kg). In delay discounting, Ro 63-1908 (1.0 mg/kg), but not CP-101,606, decreased choice for the large reinforcer, but only when the delays decreased across the session. In probability discounting, Ro 63-1908 (0.3 mg/kg)/CP-101,606 (1.0 mg/kg) increased choice for the large reinforcer when the probability of obtaining this alternative decreased across the session, but Ro 63-1908 (1.0 mg/kg)/CP-101,606 (3.0 mg/kg) decreased choice when the probabilities increased. These results show that the GluN2B is a mediator of impulsive/risky choice, but the effects of GluN2B antagonists are dependent on the order in which delays/probabilities are presented. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Effects of N-methyl-d-aspartate receptor (NMDAr) uncompetitive antagonists in a delay discounting paradigm using a concurrent-chains procedure

Impulsive choice is often assessed in rodents using a delay discounting (DD) paradigm in which the delay to a large reinforcer (LR) increases across the session. This procedure allows one to test the effects of pharmacological manipulations within a single session. Because discounting is influenced by sensitivity to reinforcer magnitude (SRM) and sensitivity to delayed reinforcement (SDR), applying quantitative analyses (e.g., fitting hyperbolic function) is important for determining the precise behavioral mechanisms being altered following drug administration. One caveat to this approach is that observing increases in SMR/SDR can be difficult (e.g., most rats choose the LR when its delivery is immediate, whereas some rats may show exclusive preference for the small reinforcer [SR] when a delay on the LR is imposed). We utilized a variant of a concurrent-chains procedure in which rats (n = 8) could not show exclusive preference for either reinforcer, thus allowing one to observe increases/decreases in responding at each delay. The NMDAr antagonists MK-801 (0, 0.003, 0.01, 0.03 mg/kg), ketamine (0, 1.0, 5.0, 10.0 mg/kg), and memantine (0, 2.5, 5.0, 7.5 mg/kg) were administered following baseline training because this receptor has recently been implicated in DD. MK-801 (0.03 mg/kg) decreased SRM and SDR. Memantine (7.5 mg/kg) decreased SRM only. These results show that this variant of the concurrent-chains procedure can be used to study the effects of pharmacological manipulations on distinct aspects of DD.

Dissecting drug effects in preclinical models of impulsive choice: emphasis on glutamatergic compounds

RATIONALE

Impulsive choice is often measured with delay discounting paradigms. Because there are multiple discounting procedures, as well as different statistical analyses that can be applied to data generated from these paradigms, there are some inconsistencies in the literature regarding drug effects on impulsive choice.

OBJECTIVES

The goal of the current paper is to review the methodological and analytic approaches used to measure discounting and to discuss how these differences can account for differential drug effects observed across studies.

RESULTS

Because some procedures/analyses use a single data point as the dependent variable, changes in this value following pharmacological treatment may be interpreted as alterations in sensitivity to delayed reinforcement, but when other procedures/analyses are used, no changes in behavior are observed. Even when multiple data points are included, some studies show that the statistical analysis (e.g., ANOVA on raw proportion of responses vs. using hyperbolic/exponential functions) can lead to different interpretations. Finally, procedural differences (e.g., delay presentation order, signaling the delay to reinforcement, etc.) in the same discounting paradigm can alter how drugs affect sensitivity to delayed reinforcement.

CONCLUSIONS

Future studies should utilize paradigms that allow one to observe alterations in responding at each delay (e.g., concurrent-chains schedules). Concerning statistical analyses, using parameter estimates derived from nonlinear functions or incorporating the generalized matching law can allow one to determine if drugs affect sensitivity to delayed reinforcement or impair discrimination of the large and small magnitude reinforcers. Using these approaches can help further our understanding of the neurochemical underpinnings of delay discounting.

Pair Housing Alters Delay Discounting in Lewis and Fischer 344 Rats

Impulsive choice underlies several psychological disorders and can be assessed in laboratory rats using delay-discounting tasks, in which choice is for either one food pellet immediately or three food pellets after a delay. Choice for the smaller, immediate reinforcer is considered the impulsive choice. Lewis (LEW) and Fischer 344 (F344) rats differ in the number of impulsive choices made during this task when singly housed, with LEW choosing the impulsive option more often. Due to increasing recommendations to provide environmental enrichment as a component of animal-husbandry practices, a systematic replication of two previous studies was conducted using pair-housed LEW and F344. Delay discounting was assessed with pair-housed LEW and F344 and compared to previous data from singly housed LEW and F344 collected from the same laboratory. Results showed that differences in impulsive choice between the two strains were attenuated with pair housing. The main result driving this change appears to be an increase in impulsive choice in pair-housed F344 relative to singly housed F344.

Spontaneously hypertensive (SHR) rats choose more impulsively than Wistar-Kyoto (WKY) rats on a delay discounting task

Indications of Attention Deficit Hyperactivity Disorder (ADHD) in the spontaneously hypertensive rat (SHR) are not consistent across different tests of impulsivity, questioning the SHR's validity as a rodent model of ADHD. This study used a concurrent-chains procedure to examine possible differences in impulsive choice between SHRs and control-normotensive Wistar Kyoto (WKY) rats. The aim was to extend the generality of findings showing regularities between the hyperbolic-decay model and the generalized matching law fitting delay discounting data from nonhuman animals. The objectives were to: (1) examine differences in impulsive choice between SHRs and WKYs; (2) add evidence suggesting that the SHR is a suitable model of ADHD; (3) demonstrate that concurrent-chains procedures requiring locomotion detect differences in impulsive choice between SHRs and WKYs; (4) support the idea that impulsivity in nonhuman animals increases with training. The initial link used two non-independent random interval schedules arranging entries to the terminal links, where one fixed-time (FT) schedule delayed 1-food pellet and the other FT 4-food pellets. The FT delaying the former was kept constant at 0.1s and that delaying the latter changed after every 10 food deliveries, defining six delay components (0.1, 5, 10, 20, 40, and 80s) presented in random order each session. Results showed that the SHRs choose more impulsively than the WKYs, adding to the body of evidence suggesting that the SHR may be a suitable model of ADHD. Both models of choice fitted the impulsive choices of the SHRs and WKYs well; positive correlations between estimates of parameters k and s suggested compatibility between models of choice showing that impulsivity increases with training.

Lewis and Fischer 344 rats as a model for genetic differences in spatial learning and memory: Cocaine effects

Lewis (LEW) and Fischer 344 (F344) rats are considered a model of genetic vulnerability to drug addiction. We previously showed important differences in spatial learning and memory between them, but in contrast with previous experiments demonstrating cocaine-induced enhanced learning in Morris water maze (MWM) highly demanding tasks, the eight-arm radial maze (RAM) performance was not modified either in LEW or F344 rats after chronic cocaine treatment. In the present work, chronically cocaine-treated LEW and F344 adult rats have been evaluated in learning and memory performance using the Y-maze, two RAM protocols that differ in difficulty, and a reversal protocol that tests cognitive flexibility. After one of the RAM protocols, we quantified dendritic spine density in hippocampal CA1 neurons and compared it to animals treated with cocaine but not submitted to RAM. LEW cocaine treated rats showed a better performance in the Y maze than their saline counterparts, an effect that was not evident in the F344 strain. F344 rats significantly took more time to learn the RAM task and made a greater number of errors than LEW animals in both protocols tested, whereas cocaine treatment induced deleterious effects in learning and memory in the highly difficult protocol. Moreover, hippocampal spine density was cocaine-modulated in LEW animals whereas no effects were found in F344 rats. We propose that differences in addictive-like behavior between LEW and F344 rats could be related to differences in hippocampal learning and memory processes that could be on the basis of individual vulnerability to cocaine addiction.

Effects of N-methyl-D-aspartate receptor ligands on sensitivity to reinforcer magnitude and delayed reinforcement in a delay-discounting procedure

RATIONALE

The N-methyl-D-aspartate (NMDA) receptor has been recently identified as an important mediator of impulsive choice, as assessed in delay discounting. Although discounting is independently influenced by sensitivity to reinforcer magnitude and delayed reinforcement, few studies have examined how NMDA receptor ligands differentially affect these parameters.

OBJECTIVES

The current study examined the effects of various NMDA receptor ligands on sensitivity to reinforcer magnitude and delayed reinforcement in a delay-discounting procedure.

METHODS

Following behavioral training, rats received treatments of the following NMDA receptor ligands: the uncompetitive antagonists ketamine (0, 1.0, 5.0, or 10.0 mg/kg; i.p.), MK-801 (0, 0.003, 0.01, or 0.03 mg/kg; s.c.), and memantine (0, 2.5, 5.0, or 10.0 mg/kg; i.p.), the competitive antagonist CGS 19755 (0, 5.0, 10.0, or 20.0 mg/kg; s.c.), the non-competitive NR2B subunit-selective antagonist ifenprodil (0, 1.0, 3.0, or 10.0 mg/kg; i.p), and the partial agonist D-cycloserine (0, 3.25, 15.0, or 30.0 mg/kg; s.c.).

RESULTS

When an exponential model was used to describe discounting, CGS 19755 (5.0 mg/kg) increased impulsive choice without altering sensitivity to reinforcer magnitude. Conversely, ketamine (10.0 mg/kg), memantine (5.0 mg/kg), and ifenprodil (10.0 mg/kg) decreased sensitivity to reinforcer magnitude without altering impulsive choice. MK-801 and D-cycloserine did not alter delay-discounting performance, although two-way ANOVA analyses indicated D-cycloserine (15.0 mg/kg) decreased impulsive choice.

CONCLUSIONS

The behavioral changes observed in delay discounting following administration of NMDA receptor antagonists do not always reflect an alteration in impulsive choice. These results emphasize the utility in employing quantitative methods to assess drug effects in delay discounting.

Effects of Group I metabotropic glutamate receptor antagonists on sensitivity to reinforcer magnitude and delayed reinforcement in a delay-discounting task in rats: Contribution of delay presentation order

Metabotropic glutamate receptor 1 (mGluR₁) blockade has been shown to decrease impulsive choice, as measured in delay discounting. However, several variables are known to influence an animal's discounting, including sensitivity to delayed reinforcement and sensitivity to reinforcer magnitude. The goal of this experiment was to determine the effects of mGluR₁, as well as mGluR₅, antagonism on these parameters. Forty Sprague Dawley rats were trained in delay discounting, in which consistently choosing a small, immediate reward reflects impulsive choice. For half of the rats, the delay to the large reinforcer increased across blocks of trials, whereas the delay decreased across the session for half of the rats. Following training, half of the rats received injections of the mGluR₁ antagonist JNJ 16259685 (JNJ; 0, 0.1, 0.3, or 1.0mg/kg; i.p), and half received injections of the mGluR₅ antagonist MPEP (0, 1.0, 3.0, or 10.0mg/kg; i.p.). Administration of JNJ increased sensitivity to delayed reinforcement (i.e., promoted impulsive choice), regardless of which schedule was used. However, the order in which delays were presented modulated the effects of JNJ on sensitivity to reinforcer magnitude. Specifically, JNJ decreased sensitivity to reinforcer magnitude in rats trained on the descending schedule only. MPEP did not alter sensitivity to reinforcer magnitude or sensitivity to delayed reinforcement. These results show that mGluR₁ is an important mediator of impulsive choice, and they provide further evidence that delay order presentation is an important variable that influences drug effects in delay discounting.

Impulsivity and sensitivity to amount and delay of reinforcement in an animal model of ADHD

Previous research has been inconclusive about the degree of impulsivity displayed by spontaneously hypertensive rats (SHR), an animal model of Attention Deficit Hyperactivity Disorder (ADHD). In the present set of experiments, concurrent-chains schedules were employed in order to explore SHR's impulsivity, sensitivity to delay, and sensitivity to amount of reinforcement; Wistar rats (WIS) were used as comparison group. In the three experiments - performed with different subjects - non-independent variable interval 30s schedules were presented in the initial links; the difference between experiments was in the terminal links. For exploring impulsivity, one of the terminal links (SS) was associated to a short delay (2s) and a small reinforcer (1 pellet), whereas the other terminal link (LL) was associated to a longer delay (28s) and a larger reinforcer (4 pellets). The results indicated a remarkably higher impulsivity in SHR. Because this impulsivity may have as potential mechanisms an increased sensitivity to delay and/or a decreased sensitivity to the amount of reinforcement, in experiments 2 and 3 these possibilities were examined. For assessing sensitivity to delay, the following pairs of fixed interval (FI) schedules were used in the terminal links in five conditions: 2-28, 6-24, 15-15, 24-6, 28-2s; the magnitude of reinforcement was 1 pellet in all conditions for both alternatives. For assessing sensitivity to amount, in five conditions the alternatives were associated with different magnitudes of reinforcement: 1-5 pellets, 2-4, 3-3, 4-2 and 5-1 in left-right alternatives, respectively; the delay to reinforcement was controlled by a FI 15s in all conditions and for both alternatives. The sensitivity to delay and the sensitivity to amount were calculated according to the Generalized Matching Law. The results indicated a higher sensitivity to delay in SHR, and the same sensitivity to amount in SHR and WIS rats. These results suggest that the increased sensitivity to delay influences the high level of impulsivity observed in SHR.