Impulsive choice in a rodent model of attention-deficit/hyperactivity disorder

Phasic dopamine release in two different rat models of attention-deficit/hyperactivity disorder: Spontaneously hypertensive rats (SHR) versus Lphn3 knockout rats

We examined DA activity in the medial prefrontal cortex (mPFC) and nucleus accumbens core (NAcc) in two Different Rat Models of Attention-Deficit/Hyperactivity Disorder: Spontaneously Hypertensive Rats (SHR) Versus Lphn3 Knockout Rats. We examined baseline stimulation-evoked phasic DA release, half-life, and DA autoreceptor (DAR) functioning in the mPFC and NAcc, as well as the response to nomifensine (10 mg/kg, IP), a DA transporter (DAT) blocker, on these measures in the NAcc. Both rat models were hypodopaminergic, with notable regional and mechanistic differences. The SHRs displayed decreased DA release in the NAcc compared to their control strain (i.e., WKY rats), with no differences in the mPFC, leading a much lower NAcc-to-PFC DA release ratio in SHRs compared to controls suggesting an imbalance in DA transmission between these regions. The Lphn3 KO rats were considered hypodopaminergic based on the reduced summed DA release in the mPFC and NAcc compared to WT controls, although differences were not observed when examining each site independently. Lphn3 KOs displayed increased DA half-life in the mPFC compared with Lphn3 WT rats, an indication of decreased DAT reuptake, with no differences in the NAcc. DAT blockade by nomifensine had a similar effect on DA release in the NAcc of SHRs and WKYs, but increased DA release in the NAcc of Lphn3 KOs to a greater extent than in WTs. These results suggest that the efficacy of pharmacotherapies used to treat externalizing disorders such as ADHD and/or SUD, likely differ between SHRs and Lphn3 KO rats.

Aberrant glutamatergic systems underlying impulsive behaviors: Insights from clinical and preclinical research

Impulsivity is a broad construct that often refers to one of several distinct behaviors and can be measured with self-report questionnaires and behavioral paradigms. Several psychiatric conditions are characterized by one or more forms of impulsive behavior, most notably the impulsive/hyperactive subtype of attention-deficit/hyperactivity disorder (ADHD), mood disorders, and substance use disorders. Monoaminergic neurotransmitters are known to mediate impulsive behaviors and are implicated in various psychiatric conditions. However, growing evidence suggests that glutamate, the major excitatory neurotransmitter of the mammalian brain, regulates important functions that become dysregulated in conditions like ADHD. The purpose of the current review is to discuss clinical and preclinical evidence linking glutamate to separate aspects of impulsivity, specifically motor impulsivity, impulsive choice, and affective impulsivity. Hyperactive glutamatergic activity in the corticostriatal and the cerebro-cerebellar pathways are major determinants of motor impulsivity. Conversely, hypoactive glutamatergic activity in frontal cortical areas and hippocampus and hyperactive glutamatergic activity in anterior cingulate cortex and nucleus accumbens mediate impulsive choice. Affective impulsivity is controlled by similar glutamatergic dysfunction observed for motor impulsivity, except a hyperactive limbic system is also involved. Loss of glutamate homeostasis in prefrontal and nucleus accumbens may contribute to motor impulsivity/affective impulsivity and impulsive choice, respectively. These results are important as they can lead to novel treatments for those with a condition characterized by increased impulsivity that are resistant to conventional treatments.

Active and passive waiting in impulsive choice: Effects of fixed-interval and fixed-time delays

Behavioral interventions to improve self-control, preference for a larger-later (LL) reward over a smaller-sooner (SS) reward, involve experience with delayed rewards. Whether they involve timing processes remains controversial. In rats, there have been inconsistent results on whether timing processes may be involved in intervention-induced improvements in self-control. Interventions that improved self-control with corresponding timing improvements used fixed-interval (FI) delays, whereas interventions that failed to find corresponding timing improvements used fixed-time (FT) delays. The FI schedule includes a response contingency (active waiting), whereas the FT schedule delivers reward automatically (passive waiting). The present study compared the effects of FI and FT schedules in interventions and impulsive choice tasks to evaluate effects on self-control and timing behavior. The impulsive choice task evaluated preference for an SS option (one pellet after 10-, 15-, 20-, 25-, and 30-s delays) versus an LL option (two pellets after a 30-s delay). The intervention task included forced-choice SS (one pellet after 10 s) and LL (two pellets after 30 s) sessions under FI or FT schedules. FI schedules produced greater sensitivity to SS delay in the impulsive choice task. Both FI and FT interventions increased LL choices. Following choice testing, temporal bisection and peak interval tasks revealed better timing precision for rats with an FI delay experience. Overall, the FI choice contingency was associated with improved temporal attention and timing precision.

An apparatus and procedure for studying discounting of real outcomes of money and aversive sound

We developed and examined a laboratory preparation with adult humans that pits shorter term avoidance over longer term positive reinforcement and may serve as a useful laboratory functional analogue of problematic behavior. Participants were exposed to choices between (1) avoiding an aversive sound and acquiring no money or (2) listening to an aversive sound for a set duration and then receiving money. The first choice, avoiding an aversive sound and acquiring no money, was conceptualized as immediate negative reinforcement and no positive reinforcement, whereas the latter choice, listening to an aversive sound for a set duration and then receiving money, was conceptualized as a potential positive punisher paired with a larger later positive reinforcer. We manipulated the duration of the sound and the magnitude of money to identify the point at which individual participants' choices changed from avoiding the sound to choosing the sound plus money. As the sound duration increased, the choice of listening to the sound and receiving money decreased. Similar functions were observed with two different monetary magnitudes. The model has potential applicability to real-world problems such as smoking, addiction, gambling, anxiety disorders, and other impulse control disorders.

Phasic dopamine signals are reduced in the spontaneously hypertensive rat and increased by methylphenidate

The spontaneously hypertensive rat (SHR) is a selectively bred animal strain that is frequently used to model attention-deficit hyperactivity disorder (ADHD) because of certain genetically determined behavioural characteristics. To test the hypothesis that the characteristically altered response to positive reinforcement in SHRs may be due to altered phasic dopamine response to reward, we measured phasic dopamine signals in the SHRs and Sprague Dawley (SD) rats using in vivo fast-scan cyclic voltammetry. The effects of the dopamine reuptake inhibitor, methylphenidate, on these signals were also studied. Phasic dopamine signals during the pairing of a sensory cue with electrical stimulation of midbrain dopamine neurons were significantly smaller in the SHRs than in the SD rats. Over repeated pairings, the dopamine response to the sensory cue increased, whereas the response to the electrical stimulation of dopamine neurons decreased, similarly in both strains. However, the final amplitude of the response to the sensory cue after pairing was significantly smaller in SHRs than in the SD rats. Methylphenidate increased responses to sensory cues to a significantly greater extent in the SHRs than in the SD rats, due largely to differences in the low dose effect. At a higher dose, methylphenidate increased responses to sensory cues and electrical stimulation similarly in SHRs and SD rats. The smaller dopamine responses may explain the reduced salience of reward-predicting cues previously reported in the SHR, whereas the action of methylphenidate on the cue response suggests a potential mechanism for the therapeutic effects of low-dose methylphenidate in ADHD.

Using rodent data to elucidate dopaminergic mechanisms of ADHD: Implications for human personality

An altered behavioral response to positive reinforcement has been proposed to be a core deficit in attention deficit hyperactivity disorder (ADHD). The spontaneously hypertensive rat (SHR), a congenic animal strain, displays a similarly altered response to reinforcement. The presence of this genetically determined phenotype in a rodent model allows experimental investigation of underlying neural mechanisms. Behaviorally, the SHR displays increased preference for immediate reinforcement, increased sensitivity to individual instances of reinforcement relative to integrated reinforcement history, and a steeper delay of reinforcement gradient compared to other rat strains. The SHR also shows less development of incentive to approach sensory stimuli, or cues, that predict reward after repeated cue-reward pairing. We consider the underlying neural mechanisms for these characteristics. It is well known that midbrain dopamine neurons are initially activated by unexpected reward and gradually transfer their responses to reward-predicting cues. This finding has inspired the dopamine transfer deficit (DTD) hypothesis, which predicts certain behavioral effects that would arise from a deficient transfer of dopamine responses from actual rewards to reward-predicting cues. We argue that the DTD predicts the altered responses to reinforcement seen in the SHR and individuals with ADHD. These altered responses to reinforcement in turn predict core symptoms of ADHD. We also suggest that variations in the degree of dopamine transfer may underlie variations in personality dimensions related to altered reinforcement sensitivity. In doing so, we highlight the value of rodent models to the study of human personality.

Selective chemogenetic inactivation of corticoaccumbal projections disrupts trait choice impulsivity

Impulsive choice has enduring trait-like characteristics and is defined by preference for small immediate rewards over larger delayed ones. Importantly, it is a determining factor in the development and persistence of substance use disorder (SUD). Emerging evidence from human and animal studies suggests frontal cortical regions exert influence over striatal reward processing areas during decision-making in impulsive choice or delay discounting (DD) tasks. The goal of this study was to examine how these circuits are involved in decision-making in animals with defined trait impulsivity. To this end, we trained adolescent male rats to stable behavior on a DD procedure and then re-trained them in adulthood to assess trait-like, conserved impulsive choice across development. We then used chemogenetic tools to selectively and reversibly target corticostriatal projections during performance of the DD task. The prelimbic region of the medial prefrontal cortex (mPFC) was injected with a viral vector expressing inhibitory designer receptors exclusively activated by designer drugs (Gi-DREADD), and then mPFC projections to the nucleus accumbens core (NAc) were selectively suppressed by intra-NAc administration of the Gi-DREADD actuator clozapine-n-oxide (CNO). Inactivation of the mPFC-NAc projection elicited a robust increase in impulsive choice in rats with lower vs. higher baseline impulsivity. This demonstrates a fundamental role for mPFC afferents to the NAc during choice impulsivity and suggests that maladaptive hypofrontality may underlie decreased executive control in animals with higher levels of choice impulsivity. Results such as these may have important implications for the pathophysiology and treatment of impulse control, SUDs, and related psychiatric disorders.

Timing and delay discounting in attention-deficit/hyperactivity disorder: A translational approach

Attention-deficit/hyperactivity disorder (ADHD) is a common neurodevelopmental disorder that often presents with abnormal time perception and increased impulsive choice behavior. The spontaneously hypertensive rat (SHR) is the most widely used preclinical model of the ADHD-Combined and ADHD-Hyperactive/Impulsive subtypes of the disorder. However, when testing the spontaneously hypertensive rat from Charles River (SHR/NCrl) on timing and impulsive choice tasks, the appropriate control strain is not clear, and it is possible that one of the possible control strains, the Wistar Kyoto from Charles River (WKY/NCrl), is an appropriate model for ADHD-Predominately Inattentive. Our goals were to test the SHR/NCrl, WKY/NCrl, and Wistar (WI; the progenitor strain for the SHR/NCrl and WKY/NCrl) strains on time perception and impulsive choice tasks to assess the validity of SHR/NCrl and WKY/NCrl as models of ADHD, and the validity of the WI strain as a control. We also sought to assess impulsive choice behavior in humans diagnosed with the three subtypes of ADHD and compare them with our findings from the preclinical models. We found SHR/NCrl rats timed faster and were more impulsive than WKY/NCrl and WI rats, and human participants diagnosed with ADHD were more impulsive compared to controls, but there were no differences between the three ADHD subtypes.

Conditioned approach behavior of SHR and SD rats during Pavlovian conditioning

Individual differences in reward-related learning are relevant to many behavioral disorders. Sensory cues that predict reward can become incentive stimuli that adaptively support behavior, or alternatively, cause maladaptive behaviors. The spontaneously hypertensive rat (SHR) expresses a genetically determined elevated sensitivity to delay of reward, and has been extensively studied as a behavioral model for attention deficit hyperactivity disorder (ADHD). We investigated reward-related learning in the SHR, comparing them to Sprague-Dawley (SD) rats as a reference strain. A standard Pavlovian conditioned approach task was used, in which a lever cue was followed by reward. Lever presses could occur while the lever was extended, but had no effect on reward delivery. The behavior of both the SHRs and the SD rats showed that they learnt that the lever cue predicted reward. However, the pattern of behavior differed between the strains. During lever cue presentation, SD rats pressed the lever more often and made fewer magazine entries than SHRs. When lever contacts that did not result in lever presses were analyzed, there was no significant difference between SHRs and SDs. These results suggest that the SHRs attributed less incentive value to the conditioned stimulus than the SD rats. During the presentation of the conditioned cue, cue directed responses are called sign tracking responses, whereas responses directed towards the food magazine are called goal tracking responses. Analysis of behavior using a standard Pavlovian conditioned approach index to quantify sign and goal tracking tendencies showed that both strains had a tendency towards goal tracking in this task. However, the SHRs showed a significantly greater goal tracking tendency than the SD rats. Taken together, these findings suggest that attribution of incentive value to reward predicting cues is attenuated in SHRs, which might explain their elevated sensitivity to delay of reward.

Effects of methylphenidate on impulsive choice and delay aversion in Lewis rats

Attention-deficit/hyperactivity disorder (ADHD), a common behavioral disorder in children and young adults, is characterized by symptoms of impulsivity, inattention, and hyperactivity. The purpose of this study was to evaluate the Lewis rat strain as a model of ADHD by testing their impulsive choices. Lewis rats were compared to their source strain, the Wistar rat, on an impulsive choice task. Rats completed the tasks on and off methylphenidate, a commonly prescribed medication for ADHD. Off methylphenidate, Lewis rats made more impulsive choices than Wistar rats. Analyses of acquisition of choice behavior suggested that both strains were able to discriminate reward sizes, but Lewis rats still chose the smaller-sooner option more than the larger-later (LL) option when the delays to reward were the same. This may be due to an aversion to the LL lever, which was associated with the longest delays to reward. Higher doses of methylphenidate increased LL choices in Lewis rats but decreased LL choices in Wistar rats. Altogether, these results suggest Lewis rats may be a viable model for ADHD in individuals whose symptoms are characterized by impulsive choices.

Previous experience with delays affects delay discounting in animal model of ADHD

BACKGROUND

ADHD is a disorder where a common symptom is impulsive behaviour, a broad term associated with making sub-optimal choices. One frequently used method to investigate impulsive behaviour is delay discounting, which involves choosing between a small, immediate reinforcer and a delayed, larger one. Choosing the small immediate reinforcer is by itself, however, not sufficient for terming the choice impulsive, as all organisms eventually switch to choosing the small, immediate reinforcer when the delay to the larger reinforcer becomes long. This switch can be termed impulsive only when it occurs more frequently, or at shorter LL delays, than typically observed in normal controls. A poorly understood aspect is how choice is influenced by previous experience with delays. Using an animal model of Attention-Deficit/Hyperactivity Disorder, the Spontaneously Hypertensive Rat, we manipulated the order of exposure to delays in a delay discounting task. Following a preference test, the Ascending group experienced gradually increasing delays between choice and reinforcer while the Descending group were exposed to these delays in reverse order.

RESULTS

The results showed that the Descending group chose the small, immediate reinforcer over the larger delayed to a much larger extent than the Ascending group, and continued to do so even when the delay component was ultimately removed. Strain effects were found in the Ascending group, with SHRs switching to the small, immediate reinforcer earlier than controls as the delay to the larger reinforcer increased.

CONCLUSION

The data suggests that delay discounting is affected by history of exposure to delayed consequences. When reinforcement contingencies are incrementally changed from having no response-reinforcer delay to a long delay, discounting of delayed consequences is gradual. However, a sudden change from no delay to a long delay, without intermediate training, results in a rapid switch to the small, immediate reinforcer option, and this behaviour is somewhat resilient to the shortening and eventual removal of the large reinforcer delay. The implication is that attempting to reduce already existing impulsive behaviour in children with ADHD will require gradual habituation and not sudden changes in reinforcement contingencies.

Impulsive choice in two different rat models of ADHD-Spontaneously hypertensive and Lphn3 knockout rats

Introduction

Impulsivity is a symptom of attention-deficit/hyperactivity disorder (ADHD) and variants in the Lphn3 (Adgrl3) gene (OMIM 616417) have been linked to ADHD. This project utilized a delay-discounting (DD) task to examine the impact of Lphn3 deletion in rats on impulsive choice. "Positive control" measures were also collected in spontaneously hypertensive rats (SHRs), another animal model of ADHD.

Methods

For Experiment I, rats were given the option to press one lever for a delayed reward of 3 food pellets or the other lever for an immediate reward of 1 pellet. Impulsive choice was measured as the tendency to discount the larger, delayed reward. We hypothesized that impulsive choice would be greater in the SHR and Lphn3 knockout (KO) rats relative to their control strains - Wistar-Kyoto (WKY) and Lphn3 wildtype (WT) rats, respectively.

Results

The results did not completely support the hypothesis, as only the SHRs (but not the Lphn3 KO rats) demonstrated a decrease in the percent choice for the larger reward. Because subsequent trials did not begin until the end of the delay period regardless of which lever was selected, rats were required to wait for the next trial to start even if they picked the immediate lever. Experiment II examined whether the rate of reinforcement influenced impulsive choice by using a DD task that incorporated a 1 s inter-trial interval (ITI) immediately after delivery of either the immediate (1 pellet) or delayed (3 pellet) reinforcer. The results of Experiment II found no difference in the percent choice for the larger reward between Lphn3 KO and WT rats, demonstrating reinforcement rate did not influence impulsive choice in Lphn3 KO rats.

Discussion

Overall, there were impulsivity differences among the ADHD models, as SHRs exhibited deficits in impulsive choice, while the Lphn3 KO rats did not.

The distinct role of orbitofrontal and medial prefrontal cortex in encoding impulsive choices in an animal model of attention deficit hyperactivity disorder

Attention deficit hyperactivity disorder (ADHD) is a complex neurodevelopmental disorder affecting up to 5% of children worldwide. The lack of understanding of ADHD etiology prevented the development of effective treatment for the disease. Here, using in vivo electrophysiology recordings, we have recorded and analyzed the neuronal encoding of delay discounting behavior in prefrontal and orbitofrontal cortex of spontaneously hypertensive rat (SHR). We found that in the presence of rewards, neurons in the orbitofrontal cortex (OFC) were activated regardless to the value of the rewards and OFC neurons in SHR exhibited significantly higher rates of neuronal discharging towards the presence of rewards. While in the medial prefrontal cortex (mPFC), neurons of SHR responded similarly in the presence of large rewards compared with control rats whereas they displayed higher firing rates towards smaller rewards. In addition, the reward-predicting neurons in the OFC encodes for value of rewards in control animals and they were strongly activated upon receiving a small immediate reinforcer in the SHR whereas the reward-predicting neurons in the mPFC neurons generally did not respond to the value of the rewards. Our study characterized the neuronal discharging patterns of OFC and mPFC neurons in the SHR and the control animals and provided novel insights for further understanding the neuronal basis of ADHD pathology.

Sequential delay and probability discounting tasks in mice reveal anchoring effects partially attributable to decision noise

Delay discounting and probability discounting decision making tasks in rodent models have high translational potential. However, it is unclear whether the discounted value of the large reward option is the main contributor to variability in animals' choices in either task, which may limit translation to humans. Male and female mice underwent sessions of delay and probability discounting in sequence to assess how choice behavior adapts over experience with each task. To control for "anchoring" (persistent choices based on the initial delay or probability), mice experienced "Worsening" schedules where the large reward was offered under initially favorable conditions that became less favorable during testing, followed by "Improving" schedules where the large reward was offered under initially unfavorable conditions that improved over a session. During delay discounting, both male and female mice showed elimination of anchoring effects over training. In probability discounting, both sexes of mice continued to show some anchoring even after months of training. One possibility is that "noisy", exploratory choices could contribute to these persistent anchoring effects, rather than constant fluctuations in value discounting. We fit choice behavior in individual animals using models that included both a value-based discounting parameter and a decision noise parameter that captured variability in choices deviating from value maximization. Changes in anchoring behavior over time were tracked by changes in both the value and decision noise parameters in delay discounting, but by the decision noise parameter in probability discounting. Exploratory decision making was also reflected in choice response times that tracked the degree of conflict caused by both uncertainty and temporal cost, but was not linked with differences in locomotor activity reflecting chamber exploration. Thus, variable discounting behavior in mice can result from changes in exploration of the decision options rather than changes in reward valuation.

Prepubertal methylphenidate leads to sex-dependent differences in probabilistic discounting

Prescription psychostimulants, such as methylphenidate (MPH), have served as a first line treatment for ADHD and associated developmental disorders since 1961. Psychostimulants has been shown to improve attention, response inhibition, and reduce hyperactivity in patients with ADHD, as well as in non-clinical human populations and animals. While there is a considerable amount of preclinical research investigating the effects of stimulant medications on reward sensitivity and basic learning in male rats, less is understood about their effects in females. Further, there are competing theories on the long-term cognitive impact of MPH, specifically in children who do not have ADHD. To this end, Long-Evans female and male rats were exposed to methylphenidate (0, 2.5, 5 mg/kg, BID, IP) for 20 days during early development (PD10-29). After discontinuation of MPH into adulthood, rats (beginning PD 60) were trained and tested for risk-preference using a 2-choice probabilistic discounting task. For this task, rats were given an option between a 'large-risky' choice (3 sugar pellets delivered on a probabilistic VR schedule) and 'small-certain' choice (1 sugar pellet delivered on a FR schedule). Rats were subsequently tested on an open field conflict test. The results demonstrate that prepubertal exposure to MPH can have lasting effects on decision-making. Specifically, female rats treated with 2.5 mg/kg MPH displayed a decrease in preference for the risky option, whereas male rats treated with the same dose showed an overall increase in preference compared to sex-matched controls. Irrespective of sex, rats treated with 2.5 mg/kg MPH also demonstrated a decrease in anxiety/inhibitory behavior on the modified open field test compared to controls. These results were not due to differences in locomotor behavior. Overall, the study contributes to the growing body of evidence to suggest that MPH exposure early in development can have a sex-dependent impact on decision-making in adulthood.

Spontaneously hypertensive rats show higher impulsive action, but equal impulsive choice with both positive and aversive consequences

Both positive and aversive delayed consequences play an important role in decision making. However, most of research has studied the temporal discounting of the positive consequences, while the study of the aversives is scarce in general and null in some areas. This is the case of research on impulsivity in spontaneously hypertensive rats (SHR), an animal model of ADHD. To evaluate SHRs' sensitivity to aversive delayed consequences, we employed a choice procedure in which subjects chose between a smaller-amount alternative and a larger-amount alternative plus a shock; when preference for the smaller-amount alternative stabilized, five different delays to the shock were presented with the objective of analyzing the recovery of preference for the larger-amount alternative, which is related to the sensitivity to the delayed aversive consequence. To analyze the sensitivity to delayed positive consequences we employed a procedure that evaluated the preference between a smaller-amount alternative and a larger-amount alternative as a function of the delay to the later. Finally, to evaluate impulsive action we employed a DRL 10s schedule. In all tasks, Wistar rats were evaluated as control strain. The results indicated that choice impulsivity was equivalent between strains, both for positive and for aversive consequences. In contrast, we found a higher level of impulsive action in SHR.

Pain-induced impulsivity is sexually dimorphic and mu-opioid receptor sensitive in rats

RATIONALE AND OBJECTIVES

Pain sensation can negatively impact cognitive function, including impulsivity. Pain-induced changes in impulsivity can contribute to development of psychiatric comorbidities found in those with chronic pain conditions. The goal of this study was to determine whether complete Freund's adjuvant (CFA)-induced pain manipulation enhances impulsivity in rats. Whether the pain-induced impulsivity is sexually dimorphic, and if mu-opioid receptors play a role in these processes.

METHODS

Male and female rats were screened for trait impulsivity and designated as high or low impulsive using a delay discounting task. Rats then received a hind paw injection of CFA, and their impulsivity was assessed for 16 days. The effects of morphine on impulsivity were also examined. In a separate experiment, rats were pretreated with beta-funaltrexamine (β-FNA) to determine the role of mu-opioid receptors on impulsivity.

RESULTS

CFA treatment increased impulsivity in males and females. The onset of CFA-induced impulsivity was faster in high impulsive females than males. Morphine blocked CFA-induced impulsivity in both sexes in a dose- and time-dependent manner. β-FNA prevented the actions of morphine on CFA-induced impulsivity in high impulsive males, but not high impulsive females. Moreover, β-FNA increased CFA-induced impulsivity in morphine naïve males, but not females.

CONCLUSION

These findings demonstrate unique sex differences in CFA-induced impulsivity, response to morphine, and the impact of mu-opioid receptors. A better understanding of cognitive deficits and their mechanisms can provide insight into the development of substance abuse and psychiatric comorbidities that occur in people with chronic pain.

The irrelevancy of the inter-trial interval in delay-discounting experiments on an animal model of ADHD

Delay discounting involves choosing between a small, immediate reward, and a larger but delayed one. As the delay between choice and large reward gets longer, people with ADHD tend to become impulsive faster than controls, indicated by a switch in preference from the large to the smaller reward. Choosing the smaller reward when the larger is considered reward maximizing is labeled impulsive behaviour. It is well documented that increased delays between choice and reward affects choice preference in both humans and other animals. Other variables such as the inter-trial interval or trial length are observed to have an effect on human discounting, but their effect on discounting in other animals is largely assumed rather than tested. In the current experiment, we tested this assumption. One group of rats was exposed to increasing delays between choosing the large reward and receiving it, while another group experienced longer inter-trial intervals that were equal in length to the delays in the other group. This ensured that trial length was controlled for in delay discounting, but that the delay function and inter-trial intervals could be manipulated and measured separately. Results showed that while the delay between choice and reward caused impulsive behaviour in rats, the length of the inter-trial interval (and by extension trial length) had no impact on choice behaviour. A follow-up experiment found this to be the case even if the length of the inter-trial interval was signaled with audio cues. These results suggest that rats, and possibly animals in general, are insensitive to time between trials, and therefore cannot easily represent human counterparts on the task.

Sex differences in nicotine-induced impulsivity and its reversal with bupropion in rats

BACKGROUND

Enhancement in cognitive impulsivity and the resulting alterations in decision making serve as a contributing factor for the development and maintenance of substance-use disorders. Nicotine-induced increases in impulsivity has been previously reported in male humans and rodents. Although the potential for sex differences in nicotine-induced impulsivity has not been examined.

AIMS AND METHODS

In the present study, male and female Sprague Dawley rats were submitted to a delay discounting task, in which several consecutive measures of self-control were taken. Firstly, rats were tested with vehicle, and next with nicotine doses of 0.4 and 0.8 mg/kg. Thereafter, chronic treatment with bupropion started, and the animals were tested again. Half the animals continued to receive 0.8 mg/kg of nicotine, while the rest received nicotine and also a daily dose of 30 mg/kg of bupropion.

RESULTS

When the animals were first tested with nicotine, female rats showed a significant nicotine dose dependent increase of impulsive behaviour, whereas male rats only showed a decrease on their elections of the larger but delayed reward under the highest dose of 0.8 mg/kg of nicotine. Treatment with bupropion blocked the effect of nicotine on decision making in female rats, as they showed results close to their baseline levels. On the other hand, bupropion did not affect the nicotine-induced delay discounting in male rats.

CONCLUSION

These findings demonstrate sexually dimorphic effects of nicotine on cognitive impulsivity which may help to shed light on nicotine use vulnerabilities observed in women.

Analyzing the magnitude effect in spontaneously hypertensive (SHR) and wistar Kyoto (WKY) rats

We analyzed the magnitude effect in Spontaneously Hypertensive (SHR) and Wistar Kyoto (WKY) rats choosing between a smaller-sooner (SSF) and a larger-later food (LLF) in the initial link of a concurrent-chains procedure. The SSF was delivered immediately in one terminal link and the LLF delayed 0.01, 5, 10, 20, 40, or 80 s in the other terminal link. An ABABA design varied food amount, 1 vs. 4 and 3 vs. 8 food-pellets in conditions A and B, respectively. The SHRs made more impulsive choices than the WKYs. The hyperbolic-decay model and the Generalized Matching Law fitted the data well. Discounting rate (k) and the area under the discounting curve (AUC) for the choices made by the SHRs in conditions A, were like those in conditions B. For the choices that the individual WKYs made, k was slightly higher and AUC smaller in conditions B than in conditions A. For both strains sensitivity to the immediacy of the LLF (s) was slightly higher in conditions A than in conditions B. Thus, we found no conclusive, compelling evidence either supporting or discarding the magnitude effect in the SHRs and scarce evidence supporting an effect opposite to the magnitude effect in the WKYs.

Attention-Deficit/Hyperactivity Disorder Predominantly Inattentive Subtype/Presentation: Research Progress and Translational Studies

Research on the predominantly inattentive attention-deficit/hyperactivity disorder (ADHD-PI) subtype/presentation is important given its high prevalence, but paradoxically it is under-recognized and undertreated. The temporal stability of the inattention symptom could impact the high worldwide prevalence of ADHD-PI. Some evidence suggests differences in the nature of attentional deficit in ADHD-PI vs. that in other subtypes. Impairments in neuropsychological, neurocognitive, and social functioning are also evident in ADHD-PI, which could be specific to the subtype (e.g., processing speed, social perception, and skills), or differ from others in severity. Neuroimaging studies have also revealed ADHD-PI-specific neuropathological abnormalities and those that are shared with other subtypes. ADHD-PI is highly comorbid with learning and internalizing (e.g., anxiety and depression) disorders. There is no solid evidence for ADHD-PI-specific genetic etiologies and differential responses of subtypes to ADHD medications. Translational studies have used the Wistar Kyoto/NCrl substrain which requires further characterizations as an ADHD-PI model. Overall, ADHD-PI research has been conducted in the context of the Diagnostic and Statistical Manual, which arguably does not conform to the widely recognized "dimensional" view of ADHD. The Research Domain Criteria has been proposed to provide a novel framework for understanding the nature of neuropsychiatric illnesses and ultimately improve their diagnosis and treatment.

Neonatal 6-OHDA Lesion Model in Mouse Induces Cognitive Dysfunctions of Attention-Deficit/Hyperactivity Disorder (ADHD) During Young Age

Attention-deficit/hyperactivity disorder (ADHD) is a syndrome characterized by impaired attention, impulsivity and hyperactivity in children. These symptoms are often maintained in adults. During adolescence, prefrontal cortex develops connectivity with other brain regions to engage executive functions such as, latent inhibition, attention and inhibitory control. In our previous work, we demonstrated the validity of the neonatal 6-Hydroxydopamine (6-OHDA) mouse model, a classical neurodevelopmental model mimicking major symptoms of the human ADHD pathology. In order to evaluate pathological forms of executive functions and impulsive behavior in 6-OHDA mice during young age, we first tested latent inhibition (LI) after weaning, and then we evaluated the impulsive behavior using a cliff avoidance reaction test. Our results demonstrated that 6-OHDA mice showed disruption in latent inhibition, suggesting a deficit in selective attention, and displayed repetitive peering-down behavior, indicating a maladaptive impulsive behavior. Subsequently, to assess impulsivity and attention in young mice, we performed a modified 5-choice serial reaction time task test (5-CSRTT), optimizing the degree of food restriction for young animals and shortening the training duration. This test allowed us to demonstrate a deficit in inhibitory control and a loss of accuracy of 6-OHDA mice in the 5-CSRTT. In conclusion, we demonstrated that the 6-OHDA mouse model reproduces human symptoms of ADHD in childhood and early adulthood periods, as seen in human. Taken together, the 6-OHDA mouse model will be useful alongside other animal models to understand the neurobiological mechanisms underlying complex, heterogeneous neurological disorders.

A time-based intervention to treat impulsivity in male and female rats

Time-based interventions have emerged as promising treatments for disorders associated with impulsivity. These interventions can be implemented to test their efficacy in preventing or treating impulsive choice in animal models of diseases related to impulsivity such as drug abuse. Impulsive choice is typically defined as choosing a smaller-sooner (SS) reward over a larger-later (LL) reward when the LL is relatively more optimal. Previous research has shown that these interventions promote LL choices in males and females, but sex differences have not been assessed. Because sex differences can complicate the application of therapies, it is critical to compare the effects of the intervention in males and females. The intervention group received exposure to 10-s and 30-s interval schedules, and the control rats received no delay to reward. Different impulsive choice tasks were used to assess the intervention efficacy across the two experiments. Following the intervention, reductions in impulsive choice were found in male and female rats, but the degree of improvement was inconsistent across sex and task. Bayesian analyses that combined the results revealed robust evidence of an overall intervention effect with the intervention group showing greater self-control, but there was no evidence for the intervention affecting males and females differently. Taken together, these results suggest that time-based interventions are effective tools to treat impulsivity in both males and females and offer promising translational capability to humans.

Effect of Schedule-Induced Behavior on Responses of Spontaneously Hypertensive and Wistar-Kyoto Rats in a Delay-Discounting Task: A Preliminary Report

Delay discounting is the loss of the subjective value of an outcome as the time to its delivery increases. It has been suggested that organisms can become more tolerant of this delay when engaging in schedule-induced behaviors. Schedule-induced behaviors are those that develop at a high rate during intermittent reinforcement schedules without the need of arranged contingency to the reinforcer, and they have been considered as a model of compulsivity. There is evidence that relates compulsivity to greater delay discounting. The rate of delay discounting represents how impulsive the subject is, as the rate of discounting increases the higher the impulsivity. Thus, the main purpose of this study was to undertake a preliminary evaluation of whether developing schedule-induced behaviors affects performance in a delay-discounting task, by comparing spontaneously hypertensive rats (SHRs) and Wistar-Kyoto (WKY) rats. The rats were exposed to a task that consisted of presenting the subjects with two levers: one produced a small, immediate food reinforcer while the other one produced a larger, delayed reinforcer. During Condition A, the levers were presented, and a water bottle and a running wheel were available in the conditioning chambers; during Condition B, only the levers were presented. SHR and WKY rats developed schedule-induced behaviors during Condition A and showed no difference in discounting rates, contradicting previous reports. Lick allocation during response-reinforcer delays and the inter-trial interval (ITI) showed, respectively, pre- and post-food distributions. Discounting rates during Condition B (when rats could not engage in schedule-induced behaviors) did not reach statistical significance difference among strains of animals, although it was observed a tendency for WKY to behave more self-controlled. Likewise it was not found any effect of schedule-induced behavior on discounting rates, however, a tendency for WKY rats to behave more impulsive during access to drink and run seems to tentatively support the idea of schedule-induced behavior as a model of compulsivity in those rats, being impulsivity simply defined as an excess in behavior.

Juvenile exposure to methylphenidate and guanfacine in rats: effects on early delay discounting and later cocaine-taking behavior

RATIONALE

Both methylphenidate (MPH), a catecholamine reuptake blocker, and guanfacine, an alpha2A agonist, are used to treat attention-deficit hyperactivity disorder (ADHD). Childhood impulsivity, including delay discounting, is associated with increased substance use during adolescence. These effects can be mitigated by juvenile exposure to MPH, but less is known about the long-term effects of developmental exposure to guanfacine in males and females.

OBJECTIVE

This study aims to determine sex differences and dose-dependent effects of juvenile exposure to MPH or guanfacine on delay-discounting and later cocaine self-administration.

METHODS

The dose-dependent effects of vehicle, MPH (0.5, 1, and 2 mg/kg p.o.) or guanfacine (0.003, 0.03, and 0.3 mg/kg, i.p.) on discounting were determined in male and female Sprague-Dawley rats beginning at postnatal day (P)20. At P90, the amount, motivation, and sensitivity to cocaine following early drug exposure were determined with self-administration.

RESULTS

Guanfacine, but not MPH, significantly reduced weight by 22.9 ± 4.6% in females. MPH dose dependently decreased delay discounting in both juvenile males and females, while guanfacine was only effective in males. Discounting was associated with cocaine self-administration in vehicle males (R² = -0.4, P < 0.05) and self-administration was reduced by guanfacine treatment (0.3 mg/kg). Guanfacine significantly decreased cocaine sensitivity in both sexes.

CONCLUSIONS

These data suggest that MPH is effective in reducing delay discounting in both sexes. Due to both weight loss and ineffectiveness on discounting in females, guanfacine should be used only in males to reduce delay discounting and later cocaine use.

Effects of GluN2B-selective antagonists on delay and probability discounting in male rats: Modulation by delay/probability presentation order

The contribution of the GluN2B subunit of the NMDA receptor to impulsivity has recently been examined. Ro 63-1908, a highly selective antagonist for the GluN2B, decreases impulsive choice. Because the order in which delays are presented modulates drug effects in discounting procedures, one goal of the current study was to determine the effects of Ro 63-1908 in delay discounting procedures in which the delays to obtaining the large reinforcer either increase or decrease across the session. We also determined if Ro 63-1908 differentially alters risky choice in probability discounting procedures that use ascending/descending schedules. Male rats were trained in either delay (n = 24) or probability (n = 24) discounting in which the delay to/odds against reinforcement were presented in either ascending or descending order (n = 12 each schedule). Following training, rats received the GluN2B antagonists Ro 63-1908 (0-1.0 mg/kg) and CP-101,606 (0-3.0 mg/kg). In delay discounting, Ro 63-1908 (1.0 mg/kg), but not CP-101,606, decreased choice for the large reinforcer, but only when the delays decreased across the session. In probability discounting, Ro 63-1908 (0.3 mg/kg)/CP-101,606 (1.0 mg/kg) increased choice for the large reinforcer when the probability of obtaining this alternative decreased across the session, but Ro 63-1908 (1.0 mg/kg)/CP-101,606 (3.0 mg/kg) decreased choice when the probabilities increased. These results show that the GluN2B is a mediator of impulsive/risky choice, but the effects of GluN2B antagonists are dependent on the order in which delays/probabilities are presented. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Neonatal 6-OHDA lesion model in mouse induces Attention-Deficit/ Hyperactivity Disorder (ADHD)-like behaviour

Attention-deficit/hyperactivity disorder (ADHD) is a common neurodevelopmental disorder characterized by impaired attention, impulsivity and hyperactivity. The "neonatal 6-hydroxydopamine" (6-OHDA) lesion is a commonly used model of ADHD in rat. However, a comprehensive assessment of ADHD-like symptoms is still missing, and data in mouse remain largely unavailable. Our aim was to analyse symptoms of ADHD in the mouse neonatal 6-OHDA model. 6-OHDA mice exhibited the major ADHD-like symptoms, i.e. hyperactivity (open field), attention deficit and impulsivity (five-choice serial reaction time task). Further, the model revealed discrete co-existing symptoms, i.e. anxiety-like (elevated plus maze test) and antisocial (social interaction) behaviours and decreased cognitive functioning (novel object recognition). The efficacy of methylphenidate, a classical psychostimulant used in the treatment of ADHD, was also evaluated. A histological analysis further supports the model validity by indicating dopamine depletion, changes in cortical thickness and abnormalities in anterior cingulate cortex neurons. A principal component analysis of the behaviour profile confirms that the 6-OHDA mouse model displayed good face and predictive validity. We conclude that neonatal dopamine depletion results in behavioural and morphological changes similar to those seen in patients and therefore could be used as a model for studying ADHD pathophysiological mechanisms and identifying therapeutic targets.

Semi-Automated Biomarker Discovery from Pharmacodynamic Effects on EEG in ADHD Rodent Models

We propose a novel semi-automatic approach to design biomarkers for capturing pharmacodynamic effects induced by pharmacological agents on the spectral power of electroencephalography (EEG) recordings. We apply this methodology to investigate the pharmacodynamic effects of methylphenidate (MPH) and atomoxetine (ATX) on attention deficit/hyperactivity disorder (ADHD), using rodent models. We inject the two agents into the spontaneously hypertensive rat (SHR) model of ADHD, the Wistar-Kyoto rat (WKY), and the Wistar rat (WIS), and record their EEG patterns. To assess individual EEG patterns quantitatively, we use an integrated methodological approach, which consists of calculating the mean, slope and intercept parameters of temporal records of EEG spectral power using a smoothing filter, outlier truncation, and linear regression. We apply Fisher discriminant analysis (FDA) to identify dominant discriminants to be heuristically consolidated into several new composite biomarkers. Results of the analysis of variance (ANOVA) and t-test show benefits in pharmacodynamic parameters, especially the slope parameter. Composite biomarker evaluation confirms their validity for genetic model stratification and the effects of the pharmacological agents used. The methodology proposed is of generic use as an approach to investigating thoroughly the dynamics of the EEG spectral power.

Dissecting drug effects in preclinical models of impulsive choice: emphasis on glutamatergic compounds

RATIONALE

Impulsive choice is often measured with delay discounting paradigms. Because there are multiple discounting procedures, as well as different statistical analyses that can be applied to data generated from these paradigms, there are some inconsistencies in the literature regarding drug effects on impulsive choice.

OBJECTIVES

The goal of the current paper is to review the methodological and analytic approaches used to measure discounting and to discuss how these differences can account for differential drug effects observed across studies.

RESULTS

Because some procedures/analyses use a single data point as the dependent variable, changes in this value following pharmacological treatment may be interpreted as alterations in sensitivity to delayed reinforcement, but when other procedures/analyses are used, no changes in behavior are observed. Even when multiple data points are included, some studies show that the statistical analysis (e.g., ANOVA on raw proportion of responses vs. using hyperbolic/exponential functions) can lead to different interpretations. Finally, procedural differences (e.g., delay presentation order, signaling the delay to reinforcement, etc.) in the same discounting paradigm can alter how drugs affect sensitivity to delayed reinforcement.

CONCLUSIONS

Future studies should utilize paradigms that allow one to observe alterations in responding at each delay (e.g., concurrent-chains schedules). Concerning statistical analyses, using parameter estimates derived from nonlinear functions or incorporating the generalized matching law can allow one to determine if drugs affect sensitivity to delayed reinforcement or impair discrimination of the large and small magnitude reinforcers. Using these approaches can help further our understanding of the neurochemical underpinnings of delay discounting.

Instrumental conditioning for food reinforcement in the spontaneously hypertensive rat model of attention deficit hyperactivity disorder

Background

The spontaneously hypertensive rat is thought to show good validity as a model of attention deficit hyperactivity disorder, in part because of impaired delayed reinforcement behaviour, corresponding to the dynamic developmental theory of the disorder. However, some previous studies may have been confounded use of fluid reward. Therefore, the objective of this study was to assess the spontaneously hypertensive rat and two comparison strains (Wistar and Wistar Kyoto) using a non-delayed food reinforcement paradigm in an attempt to advance knowledge of basic learnt behaviour in this strain, without potentially confounding reward sensitivity, which could impact on motivation to learn. Rats were trained on a fixed ratio 1 two choice discrimination schedule, extinction, reacquisition and reversal. We also tested non-reinforced spontaneous alternation to facilitate data interpretation.

Results

The spontaneously hypertensive rat displayed slower shaping and reduced on task activity during task acquisition, contrasting with previous results which indicate either enhanced responding and an impairment only when a delay is used; we suggest several reasons for this. In line with previous work, the same strain exhibited poor extinguishing of behaviour but were not impaired to the same extent on reversal of the discrimination. Finally, non-reinforced alternations on a Y-maze were also reduced in the spontaneously hypertensive rat.

Conclusions

In sum, the spontaneously hypertensive rat appear to show poor response inhibition in reinforced and non-reinforced contexts. However, impaired response inhibition was reduced during reversal when an opposite response produced food reward alongside presentation of the conditioned stimulus. We discuss the possibility of enhanced attribution of incentive salience to cues in this strain and highlight several points of caution for researchers conducting behavioural assessments using the spontaneously hypertensive rat and their associated comparison strains.

Electronic supplementary material

The online version of this article (10.1186/s13104-017-2857-5) contains supplementary material, which is available to authorized users.

Spontaneously hypertensive (SHR) rats choose more impulsively than Wistar-Kyoto (WKY) rats on a delay discounting task

Indications of Attention Deficit Hyperactivity Disorder (ADHD) in the spontaneously hypertensive rat (SHR) are not consistent across different tests of impulsivity, questioning the SHR's validity as a rodent model of ADHD. This study used a concurrent-chains procedure to examine possible differences in impulsive choice between SHRs and control-normotensive Wistar Kyoto (WKY) rats. The aim was to extend the generality of findings showing regularities between the hyperbolic-decay model and the generalized matching law fitting delay discounting data from nonhuman animals. The objectives were to: (1) examine differences in impulsive choice between SHRs and WKYs; (2) add evidence suggesting that the SHR is a suitable model of ADHD; (3) demonstrate that concurrent-chains procedures requiring locomotion detect differences in impulsive choice between SHRs and WKYs; (4) support the idea that impulsivity in nonhuman animals increases with training. The initial link used two non-independent random interval schedules arranging entries to the terminal links, where one fixed-time (FT) schedule delayed 1-food pellet and the other FT 4-food pellets. The FT delaying the former was kept constant at 0.1s and that delaying the latter changed after every 10 food deliveries, defining six delay components (0.1, 5, 10, 20, 40, and 80s) presented in random order each session. Results showed that the SHRs choose more impulsively than the WKYs, adding to the body of evidence suggesting that the SHR may be a suitable model of ADHD. Both models of choice fitted the impulsive choices of the SHRs and WKYs well; positive correlations between estimates of parameters k and s suggested compatibility between models of choice showing that impulsivity increases with training.

Methylphenidate and Atomoxetine-Responsive Prefrontal Cortical Genetic Overlaps in "Impulsive" SHR/NCrl and Wistar Rats

Impulsivity, the predisposition to act prematurely without foresight, is associated with a number of neuropsychiatric disorders, including attention-deficit/hyperactivity disorder (ADHD). Identifying genetic underpinnings of impulsive behavior may help decipher the complex etiology and neurobiological factors of disorders marked by impulsivity. To identify potential genetic factors of impulsivity, we examined common differentially expressed genes (DEGs) in the prefrontal cortex (PFC) of adolescent SHR/NCrl and Wistar rats, which showed marked decrease in preference for the large but delayed reward, compared with WKY/NCrl rats, in the delay discounting task. Of these DEGs, we examined drug-responsive transcripts whose mRNA levels were altered following treatment (in SHR/NCrl and Wistar rats) with drugs that alleviate impulsivity, namely, the ADHD medications methylphenidate and atomoxetine. Prefrontal cortical genetic overlaps between SHR/NCrl and Wistar rats in comparison with WKY/NCrl included genes associated with transcription (e.g., Btg2, Fos, Nr4a2), synaptic plasticity (e.g., Arc, Homer2), and neuron apoptosis (Grik2, Nmnat1). Treatment with methylphenidate and/or atomoxetine increased choice of the large, delayed reward in SHR/NCrl and Wistar rats and changed, in varying degrees, mRNA levels of Nr4a2, Btg2, and Homer2, genes with previously described roles in neuropsychiatric disorders characterized by impulsivity. While further studies are required, we dissected potential genetic factors that may influence impulsivity by identifying genetic overlaps in the PFC of "impulsive" SHR/NCrl and Wistar rats. Notably, these are also drug-responsive transcripts which may be studied further as biomarkers to predict response to ADHD drugs, and as potential targets for the development of treatments to improve impulsivity.

Logical fallacies in animal model research

Background

Animal models of human behavioural deficits involve conducting experiments on animals with the hope of gaining new knowledge that can be applied to humans. This paper aims to address risks, biases, and fallacies associated with drawing conclusions when conducting experiments on animals, with focus on animal models of mental illness.

Conclusions

Researchers using animal models are susceptible to a fallacy known as false analogy, where inferences based on assumptions of similarities between animals and humans can potentially lead to an incorrect conclusion. There is also a risk of false positive results when evaluating the validity of a putative animal model, particularly if the experiment is not conducted double-blind. It is further argued that animal model experiments are reconstructions of human experiments, and not replications per se, because the animals cannot follow instructions. This leads to an experimental setup that is altered to accommodate the animals, and typically involves a smaller sample size than a human experiment. Researchers on animal models of human behaviour should increase focus on mechanistic validity in order to ensure that the underlying causal mechanisms driving the behaviour are the same, as relying on face validity makes the model susceptible to logical fallacies and a higher risk of Type 1 errors. We discuss measures to reduce bias and risk of making logical fallacies in animal research, and provide a guideline that researchers can follow to increase the rigour of their experiments.

Effects of N-methyl-D-aspartate receptor ligands on sensitivity to reinforcer magnitude and delayed reinforcement in a delay-discounting procedure

RATIONALE

The N-methyl-D-aspartate (NMDA) receptor has been recently identified as an important mediator of impulsive choice, as assessed in delay discounting. Although discounting is independently influenced by sensitivity to reinforcer magnitude and delayed reinforcement, few studies have examined how NMDA receptor ligands differentially affect these parameters.

OBJECTIVES

The current study examined the effects of various NMDA receptor ligands on sensitivity to reinforcer magnitude and delayed reinforcement in a delay-discounting procedure.

METHODS

Following behavioral training, rats received treatments of the following NMDA receptor ligands: the uncompetitive antagonists ketamine (0, 1.0, 5.0, or 10.0 mg/kg; i.p.), MK-801 (0, 0.003, 0.01, or 0.03 mg/kg; s.c.), and memantine (0, 2.5, 5.0, or 10.0 mg/kg; i.p.), the competitive antagonist CGS 19755 (0, 5.0, 10.0, or 20.0 mg/kg; s.c.), the non-competitive NR2B subunit-selective antagonist ifenprodil (0, 1.0, 3.0, or 10.0 mg/kg; i.p), and the partial agonist D-cycloserine (0, 3.25, 15.0, or 30.0 mg/kg; s.c.).

RESULTS

When an exponential model was used to describe discounting, CGS 19755 (5.0 mg/kg) increased impulsive choice without altering sensitivity to reinforcer magnitude. Conversely, ketamine (10.0 mg/kg), memantine (5.0 mg/kg), and ifenprodil (10.0 mg/kg) decreased sensitivity to reinforcer magnitude without altering impulsive choice. MK-801 and D-cycloserine did not alter delay-discounting performance, although two-way ANOVA analyses indicated D-cycloserine (15.0 mg/kg) decreased impulsive choice.

CONCLUSIONS

The behavioral changes observed in delay discounting following administration of NMDA receptor antagonists do not always reflect an alteration in impulsive choice. These results emphasize the utility in employing quantitative methods to assess drug effects in delay discounting.

Sensation seeking and impulsive traits as personality endophenotypes for antisocial behavior: Evidence from two independent samples

Sensation seeking and impulsivity are personality traits that are correlated with risk for antisocial behavior (ASB). This paper uses two independent samples of twins to (a) test the extent to which sensation seeking and impulsivity statistically mediate genetic influence on ASB, and (b) compare this to genetic influences accounted for by other personality traits. In Sample 1, delinquent behavior, as well as impulsivity, sensation seeking and Big Five personality traits, were measured in adolescent twins from the Texas Twin Project. In Sample 2, adult twins from the Australian Twin Registry responded to questionnaires that assessed individual differences in Eysenck's and Cloninger's personality dimensions, and a structured telephone interview that asked participants to retrospectively report DSM-defined symptoms of conduct disorder. Bivariate quantitative genetic models were used to identify genetic overlap between personality traits and ASB. Across both samples, novelty/sensation seeking and impulsive traits accounted for larger portions of genetic variance in ASB than other personality traits. We discuss whether sensation seeking and impulsive personality are causal endophenotypes for ASB, or merely index genetic liability for ASB.

Effects of NMDA receptor antagonists on probability discounting depend on the order of probability presentation

Risky decision making can be measured using a probability-discounting procedure, in which animals choose between a small, certain reinforcer and a large, uncertain reinforcer. Recent evidence has identified glutamate as a mediator of risky decision making, as blocking the N-methyl-d-aspartate (NMDA) receptor with MK-801 increases preference for a large, uncertain reinforcer. Because the order in which probabilities associated with the large reinforcer can modulate the effects of drugs on choice, the current study determined if NMDA receptor ligands alter probability discounting using ascending and descending schedules. Sixteen rats were trained in a probability-discounting procedure in which the odds against obtaining the large reinforcer increased (n=8) or decreased (n=8) across blocks of trials. Following behavioral training, rats received treatments of the NMDA receptor ligands MK-801 (uncompetitive antagonist; 0, 0.003, 0.01, or 0.03mg/kg), ketamine (uncompetitive antagonist; 0, 1.0, 5.0, or 10.0mg/kg), and ifenprodil (NR2B-selective non-competitive antagonist; 0, 1.0, 3.0, or 10.0mg/kg). Results showed discounting was steeper (indicating increased risk aversion) for rats on an ascending schedule relative to rats on the descending schedule. Furthermore, the effects of MK-801, ketamine, and ifenprodil on discounting were dependent on the schedule used. Specifically, the highest dose of each drug decreased risk taking in rats in the descending schedule, but only MK-801 (0.03mg/kg) increased risk taking in rats on an ascending schedule. These results show that probability presentation order modulates the effects of NMDA receptor ligands on risky decision making.

Sex differences in the reduction of impulsive choice (delay discounting) for cocaine in rats with atomoxetine and progesterone

RATIONALE

Impulsive choice, or an inability to delay immediate gratification, has been strongly linked to the development and persistence of drug abuse. Indeed, delaying drug use itself may underlie drug addiction and relapse. Thus, employing treatments that are efficacious in reducing impulsive choice (atomoxetine; ATO) or drug-seeking behavior (progesterone; PRO) may be an effective means of treating drug addiction.

OBJECTIVE

The current study assessed sex differences in the effects of PRO, ATO, and their combination in a delay discounting paradigm for cocaine and for sucrose pellets.

METHOD

Male and female rats chose between a small-immediate or a large-delayed (0, 7.5, 15, 30, 60 s) outcome in an impulsive choice procedure for sucrose pellets (1 vs. 3 pellets) or for iv cocaine infusions (0.3 vs. 0.9 mg/kg). Following baseline assessment of impulsive choice, rats received daily treatment of vehicle (VEH), PRO (0.5 mg/kg), ATO (1.5 mg/kg), or a combination (PRO + ATO) until a second assessment of impulsive choice was determined.

RESULTS

Compared to the VEH group, females were less impulsive for cocaine following PRO or the PRO + ATO combined treatment, whereas males were less impulsive for cocaine following ATO. No treatment effects were observed on impulsive choice for sucrose pellets.

CONCLUSIONS

The present results indicate that impulsive choice for cocaine is reduced by PRO in females and by ATO in males. These findings suggest both treatments may be an effective intervention in treating cocaine abuse, but that their effectiveness differs by sex.

Auditory responses in a rodent model of Attention Deficit Hyperactivity Disorder

A central component of Attention Deficit Hyperactivity Disorder (ADHD) is increased distractibility in response to visual and auditory stimuli, which is linked to the superior colliculus (SC). Furthermore, there is now mounting evidence of altered collicular functioning in ADHD and it is proposed that a hyper-responsive SC could mediate symptoms of ADHD, including distractibility. In the present study we conducted a systematic characterisation of the intermediate and deep layers of the SC in the most commonly used and well-validated model of ADHD, the spontaneously hypertensive rat (SHR), building on prior work showing increased distractible behaviour in this strain using visual distractors. We examined collicular-dependent orienting behaviour, local field potential (LFP) and multiunit activity (MUA) in response to auditory stimuli in the anaesthetised rat, and morphological measures, in the SHR in comparison to the Wistar Kyoto (WKY) and Wistar (WIS). We found no evidence of increased distractibility in the behavioural data but suggest that this may arise due to cochlear hearing loss in the SHR. Furthermore, the electrophysiology data indicate that the SC in the SHR may still be hyper-responsive, normalising the amplitude of auditory responses that would otherwise be reduced due to the hearing impairment. The morphological measures of collicular volume, cell density and ratios did not indicate this potential hyper-responsiveness had a basis at the structural level examined. These findings have implications for future use of the SHR in auditory processing studies and may represent a limitation to the validity of this animal model.

D-amphetamine improves attention performance in adolescent Wistar, but not in SHR rats, in a two-choice visual discrimination task

The validity of spontaneous hypertensive rat (SHR) as a model of attention deficit hyperactivity disorder (ADHD) has been explored by comparing SHR with Wistar rats in a test of attention, the two-choice visual discrimination task (2-CVDT). Animals were 4-5 weeks old during the training phase of the experiment and 6-7 weeks old during the testing phase in which they were tested with D-amphetamine, a stimulant drug used for the treatment of ADHD. As compared to Wistar, SHR showed a slightly better attention performance, a slightly lower impulsivity level, and a lower general activity during the training phase, but these differences disappeared or lessened thereafter, during the testing phase. D-amphetamine (0.5, 1 mg/kg) improved attention performance in Wistar, but not in SHR, and did not modify impulsivity and activity in the two strains. In conclusion, the present study did not demonstrate that SHR represents a valid model of ADHD, since it did not show face validity regarding the behavioral symptoms of ADHD and predictive validity regarding the effect of a compound used for the treatment of ADHD. On the other hand, this study showed that the 2-CVDT may represent a suitable tool for evaluating in adolescent Wistar rats the effect on attention of compounds intended for the treatment of ADHD.

Impulsivity and sensitivity to amount and delay of reinforcement in an animal model of ADHD

Previous research has been inconclusive about the degree of impulsivity displayed by spontaneously hypertensive rats (SHR), an animal model of Attention Deficit Hyperactivity Disorder (ADHD). In the present set of experiments, concurrent-chains schedules were employed in order to explore SHR's impulsivity, sensitivity to delay, and sensitivity to amount of reinforcement; Wistar rats (WIS) were used as comparison group. In the three experiments - performed with different subjects - non-independent variable interval 30s schedules were presented in the initial links; the difference between experiments was in the terminal links. For exploring impulsivity, one of the terminal links (SS) was associated to a short delay (2s) and a small reinforcer (1 pellet), whereas the other terminal link (LL) was associated to a longer delay (28s) and a larger reinforcer (4 pellets). The results indicated a remarkably higher impulsivity in SHR. Because this impulsivity may have as potential mechanisms an increased sensitivity to delay and/or a decreased sensitivity to the amount of reinforcement, in experiments 2 and 3 these possibilities were examined. For assessing sensitivity to delay, the following pairs of fixed interval (FI) schedules were used in the terminal links in five conditions: 2-28, 6-24, 15-15, 24-6, 28-2s; the magnitude of reinforcement was 1 pellet in all conditions for both alternatives. For assessing sensitivity to amount, in five conditions the alternatives were associated with different magnitudes of reinforcement: 1-5 pellets, 2-4, 3-3, 4-2 and 5-1 in left-right alternatives, respectively; the delay to reinforcement was controlled by a FI 15s in all conditions and for both alternatives. The sensitivity to delay and the sensitivity to amount were calculated according to the Generalized Matching Law. The results indicated a higher sensitivity to delay in SHR, and the same sensitivity to amount in SHR and WIS rats. These results suggest that the increased sensitivity to delay influences the high level of impulsivity observed in SHR.

Discrepant effects of acute cocaine on impulsive choice (delay discounting) in female rats during an increasing- and adjusting-delay procedure

RATIONALE

The relationship between impulsive choice and cocaine use in humans has been well established, although the causal role between these variables is complex. To disentangle this relationship, studies using rats have focused on how acute or chronic cocaine alters impulsive choice. A predominance of studies has focused on chronic cocaine regimens, but few have assessed acute cocaine's effects on impulsive choice.

OBJECTIVE

The current study assessed if acute cocaine administrations alter delay discounting of rats in two common impulsive choice procedures.

METHOD

Baseline delay discounting rates were determined in female rats using both an increasing- and adjusting-delay procedure. Once stable, a range of acute cocaine injections (2, 5, and 15 mg/kg i.p.) was administered prior to both procedures.

RESULTS

Baseline delay discounting rates were positively correlated between the increasing- and adjusting-delay procedures. Acute administrations of cocaine produced a dose-dependent decrease in preference for the large alternative in the increasing-delay procedure but had no effect in the adjusting-delay procedure.

CONCLUSIONS

The concordance of delay discounting rates across the two choice procedures suggests that both quantify the same underlying components of impulsive choice. However, manipulations that disrupt large alternative preference may not be readily detected under the adjusting-delay procedure unless control conditions are employed.

A within-subject between-apparatus comparison of impulsive choice: T-maze and two-lever chamber

Whereas intertemporal choice procedures are a common method for examining impulsive choice in nonhuman subjects, the apparatus used to implement this procedure varies across studies. The purpose of the present study was to compare impulsive choice between a two-lever chamber and a T-maze. In Experiment 1, rats chose between a smaller, immediate reinforcer and a larger, delayed reinforcer, first in a two-lever chamber and then in a T-maze. Delay to the larger reinforcer changed in an ascending and descending order (0-32 s) across sessions. Experiment 2 examined the same between-apparatus comparison but under steady-state conditions with the delay fixed at 32 s. In Experiment 1, choice for the larger, delayed reinforcer was generally higher in the T-maze than in the two-lever chamber. Similarly in Experiment 2, steady-state choice for the larger, delayed reinforcer was higher in the T-maze. Choice for the 32-s delayed reinforcer was also greater in Experiment 2 than in Experiment 1, suggesting that extended exposure to the delay is required for the T-maze to yield reliable impulsive choice data. While the reasons for the between-apparatus discrepancies are at present unknown, results from both experiments clearly demonstrate that the apparatus matters when assessing overall level and reliability of impulsive choice data.

Do the adjusting-delay and increasing-delay tasks measure the same construct: delay discounting?

Delay discounting describes the subjective devaluation of a reward when it is delayed. In animals, the adjusting-delay (AD) and increasing-delay (ID) tasks often are used to assess individual differences in, and drug effects on, delay discounting. No study to date, however, has compared systematically the measures of discounting produced in these tasks. The current study examined the correlation between measures of delay discounting derived from AD and ID procedures. Twenty rats completed 30 sessions under each task (order counterbalanced across rats). Quantitative measures of delay discounting produced by the two tasks were positively correlated, suggesting that the AD and ID tasks measure the same underlying facet of impulsive choice (i.e. individual or conjoint sensitivities to reward delay and magnitude). The measures derived from either task, however, depended on the sequences in which the tasks were experienced. That is, pre-exposure to one task decreased discounting of delayed rewards in the second task. Consistent with other published findings, exposure to delayed consequences during the initial discounting assessment might explain this effect. Despite the observed correlation between ID and AD indifference delays, we suggest that the ID procedure might be a more appropriate procedure for pharmacological studies.

Models of ADHD: Five ways smaller sooner is better

BACKGROUND

In the delay discounting paradigm choices are made between a good of small utility available soon (SS) vs. a good of greater utility available later (LL). Versions of the task may be used with human and non-human subjects, they generate characteristic data, and are of relevance the topic of this special issue, the imputed impulsivity of organisms categorized as ADHD, and animal models of ADHD.

METHOD

Mathematical models of judgment were formulated. The first model adds the utility of a good to the utility of the delay. It provides distinct information about future perspective, the marginal utility of the goods offered, and the relative weight on delay. It grounds hyperbolic discounting. It predicts slower rates of discount for more preferred goods. It can reduce to an exponential function on future perspective time. When choice is mediated by conditioning, not judgment, a model of conditioned reinforcement strength is written. For studies where only the degree of preference for the LL is reported, a Thurstonian model of discrimination provides a shell that embraces all of the earlier models, providing additional information about the precision and bias of those preferential judgments.

COMPARISON WITH OTHER MODELS

All other prominent models are nested within, or approximations to, the models described here.

RESULTS

The models are fit to exemplary data. They provide some support for theories of delay aversion, and explanations for some inconsistencies in the literature. They involve parameters of general utility and provide connection to economic models.

Pragmatism, mathematical models, and the scientific ideal of prediction and control

Mathematical models are often held to be valuable, if not necessary, for theories and explanations in the quantitative analysis of behavior. The present review suggests that mathematical models primarily derived from the observation of functional relations do indeed contribute to the scientific value of theories and explanations, even though the final form of the models appears to be highly abstract. However, mathematical models not primarily so derived risk being essentialist in character, based on a particular view of formal causation. Such models invite less effective and frequently mentalistic theories and explanations of behavior. Models may be evaluated in terms of both (a) the verbal processes responsible for their origin and development and (b) the prediction and control engendered by the theories and explanations that incorporate the models, however indirect or abstract that prediction and control may be. Overall, the present review suggests that technological application and theoretical contemplation may be usefully viewed as continuous and overlapping forms of scientific activity, rather than dichotomous and mutually exclusive.