Extinction learning deficit in a rodent model of attention-deficit hyperactivity disorder

Simulating bout-and-pause patterns with reinforcement learning

Animal responses occur according to a specific temporal structure composed of two states, where a bout is followed by a long pause until the next bout. Such a bout-and-pause pattern has three components: the bout length, the within-bout response rate, and the bout initiation rate. Previous studies have investigated how these three components are affected by experimental manipulations. However, it remains unknown what underlying mechanisms cause bout-and-pause patterns. In this article, we propose two mechanisms and examine computational models developed based on reinforcement learning. The model is characterized by two mechanisms. The first mechanism is choice-an agent makes a choice between operant and other behaviors. The second mechanism is cost-a cost is associated with the changeover of behaviors. These two mechanisms are extracted from past experimental findings. Simulation results suggested that both the choice and cost mechanisms are required to generate bout-and-pause patterns and if either of them is knocked out, the model does not generate bout-and-pause patterns. We further analyzed the proposed model and found that it reproduced the relationships between experimental manipulations and the three components that have been reported by previous studies. In addition, we showed alternative models can generate bout-and-pause patterns as long as they implement the two mechanisms.

Analyzing the magnitude effect in spontaneously hypertensive (SHR) and wistar Kyoto (WKY) rats

We analyzed the magnitude effect in Spontaneously Hypertensive (SHR) and Wistar Kyoto (WKY) rats choosing between a smaller-sooner (SSF) and a larger-later food (LLF) in the initial link of a concurrent-chains procedure. The SSF was delivered immediately in one terminal link and the LLF delayed 0.01, 5, 10, 20, 40, or 80 s in the other terminal link. An ABABA design varied food amount, 1 vs. 4 and 3 vs. 8 food-pellets in conditions A and B, respectively. The SHRs made more impulsive choices than the WKYs. The hyperbolic-decay model and the Generalized Matching Law fitted the data well. Discounting rate (k) and the area under the discounting curve (AUC) for the choices made by the SHRs in conditions A, were like those in conditions B. For the choices that the individual WKYs made, k was slightly higher and AUC smaller in conditions B than in conditions A. For both strains sensitivity to the immediacy of the LLF (s) was slightly higher in conditions A than in conditions B. Thus, we found no conclusive, compelling evidence either supporting or discarding the magnitude effect in the SHRs and scarce evidence supporting an effect opposite to the magnitude effect in the WKYs.

Differential Behavioral and Biochemical Responses to Caffeine in Male and Female Rats from a Validated Model of Attention Deficit and Hyperactivity Disorder

Epidemiological studies suggest sex differences in attention deficit and hyperactivity disorder (ADHD) symptomatology. The potential benefits of caffeine have been reported in the management of ADHD, but its effects were not properly addressed with respect to sex differences. The present study examined the effects of caffeine (0.3 g/L) administered since childhood in the behavior and brain-derived neurotrophic factor (BDNF) and its related proteins in both sexes of a rat model of ADHD (spontaneously hypertensive rats-SHR). Hyperlocomotion, recognition, and spatial memory disturbances were observed in adolescent SHR rats from both sexes. However, females showed lack of habituation and worsened spatial memory. Although caffeine was effective against recognition memory impairment in both sexes, spatial memory was recovered only in female SHR rats. Besides, female SHR rats showed exacerbated hyperlocomotion after caffeine treatment. SHR rats from both sexes presented increases in the BDNF, truncated and phospho-TrkB receptors and also phospho-CREB levels in the hippocampus. Caffeine normalized BDNF in males and truncated TrkB receptor at both sexes. These findings provide insight into the potential of caffeine against fully cognitive impairment displayed by females in the ADHD model. Besides, our data revealed that caffeine intake since childhood attenuated behavioral alterations in the ADHD model associated with changes in BDNF and TrkB receptors in the hippocampus.

The Effect of Methylphenidate on the Microstructure of Schedule-Induced Polydipsia in an animal model of ADHD

Schedule-induced polydipsia (SIP) was established in spontaneously hypertensive rats (SHR), Wistar Kyoto rats (WKY), and Wistar rats, using a multiple fixed-time (FT) schedule of food delivery, with 30- and 90-s components. Thereafter, animals were exposed to methylphenidate (MPH; 2.5mg/kg/d) for six consecutive SIP sessions. A test to assess possible sensitization effects was also conducted four days after termination of the drug treatment. At baseline, FT 90-s produced longer and more frequent drinking episodes in SHR than in WKY. An analysis of the distribution of inter-lick intervals revealed that drinking was organized in bouts, which were shorter in SHR than in WKY. Across strains and schedules, MPH shifted drinking episodes towards the beginning of inter-food intervals, which may reflect a stimulant effect on SIP. MPH transiently reduced the frequency of drinking episodes in WKY in FT 30-s, and more permanently reduced the frequency of licking bouts in Wistar rats. MPH also increased the length of licking bouts in Wistar rats. Overall, SHR displayed a hyperactive-like pattern of drinking (frequent but short bouts), which 2.5mg/kg MPH appears to reduce in WKY and Wistar but not in SHR rats. It appears that therapeutic effects of MPH on hyperactive-like SIP require higher doses in SHR relative to control strains.

A bout analysis of operant response disruption

Operant behavior appears to be organized in bouts of responses, whose parameters are differentially sensitive to various manipulations. This study investigated potential differential effects of three forms of operant response disruption-extinction (EXT), non-contingent reinforcement (NCR), and prefeeding (PRE)-on response bouts. In Experiment 1, Wistar Kyoto rats (WKY) were trained on a tandem variable-time (VT) 120s fixed-ratio (FR) 5 schedule of reinforcement; after stability was established, their responding was disrupted for three sessions with one of the three disrupters (EXT, NCR, or PRE). In Experiment 2, Long Evans (LE) rats were trained on a tandem VT 240s FR 5 to stability, and their responding disrupted with EXT or NCR. In EXT and NCR, response rates declined significantly and progressively over the course of the session, primarily due to a declining bout-initiation rate in EXT, and to fewer responses per bout in NCR. In contrast, a session-wide drop in response rate was observed in PRE, primarily due to a reduction in bout-initiation rate at the start of the session. These findings suggest that each form of disruption differentially impacts dissociable aspects of behavior. Theories of behavioral persistence should account for these functional relations, which appear to be obscured in response rate measures.

Adolescent D-amphetamine treatment in a rodent model of ADHD: Pro-cognitive effects in adolescence without an impact on cocaine cue reactivity in adulthood

Attention-deficit/hyperactivity disorder (ADHD) is comorbid with cocaine abuse. Whereas initiating ADHD medication in childhood does not alter later cocaine abuse risk, initiating medication during adolescence may increase risk. Preclinical work in the Spontaneously Hypertensive Rat (SHR) model of ADHD found that adolescent methylphenidate increased cocaine self-administration in adulthood, suggesting a need to identify alternatively efficacious medications for teens with ADHD. We examined effects of adolescent d-amphetamine treatment on strategy set shifting performance during adolescence and on cocaine self-administration and reinstatement of cocaine-seeking behavior (cue reactivity) during adulthood in male SHR, Wistar-Kyoto (inbred control), and Wistar (outbred control) rats. During the set shift phase, adolescent SHR needed more trials and had a longer latency to reach criterion, made more regressive errors and trial omissions, and exhibited slower and more variable lever press reaction times. d-Amphetamine improved performance only in SHR by increasing choice accuracy and decreasing errors and latency to criterion. In adulthood, SHR self-administered more cocaine, made more cocaine-seeking responses, and took longer to extinguish lever responding than control strains. Adolescent d-amphetamine did not alter cocaine self-administration in adult rats of any strain, but reduced cocaine seeking during the first of seven reinstatement test sessions in adult SHR. These findings highlight utility of SHR in modeling cognitive dysfunction and comorbid cocaine abuse in ADHD. Unlike methylphenidate, d-amphetamine improved several aspects of flexible learning in adolescent SHR and did not increase cocaine intake or cue reactivity in adult SHR. Thus, adolescent d-amphetamine was superior to methylphenidate in this ADHD model.

A microstructural analysis of schedule-induced polydipsia reveals incentive-induced hyperactivity in an animal model of ADHD

Recent research has suggested that frequent short bursts of activity characterize hyperactivity associated with attention deficit hyperactivity disorder (ADHD). This study determined whether such pattern is also visible in schedule-induced polydipsia (SIP) in the spontaneously hypertensive rat (SHR), an animal model of ADHD. Male SHR, Wistar Kyoto (WKY) and Wistar rats were exposed to 40 sessions of SIP using a multiple fixed-time (FT) schedule of food delivery with FT 30-s and FT 90-s components. Stable performance was analyzed to determine the extent to which SIP-associated drinking is organized in bouts. The Bi-Exponential Refractory Model (BERM) of free-operant performance was applied to schedule-induced licks. A model comparison analysis supported BERM as a description of SIP episodes: licks were not produced at a constant rate but organized into bouts within drinking episodes. FT 30-s induced similar overall licking rates, latencies to first licks and episode durations across strains; FT 90-s induced longer episode durations in SHRs and reduced licking rate in WKY and Wistar rats to nearly baseline levels. Across schedules, SHRs made more and shorter bouts when compared to the other strains. These results suggest an incentive-induced hyperactivity in SHR that has been observed in operant behaviour and in children with ADHD.

Genetic targeting of the amphetamine and methylphenidate-sensitive dopamine transporter: on the path to an animal model of attention-deficit hyperactivity disorder

Alterations in dopamine (DA) signaling underlie the most widely held theories of molecular and circuit level perturbations that lead to risk for attention-deficit hyperactivity disorder (ADHD). The DA transporter (DAT), a presynaptic reuptake protein whose activity provides critical support for DA signaling by limiting DA action at pre- and postsynaptic receptors, has been consistently associated with ADHD through pharmacological, behavioral, brain imaging and genetic studies. Currently, the animal models of ADHD exhibit significant limitations, stemming in large part from their lack of construct validity. To remedy this situation, we have pursued the creation of a mouse model derived from a functional nonsynonymous variant in the DAT gene (SLC6A3) of ADHD probands. We trace our path from the identification of these variants to in vitro biochemical and physiological studies to the production of the DAT Val559 mouse model. We discuss our initial findings with these animals and their promise in the context of existing rodent models of ADHD.