1
|
Reed P. Effect of signaled reinforcement on response variability. J Exp Anal Behav 2023; 119:286-299. [PMID: 36706032 DOI: 10.1002/jeab.825] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2022] [Accepted: 11/02/2022] [Indexed: 01/28/2023]
Abstract
Three experiments examined the effect of signaling reinforcement on rats' lever pressing on contingencies that reinforced variable responding to extend the exploration of signaled reinforcement to a schedule that has previously not been examined in this respect. In Experiment 1, rats responding on a lag-8 variability schedule with signaled reinforcement displayed greater levels of variability (U values) than rats on the same schedule lacking a reinforcement signal. In Experiment 2, rats responding on a differential reinforcement of least frequent responses schedule also displayed greater operant variability with a signal for reinforcement compared with rats without a reinforcement signal. In Experiment 3, a reinforcement signal decreased the variability of a response sequence when there was no variability requirement. These results offer empirical corroboration that operant variability responds to manipulations in the same manner as do other forms of operant response and that a reinforcement signal facilitates the emission of the required operant.
Collapse
|
2
|
Fonseca-Júnior AR, Hunziker MHL. Negative reinforcement of behavioral variability without previous training with positive reinforcement. Behav Processes 2023; 204:104797. [PMID: 36460137 DOI: 10.1016/j.beproc.2022.104797] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2022] [Revised: 11/24/2022] [Accepted: 11/28/2022] [Indexed: 12/03/2022]
Abstract
In a previous study, Fonseca Júnior and Hunziker (2017) provided evidence of the control of behavioral variability by avoidance contingencies. However, their study presented three methodological weaknesses: (1) only one contingency reversal was conducted in the experimental design adopted, (2) the lever press was shaped using a positive reinforcement procedure, and (3) the intermittency of reinforcement between Lag n and Yoke conditions was not successfully equaled. The present study aimed to overcome these three methodological limitations. Three experimentally naive male rats with no prior history with positive reinforcement had sequences of three lever presses between two levers negatively reinforced under the following discrete trial avoidance contingencies that provided similar intermittency of reinforcement: Lag 1, Yoke, Lag 1, and Yoke. All subjects showed high levels of behavioral variability under the Lag 1 contingency and decreased levels of behavioral variability under the Yoke contingency. These results replicate the findings of Fonseca Júnior and Hunziker, suggesting that behavioral variability can be controlled by avoidance contingency without previous exposure to positive reinforcement. Moreover, these findings suggest that the high levels of variation obtained under the Lag n condition are an effect of operant contingency and not a mere byproduct of the intermittency of reinforcement.
Collapse
|
3
|
Fasmer OB, Johansen EB. Patterns of motor activity in spontaneously hypertensive rats compared to Wistar Kyoto rats. Behav Brain Funct 2016; 12:32. [PMID: 27906019 PMCID: PMC5131462 DOI: 10.1186/s12993-016-0117-9] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2016] [Accepted: 11/22/2016] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Increased motor activity is a defining characteristic of patients with ADHD, and spontaneously hypertensive rats have been suggested to be an animal model of this disorder. In the present study, we wanted to use linear and non-linear methods to explore differences in motor activity patterns in SHR/NCrl rats compared to Wistar Kyoto (WKY/NHsd) rats. METHODS A total number of 42 rats (23 SHR/NCrl and 19 WKY/NHsd, male and female) were tested. At PND 51, the animals' movements were video-recorded during an operant test procedure that lasted 90 min. Total activity level and velocity (mean and maximum), standard deviation (SD) and root mean square successive differences (RMSSD) were calculated. In addition, we used Fourier analysis, autocorrelations and two measures of complexity to characterize the time series; sample entropy and symbolic dynamics. RESULTS The SHR/NCrl rats showed increased total activity levels in addition to increased mean and maximum velocity of movements. The variability measures, SD and RMSSD, were markedly lower in the SHR/NCrl compared to the WKY/NHsd rats. At the same time, the SHR/NCrl rats displayed a higher complexity of the time series, particularly with regard to the total activity level as evidenced by analyses of sample entropy and symbolic dynamics. Autocorrelation analyses also showed differences between the two strains. In the Fourier analysis, the SHR/NCrl rats had an increased variance in the high frequency part of the spectrum, corresponding to the time period of 9-17 s. CONCLUSION The findings show that in addition to increased total activity and velocity of movement, the organization of behavior is different in SHR/NCrl relative to WKY/NHsd controls. Compared to controls, behavioral variability is reduced in SHR/NCrl at an aggregate level, and, concomitantly, more complex and unpredictable from moment-to-moment. These finding emphasize the importance of the measures and methods used when characterizing behavioral variability. If valid for ADHD, the results indicate that decreased behavioral variability can co-exist with increased behavioral complexity, thus representing a challenge to current theories of variability in ADHD.
Collapse
Affiliation(s)
- Ole Bernt Fasmer
- Department of Clinical Medicine, Section for Psychiatry, Faculty of Medicine and Dentistry, University of Bergen, Bergen, Norway.,Division of Psychiatry, Haukeland University Hospital, Bergen, Norway.,K.G. Jebsen Centre for Research on Neuropsychiatric Disorders, Bergen, Norway
| | | |
Collapse
|
4
|
Kim P, Choi I, Pena ICD, Kim HJ, Kwon KJ, Park JH, Han SH, Ryu JH, Cheong JH, Shin CY. A simple behavioral paradigm to measure impulsive behavior in an animal model of attention deficit hyperactivity disorder (ADHD) of the spontaneously hypertensive rats. Biomol Ther (Seoul) 2013; 20:125-31. [PMID: 24116285 PMCID: PMC3792196 DOI: 10.4062/biomolther.2012.20.1.125] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2011] [Revised: 11/18/2011] [Accepted: 11/23/2011] [Indexed: 11/24/2022] Open
Abstract
Impulsiveness is an important component of many psychiatric disorders including Attention-deficit/hyperactivity disorder (ADHD). Although the neurobiological basis of ADHD is unresolved, behavioral tests in animal models have become indispensable tools for improving our understanding of this disorder. In the punishment/extinction paradigm, impulsivity is shown by subjects that persevere with responding despite punishment or unrewarded responses. Exploiting this principle, we developed a new behavioral test that would evaluate impulsivity in the most validated animal model of ADHD of the Spontaneously Hypertensive rat (SHR) as compared with the normotensive “control” strain, the Wistar Kyoto rat (WKY). In this paradigm we call the Electro-Foot Shock aversive water Drinking test (EFSDT), water-deprived rats should pass over an electrified quadrant of the EFSDT apparatus to drink water. We reasoned that impulsive animals show increased frequency to drink water even with the presentation of an aversive consequence (electro-shock). Through this assay, we showed that the SHR was more impulsive than the WKY as it demonstrated more “drinking attempts” and drinking frequency. Methylphenidate, the most widely used ADHD medication, significantly reduced drinking frequency of both SHR and WKY in the EFSDT. Thus, the present assay may be considered as another behavioral tool to measure impulsivity in animal disease models, especially in the context of ADHD.
Collapse
Affiliation(s)
- Pitna Kim
- Center for Neuroscience Research, IBST and School of Medicine, Konkuk University, Seoul 143-701
| | | | | | | | | | | | | | | | | | | |
Collapse
|
5
|
Strain differences in self-administration of methylphenidate and sucrose pellets in a rat model of attention-deficit hyperactivity disorder. Behav Pharmacol 2013; 22:794-804. [PMID: 22015805 DOI: 10.1097/fbp.0b013e32834d623e] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
Despite its abuse potential, methylphenidate (MPH) is widely prescribed for treatment of attention-deficit hyperactivity disorder (ADHD). The purpose of the present study was to examine MPH self-administration in a rat model of ADHD. Experiment 1 examined the acquisition of MPH self-administration and assessed the MPH dose-effect curve in spontaneously hypertensive rats (SHR), an inbred rat model of ADHD, Wistar Kyotos (WKY), the progenitor strain for SHR, and Sprague-Dawley (SD), an outbred control strain. Experiment 2 replicated Experiment 1, but replaced MPH infusions with sucrose pellets. Initial acquisition of MPH self-administration was greater in SHR and SD than WKY. However, with extended training using an incrementing fixed ratio schedule SHR and WKY did not differ in responding for MPH using the training dose (0.3 mg/kg/infusion) or other unit doses, except that SHR showed greater responding than WKY at 0.1 mg/kg/infusion. SHR also showed greater acquisition and maintenance of sucrose-reinforced responding compared with both WKY and SD. Greater initial acquisition of MPH self-administration in SHR than WKY may not be due to a strain-specific difference in sensitivity to the reinforcing effect of MPH.
Collapse
|
6
|
Meneses A, Perez-Garcia G, Ponce-Lopez T, Tellez R, Gallegos-Cari A, Castillo C. Spontaneously hypertensive rat (SHR) as an animal model for ADHD: a short overview. Rev Neurosci 2011; 22:365-71. [DOI: 10.1515/rns.2011.024] [Citation(s) in RCA: 43] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
|
7
|
Pesek-Cotton EF, Johnson JE, Newland MC. Reinforcing behavioral variability: An analysis of dopamine-receptor subtypes and intermittent reinforcement. Pharmacol Biochem Behav 2011; 97:551-9. [DOI: 10.1016/j.pbb.2010.10.011] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/27/2009] [Revised: 10/26/2010] [Accepted: 10/27/2010] [Indexed: 10/18/2022]
|
8
|
Meneses A, Ponce-Lopez T, Tellez R, Gonzalez R, Castillo C, Gasbarri A. Effects of d-amphetamine on short- and long-term memory in spontaneously hypertensive, Wistar-Kyoto and Sprague-Dawley rats. Behav Brain Res 2010; 216:472-6. [PMID: 20813138 DOI: 10.1016/j.bbr.2010.08.035] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2010] [Revised: 08/15/2010] [Accepted: 08/20/2010] [Indexed: 12/15/2022]
Abstract
Diverse studies indicate that the attention deficit hyperactivity disorder (ADHD) is associated with alterations in encoding processes, including working or short-term memory. Some ADHD dysfunctional domains are reflected in the spontaneously hypertensive rat (SHR). Here SHR-saline group showed significantly poor STM and LTM relative to SD and WKY saline rats. SD and WKY rats treated with d-amphetamine displayed better STM and LTM, compared to SD-vehicle, WKY-vehicle or SHR-d-amphetamine groups.
Collapse
Affiliation(s)
- A Meneses
- Department of Pharmacobiology, CINVESTAV, Mexico City, Mexico.
| | | | | | | | | | | |
Collapse
|
9
|
Dissociation between spontaneously hypertensive (SHR) and Wistar-Kyoto (WKY) rats in baseline performance and methylphenidate response on measures of attention, impulsivity and hyperactivity in a Visual Stimulus Position Discrimination Task. Pharmacol Biochem Behav 2009; 94:374-9. [PMID: 19818805 DOI: 10.1016/j.pbb.2009.09.019] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/18/2008] [Revised: 09/16/2009] [Accepted: 09/24/2009] [Indexed: 11/20/2022]
Abstract
The spontaneously hypertensive rat (SHR) is a widely accepted rodent model of Attention Deficit/Hyperactivity Disorder (ADHD), and methylphenidate (MP) is a central nervous system stimulant that has been shown to have a dose-related positive effect on attention task performance in humans with ADHD. The current study was undertaken to compare SHR to its typical control strain, Wistar-Kyoto (WKY) rats, on the performance of a Visual Stimulus Position Discrimination Task (VSPDT) as well as of the responsiveness of the two rat strains to MP treatment. The rats were initially trained on the VSPDT, in which a light cue was presented randomly at three different cue-light intervals (1s, 300ms and 100ms) over one of two levers, and presses on the lever corresponding to the light cue were reinforced with a food pellet. Once rats reached stable performance, the treatment phase of the study began, during which they received daily intraperitoneal (IP) injections of saline, 2mg/kg, 5mg/kg, and 10mg/kg of MP in a randomized order immediately prior to being tested on the VSPDT. Baseline performance accuracy on the VSPDT did not differ between the groups. Furthermore, a striking strain dissociation was evident in the response of the two strains to treatment; VSPDT performance was substantially disrupted by the 5 and 10mg/kg dose in the WKY rats but only mildly in the SHR rats. Response omissions were also increased only in WKY rats. Finally, both strains had increased locomotor activity in the operant chamber following MP treatment. These findings point to an important difference in response tendency to MP in the two strains that supports a view that a critical difference between these strains may suggest neurochemical and neuroadaptive differences associated with the behavioral impairments of ADHD.
Collapse
|
10
|
Heal DJ, Cheetham SC, Smith SL. The neuropharmacology of ADHD drugs in vivo: insights on efficacy and safety. Neuropharmacology 2009; 57:608-18. [PMID: 19761781 DOI: 10.1016/j.neuropharm.2009.08.020] [Citation(s) in RCA: 145] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2009] [Revised: 07/15/2009] [Accepted: 08/11/2009] [Indexed: 11/19/2022]
Abstract
Results from in vivo techniques, especially intracerebral microdialysis in freely-moving rats, have provided insights into potential mechanisms responsible for the efficacy and safety of catecholaminergic drugs for ADHD treatment. The drugs reviewed come from distinct pharmacological classes: psychostimulant releasing agents, eg d-amphetamine; psychostimulant reuptake inhibitors, eg dl-threo-methylphenidate (dl-MPH), and non-stimulant reuptake inhibitors, eg atomoxetine. Psychostimulants, which currently deliver the best efficacy in treating ADHD, exhibit the following characteristics on extraneuronal catecholamine concentrations in rodent brain in vivo: 1) They enhance the efflux and function of both noradrenaline and dopamine in the central nervous system. 2) The increase of dopamine efflux that they produce is not limited to cortical regions. 3) They have a rapid onset of action with no ceiling on drug effect. d-Amphetamine has a mechanism independent of neuronal firing rate, displacing intraneuronal stores of catecholamines, delaying their reuptake and inhibiting catabolism by monoamine oxidase. dl-MPH has an enigmatic, extraneuronal action that is neuronal firing rate-dependent and reuptake transporter-mediated, yet paradoxically, almost as powerful as that of d-amphetamine. In safety terms, these powerful catecholaminergic effects also make the psychostimulants liable for abuse. Since efficacy and safety derive from the same pharmacological mechanisms, it has not yet been possible to separate these two components. However, the development of once-daily psychostimulant formulations and a prodrug, lisdexamfetamine, has improved patient compliance and markedly reduced scope for their diversion/abuse. This review will discuss the in vivo pharmacological profiles of approved catecholaminergic drugs for treatment of ADHD and implications for their clinical efficacy and abuse liability.
Collapse
Affiliation(s)
- D J Heal
- RenaSci Consultancy Ltd, BioCity, Nottingham NG1 1GF, UK.
| | | | | |
Collapse
|
11
|
New perspectives from microdialysis studies in freely-moving, spontaneously hypertensive rats on the pharmacology of drugs for the treatment of ADHD. Pharmacol Biochem Behav 2008; 90:184-97. [PMID: 18456311 DOI: 10.1016/j.pbb.2008.03.016] [Citation(s) in RCA: 85] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/04/2007] [Revised: 03/17/2008] [Accepted: 03/24/2008] [Indexed: 11/23/2022]
|
12
|
Discriminative control of variability: effects of successive stimulus reversals. Behav Processes 2007; 78:17-24. [PMID: 18191503 DOI: 10.1016/j.beproc.2007.11.007] [Citation(s) in RCA: 16] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2007] [Revised: 10/17/2007] [Accepted: 11/29/2007] [Indexed: 11/20/2022]
Abstract
A growing body of evidence suggests that behavioral variability can come under control of discriminative stimuli. The present experiment further examined discriminative control of variability in a novel way by using the discrimination-reversal paradigm. Eight pigeons responded under a multiple schedule of Vary and Yoke components signaled by different-colored keylights. In the Vary component, 4-response sequences that differed from the previous 10 produced food, while in the Yoke component, any 4-response sequence had a fixed probability of producing food, yoked to the prior Vary component. Following stability in this procedure, the key colors signaling the Vary and Yoke components were reversed across four successive conditions. Across the experiment, variability of keypeck sequences was higher in the Vary than in the Yoke component. Across successive reversals, the level of variability in the Vary component adapted more rapidly to the reversed contingencies, while the rate of adaptation in the Yoke component did not change systematically. These results are interpreted in terms of the different contingencies in the Vary and Yoke components. In addition, the improvement in the rate of adaptation across successive reversals in the Vary component appears consistent with a proactive interference account of discrimination-reversal performance. These results join others in suggesting that variability may be an operant dimension of behavior.
Collapse
|
13
|
Johansen EB, Killeen PR, Sagvolden T. Behavioral variability, elimination of responses, and delay-of-reinforcement gradients in SHR and WKY rats. Behav Brain Funct 2007; 3:60. [PMID: 18028539 PMCID: PMC2219961 DOI: 10.1186/1744-9081-3-60] [Citation(s) in RCA: 35] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2006] [Accepted: 11/20/2007] [Indexed: 12/03/2022] Open
Abstract
Background Attention-deficit/hyperactivity disorder (ADHD) is characterized by a pattern of inattention, hyperactivity, and impulsivity that is cross-situational, persistent, and produces social and academic impairment. Research has shown that reinforcement processes are altered in ADHD. The dynamic developmental theory has suggested that a steepened delay-of-reinforcement gradient and deficient extinction of behavior produce behavioral symptoms of ADHD and increased behavioral variability. Method The present study investigated behavioral variability and elimination of non-target responses during acquisition in an animal model of ADHD, the spontaneously hypertensive rat (SHR), using Wistar Kyoto (WKY) rats as controls. The study also aimed at providing a novel approach to measuring delay-of-reinforcement gradients in the SHR and the WKY strains. The animals were tested in a modified operant chamber presenting 20 response alternatives. Nose pokes in a target hole produced water according to fixed interval (FI) schedules of reinforcement, while nose pokes in the remaining 19 holes either had no consequences or produced a sound or a short flickering of the houselight. The stimulus-producing holes were included to test whether light and sound act as sensory reinforcers in SHR. Data from the first six sessions testing FI 1 s were used for calculation of the initial distribution of responses. Additionally, Euclidean distance (measured from the center of each hole to the center of the target hole) and entropy (a measure of variability) were also calculated. Delay-of-reinforcement gradients were calculated across sessions by dividing the fixed interval into epochs and determining how much reinforcement of responses in one epoch contributed to responding in the next interval. Results Over the initial six sessions, behavior became clustered around the target hole. There was greater initial variability in SHR behavior, and slower elimination of inefficient responses compared to the WKY. There was little or no differential use of the stimulus-producing holes by either strain. For SHR, the reach of reinforcement (the delay-of-reinforcement gradient) was restricted to the preceding one second, whereas for WKY it extended about four times as far. Conclusion The present findings support previous studies showing increased behavioral variability in SHR relative to WKY controls. A possibly related phenomenon may be the slowed elimination of non-operant nose pokes in SHR observed in the present study. The findings provide support for a steepened delay-of-reinforcement gradient in SHR as suggested in the dynamic developmental theory of ADHD. Altered reinforcement processes characterized by a steeper and shorter delay-of-reinforcement gradient may define an ADHD endophenotype.
Collapse
Affiliation(s)
- Espen B Johansen
- Department of Physiology, Institute of Basic Medical Sciences, University of Oslo, Oslo, Norway.
| | | | | |
Collapse
|
14
|
Ward RD, Bailey EM, Odum AL. Effects of D-amphetamine and ethanol on variable and repetitive key-peck sequences in pigeons. J Exp Anal Behav 2006; 86:285-305. [PMID: 17191754 PMCID: PMC1679968 DOI: 10.1901/jeab.2006.17-06] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2006] [Accepted: 07/10/2006] [Indexed: 10/23/2022]
Abstract
This experiment assessed the effects of d-amphetamine and ethanol on reinforced variable and repetitive key-peck sequences in pigeons. Pigeons responded on two keys under a multiple schedule of Repeat and Vary components. In the Repeat component, completion of a target sequence of right, right, left, left resulted in food. In the Vary component, 4-peck sequences differing from the previous 10 produced food. d-Amphetamine (0.1-3.0 mg/kg, i.m.) was administered in two separate phases, separated by ethanol administration (1.0-2.0 g/kg, i.g.). Under control conditions, measures of variability were high in the Vary component, and lower in the Repeat component. Following administration of the highest dose of d-amphetamine, but not ethanol, response rates decreased in both components. d-Amphetamine and ethanol tended to increase overall sequence variability in the Repeat component, and had less of an effect in the Vary component. Performance in the Repeat component during Phase 2 of d-amphetamine administration was more disrupted than during Phase 1. Measures of variability and repetition based on shifts in the relative frequency distributions of the 16 possible keypeck sequences differed from those based on the overall measure of variability, highlighting the importance of considering both molar and molecular measures when assessing the effects of drugs on reinforced variability and repetition. In addition, the shifts in the relative frequency distribution of response sequences suggest that d-amphetamine produced decrements in repeat performance by decreasing discriminative control within response sequences, whereas ethanol decreased repeat performance by decreasing discriminability between components as well as discriminative control within response sequences.
Collapse
|
15
|
Kinkead B, Selz KA, Owens MJ, Mandell AJ. Algorithmically designed peptides ameliorate behavioral defects in animal model of ADHD by an allosteric mechanism. J Neurosci Methods 2006; 151:68-81. [PMID: 16423408 DOI: 10.1016/j.jneumeth.2005.07.015] [Citation(s) in RCA: 15] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2005] [Revised: 07/22/2005] [Accepted: 07/22/2005] [Indexed: 10/25/2022]
Abstract
This study exemplifies the use of three ADHD-relevant methodological innovations. (1) The use of novel, patented, computational peptide design techniques to generate peptides targeting the extra-cellular and para-transmembrane amino acid loops of the putatively ADHD-involved, D(2) dopamine receptor, D(2)DAR; (2) experimental evidence that these peptides in L-amino acid/ortho ordered or D-amino acid/reverse ordered (retro-inverso), D(2)DAR, hydrophobic eigenmode matched forms, evoked positive allosteric and indirect agonist influences on in vitro stably receptor transfected CHO and LtK cells and on in vivo, brain mediated activity; (3) a representative 15 residue all-D-amino acid, D(2) mode matched peptide, given parenterally, was found to "repair" a key aberrant ADHD behavioral characteristic in a standard animal model of ADHD, the Spontaneously Hypertensive Rat, SHR, relative to its progenitor species control, the Wistar-Kyoto rat, WKY. The representative, retro-inverso peptide, all-D-LLYKNKPRYPKRNRE, reversed SHR's relative deficiency in sensory motor gating (pre-pulse inhibition, PPI) while leaving SHR's nonselective attention (rearings), impulsive behavior (time in center), and activity level (timed total motor behavior) unchanged. Amphetamine also reversed SHRs sensory gating defect, but with significant increases in nonselective attention, impulsivity and hyperactivity. These preliminary results suggest the possibility of a new, "softer" pharmacological approach to ADHD: hydrophobic mode matched peptide allosteric augmentation of the activity of indigenous dopamine with respect to D(2)DAR mediated function, in place of stimulant drug-induced presynaptic dopamine release or impairment of dopamine uptake.
Collapse
Affiliation(s)
- Becky Kinkead
- Laboratory of Neuropsychopharmacology, Department of Psychiatry and Behavioral Sciences, Emory University School of Medicine, Atlanta, GA 30322, USA
| | | | | | | |
Collapse
|
16
|
Neuringer A. Reinforced variability in animals and people: implications for adaptive action. ACTA ACUST UNITED AC 2005; 59:891-906. [PMID: 15584823 DOI: 10.1037/0003-066x.59.9.891] [Citation(s) in RCA: 70] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Although reinforcement often leads to repetitive, even stereotyped responding, that is not a necessary outcome. When it depends on variations, reinforcement results in responding that is diverse, novel, indeed unpredictable, with distributions sometimes approaching those of a random process. This article reviews evidence for the powerful and precise control by reinforcement over behavioral variability, evidence obtained from human and animal-model studies, and implications of such control. For example, reinforcement of variability facilitates learning of complex new responses, aids problem solving, and may contribute to creativity. Depression and autism are characterized by abnormally repetitive behaviors, but individuals afflicted with such psychopathologies can learn to vary their behaviors when reinforced for so doing. And reinforced variability may help to solve a basic puzzle concerning the nature of voluntary action.
Collapse
Affiliation(s)
- Allen Neuringer
- Department of Psychology, Reed College, Portland, OR 97202, USA.
| |
Collapse
|
17
|
Adriani W, Rea M, Baviera M, Invernizzi W, Carli M, Ghirardi O, Caprioli A, Laviola G. Acetyl-L-carnitine reduces impulsive behaviour in adolescent rats. Psychopharmacology (Berl) 2004; 176:296-304. [PMID: 15138763 DOI: 10.1007/s00213-004-1892-9] [Citation(s) in RCA: 41] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/17/2003] [Accepted: 03/21/2004] [Indexed: 12/01/2022]
Abstract
The attention deficit/hyperactivity disorder (ADHD) can affect human infants and adolescents. One important feature of this disorder is behavioural impulsivity. This study assessed the ability of chronic acetyl-L-carnitine (ALC, saline or 100 mg/kg SC, plus 50 mg/kg orally) to reduce impulsivity in a validated animal model for ADHD. Food-restricted rats were tested during adolescence (postnatal days, pnd, 30-45) in operant chambers with two nose-poking holes, one delivering one food pellet immediately, and the other five pellets after a delay. Delay length was increased over days (from 0 to 80 s). Individual differences in the preference-delay curve emerged, with the identification of two distinct subpopulations, i.e. one with a nearly horizontal curve and another with a very steep ("impulsive") slope. The impulsivity profile was slightly but consistently reduced by chronic ALC administration. Consistent results were also obtained with methylphenidate (MPH, saline or 3 mg/kg IP twice daily). Impulsive rats exhibited a lower metabolite/serotonin (5HIAA/5HT) ratio in the medial frontal cortex (MFC) and lower noradrenaline (NA) levels in the MFC and cingulate cortex (CC) when compared with the other subgroup. The ALC treatment increased NA levels in the CC and the 5HIAA/5HT ratio in both CC and MFC. Present data suggest that ALC, a drug devoid of psychostimulant properties, may have some beneficial effects in the treatment of ADHD children.
Collapse
Affiliation(s)
- Walter Adriani
- Behavioural Neuroscience Section, Dept. Cell Biology & Neurosciences, Istituto Superiore di Sanita', viale Regina Elena 299, 00161 Rome, Italy
| | | | | | | | | | | | | | | |
Collapse
|
18
|
Adriani W, Caprioli A, Granstrem O, Carli M, Laviola G. The spontaneously hypertensive-rat as an animal model of ADHD: evidence for impulsive and non-impulsive subpopulations. Neurosci Biobehav Rev 2004; 27:639-51. [PMID: 14624808 DOI: 10.1016/j.neubiorev.2003.08.007] [Citation(s) in RCA: 136] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
Attention-deficit hyperactivity disorder (ADHD) is a neuropsychiatric syndrome, affecting human infants and adolescents. Two main behavioural features are reported: (1). impaired attention and (2). an impulsive-hyperactive behavioural trait. The latter has been studied in a series of experiments, using the spontaneously hypertensive-rat (SHR) strain (which is regarded as a validated animal model for ADHD) in operant tasks. Food-restricted SHRs and their Wistar-Kyoto (WKY) controls were tested during adolescence (i.e. post-natal days 30-45), in operant chambers provided with two nose-poking holes. Nose-poking in one hole (H1) resulted in the immediate delivery of a small amount of food, whereas nose-poking in the other hole (H5) delivered a larger amount of food after a delay, which was increased progressively each day (0-100 s). As expected, all animals showed a shift in preference from the large (H5) to the immediate (H1) reinforcer as the delay length increased. Impulsivity can be measured by the steepness of this preference-delay curve. The two strains differed in home-cage circadian activity, SHRs being more active than WKYs at several time-points. During the test for impulsivity, inter-individual differences were completely absent in the WKY strain, whereas a huge inter-individual variability was evident for SHRs. On the basis of the median value of average hole-preference, we found an 'impulsive' SHR subgroup, with a very quick shift towards the H1 hole, and a flat-slope ('non-impulsive') SHR subgroup, with little or no shift. The impulsive subpopulation also presented reduced noradrenaline levels in both cingulated and medial-frontal cortex, as well as reduced serotonin turnover in the latter. Also, cannabinoid CB1 receptor density resulted significantly lower in the prefrontal cortex of impulsive SHRs, when compared to both the non-impulsive subgroup and control WKYs. Interestingly, acute administration of a cannabinoid agonist (WIN 55,212, 2 mg/kg s.c.) normalized the impulsive behavioural profile, without any effect on WKY rats. Thus, two distinct subpopulations, differing for impulsive behaviour and specific neurochemical parameters, were evidenced within adolescent SHRs. These results support the notion that a reduced cortical density of cannabinoid CB1 receptors is associated with enhanced impulsivity. This behavioural trait can be positively modulated by administration of a cannabinoid agonist. Present results confirm and extend previous literature, indicating that adolescent SHRs represent a suitable animal model for the preclinical investigation of the early-onset ADHD syndrome.
Collapse
Affiliation(s)
- Walter Adriani
- Department of Cell Biology and Neuroscience, Istituto Superiore di Sanita', viale Regina Elena 299, Roma I-00161, Italy
| | | | | | | | | |
Collapse
|
19
|
King JA, Tenney J, Rossi V, Colamussi L, Burdick S. Neural Substrates Underlying Impulsivity. Ann N Y Acad Sci 2003; 1008:160-9. [PMID: 14998882 DOI: 10.1196/annals.1301.017] [Citation(s) in RCA: 48] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Attention deficit hyperactivity disorder (ADHD) is a neuropsychiatric disorder whose three main symptoms are impulsiveness, inattention, and hyperactivity. Although ADHD is an early developmental disorder, it may persist into adulthood, resulting in deficits associated with poor academic performance, frequent job changes, poor and unstable marriages, and increases in motor vehicle accidents. Of the three primary symptoms of ADHD, deficits in impulse control are the most challenging to the social network and the judicial system. While the etiology of ADHD remains unknown, recent work suggests that the central deficits in ADHD may be due to poor response inhibition that is linked to monoamine and prefrontal lobe deficiencies. In the past, preclinical studies designed to understand the lack of impulse control have generally been relegated to studies linked to aggression and drug abuse. With the use of innovative noninvasive techniques, like anatomical and functional magnetic resonance imaging, selective neurochemical and behavioral paradigms have converged with preclinical reports and lend support to the premise that monoaminergic neurotransmitter systems and the cortico-striatal circuitry are essential to impulse control. Furthermore, new emerging data on neural substrates underlying impulsivity have incorporated brain regions involved in reinforcement, reward, and decision making such as the nucleus accumbens, cerebellum, and amygdala. As noninvasive brain imaging, neurochemical, and behavioral approaches are combined, our knowledge of the neural networks underlying impulsivity will hopefully give rise to therapeutic approaches aimed at alleviating this disorder.
Collapse
Affiliation(s)
- Jean A King
- Department of Psychiatry, Center for Comparative NeuroImaging, University of Massachusetts Medical School, 55 Lake Avenue North, Worcester, MA 01655, USA.
| | | | | | | | | |
Collapse
|
20
|
Abstract
Although responses are sometimes easy to predict, at other times responding seems highly variable, unpredictable, or even random. The inability to predict is generally attributed to ignorance of controlling variables, but this article is a review of research showing that the highest levels of behavioral variability may result from identifiable reinforcers contingent on such variability. That is, variability is an operant. Discriminative stimuli and reinforcers control it, resulting in low or high variability, depending on the contingencies. Schedule-of-reinforcement effects are orderly, and choosing to vary or repeat is lawfully governed by relative reinforcement frequencies. The operant nature of variability has important implications. For example, learning, exploring, creating, and problem solving may partly depend on it. Abnormal levels of variability, including those found in psychopathologies such as autism, depression, and attention deficit hyperactivity disorder, may be modified through reinforcement. Operant variability may also help to explain some of the unique attributes of voluntary action.
Collapse
|
21
|
King JA, Kelly TA, Delville Y. Adult levels of testosterone alter catecholamine innervation in an animal model of attention-deficit hyperactivity disorder. Neuropsychobiology 2001; 42:163-8. [PMID: 11096329 DOI: 10.1159/000026687] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Abstract
The spontaneously hypertensive rat (SHR) has been used as an animal model of attention-deficit hyperactivity disorder (ADHD). This disorder, which is most prevalent in males during childhood, persists in adulthood more frequently in females. Since other work has shown that neonatal testosterone levels may be a contributing factor in the expression of ADHD-like behavior, the present study was designed to determine whether androgen levels also altered the neurobiology of adult SHRs compared to Wistar (WKY) controls. Males castrated on postnatal day 45 were implanted with testosterone, and the density of tyrosine-hydroxylase-immunoreactive (TH-ir) fibers (an indicator of catecholamine innervation) in the frontal cortex was compared between animals. The data show that testosterone-treated SHRs were associated with higher levels of TH immunoreactivity in the frontal cortex and hippocampus than WKY rats. These results may explain why high circulating levels of testosterone during adulthood do not support an increase in ADHD-like behavior in both the animal model and human males.
Collapse
Affiliation(s)
- J A King
- Behavioral Neuroscience Program, Department of Psychiatry, University of Massachusetts Medical School, Worcester, Mass., USA.
| | | | | |
Collapse
|
22
|
Paule MG, Rowland AS, Ferguson SA, Chelonis JJ, Tannock R, Swanson JM, Castellanos FX. Attention deficit/hyperactivity disorder: characteristics, interventions and models. Neurotoxicol Teratol 2000; 22:631-51. [PMID: 11106857 DOI: 10.1016/s0892-0362(00)00095-7] [Citation(s) in RCA: 88] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
An epidemiological study of Attention Deficit/Hyperactivity Disorder (ADHD) suggests that the prevalence may be two to three times higher than the figure of 3-5% often cited. In addition, the data suggest that both underdiagnosis and overdiagnosis occur frequently. Rodent animal models of ADHD, like the Spontaneously Hypertensive Rat (SHR) and other rat models such as those with chemical and radiation-induced brain lesions and cerebellar stunting, and the Coloboma mouse model exhibit clear similarities with several aspects of the human disorder and should prove useful in studying specific traits. Operant behavioral tasks that model learning, short-term memory and simple discriminations are sensitive to ADHD and methylphenidate has been shown to normalize ADHD performance in a short-term memory task. Recent findings challenge not only the current postulate that response inhibition is a unique deficit in ADHD, but also the concepts of ADHD and its treatment, which presume intact perceptual abilities. Time perception deficits may account, in part, for the excessive variability in motor response times on speeded reaction time tasks, motor control problems and motor clumsiness associated with ADHD. The Multimodality Treatment Study of ADHD (MTA) provided data suggesting that pharmacological interventions that included systematic and frequent follow-up with parents and teachers, with or without psychosocial interventions, are superior to psychosocial interventions or standard community care alone. Additionally, the MTA was one of the first studies to demonstrate benefits of multimodal and pharmacological interventions lasting longer than 1 year. Imaging studies have demonstrated differences in brain areas in children with ADHD: anterior corpus callosum, right anterior white matter, and cerebellar volumes are all decreased in children with ADHD and there is less brain asymmetry in ADHD subjects. Additionally, functional imaging studies, coupled with pharmacological manipulations, suggest decreased blood flow and energy utilization in prefrontal cortex and striatum and the dysregulation of catecholamine systems in persons with ADHD.
Collapse
Affiliation(s)
- M G Paule
- Behavioral Toxicology Laboratory, Division of Neurotoxicology, HFT-132, National Center for Toxicological Research, 3900 NCTR Road, Jefferson, AR 72079-9502, USA.
| | | | | | | | | | | | | |
Collapse
|
23
|
King JA, Barkley RA, Delville Y, Ferris CF. Early androgen treatment decreases cognitive function and catecholamine innervation in an animal model of ADHD. Behav Brain Res 2000; 107:35-43. [PMID: 10628728 DOI: 10.1016/s0166-4328(99)00113-8] [Citation(s) in RCA: 59] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Abstract
The spontaneously hypertensive rat (SHR) has been used as an animal model of attention deficit hyperactivity disorder (ADHD). The present study was designed to determine whether exposure to elevated androgen levels early in development demonstrated impairments in cognitive functioning, neuroendocrine control, and brain development parallel to those seen in ADHD children. The animals (SHR and Wistar (WKY) controls) were implanted with testosterone on postnatal day 10 and tested for behavior in a spatial cognition paradigm on postnatal day 45. Plasma samples were collected for determination of adrenocorticotrophin hormone (ACTH) and corticosterone levels as indicators of the basal tone of the pituitary-adrenal neuroendocrine axis. In addition, the density of tyrosine hydroxylase-immunoreactive fibers (an indicator of catecholamine innervation) in the frontal cortex was compared between animals. The current data show that early testosterone treatment in SHR animals resulted in additional deficits in spatial memory in the water maze, but was ineffective in altering the response of WKY animals. Furthermore, SHR rats had high basal ACTH and low corticosterone levels that may indicate a dysfunctional stress axis similar to other reports in humans with persistent ADHD. Finally, there was a further suppression of tyrosine hydroxylase-immunoreactivity in the frontal cortex of androgen-treated SHR rats. These results support the hypothesis that early androgen treatment may support the neurobiology of animals with genetic predisposition to hyperactivity, impulsivity and inattention in a manner consistent with the enhanced expression of ADHD-like behaviors.
Collapse
Affiliation(s)
- J A King
- Department of Psychiatry, University of Massachusetts Medical School, Worcester 01655, USA.
| | | | | | | |
Collapse
|
24
|
Saldana L, Neuringer A. Is instrumental variability abnormally high in children exhibiting ADHD and aggressive behavior? Behav Brain Res 1998; 94:51-9. [PMID: 9708839 DOI: 10.1016/s0166-4328(97)00169-1] [Citation(s) in RCA: 23] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
To test whether instrumental behavior of some children with attention deficit hyperactivity disorder (ADHD) is more variable than control subjects, the sequences of responses by three groups of children were compared: (i) those diagnosed with ADHD who lived in a residential treatment facility for children demonstrating aggressive behavior; (ii) age-matched children from the same facility who did not have an ADHD diagnosis but who had also demonstrated abnormal levels of aggression; and (iii) normal children from a local school. The experiment consisted of rewarding children for responding in a computer 'game' on two keys of a keyboard during each of three phases. In phase 1, rewards were provided independently of sequence variability (IND). In phase 2, rewards depended upon highly variable sequences of left and right responses. Phase 3 was a return to the IND contingencies. The results showed that sequence variability was higher in the sequence variability (VARY) phase than in the preceding IND phase, but remained high when the contingencies returned to IND, thus replicating previous findings. In none of the phases did the ADHD children respond more variably than the controls. However, ADHD subjects made more off-task responses than did controls. Thus, although the present research showed differences between ADHD and control subjects, there was no evidence to support higher behavioral variability in the ADHD subjects.
Collapse
Affiliation(s)
- L Saldana
- Department of Psychology, Reed College, Portland, OR 97202, USA
| | | |
Collapse
|
25
|
Abstract
Converging insights into attention-deficit/hyperactivity disorder (ADHD) support the notion that ADHD is best characterized behaviorally as a disorder of self-regulation or executive functioning. Anatomic neuroimaging studies suggest that the relevant regulatory circuits include the prefrontal cortex and the basal ganglia, which are modulated by dopaminergic innervation from the midbrain and by stimulant medications. The emerging model proposed in this review encompasses a developmental perspective into this common condition.
Collapse
Affiliation(s)
- F X Castellanos
- Child Psychiatry Branch, National Institute of Mental Health (NIMH), Bethesda, MD, USA
| |
Collapse
|
26
|
Hunziker MH, Saldana RL, Neuringer A. Behavioral variability in SHR and WKY rats as a function of rearing environment and reinforcement contingency. J Exp Anal Behav 1996; 65:129-44. [PMID: 8583193 PMCID: PMC1350067 DOI: 10.1901/jeab.1996.65-129] [Citation(s) in RCA: 46] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/31/2023]
Abstract
The spontaneously hypertensive rat (SHR) may model aspects of human attention deficit hyperactivity disorder (ADHD). For example, just as responses by children with ADHD tend to be variable, so too SHRs often respond more variably than do Wistar-Kyoto (WKY) control rats. The present study asked whether behavioral variability in the SHR strain is influenced by rearing environment, a question related to hypotheses concerning the etiology of human ADHD. Some rats from each strain were reared in an enriched environment (housed socially), and others were reared in an impoverished environment (housed in isolation). Four groups--enriched SHR, impoverished SHR, enriched WKY, and impoverished WKY--were studied under two reinforcement contingencies, one in which reinforcement was independent of response variability and the other in which reinforcement depended upon high variability. The main finding was that rearing environment did not influence response variability (enriched and impoverished subjects responded similarly throughout). However, rearing environment affected body weight (enriched subjects weighted more than impoverished subjects) and response rate (impoverished subjects generally responded faster than enriched subjects). In addition, SHRs tended to respond variably throughout the experiment, whereas WKYs were more sensitive to the variability contingencies. Thus, behavioral variability was affected by genetic strain and by reinforcement contingency but not by the environment in which the subjects were reared.
Collapse
Affiliation(s)
- M H Hunziker
- Departamento de Psicologia Experimental, Universidade de São Paulo, Brazil
| | | | | |
Collapse
|