1
|
Killeen PR. Theory of reinforcement schedules. J Exp Anal Behav 2023; 120:289-319. [PMID: 37706228 DOI: 10.1002/jeab.880] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Accepted: 08/04/2023] [Indexed: 09/15/2023]
Abstract
The three principles of reinforcement are (1) events such as incentives and reinforcers increase the activity of an organism; (2) that activity is bounded by competition from other responses; and (3) animals approach incentives and their signs, guided by their temporal and physical conditions, together called the "contingencies of reinforcement." Mathematical models of each of these principles comprised mathematical principles of reinforcement (MPR; Killeen, 1994). Over the ensuing decades, MPR was extended to new experimental contexts. This article reviews the basic theory and its extensions to satiation, warm-up, extinction, sign tracking, pausing, and sequential control in progressive-ratio and multiple schedules. In the latter cases, a single equation balancing target and competing responses governs behavioral contrast and behavioral momentum. Momentum is intrinsic in the fundamental equations, as behavior unspools more slowly from highly aroused responses conditioned by higher rates of incitement than it does from responses from leaner contexts. Habits are responses that have accrued substantial behavioral momentum. Operant responses, being predictors of reinforcement, are approached by making them: The sight and feel of a paw on a lever is approached by placing paw on lever, as attempted for any sign of reinforcement. Behavior in concurrent schedules is governed by approach to momentarily richer patches (melioration). Applications of MPR in behavioral pharmacology and delay discounting are noted.
Collapse
|
2
|
Olarte-Sánchez CM, Valencia-Torres L, Cassaday HJ, Bradshaw CM, Szabadi E. Quantitative analysis of performance on a progressive-ratio schedule: effects of reinforcer type, food deprivation and acute treatment with Δ⁹-tetrahydrocannabinol (THC). Behav Processes 2015; 113:122-31. [PMID: 25637881 PMCID: PMC4534516 DOI: 10.1016/j.beproc.2015.01.014] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2014] [Revised: 01/26/2015] [Accepted: 01/26/2015] [Indexed: 12/27/2022]
Abstract
Rats' performance on a progressive-ratio schedule maintained by sucrose (0.6M, 50 μl) and corn oil (100%, 25 μl) reinforcers was assessed using a model derived from Killeen's (1994) theory of schedule-controlled behaviour, 'Mathematical Principles of Reinforcement'. When the rats were maintained at 80% of their free-feeding body weights, the parameter expressing incentive value, a, was greater for the corn oil than for the sucrose reinforcer; the response-time parameter, δ, did not differ between the reinforcer types, but a parameter derived from the linear waiting principle (T0), indicated that the minimum post-reinforcement pause was longer for corn oil than for sucrose. When the rats were maintained under free-feeding conditions, a was reduced, indicating a reduction of incentive value, but δ was unaltered. Under the food-deprived condition, the CB1 cannabinoid receptor agonist Δ(9)-tetrahydrocannabinol (THC: 0.3, 1 and 3 mg kg(-1)) increased the value of a for sucrose but not for corn oil, suggesting a selective enhancement of the incentive value of sucrose; none of the other parameters was affected by THC. The results provide new information about the sensitivity of the model's parameters to deprivation and reinforcer quality, and suggest that THC selectively enhances the incentive value of sucrose.
Collapse
Affiliation(s)
- C M Olarte-Sánchez
- Psychopharmacology Section, Division of Psychiatry, University of Nottingham, UK.
| | - L Valencia-Torres
- Psychopharmacology Section, Division of Psychiatry, University of Nottingham, UK.
| | - H J Cassaday
- School of Psychology, University of Nottingham, UK.
| | - C M Bradshaw
- Psychopharmacology Section, Division of Psychiatry, University of Nottingham, UK.
| | - E Szabadi
- Psychopharmacology Section, Division of Psychiatry, University of Nottingham, UK.
| |
Collapse
|
3
|
Valencia-Torres L, Bradshaw CM, Bouzas A, Hong E, Orduña V. Effect of streptozotocin-induced diabetes on performance on a progressive ratio schedule. Psychopharmacology (Berl) 2014; 231:2375-84. [PMID: 24402135 DOI: 10.1007/s00213-013-3401-5] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/08/2013] [Accepted: 12/02/2013] [Indexed: 12/29/2022]
Abstract
RATIONALE It has been suggested that streptozotocin (STZ)-induced diabetes causes a motivational deficit in rodents. However, some of the evidence adduced in support of this suggestion may be interpreted in terms of a motor impairment rather than a motivational deficit. OBJECTIVE This experiment examined the effect of STZ-induced diabetes on performance on a progressive ratio schedule. The data were analysed using a new model derived from Killeen's (Behav Brain Sci 17:105-172, 1994) Mathematical Principles of Reinforcement model which enables the effects of interventions on motivation or incentive value to be separated from effects on motor function. METHOD Animals were trained under a progressive ratio schedule using food-pellet reinforcement. Then they received a single intraperitoneal injection of 50 mg/kg of STZ or the vehicle. Training continued for 30 sessions after treatment. Running and overall response rates in successive ratios were analysed using the new model, and estimates of the model's parameters were compared between groups. RESULTS The parameter expressing incentive value was reduced in the group treated with STZ, whereas the parameters expressing motor capacity and post-reinforcement pausing were not affected by the treatment. Blood glucose concentration was significantly elevated in the STZ-treated group compared to the vehicle-treated group. CONCLUSIONS The results are consistent with the suggestion that STZ-induced diabetes is associated with a reduction of the incentive value of food.
Collapse
|
4
|
Mathes CM, Gregson JR, Spector AC. The selective serotonin reuptake inhibitor paroxetine decreases breakpoint of rats engaging in a progressive ratio licking task for sucrose and quinine solutions. Chem Senses 2012; 38:211-20. [PMID: 23254343 DOI: 10.1093/chemse/bjs096] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Increased serotonergic activity has been shown to reduce motivation to ingest, which may involve, in part, gustatory processes. Here, we examined the effect of paroxetine, a selective serotonin reuptake inhibitor, on appetitive responding for a preferred and an avoided taste solution using a progressive ratio (PR) task in which licking was employed as the operant. Male Sprague-Dawley rats (n = 8/taste stimulus) were trained to respond for a concentration series of sucrose or quinine on fixed and PR schedules of reinforcement. Performance for sucrose was assessed while the rats were partially food- and water-restricted and nondeprived, and performance for water and quinine was assessed while the rats were water-deprived. Then, the rats were injected with vehicle (10% dimethyl sulfoxide, 1mL/kg intraperitoneal [ip], -1h) or paroxetine (5mg/kg), and their responding on a PR schedule for sucrose measured when the rats were nondeprived or for water and quinine when the rats were water-deprived. Paroxetine decreased breakpoint, which was defined as the number of operant (e.g., dry) licks in the final reinforced ratio, for water, quinine, and sucrose. This demonstrates that a general systemic increase in serotonergic activity decreases the appetitive-based responses to both preferred and nonpreferred fluids under different deprivation states.
Collapse
Affiliation(s)
- Clare M Mathes
- Department of Psychology, Florida State University, Tallahassee, FL 32306-4301, USA.
| | | | | |
Collapse
|
5
|
den Boon FS, Body S, Hampson CL, Bradshaw CM, Szabadi E, de Bruin N. Effects of amisulpride and aripiprazole on progressive-ratio schedule performance: comparison with clozapine and haloperidol. J Psychopharmacol 2012; 26:1231-43. [PMID: 21969105 DOI: 10.1177/0269881111421974] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
Abstract
Clozapine and some other atypical antipsychotics (e.g. quetiapine, olanzapine) have been found to exert a characteristic profile of action on operant behaviour maintained by progressive-ratio schedules, as revealed by Killeen's Mathematical Principles of Reinforcement model of schedule-controlled behaviour. These drugs increase the value of a parameter that expresses the 'incentive value' of the reinforcer (a) and a parameter that is inversely related to the organism's 'motor capacity' (δ). This experiment examined the effects of two further atypical antipsychotics, aripiprazole and amisulpride, on progressive-ratio schedule performance in rats; the effects of clozapine and a conventional antipsychotic, haloperidol, were also examined. In agreement with previous findings, clozapine (4, 8 mg kg⁻¹) increased a and δ, whereas haloperidol (0.05, 0.1 mg kg⁻¹) reduced a and increased δ. Aripiprazole (3,30 mg kg⁻¹) increased δ but did not affect a. Amisulpride (5, 50 mg kg⁻¹) had a delayed and protracted effect: δ was increased 3-6 hours after treatment; a was increased 1.5 hours, and reduced 12-24 hours after treatment. Interpretation based on Killeen's model suggests that aripiprazole does not share clozapine's ability to enhance reinforcer value. Amisulpride produced a short-lived enhancement, followed by a long-lasting reduction, of reinforcer value. Both drugs impaired motor performance.
Collapse
Affiliation(s)
- F S den Boon
- Psychopharmacology Section, Division of Psychiatry, University of Nottingham, Nottingham, UK
| | | | | | | | | | | |
Collapse
|
6
|
Phenylpiperazine derivatives with selectivity for dopamine D3 receptors modulate cocaine self-administration in rats. Neuropharmacology 2012; 63:1346-59. [PMID: 22960444 DOI: 10.1016/j.neuropharm.2012.08.011] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2012] [Revised: 07/30/2012] [Accepted: 08/15/2012] [Indexed: 11/24/2022]
Abstract
This study examined cocaine self-administration after pretreatments with three structurally related compounds that bind selectively to dopamine D3 receptors (D3Rs) relative to the D2 receptor subtype (D2Rs) and exhibit varying intrinsic activities in the forskolin-stimulated adenylyl cyclase assay. The compounds are: a) WC10, a D3R weak partial agonist/antagonist with 42-fold D3R:D2R selectivity, b) WC26, a 51-fold selective D3R partial agonist, c) WC44, a 23-fold selective D3R agonist. Rats were stabilized on a multiple variable-interval 60-s (VI60) schedule with alternating components of sucrose (45 mg pellets) or cocaine reinforcement (0.375 mg/kg, IV) and then tested for effects of the WC compounds (0.0, 1.0, 3.0, 5.6, or 10.0 mg/kg, IP). Another cohort was trained to self-administer cocaine (0.75 mg/kg, IV) on a VI60 schedule then tested with various doses of cocaine available (0.0-1.5 mg/kg, IV) following pretreatment with WC10 (5.6 or 10.0 mg/kg) or WC44 (10.0 mg/kg). WC10 and WC26 decreased both cocaine and sucrose reinforcement rates at the 10.0 mg/kg dose, whereas WC44 decreased only cocaine reinforcement rate at this dose. Furthermore, WC26 and WC44 increased response latency for cocaine but not sucrose. In the cocaine dose-response experiment, WC10 and WC44 flattened the dose-effect function of cocaine reinforcement rate. All compounds decreased spontaneous locomotion. WC10 and WC26 also reduced cocaine-induced locomotion. These results support the targeting of D3Rs for treatments for cocaine dependence. WC26 and WC44, in particular, show promise as they increased the latency to respond for cocaine but not sucrose, suggesting selective reduction of the motivation for cocaine.
Collapse
|
7
|
Bradshaw CM, Killeen PR. A theory of behaviour on progressive ratio schedules, with applications in behavioural pharmacology. Psychopharmacology (Berl) 2012; 222:549-64. [PMID: 22752382 DOI: 10.1007/s00213-012-2771-4] [Citation(s) in RCA: 58] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/16/2012] [Accepted: 06/03/2012] [Indexed: 10/28/2022]
Abstract
RATIONALE Mathematical principles of reinforcement (MPR) provide the theoretical basis for a family of models of schedule-controlled behaviour. A model of fixed-ratio schedule performance that was applied to behaviour on progressive ratio (PR) schedules showed systematic departures from the data. OBJECTIVE This study aims to derive a new model from MPR that will account for overall and running response rates in the component ratios of PR schedules, and their decline toward 0, the breakpoint. METHOD The role of pausing is represented in a real-time model containing four parameters: T (0) and k are the intercept and slope of the linear relation between post-reinforcement pause duration and the prior inter-reinforcer interval; a (specific activation) measures the incentive value of the reinforcer; δ (response time) sets biomechanical limits on response rate. Running rate is predicted to decrease with negative acceleration as ratio size increments, overall rate to increase and then decrease. Differences due to type of progression are explained as hysteresis in the control by reinforcement rates. Re-analysis of extant data focuses on the effects of acute treatment with antipsychotic drugs, lesions of the nucleus accumbens core, and destruction of orexinergic neurones of the lateral hypothalamus. RESULTS The new model resolves some anomalies evident in earlier analyses, and provides new insights to the results of these interventions. CONCLUSIONS Because they can render biologically relevant parameters, mathematical models can provide greater power in interpreting the effects of interventions on the processes underlying schedule-controlled behaviour than is possible for first-order data such as the breakpoint.
Collapse
Affiliation(s)
- C M Bradshaw
- Division of Psychiatry University of Nottingham B109 Medical School, University of Nottingham, Nottingham NG7 2UH, UK.
| | | |
Collapse
|
8
|
Olarte-Sánchez CM, Valencia Torres L, Body S, Cassaday HJ, Bradshaw CM, Szabadi E, Goudie AJ. A clozapine-like effect of cyproheptadine on progressive ratio schedule performance. J Psychopharmacol 2012; 26:857-70. [PMID: 21890589 DOI: 10.1177/0269881111408961] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
Abstract
The atypical antipsychotic drug clozapine has multiple pharmacological actions, some of which, including 5-hydroxytryptamine (5-HT₂) and histamine (H₁) receptor antagonist effects, are shared by the non-selective 5-HT receptor antagonist cyproheptadine. Atypical antipsychotics have a characteristic profile of action on operant behaviour maintained by progressive ratio schedules, as revealed by Killeen's (1994) mathematical model of schedule controlled behaviour. These drugs increase the values of a parameter that expresses the 'incentive value' of the reinforcer (a) and a parameter that is inversely related to the 'motor capacity' of the organism (δ). This experiment examined the effects of acute treatment with cyproheptadine and clozapine on performance on a progressive ratio schedule of food reinforcement in rats; the effects of a conventional antipsychotic, haloperidol, and two drugs with food intake-enhancing effects, chlordiazepoxide and Δ⁹-tetrahydrocannabinol (THC), were also examined. Cyproheptadine (1, 5 mg kg⁻¹) and clozapine (3.75, 7.5 mg kg⁻¹) increased a and δ. Haloperidol (0.05, 0.1 mg kg⁻¹) reduced a and increased δ. Chlordiazepoxide (3, 10 mg kg⁻¹) increased a but reduced δ. THC (1, 3 mg kg⁻¹) had no effect. Interpretation based on Killeen's (1994) model suggests that cyproheptadine and clozapine enhanced the incentive value of the reinforcer and impaired motor performance. Motor impairment may be due to sedation (possibly reflecting H₁ receptor blockade). Enhancement of incentive value may reflect simultaneous blockade of H₁ and 5-HT₂ receptors, which has been proposed as the mechanism underlying the food intake-enhancing effect of cyproheptadine. In agreement with previous findings, haloperidol impaired motor performance and reduced the incentive value of the reinforcer. Chlordiazepoxide's effect on a is consistent with its food intake-enhancing effect.
Collapse
Affiliation(s)
- C M Olarte-Sánchez
- Psychopharmacology Section, Division of Psychiatry, University of Nottingham, Nottingham, UK
| | | | | | | | | | | | | |
Collapse
|
9
|
Olarte-Sánchez CM, Valencia Torres L, Body S, Cassaday HJ, Bradshaw CM, Szabadi E. Effect of orexin-B-saporin-induced lesions of the lateral hypothalamus on performance on a progressive ratio schedule. J Psychopharmacol 2012; 26:871-86. [PMID: 21926428 DOI: 10.1177/0269881111409607] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
It has been suggested that a sub-population of orexinergic neurones whose somata lie in the lateral hypothalamic area (LHA) play an important role in regulating the reinforcing value of both food and drugs. This experiment examined the effect of disruption of orexinergic mechanisms in the LHA on performance on the progressive ratio schedule of reinforcement, in which the response requirement increases progressively for successive reinforcers. The data were analysed using a mathematical model which yields a quantitative index of reinforcer value and dissociates effects of interventions on motor and motivational processes. Rats were trained under a progressive ratio schedule using food-pellet reinforcement. They received bilateral injections of conjugated orexin-B-saporin (OxSap) into the LHA or sham lesions. Training continued for a further 40 sessions after surgery. Equations were fitted to the response rate data from each rat, and the parameters of the model were derived for successive blocks of 10 sessions. The OxSap lesion reduced the number of orexin-containing neurones in the LHA by approximately 50% compared with the sham-lesioned group. The parameter expressing the incentive value of the reinforcer was not significantly altered by the lesion. However, the parameter related to the maximum response rate was significantly affected, suggesting that motor capacity was diminished in the OxSap-lesioned group. The results indicate that OxSap lesions of the LHA disrupted food-reinforced responding on the progressive ratio schedule. It is suggested that this disruption was brought about by a change in non-motivational (motor) processes.
Collapse
Affiliation(s)
- C M Olarte-Sánchez
- Psychopharmacology Section, Division of Psychiatry, University of Nottingham, Nottingham, UK
| | | | | | | | | | | |
Collapse
|
10
|
Killeen PR, Posadas-Sanchez D, Johansen EB, Thrailkill EA. Progressive ratio schedules of reinforcement. ACTA ACUST UNITED AC 2009; 35:35-50. [PMID: 19159161 DOI: 10.1037/a0012497] [Citation(s) in RCA: 50] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Pigeons' pecks produced grain under progressive ratio (PR) schedules, whose response requirements increased systematically within sessions. Experiment 1 compared arithmetic (AP) and geometric (GP) progressions. Response rates increased as a function of the component ratio requirement, then decreased linearly (AP) or asymptotically (GP). Experiment 2 found the linear decrease in AP rates to be relatively independent of step size. Experiment 3 showed pausing to be controlled by the prior component length, which predicted the differences between PR and regressive ratio schedules found in Experiment 4. When the longest component ratios were signaled by different key colors, rates at moderate ratios increased, demonstrating control by forthcoming context. Models for response rate and pause duration based on Bizo and Killeen (1997) described performance on AP schedules; GP schedules required an additional parameter representing the contextual reinforcement.
Collapse
Affiliation(s)
- Peter R Killeen
- Department of Psychology, Arizona State University, Tempe, AZ 85287-1104, USA.
| | | | | | | |
Collapse
|
11
|
Rickard J, Body S, Zhang Z, Bradshaw C, Szabadi E. Effect of reinforcer magnitude on performance maintained by progressive-ratio schedules. J Exp Anal Behav 2009; 91:75-87. [PMID: 19230513 PMCID: PMC2614819 DOI: 10.1901/jeab.2009.91-75] [Citation(s) in RCA: 43] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2008] [Accepted: 09/23/2008] [Indexed: 11/22/2022]
Abstract
This experiment examined the relationship between reinforcer magnitude and quantitative measures of performance on progressive-ratio schedules. Fifteen rats were trained under a progressive-ratio schedule in seven phases of the experiment in which the volume of a 0.6-M sucrose solution reinforcer was varied within the range 6-300 microl. Overall response rates in successive ratios conformed to a bitonic equation derived from Killeen's (1994) Mathematical Principles of Reinforcement. The "specific activation" parameter, a, which is presumed to reflect the incentive value of the reinforcer, was a monotonically increasing function of reinforcer volume; the "response time" parameter, delta, which defines the minimum response time, increased as a function of reinforcer volume; the "currency" parameter, beta, which is presumed to reflect the coupling of responses to the reinforcer, declined as a function of volume. Running response rate (response rate calculated after exclusion of the postreinforcement pause) decayed monotonically as a function of ratio size; the index of curvature of this function increased as a function of reinforcer volume. Postreinforcement pause increased as a function of ratio size. Estimates of a derived from overall response rates and postreinforcement pauses showed a modest positive correlation across conditions and between animals. Implications of the results for the quantification of reinforcer value and for the use of progressive-ratio schedules in behavioral neuroscience are discussed.
Collapse
|
12
|
Bezzina G, Boon FD, Hampson C, Cheung T, Body S, Bradshaw C, Szabadi E, Anderson I, Deakin J. Effect of quinolinic acid-induced lesions of the subthalamic nucleus on performance on a progressive-ratio schedule of reinforcement: a quantitative analysis. Behav Brain Res 2008; 195:223-30. [PMID: 18840473 PMCID: PMC3098367 DOI: 10.1016/j.bbr.2008.09.005] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2008] [Revised: 09/05/2008] [Accepted: 09/10/2008] [Indexed: 12/01/2022]
Abstract
UNLABELLED The subthalamic nucleus (STN), a major relay in the indirect striatofugal pathway, plays an important role in extrapyramidal motor control. Recent evidence indicates that it may also be involved in regulating the incentive value of food reinforcers. OBJECTIVE To examine the effect of lesions of the STN on performance on a progressive-ratio schedule using a quantitative model that dissociates effects of interventions on motor and motivational processes [Killeen PR. Mathematical principles of reinforcement. Behav Brain Sci 1994;17:105-72]. Rats with bilateral quinolinic acid-induced lesions of the STN (n=14) or sham lesions (n=14) were trained to press a lever for food-pellet reinforcers under a progressive-ratio schedule. In Phase 1 (90 sessions) the reinforcer was one pellet; in Phase 2 (30 sessions) it was two pellets; in Phase 3 (30 sessions) it was again one pellet. RESULTS The performance of both groups conformed to the model of progressive-ratio schedule performance. The motor parameter, delta, was significantly higher in the STN-lesioned than the sham-lesioned group, reflecting lower overall response rates in the lesioned group. The motivational parameter, a, was significantly higher in the STN-lesioned group than in the sham-lesioned group, consistent with enhanced reinforcer value in the STN-lesioned group compared to the sham-lesioned group. In both groups, a was sensitive to changes in reinforcer size, being significantly greater under the two-pellet condition (Phase 2) than under the one-pellet condition (Phases 1 and 3). The results suggest that destruction of the STN impairs response capacity and enhances the incentive value of food reinforcers.
Collapse
Affiliation(s)
- G. Bezzina
- Psychopharmacology Section, Division of Psychiatry, University of Nottingham, Room B109, Medical School, Queen’s Medical Centre, Nottingham NG7 2UH, UK
| | - F.S. den Boon
- Psychopharmacology Section, Division of Psychiatry, University of Nottingham, Room B109, Medical School, Queen’s Medical Centre, Nottingham NG7 2UH, UK
| | - C.L. Hampson
- Psychopharmacology Section, Division of Psychiatry, University of Nottingham, Room B109, Medical School, Queen’s Medical Centre, Nottingham NG7 2UH, UK
| | - T.H.C. Cheung
- Psychopharmacology Section, Division of Psychiatry, University of Nottingham, Room B109, Medical School, Queen’s Medical Centre, Nottingham NG7 2UH, UK
| | - S. Body
- Psychopharmacology Section, Division of Psychiatry, University of Nottingham, Room B109, Medical School, Queen’s Medical Centre, Nottingham NG7 2UH, UK
| | - C.M. Bradshaw
- Psychopharmacology Section, Division of Psychiatry, University of Nottingham, Room B109, Medical School, Queen’s Medical Centre, Nottingham NG7 2UH, UK
| | - E. Szabadi
- Psychopharmacology Section, Division of Psychiatry, University of Nottingham, Room B109, Medical School, Queen’s Medical Centre, Nottingham NG7 2UH, UK
| | - I.M. Anderson
- Neuroscience & Psychiatry Unit, School of Psychiatry & Behavioural Sciences, University of Manchester, Stopford Building, Oxford Road, Manchester M13 9PT, UK
| | - J.F.W. Deakin
- Neuroscience & Psychiatry Unit, School of Psychiatry & Behavioural Sciences, University of Manchester, Stopford Building, Oxford Road, Manchester M13 9PT, UK
| |
Collapse
|
13
|
Covarrubias P, Aparicio CF. Effects of reinforcer quality and step size on rats’ performance under progressive ratio schedules. Behav Processes 2008; 78:246-52. [DOI: 10.1016/j.beproc.2008.02.001] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2007] [Accepted: 02/02/2008] [Indexed: 11/26/2022]
|
14
|
Effect of quinolinic acid-induced lesions of the nucleus accumbens core on performance on a progressive ratio schedule of reinforcement: implications for inter-temporal choice. Psychopharmacology (Berl) 2008; 197:339-50. [PMID: 18167622 PMCID: PMC2668651 DOI: 10.1007/s00213-007-1036-0] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/28/2007] [Accepted: 11/27/2007] [Indexed: 10/31/2022]
Abstract
RATIONALE The nucleus accumbens core (AcbC) is believed to contribute to the control of operant behaviour by reinforcers. Recent evidence suggests that it is not crucial for determining the incentive value of immediately available reinforcers, but is important for maintaining the values of delayed reinforcers. OBJECTIVE This study aims to examine the effect of AcbC lesions on performance on a progressive-ratio schedule using a quantitative model that dissociates effects of interventions on motor and motivational processes (Killeen 1994 Mathematical principles of reinforcement. Behav Brain Sci 17:105-172). MATERIALS AND METHODS Rats with bilateral quinolinic acid-induced lesions of the AcbC (n = 15) or sham lesions (n = 14) were trained to lever-press for food-pellet reinforcers under a progressive-ratio schedule. In Phase 1 (90 sessions) the reinforcer was one pellet; in Phase 2 (30 sessions), it was two pellets; in Phase 3, (30 sessions) it was one pellet. RESULTS The performance of both groups conformed to the model of progressive-ratio performance (group mean data: r2 > 0.92). The motor parameter, delta, was significantly higher in the AcbC-lesioned than the sham-lesioned group, reflecting lower overall response rates in the lesioned group. The motivational parameter, a, was sensitive to changes in reinforcer size, but did not differ significantly between the two groups. The AcbC-lesioned group showed longer post-reinforcement pauses and lower running response rates than the sham-lesioned group. CONCLUSIONS The results suggest that destruction of the AcbC impairs response capacity but does not alter the efficacy of food reinforcers. The results are consistent with recent findings that AcbC lesions do not alter sensitivity to reinforcer size in inter-temporal choice schedules.
Collapse
|
15
|
|
16
|
Zhang Z, Rickard JF, Body S, Asgari K, Bradshaw CM, Szabadi E. Comparison of the effects of clozapine and 8-hydroxy-2-(di-n-propylamino)tetralin (8-OH-DPAT) on progressive ratio schedule performance: evidence against the involvement of 5-HT1A receptors in the behavioural effects of clozapine. Psychopharmacology (Berl) 2005; 181:381-91. [PMID: 15830225 DOI: 10.1007/s00213-005-2258-7] [Citation(s) in RCA: 15] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/10/2005] [Accepted: 02/28/2005] [Indexed: 11/30/2022]
Abstract
RATIONALE Performance on progressive ratio schedules has been proposed as a means of assessing the effects of drugs on the efficacy of reinforcers. A mathematical model (Killeen PR (1994) Mathematical principles of reinforcement. Behav Brain Sci 17:105-172) affords a basis for quantifying the effects of drugs on progressive ratio schedule performance. The model postulates a bitonic function relating response rate and ratio size. One parameter of the function, a, expresses the motivational effect of the reinforcer, whereas another parameter, delta, expresses the minimum time needed to execute a response, and is regarded as an index of 'motor capacity'. Previously we found that the atypical antipsychotic clozapine increased a, indicating an increase in reinforcer efficacy; a similar effect was observed with the 5-hydroxytryptamine (5-HT)(1A) receptor agonist 8-hydroxy-2-(di-n-propylamino)tetralin (8-OH-DPAT). It has been suggested that some of clozapine's behavioural effects are mediated by agonistic action at 5-HT(1A) receptors. OBJECTIVE This study was conducted to compare the effects of clozapine and 8-OH-DPAT on progressive ratio schedule performance. METHODS Rats were trained under a time-constrained progressive ratio schedule (50-min sessions). In experiment 1, they received acute doses of clozapine (4 mg kg(-1)) and 8-OH-DPAT (100 microg kg(-1)), alone and in combination with the 5-HT(1A) receptor antagonist N-[2-(4-[2-methoxyphenyl]-1-piperazinyl)ethyl]-N-2-yridinylcyclohexanecarboxamide (WAY-100635; 30 microg kg(-1)). In experiment 2, the effects of clozapine (2, 4 and 8 mg kg(-1)) and 8-OH-DPAT (25, 50 and 100 microg kg(-1)) were compared between intact rats and rats whose 5-HTergic pathways had been ablated by 5,7-dihydroxytryptamine (5,7-DHT). RESULTS In both experiments, clozapine and 8-OH-DPAT increased a and delta. In experiment 1, WAY-100635 abolished the effect of 8-OH-DPAT on a and delta, but did not alter clozapine's effects on these parameters. In experiment 2, the effects of clozapine and 8-OH-DPAT did not differ between sham-lesioned and 5,7-DHT-lesioned rats. CONCLUSIONS The results confirm previous findings on the effects of clozapine and 8-OH-DPAT on progressive ratio schedule performance. 8-OH-DPAT's effects are probably mediated by post-synaptic 5-HT(1A) receptors; clozapine's effects are mediated by a different mechanism, which does not appear to involve 5-HT(1A) receptors and which does not depend upon an intact 5-HTergic pathway.
Collapse
Affiliation(s)
- Z Zhang
- Psychopharmacology Section, Division of Psychiatry, University of Nottingham, Medical School, Queen's Medical Centre, UK
| | | | | | | | | | | |
Collapse
|
17
|
Zhang Z, Rickard JF, Asgari K, Body S, Bradshaw CM, Szabadi E. Quantitative analysis of the effects of some "atypical" and "conventional" antipsychotics on progressive ratio schedule performance. Psychopharmacology (Berl) 2005; 179:489-97. [PMID: 15565430 DOI: 10.1007/s00213-004-2049-6] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/19/2004] [Accepted: 09/21/2004] [Indexed: 10/26/2022]
Abstract
RATIONALE Performance on progressive ratio schedules has been proposed as a means of assessing the effects of drugs on the value or "efficacy" of reinforcers. A mathematical model affords a basis for quantifying the effects of drugs on progressive ratio schedule performance. According to this model, the relation between response rate and ratio size is described by a bitonic (inverted-U) function. One parameter of the function, alpha, expresses the motivational or "activating" effect of the reinforcer (duration of activation of responding produced by the reinforcer), whereas another parameter, delta, expresses the minimum time needed to execute a response, and is regarded as an index of "motor capacity". In a previous experiment we found that the "atypical" antipsychotic clozapine increased alpha, indicating an increase in the efficacy of a food reinforcer. OBJECTIVE We examined the effects of four "atypical" and four "conventional" antipsychotics on progressive ratio schedule performance. METHODS Rats responded for a sucrose reinforcer (0.6 M, 50 microl) on a time-constrained progressive ratio schedule (50-min sessions). After 90 preliminary training sessions, they received acute doses of antipsychotics (doses in mg kg(-1)): atypical: clozapine (2, 4, 8, IP; n=15), quetiapine (1.25, 2.5, 5, 10, SC; n=23), olanzapine (0.25, 0.5, 1, IP; n=15), ziprasidone (0.625, 1.25, 2.5, IP, n=15); conventional: haloperidol (0.025, 0.05, 0.1, IP, n=15), pimozide (0.125, 0.25, 0.5, IP; n=15), raclopride (0.25, 0.5, 1, SC; n=12), cis-flupenthixol (0.2, 0.4, 0.8, SC; n=15). Values of a and delta were estimated from the response rate functions obtained under each treatment condition, and were compared between drug and vehicle-alone treatments. RESULTS The atypical antipsychotics significantly increased alpha (indicating enhancement of reinforcer efficacy), and also increased delta (indicating reduction of motor capacity). Haloperidol, pimozide and raclopride significantly increased delta; none of the conventional antipsychotics significantly altered alpha. CONCLUSIONS The results extend previous findings with clozapine to other atypical antipsychotics and suggest that enhancement of the efficacy of reinforcers may be a common feature of atypical antipsychotics not shared by conventional antipsychotics.
Collapse
Affiliation(s)
- Z Zhang
- Psychopharmacology Section, Division of Psychiatry, Medical School, Queen's Medical Centre, University of Nottingham, Nottingham, NG7 2UH, UK
| | | | | | | | | | | |
Collapse
|
18
|
Blokland A, Sik A, Lieben C. Evaluation of DOI, 8-OH-DPAT, eticlopride and amphetamine on impulsive responding in a reaction time task in rats. Behav Pharmacol 2005; 16:93-100. [PMID: 15767844 DOI: 10.1097/00008877-200503000-00004] [Citation(s) in RCA: 36] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
We examined the effects of DOI (2,5-dimethoxy-4-iodoamphetamine), 8-OH-DPAT (8-hydroxy-2-(N,N-dipropylamino)tetralin, eticlopride and amphetamine in a reaction time (RT) task. In this task a trial is initiated after a rat pushes a panel. Rats have to wait (0.5-1.5 s) until a tone is presented before making a response. The number of premature responses, releasing the panel before tone was switched on, was taken as a measure of motor impulsivity. A group of 10 Lewis rats was tested in the RT task after treatment with different doses of drugs which have been shown previously to affect impulsive responding: DOI (0.1, 0.2 mg/kg), 8-OH-DPAT (0.1, 0.3 mg/kg), eticlopride (0.01, 0.03 mg/kg) and D-amphetamine (0.3, 1 mg/kg). A progressive ratio test was used to control for drug effects on food motivation. DOI (0.1 mg/kg) and D-amphetamine (0.3 mg/kg) increased impulsive responding in the RT task. Conversely, 8-OH-DPAT decreased impulsive responding in the RT task. These effects of DOI, D-amphetamine and 8-OH-DPAT on impulsive responding were not associated with changes in food motivation, as assessed by performance in the progressive ratio task. Eticlopride did not affect impulsive responding. The present data suggest that 5-HT2A receptors and dopamine (but not D2 receptors) are associated with motor impulsivity.
Collapse
Affiliation(s)
- A Blokland
- Faculty of Psychology, Brain am Behaviour Institute and European Graduate School of Neurosciences, Maastricht University, The Netherlands.
| | | | | |
Collapse
|
19
|
Barr AM, Markou A. Psychostimulant withdrawal as an inducing condition in animal models of depression. Neurosci Biobehav Rev 2005; 29:675-706. [PMID: 15893821 DOI: 10.1016/j.neubiorev.2005.03.012] [Citation(s) in RCA: 72] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
A large body of evidence indicates that the withdrawal from high doses of psychostimulant drugs in humans induces a transient syndrome, with symptoms that appear isomorphic to those of major depressive disorder. Pharmacological treatment strategies for psychostimulant withdrawal in humans have focused mainly on compounds with antidepressant properties. Animal models of psychostimulant withdrawal have been shown to demonstrate a wide range of deficits, including changes in homeostatic, affective and cognitive behaviors, as well as numerous physiological changes. Many of these behavioral and physiological sequelae parallel specific symptoms of major depressive disorder, and have been reversed by treatment with antidepressant drugs. These combined findings provide strong support for the use of psychostimulant withdrawal as an inducing condition in animal models of depression. In the current review we propound that the psychostimulant withdrawal model displays high levels of predictive and construct validity. Recent progress and limitations in the development of this model, as well as future directions for research, are evaluated and discussed.
Collapse
Affiliation(s)
- Alasdair M Barr
- Department of Neuropharmacology, CVN-7, The Scripps Research Institute, 10550 North Torrey Pines Rd, La Jolla, CA 92037 USA
| | | |
Collapse
|
20
|
Cetin T, Freudenberg F, Füchtemeier M, Koch M. Dopamine in the orbitofrontal cortex regulates operant responding under a progressive ratio of reinforcement in rats. Neurosci Lett 2004; 370:114-7. [PMID: 15488305 DOI: 10.1016/j.neulet.2004.08.002] [Citation(s) in RCA: 44] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2004] [Revised: 07/09/2004] [Accepted: 08/03/2004] [Indexed: 10/26/2022]
Abstract
Prefrontocortical dopamine (DA) plays an essential role in the regulation of cognitive functions and behavior. The orbitofrontal cortex (OFC) receives a dopaminergic projection from the ventral tegmental area and is particularly important for goal-directed appetitive behaviors and for the neural representation of reward value. We here examined the effects of DA receptor blockers locally infused into the OFC, on instrumental behavior under a progressive schedule of reinforcement. After continuous reinforcement training (lever pressing for casein pellets) rats received bilateral intra-OFC-infusions of the DA D1-receptor antagonist SCH23390 (3 microg/0.5 microl), the DA D2-receptor antagonist sulpiride (3 microg/0.5 microl), or phosphate buffered saline through chronically indwelling cannulae. Immediately after infusion they were tested under a time-constrained progressive ratio schedule of reinforcement (3, 6, 9, 12, ... lever presses for 1 casein pellet within 180 s). Both SCH23390 and sulpiride led to a significant reduction of the break point (cessation to respond to the increasing criterion of instrumental effort) compared to vehicle infusions. A food preference test revealed no drug effects on the amount of consumed pellets and on the preference of casein pellets over laboratory chow. Leftward shifts of the break point in progressive ratio tasks indicate a disturbance of the mechanisms that translate motivation into appetitive behavior under conditions of increasing instrumental effort. Therefore, our data indicate that orbitofrontal dopamine is necessary for reward-related instrumental behavior.
Collapse
Affiliation(s)
- Timur Cetin
- Department of Neuropharmacology, Brain Research Institute, University of Bremen-FB 2, PO Box 330440, 28334 Bremen, Germany
| | | | | | | |
Collapse
|
21
|
Schmadel S, Schwabe K, Koch M. Effects of neonatal excitotoxic lesions of the entorhinal cortex on cognitive functions in the adult rat. Neuroscience 2004; 128:365-74. [PMID: 15350648 DOI: 10.1016/j.neuroscience.2004.07.011] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/13/2004] [Indexed: 10/26/2022]
Abstract
The entorhinal cortex (EC) is involved in a variety of cognitive functions by virtue of its neuronal input from the neocortex and projection to the hippocampal formation and the limbic-striatal system. Neonatal lesions are increasingly considered useful models for disconnection syndromes such as schizophrenia. Therefore, we investigated the effects of neonatal EC lesions on adult rat behavior. Neonatal (postnatal day 7) lesions were inflicted by bilateral injections of ibotenate into the EC. Sham-lesioned (vehicle injection) and naive (unoperated) rats served as controls. Locomotor activity was measured in prepubertal and young adult rats. Adult rats were then tested for spatial learning in an eight-arm radial maze (reinforced delayed alternation) and for motivation (progressive ratio schedule of operant behavior). Finally, prepulse inhibition (PPI) of the acoustic startle reflex and locomotor activity were investigated with and without apomorphine (APO) challenge. Brain tissue damage was assessed using Nissl-staining. The total volume of the adult rat EC was reduced after neonatal ibotenate-injection. Neonatal EC-lesions increased perseveration only in a delayed task in the radial maze and induced a leftward-shift of breakpoints in operant responding. Lesions did not alter baseline locomotor activity, but enhanced the locomotor stimulating effect of APO. PPI was not affected by neonatal lesions of the EC with and without APO challenge. Neonatal lesions of the EC impaired the ability to hold information during delays and reduced motivation during operant behavior which reflects a state of anhedonia. Thus, they may serve as an animal model for certain aspects of schizophrenia.
Collapse
Affiliation(s)
- S Schmadel
- Brain Research Institute, Department of Neuropharmacology, University of Bremen, PO Box 33 04 40, 28334, Germany.
| | | | | |
Collapse
|