1
|
Ishiwari K, King CP, Martin CD, Tripi JA, George AM, Lamparelli AC, Chitre AS, Polesskaya O, Richards JB, Solberg Woods LC, Gancarz AM, Palmer AA, Dietz DM, Mitchell SH, Meyer PJ. Environmental enrichment promotes adaptive responding during tests of behavioral regulation in male heterogeneous stock rats. Sci Rep 2024; 14:4182. [PMID: 38378969 PMCID: PMC10879139 DOI: 10.1038/s41598-024-53943-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2023] [Accepted: 02/06/2024] [Indexed: 02/22/2024] Open
Abstract
Organisms must regulate their behavior flexibly in the face of environmental challenges. Failure can lead to a host of maladaptive behavioral traits associated with a range of neuropsychiatric disorders, including attention deficit hyperactivity disorder, autism, and substance use disorders. This maladaptive dysregulation of behavior is influenced by genetic and environmental factors. For example, environmental enrichment produces beneficial neurobehavioral effects in animal models of such disorders. The present study determined the effects of environmental enrichment on a range of measures related to behavioral regulation using a large cohort of male, outbred heterogeneous stock (HS) rats as subjects. Subjects were reared from late adolescence onwards either in pairs in standard housing with minimal enrichment (n = 200) or in groups of 16 in a highly enriched environment consisting of a large multi-level cage filled with toys, running wheels, and shelters (n = 64). Rats were subjected to a battery of tests, including: (i) locomotor response to novelty, (ii) light reinforcement, (iii) social reinforcement, (iv) reaction time, (v) a patch-depletion foraging test, (vi) Pavlovian conditioned approach, (vii) conditioned reinforcement, and (viii) cocaine conditioned cue preference. Results indicated that rats housed in the enriched environment were able to filter out irrelevant stimuli more effectively and thereby regulate their behavior more efficiently than standard-housing rats. The dramatic impact of environmental enrichment suggests that behavioral studies using standard housing conditions may not generalize to more complex environments that may be more ethologically relevant.
Collapse
Affiliation(s)
- Keita Ishiwari
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, USA
- Department of Pharmacology and Toxicology, University at Buffalo, Buffalo, NY, USA
| | - Christopher P King
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, USA
- Department of Psychology, University at Buffalo, Buffalo, NY, 14260, USA
| | - Connor D Martin
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, USA
| | - Jordan A Tripi
- Department of Psychology, University at Buffalo, Buffalo, NY, 14260, USA
| | - Anthony M George
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, USA
| | | | - Apurva S Chitre
- Department of Psychiatry, University of California San Diego, La Jolla, CA, USA
| | - Oksana Polesskaya
- Department of Psychiatry, University of California San Diego, La Jolla, CA, USA
| | - Jerry B Richards
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, USA
| | - Leah C Solberg Woods
- Department of Internal Medicine, Molecular Medicine, Center on Diabetes, Obesity and Metabolism, Wake Forest School of Medicine, Winston-Salem, NC, USA
| | - Amy M Gancarz
- Department of Psychology, California State University, Bakersfield, CA, USA
| | - Abraham A Palmer
- Department of Psychiatry, University of California San Diego, La Jolla, CA, USA
- Institute for Genomic Medicine, University of California San Diego, La Jolla, CA, USA
| | - David M Dietz
- Department of Pharmacology and Toxicology, University at Buffalo, Buffalo, NY, USA
| | - Suzanne H Mitchell
- Department of Behavioral Neuroscience, Oregon Health & Science University, Portland, OR, USA
- Department of Psychiatry, Oregon Health & Science University, Portland, OR, USA
- Oregon Institute for Occupational Health Sciences, Oregon Health & Science University, Portland, OR, USA
| | - Paul J Meyer
- Department of Psychology, University at Buffalo, Buffalo, NY, 14260, USA.
| |
Collapse
|
2
|
Gancarz AM, Hagarty DP, Cobb MM, Kausch MA, Krieg B, Alammari N, Gilbert K, Russo J, Dietz DM. Operant novelty seeking predicts cue-induced reinstatement following cocaine but not water reinforcement in male rats. Psychopharmacology (Berl) 2023; 240:2201-2215. [PMID: 37552291 PMCID: PMC10506955 DOI: 10.1007/s00213-023-06441-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/11/2023] [Accepted: 07/25/2023] [Indexed: 08/09/2023]
Abstract
RATIONALE An important facet of cocaine addiction is a high propensity to relapse, with increasing research investigating factors that predispose individuals toward uncontrolled drug use and relapse. A personality trait linked to drug addiction is high sensation seeking, i.e., a preference for novel sensations/experiences. In an animal model of sensation seeking, operant novelty seeking predicts the acquisition of drug self-administration. OBJECTIVE The primary goal of this research was to evaluate the hypothesis that sensitivity to the reinforcing effects of novel sensory stimuli predicts more intensive aspects of drug-taking behaviors, such as relapse. METHODS Rats were first tested for Operant Novelty Seeking, during which responses resulted in complex visual/auditory stimuli. Next, rats were trained to respond to water/cocaine reinforcers signaled by a cue light. Finally, rats were exposed to extinction in the absence of discrete cues and subsequently tested in a single session of cue-induced reinstatement, during which active responses resulted in cues previously paired with water/cocaine delivery. RESULTS The present study showed operant responses to produce novel sensory stimuli positively correlate with responding for cocaine during self-administration and during discrete cue-induced reinstatement, but no association with performance during extinction. A different pattern of associations was observed for a natural reward, in this case, water reinforcement. Here, the degree of novelty seeking also correlated with responding to water reinforcement and extinction responding; however, operant novelty seeking did not correlate with responding to water cues during testing of cue-induced reinstatement. Taken together, the incongruence of relationships indicates an underlying difference between natural and drug reinforcers. CONCLUSION In summary, we found a reinforcer-dependent relationship between operant novelty seeking (i.e., sensation seeking) and responsivity to extinction and discrete cues signaling availability for cocaine (i.e., craving), demonstrating the validity of the operant novelty seeking model to investigate drug seeking and relapse.
Collapse
Affiliation(s)
- Amy M Gancarz
- Department of Psychology, California State University, Bakersfield, Dorothy Donahoe Hall (DDH) H106, 9001 Stockdale Highway, Bakersfield, CA, 93311, USA.
| | - Devin P Hagarty
- Department of Psychology, California State University, Bakersfield, Dorothy Donahoe Hall (DDH) H106, 9001 Stockdale Highway, Bakersfield, CA, 93311, USA
| | - Moriah M Cobb
- Department of Psychology, California State University, Bakersfield, Dorothy Donahoe Hall (DDH) H106, 9001 Stockdale Highway, Bakersfield, CA, 93311, USA
| | - Michael A Kausch
- Department of Psychology, California State University, Bakersfield, Dorothy Donahoe Hall (DDH) H106, 9001 Stockdale Highway, Bakersfield, CA, 93311, USA
| | - Brandon Krieg
- Department of Psychology, California State University, Bakersfield, Dorothy Donahoe Hall (DDH) H106, 9001 Stockdale Highway, Bakersfield, CA, 93311, USA
| | - Nora Alammari
- Department of Psychology, California State University, Bakersfield, Dorothy Donahoe Hall (DDH) H106, 9001 Stockdale Highway, Bakersfield, CA, 93311, USA
| | - Kameron Gilbert
- Department of Psychology, California State University, Bakersfield, Dorothy Donahoe Hall (DDH) H106, 9001 Stockdale Highway, Bakersfield, CA, 93311, USA
| | - Jacqueline Russo
- Department of Psychology, California State University, Bakersfield, Dorothy Donahoe Hall (DDH) H106, 9001 Stockdale Highway, Bakersfield, CA, 93311, USA
| | - David M Dietz
- Clinical and Research Institute On Addictions, University at Buffalo, Buffalo, NY, USA
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, USA
| |
Collapse
|
3
|
Ishiwari K, King CP, Martin CD, Tripi JA, George AM, Lamparelli AC, Chitre A, Polesskaya O, Richards JB, Woods LCS, Gancarz A, Palmer AA, Dietz DM, Mitchell SH, Meyer PJ. Environmental enrichment promotes adaptive responding during tests of behavioral regulation in male heterogeneous stock rats. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.06.30.547228. [PMID: 37503161 PMCID: PMC10369912 DOI: 10.1101/2023.06.30.547228] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/29/2023]
Abstract
Organisms must regulate their behavior flexibly in the face of environmental challenges. Failure can lead to a host of maladaptive behavioral traits associated with a range of neuropsychiatric disorders, including attention deficit hyperactivity disorder, autism, and substance use disorders. This maladaptive dysregulation of behavior is influenced by genetic and environmental factors. For example, environmental enrichment produces beneficial neurobehavioral effects in animal models of such disorders. The present study determined the effects of environmental enrichment on a range of measures related to behavioral regulation using a large cohort of male, outbred heterogeneous stock (HS) rats as subjects to mimic the genetic variability found in the human population. Subjects were reared from late adolescence onwards either in pairs in standard housing with minimal enrichment (n=200) or in groups of 16 in a highly enriched environment consisting of a large multi-level cage filled with toys, running wheels, and shelters (n=64). Rats were subjected to a battery of tests, including: (i) locomotor response to novelty, (iI) light reinforcement, (iii) social reinforcement, (iv) reaction time, (v) a patch-depletion foraging test, (vi) Pavlovian conditioned approach, (vii) conditioned reinforcement, and (viii) cocaine conditioned cue preference. Results indicated that rats housed in the enriched environment were able to filter out irrelevant stimuli more effectively and thereby regulate their behavior more efficiently than standard-housing rats. The dramatic impact of environmental enrichment suggests that behavioral studies using standard housing conditions may not generalize to more complex environments that may be more ethologically relevant.
Collapse
Affiliation(s)
- Keita Ishiwari
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, USA
- Department of Pharmacology and Toxicology, University at Buffalo, Buffalo, NY, USA
| | - Christopher P. King
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, USA
- Department of Psychology, University at Buffalo, Buffalo, NY, USA
| | - Connor D. Martin
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, USA
| | - Jordan A. Tripi
- Department of Psychology, University at Buffalo, Buffalo, NY, USA
| | - Anthony M. George
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, USA
| | | | - Apurva Chitre
- Department of Psychiatry, University of California San Diego, La Jolla, CA, USA
| | - Oksana Polesskaya
- Department of Psychiatry, University of California San Diego, La Jolla, CA, USA
| | - Jerry B. Richards
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, USA
| | - Leah C. Solberg Woods
- Department of Internal Medicine, Molecular Medicine, Center on Diabetes, Obesity and Metabolism, Wake Forest School of Medicine, Winston-Salem, NC, USA
| | - Amy Gancarz
- Department of Psychology, California State University, Bakersfield, Bakersfield, CA, USA
| | - Abraham A. Palmer
- Department of Psychiatry, University of California San Diego, La Jolla, CA, USA
- Institute for Genomic Medicine, University of California San Diego, La Jolla, CA, USA
| | - David M. Dietz
- Department of Pharmacology and Toxicology, University at Buffalo, Buffalo, NY, USA
| | - Suzanne H. Mitchell
- Department of Behavioral Neuroscience, Oregon Health & Science University, Portland, OR, USA
- Department of Psychiatry, Oregon Health & Science University, Portland, OR, USA
- Oregon Institute for Occupational Health Sciences, Oregon Health & Science University, Portland, OR, USA
| | - Paul J. Meyer
- Department of Psychology, University at Buffalo, Buffalo, NY, USA
| |
Collapse
|
4
|
Abstract
Prior findings indicate that trait anhedonia enhances the likelihood of becoming a tobacco smoker, and preliminary evidence suggests that smoking abstinence leads to anhedonic states in some individuals and situations, and nicotine administration reduces anhedonic states. Nevertheless, many vital questions exist concerning relationships between anhedonia and nicotine dependence, including situational and individual difference factors that may moderate the strength of these associations. This chapter provides a critical review of the literature assessing relationships of anhedonia to nicotine dependence and the effects of acute nicotine through the lenses of the Research Domain Criteria's (RDoC) Positive Valence Systems (NIMH, RDoC changes to the matrix (CMAT) workgroup update: proposed positive valence domain revisions. A report by the national advisory mental health council workgroup on changes to the research domain criteria matrix, 2018) and the Situation x Trait Affective Response (STAR) model of nicotine's effects and nicotine dependence (Gilbert, Smoking individual differences, psychopathology, and emotion. Taylor and Francis, Washington, DC, 1995; Gilbert, Hum Psychopharmacol Clin Exp 12:S89-S102, 1997). The effects of nicotine and nicotine withdrawal on subjective, behavioral, and brain indices vary across the three RDoC Positive Valences Systems (Reward Responsiveness, Reward Learning, and Reward Valuation) in a manner that supports the research and potential clinical utility of using RDoC criteria and the STAR model to guide research and clinical innovation. We provide a revision of the STAR model that incorporates the three RDoC Positive Valence Systems with evidence that nicotine's effects on hedonic and affective processes vary as a function of the dominance/salience of (1) situational hedonic and affective cues and task/active coping cues, and (2) state executive functioning level/capacity and state reward sensitivity such that these effects of nicotine are maximal during states of suboptimal cognitive functioning and reward sensitivity, combined with low situational stimulus salience and low task-related cues/demands.
Collapse
Affiliation(s)
- David G Gilbert
- School of Psychological and Social Sciences, Southern Illinois University-Carbondale, Carbondale, IL, USA.
| | - Bryant M Stone
- School of Psychological and Social Sciences, Southern Illinois University-Carbondale, Carbondale, IL, USA
| |
Collapse
|
5
|
Tonkin SS, Hawk LW. Preliminary Evaluations of Habituation of Operant Responding for Sensory Stimuli in Humans. Behav Processes 2020; 178:104159. [PMID: 32504763 DOI: 10.1016/j.beproc.2020.104159] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2019] [Revised: 05/30/2020] [Accepted: 06/01/2020] [Indexed: 10/24/2022]
Abstract
Research suggests that repetitive reinforcers wane in their ability to maintain operant behavior in a manner consistent with habituation. Weaker reinforcers, including sensory stimuli common in human work, may be most impacted by repetition. The present research examined within-session operant responding patterns for visual stimuli in humans from two experiments assessing multiple characteristics of habituation. In Experiment 1, declines in reinforced responding were assessed and stimulus specificity was evaluated to test habituation's contribution to these declines. Seventy-three participants completed two visits, both including a reinforcement paradigm using pictures. With repetition, operant responding declined. The stimulus specificity manipulation did not enhance responding, suggesting that habituation did not contribute to response declines. Several methodological concerns may have contributed to the absence of a stimulus specificity effect. Experiment 2 assessed a separate habituation characteristic, rate of stimulation, to address these methodological concerns and further evaluate habituation. Twenty-eight participants completed the reinforcement paradigm over three visits. Decline in responding was partially supported, but the rate of stimulation did not alter declines. In sum, habituation's contribution to within-session declines for sensory reinforcers was not evident in either experiment. These results suggest that assessment of habituation of sensory reinforcers in humans may require parametric evaluation.
Collapse
Affiliation(s)
- Sarah S Tonkin
- Department of Psychology, The State University of New York at Buffalo, 204 Park Hall, North Campus, Buffalo, NY, 14260-4110, USA
| | - Larry W Hawk
- Department of Psychology, The State University of New York at Buffalo, 204 Park Hall, North Campus, Buffalo, NY, 14260-4110, USA.
| |
Collapse
|
6
|
Bai JYH, Cowie S, Macaskill AC, Elliffe D, Podlesnik CA. Assessing potential reinforcement‐like effects of brief stimuli unrelated to food reinforcers. J Exp Anal Behav 2020; 113:363-389. [DOI: 10.1002/jeab.580] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2019] [Revised: 09/27/2019] [Accepted: 11/20/2019] [Indexed: 11/08/2022]
|
7
|
Karelitz JL, Perkins KA. Tobacco smoking may delay habituation of reinforcer effectiveness in humans. Psychopharmacology (Berl) 2018; 235:2315-2321. [PMID: 29777289 PMCID: PMC6045957 DOI: 10.1007/s00213-018-4927-3] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/06/2017] [Accepted: 05/10/2018] [Indexed: 12/29/2022]
Abstract
BACKGROUND The effectiveness of nonconsummatory reinforcers habituate, as their ability to maintain reinforced responding declines over repeated presentations. Preclinical research has shown that nicotine can delay habituation of reinforcer effectiveness, but this effect has not been directly demonstrated in humans. OBJECTIVE In preliminary translational research, we assessed effects of nicotine from tobacco smoking (vs. a no smoking control) on within-session patterns of responding for a brief visual reinforcer. METHODS Using a within-subjects design, 32 adult dependent smokers participated in two experimental sessions, varying by smoking condition: no smoking following overnight abstinence (verified by CO ≤ 10 ppm), or smoking of own cigarette without overnight abstinence. Adapted from preclinical studies, habituation of reinforcer effectiveness was assessed by determining the rate of decline in responding on a simple operant computer task for a visual reinforcer, available on a fixed ratio schedule. RESULTS Reinforced responding and duration of responding were each significantly higher in the smoking vs. no smoking condition. The within-session rate of responding declined significantly more slowly during the smoking vs. no smoking condition, consistent with delayed habituation of reinforcer effectiveness. Follow-up analyses indicated that withdrawal relief did not influence the difference in responding between conditions, suggesting the patterns of responding reflected positive, but not negative, reinforcement. CONCLUSIONS These results are a preliminary demonstration in humans that smoked nicotine may attenuate habituation, thereby maintaining the effectiveness of a reinforcer over a longer period of access. Further research is needed to confirm habituation and rule out alternative causes of declines in within-session responding.
Collapse
Affiliation(s)
- Joshua L Karelitz
- Department of Psychiatry, WPIC, University of Pittsburgh School of Medicine, 3811 O'Hara Street, Pittsburgh, PA, 15213, USA.
| | - Kenneth A Perkins
- Department of Psychiatry, WPIC, University of Pittsburgh School of Medicine, 3811 O'Hara Street, Pittsburgh, PA, 15213, USA
| |
Collapse
|
8
|
Social reinforcement as alternative to sucrose reinforcement is increased by nicotine and methylphenidate in male Fischer-344 rats. Psychopharmacology (Berl) 2018; 235:1981-1985. [PMID: 29691605 DOI: 10.1007/s00213-018-4896-6] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/09/2017] [Accepted: 04/04/2018] [Indexed: 12/22/2022]
Abstract
BACKGROUND Stimulant drugs such as nicotine (NIC) and methylphenidate (MPH) are hypothesized to increase the reinforcing value of sensory stimuli, thus increasing the effectiveness of such reinforcers as alternatives to sucrose reinforcers. METHODS Inbred Fischer-344 rats (n = 30) were assigned to three groups: saline (SAL; n = 10), nicotine (NIC; n = 10), or methylphenidate (MPH; n = 10). Testing was done in three phases: sucrose only, (SUC), sucrose and drug (SUC/DRUG), and sucrose, drug, and social reinforcement (SUC/DRUG/SOC). During the SUC phase, rats were trained on a progressive ratio 5 (PR5) reinforcement schedule for sucrose (20% solution). In the SUC/DRUG phase, animals were treated with SAL, NIC (0.4 mg/kg, n = 10 SC), or MPH (2.0 mg/kg, n = 10 IP) 30 min prior to testing. In the SUC/DRUG/SOC phase, animals continued receiving drug treatment, and social reinforcement was introduced concurrently with the sucrose reinforcer. The progressive ratio for each reinforcer ran independently of the others. Reinforcing value was measured as break point (BP), the highest number of responses resulting in a reinforcer. RESULTS SAL-treated animals showed no significant change in sucrose BP. MPH-treated animals showed decreased sucrose BP in the SUC/DRUG phase, with a further reduction in the SUC/DRUG/SOC phase. NIC-treated animals decreased sucrose BP only when a social alternative was offered. CONCLUSION Both NIC and MPH reduce the sucrose BP in the presence of a social alternative. The decrease in sucrose responding, coupled with increased social responding, suggests that the social alternative acted as an effective alternative reinforcer to sucrose. From a translational perspective, these results suggest that stimulant drugs such as NIC and MPH may increase the effectiveness of treatments that use alternative social reinforcers to decrease eating.
Collapse
|
9
|
Taylor SB, Watterson LR, Kufahl PR, Nemirovsky NE, Tomek SE, Conrad CD, Olive MF. Chronic variable stress and intravenous methamphetamine self-administration - Role of individual differences in behavioral and physiological reactivity to novelty. Neuropharmacology 2016; 108:353-63. [PMID: 27163191 DOI: 10.1016/j.neuropharm.2016.05.003] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2015] [Revised: 04/30/2016] [Accepted: 05/05/2016] [Indexed: 11/16/2022]
Abstract
Stress is a contributing factor to the development and maintenance of addiction in humans. However, few studies have shown that stress potentiates the rewarding and/or reinforcing effects of methamphetamine in rodent models of addiction. The present study assessed the effects of exposure to 14 days of chronic variable stress (CVS), or no stress as a control (CON), on the rewarding and reinforcing effects of methamphetamine in adult rats using the conditioned place preference (Experiment 1) and intravenous self-administration (Experiment 2) paradigms. In Experiment 2, we also assessed individual differences in open field locomotor activity, anxiety-like behavior in the elevated plus maze (EPM), and physiological responses to a novel environment as possible predictors of methamphetamine intake patterns. Exposure to CVS for 14 days did not affect overall measures of methamphetamine conditioned reward or reinforcement. However, analyses of individual differences and direct vs. indirect effects revealed that rats exhibiting high physiological reactivity and locomotor activity in the EPM and open field tests self-administered more methamphetamine and reached higher breakpoints for drug reinforcement than rats exhibiting low reactivity. In addition, CVS exposure significantly increased the proportion of rats that exhibited high reactivity, and high reactivity was significantly correlated with increased levels of methamphetamine intake. These findings suggest that individual differences in physiological and locomotor reactivity to novel environments, as well as their interactions with stress history, predict patterns of drug intake in rodent models of methamphetamine addiction. Such predictors may eventually inform future strategies for implementing individualized treatment strategies for amphetamine use disorders.
Collapse
Affiliation(s)
- S B Taylor
- Department of Psychology, Arizona State University, Tempe, AZ, USA.
| | - L R Watterson
- Department of Psychology, Arizona State University, Tempe, AZ, USA
| | - P R Kufahl
- Department of Psychology, Arizona State University, Tempe, AZ, USA
| | - N E Nemirovsky
- Department of Psychology, Arizona State University, Tempe, AZ, USA
| | - S E Tomek
- Department of Psychology, Arizona State University, Tempe, AZ, USA
| | - C D Conrad
- Department of Psychology, Arizona State University, Tempe, AZ, USA; Interdisciplinary Graduate Program in Neuroscience, Arizona State University, Tempe, AZ, USA
| | - M F Olive
- Department of Psychology, Arizona State University, Tempe, AZ, USA; Interdisciplinary Graduate Program in Neuroscience, Arizona State University, Tempe, AZ, USA.
| |
Collapse
|
10
|
Chen YW, Fiscella KA, Bacharach SZ, Tanda G, Shaham Y, Calu DJ. Effect of yohimbine on reinstatement of operant responding in rats is dependent on cue contingency but not food reward history. Addict Biol 2015; 20:690-700. [PMID: 25065697 DOI: 10.1111/adb.12164] [Citation(s) in RCA: 49] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
Yohimbine is an alpha-2 adrenoceptor antagonist that has been used in numerous studies as a pharmacological stressor in rodents, monkeys and humans. Recently, yohimbine has become the most common stress manipulation in studies on reinstatement of drug and food seeking. However, the wide range of conditions under which yohimbine promotes reward seeking is significantly greater than that of stressors like intermittent footshock. Here, we addressed two fundamental questions regarding yohimbine's effect on reinstatement of reward seeking: (1) whether the drug's effect on operant responding is dependent on previous reward history or cue contingency, and (2) whether yohimbine is aversive or rewarding under conditions typically used in reinstatement studies. We also used in vivo microdialysis to determine yohimbine's effect on dopamine levels in nucleus accumbens (NAc) and medial prefrontal cortex (mPFC). We found that the magnitude of yohimbine-induced (0.5, 1.0, 2.0 mg/kg) operant responding during the reinstatement tests was critically dependent on the contingency between lever pressing and discrete tone-light cue delivery but not the previous history with food reward during training. We also found that yohimbine (2 mg/kg) did not cause conditioned place aversion. Finally, we found that yohimbine modestly increased dopamine levels in mPFC but not NAc. Results suggest that yohimbine's effects on operant responding in reinstatement studies are likely independent of the history of contingent self-administration of food or drug rewards and may not be related to the commonly assumed stress-like effects of yohimbine.
Collapse
Affiliation(s)
- Yu-Wei Chen
- Behavioral Neuroscience Research Branch; NIDA, NIH, DHHS; Baltimore MD USA
| | | | | | - Gianluigi Tanda
- Medication Development Program; Intramural Research Program; NIDA, NIH, DHHS; Baltimore MD USA
| | - Yavin Shaham
- Behavioral Neuroscience Research Branch; NIDA, NIH, DHHS; Baltimore MD USA
| | - Donna J. Calu
- Behavioral Neuroscience Research Branch; NIDA, NIH, DHHS; Baltimore MD USA
| |
Collapse
|
11
|
Meyer PJ, Cogan ES, Robinson TE. The form of a conditioned stimulus can influence the degree to which it acquires incentive motivational properties. PLoS One 2014; 9:e98163. [PMID: 24905195 PMCID: PMC4048203 DOI: 10.1371/journal.pone.0098163] [Citation(s) in RCA: 57] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2014] [Accepted: 04/29/2014] [Indexed: 11/19/2022] Open
Abstract
There is considerable individual variation in the extent to which food- and drug-associated cues (conditioned stimuli, CSs) acquire incentive salience, as indicated by whether they elicit approach towards them, and/or act as conditioned reinforcers. Here we asked whether this variation is influenced by properties of the CS itself. In rats, we assessed both the attractiveness and conditioned reinforcing properties of two CSs: a manipulable lever CS versus an auditory (tone) CS. There was considerable individual variation in the extent to which a lever CS acquired incentive motivational properties, as indicated by whether it became attractive (evoked a sign-tracking or goal-tracking conditioned response) or acted as a conditioned reinforcer. However, with a tone CS all rats learned a goal-tracking response, and the tone CS was an equally effective conditioned reinforcer in sign-trackers and goal-trackers. Even when presented in compound (a lever-tone CS), the two elements of the compound differentially acquired motivational properties. In contrast, amphetamine and stress potentiated the conditioned reinforcing properties of both visual and auditory CSs similarly in rats that primarily sign-tracked or goal-tracked. We conclude that variation in the to the ability of CSs to acquire incentive salience, and thus their ability to act as incentive stimuli capable of motivating behavior, is determined in part by properties of the CS itself.
Collapse
Affiliation(s)
- Paul J. Meyer
- Department of Psychology, University of Michigan, Ann Arbor, Michigan, United States of America
| | - Elizabeth S. Cogan
- Department of Psychology, University of Michigan, Ann Arbor, Michigan, United States of America
| | - Terry E. Robinson
- Department of Psychology, University of Michigan, Ann Arbor, Michigan, United States of America
| |
Collapse
|
12
|
Lloyd DR, Hausknecht KA, Richards JB. Nicotine and methamphetamine disrupt habituation of sensory reinforcer effectiveness in male rats. Exp Clin Psychopharmacol 2014; 22:166-75. [PMID: 24708147 PMCID: PMC4083460 DOI: 10.1037/a0034741] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The reinforcing effectiveness of a sensory stimulus such as light-onset rapidly habituates (Lloyd, Gancarz, Ashrafioun, Kausch, & Richards, 2012). According to memory-based theories, habituation occurs if a memory exists for perceived stimulation, and dishabituation occurs if a memory does not exist and the stimulation is "unexpected." According to Redgrave and Gurney (2006), unexpected response-contingent sensory stimuli increase phasic firing of dopamine neurons, providing a sensory error signal that reflects the difference between perceived and expected stimuli. Together, memory-based theories of habituation and the sensory error signal hypothesis predict a disruption (slowing) of habituation rate by novel response-contingent sensory stimulation or by artificial increases in dopamine neurotransmission by stimulant drugs. To test these predictions, we examined the effects of stimulant drugs on both the operant level of responding (snout-poking) and operant responding for a sensory reinforcer (light-onset) presented according to a fixed ratio 1 schedule. Robust within-session decreases in responding indicating habituation were observed. The effects of stimulant drugs (saline, n = 10; nicotine, 0.40 mg/kg, n = 10; and methamphetamine, 0.75 mg/kg, n = 9) on habituation in rats were determined. Nicotine was found to decrease habituation rate and did not affect response rate, while methamphetamine decreased habituation rate and increased response rate. In addition, introduction of a novel visual stimulus reinforcer decreased habituation rate and increased responding. These findings show that habituation of reinforcer effectiveness modulates operant responding for sensory reinforcers, and that stimulant drugs may disrupt normally occurring habituation of reinforcer effectiveness by increasing dopamine neurotransmission.
Collapse
Affiliation(s)
- David R Lloyd
- Research Institute on Addictions, State University of New York at Buffalo
| | | | - Jerry B Richards
- Research Institute on Addictions, State University of New York at Buffalo
| |
Collapse
|
13
|
Lloyd DR, Medina DJ, Hawk LW, Fosco WD, Richards JB. Habituation of reinforcer effectiveness. Front Integr Neurosci 2014; 7:107. [PMID: 24409128 PMCID: PMC3885986 DOI: 10.3389/fnint.2013.00107] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2013] [Accepted: 12/19/2013] [Indexed: 01/07/2023] Open
Abstract
In this paper we propose an integrative model of habituation of reinforcer effectiveness (HRE) that links behavioral- and neural-based explanations of reinforcement. We argue that HRE is a fundamental property of reinforcing stimuli. Most reinforcement models implicitly suggest that the effectiveness of a reinforcer is stable across repeated presentations. In contrast, an HRE approach predicts decreased effectiveness due to repeated presentation. We argue that repeated presentation of reinforcing stimuli decreases their effectiveness and that these decreases are described by the behavioral characteristics of habituation (McSweeney and Murphy, 2009; Rankin etal., 2009). We describe a neural model that postulates a positive association between dopamine neurotransmission and HRE. We present evidence that stimulant drugs, which artificially increase dopamine neurotransmission, disrupt (slow) normally occurring HRE and also provide evidence that stimulant drugs have differential effects on operant responding maintained by reinforcers with rapid vs. slow HRE rates. We hypothesize that abnormal HRE due to genetic and/or environmental factors may underlie some behavioral disorders. For example, recent research indicates that slow-HRE is predictive of obesity. In contrast ADHD may reflect “accelerated-HRE.” Consideration of HRE is important for the development of effective reinforcement-based treatments. Finally, we point out that most of the reinforcing stimuli that regulate daily behavior are non-consumable environmental/social reinforcers which have rapid-HRE. The almost exclusive use of consumable reinforcers with slow-HRE in pre-clinical studies with animals may have caused the importance of HRE to be overlooked. Further study of reinforcing stimuli with rapid-HRE is needed in order to understand how habituation and reinforcement interact and regulate behavior.
Collapse
Affiliation(s)
- David R Lloyd
- Research Institute on Addictions, State University of New York at Buffalo Buffalo, NY, USA ; School of Medicine and Biomedical Sciences, State University of New York at Buffalo Buffalo, NY, USA
| | - Douglas J Medina
- Research Institute on Addictions, State University of New York at Buffalo Buffalo, NY, USA
| | - Larry W Hawk
- Department of Psychology, State University of New York at Buffalo Buffalo, NY, USA
| | - Whitney D Fosco
- Department of Psychology, State University of New York at Buffalo Buffalo, NY, USA
| | - Jerry B Richards
- Research Institute on Addictions, State University of New York at Buffalo Buffalo, NY, USA
| |
Collapse
|
14
|
Barret ST, Bevins RA. Nicotine enhances operant responding for qualitatively distinct reinforcers under maintenance and extinction conditions. Pharmacol Biochem Behav 2013; 114-115:9-15. [PMID: 24422211 PMCID: PMC3898615] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
RATIONALE Nicotine enhancement of reward has been implicated as an important contributor to tobacco addiction. Despite the attention that reward enhancement has received, the behavioral mechanisms whereby nicotine enhances operant responding remain largely unknown. The present study sought to extend previous work by evaluating the effects of nicotine on responding for two qualitatively different rewards (visual stimulation (VS) and 4% sucrose solution) under fixed-ratio (FR) maintenance and extinction conditions. METHOD Sprague–Dawley rats were trained to press an active lever for VS (Experiment 1) or 4% sucrose solution (Experiment 2) and evaluated over 15 sessions on a FR5 schedule of reinforcement. Nicotine (0.4 mg base/kg, SC) or saline were administered 5 min before each session; the alternate solution was given in the home cage after the session. The effects of nicotine on extinction responding were then assessed over 5 sessions and rats were divided into 4 groups based on drug of injection received during FR-maintenance and extinction phases (maintenance–extinction): Nic–Nic, Nic–Sal, Sal–Sal, and Sal–Nic. RESULTS Nicotine increased active lever response rates for both VS and 4% sucrose under FR5 maintenance conditions. Nicotine also increased response rates in the Nic–Nic group relative to all other groups under extinction conditions in both experiments, though this effect had greater longevity following VS maintenance conditions than sucrose. Enhancement of responding during extinction does not appear dependent upon locomotor activation by nicotine.
Collapse
|
15
|
Nicotine enhances operant responding for qualitatively distinct reinforcers under maintenance and extinction conditions. Pharmacol Biochem Behav 2013. [DOI: 10.1016/j.pbb.2013.10.012] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
16
|
Richards JB, Lloyd DR, Kuehlewind B, Militello L, Paredez M, Solberg Woods L, Palmer AA. Strong genetic influences on measures of behavioral-regulation among inbred rat strains. GENES BRAIN AND BEHAVIOR 2013; 12:490-502. [PMID: 23710681 DOI: 10.1111/gbb.12050] [Citation(s) in RCA: 35] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/14/2013] [Revised: 04/22/2013] [Accepted: 05/14/2013] [Indexed: 11/27/2022]
Abstract
A fundamental challenge for any complex nervous system is to regulate behavior in response to environmental challenges. Three measures of behavioral-regulation were tested in a panel of eight inbred rat strains. These measures were: (1) sensation seeking as assessed by locomotor response to novelty and the sensory reinforcing effects of light onset, (2) attention and impulsivity, as measured by a choice reaction time task and (3) impulsivity as measured by a delay discounting task. Deficient behavioral-regulation has been linked to a number of psychopathologies, including ADHD, Schizophrenia, Autism, drug abuse and eating disorders. Eight inbred rat strains (August Copenhagen Irish, Brown Norway, Buffalo, Fischer 344, Wistar Kyoto, Spontaneous Hypertensive Rat, Lewis, Dahl Salt Sensitive) were tested. With n = 9 for each strain, we observed robust strain differences for all tasks; heritability was estimated between 0.43 and 0.66. Performance of the eight inbred rat strains on the choice reaction time task was compared to the performance of outbred Sprague Dawley (n = 28) and Heterogeneous strain rats (n = 48). The results indicate a strong genetic influence on complex tasks related to behavioral-regulation and indicate that some of the measures tap common genetically driven processes. Furthermore, our results establish the potential for future studies aimed at identifying specific alleles that influence variability for these traits. Identification of such alleles could contribute to our understanding of the molecular genetic basis of behavioral-regulation, which is of fundamental importance and likely contributes to multiple psychiatric disorders.
Collapse
Affiliation(s)
- J B Richards
- Research Institute on Addictions, State University of New York at Buffalo, Buffalo, NY 14203, USA.
| | | | | | | | | | | | | |
Collapse
|
17
|
Gancarz AM, Robble MA, Kausch MA, Lloyd DR, Richards JB. Sensory reinforcement as a predictor of cocaine and water self-administration in rats. Psychopharmacology (Berl) 2013; 226:335-46. [PMID: 23142958 PMCID: PMC3581756 DOI: 10.1007/s00213-012-2907-6] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/20/2012] [Accepted: 10/18/2012] [Indexed: 11/26/2022]
Abstract
RATIONALE The ability of locomotor activity in a novel environment (Loco) and visual stimulus reinforcement (VSR) to predict acquisition of responding for cocaine and water reinforcers in the absence of explicit audiovisual signals was evaluated. METHODS In Experiment 1 (Exp 1), rats (n = 60) were tested for VSR, followed by Loco, and finally acquisition of responding for cocaine (0.3 mg/kg/inf). In Experiment 2 (Exp 2), rats (n = 32) were tested for VSR, followed by Loco, and finally acquisition of responding for water (0.01 mL/reinforcer). RESULTS There were three main findings. First, Loco and VSR were significantly associated (Exp 1: r = 0.49, p < 0.00; Exp 2: r = 0.35, p < 0.05). Second, neither Loco (r = .00, p = 0.998) nor VSR (r = -0.12, p = 0.352) predicted acquisition of cocaine SA. Third, in the subgroup of animals that acquired cocaine SA, VSR (r = 0.41, p < 0.01) but not Loco (r = 0.28, p = 0.10) was positively associated with operant responding for cocaine. Both Loco and VSR (Loco: r = 0.37, p < 0.04; VSR: r = 0.51, p < 0.00) were positively associated with operant responding for water reinforcers. CONCLUSIONS The results indicate that VSR is at least as good a predictor of cocaine reinforced responding as Loco. VSR was predictive of operant responding for both drug and water reinforcers, while Loco was found to be predictive of responding only for water reinforcers. In studies that present visual stimuli in association with drug delivery, Loco may be predicting acquisition of responding for VSR rather than drug.
Collapse
Affiliation(s)
- Amy M Gancarz
- Department of Psychology, State University of New York at Buffalo, Park Hall Room 204, Buffalo, NY 14260, USA.
| | | | | | | | | |
Collapse
|
18
|
Lloyd DR, Kausch MA, Gancarz AM, Beyley LJ, Richards JB. Effects of novelty and methamphetamine on conditioned and sensory reinforcement. Behav Brain Res 2012; 234:312-22. [PMID: 22814112 PMCID: PMC3422403 DOI: 10.1016/j.bbr.2012.07.012] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2012] [Revised: 07/03/2012] [Accepted: 07/07/2012] [Indexed: 11/25/2022]
Abstract
BACKGROUND Light onset can be both a sensory reinforcer (SR) with intrinsic reinforcing properties, and a conditioned reinforcer (CR) which predicts a biologically important reinforcer. Stimulant drugs, such as methamphetamine (METH), may increase the reinforcing effectiveness of CRs by enhancing the predictive properties of the CR. In contrast, METH-induced increases in the reinforcing effectiveness of SRs, are mediated by the immediate sensory consequences of the light. METHODS The effects of novelty (on SRs) and METH (on both CRs and SRs) were tested. Experiment 1: rats were pre-exposed to 5 s light and water pairings presented according to a variable-time (VT) 2 min schedule or unpaired water and light presented according to independent, concurrent VT 2 min schedules. Experiment 2: rats were pre-exposed to 5 s light presented according to a VT 2 min schedule, or no stimuli. In both experiments, the pre-exposure phase was followed by a test phase in which 5 s light onset was made response-contingent on a variable-interval (VI) 2 min schedule and the effects of METH (0.5 mg/kg) were determined. RESULTS Novel light onset was a more effective reinforcer than familiar light onset. METH increased the absolute rate of responding without increasing the relative frequency of responding for both CRs and SRs. CONCLUSION Novelty plays a role in determining the reinforcing effectiveness of SRs. The results are consistent with the interpretation that METH-induced increases in reinforcer effectiveness of CRs and SRs may be mediated by immediate sensory consequences, rather than prediction.
Collapse
Affiliation(s)
- David R Lloyd
- Research Institute on Addictions, University at Buffalo, 1021 Main St., Buffalo, NY 14203, United States.
| | | | | | | | | |
Collapse
|
19
|
Association between locomotor response to novelty and light reinforcement: sensory reinforcement as a rodent model of sensation seeking. Behav Brain Res 2012; 230:380-8. [PMID: 22586716 DOI: 10.1016/j.bbr.2012.02.028] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
Abstract
BACKGROUND The human personality trait of sensation seeking (SS) indicates an attraction to novel sensations and experiences, and is associated with greater likelihood of drug abuse. In rodents, locomotor activity in a novel environment (Loco) has been found to predict drug self-administration (SA), and has been hypothesized to be a translational model of human SS. Previously, we reported (Gancarz et al., 2011) that high responder (HR) animals responded more than low responder (LR) animals to produce a response contingent light onset. The primary goal of this paper was a detailed analysis of the association between Loco and light contingent responding in a large sample of rats (n = 93). METHODS Male rats were pre-exposed to dark operant test chambers for ten 30 min sessions and baseline levels of responding (snout poking) were determined. The pre-exposure phase was followed by 6 sessions during which active responding produced a visual sensory reinforcer (VSR; 5 s light onset) according to a variable interval 1 min schedule of reinforcement. After completion of the VSR phase, Loco was tested. RESULTS The activating effects (total responding) of light were associated with Loco, but the response guiding effects (proportion of active responding) of the light were not. In addition, HR rats habituated more slowly in both the VSR and Loco tests than LR rats. CONCLUSIONS These data indicate that VSR measures aspects of the rodent’s response to novel sensations and experiences that are not detected by Loco. These data provide some evidence for the use of light reinforcement as an animal model of SS.
Collapse
|
20
|
Lloyd DR, Gancarz AM, Ashrafioun L, Kausch MA, Richards JB. Habituation and the reinforcing effectiveness of visual stimuli. Behav Processes 2012; 91:184-91. [PMID: 22868172 DOI: 10.1016/j.beproc.2012.07.007] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2012] [Revised: 07/03/2012] [Accepted: 07/21/2012] [Indexed: 10/28/2022]
Abstract
The term "sensory reinforcer" has been used to refer to sensory stimuli (e.g. light onset) that are primary reinforcers in order to differentiate them from other more biologically important primary reinforcers (e.g. food and water). Acquisition of snout poke responding for a visual stimulus (5 s light onset) with fixed ratio 1 (FR 1), variable-interval 1 min (VI 1 min), or variable-interval 6 min (VI 6 min) schedules of reinforcement was tested in three groups of rats (n=8/group). The VI 6 min schedule of reinforcement produced a higher response rate than the FR 1 or VI 1 min schedules of visual stimulus reinforcement. One explanation for greater responding on the VI 6 min schedule relative to the FR 1 and VI 1 min schedules is that the reinforcing effectiveness of light onset habituated more rapidly in the FR 1 and VI 1 min groups as compared to the VI 6 min group. The inverse relationship between response rate and the rate of visual stimulus reinforcement is opposite to results from studies with biologically important reinforcers which indicate a positive relationship between response and reinforcement rate. Rapid habituation of reinforcing effectiveness may be a fundamental characteristic of sensory reinforcers that differentiates them from biologically important reinforcers, which are required to maintain homeostatic balance.
Collapse
Affiliation(s)
- David R Lloyd
- Research Institute on Addictions, University at Buffalo, 1021 Main St., Buffalo, NY 14203, United States.
| | | | | | | | | |
Collapse
|