1
|
Gancarz AM, Mitchell SH, George AM, Martin CD, Turk MC, Bool HM, Aktar F, Kwarteng F, Palmer AA, Meyer PJ, Richards JB, Dietz DM, Ishiwari K. Reward maximization assessed using a sequential patch depletion task in a large sample of heterogeneous stock rats. Sci Rep 2023; 13:7027. [PMID: 37120610 PMCID: PMC10148848 DOI: 10.1038/s41598-023-34179-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2023] [Accepted: 04/25/2023] [Indexed: 05/01/2023] Open
Abstract
Choice behavior requires animals to evaluate both short- and long-term advantages and disadvantages of all potential alternatives. Impulsive choice is traditionally measured in laboratory tasks by utilizing delay discounting (DD), a paradigm that offers a choice between a smaller immediate reward, or a larger more delayed reward. This study tested a large sample of Heterogeneous Stock (HS) male (n = 896) and female (n = 898) rats, part of a larger genetic study, to investigate whether measures of reward maximization overlapped with traditional models of delay discounting via the patch depletion model using a Sequential Patch Depletion procedure. In this task, rats were offered a concurrent choice between two water "patches" and could elect to "stay" in the current patch or "leave" for an alternative patch. Staying in the current patch resulted in decreasing subsequent reward magnitudes, whereas the choice to leave a patch was followed by a delay and a resetting to the maximum reward magnitude. Based on the delay in a given session, different visit durations were necessary to obtain the maximum number of rewards. Visit duration may be analogous to an indifference point in traditional DD tasks. Males and females did not significantly differ on traditional measures of DD (e.g. delay gradient; AUC). When examining measures of patch utilization, females made fewer patch changes at all delays and spent more time in the patch before leaving for the alternative patch compared to males. Consistent with this, there was some evidence that females deviated from reward maximization more than males. However, when controlling for body weight, females had a higher normalized rate of reinforcement than males. Measures of reward maximization were only weakly associated with traditional DD measures and may represent distinctive underlying processes. Taken together, females performance differed from males with regard to reward maximization that were not observed utilizing traditional measures of DD, suggesting that the patch depletion model was more sensitive to modest sex differences when compared to traditional DD measures in a large sample of HS rats.
Collapse
Affiliation(s)
- Amy M Gancarz
- Department of Psychology, California State University, Bakersfield, Bakersfield, CA, 93311, USA.
| | - Suzanne H Mitchell
- Department of Behavioral Neuroscience, Oregon Health & Science University, Portland, OR, 97239, USA
- Department of Psychiatry, Oregon Health & Science University, Portland, OR, 97239, USA
- Oregon Institute for Occupational Health Sciences, Oregon Health & Science University, Portland, OR, 97239, USA
| | - Anthony M George
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA
| | - Connor D Martin
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA
| | - Marisa C Turk
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA
| | - Heather M Bool
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA
| | - Fahmida Aktar
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA
| | - Francis Kwarteng
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA
| | - Abraham A Palmer
- Department of Psychiatry, University of California San Diego, La Jolla, CA, 92093, USA
- Institute for Genomic Medicine, University of California San Diego, La Jolla, CA, 92093, USA
| | - Paul J Meyer
- Department of Psychology, University at Buffalo, Buffalo, NY, 14260, USA
| | - Jerry B Richards
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA
| | - David M Dietz
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA
| | - Keita Ishiwari
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA.
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA.
| |
Collapse
|
2
|
Gancarz AM, Mitchell SH, George AM, Martin CD, Turk MC, Bool HM, Aktar F, Kwarteng F, Palmer AA, Meyer PJ, Richards JB, Dietz DM, Isiwari K. Reward Maximization Assessed Using a Sequential Patch Depletion Task in a Large Sample of Heterogeneous Stock Rats. RESEARCH SQUARE 2023:rs.3.rs-2525080. [PMID: 36778344 PMCID: PMC9915773 DOI: 10.21203/rs.3.rs-2525080/v1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
Choice behavior requires animals to evaluate both short- and long-term advantages and disadvantages of all potential alternatives. Impulsive choice is traditionally measured in laboratory tasks by utilizing delay discounting (DD), a paradigm that offers a choice between a smaller immediate reward, or a larger more delayed reward. This study tested a large sample of Heterogeneous Stock (HS) male (n = 896) and female (n = 898) rats, part of a larger genetic study, to investigate whether measures of reward maximization overlapped with traditional models of delay discounting via the patch depletion model using a Sequential Patch Depletion procedure. In this task, rats were offered a concurrent choice between two water "patches" and could elect to "stay" in the current patch or "leave" for an alternative patch. Staying in the current patch resulted in decreasing subsequent reward magnitudes, whereas the choice to leave a patch was followed by a delay and a resetting to the maximum reward magnitude. Based on the delay in a given session, different visit durations were necessary to obtain the maximum number of rewards. Visit duration may be analogous to an indifference point in traditional DD tasks. While differences in traditional DD measures (e.g., delay gradient) have been detected between males and females, these effects were small and inconsistent. However, when examining measures of reward maximization, females made fewer patch changes at all delays and spent more time in the patch before leaving for the alternative patch compared to males. This pattern of choice resulted in males having a higher rate of reinforcement than females. Consistent with this, there was some evidence that females deviated from the optimal more, leading to less reward. Measures of reward maximization were only weakly associated with traditional DD measures and may represent distinctive underlying processes. Taken together, females performance differed from males with regard to reward maximization that were not observed utilizing traditional measures of DD, suggesting that the patch depletion model was more sensitive to modest sex differences when compared to traditional DD measures in a large sample of HS rats.
Collapse
|
3
|
Downey H, Haynes JM, Johnson HM, Odum AL. Deprivation Has Inconsistent Effects on Delay Discounting: A Review. Front Behav Neurosci 2022; 16:787322. [PMID: 35221945 PMCID: PMC8867822 DOI: 10.3389/fnbeh.2022.787322] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Accepted: 01/11/2022] [Indexed: 11/15/2022] Open
Abstract
Delay discounting, the tendency for outcomes to be devalued as they are more temporally remote, has implications as a target for behavioral interventions. Because of these implications, it is important to understand how different states individuals may face, such as deprivation, influence the degree of delay discounting. Both dual systems models and state-trait views of delay discounting assume that deprivation may result in steeper delay discounting. Despite early inconsistencies and mixed results, researchers have sometimes asserted that deprivation increases delay discounting, with few qualifications. The aim of this review was to determine what empirical effect, if any, deprivation has on delay discounting. We considered many kinds of deprivation, such as deprivation from sleep, drugs, and food in humans and non-human animals. For 23 studies, we analyzed the effect of deprivation on delay discounting by computing effect sizes for the difference between delay discounting in a control, or baseline, condition and delay discounting in a deprived state. We discuss these 23 studies and other relevant studies found in our search in a narrative review. Overall, we found mixed effects of deprivation on delay discounting. The effect may depend on what type of deprivation participants faced. Effect sizes for deprivation types ranged from small for sleep deprivation (Hedge's gs between −0.21 and 0.07) to large for opiate deprivation (Hedge's gs between 0.42 and 1.72). We discuss possible reasons why the effect of deprivation on delay discounting may depend on deprivation type, including the use of imagined manipulations and deprivation intensity. The inconsistency in results across studies, even when comparing within the same type of deprivation, indicates that more experiments are needed to reach a consensus on the effects of deprivation on delay discounting. A basic understanding of how states affect delay discounting may inform translational efforts.
Collapse
Affiliation(s)
- Haylee Downey
- Odum Laboratory, Department of Psychology, Utah State University, Logan, UT, United States
- Translational Biology Medicine and Health Graduate Program, Virginia Tech, Blacksburg, VA, United States
| | - Jeremy M. Haynes
- Odum Laboratory, Department of Psychology, Utah State University, Logan, UT, United States
| | - Hannah M. Johnson
- Odum Laboratory, Department of Psychology, Utah State University, Logan, UT, United States
| | - Amy L. Odum
- Odum Laboratory, Department of Psychology, Utah State University, Logan, UT, United States
- *Correspondence: Amy L. Odum
| |
Collapse
|
4
|
Valentina S, Blasio A, Ferragud A, Quadir SG, Iyer MR, Rice KC, Cottone P. Characterization of a differential reinforcement of low rates of responding task in non-deprived male and female rats: Role of Sigma-1 receptors. Neuropharmacology 2021; 200:108786. [PMID: 34516984 PMCID: PMC9869339 DOI: 10.1016/j.neuropharm.2021.108786] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2021] [Revised: 08/25/2021] [Accepted: 09/06/2021] [Indexed: 01/26/2023]
Abstract
Impulsive action can be defined as the inability to withhold a response and represents one of the dimensions of the broad construct impulsivity. Here, we characterized a modified differential reinforcement of low rates of responding (DRL) task developed in our laboratory, in which impulsive action is measured in ad libitum fed/watered subjects. Specifically, we first determined the effects of both sex and estrous cycle on impulsive action by systematically comparing male and estrous-synchronized female subjects. In addition, we evaluated the convergent validity of this modified DRL task by testing the effects of the D2R/5HT2AR antagonist, aripiprazole, and the noncompetitive NMDAR antagonist, MK-801. Finally, we tested the effects of the selective antagonist BD-1063 and agonist PRE-084 of Sigma-1 receptor (Sig-1R) on impulsive action using this modified DRL task. We found that female rats showed and increased inability to withhold a response when compared to males, and this effect was driven by the metestrus/diestrus phase of the estrous cycle. In addition, aripiprazole and MK-801 fully retained their capability to reduce and increase impulsive action, respectively. Finally, the selective Sig-1R antagonist, BD-1063 dose-dependently reduced the inability to withhold a response in both sexes, though more potently in female rats. In summary, we show that impulsive action, as measured in a modified DRL task which minimizes energy-homeostatic influences, is a function of both sex and estrous cycle. Furthermore, we validate the convergent validity of the task and provide evidence that Sig-1R antagonism may represent a novel pharmacological strategy to reduce impulsive action.
Collapse
Affiliation(s)
- Sabino Valentina
- Laboratory of Addictive Disorders, Departments of Pharmacology and Psychiatry, Boston University School of Medicine, Boston, MA, USA.
| | - Angelo Blasio
- Laboratory of Addictive Disorders, Departments of Pharmacology and Psychiatry, Boston University School of Medicine, Boston, MA, USA
| | - Antonio Ferragud
- Laboratory of Addictive Disorders, Departments of Pharmacology and Psychiatry, Boston University School of Medicine, Boston, MA, USA
| | - Sema G Quadir
- Laboratory of Addictive Disorders, Departments of Pharmacology and Psychiatry, Boston University School of Medicine, Boston, MA, USA
| | - Malliga R Iyer
- Section on Medicinal Chemistry, National Institute on Alcohol Abuse and Alcoholism, Bethesda, MD, USA
| | - Kenner C Rice
- Drug Design and Synthesis, National Institute on Drug Abuse and National Institute on Alcohol Abuse and Alcoholism, Bethesda, MD, USA
| | - Pietro Cottone
- Laboratory of Addictive Disorders, Departments of Pharmacology and Psychiatry, Boston University School of Medicine, Boston, MA, USA.
| |
Collapse
|
5
|
Carroll ME, Lynch WJ. How to study sex differences in addiction using animal models. Addict Biol 2016; 21:1007-29. [PMID: 27345022 PMCID: PMC4970981 DOI: 10.1111/adb.12400] [Citation(s) in RCA: 52] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2016] [Revised: 02/17/2016] [Accepted: 02/27/2016] [Indexed: 11/30/2022]
Abstract
The importance of studying sex as a biological variable in biomedical research is becoming increasingly apparent. There is a particular need in preclinical studies of addiction to include both sexes, as female animals are often excluded from studies, leaving large gaps in our knowledge of not only sex differences and potential prevention and treatment strategies but also with regard to the basic neurobiology of addiction. This review focuses on methodology that has been developed in preclinical studies to examine sex differences in the behavioral aspects and neurobiological mechanisms related to addiction across the full range of the addiction process, including initiation (acquisition), maintenance, escalation, withdrawal, relapse to drug seeking and treatment. This review also discusses strategic and technical issues that need to be considered when comparing females and males, including the role of ovarian hormones and how sex differences interact with other major vulnerability factors in addiction, such as impulsivity, compulsivity and age (adolescent versus adult). Novel treatments for addiction are also discussed, such as competing non-drug rewards, repurposed medications such as progesterone and treatment combinations. Practical aspects of conducting research comparing female and male animals are also considered. Making sex differences a point of examination requires additional effort and consideration; however, such studies are necessary given mounting evidence demonstrating that the addiction process occurs differently in males and females. These studies should lead to a better understanding of individual differences in the development of addiction and effective treatments for males and females.
Collapse
Affiliation(s)
- Marilyn E. Carroll
- Marilyn E. Carroll, Department of Psychiatry, University of Minnesota, MMC 392, Minneapolis, MN, USA
| | - Wendy J. Lynch
- Wendy J. Lynch, Department of Psychiatry and Neurobehavioral Sciences, University of Virginia, PO Box 801402, Charlottesville, VA
| |
Collapse
|
6
|
Carroll ME, Collins M, Kohl EA, Johnson S, Dougen B. Sex and menstrual cycle effects on chronic oral cocaine self-administration in rhesus monkeys: Effects of a nondrug alternative reward. Psychopharmacology (Berl) 2016; 233:2973-84. [PMID: 27318989 PMCID: PMC4935578 DOI: 10.1007/s00213-016-4343-5] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/01/2016] [Accepted: 05/20/2016] [Indexed: 12/14/2022]
Abstract
BACKGROUND In previous studies, female monkeys self-administered more oral phencyclidine (PCP) than males, and PCP intake differed by phase of menstrual cycle. OBJECTIVES The purpose of this study was to examine sex and hormonal influences on oral cocaine self-administration in male and female rhesus monkeys in the follicular vs. luteal phases of the menstrual cycle, with concurrent access to an alternative nondrug reward, saccharin (SACC) vs. water. MATERIALS AND METHODS Concurrent access to cocaine (0.2, 0.4, and 0.8 mg/ml) and SACC or water was available from two drinking spouts under concurrent fixed-ratio (FR) 2, 4, and 8 schedules during daily 3-h sessions. RESULTS Cocaine deliveries were similar in males and females in the females' luteal phase, but cocaine deliveries were higher in females during the follicular phase than the luteal phase and compared to males. When SACC was available, cocaine deliveries were reduced in females in the follicular phase of the cycle, and cocaine intake (mg/kg) was reduced in males and in females' follicular and luteal phases. CONCLUSIONS Access to concurrent SACC (vs. water) reduced cocaine intake (mg/kg) in males and in females during both menstrual phases, and the magnitude of the reduction in cocaine intake was greatest during the females' follicular phase. Thus, a nondrug alternative reward, SACC, is a viable alternative treatment for reducing cocaine's rewarding effects on male and female monkeys, and reductions in cocaine seeking were optimal in the females' luteal phase.
Collapse
Affiliation(s)
- Marilyn E Carroll
- Department of Psychiatry, University of Minnesota, MMC 392, Minneapolis, MN, 55455, USA.
| | - Molly Collins
- Department of Psychiatry, University of Minnesota, MMC 392, Minneapolis, MN, 55455, USA
| | - Emily A Kohl
- Department of Psychiatry, University of Minnesota, MMC 392, Minneapolis, MN, 55455, USA
| | - Seth Johnson
- Department of Psychiatry, University of Minnesota, MMC 392, Minneapolis, MN, 55455, USA
| | - Ben Dougen
- Department of Psychiatry, University of Minnesota, MMC 392, Minneapolis, MN, 55455, USA
| |
Collapse
|
7
|
Is Impulsivity a Male Trait Rather than Female Trait? Exploring the Sex Difference in Impulsivity. Curr Behav Neurosci Rep 2015. [DOI: 10.1007/s40473-015-0031-8] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
8
|
Hosseini-Kamkar N, Morton JB. Sex differences in self-regulation: an evolutionary perspective. Front Neurosci 2014; 8:233. [PMID: 25140126 PMCID: PMC4121536 DOI: 10.3389/fnins.2014.00233] [Citation(s) in RCA: 37] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2014] [Accepted: 07/15/2014] [Indexed: 11/29/2022] Open
Abstract
Bjorklund and Kipp (1996) provide an evolutionary framework predicting that there is a female advantage in inhibition and self-regulation due to differing selection pressures placed on males and females. The majority of the present review will summarize sex differences in self-regulation at the behavioral level. The neural and hormonal underpinnings of this potential sexual dimorphism will also be investigated and the results of the experiments summarized will be related to the hypothesis advanced by Bjorklund and Kipp (1996). Paradoxically, sex differences in self-regulation are more consistently reported in children prior to the onset of puberty. In adult cohorts, the results of studies examining sex differences in self-regulation are mixed. A few recent experiments suggesting that females are less impulsive than males only during fertile stages of the menstrual cycle will be reviewed. A brief discussion of an evolutionary framework proposing that it is adaptive for females to employ a self-regulatory behavioral strategy when fertile will follow.
Collapse
Affiliation(s)
- Niki Hosseini-Kamkar
- Cognitive Development and Neuroimaging Laboratory, Department of Psychology, The University of Western Ontario London, ON, Canada
| | - J Bruce Morton
- Cognitive Development and Neuroimaging Laboratory, Department of Psychology, The University of Western Ontario London, ON, Canada
| |
Collapse
|
9
|
Barnes SA, Der-Avakian A, Markou A. Anhedonia, avolition, and anticipatory deficits: assessments in animals with relevance to the negative symptoms of schizophrenia. Eur Neuropsychopharmacol 2014; 24:744-58. [PMID: 24183826 PMCID: PMC3986268 DOI: 10.1016/j.euroneuro.2013.10.001] [Citation(s) in RCA: 42] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/24/2013] [Revised: 07/30/2013] [Accepted: 10/05/2013] [Indexed: 12/11/2022]
Abstract
Schizophrenia represents a complex, heterogeneous disorder characterized by several symptomatic domains that include positive and negative symptoms and cognitive deficits. Negative symptoms reflect a cluster of symptoms that remains therapeutically unresponsive to currently available medications. Therefore, the development of animal models that may contribute to the discovery of novel and efficacious treatment strategies is essential. An animal model consists of both an inducing condition or manipulation (i.e., independent variable) and an observable measure(s) (i.e., dependent variables) that are used to assess the construct(s) under investigation. The objective of this review is to describe currently available experimental procedures that can be used to characterize constructs relevant to the negative symptoms of schizophrenia in experimental animals. While negative symptoms can encompass aspects of social withdrawal and emotional blunting, this review focuses on the assessment of reward deficits that result in anhedonia, avolition, and abnormal reward anticipation. The development and utilization of animal procedures that accurately assess reward-based constructs related to negative symptomatology in schizophrenia will provide an improved understanding of the neural substrates involved in these processes.
Collapse
Affiliation(s)
- Samuel A Barnes
- Department of Psychiatry, School of Medicine, University of California San Diego, La Jolla, CA 92093-0603, USA
| | - Andre Der-Avakian
- Department of Psychiatry, School of Medicine, University of California San Diego, La Jolla, CA 92093-0603, USA
| | - Athina Markou
- Department of Psychiatry, School of Medicine, University of California San Diego, La Jolla, CA 92093-0603, USA.
| |
Collapse
|