1
|
Smith T, Fitch A, Deavours A, Kirkpatrick K. Active and passive waiting in impulsive choice: Effects of fixed-interval and fixed-time delays. Learn Behav 2024; 52:249-261. [PMID: 38216839 PMCID: PMC11239795 DOI: 10.3758/s13420-023-00622-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/19/2023] [Indexed: 01/14/2024]
Abstract
Behavioral interventions to improve self-control, preference for a larger-later (LL) reward over a smaller-sooner (SS) reward, involve experience with delayed rewards. Whether they involve timing processes remains controversial. In rats, there have been inconsistent results on whether timing processes may be involved in intervention-induced improvements in self-control. Interventions that improved self-control with corresponding timing improvements used fixed-interval (FI) delays, whereas interventions that failed to find corresponding timing improvements used fixed-time (FT) delays. The FI schedule includes a response contingency (active waiting), whereas the FT schedule delivers reward automatically (passive waiting). The present study compared the effects of FI and FT schedules in interventions and impulsive choice tasks to evaluate effects on self-control and timing behavior. The impulsive choice task evaluated preference for an SS option (one pellet after 10-, 15-, 20-, 25-, and 30-s delays) versus an LL option (two pellets after a 30-s delay). The intervention task included forced-choice SS (one pellet after 10 s) and LL (two pellets after 30 s) sessions under FI or FT schedules. FI schedules produced greater sensitivity to SS delay in the impulsive choice task. Both FI and FT interventions increased LL choices. Following choice testing, temporal bisection and peak interval tasks revealed better timing precision for rats with an FI delay experience. Overall, the FI choice contingency was associated with improved temporal attention and timing precision.
Collapse
Affiliation(s)
- Travis Smith
- Department of Psychological Sciences, Kansas State University, 492 Bluemont Hall, 1114 Mid-Campus Drive N., Manhattan, KS, 66506, USA.
| | - Anderson Fitch
- Department of Psychological Sciences, Kansas State University, 492 Bluemont Hall, 1114 Mid-Campus Drive N., Manhattan, KS, 66506, USA
| | - Aubrey Deavours
- Department of Psychological Sciences, Kansas State University, 492 Bluemont Hall, 1114 Mid-Campus Drive N., Manhattan, KS, 66506, USA
| | - Kimberly Kirkpatrick
- Department of Psychological Sciences, Kansas State University, 492 Bluemont Hall, 1114 Mid-Campus Drive N., Manhattan, KS, 66506, USA
| |
Collapse
|
2
|
Koloski MF, Terry A, Lee N, Ramanathan DS. Methylphenidate, but not citalopram, decreases impulsive choice in rats performing a temporal discounting task. Front Psychiatry 2024; 15:1385502. [PMID: 38779546 PMCID: PMC11109432 DOI: 10.3389/fpsyt.2024.1385502] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/12/2024] [Accepted: 04/23/2024] [Indexed: 05/25/2024] Open
Abstract
Introduction Drugs targeting monoamine systems remain the most common treatment for disorders with impulse control impairments. There is a body of literature suggesting that drugs affecting serotonin reuptake and dopamine reuptake can modulate distinct aspects of impulsivity - though such tests are often performed using distinct behavioral tasks prohibiting easy comparisons. Methods Here, we directly compare pharmacologic agents that affect dopamine (methylphenidate) vs serotonin (citalopram) manipulations on choice impulsivity in a temporal discounting task where rats could choose between a small, immediate reward or a large reward delayed at either 2 or 10s. In control conditions, rats preferred the large reward at a small (2s) delay and discounted the large reward at a long (10s) delay. Results Methylphenidate, a dopamine transport inhibitor that blocks reuptake of dopamine, dose-dependently increased large reward preference in the long delay (10s) block. Citalopram, a selective serotonin reuptake inhibitor, had no effect on temporal discounting behavior. Impulsive behavior on the temporal discounting task was at least partially mediated by the nucleus accumbens shell. Bilateral lesions to the nucleus accumbens shell reduced choice impulsivity during the long delay (10s) block. Following lesions, methylphenidate did not impact impulsivity. Discussion Our results suggest that striatal dopaminergic systems modulate choice impulsivity via actions within the nucleus accumbens shell, whereas serotonin systems may regulate different aspects of behavioral inhibition/impulsivity.
Collapse
Affiliation(s)
- Miranda F. Koloski
- Mental Health, VA San Diego Medical Center, San Diego, CA, United States
- Center of Excellence for Stress and Mental Health, VA San Diego Medical Center, San Diego, CA, United States
- Department of Psychiatry, University of California-San Diego, San Diego, CA, United States
| | - Alyssa Terry
- Mental Health, VA San Diego Medical Center, San Diego, CA, United States
| | - Noelle Lee
- Mental Health, VA San Diego Medical Center, San Diego, CA, United States
| | - Dhakshin S. Ramanathan
- Mental Health, VA San Diego Medical Center, San Diego, CA, United States
- Center of Excellence for Stress and Mental Health, VA San Diego Medical Center, San Diego, CA, United States
- Department of Psychiatry, University of California-San Diego, San Diego, CA, United States
| |
Collapse
|
3
|
Smith TR, Southern R, Kirkpatrick K. Mechanisms of impulsive choice: Experiments to explore and models to map the empirical terrain. Learn Behav 2023; 51:355-391. [PMID: 36913144 PMCID: PMC10497727 DOI: 10.3758/s13420-023-00577-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/16/2023] [Indexed: 03/14/2023]
Abstract
Impulsive choice is preference for a smaller-sooner (SS) outcome over a larger-later (LL) outcome when LL choices result in greater reinforcement maximization. Delay discounting is a model of impulsive choice that describes the decaying value of a reinforcer over time, with impulsive choice evident when the empirical choice-delay function is steep. Steep discounting is correlated with multiple diseases and disorders. Thus, understanding the processes underlying impulsive choice is a popular topic for investigation. Experimental research has explored the conditions that moderate impulsive choice, and quantitative models of impulsive choice have been developed that elegantly represent the underlying processes. This review spotlights experimental research in impulsive choice covering human and nonhuman animals across the domains of learning, motivation, and cognition. Contemporary models of delay discounting designed to explain the underlying mechanisms of impulsive choice are discussed. These models focus on potential candidate mechanisms, which include perception, delay and/or reinforcer sensitivity, reinforcement maximization, motivation, and cognitive systems. Although the models collectively explain multiple mechanistic phenomena, there are several cognitive processes, such as attention and working memory, that are overlooked. Future research and model development should focus on bridging the gap between quantitative models and empirical phenomena.
Collapse
|
4
|
Blejewski RC, Van Heukelom JT, Langford JS, Hunt KH, Rinkert IR, Wagner TJ, Pitts RC, Hughes CE. Behavioral mechanisms of oxycodone's effects in female and male rats: Reinforcement delay and impulsive choice. Exp Clin Psychopharmacol 2023; 31:1050-1068. [PMID: 37199913 PMCID: PMC10656366 DOI: 10.1037/pha0000646] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 05/19/2023]
Abstract
μ-Opioid agonists (e.g., morphine) typically increase impulsive choice, which has been interpreted as an opioid-induced increase in sensitivity to reinforcement delay. Relatively little research has been done with opioids other than morphine (e.g., oxycodone), or on sex differences in opioid effects, on impulsive choice. The present study investigated the effects of acute (0.1-1.0 mg/kg) and chronic (1.0 mg/kg twice/day) administration of oxycodone on choice controlled by reinforcement delay, a primary mechanism implicated in impulsive choice, in female and male rats. Rats responded under a concurrent-chains procedure designed to quantify the effects of reinforcement delay on choice within each session. For both sexes, choice was sensitive to delay under this procedure. Sensitivity to delay under baseline was slightly higher for males than females, suggesting more impulsive choice with males. When given acutely, intermediate and higher doses of oxycodone decreased sensitivity to delay; this effect was larger and more reliable in males than females. When given chronically, sex differences were also observed: tolerance developed to the sensitivity-decreasing effects in females, whereas sensitization developed in males. These data suggest that reinforcement delay may play an important role in sex differences in impulsive choice, as well as in the effects of acute and chronic administration of opioids in impulsive choice. However, drug-induced changes in impulsive choice could be related to at least two potential behavioral mechanisms: reinforcement delay and/or reinforcement magnitude. Effects of oxycodone on sensitivity to reinforcement magnitude remain to be fully characterized. (PsycInfo Database Record (c) 2023 APA, all rights reserved).
Collapse
Affiliation(s)
| | | | - Jeremy S. Langford
- Department of Psychology, University of North Carolina Wilmington
- Department of Psychology, West Virginia University
| | - Katelyn H. Hunt
- Department of Psychology, University of North Carolina Wilmington
| | | | - Thomas J. Wagner
- Department of Psychology, University of North Carolina Wilmington
| | - Raymond C. Pitts
- Department of Psychology, University of North Carolina Wilmington
| | | |
Collapse
|
5
|
Wenzel JM, Zlebnik NE, Patton MH, Smethells JR, Ayvazian VM, Dantrassy HM, Zhang LY, Mathur BN, Cheer JF. Selective chemogenetic inactivation of corticoaccumbal projections disrupts trait choice impulsivity. Neuropsychopharmacology 2023; 48:1821-1831. [PMID: 37208501 PMCID: PMC10579332 DOI: 10.1038/s41386-023-01604-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/12/2022] [Revised: 05/02/2023] [Accepted: 05/05/2023] [Indexed: 05/21/2023]
Abstract
Impulsive choice has enduring trait-like characteristics and is defined by preference for small immediate rewards over larger delayed ones. Importantly, it is a determining factor in the development and persistence of substance use disorder (SUD). Emerging evidence from human and animal studies suggests frontal cortical regions exert influence over striatal reward processing areas during decision-making in impulsive choice or delay discounting (DD) tasks. The goal of this study was to examine how these circuits are involved in decision-making in animals with defined trait impulsivity. To this end, we trained adolescent male rats to stable behavior on a DD procedure and then re-trained them in adulthood to assess trait-like, conserved impulsive choice across development. We then used chemogenetic tools to selectively and reversibly target corticostriatal projections during performance of the DD task. The prelimbic region of the medial prefrontal cortex (mPFC) was injected with a viral vector expressing inhibitory designer receptors exclusively activated by designer drugs (Gi-DREADD), and then mPFC projections to the nucleus accumbens core (NAc) were selectively suppressed by intra-NAc administration of the Gi-DREADD actuator clozapine-n-oxide (CNO). Inactivation of the mPFC-NAc projection elicited a robust increase in impulsive choice in rats with lower vs. higher baseline impulsivity. This demonstrates a fundamental role for mPFC afferents to the NAc during choice impulsivity and suggests that maladaptive hypofrontality may underlie decreased executive control in animals with higher levels of choice impulsivity. Results such as these may have important implications for the pathophysiology and treatment of impulse control, SUDs, and related psychiatric disorders.
Collapse
Affiliation(s)
- Jennifer M Wenzel
- Department of Anatomy and Neurobiology, University of Maryland School of Medicine, Baltimore, MD, 21201, USA.
- Department of Psychological Sciences, University of San Diego, San Diego, CA, 92110, USA.
| | - Natalie E Zlebnik
- Department of Anatomy and Neurobiology, University of Maryland School of Medicine, Baltimore, MD, 21201, USA.
- Division of Biomedical Sciences, University of California, Riverside School of Medicine, Riverside, CA, 92521, USA.
| | - Mary H Patton
- Department of Pharmacology, University of Maryland School of Medicine, Baltimore, MD, 21201, USA
- St. Jude Children's Research Hospital, Memphis, TN, 38105, USA
| | - John R Smethells
- Hennepin Healthcare Research Institute, Minneapolis, MN, 55404, USA
| | - Victoria M Ayvazian
- Department of Anatomy and Neurobiology, University of Maryland School of Medicine, Baltimore, MD, 21201, USA
| | - Hannah M Dantrassy
- Department of Anatomy and Neurobiology, University of Maryland School of Medicine, Baltimore, MD, 21201, USA
| | - Lan-Yuan Zhang
- Department of Anatomy and Neurobiology, University of Maryland School of Medicine, Baltimore, MD, 21201, USA
| | - Brian N Mathur
- Department of Psychiatry, University of Maryland School of Medicine, Baltimore, MD, 21201, USA
- Department of Pharmacology, University of Maryland School of Medicine, Baltimore, MD, 21201, USA
| | - Joseph F Cheer
- Department of Anatomy and Neurobiology, University of Maryland School of Medicine, Baltimore, MD, 21201, USA
- Department of Psychiatry, University of Maryland School of Medicine, Baltimore, MD, 21201, USA
| |
Collapse
|
6
|
Gancarz AM, Mitchell SH, George AM, Martin CD, Turk MC, Bool HM, Aktar F, Kwarteng F, Palmer AA, Meyer PJ, Richards JB, Dietz DM, Ishiwari K. Reward maximization assessed using a sequential patch depletion task in a large sample of heterogeneous stock rats. Sci Rep 2023; 13:7027. [PMID: 37120610 PMCID: PMC10148848 DOI: 10.1038/s41598-023-34179-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2023] [Accepted: 04/25/2023] [Indexed: 05/01/2023] Open
Abstract
Choice behavior requires animals to evaluate both short- and long-term advantages and disadvantages of all potential alternatives. Impulsive choice is traditionally measured in laboratory tasks by utilizing delay discounting (DD), a paradigm that offers a choice between a smaller immediate reward, or a larger more delayed reward. This study tested a large sample of Heterogeneous Stock (HS) male (n = 896) and female (n = 898) rats, part of a larger genetic study, to investigate whether measures of reward maximization overlapped with traditional models of delay discounting via the patch depletion model using a Sequential Patch Depletion procedure. In this task, rats were offered a concurrent choice between two water "patches" and could elect to "stay" in the current patch or "leave" for an alternative patch. Staying in the current patch resulted in decreasing subsequent reward magnitudes, whereas the choice to leave a patch was followed by a delay and a resetting to the maximum reward magnitude. Based on the delay in a given session, different visit durations were necessary to obtain the maximum number of rewards. Visit duration may be analogous to an indifference point in traditional DD tasks. Males and females did not significantly differ on traditional measures of DD (e.g. delay gradient; AUC). When examining measures of patch utilization, females made fewer patch changes at all delays and spent more time in the patch before leaving for the alternative patch compared to males. Consistent with this, there was some evidence that females deviated from reward maximization more than males. However, when controlling for body weight, females had a higher normalized rate of reinforcement than males. Measures of reward maximization were only weakly associated with traditional DD measures and may represent distinctive underlying processes. Taken together, females performance differed from males with regard to reward maximization that were not observed utilizing traditional measures of DD, suggesting that the patch depletion model was more sensitive to modest sex differences when compared to traditional DD measures in a large sample of HS rats.
Collapse
Affiliation(s)
- Amy M Gancarz
- Department of Psychology, California State University, Bakersfield, Bakersfield, CA, 93311, USA.
| | - Suzanne H Mitchell
- Department of Behavioral Neuroscience, Oregon Health & Science University, Portland, OR, 97239, USA
- Department of Psychiatry, Oregon Health & Science University, Portland, OR, 97239, USA
- Oregon Institute for Occupational Health Sciences, Oregon Health & Science University, Portland, OR, 97239, USA
| | - Anthony M George
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA
| | - Connor D Martin
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA
| | - Marisa C Turk
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA
| | - Heather M Bool
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA
| | - Fahmida Aktar
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA
| | - Francis Kwarteng
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA
| | - Abraham A Palmer
- Department of Psychiatry, University of California San Diego, La Jolla, CA, 92093, USA
- Institute for Genomic Medicine, University of California San Diego, La Jolla, CA, 92093, USA
| | - Paul J Meyer
- Department of Psychology, University at Buffalo, Buffalo, NY, 14260, USA
| | - Jerry B Richards
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA
| | - David M Dietz
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA
| | - Keita Ishiwari
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA.
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA.
| |
Collapse
|
7
|
Truckenbrod LM, Cooper EM, Orsini CA. Cognitive mechanisms underlying decision making involving risk of explicit punishment in male and female rats. COGNITIVE, AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2023; 23:248-275. [PMID: 36539558 PMCID: PMC10065932 DOI: 10.3758/s13415-022-01052-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 11/29/2022] [Indexed: 12/24/2022]
Abstract
Individuals engage in the process of risk-based decision making on a daily basis to navigate various aspects of life. There are, however, individual differences in this form of decision making, with some individuals exhibiting preference for riskier choices (risk taking) and others exhibiting preference for safer choices (risk aversion). Recent work has shown that extremes in risk taking (e.g., excessive risk taking or risk aversion) are not only cognitive features of neuropsychiatric diseases, but may in fact predispose individuals to the development of such diseases. To better understand individual differences in risk taking, and thus the mechanisms by which they confer disease vulnerability, the current study investigated the cognitive contributions to risk taking in both males and females. Rats were first behaviorally characterized in a decision-making task involving risk of footshock punishment and then tested on a battery of cognitive behavioral assays. Individual variability in risk taking was compared with performance on these tasks. Consistent with prior work, females were more risk averse than males. With the exception of the Set-shifting Task, there were no sex differences in performance on other cognitive assays. There were, however, sex-dependent associations between risk taking and specific cognitive measures. Greater risk taking was associated with better cognitive flexibility in males whereas greater risk aversion was associated with better working memory in females. Collectively, these findings reveal that distinct cognitive mechanisms are associated with risk taking in males and females, which may account for sex differences in this form of decision making.
Collapse
Affiliation(s)
- Leah M Truckenbrod
- Institute for Neuroscience, The University of Texas at Austin, Austin, TX, USA
| | - Emily M Cooper
- Department of Psychology, The University of Texas at Austin, Austin, TX, USA
| | - Caitlin A Orsini
- Department of Psychology, The University of Texas at Austin, Austin, TX, USA.
- Department of Neurology, The University of Texas at Austin, Austin, TX, USA.
- Waggoner Center for Alcohol and Addiction Research, The University of Texas at Austin, 1601B Trinity Street, Austin, TX, 78712, USA.
| |
Collapse
|
8
|
Panfil K, Deavours A, Kirkpatrick K. Effects of the estrous cycle on impulsive choice and interval timing in female rats. Horm Behav 2023; 149:105315. [PMID: 36669427 PMCID: PMC9974800 DOI: 10.1016/j.yhbeh.2023.105315] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/17/2022] [Revised: 01/11/2023] [Accepted: 01/12/2023] [Indexed: 01/20/2023]
Abstract
Research in humans and animals shows differences in impulsive choice, which is a failure to wait for larger, delayed rewards, when comparing males and females. It is possible that fluctuations in sex hormones (estradiol and progesterone) across the reproductive cycle contribute to sex differences in impulsive choice. The current study delivered an impulsive choice task with peak interval trials to female rats while estrous cycles, the rodent reproductive cycle, were tracked over the course of the task. Female rats were more sensitive to changes in delay in the proestrus phase of the estrous cycle and made more larger-later choices when in estrus, particularly when the delay to the smaller reward was short. Estradiol increases dramatically during proestrus while progesterone peaks during estrus, suggesting that estradiol and progesterone may affect impulsive choice through mechanisms such as delay discounting, delay aversion, and/or timing processes. Analyses of timing of the choice task delays showed inconsistent effects of the estrous cycle across delays, suggesting that reward-timing interactions may have complicated how hormone fluctuations affected interval timing. Further research is needed to determine the mechanism underlying increased larger-later choices during the estrus phase, increased delay sensitivity during the proestrus phase, and variability in interval timing across delays and estrous cycle stages.
Collapse
Affiliation(s)
- Kelsey Panfil
- Department of Psychological Sciences, Kansas State University, Manhattan, KS 66506, United States of America.
| | - Aubrey Deavours
- Department of Psychological Sciences, Kansas State University, Manhattan, KS 66506, United States of America; Department of Diagnostic Medicine/Pathobiology, Kansas State University, Manhattan, KS 66506, United States of America
| | - Kimberly Kirkpatrick
- Department of Psychological Sciences, Kansas State University, Manhattan, KS 66506, United States of America
| |
Collapse
|
9
|
Gancarz AM, Mitchell SH, George AM, Martin CD, Turk MC, Bool HM, Aktar F, Kwarteng F, Palmer AA, Meyer PJ, Richards JB, Dietz DM, Isiwari K. Reward Maximization Assessed Using a Sequential Patch Depletion Task in a Large Sample of Heterogeneous Stock Rats. RESEARCH SQUARE 2023:rs.3.rs-2525080. [PMID: 36778344 PMCID: PMC9915773 DOI: 10.21203/rs.3.rs-2525080/v1] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
Choice behavior requires animals to evaluate both short- and long-term advantages and disadvantages of all potential alternatives. Impulsive choice is traditionally measured in laboratory tasks by utilizing delay discounting (DD), a paradigm that offers a choice between a smaller immediate reward, or a larger more delayed reward. This study tested a large sample of Heterogeneous Stock (HS) male (n = 896) and female (n = 898) rats, part of a larger genetic study, to investigate whether measures of reward maximization overlapped with traditional models of delay discounting via the patch depletion model using a Sequential Patch Depletion procedure. In this task, rats were offered a concurrent choice between two water "patches" and could elect to "stay" in the current patch or "leave" for an alternative patch. Staying in the current patch resulted in decreasing subsequent reward magnitudes, whereas the choice to leave a patch was followed by a delay and a resetting to the maximum reward magnitude. Based on the delay in a given session, different visit durations were necessary to obtain the maximum number of rewards. Visit duration may be analogous to an indifference point in traditional DD tasks. While differences in traditional DD measures (e.g., delay gradient) have been detected between males and females, these effects were small and inconsistent. However, when examining measures of reward maximization, females made fewer patch changes at all delays and spent more time in the patch before leaving for the alternative patch compared to males. This pattern of choice resulted in males having a higher rate of reinforcement than females. Consistent with this, there was some evidence that females deviated from the optimal more, leading to less reward. Measures of reward maximization were only weakly associated with traditional DD measures and may represent distinctive underlying processes. Taken together, females performance differed from males with regard to reward maximization that were not observed utilizing traditional measures of DD, suggesting that the patch depletion model was more sensitive to modest sex differences when compared to traditional DD measures in a large sample of HS rats.
Collapse
|
10
|
Haynes JM, Willis-Moore ME, Perez D, Cousins DJ, Odum AL. Temporal expectations in delay of gratification. J Exp Anal Behav 2023; 119:59-80. [PMID: 36477783 DOI: 10.1002/jeab.814] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2022] [Revised: 11/16/2022] [Accepted: 11/19/2022] [Indexed: 12/12/2022]
Abstract
We examined how temporal expectations influence preference reversals in a delay of gratification task for rats based on a hypothesis of Rachlin (2000), who suggested that preference for a larger-later reward may shift in favor of a smaller-immediate reward as a result of changes in when that larger reward is expected. To explore Rachlin's hypothesis, we preexposed two groups of rats to the delays associated with a larger-later reinforcer from a delay of gratification task. One group experienced the delays as a function of their choices in an intertemporal choice task and the other group experienced delays yoked from the first group (independent of their behavior) in an exposure training procedure. In addition, we included a third group of rats that were not exposed to delays during preexposure training as a comparison to the other two groups. Overall, the two groups of rats that experienced delays during preexposure training tended to make fewer defection responses than the comparison group during the delay of gratification task. Consistent with Rachlin's hypothesis, our results suggest that temporal learning may influence preference reversals in a delay of gratification task, providing a number of future directions for research in this area.
Collapse
Affiliation(s)
| | | | - D Perez
- Department of Psychology, Utah State University
| | | | - Amy L Odum
- Department of Psychology, Utah State University
| |
Collapse
|
11
|
Peck S, Preston E, Smith KB, Madden GJ. Reducing impulsive choice: VIII. Effects of delay-exposure training in female rats. Behav Processes 2022; 197:104622. [PMID: 35301066 PMCID: PMC9013280 DOI: 10.1016/j.beproc.2022.104622] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2021] [Revised: 03/06/2022] [Accepted: 03/10/2022] [Indexed: 11/19/2022]
Abstract
Impulsive choice may play an important role in serious health-related decisions, like addiction tendencies. Thus, there is merit in exploring interventions that reduce impulsive choice. Delay-exposure training involves extended experience with delayed reinforcement. Following training, delay-exposed rats make fewer impulsive choices than control rats. The reducing effects of delay exposure training on impulsive choice have been replicated in male rats seven times. For the first time, this study evaluated the effects of delay exposure training in female rats. Thirty-six rats were randomly assigned to either delay-exposure or immediacy-exposure training. Then, rats underwent two impulsive choice assessments in which they chose between one immediate pellet or three delayed pellets. In the first assessment, delays increased within-sessions, across trial blocks from 0, 8, 16, to 32 s. In the second assessment, delays to the larger reward increased between-sessions, from 8, 16, 32, to 4 s. Unlike findings with male rats, delay-exposure training produced a reduction in impulsive choice only in the initial five sessions in female rats. Possible reasons for the lack of lasting effect in female rats are discussed and future research directions are identified.
Collapse
Affiliation(s)
- Sara Peck
- Department of Psychology, Utah State University, United States.
| | - Emma Preston
- Department of Special Education, Utah State University, United States
| | - Kelsey B Smith
- Department of Psychology, Utah State University, United States
| | | |
Collapse
|
12
|
Smith TR, Panfil K, Kirkpatrick K. Generalizability of time-based interventions: Effects of choice procedure and smaller-sooner delay. Behav Processes 2022; 196:104584. [PMID: 35033629 PMCID: PMC8897259 DOI: 10.1016/j.beproc.2022.104584] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2021] [Revised: 12/20/2021] [Accepted: 01/10/2022] [Indexed: 12/31/2022]
Abstract
Interventions exposing rats to delayed-reward contingencies attenuate suboptimal impulsive choices, a preference for a smaller-sooner (SS) over a larger-later (LL) reward. Interventions may potentially improve delay-tolerance, timing of delays, and/or discrimination of reward magnitudes. Generalization from the intervention to impulsive choice under different procedures can provide insights into the processes that underlie the intervention effects. Experiment 1 tested intervention effects on systematic-delay (SYS) and adjusting-delay (ADJ) procedures, predicting that intervention effects would be more effective on the SYS procedure with predictable delays. The ADJ procedure did not benefit significantly from intervention, but the SYS procedure, unexpectedly, showed greater impulsive choices following intervention. Experiment 2 tested whether short (5 s) SS intervention delays may have promoted greater impulsivity in the SYS impulsive choice procedure in Experiment 1. Short SS delays in choice and intervention procedures increased impulsive choices in comparison to longer (10 s) delays. Incongruent SS delays in the intervention/choice procedures resulted in negative intervention effects. The results suggest that short SS delays are detrimental to self-control and that specific temporal information generalizes from the intervention to the SYS choice task, but not the ADJ choice task.
Collapse
Affiliation(s)
| | - Kelsey Panfil
- Department of Psychological Sciences, Kansas State University, Manhattan, KS 66506, United States.
| | - Kimberly Kirkpatrick
- Department of Psychological Sciences, Kansas State University, Manhattan, KS 66506, United States.
| |
Collapse
|
13
|
Fox AE. Effects of immediate-reinforcement training on delay discounting behavior in rats. J Exp Anal Behav 2021; 117:53-68. [PMID: 34734647 DOI: 10.1002/jeab.727] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2021] [Revised: 10/13/2021] [Accepted: 10/14/2021] [Indexed: 12/21/2022]
Abstract
Chronic exposure to delayed reinforcement has been shown to increase choice for larger, later reinforcement in a subsequent delay discounting task. In the 3 experiments presented in this paper, the opposite was tested: effects of chronic exposure to immediate reinforcement on choice in a subsequent delay discounting task. In Experiment 1, larger, later reinforcement choice was significantly reduced as a result of exposure to immediate reinforcement, compared to a maturation/handle control group, in experienced, male Lewis rats. In Experiment 2, with naive male and female Wistar rats, and Experiment 3, with naïve male Long Evans rats, the impact of exposure to immediate reinforcement was less robust, but directionally consistent with results from Experiment 1. These results align with some previous work reporting that exposure to immediate reinforcement may decrease choice for larger, later reinforcement in a delay discounting task, and/or blunt maturational increases in choice for larger, later reinforcement. These findings have implications for future research investigating experience-based interventions to manipulate delay discounting behavior. They also have clinical implications for understanding and treating disorders involving maladaptive choice.
Collapse
|
14
|
Bailey C, Panfil K, Kirkpatrick K. Hazard function effects on promoting self-control in variable interval time-based interventions in rats. J Exp Anal Behav 2021; 116:279-299. [PMID: 34669191 DOI: 10.1002/jeab.722] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2021] [Revised: 08/09/2021] [Accepted: 09/23/2021] [Indexed: 11/10/2022]
Abstract
The present experiments investigated properties of time-based interventions used to increase self-control. Rats received impulsive-choice assessments before and after interventions that consisted of different distributions of delays to reinforcement. In Experiment 1, rats received an intervention with an increasing hazard function where delays were more evenly distributed, a decreasing hazard function where delays were mostly short, or a constant hazard function where delays were exponentially distributed. Surprisingly, rats that received the decreasing hazard function made the most self-controlled choices. Response rates during intervention trials showed that rats anticipated reinforcement based on the shape of the distributions they received. In Experiment 2, rats received an intervention with a decreasing hazard function with a steep slope or a shallow slope. Both time-based interventions increased self-control and produced similar response-rate patterns, indicating that the slope of the decreasing hazard function may not play a strong role in intervention efficacy. While this research aligns with previous literature showing that time-based interventions improved self-control, exposure to short delays produced the biggest improvements. Ultimately, exposure to short delays may increase the subjective value of the larger-later choice while occasional long delays may promote the ability to wait, which may have important implications for translational applications.
Collapse
Affiliation(s)
- Carrie Bailey
- Department of Psychology, University of Missouri-Kansas City.,Department of Psychological Sciences, Kansas State University
| | - Kelsey Panfil
- Department of Psychological Sciences, Kansas State University
| | | |
Collapse
|
15
|
Lukinova E, Erlich JC. Quantifying the contribution of individual variation in timing to delay-discounting. Sci Rep 2021; 11:18354. [PMID: 34526520 PMCID: PMC8443764 DOI: 10.1038/s41598-021-97496-w] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2021] [Accepted: 08/19/2021] [Indexed: 12/03/2022] Open
Abstract
Delay-discounting studies in neuroscience, psychology, and economics have been mostly focused on concepts of self-control, reward evaluation, and discounting. Another important relationship to consider is the link between intertemporal choice and time perception. We presented 50 college students with timing tasks on the range of seconds to minutes and intertemporal-choice tasks on both the time-scale of seconds and of days. We hypothesized that individual differences in time perception would influence decisions about short experienced delays but not long delays. While we found some evidence that individual differences in internal clock speed account for some unexplained variance between choices across time-horizons, overall our findings suggest a nominal contribution of the altered sense of time in intertemporal choice.
Collapse
Affiliation(s)
- Evgeniya Lukinova
- NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai, 200062, China
- NYU Shanghai, Shanghai, 200122, China
| | - Jeffrey C Erlich
- NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai, 200062, China.
- NYU Shanghai, Shanghai, 200122, China.
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), East China Normal University, Shanghai, 200062, China.
| |
Collapse
|
16
|
Impact of Light–Dark Phase on Delay Discounting Behavior in Rats. PSYCHOLOGICAL RECORD 2021. [DOI: 10.1007/s40732-021-00462-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
17
|
Garman TS, Setlow B, Orsini CA. Effects of a high-fat diet on impulsive choice in rats. Physiol Behav 2021; 229:113260. [PMID: 33227243 DOI: 10.1016/j.physbeh.2020.113260] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2020] [Accepted: 11/18/2020] [Indexed: 12/21/2022]
Abstract
INTRODUCTION Obesity and binge eating disorder are associated with high levels of impulsivity, but the causal role of eating and palatable food in these associations is unclear. Studies in rodents show that a high-fat diet can increase one aspect of impulsivity (impulsive action); it is less clear, however, whether a dissociable aspect of impulsivity (impulsive choice) is similarly affected. Hence, the aim of this study was to ascertain whether chronic exposure to a high-fat diet would alter impulsive choice. METHODS Male rats were maintained on either a high-fat or control chow diet for two weeks ad libitum. They then underwent equi-caloric food restriction for the duration of the experiment, with each group maintained on their respective diet. To measure impulsive choice, rats were trained on a delay discounting task (DDT) in which they made discrete choices between a lever that delivered a small food reward immediately and a lever that delivered a large food reward accompanied by systematically increasing delays. Upon reaching stable performance on the DDT, rats were given acute systemic injections of amphetamine prior to testing in the DDT to determine whether increased monoamine transmission affected impulsive choice differently in the two diet groups. Lastly, subjects were tested on a progressive ratio schedule of reinforcement to assess motivation for a sucrose reward. RESULTS There was no significant effect of the high-fat diet on impulsive choice. Further, amphetamine decreased choice of the large, delayed reward (increased impulsive choice) to the same extent in both groups. Exposure to the high-fat diet did, however, increase motivation to obtain a sucrose reward. CONCLUSIONS These experiments reveal that, under conditions that do not promote weight gain, a chronic high-fat diet does not affect impulsive choice in a delay discounting task. The data are surprising in light of findings showing that this same diet alters impulsive action, and highlight the necessity of further research to elucidate relationships between palatable food consumption and impulsivity.
Collapse
Affiliation(s)
| | - Barry Setlow
- Department of Neuroscience; Department of Psychiatry; McKnight Brain Institute; Center for Addiction Research and Education, University of Florida, Gainesville, FL 32610
| | - Caitlin A Orsini
- Department of Psychiatry; McKnight Brain Institute; Department of Psychology, Waggoner Center for Alcoholism and Addiction Research, The University of Texas at Austin, Austin, TX 78712.
| |
Collapse
|
18
|
Hernandez CM, Orsini C, Wheeler AR, Ten Eyck TW, Betzhold SM, Labiste CC, Wright NG, Setlow B, Bizon JL. Testicular hormones mediate robust sex differences in impulsive choice in rats. eLife 2020; 9:58604. [PMID: 32985975 PMCID: PMC7521924 DOI: 10.7554/elife.58604] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2020] [Accepted: 09/09/2020] [Indexed: 01/04/2023] Open
Abstract
Impairments in choosing optimally between immediate and delayed rewards are associated with numerous psychiatric disorders. Such ‘intertemporal’ choice is influenced by genetic and experiential factors; however, the contributions of biological sex are understudied and data to date are largely inconclusive. Rats were used to determine how sex and gonadal hormones influence choices between small, immediate and large, delayed rewards. Females showed markedly greater preference than males for small, immediate over large, delayed rewards (greater impulsive choice). This difference was neither due to differences in food motivation or reward magnitude perception, nor was it affected by estrous cycle. Ovariectomies did not affect choice in females, whereas orchiectomies increased impulsive choice in males. These data show that male rats exhibit less impulsive choice than females and that this difference is at least partly maintained by testicular hormones. These differences in impulsive choice could be linked to gender differences across multiple neuropsychiatric conditions.
Collapse
Affiliation(s)
- Caesar M Hernandez
- Department of Neuroscience, University of Florida, Gainesville, United States.,Department of Psychiatry, University of Florida, Gainesville, United States
| | - Caitlin Orsini
- Department of Psychiatry, University of Florida, Gainesville, United States
| | - Alexa-Rae Wheeler
- Department of Neuroscience, University of Florida, Gainesville, United States
| | - Tyler W Ten Eyck
- Department of Neuroscience, University of Florida, Gainesville, United States
| | - Sara M Betzhold
- Department of Psychiatry, University of Florida, Gainesville, United States
| | - Chase C Labiste
- Department of Neuroscience, University of Florida, Gainesville, United States
| | - Noelle G Wright
- Department of Neuroscience, University of Florida, Gainesville, United States
| | - Barry Setlow
- Department of Psychiatry, University of Florida, Gainesville, United States
| | - Jennifer L Bizon
- Department of Neuroscience, University of Florida, Gainesville, United States
| |
Collapse
|