1
|
Yates JR, Adhikari S, Bako RE, Berling KL, Broderick MR, Mains R, Zwick B. Methamphetamine increases risky choice in rats, but only when magnitude and probability of reinforcement are manipulated within a session. Pharmacol Biochem Behav 2024; 239:173751. [PMID: 38548247 DOI: 10.1016/j.pbb.2024.173751] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Revised: 03/18/2024] [Accepted: 03/20/2024] [Indexed: 05/12/2024]
Abstract
Risky choice is associated with maladaptive behaviors, particularly substance use disorders. Current animal models of risky choice are often confounded by other constructs like behavioral flexibility and suboptimal choice. The purpose of the current experiment was to determine if the psychostimulant methamphetamine, a drug whose popularity has increased in recent years, increases risky choice in an equivalent expected value (EEV) task. In the EEV task, rats are given a choice between two reinforcer alternatives that differ in magnitude and probability of delivery, but have equivalent expected value. Forty-eight Sprague Dawley rats were tested in three versions of the EEV task. In the first version of the EEV task, both reinforcer magnitude and probability were adjusted across blocks of trials for both alternatives. In the second and the third versions of the EEV task, reinforcer magnitude was held constant across each block of trials (either 1 vs. 2 pellets or 4 vs. 5 pellets). We found that male rats preferred the "riskier" option, except when reinforcer magnitudes were held constant at 4 and 5 pellets across each block of trials. Methamphetamine (0.5 mg/kg) increased preference for the risky option in both males and females, but only when both reinforcer magnitude and probability were manipulated across blocks of trials for each alternative. The current results demonstrate that both magnitude of reinforcement and probability of reinforcement interact to influence risky choice. Overall, this study provides additional support for using reinforcers with expected value to measure risky choice.
Collapse
Affiliation(s)
- Justin R Yates
- Department of Psychological Science, Northern Kentucky University, Highland Heights, KY 41099, United States of America.
| | - Shreeukta Adhikari
- Department of Biological Sciences, Northern Kentucky University, Highland Heights, KY 41099, United States of America
| | - Rayah E Bako
- Department of Psychological Science, Northern Kentucky University, Highland Heights, KY 41099, United States of America
| | - Kevin L Berling
- Department of Biological Sciences, Northern Kentucky University, Highland Heights, KY 41099, United States of America
| | - Maria R Broderick
- Department of Biological Sciences, Northern Kentucky University, Highland Heights, KY 41099, United States of America; Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY 14260, United States of America
| | - Reuben Mains
- Department of Psychological Science, Northern Kentucky University, Highland Heights, KY 41099, United States of America; Department of Biological Sciences, Northern Kentucky University, Highland Heights, KY 41099, United States of America
| | - Bradley Zwick
- Department of Psychological Science, Northern Kentucky University, Highland Heights, KY 41099, United States of America; Department of Biological Sciences, Northern Kentucky University, Highland Heights, KY 41099, United States of America
| |
Collapse
|
2
|
Maddern XJ, Walker LC, Anversa RG, Lawrence AJ, Campbell EJ. Understanding sex differences and the translational value of models of persistent substance use despite negative consequences. Neurobiol Learn Mem 2024; 213:107944. [PMID: 38825163 DOI: 10.1016/j.nlm.2024.107944] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2024] [Revised: 05/14/2024] [Accepted: 05/27/2024] [Indexed: 06/04/2024]
Abstract
Persistent substance use despite negative consequences is a key facet of substance use disorder. The last decade has seen the preclinical field adopt the use of punishment to model adverse consequences associated with substance use. This has largely involved the pairing of drug use with either electric foot shock or quinine, a bitter tastant. Whilst at face value, these punishers may model aspects of the physical and psychological consequences of substance use, such models are yet to assist the development of approved medications for treatment. This review discusses progress made with animal models of punishment to understand the behavioral consequences of persistent substance use despite negative consequences. We highlight the importance of examining sex differences, especially when the behavioral response to punishment changes following drug exposure. Finally, we critique the translational value these models provide for the substance use disorder field.
Collapse
Affiliation(s)
- Xavier J Maddern
- Florey Institute of Neuroscience and Mental Health, University of Melbourne, VIC, 3010, Australia; Florey Department of Neuroscience and Mental Health, University of Melbourne, VIC, 3010, Australia
| | - Leigh C Walker
- Florey Institute of Neuroscience and Mental Health, University of Melbourne, VIC, 3010, Australia; Florey Department of Neuroscience and Mental Health, University of Melbourne, VIC, 3010, Australia
| | - Roberta G Anversa
- Florey Institute of Neuroscience and Mental Health, University of Melbourne, VIC, 3010, Australia; Florey Department of Neuroscience and Mental Health, University of Melbourne, VIC, 3010, Australia
| | - Andrew J Lawrence
- Florey Institute of Neuroscience and Mental Health, University of Melbourne, VIC, 3010, Australia; Florey Department of Neuroscience and Mental Health, University of Melbourne, VIC, 3010, Australia
| | - Erin J Campbell
- School of Biomedical Sciences and Pharmacy, Faculty of Health and Medicine, University of Newcastle, Callaghan, NSW, Australia; Brain Neuromodulation Research Program, Hunter Medical Research Institute, New Lambton Heights, NSW, Australia.
| |
Collapse
|
3
|
Martinez MX, Alizo Vera V, Ruiz CM, Floresco SB, Mahler SV. Adolescent THC impacts on mPFC dopamine-mediated cognitive processes in male and female rats. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.04.12.588937. [PMID: 38826339 PMCID: PMC11142049 DOI: 10.1101/2024.04.12.588937] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2024]
Abstract
Rationale Adolescent cannabis use is linked to later-life changes in cognition, learning, and memory. Rodent experimental studies suggest Δ9-tetrahydrocannabinol (THC) influences development of circuits underlying these processes, especially in the prefrontal cortex, which matures during adolescence. Objective We determined how 14 daily THC injections (5mg/kg) during adolescence persistently impacts medial prefrontal cortex (mPFC) dopamine-dependent cognition. Methods In adult Long Evans rats treated as adolescents with THC (AdoTHC), we quantify performance on two mPFC dopamine-dependent reward-based tasks-strategy set shifting and probabilistic discounting. We also determined how acute dopamine augmentation with amphetamine (0, 0.25, 0.5 mg/kg), or specific chemogenetic stimulation of ventral tegmental area (VTA) dopamine neurons and their projections to mPFC impacts probabilistic discounting. Results AdoTHC sex-dependently impacts acquisition of cue-guided instrumental reward seeking, but has minimal effects on set-shifting or probabilistic discounting in either sex. When we challenged dopamine circuits acutely with amphetamine during probabilistic discounting, we found reduced discounting of improbable reward options, with AdoTHC rats being more sensitive to these effects than controls. In contrast, neither acute chemogenetic stimulation of VTA dopamine neurons nor pathway-specific chemogenetic stimulation of their projection to mPFC impacted probabilistic discounting in control rats, although stimulation of this cortical dopamine projection slightly disrupted choices in AdoTHC rats. Conclusions These studies confirm a marked specificity in the cognitive processes impacted by AdoTHC exposure. They also suggest that some persistent AdoTHC effects may alter amphetamine-induced cognitive changes in a manner independent of VTA dopamine projections to mPFC, or via alterations of non-VTA dopamine neurons.
Collapse
Affiliation(s)
- Maricela X. Martinez
- Department of Neurobiology and Behavior, University of California, Irvine. 1203 McGaugh Hall. Irvine, CA 92697
| | - Vanessa Alizo Vera
- Department of Neurobiology and Behavior, University of California, Irvine. 1203 McGaugh Hall. Irvine, CA 92697
| | - Christina M Ruiz
- Department of Neurobiology and Behavior, University of California, Irvine. 1203 McGaugh Hall. Irvine, CA 92697
| | - Stan B Floresco
- Department of Psychology, University of British Columbia, Vancouver, British Columbia, V6T 1Z4, Canada
| | - Stephen V Mahler
- Department of Neurobiology and Behavior, University of California, Irvine. 1203 McGaugh Hall. Irvine, CA 92697
| |
Collapse
|
4
|
Münster A, Huster J, Sommer S, Traxler C, Votteler A, Hauber W. Enhanced Risky Choice in Male Rats Elicited by the Acute Pharmacological Stressor Yohimbine Involves Prefrontal Dopamine D1 Receptor Activation. Int J Neuropsychopharmacol 2024; 27:pyae006. [PMID: 38214654 PMCID: PMC10852621 DOI: 10.1093/ijnp/pyae006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/14/2023] [Accepted: 01/09/2024] [Indexed: 01/13/2024] Open
Abstract
BACKGROUND Acute stress alters risk-based decision-making; however, the underlying neural and neurochemical substrates are underexplored. Given their well-documented stress-inducing effects in humans and laboratory animals, glucocorticoids such as cortisol and corticosterone and the α2-adrenoceptor antagonist yohimbine represent potent pharmacological tools to mimic some characteristics of acute stress. METHODS Here, we analyzed the effects of the pharmacological stressors corticosterone and yohimbine given systemically on risk-based decision-making in male rats. Moreover, we investigated whether pharmacological stressor effects on risk-based decision-making involve dopamine D1 receptor stimulation in the dorsal prelimbic cortex (PL). We used a risk discounting task that requires choosing between a certain/small reward lever that always delivered 1 pellet and a risky/large reward lever that delivered 4 pellets with a decreasing probability across subsequent trials. RESULTS Systemic administration of yohimbine increased the preference for the risky/large reward lever. By contrast, systemic single administration of corticosterone did not significantly promote risky choice. Moreover, co-administration of corticosterone did not enhance the effects of yohimbine on risky choice. The data further show that the increased preference for the risky/large reward lever under systemic yohimbine was lowered by a concurrent pharmacological blockade of dopamine D1 receptors in the PL. CONCLUSIONS Our rodent data provide causal evidence that stimulation of PL D1 receptors may represent a neurochemical mechanism by which the acute pharmacological stressor yohimbine, and possibly nonpharmacological stressors as well, promote risky choice.
Collapse
Affiliation(s)
| | | | - Susanne Sommer
- Department of Neurobiology, University of Stuttgart, Stuttgart, Germany
| | | | - Angeline Votteler
- Department of Neurobiology, University of Stuttgart, Stuttgart, Germany
| | | |
Collapse
|
5
|
Nolder KA, Anderson KG. Effects of acute and chronic nicotine administration on probability discounting. Behav Pharmacol 2023; 34:468-476. [PMID: 37668161 DOI: 10.1097/fbp.0000000000000753] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/06/2023]
Abstract
Nicotine use is a continuing public health concern. Smokers are more likely to make risky or maladaptive decisions compared to nonsmokers, so the relation between nicotine and risky choice warrants further investigation. Risky choice can be operationally defined as the choice for a larger, uncertain reinforcer over a smaller, certain reinforcer and can be assessed through a probability-discounting procedure. Acute nicotine administration has been shown to alter risky choice, but because the everyday smoker uses nicotine repeatedly, more research on chronic administration is needed and would allow for assessment of tolerance or sensitization of any effects. The present study examined effects of acute and repeated nicotine administration on probability discounting. Sprague-Dawley rats were used as subjects and the probability-discounting task involved discrete-trial choices between a small, certain reinforcer and a larger, uncertain reinforcer. The probability of larger-reinforcer delivery decreased across blocks within each session. Acute nicotine (0.1-1.0 mg/kg) administration dose-dependently increased risky choice, increased lose-stay ratios (a measure of response perseveration), and decreased reinforcement frequency. Tolerance to nicotine's effects on larger-reinforcer choice was observed after repeated 1.0 mg/kg nicotine administration. The results of the present study add to the existing literature that acute nicotine administration increases risky choice and demonstrates that tolerance to this effect develops after chronic exposure to the drug. Possible behavioral mechanisms behind this effect are discussed, as are suggestions for future research on nicotine and risky choice.
Collapse
Affiliation(s)
- Katya A Nolder
- Department of Psychology, West Virginia University, Morgantown, West Virginia, USA
| | | |
Collapse
|
6
|
Zhang Q, Li M, Wang Z, Chen F. Sex differences in learning and performing the Go/NoGo tasks. Biol Sex Differ 2023; 14:25. [PMID: 37138307 PMCID: PMC10155458 DOI: 10.1186/s13293-023-00504-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/11/2023] [Accepted: 04/04/2023] [Indexed: 05/05/2023] Open
Abstract
BACKGROUND The quality of learning and post-learning performances is critical for daily life. The behavioral flexibility is equally important for adapting the changing circumstances. The learning process requires repeated practices, which enhances prompt and proper behavioral responses, in turn, which promotes habits formation as well. Despite the well-documented sex differences in learning and performances, contradictory results were reported. A possible cause might be a systematic analysis due to specific research interests, regardless of the continuity of natural acquisition process. Here, we investigate the potential sex differences in learning, performances and adjustments of habited behaviors with regular and reversal Go/NoGo tasks. METHODS Both male and female Sprague-Dawley rats were used in this study. All rats were trained for a regular rodent Go/NoGo task and a subset of rats were trained for a reversal rodent Go/NoGo task, both with strict elimination criteria. The behavioral performance data were stored in PC for off-line analysis. Multiple behavioral indices were analyzed for both passed and retired rats. RESULTS The ability of learning the regular the reversal Go/NoGo tasks was similar for both male and female rats, however, the female rats took longer time to master the task principles in later stages for both tasks. In the regular Go/NoGo task, the female rats spent more time on completing the trial in performance optimization phases, which implied female rats were more cautious than male rats. Along with the progression of training, both male and female rats developed Go-preference strategies to perform the regular Go/NoGo task, which induced failure to meet the setting success criteria. The retired male rats exhibited shorter RTs and MTs than the retired female rats after developing Go-preference. Moreover, the time needed to complete the Go trials was significantly prolonged for male rats in the reversal Go/NoGo task. CONCLUSIONS Overall, we conclude that distinctive strategies were employed in performing Go/NoGo tasks for both male and female rats. Male rats required less time to stabilize the performance in behavioral optimization phase. In addition, male rats were more accurate in estimating time elapsing. In contrast, female rats took more cautious considerations in performing the task, through which minimal influences were manifested in the reversal version of task.
Collapse
Affiliation(s)
- Qianwen Zhang
- Bio-X Institutes, Key Laboratory for the Genetics of Developmental and Neuropsychiatric Disorders, Ministry of Education, Shanghai Jiao Tong University, Shanghai, China
- Exercise, Health and Technology Centre, Department of Physical Education, Shanghai Jiao Tong University, Shanghai, China
| | - Mingxi Li
- Bio-X Institutes, Key Laboratory for the Genetics of Developmental and Neuropsychiatric Disorders, Ministry of Education, Shanghai Jiao Tong University, Shanghai, China
- Exercise, Health and Technology Centre, Department of Physical Education, Shanghai Jiao Tong University, Shanghai, China
| | - Zhiru Wang
- The Institute of Brain Functional Genomics, East China Normal University, Shanghai, China.
| | - Fujun Chen
- Bio-X Institutes, Key Laboratory for the Genetics of Developmental and Neuropsychiatric Disorders, Ministry of Education, Shanghai Jiao Tong University, Shanghai, China.
- Exercise, Health and Technology Centre, Department of Physical Education, Shanghai Jiao Tong University, Shanghai, China.
| |
Collapse
|
7
|
Gancarz AM, Mitchell SH, George AM, Martin CD, Turk MC, Bool HM, Aktar F, Kwarteng F, Palmer AA, Meyer PJ, Richards JB, Dietz DM, Ishiwari K. Reward maximization assessed using a sequential patch depletion task in a large sample of heterogeneous stock rats. Sci Rep 2023; 13:7027. [PMID: 37120610 PMCID: PMC10148848 DOI: 10.1038/s41598-023-34179-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2023] [Accepted: 04/25/2023] [Indexed: 05/01/2023] Open
Abstract
Choice behavior requires animals to evaluate both short- and long-term advantages and disadvantages of all potential alternatives. Impulsive choice is traditionally measured in laboratory tasks by utilizing delay discounting (DD), a paradigm that offers a choice between a smaller immediate reward, or a larger more delayed reward. This study tested a large sample of Heterogeneous Stock (HS) male (n = 896) and female (n = 898) rats, part of a larger genetic study, to investigate whether measures of reward maximization overlapped with traditional models of delay discounting via the patch depletion model using a Sequential Patch Depletion procedure. In this task, rats were offered a concurrent choice between two water "patches" and could elect to "stay" in the current patch or "leave" for an alternative patch. Staying in the current patch resulted in decreasing subsequent reward magnitudes, whereas the choice to leave a patch was followed by a delay and a resetting to the maximum reward magnitude. Based on the delay in a given session, different visit durations were necessary to obtain the maximum number of rewards. Visit duration may be analogous to an indifference point in traditional DD tasks. Males and females did not significantly differ on traditional measures of DD (e.g. delay gradient; AUC). When examining measures of patch utilization, females made fewer patch changes at all delays and spent more time in the patch before leaving for the alternative patch compared to males. Consistent with this, there was some evidence that females deviated from reward maximization more than males. However, when controlling for body weight, females had a higher normalized rate of reinforcement than males. Measures of reward maximization were only weakly associated with traditional DD measures and may represent distinctive underlying processes. Taken together, females performance differed from males with regard to reward maximization that were not observed utilizing traditional measures of DD, suggesting that the patch depletion model was more sensitive to modest sex differences when compared to traditional DD measures in a large sample of HS rats.
Collapse
Affiliation(s)
- Amy M Gancarz
- Department of Psychology, California State University, Bakersfield, Bakersfield, CA, 93311, USA.
| | - Suzanne H Mitchell
- Department of Behavioral Neuroscience, Oregon Health & Science University, Portland, OR, 97239, USA
- Department of Psychiatry, Oregon Health & Science University, Portland, OR, 97239, USA
- Oregon Institute for Occupational Health Sciences, Oregon Health & Science University, Portland, OR, 97239, USA
| | - Anthony M George
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA
| | - Connor D Martin
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA
| | - Marisa C Turk
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA
| | - Heather M Bool
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA
| | - Fahmida Aktar
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA
| | - Francis Kwarteng
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA
| | - Abraham A Palmer
- Department of Psychiatry, University of California San Diego, La Jolla, CA, 92093, USA
- Institute for Genomic Medicine, University of California San Diego, La Jolla, CA, 92093, USA
| | - Paul J Meyer
- Department of Psychology, University at Buffalo, Buffalo, NY, 14260, USA
| | - Jerry B Richards
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA
| | - David M Dietz
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA
| | - Keita Ishiwari
- Clinical and Research Institute on Addictions, University at Buffalo, Buffalo, NY, 14203, USA.
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, 14203, USA.
| |
Collapse
|
8
|
Truckenbrod LM, Cooper EM, Orsini CA. Cognitive mechanisms underlying decision making involving risk of explicit punishment in male and female rats. COGNITIVE, AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2023; 23:248-275. [PMID: 36539558 PMCID: PMC10065932 DOI: 10.3758/s13415-022-01052-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 11/29/2022] [Indexed: 12/24/2022]
Abstract
Individuals engage in the process of risk-based decision making on a daily basis to navigate various aspects of life. There are, however, individual differences in this form of decision making, with some individuals exhibiting preference for riskier choices (risk taking) and others exhibiting preference for safer choices (risk aversion). Recent work has shown that extremes in risk taking (e.g., excessive risk taking or risk aversion) are not only cognitive features of neuropsychiatric diseases, but may in fact predispose individuals to the development of such diseases. To better understand individual differences in risk taking, and thus the mechanisms by which they confer disease vulnerability, the current study investigated the cognitive contributions to risk taking in both males and females. Rats were first behaviorally characterized in a decision-making task involving risk of footshock punishment and then tested on a battery of cognitive behavioral assays. Individual variability in risk taking was compared with performance on these tasks. Consistent with prior work, females were more risk averse than males. With the exception of the Set-shifting Task, there were no sex differences in performance on other cognitive assays. There were, however, sex-dependent associations between risk taking and specific cognitive measures. Greater risk taking was associated with better cognitive flexibility in males whereas greater risk aversion was associated with better working memory in females. Collectively, these findings reveal that distinct cognitive mechanisms are associated with risk taking in males and females, which may account for sex differences in this form of decision making.
Collapse
Affiliation(s)
- Leah M Truckenbrod
- Institute for Neuroscience, The University of Texas at Austin, Austin, TX, USA
| | - Emily M Cooper
- Department of Psychology, The University of Texas at Austin, Austin, TX, USA
| | - Caitlin A Orsini
- Department of Psychology, The University of Texas at Austin, Austin, TX, USA.
- Department of Neurology, The University of Texas at Austin, Austin, TX, USA.
- Waggoner Center for Alcohol and Addiction Research, The University of Texas at Austin, 1601B Trinity Street, Austin, TX, 78712, USA.
| |
Collapse
|
9
|
Bercovici DA, Princz-Lebel O, Schumacher JD, Lo VM, Floresco SB. Temporal Dynamics Underlying Prelimbic Prefrontal Cortical Regulation of Action Selection and Outcome Evaluation during Risk/Reward Decision-Making. J Neurosci 2023; 43:1238-1255. [PMID: 36609453 PMCID: PMC9962784 DOI: 10.1523/jneurosci.0802-22.2022] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2022] [Revised: 12/23/2022] [Accepted: 12/30/2022] [Indexed: 01/09/2023] Open
Abstract
Risk/reward decision-making is a dynamic process that includes periods of deliberation before action selection and evaluation of the action outcomes that bias subsequent choices. Inactivation of the prelimbic (PL) cortex has revealed its integral role in updating decision biases in the face of changes in probabilistic reward contingencies, yet how phasic PL signals during different phases of the decision process influence choice remains unclear. We used temporally specific optogenetic inhibition to selectively disrupt PL activity coinciding with action selection and outcome phases to examine how these signals influence choice. Male rats expressing the inhibitory opsin eArchT within PL excitatory neurons were well trained on a probabilistic discounting task, entailing choice between small/certain versus large/risky rewards, the probability of which varied over a session (50-12.5%). During testing, brief light pulses suppressed PL activity before choice or after different outcomes. Prechoice suppression reduced bias toward more preferred/higher utility options and disrupted how recent outcomes influenced subsequent choice. Inhibition during risky losses induced a similar profile, but here, the impact of reward omissions were either amplified or diminished, relative to the context of the estimated profitability of the risky option. Inhibition during large or small reward receipt reduced risky choice when this option was more profitable, suggesting these signals can both reinforce rewarded risky choices and also act as a relative value comparator signal that augments incentive for larger rewards. These findings reveal multifaceted contributions by the PL in implementing decisions and integrating action-outcome feedback to assign context to the decision space.SIGNIFICANCE STATEMENT The PL prefrontal cortex plays an integral role in guiding risk/reward decisions, but how activity in this region during different phases of the decision process influences choice is unclear. By using temporally specific optogenetic manipulations of this activity, the present study unveiled previously uncharacterized and differential contributions by PL in implementing decision policies and how evaluation of decision outcomes shape subsequent choice. These findings provide novel insight into the dynamic processes engaged by the PL that underlie action selection in situations involving reward uncertainty that may aid in understanding the mechanism underlying normal and aberrant decision-making processes.
Collapse
Affiliation(s)
- Debra A Bercovici
- Department of Psychology and Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia V6T1Z4, Canada
| | - Oren Princz-Lebel
- Department of Psychology and Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia V6T1Z4, Canada
| | - Jackson D Schumacher
- Department of Psychology and Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia V6T1Z4, Canada
| | - Valerie M Lo
- Department of Psychology and Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia V6T1Z4, Canada
| | - Stan B Floresco
- Department of Psychology and Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia V6T1Z4, Canada
| |
Collapse
|
10
|
Rojas GR, Curry-Pochy LS, Chen CS, Heller AT, Grissom NM. Sequential delay and probability discounting tasks in mice reveal anchoring effects partially attributable to decision noise. Behav Brain Res 2022; 431:113951. [PMID: 35661751 PMCID: PMC9844124 DOI: 10.1016/j.bbr.2022.113951] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2021] [Revised: 05/20/2022] [Accepted: 05/29/2022] [Indexed: 01/19/2023]
Abstract
Delay discounting and probability discounting decision making tasks in rodent models have high translational potential. However, it is unclear whether the discounted value of the large reward option is the main contributor to variability in animals' choices in either task, which may limit translation to humans. Male and female mice underwent sessions of delay and probability discounting in sequence to assess how choice behavior adapts over experience with each task. To control for "anchoring" (persistent choices based on the initial delay or probability), mice experienced "Worsening" schedules where the large reward was offered under initially favorable conditions that became less favorable during testing, followed by "Improving" schedules where the large reward was offered under initially unfavorable conditions that improved over a session. During delay discounting, both male and female mice showed elimination of anchoring effects over training. In probability discounting, both sexes of mice continued to show some anchoring even after months of training. One possibility is that "noisy", exploratory choices could contribute to these persistent anchoring effects, rather than constant fluctuations in value discounting. We fit choice behavior in individual animals using models that included both a value-based discounting parameter and a decision noise parameter that captured variability in choices deviating from value maximization. Changes in anchoring behavior over time were tracked by changes in both the value and decision noise parameters in delay discounting, but by the decision noise parameter in probability discounting. Exploratory decision making was also reflected in choice response times that tracked the degree of conflict caused by both uncertainty and temporal cost, but was not linked with differences in locomotor activity reflecting chamber exploration. Thus, variable discounting behavior in mice can result from changes in exploration of the decision options rather than changes in reward valuation.
Collapse
|
11
|
Orsini CA, Truckenbrod LM, Wheeler AR. Regulation of sex differences in risk-based decision making by gonadal hormones: Insights from rodent models. Behav Processes 2022; 200:104663. [PMID: 35661794 PMCID: PMC9893517 DOI: 10.1016/j.beproc.2022.104663] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2021] [Revised: 04/22/2022] [Accepted: 05/24/2022] [Indexed: 02/04/2023]
Abstract
Men and women differ in their ability to evaluate options that vary in their rewards and the risks that are associated with these outcomes. Most studies have shown that women are more risk averse than men and that gonadal hormones significantly contribute to this sex difference. Gonadal hormones can influence risk-based decision making (i.e., risk taking) by modulating the neurobiological substrates underlying this cognitive process. Indeed, estradiol, progesterone and testosterone modulate activity in the prefrontal cortex, amygdala and nucleus accumbens associated with reward and risk-related information. The use of animal models of decision making has advanced our understanding of the intersection between the behavioral, neural and hormonal mechanisms underlying sex differences in risk taking. This review will outline the current state of this literature, identify the current gaps in knowledge and suggest the neurobiological mechanisms by which hormones regulate risky decision making. Collectively, this knowledge can be used to understand the potential consequences of significant hormonal changes, whether endogenously or exogenously induced, on risk-based decision making as well as the neuroendocrinological basis of neuropsychiatric diseases that are characterized by impaired risk taking, such as substance use disorder and schizophrenia.
Collapse
Affiliation(s)
- Caitlin A. Orsini
- Department of Psychology, University of Texas at Austin, Austin, TX, USA,Department of Neurology, University of Texas at Austin, Austin, TX, USA,Waggoner Center for Alcohol and Addiction Research, University of Texas at Austin, Austin, TX, USA,Institute for Neuroscience, University of Texas at Austin, Austin, TX, USA,Correspondence to: Department of Psychology & Neurology, Waggoner Center for Alcohol and Addiction Research, 108 E. Dean Keaton St., Stop A8000, Austin, TX 78712, USA. (C.A. Orsini)
| | - Leah M. Truckenbrod
- Department of Neurology, University of Texas at Austin, Austin, TX, USA,Waggoner Center for Alcohol and Addiction Research, University of Texas at Austin, Austin, TX, USA,Institute for Neuroscience, University of Texas at Austin, Austin, TX, USA
| | - Alexa-Rae Wheeler
- Department of Neurology, University of Texas at Austin, Austin, TX, USA,Waggoner Center for Alcohol and Addiction Research, University of Texas at Austin, Austin, TX, USA,Institute for Neuroscience, University of Texas at Austin, Austin, TX, USA
| |
Collapse
|
12
|
Medial orbitofrontal cortex dopamine D 1/D 2 receptors differentially modulate distinct forms of probabilistic decision-making. Neuropsychopharmacology 2021; 46:1240-1251. [PMID: 33452435 PMCID: PMC8134636 DOI: 10.1038/s41386-020-00931-1] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/03/2020] [Revised: 11/10/2020] [Accepted: 11/27/2020] [Indexed: 01/29/2023]
Abstract
Efficient decision-making involves weighing the costs and benefits associated with different actions and outcomes to maximize long-term utility. The medial orbitofrontal cortex (mOFC) has been implicated in guiding choice in situations involving reward uncertainty, as inactivation in rats alters choice involving probabilistic rewards. The mOFC receives considerable dopaminergic input, yet how dopamine (DA) modulates mOFC function has been virtually unexplored. Here, we assessed how mOFC D1 and D2 receptors modulate two forms of reward seeking mediated by this region, probabilistic reversal learning and probabilistic discounting. Separate groups of well-trained rats received intra-mOFC microinfusions of selective D1 or D2 antagonists or agonists prior to task performance. mOFC D1 and D2 blockade had opposing effects on performance during probabilistic reversal learning and probabilistic discounting. D1 blockade impaired, while D2 blockade increased the number of reversals completed, both mediated by changes in errors and negative feedback sensitivity apparent during the initial discrimination of the task, which suggests changes in probabilistic reinforcement learning rather than flexibility. Similarly, D1 blockade reduced, while D2 blockade increased preference for larger/risky rewards. Excess D1 stimulation had no effect on either task, while excessive D2 stimulation impaired probabilistic reversal performance, and reduced both profitable risky choice and overall task engagement. These findings highlight a previously uncharacterized role for mOFC DA, showing that D1 and D2 receptors play dissociable and opposing roles in different forms of reward-related action selection. Elucidating how DA biases behavior in these situations will expand our understanding of the mechanisms regulating optimal and aberrant decision-making.
Collapse
|
13
|
Li SS, Xie LL, Li ZZ, Fan YJ, Qi MM, Xi YG. Androgen is responsible for enhanced susceptibility of melatonin against traumatic brain injury in females. Neurosci Lett 2021; 752:135842. [PMID: 33766734 DOI: 10.1016/j.neulet.2021.135842] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2020] [Revised: 02/06/2021] [Accepted: 03/18/2021] [Indexed: 12/24/2022]
Abstract
BACKGROUND Numerous publications have demonstrated that melatonin administration is associated with mortality reduction and improvement in neurological outcomes after traumatic brain injury (TBI). However, there are significant sex differences in several diseases associated with melatonin. We aimed to determine whether androgen was responsible for enhanced susceptibility of melatonin against TBI in females, as well as potential molecular mechanisms. METHODS Weight-drop was used to establish a rodent model of TBI. Melatonin (10 mg/kg) and testosterone (1 mg/kg) were administered three times every day for three days after TBI using subcutaneous injection, respectively. Seven days after TBI, an open field assay was used to evaluate locomotor and exploratory activities. Neuronal amount, neuronal apoptosis, and expression of phosphorylated extracellularly regulated protein kinases 1/2 (ERK1/2), c-jun N-terminal kinase 1/2 (JNK1/2), and p38 mitogen-activated protein kinase (p38MAPK) in neurons were assessed using immunofluorescence assay seven days after TBI. The expression of caspase-3, Bax, and Bcl-2 in the frontal cortex was detected using western blot. RESULTS Compared with female rats, melatonin administration exhibited more neuroprotective effects (including improved locomotor and exploratory activities, elevated neuronal amount, and reduced neuronal apoptosis) in male rats exposed to TBI. Moreover, testosterone significantly improved locomotor and exploratory activities, elevated neuronal amount, decreased neuronal apoptosis, downregulated phosphorylation of JNK1/2- and p38MAPK-positive neurons, but upregulated phosphorylation of ERK1/2-positive neurons in the frontal cortex, and reduced the expressions of cleaved caspase-3, Bax, but increased Bcl-2 expressions in female rats exposed to TBI. CONCLUSIONS Androgen was responsible for the enhanced susceptibility to TBI under melatonin supplementation in females through a mechanism that may be associated with MAPK pathway regulation.
Collapse
Affiliation(s)
- Shan-Shan Li
- Clinical Lab, Cangzhou Central Hospital, Cangzhou, China.
| | - Ling-Ling Xie
- Department of Pharmacy, Cangzhou Central Hospital, Cangzhou, China.
| | - Zhuang-Zhuang Li
- Department of Pharmacy, Cangzhou Central Hospital, Cangzhou, China.
| | - Yong-Jian Fan
- Department of Ultrasonography, Cangzhou Central Hospital, Cangzhou, China.
| | - Man-Man Qi
- Department of Anesthesiology, Cangzhou Central Hospital, Cangzhou, China.
| | - Yan-Guo Xi
- Department of Neurosurgery, Cangzhou Central Hospital, Cangzhou, China.
| |
Collapse
|
14
|
Chronic non-discriminatory social defeat stress reduces effort-related motivated behaviors in male and female mice. Transl Psychiatry 2021; 11:125. [PMID: 33589585 PMCID: PMC7884699 DOI: 10.1038/s41398-021-01250-9] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/28/2020] [Revised: 01/07/2021] [Accepted: 01/20/2021] [Indexed: 01/31/2023] Open
Abstract
Reward and motivation deficits are prominent symptoms in many mood disorders, including depression. Similar reward and effort-related choice behavioral tasks can be used to study aspects of motivation in both rodents and humans. Chronic stress can precipitate mood disorders in humans and maladaptive reward and motivation behaviors in male rodents. However, while depression is more prevalent in women, there is relatively little known about whether chronic stress elicits maladaptive behaviors in female rodents in effort-related motivated tasks and whether there are any behavioral sex differences. Chronic nondiscriminatory social defeat stress (CNSDS) is a variation of chronic social defeat stress that is effective in both male and female mice. We hypothesized that CNSDS would reduce effort-related motivated and reward behaviors, including reducing sensitivity to a devalued outcome, reducing breakpoint in progressive ratio, and shifting effort-related choice behavior. Separate cohorts of adult male and female C57BL/6 J mice were divided into Control or CNSDS groups, exposed to the 10-day CNSDS paradigm, and then trained and tested in instrumental reward or effort-related behaviors. CNSDS reduced motivation to lever press in progressive ratio and shifted effort-related choice behavior from a high reward to a more easily attainable low reward in both sexes. CNSDS caused more nuanced impairments in outcome devaluation. Taken together, CNSDS induces maladaptive shifts in effort-related choice and reduces motivated lever pressing in both sexes.
Collapse
|
15
|
Garman TS, Setlow B, Orsini CA. Effects of a high-fat diet on impulsive choice in rats. Physiol Behav 2021; 229:113260. [PMID: 33227243 DOI: 10.1016/j.physbeh.2020.113260] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2020] [Accepted: 11/18/2020] [Indexed: 12/21/2022]
Abstract
INTRODUCTION Obesity and binge eating disorder are associated with high levels of impulsivity, but the causal role of eating and palatable food in these associations is unclear. Studies in rodents show that a high-fat diet can increase one aspect of impulsivity (impulsive action); it is less clear, however, whether a dissociable aspect of impulsivity (impulsive choice) is similarly affected. Hence, the aim of this study was to ascertain whether chronic exposure to a high-fat diet would alter impulsive choice. METHODS Male rats were maintained on either a high-fat or control chow diet for two weeks ad libitum. They then underwent equi-caloric food restriction for the duration of the experiment, with each group maintained on their respective diet. To measure impulsive choice, rats were trained on a delay discounting task (DDT) in which they made discrete choices between a lever that delivered a small food reward immediately and a lever that delivered a large food reward accompanied by systematically increasing delays. Upon reaching stable performance on the DDT, rats were given acute systemic injections of amphetamine prior to testing in the DDT to determine whether increased monoamine transmission affected impulsive choice differently in the two diet groups. Lastly, subjects were tested on a progressive ratio schedule of reinforcement to assess motivation for a sucrose reward. RESULTS There was no significant effect of the high-fat diet on impulsive choice. Further, amphetamine decreased choice of the large, delayed reward (increased impulsive choice) to the same extent in both groups. Exposure to the high-fat diet did, however, increase motivation to obtain a sucrose reward. CONCLUSIONS These experiments reveal that, under conditions that do not promote weight gain, a chronic high-fat diet does not affect impulsive choice in a delay discounting task. The data are surprising in light of findings showing that this same diet alters impulsive action, and highlight the necessity of further research to elucidate relationships between palatable food consumption and impulsivity.
Collapse
Affiliation(s)
| | - Barry Setlow
- Department of Neuroscience; Department of Psychiatry; McKnight Brain Institute; Center for Addiction Research and Education, University of Florida, Gainesville, FL 32610
| | - Caitlin A Orsini
- Department of Psychiatry; McKnight Brain Institute; Department of Psychology, Waggoner Center for Alcoholism and Addiction Research, The University of Texas at Austin, Austin, TX 78712.
| |
Collapse
|
16
|
Leenaars CH, Van der Mierden S, Joosten RN, Van der Weide MA, Schirris M, Dematteis M, Meijboom FL, Feenstra MG, Bleich A. Risk-Based Decision Making: A Systematic Scoping Review of Animal Models and a Pilot Study on the Effects of Sleep Deprivation in Rats. Clocks Sleep 2021; 3:31-52. [PMID: 33498259 PMCID: PMC7838799 DOI: 10.3390/clockssleep3010003] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Revised: 01/13/2021] [Accepted: 01/18/2021] [Indexed: 02/07/2023] Open
Abstract
Animals, including humans, frequently make decisions involving risk or uncertainty. Different strategies in these decisions can be advantageous depending the circumstances. Short sleep duration seems to be associated with more risky decisions in humans. Animal models for risk-based decision making can increase mechanistic understanding, but very little data is available concerning the effects of sleep. We combined primary- and meta-research to explore the relationship between sleep and risk-based decision making in animals. Our first objective was to create an overview of the available animal models for risky decision making. We performed a systematic scoping review. Our searches in Pubmed and Psychinfo retrieved 712 references, of which 235 were included. Animal models for risk-based decision making have been described for rodents, non-human primates, birds, pigs and honey-bees. We discuss task designs and model validity. Our second objective was to apply this knowledge and perform a pilot study on the effect of sleep deprivation. We trained and tested male Wistar rats on a probability discounting task; a “safe” lever always resulted in 1 reward, a “risky” lever resulted in 4 or no rewards. Rats adapted their preferences to variations in reward probabilities (p < 0.001), but 12 h of sleep deprivation during the light phase did not clearly alter risk preference (p = 0.21).
Collapse
Affiliation(s)
- Cathalijn H.C. Leenaars
- Institute for Laboratory Animal Science, Hannover Medical School, 30625 Hannover, Germany; (S.V.d.M.); (A.B.)
- Department for Health Evidence (Section HTA), SYRCLE, Radboud University Medical Centre, 6600 Nijmegen, The Netherlands
- Unit Animals in Science and Society, Population Health Sciences, Utrecht University, 3500 Utrecht, The Netherlands;
- Correspondence: ; Tel.: +49-511-532-1368
| | - Stevie Van der Mierden
- Institute for Laboratory Animal Science, Hannover Medical School, 30625 Hannover, Germany; (S.V.d.M.); (A.B.)
- Department for Health Evidence (Section HTA), SYRCLE, Radboud University Medical Centre, 6600 Nijmegen, The Netherlands
| | - Ruud N.J.M.A. Joosten
- Netherlands Institute for Neuroscience, an Institute of the Royal Netherlands Academy of Arts and Sciences, 1000 Amsterdam, The Netherlands; (R.N.J.M.A.J.); (M.A.V.d.W.); (M.S.); (M.G.P.F.)
| | - Marnix A. Van der Weide
- Netherlands Institute for Neuroscience, an Institute of the Royal Netherlands Academy of Arts and Sciences, 1000 Amsterdam, The Netherlands; (R.N.J.M.A.J.); (M.A.V.d.W.); (M.S.); (M.G.P.F.)
| | - Mischa Schirris
- Netherlands Institute for Neuroscience, an Institute of the Royal Netherlands Academy of Arts and Sciences, 1000 Amsterdam, The Netherlands; (R.N.J.M.A.J.); (M.A.V.d.W.); (M.S.); (M.G.P.F.)
| | - Maurice Dematteis
- Department of Addiction Medicine, Grenobles Alpes University Hospital, Faculty of Medicine, Grenoble Alpes University, 38400 Grenoble, France;
| | - Franck L.B. Meijboom
- Unit Animals in Science and Society, Population Health Sciences, Utrecht University, 3500 Utrecht, The Netherlands;
| | - Matthijs G.P. Feenstra
- Netherlands Institute for Neuroscience, an Institute of the Royal Netherlands Academy of Arts and Sciences, 1000 Amsterdam, The Netherlands; (R.N.J.M.A.J.); (M.A.V.d.W.); (M.S.); (M.G.P.F.)
| | - André Bleich
- Institute for Laboratory Animal Science, Hannover Medical School, 30625 Hannover, Germany; (S.V.d.M.); (A.B.)
| |
Collapse
|
17
|
Dorsomedial striatal contributions to different forms of risk/reward decision making. Neurobiol Learn Mem 2020; 178:107369. [PMID: 33383183 DOI: 10.1016/j.nlm.2020.107369] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2020] [Revised: 11/30/2020] [Accepted: 12/21/2020] [Indexed: 11/22/2022]
Abstract
Optimal decision making involving reward uncertainty is integral to adaptive goal-directed behavior. In some instances, these decisions are guided by internal representations of reward history, whereas in other situations, external cues inform a decision maker about how likely certain actions are to yield reward. Different regions of the frontal lobe form distributed networks with striatal and amygdalar regions that facilitate different types of risk/reward decision making. The dorsal medial striatum (DMS) is one key output region of the prefrontal cortex, yet there have been few preclinical studies investigating the involvement of the DMS in different forms of risk/reward decision making. The present study addressed this issue, wherein separate groups of male rats were trained on one of two tasks where they chose between a small/certain or a large/risky reward. In a probabilistic discounting task, reward probabilities changed systematically over blocks of trials (100-6.25% or 6.25-100%), requiring rats to use internal representations of reward history to guide choice. Cue-guided decision-making was assessed with a "Blackjack" task, where different auditory cues indicated the odds associated with the large/risky option (50 or 12.5%). Inactivation of the DMS with GABA agonists impaired adjustments in choice biases during probabilistic discounting, resulting in either increases or decreases in risky choice as the probabilities associated with the large/risky reward decreased or increased over a session. In comparison, DMS inactivation increased risky choices on poor-odds trials on the Blackjack task, which was associated with a reduced impact that non-rewarded choices had on subsequent choices. DMS inactivation also impaired performance of an auditory conditional discrimination. These findings highlight a previously uncharacterized role for the DMS in facilitating flexible action selection during multiple forms of risk/reward decision making.
Collapse
|