Sex differences in a rat model of risky decision making

Effects of psilocybin on uncertain punishment learning

Psilocybin may provide a useful treatment for mood disorders including anxiety and depression but its mechanisms of action for these effects are not well understood. While recent preclinical work has begun to assess psilocybin's role in affective behaviors through innate anxiety or fear conditioning, there is scant evidence for its role in conflict between reward and punishment. The current study was designed to determine the impact of psilocybin on the learning of reward-punishment conflict associations, as well as its effects after learning, in male and female rats. We utilized a chained schedule of reinforcement that involved execution of safe and risky reward-guided actions under uncertain punishment. Different patterns of behavioral suppression by psilocybin emerged during learning versus after learning of risky action-reward associations. Psilocybin increased behavioral suppression in female rats as punishment associations were learned. After learning, psilocybin decreased behavioral suppression in both sexes. Thus, psilocybin produces divergent effects on action suppression during approach-avoidance conflict depending on when the conflict is experienced. This observation may have implications for its therapeutic mechanism of action.

Ventral Pallidum and Amygdala Cooperate to Restrain Reward Approach under Threat

Foraging decisions involve assessing potential risks and prioritizing food sources, which can be challenging when confronted with changing and conflicting circumstances. A crucial aspect of this decision-making process is the ability to actively overcome defensive reactions to threats and focus on achieving specific goals. The ventral pallidum (VP) and basolateral amygdala (BLA) are two brain regions that play key roles in regulating behavior motivated by either rewards or threats. However, it is unclear whether these regions are necessary in decision-making processes involving competing motivational drives during conflict. Our aim was to investigate the requirements of the VP and BLA for foraging choices in conflicts involving overcoming defensive responses. Here, we used a novel foraging task and pharmacological techniques to inactivate either the VP or BLA or to disconnect these brain regions before conducting a conflict test in male rats. Our findings showed that BLA is necessary for making risky choices during conflicts, whereas VP is necessary for invigorating the drive to obtain food, regardless of the presence of conflict. Importantly, our research revealed that the connection between VP and BLA is critical in controlling risky food-seeking choices during conflict situations. This study provides a new perspective on the collaborative function of VP and BLA in driving behavior, aimed at achieving goals in the face of dangers.

Sex mechanisms as nonbinary influences on cognitive diversity

Essentially all neuropsychiatric diagnoses show some degree of sex and/or gender differences in their etiology, diagnosis, or prognosis. As a result, the roles of sex-related variables in behavior and cognition are of strong interest to many, with several lines of research showing effects on executive functions and value-based decision making in particular. These findings are often framed within a sex binary, with behavior of females described as less optimal than male "defaults"-- a framing that pits males and females against each other and deemphasizes the enormous overlap in fundamental neural mechanisms across sexes. Here, we propose an alternative framework in which sex-related factors encompass just one subset of many sources of valuable diversity in cognition. First, we review literature establishing multidimensional, nonbinary impacts of factors related to sex chromosomes and endocrine mechanisms on cognition, focusing on value- based decision-making tasks. Next, we present two suggestions for nonbinary interpretations and analyses of sex-related data that can be implemented by behavioral neuroscientists without devoting laboratory resources to delving into mechanisms underlying sex differences. We recommend (1) shifting interpretations of behavior away from performance metrics and towards strategy assessments to avoid the fallacy that the performance of one sex is worse than another; and (2) asking how much variance sex explains in measures and whether any differences are mosaic rather than binary, to avoid assuming that sex differences in separate measures are inextricably correlated. Nonbinary frameworks in research on cognition will allow neuroscience to represent the full spectrum of brains and behaviors.

Adolescent nicotine exposure promotes adulthood opioid consumption that persists despite adverse consequences and increases the density of insular perineuronal nets

Adolescence marks a sensitive period for neurodevelopment wherein exposure to drugs of abuse may disrupt maturation and induce persistent changes in neurophysiology which may exacerbate the risk for developing substance use disorders in adulthood. Adolescent nicotine exposure (ANE) enhances motivation to obtain drugs of abuse, particularly opioids, and increases vulnerability for the development of opioid use disorder (OUD). Here, we characterized ANE effects on learning about the adverse consequences of opioid consumption in adulthood in the absence of further nicotine administration. First, we show that ANE engenders punishment resistant fentanyl self-administration in a heterogenous seeking-taking chain schedule of reinforcement at least at the tested dose of fentanyl (0.75 μg/kg). We found that ANE rats consumed significantly more fentanyl and contingent foot shock punishment was less efficacious in limiting fentanyl seeking in ANE rats, relative to nicotine-naïve controls. Next, we demonstrated that ANE limits learning about the deleterious consequences of acute opioid intoxication in adulthood. In a combined conditioned taste avoidance and place preference paradigm we found that ANE resulted in significant reductions in the strength of morphine-induced CTA, and a simultaneous enhancement of CPP at a higher dose that was less capable of driving reinforcement in naïve controls. Finally, we examined the expression of perineuronal nets (PNNs) within insular cortex (IC) and found ANE rats to have increased density of PNNs across the anterior IC and significantly more parvalbumin-labeled IC cells relative to naïve controls. Together, these data lay the framework for a mechanistic explanation of the extreme comorbidity between nicotine use and development of OUDs.

Examining a punishment-related brain circuit with miniature fluorescence microscopes and deep learning

In humans experiencing substance use disorder (SUD), abstinence from drug use is often motivated by a desire to avoid some undesirable consequence of further use: health effects, legal ramifications, etc. This process can be experimentally modeled in rodents by training and subsequently punishing an operant response in a context-induced reinstatement procedure. Understanding the biobehavioral mechanisms underlying punishment learning is critical to understanding both abstinence and relapse in individuals with SUD. To date, most investigations into the neural mechanisms of context-induced reinstatement following punishment have utilized discrete loss-of-function manipulations that do not capture ongoing changes in neural circuitry related to punishment-induced behavior change. Here, we describe a two-pronged approach to analyzing the biobehavioral mechanisms of punishment learning using miniature fluorescence microscopes and deep learning algorithms. We review recent advancements in both techniques and consider a target neural circuit.

Methamphetamine increases risky choice in rats, but only when magnitude and probability of reinforcement are manipulated within a session

Risky choice is associated with maladaptive behaviors, particularly substance use disorders. Current animal models of risky choice are often confounded by other constructs like behavioral flexibility and suboptimal choice. The purpose of the current experiment was to determine if the psychostimulant methamphetamine, a drug whose popularity has increased in recent years, increases risky choice in an equivalent expected value (EEV) task. In the EEV task, rats are given a choice between two reinforcer alternatives that differ in magnitude and probability of delivery, but have equivalent expected value. Forty-eight Sprague Dawley rats were tested in three versions of the EEV task. In the first version of the EEV task, both reinforcer magnitude and probability were adjusted across blocks of trials for both alternatives. In the second and the third versions of the EEV task, reinforcer magnitude was held constant across each block of trials (either 1 vs. 2 pellets or 4 vs. 5 pellets). We found that male rats preferred the "riskier" option, except when reinforcer magnitudes were held constant at 4 and 5 pellets across each block of trials. Methamphetamine (0.5 mg/kg) increased preference for the risky option in both males and females, but only when both reinforcer magnitude and probability were manipulated across blocks of trials for each alternative. The current results demonstrate that both magnitude of reinforcement and probability of reinforcement interact to influence risky choice. Overall, this study provides additional support for using reinforcers with expected value to measure risky choice.

Punishment resistance for cocaine is associated with inflexible habits in rats

Addiction is characterized by continued drug use despite negative consequences. In an animal model, a subset of rats continues to self-administer cocaine despite footshock consequences, showing punishment resistance. We sought to test the hypothesis that punishment resistance arises from failure to exert goal-directed control over habitual cocaine seeking. While habits are not inherently permanent or maladaptive, continued use of habits under conditions that should encourage goal-directed control makes them maladaptive and inflexible. We trained male and female Sprague Dawley rats on a seeking-taking chained schedule of cocaine self-administration. We then exposed them to four days of punishment testing in which footshock was delivered randomly on one-third of trials. Before and after punishment testing (four days pre-punishment and ≥ four days post-punishment), we assessed whether cocaine seeking was goal-directed or habitual using outcome devaluation via cocaine satiety. We found that punishment resistance was associated with continued use of habits, whereas punishment sensitivity was associated with increased goal-directed control. Although punishment resistance for cocaine was not predicted by habitual responding pre-punishment, it was associated with habitual responding post-punishment. In parallel studies of food self-administration, we similarly observed that punishment resistance was associated with habitual responding post-punishment but not pre-punishment in males, although it was associated with habitual responding both pre- and post-punishment in females, indicating that punishment resistance was predicted by habitual responding in food-seeking females. These findings indicate that punishment resistance is related to habits that have become inflexible and persist under conditions that should encourage a transition to goal-directed behavior.

Understanding sex differences and the translational value of models of persistent substance use despite negative consequences

Persistent substance use despite negative consequences is a key facet of substance use disorder. The last decade has seen the preclinical field adopt the use of punishment to model adverse consequences associated with substance use. This has largely involved the pairing of drug use with either electric foot shock or quinine, a bitter tastant. Whilst at face value, these punishers may model aspects of the physical and psychological consequences of substance use, such models are yet to assist the development of approved medications for treatment. This review discusses progress made with animal models of punishment to understand the behavioral consequences of persistent substance use despite negative consequences. We highlight the importance of examining sex differences, especially when the behavioral response to punishment changes following drug exposure. Finally, we critique the translational value these models provide for the substance use disorder field.

Adolescent THC impacts on mPFC dopamine-mediated cognitive processes in male and female rats

Rationale

Adolescent cannabis use is linked to later-life changes in cognition, learning, and memory. Rodent experimental studies suggest Δ9-tetrahydrocannabinol (THC) influences development of circuits underlying these processes, especially in the prefrontal cortex, which matures during adolescence.

Objective

We determined how 14 daily THC injections (5mg/kg) during adolescence persistently impacts medial prefrontal cortex (mPFC) dopamine-dependent cognition.

Methods

In adult Long Evans rats treated as adolescents with THC (AdoTHC), we quantify performance on two mPFC dopamine-dependent reward-based tasks-strategy set shifting and probabilistic discounting. We also determined how acute dopamine augmentation with amphetamine (0, 0.25, 0.5 mg/kg), or specific chemogenetic stimulation of ventral tegmental area (VTA) dopamine neurons and their projections to mPFC impacts probabilistic discounting.

Results

AdoTHC sex-dependently impacts acquisition of cue-guided instrumental reward seeking, but has minimal effects on set-shifting or probabilistic discounting in either sex. When we challenged dopamine circuits acutely with amphetamine during probabilistic discounting, we found reduced discounting of improbable reward options, with AdoTHC rats being more sensitive to these effects than controls. In contrast, neither acute chemogenetic stimulation of VTA dopamine neurons nor pathway-specific chemogenetic stimulation of their projection to mPFC impacted probabilistic discounting in control rats, although stimulation of this cortical dopamine projection slightly disrupted choices in AdoTHC rats.

Conclusions

These studies confirm a marked specificity in the cognitive processes impacted by AdoTHC exposure. They also suggest that some persistent AdoTHC effects may alter amphetamine-induced cognitive changes in a manner independent of VTA dopamine projections to mPFC, or via alterations of non-VTA dopamine neurons.

Effects of systemic oxytocin receptor activation and blockade on risky decision making in female and male rats

The neuropeptide oxytocin is traditionally known for its roles in parturition, lactation, and social behavior. Other data, however, show that oxytocin can modulate behaviors outside of these contexts, including drug self-administration and some aspects of cost-benefit decision making. Here we used a pharmacological approach to investigate the contributions of oxytocin signaling to decision making under risk of explicit punishment. Female and male Long-Evans rats were trained on a risky decision-making task in which they chose between a small, "safe" food reward and a large, "risky" food reward that was accompanied by varying probabilities of mild footshock. Once stable choice behavior emerged, rats were tested in the task following acute intraperitoneal injections of oxytocin or the oxytocin receptor antagonist L-368,899. Neither drug affected task performance in males. In females, however, both oxytocin and L-368,899 caused a dose-dependent reduction in preference for large risky reward. Control experiments showed that these effects could not be accounted for by alterations in food motivation or shock sensitivity. Together, these results reveal a sex-dependent effect of oxytocin signaling on risky decision making in rats.

Acute stress differentially alters reward-related decision making and inhibitory control under threat of punishment

Acute stress has various effects on cognition, executive function and certain forms of cost/benefit decision making. Recent studies in rodents indicate that acute stress differentially alters reward-related decisions involving particular types of costs and slows choice latencies. Yet, how stress alters decisions where rewards are linked to punishment is less clear. We examined how 1 h restraint stress, followed by behavioral testing 10 min later altered action-selection on two tasks involving reward-seeking under threat of punishment in well-trained male and female rats. One study used a risky decision-making task involving choice between a small/safe reward and a large/risky one that could coincide with shock, delivered with a probability that increased over blocks of trials. Stress increased risk aversion and punishment sensitivity, reducing preference for the larger/risky reward, while increasing decision latencies and trial omissions in both sexes, when rats were teste. A second study used a "behavioral control" task, requiring inhibition of approach towards a readily available reward associated with punishment. Here, food pellets were delivered over discrete trials, half of which coincided with a 12 s audiovisual cue, signalling that reward retrieval prior to cue termination would deliver shock. Stress exerted sex- and timing-dependent effects on inhibitory control. Males became more impulsive and received more shocks on the stress test, whereas females were unaffected on the stress test, and were actually less impulsive when tested 24 h later. None of the effects of restraint stress were recapitulated by systemic treatment with physiological doses of corticosterone. These findings suggest acute stress induces qualitatively distinct and sometimes sex-dependent effects on punished reward-seeking that are critically dependent on whether animals must either choose between different actions or withhold them to obtain rewards and avoid punishment.

Sex differences in risk-based decision-making and the modulation of risk preference by dopamine-2 like receptors in rats

Heightened risk-based decision-making is observed across several neuropsychiatric disorders including schizophrenia, bipolar disorder, and Parkinson's disease, yet no treatments exist that effectively normalize this aberrant behavior. Preclinical risk-based decision-making paradigms have identified the important modulatory roles of dopamine and sex in the performance of such tasks, though specific task parameters may alter such effects (e.g., punishment and reward values). Previous work has highlighted the role of dopamine 2-like receptors (D2R) during performance of the Risk Preference Task (RPT) in male rats, however sex was not considered as a factor in this study, nor were treatments identified that reduced risk preference. Here, we utilized the RPT to determine sex-dependent differences in baseline performance and impact of the D2R receptor agonist pramipexole (PPX), and antagonist sulpiride (SUL) on behavioral performance. Female rats exhibited heightened risk-preference during baseline testing. Consistent with human studies, PPX increased risk-preference across sex, though the effects of PPX were more pronounced in female animals. Importantly, SUL reduced risk-preference in these rats across sexes. Thus, under the task specifications of the RPT that does not include punishment, female rats were more risk-preferring and required higher PPX doses to promote risky choices compared to males. Furthermore, blockade of D2R receptors may reduce risk-preference of rats, though further studies are required.

Lateral Orbitofrontal Cortex Encodes Presence of Risk and Subjective Risk Preference During Decision-Making

Adaptive decision-making requires consideration of objective risks and rewards associated with each option, as well as subjective preference for risky/safe alternatives. Inaccurate risk/reward estimations can engender excessive risk-taking, a central trait in many psychiatric disorders. The lateral orbitofrontal cortex (lOFC) has been linked to many disorders associated with excessively risky behavior and is ideally situated to mediate risky decision-making. Here, we used single-unit electrophysiology to measure neuronal activity from lOFC of freely moving rats performing in a punishment-based risky decision-making task. Subjects chose between a small, safe reward and a large reward associated with either 0% or 50% risk of concurrent punishment. lOFC activity repeatedly encoded current risk in the environment throughout the decision-making sequence, signaling risk before, during, and after a choice. In addition, lOFC encoded reward magnitude, although this information was only evident during action selection. A Random Forest classifier successfully used neural data accurately to predict the risk of punishment in any given trial, and the ability to predict choice via lOFC activity differentiated between and risk-preferring and risk-averse rats. Finally, risk preferring subjects demonstrated reduced lOFC encoding of risk and increased encoding of reward magnitude. These findings suggest lOFC may serve as a central decision-making hub in which external, environmental information converges with internal, subjective information to guide decision-making in the face of punishment risk.

A special role for anterior cingulate cortex, but not orbitofrontal cortex or basolateral amygdala, in choices involving information

Subjects are often willing to pay a cost for information. In a procedure that promotes paradoxical choices, animals choose between a richer option followed by a cue that is rewarded 50% of the time (No Info) vs. a leaner option followed by one of two cues that signal certain outcomes: one always rewarded (100%) and the other never rewarded, 0% (Info). Since decisions involve comparing the subjective value of options after integrating all their features, preference for information may rely on cortico-amygdalar circuitry. To test this, male and female rats were prepared with bilateral inhibitory Designer Receptors Exclusively Activated by Designer Drugs (DREADDs) in the anterior cingulate cortex, orbitofrontal cortex, basolateral amygdala, or null virus (control). We inhibited these regions after stable preference was acquired. We found that inhibition of the anterior cingulate cortex destabilized choice preference in female rats without affecting latency to choose or response rate to cues. A logistic regression fit revealed that previous choice predicted current choice in all conditions, however previously rewarded Info trials strongly predicted preference in all conditions except in female rats following anterior cingulate cortex inhibition. The results reveal a causal, sex-dependent role for the anterior cingulate cortex in decisions involving information.

Orbitofrontal and Prelimbic Cortices Serve Complementary Roles in Adapting Reward Seeking to Learned Anxiety

BACKGROUND

Anxiety is a common symptom of several mental health disorders and adversely affects motivated behaviors. Anxiety can emerge from associating risk of future harm while engaged in goal-guided actions. Using a recently developed behavioral paradigm to model this aspect of anxiety, we investigated the role of 2 cortical subregions, the prelimbic medial frontal cortex (PL) and lateral orbitofrontal cortex (lOFC), which have been implicated in anxiety and outcome expectation, in flexible representation of actions associated with harm risk.

METHODS

A seek-take reward-guided instrumental task design was used to train animals (N = 8) to associate the seek action with a variable risk of punishment. After learning, animals underwent extinction training for this association. Fiber photometry was used to measure and compare neuronal activity in the PL and lOFC during learning and extinction.

RESULTS

Animals increased action suppression in response to punishment contingencies. This increase dissipated after extinction training. These behavioral changes were associated with region-specific changes in neuronal activity. PL neuronal activity preferentially adapted to the threat of punishment, whereas lOFC activity adapted to safe aspects of the task. Moreover, correlated activity between these regions was suppressed during actions associated with harm risk, suggesting that these regions may guide behavior independently under anxiety.

CONCLUSIONS

These findings suggest that the PL and lOFC serve distinct but complementary roles in the representation of learned anxiety. This dissociation may provide a mechanism to explain how overlapping cortical systems are implicated in reward-guided action execution during anxiety.

Enhanced Risky Choice in Male Rats Elicited by the Acute Pharmacological Stressor Yohimbine Involves Prefrontal Dopamine D1 Receptor Activation

BACKGROUND

Acute stress alters risk-based decision-making; however, the underlying neural and neurochemical substrates are underexplored. Given their well-documented stress-inducing effects in humans and laboratory animals, glucocorticoids such as cortisol and corticosterone and the α2-adrenoceptor antagonist yohimbine represent potent pharmacological tools to mimic some characteristics of acute stress.

METHODS

Here, we analyzed the effects of the pharmacological stressors corticosterone and yohimbine given systemically on risk-based decision-making in male rats. Moreover, we investigated whether pharmacological stressor effects on risk-based decision-making involve dopamine D1 receptor stimulation in the dorsal prelimbic cortex (PL). We used a risk discounting task that requires choosing between a certain/small reward lever that always delivered 1 pellet and a risky/large reward lever that delivered 4 pellets with a decreasing probability across subsequent trials.

RESULTS

Systemic administration of yohimbine increased the preference for the risky/large reward lever. By contrast, systemic single administration of corticosterone did not significantly promote risky choice. Moreover, co-administration of corticosterone did not enhance the effects of yohimbine on risky choice. The data further show that the increased preference for the risky/large reward lever under systemic yohimbine was lowered by a concurrent pharmacological blockade of dopamine D1 receptors in the PL.

CONCLUSIONS

Our rodent data provide causal evidence that stimulation of PL D1 receptors may represent a neurochemical mechanism by which the acute pharmacological stressor yohimbine, and possibly nonpharmacological stressors as well, promote risky choice.

Effects of reproductive experience on cost-benefit decision making in female rats

Many individuals undergo mating and/or other aspects of reproductive experience at some point in their lives, and pregnancy and childbirth in particular are associated with alterations in the prevalence of several psychiatric disorders. Research in rodents shows that maternal experience affects spatial learning and other aspects of hippocampal function. In contrast, there has been little work in animal models concerning how reproductive experience affects cost-benefit decision making, despite the relevance of this aspect of cognition for psychiatric disorders. To begin to address this issue, reproductively experienced (RE) and reproductively naïve (RN) female Long-Evans rats were tested across multiple tasks that assess different forms of cost-benefit decision making. In a risky decision-making task, in which rats chose between a small, safe food reward and a large food reward accompanied by variable probabilities of punishment, RE females chose the large risky reward significantly more frequently than RN females (greater risk taking). In an intertemporal choice task, in which rats chose between a small, immediate food reward and a large food reward delivered after a variable delay period, RE females chose the large reward less frequently than RN females. Together, these results show distinct effects of reproductive experience on different forms of cost-benefit decision making in female rats, and highlight reproductive status as a variable that could influence aspects of cognition relevant for psychiatric disorders.

Chemogenetic activation of corticotropin-releasing factor-expressing neurons in the anterior bed nucleus of the stria terminalis reduces effortful motivation behaviors

Corticotropin-releasing factor (CRF) in the anterior bed nucleus of the stria terminalis (aBNST) is associated with chronic stress and avoidance behavior. However, CRF + BNST neurons project to reward- and motivation-related brain regions, suggesting a potential role in motivated behavior. We used chemogenetics to selectively activate CRF+ aBNST neurons in male and female CRF-ires-Cre mice during an effort-related choice task and a concurrent choice task. In both tasks, mice were given the option either to exert effort for high value rewards or to choose freely available low value rewards. Acute chemogenetic activation of CRF+ aBNST neurons reduced barrier climbing for a high value reward in the effort-related choice task in both males and females. Furthermore, acute chemogenetic activation of CRF+ aBNST neurons also reduced effortful lever pressing in high-performing males in the concurrent choice task. These data suggest a novel role for CRF+ aBNST neurons in effort-based decision and motivation behaviors.

A special role for anterior cingulate cortex, but not orbitofrontal cortex or basolateral amygdala, in choices involving information

Subjects often are willing to pay a cost for information. In a procedure that promotes paradoxical choices, animals choose between a richer option followed by a cue that is rewarded 50% of the time (No-info) vs a leaner option followed by one of two cues that signal certain outcomes: one always rewarded (100%), and the other never rewarded, 0% (Info). Since decisions involve comparing the subjective value of options after integrating all their features, preference for information may rely on cortico-amygdalar circuitry. To test this, male and female rats were prepared with bilateral inhibitory DREADDs in the anterior cingulate cortex (ACC), orbitofrontal cortex (OFC), basolateral amygdala (BLA), or null virus (control). We inhibited these regions after stable preference was acquired. We found that inhibition of ACC destabilized choice preference in female rats without affecting latency to choose or response rate to cues. A logistic regression fit revealed that the previous choice strongly predicted preference in control animals, but not in female rats following ACC inhibition. The results reveal a causal, sex-dependent role for ACC in decisions involving information.

Effects of fentanyl self-administration on risk-taking behavior in male rats

RATIONALE

Individuals with opioid use disorder (OUD) exhibit impaired decision making and elevated risk-taking behavior. In contrast to the effects of natural and semi-synthetic opioids, however, the impact of synthetic opioids on decision making is still unknown.

OBJECTIVES

The objective of the current study was to determine how chronic exposure to the synthetic opioid fentanyl alters risk-based decision making in adult male rats.

METHODS

Male rats underwent 14 days of intravenous fentanyl or oral sucrose self-administration. After 3 weeks of abstinence, rats were tested in a decision-making task in which they chose between a small, safe food reward and a large food reward accompanied by variable risk of footshock punishment. Following testing in the decision-making task, rats were tested in control assays that assessed willingness to work for food and shock reactivity. Lastly, rats were tested on a probabilistic reversal learning task to evaluate enduring effects of fentanyl on behavioral flexibility.

RESULTS

Relative to rats in the sucrose group, rats in the fentanyl group displayed greater choice of the large, risky reward (risk taking), an effect that was present as long as 7 weeks into abstinence. This increased risk taking was driven by enhanced sensitivity to the large rewards and diminished sensitivity to punishment. The fentanyl-induced elevation in risk taking was not accompanied by alterations in food motivation or shock reactivity or impairments in behavioral flexibility.

CONCLUSIONS

Results from the current study reveal that the synthetic opioid fentanyl leads to long-lasting increases in risk taking in male rats. Future experiments will extend this work to females and identify neural mechanisms that underlie these drug-induced changes in risk taking.

Acute Ethanol Modulates Synaptic Inhibition in the Basolateral Amygdala via Rapid NLRP3 Inflammasome Activation and Regulates Anxiety-Like Behavior in Rats

Chronic alcohol exposure leads to a neuroinflammatory response involving activation of the nucleotide-binding oligomerization domain-like receptor protein 3 (NLRP3) inflammasome and proinflammatory cytokine production. Acute ethanol (EtOH) exposure activates GABAergic synapses in the central and basolateral amygdala (BLA) ex vivo, but whether this rapid modulation of synaptic inhibition is because of an acute inflammatory response and alters anxiety-like behavior in male and female animals is not known. Here, we tested the hypotheses that acute EtOH facilitates inhibitory synaptic transmission in the BLA by activating the NLRP3 inflammasome-dependent acute inflammatory response, that the alcohol-induced increase in inhibition is cell type and sex dependent, and that acute EtOH in the BLA reduces anxiety-like behavior. Acute EtOH application at a binge-like concentration (22-44 mm) stimulated synaptic GABA release from putative parvalbumin (PV) interneurons onto BLA principal neurons in ex vivo brain slices from male, but not female, rats. The EtOH facilitation of synaptic inhibition was blocked by antagonists of the Toll-like receptor 4 (TLR4), the NLRP3 inflammasome, and interleukin-1 receptors, suggesting it was mediated by a rapid local neuroinflammatory response in the BLA. In vivo, bilateral injection of EtOH directly into the BLA produced an acute concentration-dependent reduction in anxiety-like behavior in male but not female rats. These findings demonstrate that acute EtOH in the BLA regulates anxiety-like behavior in a sex-dependent manner and suggest that this effect is associated with presynaptic facilitation of parvalbumin-expressing interneuron inputs to BLA principal neurons via a local NLRP3 inflammasome-dependent neuroimmune response.SIGNIFICANCE STATEMENT Chronic alcohol exposure produces a neuroinflammatory response, which contributes to alcohol-associated pathologies. Acute alcohol administration increases inhibitory synaptic signaling in the brain, but the mechanism for the rapid alcohol facilitation of inhibitory circuits is unknown. We found that acute ethanol at binge-like concentrations in the basolateral amygdala (BLA) facilitates GABA release from parvalbumin-expressing (PV) interneuron synapses onto principal neurons in ex vivo brain slices from male rats and that intra-BLA ethanol reduces anxiety-like behavior in vivo in male rats, but not female rats. The ethanol (EtOH) facilitation of inhibition in the BLA is mediated by Toll-like receptor 4 (TLR4) and nucleotide-binding oligomerization domain-like receptor protein 3 (NLRP3) inflammasome activation and proinflammatory IL-1β signaling, which suggests a rapid NLRP3 inflammasome-dependent neuroimmune cascade that plays a critical role in acute alcohol intoxication.

Cocaine intake correlates with risk-taking behavior and affects estrous cycling in female Sprague-Dawley rats

Navigating complex decisions and considering their relative risks and rewards is an important cognitive ability necessary for survival. However, use of and dependence on illicit drugs can result in long-lasting changes to this risk/reward calculus in individuals with substance use disorder. Recent work has shown that chronic exposure to cocaine causes long-lasting increases in risk taking in male and female rats, but there are still significant gaps in our understanding of the relationship between cocaine use and changes in risk taking. For example, it is unclear whether the magnitude of cocaine intake dictates the extent to which risk taking is altered. To address this, male and female Sprague-Dawley rats underwent cocaine (or sucrose) self-administration and, following a period of abstinence, were trained and tested in a rodent model of risky decision making. In this behavioral task, rats made discrete-trial choices between a lever associated with a small food reward (i.e., "safe" option) and a lever associated with a larger food reward accompanied by a variable risk of footshock delivery (i.e., "risky" option). Surprisingly, and in contrast to prior work in Long-Evans rats, there were no effects of cocaine self-administration on choice of the large, risky reward (i.e., risk taking) during abstinence in males or females. There was, however, a significant relationship between cocaine intake and risk taking in female rats, with greater intake associated with greater preference for the large, risky reward. Relative to their sucrose counterparts, female rats in the cocaine group also exhibited irregular estrous cycles, characterized by prolonged estrus and/or diestrus phases. Collectively, these data suggest that there may be strain differences in the effects of cocaine on risk taking and highlight the impact that chronic cocaine exposure has on hormonal cyclicity in females. Future work will focus on understanding the neural mechanisms underlying cocaine's intake-dependent effects on risk taking in females, and whether this is directly related to cocaine-induced alterations in neuroendocrine function.

Sex differences in patch-leaving foraging decisions in rats

The ubiquity, importance, and sophistication of foraging behavior makes it an ideal platform for studying naturalistic decision making in animals. We developed a spatial patch-foraging task for rats, in which subjects chose how long to remain in one foraging patch as the rate of food earnings steadily decreased. The cost of seeking out a new location was varied across sessions. The behavioral task was designed to mimic the structure of natural foraging problems, where distinct spatial locations are associated with different reward statistics, and decisions require navigation and movement through space. Male and female Long-Evans rats generally followed the predictions of theoretical models of foraging, albeit with a consistent tendency to persist with patches for too long compared to behavioral strategies that maximize food intake rate. The tendency to choose overly-long patch residence times was stronger in male rats. We also observed sex differences in locomotion as rats performed the task, but these differences in movement only partially accounted for the differences in patch residence durations observed between male and female rats. Together, these results suggest a nuanced relationship between movement, sex, and foraging decisions.

Sex differences in patch-leaving foraging decisions in rats

The ubiquity, importance, and sophistication of foraging behavior makes it an ideal platform for studying naturalistic decision making in animals. We developed a spatial patch-foraging task for rats, in which subjects chose how long to remain in one foraging patch as the rate of food earnings steadily decreased. The cost of seeking out a new location was varied across sessions. The behavioral task was designed to mimic the structure of natural foraging problems, where distinct spatial locations are associated with different reward statistics, and decisions require navigation and movement through space. Male and female Long-Evans rats generally followed the predictions of theoretical models of foraging, albeit with a consistent tendency to persist with patches for too long compared to behavioral strategies that maximize food intake rate. The tendency to choose overly-long patch residence times was stronger in male rats. We also observed sex differences in locomotion as rats performed the task, but these differences in movement only partially accounted for the differences in patch residence durations observed between male and female rats. Together, these results suggest a nuanced relationship between movement, sex, and foraging decisions.

Female rats prefer to forage food from males, an effect that is not influenced by stress

As social beings, animals and humans alike make real life decisions that are often influenced by other members. Most current research has focused on the influence of same-sex peers on individual decision-making, with potential opposite sex effect scarcely explored. Here, we developed a behavioral model to observe food foraging decision-making in female rats under various social situations. We found that female rats preferred to forage food from male over female rats or from the no-rat storage side. Female rats were more likely to forage food from familiar males than from unfamiliar. This opposite-sex preference was not altered by the lure of sweet food, or with estrous cycle, nor under stress conditions. These results suggest that the opposite sex influences food foraging decision-making in female rats. The behavioral model established could facilitate future investigation into the underlying neurobiological mechanisms.

Relative to females, male rats are more willing to forego obtaining sucrose reward in order to prevent harm to their cage mate

RATIONALE

Empathy, or the ability to perceive, share, and act upon the emotions of another, is a crucial social skill and is dysfunctional in autism and schizophrenia. While the complexities of human empathy are difficult to model in rodents, behavioral paradigms utilizing rats which study decision-making in social contexts may provide a translational framework for assessing biological, pharmacotherapeutic, and environmental interventions.

OBJECTIVES

Modify and expand upon the three-session rat harm aversion task, which measures the willingness of rats to cease pressing a lever that earns them sucrose reward but delivers a shock to their cage mate. We sought to test the sustainability of harm aversion across seven sessions in male and female rats.

METHODS

Same-sex pair-housed rats were assigned as either the observer, which had access to the lever, or the demonstrator, which would receive shocks. After training the observer to press the lever to receive sucrose pellets, the demonstrator was placed into an adjacent chamber at which point lever responses would also deliver a shock. If the observer did not press the lever, no shock and no sucrose was delivered.

RESULTS

A sex difference in harm aversion was observed with female rats having significantly higher response rates and decreased response latencies across the seven test sessions, thus delivering more shocks and obtaining more sucrose, relative to males.

CONCLUSIONS

These data demonstrate that male rats sustain harm aversion to a greater extent relative to females.

Behavioural and physiological responses of Small Tail Han sheep to predators

Prey animals modify their behaviour and physiology in the presence of predators. Domestic animals differ from wild animals in having less exposure to wild predators, but whether they still retain an antipredator instinct is frequently unknown. In this study, we used domesticated Small Tail Han sheep as a model prey animal to gauge their response to the presence of predators, in the form of odours from the faeces of lion, tiger, and leopard. The faeces of male sheep and male rabbit (as a heterogeneous non-predator) were used as control. We found that the frequency and time of feeding, exploration, moving, watching, and lying down behaviours were significantly affected by predator odour, and that there was an interaction between odour sources and sex. When exposed to predator odour, sheep reduced their frequency and time of feeding, and increased their exploratory, moving, and watching behaviours. Female sheep showed greater motivation towards frequent and lengthy exploration, moving, watching, and lying down behaviours than male sheep, and less motivation towards feeding and drinking behaviours. Serum cortisol levels were lowest in response to tiger stimuli. These results illustrated that Small Tail Han sheep could recognise predator odour and adjust their behaviour to display antipredator strategies, and displayed some physiological responses, although only changing in serum cortisol could be significantly attributed to the odour of predators.

Divergent risky decision-making and impulsivity behaviors in Lewis rat substrains with low genetic difference

Substance use disorder (SUD) is associated with a cluster of cognitive disturbances that engender vulnerability to ongoing drug seeking and relapse. Two of these endophenotypes-risky decision-making and impulsivity-are amplified in individuals with SUD and are augmented by repeated exposure to illicit drugs. Identifying genetic factors underlying variability in these behavioral patterns is critical for early identification, prevention, and treatment of SUD-vulnerable individuals. Here, we compared risky decision-making and different facets of impulsivity between two fully inbred substrains of Lewis rats-LEW/NCrl and LEW/NHsd. We performed whole genome sequencing of both substrains to identify almost all relevant variants. We observed substantial differences in risky decision-making and impulsive behaviors. Relative to LEW/NHsd, the LEW/NCrl substrain accepts higher risk options in a decision-making task and higher rates of premature responses in the differential reinforcement of low rates of responding task. These phenotypic differences were more pronounced in females than males. We defined a total of ∼9,000 polymorphisms between these substrains at 40× whole genome short-read coverage. Roughly half of variants are located within a single 1.5 Mb region of Chromosome 8, but none impact protein-coding regions. In contrast, other variants are widely distributed, and of these, 38 are predicted to cause protein-coding variants. In conclusion, Lewis rat substrains differ significantly in risk-taking and impulsivity and only a small number of easily mapped variants are likely to be causal. Sequencing combined with a reduced complexity cross should enable identification of one or more variants underlying multiple complex addiction-relevant behaviors. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Dopamine and norepinephrine differentially mediate the exploration-exploitation tradeoff

The catecholamines dopamine (DA) and norepinephrine (NE) have been repeatedly implicated in neuropsychiatric vulnerability, in part via their roles in mediating the decision making processes. Although the two neuromodulators share a synthesis pathway and are co-activated under states of arousal, they engage in distinct circuits and roles in modulating neural activity across the brain. However, in the computational neuroscience literature, they have been assigned similar roles in modulating the latent cognitive processes of decision making, in particular the exploration-exploitation tradeoff. Revealing how each neuromodulator contributes to this explore-exploit process will be important in guiding mechanistic hypotheses emerging from computational psychiatric approaches. To understand the differences and overlaps of the roles of these two catecholamine systems in regulating exploration and exploitation, a direct comparison using the same dynamic decision making task is needed. Here, we ran mice in a restless two-armed bandit task, which encourages both exploration and exploitation. We systemically administered a nonselective DA receptor antagonist (flupenthixol), a nonselective DA receptor agonist (apomorphine), a NE beta-receptor antagonist (propranolol), and a NE beta-receptor agonist (isoproterenol), and examined changes in exploration within subjects across sessions. We found a bidirectional modulatory effect of dopamine receptor activity on the level of exploration. Increasing dopamine activity decreased exploration and decreasing dopamine activity increased exploration. Beta-noradrenergic receptor activity also modulated exploration, but the modulatory effect was mediated by sex. Reinforcement learning model parameters suggested that dopamine modulation affected exploration via decision noise and norepinephrine modulation affected exploration via outcome sensitivity. Together, these findings suggested that the mechanisms that govern the transition between exploration and exploitation are sensitive to changes in both catecholamine functions and revealed differential roles for NE and DA in mediating exploration.

Punishment resistance for cocaine is associated with inflexible habits in rats

Addiction is characterized by continued drug use despite negative consequences. In an animal model, a subset of rats continues to self-administer cocaine despite footshock consequences, showing punishment resistance. We sought to test the hypothesis that punishment resistance arises from failure to exert goal-directed control over habitual cocaine seeking. While habits are not inherently permanent or maladaptive, continued use of habits under conditions that should encourage goal-directed control makes them maladaptive and inflexible. We trained male and female Sprague Dawley rats on a seeking-taking chained schedule of cocaine self-administration (2 h/day). We then exposed them to 4 days of punishment testing, in which footshock (0.4 mA, 0.3 s) was delivered randomly on one-third of trials, immediately following completion of seeking and prior to extension of the taking lever. Before and after punishment testing (4 days pre-punishment and ≥4 days post-punishment), we assessed whether cocaine seeking was goal-directed or habitual using outcome devaluation via cocaine satiety. We found that punishment resistance was associated with continued use of habits, whereas punishment sensitivity was associated with increased goal-directed control. Although punishment resistance was not predicted by habitual responding pre-punishment, it was associated with habitual responding post-punishment. In parallel studies of food self-administration, we similarly observed that punishment resistance was associated with habitual responding post-punishment but not pre-punishment. These findings indicate that punishment resistance is related to habits that have become inflexible and persist under conditions that should encourage a transition to goal-directed behavior.

Reward maximization assessed using a sequential patch depletion task in a large sample of heterogeneous stock rats

Choice behavior requires animals to evaluate both short- and long-term advantages and disadvantages of all potential alternatives. Impulsive choice is traditionally measured in laboratory tasks by utilizing delay discounting (DD), a paradigm that offers a choice between a smaller immediate reward, or a larger more delayed reward. This study tested a large sample of Heterogeneous Stock (HS) male (n = 896) and female (n = 898) rats, part of a larger genetic study, to investigate whether measures of reward maximization overlapped with traditional models of delay discounting via the patch depletion model using a Sequential Patch Depletion procedure. In this task, rats were offered a concurrent choice between two water "patches" and could elect to "stay" in the current patch or "leave" for an alternative patch. Staying in the current patch resulted in decreasing subsequent reward magnitudes, whereas the choice to leave a patch was followed by a delay and a resetting to the maximum reward magnitude. Based on the delay in a given session, different visit durations were necessary to obtain the maximum number of rewards. Visit duration may be analogous to an indifference point in traditional DD tasks. Males and females did not significantly differ on traditional measures of DD (e.g. delay gradient; AUC). When examining measures of patch utilization, females made fewer patch changes at all delays and spent more time in the patch before leaving for the alternative patch compared to males. Consistent with this, there was some evidence that females deviated from reward maximization more than males. However, when controlling for body weight, females had a higher normalized rate of reinforcement than males. Measures of reward maximization were only weakly associated with traditional DD measures and may represent distinctive underlying processes. Taken together, females performance differed from males with regard to reward maximization that were not observed utilizing traditional measures of DD, suggesting that the patch depletion model was more sensitive to modest sex differences when compared to traditional DD measures in a large sample of HS rats.

Cognitive mechanisms underlying decision making involving risk of explicit punishment in male and female rats

Individuals engage in the process of risk-based decision making on a daily basis to navigate various aspects of life. There are, however, individual differences in this form of decision making, with some individuals exhibiting preference for riskier choices (risk taking) and others exhibiting preference for safer choices (risk aversion). Recent work has shown that extremes in risk taking (e.g., excessive risk taking or risk aversion) are not only cognitive features of neuropsychiatric diseases, but may in fact predispose individuals to the development of such diseases. To better understand individual differences in risk taking, and thus the mechanisms by which they confer disease vulnerability, the current study investigated the cognitive contributions to risk taking in both males and females. Rats were first behaviorally characterized in a decision-making task involving risk of footshock punishment and then tested on a battery of cognitive behavioral assays. Individual variability in risk taking was compared with performance on these tasks. Consistent with prior work, females were more risk averse than males. With the exception of the Set-shifting Task, there were no sex differences in performance on other cognitive assays. There were, however, sex-dependent associations between risk taking and specific cognitive measures. Greater risk taking was associated with better cognitive flexibility in males whereas greater risk aversion was associated with better working memory in females. Collectively, these findings reveal that distinct cognitive mechanisms are associated with risk taking in males and females, which may account for sex differences in this form of decision making.

The medial orbitofrontal cortex governs reward-related circuits in an age-dependent manner

Nucleus accumbens (NAc) neurons integrate excitatory inputs from cortical and limbic structures, contributing to critical cognitive functions, including decision-making. As these afferents mature from adolescence through adulthood, incoming signals to the NAc may summate differently between age groups. Decision-making evaluates both reward and risk before action selection, suggesting an interplay between reward- and risk-related circuits. Medial orbitofrontal cortex (MO)-NAc circuits permit risk assessment behaviors and likely underlie risk information incorporation. As adolescents make reward-centric choices regardless of risk, we hypothesized the impact of MO activity alters reward-related NAc circuits in an age-dependent manner. To test this hypothesis, we used single-unit electrophysiology to measure MO train stimulation's effect on reward-related pathways, specifically the basolateral amygdala (BLA)-NAc circuit, in adult and adolescent rats. MO train stimulation altered the strength but not the timing of BLA-NAc interactions in a frequency-dependent manner. In adults, MO train stimulation produced a frequency-dependent, bidirectional effect on BLA-evoked NAc AP probability. Contrastingly, MO train stimulation uniformly attenuated BLA-NAc interactions in adolescents. While the mature MO can govern reward-related circuits in an activity-dependent manner, perhaps to adapt to positive or negative decision-making outcomes, the adolescent MO may be less able to bidirectionally impact reward-related pathways resulting in biased decision-making.

Adolescent alcohol exposure alters threat avoidance in adulthood

Adolescent binge-like alcohol exposure impairs cognitive function and decision making in adulthood and may be associated with dysfunction of threat avoidance, a critical mechanism of survival which relies upon executive function. The present study investigated the impact of binge-like alcohol exposure during adolescence on active avoidance in adulthood. Male and female rats were subjected to adolescent intermittent ethanol (AIE) exposure by vapor inhalation and then tested in adulthood using a platform-mediated avoidance task. After training to press a lever to receive a sucrose reward, the rats were conditioned to a tone that co-terminated with a foot-shock. A motivational conflict was introduced by the presence of an escape platform that isolated the rat from the shock, but also prevented access to the sucrose reward while the rat was on the platform. During the task training phase, both male and female rats exhibited progressive increases in active avoidance (platform escape) in response to the conditioned tone, whereas innate fear behavior (freezing) remained relatively constant over training days. A history of AIE exposure did not impact either active avoidance or freezing behavior during task acquisition. On the test day following platform acquisition training, female rats exhibited higher levels of both active avoidance and freezing compared to male rats, while AIE-exposed male but not female rats exhibited significantly greater levels of active avoidance compared to controls. In contrast, neither male nor female AIE-exposed rats exhibited alterations in freezing compared to controls. Following 5 days of extinction training, female rats continued to display higher levels of active avoidance and freezing during tone presentation compared to males. Male AIE-exposed rats also had higher levels of both active avoidance and freezing compared to the male control rats. Together, the results demonstrate that female rats exhibit elevated levels of active avoidance and freezing compared to males and further reveal a sex-specific impact of AIE on threat responding in adulthood.

Dopamine D1 receptor and effort-based decision making in rats: The moderating effect of sex

Dopamine is a modulating factor in effort-based decision-making, and emerging evidence from pharmacological research suggests that the dopamine D1 receptor is the primary regulator. Given the limited selectivity of pharmacological tools, we further explored this hypothesis using dopamine D1 mutant (DAD1^-/-) rats which have a specific genetic reduction in functional D1 receptors. Moreover, given the strong focus on males in neuroscience research in general and in the role of D1 receptors in effort-based learning, we compared both sexes in the present study. Adult male and female DAD1^-/- mutant rats and wild type controls were trained to press a lever for a reinforcer. Once trained, subjects completed multiple fixed ratio, progressive ratio, and operant effort-choice (concurrent progressive ratio/chow feeding task [PROG/chow]) experiments. We predicted that DAD1^-/- mutant rats would press the lever significantly less than controls across all experiments, have lower breakpoints, and consume more freely available food. As predicted, DAD1^-/- mutant rats (regardless of sex) pressed the lever significantly less than controls and had lower breakpoints. Interestingly, there was a sex * genotype interaction for acquisition rates of lever pressing and change in breakpoints with free food available. Only 31% of DAD1^-/- mutant males acquired lever pressing while 73% of DAD1^-/- mutant females acquired lever pressing. Additionally, DAD1^-/- mutant males had significantly larger decreases in breakpoints when free food was available. These findings extend the pharmacological research suggesting that the dopamine D1 receptor modulates decisions based on effort, which has implications for the development of treatment targeting amotivation in neuropsychiatric disorders. The sex * genotype interaction highlights the importance of including both sexes in future research, especially when there are sex differences in incidences and severity of neuropsychiatric disorders.

Age-Related Changes in Risky Decision Making and Associated Neural Circuitry in a Rat Model

Altered decision making at advanced ages can have a significant impact on an individual's quality of life and the ability to maintain personal independence. Relative to young adults, older adults make less impulsive and less risky choices; although these changes in decision making could be considered beneficial, they can also lead to choices with potentially negative consequences (e.g., avoidance of medical procedures). Rodent models of decision making have been invaluable for dissecting cognitive and neurobiological mechanisms that contribute to age-related changes in decision making, but they have predominantly used costs related to timing or probability of reward delivery and have not considered other equally important costs, such as the risk of adverse consequences. The current study therefore used a rat model of decision making involving risk of explicit punishment to examine age-related changes in this form of choice behavior in male rats, and to identify potential cognitive and neurobiological mechanisms that contribute to these changes. Relative to young rats, aged rats displayed greater risk aversion, which was not attributable to reduced motivation for food, changes in shock sensitivity, or impaired cognitive flexibility. Functional MRI analyses revealed that, overall, functional connectivity was greater in aged rats compared with young rats, particularly among brain regions implicated in risky decision making such as basolateral amygdala, orbitofrontal cortex, and ventral tegmental area. Collectively, these findings are consistent with greater risk aversion found in older humans, and reveal age-related changes in brain connectivity.

Sex-dependent effects of chronic stress on punished cocaine self-administration and cue-induced relapse to cocaine seeking

We tested the effects of chronic stress on cocaine relapse after drug-reinforced responding was suppressed by punishment, an animal model of human relapse after self-imposed abstinence due to the negative consequences of drug use. Male rats displayed greater resistance to punishment than females, but daily stress decreased this resistance. Only female rats with a history of chronic stress displayed increased responding for cocaine cues from abstinence Day 1 to Day 8. Thus, the effects of chronic stress on punished cocaine self-administration and cue-induced relapse are dependent on biological sex, and may have implications for more targeted treatments for cocaine addiction.

Sequential delay and probability discounting tasks in mice reveal anchoring effects partially attributable to decision noise

Delay discounting and probability discounting decision making tasks in rodent models have high translational potential. However, it is unclear whether the discounted value of the large reward option is the main contributor to variability in animals' choices in either task, which may limit translation to humans. Male and female mice underwent sessions of delay and probability discounting in sequence to assess how choice behavior adapts over experience with each task. To control for "anchoring" (persistent choices based on the initial delay or probability), mice experienced "Worsening" schedules where the large reward was offered under initially favorable conditions that became less favorable during testing, followed by "Improving" schedules where the large reward was offered under initially unfavorable conditions that improved over a session. During delay discounting, both male and female mice showed elimination of anchoring effects over training. In probability discounting, both sexes of mice continued to show some anchoring even after months of training. One possibility is that "noisy", exploratory choices could contribute to these persistent anchoring effects, rather than constant fluctuations in value discounting. We fit choice behavior in individual animals using models that included both a value-based discounting parameter and a decision noise parameter that captured variability in choices deviating from value maximization. Changes in anchoring behavior over time were tracked by changes in both the value and decision noise parameters in delay discounting, but by the decision noise parameter in probability discounting. Exploratory decision making was also reflected in choice response times that tracked the degree of conflict caused by both uncertainty and temporal cost, but was not linked with differences in locomotor activity reflecting chamber exploration. Thus, variable discounting behavior in mice can result from changes in exploration of the decision options rather than changes in reward valuation.

Regulation of sex differences in risk-based decision making by gonadal hormones: Insights from rodent models

Men and women differ in their ability to evaluate options that vary in their rewards and the risks that are associated with these outcomes. Most studies have shown that women are more risk averse than men and that gonadal hormones significantly contribute to this sex difference. Gonadal hormones can influence risk-based decision making (i.e., risk taking) by modulating the neurobiological substrates underlying this cognitive process. Indeed, estradiol, progesterone and testosterone modulate activity in the prefrontal cortex, amygdala and nucleus accumbens associated with reward and risk-related information. The use of animal models of decision making has advanced our understanding of the intersection between the behavioral, neural and hormonal mechanisms underlying sex differences in risk taking. This review will outline the current state of this literature, identify the current gaps in knowledge and suggest the neurobiological mechanisms by which hormones regulate risky decision making. Collectively, this knowledge can be used to understand the potential consequences of significant hormonal changes, whether endogenously or exogenously induced, on risk-based decision making as well as the neuroendocrinological basis of neuropsychiatric diseases that are characterized by impaired risk taking, such as substance use disorder and schizophrenia.

Examining sex disparities in risk/reward trade-offs in Smith's zokors, Eospalax smithii

Risk taking is imperative for the survival and fitness of animals since they are constantly facing innumerable threats from various sources. Indeed, the ability of the individual to balance the costs and benefits of various options and adopt a wise decision is critical for the animal well-being. We modified several traditionally used anxiety tests [The modified light-dark box (mLDB), the modified open field test (mOFT) and the modified defensive withdrawal apparatus (mDWA)] by adding a palatable food reward within the anxiogenic zone which granted us to assess the sex differences in risk-taking behavior in Smith's zokors (Eospalax smithii), a typical subterranean rodent species endemic to the Qinghai-Tibetan Plateau. Concomitant with our working hypothesis, female zokors showed strong aversion and avoidance behavioral responses when tested in the mOFT and mDWA while there were no apparent sexually dimorphic behavioral changes when they were tested in the mLDB (Except for the percentage of food consumed and the latency till start feeding). Furthermore, comparison between the three behavioral paradigms revealed that both sexes showed different behavioral responses toward the different behavioral tests. Sex differences in repeatable behaviors were more profound in females than males. This might reflect different degrees of risk perception and emotionality that may differ considerably between the different models of anxiety. Our results highlighted the functional significance of a trade-off between risk and incentives in natural environment that both male and female zokors differ in the processing of risk assessment in the presence of a food reward.

Prepubertal methylphenidate leads to sex-dependent differences in probabilistic discounting

Prescription psychostimulants, such as methylphenidate (MPH), have served as a first line treatment for ADHD and associated developmental disorders since 1961. Psychostimulants has been shown to improve attention, response inhibition, and reduce hyperactivity in patients with ADHD, as well as in non-clinical human populations and animals. While there is a considerable amount of preclinical research investigating the effects of stimulant medications on reward sensitivity and basic learning in male rats, less is understood about their effects in females. Further, there are competing theories on the long-term cognitive impact of MPH, specifically in children who do not have ADHD. To this end, Long-Evans female and male rats were exposed to methylphenidate (0, 2.5, 5 mg/kg, BID, IP) for 20 days during early development (PD10-29). After discontinuation of MPH into adulthood, rats (beginning PD 60) were trained and tested for risk-preference using a 2-choice probabilistic discounting task. For this task, rats were given an option between a 'large-risky' choice (3 sugar pellets delivered on a probabilistic VR schedule) and 'small-certain' choice (1 sugar pellet delivered on a FR schedule). Rats were subsequently tested on an open field conflict test. The results demonstrate that prepubertal exposure to MPH can have lasting effects on decision-making. Specifically, female rats treated with 2.5 mg/kg MPH displayed a decrease in preference for the risky option, whereas male rats treated with the same dose showed an overall increase in preference compared to sex-matched controls. Irrespective of sex, rats treated with 2.5 mg/kg MPH also demonstrated a decrease in anxiety/inhibitory behavior on the modified open field test compared to controls. These results were not due to differences in locomotor behavior. Overall, the study contributes to the growing body of evidence to suggest that MPH exposure early in development can have a sex-dependent impact on decision-making in adulthood.

Instrumental aversion coding in the basolateral amygdala and its reversion by a benzodiazepine

Punishment involves learning the relationship between actions and their adverse consequences. Both the acquisition and expression of punishment learning depend on the basolateral amygdala (BLA), but how BLA supports punishment remains poorly understood. To address this, we measured calcium (Ca²⁺) transients in BLA principal neurons during punishment. Male rats were trained to press two individually presented levers for food; when one of these levers also yielded aversive footshock, responding on this punished lever decreased relative to the other, unpunished lever. In rats with the Ca²⁺ indicator GCaMP6f targeted to BLA principal neurons, we observed excitatory activity transients to the footshock punisher and inhibitory transients to lever-presses earning a reward. Critically, as rats learned punishment, activity around the punished response transformed from inhibitory to excitatory and similarity analyses showed that these punished lever-press transients resembled BLA transients to the punisher itself. Systemically administered benzodiazepine (midazolam) selectively alleviated punishment. Moreover, the degree to which midazolam alleviated punishment was associated with how much punished response-related BLA transients reverted to their pre-punishment state. Together, these findings show that punishment learning is supported by aversion-coding of instrumental responses in the BLA and that the anti-punishment effects of benzodiazepines are associated with a reversion of this aversion coding.

Impairments in Fear Extinction Memory and Basolateral Amygdala Plasticity in the TgF344-AD Rat Model of Alzheimer's Disease Are Distinct from Nonpathological Aging

Fear-based disorders such as post-traumatic stress disorder (PTSD) steepen age-related cognitive decline and double the risk for developing Alzheimer's disease (AD). Because of the seemingly hyperactive properties of fear memories, PTSD symptoms can worsen with age. Perturbations in the synaptic circuitry supporting fear memory extinction are key neural substrates of PTSD. The basolateral amygdala (BLA) is a medial temporal lobe structure that is critical in the encoding, consolidation, and retrieval of fear memories. As little is known about fear extinction memory and BLA synaptic dysfunction within the context of aging and AD, the goal of this study was to investigate how fear extinction memory deficits and basal amygdaloid nucleus (BA) synaptic dysfunction differentially associate in nonpathologic aging and AD in the TgF344AD (TgAD) rat model of AD. Young, middle-aged, and older-aged WT and TgAD rats were trained on a delay fear conditioning and extinction procedure before ex vivo extracellular field potential recording experiments in the BA. Relative to young WT rats, long-term extinction memory was impaired, and in general, was associated with a hyperexcitable BA and impaired LTP in TgAD rats at all ages. In contrast, long-term extinction memory was impaired in aged WT rats and was associated with impaired LTP but not BA hyperexcitability. Interestingly, the middle-aged TgAD rats showed intact short-term extinction and BA LTP, which is suggestive of a compensatory mechanism, whereas differential neural recruitment in older-aged WT rats may have facilitated short-term extinction. As such, associations between fear extinction memory and amygdala deficits in nonpathologic aging and AD are dissociable.

Body mass and sex, but not breeding condition and season, influence open‐field exploration in the yellow‐necked mouse

Theory predicts that risk taking should be influenced by external (e.g., season) and internal (e.g., breeding condition, sex, and body mass) conditions. We investigated whether these factors are associated with a potentially risky behavior: exploration of a novel environment. We conducted repeated open‐field tests of exploration in a common forest rodent, the yellow‐necked mouse Apodemus flavicollis. Contrary to expectations, the exploration did not vary with the season (spring vs. fall) or the reproductive status of the tested animals. Also unexpectedly, there was an inverted U‐shaped relationship between body mass and exploration: animals with intermediate body mass tended to have the highest exploration tendencies. Males were more exploratory than females. Finally, even after adjusting for the effects of body mass and sex, individuals exhibited consistent, repeatable differences in exploration tendencies (“behavioral types” or “personalities”). The discrepancies between certain broad generalizations and our results suggest that risk taking depends on details of species‐specific biology.

Adolescent Alcohol Exposure Results in Sex-specific Alterations in Conditioned Fear Learning and Memory in Adulthood

The present study used auditory fear conditioning to assess the impact of repeated binge-like episodes of alcohol exposure during adolescence on conditioned fear in adulthood. Male and female Long-Evans rats were subjected to adolescent intermittent ethanol (AIE) exposure by vapor inhalation between post-natal day 28 and 44. After aging into adulthood, rats then underwent fear conditioning by exposure to a series of tone-shock pairings. This was followed by cued-tone extinction training, and then testing of fear recovery. In male rats, AIE exposure enhanced conditioned freezing but did not alter the time-course of extinction of cued-tone freezing. During subsequent assessment of fear recovery, AIE exposed rats exhibited less freezing during contextual fear renewal, but greater freezing during extinction recall and spontaneous recovery. Compared to males, female rats exhibited significantly lower levels of freezing during fear conditioning, more rapid extinction of freezing behavior, and significantly lower levels of freezing during the tests of fear recovery. Unlike males that were all classified as high conditioners; female rats could be parsed into either a high or low conditioning group. However, irrespective of their level of conditioned freezing, both the high and low conditioning groups of female rats exhibited rapid extinction of conditioned freezing behavior and comparatively low levels of freezing in tests of fear recovery. Regardless of group classification, AIE had no effect on freezing behavior in female rats during acquisition, extinction, or fear recovery. Lastly, exposure of male rats to the mGlu5 positive allosteric modulator CDPPB prevented AIE-induced alterations in freezing. Taken together, these observations demonstrate sex-specific changes in conditioned fear behaviors that are reversible by pharmacological interventions that target mGlu5 receptor activation.

Effects of the psychoactive compounds in green tea on risky decision-making

Epigallocatechin-3-gallate (EGCG) and caffeine are the two primary compounds found in green tea. While EGCG has anxiolytic and anti-inflammatory effects, its acute effects on cognition are not well understood. Furthermore, despite widespread green tea consumption, little is known about how EGCG and caffeine co-administration impacts behavior. Here, we investigated the effects of multiple doses of either EGCG or caffeine on a rat model of risk-taking. This was assessed using the risky decision-making task (RDT), in which rats choose between a small, well-tolerated reward and a large reward with escalating risk of mild footshock. Rats were tested in RDT after acute systemic administration of EGCG, caffeine or joint EGCG and caffeine. EGCG caused a dose-dependent reduction in risk-taking without affecting reward discrimination or task engagement. Caffeine did not impact risk-taking, but elevated locomotor activity and reduced task engagement at high doses. Finally, exposure to both EGCG and caffeine had no effect on risk-taking, suggesting that low-dose caffeine is sufficient to mask the risk-aversion caused by EGCG. These data suggest EGCG as a potential therapeutic treatment for psychological disorders that induce compulsive risky decision-making.

High-Level Executive Functions: A Possible Role of Sex and Weight Condition in Planning and Decision-Making Performances

Evidence indicates an association between executive functioning and increased weight, with different patterns ascribed to individual differences (sex, age, lifestyles). This study reports on the relationship between high-level executive functions and body weight. Sixty-five young adults participated in the study: 29 participants (14 males, 15 females) in the normal weight range; 36 participants (18 males, 18 females) in the overweight range. The Iowa Gambling Task (IGT) and Tower of London Task were administered to assess decision making and planning. Planning did not differ in individuals in the normal-weight and overweight groups, and no difference emerged between females and males. However, normal and overweight males and females had different patterns in decision making. On the long-term consequences index of the IGT, females reported lower scores than males. Males in the overweight range had a lower long-term consequences index on the IGT than normal-weight males, while this pattern did not emerge in females. These findings suggest that decision-making responses may differ in the overweight relative to healthy weight condition, with a different expression in males and females. This pattern should be considered in weight loss prevention strategies, possibly adopting different approaches in males and females.

Functional dynamics of dopamine synthesis during monetary reward and punishment processing

The assessment of dopamine release with the PET competition model is thoroughly validated but entails disadvantages for the investigation of cognitive processes. We introduce a novel approach incorporating 6-[¹⁸F]FDOPA uptake as index of the dynamic regulation of dopamine synthesis enzymes by neuronal firing. The feasibility of this approach is demonstrated by assessing widely described sex differences in dopamine neurotransmission. Reward processing was behaviorally investigated in 36 healthy participants, of whom 16 completed fPET and fMRI during the monetary incentive delay task. A single 50 min fPET acquisition with 6-[¹⁸F]FDOPA served to quantify task-specific changes in dopamine synthesis. In men monetary gain induced stronger increases in ventral striatum dopamine synthesis than loss. Interestingly, the opposite effect was discovered in women. These changes were further associated with reward (men) and punishment sensitivity (women). As expected, fMRI showed robust task-specific neuronal activation but no sex difference. Our findings provide a neurobiological basis for known behavioral sex differences in reward and punishment processing, with important implications in psychiatric disorders showing sex-specific prevalence, altered reward processing and dopamine signaling. The high temporal resolution and magnitude of task-specific changes make fPET a promising tool to investigate functional neurotransmitter dynamics during cognitive processing and in brain disorders.

The association between risky decision making and cocaine conditioned place preference is moderated by sex

BACKGROUND

Excessive risk taking is a characteristic trait of several psychiatric conditions, including substance use disorders. High risk-taking (HiR) rats self-administer more cocaine compared to low risk-taking (LoR) rats. However, research has not determined if risk taking is associated with enhanced cocaine conditioned place preference (CPP).

METHODS

Male and female Sprague Dawley rats (n = 48 each sex) were first tested in the risky decision task (RDT), in which a response on one lever resulted in safe delivery of one food pellet, and a response on a different lever resulted in delivery of two pellets and probabilistic delivery of foot shock. Following RDT training, rats were tested for cocaine CPP. The first session was a pretest that measured rats' preference for three compartments that provided different visual and tactile cues. Rats then learned to associate one compartment with cocaine (either 10.0 mg/kg or 20.0 mg/kg; i.p.) and one compartment with saline (1.0 ml/kg; i.p.) across eight conditioning sessions. Finally, rats explored all three compartments in a drug-free state.

RESULTS

Sex significantly moderated the association between risky decision making and cocaine CPP. While increased risk aversion was somewhat positively associated with cocaine CPP in males, increased risk taking was positively correlated with cocaine CPP in females.

CONCLUSIONS

These results highlight the moderating role of sex on the relationship between risky decision making and cocaine reward.

Relationship between voluntary ethanol drinking and approach-avoidance biases in the face of motivational conflict: novel sex-dependent associations in rats

RATIONALE

Aberrant approach-avoidance conflict processing may contribute to compulsive seeking that characterizes addiction. Exploration of the relationship between drugs of abuse and approach-avoidance behavior remains limited, especially with ethanol.

OBJECTIVES

To investigate the effects of voluntary ethanol consumption on approach-avoidance conflict behavior and to examine the potential approach/avoidance bias to predict drinking in male and female rats.

METHODS

Long-Evans rats consumed ethanol for 5 weeks under the intermittent access two-bottle choice (IA2BC) paradigm. Approach-avoidance tendencies were assessed before and after IA2BC drinking using a previously established cued approach-avoidance conflict maze task and the elevated plus maze (EPM).

RESULTS

Female rats displayed higher consumption of and preference for ethanol than males. In the conflict task, males showed greater approach bias towards cues predicting conflict than females. In females only, a median split and regression analysis of cued-conflict preference scores revealed that the more conflict-avoidant group displayed higher intake and preference for ethanol in the first few weeks of drinking. In both sexes, ethanol drinking did not affect cued-conflict preference, but ethanol exposure led to increased time spent in the central hub in the males only. Finally, anxiety levels in EPM predicted subsequent onset of ethanol drinking in males only.

CONCLUSIONS

Our results highlight sex and individual differences in both drinking and approach-avoidance bias in the face of cued conflict and further suggest that cued-conflict preference should be examined as a potential predictor of ethanol drinking. Ethanol exposure may also affect the timing of decision-making in the face of conflict.