Sex differences in reward- and punishment-guided actions

Sex differences in reward-based operant conditioning performance and neurotransmitter changes following chronic sleep restriction stress in rats

BACKGROUND

Sleep deprivation significantly impairs cognitive function, which disrupts daily life. However, sex differences in these impairments are not well understood, as most preclinical studies primarily use male animals, neglecting potential differences between sexes. This study aims to investigate sex-specific differences in cognitive function under sleep deprivation using reward-based operant conditioning tasks.

RESULTS

Sprague-Dawley rats were pre-trained on a lever-press task and subsequently divided into control and chronic sleep restriction (CSR) groups. The CSR group underwent 14 days of sleep restriction. After CSR modeling, rats were assessed using the open field test, retraining on the lever-pressing task, signal discrimination task, and extinction task to evaluate motor abilities, memory formation, learning, and cognitive flexibility. CSR significantly impaired task performance in both sexes, with rats requiring more time and exhibiting lower accuracy. In the signal discrimination task, male rats showed longer feeding latency and lower accuracy compared to females. CSR also specifically increased the frequency of operant responses in male rats. In the extinction task, CSR enhanced exploration time and frequency in both sexes, with females exhibiting significantly higher exploration frequencies than males. Biochemically, CSR induced sex-specific alterations, including elevated serum MDA and MAO levels in males and increased serotonin, dopamine, and epinephrine in both sexes. Although activation was observed in metabolites of the tryptophan-kynurenine pathway, sex differences were evident in the kynurenic acid metabolism levels in the prefrontal cortex.

CONCLUSIONS

CSR impairs cognitive function in both male and female rats, with significant sex differences observed. Male CSR rats exhibited impaired signal discrimination, while CSR impaired extinction learning in female rats. These impairments are accompanied by CSR-induced oxidative stress, neurotransmitter dysregulation, and disturbances in the tryptophan metabolic pathway. These findings underscore the importance of considering sex differences in understanding the effects of sleep deprivation on cognitive function and developing targeted intervention strategies.

Punishment and dynamic choice: Assessment of the direct-suppression model

The effects of punishment rate on response allocation were investigated using a choice procedure where relative reinforcement rates changed rapidly within session. Predictions from a modified version of the direct-suppression model were tested in two separate experiments. In both experiments, sessions were composed of seven unsignaled components, each programming a different reinforcement ratio. In Experiment 1, equal punishment rates were superimposed on the schedule of reinforcement for both responses and absolute punishment rates increased across blocks of sessions. Punishment increased preference for the richer schedule of reinforcement, but the degree of the preference shift was not a function of absolute punishment rates. In Experiment 2, unequal punishment rates were superimposed on the schedules of reinforcement for both responses and relative punishment rates changed across blocks of sessions. Response allocation shifted away from the richer punishment schedule creating a bias toward the option associated with less frequent punishment. The results from both experiments challenged the predictions of the direct-suppression model. Furthermore, fits of the generalized matching law to the data indicated that superimposition of equal or unequal punishment schedules on responses maintained by unequal reinforcement schedules differentially affect the values of sensitivity and bias.

Sex differences in sensitivity to dopamine receptor manipulations of risk-based decision making in rats

Risky decision making involves the ability to weigh risks and rewards associated with different options to make adaptive choices. Previous work has established a necessary role for the basolateral amygdala (BLA) in mediating effective decision making under risk of punishment, but the mechanisms by which the BLA mediates this process are less clear. Because this form of decision making is profoundly sensitive to dopaminergic (DA) manipulations, we hypothesized that DA receptors in the BLA may be involved in risk-taking behavior. To test this hypothesis, male and female Long-Evans rats were trained in a decision-making task in which rats chose between a small, safe food reward and a larger food reward that was associated with a variable risk of footshock punishment. Once behavioral stability emerged, rats received intra-BLA infusions of ligands targeting distinct dopamine receptor subtypes prior to behavioral testing. Intra-BLA infusions of the dopamine D2 receptor (D2R) agonist quinpirole decreased risk taking in females at all doses, and this reduction in risk taking was accompanied by an increase in sensitivity to punishment. In males, decreased risk taking was only observed at the highest dose of quinpirole. In contrast, intra-BLA manipulations of dopamine D1 or D3 receptors (D1R and D3R, respectively) had no effect on risk taking. Considered together, these data suggest that differential D2R sensitivity in the BLA may contribute to the well-established sex differences in risk taking. Neither D1Rs nor D3Rs, however, appear to contribute to risky decision making in either sex.

Sex differences in motivational biases over instrumental actions

Motivational (i.e., appetitive or aversive) cues can bias value-based decisions by affecting either direction and intensity of instrumental actions. Despite several findings describing important interindividual differences in these biases, whether biological sex can also play a role is still up to debate. By comparing females and males in both appetitive and aversive Pavlovian-to-Instrumental Transfer paradigms we found that, while motivational cues similarly bias the direction of instrumental actions in both sexes, the intensity of such actions is increased by the cue in male participants only. The present results constitute compelling evidence that a crucial motivational bias of daily actions directed to obtaining rewards or avoiding punishments is modulated by biological sex. This evidence sheds new light on the role of sex in motivational processes that underlie decision-making, highlighting the importance of considering sex as a crucial factor in future research on this topic.

Understanding sex differences and the translational value of models of persistent substance use despite negative consequences

Persistent substance use despite negative consequences is a key facet of substance use disorder. The last decade has seen the preclinical field adopt the use of punishment to model adverse consequences associated with substance use. This has largely involved the pairing of drug use with either electric foot shock or quinine, a bitter tastant. Whilst at face value, these punishers may model aspects of the physical and psychological consequences of substance use, such models are yet to assist the development of approved medications for treatment. This review discusses progress made with animal models of punishment to understand the behavioral consequences of persistent substance use despite negative consequences. We highlight the importance of examining sex differences, especially when the behavioral response to punishment changes following drug exposure. Finally, we critique the translational value these models provide for the substance use disorder field.

Random interval schedule of reinforcement influences punishment resistance for cocaine in rats

In an animal model of compulsive drug use, a subset of rats continues to self-administer cocaine despite footshock consequences and is considered punishment resistant. We recently found that punishment resistance is associated with habits that persist under conditions that typically encourage a transition to goal-directed control. Given that random ratio (RR) and random interval (RI) schedules of reinforcement influence whether responding is goal-directed or habitual, we investigated the influence of these schedules on punishment resistance for cocaine or food. Male and female Sprague Dawley rats were trained to self-administer either intravenous cocaine or food pellets on a seeking-taking chained schedule of reinforcement, with the seeking lever requiring completion of either an RR20 or RI60 schedule. Rats were then given four days of punishment testing with footshock administered at the completion of seeking on a random one-third of trials. For cocaine-trained rats, the RI60 schedule led to greater punishment resistance (i.e., more trials completed) than the RR20 schedule in males and females. For food-trained rats, the RI60 schedule led to greater punishment resistance (i.e., higher reward rates) than the RR20 schedule in female rats, although male rats showed punishment resistance on both RR20 and RI60 schedules. For both cocaine and food, we found that seeking responses were suppressed to a greater degree than reward rate with the RI60 schedule, whereas response rate and reward rate were equally suppressed with the RR20 schedule. This dissociation between punishment effects on reward rate and response rate with the RI60 schedule can be explained by the nonlinear relation between these variables on RI schedules, but it does not account for the enhanced resistance to punishment. Overall, the results show greater punishment resistance with the RI60 schedule as compared to the RR20 schedule, indicating that schedules of reinforcement are an influencing factor on resistance to negative consequences.

Adolescent nicotine exposure promotes adulthood opioid consumption that persists despite adverse consequences and increases the density of insular perineuronal nets

Adolescence marks a sensitive period for neurodevelopment wherein exposure to drugs of abuse may disrupt maturation and induce persistent changes in neurophysiology which may exacerbate the risk for developing substance use disorders in adulthood. Adolescent nicotine exposure (ANE) enhances motivation to obtain drugs of abuse, particularly opioids, and increases vulnerability for the development of opioid use disorder (OUD). Here, we characterized ANE effects on learning about the adverse consequences of opioid consumption in adulthood in the absence of further nicotine administration. First, we show that ANE engenders punishment resistant fentanyl self-administration in a heterogenous seeking-taking chain schedule of reinforcement at least at the tested dose of fentanyl (0.75 μg/kg). We found that ANE rats consumed significantly more fentanyl and contingent foot shock punishment was less efficacious in limiting fentanyl seeking in ANE rats, relative to nicotine-naïve controls. Next, we demonstrated that ANE limits learning about the deleterious consequences of acute opioid intoxication in adulthood. In a combined conditioned taste avoidance and place preference paradigm we found that ANE resulted in significant reductions in the strength of morphine-induced CTA, and a simultaneous enhancement of CPP at a higher dose that was less capable of driving reinforcement in naïve controls. Finally, we examined the expression of perineuronal nets (PNNs) within insular cortex (IC) and found ANE rats to have increased density of PNNs across the anterior IC and significantly more parvalbumin-labeled IC cells relative to naïve controls. Together, these data lay the framework for a mechanistic explanation of the extreme comorbidity between nicotine use and development of OUDs.

Examining a punishment-related brain circuit with miniature fluorescence microscopes and deep learning

In humans experiencing substance use disorder (SUD), abstinence from drug use is often motivated by a desire to avoid some undesirable consequence of further use: health effects, legal ramifications, etc. This process can be experimentally modeled in rodents by training and subsequently punishing an operant response in a context-induced reinstatement procedure. Understanding the biobehavioral mechanisms underlying punishment learning is critical to understanding both abstinence and relapse in individuals with SUD. To date, most investigations into the neural mechanisms of context-induced reinstatement following punishment have utilized discrete loss-of-function manipulations that do not capture ongoing changes in neural circuitry related to punishment-induced behavior change. Here, we describe a two-pronged approach to analyzing the biobehavioral mechanisms of punishment learning using miniature fluorescence microscopes and deep learning algorithms. We review recent advancements in both techniques and consider a target neural circuit.

Methamphetamine increases risky choice in rats, but only when magnitude and probability of reinforcement are manipulated within a session

Risky choice is associated with maladaptive behaviors, particularly substance use disorders. Current animal models of risky choice are often confounded by other constructs like behavioral flexibility and suboptimal choice. The purpose of the current experiment was to determine if the psychostimulant methamphetamine, a drug whose popularity has increased in recent years, increases risky choice in an equivalent expected value (EEV) task. In the EEV task, rats are given a choice between two reinforcer alternatives that differ in magnitude and probability of delivery, but have equivalent expected value. Forty-eight Sprague Dawley rats were tested in three versions of the EEV task. In the first version of the EEV task, both reinforcer magnitude and probability were adjusted across blocks of trials for both alternatives. In the second and the third versions of the EEV task, reinforcer magnitude was held constant across each block of trials (either 1 vs. 2 pellets or 4 vs. 5 pellets). We found that male rats preferred the "riskier" option, except when reinforcer magnitudes were held constant at 4 and 5 pellets across each block of trials. Methamphetamine (0.5 mg/kg) increased preference for the risky option in both males and females, but only when both reinforcer magnitude and probability were manipulated across blocks of trials for each alternative. The current results demonstrate that both magnitude of reinforcement and probability of reinforcement interact to influence risky choice. Overall, this study provides additional support for using reinforcers with expected value to measure risky choice.

Sex differences in risk-based decision-making and the modulation of risk preference by dopamine-2 like receptors in rats

Heightened risk-based decision-making is observed across several neuropsychiatric disorders including schizophrenia, bipolar disorder, and Parkinson's disease, yet no treatments exist that effectively normalize this aberrant behavior. Preclinical risk-based decision-making paradigms have identified the important modulatory roles of dopamine and sex in the performance of such tasks, though specific task parameters may alter such effects (e.g., punishment and reward values). Previous work has highlighted the role of dopamine 2-like receptors (D2R) during performance of the Risk Preference Task (RPT) in male rats, however sex was not considered as a factor in this study, nor were treatments identified that reduced risk preference. Here, we utilized the RPT to determine sex-dependent differences in baseline performance and impact of the D2R receptor agonist pramipexole (PPX), and antagonist sulpiride (SUL) on behavioral performance. Female rats exhibited heightened risk-preference during baseline testing. Consistent with human studies, PPX increased risk-preference across sex, though the effects of PPX were more pronounced in female animals. Importantly, SUL reduced risk-preference in these rats across sexes. Thus, under the task specifications of the RPT that does not include punishment, female rats were more risk-preferring and required higher PPX doses to promote risky choices compared to males. Furthermore, blockade of D2R receptors may reduce risk-preference of rats, though further studies are required.

Hereditary and cortical morphological biomarker of sensitivity to reward in short-term withdrawal methamphetamine abusers

Higher sensitivity to reward (SR) and weaker sensitivity to punishment (SP) construct the fundamental craving characteristics of methamphetamine abuse. However, few studies have appraised relationships between SR/SP (SR or SP) and cortical morphological alterations in methamphetamine abusers and whether hereditary factors take effects on SR/SP is unclear. Based on surface-based morphometric analysis, cortical discrepancy was investigated between 38 methamphetamine abusers and 37 healthy controls. Within methamphetamine abusers, correlation profiling was performed to discover associations among aberrant neuroimaging substrates, SR, SP, and craving. According to nine single nucleotide polymorphism sites of dopamine-related genes, we conducted univariate general linear model to find different effects of genotypes on cortical alterations and SR/SP/craving (SR, SP, or craving). Ultimately, mediation analyses were conducted among single nucleotide polymorphism sites, SR/SP/craving, and cortical morphological alterations to discover their association pathways. Compared to healthy controls, thinner cortices in inferior temporal gyrus, lateral orbitofrontal cortex, medial orbitofrontal cortex, inferior parietal lobule, and lateral occipital cortex in the left hemisphere were found in methamphetamine abusers (P < 0.05, family-wise error corrected). Cortical thickness in the inferior temporal gyrus was negatively correlated with SR scores. We found that rs1800497 A-containing genotypes had lower cortical thickness in the left inferior parietal lobule than the GG genotype. The rs5751876 had effects on SR scores. This study would provide convincing biomarkers for SR in methamphetamine abusers and offer potential genetic targets for personalizing relapse prevention.

A special role for anterior cingulate cortex, but not orbitofrontal cortex or basolateral amygdala, in choices involving information

Subjects are often willing to pay a cost for information. In a procedure that promotes paradoxical choices, animals choose between a richer option followed by a cue that is rewarded 50% of the time (No Info) vs. a leaner option followed by one of two cues that signal certain outcomes: one always rewarded (100%) and the other never rewarded, 0% (Info). Since decisions involve comparing the subjective value of options after integrating all their features, preference for information may rely on cortico-amygdalar circuitry. To test this, male and female rats were prepared with bilateral inhibitory Designer Receptors Exclusively Activated by Designer Drugs (DREADDs) in the anterior cingulate cortex, orbitofrontal cortex, basolateral amygdala, or null virus (control). We inhibited these regions after stable preference was acquired. We found that inhibition of the anterior cingulate cortex destabilized choice preference in female rats without affecting latency to choose or response rate to cues. A logistic regression fit revealed that previous choice predicted current choice in all conditions, however previously rewarded Info trials strongly predicted preference in all conditions except in female rats following anterior cingulate cortex inhibition. The results reveal a causal, sex-dependent role for the anterior cingulate cortex in decisions involving information.

Delay of punishment highlights differential vulnerability to developing addiction-like behavior toward sweet food

Resistance to punishment is commonly used to measure the difficulty in refraining from rewarding activities when negative consequences ensue, which is a hallmark of addictive behavior. We recently developed a progressive shock strength (PSS) procedure in which individual rats can titrate the amount of punishment that they are willing to tolerate to obtain food rewards. Here, we investigated the effects of a range of delays (0-12 s) on resistance to punishment measured by PSS break points. As expected from delay discounting principles, we found that delayed shock was less effective as a punisher, as revealed by higher PSS breakpoints. However, this discounting effect was not equally distributed in the population of rats, and the introduction of a delay highlighted the existence of two populations: rats that were sensitive to immediate punishment were also sensitive to delayed shock, whereas rats that were resistant to immediate punishment showed strong temporal discounting of delayed punishment. Importantly, shock-sensitive rats suppressed responding even in subsequent non-punishment sessions, and they differed from shock-resistant rats in anxiety-like behavior, but not in sensitivity to pain. These results show that manipulation of temporal contingencies of punishment in the PSS procedure provides a valuable tool to identify individuals with a double vulnerability to addiction: low sensitivity to aversion and excessive discounting of negative future consequences. Conversely, the shock-sensitive population may provide a model of humans who are vulnerable to opportunity loss due to excessive anxiety.

Perineuronal nets are associated with decision making under conditions of uncertainty in female but not male mice

Biological sex influences decision-making processes in significant ways, differentiating the responses animals choose when faced with a range of stimuli. The neurobiological underpinnings that dictate sex differences in decision-making tasks remains an important open question, yet single-sex studies of males form most studies in behavioural neuroscience. Here we used female and male BALB/c mice on two spatial learning and memory tasks and examined the expression of perineuronal nets (PNNs) and parvalbumin interneurons (PV) in regions correlated with spatial memory. Mice underwent the aversive active place avoidance (APA) task or the appetitive trial-unique nonmatching-to-location (TUNL) touchscreen task. Mice in the APA cohort learnt to avoid the foot-shock and no differences were observed on key measures of the task nor in the number and intensity of PNNs and PV. On the delay but not separation manipulation in the TUNL task, females received more incorrect trials and less correct trials compared to males. Furthermore, females in this cohort exhibited higher intensity PNNs and PV cells in the agranular and granular retrosplenial cortex, compared to males. These data show that female and male mice perform similarly on spatial learning tasks. However, sex differences in neural circuitry may underly differences in making decisions under conditions of uncertainty on an appetitive task. These data emphasise the importance of using mice of both sexes in studies of decision-making neuroscience.

Lying about money and game points by men and women and its relation to the Self-Reported Lying Scale

Introduction

The present study was designed to examine the effect of monetary and non-monetary endowment on lying by men and women in the Ultimatum Game. Another goal was to examine to what extent the Self-Reported Lying Scale (SRLS), described here for the first time, predicts lying in the Ultimatum Game.

Methods

Examinees (162, 82 women) were allocated to four experimental conditions in a 2 × 2 factorial design. Two endowment conditions (money and game points) were crossed with two sex conditions (men and women). Participants underwent an Ultimatum Game in which they were permitted to conceal part of the endowment from an unidentified partner. Finally, participants completed the SRLS.

Results

The results indicated that more cash than points were concealed from the partner, and men concealed more of their endowment than women. We further defined fake fairness in sharing that combined hiding a more significant portion of the endowment from the partner while presenting fair sharing of the remaining award. We found more fake fairness when money was shared than when points were concealed. Fake fairness is more significant for men than for women. For money and points alike, concealment was predicted by the global score of the SRLS and its five subscales (self-assessed lying ability, lie detection ability, the use of reason in lying, lie acceptability, and lie frequency).

Discussion

It was suggested that a monetary endowment is more sensitive to lying than game points and involves more fake fairness. Nevertheless, the differences are quantitative, and the same response pattern exists in the two endowment conditions. Replacing money with points is a proper solution whenever a monetary endowment presents difficulties. It was further suggested that sex differences exist in lying using an asymmetric information UG, where proposers were permitted to mislead responders about their endowment. Finally, the SRLS may contribute to a better understanding of the question of who lies.

A special role for anterior cingulate cortex, but not orbitofrontal cortex or basolateral amygdala, in choices involving information

Subjects often are willing to pay a cost for information. In a procedure that promotes paradoxical choices, animals choose between a richer option followed by a cue that is rewarded 50% of the time (No-info) vs a leaner option followed by one of two cues that signal certain outcomes: one always rewarded (100%), and the other never rewarded, 0% (Info). Since decisions involve comparing the subjective value of options after integrating all their features, preference for information may rely on cortico-amygdalar circuitry. To test this, male and female rats were prepared with bilateral inhibitory DREADDs in the anterior cingulate cortex (ACC), orbitofrontal cortex (OFC), basolateral amygdala (BLA), or null virus (control). We inhibited these regions after stable preference was acquired. We found that inhibition of ACC destabilized choice preference in female rats without affecting latency to choose or response rate to cues. A logistic regression fit revealed that the previous choice strongly predicted preference in control animals, but not in female rats following ACC inhibition. The results reveal a causal, sex-dependent role for ACC in decisions involving information.

Effects of fentanyl self-administration on risk-taking behavior in male rats

RATIONALE

Individuals with opioid use disorder (OUD) exhibit impaired decision making and elevated risk-taking behavior. In contrast to the effects of natural and semi-synthetic opioids, however, the impact of synthetic opioids on decision making is still unknown.

OBJECTIVES

The objective of the current study was to determine how chronic exposure to the synthetic opioid fentanyl alters risk-based decision making in adult male rats.

METHODS

Male rats underwent 14 days of intravenous fentanyl or oral sucrose self-administration. After 3 weeks of abstinence, rats were tested in a decision-making task in which they chose between a small, safe food reward and a large food reward accompanied by variable risk of footshock punishment. Following testing in the decision-making task, rats were tested in control assays that assessed willingness to work for food and shock reactivity. Lastly, rats were tested on a probabilistic reversal learning task to evaluate enduring effects of fentanyl on behavioral flexibility.

RESULTS

Relative to rats in the sucrose group, rats in the fentanyl group displayed greater choice of the large, risky reward (risk taking), an effect that was present as long as 7 weeks into abstinence. This increased risk taking was driven by enhanced sensitivity to the large rewards and diminished sensitivity to punishment. The fentanyl-induced elevation in risk taking was not accompanied by alterations in food motivation or shock reactivity or impairments in behavioral flexibility.

CONCLUSIONS

Results from the current study reveal that the synthetic opioid fentanyl leads to long-lasting increases in risk taking in male rats. Future experiments will extend this work to females and identify neural mechanisms that underlie these drug-induced changes in risk taking.

DREADD activation of the lateral orbitofrontal increases cocaine-taking and cocaine-seeking in male and female rats during intermittent access self-administration under risky conditions

Addiction is a disorder that can be characterized in part as the constant pursuit of a particular substance despite negative consequences. Although the orbitofrontal cortex (OFC) is known to regulate risk-taking more generally and be critical to the development of addiction, its role in regulating drug use under risk-taking conditions is unknown. To address this, we examined drug-taking and drug-seeking in male and female rats under conditions where cocaine infusions were paired with foot shock punishment 50% of the time and combined this paradigm with cFos immunohistochemistry. We found that rats that showed higher levels of drug-taking and drug-seeking prior to punishment showed decreased responding during self-administration sessions under risky conditions and lower levels of c-Fos expression in the lateral but not medial OFC. However, despite these initial differences in responses to infusions paired with foot shocks, all rats showed decreased responding with additional punishment sessions. We then used chemogenetic viral approaches to examine how altering activity of the lateral OFC affects drug-taking and drug-seeking during punished drug use. Although there was no effect of Gi/o DREADD-mediated inhibition of the lateral OFC on these behaviors, Gq DREADD-mediated activation increased drug-taking and drug-seeking when drug use was associated with foot shock 50% of the time. Interestingly, this manipulation had no effect on non-risky self-administration behavior. These results suggest that the involvement of lateral OFC in cocaine use is context-sensitive and influences decision-making based on negative outcomes.

Sex, but not juvenile stress, affects reversal learning and DRL performance following cocaine administration

INTRODUCTION

Early adversity, impulsivity and sex all contribute to the risk of developing substance use disorder. Using rats, we examined how juvenile stress interacts with sex and cocaine to affect performance on a serial reversal task and a differential reinforcement of low rates 10 s (DRL10) task. The expression of dopamine-related proteins in several brain areas was also assessed.

METHODS

From postnatal days (PND) 25-29, rats were exposed to a variable stress protocol. In adulthood, rats were trained on the reversal task and the effects of cocaine (0, 10, or 20 mg/kg, IP) on performance were assessed. Next, rats were trained on the DRL10 task and the effects of cocaine on performance were assessed. Finally, brains were extracted, and Western blot analyses conducted.

RESULTS

Juvenile stress did not affect behavior. Sex did not affect baseline performance in either task. In the reversal task, cocaine decreased % high probability responses and the number of rewards earned in both sexes. Cocaine had sex-dependent effects on omissions, low probability responses and response latencies. In the DRL10 task, cocaine decreased the peak latency to respond and the number of rewards earned in both sexes. Cocaine had sex-dependent effects on peak rate of responding, response efficiency, burst responses and long responses. Female rats exhibited increased expression of DRD1 receptors in the striatum.

DISCUSSION

These data contribute to the growing literature demonstrating sex differences in the behavioral effects of cocaine and suggest that DRD1 receptors could contribute to the observed behavioral sex differences.

Non-invasive assessment of positive affective state using infra-red thermography in rats

With recent increased focus on positive welfare in animal welfare science, there is demand for objective positive welfare indicators. It is unclear whether changes in body surface temperature can be used to non-invasively identify and quantify positive states in mammals. We recorded continuous measurements of tail surface temperature using infra-red thermography (IRT) and concurrent behavioural observations in male and female Wistar rats (Rattus norvegicus). If tail surface temperature can differentiate between positive and negative experiences, we expect a qualitatively different response compared to negative experiences. Three groups of rats were presented with increasing magnitudes of food rewards (neutral/none, one and three rewards). The rats were placed in an arena to which they were habituated and filmed for 30 s before and 30 min after exposure to different rewards. Tail temperature initially decreased from the pre-reward baseline and subsequently returned towards baseline temperature. The overall pattern of the change was the same as for rats subjected to negative stimuli in previous studies. Nevertheless, dynamic changes in tail temperature, specifically the rate of recovery and the behavioural response (exploration), differed between neutral and rewarded rats but failed to distinguish reward magnitude. Sex differences were found in both thermal and behavioural responses, unrelated to reward magnitudes. Female rats exhibited a greater initial response with a slower recovery than male rats, emphasising the value of using of both sexes in animal welfare research. This study improves our understanding of the effects of positive emotions induced by food reward on peripheral body temperature and behaviour.

Gender-Specific Interactions in a Visual Object Recognition Task in Persons with Opioid Use Disorder

Opioid use disorder (OUD)-associated overdose deaths have reached epidemic proportions worldwide over the past two decades, with death rates for men reported at twice the rate for women. Using a controlled, cross-sectional, age-matched (18-56 y) design to better understand the cognitive neuroscience of OUD, we evaluated the electroencephalographic (EEG) responses of male and female participants with OUD vs. age- and gender-matched non-OUD controls during a simple visual object recognition Go/No-Go task. Overall, women had significantly slower reaction times (RTs) than men. In addition, EEG N200 and P300 event-related potential (ERP) amplitudes for non-OUD controls were significantly larger for men, while their latencies were significantly shorter than for women. However, while N200 and P300 amplitudes were not significantly affected by OUD for either men or women in this task, latencies were also affected differentially in men vs. women with OUD. Accordingly, for both N200 and P300, male OUD participants exhibited longer latencies while female OUD participants exhibited shorter ones than in non-OUD controls. Additionally, robust oscillations were found in all participants during a feedback message associated with performance in the task. Although alpha and beta power during the feedback message were significantly greater for men than women overall, both alpha and beta oscillations exhibited significantly lower power in all participants with OUD. Taken together, these findings suggest important gender by OUD differences in cognitive processing and reflection of performance in this simple visual task.

A comprehensive assay of social motivation reveals sex-specific roles of autism-associated genes and oxytocin

Social motivation is critical to the development of typical social functioning. Social motivation, specifically one or more of its components (e.g., social reward seeking or social orienting), could be relevant for understanding phenotypes related to autism. We developed a social operant conditioning task to quantify effort to access a social partner and concurrent social orienting in mice. We established that mice will work for access to a social partner, identified sex differences, and observed high test-retest reliability. We then benchmarked the method with two test-case manipulations. Shank3B mutants exhibited reduced social orienting and failed to show social reward seeking. Oxytocin receptor antagonism decreased social motivation, consistent with its role in social reward circuitry. Overall, we believe that this method provides a valuable addition to the assessment of social phenotypes in rodent models of autism and the mapping of potentially sex-specific social motivation neural circuits.

Cognitive mechanisms underlying decision making involving risk of explicit punishment in male and female rats

Individuals engage in the process of risk-based decision making on a daily basis to navigate various aspects of life. There are, however, individual differences in this form of decision making, with some individuals exhibiting preference for riskier choices (risk taking) and others exhibiting preference for safer choices (risk aversion). Recent work has shown that extremes in risk taking (e.g., excessive risk taking or risk aversion) are not only cognitive features of neuropsychiatric diseases, but may in fact predispose individuals to the development of such diseases. To better understand individual differences in risk taking, and thus the mechanisms by which they confer disease vulnerability, the current study investigated the cognitive contributions to risk taking in both males and females. Rats were first behaviorally characterized in a decision-making task involving risk of footshock punishment and then tested on a battery of cognitive behavioral assays. Individual variability in risk taking was compared with performance on these tasks. Consistent with prior work, females were more risk averse than males. With the exception of the Set-shifting Task, there were no sex differences in performance on other cognitive assays. There were, however, sex-dependent associations between risk taking and specific cognitive measures. Greater risk taking was associated with better cognitive flexibility in males whereas greater risk aversion was associated with better working memory in females. Collectively, these findings reveal that distinct cognitive mechanisms are associated with risk taking in males and females, which may account for sex differences in this form of decision making.

Sex Differences in Behavior and Learning Abilities in Adult Rats

Laboratory rats have excellent learning abilities and are often used in cognitive neuroscience research. The majority of rat studies are conducted on males, whereas females are usually overlooked. Here, we examined sex differences in behavior and tactile sensitivity in littermates during adulthood (5.8-7.6 months of age). We used a battery of behavioral tests, including the 2% sucrose preference test (positive motivation), a free-choice paradigm (T-maze, neutral situation), and associative fear-avoidance learning (negative motivation, aversive situation). Tactile perception was examined using the von Frey test (aversive situation). In two aversive situations (von Frey test and avoidance learning), females were examined during the diestrus stage of the estrous cycle, and ultrasonic vocalization was recorded in both sexes. It was found that (1) females, but not males, lost their body weight on the first day of the sucrose preference test, suggesting sex differences in their reaction to environmental novelty or in metabolic homeostasis; (2) the tactile threshold in females was lower than in males, and females less frequently emitted aversive ultrasonic calls; (3) in the avoidance learning task, around 26% of males (but no females) were not able to learn and experienced frizzing. Overall, the performance of associative fear-avoidance in males was worse than in females. In general, females demonstrated higher abilities of associative learning and less persistently emitted aversive ultrasonic calls.

Age-Related Changes in Risky Decision Making and Associated Neural Circuitry in a Rat Model

Altered decision making at advanced ages can have a significant impact on an individual's quality of life and the ability to maintain personal independence. Relative to young adults, older adults make less impulsive and less risky choices; although these changes in decision making could be considered beneficial, they can also lead to choices with potentially negative consequences (e.g., avoidance of medical procedures). Rodent models of decision making have been invaluable for dissecting cognitive and neurobiological mechanisms that contribute to age-related changes in decision making, but they have predominantly used costs related to timing or probability of reward delivery and have not considered other equally important costs, such as the risk of adverse consequences. The current study therefore used a rat model of decision making involving risk of explicit punishment to examine age-related changes in this form of choice behavior in male rats, and to identify potential cognitive and neurobiological mechanisms that contribute to these changes. Relative to young rats, aged rats displayed greater risk aversion, which was not attributable to reduced motivation for food, changes in shock sensitivity, or impaired cognitive flexibility. Functional MRI analyses revealed that, overall, functional connectivity was greater in aged rats compared with young rats, particularly among brain regions implicated in risky decision making such as basolateral amygdala, orbitofrontal cortex, and ventral tegmental area. Collectively, these findings are consistent with greater risk aversion found in older humans, and reveal age-related changes in brain connectivity.

Sex-dependent effects of chronic stress on punished cocaine self-administration and cue-induced relapse to cocaine seeking

We tested the effects of chronic stress on cocaine relapse after drug-reinforced responding was suppressed by punishment, an animal model of human relapse after self-imposed abstinence due to the negative consequences of drug use. Male rats displayed greater resistance to punishment than females, but daily stress decreased this resistance. Only female rats with a history of chronic stress displayed increased responding for cocaine cues from abstinence Day 1 to Day 8. Thus, the effects of chronic stress on punished cocaine self-administration and cue-induced relapse are dependent on biological sex, and may have implications for more targeted treatments for cocaine addiction.

A self-adjusting, progressive shock strength procedure to investigate resistance to punishment: Characterization in male and female rats

Indifference to harmful consequences is one of the main characteristics of compulsive behaviors and addiction. Animal models that provide a rapid and effective measure of resistance to punishment could be critical for the investigation of mechanisms underlying these maladaptive behaviors. Here, analogous to the progressive ratio (PR) procedure widely used to evaluate appetitive motivation as the response requirement is increased, we developed a self-adjusting, progressive shock strength (PSS) procedure. The PSS provides, within a single session, a break point that quantifies the propensity to work for a reward in spite of receiving electric footshock that progressively increases in duration. In both male and female rats, the PSS break point was sensitive to 1) hunger; and 2) changes in the qualitative, but not quantitative, incentive value of the reward. In systematic comparisons between PSS and PR procedures in the same rats, we found that both measures are sensitive to manipulations of motivational states, but they are not intercorrelated, suggesting that they measure overlapping but partially distinct processes. Importantly, the PSS procedure represents a refinement in the 3Rs principles of animal research because animals can control the strength of shock that they are willing to tolerate. This self-adjusting PSS procedure may represent a useful tool to investigate mechanisms underlying maladaptive behavior that persists in certain individuals despite harmful consequences.

Learning of probabilistic punishment as a model of anxiety produces changes in action but not punisher encoding in the dmPFC and VTA

Previously, we developed a novel model for anxiety during motivated behavior by training rats to perform a task where actions executed to obtain a reward were probabilistically punished and observed that after learning, neuronal activity in the ventral tegmental area (VTA) and dorsomedial prefrontal cortex (dmPFC) represent the relationship between action and punishment risk (Park and Moghaddam, 2017). Here, we used male and female rats to expand on the previous work by focusing on neural changes in the dmPFC and VTA that were associated with the learning of probabilistic punishment, and anxiolytic treatment with diazepam after learning. We find that adaptive neural responses of dmPFC and VTA during the learning of anxiogenic contingencies are independent from the punisher experience and occur primarily during the peri-action and reward period. Our results also identify peri-action ramping of VTA neural calcium activity, and VTA-dmPFC correlated activity, as potential markers for the anxiolytic properties of diazepam.

Sex Differences In Avoidance Extinction After Contextual Fear Conditioning: Anxioescapic Behavior In Female Rats

Fear memories are important for survival and are implicated in the etiology of fear disorders such as Post Traumatic Stress Disorder (PTSD). Fear memories are well studied pre-clinically and sex differences in rodent fear expression have been reported: females tend to freeze less than males. Whether this is a difference in fear learning or expression is debated. We aimed to differentiate between these possibilities with a task that allowed female rats to express fear memory by moving, rather than freezing. We assessed fear extinction after contextual fear conditioning in the isolated Shock Arm of a Y-maze in female and male rats by either placing them back in the isolated Shock Arm (Fear Extinction in the Shock Context) or allowing them to move freely in the Y-maze during extinction training and enter/avoid the Shock Arm (Avoidance Extinction). We confirmed that female rats freeze less than males during fear extinction in both settings. During Avoidance Extinction, however, both sexes had similar avoidance of the Shock Context, showing comparable fear memory and extinction. Additionally, female rats made more entries into the non-shock arms. Thus, female and male rats have similar fear learning but females express it with an active motor response. Furthermore, female rats also exhibited an active motor response under other anxiogenic conditions (Elevated Plus Maze) and had higher reactivity (Acoustic Startle Response) but not when fear-eliciting stimuli were present: cat hair and foot-shock. In summary, female rats have an active motor response to anxiogenic stimuli which we termed 'Anxioescapic' behavior strategy.

Regulation of sex differences in risk-based decision making by gonadal hormones: Insights from rodent models

Men and women differ in their ability to evaluate options that vary in their rewards and the risks that are associated with these outcomes. Most studies have shown that women are more risk averse than men and that gonadal hormones significantly contribute to this sex difference. Gonadal hormones can influence risk-based decision making (i.e., risk taking) by modulating the neurobiological substrates underlying this cognitive process. Indeed, estradiol, progesterone and testosterone modulate activity in the prefrontal cortex, amygdala and nucleus accumbens associated with reward and risk-related information. The use of animal models of decision making has advanced our understanding of the intersection between the behavioral, neural and hormonal mechanisms underlying sex differences in risk taking. This review will outline the current state of this literature, identify the current gaps in knowledge and suggest the neurobiological mechanisms by which hormones regulate risky decision making. Collectively, this knowledge can be used to understand the potential consequences of significant hormonal changes, whether endogenously or exogenously induced, on risk-based decision making as well as the neuroendocrinological basis of neuropsychiatric diseases that are characterized by impaired risk taking, such as substance use disorder and schizophrenia.

Altered Reward Processing and Sex Differences in Chronic Pain

Chronic pain and reward processing are understood to be reciprocally related to one another. Previous studies of reward processing in chronic pain patients have reported incongruent findings. While several factors likely contribute to these disparate findings, these previous studies did not stratify their analyses by sex-a factor previously shown to robustly impact reward-related responses. Thus, we examined sex as a factor of interest in level of striatal activation during anticipation of monetary incentives among patients with chronic non-specific back pain and healthy controls (HC). This study utilized functional magnetic resonance imaging during a monetary incentive delay task to evaluate reward and loss responsivity in the striatum among males and females with and without chronic pain (N = 90). Group, sex, and group-by-sex interactions were analyzed via repeated measures analysis of variance. Among HC, males exhibited significantly greater blood oxygen level dependent (BOLD) signal in the striatum during reward anticipation, particularly during large reward trials. By contrast, no significant sex differences were observed among patients. A significant group-by-sex interaction was also observed, revealing diminished BOLD responses among males with chronic pain relative to control males. These results provide novel evidence of sex-specific reductions in anticipatory responses to reward in patients with chronic pain. Altered striatal reward responsivity among males, but not females, suggests that the reward systems of males and females are uniquely disrupted by chronic pain, and highlights the value of including sex as a factor of interest in future studies of reward responsivity in the context of persistent pain.

Instrumental aversion coding in the basolateral amygdala and its reversion by a benzodiazepine

Punishment involves learning the relationship between actions and their adverse consequences. Both the acquisition and expression of punishment learning depend on the basolateral amygdala (BLA), but how BLA supports punishment remains poorly understood. To address this, we measured calcium (Ca²⁺) transients in BLA principal neurons during punishment. Male rats were trained to press two individually presented levers for food; when one of these levers also yielded aversive footshock, responding on this punished lever decreased relative to the other, unpunished lever. In rats with the Ca²⁺ indicator GCaMP6f targeted to BLA principal neurons, we observed excitatory activity transients to the footshock punisher and inhibitory transients to lever-presses earning a reward. Critically, as rats learned punishment, activity around the punished response transformed from inhibitory to excitatory and similarity analyses showed that these punished lever-press transients resembled BLA transients to the punisher itself. Systemically administered benzodiazepine (midazolam) selectively alleviated punishment. Moreover, the degree to which midazolam alleviated punishment was associated with how much punished response-related BLA transients reverted to their pre-punishment state. Together, these findings show that punishment learning is supported by aversion-coding of instrumental responses in the BLA and that the anti-punishment effects of benzodiazepines are associated with a reversion of this aversion coding.

Juvenile stress increases cocaine-induced impulsivity in female rats

In humans, adverse childhood experiences are associated with an increased risk of developing a neuropsychiatric disorder. Changes in social behavior and cognitive function are hallmarks of numerous neuropsychiatric disorders. Here we examined the effects of exposure to variable stress during the juvenile period on social behavior, reward, and cognitive function (as measured in the 5-choice serial reaction time task (5CSRTT)) in rats. From postnatal days (PND) 25-29 male and female rats were exposed to a variable stress protocol. In adulthood, social interactions and sucrose preference were assessed prior to training on the 5CSRTT. Once successfully trained, rats were challenged with different task versions, and then the effects of cocaine (0, 10, or 20 mg/kg, IP) on performance were assessed. A follow-up experiment examined the ability of the D2 receptor antagonist eticlopride (0.0, 0.025, 0.05 mg/kg, IP) to block the effects of cocaine on 5CSRTT performance in female rats. Male rats exposed to juvenile stress tended to engage in less social behavior and had an increased correct response latency in the 5CSRTT following cocaine administration. Female rats exposed to juvenile stress exhibited a trend towards increased social behavior and demonstrated increased cocaine-induced impulsivity. The increase in impulsivity was not blocked by co-administration of eticlopride. Juvenile stress had minimal effects on adult behavior in male rats, but increased cocaine-induced impulsivity in female rats. Such an effect could contribute to the enhanced escalation of drug-use observed in females that experience juvenile stress. This possibility awaits further testing.

Advances in understanding meso-cortico-limbic-striatal systems mediating risky reward seeking

The risk of an aversive consequence occurring as the result of a reward-seeking action can have a profound effect on subsequent behavior. Such aversive events can be described as punishers, as they decrease the probability that the same action will be produced again in the future and increase the exploration of less risky alternatives. Punishment can involve the omission of an expected rewarding event ("negative" punishment) or the addition of an unpleasant event ("positive" punishment). Although many individuals adaptively navigate situations associated with the risk of negative or positive punishment, those suffering from substance use disorders or behavioral addictions tend to be less able to curtail addictive behaviors despite the aversive consequences associated with them. Here, we discuss the psychological processes underpinning reward seeking despite the risk of negative and positive punishment and consider how behavioral assays in animals have been employed to provide insights into the neural mechanisms underlying addictive disorders. We then review the critical contributions of dopamine signaling to punishment learning and risky reward seeking, and address the roles of interconnected ventral striatal, cortical, and amygdala regions to these processes. We conclude by discussing the ample opportunities for future study to clarify critical gaps in the literature, particularly as related to delineating neural contributions to distinct phases of the risky decision-making process.

Brain gray matter structures associated with trait impulsivity: A systematic review and voxel-based meta-analysis

Trait impulsivity is a multifaceted personality characteristic that contributes to maladaptive life outcomes. Although a growing body of neuroimaging studies have investigated the structural correlates of trait impulsivity, the findings remain highly inconsistent and heterogeneous. Herein, we performed a systematic review to depict an integrated delineation of gray matter (GM) substrates of trait impulsivity and a meta-analysis to examine concurrence across previous whole-brain voxel-based morphometry studies. The systematic review summarized the diverse findings in GM morphometry in the past literature, and the quantitative meta-analysis revealed impulsivity-related volumetric GM alterations in prefrontal, temporal, and parietal cortices. In addition, we identified the modulatory effects of age and gender in impulsivity-GM volume associations. The present study advances understanding of brain GM morphometry features underlying trait impulsivity. The findings may have practical implications in the clinical diagnosis of and intervention for impulsivity-related disorders.

BEHAVIORAL AND NEUROBIOLOGICAL MECHANISMS OF PAVLOVIAN AND INSTRUMENTAL EXTINCTION LEARNING

This article reviews the behavioral neuroscience of extinction, the phenomenon in which a behavior that has been acquired through Pavlovian or instrumental (operant) learning decreases in strength when the outcome that reinforced it is removed. Behavioral research indicates that neither Pavlovian nor operant extinction depends substantially on erasure of the original learning but instead depends on new inhibitory learning that is primarily expressed in the context in which it is learned, as exemplified by the renewal effect. Although the nature of the inhibition may differ in Pavlovian and operant extinction, in either case the decline in responding may depend on both generalization decrement and the correction of prediction error. At the neural level, Pavlovian extinction requires a tripartite neural circuit involving the amygdala, prefrontal cortex, and hippocampus. Synaptic plasticity in the amygdala is essential for extinction learning, and prefrontal cortical inhibition of amygdala neurons encoding fear memories is involved in extinction retrieval. Hippocampal-prefrontal circuits mediate fear relapse phenomena, including renewal. Instrumental extinction involves distinct ensembles in corticostriatal, striatopallidal, and striatohypothalamic circuits as well as their thalamic returns for inhibitory (extinction) and excitatory (renewal and other relapse phenomena) control over operant responding. The field has made significant progress in recent decades, although a fully integrated biobehavioral understanding still awaits.

Sex differences in neural responses to reward and the influences of individual reward and punishment sensitivity

BACKGROUND

Men and women show differences in sensitivity to reward and punishment, which may impact behavior in health and disease. However, the neural bases of these sex differences remain under-investigated. Here, by combining functional magnetic resonance imaging (fMRI) and a variant of the Monetary Incentive Delay Task (MIDT), we examined sex differences in the neural responses to wins and losses and how individual reward and punishment sensitivity modulates these regional activities.

METHODS

Thirty-sex men and 27 women participated in the fMRI study. We assessed sensitivity to punishment (SP) and sensitivity to reward (SR) with the Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ). In the MIDT, participants pressed a button to collect reward ($1, 1¢, or nil), with the reaction time window titrated across trials so participants achieved a success rate of approximately 67%. We processed the Imaging data with published routines and evaluated the results with a corrected threshold.

RESULTS

Women showed higher SP score than men and men showed higher SR score than women. Men relative to women showed higher response to the receipt of dollar or cent reward in bilateral orbitofrontal and visual cortex. Men as compared to women also showed higher response to dollar loss in bilateral orbitofrontal cortex. Further, in whole-brain regressions, women relative to men demonstrated more significant modulation by SP in the neural responses to wins and larger wins, and the sex differences were confirmed by slope tests.

CONCLUSIONS

Together, men showed higher SR and neural sensitivity to both wins, large or small, and losses than women. Individual differences in SP were associated with diminished neural responses to wins and larger wins in women only. These findings highlight how men and women may differ in reward-related brain activations in the MIDT and add to the imaging literature of sex differences in cognitive and affective functions.

Regulation of risky decision making by gonadal hormones in males and females

Psychiatric diseases characterized by dysregulated risky decision making are differentially represented in males and females. The factors that govern such sex differences, however, remain poorly understood. Using a task in which rats make discrete trial choices between a small, "safe" food reward and a large food reward accompanied by varying probabilities of footshock punishment, we recently showed that females are more risk averse than males. The objective of the current experiments was to test the extent to which these sex differences in risky decision making are mediated by gonadal hormones. Male and female rats were trained in the risky decision-making task, followed by ovariectomy (OVX), orchiectomy (ORX), or sham surgery. Rats were then retested in the task, under both baseline conditions and following administration of estradiol and/or testosterone. OVX increased choice of the large, risky reward (increased risky choice), an effect that was attenuated by estradiol administration. In contrast, ORX decreased risky choice, but testosterone administration was without effect in either ORX or sham males. Estradiol, however, decreased risky choice in both groups of males. Importantly, none of the effects of hormonal manipulation on risky choice were due to altered shock sensitivity or food motivation. These data show that gonadal hormones are required for maintaining sex-typical profiles of risk-taking behavior in both males and females, and that estradiol is sufficient to promote risk aversion in both sexes. The findings provide novel information about the mechanisms supporting sex differences in risk taking and may prove useful in understanding sex differences in the prevalence of psychiatric diseases associated with altered risk taking.

Divergent Strategies for Learning in Males and Females

A frequent assumption in value-based decision-making tasks is that agents make decisions based on the feature dimension that reward probabilities vary on. However, in complex, multidimensional environments, stimuli can vary on multiple dimensions at once, meaning that the feature deserving the most credit for outcomes is not always obvious. As a result, individuals may vary in the strategies used to sample stimuli across dimensions, and these strategies may have an unrecognized influence on decision-making. Sex is a proxy for multiple genetic and endocrine influences on behavior, including how environments are sampled. In this study, we examined the strategies adopted by female and male mice as they learned the value of stimuli that varied in both image and location in a visually cued two-armed bandit, allowing two possible dimensions to learn about. Female mice acquired the correct image-value associations more quickly than male mice, preferring a fundamentally different strategy. Female mice were more likely to constrain their decision-space early in learning by preferentially sampling one location over which images varied. Conversely, male mice were more likely to be inconsistent, changing their choice frequently and responding to the immediate experience of stochastic rewards. Individual strategies were related to sex-biased changes in neuronal activation in early learning. Together, we find that in mice, sex is associated with divergent strategies for sampling and learning about the world, revealing substantial unrecognized variability in the approaches implemented during value-based decision making.

Effects of adolescent experience of food restriction and exercise on spatial learning and open field exploration of female rats

The hippocampus carries out multiple functions: spatial cognition dorsally (DH) and regulation of emotionality-driven behavior ventrally (VH). Previously, we showed that dendrites of DH and VH pyramidal neurons of female rats are still developing robustly during adolescence and are altered by the experience of food restriction and voluntary exercise on a wheel. We tested whether such anatomical changes during adolescence impact anxiety-like behavior and spatial cognition. Four groups of female rats were evaluated for these behaviors: those with wheel access in its cage from postnatal day (P) 36-44 (EX); those with food access restricted to 1 hr per day, from P40 to 44 (FR); those with EX from P36 to 44, combined with FR from P40 to 44, which we will refer to as EX + FR; and controls, CON (no EX, no FR). Open field test for anxiety-like behavior and active place avoidance test for spatial cognition were conducted at P47-49, the age when food restricted animals have restored body weight, or at P54-56, to identify more enduring effects. Anxiety-like behavior was elevated for the EX and FR groups at P47-49 but not for the EX + FR group. By P54-56, the EX + FR and EX groups exhibited less anxiety-like behavior, indicating a beneficial delayed main effect of exercise. There was a beneficial main effect of food restriction upon cognition, as the FR group showed cognition superior to CONs' at P44-46 and P54-56, while the EX + FR animals also showed enhanced spatial learning at P54-56. EX + FR animals with best adaptation to the feeding schedule showed the best spatial learning performance but with a delay. The EX group exhibited only a transient improvement. These findings indicate that FR, EX, and EX + FR in mid-adolescence are all beneficial in reducing anxiety-like behavior and improving spatial cognition but with subtle differences in the timing of their manifestation, possibly reflecting the protracted maturation of the hippocampus.

Sex and strain differences in dynamic and static properties of the mesolimbic dopamine system

Sex is a biological variable that contributes to the incidence, clinical course, and treatment outcome of brain disorders. Chief among these are disorders associated with the dopamine system. These include Parkinson's disease, ADHD, schizophrenia, and mood disorders, which show stark differences in prevalence and outcome between men and women. In order to reveal the influence of biological sex as a risk factor in these disorders, there is a critical need to collect fundamental information about basic properties of the dopamine system in males and females. In Long Evans rats, we measured dynamic and static properties related to the mesolimbic dopamine system. Static measures included assessing ventral tegmental area (VTA) dopamine cell number and volume and expression of tyrosine hydroxylase and dopamine transporter. Dynamic measures in behaving animals included assessing (1) VTA neuronal encoding during learning of a cue-action-reward instrumental task and (2) dopamine release in the nucleus accumbens in response to electrical stimulation of the VTA, vesicular depletion of dopamine, and amphetamine. We found little or no sex difference in these measures, suggesting sexual congruency in fundamental static and dynamic properties of dopamine neurons. Thus, dopamine related sex-differences are likely mediated by secondary mechanisms that flexibly influence the function of the dopamine cells and circuits. Finally, we noted that most behavioral sex differences had been reported in Sprague-Dawley rats and repeated some of the above measures in that strain. We found some sex differences in those animals highlighting the importance of considering strain differences in experimental design and result interpretation.

Testicular hormones mediate robust sex differences in impulsive choice in rats

Impairments in choosing optimally between immediate and delayed rewards are associated with numerous psychiatric disorders. Such ‘intertemporal’ choice is influenced by genetic and experiential factors; however, the contributions of biological sex are understudied and data to date are largely inconclusive. Rats were used to determine how sex and gonadal hormones influence choices between small, immediate and large, delayed rewards. Females showed markedly greater preference than males for small, immediate over large, delayed rewards (greater impulsive choice). This difference was neither due to differences in food motivation or reward magnitude perception, nor was it affected by estrous cycle. Ovariectomies did not affect choice in females, whereas orchiectomies increased impulsive choice in males. These data show that male rats exhibit less impulsive choice than females and that this difference is at least partly maintained by testicular hormones. These differences in impulsive choice could be linked to gender differences across multiple neuropsychiatric conditions.

Biological Sex and Sex Hormone Impacts on Deficits in Episodic-Like Memory in a Rat Model of Early, Pre-motor Stages of Parkinson's Disease

Episodic memory deficits are among the earliest appearing and most commonly occurring examples of cognitive impairment in Parkinson's disease (PD). These enduring features can also predict a clinical course of rapid motor decline, significant cognitive deterioration, and the development of PD-related dementia. The lack of effective means to treat these deficits underscores the need to better understand their neurobiological bases. The prominent sex differences that characterize episodic memory in health, aging and in schizophrenia and Alzheimer's disease suggest that neuroendocrine factors may also influence episodic memory dysfunction in PD. However, while sex differences have been well-documented for many facets of PD, sex differences in, and sex hormone influences on associated episodic memory impairments have been less extensively studied and have never been examined in preclinical PD models. Accordingly, we paired bilateral neostriatal 6-hydroxydopamine (6-OHDA) lesions with behavioral testing using the What-Where-When Episodic-Like Memory (ELM) Task in adult rats to first determine whether episodic-like memory is impaired in this model. We further compared outcomes in gonadally intact female and male subjects, and in male rats that had undergone gonadectomy—with and without hormone replacement, to determine whether biological sex and/or sex hormones influenced the expression of dopamine lesioned-induced memory deficits. These studies showed that 6-OHDA lesions profoundly impaired recall for all memory domains in male and female rats. They also showed that in males, circulating gonadal hormones powerfully modulated the negative impacts of 6-OHDA lesions on What, Where, and When discriminations in domain-specific ways. Specifically, the absence of androgens was shown to fully attenuate 6-OHDA lesion-induced deficits in ELM for “Where” and to partially protect against lesion-induced deficits in ELM for “What.” In sum, these findings show that 6-OHDA lesions in rats recapitulate the vulnerability of episodic memory seen in early PD. Together with similar evidence recently obtained for spatial working memory, the present findings also showed that diminished androgen levels provide powerful, highly selective protections against the harmful effects that 6-OHDA lesions have on memory functions in male rats.

A novel multidimensional reinforcement task in mice elucidates sex-specific behavioral strategies

A large body of work has focused on understanding stimulus-driven behavior, sex differences in these processes, and the neural circuits underlying them. Many preclinical mouse models present rewarding or aversive stimuli in isolation, ignoring that ethologically, reward seeking requires the consideration of potential aversive outcomes. In addition, the context (or reinforcement schedule under) in which stimuli are encountered can engender different behavioral responses to the same stimulus. Thus, delineating neural control of behavior requires a dissociation between stimulus valence and stimulus-driven behavior. We developed the Multidimensional Cue Outcome Action Task (MCOAT) to dissociate motivated action from cue learning and valence in mice. First, mice acquire positive and negative reinforcement in the presence of discrete discriminative stimuli. Next, discriminative stimuli are presented concurrently allowing for parsing innate behavioral strategies based on reward seeking and avoidance. Lastly, responding in the face of punishment is assessed, thus examining  how positive and negative outcomes are relatively valued. First, we identified sex-specific behavioral strategies, showing that females prioritize avoidance of negative outcomes over seeking positive, while males have the opposite strategy. Next, we show that chemogenetically inhibiting D1 medium spiny neurons (MSNs) in the nucleus accumbens-a population that has been linked to reward-driven behavior-reduces positive and increases negative reinforcement learning rates. Thus, D1 MSNs modulate stimulus processing, rather than motivated responses or the reinforcement process itself. Together, the MCOAT has broad utility for understanding complex behaviors as well as the definition of the discrete information encoded within cellular populations.

Reward Responsiveness in the Adolescent Brain Cognitive Development (ABCD) Study: African Americans' Diminished Returns of Parental Education

(1) Background: Reward responsiveness (RR) is a risk factor for high-risk behaviors such as aggressive behaviors and early sexual initiation, which are all reported to be higher in African American and low socioeconomic status adolescents. At the same time, parental education is one of the main drivers of reward responsiveness among adolescents. It is still unknown if some of this racial and economic gap is attributed to weaker effects of parental education for African Americans, a pattern also called minorities' diminished returns (MDRs). (2) Aim: We compared non-Hispanic White and African American adolescents for the effects of parent education on adolescents RR, a psychological and cognitive construct that is closely associated with high-risk behaviors such as the use of drugs, alcohol, and tobacco. (3) Methods: This was a cross-sectional analysis that included 7072 adolescents from the adolescent brain cognitive development (ABCD) study. The independent variable was parent education. The main outcome as adolescents' RR measured by the behavioral inhibition system (BIS) and behavioral activation system (BAS) measure. (4) Results: In the overall sample, high parent education was associated with lower levels of RR. In the overall sample, we found a statistically significant interaction between race and parent education on adolescents' RR. The observed statistical interaction term suggested that high parent education is associated with a weaker effect on RR for African American than non-Hispanic White adolescents. In race-stratified models, high parent education was only associated with lower RR for non-Hispanic White but not African American adolescents. (5) Conclusion: Parent education reduces RR for non-Hispanic White but not African American adolescents. To minimize the racial gap in brain development and risk-taking behaviors, we need to address societal barriers that diminish the returns of parent education and resources in African American families. We need public and social policies that target structural and societal barriers, such as the unequal distribution of opportunities and resources. To meet such an aim, we need to reduce the negative effects of social stratification, segregation, racism, and discrimination in the daily lives of African American parents and families. Through an approach like this, African American families and parents can effectively mobilize their resources and utilize their human capital to secure the best possible tangible outcomes for their adolescents.

Sex Differences and Effects of Predictive Cues on Delayed Punishment Discounting

The majority of the research studying punishment has focused on an aversive stimulus delivered immediately after an action. However, in real-world decision-making, negative consequences often occur long after a decision has been made. This can engender myopic decisions that fail to appropriately respond to consequences. Whereas discounting of delayed rewards has been well studied in both human and animal models, systematic discounting of delayed consequences remains largely unexplored. To address this gap in the literature, we developed the delayed punishment decision-making task. Rats chose between a small, single-pellet reinforcer and a large, three-pellet reinforcer accompanied by a mild foot shock. The shock was preceded by a delay, which systematically increased throughout the session (0, 4, 8, 12, 16 s). On average, rats discounted the negative value of delayed punishment, as indicated by increased choice of the large, punished reward as the delay preceding the shock lengthened. Female rats discounted delayed punishment less than males, and this behavior was not influenced by estrous cycling. The addition of a cue light significantly decreased the undervaluation of delayed consequences for both sexes. Finally, there was no correlation between the discounting of delayed punishments and a traditional reward delay discounting task for either sex. These data indicate that the ability of punishment to regulate decision-making is attenuated when punishment occurs later in time. This task provides an avenue for exploration of the neural circuitry underlying the devaluation of delayed punishment and may assist in developing treatments for substance use disorders.