Estradiol and the reward system in humans

Characterizing within-person variance in, and menstrual cycle associations with, event-related potentials associated with positive and negative valence systems: The reward positivity and the error-related negativity

Event-related potentials (ERPs) are widely employed as measures of transdiagnostic cognitive processes that are thought to underlie various clinical disorders (Hajcak et al., 2019). Despite their prevalent use as individual difference measures, the effects of within-person processes, such as the human menstrual cycle, on a broad range of ERPs are poorly understood. The present study leveraged a within-subject design to characterize between- and within-person variance in ERPs as well as effects of the menstrual cycle in two frequently studied ERPs associated with positive and negative valence systems underlying psychopathology-the Reward Positivity (RewP) and the Error- Related Negativity (ERN). Seventy-one naturally-cycling participants completed repeated EEG and ecological momentary assessments of positive and negative affect in the menstrual cycle's early follicular, periovulatory, and mid-luteal phases. We examined the mean degree of change between cycle phases in both ERPs, the between-person variability in the degree of change in both ERPs, and whether an individual's degree of cyclical change in these ERPs show coherence with their degree of cyclical change in positive and negative affect recorded across the cycle. Results revealed no significant changes in positive and negative affect across the cycle and rather small changes in ERP amplitudes. Significant random slopes in our model revealed larger individual differences in trajectories of change in ERP amplitudes and affect, in agreement with prior evidence of heterogeneity in dimensional hormone sensitivity. Additionally, state-variance in these ERPs correlated with positive and negative affect changes across the cycle, suggesting that cycle-mediated ERP changes may have relevance for affect and behavior. Finally, exploratory latent class growth mixture modeling revealed subgroups of individuals that display disparate patterns of change in ERPs that should be further investigated.

Reward processes in extinction learning and applications to exposure therapy

Anxiety disorders are common and highly distressing mental health conditions. Exposure therapy is a gold-standard treatment for anxiety disorders. Mechanisms of Pavlovian fear learning, and particularly fear extinction, are central to exposure therapy. A growing body of evidence suggests an important role of reward processes during Pavlovian fear extinction. Nonetheless, predominant models of exposure therapy do not currently incorporate reward processes. Herein, we present a theoretical model of reward processes in relation to Pavlovian mechanisms of exposure therapy, including a focus on dopaminergic prediction error signaling, coinciding positive emotional experiences (i.e., relief), and unexpected positive outcomes. We then highlight avenues for further research and discuss potential strategies to leverage reward processes to maximize exposure therapy response, such as pre-exposure interventions to increase reward sensitivity or post-exposure rehearsal (e.g., savoring, imaginal recounting strategies) to enhance retrieval and retention of learned associations.

Sex and pubertal variation in reward-related behavior and neural activation in early adolescents

This study aimed to characterize the role of sex and pubertal markers in reward motivation behavior and neural processing in early adolescence. We used baseline and two-year follow-up data from the Adolescent Brain and Cognitive DevelopmentSM study (15844 observations; 52% from boys; age 9-13). Pubertal development was measured with parent-reported Pubertal Development Scale, and DHEA, testosterone, and estradiol levels. Reward motivation behavior and neural processing at anticipation and feedback stages were assessed with the Monetary Incentive Delay task. Boys had higher reward motivation than girls, demonstrating greater accuracy difference between reward and neutral trials and higher task earnings. Girls had lower neural activation during reward feedback than boys in the nucleus accumbens, caudate, rostral anterior cingulate, medial orbitofrontal cortex, superior frontal gyrus and posterior cingulate. Pubertal stage and testosterone levels were positively associated with reward motivation behavior, although these associations changed when controlling for age. There were no significant associations between pubertal development and neural activation during reward anticipation and feedback. Sex differences in reward-related processing exist in early adolescence, signaling the need to understand their impact on typical and atypical functioning as it unfolds into adulthood.

Hormone sensitivity predicts the beneficial effects of transdermal estradiol on reward-seeking behaviors in perimenopausal women: A randomized controlled trial

Depression is highly prevalent during the menopause transition (perimenopause), and often presents with anxious and anhedonic features. This increased vulnerability for mood symptoms is likely driven in part by the dramatic hormonal changes that are characteristic of the menopause transition, as prior research has linked fluctuations in estradiol (E2) to emergence of depressed mood in at risk perimenopausal women. Transdermal estradiol (TE2) has been shown to reduce the severity of depression in clinically symptomatic women, particularly in those with recent stressful life events. This research extends prior work by examining the relation between E2 and reward seeking behaviors, a precise behavioral indicator of depression. Specifically, the current study utilizes a randomized, double blind, placebo-controlled design to investigate whether mood sensitivity to E2 flux ("hormone sensitivity") predicts the beneficial effects of TE2 interventions on reward seeking behaviors in perimenopausal women, and whether recent stressful life events moderate any observed associations.

METHOD

Participants were 66 women who met standardized criteria for being early or late perimenopausal based on bleeding patterns. Participants were recruited from a community sample; therefore, mood symptoms varied across the continuum and the majority of participants did not meet diagnostic criteria for a depressive or anxiety disorder at the time of enrollment. Hormone sensitivity was quantified over an 8-week baseline period, using within-subjects correlations between repeated weekly measures of E2 serum concentrations and weekly anxiety (State Trait Anxiety Inventory) and anhedonia ratings (Snaith-Hamilton Pleasure Scale). Women were then randomized to receive 8 weeks of TE2 (0.1 mg) or transdermal placebo, and reward-seeking behaviors were assessed using the Effort-Expenditure for Rewards Task (EEfRT).

RESULTS

Participants who were randomized to receive transdermal estradiol and who demonstrated greater anxiety sensitivity to E2 fluctuations at baseline, demonstrated more reward seeking behaviors on the EEfRT task. Notably, the strength of the association between E2-anxiety sensitivity and post-randomization EEfRT for TE2 participants increased when women experienced more recent stressful life events and rated those events as more stressful. E2-anhedonia sensitivity was not associated with reward-seeking behaviors.

CONCLUSION

Perimenopausal women who are more sensitive to E2 fluctuations and experienced more recent life stress may experience a greater benefit of TE2 as evidenced by an increase in reward seeking behaviors.

Depressive and anxiety symptoms, and neural correlates of reward and punishment anticipation in female athletes with amenorrhea

Objective

Studies in estrogen deficiency states such as primary ovarian insufficiency and Turner syndrome suggest that estrogen status may be an important modulator of mood and emotions. In this study we compared depressive and anxiety symptoms between adolescent and young adult female oligo-amenorrheic athletes (AA) and eumenorrheic females (EM), and explored structural, and functional changes in related brain areas during reward processing, a behavioral construct that is altered in depression and anxiety.

Methods

We included (i) 24 AA participating in ≥4 hours/week of aerobic exercise or running ≥20 miles/week for ≥6 months in the preceding year, with lack of menstrual cycles for ≥3 months within at least 6 preceding months of oligo-amenorrhea, OR in premenarchal girls, absence of menses at >15 years), and (ii) 27 EM aged 14-25 years. Participants completed the Beck Depression Inventory-II (BDI-II), State and Trait Anxiety Inventory (STAI), and Mood and Anxiety Symptoms Questionnaire (MASQ). Structural MRI and brain activation during a functional MRI (fMRI) task that probes reward and punishment processing was examined in a subset of 10 AA and 23 EM.

Results

Median (IQR) age and BMI of AA and EM groups were 20.6 (19.0-22.6) vs. 20.6 (19.2-23.7) years, p=0.6 and v 20.3 (18.8-21.5) vs. 21.9 (19.6-23.5) kg/m2, p=0.005, respectively. While groups did not differ for BDI-II scores, AA had higher anhedonic depression MASQ scores (p=0.04), and STAI (p=0.03) scores vs. EM. In the fMRI subset, AA had higher caudate volumes vs. EM [F(1, 29)=9.930, p=0.004]. Lower activation observed in the right caudate during reward anticipation in AA compared with EM (p=0.036) suggests blunted reward processing in the striatum in estrogen deficient states.

Conclusion

Athletes with amenorrhea had higher depressive and anxiety symptomatology compared to eumenorrheic young women. Exploratory analyses demonstrated increased caudate volumes and decreased caudate activation during reward processing in athletes with amenorrhea suggesting that estrogen may play a role in reward processing.

Adverse childhood experiences and hormonal contraception: Interactive impact on sexual reward function

The current literature suggests that some women are uniquely vulnerable to negative effects of hormonal contraception (HC) on affective processes. However, little data exists as to which factors contribute to such vulnerability. The present study evaluated the impact of prepubertal adverse childhood experiences (ACEs) on reward processing in women taking HC (N = 541) compared to naturally cycling women (N = 488). Participants completed an online survey assessing current and past HC use and exposure to 10 different adverse childhood experiences (ACEs) before puberty (ACE Questionnaire), with participants categorized into groups of low (0-1) versus high (≥2) prepubertal ACE exposure. Participants then completed a reward task rating their expected and experienced valence for images that were either erotic, pleasant (non-erotic), or neutral. Significant interactions emerged between prepubertal ACE exposure and HC use on expected (p = 0.028) and experienced (p = 0.025) valence ratings of erotic images but not pleasant or neutral images. Importantly, follow-up analyses considering whether women experienced HC-induced decreases in sexual desire informed the significant interaction for expected valence ratings of erotic images. For current HC users, prepubertal ACEs interacted with HC-induced decreased sexual desire (p = 0.008), such that high ACE women reporting decreased sexual desire on HC showed substantially decreased ratings for anticipated erotic images compared to both high prepubertal ACE women without decreased sexual desire (p < 0.001) and low prepubertal ACE women also reporting decreased sexual desire (p = 0.010). The interaction was not significant in naturally cycling women reporting previous HC use, suggesting that current HC use could be impacting anticipatory reward processing of sexual stimuli among certain women (e.g., high prepubertal ACE women reporting HC-induced decreases in sexual desire). The study provides rationale for future randomized, controlled trials to account for prepubertal ACE exposure to promote contraceptive selection informed by behavioral evidence.

When fertile, women seek status via prestige but not dominance

Biological predictors of human dominance are hotly contested, with far-reaching implications for psychological sex differences and the placement of men and women in the social hierarchy. Most investigations have focused on dominance in men and testosterone, with diminished attention paid to dominance in women and other biological mechanisms. Investigating biological influences on other routes to status attainment popular among women-such as via prestige in addition to dominance-have also been neglected. Here, I examined whether status seeking via prestige and via dominance covaried with fertility probability in a citizen science project spanning 14 countries and 4 world regions. Across 4,179 observations, participants tracked their menstrual cycle characteristics, motivation for prestige and dominance, dominance contest outcomes, and three domains of self-esteem. Self-esteem is predicted by status within a group and helps individuals navigate social hierarchies. Bayesian mixed models controlling for menstruation indicated that the motivation to obtain status via prestige but not dominance peaked when conception was most likely, as did dominance contest losses and two self-esteem domains. Fertility appears to reorient female psychology toward prestige-based strategies to success, enhancing women's desire for social capital through influence and admiration but not through fear, coercion, or intimidation. These insights fundamentally advance the understanding of the biological correlates of status seeking among women. They further suggest that fertility motivates not only mating competition but gaining rank and positive regard in social hierarchies.

Assessing the role of adolescent hormonal contraceptive use on risk for depression: a 3-year longitudinal study protocol

BACKGROUND

The incidence of depression in human females rises steadily throughout adolescence, a critical period of pubertal maturation marked by increasing levels of gonadal hormones including estrogens and progesterone. These gonadal hormones play a central role in social and emotional development and may also contribute to the increased occurrence of depression in females that begins in early adolescence. In this study, we examine whether and how introducing synthetic estrogen and progestin derivatives through the use of combined hormonal contraceptives (CHC), affects adolescent females' risk for developing depression. We further assess potential links between CHC use and alterations in stress responses and social-emotional functioning.

METHODS

Using a longitudinal cohort design, we will follow a sample of adolescent females over the span of three years. Participants will be assessed at three time points: once when they are between 13 and 15 years of age, and at approximately 18 and 36 months after their initial assessment. Each time point will consist of two online sessions during which participants will complete a clinical interview that screens for key symptoms of mental health disorders, along with a series of questionnaires assessing their level of depressive symptoms and history of contraceptive use. They will also complete a standardized social-evaluative stress test and an emotion recognition task, as well as provide saliva samples to allow for assessment of their circulating free cortisol levels.

DISCUSSION

In this study we will assess the effect of CHC use during adolescence on development of Major Depressive Disorder (MDD). We will control for variables previously found to or proposed to partially account for the observed relationship between CHC use and MDD, including socioeconomic status, age of sexual debut, and CHC-related variables including age of first use, reasons for use, and its duration. In particular, we will discover whether CHC use increases depressive symptoms and/or MDD, whether elevated depressive symptoms and/or MDD predict a higher likelihood of starting CHC, or both. Furthermore, this study will allow us to clarify whether alterations in stress reactivity and social-emotional functioning serve as pathways through which CHC use may result in increased risk of depressive symptoms and/or MDD.

Testosterone and estradiol affect adolescent reinforcement learning

During adolescence, gonadal hormones influence brain maturation and behavior. The impact of 17β-estradiol and testosterone on reinforcement learning was previously investigated in adults, but studies with adolescents are rare. We tested 89 German male and female adolescents (mean age ± sd = 14.7 ± 1.9 years) to determine the extent 17β-estradiol and testosterone influenced reinforcement learning capacity in a response time adjustment task. Our data showed, that 17β-estradiol correlated with an enhanced ability to speed up responses for reward in both sexes, while the ability to wait for higher reward correlated with testosterone primary in males. This suggests that individual differences in reinforcement learning may be associated with variations in these hormones during adolescence, which may shift the balance between a more reward- and an avoidance-oriented learning style.

Daytime and season do not affect reinforcement learning capacity in a response time adjustment task

Seasonal and circadian rhythms have a broad impact on physiological aspects, such as dopamine neurotransmission, and may be involved in the etiology of mood disorders. Considering this, studies on the influence of season and daytime on cognitive function are rare. The present study aimed to assess the impact of seasonal and diurnal effects on the ability to maximize reward outcomes by optimizing response times adaptively. For this purpose, a reward-based learning task that required an adaptation of response time to either a fast or a slow response was used. Eighty German participants (mean age ± SD = 21.86 ± 1.89 years, 41 women) were examined twice, in the morning and in the evening. Half of the participants were tested during the summer, while the other half performed the test in the winter. No impact of daytime, season or of the external factors photoperiodicity and temperature on reinforcement learning could be found. However, a generally slower response speed in the morning compared to the evening appeared. Previously conducted tasks could not display behavioral differences in both times of season and daytime, although neurophysiological findings suggest it.

A causal role of estradiol in human reinforcement learning

The sex hormone estradiol is hypothesized to play a key role in human cognition, and reward processing specifically, via increased dopamine D1-receptor signalling. However, the effect of estradiol on reward processing in men has never been established. To fill this gap, we performed a double-blind placebo-controlled study in which men (N = 100) received either a single dose of estradiol (2 mg) or a placebo. Subjects performed a probabilistic reinforcement learning task where they had to choose between two options with varying reward probabilities to maximize monetary reward. Results showed that estradiol administration increased reward sensitivity compared to placebo. This effect was observed in subjects' choices, how much weight they assigned to their previous choices, and subjective reports about the reward probabilities. Furthermore, effects of estradiol were moderated by reward sensitivity, as measured through the BIS/BAS questionnaire. Using reinforcement learning models, we found that behavioral effects of estradiol were reflected in increased learning rates. These results demonstrate a causal role of estradiol within the framework of reinforcement learning, by enhancing reward sensitivity and learning. Furthermore, they provide preliminary evidence for dopamine-related genetic variants moderating the effect of estradiol on reward processing.

The Straw That Broke the Camel's Back: Natural Variations in 17β-Estradiol and COMT-Val158Met Genotype Interact in the Modulation of Model-Free and Model-Based Control

The sex hormone estradiol has recently gained attention in human decision-making research. Animal studies have already shown that estradiol promotes dopaminergic transmission and thus supports reward-seeking behavior and aspects of addiction. In humans, natural variations of estradiol across the menstrual cycle modulate the ability to learn from direct performance feedback ("model-free" learning). However, it remains unclear whether estradiol also influences more complex "model-based" contributions to reinforcement learning. Here, 41 women were tested twice - in the low and high estradiol state of the follicular phase of their menstrual cycle - with a Two-Step decision task designed to separate model-free from model-based learning. The results showed that in the high estradiol state women relied more heavily on model-free learning, and accomplished reduced performance gains, particularly during the more volatile periods of the task that demanded increased learning effort. In contrast, model-based control remained unaltered by the influence of hormonal state across the group. Yet, when accounting for individual differences in the genetic proxy of the COMT-Val158Met polymorphism (rs4680), we observed that only the participants homozygote for the methionine allele (n = 12; with putatively higher prefrontal dopamine) experienced a decline in model-based control when facing volatile reward probabilities. This group also showed the increase in suboptimal model-free control, while the carriers of the valine allele remained unaffected by the rise in endogenous estradiol. Taken together, these preliminary findings suggest that endogenous estradiol may affect the balance between model-based and model-free control, and particularly so in women with a high prefrontal baseline dopamine capacity and in situations of increased environmental volatility.

Dopamine multilocus genetic profiles predict sex differences in reactivity of the human reward system

Sex differences in the neural processing of decision-making are of high interest as they may have pronounced effects on reward- and addiction-related processes. In these, the neurotransmitter dopamine plays a central role by modulating the responsiveness of the reward circuitry. The present functional magnetic resonance imaging study aimed to explore sex and dopamine transmission interactions in decision-making. 172 subjects (111 women) performed a behavioral self-control task assessing reward-related activation during acceptance and rejection of conditioned rewards. Participants were genotyped for six key genetic polymorphisms in the dopamine system that have previously been associated with individual differences in reward sensitivity or dopaminergic transmission in the human striatum, such as rs7118900 (dopamine receptor D2 (DRD2) Taq1A), rs1554929 (DRD2 C957T), rs907094 (DARPP-32), rs12364283 (DRD2), rs6278 (DRD2), and rs107656 (DRD2). The selected polymorphisms were combined in a so-called multilocus genetic composite (MGC) score reflecting the additive effect of different alleles conferring relative increased dopamine transmission in every individual. We successfully demonstrated that reward-related activation in the ventral striatum and ventral tegmental area (VTA) was significantly modulated by biologically informed MGC profiles and sex. When comparing men and women with low MGC profiles that may indicate lower dopamine transmission, only women displayed a reduced down-regulation of activation in the mesolimbic system during reward rejection and additionally, a significant non-linear u-shape relationship between MGC score and VTA activation. Taken together, by integrating neuroimaging and genetics, the present findings contribute to a better understanding of the effects of sex differences on the human brain.

Ovarian Hormones and Reward Processes in Palatable Food Intake and Binge Eating

Ovarian hormones are associated with risk for binge eating in women. Recent animal and human studies suggest that food-related reward processing may be one set of neurobiological factors that contribute to these relationships, but additional studies are needed to confirm and extend findings.

Influence of ovarian hormones on value-based decision-making systems: Contribution to sexual dimorphisms in mental disorders

Women and men exhibit differences in behavior when making value-based decisions. Various hypotheses have been proposed to explain these findings, stressing differences in functional lateralization of the brain, functional activation, neurotransmitter involvement and more recently, sex hormones. While a significant interaction of neurotransmitter systems and sex hormones has been shown for both sexes, decision-making in women might be particularly affected by variations of ovarian hormones. In this review we have gathered information from animal and human studies on how ovarian hormones affect decision-making processes in females by interacting with neurotransmitter systems at functionally relevant brain locations and thus modify the computation of decision aspects. We also review previous findings on impaired decision-making in animals and clinical populations with substance use disorder and depression, emphasizing how little we know about the role of ovarian hormones in aberrant decision-making.

Sex hormones and human brain function

Sex hormones have organizational and activational effects on the human brain and can interact with the neurotransmitter systems. These biologic mechanisms may have a far-reaching impact, with both behavioral consequences and structural as well as functional brain modulation. The impact of cycling hormone levels throughout the menstrual cycle on cognitive and emotion processing has especially received some attention recently. Therefore, the aim of this chapter is to give an overview of findings regarding the effects of estradiol and progesterone, but also testosterone, on functional brain domains comprising cognition, emotion, and reward processing.

Avoidance Learning Across the Menstrual Cycle: A Conceptual Replication

Hormonal transitions across the menstrual cycle may modulate human reward processing and reinforcement learning, but previous results were contradictory. Studies assessed relatively small samples (n < 30) and exclusively used within-subject designs to compare women in hormonally distinct menstrual cycle phases. This increased the risk of sporadic findings and results may have been disproportionally affected by expectancy effects. Also, replication studies are widely missing, which currently precludes any reliable inferences. The present study was intended as a conceptual replication of a previous study [(1), Neuropsychologia 84; n = 15]. There, we had observed a reduction in avoidance learning capacity when women were in the high estradiol state of the late follicular phase as compared to the mid luteal phase with enhanced progesterone influence. These results conformed to the idea that estradiol and progesterone may antagonistically modulate dopaminergic transmission as a dopamine agonist and antagonist, respectively. Heightened progesterone in the luteal phase thereby supported the ability to learn from the negative outcomes of one's actions, while the follicular rise in estradiol interfered with this capacity. Here, we re-examined the above described within-subject difference between the follicular and the luteal phase in a between-subjects design. Seventy-five women were tested once with a probabilistic feedback learning task, while being either in the follicular (36 women) or luteal phase (39 women), and were compared for phase-related differences in behavior. Secondly, we combined the new data with data from three previous studies from our laboratory that used the same task and menstrual cycle phases. This meta-analysis included only data from the first test day, free of any biasing expectancy effects. Both analyses demonstrated the consistency of the decline in avoidance learning in the follicular relative to the luteal phase. We also showed that this decline reliably occurred in all of the included samples. Altogether, these results provide evidence for the consistency of a behavioral difference and its apparent association with a transient change in hormonal state that occurs in the natural menstrual cycle. Our findings may also open new avenues for the development of reliable between-subjects test protocols in menstrual cycle research.

Effects of Hormonal Contraceptives on Mood: A Focus on Emotion Recognition and Reactivity, Reward Processing, and Stress Response

PURPOSE OF REVIEW

We review recent research investigating the relationship of hormonal contraceptives and mood with a focus on relevant underlying mechanisms, such as emotion recognition and reactivity, reward processing, and stress response.

RECENT FINDINGS

Adverse effects of hormonal contraceptives (HCs) on mood seem most consistent in women with a history of depressive symptoms and/or previous negative experience with HC-intake. Current evidence supports a negativity bias in emotion recognition and reactivity in HC-users, although inconsistent to some extent. Some data, however, do indicate a trend towards a blunted reward response and a potential dysregulation of the stress response in some HC-users. HC-effects on psychological and neurophysiological mechanisms underlying mood are likely context-dependent. We provide suggestions on how to address some of the contributing factors to this variability in future studies, such as HC-dose, timing, administration-mode, and individual risk. A better understanding of how and when HCs affect mood is critical to provide adequate contraceptive choices to women worldwide.