Dissociable systems for gain- and loss-related value predictions and errors of prediction in the human brain

Astrocyte-mediated regulation of BLAWFS1 neurons alleviates risk-assessment deficits in DISC1-N mice

Assessing and responding to threats is vital in everyday life. Unfortunately, many mental illnesses involve impaired risk assessment, affecting patients, families, and society. The brain processes behind these behaviors are not well understood. We developed a transgenic mouse model (disrupted-in-schizophrenia 1 [DISC1]-N) with a disrupted avoidance response in risky settings. Our study utilized single-nucleus RNA sequencing and path-clamp coupling with real-time RT-PCR to uncover a previously undescribed group of glutamatergic neurons in the basolateral amygdala (BLA) marked by Wolfram syndrome 1 (WFS1) expression, whose activity is modulated by adjacent astrocytes. These neurons in DISC1-N mice exhibited diminished firing ability and impaired communication with the astrocytes. Remarkably, optogenetic activation of these astrocytes reinstated neuronal excitability via D-serine acting on BLAWFS1 neurons' NMDA receptors, leading to improved risk-assessment behavior in the DISC1-N mice. Our findings point to BLA astrocytes as a promising target for treating risk-assessment dysfunctions in mental disorders.

Neural interactions in the human frontal cortex dissociate reward and punishment learning

How human prefrontal and insular regions interact while maximizing rewards and minimizing punishments is unknown. Capitalizing on human intracranial recordings, we demonstrate that the functional specificity toward reward or punishment learning is better disentangled by interactions compared to local representations. Prefrontal and insular cortices display non-selective neural populations to rewards and punishments. Non-selective responses, however, give rise to context-specific interareal interactions. We identify a reward subsystem with redundant interactions between the orbitofrontal and ventromedial prefrontal cortices, with a driving role of the latter. In addition, we find a punishment subsystem with redundant interactions between the insular and dorsolateral cortices, with a driving role of the insula. Finally, switching between reward and punishment learning is mediated by synergistic interactions between the two subsystems. These results provide a unifying explanation of distributed cortical representations and interactions supporting reward and punishment learning.

Internally Formed Preferences for Options only Influence Initial Decisions in Gambling Tasks, while the Gambling Outcomes do not Alter these Preferences

All humans must engage in decision-making. Decision-making processes can be broadly classified into internally guided decision-making (IDM), which is determined by individuals' internal value criteria, such as preference, or externally guided decision-making (EDM), which is determined by environmental external value criteria, such as monetary rewards. However, real-life decisions are never made simply using one kind of decision-making, and the relationship between IDM and EDM remains unclear. This study had individuals perform gambling tasks requiring the EDM using stimuli that formed preferences through the preference judgment task as the IDM. Computational model analysis revealed that strong preferences in the IDM affected initial choice behavior in the EDM. Moreover, through the analysis of the subjective preference evaluation after the gambling tasks, we found that even when stimuli that were preferred in the IDM were perceived as less valuable in the EDM, the preference for IDM was maintained after EDM. These results indicate that although internal criteria, such as preferences, influence EDM, the results show that internal and external criteria differ.

Connection Failure: Differences in White Matter Microstructure Are Associated with 5-HTTLPR but Not with Risk Seeking for Losses

S/S carriers of 5-HTTLPR have been found to be more risk seeking for losses compared to L/L carriers. This finding may be the result of reduced top-down control from the frontal cortex due to altered signal pathways involving the amygdala and ventral striatum. The serotonergic system is known to be involved in neurodevelopment and neuroplasticity. Therefore, the aim of this study was to investigate whether structural differences in white matter can explain the differences in risk-seeking behaviour. Lower structural connectivity in S/S compared to L/L carriers and a negative relationship between risk seeking for losses and connectivity were assumed. Diffusion-weighted imaging was used to compute diffusion parameters for the frontostriatal and uncinate tract in 175 genotyped individuals. The results showed no significant relationship between diffusion parameters and risk seeking for losses. Furthermore, we did not find significant differences in diffusion parameters of the S/S vs. L/L group. There were only group differences in the frontostriatal tract showing stronger structural connectivity in the S/L group, which is also reflected in the whole brain approach. Therefore, the data do not support the hypothesis that the association between 5-HTTLPR and risk seeking for losses is related to differences in white matter pathways implicated in decision-making.

Ventral frontostriatal circuitry mediates the computation of reinforcement from symbolic gains and losses

Reinforcement learning (RL), particularly in primates, is often driven by symbolic outcomes. However, it is usually studied with primary reinforcers. To examine the neural mechanisms underlying learning from symbolic outcomes, we trained monkeys on a task in which they learned to choose options that led to gains of tokens and avoid choosing options that led to losses of tokens. We then recorded simultaneously from the orbitofrontal cortex (OFC), ventral striatum (VS), amygdala (AMY), and the mediodorsal thalamus (MDt). We found that the OFC played a dominant role in coding token outcomes and token prediction errors. The other areas contributed complementary functions with the VS coding appetitive outcomes and the AMY coding the salience of outcomes. The MDt coded actions and relayed information about tokens between the OFC and VS. Thus, OFC leads the process of symbolic reinforcement learning in the ventral frontostriatal circuitry.

Preexposure to one social threat alters responses to another social threat: Behavioral and electrophysiological evidence

A recent Cyberball study has indicated that the experience of loss of control can affect how people process subsequent social exclusion. This "preexposure effect" supports the idea of a common cognitive system involved in the processing of different types of social threats. To test the validity of this assumption in the current study, we reversed the sequence of the preexposure setup. We measured the effects of social exclusion on the subsequent processing of loss of control utilizing event-related brain potentials (ERPs) and self-reports. In the control group (CG, n = 26), the transition to loss of control elicited significant increases in both the P3 amplitude and the self-reported negative mood. Replicating the results of the previous preexposure study, these effects were significantly reduced by the preexposure to an independent social threat (here: social exclusion). In contrast to previous findings, these effects were not modulated by the discontinuation (EG1disc, n = 25) or continuation (EG2cont, n = 24) of the preexposure threat. Given that the P3 effect is related to the violation of subjective expectations, these results support the notion that preexposure to a specific social threat has widespread effects on the individuals' expectancy of upcoming social participation and control.

Trajectory of reward-related abnormalities in unaffected relatives of patients with bipolar disorder - A longitudinal fMRI study

First-degree relatives of patients with bipolar disorder are at heightened risk of mood episodes, which may be attributed to the existence of endophenotypes i.e., heritable (neuro)biological changes present in patients and their unaffected relatives (UR). In this longitudinal MRI study, we aim to investigate the trajectories of aberrant reward-related functional changes identified in UR vs healthy controls (HC). Sixty-eight UR and 65 HC of similar age and gender distribution underwent MRI at baseline while performing a card guessing task. Of these, 29 UR and 36 HC were investigated with the same protocol following a 16-month period in average. We first identified brain regions showing group differences in the neural response to expected value (EV) and reward prediction error (PE) at baseline and analyzed how the reward-related response in these regions changed over time in UR vs HC. Relative to HC at baseline, UR showed lower EV signal in the right ventrolateral prefrontal cortex (vlPFC) and paracingulate gyrus and lower PE signal in the left vlPFC and dorsomedial PFC. The trajectories of these abnormalities in UR showed a normalization of the prefrontal EV signals, whereas the PE signals which correlated with depressive symptoms remained stable over time. While the UR showed both blunted EV and PE signals, none of these abnormalities increased over time, which is consistent with the observed stable mood symptoms.

Altered neural activity in the reward-related circuit associated with anhedonia in mild to moderate Major Depressive Disorder

BACKGROUND

Anhedonia is a significant predictor of disease progression and treatment outcomes in Major Depressive Disorder (MDD), linked to reward network dysfunctions. However, understanding of its underlying neural mechanisms remains limited. This study aimed to investigate the brain functional mechanisms underlying MDD with anhedonia using resting-state functional magnetic resonance imaging (rs-fMRI).

METHODS

The Snaith-Hamilton Pleasure Scale (SHAPS) was used to evaluation MDD with anhedonia (anMDD) and non-anhedonia MDD (non-anMDD). Forty-eight patients with anMDD, Forty-four patients with non-anMDD, and Fifty healthy controls (HCs) were enrolled for the fMRI scans. A seed-based functional connectivity (FC) method was employed to explore reward network abnormalities.

RESULTS

anMDD patients exhibited lower FC values in Ventral Striatum (VS), right lateral Ventral Tegmental Area (VTA_R), left Thalamus (THA_L), and higher FC values in Ventromedial Prefrontal Cortex (vmPFC), left Anterior Insula (AI_L), and Presupplementary Motor Area (Pre-SMA) compared to HCs. Comparing anMDD to non-anMDD, significant differences were observed in FC values of VS, vmPFC, Pre-SMA, and THA_L regions. Correlation analysis revealed positive correlations between FC values of VS_R and NAc_R, as well as THA_L and Cerebellum_Crus1_L, with SHAPS scores. Negative correlations were observed between FC values of Pre-SMA and the right caudate, and between vmPFC and Frontal_Mid_Orb_L, and SHAPS scores.

CONCLUSION

Both anMDD and non-anMDD groups demonstrated abnormal FCs in the reward network. These findings indicate distinct roles of reward-related circuits in the two subtypes, contributing to a refined understanding of depression phenotypes and potential directions for targeted interventions.

Feedback-related brain activity in individual decision: evidence from a gambling EEG study

In this study, based on scalp electroencephalogram (EEG), we conducted cortical source localization and functional network analyses to investigate the underlying mechanism explaining the decision processes when individuals anticipate maximizing gambling benefits, particularly in situations where the decision outcomes are inconsistent with the profit goals. The findings shed light on the feedback monitoring process, wherein incongruity between outcomes and gambling goals triggers a more pronounced medial frontal negativity and activates the frontal lobe. Moreover, long-range theta connectivity is implicated in processing surprise and uncertainty caused by inconsistent feedback conditions, while middle-range delta coupling reflects a more intricate evaluation of feedback outcomes, which subsequently modifies individual decision-making for optimizing future rewards. Collectively, these findings deepen our comprehension of decision-making under circumstances where the profit goals are compromised by decision outcomes and provide electrophysiological evidence supporting adaptive adjustments in individual decision strategies to achieve maximum benefit.

Functional connectivity between the amygdala and prefrontal cortex underlies processing of emotion ambiguity

Processing facial expressions of emotion draws on a distributed brain network. In particular, judging ambiguous facial emotions involves coordination between multiple brain areas. Here, we applied multimodal functional connectivity analysis to achieve network-level understanding of the neural mechanisms underlying perceptual ambiguity in facial expressions. We found directional effective connectivity between the amygdala, dorsomedial prefrontal cortex (dmPFC), and ventromedial PFC, supporting both bottom-up affective processes for ambiguity representation/perception and top-down cognitive processes for ambiguity resolution/decision. Direct recordings from the human neurosurgical patients showed that the responses of amygdala and dmPFC neurons were modulated by the level of emotion ambiguity, and amygdala neurons responded earlier than dmPFC neurons, reflecting the bottom-up process for ambiguity processing. We further found parietal-frontal coherence and delta-alpha cross-frequency coupling involved in encoding emotion ambiguity. We replicated the EEG coherence result using independent experiments and further showed modulation of the coherence. EEG source connectivity revealed that the dmPFC top-down regulated the activities in other brain regions. Lastly, we showed altered behavioral responses in neuropsychiatric patients who may have dysfunctions in amygdala-PFC functional connectivity. Together, using multimodal experimental and analytical approaches, we have delineated a neural network that underlies processing of emotion ambiguity.

Loss aversion in the control of attention

Loss aversion is a psychological bias where an increase in loss is perceived as being larger than an equivalent increase in gain. In the present study, two experiments were conducted to explore whether attentional control reflects loss aversion. Participants performed a visual search task. On each trial, a red target and a green target were presented simultaneously, and participants were free to search for either one. Participants always gained points when they searched for a gain color target (e.g., red). However, they gained or lost points when they searched for a gain-loss color target (e.g., green). In Experiment 1, the expected values of the gain color and the gain-loss color were equal. Therefore, for maximizing the reward, participants did not need to preferably search for a particular color. However, results showed that participants searched for the gain color target more than the gain-loss color target, suggesting stronger attentional control for the gain color than the gain-loss color. In Experiment 2, even though the expected value of the gain-loss color was greater than that of the gain color, attention was allocated to the gain color more than to the gain-loss color. The results imply that attentional control can operate in accordance with the loss aversion principle when the boundary conditions for loss aversion in a repeated binary decision-making task were met.

Prediction errors arising from switches between major and minor modes in music: An fMRI study

The major and minor modes in Western music have positive and negative connotations, respectively. The present fMRI study examined listeners' neural responses to switches between major and minor modes. We manipulated the final chords of J. S. Bach's keyboard pieces so that each major-mode passage ended with either the major (Major-Major) or minor (Major-Minor) tonic chord, and each minor-mode passage ended with either the minor (Minor-Minor) or major (Minor-Major) tonic chord. If the final major and minor chords have positive and negative reward values respectively, the Major-Minor and Minor-Major stimuli would cause negative and positive reward prediction errors (RPEs) respectively in a listener's brain. We found that activity in a frontoparietal network was significantly higher for Major-Minor than for Major-Major. Based on previous research, these results support the idea that a major-to-minor switch causes negative RPE. The contrast of Minor-Major minus Minor-Minor yielded activation in the ventral insula and visual cortex, speaking against the idea that a minor-to-major switch causes positive RPE. We discuss our results in relation to executive functions and the emotional connotations of major versus minor modes.

Neural valuation of rewards and punishments in posttraumatic stress disorder: a computational approach

Posttraumatic stress disorder (PTSD) is associated with changes in fear learning and decision-making, suggesting involvement of the brain's valuation system. Here we investigate the neural mechanisms of subjective valuation of rewards and punishments in combat veterans. In a functional MRI study, male combat veterans with a wide range of posttrauma symptoms (N = 48, Clinician Administered PTSD Scale, CAPS-IV) made a series of choices between sure and uncertain monetary gains and losses. Activity in the ventromedial prefrontal cortex (vmPFC) during valuation of uncertain options was associated with PTSD symptoms, an effect which was consistent for gains and losses, and specifically driven by numbing symptoms. In an exploratory analysis, computational modeling of choice behavior was used to estimate the subjective value of each option. The neural encoding of subjective value varied as a function of symptoms. Most notably, veterans with PTSD exhibited enhanced representations of the saliency of gains and losses in the neural valuation system, especially in ventral striatum. These results suggest a link between the valuation system and the development and maintenance of PTSD, and demonstrate the significance of studying reward and punishment processing within subject.

Voluntary or reluctant? Social influence in charitable giving: an ERP study

Social information has substantial influences on prosocial behavior. In this study, we performed an event-related potential (ERP) experiment to examine the effect of social influence on giving. The participants were allowed to form an initial decision on how much money to donate to a charity provided the program's average donation amount and to make a second donation decision. Social influence varied in different directions (upward, downward and equal) by altering the relative donation amount between the average donation amount and the participants' first donation amount. The behavioral results showed that participants increased their donation amount in the upward condition and decreased it in the downward condition. The ERP results revealed that upward social information evoked larger feedback-related negativity (FRN) amplitudes and smaller P3 amplitudes than in the downward and equal conditions. Furthermore, the pressure ratings, rather than the happiness ratings, were associated with the FRN patterns across the three conditions. We argue that people in social situations are more likely to increase their donations owing to pressure than voluntary altruism. Our study provides the first ERP evidence that different directions of social information evoke different neural responses in time course processing.

A multivariate brain signature for reward

The processing of reinforcers and punishers is crucial to adapt to an ever changing environment and its dysregulation is prevalent in mental health and substance use disorders. While many human brain measures related to reward have been based on activity in individual brain regions, recent studies indicate that many affective and motivational processes are encoded in distributed systems that span multiple regions. Consequently, decoding these processes using individual regions yields small effect sizes and limited reliability, whereas predictive models based on distributed patterns yield larger effect sizes and excellent reliability. To create such a predictive model for the processes of rewards and losses, termed the Brain Reward Signature (BRS), we trained a model to predict the signed magnitude of monetary rewards on the Monetary Incentive Delay task (MID; N = 39) and achieved a highly significant decoding performance (92% for decoding rewards versus losses). We subsequently demonstrate the generalizability of our signature on another version of the MID in a different sample (92% decoding accuracy; N = 12) and on a gambling task from a large sample (73% decoding accuracy, N = 1084). We further provided preliminary data to characterize the specificity of the signature by illustrating that the signature map generates estimates that significantly differ between rewarding and negative feedback (92% decoding accuracy) but do not differ for conditions that differ in disgust rather than reward in a novel Disgust-Delay Task (N = 39). Finally, we show that passively viewing positive and negatively valenced facial expressions loads positively on our signature, in line with previous studies on morbid curiosity. We thus created a BRS that can accurately predict brain responses to rewards and losses in active decision making tasks, and that possibly relates to information seeking in passive observational tasks.

Functional connectivity between the amygdala and prefrontal cortex underlies processing of emotion ambiguity

Processing facial expressions of emotion draws on a distributed brain network. In particular, judging ambiguous facial emotions involves coordination between multiple brain areas. Here, we applied multimodal functional connectivity analysis to achieve network-level understanding of the neural mechanisms underlying perceptual ambiguity in facial expressions. We found directional effective connectivity between the amygdala, dorsomedial prefrontal cortex (dmPFC), and ventromedial PFC, supporting both bottom-up affective processes for ambiguity representation/perception and top-down cognitive processes for ambiguity resolution/decision. Direct recordings from the human neurosurgical patients showed that the responses of amygdala and dmPFC neurons were modulated by the level of emotion ambiguity, and amygdala neurons responded earlier than dmPFC neurons, reflecting the bottom-up process for ambiguity processing. We further found parietal-frontal coherence and delta-alpha cross-frequency coupling involved in encoding emotion ambiguity. We replicated the EEG coherence result using independent experiments and further showed modulation of the coherence. EEG source connectivity revealed that the dmPFC top-down regulated the activities in other brain regions. Lastly, we showed altered behavioral responses in neuropsychiatric patients who may have dysfunctions in amygdala-PFC functional connectivity. Together, using multimodal experimental and analytical approaches, we have delineated a neural network that underlies processing of emotion ambiguity.

Significance Statement

A large number of different brain regions participate in emotion processing. However, it remains elusive how these brain regions interact and coordinate with each other and collectively encode emotions, especially when the task requires orchestration between different brain areas. In this study, we employed multimodal approaches that well complemented each other to comprehensively study the neural mechanisms of emotion ambiguity. Our results provided a systematic understanding of the amygdala-PFC network underlying emotion ambiguity with fMRI-based connectivity, EEG coordination of cortical regions, synchronization of brain rhythms, directed information flow of the source signals, and latency of single-neuron responses. Our results further shed light on neuropsychiatric patients who have abnormal amygdala-PFC connectivity.

Glutathione in the nucleus accumbens regulates motivation to exert reward-incentivized effort

Emerging evidence is implicating mitochondrial function and metabolism in the nucleus accumbens in motivated performance. However, the brain is vulnerable to excessive oxidative insults resulting from neurometabolic processes, and whether antioxidant levels in the nucleus accumbens contribute to motivated performance is not known. Here, we identify a critical role for glutathione (GSH), the most important endogenous antioxidant in the brain, in motivation. Using proton magnetic resonance spectroscopy at ultra-high field in both male humans and rodent populations, we establish that higher accumbal GSH levels are highly predictive of better, and particularly, steady performance over time in effort-related tasks. Causality was established in in vivo experiments in rats that, first, showed that downregulating GSH levels through micro-injections of the GSH synthesis inhibitor buthionine sulfoximine in the nucleus accumbens impaired effort-based reward-incentivized performance. In addition, systemic treatment with the GSH precursor N-acetyl-cysteine increased accumbal GSH levels in rats and led to improved performance, potentially mediated by a cell-type-specific shift in glutamatergic inputs to accumbal medium spiny neurons. Our data indicate a close association between accumbal GSH levels and an individual’s capacity to exert reward-incentivized effort over time. They also suggest that improvement of accumbal antioxidant function may be a feasible approach to boost motivation.

Decreased reward circuit connectivity during reward anticipation in major depression

An important symptom of major depressive disorder (MDD) is the inability to experience pleasure, possibly due to a dysfunction of the reward system. Despite promising insights regarding impaired reward-related processing in MDD, circuit-level abnormalities remain largely unexplored. Furthermore, whereas studies contrasting experimental conditions from incentive tasks have revealed important information about reward processing, temporal difference modeling of reward-related prediction error (PE) signals might give a more accurate representation of the reward system. We used a monetary incentive delay task during functional MRI scanning to explore PE-related striatal and ventral tegmental area (VTA) activation in response to anticipation and delivery of monetary rewards in 24 individuals with MDD versus 24 healthy controls (HCs). Furthermore, we investigated group differences in temporal difference related connectivity with a generalized psychophysiological interaction (gPPI) analysis with the VTA, ventral striatum (VS) and dorsal striatum (DS) as seeds during reward versus neutral, both in anticipation and delivery. Relative to HCs, MDD patients displayed a trend-level (p = 0.052) decrease in temporal difference-related activation in the VS during reward anticipation and delivery combined. Moreover, gPPI analyses revealed that during reward anticipation, MDD patients exhibited decreased functional connectivity between the VS and anterior cingulate cortex / medial prefrontal cortex, anterior cingulate gyrus, angular/middle orbital gyrus, left insula, superior/middle frontal gyrus (SFG/MFG) and precuneus/superior occipital gyrus/cerebellum compared to HC. Moreover, MDD patients showed decreased functional connectivity between the VTA and left insula compared to HC during reward anticipation. Exploratory analysis separating medication free patients from patients using antidepressant revealed that these decreased functional connectivity patterns were mainly apparent in the MDD group that used antidepressants. These results suggest that MDD is characterized by alterations in reward circuit connectivity rather than isolated activation impairments. These findings represent an important extension of the existing literature since improved understanding of neural pathways underlying depression-related reward dysfunctions, may help currently unmet diagnostic and therapeutic efforts.

Dorsolateral prefrontal cortex plays causal role in probability weighting during risky choice

In this study, we provide causal evidence that the dorsolateral prefrontal cortex (DLPFC) supports the computation of subjective value in choices under risk via its involvement in probability weighting. Following offline continuous theta-burst transcranial magnetic stimulation (cTBS) of the DLPFC subjects (N = 30, mean age 23.6, 56% females) completed a computerized task consisting of 96 binary lottery choice questions presented in random order. Using the hierarchical Bayesian modeling approach, we then estimated the structural parameters of risk preferences (the degree of risk aversion and the curvature of the probability weighting function) and analyzed the obtained posterior distributions to determine the effect of stimulation on model parameters. On a behavioral level, temporary downregulation of the left DLPFC excitability through cTBS decreased the likelihood of choosing an option with higher expected reward while the probability of choosing a riskier lottery did not significantly change. Modeling the stimulation effects on risk preference parameters showed anecdotal evidence as assessed by Bayes factors that probability weighting parameter increased after the left DLPFC TMS compared to sham.

Interactions between attributions and beliefs at trial-by-trial level: Evidence from a novel computer game task

Inferring causes of the good and bad events that we experience is part of the process of building models of our own capabilities and of the world around us. Making such inferences can be difficult because of complex reciprocal relationships between attributions of the causes of particular events, and beliefs about the capabilities and skills that influence our role in bringing them about. Abnormal causal attributions have long been studied in connection with psychiatric disorders, notably depression and paranoia; however, the mechanisms behind attributional inferences and the way they can go awry are not fully understood. We administered a novel, challenging, game of skill to a substantial population of healthy online participants, and collected trial-by-trial time series of both their beliefs about skill and attributions about the causes of the success and failure of real experienced outcomes. We found reciprocal relationships that provide empirical confirmation of the attribution-self representation cycle theory. This highlights the dynamic nature of the processes involved in attribution, and validates a framework for developing and testing computational accounts of attribution-belief interactions.

As part of interpreting our experiences, we spontaneously make causal attributions and use them to update our beliefs about the world, ourselves and others. This has long been a topic of interest, particularly within psychiatry. Some theories assume that people have stable “attributional styles”, others focus on the changing nature of attribution-making and on the relationships between attributions and one’s beliefs about the self, suggesting that the two are mutually connected. In this area of research, people have traditionally been asked to imagine themselves experiencing various significant life events and report on how they would interpret those, or have been exposed to artificial and highly simplified situations in the lab. In this work, we introduce a new task to study relationships between causal attributions and beliefs: repeatedly playing an engaging and relatively complex game of skill. We show that we can detect mutual influences between attributions and beliefs at the level of individual wins and losses. This has implications for how everyday successes and failures impact our beliefs about ourselves and our well-being. It also could help understand how our interpretations of negative experiences can spiral out of control, affecting our mental health.

Amygdala-cortical collaboration in reward learning and decision making

Adaptive reward-related decision making requires accurate prospective consideration of the specific outcome of each option and its current desirability. These mental simulations are informed by stored memories of the associative relationships that exist within an environment. In this review, I discuss recent investigations of the function of circuitry between the basolateral amygdala (BLA) and lateral (lOFC) and medial (mOFC) orbitofrontal cortex in the learning and use of associative reward memories. I draw conclusions from data collected using sophisticated behavioral approaches to diagnose the content of appetitive memory in combination with modern circuit dissection tools. I propose that, via their direct bidirectional connections, the BLA and OFC collaborate to help us encode detailed, outcome-specific, state-dependent reward memories and to use those memories to enable the predictions and inferences that support adaptive decision making. Whereas lOFC→BLA projections mediate the encoding of outcome-specific reward memories, mOFC→BLA projections regulate the ability to use these memories to inform reward pursuit decisions. BLA projections to lOFC and mOFC both contribute to using reward memories to guide decision making. The BLA→lOFC pathway mediates the ability to represent the identity of a specific predicted reward and the BLA→mOFC pathway facilitates understanding of the value of predicted events. Thus, I outline a neuronal circuit architecture for reward learning and decision making and provide new testable hypotheses as well as implications for both adaptive and maladaptive decision making.

Anhedonia in endometriosis: An unexplored symptom

Anhedonia is the diminished motivation and sensitivity to pleasurable stimuli. It has been reported to be more prevalent in patients with chronic pain as compared to healthy controls. Endometriosis is a chronic inflammatory systemic disease with a significant psychosocial impact that compromises wellbeing and the day-to-day life of patients. Women with endometriosis show significant psychological distress, even more pervasive when chronic pelvic pain is present. In the current review we will discuss the role of anhedonia in endometriotic chronic pelvic pain. We will also present new lines of research that could lead to more fully clarifying the psychological impact of endometriosis and its detrimental repercussions to quality of life and mental health.

Trajectory of aberrant reward processing in patients with bipolar disorder - A longitudinal fMRI study

BACKGROUND

Bipolar disorder (BD), and especially the mania phenotype, is characterized by heightened reward responsivity and aberrant reward processing. In this longitudinal fMRI study, we investigated neuronal response during reward anticipation as the computed expected value (EV) and outcome evaluation as reward prediction error (RPE) in recently diagnosed patients with BD.

METHODS

Eighty remitted patients with BD and 60 healthy controls (HC) underwent fMRI during which they performed a card guessing task. Of these, 41 patients and 36 HC were re-scanned after 16 months. We compared reward-related neural activity between groups at baseline and longitudinally and assessed the impact of mood relapse.

RESULTS

Patients showed lower RPE signal in areas of the ventrolateral prefrontal cortex (vlPFC) than HC. In these regions, the HC showed decrease in RPE signal over time, which was absent in patients. Patients further exhibited decreased EV signal in the occipital cortex across baseline and follow-up. Patients who remained in remission showed normalization of the EV signal at follow-up. Baseline activity in the identified regions was not associated with subsequent relapse.

LIMITATIONS

Follow-up scans were only available in a relatively small sample. Medication status, follow-up time and BD illness duration prior to diagnosis varied.

CONCLUSIONS

Lower RPE signal in the vlPFC in patients with BD at baseline and its lack of normative reduction over time may represent a trait marker of dysfunctional reward-based learning or habituation. The increase in EV signal in the occipital cortex over time in patients who remained in remission may indicate normalization of reward anticipation activity.

The human insula processes both modality-independent and pain-selective learning signals

Prediction errors (PEs) are generated when there are differences between an expected and an actual event or sensory input. The insula is a key brain region involved in pain processing, and studies have shown that the insula encodes the magnitude of an unexpected outcome (unsigned PEs). In addition to signaling this general magnitude information, PEs can give specific information on the direction of this deviation-i.e., whether an event is better or worse than expected. It is unclear whether the unsigned PE responses in the insula are selective for pain or reflective of a more general processing of aversive events irrespective of modality. It is also unknown whether the insula can process signed PEs at all. Understanding these specific mechanisms has implications for understanding how pain is processed in the brain in both health and in chronic pain conditions. In this study, 47 participants learned associations between 2 conditioned stimuli (CS) with 4 unconditioned stimuli (US; painful heat or loud sound, of one low and one high intensity each) while undergoing functional magnetic resonance imaging (fMRI) and skin conductance response (SCR) measurements. We demonstrate that activation in the anterior insula correlated with unsigned intensity PEs, irrespective of modality, indicating an unspecific aversive surprise signal. Conversely, signed intensity PE signals were modality specific, with signed PEs following pain but not sound located in the dorsal posterior insula, an area implicated in pain intensity processing. Previous studies have identified abnormal insula function and abnormal learning as potential causes of pain chronification. Our findings link these results and suggest that a misrepresentation of learning relevant PEs in the insular cortex may serve as an underlying factor in chronic pain.

GABAB receptors in prelimbic cortex and basolateral amygdala differentially influence intertemporal decision making and decline with age

The ability to decide adaptively between immediate vs. delayed gratification (intertemporal choice) is critical for well-being and is associated with a range of factors that influence quality of life. In contrast to young adults, many older adults show enhanced preference for delayed gratification; however, the neural mechanisms underlying this age difference in intertemporal choice are largely un-studied. Changes in signaling through GABA_B receptors (GABA_BRs) mediate several age-associated differences in cognitive processes linked to intertemporal choice. The current study used a rat model to determine how GABA_BRs in two brain regions known to regulate intertemporal choice (prelimbic cortex; PrL and basolateral amygdala; BLA) contribute to age differences in this form of decision making in male rats. As in humans, aged rats showed enhanced preference for large, delayed over small, immediate rewards during performance in an intertemporal choice task in operant test chambers. Activation of PrL GABA_BRs via microinfusion of the agonist baclofen increased choice of large, delayed rewards in young adult rats but did not influence choice in aged rats. Conversely, infusion of baclofen into the BLA strongly reduced choice of large, delayed rewards in both young adult and aged rats. Aged rats further showed a significant reduction in expression of GABA_BR1 subunit isoforms in the prefrontal cortex, a discovery that is consonant with the null effect of intra-PrL baclofen on intertemporal choice in aged rats. In contrast, expression of GABA_BR subunits was generally conserved with age in the BLA. Jointly, these findings elucidate a role for GABA_BRs in intertemporal choice and identify fundamental features of brain maturation and aging that mediate an improved ability to delay gratification.

Primate anterior insular cortex represents economic decision variables proposed by prospect theory

In humans, risk attitude is highly context-dependent, varying with wealth levels or for different potential outcomes, such as gains or losses. These behavioral effects have been modelled using prospect theory, with the key assumption that humans represent the value of each available option asymmetrically as a gain or loss relative to a reference point. It remains unknown how these computations are implemented at the neuronal level. Here we show that macaques, like humans, change their risk attitude across wealth levels and gain/loss contexts using a token gambling task. Neurons in the anterior insular cortex (AIC) encode the ‘reference point’ (i.e., the current wealth level of the monkey) and reflect ‘loss aversion’ (i.e., option value signals are more sensitive to change in the loss than in the gain context) as postulated by prospect theory. In addition, changes in the activity of a subgroup of AIC neurons correlate with the inter-trial fluctuations in choice and risk attitude. Taken together, we show that the primate AIC in risky decision-making may be involved in monitoring contextual information used to guide the animal’s willingness to accept risk.

Prospect theory predicts irrational effects in human decision-making, but relies on ad-hoc assumptions. Here, authors provide a neural basis for this by showing that anterior insular cortex encodes key economic variables proposed by prospect theory.

Is depression associated with reduced optimistic belief updating?

When asked to evaluate their probability of experiencing a negative life event, healthy individuals update their beliefs more following good news than bad. This is referred to as optimistic belief updating. By contrast, individuals with depression update their beliefs by a similar amount, showing reduced optimism. We conducted the first independent replication of this effect and extended this work to examine whether reduced optimistic belief updating in depression also occurs for positive life events. Replicating previous research, healthy and depression groups differed in belief updating for negative events (β = 0.71, 95% CI: 0.24, 1.18). Whereas healthy participants updated their beliefs more following good news than bad, individuals experiencing depression lacked this bias. However, our findings for positive events were inconclusive. While we did not find statistical evidence that patterns of belief updating between groups varied by valence (β = -0.51, 95% CI: -1.16, 0.15), mean update scores suggested that both groups showed largely similar updating for positive life events. Our results add confidence to previous findings that depression is characterized by negative future expectations maintained by reduced updating in response to good news. However, further research is required to understand the specificity of this to negative events, and into refining methods for quantifying belief updating in clinical and non-clinical research.

Diverse risk-avoidance behaviors in DISC1 mice are associated with different neuronal firing patterns in BLA neurons

It is very important to maintain normal levels of risk avoidance in daily life. We found that DISC1-N^TM mice, which are a model for mental disorders, had a phenotype marked by a risk-avoidance impairment as measured in an open-field test (OFT). We used optogenetic methods to modulate glutamatergic neurons in the basolateral amygdala (BLA) in an attempt to rescue this risk-avoidance impairment. We found that photostimulation of BLA neurons at 20 Hz modified DISC1-N^TM mouse behavior from low risk avoidance to high risk avoidance. We observed following photostimulation that, compared to controls, the number of entries to the center of the open field was lower and less time was spent in the central area. We also found that the time spent immobile was higher during photostimulation compared with WT mice. We also used a lower photostimulation frequency of 5 Hz, which activated BLA glutamatergic neurons and rescued the risk-avoidance impairment in DISC1-N^TM mice. Our findings confirm that the BLA participates in diverse risk-avoidance behavior. Our results are also a reminder that differences in neuronal firing patterns within the same pathway may lead to different physiological functions.

Characterizing reward system neural trajectories from adolescence to young adulthood

Mixed findings exist in studies comparing brain responses to reward in adolescents and adults. Here we examined the trajectories of brain response, functional connectivity and task-modulated network properties during reward processing with a large-sample longitudinal design. Participants from the IMAGEN study performed a Monetary Incentive Delay task during fMRI at timepoint 1 (T1; n = 1304, mean age=14.44 years old) and timepoint 2 (T2; n = 1241, mean age=19.09 years). The Alcohol Use Disorders Identification Test (AUDIT) was administrated at both T1 and T2 to assess a participant’s alcohol use during the past year. Voxel-wise linear mixed effect models were used to compare whole brain response as well as functional connectivity of the ventral striatum (VS) during reward anticipation (large reward vs no-reward cue) between T1 and T2. In addition, task-modulated networks were constructed using generalized psychophysiological interaction analysis and summarized with graph theory metrics. To explore alcohol use in relation to development, participants with no/low alcohol use at T1 but increased alcohol use to hazardous use level at T2 (i.e., participants with AUDIT≤2 at T1 and ≥8 at T2) were compared against those with consistently low scores (i.e., participants with AUDIT≤2 at T1 and ≤7 at T2). Across the whole sample, lower brain response during reward anticipation was observed at T2 compared with T1 in bilateral caudate nucleus, VS, thalamus, midbrain, dorsal anterior cingulate as well as left precentral and postcentral gyrus. Conversely, greater response was observed bilaterally in the inferior and middle frontal gyrus and right precentral and postcentral gyrus at T2 (vs. T1). Increased functional connectivity with VS was found in frontal, temporal, parietal and occipital regions at T2. Graph theory metrics of the task-modulated network showed higher inter-regional connectivity and topological efficiency at T2. Interactive effects between time (T1 vs. T2) and alcohol use group (low vs. high) on the functional connectivity were observed between left middle temporal gyrus and right VS and the characteristic shortest path length of the task-modulated networks. Collectively, these results demonstrate the utility of the MID task as a probe of typical brain response and network properties during development and of differences in these features related to adolescent drinking, a reward-related behaviour associated with heightened risk for future negative health outcomes.

•

Imaging data during reward anticipation at T1 (age 14) and T2 (age 19) was compared.

•

Brain response decreased in subcortical areas and increased in cortical areas at T2.

•

Functional connectivity (FC) with the ventral striatum increased at T2.

•

Topological efficiency of task-modulated network increased at T2.

•

The developmental pattern was altered in those who increased drinking most at T2.

A Revised Framework for the Investigation of Expectation Update Versus Maintenance in the Context of Expectation Violations: The ViolEx 2.0 Model

Expectations are probabilistic beliefs about the future that shape and influence our perception, affect, cognition, and behavior in many contexts. This makes expectations a highly relevant concept across basic and applied psychological disciplines. When expectations are confirmed or violated, individuals can respond by either updating or maintaining their prior expectations in light of the new evidence. Moreover, proactive and reactive behavior can change the probability with which individuals encounter expectation confirmations or violations. The investigation of predictors and mechanisms underlying expectation update and maintenance has been approached from many research perspectives. However, in many instances there has been little exchange between different research fields. To further advance research on expectations and expectation violations, collaborative efforts across different disciplines in psychology, cognitive (neuro)science, and other life sciences are warranted. For fostering and facilitating such efforts, we introduce the ViolEx 2.0 model, a revised framework for interdisciplinary research on cognitive and behavioral mechanisms of expectation update and maintenance in the context of expectation violations. To support different goals and stages in interdisciplinary exchange, the ViolEx 2.0 model features three model levels with varying degrees of specificity in order to address questions about the research synopsis, central concepts, or functional processes and relationships, respectively. The framework can be applied to different research fields and has high potential for guiding collaborative research efforts in expectation research.

Multi-band FMRI compromises detection of mesolimbic reward responses

Recent innovations in Functional Magnetic Resonance Imaging (FMRI) have sped data collection by enabling simultaneous scans of neural activity in multiple brain locations, but have these innovations come at a cost? In a meta-analysis and preregistered direct comparison of original data, we examined whether acquiring FMRI data with multi-band versus single-band scanning protocols might compromise detection of mesolimbic activity during reward processing. Meta-analytic results (n = 44 studies; cumulative n = 5005 subjects) indicated that relative to single-band scans, multi-band scans showed significantly decreased effect sizes for reward anticipation in the Nucleus Accumbens (NAcc) by more than half. Direct within-subject comparison of single-band versus multi-band scanning data (multi-band factors = 4 and 8; n = 12 subjects) acquired during repeated administration of the Monetary Incentive Delay task indicated that reductions in temporal signal-to-noise ratio could account for compromised detection of task-related responses in mesolimbic regions (i.e., the NAcc). Together, these findings imply that researchers should opt for single-band over multi-band scanning protocols when probing mesolimbic responses with FMRI. The findings also have implications for inferring mesolimbic activity during related tasks and rest, for summarizing historical results, and for using neuroimaging data to track individual differences in reward-related brain activity.

Motivational Salience Guides Attention to Valuable and Threatening Stimuli: Evidence from Behavior and Functional Magnetic Resonance Imaging

Rewarding and aversive outcomes have opposing effects on behavior, facilitating approach and avoidance, although we need to accurately anticipate each type of outcome to behave effectively. Attention is biased toward stimuli that have been learned to predict either type of outcome, and it remains an open question whether such orienting is driven by separate systems for value- and threat-based orienting or whether there exists a common underlying mechanism of attentional control driven by motivational salience. Here, we provide a direct comparison of the neural correlates of value- and threat-based attentional capture after associative learning. Across multiple measures of behavior and brain activation, our findings overwhelmingly support a motivational salience account of the control of attention. We conclude that there exists a core mechanism of experience-dependent attentional control driven by motivational salience and that prior characterizations of attention as being value driven or supporting threat monitoring need to be revisited.

Effective connectivity underlying reward-based executive control

Motivational influences on cognitive control play an important role in shaping human behavior. Cognitive facilitation through motivators such as prospective reward or punishment is thought to depend on regions from the dopaminergic mesocortical network, primarily the ventral tegmental area (VTA), inferior frontal junction (IFJ), and anterior cingulate cortex (ACC). However, how interactions between these regions relate to motivated control remains elusive. In the present functional magnetic resonance imaging study, we used dynamic causal modeling (DCM) to investigate effective connectivity between left IFJ, ACC, and VTA in a task-switching paradigm comprising three distinct motivational conditions (prospective monetary reward or punishment and a control condition). We found that while prospective punishment significantly facilitated switching between tasks on a behavioral level, interactions between IFJ, ACC, and VTA were characterized by modulations through prospective reward but not punishment. Our DCM results show that IFJ and VTA modulate ACC activity in parallel rather than by interaction to serve task demands in reward-based cognitive control. Our findings further demonstrate that prospective reward and punishment differentially affect neural control mechanisms to initiate decision-making.

Generating Options and Choosing Between Them Depend on Distinct Forms of Value Representation

Humans have a remarkable capacity for flexible decision-making, deliberating among actions by modeling their likely outcomes. This capacity allows us to adapt to the specific features of diverse circumstances. In real-world decision-making, however, people face an important challenge: There are often an enormous number of possibilities to choose among, far too many for exhaustive consideration. There is a crucial, understudied prechoice step in which, among myriad possibilities, a few good candidates come quickly to mind. How do people accomplish this? We show across nine experiments (N = 3,972 U.S. residents) that people use computationally frugal cached value estimates to propose a few candidate actions on the basis of their success in past contexts (even when irrelevant for the current context). Deliberative planning is then deployed just within this set, allowing people to compute more accurate values on the basis of context-specific criteria. This hybrid architecture illuminates how typically valuable thoughts come quickly to mind during decision-making.

Neural Responsivity to Reward versus Punishment Shortly after Trauma Predicts Long-term Development of Post-Traumatic Stress Symptoms

BACKGROUND

Processing negative and positive valenced stimuli involve multiple brain regions including the amygdala and ventral striatum (VS). Post-Traumatic Stress Disorder (PTSD) is often associated with hyper-responsivity to negatively valenced, yet recent evidence also points to deficient positive valence functioning. It is yet unclear what is the relative contribution of such opposing valence processing shortly after trauma to the development of chronic PTSD.

METHODS

Neurobehavioral indicators of motivational positive vs. negative valence sensitivities were longitudinally assessed in 171 adults (87 females, age=34.19±11.47 years) at 1-, 6-, and 14-months following trauma exposure (TP1, TP2, TP3). Using a gambling fMRI paradigm, amygdala and VS functionality (activity and functional connectivity with the prefrontal cortex) in response to rewards vs. punishments were assessed with relation to PTSD severity at different time-points. The effect of valence processing was depicted behaviorally by the amount of risk taken to maximize reward.

RESULTS

PTSD severity at TP1 was associated with greater neural functionality in the amygdala (but not the VS) towards punishments vs. rewards, and fewer risky choices. PTSD severity at TP3 was associated with decreased neural functionality in both the VS and amygdala towards rewards vs. punishments at TP1 (but not with risky behavior). Explainable machine learning revealed the primacy of VS biased processing, over the amygdala, in predicting PTSD severity at TP3.

CONCLUSIONS

These results highlight the importance of biased neural responsivity to positive relative to negative motivational outcomes in PTSD development. Novel therapeutic strategies early after trauma may thus target both valence fronts.

Reduced frontostriatal response to expected value and reward prediction error in remitted monozygotic twins with mood disorders and their unaffected high-risk co-twins

BACKGROUND

Depressive episodes experienced in unipolar (UD) and bipolar (BD) disorders are characterized by anhedonia and have been associated with abnormalities in reward processes related to reward valuation and error prediction. It remains however unclear whether these deficits are associated with familial vulnerability to mood disorders.

METHODS

In a functional magnetic resonance imaging study, we evaluated differences in the expected value (EV) and reward prediction error (RPE) signals in ventral striatum (VS) and prefrontal cortex between three groups of monozygotic twins: affected twins in remission for either UD or BD (n = 53), their high-risk unaffected co-twins (n = 34), and low-risk twins with no family history of mood disorders (n = 25).

RESULTS

Compared to low-risk twins, affected twins showed lower EV signal bilaterally in the frontal poles and lower RPE signal bilaterally in the VS, left frontal pole and superior frontal gyrus. The high-risk group did not show a significant change in the EV or RPE signals in frontostriatal regions, yet both reward signals were consistently lower compared with low-risk twins in all regions where the affected twins showed significant reductions.

CONCLUSION

Our findings strengthen the notion that reduced valuation of expected rewards and reduced error-dependent reward learning may underpin core symptom of depression such as loss of interest in rewarding activities. The trend reduction in reward-related signals in unaffected co-twins warrants further investigation of this effect in larger samples and prospective follow-up to confirm possible association with increased familial vulnerability to mood disorders.

The golden age of social science

Social science is entering a golden age, marked by the confluence of explosive growth in new data and analytic methods, interdisciplinary approaches, and a recognition that these ingredients are necessary to solve the more challenging problems facing our world. We discuss how developing a "lingua franca" can encourage more interdisciplinary research, providing two case studies (social networks and behavioral economics) to illustrate this theme. Several exemplar studies from the past 12 y are also provided. We conclude by addressing the challenges that accompany these positive trends, such as career incentives and the search for unifying frameworks, and associated best practices that can be employed in response.

Anatomical dissociation of intracerebral signals for reward and punishment prediction errors in humans

Whether maximizing rewards and minimizing punishments rely on distinct brain systems remains debated, given inconsistent results coming from human neuroimaging and animal electrophysiology studies. Bridging the gap across techniques, we recorded intracerebral activity from twenty participants while they performed an instrumental learning task. We found that both reward and punishment prediction errors (PE), estimated from computational modeling of choice behavior, correlate positively with broadband gamma activity (BGA) in several brain regions. In all cases, BGA scaled positively with the outcome (reward or punishment versus nothing) and negatively with the expectation (predictability of reward or punishment). However, reward PE were better signaled in some regions (such as the ventromedial prefrontal and lateral orbitofrontal cortex), and punishment PE in other regions (such as the anterior insula and dorsolateral prefrontal cortex). These regions might therefore belong to brain systems that differentially contribute to the repetition of rewarded choices and the avoidance of punished choices.

Whether maximizing rewards and minimizing punishments rely on distinct brain learning systems remains debated. Here, using intracerebral recordings in humans, the authors provide evidence for brain regions differentially engaged in signaling reward and punishment prediction errors that prescribe repetition versus avoidance of past choices.

Punishment-modulated attentional capture is context specific

Attention prioritizes stimuli previously associated with punishment. Despite the importance of this process for survival and adaptation, the potential generalization of punishment-related attentional biases has been largely ignored in the literature. This study aimed to determine whether stimulus-punishment associations learned in a specific context bias attention in another context (in which the stimulus was never paired with punishment). We examined this issue using an antisaccade task in which participants had to shift their gaze in the opposite direction of a colored square during stimulus-outcome learning. Two contexts and three colors were employed. One color was associated with punishment (i.e., electrical shock) in one context and never paired with punishment in the other context. For a second color, the punishment-context relationship was reversed. A third color never paired with shock in either context (neutral) was included in Experiment 1 but absent in Experiment 2. Participants then performed search for a shape-defined target in an extinction phase (in which no shock was delivered) in which attentional bias for the colors was assessed. Context was manipulated via the background image upon which the stimuli were presented. In each of the two experiments, a bias to selectively orient toward the color that had been associated with punishment in the current context was observed, suggesting that punishment-modulated attentional priority is context specific.

Reward Processing and Circuit Dysregulation in Posttraumatic Stress Disorder

Past decades have witnessed substantial progress in understanding of neurobiological mechanisms that contribute to generation of various PTSD symptoms, including intrusive memories, physiological arousal and avoidance of trauma reminders. However, the neurobiology of anhedonia and emotional numbing in PTSD, that have been conceptualized as reward processing deficits - reward wanting (anticipation of reward) and reward liking (satisfaction with reward outcome), respectively, remains largely unexplored. Empirical evidence on reward processing in PTSD is rather limited, and no studies have examined association of reward processing abnormalities and neurocircuitry-based models of PTSD pathophysiology. The manuscript briefly summarizes "state of the science" of both human reward processing, and of PTSD implicated neurocircuitry, as well as empirical evidence of reward processing deficits in PTSD. We then summarize current gaps in the literature and outline key future directions, further illustrating it by the example of two alternative explanations of PTSD pathophysiology potentially affecting reward processing via different neurobiological pathways. Studying reward processing in PTSD will not only advance the understanding of their link, but also could enhance current treatment approaches by specifically targeting anhedonia and emotional symptoms in PTSD patients.

Dissociating brain systems that respond to contingency and valence during monetary loss avoidance in adolescence

Negative reinforcement processes allow individuals to avoid negative and/or harmful outcomes. They depend on the brain's ability to differentiate; (i) contingency from non-contingency, separately from (ii) judgements about positive and negative valence. Thirty-three males (8-18 years) performed a cued reaction-time task during fMRI scanning to differentiate the brain's responses to contingency and valence during loss avoidance. In two conditions, cues indicated no -contingency between participants' responses and monetary loss - (1) CERTAIN LOSS (negative valence) of €0.20, €1 or €5 or (2) CERTAIN LOSS AVOIDANCE (positive valence). In a third condition, cues indicated a contingency between short reaction times and avoidance of monetary loss. As expected participants had shorter reaction times in this latter condition where CONDITIONAL LOSS AVOIDANCE cues activated salience and motor-response-preparation brain networks - independent of the relative valence of the contrast (CERTAIN LOSS or CERTAIN LOSS AVOIDANCE). Effects of valence were seen toward the session's end where CERTAIN LOSS AVOIDANCE cues activated ventral striatum, medial-orbitofrontal cortex and medial-temporal areas more than CERTAIN LOSS. CONDITIONAL LOSS AVOIDANCE trials with feedback indicating "success" activated ventral striatum more than "failure feedback". The findings support the hypothesis that brain networks controlling contingency and valence processes during negative reinforcement are dissociable.

Associations with monetary values do not influence access to awareness for faces

Human faces can convey socially relevant information in various ways. Since the early detection of such information is crucial in social contexts, socially meaningful information might also have privileged access to awareness. This is indeed suggested by previous research using faces with emotional expressions. However, the social relevance of emotional faces is confounded with their physical stimulus characteristics. Here, we sought to overcome this problem by manipulating the relevance of face stimuli through classical conditioning: Participants had to learn the association between different face exemplars and high or low amounts of positive and negative monetary outcomes. Before and after the conditioning procedure, the time these faces needed to enter awareness was probed using continuous flash suppression, a variant of binocular rivalry. While participants successfully learned the association between the face stimuli and the respective monetary outcomes, faces with a high monetary value did not enter visual awareness faster than faces with a low monetary value after conditioning, neither for rewarding nor for aversive outcomes. Our results tentatively suggest that behaviorally relevant faces do not have privileged access to awareness when the assessment of the faces' relevance is dependent on the processing of face identity, as this requires complex stimulus processing that is likely limited at pre-conscious stages.

Disruption of Nrxn1α within excitatory forebrain circuits drives value-based dysfunction

Goal-directed behaviors are essential for normal function and significantly impaired in neuropsychiatric disorders. Despite extensive associations between genetic mutations and these disorders, the molecular contributions to goal-directed dysfunction remain unclear. We examined mice with constitutive and brain region-specific mutations in Neurexin1α, a neuropsychiatric disease-associated synaptic molecule, in value-based choice paradigms. We found Neurexin1α knockouts exhibited reduced selection of beneficial outcomes and impaired avoidance of costlier options. Reinforcement modeling suggested that this was driven by deficits in updating and representation of value. Disruption of Neurexin1α within telencephalic excitatory projection neurons, but not thalamic neurons, recapitulated choice abnormalities of global Neurexin1α knockouts. Furthermore, this selective forebrain excitatory knockout of Neurexin1α perturbed value-modulated neural signals within striatum, a central node in feedback-based reinforcement learning. By relating deficits in value-based decision-making to region-specific Nrxn1α disruption and changes in value-modulated neural activity, we reveal potential neural substrates for the pathophysiology of neuropsychiatric disease-associated cognitive dysfunction.

Abnormal prefrontal cortex processing of reward prediction errors in recently diagnosed patients with bipolar disorder and their unaffected relatives

OBJECTIVE

Bipolar disorder (BD) has been associated with abnormal reward functioning including pleasure-seeking and impulsivity. Here we sought to clarify whether these changes can be attributed to abnormalities in the neural processing of reward valuation or error prediction. Moreover, we tested whether abnormalities in these processes are associated with familial vulnerability to BD.

METHODS

We obtained functional magnetic resonance imaging data from patients with recently diagnosed BD (n = 85), their unaffected first-degree relatives (n = 44), and healthy control participants (n = 66) while they were performing a monetary card game. We used a region-of-interest approach to test for group differences in the activation of the midbrain, the ventral striatum, and the prefrontal cortex during reward valuation and error prediction.

RESULTS

Patients with BD showed decreased prediction error signal in ventrolateral prefrontal cortex and the unaffected relatives showed decreased prediction error signal in the supplementary motor area in comparison to healthy controls. There were no significant group differences in the activation of the ventral striatum during the task. In healthy controls, prediction error signal in dorsal anterior cingulate cortex correlated with an out-of-scanner measure of motor inhibition but this association was absent in patients and relatives.

CONCLUSIONS

The findings indicate that abnormal reward processing in BD is primarily related to deficits in the engagement of prefrontal regions involved in inhibitory control during error prediction. In contrast, deficient activation in supplementary motor cortex involved in planning of movement emerged as a familial vulnerability to BD.

Distinct regions of the striatum underlying effort, movement initiation and effort discounting

The ventral striatum is believed to encode the subjective value of cost-benefit options; however, this effect has notably been absent during choices that involve physical effort. Previous work in freely moving animals has revealed opposing striatal signals, with greater response to increasing effort demands and reduced responses to rewards requiring effort. Yet, the relationship between these conflicting signals remains unknown. Using functional magnetic resonance imaging with a naturalistic maze-navigation paradigm, we identified functionally segregated regions within the ventral striatum that separately encoded effort activation, movement initiation and effort discounting of rewards. In addition, activity in regions associated with effort activation and discounting oppositely predicted striatal encoding of effort during effort-based decision-making. Our results suggest that the dorsomedial region hitherto associated with action may instead represent the cost of effort and raise fundamental questions regarding the interpretation of striatal 'reward' signals in the context of effort demands. This has implications for uncovering the neural architecture underlying motivated behaviour.

The role of the vestibular system in value attribution to positive and negative reinforcers

Somatic inputs originating from bioregulatory processes can guide cognition and behavior. One such bodily signal, mostly overlooked so far, is represented by visuo-vestibular coupling and its alteration, which in extreme cases may result in motion sickness. We argued that the inherently perturbed interoceptive state that follows can be a powerful determinant of human motivated behavior, resulting in a blunted response to appetitive stimuli and an exaggerated response to noxious ones. We sought to assess such differential impact of visuo-vestibular mismatches on value through a task involving conflict monitoring. We therefore administered to 42 healthy participants a modified version of the Flankers task, in which distractors (arrows, pointing in either a congruent or incongruent direction) signaled the availability of monetary incentives (gains, losses, or neutral trials). While performing the task, participants received either galvanic vestibular stimulation (GVS), or sham stimulation. We have found impaired behavioral performances when value, which was attached to task-irrelevant information, was at stake. Gains and losses, interestingly, dissociated, and only the latter caused enhanced interference costs in the task, suggesting that negative incentives may be more effective in capturing human attention than positive ones. Finally, we have found some weak evidence for GVS to further increase the processing of losses, as suggested by even larger interference costs in this condition. Results were, however, overall ambiguous, and suggest that much more research is needed to better understand the link between the vestibular system and motivation.

Ventral Caudate and Anterior Insula Recruitment During Value Estimation of Passionate Rewarding Cues

“Wanting”, a component of reward processing, is a motivational property that guides decision making in goal-oriented behavior. This includes behavior aiming at supporting relational bonds, even at the group level. Accordingly, group belongingness works as this motivational property, which is fundamentally different from romantic or maternal love. While primary rewards (or learned associations, such as money) have been largely used to study the conceptual framework associated with “wanting,” other cues triggering behavior, such as passionate motives, are less well-studied. We investigated the neural correlates of value estimation of a passion-driven incentive in neuropsychologically defined football fans. We asked the participants (n = 57) to compute the value of football tickets (the cues that trigger passionate behavior in this “tribal love” context). The trials were all different, comprising tickets for different matches. The participants had no restrictions on the amount to be introduced. This enabled a parametric functional magnetic resonance imaging design based on the explicit estimated value given by the participants in a trial-by-trial approach. Using a whole-brain approach (to prevent biased focus on value-related regions), only the activity in the ventral caudate and left anterior insula showed a critical relationship with the reported value. Higher normalized values led to more activity in the striatum and left insula. The parametric map shows that these regions encode the magnitude of incentive by indexing self-relevant value. Other regions were involved in value computation, such as the ventromedial prefrontal cortex, lateral orbitofrontal cortex, and dorsolateral prefrontal cortex, but did not exhibit parametric patterns. The involvement of the nucleus accumbens in value estimation was only found in region of interest -based analysis, which emphasizes the role of the ventral caudate for the presently studied social “reinforcer” cue.

The effect of concurrent reward on aversive information processing in the brain

Neural networks for the processing of appetitive and aversive information, in isolation, have been well characterized. However, how the brain integrates competing signals associated with simultaneous appetitive and aversive information is less clear. In particular, it is unknown how the presence of concurrent reward modulates the processing of an aversive event throughout the brain. Here, we utilized a four-armed bandit task in an fMRI study to measure the representation of an aversive electric shock with and without the simultaneous receipt of monetary reward. Using a region of interest (ROI) approach, we first identified regions activated by the experience of aversive electric shock, and then measured how this shock-related activation is modulated by concurrent reward using independent data. Informed by prior literature and our own preliminary data, analyses focused on the dorsolateral prefrontal cortex, anterior and posterior insula, anterior cingulate cortex, and the thalamus and somatosensory cortex. We hypothesized that the neural response to punishment in these ROIs would be attenuated by the presence of concurrent reward. However, we found no evidence of concurrent reward attenuating the neural response to punishment in any ROI and also no evidence of concurrent punishment attenuating the neural response to reward in exploratory analyses. Altogether, our findings are consistent with the idea that neural networks responsible for the processing of reward and punishment signals are largely independent of one another, and that representations of overall value or utility are arrived at through the integration of separate reward and punishment signals at later stages of information processing.

Event-Related Potentials (ERP) Indices of Motivation during the Effort Expenditure for Reward Task

Dynamic and temporal facets of the various constructs that comprise motivation remain to be explored. Here, we adapted the Effort Expenditure for Reward Task, a well-known laboratory task used to evaluate motivation, to study the event-related potentials associated with reward processing. The Stimulus Preceding Negativity (SPN) and the P300 were utilized as motivation indicators with high density electroencephalography. The SPN was found to be more negative for difficult choices compared to easy choices, suggesting a greater level of motivation, at a neurophysiological level. The insula, a structure previously associated with both effort discounting and prediction error, was concomitantly activated during the generation of the SPN. Processing a gain significantly altered the amplitude of the P300 compared to an absence of gain, particularly on centroparietal electrodes. One of the generators of the P300 was located on the vmPFC, a cerebral structure involved in the choice between two positive results and their predictions, during loss processing. Both the SPN and the P300 appear to be reliable neural markers of motivation. We postulate that the SPN represents the strength of the motivational level, while the P300 represents the impact of motivation on updating memories of the feedback.

Neurocognitive Underpinnings of Aggressive Predation in Economic Contests

Competitions are part and parcel of daily life and require people to invest time and energy to gain advantage over others and to avoid (the risk of) falling behind. Whereas the behavioral mechanisms underlying competition are well documented, its neurocognitive underpinnings remain poorly understood. We addressed this using neuroimaging and computational modeling of individual investment decisions aimed at exploiting one's counterpart ("attack") or at protecting against exploitation by one's counterpart ("defense"). Analyses revealed that during attack relative to defense (i) individuals invest less and are less successful; (ii) computations of expected reward are strategically more sophisticated (reasoning level k = 4 vs. k = 3 during defense); (iii) ventral striatum activity tracks reward prediction errors; (iv) risk prediction errors were not correlated with neural activity in either ROI or whole-brain analyses; and (v) successful exploitation correlated with neural activity in the bilateral ventral striatum, left OFC, left anterior insula, left TPJ, and lateral occipital cortex. We conclude that, in economic contests, coming out ahead (vs. not falling behind) involves sophisticated strategic reasoning that engages both reward and value computation areas and areas associated with theory of mind.