Neurocomputational mechanisms involved in adaptation to fluctuating intentions of others

Humans frequently interact with agents whose intentions can fluctuate between competition and cooperation over time. It is unclear how the brain adapts to fluctuating intentions of others when the nature of the interactions (to cooperate or compete) is not explicitly and truthfully signaled. Here, we use model-based fMRI and a task in which participants thought they were playing with another player. In fact, they played with an algorithm that alternated without signaling between cooperative and competitive strategies. We show that a neurocomputational mechanism with arbitration between competitive and cooperative experts outperforms other learning models in predicting choice behavior. At the brain level, the fMRI results show that the ventral striatum and ventromedial prefrontal cortex track the difference of reliability between these experts. When attributing competitive intentions, we find increased coupling between these regions and a network that distinguishes prediction errors related to competition and cooperation. These findings provide a neurocomputational account of how the brain arbitrates dynamically between cooperative and competitive intentions when making adaptive social decisions.

Transcranial direct current stimulation suggests a causal role of the medial prefrontal cortex in learning social hierarchy

Social hierarchies can be inferred through observational learning of social relationships between individuals. Yet, little is known about the causal role of specific brain regions in learning hierarchies. Here, using transcranial direct current stimulation, we show a causal role of the medial prefrontal cortex (mPFC) in learning social versus non-social hierarchies. In a Training phase, participants acquired knowledge about social and non-social hierarchies by trial and error. During a Test phase, they were presented with two items from hierarchies that were never encountered together, requiring them to make transitive inferences. Anodal stimulation over mPFC impaired social compared with non-social hierarchy learning, and this modulation was influenced by the relative social rank of the members (higher or lower status). Anodal stimulation also impaired transitive inference making, but only during early blocks before learning was established. Together, these findings demonstrate a causal role of the mPFC in learning social ranks by observation.

Toddlers' sensitivity to dominance traits from faces

In adults, seeing individual faces is sufficient to trigger dominance evaluations, even when conflict is absent. From early on, infants represent dyadic dominance relations and they can infer conflict outcomes based on a variety of cues. To date, it is unclear if toddlers also make automatic dominance trait evaluations of individual faces. Here we asked if toddlers are sensitive to dominance traits from faces, and whether their sensitivity depends on their face experience. We employed a visual preference paradigm to study 18- and 24-month-old toddlers' sensitivity to dominance traits from three types of faces: artificial, male, female. When presented with artificial faces (Experiment 1), 18- and 24-month-olds attended longer to the non-dominant faces, but only when they were in upright orientation. For real male faces (Experiment 2), toddlers showed equivalent looking durations to the dominant and non-dominant upright faces. However, when looking at female faces (Experiment 3), toddlers displayed a visual preference for the upright non-dominant faces at 24 months. To our knowledge, this is the first study to show that toddlers already display sensitivity to facial cues of dominance from 18 months of age, at least for artificial face stimuli.

Strengths of social ties modulate brain computations for third-party punishment

Costly punishment of social norm transgressors by third-parties has been considered as a decisive stage in the evolution of human cooperation. An important facet of social relationship knowledge concerns the strength of the social ties between individuals, as measured by social distance. Yet, it is unclear how the enforcement of social norms is influenced by the social distance between a third-party and a norm violator at the behavioral and the brain system levels. Here, we investigated how social distance between punishers and norm-violators influences third-party punishment. Participants as third-party punished norm violators more severely as social distance between them increased. Using model-based fMRI, we disentangled key computations contributing to third-party punishment: inequity aversion, social distance between participant and norm violator and integration of the cost to punish with these signals. Inequity aversion increased activity in the anterior cingulate cortex and bilateral insula, and processing social distance engaged a bilateral fronto-parietal cortex brain network. These two brain signals and the cost to punish were integrated in a subjective value signal of sanctions that modulated activity in the ventromedial prefrontal cortex. Together, our results reveal the neurocomputational underpinnings of third-party punishment and how social distance modulates enforcement of social norms in humans.

Spillover effects of competition outcome on future risky cooperation

There is growing evidence that risky cooperation is regulated by the experience of previous interactions with others. However, it is unclear how the evaluation of outcomes from competitive interactions can affect individuals' subsequent cooperative behavior. To address this issue, we examined how participants cooperated with a partner having just competed with them. While competing, participants (N = 164) were randomly assigned to receive one of four types of outcome feedback regarding their performance (victory vs. defeat vs. uncertain vs. no competition (control)). We found that both the experience of defeats and of uncertainty as competitive outcomes exerted a negative impact on the extent to which participants then engaged in cooperative behavior with their recent opponents. This only occurred when such subsequent cooperative behavior involved a high potential for incurring personal costs but not when there was no risk of incurring personal costs and a positive return. Finally, mediation analysis revealed that the effect of defeat was mediated by participants' level of interpersonal trust and the extent to which participants were willing to cooperate, while the effect of the uncertain competitive outcome was mediated only by the extent to which participants were willing to cooperate. These findings offer novel insights into how risky cooperation is modulated by previous competition.

Relationships between serotonin availability and frontolimbic response to fearful and threatening faces

Serotonin is a critical neurotransmitter in the regulation of emotional behavior. Although emotion processing is known to engage a corticolimbic circuit, including the amygdala and prefrontal cortex, exactly how this brain system is modulated by serotonin remains unclear. Here, we hypothesized that serotonin modulates variability in excitability and functional connectivity within this circuit. We tested whether this modulation contributes to inter-individual differences in emotion processing. Using a multimodal neuroimaging approach with a simultaneous PET-3T fMRI scanner, we simultaneously acquired BOLD signal while participants viewed emotional faces depicting fear and anger, while also measuring serotonin transporter (SERT) levels, regulating serotonin functions. Individuals with higher activity of the medial amygdala BOLD in response to fearful or angry facial expressions, who were temperamentally more anxious, also exhibited lower SERT availability in the dorsal raphe nucleus (DRN). Moreover, higher connectivity of the medial amygdala with the left dorsolateral prefrontal and the anterior cingulate cortex was associated with lower levels of SERT availability in the DRN. These results demonstrate the association between the serotonin transporter level and emotion processing through changes in functional interactions between the amygdala and the prefrontal areas in healthy humans.

Cross-cultural study of kinship premium and social discounting of generosity

Social discounting predicts that one's concern for others decreases with increasing social distance. Cultural dimensions may influence this social behavior. Here, we used a dictator game, in which the participants and real members of their social entourage profited from the partition of the endowments determined by the participant, to compare how Chinese and French university students shared endowments with people at different social distances. We tested two hypotheses based on the concepts of kinship premium and cultural collectivism. Stronger ties between close family members were expected among Chinese. This may predict a larger "kinship premium," i.e., increased generosity to family members at close social distances, in Chinese relative to French participants. Similarly, because collectivism is thought to be stronger in Asian than western societies, greater generosity at larger social distances might also be expected among Chinese participants. The results showed that Chinese were more generous than French at close social distances but discounted more as social distance increased. This difference between French and Chinese was confined to family members and no significant difference in generosity was observed between French and Chinese for non-family members at any social distance. Our findings evidence a stronger kinship premium among Chinese than French students, and no significant effect of cultural collectivism.

Regulation of social hierarchy learning by serotonin transporter availability

Learning one's status in a group is a fundamental process in building social hierarchies. Although animal studies suggest that serotonin (5-HT) signaling modulates learning social hierarchies, direct evidence in humans is lacking. Here we determined the relationship between serotonin transporter (SERT) availability and brain systems engaged in learning social ranks combining computational approaches with simultaneous PET-fMRI acquisition in healthy males. We also investigated the link between SERT availability and brain activity in a non-social control condition involving learning the payoffs of slot machines. Learning social ranks was modulated by the dorsal raphe nucleus (DRN) 5-HT function. BOLD ventral striatal response, tracking the rank of opponents, decreased with DRN SERT levels. Moreover, this link was specific to the social learning task. These findings demonstrate that 5-HT plays an influence on the computations required to learn social ranks.

Perturbation of Right Dorsolateral Prefrontal Cortex Makes Power Holders Less Resistant to Tempting Bribes

Bribery is a common form of corruption that takes place when a briber suborns a power holder to achieve an advantageous outcome at the cost of moral transgression. Although bribery has been extensively investigated in the behavioral sciences, its underlying neurobiological basis remains poorly understood. Here, we employed transcranial direct-current stimulation (tDCS) in combination with a novel paradigm (N = 119 adults) to investigate whether disruption of right dorsolateral prefrontal cortex (rDLPFC) causally changed bribe-taking decisions of power holders. Perturbing rDLPFC via tDCS specifically made participants more willing to take bribes as the relative value of the offer increased. This tDCS-induced effect could not be explained by changes in other measures. Model-based analyses further revealed that such neural modulation alters the concern for generating profits for oneself via taking bribes and reshapes the concern for the distribution inequity between oneself and the briber, thereby influencing the subsequent decisions. These findings reveal a causal role of rDLPFC in modulating corrupt behavior.

Neural basis of corruption in power-holders

Corruption often involves bribery, when a briber suborns a power-holder to gain advantages usually at a cost of moral transgression. Despite its wide presence in human societies, the neurocomputational basis of bribery remains elusive. Here, using model-based fMRI, we investigated the neural substrates of how a power-holder decides to accept or reject a bribe. Power-holders considered two types of moral cost brought by taking bribes: the cost of conniving with a fraudulent briber, encoded in the anterior insula, and the harm brought to a third party, represented in the right temporoparietal junction. These moral costs were integrated into a value signal in the ventromedial prefrontal cortex. The dorsolateral prefrontal cortex was selectively engaged to guide anti-corrupt behaviors when a third party would be harmed. Multivariate and connectivity analyses further explored how these neural processes depend on individual differences. These findings advance our understanding of the neurocomputational mechanisms underlying corrupt behaviors.

Rewards that are near increase impulsive action

In modern society, the natural drive to behave impulsively in order to obtain rewards must often be curbed. A continued failure to do so is associated with a range of outcomes including drug abuse, pathological gambling, and obesity. Here, we used virtual reality technology to investigate whether spatial proximity to rewards has the power to exacerbate the drive to behave impulsively toward them. We embedded two behavioral tasks measuring distinct forms of impulsive behavior, impulsive action, and impulsive choice, within an environment rendered in virtual reality. Participants responded to three-dimensional cues representing food rewards located in either near or far space. Bayesian analyses revealed that participants were significantly less able to stop motor actions when rewarding cues were near compared with when they were far. Since factors normally associated with proximity were controlled for, these results suggest that proximity plays a distinctive role in driving impulsive actions for rewards.

Cognitive and hormonal regulation of appetite for food presented in the olfactory and visual modalities

The ability to regulate appetite is essential to avoid food over-consumption. The desire for a particular food can be triggered by its odor before it is even seen. Using fMRI, we identify the neural systems modulated by cognitive regulation when experiencing appetizing food stimuli presented in both olfactory and visual modalities, while being hungry. Regulatory instruction modulated bids for food items and inhalation patterns. Distinct brain regions were observed for up and down appetite-regulation, respectively the dorsomedial prefrontal cortex (dmPFC) and dorsolateral PFC. Food valuation engaged the ventromedial PFC and bilateral striatum. Furthermore, we identified a neurobiological marker for successful appetite upregulation. Individuals with higher blood levels of ghrelin were better at exercising up-regulation, and engaged the dmPFC more. These findings characterize the neural circuitry regulating food consumption within the healthy population and highlight how cognitive regulation modulates olfactomotor measures of olfaction.

Endogenous testosterone is associated with increased striatal response to audience effects during prosocial choices

The role of testosterone on cognitive functions in humans remains controversial. One recent hypothesis suggests that this steroid hormone advances social status. As being observed by others is known to modulate a range of behaviors because of image concerns, we hypothesized that such an audience effect might be an important component of status seeking that is under the control of testosterone. Thus, we investigated to which extent testosterone levels are associated with the effect of being observed during prosocial choices and the neural mechanisms underlying this effect. We enrolled twenty-four male participants, aged 22.47 ± 2.62 years, in an fMRI experiment to examine the relationship between testosterone levels and brain activity engaged in deciding whether to accept or reject monetary transfers to two types of organizations (a positively evaluated organization and a negatively evaluated organization) in presence or absence of an audience. When comparing the public to the private condition, the rate of acceptance increased for the positively evaluated organization, while the rate of rejection increased for the negatively evaluated one. Higher testosterone levels were linked to greater activation in the striatum in the public compared to the private condition, regardless of the organization type. These results indicate a relationship between testosterone levels and striatal activity induced by the audience effect. These findings provide new insights on the role of testosterone in human social behavior.

Prediction of trust propensity from intrinsic brain morphology and functional connectome

Trust forms the basis of virtually all interpersonal relationships. Although significant individual differences characterize trust, the driving neuropsychological signatures behind its heterogeneity remain obscure. Here, we applied a prediction framework in two independent samples of healthy participants to examine the relationship between trust propensity and multimodal brain measures. Our multivariate prediction analyses revealed that trust propensity was predicted by gray matter volume and node strength across multiple regions. The gray matter volume of identified regions further enabled the classification of individuals from an independent sample with the propensity to trust or distrust. Our modular and functional decoding analyses showed that the contributing regions were part of three large‐scale networks implicated in calculus‐based trust strategy, cost–benefit calculation, and trustworthiness inference. These findings do not only deepen our neuropsychological understanding of individual differences in trust propensity, but also provide potential biomarkers in predicting trust impairment in neuropsychiatric disorders.

Hormonal responses in gambling versus alcohol abuse: A review of human studies

The endocrine system plays an essential role in communication between various organs of the body to maintain homeostasis. Both substance use disorders (SUDs) and non-substance abuse disrupt this system and lead to hormonal dysregulations. Here, we focus on the comparison between the function of the endocrine system in gambling disorders and alcohol addiction to understand the commonalities and differences in their neurobiological and psychological underpinnings. We review human research to compare findings on gambling addiction and alcohol dependence pertaining to the dynamic interplay between testosterone and cortisol. Understanding and classifying similarities in hormonal responses between behavioural addiction and SUDs may facilitate development of treatments and therapeutic interventions across different types of addictive disorders, while describing differences may shed light on therapeutic interventions for specific disorders. Although research on gambling addiction is in its infancy, such evaluation may still have a positive effect for addiction research, thereby stimulating discovery of "crossover" pharmacotherapies with benefits for both SUDs and nonsubstance addictions.

Neurocomputational mechanisms underlying immoral decisions benefiting self or others

Immoral behavior often consists of weighing transgression of a moral norm against maximizing personal profits. One important question is to understand why immoral behaviors vary based on who receives specific benefits and what are the neurocomputational mechanisms underlying such moral flexibility. Here, we used model-based functional magnetic resonance imaging to investigate how immoral behaviors change when benefiting oneself or someone else. Participants were presented with offers requiring a tradeoff between a moral cost (i.e. profiting a morally bad cause) and a benefit for either oneself or a charity. Participants were more willing to obtain ill-gotten profits for themselves than for a charity, driven by a devaluation of the moral cost when deciding for their own interests. The subjective value of an immoral offer, computed as a linear summation of the weighed monetary gain and moral cost, recruited the ventromedial prefrontal cortex (PFC) regardless of beneficiaries. Moreover, paralleling the behavioral findings, this region enhanced its functional coupling with mentalizing-related regions while deciding whether to gain morally tainted profits for oneself vs charity. Finally, individual differences in moral preference differentially modulated choice-specific signals in the dorsolateral PFC according to who benefited from the decisions. These findings provide insights for understanding the neurobiological basis of moral flexibility.

Neural computations underlying strategic social decision-making in groups

When making decisions in groups, the outcome of one's decision often depends on the decisions of others, and there is a tradeoff between short-term incentives for an individual and long-term incentives for the groups. Yet, little is known about the neurocomputational mechanisms at play when weighing different utilities during repeated social interactions. Here, using model-based fMRI and Public-good-games, we find that the ventromedial prefrontal cortex encodes immediate expected rewards as individual utility while the lateral frontopolar cortex encodes group utility (i.e., pending rewards of alternative strategies beneficial for the group). When it is required to change one's strategy, these brain regions exhibited changes in functional interactions with brain regions engaged in switching strategies. Moreover, the anterior cingulate cortex and the temporoparietal junction updated beliefs about the decision of others during interactions. Together, our findings provide a neurocomputational account of how the brain dynamically computes effective strategies to make adaptive collective decisions.

Modeling other minds: Bayesian inference explains human choices in group decision-making

To make decisions in a social context, humans have to predict the behavior of others, an ability that is thought to rely on having a model of other minds known as "theory of mind." Such a model becomes especially complex when the number of people one simultaneously interacts with is large and actions are anonymous. Here, we present results from a group decision-making task known as the volunteer's dilemma and demonstrate that a Bayesian model based on partially observable Markov decision processes outperforms existing models in quantitatively predicting human behavior and outcomes of group interactions. Our results suggest that in decision-making tasks involving large groups with anonymous members, humans use Bayesian inference to model the "mind of the group," making predictions of others' decisions while also simulating the effects of their own actions on the group's dynamics in the future.

Wait and you shall see: sexual delay discounting in hypersexual Parkinson's disease

Patients with Parkinson's disease may develop impulse control disorders under dopaminergic treatments. Impulse control disorders include a wide spectrum of behaviours, such as hypersexuality, pathological gambling or compulsive shopping. Yet, the neural systems engaged in specific impulse control disorders remain poorly characterized. Here, using model-based functional MRI, we aimed to determine the brain systems involved during delay-discounting of erotic rewards in hypersexual patients with Parkinson's disease (PD+HS), patients with Parkinson's disease without hypersexuality (PD - HS) and controls. Patients with Parkinson's disease were evaluated ON and OFF levodopa (counterbalanced). Participants had to decide between two options: (i) wait for 1.5 s to briefly view an erotic image; or (ii) wait longer to see the erotic image for a longer period of time. At the time of decision-making, we investigated which brain regions were engaged with the subjective valuation of the delayed erotic reward. At the time of the rewarded outcome, we searched for the brain regions responding more robustly after waiting longer to view the erotic image. PD+HS patients showed reduced discounting of erotic delayed rewards, compared to both patients with Parkinson's disease and controls, suggesting that they accepted waiting longer to view erotic images for a longer period of time. Thus, when using erotic stimuli that motivate PD+HS, these patients were less impulsive for the immediate reward. At the brain system level, this effect was paralleled by the fact that PD+HS, as compared to controls and PD - HS, showed a negative correlation between subjective value of the delayed reward and activity of medial prefrontal cortex and ventral striatum. Consistent with the incentive salience hypothesis combining learned cue-reward associations with current relevant physiological state, dopaminergic treatment in PD+HS boosted excessive 'wanting' of rewards and heightened activity in the anterior medial prefrontal cortex and the posterior cingulate cortex, as reflected by higher correlation with subjective value of the option associated to the delayed reward when ON medication as compared to the OFF medication state. At the time of outcome, the anterior medial prefrontal/rostral anterior cingulate cortex showed an interaction between group (PD+HS versus PD - HS) and medication (ON versus OFF), suggesting that dopaminergic treatment boosted activity of this brain region in PD+HS when viewing erotic images after waiting for longer periods of time. Our findings point to reduced delay discounting of erotic rewards in PD+HS, both at the behavioural and brain system levels, and abnormal reinforcing effect of levodopa when PD+HS patients are confronted with erotic stimuli.10.1093/brain/awy298_video1awy298media15983845074001.

Altered orbitofrontal sulcogyral patterns in gambling disorder: a multicenter study

Gambling disorder is a serious psychiatric condition characterized by decision-making and reward processing impairments that are associated with dysfunctional brain activity in the orbitofrontal cortex (OFC). However, it remains unclear whether OFC functional abnormalities in gambling disorder are accompanied by structural abnormalities. We addressed this question by examining the organization of sulci and gyri in the OFC. This organization is in place very early and stable across life, such that OFC sulcogyral patterns (classified into Types I, II, and III) can be regarded as potential pre-morbid markers of pathological conditions. We gathered structural brain data from nine existing studies, reaching a total of 165 individuals with gambling disorder and 159 healthy controls. Our results, supported by both frequentist and Bayesian statistics, show that the distribution of OFC sulcogyral patterns is skewed in individuals with gambling disorder, with an increased prevalence of Type II pattern compared with healthy controls. Examination of gambling severity did not reveal any significant relationship between OFC sulcogyral patterns and disease severity. Altogether, our results provide evidence for a skewed distribution of OFC sulcogyral patterns in gambling disorder and suggest that pattern Type II might represent a pre-morbid structural brain marker of the disease. It will be important to investigate more closely the functional implications of these structural abnormalities in future work.

Vicarious Rewards Modulate the Drift Rate of Evidence Accumulation From the Drift Diffusion Model

Taking other people's interests into account is a fundamental ability allowing humans to maintain relationships. Yet, the mechanisms by which monetary incentives for close others influence perceptual decision-making processes remain elusive. Here, we compared perceptual decisions motivated by payoffs for oneself or a close relative. According to drift diffusion models (DDMs), perceptual decisions are made when sensory evidence accumulated over time - with a given drift rate - reaches one of the decision boundaries. We used these computational models to identify whether the drift rate of evidence accumulation or the decision boundary is affected by these two sources of motivation. Reaction times and sensitivity were modulated by three factors: the Difficulty (motion coherence of the moving dots), the Payoff associated with, and the Beneficiary of the decision. Reaction times (RTs) were faster for easy compared to difficult trials and faster for high payoffs as compared to low payoffs. More interestingly, RTs were also faster for self than for other-affecting decisions. Finally, using DDM, we found that these faster RTs were linked to a higher drift rate of the decision variable. This study offers a mechanistic understanding of how incentives for others and motion coherence influence decision-making processes.

The Neuro-Computational Architecture of Value-Based Selection in the Human Brain

Current neural models of value-based decision-making consider choices as a 2-stage process, proceeding from the "valuation" of each option under consideration to the "selection" of the best option on the basis of their subjective values. However, little is known about the computational mechanisms at play at the selection stage and its implementation in the human brain. Here, we used drift-diffusion models combined with model-based functional magnetic resonance imaging, effective connectivity, and multivariate pattern analysis to characterize the neuro-computational architecture of value-based decisions. We found that 2 key drift-diffusion computations at the selection stage, namely integration and choice readout, engage distinct brain regions, with the dorsolateral prefrontal cortex integrating a decision value signal computed in the ventromedial prefrontal cortex, and the posterior parietal cortex reading out choice outcomes. Our findings suggest that this prefronto-parietal network acts as a hub implementing behavioral selection through a distributed drift-diffusion process.

Sociobiology: Changing the Dominance Hierarchy

One fundamental question is to understand what neural circuits are involved when social hierarchies are established, maintained and modified. Now, a new study shows that a previously subordinate animal can become dominant after optogenetic stimulation of the dorsomedial prefrontal cortex, demonstrating that this brain region is necessary and sufficient to quickly induce winning during social competitions.

Effect of the catechol-O-methyltransferase Val 158 Met polymorphism on theory of mind in obesity

Obesity is often accompanied with psychosocial adjustment problems, such as difficulties in social interactions and social withdrawal. A key aspect of social cognition is theory of mind, which allows inferring mental states, feelings, motivations, and beliefs of others and to use this information to predict their future behaviour. Theory of mind is highly dependent on prefrontal dopaminergic neurotransmission, which is regulated by catechol-O-methyltransferase (COMT) activity. We aimed at determining whether theory of mind is altered in obesity and if this ability is modulated by COMT. Fifty patients with obesity and 47 normal-weight individuals underwent the Reading the Mind in the Eyes Test, the Wisconsin Card Sorting Test, and the Vocabulary subscale of the Wechsler Adult Intelligence Scale. The genotype for the COMT Val ¹⁵⁸ Met functional polymorphism was determined for all subjects. Patients with obesity obtained significantly lower scores in the negative items of the Reading the Mind in the Eyes Test than normal-weight subjects. Further, an interaction effect was observed between group and COMT genotype. Specifically, the presence of the Met allele was associated to a better identification of negative mental states only in patients with obesity. Our results indicate that obesity is accompanied with difficulties in theory of mind and that this ability is influenced by the COMT genotype.

Spreading inequality: neural computations underlying paying-it-forward reciprocity

People tend to pay the generosity they receive from a person forward to someone else even if they have no chance to reciprocate directly. This phenomenon, known as paying-it-forward (PIF) reciprocity, crucially contributes to the maintenance of a cooperative human society by passing kindness among strangers and has been widely studied in evolutionary biology. To further examine its neural implementation and underlying computations, we used functional magnetic resonance imaging together with computational modeling. In a modified PIF paradigm, participants first received a monetary split (i.e. greedy, equal or generous) from either a human partner or a computer. They then chose between two options involving additional amounts of money to be allocated between themselves and an uninvolved person. Behaviorally, people forward the previously received greed/generosity towards a third person. The social impact of previous treatments is integrated into computational signals in the ventromedial prefrontal cortex and the right temporoparietal junction during subsequent decision making. Our findings provide insights to understand the proximal origin of PIF reciprocity.

A causal role for right temporo-parietal junction in signaling moral conflict

The right temporo-parietal junction (rTPJ) has been proposed to play a key role in guiding human altruistic behavior, but its precise functional contribution to altruism remains unclear. We aimed to disentangle three possible functions of the rTPJ for human altruism, namely: implementing the motivation to help, signaling conflicts between moral and material values, or representing social reputation concerns. Our novel donation-decision task consisted of decisions requiring trade-offs of either positive moral values and monetary cost when donating to a good cause, or negative moral values and monetary benefits when sending money to a bad cause. Disrupting the rTPJ using transcranial magnetic stimulation did not change the general motivation to give or to react to social reputation cues, but specifically reduced the behavioral impact of moral-material conflicts. These findings reveal that signaling moral-material conflict is a core rTPJ mechanism that may contribute to a variety of human moral behaviors.

Differences in Cortical Structure and Functional MRI Connectivity in High Functioning Autism

Autism spectrum disorders (ASD) represent a complex group of neurodevelopmental conditions characterized by deficits in communication and social behaviors. We examined the functional connectivity (FC) of the default mode network (DMN) and its relation to multimodal morphometry to investigate superregional, system-level alterations in a group of 22 adolescents and young adults with high-functioning autism compared to age-, and intelligence quotient-matched 29 healthy controls. The main findings were that ASD patients had gray matter (GM) reduction, decreased cortical thickness and larger cortical surface areas in several brain regions, including the cingulate, temporal lobes, and amygdala, as well as increased gyrification in regions associated with encoding visual memories and areas of the sensorimotor component of the DMN, more pronounced in the left hemisphere. Moreover, patients with ASD had decreased connectivity between the posterior cingulate cortex, and areas of the executive control component of the DMN and increased FC between the anteromedial prefrontal cortex and areas of the sensorimotor component of the DMN. Reduced cortical thickness in the right inferior frontal lobe correlated with higher social impairment according to the scores of the Autism Diagnostic Interview-Revised (ADI-R). Reduced cortical thickness in left frontal regions, as well as an increased cortical thickness in the right temporal pole and posterior cingulate, were associated with worse scores on the communication domain of the ADI-R. We found no association between scores on the restrictive and repetitive behaviors domain of ADI-R with structural measures or FC. The combination of these structural and connectivity abnormalities may help to explain some of the core behaviors in high-functioning ASD and need to be investigated further.

Integration of individual and social information for decision-making in groups of different sizes

When making judgments in a group, individuals often revise their initial beliefs about the best judgment to make given what others believe. Despite the ubiquity of this phenomenon, we know little about how the brain updates beliefs when integrating personal judgments (individual information) with those of others (social information). Here, we investigated the neurocomputational mechanisms of how we adapt our judgments to those made by groups of different sizes, in the context of jury decisions for a criminal. By testing different theoretical models, we showed that a social Bayesian inference model captured changes in judgments better than 2 other models. Our results showed that participants updated their beliefs by appropriately weighting individual and social sources of information according to their respective credibility. When investigating 2 fundamental computations of Bayesian inference, belief updates and credibility estimates of social information, we found that the dorsal anterior cingulate cortex (dACC) computed the level of belief updates, while the bilateral frontopolar cortex (FPC) was more engaged in individuals who assigned a greater credibility to the judgments of a larger group. Moreover, increased functional connectivity between these 2 brain regions reflected a greater influence of group size on the relative credibility of social information. These results provide a mechanistic understanding of the computational roles of the FPC-dACC network in steering judgment adaptation to a group’s opinion. Taken together, these findings provide a computational account of how the human brain integrates individual and social information for decision-making in groups.

In collective decisions, both the size of groups and the confidence that each member has in their own judgment determine how much a given individual will adapt to the judgment of the group. Here, we show that judgment adaptation during collective decisions—a fundamental brain mechanism needed for fluid functioning of social organizations—can be accounted for by Bayesian inference computations. At the time of judgment adaptation, individuals trade off the credibility inferred from their own confidence levels against the credibility of social information. The dorsal anterior cingulate cortex (dACC) represented belief updates, while the lateral frontopolar cortex (FPC) monitored the changes in credibility assigned to social information. These results provide a neurocomputational understanding of how individuals benefit both from the wisdom of larger groups and from their own confidence.

Social brains and divides: the interplay between social dominance orientation and the neural sensitivity to hierarchical ranks

Ubiquitous in the animal kingdom, dominance hierarchies emerge through social competition and underlie the control of resources. Confronting the disruptive influence of socioeconomic inequalities, human populations tend to split into groups who legitimize existing dominance hierarchies and groups who condemn them. Here, we hypothesized that variations in the neural sensitivity to dominance ranks partly underpins this ideological split, as measured by the social dominance orientation scale (SDO). Following a competitive task used to induce dominance representations about three opponents (superior, equal and inferior), subjects were passively presented the faces of these opponents while undergoing fMRI. Analyses demonstrated that two key brain regions, the superior temporal sulcus (STS) and anterior dorsolateral prefrontal cortex (aDLPFC) were sensitive to social ranks. Confirming our hypothesis, the sensitivity of the right aDLPFC to social ranks correlated positively with the SDO scale, which is known to predict behaviors and political attitudes associated with the legitimization of dominance hierarchies. This study opens new perspectives for the neurosciences of political orientation and social dominance.

The neural dynamics of reward value and risk coding in the human orbitofrontal cortex

The orbitofrontal cortex is known to carry information regarding expected reward, risk and experienced outcome. Yet, due to inherent limitations in lesion and neuroimaging methods, the neural dynamics of these computations has remained elusive in humans. Here, taking advantage of the high temporal definition of intracranial recordings, we characterize the neurophysiological signatures of the intact orbitofrontal cortex in processing information relevant for risky decisions. Local field potentials were recorded from the intact orbitofrontal cortex of patients suffering from drug-refractory partial epilepsy with implanted depth electrodes as they performed a probabilistic reward learning task that required them to associate visual cues with distinct reward probabilities. We observed three successive signals: (i) around 400 ms after cue presentation, the amplitudes of the local field potentials increased with reward probability; (ii) a risk signal emerged during the late phase of reward anticipation and during the outcome phase; and (iii) an experienced value signal appeared at the time of reward delivery. Both the medial and lateral orbitofrontal cortex encoded risk and reward probability while the lateral orbitofrontal cortex played a dominant role in coding experienced value. The present study provides the first evidence from intracranial recordings that the human orbitofrontal cortex codes reward risk both during late reward anticipation and during the outcome phase at a time scale of milliseconds. Our findings offer insights into the rapid mechanisms underlying the ability to learn structural relationships from the environment.

Hormonal treatment increases the response of the reward system at the menopause transition: a counterbalanced randomized placebo-controlled fMRI study

Preclinical research using rodent models demonstrated that estrogens play neuroprotective effects if they are administered during a critical period near the time of cessation of ovarian function. In women, a number of controversial epidemiological studies reported that a neuroprotective effect of estradiol may be obtained on cognition and mood-related disorders if hormone therapy (HT) begins early at the beginning of menopause. Yet, little is known about the modulatory effects of early HT administration on brain activation near menopause. Here, we investigated whether HT, initiated early during the menopause transition, increases the response of the reward system, a key brain circuit involved in motivation and hedonic behavior. We used fMRI and a counterbalanced, double-blind, randomized and crossover placebo-controlled design to investigate whether sequential 17β-estradiol plus oral progesterone modulate reward-related brain activity. Each woman was scanned twice while presented with images of slot machines, once after receiving HT and once under placebo. The fMRI results demonstrate that HT, relative to placebo, increased the response of the striatum and ventromedial prefrontal cortex, two areas that have been shown to be respectively involved during reward anticipation and at the time of reward delivery. Our neuroimaging results bridge the gap between animal studies and human epidemiological studies of HT on cognition. These findings establish a neurobiological foundation for understanding the neurofunctional impact of early HT initiation on reward processing at the menopause transition.

A common currency for the computation of motivational values in the human striatum

Reward comparison in the brain is thought to be achieved through the use of a 'common currency', implying that reward value representations are computed on a unique scale in the same brain regions regardless of the reward type. Although such a mechanism has been identified in the ventro-medial prefrontal cortex and ventral striatum in the context of decision-making, it is less clear whether it similarly applies to non-choice situations. To answer this question, we scanned 38 participants with fMRI while they were presented with single cues predicting either monetary or erotic rewards, without the need to make a decision. The ventral striatum was the main brain structure to respond to both cues while showing increasing activity with increasing expected reward intensity. Most importantly, the relative response of the striatum to monetary vs erotic cues was correlated with the relative motivational value of these rewards as inferred from reaction times. Similar correlations were observed in a fronto-parietal network known to be involved in attentional focus and motor readiness. Together, our results suggest that striatal reward value signals not only obey to a common currency mechanism in the absence of choice but may also serve as an input to adjust motivated behaviour accordingly.

Endogenous cortisol levels are associated with an imbalanced striatal sensitivity to monetary versus non-monetary cues in pathological gamblers

Pathological gambling is a behavioral addiction characterized by a chronic failure to resist the urge to gamble. It shares many similarities with drug addiction. Glucocorticoid hormones including cortisol are thought to play a key role in the vulnerability to addictive behaviors, by acting on the mesolimbic reward pathway. Based on our previous report of an imbalanced sensitivity to monetary versus non-monetary incentives in the ventral striatum of pathological gamblers (PGs), we investigated whether this imbalance was mediated by individual differences in endogenous cortisol levels. We used functional magnetic resonance imaging (fMRI) and examined the relationship between cortisol levels and the neural responses to monetary versus non-monetary cues, while PGs and healthy controls were engaged in an incentive delay task manipulating both monetary and erotic rewards. We found a positive correlation between cortisol levels and ventral striatal responses to monetary versus erotic cues in PGs, but not in healthy controls. This indicates that the ventral striatum is a key region where cortisol modulates incentive motivation for gambling versus non-gambling related stimuli in PGs. Our results extend the proposed role of glucocorticoid hormones in drug addiction to behavioral addiction, and help understand the impact of cortisol on reward incentive processing in PGs.

Neural dynamics of reward probability coding: a Magnetoencephalographic study in humans

Prediction of future rewards and discrepancy between actual and expected outcomes (prediction error) are crucial signals for adaptive behavior. In humans, a number of fMRI studies demonstrated that reward probability modulates these two signals in a large brain network. Yet, the spatio-temporal dynamics underlying the neural coding of reward probability remains unknown. Here, using magnetoencephalography, we investigated the neural dynamics of prediction and reward prediction error computations while subjects learned to associate cues of slot machines with monetary rewards with different probabilities. We showed that event-related magnetic fields (ERFs) arising from the visual cortex coded the expected reward value 155 ms after the cue, demonstrating that reward value signals emerge early in the visual stream. Moreover, a prediction error was reflected in ERF peaking 300 ms after the rewarded outcome and showing decreasing amplitude with higher reward probability. This prediction error signal was generated in a network including the anterior and posterior cingulate cortex. These findings pinpoint the spatio-temporal characteristics underlying reward probability coding. Together, our results provide insights into the neural dynamics underlying the ability to learn probabilistic stimuli-reward contingencies.

Imbalance in the sensitivity to different types of rewards in pathological gambling

Pathological gambling is an addictive disorder characterized by a persistent and compulsive desire to engage in gambling activities. This maladaptive behaviour has been suggested to result from a decreased sensitivity to experienced rewards, regardless of reward type. Alternatively, pathological gambling might reflect an imbalance in the sensitivity to monetary versus non-monetary incentives. To directly test these two hypotheses, we examined how the brain reward circuit of pathological gamblers responds to different types of rewards. Using functional magnetic resonance imaging, we compared the brain responses of 18 pathological gamblers and 20 healthy control subjects while they engaged in a simple incentive task manipulating both monetary and visual erotic rewards. During reward anticipation, the ventral striatum of pathological gamblers showed a differential response to monetary versus erotic cues, essentially driven by a blunted reactivity to cues predicting erotic stimuli. This differential response correlated with the severity of gambling symptoms and was paralleled by a reduced behavioural motivation for erotic rewards. During reward outcome, a posterior orbitofrontal cortex region, responding to erotic rewards in both groups, was further recruited by monetary gains in pathological gamblers but not in control subjects. Moreover, while ventral striatal activity correlated with subjective ratings assigned to monetary and erotic rewards in control subjects, it only correlated with erotic ratings in gamblers. Our results point to a differential sensitivity to monetary versus non-monetary rewards in pathological gambling, both at the motivational and hedonic levels. Such an imbalance might create a bias towards monetary rewards, potentially promoting addictive gambling behaviour.

Neural coding of computational factors affecting decision making

We constantly need to make decisions that can result in rewards of different amounts with different probabilities and at different timing. To characterize the neural coding of such computational factors affecting value-based decision making, we have investigated how reward information processing is influenced by parameters such as reward magnitude, probability, delay, effort, and uncertainty using either fMRI in healthy humans or intracranial recordings in patients with epilepsy. We decomposed brain signals modulated by these computational factors, showing that prediction error (PE), salient PE, and uncertainty signals are computed in partially overlapping brain circuits and that both transient and sustained uncertainty signals coexist in the brain. When investigating the neural representation of primary and secondary rewards, we found both a common brain network, including the ventromedial prefrontal cortex and ventral striatum, and a functional organization of the orbitofrontal cortex according to reward type. Moreover, separate valuation systems were engaged for delay and effort costs when deciding between options. Finally, genetic variations in dopamine-related genes influenced the response of the reward system and may contribute to individual differences in reward-seeking behavior and in predisposition to neuropsychiatric disorders.

The architecture of reward value coding in the human orbitofrontal cortex

To ensure their survival, animals exhibit a number of reward-directed behaviors, such as foraging for food or searching for mates. This suggests that a core set of brain regions may be shared by many species to process different types of rewards. Conversely, many new brain areas have emerged over the course of evolution, suggesting potential specialization of specific brain regions in the processing of more recent rewards such as money. Here, using functional magnetic resonance imaging in humans, we identified the common and distinct brain systems processing the value of erotic stimuli and monetary gains. First, we provide evidence that a set of neural structures, including the ventral striatum, anterior insula, anterior cingulate cortex, and midbrain, encodes the subjective value of rewards regardless of their type, consistent with a general hedonic representation. More importantly, our results reveal reward-specific representations in the orbitofrontal cortex (OFC): whereas the anterior lateral OFC, a phylogenetically recent structure, processes monetary gains, the posterior lateral OFC, phylogenetically and ontogenetically older, processes more basic erotic stimuli. This dissociation between OFC representations of primary and secondary rewards parallels current views on lateral prefrontal cortex organization in cognitive control, suggesting an increasing trend in complexity along a postero-anterior axis according to more abstract representations. Together, our results support a modular view of reward value coding in the brain and propose that a unifying principle of postero-anterior organization can be applied to the OFC.

Damage to the fronto-polar cortex is associated with impaired multitasking

Background

A major question in understanding the functional organization of the brain is to delineate the functional divisions of the prefrontal cortex. Of particular importance to the cognitive capacities that are uniquely human is the fronto-polar cortex (Brodmann's area 10), which is disproportionally larger in humans relative to the rest of the brain than it is in the ape's brain. The specific function of this brain region remains poorly understood, but recent neuroimaging studies have proposed that it may hold goals in mind while exploring and processing secondary goals.

Principal Findings

Here we show that the extent of damage to the fronto-polar cortex predicts impairment in the management of multiple goals. This result reveals that the integrity of the fronto-polar cortex is necessary to perform tasks that require subjects to maintain a primary goal in mind while processing secondary goals, an ability which is crucial for complex human cognitive abilities.

Conclusion/Significance

These results provide important new insights concerning the cerebral basis of complex human cognition such as planning and multitasking.

Hormonal and Genetic Influences on Processing Reward and Social Information

Social neuroscience is an emerging interdisciplinary field that combines tools from cognitive, cellular, and molecular neuroscience to understand the neural mechanisms underlying human interactions, emphasizing the complementary nature of different organization levels in the social and biological domains. Previous studies focused on the molecular/neuronal substrates of a variety of complex behaviors, such as parental behavior and pair bonding. Less is known about the various factors influencing interindividual differences in reward processing and decision making in social contexts, both relying upon the dopaminergic system. This review concerns (1) basic electrophysiological findings and recent neuroimaging findings showing that reward processing and social interaction processes share common neural substrates and (2) genetic and hormonal influences on these processes. Recent research combining molecular genetics, endocrinology, and neuroimaging demonstrated that variations in dopamine-related genes and in hormone levels affect the physiological properties of the dopaminergic system in nonhuman primates and modulate the processing of reward and social information in humans. These findings are important because they indicate the neural influence of genes conferring vulnerability to develop neuropathologies such as drug addiction and pathological gambling. Taken together, the reviewed data start to unveil the relationships between genes, hormones, and the functioning of the reward system, as well as decision making in social contexts, and provide a link between molecular, cellular, and social cognitive levels in humans.

Silence is golden: transient neural deactivation in the prefrontal cortex during attentive reading

It is becoming increasingly clear that attention-demanding tasks engage not only activation of specific cortical regions but also deactivation of other regions that could interfere with the task at hand. At the same time, electrophysiological studies in animals and humans have found that the participation of cortical regions to cognitive processes translates into local synchronization of rhythmic neural activity at frequencies above 40 Hz (so-called gamma-band synchronization). Such synchronization is seen as a potential facilitator of neural communication and synaptic plasticity. We found evidence that cognitive processes can also involve the disruption of gamma-band activity in high-order brain regions. Intracerebral electroencephalograms were recorded in 3 epileptic patients during 2 reading tasks. Visual presentation of words induced a strong deactivation in a broad (20-150 Hz) frequency range in the left ventral lateral prefrontal cortex, in parallel with gamma-band activations within the reading network, including Broca's area. The observed energy decrease in neural signals was reproducible across patients. It peaked around 500 ms after stimulus onset and appeared subject to attention-modulated amplification. Our results suggest that cognition might be mediated by a coordinated interaction between regional gamma-band synchronizations and desynchronizations, possibly reflecting enhanced versus reduced local neural communication.

Sensitivity of the brain to loss aversion during risky gambles

Little is known about the neural systems that subserve human loss aversion. A recent neuroimaging study by Tom, Poldrack and colleagues reports that this pattern of behaviour is directly tied to the greater sensitivity of the brain to potential losses compared with potential gains and uncovers a brain network whose activity increases with potential gains and decreases with potential losses. These results challenge the common view that loss aversion engages a distinct emotion-related brain network (e.g. amygdala and insula).

Menstrual cycle phase modulates reward-related neural function in women

There is considerable evidence from animal studies that the mesolimbic and mesocortical dopamine systems are sensitive to circulating gonadal steroid hormones. Less is known about the influence of estrogen and progesterone on the human reward system. To investigate this directly, we used functional MRI and an event-related monetary reward paradigm to study women with a repeated-measures, counterbalanced design across the menstrual cycle. Here we show that during the midfollicular phase (days 4-8 after onset of menses) women anticipating uncertain rewards activated the orbitofrontal cortex and amygdala more than during the luteal phase (6-10 days after luteinizing hormone surge). At the time of reward delivery, women in the follicular phase activated the midbrain, striatum, and left fronto-polar cortex more than during the luteal phase. These data demonstrate augmented reactivity of the reward system in women during the midfollicular phase when estrogen is unopposed by progesterone. Moreover, investigation of between-sex differences revealed that men activated ventral putamen more than women during anticipation of uncertain rewards, whereas women more strongly activated the anterior medial prefrontal cortex at the time of reward delivery. Correlation between brain activity and gonadal steroid levels also revealed that the amygdalo-hippocampal complex was positively correlated with estradiol level, regardless of menstrual cycle phase. Together, our findings provide evidence of neurofunctional modulation of the reward system by gonadal steroid hormones in humans and establish a neurobiological foundation for understanding their impact on vulnerability to drug abuse, neuropsychiatric diseases with differential expression across males and females, and hormonally mediated mood disorders.

Neural coding of distinct statistical properties of reward information in humans

Brain processing of reward information is essential for complex functions such as learning and motivation. Recent primate electrophysiological studies using concepts from information, economic and learning theories indicate that the midbrain may code two statistical parameters of reward information: a transient reward error prediction signal that varies linearly with reward probability and a sustained signal that varies highly non-linearly with reward probability and that is highest with maximal reward uncertainty (reward probability = 0.5). Here, using event-related functional magnetic resonance imaging, we disentangled these two signals in humans using a novel paradigm that systematically varied monetary reward probability, magnitude and expected reward value. The midbrain was activated both transiently with the error prediction signal and in a sustained fashion with reward uncertainty. Moreover, distinct activity dynamics were observed in post-synaptic midbrain projection sites: the prefrontal cortex responded to the transient error prediction signal while the ventral striatum covaried with the sustained reward uncertainty signal. These data suggest that the prefrontal cortex may generate the reward prediction while the ventral striatum may be involved in motivational processes that are useful when an organism needs to obtain more information about its environment. Our results indicate that distinct functional brain networks code different aspects of the statistical properties of reward information in humans.

Dissociating the roles of the rostral anterior cingulate and the lateral prefrontal cortices in performing two tasks simultaneously or successively

A fundamental question about the nature of cognitive control is whether performing two tasks successively or simultaneously activates distinct brain regions. To investigate this question, we designed a functional magnetic resonance imaging (fMRI) study that compared task-switching and dual-task performance. The results showed that performing two tasks successively or simultaneously activated a common prefronto-parietal neural network relative to performing each task separately. More importantly, we found that the anterior cingulate and the lateral prefrontal cortices were differently activated in dual-task and task-switching situations. When performing two tasks simultaneously, as compared to performing them in succession, activation was found in the rostral anterior cingulate cortex. In contrast, switching between two tasks, relative to performing them simultaneously, activated the left lateral prefrontal cortex and the bilateral intra-parietal sulcus region. We interpret these results as indicating that the rostral anterior cingulate cortex serves to resolve conflicts between stimulus-response associations when performing two tasks simultaneously, while the lateral prefrontal cortex dynamically selects the neural pathways needed to perform a given task during task switching.