When Implicit Prosociality Trumps Selfishness: The Neural Valuation System Underpins More Optimal Choices When Learning to Avoid Harm to Others Than to Oneself

Predictive coding for the actions and emotions of others and its deficits in autism spectrum disorders

Traditionally, the neural basis of social perception has been studied by showing participants brief examples of the actions or emotions of others presented in randomized order to prevent participants from anticipating what others do and feel. This approach is optimal to isolate the importance of information flow from lower to higher cortical areas. The degree to which feedback connections and Bayesian hierarchical predictive coding contribute to how mammals process more complex social stimuli has been less explored, and will be the focus of this review. We illustrate paradigms that start to capture how participants predict the actions and emotions of others under more ecological conditions, and discuss the brain activity measurement methods suitable to reveal the importance of feedback connections in these predictions. Together, these efforts draw a richer picture of social cognition in which predictive coding and feedback connections play significant roles. We further discuss how the notion of predicting coding is influencing how we think of autism spectrum disorder.

Connected in Bad Times and in Good Times: Empathy Induces Stable Social Closeness

Humans need social closeness to prosper. There is evidence that empathy can induce social closeness. However, it remains unclear how empathy-related social closeness is formed and how stable it is as time passes. We applied an acquisition-extinction paradigm combined with computational modeling and fMRI, to investigate the formation and stability of empathy-related social closeness. Female participants observed painful stimulation of another person with high probability (acquisition) and low probability (extinction) and rated their closeness to that person. The results of two independent studies showed increased social closeness in the acquisition block that resisted extinction in the extinction block. Providing insights into underlying mechanisms, reinforcement learning modeling revealed that the formation of social closeness is based on a learning signal (prediction error) generated from observing another's pain, whereas maintaining social closeness is based on a learning signal generated from observing another's pain relief. The results of a reciprocity control study indicate that this feedback recalibration is specific to learning of empathy-related social closeness. On the neural level, the recalibration of the feedback signal was associated with neural responses in anterior insula and adjacent inferior frontal gyrus and the bilateral superior temporal sulcus/temporoparietal junction. Together, these findings show that empathy-related social closeness generated in bad times, that is, empathy with the misfortune of another person, transfers to good times and thus may form one important basis for stable social relationships.

Testosterone eliminates strategic prosocial behavior through impacting choice consistency in healthy males

Humans are strategically more prosocial when their actions are being watched by others than when they act alone. Using a psychopharmacogenetic approach, we investigated the endocrinological and computational mechanisms of such audience-driven prosociality. One hundred and ninety-two male participants received either a single dose of testosterone (150 mg) or a placebo and performed a prosocial and self-benefitting reinforcement learning task. Crucially, the task was performed either in private or when being watched. Rival theories suggest that the hormone might either diminish or strengthen audience-dependent prosociality. We show that exogenous testosterone fully eliminated strategic, i.e., feigned, prosociality and thus decreased submission to audience expectations. We next performed reinforcement-learning drift-diffusion computational modeling to elucidate which latent aspects of decision-making testosterone acted on. The modeling revealed that testosterone compared to placebo did not deteriorate reinforcement learning per se. Rather, when being watched, the hormone altered the degree to which the learned information on choice value translated to action selection. Taken together, our study provides novel evidence of testosterone's effects on implicit reward processing, through which it counteracts conformity and deceptive reputation strategies.

Neuro-computational mechanisms and individual biases in action-outcome learning under moral conflict

Learning to predict action outcomes in morally conflicting situations is essential for social decision-making but poorly understood. Here we tested which forms of Reinforcement Learning Theory capture how participants learn to choose between self-money and other-shocks, and how they adapt to changes in contingencies. We find choices were better described by a reinforcement learning model based on the current value of separately expected outcomes than by one based on the combined historical values of past outcomes. Participants track expected values of self-money and other-shocks separately, with the substantial individual difference in preference reflected in a valuation parameter balancing their relative weight. This valuation parameter also predicted choices in an independent costly helping task. The expectations of self-money and other-shocks were biased toward the favored outcome but fMRI revealed this bias to be reflected in the ventromedial prefrontal cortex while the pain-observation network represented pain prediction errors independently of individual preferences.

On the relationship between the social brain, social connectedness, and wellbeing

The emergence of social neuroscience in the past two decades has offered a useful neurocognitive framework for understanding human social behavior. Of importance, social neuroscience research aimed to provide mechanistic explanations for the established link between wellbeing and social behavioral phenomena-particularly those reflective of social connectedness. Here, we provide an overview of the relevant literature focusing on recent work using functional magnetic resonance imaging (fMRI). In general, fMRI research demonstrated that aspects of social connectedness that are known to either positively (e.g., social acceptance) or negatively (e.g., social isolation) impact wellbeing also modulated the activity of subcortical reward system accordingly. Similar modulatory influence was found for the activity of other brain regions such as the medial prefrontal cortex, which are typically regarded as components of the "social brain" that support a wide range of functions related to social cognition and behavior. Elucidating such individual differences in brain activity may shed light onto the neural underpinnings of the link between social connectedness and wellbeing.

Effects of dopamine D2/3 and opioid receptor antagonism on the trade-off between model-based and model-free behaviour in healthy volunteers

Human behaviour requires flexible arbitration between actions we do out of habit and actions that are directed towards a specific goal. Drugs that target opioid and dopamine receptors are notorious for inducing maladaptive habitual drug consumption; yet, how the opioidergic and dopaminergic neurotransmitter systems contribute to the arbitration between habitual and goal-directed behaviour is poorly understood. By combining pharmacological challenges with a well-established decision-making task and a novel computational model, we show that the administration of the dopamine D2/3 receptor antagonist amisulpride led to an increase in goal-directed or 'model-based' relative to habitual or 'model-free' behaviour, whereas the non-selective opioid receptor antagonist naltrexone had no appreciable effect. The effect of amisulpride on model-based/model-free behaviour did not scale with drug serum levels in the blood. Furthermore, participants with higher amisulpride serum levels showed higher explorative behaviour. These findings highlight the distinct functional contributions of dopamine and opioid receptors to goal-directed and habitual behaviour and support the notion that even small doses of amisulpride promote flexible application of cognitive control.

Placebo Analgesia Reduces Costly Prosocial Helping to Lower Another Person's Pain

Painkiller administration lowers pain empathy, but whether this also reduces prosocial behavior is unknown. In this preregistered study, we investigated whether inducing analgesia through a placebo painkiller reduced effortful helping. When given the opportunity to reduce the pain of another person, individuals experiencing placebo analgesia (n = 45 adults from Austria; 21 male, 24 female) made fewer prosocial choices at the lowest helping level and exerted less physical effort when helping, compared with controls whose pain sensitivity was unaltered (n = 45; 21 male, 24 female). Self-reported empathic unpleasantness positively correlated with prosocial choices across the whole sample. While not replicating group differences in empathy, a mediation analysis revealed that the level of unpleasantness to other people's pain fully mediated the effect of placebo analgesia on prosocial choices. Given the importance of prosociality for social cohesion, these findings have broad potential implications both for individuals under the influence of painkillers and for society at large.

Believing and social interactions: effects on bodily expressions and personal narratives

The processes of believing integrate external perceptual information from the environment with internal emotional states and prior experience to generate probabilistic neural representations of events, i.e., beliefs. As these neural representations manifest mostly below the level of a person's conscious awareness, they may inadvertently affect the spontaneous person's bodily expressions and prospective behavior. By yet to be understood mechanisms people can become aware of these representations and reflect upon them. Typically, people can communicate the content of their beliefs as personal statements and can summarize the narratives of others to themselves or to other people. Here, we describe that social interactions may benefit from the consistency between a person's bodily expressions and verbal statements because the person appears authentic and ultimately trustworthy. The transmission of narratives can thus lay the groundwork for social cooperation within and between groups and, ultimately, between communities and nations. Conversely, a discrepancy between bodily expressions and narratives may cause distrust in the addressee(s) and eventually may destroy social bonds.

Learning whom to cooperate with: neurocomputational mechanisms for choosing cooperative partners

Cooperation is fundamental for survival and a functioning society. With substantial individual variability in cooperativeness, we must learn whom to cooperate with, and often make these decisions on behalf of others. Understanding how people learn about the cooperativeness of others, and the neurocomputational mechanisms supporting this learning, is therefore essential. During functional magnetic resonance imaging scanning, participants completed a novel cooperation-partner-choice task where they learned to choose between cooperative and uncooperative partners through trial-and-error both for themselves and vicariously for another person. Interestingly, when choosing for themselves, participants made faster and more exploitative choices than when choosing for another person. Activity in the ventral striatum preferentially responded to prediction errors (PEs) during self-learning, whereas activity in the perigenual anterior cingulate cortex (ACC) signaled both personal and vicarious PEs. Multivariate pattern analyses showed distinct coding of personal and vicarious choice-making and outcome processing in the temporoparietal junction (TPJ), dorsal ACC, and striatum. Moreover, in right TPJ the activity pattern that differentiated self and other outcomes was associated with individual differences in exploitation tendency. We reveal neurocomputational mechanisms supporting cooperative learning and show that this learning is reflected in trial-by-trial univariate signals and multivariate patterns that can distinguish personal and vicarious choices.

Modeling Variation in Empathic Sensitivity Using Go/No-Go Social Reinforcement Learning

Recent advances in computational behavioral modeling can help rigorously quantify differences in how individuals learn behaviors that affect both themselves and others. But social learning remains understudied in the context of understanding individual variation in social phenomena like aggression, which is defined by persistent engagement in behaviors that harm others. We adapted a go/no-go reinforcement learning task across social and non-social contexts such that monetary gains and losses explicitly impacted the subject, a study partner, or no one. We then quantified participants' (n = 61) sensitivity to others' rewards, sensitivity to others' losses, and the Pavlovian influence of expected outcomes on approach and avoidance behavior. Results showed that subjects learned in response to punishments and rewards that affected their partner in a way that was computationally similar to how they learned for themselves, consistent with the possibility that social learning engages empathic processes. Further supporting this interpretation, an individualized model parameter that indexed sensitivity to others' punishments was inversely associated with trait antisociality. Modeled sensitivity to others' losses also mapped onto post-task motivation ratings, but was not associated with self-reported trait empathy. This work is the first to apply a social reinforcement learning task that spans affect and action requirement (go/no-go) to measure multiple facets of empathic sensitivity.

Supplementary Information

The online version contains supplementary material available at 10.1007/s42761-022-00119-4.

How resource sharing resists scarcity: the role of cognitive empathy and its neurobiological mechanisms

Resource scarcity challenges individuals' willingness to share limited resources with other people. Still, lots of field studies and laboratory experiments have shown that sharing behaviors do not disappear under scarcity. Rather, some individuals are willing to share their scarce resources with others in a similar way as when the resource is abundant, which is crucial for the maintenance and development of human society. Here, we designed a novel paradigm in which subjects decided whether (and how much) to share an amount of "relieving resources" for counteracting unpleasant noises, which mimics real-life situations that people cost their own resources to help others escape from adversity. Overall, the robustness of resource sharing under scarcity was positively correlated with individual level of the cognitive component of empathy across two independent experiments. Resource insufficiency modulated the activations of several brain regions (including the TPJ, mPFC, and PCC) as well as the functional connection (from the rTPJ to the mPFC) within the mentalizing brain network, but the modulatory effect decreased as a function of cognitive empathy. We also applied the administration of oxytocin and found significant effects on sharing behavior among individuals with a higher level of cognitive empathy, but not their low-level counterparts. These findings highlight the importance of empathy to resource sharing under scarcity and explain the underlying neurobiological mechanisms.

Birth order and prosociality in the early adolescent brain

Birth order is a crucial environmental factor for child development. For example, later-born children are relatively unlikely to feel secure due to sibling competition or diluted parental resources. The positive effect of being earlier-born on cognitive intelligence is well-established. However, whether birth order is linked to social behavior remains controversial, and the neural correlates of birth order effects in adolescence when social cognition develops remain unknown. Here, we explored the birth order effect on prosociality using a large-scale population-based adolescent cohort. Next, since the amygdala is a key region for sociality and environmental stress, we examined amygdala substrates of the association between birth order and prosociality using a subset neuroimaging cohort. We found enhanced prosociality in later-born adolescents (N = 3160), and observed the mediating role of larger amygdala volume (N = 208) and amygdala-prefrontal functional connectivity with sex-selective effects (N = 183). We found that birth order, a non-genetic environmental factor, affects adolescent social development via different neural substrates. Our findings may indicate the later-born people’s adaptive survival strategy in stressful environments.

A causal role of estradiol in human reinforcement learning

The sex hormone estradiol is hypothesized to play a key role in human cognition, and reward processing specifically, via increased dopamine D1-receptor signalling. However, the effect of estradiol on reward processing in men has never been established. To fill this gap, we performed a double-blind placebo-controlled study in which men (N = 100) received either a single dose of estradiol (2 mg) or a placebo. Subjects performed a probabilistic reinforcement learning task where they had to choose between two options with varying reward probabilities to maximize monetary reward. Results showed that estradiol administration increased reward sensitivity compared to placebo. This effect was observed in subjects' choices, how much weight they assigned to their previous choices, and subjective reports about the reward probabilities. Furthermore, effects of estradiol were moderated by reward sensitivity, as measured through the BIS/BAS questionnaire. Using reinforcement learning models, we found that behavioral effects of estradiol were reflected in increased learning rates. These results demonstrate a causal role of estradiol within the framework of reinforcement learning, by enhancing reward sensitivity and learning. Furthermore, they provide preliminary evidence for dopamine-related genetic variants moderating the effect of estradiol on reward processing.