Effects of direct social experience on trust decisions and neural reward circuitry

Neural signatures of trust in reciprocity: A coordinate-based meta-analysis

Trust in reciprocity (TR) is defined as the risky decision to invest valued resources in another party with the hope of mutual benefit. Several fMRI studies have investigated the neural correlates of TR in one-shot and multiround versions of the investment game (IG). However, an overall characterization of the underlying neural networks remains elusive. Here, a coordinate-based meta-analysis was employed (activation likelihood estimation method, 30 articles) to investigate consistent brain activations in each of the IG stages (i.e., the trust, reciprocity and feedback stage). Results showed consistent activations in the anterior insula (AI) during trust decisions in the one-shot IG and decisions to reciprocate in the multiround IG, likely related to representations of aversive feelings. Moreover, decisions to reciprocate also consistently engaged the intraparietal sulcus, probably involved in evaluations of the reciprocity options. On the contrary, trust decisions in the multiround IG consistently activated the ventral striatum, likely associated with reward prediction error signals. Finally, the dorsal striatum was found consistently recruited during the feedback stage of the multiround IG, likely related to reinforcement learning. In conclusion, our results indicate different neural networks underlying trust, reciprocity, and feedback learning. These findings suggest that although decisions to trust and reciprocate may elicit aversive feelings likely evoked by the uncertainty about the decision outcomes and the pressing requirements of social standards, multiple interactions allow people to build interpersonal trust for cooperation via a learning mechanism by which they arguably learn to distinguish trustworthy from untrustworthy partners. Hum Brain Mapp 38:1233-1248, 2017. © 2016 Wiley Periodicals, Inc.

How do we trust strangers? The neural correlates of decision making and outcome evaluation of generalized trust

This study investigates the brain correlates of decision making and outcome evaluation of generalized trust (i.e. trust in unfamiliar social agents)-a core component of social capital which facilitates civic cooperation and economic exchange. We measured 18 (9 male) Chinese participants' event-related potentials while they played the role of the trustor in a one-shot trust game with unspecified social agents (trustees) allegedly selected from a large representative sample. At the decision-making phase, greater N2 amplitudes were found for trustors' distrusting decisions compared to trusting decisions, which may reflect greater cognitive control exerted to distrust. Source localization identified the precentral gyrus as one possible neuronal generator of this N2 component. At the outcome evaluation phase, principal components analysis revealed that the so called feedback-related negativity was in fact driven by a reward positivity, which was greater in response to gain feedback compared to loss feedback. This reduced reward positivity following loss feedback may indicate that the absence of reward for trusting decisions was unexpected by the trustor. In addition, we found preliminary evidence suggesting that the decision-making processes may differ between high trustors and low trustors.

Effects of early life stress on amygdala and striatal development

Species-expected caregiving early in life is critical for the normative development and regulation of emotional behavior, the ability to effectively evaluate affective stimuli in the environment, and the ability to sustain social relationships. Severe psychosocial stressors early in life (early life stress; ELS) in the form of the absence of species expected caregiving (i.e., caregiver deprivation), can drastically impact one's social and emotional success, leading to the onset of internalizing illness later in life. Development of the amygdala and striatum, two key regions supporting affective valuation and learning, is significantly affected by ELS, and their altered developmental trajectories have important implications for cognitive, behavioral and socioemotional development. However, an understanding of the impact of ELS on the development of functional interactions between these regions and subsequent behavioral effects is lacking. In this review, we highlight the roles of the amygdala and striatum in affective valuation and learning in maturity and across development. We discuss their function separately as well as their interaction. We highlight evidence across species characterizing how ELS induced changes in the development of the amygdala and striatum mediate subsequent behavioral changes associated with internalizing illness, positing a particular import of the effect of ELS on their interaction.

Striatal Associative Learning Signals Are Tuned to In-groups

An important feature of adaptive social behavior is the ability to flexibly modify future actions based on the successes or failures of past experiences. The ventral striatum (VS) occupies a central role in shaping behavior by using feedback to evaluate actions and guide learning. The current studies tested whether feedback indicating the need to update social knowledge would engage the VS, thereby facilitating subsequent learning. We also examined the sensitivity of these striatal signals to the value associated with social group membership. Across two fMRI studies, participants answered questions testing their knowledge about the preferences of personally relevant social groups who were high (in-group) or low (out-group) in social value. Participants received feedback indicating whether their responses were correct or incorrect on a trial-by-trial basis. After scanning, participants were given a surprise memory test examining memory for the different types of feedback. VS activity in response to social feedback correlated with subsequent memory, specifying a role for the VS in encoding and updating social knowledge. This effect was more robust in response to in-group than out-group feedback, indicating that the VS tracks variations in social value. These results provide novel evidence of a neurobiological mechanism adaptively tuned to the motivational relevance of the surrounding social environment that focuses learning efforts on the most valuable social outcomes and triggers adjustments in behavior when necessary.

Reinforcement learning models and their neural correlates: An activation likelihood estimation meta-analysis

Reinforcement learning describes motivated behavior in terms of two abstract signals. The representation of discrepancies between expected and actual rewards/punishments-prediction error-is thought to update the expected value of actions and predictive stimuli. Electrophysiological and lesion studies have suggested that mesostriatal prediction error signals control behavior through synaptic modification of cortico-striato-thalamic networks. Signals in the ventromedial prefrontal and orbitofrontal cortex are implicated in representing expected value. To obtain unbiased maps of these representations in the human brain, we performed a meta-analysis of functional magnetic resonance imaging studies that had employed algorithmic reinforcement learning models across a variety of experimental paradigms. We found that the ventral striatum (medial and lateral) and midbrain/thalamus represented reward prediction errors, consistent with animal studies. Prediction error signals were also seen in the frontal operculum/insula, particularly for social rewards. In Pavlovian studies, striatal prediction error signals extended into the amygdala, whereas instrumental tasks engaged the caudate. Prediction error maps were sensitive to the model-fitting procedure (fixed or individually estimated) and to the extent of spatial smoothing. A correlate of expected value was found in a posterior region of the ventromedial prefrontal cortex, caudal and medial to the orbitofrontal regions identified in animal studies. These findings highlight a reproducible motif of reinforcement learning in the cortico-striatal loops and identify methodological dimensions that may influence the reproducibility of activation patterns across studies.

The personality trait of behavioral inhibition modulates perceptions of moral character and performance during the trust game: behavioral results and computational modeling

Decisions based on trust are critical for human social interaction. We judge the trustworthiness of partners in social interactions based on a number of partner characteristics as well as experiences with those partners. These decisions are also influenced by personality. The current study examined how the personality trait of behavioral inhibition, which involves the tendency to avoid or withdraw from novelty in both social and non-social situations, is related to explicit ratings of trustworthiness as well as decisions made in the trust game. In the game, healthy young adults interacted with three fictional partners who were portrayed as trustworthy, untrustworthy or neutral through biographical information. Participants could choose to keep $1 or send $3 of virtual money to a partner. The partner could then choose to send $1.5 back to the participant or to keep the entire amount. On any trial in which the participant chose to send, the partner always reciprocated with 50% probability, irrespective of how that partner was portrayed in the biography. Behavioral inhibition was assessed through a self-report questionnaire. Finally, a reinforcement learning computational model was fit to the behavior of each participant. Self-reported ratings of trust confirmed that all participants, irrespective of behavioral inhibition, perceived differences in the moral character of the three partners (trustworthiness of good > neutral > bad partner). Decisions made in the game showed that inhibited participants tended to trust the neutral partner less than uninhibited participants. In contrast, this was not reflected in the ratings of the neutral partner (either pre- or post-game), indicating a dissociation between ratings of trustworthiness and decisions made by inhibited participants. Computational modeling showed that this was due to lower initial trust of the neutral partner rather than a higher learning rate associated with loss, suggesting an implicit bias against the neutral partner. Overall, the results suggest inhibited individuals may be predisposed to interpret neutral or ambiguous information more negatively which could, at least in part, account for the tendency to avoid unfamiliar people characteristic of behaviorally inhibited temperament, as well as its relationship to anxiety disorders.

Computational substrates of social value in interpersonal collaboration

Decisions to engage in collaborative interactions require enduring considerable risk, yet provide the foundation for building and maintaining relationships. Here, we investigate the mechanisms underlying this process and test a computational model of social value to predict collaborative decision making. Twenty-six participants played an iterated trust game and chose to invest more frequently with their friends compared with a confederate or computer despite equal reinforcement rates. This behavior was predicted by our model, which posits that people receive a social value reward signal from reciprocation of collaborative decisions conditional on the closeness of the relationship. This social value signal was associated with increased activity in the ventral striatum and medial prefrontal cortex, which significantly predicted the reward parameters from the social value model. Therefore, we demonstrate that the computation of social value drives collaborative behavior in repeated interactions and provide a mechanistic account of reward circuit function instantiating this process.

How Social and Nonsocial Context Affects Stay/Leave Decision-Making: The Influence of Actual and Expected Rewards

This study investigated whether deciding to either stay with or leave a social relationship partner, based on a sequence of collaborative social interactions, is impacted by (1) observed and (2) anticipated gains and losses associated with the collaboration; and, importantly, (3) whether these effects differ between social and nonsocial contexts. In the social context, participants played an iterated collaborative economic game in which they were dependent on the successes and failures of a game partner in order to increase their monetary payoff, and in which they were free to stop collaborating with this partner whenever they chose. In Study 1, we manipulated the actual success rate of partners, and demonstrated that participants decided to stay longer with 'better' partners. In Study 2, we induced prior expectations about specific partners, while keeping the objective performance of all partners equal, and found that participants decided to stay longer with partners whom they expected to be 'better' than others, irrespective of actual performance. Importantly, both Study 1 and 2 included a nonsocial control condition that was probabilistically identical to the social conditions. All findings were replicated in nonsocial context, but results demonstrated that the effect of prior beliefs on stay/leave decision-making was much less pronounced in a social than a nonsocial context.

Acting on social exclusion: neural correlates of punishment and forgiveness of excluders

This functional magnetic resonance imaging study examined the neural correlates of punishment and forgiveness of initiators of social exclusion (i.e. 'excluders'). Participants divided money in a modified Dictator Game between themselves and people who previously either included or excluded them during a virtual ball-tossing game (Cyberball). Participants selectively punished the excluders by decreasing their outcomes; even when this required participants to give up monetary rewards. Punishment of excluders was associated with increased activation in the pre-supplementary motor area (pre-SMA) and bilateral anterior insula. Costly punishment was accompanied by higher activity in the pre-SMA compared with punishment that resulted in gains or was non-costly. Refraining from punishment (i.e. forgiveness) was associated with self-reported perspective-taking and increased activation in the bilateral temporoparietal junction, dorsomedial prefrontal cortex, dorsal anterior cingulate cortex, and ventrolateral and dorsolateral prefrontal cortex. These findings show that social exclusion can result in punishment as well as forgiveness of excluders and that separable neural networks implicated in social cognition and cognitive control are recruited when people choose either to punish or to forgive those who excluded them.

The social brain and reward: social information processing in the human striatum

In the highly social life of humans, rewards that are sought and experienced are intertwined with social relationships and interactions between people. Just as we value nonsocial rewards such as food or money, we also value social outcomes (e.g., praise from a superior). We use social information to evaluate and form expectations of others and to make decisions involving others. Here we review research demonstrating how the neural circuitry of reward, particularly the striatum, is also involved in processing social information and making decisions in social situations. This research provides an understanding of the neural basis for social behavior from the perspective of how we evaluate social experiences and how our social interactions and decisions are motivated. We review research addressing the common neural systems underlying evaluation of social and nonsocial rewards. The human striatum, known to play a key role in reward processing, displays signals related to a broad spectrum of social functioning, including evaluating social rewards, making decisions influenced by social factors, learning about social others, cooperating, competing, and following social norms. WIREs Cogn Sci 2014, 5:61-73. doi: 10.1002/wcs.1266 Conflict of interest: The authors have declared no conflicts of interest for this article. For further resources related to this article, please visit the WIREs website.

DAT1 polymorphism determines L-DOPA effects on learning about others' prosociality

Despite that a wealth of evidence links striatal dopamine to individualś reward learning performance in non-social environments, the neurochemical underpinnings of such learning during social interaction are unknown. Here, we show that the administration of 300 mg of the dopamine precursor L-DOPA to 200 healthy male subjects influences learning about a partners' prosocial preferences in a novel social interaction task, which is akin to a repeated trust game. We found learning to be modulated by a well-established genetic marker of striatal dopamine levels, the 40-bp variable number tandem repeats polymorphism of the dopamine transporter (DAT1 polymorphism). In particular, we found that L-DOPA improves learning in 10/10R genoype subjects, who are assumed to have lower endogenous striatal dopamine levels and impairs learning in 9/10R genotype subjects, who are assumed to have higher endogenous dopamine levels. These findings provide first evidence for a critical role of dopamine in learning whether an interaction partner has a prosocial or a selfish personality. The applied pharmacogenetic approach may open doors to new ways of studying psychiatric disorders such as psychosis, which is characterized by distorted perceptions of others' prosocial attitudes.

The caudate signals bad reputation during trust decisions

The ability to initiate and sustain trust is critical to health and well-being. Willingness to trust is in part determined by the reputation of the putative trustee, gained via direct interactions or indirectly through word of mouth. Few studies have examined how the reputation of others is instantiated in the brain during trust decisions. Here we use an event-related functional MRI (fMRI) design to examine what neural signals correspond to experimentally manipulated reputations acquired in direct interactions during trust decisions. We hypothesized that the caudate (dorsal striatum) and putamen (ventral striatum) and amygdala would signal differential reputations during decision-making. Twenty-nine healthy adults underwent fMRI scanning while completing an iterated Trust Game as trusters with three fictive trustee partners who had different tendencies to reciprocate (i.e., likelihood of rewarding the truster), which were learned over multiple exchanges with real-time feedback. We show that the caudate (both left and right) signals reputation during trust decisions, such that caudate is more active to partners with two types of "bad" reputations, either indifferent partners (who reciprocate 50% of the time) or unfair partners (who reciprocate 25% of the time), than to those with "good" reputations (who reciprocate 75% of the time). Further, individual differences in caudate activity related to biases in trusting behavior in the most uncertain situation, i.e. when facing an indifferent partner. We also report on other areas that were activated by reputation at p < 0.05 whole brain corrected. Our findings suggest that the caudate is involved in signaling and integrating reputations gained through experience into trust decisions, demonstrating a neural basis for this key social process.

Delaying gratification depends on social trust

Delaying gratification is hard, yet predictive of important life outcomes, such as academic achievement and physical health. Prominent theories focus on the role of self-control, hypersensitivity to immediate rewards, and the cost of time spent waiting. However, delaying gratification may also require trust in people delivering future rewards as promised. To test the role of social trust, participants were presented with character vignettes and faces that varied in trustworthiness, and then choose between hypothetical smaller immediate or larger delayed rewards from those characters. Across two experiments, participants were less willing to wait for delayed rewards from less trustworthy characters, and perceived trustworthiness predicted willingness to delay gratification. These findings provide the first demonstration of a causal role for social trust in willingness to delay gratification, independent of other relevant factors, such as self-control or reward history. Thus, delaying gratification requires choosing not only a later reward, but a reward that is potentially less likely to be delivered, when there is doubt about the person promising it. Implications of this work include the need to revise prominent theories of delay of gratification, and new directions for interventions with populations characterized by impulsivity.

Reputational priors magnify striatal responses to violations of trust

Humans learn to trust each other by evaluating the outcomes of repeated interpersonal interactions. However, available prior information on the reputation of traders may alter the way outcomes affect learning. Our functional magnetic resonance imaging study is the first to allow the direct comparison of interaction-based and prior-based learning. Twenty participants played repeated trust games with anonymous counterparts. We manipulated two experimental conditions: whether or not reputational priors were provided, and whether counterparts were generally trustworthy or untrustworthy. When no prior information is available our results are consistent with previous studies in showing that striatal activation patterns correlate with behaviorally estimated reinforcement learning measures. However, our study additionally shows that this correlation is disrupted when reputational priors on counterparts are provided. Indeed participants continue to rely on priors even when experience sheds doubt on their accuracy. Notably, violations of trust from a cooperative counterpart elicited stronger caudate deactivations when priors were available than when they were not. However, tolerance to such violations appeared to be mediated by prior-enhanced connectivity between the caudate nucleus and ventrolateral prefrontal cortex, which anticorrelated with retaliation rates. Moreover, on top of affecting learning mechanisms, priors also clearly oriented initial decisions to trust, reflected in medial prefrontal cortex activity.

Aberrant reward center response to partner reputation during a social exchange game in generalized social phobia

OBJECTIVE

Generalized social anxiety disorder (GSAD) is characterized by excessive fear of public scrutiny and reticence in social engagement. Previous studies have probed the neural basis of GSAD often using static, noninteractive stimuli (e.g., face photographs) and have identified dysfunction in fear circuitry. We sought to investigate brain-based dysfunction in GSAD during more real-world, dynamic social interactions, focusing on the role of reward-related regions that are implicated in social decision-making.

METHODS

Thirty-six healthy individuals (healthy control [HC]) and 36 individuals with GSAD underwent functional magnetic resonance imaging (fMRI) scanning while participating in a behavioral economic game ("Trust Game") involving iterative exchanges with fictive partners who acquire differential reputations for reciprocity. We investigated brain responses to reciprocation of trust in one's social partner, and how these brain responses are modulated by partner reputation for repayment.

RESULTS

In both HC and GSAD, receipt of reciprocity robustly engaged ventral striatum, a region implicated in reward. In HC, striatal responses to reciprocity were specific to partners who have consistently returned the investment ("cooperative partners"), and were absent for partners who lack a cooperative reputation. In GSAD, modulation of striatal responses by partner reputation was absent. Social anxiety severity predicted diminished responses to cooperative partners.

CONCLUSION

These results suggest abnormalities in GSAD in reward-related striatal mechanisms that may be important for the initiation, valuation, and maintenance of cooperative social relationships. Moreover, this study demonstrates that dynamic, interactive task paradigms derived from economics can help illuminate novel mechanisms of pathology in psychiatric illnesses in which social dysfunction is a cardinal feature.