Oxytocin modulates neurocomputational mechanisms underlying prosocial reinforcement learning

L-DOPA and oxytocin influence the neural correlates of performance monitoring for self and others

RATIONALE

The ability to monitor the consequences of our actions for others is imperative for flexible and adaptive behavior, and allows us to act in a (pro)social manner. Yet, little is known about the neurochemical mechanisms underlying alterations in (pro)social performance monitoring.

OBJECTIVE

The aim of this functional magnetic resonance imaging (fMRI) study was to improve our understanding of the role of dopamine and oxytocin and their potential overlap in the neural mechanisms underlying performance monitoring for own versus others' outcomes.

METHOD

Using a double-blind placebo-controlled cross-over design, 30 healthy male volunteers were administered oxytocin (24 international units), the dopamine precursor L-DOPA (100 mg + 25 mg carbidopa), or placebo in three sessions. Participants performed a computerized cannon shooting game in two recipient conditions where mistakes resulted in negative monetary consequences for (1) oneself or (2) an anonymous other participant.

RESULTS

Results indicated reduced error-correct differentiation in the ventral striatum after L-DOPA compared to placebo, independent of recipient. Hence, pharmacological manipulation of dopamine via L-DOPA modulated performance-monitoring activity in a brain region associated with reward prediction and processing in a domain-general manner. In contrast, oxytocin modulated the BOLD response in a recipient-specific manner, such that it specifically enhanced activity for errors that affected the other in the pregenual anterior cingulate cortex (pgACC), a region previously implicated in the processing of social rewards and prediction errors. Behaviorally, we also found reduced target sizes-indicative of better performance-after oxytocin, regardless of recipient. Moreover, after oxytocin lower target sizes specifically predicted higher pgACC activity when performing for others.

CONCLUSIONS

These different behavioral and neural patterns after oxytocin compared to L-DOPA administration highlight a divergent role of each neurochemical in modulating the neural mechanisms underlying social performance monitoring.

Neural and behavioral evidence for oxytocin's facilitatory effects on learning in volatile and stable environments

Outcomes of past decisions profoundly shape our behavior. However, choice-outcome associations can become volatile and adaption to such changes is of importance. The present study combines pharmaco-electroencephalography with computational modeling to examine whether intranasal oxytocin can modulate reinforcement learning under a volatile vs. a stable association. Results show that oxytocin increases choice accuracy independent of learning context, which is paralleled by a larger N2pc and a smaller P300. Model-based analyses reveal that while oxytocin promotes learning by accelerating value update of outcomes in the volatile context, in the stable context it does so by improving choice consistency. These findings suggest that oxytocin's facilitatory effects on learning may be exerted via improving early attentional selection and late neural processing efficiency, although at the computational level oxytocin's actions are highly adaptive between learning contexts. Our findings provide proof of concept for oxytocin's therapeutic potential in mental disorders with adaptive learning dysfunction.

Dissociated modulations of intranasal vasopressin on prosocial learning between reward-seeking and punishment-avoidance

BACKGROUND

As an integral ingredient of human sociality, prosocial behavior requires learning what acts can benefit or harm others. However, it remains unknown how individuals adjust prosocial learning to avoid punishment or to pursue reward. Given that arginine vasopressin (AVP) is a neuropeptide that has been involved in modulating various social behaviors in mammals, it could be a crucial neurochemical facilitator that supports prosocial learning.

METHODS

In 50 placebo controls and 54 participants with AVP administration, we examined the modulation of AVP on the prosocial learning characterized by reward and punishment framework, as well as its underlying neurocomputational mechanisms combining computational modeling, event-related potentials and oscillations.

RESULTS

We found a self-bias that individuals learn to avoid punishment asymmetrically more severely than reward-seeking. Importantly, AVP increased behavioral performances and learning rates when making decisions to avoid losses for others and to obtain gains for self. These behavioral effects were underpinned by larger responses of stimulus-preceding negativity (SPN) to anticipation, as well as higher punishment-related feedback-related negativity (FRN) for prosocial learning and reward-related P300 for proself benefits, while FRN and P300 neural processes were integrated into theta (4-7 Hz) oscillation at the outcome evaluation stage.

CONCLUSIONS

These results suggest that AVP context-dependently up-regulates altruism for concerning others' losses and reward-seeking for self-oriented benefits. Our findings provide insight into the selectively modulatory roles of AVP in prosocial behaviors depending on learning contexts between proself reward-seeking and prosocial punishment-avoidance.

A neurocognitive model of early onset persistent and desistant antisocial behavior in early adulthood

It remains unclear which functional and neurobiological mechanisms are associated with persistent and desistant antisocial behavior in early adulthood. We reviewed the empirical literature and propose a neurocognitive social information processing model for early onset persistent and desistant antisocial behavior in early adulthood, focusing on how young adults evaluate, act upon, monitor, and learn about their goals and self traits. Based on the reviewed literature, we propose that persistent antisocial behavior is characterized by domain-general impairments in self-relevant and goal-related information processing, regulation, and learning, which is accompanied by altered activity in fronto-limbic brain areas. We propose that desistant antisocial development is associated with more effortful information processing, regulation and learning, that possibly balances self-relevant goals and specific situational characteristics. The proposed framework advances insights by considering individual differences such as psychopathic personality traits, and specific emotional characteristics (e.g., valence of social cues), to further illuminate functional and neural mechanisms underlying heterogenous developmental pathways. Finally, we address important open questions and offer suggestions for future research to improve scientific knowledge on general and context-specific expression and development of antisocial behavior in early adulthood.

l-DOPA and oxytocin influence the neurocomputational mechanisms of self-benefitting and prosocial reinforcement learning

Humans learn through reinforcement, particularly when outcomes are unexpected. Recent research suggests similar mechanisms drive how we learn to benefit other people, that is, how we learn to be prosocial. Yet the neurochemical mechanisms underlying such prosocial computations remain poorly understood. Here, we investigated whether pharmacological manipulation of oxytocin and dopamine influence the neurocomputational mechanisms underlying self-benefitting and prosocial reinforcement learning. Using a double-blind placebo-controlled cross-over design, we administered intranasal oxytocin (24 IU), dopamine precursor l-DOPA (100 mg + 25 mg carbidopa), or placebo over three sessions. Participants performed a probabilistic reinforcement learning task with potential rewards for themselves, another participant, or no one, during functional magnetic resonance imaging. Computational models of reinforcement learning were used to calculate prediction errors (PEs) and learning rates. Participants behavior was best explained by a model with different learning rates for each recipient, but these were unaffected by either drug. On the neural level, however, both drugs blunted PE signaling in the ventral striatum and led to negative signaling of PEs in the anterior mid-cingulate cortex, dorsolateral prefrontal cortex, inferior parietal gyrus, and precentral gyrus, compared to placebo, and regardless of recipient. Oxytocin (versus placebo) administration was additionally associated with opposing tracking of self-benefitting versus prosocial PEs in dorsal anterior cingulate cortex, insula and superior temporal gyrus. These findings suggest that both l-DOPA and oxytocin induce a context-independent shift from positive towards negative tracking of PEs during learning. Moreover, oxytocin may have opposing effects on PE signaling when learning to benefit oneself versus another.

Interplay between the oxytocin and opioid systems in regulating social behaviour

The influence of neuromodulators on brain activity and behaviour is undeniably profound, yet our knowledge of the underlying mechanisms, or ability to reliably reproduce effects across varying conditions, is still lacking. Oxytocin, a hormone that acts as a neuromodulator in the brain, is an example of this quandary; it powerfully shapes behaviours across nearly all mammalian species, yet when manipulated exogenously can produce unreliable or sometimes unexpected behavioural results across varying contexts. While current research is rapidly expanding our understanding of oxytocin, interactions between oxytocin and other neuromodulatory systems remain underappreciated in the current literature. This review highlights interactions between oxytocin and the opioid system that serve to influence social behaviour and proposes a parallel-mechanism hypothesis to explain the supralinear effects of combinatorial neuropharmacological approaches. This article is part of the theme issue 'Interplays between oxytocin and other neuromodulators in shaping complex social behaviours'.