DAT1 polymorphism determines L-DOPA effects on learning about others' prosociality

Blocking D2/D3 dopamine receptors in male participants increases volatility of beliefs when learning to trust others

The ability to learn about other people is crucial for human social functioning. Dopamine has been proposed to regulate the precision of beliefs, but direct behavioural evidence of this is lacking. In this study, we investigate how a high dose of the D2/D3 dopamine receptor antagonist sulpiride impacts learning about other people's prosocial attitudes in a repeated Trust game. Using a Bayesian model of belief updating, we show that in a sample of 76 male participants sulpiride increases the volatility of beliefs, which leads to higher precision weights on prediction errors. This effect is driven by participants with genetically conferred higher dopamine availability (Taq1a polymorphism) and remains even after controlling for working memory performance. Higher precision weights are reflected in higher reciprocal behaviour in the repeated Trust game but not in single-round Trust games. Our data provide evidence that the D2 receptors are pivotal in regulating prediction error-driven belief updating in a social context.

Perspectives for the application of neurogenetic research in programming Neurorehabilitation

Certain genetic variants underlie the proper functioning of the nervous system. They affect the nervous system in all aspects - molecular, systemic, cognitive, computational and sensorimotor. The greatest changes in the nervous system take place in the process of its maturation in the period of psychomotor development, as well as during neurorehabilitation, the task of which is to rebuild damaged neuronal pathways, e.g. by facilitating movement or training cognitive functions. Certain genetic polymorphisms affect the effectiveness of the processes of reconstruction or restoration of neural structures, which is clearly reflected in the effects of neurorehabilitation. This review presents the perspectives for the application of neurogenetic research in programming neurorehabilitation by determining the relationship of as many as 16 different genetic polymorphisms with specific functions of importance in rehabilitation. Thanks to this broad view, it may be possible to predict the effectiveness of rehabilitation on the basis of genetic testing, which would significantly contribute to the development of personalized medicine and to the optimal management of medical services in healthcare systems.

Effects of dopamine D2/3 and opioid receptor antagonism on the trade-off between model-based and model-free behaviour in healthy volunteers

Human behaviour requires flexible arbitration between actions we do out of habit and actions that are directed towards a specific goal. Drugs that target opioid and dopamine receptors are notorious for inducing maladaptive habitual drug consumption; yet, how the opioidergic and dopaminergic neurotransmitter systems contribute to the arbitration between habitual and goal-directed behaviour is poorly understood. By combining pharmacological challenges with a well-established decision-making task and a novel computational model, we show that the administration of the dopamine D2/3 receptor antagonist amisulpride led to an increase in goal-directed or 'model-based' relative to habitual or 'model-free' behaviour, whereas the non-selective opioid receptor antagonist naltrexone had no appreciable effect. The effect of amisulpride on model-based/model-free behaviour did not scale with drug serum levels in the blood. Furthermore, participants with higher amisulpride serum levels showed higher explorative behaviour. These findings highlight the distinct functional contributions of dopamine and opioid receptors to goal-directed and habitual behaviour and support the notion that even small doses of amisulpride promote flexible application of cognitive control.

A causal role of estradiol in human reinforcement learning

The sex hormone estradiol is hypothesized to play a key role in human cognition, and reward processing specifically, via increased dopamine D1-receptor signalling. However, the effect of estradiol on reward processing in men has never been established. To fill this gap, we performed a double-blind placebo-controlled study in which men (N = 100) received either a single dose of estradiol (2 mg) or a placebo. Subjects performed a probabilistic reinforcement learning task where they had to choose between two options with varying reward probabilities to maximize monetary reward. Results showed that estradiol administration increased reward sensitivity compared to placebo. This effect was observed in subjects' choices, how much weight they assigned to their previous choices, and subjective reports about the reward probabilities. Furthermore, effects of estradiol were moderated by reward sensitivity, as measured through the BIS/BAS questionnaire. Using reinforcement learning models, we found that behavioral effects of estradiol were reflected in increased learning rates. These results demonstrate a causal role of estradiol within the framework of reinforcement learning, by enhancing reward sensitivity and learning. Furthermore, they provide preliminary evidence for dopamine-related genetic variants moderating the effect of estradiol on reward processing.

Potential role of primed microglia during obesity on the mesocorticolimbic circuit in autism spectrum disorder

Autism spectrum disorder (ASD) is a complex neurodevelopmental disease which involves functional and structural defects in selective central nervous system (CNS) regions that harm function and individual ability to process and respond to external stimuli. Individuals with ASD spend less time engaging in social interaction compared to non-affected subjects. Studies employing structural and functional magnetic resonance imaging reported morphological and functional abnormalities in the connectivity of the mesocorticolimbic reward pathway between the nucleus accumbens and the ventral tegmental area (VTA) in response to social stimuli, as well as diminished medial prefrontal cortex in response to visual cues, whereas stronger reward system responses for the non-social realm (e.g., video games) than social rewards (e.g., approval), associated with caudate nucleus responsiveness in ASD children. Defects in the mesocorticolimbic reward pathway have been modulated in transgenic murine models using D2 dopamine receptor heterozygous (D2+/-) or dopamine transporter knockout mice, which exhibit sociability deficits and repetitive behaviors observed in ASD phenotypes. Notably, the mesocorticolimbic reward pathway is modulated by systemic and central inflammation, such as primed microglia, which occurs during obesity or maternal overnutrition. Therefore, we propose that a positive energy balance during obesity/maternal overnutrition coordinates a systemic and central inflammatory crosstalk that modulates the dopaminergic neurotransmission in selective brain areas of the mesocorticolimbic reward pathway. Here, we will describe how obesity/maternal overnutrition may prime microglia, causing abnormalities in dopamine neurotransmission of the mesocorticolimbic reward pathway, postulating a possible immune role in the development of ASD.

Using reinforcement learning models in social neuroscience: frameworks, pitfalls and suggestions of best practices

The recent years have witnessed a dramatic increase in the use of reinforcement learning (RL) models in social, cognitive and affective neuroscience. This approach, in combination with neuroimaging techniques such as functional magnetic resonance imaging, enables quantitative investigations into latent mechanistic processes. However, increased use of relatively complex computational approaches has led to potential misconceptions and imprecise interpretations. Here, we present a comprehensive framework for the examination of (social) decision-making with the simple Rescorla-Wagner RL model. We discuss common pitfalls in its application and provide practical suggestions. First, with simulation, we unpack the functional role of the learning rate and pinpoint what could easily go wrong when interpreting differences in the learning rate. Then, we discuss the inevitable collinearity between outcome and prediction error in RL models and provide suggestions of how to justify whether the observed neural activation is related to the prediction error rather than outcome valence. Finally, we suggest posterior predictive check is a crucial step after model comparison, and we articulate employing hierarchical modeling for parameter estimation. We aim to provide simple and scalable explanations and practical guidelines for employing RL models to assist both beginners and advanced users in better implementing and interpreting their model-based analyses.

Dopamine manipulations modulate paranoid social inferences in healthy people

Altered dopamine transmission is thought to influence the formation of persecutory delusions. However, despite extensive evidence from clinical studies there is little experimental evidence on how modulating the dopamine system changes social attributions related to paranoia, and the salience of beliefs more generally. Twenty seven healthy male participants received 150mg L-DOPA, 3 mg haloperidol, or placebo in a double-blind, randomised, placebo-controlled study, over three within-subject sessions. Participants completed a multi-round Dictator Game modified to measure social attributions, and a measure of belief salience spanning themes of politics, religion, science, morality, and the paranormal. We preregistered predictions that altering dopamine function would affect (i) attributions of harmful intent and (ii) salience of paranormal beliefs. As predicted, haloperidol reduced attributions of harmful intent across all conditions compared to placebo. L-DOPA reduced attributions of harmful intent in fair conditions compared to placebo. Unexpectedly, haloperidol increased attributions of self-interest about opponents' decisions. There was no change in belief salience within any theme. These results could not be explained by scepticism or subjective mood. Our findings demonstrate the selective involvement of dopamine in social inferences related to paranoia in healthy individuals.

Fairness norm violations in anti-social psychopathic offenders in a repeated trust game

Psychopathic offenders have a high propensity to violate social norms, as indicated for instance by their widespread lying and cheating behaviour. The reasons for their norm violations are not well understood, though, as they are able to recognise norms in a given situation and also punish norm violators. In this study, we investigated whether psychopathic offenders would violate fairness norms during a repeated trust game because of increased profit-maximising concerns. We measured back-transfer decisions in the repeated trust game, and affective arousal by means of skin conductance responses (SCR) in violent offenders with varying degrees of psychopathy, and non-offenders with low-trait psychopathy. Psychopathy in offenders was measured with the Psychopathy Checklist-Revised (PCL-R). In the task, a participant and an interaction partner entrusted each other money for multiple rounds with the goal to earn as much money as possible. Fairness norm violations were positively associated with Factor 2 scores (the lifestyle/anti-social psychopathy subscale) of the PCL-R, but this was not accompanied by clear profit-maximising behaviour. In addition, anticipatory arousal to self-advantageous decisions was higher in all offenders, independent of their degree of psychopathy, compared with non-offenders. The results of our study widen our understanding of social decision-making in psychopathy. They also suggest treatment possibilities in offenders scoring high on Factor 2, targeting empathic concern and related prosocial intentions to overcome norm-violating behaviour.

SLC6A3 Polymorphism Predisposes to Dopamine Overdose in Parkinson's Disease

In Parkinson's disease (PD), cognitive functions mediated by brain regions innervated by ventral tegmental area (VTA) worsen with dopamine replacement therapy, whereas processes relying on regions innervated by the substantia nigra pars compacta (SNc) improve. The SLC6A3 gene encodes the dopamine transporter (DAT). The common 9R polymorphism produces higher DAT concentrations and consequently lower baseline dopamine than SLC6A3 wildtype. Whether SLC6A3 genotype modulates the effect of dopaminergic therapy on cognition in PD is not known. We investigated the effect of dopaminergic therapy and SLC6A3 genotype on encoding and recall of abstract images using the Aggie Figures Learning Test in PD patients. Encoding depends upon brain regions innervated by the VTA, whereas recall is mediated by widespread brain regions, a number innervated by the SNc. We found that dopaminergic therapy worsened encoding of abstract images in 9R carriers only. In contrast, dopaminergic therapy improved recall of abstract images in all PD patients, irrespective of SLC6A3 genotype. Our findings suggest that 9R-carrier PD patients are more predisposed to dopamine overdose and medication-induced impairment of cognitive functions mediated by VTA-innervated brain regions. Interestingly, PD patients without the 9R polymorphism did not show such an impairment. SLC6A3 genotype does not modulate the dopaminergic therapy-induced improvement of functions mediated by SNc-innervated regions in PD patients.

Tandem repeats mediating genetic plasticity in health and disease

Accumulating evidence suggests that many classes of DNA repeats exhibit attributes that distinguish them from other genetic variants, including the fact that they are more liable to mutation; this enables them to mediate genetic plasticity. The expansion of tandem repeats, particularly of short tandem repeats, can cause a range of disorders (including Huntington disease, various ataxias, motor neuron disease, frontotemporal dementia, fragile X syndrome and other neurological disorders), and emerging data suggest that tandem repeat polymorphisms (TRPs) can also regulate gene expression in healthy individuals. TRPs in human genomes may also contribute to the missing heritability of polygenic disorders. A better understanding of tandem repeats and their associated repeatome, as well as their capacity for genetic plasticity via both germline and somatic mutations, is needed to transform our understanding of the role of TRPs in health and disease.

DAT1-Genotype and Menstrual Cycle, but Not Hormonal Contraception, Modulate Reinforcement Learning: Preliminary Evidence

Hormone by genotype interactions have been widely ignored by cognitive neuroscience. Yet, the dependence of cognitive performance on both baseline dopamine (DA) and current 17ß-estradiol (E2) level argues for their combined effect also in the context of reinforcement learning. Here, we assessed how the interaction between the natural rise of E2 in the late follicular phase (FP) and the 40 base-pair variable number tandem repeat polymorphism of the dopamine transporter (DAT1) affects reinforcement learning capacity. 30 women with a regular menstrual cycle performed a probabilistic feedback learning task twice during the early and late FP. In addition, 39 women, who took hormonal contraceptives (HC) to suppress natural ovulation, were tested during the "pill break" and the intake phase of HC. The present data show that DAT1-genotype may interact with transient hormonal state, but only in women with a natural menstrual cycle. We found that carriers of the 9-repeat allele (9RP) experienced a significant decrease in the ability to avoid punishment from early to late FP. Neither homozygote subjects of the 10RP allele, nor subjects from the HC group showed a change in behavior between phases. These data are consistent with neurobiological studies that found that rising E2 may reverse DA transporter function and could enhance DA efflux, which would in turn reduce punishment sensitivity particularly in subjects with a higher transporter density to begin with. Taken together, the present results, although based on a small sample, add to the growing understanding of the complex interplay between different physiological modulators of dopaminergic transmission. They may not only point out the necessity to control for hormonal state in behavioral genetic research, but may offer new starting points for studies in clinical settings.

Effects of dopamine D2/D3 receptor antagonism on human planning and spatial working memory

Psychopharmacological studies in humans suggest important roles for dopamine (DA) D2 receptors in human executive functions, such as cognitive planning and spatial working memory (SWM). However, studies that investigate an impairment of such functions using the selective DA D2/3 receptor antagonist sulpiride have yielded inconsistent results, perhaps because relatively low doses were used. We believe we report for the first time, the effects of a higher (800 mg p.o.) single dose of sulpiride as well as of genetic variation in the DA receptor D2 gene (DA receptor D2 Taq1A polymorphism), on planning and working memory. With 78 healthy male volunteers, we apply a between-groups, placebo-controlled design. We measure outcomes in the difficult versions of the Cambridge Neuropsychological Test Automated Battery One-Touch Stockings of Cambridge and the self-ordered SWM task. Volunteers in the sulpiride group showed significant impairments in planning accuracy and, for the more difficult problems, in SWM. Sulpiride administration speeded response latencies in the planning task on the most difficult problems. Volunteers with at least one copy of the minor allele (A1+) of the DA receptor D2 Taq1A polymorphism showed better SWM capacity, regardless of whether they received sulpiride or placebo. There were no effects on blood pressure, heart rate or subjective sedation. In sum, a higher single dose of sulpiride impairs SWM and executive planning functions, in a manner independent of the DA receptor D2 Taq1A polymorphism.

Reward: From Basic Reinforcers to Anticipation of Social Cues

Reward processing plays a major role in goal-directed behavior and motivation. On the neural level, it is mediated by a complex network of brain structures called the dopaminergic reward system. In the last decade, neuroscientific researchers have become increasingly interested in aspects of social interaction that are experienced as rewarding. Recent neuroimaging studies have provided evidence that the reward system mediates the processing of social stimuli in a manner analogous to nonsocial rewards and thus motivates social behavior. In this context, the neuropeptide oxytocin is assumed to play a key role by activating dopaminergic reward pathways in response to social cues, inducing the rewarding quality of social interactions. Alterations in the dopaminergic reward system have been found in several psychiatric disorders that are accompanied by social interaction and motivation problems, for example autism, attention deficit/hyperactivity disorder, addiction disorders, and schizophrenia.

Dopaminergic Neurotransmission in the Nucleus Accumbens Modulates Social Play Behavior in Rats

Social play behavior is a highly rewarding form of social interaction displayed by young mammals. Social play is important for neurobehavioral development and it has been found to be impaired in several developmental psychiatric disorders. In line with the rewarding properties of social play, we have previously identified the nucleus accumbens (NAc) as an important site of action for endocannabinoid and opioid modulation of this behavior. NAc dopamine has a well-known role in certain components of reward processes, such as incentive motivation. However, its contribution to the positive emotional aspects of social interactions is less clear. Therefore, we investigated the role of dopaminergic neurotransmission in the NAc in social play behavior in rats. We found that intra-NAc infusion of the dopamine releaser/reuptake inhibitor amphetamine increased social play behavior that was dependent on activation of both D1 and D2 dopamine receptors. This increase in social play behavior was mimicked by intra-NAc infusion of the dopamine receptor agonist apomorphine, but not of the dopamine reuptake inhibitor GBR-12909. Blockade of either D1 or D2 NAc dopamine receptors reduced social play in animals highly motivated to play as a result of longer social isolation before testing. Last, blockade of NAc dopamine receptors prevented the play-enhancing effects of endocannabinoid and opioid receptor stimulation. These findings demonstrate an important modulatory role of NAc dopaminergic neurotransmission in social play. Thus, functional activity in the mesolimbic dopamine pathway plays an important role in adaptive social development, whereas abnormal NAc dopamine function may underlie the social impairments observed in developmental psychiatric disorders such as autism, attention deficit hyperactivity disorder or early-onset schizophrenia.

Dopamine modulates egalitarian behavior in humans

Egalitarian motives form a powerful force in promoting prosocial behavior and enabling large-scale cooperation in the human species [1]. At the neural level, there is substantial, albeit correlational, evidence suggesting a link between dopamine and such behavior [2, 3]. However, important questions remain about the specific role of dopamine in setting or modulating behavioral sensitivity to prosocial concerns. Here, using a combination of pharmacological tools and economic games, we provide critical evidence for a causal involvement of dopamine in human egalitarian tendencies. Specifically, using the brain penetrant catechol-O-methyl transferase (COMT) inhibitor tolcapone [4, 5], we investigated the causal relationship between dopaminergic mechanisms and two prosocial concerns at the core of a number of widely used economic games: (1) the extent to which individuals directly value the material payoffs of others, i.e., generosity, and (2) the extent to which they are averse to differences between their own payoffs and those of others, i.e., inequity. We found that dopaminergic augmentation via COMT inhibition increased egalitarian tendencies in participants who played an extended version of the dictator game [6]. Strikingly, computational modeling of choice behavior [7] revealed that tolcapone exerted selective effects on inequity aversion, and not on other computational components such as the extent to which individuals directly value the material payoffs of others. Together, these data shed light on the causal relationship between neurochemical systems and human prosocial behavior and have potential implications for our understanding of the complex array of social impairments accompanying neuropsychiatric disorders involving dopaminergic dysregulation.

Role of dopamine D2 receptors in human reinforcement learning

Influential neurocomputational models emphasize dopamine (DA) as an electrophysiological and neurochemical correlate of reinforcement learning. However, evidence of a specific causal role of DA receptors in learning has been less forthcoming, especially in humans. Here we combine, in a between-subjects design, administration of a high dose of the selective DA D2/3-receptor antagonist sulpiride with genetic analysis of the DA D2 receptor in a behavioral study of reinforcement learning in a sample of 78 healthy male volunteers. In contrast to predictions of prevailing models emphasizing DA's pivotal role in learning via prediction errors, we found that sulpiride did not disrupt learning, but rather induced profound impairments in choice performance. The disruption was selective for stimuli indicating reward, whereas loss avoidance performance was unaffected. Effects were driven by volunteers with higher serum levels of the drug, and in those with genetically determined lower density of striatal DA D2 receptors. This is the clearest demonstration to date for a causal modulatory role of the DA D2 receptor in choice performance that might be distinct from learning. Our findings challenge current reward prediction error models of reinforcement learning, and suggest that classical animal models emphasizing a role of postsynaptic DA D2 receptors in motivational aspects of reinforcement learning may apply to humans as well.

The overdue promise of short tandem repeat variation for heritability

Short tandem repeat (STR) variation has been proposed as a major explanatory factor in the heritability of complex traits in humans and model organisms. However, we still struggle to incorporate STR variation into genotype-phenotype maps. We review here the promise of STRs in contributing to complex trait heritability and highlight the challenges that STRs pose due to their repetitive nature. We argue that STR variants are more likely than single-nucleotide variants to have epistatic interactions, reiterate the need for targeted assays to genotype STRs accurately, and call for more appropriate statistical methods in detecting STR-phenotype associations. Lastly, we suggest that somatic STR variation within individuals may serve as a read-out of disease susceptibility, and is thus potentially a valuable covariate for future association studies.