Serotonin modulates the effects of Pavlovian aversive predictions on response vigor

Direct serotonin release in humans shapes aversive learning and inhibition

The role of serotonin in human behaviour is informed by approaches which allow in vivo modification of synaptic serotonin. However, characterising the effects of increased serotonin signalling in human models of behaviour is challenging given the limitations of available experimental probes, notably selective serotonin reuptake inhibitors. Here we use a now-accessible approach to directly increase synaptic serotonin in humans (a selective serotonin releasing agent) and examine its influence on domains of behaviour historically considered core functions of serotonin. Computational techniques, including reinforcement learning and drift diffusion modelling, explain participant behaviour at baseline and after week-long intervention. Reinforcement learning models reveal that increasing synaptic serotonin reduces sensitivity for outcomes in aversive contexts. Furthermore, increasing synaptic serotonin enhances behavioural inhibition, and shifts bias towards impulse control during exposure to aversive emotional probes. These effects are seen in the context of overall improvements in memory for neutral verbal information. Our findings highlight the direct effects of increasing synaptic serotonin on human behaviour, underlining its role in guiding decision-making within aversive and more neutral contexts, and offering implications for longstanding theories of central serotonin function.

High stakes slow responding, but do not help overcome Pavlovian biases in humans

"Pavlovian" or "motivational" biases are the phenomenon that the valence of prospective outcomes modulates action invigoration: the prospect of reward invigorates actions, while the prospect of punishment suppresses actions. Effects of the valence of prospective outcomes are well established, but it remains unclear how the magnitude of outcomes ("stake magnitude") modulates these biases. In this preregistered study (N = 55), we manipulated stake magnitude (high vs. low) in an orthogonalized Motivational Go/NoGo Task. We tested whether higher stakes (a) strengthen biases or (b) elicit cognitive control recruitment, enhancing the suppression of biases in motivationally incongruent conditions. Confirmatory tests showed that high stakes slowed down responding, especially in motivationally incongruent conditions. However, high stakes did not affect whether a response was made or not, and did not change the magnitude of Pavlovian biases. Reinforcement-learning drift-diffusion models (RL-DDMs) fit to the data suggested that response slowing was best captured by stakes prolonging the non-decision time. There was no effect of the stakes on the response threshold (as in typical speed-accuracy trade-offs). In sum, these results suggest that high stakes slow down responses without affecting the expression of Pavlovian biases in behavior. We speculate that this slowing under high stakes might reflect heightened cognitive control, which is however ineffectively used, or reflect positive conditioned suppression, i.e., the interference between goal-directed and consummatory behaviors, a phenomenon previously observed in rodents that might also exist in humans. Pavlovian biases and slowing under high stakes may arise in parallel to each other.

The selective serotonin reuptake inhibitor sertraline alters learning from aversive reinforcements in patients with depression: evidence from a randomized controlled trial

BACKGROUND

Selective serotonin reuptake inhibitors (SSRIs) are first-line pharmacological treatments for depression and anxiety. However, little is known about how pharmacological action is related to cognitive and affective processes. Here, we examine whether specific reinforcement learning processes mediate the treatment effects of SSRIs.

METHODS

The PANDA trial was a multicentre, double-blind, randomized clinical trial in UK primary care comparing the SSRI sertraline with placebo for depression and anxiety. Participants (N = 655) performed an affective Go/NoGo task three times during the trial and computational models were used to infer reinforcement learning processes.

RESULTS

There was poor task performance: only 54% of the task runs were informative, with more informative task runs in the placebo than in the active group. There was no evidence for the preregistered hypothesis that Pavlovian inhibition was affected by sertraline. Exploratory analyses revealed that in the sertraline group, early increases in Pavlovian inhibition were associated with improvements in depression after 12 weeks. Furthermore, sertraline increased how fast participants learned from losses and faster learning from losses was associated with more severe generalized anxiety symptoms.

CONCLUSIONS

The study findings indicate a relationship between aversive reinforcement learning mechanisms and aspects of depression, anxiety, and SSRI treatment, but these relationships did not align with the initial hypotheses. Poor task performance limits the interpretability and likely generalizability of the findings, and highlights the critical importance of developing acceptable and reliable tasks for use in clinical studies.

FUNDING

This article presents research supported by NIHR Program Grants for Applied Research (RP-PG-0610-10048), the NIHR BRC, and UCL, with additional support from IMPRS COMP2PSYCH (JM, QH) and a Wellcome Trust grant (QH).

Negative emotionality downregulation affects moral choice but not moral judgement of harm: a pharmacological study

Previous neuroscientific research has expounded on the fundamental role played by emotion during moral decision-making. Negative emotionality has been observed to exert a general inhibitory effect towards harmful behaviors against others. Nevertheless, the downregulation of negative affects at different levels of moral processing (e.g. impersonal versus personal moral dilemmas) alongside its possible interactions with other factors (e.g. perspective taking) hasn't been directly assessed; both of which can assist in predicting future moral decision-making. In the present research, we empirically test (Study 1, N = 41) whether downregulating negative emotionality through pharmacological interventions using lorazepam (a GABA receptor agonist), modulate the permissibility of harm to others -i.e. if participants find it more morally permissible to harm others when harm is unavoidable (inevitable harm moral dilemmas), than when it may be avoided (evitable harm moral dilemmas). Furthermore, using another sample (Study 2, N = 31), we assess whether lorazepam's effect is modulated by different perspective-taking conditions during a moral dilemma task -e.g. "is it morally permissible for you to […]?" (1st person perspective), relative to "is it morally permissible for [x individual] to […]?" (3rd person perspective)-, where the outcome of the different scenarios is controlled. The results of both studies converge, revealing an emotion-dependent, rather than an outcome-dependent, pharmacological modulation. Lorazepam only influenced interpersonal moral judgments when not modulated by the evitable/inevitable condition. Furthermore, there was a significant interaction between perspective-taking and drug administration, as lorazepam exerted a larger effect in modulating moral choices rather than moral judgements.

Causal role of the dorsolateral prefrontal cortex in modulating the balance between Pavlovian and instrumental systems in the punishment domain

Previous literature suggests that a balance between Pavlovian and instrumental decision-making systems is critical for optimal decision-making. Pavlovian bias (i.e., approach toward reward-predictive stimuli and avoid punishment-predictive stimuli) often contrasts with the instrumental response. Although recent neuroimaging studies have identified brain regions that may be related to Pavlovian bias, including the dorsolateral prefrontal cortex (dlPFC), it is unclear whether a causal relationship exists. Therefore, we investigated whether upregulation of the dlPFC using transcranial current direct stimulation (tDCS) would reduce Pavlovian bias. In this double-blind study, participants were assigned to the anodal or the sham group; they received stimulation over the right dlPFC for 3 successive days. On the last day, participants performed a reinforcement learning task known as the orthogonalized go/no-go task; this was used to assess each participant's degree of Pavlovian bias in reward and punishment domains. We used computational modeling and hierarchical Bayesian analysis to estimate model parameters reflecting latent cognitive processes, including Pavlovian bias, go bias, and choice randomness. Several computational models were compared; the model with separate Pavlovian bias parameters for reward and punishment domains demonstrated the best model fit. When using a behavioral index of Pavlovian bias, the anodal group showed significantly lower Pavlovian bias in the punishment domain, but not in the reward domain, compared with the sham group. In addition, computational modeling showed that Pavlovian bias parameter in the punishment domain was lower in the anodal group than in the sham group, which is consistent with the behavioral findings. The anodal group also showed a lower go bias and choice randomness, compared with the sham group. These findings suggest that anodal tDCS may lead to behavioral suppression or change in Pavlovian bias in the punishment domain, which will help to improve comprehension of the causal neural mechanism.

Innate cocaine-seeking vulnerability arising from loss of serotonin-mediated aversive effects of cocaine in rats

Cocaine blocks dopamine reuptake, thereby producing rewarding effects that are widely studied. However, cocaine also blocks serotonin uptake, which we show drives, in rats, individually variable aversive effects that depend on serotonin 2C receptors (5-HT2CRs) in the rostromedial tegmental nucleus (RMTg), a major GABAergic afferent to midbrain dopamine neurons. 5-HT2CRs produce depolarizing effects in RMTg neurons that are particularly strong in some rats, leading to aversive effects that reduce acquisition of and relapse to cocaine seeking. In contrast, 5-HT2CR signaling is largely lost after cocaine exposure in other rats, leading to reduced aversive effects and increased cocaine seeking. These results suggest a serotonergic biological marker of cocaine-seeking vulnerability that can be targeted to modulate drug seeking.

Physical activity for cognitive health promotion: An overview of the underlying neurobiological mechanisms

Physical activity is one of the modifiable factors of cognitive decline and dementia with the strongest evidence. Although many influential reviews have illustrated the neurobiological mechanisms of the cognitive benefits of physical activity, none of them have linked the neurobiological mechanisms to normal exercise physiology to help the readers gain a more advanced, comprehensive understanding of the phenomenon. In this review, we address this issue and provide a synthesis of the literature by focusing on five most studied neurobiological mechanisms. We show that the body's adaptations to enhance exercise performance also benefit the brain and contribute to improved cognition. Specifically, these adaptations include, 1), the release of growth factors that are essential for the development and growth of neurons and for neurogenesis and angiogenesis, 2), the production of lactate that provides energy to the brain and is involved in the synthesis of glutamate and the maintenance of long-term potentiation, 3), the release of anti-inflammatory cytokines that reduce neuroinflammation, 4), the increase in mitochondrial biogenesis and antioxidant enzyme activity that reduce oxidative stress, and 5), the release of neurotransmitters such as dopamine and 5-HT that regulate neurogenesis and modulate cognition. We also discussed several issues relevant for prescribing physical activity, including what intensity and mode of physical activity brings the most cognitive benefits, based on their influence on the above five neurobiological mechanisms. We hope this review helps readers gain a general understanding of the state-of-the-art knowledge on the neurobiological mechanisms of the cognitive benefits of physical activity and guide them in designing new studies to further advance the field.

Pavlovian-to-Instrumental Transfer across Mental Disorders: A Review

A mechanism known as Pavlovian-to-instrumental transfer (PIT) describes a phenomenon by which the values of environmental cues acquired through Pavlovian conditioning can motivate instrumental behavior. PIT may be one basic mechanism of action control that can characterize mental disorders on a dimensional level beyond current classification systems. Therefore, we review human PIT studies investigating subclinical and clinical mental syndromes. The literature prevails an inhomogeneous picture concerning PIT. While enhanced PIT effects seem to be present in non-substance-related disorders, overweight people, and most studies with AUD patients, no altered PIT effects were reported in tobacco use disorder and obesity. Regarding AUD and relapsing alcohol-dependent patients, there is mixed evidence of enhanced or no PIT effects. Additionally, there is evidence for aberrant corticostriatal activation and genetic risk, e.g., in association with high-risk alcohol consumption and relapse after alcohol detoxification. In patients with anorexia nervosa, stronger PIT effects elicited by low caloric stimuli were associated with increased disease severity. In patients with depression, enhanced aversive PIT effects and a loss of action-specificity associated with poorer treatment outcomes were reported. Schizophrenic patients showed disrupted specific but intact general PIT effects. Patients with chronic back pain showed reduced PIT effects. We provide possible reasons to understand heterogeneity in PIT effects within and across mental disorders. Further, we strengthen the importance of reliable experimental tasks and provide test-retest data of a PIT task showing moderate to good reliability. Finally, we point toward stress as a possible underlying factor that may explain stronger PIT effects in mental disorders, as there is some evidence that stress per se interacts with the impact of environmental cues on behavior by selectively increasing cue-triggered wanting. To conclude, we discuss the results of the literature review in the light of Research Domain Criteria, suggesting future studies that comprehensively assess PIT across psychopathological dimensions.

Dopamine and serotonin interplay for valence-based spatial learning

Dopamine (DA) and serotonin (5-HT) are important neuromodulators of synaptic plasticity that have been linked to learning from positive or negative outcomes or valence-based learning. In the hippocampus, both affect long-term plasticity but play different roles in encoding uncertainty or predicted reward. DA has been related to positive valence, from reward consumption or avoidance behavior, and 5-HT to aversive encoding. We propose DA produces overall LTP while 5-HT elicits LTD. Here, we compare two reward-modulated spike timing-dependent plasticity (R-STDP) rules to describe the action of these neuromodulators. We examined their role in cognitive performance and flexibility for computational models of the Morris water maze task and reversal learning. Our results show that the interplay of DA and 5-HT improves learning performance and can explain experimental evidence. This study reinforces the importance of neuromodulation in determining the direction of plasticity.

A Role for Serotonin in Modulating Opposing Drive and Brake Circuits of Impulsivity

Impulsivity generally refers to a deficit in inhibition, with a focus on understanding the neural circuits which constitute the "brake" on actions and gratification. It is likely that increased impulsivity can arise not only from reduced inhibition, but also from a heightened or exaggerated excitatory "drive." For example, an action which has more vigor, or is fueled by either increased incentive salience or a stronger action-outcome association, may be harder to inhibit. From this perspective, this review focuses on impulse control as a competition over behavioral output between an initially learned response-reward outcome association, and a subsequently acquired opposing inhibitory association. Our goal is to present a synthesis of research from humans and animal models that supports this dual-systems approach to understanding the behavioral and neural substrates that contribute to impulsivity, with a focus on the neuromodulatory role of serotonin. We review evidence for the role of serotonin signaling in mediating the balance of the "drive" and "brake" circuits. Additionally, we consider parallels of these competing instrumental systems in impulsivity within classical conditioning processes (e.g., extinction) in order to point us to potential behavioral and neural mechanisms that may modulate the competing instrumental associations. Finally, we consider how the balance of these competing associations might contribute to, or be extracted from, our experimental assessments of impulsivity. A careful understanding of the underlying behavioral and circuit level contributions to impulsivity is important for understanding the pathogenesis of increased impulsivity present in a number of psychiatric disorders. Pathological levels of impulsivity in such disorders are likely subserved by deficits in the balance of motivational and inhibitory processes.

Serotonin neurons modulate learning rate through uncertainty

Regulating how fast to learn is critical for flexible behavior. Learning about the consequences of actions should be slow in stable environments, but accelerate when that environment changes. Recognizing stability and detecting change are difficult in environments with noisy relationships between actions and outcomes. Under these conditions, theories propose that uncertainty can be used to modulate learning rates ("meta-learning"). We show that mice behaving in a dynamic foraging task exhibit choice behavior that varied as a function of two forms of uncertainty estimated from a meta-learning model. The activity of dorsal raphe serotonin neurons tracked both types of uncertainty in the foraging task as well as in a dynamic Pavlovian task. Reversible inhibition of serotonin neurons in the foraging task reproduced changes in learning predicted by a simulated lesion of meta-learning in the model. We thus provide a quantitative link between serotonin neuron activity, learning, and decision making.

Testosterone and estradiol affect adolescent reinforcement learning

During adolescence, gonadal hormones influence brain maturation and behavior. The impact of 17β-estradiol and testosterone on reinforcement learning was previously investigated in adults, but studies with adolescents are rare. We tested 89 German male and female adolescents (mean age ± sd = 14.7 ± 1.9 years) to determine the extent 17β-estradiol and testosterone influenced reinforcement learning capacity in a response time adjustment task. Our data showed, that 17β-estradiol correlated with an enhanced ability to speed up responses for reward in both sexes, while the ability to wait for higher reward correlated with testosterone primary in males. This suggests that individual differences in reinforcement learning may be associated with variations in these hormones during adolescence, which may shift the balance between a more reward- and an avoidance-oriented learning style.

Aversive motivation and cognitive control

Aversive motivation plays a prominent role in driving individuals to exert cognitive control. However, the complexity of behavioral responses attributed to aversive incentives creates significant challenges for developing a clear understanding of the neural mechanisms of this motivation-control interaction. We review the animal learning, systems neuroscience, and computational literatures to highlight the importance of experimental paradigms that incorporate both motivational context manipulations and mixed motivational components (e.g., bundling of appetitive and aversive incentives). Specifically, we postulate that to understand aversive incentive effects on cognitive control allocation, a critical contextual factor is whether such incentives are associated with negative reinforcement or punishment. We further illustrate how the inclusion of mixed motivational components in experimental paradigms enables increased precision in the measurement of aversive influences on cognitive control. A sharpened experimental and theoretical focus regarding the manipulation and assessment of distinct motivational dimensions promises to advance understanding of the neural, monoaminergic, and computational mechanisms that underlie the interaction of motivation and cognitive control.

The Effect of Acute Aerobic Exercise on Divergent and Convergent Thinking and Its Influence by Mood

Abundant evidence shows that various forms of physical exercise, even conducted briefly, may improve cognitive functions. However, the effect of physical exercise on creative thinking remains under-investigated, and the role of mood in this effect remains unclear. In the present study, we set out to investigate the effect of an acute bout of aerobic exercise on divergent and convergent thinking and whether this effect depends on the post-exercise mood. Forty healthy young adults were randomly assigned to receive a 15-min exercise or control intervention, before and after which they conducted an alternate use test measuring divergent thinking and an insight problem-solving task measuring convergent thinking. It was found that exercise enhanced divergent thinking in that it increased flexibility and fluency. Importantly, these effects were not mediated by the post-exercise mood in terms of pleasure and vigor. In contrast, the effect on convergent thinking depended on subjects' mood after exercise: subjects reporting high vigor tended to solve more insight problems that were unsolved previously, while those reporting low vigor became less capable of solving previously unsolved problems. These findings suggest that aerobic exercise may affect both divergent and convergent thinking, with the former being mood-independent and the latter mood-dependent. If these findings can be replicated with more rigorous studies, engaging in a bout of mood, particularly vigor-enhancing aerobic exercise, may be considered a useful strategy for gaining insights into previously unsolved problems.

Eating to dare - Nutrition impacts human risky decision and related brain function

Macronutrient composition modulates plasma amino acids that are precursors of neurotransmitters and can impact brain function and decisions. Neurotransmitter serotonin has been shown to regulate not only food intake, but also economic decisions. We investigated whether an acute nutrition-manipulation inducing plasma tryptophan fluctuation affects brain function, thereby affecting risky decisions. Breakfasts differing in carbohydrate/protein ratios were offered to test changes in risky decision-making while metabolic and neural dynamics were tracked. We identified that a high-carbohydrate/protein breakfast increased plasma tryptophan/LNAA (large neutral amino acids) ratio which mapped to individual risk propensity changes. The nutrition-manipulation and tryptophan/LNAA fluctuation effects on risk propensity changes were further modulated by individual differences in body fat mass. Using fMRI, we further identified activation in the parietal lobule during risk-processing, of which activities 1) were sensitive to the tryptophan/LNAA fluctuation, 2) were modulated by individual's body fat mass, and 3) predicted the risk propensity changes in decision-making. Our results provide evidence for a personalized nutrition-driven modulation on human risky decision and its metabolic and neural mechanisms.

Neural signatures of arbitration between Pavlovian and instrumental action selection

Pavlovian associations drive approach towards reward-predictive cues, and avoidance of punishment-predictive cues. These associations “misbehave” when they conflict with correct instrumental behavior. This raises the question of how Pavlovian and instrumental influences on behavior are arbitrated. We test a computational theory according to which Pavlovian influence will be stronger when inferred controllability of outcomes is low. Using a model-based analysis of a Go/NoGo task with human subjects, we show that theta-band oscillatory power in frontal cortex tracks inferred controllability, and that these inferences predict Pavlovian action biases. Functional MRI data revealed an inferior frontal gyrus correlate of action probability and a ventromedial prefrontal correlate of outcome valence, both of which were modulated by inferred controllability.

Using a combination of computational modeling, neuroimaging (both EEG and fMRI), and behavioral analysis, we present evidence for a dual-process architecture in which Pavlovian and instrumental action values are adaptively combined through a Bayesian arbitration mechanism. Building on prior research, we find neural signatures of this arbitration mechanism in frontal cortex. In particular, we show that trial-by-trial changes in Pavlovian influences on action can be predicted by our computational model, and are reflected in midfrontal theta power, as well as inferior frontal and ventromedial prefrontal cortex fMRI responses.

Evaluating the Effect of Inert Recruiting on Blood Donations Immediately After the Consecutive Earthquakes

OBJECTIVE

Disasters can have impact on the demand and supply of blood, with such a difficult perspective, planning of an appropriate response to counterbalance the need for blood is of paramount importance. The primary objective of this study was to evaluate how the impact of blood imbalances may be absorbed by inert recruitment of donors during 2 life-threatening earthquakes that shook Taiwan on the same date in 2016 and 2018.

METHOD

A retrospective database search from blood bank registries was developed.

RESULTS

Despite the public efforts to restrain the flow, a 3- to 4-fold increase in volunteers responded to the earthquakes. This surge alleviated after a day and did not contribute to sub-par collections. Those who donated more than usual immediately after the event were identified as first-time, younger, and female populations. The hospitals providing inpatient care to the injured transfused a slightly decreased amount of packed red cells, whereas the use of whole blood, platelets, and plasma remained stable. The inert recruiting was effective in reducing the duration of donor overabundance.

CONCLUSION

Compared with other examples, the inert recruiting approach was effective in reducing the duration of donor overabundance to 1 day and may be useful for disaster preparedness of transfusion supplies.

Serotonin depletion amplifies distinct human social emotions as a function of individual differences in personality

Serotonin is involved in a wide range of mental capacities essential for navigating the social world, including emotion and impulse control. Much recent work on serotonin and social functioning has focused on decision-making. Here we investigated the influence of serotonin on human emotional reactions to social conflict. We used a novel computerised task that required mentally simulating social situations involving unjust harm and found that depleting the serotonin precursor tryptophan-in a double-blind randomised placebo-controlled design-enhanced emotional responses to the scenarios in a large sample of healthy volunteers (n = 73), and interacted with individual differences in trait personality to produce distinctive human emotions. Whereas guilt was preferentially elevated in highly empathic participants, annoyance was potentiated in those high in trait psychopathy, with medium to large effect sizes. Our findings show how individual differences in personality, when combined with fluctuations of serotonin, may produce diverse emotional phenotypes. This has implications for understanding vulnerability to psychopathology, determining who may be more sensitive to serotonin-modulating treatments, and casts new light on the functions of serotonin in emotional processing.

Serotonin depletion impairs both Pavlovian and instrumental reversal learning in healthy humans

Serotonin is involved in updating responses to changing environmental circumstances. Optimising behaviour to maximise reward and minimise punishment may require shifting strategies upon encountering new situations. Likewise, autonomic responses to threats are critical for survival yet must be modified as danger shifts from one source to another. Whilst numerous psychiatric disorders are characterised by behavioural and autonomic inflexibility, few studies have examined the contribution of serotonin in humans. We modelled both processes, respectively, in two independent experiments (N = 97). Experiment 1 assessed instrumental (stimulus-response-outcome) reversal learning whereby individuals learned through trial and error which action was most optimal for obtaining reward or avoiding punishment initially, and the contingencies subsequently reversed serially. Experiment 2 examined Pavlovian (stimulus-outcome) reversal learning assessed by the skin conductance response: one innately threatening stimulus predicted receipt of an uncomfortable electric shock and another did not; these contingencies swapped in a reversal phase. Upon depleting the serotonin precursor tryptophan-in a double-blind randomised placebo-controlled design-healthy volunteers showed impairments in updating both actions and autonomic responses to reflect changing contingencies. Reversal deficits in each domain, furthermore, were correlated with the extent of tryptophan depletion. Initial Pavlovian conditioning, moreover, which involved innately threatening stimuli, was potentiated by depletion. These results translate findings in experimental animals to humans and have implications for the neurochemical basis of cognitive inflexibility.

The Role of Tryptophan and Tyrosine in Executive Function and Reward Processing

The serotonergic precursor tryptophan and the dopaminergic precursor tyrosine have been shown to be important modulators of mood, behaviour and cognition. Specifically, research on the function of tryptophan has characterised this molecule as particularly relevant in the context of pathological disorders such as depression. Moreover, a large body of evidence has now been accumulated to suggest that tryptophan may also be involved in executive function and reward processing. Despite some clear differentiation with tryptophan, the data reviewed in this paper illustrates that tyrosine shares similar functions with tryptophan in the regulation of executive function and reward, and that these processes in turn, rather than acting in isolation, causally influence each other.

Sub-second Dopamine and Serotonin Signaling in Human Striatum during Perceptual Decision-Making

Recent animal research indicates that dopamine and serotonin, neuromodulators traditionally linked to appetitive and aversive processes, are also involved in sensory inference and decisions based on such inference. We tested this hypothesis in humans by monitoring sub-second striatal dopamine and serotonin signaling during a visual motion discrimination task that separates sensory uncertainty from decision difficulty in a factorial design. Caudate nucleus recordings (n = 4) revealed multi-scale encoding: in three participants, serotonin tracked sensory uncertainty, and, in one participant, both dopamine and serotonin tracked deviations from expected trial transitions within our factorial design. Putamen recordings (n = 1) supported a cognition-action separation between caudate nucleus and putamen—a striatal sub-division unique to primates—with both dopamine and serotonin tracking decision times. These first-of-their-kind observations in the human brain reveal a role for sub-second dopamine and serotonin signaling in non-reward-based aspects of cognition and action.

•

Dopamine and serotonin are measured in human striatum during awake decision-making

•

Serotonin tracks sensory uncertainty in caudate nucleus

•

Dopamine and serotonin track sensory statistics in caudate nucleus

•

Dopamine and serotonin track decision times in putamen

Beyond cardiovascular medicine: potential future uses of icosapent ethyl

The REDUCE-IT trial demonstrated that icosapent ethyl, an ethyl ester of eicosapentaenoic acid (EPA), reduced cardiovascular events in an at-risk population by a substantial degree. While the cardiovascular protective properties of this compound are now proven, several other potential uses are being actively explored in clinical studies. These areas of investigation include cancer, inflammatory bowel disease, infections, Alzheimer's disease, dementia, and depression. The next decade promises to deepen our understanding of the beneficial effects that EPA may offer beyond cardiovascular risk reduction.

Effects of serotonin and dopamine depletion on neural prediction computations during social learning

We have previously shown that individuals with high depression scores demonstrate impaired behavioral and neural responses during social learning. Given that depression is associated with altered dopamine (DA) and serotonin (5-HT) functioning, the current study aimed to elucidate the role of these neurotransmitters in the social learning process using a dietary depletion manipulation. In a double-blind design, 70 healthy volunteers were randomly allocated to a 5-HT depletion (N = 24), DA depletion (N = 24), or placebo (N = 22) group. Participants performed a social learning task during fMRI scanning, as part of which they learned associations between name cues and rewarding (happy faces) or aversive (fearful faces) social outcomes. Behaviorally, 5-HT depleted subjects demonstrated impaired social reward learning compared to placebo controls, with a marginal effect in the same direction in the DA depletion group. On the neural level, computational modeling-based fMRI analyses revealed that 5-HT depletion altered social reward prediction signals in the insula, temporal lobe, and prefrontal cortex, while DA depletion affected social reward prediction encoding only in the prefrontal cortex. These results indicate that 5-HT depletion impairs learning from social rewards, on both the behavioral and the neural level, while DA depletion has a less extensive effect. Interestingly, the behavioral and neural responses observed after 5-HT depletion in the current study closely resemble our previous findings in individuals with high depression scores using the same task. It may thus be the case that decreased 5-HT levels contribute to social learning deficits in depression.

The 4 D's of Pellagra and Progress

Nicotinamide homeostasis is a candidate common denominator to explain smooth transitions, whether demographic, epidemiological or economic. This 'NAD world', dependent on hydrogen-based energy, is not widely recognised as it is neither measured nor viewed from a sufficiently multi-genomic or historical perspective. Reviewing the importance of meat and nicotinamide balances during our co-evolution, recent history suggests that populations only modernise and age well with low fertility on a suitably balanced diet. Imbalances on the low meat side lead to an excess of infectious disease, short lives and boom-bust demographics. On the high side, meat has led to an excess of degenerative, allergic and metabolic disease and low fertility. A 'Goldilocks' diet derived from mixed and sustainable farming (preserving the topsoil) allows for high intellectual capital, height and good health with controlled population growth resulting in economic growth and prosperity. Implementing meat equity worldwide could lead to progress for future generations on 'spaceship' earth by establishing control over population quality, thermostat and biodiversity, if it is not already too late.

The neurochemical substrates of habitual and goal-directed control

Our daily decisions are governed by the arbitration between goal-directed and habitual strategies. However, the neurochemical basis of this arbitration is unclear. We assessed the contribution of dopaminergic, serotonergic, and opioidergic systems to this balance across reward and loss domains. Thirty-nine participants (17 healthy controls, 15 patients with pathological gambling, and 7 with binge eating disorder) underwent positron emission tomography (PET) imaging with [¹⁸F]FDOPA, [¹¹C]MADAM and [¹¹C]carfentanil to assess presynaptic dopamine, and serotonin transporter and mu-opioid receptor binding potential. Separately, participants completed a modified two-step task, which quantifies the degree to which decision-making is influenced by goal-directed or habitual strategies. All participants completed a version with reward outcomes; healthy controls additionally completed a version with loss outcomes. In the context of rewarding outcomes, we found that greater serotonin transporter binding potential in prefrontal regions was associated with habitual control, while greater serotonin transporter binding potential in the putamen was marginally associated with goal-directed control; however, the findings were no longer significant when controlling for the opposing valence (loss). In blocks with loss outcomes, we found that the opioidergic system, specifically greater [¹¹C]carfentanil binding potential, was positively associated with goal-directed control and negatively associated with habit-directed control. Our findings illuminate the complex neurochemical basis of goal-directed and habitual behavior, implicating differential roles for prefrontal and subcortical serotonin in decision-making across healthy and pathological populations.

Brain eicosapentaenoic acid metabolism as a lead for novel therapeutics in major depression

The results of several meta-analyses suggest that eicosapentaenoic acid (EPA) supplementation is therapeutic in managing the symptoms of major depression. It was previously assumed that because EPA is extremely low in the brain it did not cross the blood-brain barrier and any therapeutic effects it exerted would be via the periphery. However, more recent studies have established that EPA does enter the brain, but is rapidly metabolised following entry. While EPA does not accumulate within the brain, it is present in microglia and homeostatic mechanisms may regulate its esterification to phospholipids that serve important roles in cell signaling. Furthermore, a variety of signaling molecules from EPA have been described in the periphery and they have the potential to exert effects within the brain. If EPA is confirmed to be therapeutic in major depression as a result of adequately powered randomized clinical trials, future research on brain EPA metabolism could lead to the discovery of novel targets for treating or preventing major depression.

Reward and avoidance learning in the context of aversive environments and possible implications for depressive symptoms

BACKGROUND

Aversive stimuli in the environment influence human actions. This includes valence-dependent influences on action selection, e.g., increased avoidance but decreased approach behavior. However, it is yet unclear how aversive stimuli interact with complex learning and decision-making in the reward and avoidance domain. Moreover, the underlying computational mechanisms of these decision-making biases are unknown.

METHODS

To elucidate these mechanisms, 54 healthy young male subjects performed a two-step sequential decision-making task, which allows to computationally model different aspects of learning, e.g., model-free, habitual, and model-based, goal-directed learning. We used a within-subject design, crossing task valence (reward vs. punishment learning) with emotional context (aversive vs. neutral background stimuli). We analyzed choice data, applied a computational model, and performed simulations.

RESULTS

Whereas model-based learning was not affected, aversive stimuli interacted with model-free learning in a way that depended on task valence. Thus, aversive stimuli increased model-free avoidance learning but decreased model-free reward learning. The computational model confirmed this effect: the parameter lambda that indicates the influence of reward prediction errors on decision values was increased in the punishment condition but decreased in the reward condition when aversive stimuli were present. Further, by using the inferred computational parameters to simulate choice data, our effects were captured. Exploratory analyses revealed that the observed biases were associated with subclinical depressive symptoms.

CONCLUSION

Our data show that aversive environmental stimuli affect complex learning and decision-making, which depends on task valence. Further, we provide a model of the underlying computations of this affective modulation. Finally, our finding of increased decision-making biases in subjects reporting subclinical depressive symptoms matches recent reports of amplified Pavlovian influences on action selection in depression and suggests a potential vulnerability factor for mood disorders. We discuss our findings in the light of the involvement of the neuromodulators serotonin and dopamine.

Depression is associated with enhanced aversive Pavlovian control over instrumental behaviour

The dynamic modulation of instrumental behaviour by conditioned Pavlovian cues is an important process in decision-making. Patients with major depressive disorder (MDD) are known to exhibit mood-congruent biases in information processing, which may occur due to Pavlovian influences, but this hypothesis has never been tested directly in an unmedicated sample. To address this we tested unmedicated MDD patients and healthy volunteers on a computerized Pavlovian-Instrumental Transfer (PIT) task designed to separately examine instrumental approach and withdrawal actions in the context of Pavlovian appetitive and aversive cues. This design allowed us to directly measure the degree to which Pavlovian cues influence instrumental responding. Depressed patients were profoundly influenced by aversive Pavlovian stimuli, to a significantly greater degree than healthy volunteers. This was the case for instrumental behaviour both in the approach condition (in which aversive Pavlovian cues inhibited ‘go’ responses), and in the withdrawal condition (in which aversive Pavlovian cues facilitated ‘go’ responses). Exaggerated aversive PIT provides a potential cognitive mechanism for biased emotion processing in major depression. This finding also has wider significance for the understanding of disrupted motivational processing in neuropsychiatric disorders.

The Protective Action Encoding of Serotonin Transients in the Human Brain

The role of serotonin in human brain function remains elusive due, at least in part, to our inability to measure rapidly the local concentration of this neurotransmitter. We used fast-scan cyclic voltammetry to infer serotonergic signaling from the striatum of 14 brains of human patients with Parkinson's disease. Here we report these novel measurements and show that they correlate with outcomes and decisions in a sequential investment game. We find that serotonergic concentrations transiently increase as a whole following negative reward prediction errors, while reversing when counterfactual losses predominate. This provides initial evidence that the serotonergic system acts as an opponent to dopamine signaling, as anticipated by theoretical models. Serotonin transients on one trial were also associated with actions on the next trial in a manner that correlated with decreased exposure to poor outcomes. Thus, the fluctuations observed for serotonin appear to correlate with the inhibition of over-reactions and promote persistence of ongoing strategies in the face of short-term environmental changes. Together these findings elucidate a role for serotonin in the striatum, suggesting it encodes a protective action strategy that mitigates risk and modulates choice selection particularly following negative environmental events.

Opinion on monoaminergic contributions to traits and temperament

This article critically reviews evidence relating temperamental traits and personality factors to the monoamine neurotransmitters, especially dopamine and serotonin. The genetic evidence is not yet considered to be conclusive and it is argued that basic neuroscience research on the neural basis of behaviour in experimental animals should be taken more into account. While questionnaire and lexical methodology including the 'Five Factor' theory has been informative (mostly for the traits relevant to social functioning, i.e. personality), biologically oriented approaches should be employed with more objective, theoretically grounded measures of cognition and behaviour, combined with neuroimaging and psychopharmacology, where appropriate. This strategy will enable specific functions of monoamines and other neuromodulators such as acetylcholine and neuropeptides (such as orexin) to be defined with respect to their roles in modulating activity in specific neural networks-leading to a more realistic definition of their interactive roles in complex, biologically based traits (i.e. temperament).This article is part of the theme issue 'Diverse perspectives on diversity: multi-disciplinary approaches to taxonomies of individual differences'.

Activation of serotonin neurons promotes active persistence in a probabilistic foraging task

The neuromodulator serotonin (5-HT) has been implicated in a variety of functions that involve patience or impulse control. Many of these effects are consistent with a long-standing theory that 5-HT promotes behavioral inhibition, a motivational bias favoring passive over active behaviors. To further test this idea, we studied the impact of 5-HT in a probabilistic foraging task, in which mice must learn the statistics of the environment and infer when to leave a depleted foraging site for the next. Critically, mice were required to actively nose-poke in order to exploit a given site. We show that optogenetic activation of 5-HT neurons in the dorsal raphe nucleus increases the willingness of mice to actively attempt to exploit a reward site before giving up. These results indicate that behavioral inhibition is not an adequate description of 5-HT function and suggest that a unified account must be based on a higher-order function.

Serotonin enhances the impact of health information on food choice

Serotonin has been implicated in promoting self-control, regulation of hunger and physiological homeostasis, and regulation of caloric intake. However, it remains unclear whether the effects of serotonin on caloric intake reflect purely homeostatic mechanisms, or whether serotonin also modulates cognitive processes involved in dietary decision making. We investigated the effects of an acute dose of the serotonin reuptake inhibitor citalopram on choices between food items that differed along taste and health attributes, compared with placebo and the noradrenaline reuptake inhibitor atomoxetine. Twenty-seven participants attended three sessions and received single doses of atomoxetine, citalopram, and placebo in a double-blind randomised cross-over design. Relative to placebo, citalopram increased choices of more healthy foods over less healthy foods. Citalopram also increased the emphasis on health considerations in decisions. Atomoxetine did not affect decision making relative to placebo. The results support the hypothesis that serotonin may influence food choice by enhancing a focus on long-term goals. The findings are relevant for understanding decisions about food consumption and also for treating health conditions such as eating disorders and obesity.

Neuromodulatory Systems and Their Interactions: A Review of Models, Theories, and Experiments

Neuromodulatory systems, including the noradrenergic, serotonergic, dopaminergic, and cholinergic systems, track environmental signals, such as risks, rewards, novelty, effort, and social cooperation. These systems provide a foundation for cognitive function in higher organisms; attention, emotion, goal-directed behavior, and decision-making derive from the interaction between the neuromodulatory systems and brain areas, such as the amygdala, frontal cortex, hippocampus, and sensory cortices. Given their strong influence on behavior and cognition, these systems also play a key role in disease states and are the primary target of many current treatment strategies. The fact that these systems interact with each other either directly or indirectly, however, makes it difficult to understand how a failure in one or more systems can lead to a particular symptom or pathology. In this review, we explore experimental evidence, as well as focus on computational and theoretical models of neuromodulation. Better understanding of neuromodulatory systems may lead to the development of novel treatment strategies for a number of brain disorders.

Pavlovian Control of Escape and Avoidance

To survive in complex environments, animals need to have mechanisms to select effective actions quickly, with minimal computational costs. As perhaps the computationally most parsimonious of these systems, Pavlovian control accomplishes this by hardwiring specific stereotyped responses to certain classes of stimuli. It is well documented that appetitive cues initiate a Pavlovian bias toward vigorous approach; however, Pavlovian responses to aversive stimuli are less well understood. Gaining a deeper understanding of aversive Pavlovian responses, such as active avoidance, is important given the critical role these behaviors play in several psychiatric conditions. The goal of the current study was to establish a behavioral and computational framework to examine aversive Pavlovian responses (activation vs. inhibition) depending on the proximity of an aversive state (escape vs. avoidance). We introduce a novel task in which participants are exposed to primary aversive (noise) stimuli and characterized behavior using a novel generative computational model. This model combines reinforcement learning and drift-diffusion models so as to capture effects of invigoration/inhibition in both explicit choice behavior as well as changes in RT. Choice and RT results both suggest that escape is associated with a bias for vigorous action, whereas avoidance is associated with behavioral inhibition. These results lay a foundation for future work seeking insights into typical and atypical aversive Pavlovian responses involved in psychiatric disorders, allowing us to quantify both implicit and explicit indices of vigorous choice behavior in the context of aversion.

Interactions between metabolic, reward and cognitive processes in appetite control: Implications for novel weight management therapies

Traditional models of appetite control have emphasised the role of parallel homeostatic and hedonic systems, but more recently the distinction between independent homeostatic and hedonic systems has been abandoned in favour of a framework that emphasises the cross talk between the neurochemical substrates of the two systems. In addition, evidence has emerged more recently, that higher level cognitive functions such as learning, memory and attention play an important role in everyday appetite control and that homeostatic signals also play a role in cognition. Here, we review this evidence and present a comprehensive model of the control of appetite that integrates cognitive, homeostatic and reward mechanisms. We discuss the implications of this model for understanding the factors that may contribute to disordered patterns of eating and suggest opportunities for developing more effective treatment approaches for eating disorders and weight management.

An Update on the Role of Serotonin and its Interplay with Dopamine for Reward

The specific role of serotonin and its interplay with dopamine (DA) in adaptive, reward guided behavior as well as drug dependance, still remains elusive. Recently, novel methods allowed cell type specific anatomical, functional and interventional analyses of serotonergic and dopaminergic circuits, promising significant advancement in understanding their functional roles. Furthermore, it is increasingly recognized that co-release of neurotransmitters is functionally relevant, understanding of which is required in order to interpret results of pharmacological studies and their relationship to neural recordings. Here, we review recent animal studies employing such techniques with the aim to connect their results to effects observed in human pharmacological studies and subjective effects of drugs. It appears that the additive effect of serotonin and DA conveys significant reward related information and is subjectively highly euphorizing. Neither DA nor serotonin alone have such an effect. This coincides with optogenetically targeted recordings in mice, where the dopaminergic system codes reward prediction errors (PE), and the serotonergic system mainly unsigned PE. Overall, this pattern of results indicates that joint activity between both systems carries essential reward information and invites parallel investigation of both neurotransmitter systems.

Threat of shock and aversive inhibition: Induced anxiety modulates Pavlovian-instrumental interactions

Anxiety can be an adaptive response to potentially threatening situations. However, if experienced in inappropriate contexts, it can also lead to pathological and maladaptive anxiety disorders. Experimentally, anxiety can be induced in healthy individuals using the threat of shock (ToS) paradigm. Accumulating work with this paradigm suggests that anxiety promotes harm–avoidant mechanisms through enhanced inhibitory control. However, the specific cognitive mechanisms underlying anxiety-linked inhibitory control are unclear. Critically, behavioral inhibition can arise from at least 2 interacting valuation systems: instrumental (a goal-directed system) and Pavlovian (a “hardwired” reflexive system). The present study (N = 62) replicated a study showing improved response inhibition under ToS in healthy participants, and additionally examined the impact of ToS on aversive and appetitive Pavlovian-instrumental interactions in a reinforced go/no-go task. When Pavlovian and instrumental systems were in conflict, ToS increased inhibition to aversive events, while leaving appetitive interactions unperturbed. We argue that anxiety promotes avoidant behavior in potentially harmful situations by potentiating aversive Pavlovian reactions (i.e., promoting avoidance in the face of threats). Critically, such a mechanism would drive adaptive harm–avoidant behavior in threatening situations where Pavlovian and instrumental processes are aligned, but at the same time, result in maladaptive behaviors when misaligned and where instrumental control would be advantageous. This has important implications for our understanding of the mechanisms that underlie pathological anxiety.

Pavlovian influences on learning differ between rats and mice in a counter-balanced Go/NoGo judgement bias task

Judgement bias tests of animal affect and hence welfare assume that the animal's responses to ambiguous stimuli, which may herald positive or negative outcomes, are under instrumental control and reflect 'optimism' or 'pessimism' about what will happen. However, Pavlovian control favours responses (e.g. approach or withdrawal) according to the valence associated with a stimulus, rather than the anticipated response outcomes. Typically, positive contexts promote action and approach whilst negative contexts promote inhibition or withdrawal. The prevalence of Go-for-reward (Go-pos) and NoGo-to-avoid-punishment (NoGo-neg) judgement bias tasks reflects this Pavlovian influence. A Pavlovian increase or decrease in activity or vigour has also been argued to accompany positive or negative affective states, and this may interfere with instrumental Go or NoGo decisions under ambiguity based on anticipated decision outcomes. One approach to these issues is to develop counter-balanced Go-pos/NoGo-neg and Go-neg/NoGo-pos tasks. Here we implement such tasks in Sprague Dawley rats and C57BL/6J mice using food and air-puff as decision outcomes. We find striking species/strain differences with rats achieving criterion performance on the Go-pos/NoGo-neg task but failing to learn the Go-neg/NoGo-pos task, in line with predictions, whilst mice do exactly the opposite. Pavlovian predispositions may thus differ between species, for example reflecting foraging and predation ecology and/or baseline activity rates. Learning failures are restricted to cues predicting a negative outcome; use of a more powerful air-puff stimulus may thus allow implementation of a fully counter-balanced task. Rats and mice achieve criterion faster than in comparable automated tasks and also show the expected generalisation of responses across ambiguous tones. A fully counter-balanced task thus offers a potentially rapidly implemented and automated method for assessing animal welfare, identifying welfare problems and areas for welfare improvement and 3Rs Refinement, and assessing the effectiveness of refinements.

Vigour in active avoidance

It would be maladaptive to learn about catastrophes by trial and error alone. Investment in planning and effort are necessary. Devoting too many resources to averting disaster, however, can impair quality of life, as in anxiety and paranoia. Here, we developed a novel task to explore how people adjust effort expenditure (vigor) so as to avoid negative consequences. Our novel paradigm is immersive, enabling us to measure vigor in the context of (simulated) disaster. We found that participants (N = 118) exerted effort to avoid disaster-associated states, adjusting their effort expenditure according to the baseline probability of catastrophe, in agreement with theoretical predictions. Furthermore, negative subjective emotional states were associated both with threat level and with increasing vigor in the face of disaster. We describe for the first time effort expenditure in the context of irreversible losses, with important implications for disorders marked by excessive avoidance.

Beyond negative valence: 2-week administration of a serotonergic antidepressant enhances both reward and effort learning signals

To make good decisions, humans need to learn about and integrate different sources of appetitive and aversive information. While serotonin has been linked to value-based decision-making, its role in learning is less clear, with acute manipulations often producing inconsistent results. Here, we show that when the effects of a selective serotonin reuptake inhibitor (SSRI, citalopram) are studied over longer timescales, learning is robustly improved. We measured brain activity with functional magnetic resonance imaging (fMRI) in volunteers as they performed a concurrent appetitive (money) and aversive (effort) learning task. We found that 2 weeks of citalopram enhanced reward and effort learning signals in a widespread network of brain regions, including ventromedial prefrontal and anterior cingulate cortex. At a behavioral level, this was accompanied by more robust reward learning. This suggests that serotonin can modulate the ability to learn via a mechanism that is independent of stimulus valence. Such effects may partly underlie SSRIs’ impact in treating psychological illnesses. Our results highlight both a specific function in learning for serotonin and the importance of studying its role across longer timescales.

Drugs acting on the neurotransmitter serotonin in the brain are commonly prescribed to treat depression, but we still lack a complete understanding of their effects on the brain and behavior. We do, however, know that patients who suffer from depression learn about the links between their choices and pleasant and unpleasant outcomes in a different manner than healthy controls. Neural markers of learning are also weakened in depressed people. Here, we looked at the effects of a short-term course (2 weeks) of a serotonergic antidepressant on brain and behavior in healthy volunteers while they learnt to predict what consequences their choices had in a simple computer task. We found that the antidepressant increased how strongly brain areas concerned with predictions of pleasant and unpleasant consequences became active during learning of the task. At the same time, participants who had taken the antidepressant also performed better on the task. Our results suggest that serotonergic drugs might exert their beneficial clinical effects by changing how the brain learns.

Modeling Trait Anxiety: From Computational Processes to Personality

Computational methods are increasingly being applied to the study of psychiatric disorders. Often, this involves fitting models to the behavior of individuals with subclinical character traits that are known vulnerability factors for the development of psychiatric conditions. Anxiety disorders can be examined with reference to the behavior of individuals high in "trait" anxiety, which is a known vulnerability factor for the development of anxiety and mood disorders. However, it is not clear how this self-report measure relates to neural and behavioral processes captured by computational models. This paper reviews emerging computational approaches to the study of trait anxiety, specifying how interacting processes susceptible to analysis using computational models could drive a tendency to experience frequent anxious states and promote vulnerability to the development of clinical disorders. Existing computational studies are described in the light of this perspective and appropriate targets for future studies are discussed.

The role of serotonin in personality inference: tryptophan depletion impairs the identification of neuroticism in the face

Serotonergic mechanisms mediate the expression of personality traits (such as impulsivity, aggression and anxiety) that are linked to vulnerability to psychological illnesses, and modulate the identification of emotional expressions in the face as well as learning about broader classes of appetitive and aversive signals. Faces with neutral expressions signal a variety of socially relevant information, such that inferences about the big five personality traits, including Neuroticism, Extraversion and Agreeableness, can be accurately made on the basis of emotionally neutral facial photographs. Given the close link between Neuroticism and psychological distress, we investigated the effects of diminished central serotonin activity (achieved by tryptophan depletion) upon the accuracy of 52 healthy (non-clinical) adults' discriminations of personality from facial characteristics. All participants were able to discriminate reliably four of the big five traits. However, the tryptophan-depleted participants were specifically less accurate in discriminating Neuroticism than the matched non-depleted participants. These data suggest that central serotonin activity modulates the identification of not only negative facial emotional expression but also a broader class of signals about personality characteristics linked to psychological distress.

Cognitive Bias in Ambiguity Judgements: Using Computational Models to Dissect the Effects of Mild Mood Manipulation in Humans

Positive and negative moods can be treated as prior expectations over future delivery of rewards and punishments. This provides an inferential foundation for the cognitive (judgement) bias task, now widely-used for assessing affective states in non-human animals. In the task, information about affect is extracted from the optimistic or pessimistic manner in which participants resolve ambiguities in sensory input. Here, we report a novel variant of the task aimed at dissecting the effects of affect manipulations on perceptual and value computations for decision-making under ambiguity in humans. Participants were instructed to judge which way a Gabor patch (250ms presentation) was leaning. If the stimulus leant one way (e.g. left), pressing the REWard key yielded a monetary WIN whilst pressing the SAFE key failed to acquire the WIN. If it leant the other way (e.g. right), pressing the SAFE key avoided a LOSS whilst pressing the REWard key incurred the LOSS. The size (0–100 UK pence) of the offered WIN and threatened LOSS, and the ambiguity of the stimulus (vertical being completely ambiguous) were varied on a trial-by-trial basis, allowing us to investigate how decisions were affected by differing combinations of these factors. Half the subjects performed the task in a ‘Pleasantly’ decorated room and were given a gift (bag of sweets) prior to starting, whilst the other half were in a bare ‘Unpleasant’ room and were not given anything. Although these treatments had little effect on self-reported mood, they did lead to differences in decision-making. All subjects were risk averse under ambiguity, consistent with the notion of loss aversion. Analysis using a Bayesian decision model indicated that Unpleasant Room subjects were (‘pessimistically’) biased towards choosing the SAFE key under ambiguity, but also weighed WINS more heavily than LOSSes compared to Pleasant Room subjects. These apparently contradictory findings may be explained by the influence of affect on different processes underlying decision-making, and the task presented here offers opportunities for further dissecting such processes.

Peripheral Serotonin 1B Receptor Transcription Predicts the Effect of Acute Tryptophan Depletion on Risky Decision-Making

BACKGROUND

The effects of acute tryptophan depletion on human decision-making suggest that serotonin modulates the processing of rewards and punishments. However, few studies have assessed which of the many types of serotonin receptors are responsible.

METHODS

Using a within-subject, double-blind, sham-controlled design in 26 subjects, we examined whether individual differences in serotonin system gene transcription, measured in peripheral blood, predicted the effect of acute tryptophan depletion on decision-making. Participants performed a task in which they chose between successive pairs of fixed, lower-stakes (control) and variable, higher-stakes (experimental) gambles, each involving wins or losses. In 21 participants, mRNA from 9 serotonin system genes was measured in whole blood prior to acute tryptophan depletion: 5-HT1B, 5-HT1F, 5-HT2A, 5-HT2B, 5-HT3A, 5-HT3E, 5-HT7 (serotonin receptors), 5-HTT (the serotonin transporter), and tryptophan hydroxylase 1.

RESULTS

Acute tryptophan depletion did not significantly influence participants' sensitivity to probability, wins, or losses, although there was a trend for a lower tendency to choose experimental gambles overall following depletion. Significant positive correlations, which survived correction for multiple comparisons, were detected between baseline 5-HT1B mRNA levels and acute tryptophan depletion-induced increases in both the overall tendency to choose the experimental gamble and sensitivity to wins. No significant relationship was observed with any other peripheral serotonin system markers. Computational analyses of decision-making data provided results consistent with these findings.

CONCLUSIONS

These results suggest that the 5-HT1B receptor may modulate the effects of acute tryptophan depletion on risky decision-making. Peripheral levels of serotonin markers may predict response to treatments that act upon the serotonin system, such as selective serotonin reuptake inhibitors.

Humans Integrate Monetary and Liquid Incentives to Motivate Cognitive Task Performance

It is unequivocal that a wide variety of incentives can motivate behavior. However, few studies have explicitly examined whether and how different incentives are integrated in terms of their motivational influence. The current study examines the combined effects of monetary and liquid incentives on cognitive processing, and whether appetitive and aversive incentives have distinct influences. We introduce a novel task paradigm, in which participants perform cued task-switching for monetary rewards that vary parametrically across trials, with liquid incentives serving as post-trial performance feedback. Critically, the symbolic meaning of the liquid was held constant (indicating successful reward attainment), while liquid valence was blocked. In the first experiment, monetary rewards combined additively with appetitive liquid feedback to improve subject task performance. Aversive liquid feedback counteracted monetary reward effects in low monetary reward trials, particularly in a subset of participants who tended to avoid responding under these conditions. Self-report motivation ratings predicted behavioral performance above and beyond experimental effects. A follow-up experiment replicated the predictive power of motivation ratings even when only appetitive liquids were used, suggesting that ratings reflect idiosyncratic subjective values of, rather than categorical differences between, the liquid incentives. Together, the findings indicate an integrative relationship between primary and secondary incentives and potentially dissociable influences in modulating motivational value, while informing hypotheses regarding candidate neural mechanisms.

A Computational Analysis of Aberrant Delay Discounting in Psychiatric Disorders

Impatience for reward is a facet of many psychiatric disorders. We draw attention to a growing literature finding greater discounting of delayed reward, an important aspect of impatience, across a range of psychiatric disorders. We propose these findings are best understood by considering the goals and motivation for discounting future reward. We characterize these as arising from either the opportunity costs of waiting or the uncertainty associated with delayed reward. We link specific instances of higher discounting in psychiatric disorder to heightened subjective estimates of either of these factors. We propose these costs are learned and represented based either on a flexible cognitive model of the world, an accumulation of previous experience, or through evolutionary specification. Any of these can be considered suboptimal for the individual if the resulting behavior results in impairments in personal and social functioning and/or in distress. By considering the neurochemical and neuroanatomical implementation of these processes, we illustrate how this approach can in principle unite social, psychological and biological conceptions of impulsive choice.

Serotonin reuptake inhibitors and serotonin transporter genotype modulate performance monitoring functions but not their electrophysiological correlates

Serotonin (5-HT) has been hypothesized to be implicated in performance monitoring by promoting behavioral inhibition in the face of aversive events. However, it is unclear whether this is restricted to external (punishment) or includes internal (response errors) events. The aim of the current study was to test whether higher 5-HT levels instigate inhibition specifically in the face of errors, measured as post-error slowing (PES), and whether this is represented in electrophysiological correlates of error processing, namely error-related negativity (ERN) and positivity. Therefore, from a large sample of human subjects (n = 878), two extreme groups were formed regarding hypothesized high and low 5-HT transporter (5-HTT) expression based on 5-HTTLPR and two additional single nucleotide polymorphisms (rs25531, rs25532). Seventeen higher (LL) and 15 lower (SS) expressing Caucasian subjects were administered the selective serotonin reuptake inhibitor (SSRI) citalopram (10 mg) intravenously in a double-blind crossover design. We found pharmacogenetic evidence for a role of 5-HT in mediating PES: SSRI administration increased PES in both genetic groups, and SS subjects displayed higher PES. These effects were absent on post-conflict slowing. However, ERN and error positivity were unaffected by pharmacogenetic factors, but ERN was decoupled from behavioral adaptation by SSRI administration in the LL group. Thus, pharmacogenetic evidence suggests that increased 5-HT levels lead to behavioral inhibition in the context of internal aversive events, but electrophysiological correlates of performance monitoring appear unrelated to the 5-HT system. Therefore, our findings are consistent with theories suggesting that 5-HT mediates the link between aversive processing and inhibition.