Serotonin and dopamine: unifying affective, activational, and decision functions

A Neuroeconomic Framework for Creative Cognition

Neuroeconomics is the study of the neurobiological bases of subjective preferences and choices. We present a novel framework that synthesizes findings from the literatures on neuroeconomics and creativity to provide a neurobiological description of creative cognition. We propose that value-based decision-making processes and activity in the locus ceruleus-norepinephrine (LC-NE) neuromodulatory system underlie creative cognition, as well as the large-scale brain network dynamics shown to be associated with creativity. This reconceptualization leads to several falsifiable hypotheses that can further understanding of creativity, decision making, and brain network dynamics.

Sumatriptan improves postoperative quality of recovery and reduces postcraniotomy headache after cranial nerve decompression

BACKGROUND

Microvascular decompression (MVD) is a surgical treatment for cranial nerve disorders via a small craniotomy. The postoperative pain of this procedure can be classified as surgical site somatic pain and postcraniotomy headache similar in nature to a migraine, including its association with photophobia, nausea, and vomiting. This headache can be difficult to treat and can impact on postoperative recovery. Sumatriptan is used to treat migraine-like headaches in various settings. This single-centre randomized controlled trial investigated whether postoperative administration of sumatriptan after MVD surgery impacts the quality of postoperative recovery.

METHODS

Fifty patients who complained of postoperative headache after MVD were randomized to receive an s.c. injection of sumatriptan (6 mg) or saline. The primary outcome was quality of recovery as measured by the Quality of Recovery-40 (QoR-40) score at 24 h.

RESULTS

The QoR-40 scores were significantly higher in the sumatriptan group (median 184; interquartile range 169-196) than in the placebo group (133; 119-155; P<0.01), suggesting higher quality of recovery. The sumatriptan group also had significantly lower headache scores at 4, 12, and 24 h. There were no significant differences in other secondary outcomes.

CONCLUSIONS

Use of sumatriptan improved the quality of recovery as measured by the QoR-40 and reduction of headache at 24 h after surgery. Sumatriptan is a useful alternative treatment for postcraniotomy headache. The mechanism remains unknown but could be related to reduction in headache, mood modulation, or both, mediated by a serotonin effect.

CLINICAL TRIAL REGISTRATION

NCT01632657.

From simultaneous to synergistic MR-PET brain imaging: A review of hybrid MR-PET imaging methodologies

Simultaneous Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET) scanning is a recent major development in biomedical imaging. The full integration of the PET detector ring and electronics within the MR system has been a technologically challenging design to develop but provides capacity for simultaneous imaging and the potential for new diagnostic and research capability. This article reviews state-of-the-art MR-PET hardware and software, and discusses future developments focusing on neuroimaging methodologies for MR-PET scanning. We particularly focus on the methodologies that lead to an improved synergy between MRI and PET, including optimal data acquisition, PET attenuation and motion correction, and joint image reconstruction and processing methods based on the underlying complementary and mutual information. We further review the current and potential future applications of simultaneous MR-PET in both systems neuroscience and clinical neuroimaging research. We demonstrate a simultaneous data acquisition protocol to highlight new applications of MR-PET neuroimaging research studies.

Intellectual Investment, Dopaminergic Gene Variation, and Life Events: A Critical Examination

Need for Cognition (NFC) and Openness to Ideas are intellectual investment traits that are characterized by a tendency to seek out, engage in and enjoy effortful cognitive activity. Little, however, is known about the extent to which they are influenced by genetic and environmental factors. With the present contribution, we aim at furthering our knowledge on the mechanisms underlying intellectual investment traits by following-up on a recent investigation of the role of dopaminergic gene variation in intellectual investment. Employing a standard approach that relied on null-hypothesis significance testing, we found that, first, two dopaminergic genetic variants interacted in modulating individual differences in NFC, but not in Openness to Ideas; that, second, negative life events played a role in the modulation of Openness to Ideas, but not of NFC; and that, third, negative life events as assessed using another measure were only marginally related to Openness to Ideas while positive life events were associated with both Openness to Ideas and NFC, with the latter effect being also dependent on DRD4 exon III genotype. However, employing a Bayesian approach, the assumption of a genetic effect on investment traits was overall not supported, while the assumption of a role of positive life events in the modulation of investment traits could be confirmed, with a tentative increment in the prediction of NFC by adding an interaction of positive life events and DRD4 variation to the main effect of positive life events. Our findings underscore the importance to use different approaches in the field of personality neuroscience. To gain deeper insight into the basis of personality traits does not only require to consider genetic as well as environmental influences and their interplay, but also requires more differentiated statistical analyses that can at least in part tackle the often inconsistent findings in this field.

Behavioral and neurobiological mechanisms of punishment: implications for psychiatric disorders

Punishment involves learning about the relationship between behavior and its adverse consequences. Punishment is fundamental to reinforcement learning, decision-making and choice, and is disrupted in psychiatric disorders such as addiction, depression, and psychopathy. However, little is known about the brain mechanisms of punishment and much of what is known is derived from study of superficially similar, but fundamentally distinct, forms of aversive learning such as fear conditioning and avoidance learning. Here we outline the unique conditions that support punishment, the contents of its learning, and its behavioral consequences. We consider evidence implicating GABA and monoamine neurotransmitter systems, as well as corticostriatal, amygdala, and dopamine circuits in punishment. We show how maladaptive punishment processes are implicated in addictions, impulse control disorders, psychopathy, anxiety, and depression and argue that a better understanding of the cellular, circuit, and cognitive mechanisms of punishment will make important contributions to next generation therapeutic approaches.

Risk-seeking for losses is associated with 5-HTTLPR, but not with transient changes in 5-HT levels

RATIONALE

Serotonin (5-HT) plays a key role in different aspects of value-based decision-making. A recent framework proposed that tonic 5-HT (together with dopamine, DA) codes future average reward expectations, providing a baseline against which possible choice outcomes are compared to guide decision-making.

OBJECTIVES

To test whether high 5-HT levels decrease loss aversion, risk-seeking for gains, and risk-seeking for losses.

METHODS

In a first session, 611 participants were genotyped for 5-HTTLPR and performed a mixed gambles (MGA) task and two probability discounting tasks for gains and losses, respectively (PDG/PDL). Afterwards, a subsample of 105 participants (44 with S/S, 6 with S/L, 55 with L/L genotype) completed the pharmacological study using a crossover design with tryptophan depletion (ATD), loading (ATL), and balanced (BAL) conditions. The same decision constructs were assessed.

RESULTS

We found increased risk-seeking for losses in S/S compared to L/L individuals at the first visit (p = 0.002). Neither tryptophan depletion nor loading affected decision-making, nor did we observe an interaction between intervention and 5-HTTLPR genotype.

CONCLUSION

Our data do not support the idea that transient changes of tonic 5-HT affect value-based decision-making. We provide evidence for an association of 5-HTTLPR with risk-seeking for losses, independent of acute 5-HT levels. This indicates that the association of 5-HTTLPR and risk-seeking for losses is mediated via other mechanisms, possibly by differences in the structural development of neural circuits of the 5-HT system during early life phases.

Overexpression of the DYRK1A Gene (Dual-Specificity Tyrosine Phosphorylation-Regulated Kinase 1A) Induces Alterations of the Serotoninergic and Dopaminergic Processing in Murine Brain Tissues

Trisomy 21 (T21) or Down syndrome (DS) is the most common genetic disorder associated with intellectual disability and affects around 5 million persons worldwide. Neuroanatomical phenotypes associated with T21 include slight reduction of brain size and weight, abnormalities in several brain areas including spines dysgenesis, dendritic morphogenesis, and early neuroanatomical characteristics of Alzheimer's disease. Monoamine neurotransmitters are involved in dendrites development, functioning of synapses, memory consolidation, and their levels measured in the cerebrospinal fluid, blood, or brain areas that are modified in individuals with T21. DYRK1A is one of the recognized key genes that could explain some of the deficits present in individuals with T21. We investigated by high-performance liquid chromatography with electrochemical detection the contents and processing of monoamines neurotransmitters in four brain areas of female and male transgenic mice for the Dyrk1a gene (mBactgDyrk1a). DYRK1A overexpression induced dramatic deficits in the serotonin contents of the four brain areas tested and major deficits in dopamine and adrenaline contents especially in the hypothalamus. These results suggest that DYRK1A overexpression might be associated with the modification of monoamines content found in individuals with T21 and reinforce the interest to target the level of DYRK1A expression as a therapeutic approach for persons with T21.

Environmental complexity buffers against stress-induced negative judgement bias in female chickens

Cognitive processes are often biased by emotions. In humans, affective disorders are accompanied by pessimistic judgement, while optimistic judgement is linked to emotional stability. Similar to humans, animals tend to interpret ambiguous stimuli negatively after experiencing stressful events, although the long-lasting impact on judgement bias has rarely been investigated. We measure judgement bias in female chicks (Gallus gallus domesticus) after exposure to cold stress, and before and after exposure to additional unpredictable stressors. Additionally, we explore if brain monoamines can explain differences in judgement bias. Chicks exposed to cold stress did not differ in judgement bias compared to controls, but showed sensitivity to additional stressors by having higher motivation for social reinstatement. Environmental complexity reduced stress-induced negative judgement bias, by maintaining an optimistic bias in individuals housed in complex conditions even after stress exposure. Moreover, judgement bias was related to dopamine turnover rate in mesencephalon, with higher activity in individuals that had a more optimistic response. These results demonstrate that environmental complexity can buffer against negative effects of additive stress and that dopamine relates to judgement bias in chicks. These results reveal that both internal and external factors can mediate emotionally biased judgement in animals, thus showing similarities to findings in humans.

Separate neural representations of prediction error valence and surprise: Evidence from an fMRI meta-analysis

Learning occurs when an outcome differs from expectations, generating a reward prediction error signal (RPE). The RPE signal has been hypothesized to simultaneously embody the valence of an outcome (better or worse than expected) and its surprise (how far from expectations). Nonetheless, growing evidence suggests that separate representations of the two RPE components exist in the human brain. Meta-analyses provide an opportunity to test this hypothesis and directly probe the extent to which the valence and surprise of the error signal are encoded in separate or overlapping networks. We carried out several meta-analyses on a large set of fMRI studies investigating the neural basis of RPE, locked at decision outcome. We identified two valence learning systems by pooling studies searching for differential neural activity in response to categorical positive-versus-negative outcomes. The first valence network (negative > positive) involved areas regulating alertness and switching behaviours such as the midcingulate cortex, the thalamus and the dorsolateral prefrontal cortex whereas the second valence network (positive > negative) encompassed regions of the human reward circuitry such as the ventral striatum and the ventromedial prefrontal cortex. We also found evidence of a largely distinct surprise-encoding network including the anterior cingulate cortex, anterior insula and dorsal striatum. Together with recent animal and electrophysiological evidence this meta-analysis points to a sequential and distributed encoding of different components of the RPE signal, with potentially distinct functional roles.

Serotonin enhances the impact of health information on food choice

Serotonin has been implicated in promoting self-control, regulation of hunger and physiological homeostasis, and regulation of caloric intake. However, it remains unclear whether the effects of serotonin on caloric intake reflect purely homeostatic mechanisms, or whether serotonin also modulates cognitive processes involved in dietary decision making. We investigated the effects of an acute dose of the serotonin reuptake inhibitor citalopram on choices between food items that differed along taste and health attributes, compared with placebo and the noradrenaline reuptake inhibitor atomoxetine. Twenty-seven participants attended three sessions and received single doses of atomoxetine, citalopram, and placebo in a double-blind randomised cross-over design. Relative to placebo, citalopram increased choices of more healthy foods over less healthy foods. Citalopram also increased the emphasis on health considerations in decisions. Atomoxetine did not affect decision making relative to placebo. The results support the hypothesis that serotonin may influence food choice by enhancing a focus on long-term goals. The findings are relevant for understanding decisions about food consumption and also for treating health conditions such as eating disorders and obesity.

Nested positive feedback loops in the maintenance of major depression: An integration and extension of previous models

Several theories of Major Depressive Disorder (MDD) have previously been proposed, focusing largely on either a psychological (i.e., cognitive/affective), biological, or neural/computational level of description. These theories appeal to somewhat distinct bodies of work that have each highlighted separate factors as being of considerable potential importance to the maintenance of MDD. Such factors include a range of cognitive/attentional information-processing biases, a range of structural and functional brain abnormalities, and also dysregulation within the autonomic, endocrine, and immune systems. However, to date there have been limited efforts to integrate these complimentary perspectives into a single multi-level framework. Here we review previous work in each of these MDD research domains and illustrate how they can be synthesized into a more comprehensive model of how a depressive episode is maintained. In particular, we emphasize how plausible (but insufficiently studied) interactions between the various MDD-related factors listed above can lead to a series of nested positive feedback loops, which are each capable of maintaining an individual in a depressive episode. We also describe how these different feedback loops could be active to different degrees in different individual cases, potentially accounting for heterogeneity in both depressive symptoms and treatment response. We conclude by discussing how this integrative model might extend understanding of current treatment mechanisms, and also potentially guide the search for markers to inform treatment selection in individual cases.

Pavlovian Control of Escape and Avoidance

To survive in complex environments, animals need to have mechanisms to select effective actions quickly, with minimal computational costs. As perhaps the computationally most parsimonious of these systems, Pavlovian control accomplishes this by hardwiring specific stereotyped responses to certain classes of stimuli. It is well documented that appetitive cues initiate a Pavlovian bias toward vigorous approach; however, Pavlovian responses to aversive stimuli are less well understood. Gaining a deeper understanding of aversive Pavlovian responses, such as active avoidance, is important given the critical role these behaviors play in several psychiatric conditions. The goal of the current study was to establish a behavioral and computational framework to examine aversive Pavlovian responses (activation vs. inhibition) depending on the proximity of an aversive state (escape vs. avoidance). We introduce a novel task in which participants are exposed to primary aversive (noise) stimuli and characterized behavior using a novel generative computational model. This model combines reinforcement learning and drift-diffusion models so as to capture effects of invigoration/inhibition in both explicit choice behavior as well as changes in RT. Choice and RT results both suggest that escape is associated with a bias for vigorous action, whereas avoidance is associated with behavioral inhibition. These results lay a foundation for future work seeking insights into typical and atypical aversive Pavlovian responses involved in psychiatric disorders, allowing us to quantify both implicit and explicit indices of vigorous choice behavior in the context of aversion.

Interactions between metabolic, reward and cognitive processes in appetite control: Implications for novel weight management therapies

Traditional models of appetite control have emphasised the role of parallel homeostatic and hedonic systems, but more recently the distinction between independent homeostatic and hedonic systems has been abandoned in favour of a framework that emphasises the cross talk between the neurochemical substrates of the two systems. In addition, evidence has emerged more recently, that higher level cognitive functions such as learning, memory and attention play an important role in everyday appetite control and that homeostatic signals also play a role in cognition. Here, we review this evidence and present a comprehensive model of the control of appetite that integrates cognitive, homeostatic and reward mechanisms. We discuss the implications of this model for understanding the factors that may contribute to disordered patterns of eating and suggest opportunities for developing more effective treatment approaches for eating disorders and weight management.

Comorbidity of Alcohol Use Disorder and Chronic Pain: Genetic Influences on Brain Reward and Stress Systems

Alcohol use disorder (AUD) is highly comorbid with chronic pain (CP). Evidence has suggested that neuroadaptive processes characterized by reward deficit and stress surfeit are involved in the development of AUD and pain chronification. Neurological data suggest that shared genetic architecture associated with the reward and stress systems may contribute to the comorbidity of AUD and CP. This monograph first delineates the prevailing theories of the development of AUD and pain chronification focusing on the reward and stress systems. It then provides a brief summary of relevant neurological findings followed by an evaluation of evidence documented by molecular genetic studies. Candidate gene association studies have provided some initial support for the genetic overlap between AUD and CP; however, these results must be interpreted with caution until studies with sufficient statistical power are conducted and replications obtained. Genomewide association studies have suggested a number of genes (e.g., TBX19, HTR7, and ADRA1A) that are either directly or indirectly related to the reward and stress systems in the AUD and CP literature. Evidence reviewed in this monograph suggests that shared genetic liability underlying the comorbidity between AUD and CP, if present, is likely to be complex. As the advancement in molecular genetic methods continues, future studies may show broader central nervous system involvement in AUD-CP comorbidity.

Serotonin Decreases the Gain of Visual Responses in Awake Macaque V1

Serotonin, an important neuromodulator in the brain, is implicated in affective and cognitive functions. However, its role even for basic cortical processes is controversial. For example, in the mammalian primary visual cortex (V1), heterogenous serotonergic modulation has been observed in anesthetized animals. Here, we combined extracellular single-unit recordings with iontophoresis in awake animals. We examined the role of serotonin on well-defined tuning properties (orientation, spatial frequency, contrast, and size) in V1 of two male macaque monkeys. We find that in the awake macaque the modulatory effect of serotonin is surprisingly uniform: it causes a mainly multiplicative decrease of the visual responses and a slight increase in the stimulus-selective response latency. Moreover, serotonin neither systematically changes the selectivity or variability of the response, nor the interneuronal correlation unexplained by the stimulus ("noise-correlation"). The modulation by serotonin has qualitative similarities with that for a decrease in stimulus contrast, but differs quantitatively from decreasing contrast. It can be captured by a simple additive change to a threshold-linear spiking nonlinearity. Together, our results show that serotonin is well suited to control the response gain of neurons in V1 depending on the animal's behavioral or motivational context, complementing other known state-dependent gain-control mechanisms.SIGNIFICANCE STATEMENT Serotonin is an important neuromodulator in the brain and a major target for drugs used to treat psychiatric disorders. Nonetheless, surprisingly little is known about how it shapes information processing in sensory areas. Here we examined the serotonergic modulation of visual processing in the primary visual cortex of awake behaving macaque monkeys. We found that serotonin mainly decreased the gain of the visual responses, without systematically changing their selectivity, variability, or covariability. This identifies a simple computational function of serotonin for state-dependent sensory processing, depending on the animal's affective or motivational state.

Toward a multiscale modeling framework for understanding serotonergic function

Despite its importance in regulating emotion and mental wellbeing, the complex structure and function of the serotonergic system present formidable challenges toward understanding its mechanisms. In this paper, we review studies investigating the interactions between serotonergic and related brain systems and their behavior at multiple scales, with a focus on biologically-based computational modeling. We first discuss serotonergic intracellular signaling and neuronal excitability, followed by neuronal circuit and systems levels. At each level of organization, we will discuss the experimental work accompanied by related computational modeling work. We then suggest that a multiscale modeling approach that integrates the various levels of neurobiological organization could potentially transform the way we understand the complex functions associated with serotonin.

Neural correlates of altered feedback learning in women recovered from anorexia nervosa

Anorexia nervosa (AN) is associated with exaggerated self-control and altered reward-based decision making, but the underlying neural mechanisms are poorly understood. Consistent with the notion of excessive cognitive control, we recently found increased dorsal anterior cingulate cortex (dACC) activation in acutely ill patients (acAN) on lose-shift trials in a probabilistic reversal learning (PRL) task. However, undernutrition may modulate brain function. In attempt to disentangle trait from state factors, the current fMRI study investigated cognitive control in recovered patients (recAN). Thirty-one recAN and 31 healthy controls (HC) completed a PRL task during fMRI. Based on previous findings, we focused on hemodynamic responses during lose-shift behaviour and conducted supplementary functional connectivity analysis. RecAN showed elevated lose-shift behaviour relative to HC. On the neural level, recAN showed normal dACC responses, but increased activation in fronto-parietal control regions. A trend for increased coupling between frontal and parietal regions of interest was also evident in recAN. The current findings in recAN differ from those in our previous study in acAN. While aberrant dACC response to negative feedback may be a correlate of the underweight state in acAN, impaired behavioural adaptation and elevated activation of cognitive control regions in recAN is suggestive of altered neural efficiency.

Fenfluramine Reduces [11C]Cimbi-36 Binding to the 5-HT2A Receptor in the Nonhuman Primate Brain

BACKGROUND

[11C]Cimbi-36 is a serotonin 2A receptor agonist positron emission tomography radioligand that has recently been examined in humans. The binding of agonist radioligand is expected to be more sensitive to endogenous neurotransmitter concentrations than antagonist radioligands. In the current study, we compared the effect of serotonin releaser fenfluramine on the binding of [11C]Cimbi-36, [11C]MDL 100907 (a serotonin 2A receptor antagonist radioligand), and [11C]AZ10419369 (a serotonin 1B receptor partial agonist radioligand with established serotonin sensitivity) in the monkey brain.

METHODS

Eighteen positron emission tomography measurements, 6 for each radioligand, were performed in 3 rhesus monkeys before or after administration of 5.0 mg/kg fenfluramine. Binding potential values were determined with the simplified reference tissue model using cerebellum as the reference region.

RESULTS

Fenfluramine significantly decreased [11C]Cimbi-36 (26-62%) and [11C]AZ10419369 (35-58%) binding potential values in most regions (P < 0.05). Fenfluramine-induced decreases in [11C]MDL 100907 binding potential were 8% to 30% and statistically significant in 3 regions. Decreases in [11C]Cimbi-36 binding potential were larger than for [11C]AZ10419369 in neocortical and limbic regions (~35%) but smaller in striatum and thalamus (~40%). Decreases in [11C]Cimbi-36 binding potential were 0.9 to 2.8 times larger than for [11C]MDL 100907, and the fraction of serotonin 2A receptor in the high-affinity state was estimated as 54% in the neocortex.

CONCLUSIONS

The serotonin sensitivity of serotonin 2A receptor agonist radioligand [11C]Cimbi-36 was higher than for antagonist radioligand [11C]MDL 100907. The serotonin sensitivity of [11C]Cimbi-36 was similar to [11C]AZ10419369, which is one of the most sensitive radioligands. [11C]Cimbi-36 is a promising radioligand to examine serotonin release in the primate brain.

The interrelationship of metabolic syndrome and neurodegenerative diseases with focus on brain-derived neurotrophic factor (BDNF): Kill two birds with one stone

The brain-derived neurotrophic factor (BDNF) is involved in metabolic syndrome (MetS) and neurodegenerative diseases (NDD) like Alzheimer's disease, Huntington's disease, Parkinson's disease and depression. If one factor plays an essential role in the pathogenesis of two diseases, it can be concluded that there might be a common root in these two diseases, as well. This review was aimed to highlight the crucial roles of BDNF in the pathogenesis of MetS and NDD and to introduce sole prophylactic or therapeutic applications, BDNF gene therapy and BDFN administration, in controlling MetS and NDD.

Testing differential susceptibility: Plasticity genes, the social environment, and their interplay in adolescent response inhibition

OBJECTIVES

Impaired inhibitory control is a key feature of attention-deficit/hyperactivity disorder (ADHD). We investigated gene-environment interaction (GxE) as a possible contributing factor to response inhibition variation in context of the differential susceptibility theory. This states individuals carrying plasticity gene variants will be more disadvantaged in negative, but more advantaged in positive environments.

METHODS

Behavioural and neural measures of response inhibition were assessed during a Stop-signal task in participants with (N = 197) and without (N = 295) ADHD, from N = 278 families (age M = 17.18, SD =3.65). We examined GxE between candidate plasticity genes (DAT1, 5-HTT, DRD4) and social environments (maternal expressed emotion, peer affiliation).

RESULTS

A DRD4 × Positive peer affiliation interaction was found on the right fusiform gyrus (rFG) activation during successful inhibition. Further, 5-HTT short allele carriers showed increased rFG activation during failed inhibitions. Maternal warmth and positive peer affiliation were positively associated with right inferior frontal cortex activation during successful inhibition. Deviant peer affiliation was positively related to the error rate.

CONCLUSIONS

While a pattern of differential genetic susceptibility was found, more clarity on the role of the FG during response inhibition is warranted before firm conclusions can be made. Positive and negative social environments were related to inhibitory control. This extends previous research emphasizing adverse environments.

Chronic and Acute Stress Promote Overexploitation in Serial Decision Making

Many decisions that humans make resemble foraging problems in which a currently available, known option must be weighed against an unknown alternative option. In such foraging decisions, the quality of the overall environment can be used as a proxy for estimating the value of future unknown options against which current prospects are compared. We hypothesized that such foraging-like decisions would be characteristically sensitive to stress, a physiological response that tracks biologically relevant changes in environmental context. Specifically, we hypothesized that stress would lead to more exploitative foraging behavior. To test this, we investigated how acute and chronic stress, as measured by changes in cortisol in response to an acute stress manipulation and subjective scores on a questionnaire assessing recent chronic stress, relate to performance in a virtual sequential foraging task. We found that both types of stress bias human decision makers toward overexploiting current options relative to an optimal policy. These findings suggest a possible computational role of stress in decision making in which stress biases judgments of environmental quality.SIGNIFICANCE STATEMENT Many of the most biologically relevant decisions that we make are foraging-like decisions about whether to stay with a current option or search the environment for a potentially better one. In the current study, we found that both acute physiological and chronic subjective stress are associated with greater overexploitation or staying at current options for longer than is optimal. These results suggest a domain-general way in which stress might bias foraging decisions through changing one's appraisal of the overall quality of the environment. These novel findings not only have implications for understanding how this important class of foraging decisions might be biologically implemented, but also for understanding the computational role of stress in behavior and cognition more broadly.

Activity patterns of serotonin neurons underlying cognitive flexibility

Serotonin is implicated in mood and affective disorders. However, growing evidence suggests that a core endogenous role is to promote flexible adaptation to changes in the causal structure of the environment, through behavioral inhibition and enhanced plasticity. We used long-term photometric recordings in mice to study a population of dorsal raphe serotonin neurons, whose activity we could link to normal reversal learning using pharmacogenetics. We found that these neurons are activated by both positive and negative prediction errors, and thus report signals similar to those proposed to promote learning in conditions of uncertainty. Furthermore, by comparing the cue responses of serotonin and dopamine neurons, we found differences in learning rates that could explain the importance of serotonin in inhibiting perseverative responding. Our findings show how the activity patterns of serotonin neurons support a role in cognitive flexibility, and suggest a revised model of dopamine-serotonin opponency with potential clinical implications.

The association between endogenous testosterone level and behavioral flexibility in young men - Evidence from stimulus-outcome reversal learning

The capacity to flexibly adapt responding to unexpected changes in the environment is crucial for survival. Several neurotransmitters have been implicated in stimulus-outcome reversal learning. Yet, it remains an open question whether inter-individual differences in the neuroactive hormone testosterone may also be related to this type of behavioral flexibility. In this study we assessed the association between endogenous testosterone level and reversal learning in young healthy men. We used an observer reversal learning task, in which subjects viewed computer-based decisions between two stimuli, of which one was currently rewarded while the other one was punished. Contingencies reversed unpredictably every 5-9 trials. Subjects had to indicate the current outcome association before the actual outcome was revealed. In the trial following an unexpected reversal either the same stimulus from the reversal (experienced reversal), or its alternative, for which the reversal had not yet been shown (inferred reversal), could be chosen by the computer, and subjects had to adapt responding accordingly. We found that testosterone predicted better post-reversal performance. This correlation was strongest in the more difficult inferred reversal condition, particularly in impulsive individuals. Collectively, these data support the view that endogenous testosterone may enhance behavioral flexibility in men, particularly when working memory demand is high and subjects have to update several stimulus-outcome contingencies at the same time. It remains to be further elucidated whether this testosterone effect was achieved through an interaction with dopaminergic transmission or through direct interplay with androgen receptors in the brain regions implicated in reversal learning.

Transient inhibition and long-term facilitation of locomotion by phasic optogenetic activation of serotonin neurons

Serotonin (5-HT) is associated with mood and motivation but the function of endogenous 5-HT remains controversial. Here, we studied the impact of phasic optogenetic activation of 5-HT neurons in mice over time scales from seconds to weeks. We found that activating dorsal raphe nucleus (DRN) 5-HT neurons induced a strong suppression of spontaneous locomotor behavior in the open field with rapid kinetics (onset ≤1 s). Inhibition of locomotion was independent of measures of anxiety or motor impairment and could be overcome by strong motivational drive. Repetitive place-contingent pairing of activation caused neither place preference nor aversion. However, repeated 15 min daily stimulation caused a persistent increase in spontaneous locomotion to emerge over three weeks. These results show that 5-HT transients have strong and opposing short and long-term effects on motor behavior that appear to arise from effects on the underlying factors that motivate actions.

DOI:http://dx.doi.org/10.7554/eLife.20975.001

The brain controls sleep, movement and the other behaviors that an animal needs to survive. A chemical called serotonin plays an important role in controlling these behaviors as it regulates the activity of nerve cells (known as neurons) throughout the brain. Serotonin is produced by a specific group of neurons found in an area at the base of the brain called the raphe nuclei. From there, serotonin is released into other parts of the brain to influence different behaviors. Although drugs that target serotonin are widely used as antidepressants, how this chemical signal acts in the brain remains a mystery. This is due, in part, to it being technically challenging to carry out experiments on the serotonin-producing neurons.

A technique called optogenetics uses light to selectively activate or inhibit individual cells in live animals. Here, Correia, Lottem et al. use optogenetics to activate serotonin-producing neurons in the dorsal raphe nucleus of mice. The experiments show that triggering serotonin production for a few seconds causes the mice to move around more slowly as they explore their surroundings. This short-term release of serotonin only slows the mice down if they are not already occupied with other activities, such as finding water or balancing on a moving object. These experiments suggest that serotonin decreases an individual’s motivation to move but that this can be overcome by sufficiently powerful goals. In contrast, repeatedly activating the serotonin neurons over a period of several weeks led to long-term changes of the opposite kind – the mice begin to move around more quickly.

The findings of Correia, Lottem et al. have possible implications for the use of drugs that target serotonin to treat mental disorders as it suggests important links between serotonin, movement, and the ability of the brain to change how it responds to certain situations. The next steps will be to investigate how the two different effects of serotonin are connected, which areas in the brain are involved and how best to apply these findings to clinical studies.

DOI:http://dx.doi.org/10.7554/eLife.20975.002

Opposing effects of reward and punishment on human vigor

The vigor with which humans and animals engage in a task is often a determinant of the likelihood of the task's success. An influential theoretical model suggests that the speed and rate at which responses are made should depend on the availability of rewards and punishments. While vigor facilitates the gathering of rewards in a bountiful environment, there is an incentive to slow down when punishments are forthcoming so as to decrease the rate of punishments, in conflict with the urge to perform fast to escape punishment. Previous experiments confirmed the former, leaving the latter unanswered. We tested the influence of punishment in an experiment involving economic incentives and contrasted this with reward related behavior on the same task. We found that behavior corresponded with the theoretical model; while instantaneous threat of punishment caused subjects to increase the vigor of their response, subjects' response times would slow as the overall rate of punishment increased. We quantitatively show that this is in direct contrast to increases in vigor in the face of increased overall reward rates. These results highlight the opposed effects of rewards and punishments and provide further evidence for their roles in the variety of types of human decisions.

High reward expectancy during methylphenidate depresses the dopaminergic response to gain and loss

Dopamine plays an important role in goal-directed behavior, through its modulatory influence on striatal neurons. It is unclear whether tonic dopamine levels, which regulate the vigor of acting, interact with the phasic dopamine response to reward that drives instrumental behavior. In a randomized placebo-controlled study in healthy volunteers, we show that methylphenidate, a drug that increases tonic dopamine levels, systematically reduced striatal phasic BOLD responses to gain and loss in a gambling task as measured with fMRI. It also increased response vigor and reward expectancy-related BOLD signals in the ventral striatum. These findings suggest that striatal tonic dopamine levels constitute an average reward expectation signal that modulates the phasic dopaminergic response to reward. This offers opportunities for treatment of behavioral disorders associated with abnormal reward sensitivity.

Serotonin Transporter Genetic Variation is Differentially Associated with Reflexive- and Reflective-Optimal Learning

Learning to respond optimally under a broad array of environmental conditions is a critical brain function that requires engaging the cognitive systems that are optimal for solving the task at hand. Serotonin is implicated in learning and decision-making, but the specific functions of serotonin in system-level cognitive control remain unclear. Across 3 studies, we examined the influence of a polymorphism within the promoter region of the serotonin transporter gene (5-HTTLPR polymorphism in SLC6A4) on participants' ability to engage the task appropriate cognitive system when the reflexive (Experiments 1 and 2) or the reflective (Experiment 3) system was optimal. Critically, we utilized a learning task for which all aspects remain fixed with only the nature of the optimal cognitive processing system varying across experiments. Using large community samples, Experiments 1 and 2 (screened for psychiatric diagnosis) found that 5-HTTLPR S/LG allele homozygotes, with putatively lower serotonin transport functionality, outperformed LA allele homozygotes in a reflexive-optimal learning task. Experiment 3 used a large community sample, also screened for psychiatric diagnosis, and found that 5-HTTLPR LA homozygotes, with putatively higher serotonin transport functionality, outperformed S/LG allele homozygotes in a reflective-optimal learning task.

Neuroprotective effect of Cucumis melo Var. flexuosus leaf extract on the brains of rats with streptozotocin-induced diabetes

The central nervous system is one of the most vulnerable organs affected by the oxidative stress associated with diabetes mellitus. Healthy food provides an important source for antioxidants. Therefore, the protective effect of Cucumis melo var. flexuosus (C. melo var. flexuosus) leaf extract on the brains of diabetic rats was investigated. Adult male albino rats divided into 5 groups of 6 rats each were assigned into a normal control group and four diabetic groups. Diabetes was induced in rats by a single intraperitoneal injection of streptozotocin (STZ; 60 mg/kg bw). One of the four diabetic groups was left untreated and was considered as a diabetic control group while the three other groups were treated with C. melo var. flexuosus leaf extract at the doses of 30, 60 and 120 mg/kg bw for a period of 30 days. After completion of experimental duration plasma and brains were used for evaluating biochemical changes. The obtained data showed that C. melo var. flexuosus leaf extract treatment lowered blood glucose, glycated hemoglobin, brain tumor necrosis factor-alpha, interleukin levels, brain malondialdehyde content and caspase-3 activity. Furthermore, the treatment resulted in a marked increase in plasma dopamine, melatonin, brain vascular endothelial growth factor-A levels, brain catalase and superoxide dismutase activities. From the present study, it can be concluded that the C. melo var. flexuosus leaf extract exerts a neuroprotective effect against oxidative damage associated with diabetes.

Perseveration in a spatial-discrimination serial reversal learning task is differentially affected by MAO-A and MAO-B inhibition and associated with reduced anxiety and peripheral serotonin levels

RATIONALE

Impairments in behavioral flexibility lie at the core of anxiety and obsessive-compulsive disorders. Few studies, however, have investigated the neural substrates of natural variation in behavioral flexibility and whether inflexible behavior is linked to anxiety and peripheral markers of stress and monoamine function.

OBJECTIVE

The objective of the study was to investigate peripheral and central markers associated with perseverative behavior on a spatial-discrimination serial reversal learning task.

METHODS

Rats were trained on a reversal learning task prior to blood sampling, anxiety assessment, and the behavioral evaluation of selective monoamine oxidase-A (MAO-A) and MAO-B inhibitors, which block the degradation of serotonin (5-HT), dopamine (DA), and noradrenaline (NA).

RESULTS

Perseveration correlated positively with 5-HT levels in blood plasma and inversely with trait anxiety, as measured on the elevated plus maze. No significant relationships were found between perseveration and the stress hormone corticosterone or the 5-HT precursor tryptophan. Reversal learning was significantly improved by systemic administration of the MAO-A inhibitor moclobemide but not by the MAO-B inhibitor lazabemide. Moclobemide also increased latencies to initiate a new trial following an incorrect response suggesting a possible role in modulating behavioral inhibition to negative feedback. MAO-A but not MAO-B inhibition resulted in pronounced increases in 5-HT and NA content in the orbitofrontal cortex and dorsal raphé nuclei and increased 5-HT and DA content in the basolateral amygdala and dorsomedial striatum.

CONCLUSIONS

These findings indicate that central and peripheral monoaminergic mechanisms underlie inter-individual variation in behavioral flexibility, which overlaps with trait anxiety and depends on functional MAO-A activity.

A Single Pair of Serotonergic Neurons Counteracts Serotonergic Inhibition of Ethanol Attraction in Drosophila

Attraction to ethanol is common in both flies and humans, but the neuromodulatory mechanisms underlying this innate attraction are not well understood. Here, we dissect the function of the key regulator of serotonin signaling—the serotonin transporter–in innate olfactory attraction to ethanol in Drosophila melanogaster. We generated a mutated version of the serotonin transporter that prolongs serotonin signaling in the synaptic cleft and is targeted via the Gal4 system to different sets of serotonergic neurons. We identified four serotonergic neurons that inhibit the olfactory attraction to ethanol and two additional neurons that counteract this inhibition by strengthening olfactory information. Our results reveal that compensation can occur on the circuit level and that serotonin has a bidirectional function in modulating the innate attraction to ethanol. Given the evolutionarily conserved nature of the serotonin transporter and serotonin, the bidirectional serotonergic mechanisms delineate a basic principle for how random behavior is switched into targeted approach behavior.

Protective effects of high Tryptophan diet on aging-induced passive avoidance impairment and hippocampal apoptosis

In our previous work we have shown that L-Tryptophan (TrP) enriched diet prevents the age-induced decline of hippocampal Serotonin (5-HT) production. Considering that loss or reduction in 5-HT neurotransmission may contribute to age-related cognitive decline, here we have investigated the effect of such diet on passive avoidance (PA) behavior, cell death, pro- and anti- apoptotic molecules (BAX, Bcl-2 and Caspase-3) and an important transcription factor involved in synaptic plasticity and memory (CREB). The increase in 5-HT neurotransmission in the Hippocampus (Hp) of aged rats was induced by 1 month of high TrP administration. In the first phase of our study we found that high TrP diet improves PA behaviour of aged rats and this correlated with a decrease of TUNEL positive cells in all hippocampal regions tested (CA1, CA2, CA3, DG). Interestingly, the Hp of aged animals fed with high TrP diet showed a significant downregulation of proapoptotic proteins, caspase-3 and BAX, and an increase of antiapoptotic molecules Bcl-2 as indicated by Western Blot and immunohistochemical analyses. Also, high TrP diet partially rescued the age-induced inhibition of hippocampal CREB phosphorylation. Altogether, our data suggest that enhanced TrP intake, and in consequence a potential increase in 5-HT neurotransmission, might be beneficial in preventing age-related detrimental features by inhibition of hippocampal apoptosis.

An active inference theory of allostasis and interoception in depression

In this paper, we integrate recent theoretical and empirical developments in predictive coding and active inference accounts of interoception (including the Embodied Predictive Interoception Coding model) with working hypotheses from the theory of constructed emotion to propose a biologically plausible unified theory of the mind that places metabolism and energy regulation (i.e. allostasis), as well as the sensory consequences of that regulation (i.e. interoception), at its core. We then consider the implications of this approach for understanding depression. We speculate that depression is a disorder of allostasis, whose myriad symptoms result from a 'locked in' brain that is relatively insensitive to its sensory context. We conclude with a brief discussion of the ways our approach might reveal new insights for the treatment of depression.This article is part of the themed issue 'Interoception beyond homeostasis: affect, cognition and mental health'.

A specific role for serotonin in overcoming effort cost

Serotonin is implicated in many aspects of behavioral regulation. Theoretical attempts to unify the multiple roles assigned to serotonin proposed that it regulates the impact of costs, such as delay or punishment, on action selection. Here, we show that serotonin also regulates other types of action costs such as effort. We compared behavioral performance in 58 healthy humans treated during 8 weeks with either placebo or the selective serotonin reuptake inhibitor escitalopram. The task involved trading handgrip force production against monetary benefits. Participants in the escitalopram group produced more effort and thereby achieved a higher payoff. Crucially, our computational analysis showed that this effect was underpinned by a specific reduction of effort cost, and not by any change in the weight of monetary incentives. This specific computational effect sheds new light on the physiological role of serotonin in behavioral regulation and on the clinical effect of drugs for depression.

CLINICAL TRIAL REGISTRATION

ISRCTN75872983.

Down-regulation of serotonin and dopamine transporter genes in individual rats expressing a gambling-prone profile: A possible role for epigenetic mechanisms

Gambling Disorder (GD) is characterized by excessive gambling despite adverse consequences on individual functioning. In spite of some positive findings, it is difficult to draw any conclusion on the genetics of GD. Indeed, beyond DNA sequence variation, other regulatory mechanisms (like those that engage epigenetics) may explain gene alterations in this addictive disease. Wistar male rats underwent an operant task for the evaluation of individual propensity to gamble. Few rats, after having learnt to prefer nose-poking for a large over a small food reward, were sacrificed to obtain a baseline profile of gene expression at both central and peripheral levels. In the remaining rats, probability of occurrence of large-reward delivery decreased progressively to very low levels. Thus, rats were faced with temptation to "gamble", i.e. to nose-poke for a binge reward, whose delivery was omitted the majority of times. After 3weeks of testing, rats showing a clear-cut profile of either gambling proneness or aversion were selected and sacrificed after the last session. A selective down-regulation of i) serotonin transporter in prefrontal cortex, ii) tyrosine hydroxylase in ventral striatum, iii) dopamine transporter in lymphocytes was evidenced in "gambler" vs "non-gambler" rats. The exposure to such operant task (compared to home-cage alone) modulated ventrostriatal but not prefrontal genes. A consistent increase of DNA methylation, in one specific CpG site at serotonin transporter gene, was evident in prefrontal cortex of "gambler" rats. Elucidation of epigenetic changes occurring during GD progression may pave the way to the development of new therapeutic strategies through specific modulation of epigenetic factors.

Models of neuromodulation for computational psychiatry

Psychiatry faces fundamental challenges: based on a syndrome-based nosology, it presently lacks clinical tests to infer on disease processes that cause symptoms of individual patients and must resort to trial-and-error treatment strategies. These challenges have fueled the recent emergence of a novel field-computational psychiatry-that strives for mathematical models of disease processes at physiological and computational (information processing) levels. This review is motivated by one particular goal of computational psychiatry: the development of 'computational assays' that can be applied to behavioral or neuroimaging data from individual patients and support differential diagnosis and guiding patient-specific treatment. Because the majority of available pharmacotherapeutic approaches in psychiatry target neuromodulatory transmitters, models that infer (patho)physiological and (patho)computational actions of different neuromodulatory transmitters are of central interest for computational psychiatry. This article reviews the (many) outstanding questions on the computational roles of neuromodulators (dopamine, acetylcholine, serotonin, and noradrenaline), outlines available evidence, and discusses promises and pitfalls in translating these findings to clinical applications. WIREs Cogn Sci 2017, 8:e1420. doi: 10.1002/wcs.1420 For further resources related to this article, please visit the WIREs website.

Learning the opportunity cost of time in a patch-foraging task

Although most decision research concerns choice between simultaneously presented options, in many situations options are encountered serially, and the decision is whether to exploit an option or search for a better one. Such problems have a rich history in animal foraging, but we know little about the psychological processes involved. In particular, it is unknown whether learning in these problems is supported by the well-studied neurocomputational mechanisms involved in more conventional tasks. We investigated how humans learn in a foraging task, which requires deciding whether to harvest a depleting resource or switch to a replenished one. The optimal choice (given by the marginal value theorem; MVT) requires comparing the immediate return from harvesting to the opportunity cost of time, which is given by the long-run average reward. In two experiments, we varied opportunity cost across blocks, and subjects adjusted their behavior to blockwise changes in environmental characteristics. We examined how subjects learned their choice strategies by comparing choice adjustments to a learning rule suggested by the MVT (in which the opportunity cost threshold is estimated as an average over previous rewards) and to the predominant incremental-learning theory in neuroscience, temporal-difference learning (TD). Trial-by-trial decisions were explained better by the MVT threshold-learning rule. These findings expand on the foraging literature, which has focused on steady-state behavior, by elucidating a computational mechanism for learning in switching tasks that is distinct from those used in traditional tasks, and suggest connections to research on average reward rates in other domains of neuroscience.

Prenatal maternal depression and child serotonin transporter linked polymorphic region (5-HTTLPR) and dopamine receptor D4 (DRD4) genotype predict negative emotionality from 3 to 36 months

Prenatal maternal depression and a multilocus genetic profile of two susceptibility genes implicated in the stress response were examined in an interaction model predicting negative emotionality in the first 3 years. In 179 mother-infant dyads from the Maternal Adversity, Vulnerability, and Neurodevelopment cohort, prenatal depression (Center for Epidemiologic Studies Depressions Scale) was assessed at 24 to 36 weeks. The multilocus genetic profile score consisted of the number of susceptibility alleles from the serotonin transporter linked polymorphic region gene (5-HTTLPR): no long-rs25531(A) (LA: short/short, short/long-rs25531(G) [LG], or LG/LG] vs. any LA) and the dopamine receptor D4 gene (six to eight repeats vs. two to five repeats). Negative emotionality was extracted from the Infant Behaviour Questionnaire-Revised at 3 and 6 months and the Early Child Behavior Questionnaire at 18 and 36 months. Mixed and confirmatory regression analyses indicated that prenatal depression and the multilocus genetic profile interacted to predict negative emotionality from 3 to 36 months. The results were characterized by a differential susceptibility model at 3 and 6 months and by a diathesis-stress model at 36 months.

Ventral striatal hyperconnectivity during rewarded interference control in adolescents with ADHD

OBJECTIVE

Attention-deficit/hyperactivity disorder (ADHD) is characterized by cognitive deficits (e.g., interference control) and altered reward processing. Cognitive control is influenced by incentive motivation and according to current theoretical models, ADHD is associated with abnormal interactions between incentive motivation and cognitive control. However, the neural mechanisms by which reward modulates cognitive control in individuals with ADHD are unknown.

METHOD

We used event-related functional resonance imaging (fMRI) to study neural responses during a rewarded Stroop color-word task in adolescents (14-17 years) with ADHD (n = 25; 19 boys) and healthy controls (n = 33; 22 boys).

RESULTS

Adolescents with ADHD showed increased reward signaling within the superior frontal gyrus and ventral striatum (VS) relative to controls. Importantly, functional connectivity analyses revealed a hyperconnectivity between VS and motor control regions in the ADHD group, as a function of reward-cognitive control integration. Connectivity was associated with performance improvement in controls but not in the ADHD group, suggesting inefficient connectivity.

CONCLUSION

Adolescents with ADHD show increased neural sensitivity to rewards and its interactions with interference control in VS and motor regions, respectively. The findings support theoretical models of altered reward-cognitive control integration in individuals with ADHD.

Tryptophan hydroxylase type 2 variants modulate severity and outcome of addictive behaviors in Parkinson's disease

BACKGROUND

Impulse control disorders and compulsive medication intake may occur in a minority of patients with Parkinson's disease (PD). We hypothesize that genetic polymorphisms associated with addiction in the general population may increase the risk for addictive behaviors also in PD.

METHODS

Sixteen polymorphisms in candidate genes belonging to five neurotransmitter systems (dopaminergic, catecholaminergic, serotonergic, glutamatergic, opioidergic) and the BDNF were screened in 154 PD patients with addictive behaviors and 288 PD control subjects. Multivariate analysis investigated clinical and genetic predictors of outcome (remission vs. persistence/relapse) after 1 year and at the last follow-up (5.1 ± 2.5 years).

RESULTS

Addictive behaviors were associated with tryptophan hydroxylase type 2 (TPH2) and dopamine transporter gene variants. A subsequent analysis within the group of cases showed a robust association between TPH2 genotype and the severity of addictive behaviors, which survived Bonferroni correction for multiple testing. At multivariate analysis, TPH2 genotype resulted the strongest predictor of no remission at the last follow-up (OR[95%CI], 7.4[3.27-16.78] and 13.2[3.89-44.98] in heterozygous and homozygous carriers, respectively, p < 0.001). The extent of medication dose reduction was not a predictor. TPH2 haplotype analysis confirmed the association with more severe symptoms and lower remission rates in the short- and the long-term (p < 0.005 for all analyses).

CONCLUSION

The serotonergic system is likely to be involved in the pathophysiology of addictive behaviors in PD, modulating the severity of symptoms and the rate of remission at follow-up. If confirmed in larger independent cohorts, TPH2 genotype may become a useful biomarker for the identification of at-risk individuals.