Serotonin's many meanings elude simple theories

Neuroimmune modulation by tryptophan derivatives in neurological and inflammatory disorders

The nervous and immune systems are highly developed, and each performs specialized physiological functions. However, they work together, and their dysfunction is associated with various diseases. Specialized molecules, such as neurotransmitters, cytokines, and more general metabolites, are essential for the appropriate regulation of both systems. Tryptophan, an essential amino acid, is converted into functional molecules such as serotonin and kynurenine, both of which play important roles in the nervous and immune systems. The role of kynurenine metabolites in neurodegenerative and psychiatric diseases has recently received particular attention. Recently, we found that hyperactivity of the kynurenine pathway is a critical risk factor for septic shock. In this review, we first outline neuroimmune interactions and tryptophan derivatives and then summarized the changes in tryptophan metabolism in neurological disorders. Finally, we discuss the potential of tryptophan derivatives as therapeutic targets for neuroimmune disorders.

Pathways to the persistence of drug use despite its adverse consequences

The persistence of drug taking despite its adverse consequences plays a central role in the presentation, diagnosis, and impacts of addiction. Eventual recognition and appraisal of these adverse consequences is central to decisions to reduce or cease use. However, the most appropriate ways of conceptualizing persistence in the face of adverse consequences remain unclear. Here we review evidence that there are at least three pathways to persistent use despite the negative consequences of that use. A cognitive pathway for recognition of adverse consequences, a motivational pathway for valuation of these consequences, and a behavioral pathway for responding to these adverse consequences. These pathways are dynamic, not linear, with multiple possible trajectories between them, and each is sufficient to produce persistence. We describe these pathways, their characteristics, brain cellular and circuit substrates, and we highlight their relevance to different pathways to self- and treatment-guided behavior change.

Temporal derivative computation in the dorsal raphe network revealed by an experimentally driven augmented integrate-and-fire modeling framework

By means of an expansive innervation, the serotonin (5-HT) neurons of the dorsal raphe nucleus (DRN) are positioned to enact coordinated modulation of circuits distributed across the entire brain in order to adaptively regulate behavior. Yet the network computations that emerge from the excitability and connectivity features of the DRN are still poorly understood. To gain insight into these computations, we began by carrying out a detailed electrophysiological characterization of genetically identified mouse 5-HT and somatostatin (SOM) neurons. We next developed a single-neuron modeling framework that combines the realism of Hodgkin-Huxley models with the simplicity and predictive power of generalized integrate-and-fire models. We found that feedforward inhibition of 5-HT neurons by heterogeneous SOM neurons implemented divisive inhibition, while endocannabinoid-mediated modulation of excitatory drive to the DRN increased the gain of 5-HT output. Our most striking finding was that the output of the DRN encodes a mixture of the intensity and temporal derivative of its input, and that the temporal derivative component dominates this mixture precisely when the input is increasing rapidly. This network computation primarily emerged from prominent adaptation mechanisms found in 5-HT neurons, including a previously undescribed dynamic threshold. By applying a bottom-up neural network modeling approach, our results suggest that the DRN is particularly apt to encode input changes over short timescales, reflecting one of the salient emerging computations that dominate its output to regulate behavior.

Serotonin regulation of behavior via large-scale neuromodulation of serotonin receptor networks

Although we understand how serotonin receptors function at the single-cell level, what role different serotonin receptors play in regulating brain-wide activity and, in turn, human behavior, remains unknown. Here, we developed transcriptomic-neuroimaging mapping to characterize brain-wide functional signatures associated with specific serotonin receptors: serotonin receptor networks (SRNs). Probing SRNs with optogenetics-functional magnetic resonance imaging (MRI) and pharmacology in mice, we show that activation of dorsal raphe serotonin neurons differentially modulates the amplitude and functional connectivity of different SRNs, showing that receptors' spatial distributions can confer specificity not only at the local, but also at the brain-wide, network level. In humans, using resting-state functional MRI, SRNs replicate established divisions of serotonin effects on impulsivity and negative biases. These results provide compelling evidence that heterogeneous brain-wide distributions of different serotonin receptor types may underpin behaviorally distinct modes of serotonin regulation. This suggests that serotonin neurons may regulate multiple aspects of human behavior via modulation of large-scale receptor networks.

Dopamine and serotonin interplay for valence-based spatial learning

Dopamine (DA) and serotonin (5-HT) are important neuromodulators of synaptic plasticity that have been linked to learning from positive or negative outcomes or valence-based learning. In the hippocampus, both affect long-term plasticity but play different roles in encoding uncertainty or predicted reward. DA has been related to positive valence, from reward consumption or avoidance behavior, and 5-HT to aversive encoding. We propose DA produces overall LTP while 5-HT elicits LTD. Here, we compare two reward-modulated spike timing-dependent plasticity (R-STDP) rules to describe the action of these neuromodulators. We examined their role in cognitive performance and flexibility for computational models of the Morris water maze task and reversal learning. Our results show that the interplay of DA and 5-HT improves learning performance and can explain experimental evidence. This study reinforces the importance of neuromodulation in determining the direction of plasticity.

Neuromodulatory Control of Early Visual Processing in Macaque

Visual processing is dynamically controlled by multiple neuromodulatory molecules that modify the responsiveness of neurons and the strength of the connections between them. In particular, modulatory control of processing in the lateral geniculate nucleus of the thalamus, V1, and V2 will alter the outcome of all subsequent processing of visual information, including the extent to and manner in which individual inputs contribute to perception and decision making and are stored in memory. This review addresses five small-molecule neuromodulators-acetylcholine, dopamine, serotonin, noradrenaline, and histamine-considering the structural basis for their action, and the effects of their release, in the early visual pathway of the macaque monkey. Traditionally, neuromodulators are studied in isolation and in discrete circuits; this review makes a case for considering the joint action of modulatory molecules and differences in modulatory effects across brain areas as a better means of understanding the diverse roles that these molecules serve.

Modulating the Neuromodulators: Dopamine, Serotonin, and the Endocannabinoid System

Dopamine (DA), serotonin (5-hydroxytryptamine, 5-HT), and endocannabinoids (ECs) are key neuromodulators involved in many aspects of motivated behavior, including reward processing, reinforcement learning, and behavioral flexibility. Among the longstanding views about possible relationships between these neuromodulators is the idea of DA and 5-HT acting as opponents. This view has been challenged by emerging evidence that 5-HT supports reward seeking via activation of DA neurons in the ventral tegmental area. Adding an extra layer of complexity to these interactions, the endocannabinoid system is uniquely placed to influence dopaminergic and serotonergic neurotransmission. In this review we discuss how these three neuromodulatory systems interact at the cellular and circuit levels. Technological advances that facilitate precise identification and control of genetically targeted neuronal populations will help to achieve a better understanding of the complex relationship between these essential systems, and the potential relevance for motivated behavior.

Reward Contributions to Serotonergic Functions

The brain serotonin systems participate in numerous aspects of reward processing, although it remains elusive how exactly serotonin signals regulate neural computation and reward-related behavior. The application of optogenetics and imaging techniques during the last decade has provided many insights. Here, we review recent progress on the organization and physiology of the dorsal raphe serotonin neurons and the relationships between their activity and behavioral functions in the context of reward processing. We also discuss several interesting theories on serotonin's function and how these theories may be reconciled by the possibility that serotonin, acting in synergy with coreleased glutamate, tracks and calculates the so-called beneficialness of the current state to guide an animal's behavior in dynamic environments.

Anatomically Defined and Functionally Distinct Dorsal Raphe Serotonin Sub-systems

The dorsal raphe (DR) constitutes a major serotonergic input to the forebrain and modulates diverse functions and brain states, including mood, anxiety, and sensory and motor functions. Most functional studies to date have treated DR serotonin neurons as a single population. Using viral-genetic methods, we found that subcortical- and cortical-projecting serotonin neurons have distinct cell-body distributions within the DR and differentially co-express a vesicular glutamate transporter. Further, amygdala- and frontal-cortex-projecting DR serotonin neurons have largely complementary whole-brain collateralization patterns, receive biased inputs from presynaptic partners, and exhibit opposite responses to aversive stimuli. Gain- and loss-of-function experiments suggest that amygdala-projecting DR serotonin neurons promote anxiety-like behavior, whereas frontal-cortex-projecting neurons promote active coping in the face of challenge. These results provide compelling evidence that the DR serotonin system contains parallel sub-systems that differ in input and output connectivity, physiological response properties, and behavioral functions.

Pharmacological Dopamine Manipulation Does Not Alter Reward-Based Improvements in Memory Retention during a Visuomotor Adaptation Task

Motor adaptation tasks investigate our ability to adjust motor behaviors to an ever-changing and unpredictable world. Previous work has shown that punishment-based feedback delivered during a visuomotor adaptation task enhances error-reduction, whereas reward increases memory retention. While the neural underpinnings of the influence of punishment on the adaptation phase remain unclear, reward has been hypothesized to increase retention through dopaminergic mechanisms. We directly tested this hypothesis through pharmacological manipulation of the dopaminergic system. A total of 96 young healthy human participants were tested in a placebo-controlled double-blind between-subjects design in which they adapted to a 40° visuomotor rotation under reward or punishment conditions. We confirmed previous evidence that reward enhances retention, but the dopamine (DA) precursor levodopa (LD) or the DA antagonist haloperidol failed to influence performance. We reason that such a negative result could be due to experimental limitations or it may suggest that the effect of reward on motor memory retention is not driven by dopaminergic processes. This provides further insight regarding the role of motivational feedback in optimizing motor learning, and the basis for further decomposing the effect of reward on the subprocesses known to underlie motor adaptation paradigms.

Monoaminergic Neuromodulation of Sensory Processing

All neuronal circuits are subject to neuromodulation. Modulatory effects on neuronal processing and resulting behavioral changes are most commonly reported for higher order cognitive brain functions. Comparatively little is known about how neuromodulators shape processing in sensory brain areas that provide the signals for downstream regions to operate on. In this article, we review the current knowledge about how the monoamine neuromodulators serotonin, dopamine and noradrenaline influence the representation of sensory stimuli in the mammalian sensory system. We review the functional organization of the monoaminergic brainstem neuromodulatory systems in relation to their role for sensory processing and summarize recent neurophysiological evidence showing that monoamines have diverse effects on early sensory processing, including changes in gain and in the precision of neuronal responses to sensory inputs. We also highlight the substantial evidence for complementarity between these neuromodulatory systems with different patterns of innervation across brain areas and cortical layers as well as distinct neuromodulatory actions. Studying the effects of neuromodulators at various target sites is a crucial step in the development of a mechanistic understanding of neuronal information processing in the healthy brain and in the generation and maintenance of mental diseases.

Intrinsic and Extrinsic Neuromodulation of Olfactory Processing

Neuromodulation is a ubiquitous feature of neural systems, allowing flexible, context specific control over network dynamics. Neuromodulation was first described in invertebrate motor systems and early work established a basic dichotomy for neuromodulation as having either an intrinsic origin (i.e., neurons that participate in network coding) or an extrinsic origin (i.e., neurons from independent networks). In this conceptual dichotomy, intrinsic sources of neuromodulation provide a “memory” by adjusting network dynamics based upon previous and ongoing activation of the network itself, while extrinsic neuromodulators provide the context of ongoing activity of other neural networks. Although this dichotomy has been thoroughly considered in motor systems, it has received far less attention in sensory systems. In this review, we discuss intrinsic and extrinsic modulation in the context of olfactory processing in invertebrate and vertebrate model systems. We begin by discussing presynaptic modulation of olfactory sensory neurons by local interneurons (LNs) as a mechanism for gain control based on ongoing network activation. We then discuss the cell-class specific effects of serotonergic centrifugal neurons on olfactory processing. Finally, we briefly discuss the integration of intrinsic and extrinsic neuromodulation (metamodulation) as an effective mechanism for exerting global control over olfactory network dynamics. The heterogeneous nature of neuromodulation is a recurring theme throughout this review as the effects of both intrinsic and extrinsic modulation are generally non-uniform.

Pavlovian Control of Escape and Avoidance

To survive in complex environments, animals need to have mechanisms to select effective actions quickly, with minimal computational costs. As perhaps the computationally most parsimonious of these systems, Pavlovian control accomplishes this by hardwiring specific stereotyped responses to certain classes of stimuli. It is well documented that appetitive cues initiate a Pavlovian bias toward vigorous approach; however, Pavlovian responses to aversive stimuli are less well understood. Gaining a deeper understanding of aversive Pavlovian responses, such as active avoidance, is important given the critical role these behaviors play in several psychiatric conditions. The goal of the current study was to establish a behavioral and computational framework to examine aversive Pavlovian responses (activation vs. inhibition) depending on the proximity of an aversive state (escape vs. avoidance). We introduce a novel task in which participants are exposed to primary aversive (noise) stimuli and characterized behavior using a novel generative computational model. This model combines reinforcement learning and drift-diffusion models so as to capture effects of invigoration/inhibition in both explicit choice behavior as well as changes in RT. Choice and RT results both suggest that escape is associated with a bias for vigorous action, whereas avoidance is associated with behavioral inhibition. These results lay a foundation for future work seeking insights into typical and atypical aversive Pavlovian responses involved in psychiatric disorders, allowing us to quantify both implicit and explicit indices of vigorous choice behavior in the context of aversion.

Serotonin Decreases the Gain of Visual Responses in Awake Macaque V1

Serotonin, an important neuromodulator in the brain, is implicated in affective and cognitive functions. However, its role even for basic cortical processes is controversial. For example, in the mammalian primary visual cortex (V1), heterogenous serotonergic modulation has been observed in anesthetized animals. Here, we combined extracellular single-unit recordings with iontophoresis in awake animals. We examined the role of serotonin on well-defined tuning properties (orientation, spatial frequency, contrast, and size) in V1 of two male macaque monkeys. We find that in the awake macaque the modulatory effect of serotonin is surprisingly uniform: it causes a mainly multiplicative decrease of the visual responses and a slight increase in the stimulus-selective response latency. Moreover, serotonin neither systematically changes the selectivity or variability of the response, nor the interneuronal correlation unexplained by the stimulus ("noise-correlation"). The modulation by serotonin has qualitative similarities with that for a decrease in stimulus contrast, but differs quantitatively from decreasing contrast. It can be captured by a simple additive change to a threshold-linear spiking nonlinearity. Together, our results show that serotonin is well suited to control the response gain of neurons in V1 depending on the animal's behavioral or motivational context, complementing other known state-dependent gain-control mechanisms.SIGNIFICANCE STATEMENT Serotonin is an important neuromodulator in the brain and a major target for drugs used to treat psychiatric disorders. Nonetheless, surprisingly little is known about how it shapes information processing in sensory areas. Here we examined the serotonergic modulation of visual processing in the primary visual cortex of awake behaving macaque monkeys. We found that serotonin mainly decreased the gain of the visual responses, without systematically changing their selectivity, variability, or covariability. This identifies a simple computational function of serotonin for state-dependent sensory processing, depending on the animal's affective or motivational state.

The role of the serotonergic system in motor control

The serotonergic system in the vertebrate brain is implicated in various behaviors and diseases. Its involvement in motor control has been studied for over half a century, but efforts to build a unified model of its functions have been hampered due to the complexity of serotonergic neuromodulation. This review summarizes the anatomical structure of the serotonergic system, its afferent and efferent connections to other brain regions, and recent insights into the sensorimotor computations in the serotonergic system, and considers future research directions into the roles of serotonergic system in motor control.

GluA2-Lacking AMPA Receptors and Nitric Oxide Signaling Gate Spike-Timing-Dependent Potentiation of Glutamate Synapses in the Dorsal Raphe Nucleus

The dorsal raphe nucleus (DRn) receives glutamatergic inputs from numerous brain areas that control the function of DRn serotonin (5-HT) neurons. By integrating these synaptic inputs, 5-HT neurons modulate a plethora of behaviors and physiological functions. However, it remains unknown whether the excitatory inputs onto DRn 5-HT neurons can undergo activity-dependent change of strength, as well as the mechanisms that control their plasticity. Here, we describe a novel form of spike-timing–dependent long-term potentiation (tLTP) of glutamate synapses onto rat DRn 5-HT neurons. This form of synaptic plasticity is initiated by an increase in postsynaptic intracellular calcium but is maintained by a persistent increase in the probability of glutamate release. The tLTP of glutamate synapses onto DRn 5-HT is independent of NMDA receptors but requires the activation of calcium-permeable AMPA receptors and voltage-dependent calcium channels. The presynaptic expression of the tLTP is mediated by the retrograde messenger nitric oxide (NO) and activation of cGMP/PKG pathways. Collectively, these results indicate that glutamate synapses in the DRn undergo activity-dependent synaptic plasticity gated by NO signaling and unravel a previously unsuspected role of NO in controlling synaptic function and plasticity in the DRn.

For Motor Adjustments, Serotonin Steps In

To adapt to their environment, animals subconsciously calculate how motor commands can be efficiently translated into the actual movements. Kawashima et al. discovered that serotonergic neurons in the dorsal raphe nucleus regulate the transient memory of such efficacy; thus, successive behaviors do not require repeated cumbersome readjustment of efficacy.

The Serotonergic System Tracks the Outcomes of Actions to Mediate Short-Term Motor Learning

To execute accurate movements, animals must continuously adapt their behavior to changes in their bodies and environments. Animals can learn changes in the relationship between their locomotor commands and the resulting distance moved, then adjust command strength to achieve a desired travel distance. It is largely unknown which circuits implement this form of motor learning, or how. Using whole-brain neuronal imaging and circuit manipulations in larval zebrafish, we discovered that the serotonergic dorsal raphe nucleus (DRN) mediates short-term locomotor learning. Serotonergic DRN neurons respond phasically to swim-induced visual motion, but little to motion that is not self-generated. During prolonged exposure to a given motosensory gain, persistent DRN activity emerges that stores the learned efficacy of motor commands and adapts future locomotor drive for tens of seconds. The DRN's ability to track the effectiveness of motor intent may constitute a computational building block for the broader functions of the serotonergic system. VIDEO ABSTRACT.

Models of neuromodulation for computational psychiatry

Psychiatry faces fundamental challenges: based on a syndrome-based nosology, it presently lacks clinical tests to infer on disease processes that cause symptoms of individual patients and must resort to trial-and-error treatment strategies. These challenges have fueled the recent emergence of a novel field-computational psychiatry-that strives for mathematical models of disease processes at physiological and computational (information processing) levels. This review is motivated by one particular goal of computational psychiatry: the development of 'computational assays' that can be applied to behavioral or neuroimaging data from individual patients and support differential diagnosis and guiding patient-specific treatment. Because the majority of available pharmacotherapeutic approaches in psychiatry target neuromodulatory transmitters, models that infer (patho)physiological and (patho)computational actions of different neuromodulatory transmitters are of central interest for computational psychiatry. This article reviews the (many) outstanding questions on the computational roles of neuromodulators (dopamine, acetylcholine, serotonin, and noradrenaline), outlines available evidence, and discusses promises and pitfalls in translating these findings to clinical applications. WIREs Cogn Sci 2017, 8:e1420. doi: 10.1002/wcs.1420 For further resources related to this article, please visit the WIREs website.

Activation and inhibition of tph2 serotonergic neurons operate in tandem to influence larval zebrafish preference for light over darkness

Serotonergic neurons have been implicated in a broad range of processes, but the principles underlying their effects remain a puzzle. Here, we ask how these neurons influence the tendency of larval zebrafish to swim in the light and avoid regions of darkness. Pharmacological inhibition of serotonin synthesis reduces dark avoidance, indicating an involvement of this neuromodulator. Calcium imaging of tph2-expressing cells demonstrates that a rostral subset of dorsal raphe serotonergic neurons fire continuously while the animal is in darkness, but are inhibited in the light. Optogenetic manipulation of tph2 neurons by channelrhodopsin or halorhodopsin expression modifies preference, confirming a role for these neurons. In particular, these results suggest that fish prefer swimming in conditions that elicits lower activity in tph2 serotonergic neurons in the rostral raphe.

Dorsal raphe nucleus projecting retinal ganglion cells: Why Y cells?

Retinal ganglion Y (alpha) cells are found in retinas ranging from frogs to mice to primates. The highly conserved nature of the large, fast conducting retinal Y cell is a testament to its fundamental task, although precisely what this task is remained ill-defined. The recent discovery that Y-alpha retinal ganglion cells send axon collaterals to the serotonergic dorsal raphe nucleus (DRN) in addition to the lateral geniculate nucleus (LGN), medial interlaminar nucleus (MIN), pretectum and the superior colliculus (SC) has offered new insights into the important survival tasks performed by these cells with highly branched axons. We propose that in addition to its role in visual perception, the Y-alpha retinal ganglion cell provides concurrent signals via axon collaterals to the DRN, the major source of serotonergic afferents to the forebrain, to dramatically inhibit 5-HT activity during orientation or alerting/escape responses, which dis-facilitates ongoing tonic motor activity while dis-inhibiting sensory information processing throughout the visual system. The new data provide a fresh view of these evolutionarily old retinal ganglion cells.

A network model of basal ganglia for understanding the roles of dopamine and serotonin in reward-punishment-risk based decision making

There is significant evidence that in addition to reward-punishment based decision making, the Basal Ganglia (BG) contributes to risk-based decision making (Balasubramani et al., 2014). Despite this evidence, little is known about the computational principles and neural correlates of risk computation in this subcortical system. We have previously proposed a reinforcement learning (RL)-based model of the BG that simulates the interactions between dopamine (DA) and serotonin (5HT) in a diverse set of experimental studies including reward, punishment and risk based decision making (Balasubramani et al., 2014). Starting with the classical idea that the activity of mesencephalic DA represents reward prediction error, the model posits that serotoninergic activity in the striatum controls risk-prediction error. Our prior model of the BG was an abstract model that did not incorporate anatomical and cellular-level data. In this work, we expand the earlier model into a detailed network model of the BG and demonstrate the joint contributions of DA-5HT in risk and reward-punishment sensitivity. At the core of the proposed network model is the following insight regarding cellular correlates of value and risk computation. Just as DA D1 receptor (D1R) expressing medium spiny neurons (MSNs) of the striatum were thought to be the neural substrates for value computation, we propose that DA D1R and D2R co-expressing MSNs are capable of computing risk. Though the existence of MSNs that co-express D1R and D2R are reported by various experimental studies, prior existing computational models did not include them. Ours is the first model that accounts for the computational possibilities of these co-expressing D1R-D2R MSNs, and describes how DA and 5HT mediate activity in these classes of neurons (D1R-, D2R-, D1R-D2R- MSNs). Starting from the assumption that 5HT modulates all MSNs, our study predicts significant modulatory effects of 5HT on D2R and co-expressing D1R-D2R MSNs which in turn explains the multifarious functions of 5HT in the BG. The experiments simulated in the present study relates 5HT to risk sensitivity and reward-punishment learning. Furthermore, our model is shown to capture reward-punishment and risk based decision making impairment in Parkinson's Disease (PD). The model predicts that optimizing 5HT levels along with DA medications might be essential for improving the patients' reward-punishment learning deficits.