Serotonergic neurons signal reward and punishment on multiple timescales

Architectural Representation of Valence in the Limbic System

In order to thrive, animals must be able to recognize aversive and appetitive stimuli within the environment and subsequently initiate appropriate behavioral responses. This assignment of positive or negative valence to a stimulus is a key feature of emotional processing, the neural substrates of which have been a topic of study for several decades. Until recently, the result of this work has been the identification of specific brain regions, such as the basolateral amygdala (BLA) and nucleus accumbens (NAc), as important to valence encoding. The advent of modern tools in neuroscience has allowed further dissection of these regions to identify specific populations of neurons signaling the valence of environmental stimuli. In this review, we focus upon recent work examining the mechanisms of valence encoding, and provide a model for the systematic investigation of valence within anatomically-, genetically-, and functionally defined populations of neurons.

Safety out of control: dopamine and defence

We enjoy a sophisticated understanding of how animals learn to predict appetitive outcomes and direct their behaviour accordingly. This encompasses well-defined learning algorithms and details of how these might be implemented in the brain. Dopamine has played an important part in this unfolding story, appearing to embody a learning signal for predicting rewards and stamping in useful actions, while also being a modulator of behavioural vigour. By contrast, although choosing correct actions and executing them vigorously in the face of adversity is at least as important, our understanding of learning and behaviour in aversive settings is less well developed. We examine aversive processing through the medium of the role of dopamine and targets such as D2 receptors in the striatum. We consider critical factors such as the degree of control that an animal believes it exerts over key aspects of its environment, the distinction between 'better' and 'good' actual or predicted future states, and the potential requirement for a particular form of opponent to dopamine to ensure proper calibration of state values.

ON and OFF retinal ganglion cells differentially regulate serotonergic and GABAergic activity in the dorsal raphe nucleus

The dorsal raphe nucleus (DRN), the major source of serotonergic input to the forebrain, receives excitatory input from the retina that can modulate serotonin levels and depressive-like behavior. In the Mongolian gerbil, retinal ganglion cells (RGCs) with alpha-like morphological and Y-like physiological properties innervate the DRN with ON DRN-projecting RGCs out numbering OFF DRN-projecting RGCs. The DRN neurons targeted by ON and OFF RGCs are unknown. To explore retino-raphe anatomical organization, retinal afferents labeled with Cholera toxin B were examined for association with the postsynaptic protein PSD-95. Synaptic associations between retinal afferents and DRN serotonergic and GABAergic neurons were observed. To explore retino-raphe functional organization, light-evoked c-fos expression was examined. Light significantly increased the number of DRN serotonergic and GABAergic cells expressing c-Fos. When ON RGCs were rendered silent while enhancing the firing rate of OFF RGCs, c-Fos expression was greatly increased in DRN serotonergic neurons suggesting that OFF DRN-projecting RGCs predominately activate serotonergic neurons whereas ON DRN-projecting RGCs mainly target GABAergic neurons. Direct glutamatergic retinal input to DRN 5-HT neurons contributes to the complex excitatory drive regulating these cells. Light, via the retinoraphe pathway can modify DRN 5-HT neuron activity which may play a role in modulating affective behavior.

Serotonin's Complex Role in Alcoholism: Implications for Treatment and Future Research

Current pharmacological treatments for alcohol dependence have focused on reducing alcohol consumption, but to date there are few treatments that also address the negative affective symptoms during acute and protracted alcohol withdrawal which are often exacerbated in people with comorbid anxiety and depression. Selective serotonin reuptake inhibitors (SSRIs) are sometimes prescribed to ameliorate these symptoms but can exacerbate anxiety and cravings in a select group of patients. In this critical review, we discuss recent literature describing an association between alcohol dependence, the SERT linked polymorphic region (5-HTTLPR), and pharmacological response to SSRIs. Given the heterogeneity in responsiveness to serotonergic drugs across the spectrum of alcoholic subtypes, we assess the contribution of specific 5-HT circuits to discrete endophenotypes of alcohol dependence. 5-HT circuits play a distinctive role in reward, stress, and executive function which may account for the variation in response to serotonergic drugs. New optogenetic and chemogenetic methods for dissecting 5-HT circuits in alcohol dependence may provide clues leading to more effective pharmacotherapies. Although our current understanding of the role of 5-HT systems in alcohol dependence is incomplete, there is some evidence to suggest that 5-HT3 receptor antagonists are effective in people with the L/L genotype of the 5-HTTLPR polymorphism while SSRIs may be more beneficial to people with the S/L or S/S genotype. Studies that assess the impact of serotonin transporter polymorphisms on 5-HT circuit function and the subsequent development of alcohol use disorders will be an important step forward in treating alcohol dependence.

Optogenetic Activation of Dorsal Raphe Serotonin Neurons Rapidly Inhibits Spontaneous But Not Odor-Evoked Activity in Olfactory Cortex

Serotonin (5-hydroxytriptamine; 5-HT) is implicated in a variety of brain functions including not only the regulation of mood and control of behavior but also the modulation of perception. 5-HT neurons in the dorsal raphe nucleus (DRN) often fire locked to sensory stimuli, but little is known about how 5-HT affects sensory processing, especially on this timescale. Here, we used an optogenetic approach to study the effect of 5-HT on single-unit activity in the mouse primary olfactory (anterior piriform) cortex. We show that activation of DRN 5-HT neurons rapidly inhibits the spontaneous firing of olfactory cortical neurons, acting in a divisive manner, but entirely spares sensory-driven firing. These results identify a new role for serotonergic modulation in dynamically regulating the balance between different sources of neural activity in sensory systems, suggesting a possible role for 5-HT in perceptual inference.

SIGNIFICANCE STATEMENT

Serotonin is implicated in a wide variety of (pato)physiological functions including perception, but its precise role has remained elusive. Here, using optogenetic tools in vivo, we show that serotonergic neuromodulation prominently inhibits the spontaneous electrical activity of neurons in the primary olfactory cortex on a rapid (<1 s) timescale but leaves sensory responses unaffected. These results identify a new role for serotonergic modulation in rapidly changing the balance between different sources of neural activity in sensory systems.

The Brain on Drugs: From Reward to Addiction

Advances in neuroscience identified addiction as a chronic brain disease with strong genetic, neurodevelopmental, and sociocultural components. We here discuss the circuit- and cell-level mechanisms of this condition and its co-option of pathways regulating reward, self-control, and affect. Drugs of abuse exert their initial reinforcing effects by triggering supraphysiologic surges of dopamine in the nucleus accumbens that activate the direct striatal pathway via D1 receptors and inhibit the indirect striato-cortical pathway via D2 receptors. Repeated drug administration triggers neuroplastic changes in glutamatergic inputs to the striatum and midbrain dopamine neurons, enhancing the brain's reactivity to drug cues, reducing the sensitivity to non-drug rewards, weakening self-regulation, and increasing the sensitivity to stressful stimuli and dysphoria. Drug-induced impairments are long lasting; thus, interventions designed to mitigate or even reverse them would be beneficial for the treatment of addiction.

Target-specific modulation of the descending prefrontal cortex inputs to the dorsal raphe nucleus by cannabinoids

Serotonin (5-HT) neurons located in the raphe nuclei modulate a wide range of behaviors by means of an expansive innervation pattern. In turn, the raphe receives a vast array of synaptic inputs, and a remaining challenge lies in understanding how these individual inputs are organized, processed, and modulated in this nucleus to contribute ultimately to the core coding features of 5-HT neurons. The details of the long-range, top-down control exerted by the medial prefrontal cortex (mPFC) in the dorsal raphe nucleus (DRN) are of particular interest, in part, because of its purported role in stress processing and mood regulation. Here, we found that the mPFC provides a direct monosynaptic, glutamatergic drive to both DRN 5-HT and GABA neurons and that this architecture was conducive to a robust feed-forward inhibition. Remarkably, activation of cannabinoid (CB) receptors differentially modulated the mPFC inputs onto these cell types in the DRN, in effect regulating the synaptic excitatory/inhibitory balance governing the excitability of 5-HT neurons. Thus, the CB system dynamically reconfigures the processing features of the DRN, a mood-related circuit believed to provide a concerted and distributed regulation of the excitability of large ensembles of brain networks.

Serotonin, Amygdala and Fear: Assembling the Puzzle

The fear circuitry orchestrates defense mechanisms in response to environmental threats. This circuitry is evolutionarily crucial for survival, but its dysregulation is thought to play a major role in the pathophysiology of psychiatric conditions in humans. The amygdala is a key player in the processing of fear. This brain area is prominently modulated by the neurotransmitter serotonin (5-hydroxytryptamine, 5-HT). The 5-HT input to the amygdala has drawn particular interest because genetic and pharmacological alterations of the 5-HT transporter (5-HTT) affect amygdala activation in response to emotional stimuli. Nonetheless, the impact of 5-HT on fear processing remains poorly understood.The aim of this review is to elucidate the physiological role of 5-HT in fear learning via its action on the neuronal circuits of the amygdala. Since 5-HT release increases in the basolateral amygdala (BLA) during both fear memory acquisition and expression, we examine whether and how 5-HT neurons encode aversive stimuli and aversive cues. Next, we describe pharmacological and genetic alterations of 5-HT neurotransmission that, in both rodents and humans, lead to altered fear learning. To explore the mechanisms through which 5-HT could modulate conditioned fear, we focus on the rodent BLA. We propose that a circuit-based approach taking into account the localization of specific 5-HT receptors on neurochemically-defined neurons in the BLA may be essential to decipher the role of 5-HT in emotional behavior. In keeping with a 5-HT control of fear learning, we review electrophysiological data suggesting that 5-HT regulates synaptic plasticity, spike synchrony and theta oscillations in the BLA via actions on different subcellular compartments of principal neurons and distinct GABAergic interneuron populations. Finally, we discuss how recently developed optogenetic tools combined with electrophysiological recordings and behavior could progress the knowledge of the mechanisms underlying 5-HT modulation of fear learning via action on amygdala circuits. Such advancement could pave the way for a deeper understanding of 5-HT in emotional behavior in both health and disease.

Activation and inhibition of tph2 serotonergic neurons operate in tandem to influence larval zebrafish preference for light over darkness

Serotonergic neurons have been implicated in a broad range of processes, but the principles underlying their effects remain a puzzle. Here, we ask how these neurons influence the tendency of larval zebrafish to swim in the light and avoid regions of darkness. Pharmacological inhibition of serotonin synthesis reduces dark avoidance, indicating an involvement of this neuromodulator. Calcium imaging of tph2-expressing cells demonstrates that a rostral subset of dorsal raphe serotonergic neurons fire continuously while the animal is in darkness, but are inhibited in the light. Optogenetic manipulation of tph2 neurons by channelrhodopsin or halorhodopsin expression modifies preference, confirming a role for these neurons. In particular, these results suggest that fish prefer swimming in conditions that elicits lower activity in tph2 serotonergic neurons in the rostral raphe.

An Emerging Technology Framework for the Neurobiology of Appetite

Advances in neuro-technology for mapping, manipulating, and monitoring molecularly defined cell types are rapidly advancing insight into neural circuits that regulate appetite. Here, we review these important tools and their applications in circuits that control food seeking and consumption. Technical capabilities provided by these tools establish a rigorous experimental framework for research into the neurobiology of hunger.

Serotonin promotes exploitation in complex environments by accelerating decision-making

Background

Fast responses can provide a competitive advantage when resources are inhomogeneously distributed. The nematode Caenorhabditis elegans was shown to modulate locomotion on a lawn of bacterial food in serotonin (5-HT)-dependent manners. However, potential roles for serotonergic signaling in responding to food discovery are poorly understood.

Results

We found that 5-HT signaling in C. elegans facilitates efficient exploitation in complex environments by mediating a rapid response upon encountering food. Genetic or cellular manipulations leading to deficient serotonergic signaling resulted in gradual responses and defective exploitation of a patchy foraging landscape. Physiological imaging revealed that the NSM serotonergic neurons responded acutely upon encounter with newly discovered food and were key to rapid responses. In contrast, the onset of responses of ADF serotonergic neurons preceded the physical encounter with the food. The serotonin-gated chloride channel MOD-1 and the ortholog of mammalian 5-HT1 metabotropic serotonin receptors SER-4 acted in synergy to accelerate decision-making. The relevance of responding rapidly was demonstrated in patchy environments, where the absence of 5-HT signaling was detrimental to exploitation.

Conclusions

Our results implicate 5-HT in a novel form of decision-making, demonstrate its fitness consequences, suggest that NSM and ADF act in concert to modulate locomotion in complex environments, and identify the synergistic action of a channel and a metabotropic receptor in accelerating C. elegans decision-making.

Electronic supplementary material

The online version of this article (doi:10.1186/s12915-016-0232-y) contains supplementary material, which is available to authorized users.

Serotonin neurons in the dorsal raphe nucleus encode reward signals

The dorsal raphe nucleus (DRN) is involved in organizing reward-related behaviours; however, it remains unclear how genetically defined neurons in the DRN of a freely behaving animal respond to various natural rewards. Here we addressed this question using fibre photometry and single-unit recording from serotonin (5-HT) neurons and GABA neurons in the DRN of behaving mice. Rewards including sucrose, food, sex and social interaction rapidly activate 5-HT neurons, but aversive stimuli including quinine and footshock do not. Both expected and unexpected rewards activate 5-HT neurons. After mice learn to wait for sucrose delivery, most 5-HT neurons fire tonically during waiting and then phasically on reward acquisition. Finally, GABA neurons are activated by aversive stimuli but inhibited when mice seek rewards. Thus, DRN 5-HT neurons positively encode a wide range of reward signals during anticipatory and consummatory phases of reward responses. Moreover, GABA neurons play a complementary role in reward processing.

Acute selective serotonin reuptake inhibitors regulate the dorsal raphe nucleus causing amplification of terminal serotonin release

Selective serotonin reuptake inhibitors (SSRIs) were designed to treat depression by increasing serotonin levels throughout the brain via inhibition of clearance from the extracellular space. Although increases in serotonin levels are observed after acute SSRI exposure, 3–6 weeks of continuous use is required for relief from the symptoms of depression. Thus, it is now believed that plasticity in multiple brain systems that are downstream of serotonergic inputs contributes to the therapeutic efficacy of SSRIs. The onset of antidepressant effects also coincides with desensitization of somatodendritic serotonin autoreceptors in the dorsal raphe nucleus (DRN), suggesting that disrupting inhibitory feedback within the serotonin system may contribute to the therapeutic effects of SSRIs. Previously, we showed that chronic SSRI treatment caused a frequency‐dependent facilitation of serotonin signaling that persisted in the absence of uptake inhibition. In this work, we use in vivo fast‐scan cyclic voltammetry in mice to investigate a similar facilitation after a single treatment of the SSRI citalopram hydrobromide. Acute citalopram hydrobromide treatment resulted in frequency‐dependent increases of evoked serotonin release in the substantia nigra pars reticulata. These increases were independent of changes in uptake velocity, but required SERT expression. Using microinjections, we show that the frequency‐dependent enhancement in release is because of SERT inhibition in the DRN, demonstrating that SSRIs can enhance serotonin release by inhibiting uptake in a location distal to the terminal release site. The novel finding that SERT inhibition can disrupt modulatory mechanisms at the level of the DRN to facilitate serotonin release will help future studies investigate serotonin's role in depression and motivated behavior.

In this work, stimulations of the dorsal raphe nucleus (DRN) evoke serotonin release that is recorded in the substantia nigra pars reticulata (SNpr) using in vivo fast‐scan cyclic voltammetry. Systemic administration of a selective serotonin reuptake inhibitor (SSRI) causes both an increase in t_1/2 and an increase in [5‐HT]_max in the SNpr. Local application of SSRI to the DRN recapitulates the increase in [5‐HT]_max observed in the SNpr without affecting uptake. Thus, SSRIs increase serotonin signaling via two distinct SERT‐mediated mechanisms.

Activation of raphe nuclei triggers rapid and distinct effects on parallel olfactory bulb output channels

The serotonergic raphe nuclei are involved in regulating brain states over timescales of minutes and hours. We examined more rapid effects of raphe activation on two classes of principal neurons in the mouse olfactory bulb, mitral and tufted cells, which send olfactory information to distinct targets. Brief stimulation of the raphe nuclei led to excitation of tufted cells at rest and potentiation of their odor responses. While mitral cells at rest were also excited by raphe activation, their odor responses were bidirectionally modulated, leading to improved pattern separation of odors. In vitro whole-cell recordings revealed that specific optogenetic activation of raphe axons affected bulbar neurons through dual release of serotonin and glutamate. Therefore, the raphe nuclei, in addition to their role in neuromodulation of brain states, are also involved in fast, sub-second top-down modulation similar to cortical feedback. This modulation can selectively and differentially sensitize or decorrelate distinct output channels.

Ascending serotonin neuron diversity under two umbrellas

Forebrain serotonin relevant for many psychological disorders arises in the hindbrain, primarily within the dorsal and median raphe nuclei (DR and MR). These nuclei are heterogeneous, containing several distinct groups of serotonin neurons. Here, new insight into the afferent and efferent connectivity of these areas is reviewed in correlation with their developmental origin. These data suggest that the caudal third of the DR, the area originally designated B6, may be misidentified as part of the DR as it shares many features of connectivity with the MR. By considering the rostral DR independently and affiliating the B6 to the MR, the diverse subgroups of serotonin neurons can be arranged with more coherence into two umbrella groups, each with distinctive domains of influence. Serotonin neurons within the rostral DR are uniquely interconnected with brain areas associated with emotion and motivation such as the amygdala, accumbens and ventral pallidum. In contrast serotonin neurons in the B6 and MR are characterized by their dominion over the septum and hippocampus. This distinction between the DR and B6/MR parallels their developmental origin and likely impacts their role in both behavior and psychopathology. Implications and further subdivisions within these areas are discussed.

Interacting Neural Processes of Feeding, Hyperactivity, Stress, Reward, and the Utility of the Activity-Based Anorexia Model of Anorexia Nervosa

Anorexia nervosa (AN) is a psychiatric illness with minimal effective treatments and a very high rate of mortality. Understanding the neurobiological underpinnings of the disease is imperative for improving outcomes and can be aided by the study of animal models. The activity-based anorexia rodent model (ABA) is the current best parallel for the study of AN. This review describes the basic neurobiology of feeding and hyperactivity seen in both ABA and AN, and compiles the research on the role that stress-response and reward pathways play in modulating the homeostatic drive to eat and to expend energy, which become dysfunctional in ABA and AN.

Mechanisms of 5-HT1A receptor-mediated transmission in dorsal raphe serotonin neurons

KEY POINTS

In the dorsal raphe nucleus, it is known that serotonin release activates metabotropic 5-HT1A autoreceptors located on serotonin neurons that leads to an inhibition of firing through the activation of G-protein-coupled inwardly rectifying potassium channels. We found that in mouse brain slices evoked serotonin release produced a 5-HT1A receptor-mediated inhibitory postsynaptic current (IPSC) that resulted in only a transient pause in firing. While spillover activation of receptors contributed to evoked IPSCs, serotonin reuptake transporters prevented pooling of serotonin in the extrasynaptic space from activating 5-HT1A -IPSCs. As a result, the decay of 5-HT1A -IPSCs was independent of the intensity of stimulation or the probability of transmitter release. These results indicate that evoked serotonin transmission in the dorsal raphe nucleus mediated by metabotropic 5-HT1A autoreceptors may occur via point-to-point synapses rather than by paracrine mechanisms.

ABSTRACT

In the dorsal raphe nucleus (DRN), feedback activation by Gαi/o -coupled 5-HT1A autoreceptors reduces the excitability of serotoninergic neurons, which decreases serotonin release both locally within the DRN and in projection regions. Serotonin transmission within the DRN is thought to occur via transmitter spillover and paracrine activation of extrasynaptic receptors. Here, we tested the volume transmission hypothesis in mouse DRN brain slices by recording 5-HT1A receptor-mediated inhibitory postsynaptic currents (5-HT1A -IPSCs) generated by the activation of G-protein-coupled inwardly rectifying potassium channels (GIRKs). We found that in the DRN of ePET1-EYFP mice, which selectively express enhanced yellow fluorescent protein in serontonergic neurons, the local release of serotonin generated 5-HT1A -IPSCs in serotonin neurons that rose and fell within a second. The transient activation of 5-HT1A autoreceptors resulted in brief pauses in neuron firing that did not alter the overall firing rate. The duration of 5-HT1A -IPSCs was primarily shaped by receptor deactivation due to clearance via serotonin reuptake transporters. Slowing diffusion with dextran prolonged the rise and reduced the amplitude the IPSCs and the effects were potentiated when uptake was inhibited. By examining the decay kinetics of IPSCs, we found that while spillover may allow for the activation of extrasynaptic receptors, efficient uptake by serotonin reuptake transporters (SERTs) prevented the pooling of serotonin from prolonging the duration of transmission when multiple inputs were active. Together the results suggest that the activation of 5-HT1A receptors in the DRN results from the local release of serotonin rather than the extended diffusion throughout the extracellular space.

Central Cholinergic Neurons Are Rapidly Recruited by Reinforcement Feedback

Basal forebrain cholinergic neurons constitute a major neuromodulatory system implicated in normal cognition and neurodegenerative dementias. Cholinergic projections densely innervate neocortex, releasing acetylcholine to regulate arousal, attention, and learning. However, their precise behavioral function is poorly understood because identified cholinergic neurons have never been recorded during behavior. To determine which aspects of cognition their activity might support, we recorded cholinergic neurons using optogenetic identification in mice performing an auditory detection task requiring sustained attention. We found that a non-cholinergic basal forebrain population-but not cholinergic neurons-were correlated with trial-to-trial measures of attention. Surprisingly, cholinergic neurons responded to reward and punishment with unusual speed and precision (18 ± 3 ms). Cholinergic responses were scaled by the unexpectedness of reinforcement and were highly similar across neurons and two nuclei innervating distinct cortical areas. These results reveal that the cholinergic system broadcasts a rapid and precisely timed reinforcement signal, supporting fast cortical activation and plasticity.

Mood as Representation of Momentum

Experiences affect mood, which in turn affects subsequent experiences. Recent studies suggest two specific principles. First, mood depends on how recent reward outcomes differ from expectations. Second, mood biases the way we perceive outcomes (e.g., rewards), and this bias affects learning about those outcomes. We propose that this two-way interaction serves to mitigate inefficiencies in the application of reinforcement learning to real-world problems. Specifically, we propose that mood represents the overall momentum of recent outcomes, and its biasing influence on the perception of outcomes ‘corrects’ learning to account for environmental dependencies. We describe potential dysfunctions of this adaptive mechanism that might contribute to the symptoms of mood disorders.

With increasing use of computational models to understand human behavior, scientists have begun to model the dynamics of subjective states such as mood.

Recent data suggest that mood reflects the cumulative impact of differences between reward outcomes and expectations.

Behavioral and neural findings suggest that mood biases the perception of reward outcomes such that outcomes are perceived as better when one is in a good mood relative to when one is in a bad mood.

These two lines of research establish a bidirectional interaction between mood and reinforcement learning, which may play an important adaptive role in healthy behavior, and whose dysfunction might contribute to psychiatric disorders.

Dorsal raphe nucleus projecting retinal ganglion cells: Why Y cells?

Retinal ganglion Y (alpha) cells are found in retinas ranging from frogs to mice to primates. The highly conserved nature of the large, fast conducting retinal Y cell is a testament to its fundamental task, although precisely what this task is remained ill-defined. The recent discovery that Y-alpha retinal ganglion cells send axon collaterals to the serotonergic dorsal raphe nucleus (DRN) in addition to the lateral geniculate nucleus (LGN), medial interlaminar nucleus (MIN), pretectum and the superior colliculus (SC) has offered new insights into the important survival tasks performed by these cells with highly branched axons. We propose that in addition to its role in visual perception, the Y-alpha retinal ganglion cell provides concurrent signals via axon collaterals to the DRN, the major source of serotonergic afferents to the forebrain, to dramatically inhibit 5-HT activity during orientation or alerting/escape responses, which dis-facilitates ongoing tonic motor activity while dis-inhibiting sensory information processing throughout the visual system. The new data provide a fresh view of these evolutionarily old retinal ganglion cells.

Reward modulates the effect of visual cortical microstimulation on perceptual decisions

Effective perceptual decisions rely upon combining sensory information with knowledge of the rewards available for different choices. However, it is not known where reward signals interact with the multiple stages of the perceptual decision-making pathway and by what mechanisms this may occur. We combined electrical microstimulation of functionally specific groups of neurons in visual area V5/MT with performance-contingent reward manipulation, while monkeys performed a visual discrimination task. Microstimulation was less effective in shifting perceptual choices towards the stimulus preferences of the stimulated neurons when available reward was larger. Psychophysical control experiments showed this result was not explained by a selective change in response strategy on microstimulated trials. A bounded accumulation decision model, applied to analyse behavioural performance, revealed that the interaction of expected reward with microstimulation can be explained if expected reward modulates a sensory representation stage of perceptual decision-making, in addition to the better-known effects at the integration stage.

DOI:http://dx.doi.org/10.7554/eLife.07832.001

Identifying how an object is moving in three-dimensional (3D) space depends upon a brain region known as V5/MT. The neurons that make up area V5/MT form groups that each have a ‘preference’ for a particular direction of movement and a particular 3D depth. If a group of neurons detects its preferred direction of movement and 3D depth, it will become highly active. The brain can assess which groups of neurons are active, in a process known as integration. This information can then be used to work out the object's movement in space.

The process of integration can be influenced by whether a rewarding outcome is expected to result from identifying the 3D movement correctly. This allows the brain to increase its likelihood of success in situations where a large reward is on offer. Until now, it was thought that the activity in area V5/MT, which takes place before integration, was not affected by the likelihood of receiving a reward.

As well as being ‘naturally’ stimulated by moving objects, the V5/MT neurons can also be ‘artificially’ activated by a technique called microstimulation, which uses a tiny electrode to electrically stimulate groups of neurons. Microstimulation can bias visual perception towards the movement and 3D depth ‘preference’ of the artificially activated neurons. If the V5/MT neurons do receive information about potential rewards from other areas of the brain, we would expect rewards to affect naturally and artificially stimulated neural activity in different ways. On the other hand, if the V5/MT neurons do not receive any information about reward, then it will not matter whether their activity is natural or artificial; the signal that they produce will be the same.

Cicmil et al. gave two monkeys a task in which they could receive rewards for correctly identifying a three-dimensional cylinder's direction of rotation, and applied microstimulation to specific groups of V5/MT neurons on some of the trials. When a larger reward was available, microstimulation was less able to bias the monkeys' choices about the rotation direction of the 3D cylinders.

Overall, Cicmil et al.'s results suggest that the V5/MT neurons are able to incorporate information about reward, before integration occurs. The next step will be to record the activity of area V5/MT to investigate exactly how this happens.

DOI:http://dx.doi.org/10.7554/eLife.07832.002

Autism: Oxytocin, serotonin, and social reward

Over 70 years since the first description of the disease, disrupted social behavior remains a core clinical feature of autistic spectrum disorder. The complex etiology of the disorder portends the need for a better understanding of the brain mechanisms that enable social behaviors, particularly those that are relevant to autism which is characterized by a failure to develop peer relationships, difficulty with emotional reciprocity and imitative play, and disrupted language and communication skills. Toward this end, the current review will examine recent progress that has been made toward understanding the neural mechanisms underlying consociate social attachments.

Habenula Lesions Reveal that Multiple Mechanisms Underlie Dopamine Prediction Errors

Dopamine (DA) neurons are thought to facilitate learning by signaling reward prediction errors (RPEs), the discrepancy between actual and expected reward. However, how RPEs are calculated remains unknown. It has been hypothesized that DA neurons receive RPE signals from the lateral habenula. Here, we tested how lesions of the habenular complex affect the response of optogenetically identified DA neurons in mice. We found that lesions impaired specific aspects of RPE signaling in DA neurons. The inhibitory responses caused by reward omission were greatly diminished while inhibitory responses to aversive stimuli, such as air puff-predictive cues or air puff, remained unimpaired. Furthermore, we found that after habenula lesions, DA neurons' ability to signal graded levels of positive RPEs became unreliable, yet significant excitatory responses still remained. These results demonstrate that the habenula plays a critical role in DA RPE signaling but suggest that it is not the exclusive source of RPE signals.

The good, the bad and the brain: Neural correlates of appetitive and aversive values underlying decision making

Approaching rewards and avoiding punishments could be considered as core principles governing behavior. Experiments from behavioral economics have shown that choices involving gains and losses follow different policy rules, suggesting that appetitive and aversive processes might rely on different brain systems. Here we contrast this hypothesis with recent neuroscience studies exploring the human brain from brainstem nuclei to cortical areas. Although some circuits show rigid specialization, many others appear to process both appetitive and aversive stimuli, in a flexible manner that depends on a context-wise subjective reference point. Moreover, appetitive and aversive aspects are often integrated into net values that are signaled with enhanced activity in 'positive regions', and suppressed activity in 'negative regions'. This dichotomy might explain why drugs or lesions can produce valence-specific effects, biasing decisions towards approaching a reward or avoiding a punishment.

Reward processing by the dorsal raphe nucleus: 5-HT and beyond

The dorsal raphe nucleus (DRN) represents one of the most sensitive reward sites in the brain. However, the exact relationship between DRN neuronal activity and reward signaling has been elusive. In this review, we will summarize anatomical, pharmacological, optogenetics, and electrophysiological studies on the functions and circuit mechanisms of DRN neurons in reward processing. The DRN is commonly associated with serotonin (5-hydroxytryptamine; 5-HT), but this nucleus also contains neurons of the neurotransmitter phenotypes of glutamate, GABA and dopamine. Pharmacological studies indicate that 5-HT might be involved in modulating reward- or punishment-related behaviors. Recent optogenetic stimulations demonstrate that transient activation of DRN neurons produces strong reinforcement signals that are carried out primarily by glutamate. Moreover, activation of DRN 5-HT neurons enhances reward waiting. Electrophysiological recordings reveal that the activity of DRN neurons exhibits diverse behavioral correlates in reward-related tasks. Studies so far thus demonstrate the strong power of DRN neurons in reward signaling and at the same time invite additional efforts to dissect the roles and mechanisms of different DRN neuron types in various processes of reward-related behaviors.

5-HT1A Receptor-Mediated Autoinhibition and the Control of Serotonergic Cell Firing

The idea that serotonergic synaptic transmission plays an essential role in the control of mood and the pharmacotherapy of anxiety and depression is one of the cornerstones of modern biological psychiatry. As a result, there is intense interest in understanding the mechanisms controlling the activity of serotonin-synthesizing (serotonergic) neurons. One of the oldest and most durable ideas emerging from this work is that serotonergic neurons are capable of autonomously regulating their own basal firing rate. Serotonergic neurons express on their surface 5-HT1A receptors (autoreceptors) that, when activated, induce the opening of potassium channels that hyperpolarize and thereby inhibit cell firing. Activity-dependent release of serotonin within serotonergic nuclei is thought to activate these autoreceptors, thus completing an autoinhibitory feedback loop. This concept, which was originally proposed in the 1970s, has proven to be enormously fruitful and has guided the interpretation of a broad range of clinical and preclinical work. Yet, remarkably, electrophysiological studies seeking to directly demonstrate this phenomenon, especially in in vitro brain slices, have produced mixed results. Here, we critically review this work with a focus on electrophysiological studies, which directly assess neuronal activity. We also highlight recent work suggesting that 5-HT1A receptor-mediated autoinhibition may play other roles in the control of firing besides acting as a feedback regulator for the pacemaker-like firing rate of serotonergic neurons.

Serotonin's many meanings elude simple theories

Neurons that produce serotonin respond in a number of different and complex ways in anticipation and receipt of rewards or punishments.