The GABAB receptor agonist baclofen administered into the median and dorsal raphe nuclei is rewarding as shown by intracranial self-administration and conditioned place preference in rats

The dorsal raphe nucleus in the control of energy balance

Energy balance is orchestrated by an extended network of highly interconnected nuclei across the central nervous system. While much is known about the hypothalamic circuits regulating energy homeostasis, the 'extra-hypothalamic' circuits involved are relatively poorly understood. In this review, we focus on the brainstem's dorsal raphe nucleus (DRN), integrating decades of research linking this structure to the physiologic and behavioral responses that maintain proper energy stores. DRN neurons sense and respond to interoceptive and exteroceptive cues related to energy imbalance and in turn induce appropriate alterations in energy intake and expenditure. The DRN is also molecularly differentiable, with different populations playing distinct and often opposing roles in controlling energy balance. These populations are integrated into the extended circuit known to regulate energy balance. Overall, this review summarizes the key evidence demonstrating an important role for the DRN in regulating energy balance.

Serotonergic regulation of the dopaminergic system: Implications for reward-related functions

Serotonin is a critical neuromodulator involved in development and behavior. Its role in reward is however still debated. Here, we first review classical studies involving electrical stimulation protocols and pharmacological approaches. Contradictory results on the serotonergic' involvement in reward emerge from these studies. These differences might be ascribable to either the diversity of cellular types within the raphe nuclei or/and the specific projection pathways of serotonergic neurons. We continue to review more recent work, using optogenetic approaches to activate serotonergic cells in the Raphe to VTA pathway. From these studies, it appears that activation of this pathway can lead to reinforcement learning mediated through the excitation of dopaminergic neurons by serotonergic neurons co-transmitting glutamate. Finally, given the importance of serotonin during development on adult emotion, the effect of abnormal early-life levels of serotonin on the dopaminergic system will also be discussed. Understanding the interaction between the serotonergic and dopaminergic systems during development and adulthood is critical to gain insight into the specific facets of neuropsychiatric disorders.

Reward Contributions to Serotonergic Functions

The brain serotonin systems participate in numerous aspects of reward processing, although it remains elusive how exactly serotonin signals regulate neural computation and reward-related behavior. The application of optogenetics and imaging techniques during the last decade has provided many insights. Here, we review recent progress on the organization and physiology of the dorsal raphe serotonin neurons and the relationships between their activity and behavioral functions in the context of reward processing. We also discuss several interesting theories on serotonin's function and how these theories may be reconciled by the possibility that serotonin, acting in synergy with coreleased glutamate, tracks and calculates the so-called beneficialness of the current state to guide an animal's behavior in dynamic environments.

Dorsal Raphe Dual Serotonin-Glutamate Neurons Drive Reward by Establishing Excitatory Synapses on VTA Mesoaccumbens Dopamine Neurons

Dorsal raphe (DR) serotonin neurons provide a major input to the ventral tegmental area (VTA). Here, we show that DR serotonin transporter (SERT) neurons establish both asymmetric and symmetric synapses on VTA dopamine neurons, but most of these synapses are asymmetric. Moreover, the DR-SERT terminals making asymmetric synapses on VTA dopamine neurons coexpress vesicular glutamate transporter 3 (VGluT3; transporter for accumulation of glutamate for its synaptic release), suggesting the excitatory nature of these synapses. VTA photoactivation of DR-SERT fibers promotes conditioned place preference, elicits excitatory currents on mesoaccumbens dopamine neurons, increases their firing, and evokes dopamine release in nucleus accumbens. These effects are blocked by VTA inactivation of glutamate and serotonin receptors, supporting the idea of glutamate release in VTA from dual DR SERT-VGluT3 inputs. Our findings suggest a path-specific input from DR serotonergic neurons to VTA that promotes reward by the release of glutamate and activation of mesoaccumbens dopamine neurons.

Role of GABA(B) receptors in learning and memory and neurological disorders

Although it is evident from the literature that altered GABAB receptor function does affect behavior, these results often do not correspond well. These differences could be due to the task protocol, animal strain, ligand concentration, or timing of administration utilized. Because several clinical populations exhibit learning and memory deficits in addition to altered markers of GABA and the GABAB receptor, it is important to determine whether altered GABAB receptor function is capable of contributing to the deficits. The aim of this review is to examine the effect of altered GABAB receptor function on synaptic plasticity as demonstrated by in vitro data, as well as the effects on performance in learning and memory tasks. Finally, data regarding altered GABA and GABAB receptor markers within clinical populations will be reviewed. Together, the data agree that proper functioning of GABAB receptors is crucial for numerous learning and memory tasks and that targeting this system via pharmaceuticals may benefit several clinical populations.

Reward processing by the dorsal raphe nucleus: 5-HT and beyond

The dorsal raphe nucleus (DRN) represents one of the most sensitive reward sites in the brain. However, the exact relationship between DRN neuronal activity and reward signaling has been elusive. In this review, we will summarize anatomical, pharmacological, optogenetics, and electrophysiological studies on the functions and circuit mechanisms of DRN neurons in reward processing. The DRN is commonly associated with serotonin (5-hydroxytryptamine; 5-HT), but this nucleus also contains neurons of the neurotransmitter phenotypes of glutamate, GABA and dopamine. Pharmacological studies indicate that 5-HT might be involved in modulating reward- or punishment-related behaviors. Recent optogenetic stimulations demonstrate that transient activation of DRN neurons produces strong reinforcement signals that are carried out primarily by glutamate. Moreover, activation of DRN 5-HT neurons enhances reward waiting. Electrophysiological recordings reveal that the activity of DRN neurons exhibits diverse behavioral correlates in reward-related tasks. Studies so far thus demonstrate the strong power of DRN neurons in reward signaling and at the same time invite additional efforts to dissect the roles and mechanisms of different DRN neuron types in various processes of reward-related behaviors.

Serotonergic neurons signal reward and punishment on multiple timescales

Serotonin's function in the brain is unclear. One challenge in testing the numerous hypotheses about serotonin's function has been observing the activity of identified serotonergic neurons in animals engaged in behavioral tasks. We recorded the activity of dorsal raphe neurons while mice experienced a task in which rewards and punishments varied across blocks of trials. We ‘tagged’ serotonergic neurons with the light-sensitive protein channelrhodopsin-2 and identified them based on their responses to light. We found three main features of serotonergic neuron activity: (1) a large fraction of serotonergic neurons modulated their tonic firing rates over the course of minutes during reward vs punishment blocks; (2) most were phasically excited by punishments; and (3) a subset was phasically excited by reward-predicting cues. By contrast, dopaminergic neurons did not show firing rate changes across blocks of trials. These results suggest that serotonergic neurons signal information about reward and punishment on multiple timescales.

DOI:http://dx.doi.org/10.7554/eLife.06346.001

Rewards and punishments can both encourage animals to change their immediate behavior and influence their mood over a longer term, particularly when given repeatedly. A region of the brain that increases its activity in response to rewards and punishments also contains many neurons that communicate with each other by releasing a chemical called serotonin. This chemical is commonly thought to produce feelings of happiness; however, it remains unclear exactly how these particular ‘serotonergic’ neurons help to process rewards and punishments.

The ideal way to work out the role that a type of neuron plays in a behavior is to measure its electrical activity as the behavior is being performed. However, it is difficult to distinguish the activity of serotonergic neurons from the activity of the non-serotonergic neurons around them. To overcome this problem, Cohen et al. used viruses to force serotonergic neurons to make a type of ion channel that produces electrical currents in response to light. Shining light on these neurons via optical fibers and then measuring the neurons' responses helped to develop criteria that can identify which responses are generated by the serotonergic neurons.

Cohen et al. then recorded the activity of serotonergic neurons in thirsty mice as they experienced a series of rewards (for example, a drop of water) or punishments (such as a puff of air to the eye). Each reward or punishment was preceded by a distinct odor, so that the mice learned to anticipate what was coming.

These experiments revealed that serotonergic neurons respond to rewards and punishments by changing two aspects of their electrical activity: by producing short bursts of high activity, and by altering their baseline activity. Some of the serotonergic neurons fired rapidly in response to punishments, but not rewards; others fired rapidly when the mice detected a scent that meant that a reward was about to be given. The average level of reward or punishment the mice received also affected the baseline activity of many of the serotonergic neurons; this effect lasted for several minutes.

Overall, Cohen et al. suggest that serotonergic neurons can affect how mice respond to rewards or punishments in both the short and long term. Future experiments should aim to understand the diversity of the signals that Cohen et al. observed, and to determine how these signals are used to drive behavior. Ultimately, understanding how neural circuits made up of different types of cells work may aid in understanding the neural basis of behavior.

DOI:http://dx.doi.org/10.7554/eLife.06346.002

A glutamatergic reward input from the dorsal raphe to ventral tegmental area dopamine neurons

Electrical stimulation of the dorsal raphe (DR) and ventral tegmental area (VTA) activates the fibres of the same reward pathway but the phenotype of this pathway and the direction of the reward-relevant fibres have not been determined. Here we report rewarding effects following activation of a DR-originating pathway consisting of vesicular glutamate transporter 3 (VGluT3) containing neurons that form asymmetric synapses onto VTA dopamine neurons that project to nucleus accumbens. Optogenetic VTA activation of this projection elicits AMPA-mediated synaptic excitatory currents in VTA mesoaccumbens dopaminergic neurons and causes dopamine release in nucleus accumbens. Activation also reinforces instrumental behaviour and establishes conditioned place preferences. These findings indicate that the DR-VGluT3 pathway to VTA utilizes glutamate as a neurotransmitter and is a substrate linking the DR-one of the most sensitive reward sites in the brain--to VTA dopaminergic neurons.

Dopamine is differentially involved in the locomotor hyperactivity produced by manipulations of opioid, GABA and glutamate receptors in the median raphe nucleus

The median raphe nucleus (MR) has been shown to exert a powerful influence on behavioral arousal and marked locomotor hyperactivity can be produced by intra-MR injections of a variety of drugs including GABAA and GABAB agonists, excitatory amino acid antagonists, and μ- and δ-opioid agonists. Other studies have indicated that the MR exerts an inhibitory influence on ascending dopamine systems, suggesting that MR induced alterations in activity may be mediated through changes in dopaminergic transmission. In the present study, we explored this possibility by examining whether systemic administration of the preferential D2 dopamine antagonist haloperidol is able to antagonize the hyperactivity produced by intra-MR injections of various drugs. We found that haloperidol completely blocked the locomotor response to intra-MR injections of the μ-opioid receptor agonist DAMGO and the δ-opioid receptor agonist DPDPE. In marked contrast, at doses which abolished the locomotor response to systemic amphetamine, haloperidol had no effect on the hyperactivity induced by intra-MR injections of GABAA agonist muscimol, the GABAB agonist baclofen, or the kainate/quisqualate antagonist pBB-PZDA, even though it suppressed baseline activity in these same animals. These results indicate that there must be at least two mechanisms capable of influencing behavioral arousal within the MR region, one of which is dependent on D2 dopamine receptors and the other is not.

Neurocircuitry of drug reward

In recent years, neuroscientists have produced profound conceptual and mechanistic advances on the neurocircuitry of reward and substance use disorders. Here, we will provide a brief review of intracranial drug self-administration and optogenetic self-stimulation studies that identified brain regions and neurotransmitter systems involved in drug- and reward-related behaviors. Also discussed is a theoretical framework that helps to understand the functional properties of the circuitry involved in these behaviors. The circuitry appears to be homeostatically regulated and mediate anticipatory processes that regulate behavioral interaction with the environment in response to salient stimuli. That is, abused drugs or, at least, some may act on basic motivation and mood processes, regulating behavior-environment interaction. Optogenetics and related technologies have begun to uncover detailed circuit mechanisms linking key brain regions in which abused drugs act for rewarding effects. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'.

Rewarding and incentive motivational effects of excitatory amino acid receptor antagonists into the median raphe and adjacent regions of the rat

RATIONALE

The motivational process that regulates approach behavior toward salient distal stimuli (i.e., incentive motivation) plays a key role in voluntary behavior and motivational disorders such as addiction. This process may be mediated by many neurotransmitter systems and a network of many brain structures, including the median and dorsal raphe regions (MR and DR, respectively).

OBJECTIVE

We sought to examine whether the blockade of excitatory amino acid receptors in the MR and DR is rewarding, using intracranial self-administration, and whether the self-administration effect can be explained by drug's effectiveness to enhance incentive motivation, using a visual sensation seeking procedure.

RESULTS

Rats learned to self-administer the AMPA receptor antagonist ZK 200775 into the vicinity of the MR, DR, or medial oral pontine reticular regions, but not the ventral tegmental area. The NMDA receptor antagonist AP5 was also self-administered into the MR, while it was not readily self-administered into other regions. When ZK 200775 was noncontingently administered into the MR, rats markedly increased approach responses rewarded by brief illumination of a light stimulus. In addition, contingent administration of ZK 200775 into the MR induced a conditioning effect on approach responses.

CONCLUSIONS

Rats self-administer excitatory amino acid receptor antagonists into the MR and adjacent regions. Self-administration effect of AMPA receptor antagonists into the MR can be largely explained by the manipulation's properties to invigorate ongoing approach behavior and induces conditioned approach. Glutamatergic afferents to the median raphe and adjacent regions appear to tonically suppress incentive-motivational processes.

Synergistic interaction between baclofen administration into the median raphe nucleus and inconsequential visual stimuli on investigatory behavior of rats

RATIONALE

Noncontingent administration of amphetamine into the ventral striatum or systemic nicotine increases responses rewarded by inconsequential visual stimuli. When these drugs are contingently administered, rats learn to self-administer them. We recently found that rats self-administer the GABA(B) receptor agonist baclofen into the median (MR) or dorsal (DR) raphe nuclei.

OBJECTIVES

We examined whether noncontingent administration of baclofen into the MR or DR increases rats' investigatory behavior rewarded by a flash of light.

RESULTS

Contingent presentations of a flash of light slightly increased lever presses. Whereas noncontingent administration of baclofen into the MR or DR did not reliably increase lever presses in the absence of visual stimulus reward, the same manipulation markedly increased lever presses rewarded by the visual stimulus. Heightened locomotor activity induced by intraperitoneal injections of amphetamine (3 mg/kg) failed to concur with increased lever pressing for the visual stimulus. These results indicate that the observed enhancement of visual stimulus seeking is distinct from an enhancement of general locomotor activity. Visual stimulus seeking decreased when baclofen was co-administered with the GABA(B) receptor antagonist, SCH 50911, confirming the involvement of local GABA(B) receptors. Seeking for visual stimulus also abated when baclofen administration was preceded by intraperitoneal injections of the dopamine antagonist, SCH 23390 (0.025 mg/kg), suggesting enhanced visual stimulus seeking depends on intact dopamine signals.

CONCLUSIONS

Baclofen administration into the MR or DR increased investigatory behavior induced by visual stimuli. Stimulation of GABA(B) receptors in the MR and DR appears to disinhibit the motivational process involving stimulus-approach responses.

The mesopontine rostromedial tegmental nucleus: an integrative modulator of the reward system

The mesopontine rostromedial tegmental nucleus (RMTg) is a newly discovered brain structure thought to profoundly influence reward-related pathways. The RMTg is prominently GABAergic, receives dense projections from the lateral habenula and projects strongly to the midbrain ventral tegmental area and substantia nigra compacta. It receives additional afferent connections from widespread brain structures and sends additional strong efferent connections to a number of non-dopaminergic brainstem structures and, to a lesser extent, the forebrain. Projection neurons of the RMTg have been shown to express Fos in response to aversive stimuli and/or reward omission and psychostimulant drug administration. This review will first recount how the RMTg was discovered and then describe in greater detail what is known about its neuroanatomical relationships, including afferent and efferent connections, neurotransmitters, and receptors. Finally, we will focus on what has been reported about its function.

GABAB receptors in reward processes

gamma-aminobutyric acid (GABA) is the predominant inhibitory neurotransmitter in the brain which acts through different receptor subtypes. Metabotropic GABA(B) receptors are widely distributed throughout the brain. Alterations in GABA signaling through pharmacological activation or deactivation of the GABA(B) receptor regulate behavior and brain reward processes. GABA(B) receptor agonists and, most recently, positive modulators have been found to inhibit the reinforcing effects of drugs of abuse, such as cocaine, amphetamine, nicotine, ethanol, and opiates. This converging evidence of the effects of GABA(B) compounds on the reinforcing properties of addictive drugs is based on behavioral studies that used a variety of procedures with relevance to reward processes and drug abuse liability, including intracranial self-stimulation, intravenous self-administration under both fixed- and progressive-ratio schedules of reinforcement, reinstatement, and conditioned place preference. GABA(B) receptor agonists and positive modulators block the reinforcing effects of drugs of abuse in these animal models. However, GABA(B) receptor agonists also have undesirable side-effects. GABA(B) receptor modulators have potential advantages as medications for drug addiction. These compounds have a better side-effect profile than GABA(B) agonists because they are devoid of intrinsic agonistic activity in the absence of GABA. They only exert their modulatory actions in concert with endogenous GABAergic activity. Thus, GABA(B) receptor positive modulators are promising therapeutics for the treatment of various aspects of dependence (e.g., initiation, maintenance, and relapse) on various drugs of abuse, such as cocaine, nicotine, heroin, and alcohol.

Brain reward circuitry beyond the mesolimbic dopamine system: a neurobiological theory

Reductionist attempts to dissect complex mechanisms into simpler elements are necessary, but not sufficient for understanding how biological properties like reward emerge out of neuronal activity. Recent studies on intracranial self-administration of neurochemicals (drugs) found that rats learn to self-administer various drugs into the mesolimbic dopamine structures-the posterior ventral tegmental area, medial shell nucleus accumbens and medial olfactory tubercle. In addition, studies found roles of non-dopaminergic mechanisms of the supramammillary, rostromedial tegmental and midbrain raphe nuclei in reward. To explain intracranial self-administration and related effects of various drug manipulations, I outlined a neurobiological theory claiming that there is an intrinsic central process that coordinates various selective functions (including perceptual, visceral, and reinforcement processes) into a global function of approach. Further, this coordinating process for approach arises from interactions between brain structures including those structures mentioned above and their closely linked regions: the medial prefrontal cortex, septal area, ventral pallidum, bed nucleus of stria terminalis, preoptic area, lateral hypothalamic areas, lateral habenula, periaqueductal gray, laterodorsal tegmental nucleus and parabrachical area.

Administration of the GABAA receptor antagonist picrotoxin into rat supramammillary nucleus induces c-Fos in reward-related brain structures. Supramammillary picrotoxin and c-Fos expression

BACKGROUND

Picrotoxin blocks GABAA receptors, whose activation typically inhibits neuronal firing activity. We recently found that rats learn to selectively self-administer picrotoxin or bicuculline, another GABAA receptor antagonist, into the supramammillary nucleus (SuM), a posterior hypothalamic structure localized anterior to the ventral tegmental area. Other drugs such as nicotine or the excitatory amino acid AMPA are also self-administered into the SuM. The SuM appears to be functionally linked with the mesolimbic dopamine system and is closely connected with other brain structures that are implicated in motivational processes, including the prefrontal cortex, septal area, preoptic area, lateral hypothalamic area and dorsal raphe nucleus. Here, we hypothesized that these brain structures are activated by picrotoxin injections into the SuM.

RESULTS

Picrotoxin administration into the SuM markedly facilitated locomotion and rearing. Further, it increased c-Fos expression in this region, suggesting blockade of tonic inhibition and thus the disinhibition of local neurons. This manipulation also increased c-Fos expression in structures including the ventral tegmental area, medial shell of the nucleus accumbens, medial prefrontal cortex, septal area, preoptic area, lateral hypothalamic area and dorsal raphe nucleus.

CONCLUSIONS

Picrotoxin administration into the SuM appears to disinhibit local neurons and recruits activation of brain structures associated with motivational processes, including the mesolimbic dopamine system, prefrontal cortex, septal area, preoptic area, lateral hypothalamic area and dorsal raphe nucleus. These regions may be involved in mediating positive motivational effects triggered by intra-SuM picrotoxin.