Conditioned place preference induced by microinjection of 8-OH-DPAT into the dorsal or median raphe nucleus

Median raphe serotonergic neurons projecting to the interpeduncular nucleus control preference and aversion

Appropriate processing of reward and aversive information is essential for survival. Although a critical role of serotonergic neurons in the dorsal raphe nucleus (DRN) in reward processing has been shown, the lack of rewarding effects with selective serotonin reuptake inhibitors (SSRIs) implies the presence of a discrete serotonergic system playing an opposite role to the DRN in the processing of reward and aversive stimuli. Here, we demonstrated that serotonergic neurons in the median raphe nucleus (MRN) of mice process reward and aversive information in opposite directions to DRN serotonergic neurons. We further identified MRN serotonergic neurons, including those projecting to the interpeduncular nucleus (5-HT^MRN→IPN), as a key mediator of reward and aversive stimuli. Moreover, 5-HT receptors, including 5-HT_2A receptors in the interpeduncular nucleus, are involved in the aversive properties of MRN serotonergic neural activity. Our findings revealed an essential function of MRN serotonergic neurons, including 5-HT^MRN→IPN, in the processing of reward and aversive stimuli.

What Can Reinforcement Learning Models of Dopamine and Serotonin Tell Us about the Action of Antidepressants?

Although evidence suggests that antidepressants are effective at treating depression, the mechanisms behind antidepressant action remain unclear, especially at the cognitive/computational level. In recent years, reinforcement learning (RL) models have increasingly been used to characterise the roles of neurotransmitters and to probe the computations that might be altered in psychiatric disorders like depression. Hence, RL models might present an opportunity for us to better understand the computational mechanisms underlying antidepressant effects. Moreover, RL models may also help us shed light on how these computations may be implemented in the brain (e.g., in midbrain, striatal, and prefrontal regions) and how these neural mechanisms may be altered in depression and remediated by antidepressant treatments. In this paper, we evaluate the ability of RL models to help us understand the processes underlying antidepressant action. To do this, we review the preclinical literature on the roles of dopamine and serotonin in RL, draw links between these findings and clinical work investigating computations altered in depression, and appraise the evidence linking modification of RL processes to antidepressant function. Overall, while there is no shortage of promising ideas about the computational mechanisms underlying antidepressant effects, there is insufficient evidence directly implicating these mechanisms in the response of depressed patients to antidepressant treatment. Consequently, future studies should investigate these mechanisms in samples of depressed patients and assess whether modifications in RL processes mediate the clinical effect of antidepressant treatments.

A Role for Serotonin in Modulating Opposing Drive and Brake Circuits of Impulsivity

Impulsivity generally refers to a deficit in inhibition, with a focus on understanding the neural circuits which constitute the “brake” on actions and gratification. It is likely that increased impulsivity can arise not only from reduced inhibition, but also from a heightened or exaggerated excitatory “drive.” For example, an action which has more vigor, or is fueled by either increased incentive salience or a stronger action-outcome association, may be harder to inhibit. From this perspective, this review focuses on impulse control as a competition over behavioral output between an initially learned response-reward outcome association, and a subsequently acquired opposing inhibitory association. Our goal is to present a synthesis of research from humans and animal models that supports this dual-systems approach to understanding the behavioral and neural substrates that contribute to impulsivity, with a focus on the neuromodulatory role of serotonin. We review evidence for the role of serotonin signaling in mediating the balance of the “drive” and “brake” circuits. Additionally, we consider parallels of these competing instrumental systems in impulsivity within classical conditioning processes (e.g., extinction) in order to point us to potential behavioral and neural mechanisms that may modulate the competing instrumental associations. Finally, we consider how the balance of these competing associations might contribute to, or be extracted from, our experimental assessments of impulsivity. A careful understanding of the underlying behavioral and circuit level contributions to impulsivity is important for understanding the pathogenesis of increased impulsivity present in a number of psychiatric disorders. Pathological levels of impulsivity in such disorders are likely subserved by deficits in the balance of motivational and inhibitory processes.

The dorsal raphe nucleus in the control of energy balance

Energy balance is orchestrated by an extended network of highly interconnected nuclei across the central nervous system. While much is known about the hypothalamic circuits regulating energy homeostasis, the 'extra-hypothalamic' circuits involved are relatively poorly understood. In this review, we focus on the brainstem's dorsal raphe nucleus (DRN), integrating decades of research linking this structure to the physiologic and behavioral responses that maintain proper energy stores. DRN neurons sense and respond to interoceptive and exteroceptive cues related to energy imbalance and in turn induce appropriate alterations in energy intake and expenditure. The DRN is also molecularly differentiable, with different populations playing distinct and often opposing roles in controlling energy balance. These populations are integrated into the extended circuit known to regulate energy balance. Overall, this review summarizes the key evidence demonstrating an important role for the DRN in regulating energy balance.

Serotonergic regulation of the dopaminergic system: Implications for reward-related functions

Serotonin is a critical neuromodulator involved in development and behavior. Its role in reward is however still debated. Here, we first review classical studies involving electrical stimulation protocols and pharmacological approaches. Contradictory results on the serotonergic' involvement in reward emerge from these studies. These differences might be ascribable to either the diversity of cellular types within the raphe nuclei or/and the specific projection pathways of serotonergic neurons. We continue to review more recent work, using optogenetic approaches to activate serotonergic cells in the Raphe to VTA pathway. From these studies, it appears that activation of this pathway can lead to reinforcement learning mediated through the excitation of dopaminergic neurons by serotonergic neurons co-transmitting glutamate. Finally, given the importance of serotonin during development on adult emotion, the effect of abnormal early-life levels of serotonin on the dopaminergic system will also be discussed. Understanding the interaction between the serotonergic and dopaminergic systems during development and adulthood is critical to gain insight into the specific facets of neuropsychiatric disorders.

Serotonergic inhibition of responding for conditioned but not primary reinforcers

Serotonin is widely implicated as a modulator of brain reward function. However, laboratory studies have not yielded a consensus on which specific reward-related processes are influenced by serotonin and in what manner. Here we explored the role of serotonin in cue-reward learning in mice. In a first series of experiments, we found that acute administration of the serotonin reuptake inhibitors citalopram, fluoxetine, or duloxetine all reduced lever pressing reinforced on an FR1 schedule with presentation of a cue that had been previously paired with delivery of food. However, citalopram had no effect on responding that was reinforced with both cue and food on an FR1 schedule. Furthermore, citalopram did not affect nose poke responses that produced no auditory, visual, or proprioceptive cues but were reinforced with food pellets on a progressive ratio schedule. We next performed region-specific knock out of tryptophan hydroxylase-2 (Tph2), the rate-limiting enzyme in serotonin synthesis. Viral delivery of Cre recombinase was targeted to dorsal or median raphe nuclei (DRN, MRN), the major sources of ascending serotonergic projections. MRN but not DRN knockouts were impaired in development of cue-elicited approach during Pavlovian conditioning; both groups were subsequently hyper-responsive when lever pressing for cue presentation. The inhibitory effect of citalopram was attenuated in DRN but not MRN knockouts. Our findings are in agreement with prior studies showing serotonin to suppress responding for conditioned reinforcers. Furthermore, these results suggest an inhibitory role of MRN serotonin neurons in the initial attribution of motivational properties to a reward-predictive cue, but not in its subsequent maintenance. In contrast, the DRN appears to promote the reduction of motivational value attached to a cue when it is presented repeatedly in the absence of primary reward.

Down-regulation of habenular calcium-dependent secretion activator 2 induces despair-like behavior

Calcium-dependent secretion activator 2 (CAPS2) regulates the trafficking and exocytosis of neuropeptide-containing dense-core vesicles (DCVs). CAPS2 is prominently expressed in the medial habenula (MHb), which is related to depressive behavior; however, how MHb neurons cause depressive symptoms and the role of CAPS2 remains unclear. We hypothesized that dysfunction of MHb CAPS neurons might cause defects in neuropeptide secretion and the activity of monoaminergic centers, resulting in depressive-like behaviors. In this study, we examined (1) CAPS2 expression in the habenula of depression animal models and major depressive disorder patients and (2) the effects of down-regulation of MHb CAPS2 on the animal behaviors, synaptic transmission in the interpeduncular nucleus (IPN), and neuronal activity of monoamine centers. Habenular CAPS2 expression was decreased in the rat chronic restraint stress model, mouse learned helplessness model, and showed tendency to decrease in depression patients who died by suicide. Knockdown of CAPS2 in the mouse habenula evoked despair-like behavior and a reduction of the release of DCVs in the IPN. Neuronal activity of IPN and monoaminergic centers was also reduced. These results implicate MHb CAPS2 as playing a pivotal role in depressive behavior through the regulation of neuropeptide secretion of the MHb-IPN pathway and the activity of monoaminergic centers.

A Psycho-Behavioral Perspective on Modelling Obsessive-Compulsive Disorder (OCD) in Animals: The Role of Context

Obsessive-compulsive disorder is a heterogeneous and debilitating condition, characterized by intrusive thoughts and compulsive repetition. Animal models of OCD are important tools that have the potential to contribute significantly to our understanding of the condition. Although there is consensus that pre-clinical models are valuable in elucidating the underlying neurobiology in psychiatric disorders, the current paper attempts to prompt ideas on how interpretation of animal behavior can be expanded upon to more effectively converge with the human disorder. Successful outcomes in psychopharmacology involve rational design and synthesis of novel compounds and their testing in well-designed animal models. As part of a special journal issue on OCD, this paper will 1) review the psychobehavioral aspects of OCD that are of importance on how the above ideas can be articulated, 2) briefly elaborate on general issues that are important for the development of animal models of OCD, with a particular focus on the role and importance of context, 3) propose why translational progress may often be less than ideal, 4) highlight some of the significant contributions afforded by animal models to advance understanding, and 5) conclude by identifying novel behavioral constructs for future investigations that may contribute to the face, predictive and construct validity of OCD animal models. We base these targets on an integrative approach to face and construct validity, and note that the issue of treatment-resistance in the clinical context should receive attention in current animal models of OCD.

Dorsal raphe serotonin neurons inhibit operant responding for reward via inputs to the ventral tegmental area but not the nucleus accumbens: evidence from studies combining optogenetic stimulation and serotonin reuptake inhibition

The monoamine neurotransmitter serotonin (5-hydroxytryptamine; 5-HT) exerts an inhibitory influence over motivation, but the circuits mediating this are unknown. Here, we used an optogenetic approach to isolate the contribution of dorsal raphe nucleus (DRN) 5-HT neurons and 5-HT innervation of the mesolimbic dopamine (DA) system to motivated behavior in mice. We found that optogenetic stimulation of DRN 5-HT neurons enhanced downstream 5-HT release, but this was not sufficient to inhibit operant responding for saccharin, a measure of motivated behavior. However, combining optogenetic stimulation of DRN 5-HT neurons with a low dose of the selective serotonin reuptake inhibitor (SSRI) citalopram synergistically reduced operant responding. We then examined whether these effects could be recapitulated if optogenetic stimulation specifically targeted 5-HT terminals in the ventral tegmental area (VTA) or nucleus accumbens (NAc) of the mesolimbic DA system. Optogenetic stimulation of 5-HT input to the VTA combined with citalopram treatment produced a synergistic decrease in responding for saccharin, resembling the changes produced by targeting 5-HT neurons in the DRN. However, this effect was not observed when optogenetic stimulation targeted 5-HT terminals in the NAc. Taken together, these results suggest that DRN 5-HT neurons exert an inhibitory influence over operant responding for reward through a direct interaction with the mesolimbic DA system at the level of the VTA. These studies support an oppositional interaction between 5-HT and DA systems in controlling motivation and goal-directed behavior, and have important implications for the development and refinement of treatment strategies for psychiatric disorders such as depression and addiction.

Dorsal Raphe Dual Serotonin-Glutamate Neurons Drive Reward by Establishing Excitatory Synapses on VTA Mesoaccumbens Dopamine Neurons

Dorsal raphe (DR) serotonin neurons provide a major input to the ventral tegmental area (VTA). Here, we show that DR serotonin transporter (SERT) neurons establish both asymmetric and symmetric synapses on VTA dopamine neurons, but most of these synapses are asymmetric. Moreover, the DR-SERT terminals making asymmetric synapses on VTA dopamine neurons coexpress vesicular glutamate transporter 3 (VGluT3; transporter for accumulation of glutamate for its synaptic release), suggesting the excitatory nature of these synapses. VTA photoactivation of DR-SERT fibers promotes conditioned place preference, elicits excitatory currents on mesoaccumbens dopamine neurons, increases their firing, and evokes dopamine release in nucleus accumbens. These effects are blocked by VTA inactivation of glutamate and serotonin receptors, supporting the idea of glutamate release in VTA from dual DR SERT-VGluT3 inputs. Our findings suggest a path-specific input from DR serotonergic neurons to VTA that promotes reward by the release of glutamate and activation of mesoaccumbens dopamine neurons.

Effects of 5-HT1A, 5-HT2A and 5-HT2C receptor agonists and antagonists on responding for a conditioned reinforcer and its enhancement by methylphenidate

OBJECTIVES

These experiments examined the effects of selective 5-HT_1A, 5-HT_2A and 5-HT_2C receptor ligands on responding for a conditioned reinforcer (CRf). Effects of these ligands were measured under basal conditions and following elevated dopamine (DA) activity produced by the DA reuptake inhibitor methylphenidate.

METHODS

Water-restricted rats learned to associate a conditioned stimulus (CS) with water in operant chambers. Subsequently, two response levers were made available; responding on one lever delivered the CS (now a CRf), while responding on the second lever had no consequences. The effects of agonist and antagonists of 5-HT_1A (8-hydroxy-2(di-n-propylamino)tetralin hydrobromide (8-OH-DPAT) and N-[2-[4-(2-methoxyphenyl)-1-piperazinyl]ethyl]-N-2-pyridinylcyclohexanecarboxamide (WAY100635)), 5-HT_2A (DOI and M100907) and 5-HT_2C (Ro60-0175 and SB242084) receptors on responding were examined alone, as well as in the presence of methylphenidate.

RESULTS

Responding for a CRf was reduced by the agonists 8-OH-DPAT, DOI and Ro60-0175. 8-OH-DPAT also reduced responding for water and seemed to impair responding in a non-specific fashion. None of the receptor antagonists affected responding. Methylphenidate dose-dependently enhanced responding for a CRf, and this was attenuated by DOI and Ro60-0175. Conversely, the 5-HT_2C receptor antagonist SB242084 potentiated the effect of methylphenidate.

CONCLUSIONS

No evidence was found for a behaviourally selective effect of 5-HT_1A receptor ligands on responding for a CRf. Activation of 5-HT_2A receptors selectively inhibits responding for a CRf. 5-HT_2C receptor ligands exerted bidirectional modulation of responding for a CRf, especially when DA activity was increased. This indicates that 5-HT_2C receptor activity is an important modulator of DA-dependent reward-related behaviours.

5-HT1A Autoreceptors in the Dorsal Raphe Nucleus Convey Vulnerability to Compulsive Cocaine Seeking

Cocaine addiction and depression are comorbid disorders. Although it is well recognized that 5-hydroxytryptamine (5-HT; serotonin) plays a central role in depression, our understanding of its role in addiction is notably lacking. The 5-HT system in the brain is carefully controlled by a combined process of regulating 5-HT neuron firing through 5-HT autoreceptors, neurotransmitter release, enzymatic degradation, and reuptake by transporters. This study tests the hypothesis that activation of 5-HT1A autoreceptors, which would lessen 5-HT neuron firing, contributes to cocaine-seeking behaviors. Using 5-HT neuron-specific reduction of 5-HT1A autoreceptor gene expression in mice, we demonstrate that 5-HT1A autoreceptors are necessary for cocaine conditioned place preference. In addition, using designer receptors exclusively activated by designer drugs (DREADDs) technology, we found that stimulation of the serotonergic dorsal raphe nucleus (DRN) afferents to the nucleus accumbens (NAc) abolishes cocaine reward and promotes antidepressive-like behaviors. Finally, using a rat model of compulsive-like cocaine self-administration, we found that inhibition of dorsal raphe 5-HT1A autoreceptors attenuates cocaine self-administration in rats with 6 h extended access, but not 1 h access to the drug. Therefore, our findings suggest an important role for 5-HT1A autoreceptors, and thus DRNNAc 5-HT neuronal activity, in the etiology and vulnerability to cocaine reward and addiction. Moreover, our findings support a strategy for antagonizing 5-HT1A autoreceptors for treating cocaine addiction.

Activation and inhibition of tph2 serotonergic neurons operate in tandem to influence larval zebrafish preference for light over darkness

Serotonergic neurons have been implicated in a broad range of processes, but the principles underlying their effects remain a puzzle. Here, we ask how these neurons influence the tendency of larval zebrafish to swim in the light and avoid regions of darkness. Pharmacological inhibition of serotonin synthesis reduces dark avoidance, indicating an involvement of this neuromodulator. Calcium imaging of tph2-expressing cells demonstrates that a rostral subset of dorsal raphe serotonergic neurons fire continuously while the animal is in darkness, but are inhibited in the light. Optogenetic manipulation of tph2 neurons by channelrhodopsin or halorhodopsin expression modifies preference, confirming a role for these neurons. In particular, these results suggest that fish prefer swimming in conditions that elicits lower activity in tph2 serotonergic neurons in the rostral raphe.

Reward processing by the dorsal raphe nucleus: 5-HT and beyond

The dorsal raphe nucleus (DRN) represents one of the most sensitive reward sites in the brain. However, the exact relationship between DRN neuronal activity and reward signaling has been elusive. In this review, we will summarize anatomical, pharmacological, optogenetics, and electrophysiological studies on the functions and circuit mechanisms of DRN neurons in reward processing. The DRN is commonly associated with serotonin (5-hydroxytryptamine; 5-HT), but this nucleus also contains neurons of the neurotransmitter phenotypes of glutamate, GABA and dopamine. Pharmacological studies indicate that 5-HT might be involved in modulating reward- or punishment-related behaviors. Recent optogenetic stimulations demonstrate that transient activation of DRN neurons produces strong reinforcement signals that are carried out primarily by glutamate. Moreover, activation of DRN 5-HT neurons enhances reward waiting. Electrophysiological recordings reveal that the activity of DRN neurons exhibits diverse behavioral correlates in reward-related tasks. Studies so far thus demonstrate the strong power of DRN neurons in reward signaling and at the same time invite additional efforts to dissect the roles and mechanisms of different DRN neuron types in various processes of reward-related behaviors.

A glutamatergic reward input from the dorsal raphe to ventral tegmental area dopamine neurons

Electrical stimulation of the dorsal raphe (DR) and ventral tegmental area (VTA) activates the fibres of the same reward pathway but the phenotype of this pathway and the direction of the reward-relevant fibres have not been determined. Here we report rewarding effects following activation of a DR-originating pathway consisting of vesicular glutamate transporter 3 (VGluT3) containing neurons that form asymmetric synapses onto VTA dopamine neurons that project to nucleus accumbens. Optogenetic VTA activation of this projection elicits AMPA-mediated synaptic excitatory currents in VTA mesoaccumbens dopaminergic neurons and causes dopamine release in nucleus accumbens. Activation also reinforces instrumental behaviour and establishes conditioned place preferences. These findings indicate that the DR-VGluT3 pathway to VTA utilizes glutamate as a neurotransmitter and is a substrate linking the DR-one of the most sensitive reward sites in the brain--to VTA dopaminergic neurons.

Serotonergic versus nonserotonergic dorsal raphe projection neurons: differential participation in reward circuitry

The dorsal raphe nucleus (DRN) contains the largest group of serotonin-producing neurons in the brain and projects to regions controlling reward. Although pharmacological studies suggest that serotonin inhibits reward seeking, electrical stimulation of the DRN strongly reinforces instrumental behavior. Here, we provide a targeted assessment of the behavioral, anatomical, and electrophysiological contributions of serotonergic and nonserotonergic DRN neurons to reward processes. To explore DRN heterogeneity, we used a simultaneous two-vector knockout/optogenetic stimulation strategy, as well as cre-induced and cre-silenced vectors in several cre-expressing transgenic mouse lines. We found that the DRN is capable of reinforcing behavior primarily via nonserotonergic neurons, for which the main projection target is the ventral tegmental area (VTA). Furthermore, these nonserotonergic projections provide glutamatergic excitation of VTA dopamine neurons and account for a large majority of the DRN-VTA pathway. These findings help to resolve apparent discrepancies between the roles of serotonin versus the DRN in behavioral reinforcement.

The role of lateral habenula-dorsal raphe nucleus circuits in higher brain functions and psychiatric illness

Serotonergic neurons in the dorsal raphe nucleus (DRN) play an important role in regulation of many physiological functions. The lateral nucleus of the habenular complex (LHb) is closely connected to the DRN both morphologically and functionally. The LHb is a key regulator of the activity of DRN serotonergic neurons, and it also receives reciprocal input from the DRN. The LHb is also a major way-station that receives limbic system input via the stria medullaris and provides output to the DRN and thereby indirectly connects a number of other brain regions to the DRN. The complex interactions of the LHb and DRN contribute to the regulation of numerous important behavioral and physiological mechanisms, including those regulating cognition, reward, pain sensitivity and patterns of sleep and waking. Disruption of these functions is characteristic of major psychiatric illnesses, so there has been a great deal of interest in how disturbed LHb-DRN interactions may contribute to the symptoms of these illnesses. This review summarizes recent research related to the roles of the LHb-DRN system in regulation of higher brain functions and the possible role of disturbed LHb-DRN function in the pathogenesis of psychiatric disorders, especially depression.

The role of the dorsal raphé nucleus in reward-seeking behavior

Pharmacological experiments have shown that the modulation of brain serotonin levels has a strong impact on value-based decision making. Anatomical and physiological evidence also revealed that the dorsal raphé nucleus (DRN), a major source of serotonin, and the dopamine system receive common inputs from brain regions associated with appetitive and aversive information processing. The serotonin and dopamine systems also have reciprocal functional influences on each other. However, the specific mechanism by which serotonin affects value-based decision making is not clear. To understand the information carried by the DRN for reward-seeking behavior, we measured single neuron activity in the primate DRN during the performance of saccade tasks to obtain different amounts of a reward. We found that DRN neuronal activity was characterized by tonic modulation that was altered by the expected and received reward value. Consistent reward-dependent modulation across different task periods suggested that DRN activity kept track of the reward value throughout a trial. The DRN was also characterized by modulation of its activity in the opposite direction by different neuronal subgroups, one firing strongly for the prediction and receipt of large rewards, with the other firing strongly for small rewards. Conversely, putative dopamine neurons showed positive phasic responses to reward-indicating cues and the receipt of an unexpected reward amount, which supports the reward prediction error signal hypothesis of dopamine. I suggest that the tonic reward monitoring signal of the DRN, possibly together with its interaction with the dopamine system, reports a continuous level of motivation throughout the performance of a task. Such a signal may provide "reward context" information to the targets of DRN projections, where it may be integrated further with incoming motivationally salient information.

Neurocircuitry of drug reward

In recent years, neuroscientists have produced profound conceptual and mechanistic advances on the neurocircuitry of reward and substance use disorders. Here, we will provide a brief review of intracranial drug self-administration and optogenetic self-stimulation studies that identified brain regions and neurotransmitter systems involved in drug- and reward-related behaviors. Also discussed is a theoretical framework that helps to understand the functional properties of the circuitry involved in these behaviors. The circuitry appears to be homeostatically regulated and mediate anticipatory processes that regulate behavioral interaction with the environment in response to salient stimuli. That is, abused drugs or, at least, some may act on basic motivation and mood processes, regulating behavior-environment interaction. Optogenetics and related technologies have begun to uncover detailed circuit mechanisms linking key brain regions in which abused drugs act for rewarding effects. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'.

Rewarding and incentive motivational effects of excitatory amino acid receptor antagonists into the median raphe and adjacent regions of the rat

RATIONALE

The motivational process that regulates approach behavior toward salient distal stimuli (i.e., incentive motivation) plays a key role in voluntary behavior and motivational disorders such as addiction. This process may be mediated by many neurotransmitter systems and a network of many brain structures, including the median and dorsal raphe regions (MR and DR, respectively).

OBJECTIVE

We sought to examine whether the blockade of excitatory amino acid receptors in the MR and DR is rewarding, using intracranial self-administration, and whether the self-administration effect can be explained by drug's effectiveness to enhance incentive motivation, using a visual sensation seeking procedure.

RESULTS

Rats learned to self-administer the AMPA receptor antagonist ZK 200775 into the vicinity of the MR, DR, or medial oral pontine reticular regions, but not the ventral tegmental area. The NMDA receptor antagonist AP5 was also self-administered into the MR, while it was not readily self-administered into other regions. When ZK 200775 was noncontingently administered into the MR, rats markedly increased approach responses rewarded by brief illumination of a light stimulus. In addition, contingent administration of ZK 200775 into the MR induced a conditioning effect on approach responses.

CONCLUSIONS

Rats self-administer excitatory amino acid receptor antagonists into the MR and adjacent regions. Self-administration effect of AMPA receptor antagonists into the MR can be largely explained by the manipulation's properties to invigorate ongoing approach behavior and induces conditioned approach. Glutamatergic afferents to the median raphe and adjacent regions appear to tonically suppress incentive-motivational processes.

Opposing effects of 5,7-DHT lesions to the core and shell of the nucleus accumbens on the processing of irrelevant stimuli

There is good evidence that forebrain serotonergic systems modulate cognitive flexibility. Latent inhibition (LI) is a cross-species phenomenon which manifests as poor conditioning to a stimulus that has previously been experienced without consequence and is widely considered an index of the ability to ignore irrelevant stimuli. While much research has focused on dopaminergic mechanisms underlying LI, there is also considerable evidence of serotonergic modulation. However, the neuroanatomical locus of these effects remains poorly understood. Previous work has identified the nucleus accumbens (NAc) as a key component of the neural circuit underpinning LI and furthermore, this work has shown that the core and shell subregions of the NAc contribute differentially to the expression of LI. To examine the role of the serotonergic input to NAc in LI, we tested animals with 5,7-dihydroxytryptamine (5,7-DHT) lesions to the core and shell subregions on LI assessed under experimental conditions that produce LI in shams and subsequently with weak stimulus pre-exposure designed to prevent the emergence of LI in shams. We found that serotonergic deafferentation of the core disrupted LI whereas 5,7-DHT lesions to the shell produced the opposite effect and potentiated LI.

Regulation of dorsal raphe nucleus function by serotonin autoreceptors: a behavioral perspective

Neurotransmission by serotonin (5-HT) is tightly regulated by several autoreceptors that fine-tune serotonergic neurotransmission through negative feedback inhibition at the cell bodies (predominantly 5-HT(1A)) or at the axon terminals (predominantly 5-HT(1B)); however, more subtle roles for 5-HT(1D) and 5-HT(2B) autoreceptors have also been detected. This review provides an overview of 5-HT autoreceptors, focusing on their contribution in animal behavioral models of stress and emotion. Experiments targeting 5-HT autoreceptors in awake, behaving animals have generally shown that increasing autoreceptor feedback is anxiolytic and rewarding, while enhanced 5-HT function is aversive and anxiogenic; however, the role of serotonergic activity in behavioral models of helplessness is more complex. The prevailing model suggests that 5-HT autoreceptors become desensitized in response to stress exposure and antidepressant administration, two seemingly opposite manipulations. Thus there are still unresolved questions regarding the role of these receptors-and serotonin in general-in normal and pathological states.

5-HT receptors and reward-related behaviour: a review

The brain's serotonin (5-HT) system is key in the regulation of reward-related behaviours, from eating and drinking to sexual activity. The complexity of studying this system is due, in part, to the fact that 5-HT acts at many receptor subtypes throughout the brain. The recent development of drugs with greater selectivity for individual receptor subtypes has allowed for rapid advancements in our understanding of this system. Use of these drugs in combination with animal models entailing selective reward measures (i.e. intracranial self-stimulation, drug self-administration, conditioned place preference) have resulted in a greater understanding of the pharmacology of reward-related processing and behaviour (particularly regarding drugs of abuse). The putative roles of each 5-HT receptor subtype in the pharmacology of reward are outlined and discussed here. It is concluded that the actions of 5-HT in reward are receptor subtype-dependent (and thus should not be generalized) and that all studied subtypes appear to have a unique profile which is determined by content (e.g. receptor function, localization - both throughout the brain and within the synapse) and context (e.g. type of behavioural paradigm, type of drug). Given evidence of altered reward-related processing and serotonergic function in numerous neuropsychiatric disorders, such as depression, schizophrenia, and addiction, a clearer understanding of the role of 5-HT receptor subtypes in this context may lead to improved drug development and therapeutic approaches.

The roles of dopamine and serotonin in decision making: evidence from pharmacological experiments in humans

Neurophysiological experiments in primates, alongside neuropsychological and functional magnetic resonance investigations in humans, have significantly enhanced our understanding of the neural architecture of decision making. In this review, I consider the more limited database of experiments that have investigated how dopamine and serotonin activity influences the choices of human adults. These include those experiments that have involved the administration of drugs to healthy controls, experiments that have tested genotypic influences upon dopamine and serotonin function, and, finally, some of those experiments that have examined the effects of drugs on the decision making of clinical samples. Pharmacological experiments in humans are few in number and face considerable methodological challenges in terms of drug specificity, uncertainties about pre- vs post-synaptic modes of action, and interactions with baseline cognitive performance. However, the available data are broadly consistent with current computational models of dopamine function in decision making and highlight the dissociable roles of dopamine receptor systems in the learning about outcomes that underpins value-based decision making. Moreover, genotypic influences on (interacting) prefrontal and striatal dopamine activity are associated with changes in choice behavior that might be relevant to understanding exploratory behaviors and vulnerability to addictive disorders. Manipulations of serotonin in laboratory tests of decision making in human participants have provided less consistent results, but the information gathered to date indicates a role for serotonin in learning about bad decision outcomes, non-normative aspects of risk-seeking behavior, and social choices involving affiliation and notions of fairness. Finally, I suggest that the role played by serotonin in the regulation of cognitive biases, and representation of context in learning, point toward a role in the cortically mediated cognitive appraisal of reinforcers when selecting between actions, potentially accounting for its influence upon the processing salient aversive outcomes and social choice.

Brain reward circuitry beyond the mesolimbic dopamine system: a neurobiological theory

Reductionist attempts to dissect complex mechanisms into simpler elements are necessary, but not sufficient for understanding how biological properties like reward emerge out of neuronal activity. Recent studies on intracranial self-administration of neurochemicals (drugs) found that rats learn to self-administer various drugs into the mesolimbic dopamine structures-the posterior ventral tegmental area, medial shell nucleus accumbens and medial olfactory tubercle. In addition, studies found roles of non-dopaminergic mechanisms of the supramammillary, rostromedial tegmental and midbrain raphe nuclei in reward. To explain intracranial self-administration and related effects of various drug manipulations, I outlined a neurobiological theory claiming that there is an intrinsic central process that coordinates various selective functions (including perceptual, visceral, and reinforcement processes) into a global function of approach. Further, this coordinating process for approach arises from interactions between brain structures including those structures mentioned above and their closely linked regions: the medial prefrontal cortex, septal area, ventral pallidum, bed nucleus of stria terminalis, preoptic area, lateral hypothalamic areas, lateral habenula, periaqueductal gray, laterodorsal tegmental nucleus and parabrachical area.

Behavioral evidence for the significance of serotoninergic (5-HT) receptors in cocaine addiction

Cocaine addiction has somatic, psychological, psychiatric, socio-economic and legal implications in the developed world. Presently, there is no medication approved for the treatment of cocaine addiction. In recent years, data from the literature (pre-clinical studies and clinical trials) have provided several lines of evidence that serotonin (5-HT) and 5-HT receptors play a modulatory role in the mechanisms of action of cocaine. Here we review the contribution of 5-HT receptor subtypes to cocaine sensitization, discrimination, conditioned place preference, self-administration, reinstatement of seeking behavior and withdrawal symptoms in laboratory animals. Additionally, the consequences of chronic cocaine exposure on particular 5-HT receptor-assigned functions in pre-clinical studies are presented.

The GABAB receptor agonist baclofen administered into the median and dorsal raphe nuclei is rewarding as shown by intracranial self-administration and conditioned place preference in rats

RATIONALE

The midbrain raphe regions have long been implicated in affective processes and disorders. There is increasing evidence to suggest that the median (MR) and dorsal raphe nuclei (DR) tonically inhibit reward-related processes.

OBJECTIVES

Stimulation of GABAB receptors in the midbrain raphe nuclei is known to inhibit local neurons, especially serotonergic neurons. We sought to determine if injections of the GABAB receptor agonist baclofen into the MR or DR are rewarding, using intracranial self-administration and conditioned place preference.

RESULTS

Rats quickly learned to lever press for infusions of baclofen (0.1–2.5 mM) into the MR, but not the ventral tegmental area or central linear nucleus. Rats increased lever pressing associated with intra-DR baclofen infusions, but not readily. Baclofen self-administration into the MR or DR was attenuated by coadministration of the GABAB receptor antagonist SCH 50911 (1 mM) or systemic pretreatment with the dopamine receptor antagonist SCH 23390 (0.025 mg/kg, i.p.). In addition, intra-DR and intra-MR injections of baclofen induced conditioned place preference; injection into DR was more effective.

CONCLUSIONS

Baclofen injections into the midbrain raphe nuclei are rewarding. Baclofen was more readily self-administered into the MR than into the DR, while baclofen injections into the DR more readily induced conditioned place preference than those into the MR. These sites may be differentially involved in aspects of reward. These findings suggest that MR or DR neurons containing GABAB receptors are involved in tonic inhibitory control over reward processes.

Effects of systemic 5-HT(1B) receptor compounds on ventral tegmental area intracranial self-stimulation thresholds in rats

Serotonin 1B (5-HT(1B)) receptors may play a role in regulating motivation and reward-related behaviours. To date, no studies have investigated the effects of the highly selective 5-HT(1B) receptor agonist CP 94253, on the reward model of ventral tegmental area intracranial self-stimulation. The current study investigated the hypothesis that 5-HT(1B) receptors play an inhibitory role in ventral tegmental area ICSS. Using Sprague-Dawley rats, the effects of the selective 5-HT(1B) receptor agonist CP 94253 (0-5.0 mg/kg) and the 5-HT(1B/1D) receptor antagonist GR 127935 (10.0 mg/kg) were investigated in rats trained to respond for ventral tegmental area ICSS; results were compared using rate-frequency threshold analysis. The highest dose of CP 94253 (5.0 mg/kg) tested in ventral tegmental area ICSS produced an increase in rate-frequency thresholds without affecting maximal response rates. This effect was attenuated by GR 127935 which did not show any effects when administered alone. These results suggest that 5-HT(1B) receptors play an inhibitory role in regulating ventral tegmental area ICSS.

Reward-dependent modulation of neuronal activity in the primate dorsal raphe nucleus

The dopamine system has been thought to play a central role in guiding behavior based on rewards. Recent pharmacological studies suggest that another monoamine neurotransmitter, serotonin, is also involved in reward processing. To elucidate the functional relationship between serotonin neurons and dopamine neurons, we performed single-unit recording in the dorsal raphe nucleus (DRN), a major source of serotonin, and the substantia nigra pars compacta, a major source of dopamine, while monkeys performed saccade tasks in which the position of the target indicated the size of an upcoming reward. After target onset, but before reward delivery, the activity of many DRN neurons was modulated tonically by the expected reward size with either large- or small-reward preference, whereas putative dopamine neurons had phasic responses and only preferred large rewards. After reward delivery, the activity of DRN neurons was modulated tonically by the received reward size with either large- or small-reward preference, whereas the activity of dopamine neurons was not modulated except after the unexpected reversal of the position-reward contingency. Thus, DRN neurons encode the expected and received rewards, whereas dopamine neurons encode the difference between the expected and received rewards. These results suggest that the DRN, probably including serotonin neurons, signals the reward value associated with the current behavior.

Intra-median raphe nucleus (MRN) infusions of muscimol, a GABA-A receptor agonist, reinstate alcohol seeking in rats: role of impulsivity and reward

RATIONALE AND OBJECTIVES

We previously found that the inhibition of median raphe nucleus (MRN) 5-HT transmission by local injections of a 5-HT1A agonist 8-OH-DPAT or corticotrophin-releasing factor (CRF) mimic the effect of foot shock stress to reinstate alcohol seeking. In this study, we further explored the role of the MRN by examining the effect of inhibition of MRN neurons, by injecting the GABA-A receptor agonist muscimol, on the reinstatement of alcohol seeking.

MATERIALS AND METHODS

Male rats were trained to lever press for 12% alcohol. Cannulae were implanted aimed at the MRN; some rats were also given intra-MRN injections of 5,7-DHT to destroy ascending 5-HT neurons. After retraining, alcohol responding was extinguished for 14 days. Subsequently, we tested the effect of muscimol injections into the MRN (0, 12.5, 25, 50 ng) on reinstatement. We also tested the effect of MRN muscimol injections on a measure of reward, conditioned place preference (CPP) and performance in the five-choice serial reaction time task (5-CSRTT), which tests a variety of psychological processes including sustained attention and impulsivity.

RESULTS

MRN muscimol injections strongly reinstated alcohol seeking and this effect was not reversed by the depletion of 5-HT with 5,7-DHT. MRN muscimol injections did not induce a CPP, but did significantly impair multiple aspects of performance on the 5-CSRTT, including a marked increase in premature, or impulsive, responding.

CONCLUSIONS

Together with our previous findings, these results suggest that the inhibition of MRN projection neurons provokes alcohol seeking. Results from the 5-CSRTT suggest that increased impulsivity may contribute to these effects.

The midbrain raphe nuclei mediate primary reinforcement via GABA(A) receptors

Because rats learn to lever-press for brief electrical stimulation of the median and dorsal raphe nuclei (MRN and DRN, respectively), these brain sites have long been implicated in reward processes. However, it is not clear whether the MRN and DRN integrate reward-related signals or merely contain fibers of passage involved in reward processes. To shed light on this issue, the present study employed chemicals that selectively modulate neurotransmission, in particular the GABA(A) receptor agonist muscimol. Rats quickly learned to lever-press for muscimol infusions (50 and 100 microM) into the MRN or DRN. Muscimol was not self-administered when cannulae were placed just outside these nuclei. The reinforcing effects of muscimol appeared to be greater when the drug was administered into the MRN than into the DRN, as demonstrated by higher infusion rates and better response discrimination. These observations are consistent with the additional finding that muscimol administration into the MRN, but not the DRN, induced conditioned place preference. The reinforcing effects of muscimol administration into the MRN were blocked by coadministration of the GABA(A) antagonist picrotoxin (100 microM) and by pretreatment with the dopamine receptor antagonist SCH 23390 (0.025 mg/kg, i.p.). The present results suggest that median and dorsal raphe neurons presumably inhibited by muscimol via GABA(A) receptors are involved in integration of primary reinforcement, and that median raphe neurons exert tonic inhibition over dopamine-dependent reward circuitry. The midbrain raphe nuclei may be involved in a variety of reward-related phenomena including drug addiction.

Serotonin and psychostimulant addiction: Focus on 5-HT1A-receptors

Serotonin(1A)-receptors (5-HT(1A)-Rs) are important components of the 5-HT system in the brain. As somatodendritic autoreceptors they control the activity of 5-HT neurons, and, as postsynaptic receptors, the activity in terminal areas. Cocaine (COC), amphetamine (AMPH), methamphetamine (METH) and 3,4-methylenedioxymethamphetamine ("Ecstasy", MDMA) are psychostimulant drugs that can lead to addiction-related behavior in humans and in animals. At the neurochemical level, these psychostimulant drugs interact with monoamine transporters and increase extracellular 5-HT, dopamine and noradrenalin activity in the brain. The increase in 5-HT, which, in addition to dopamine, is a core mechanism of action for drug addiction, hyperactivates 5-HT(1A)-Rs. Here, we first review the role of the various 5-HT(1A)-R populations in spontaneous behavior to provide a background to elucidate the contribution of the 5-HT(1A)-Rs to the organization of psychostimulant-induced addiction behavior. The progress achieved in this field shows the fundamental contribution of brain 5-HT(1A)-Rs to virtually all behaviors associated with psychostimulant addiction. Importantly, the contribution of pre- and postsynaptic 5-HT(1A)-Rs can be dissociated and frequently act in opposite directions. We conclude that 5-HT(1A)-autoreceptors mainly facilitate psychostimulant addiction-related behaviors by a limitation of the 5-HT response in terminal areas. Postsynaptic 5-HT(1A)-Rs, in contrast, predominantly inhibit the expression of various addiction-related behaviors directly. In addition, they may also influence the local 5-HT response by feedback mechanisms. The reviewed findings do not only show a crucial role of 5-HT(1A)-Rs in the control of brain 5-HT activity and spontaneous behavior, but also their complex role in the regulation of the psychostimulant-induced 5-HT response and subsequent addiction-related behaviors.

Augmented cocaine conditioned place preference in rats pretreated with systemic ghrelin

The physiological mechanism through which food restriction (FR) enhances the biobehavioral actions of psychostimulants is unknown but may involve the gut peptide ghrelin. Plasma levels of ghrelin are increased by FR and reduced by eating. Moreover, systemically administered ghrelin crosses into the brain and is known to augment the locomotor-stimulating effects of cocaine [COC: Wellman et al., 2005]. This study sought to determine whether pretreatment with ghrelin (5 nmol) would enhance the rewarding properties of COC (0.0, 0.312, 0.625, or 1.25 mg/kg i.p.) as measured by conditioned place preference (CPP). Adult male Sprague-Dawley rats were given free access to both sides of a CPP chamber to determine initial side preference. The rats were then confined for 30 min to either their preferred side or non-preferred side on 8 consecutive days. When rats were confined to the least preferred side, each was injected with 0.5 ml (i.p.) of either ghrelin (5 nmol) or saline 1 h before the conditioning trial and then injected (i.p.) with one of the COC doses immediately prior to the conditioning trial. On alternate days, rats were injected with vehicle one hour before and again immediately before the conditioning trial. Place preference scores were computed as the differences in time (min) spent on the least preferred side of the chamber for the pre-test and the postconditioning test, covaried by the initial degree of preference (% time spent on the black side during the pre-test). These analyses indicated a significant interaction between ghrelin pretreatment and COC dose on changes in preference scores. Significantly higher place preference scores were noted for rats treated with either 0.312 or 0.625 mg/kg COC doses, but only when these COC doses were preceded by administration of 5 nmol ghrelin. In contrast, saline pretreated rats exhibited significant CPP at the 1.25 mg/kg COC dose, but the ghrelin pretreated group did not. These results provide partial support for the contention that ghrelin pretreatment can augment the rewarding effects of sub-threshold doses of COC in a CPP procedure. Moreover, these findings are consistent with the view that ghrelin may play a role in the capacity of FR to augment psychostimulant action.

Role for dopamine neurons of the rostral linear nucleus and periaqueductal gray in the rewarding and sensitizing properties of heroin

There is a mesencephalic dopaminergic network outside the ventral tegmental area (VTA), including structures such as the rostral linear nucleus (RLi) and periaqueductal gray (PAG). These nuclei project to neural areas implicated in reinforcing effects of drugs, indicating that they could participate in opiate reward. The objectives were to study the morphological characteristics of the dopamine network of the RLi/PAG region, and to discern its role on rewarding and sensitizing effects of heroin in rats, following dopamine depletion or local injection of dopaminergic antagonists. The findings indicated that this network is composed of small cells in the RLi/ventral PAG, large multipolar dopamine PAG neurons, and periaqueductal PAG neurons. Following repeated heroin, large PAG neurons and small RLi/ventral PAG cells (not periaqueductal neurons) were activated, since tyrosine-hydroxylase was adaptively induced, without changes in protein kinase Aalpha. After dopamine depletion, small RLi/ventral PAG neurons and large cells of the PAG (not periaqueductal ones) were selectively affected by the neurotoxin. Dopamine neurons of the nearby VTA and dorsal raphe were not affected, as revealed by cell counting. After lesion, 'anxiety-like' responses and basal locomotion were not altered. However, conditioned place preference to heroin was found to be abolished, as well as heroin-induced motor sensitization. Following infusions of dopaminergic antagonists into RLi/PAG, D(2) (not D(1)) receptor blocking dose-dependently abolished heroin-induced reward. The present study provides evidence that dopamine neurons of the RLi/PAG region (excluding PAG periaqueductal cells) show adaptive biochemical changes after heroin, and mediate the rewarding and sensitizing effects of this drug. D(2) dopamine receptors within the RLi/PAG region participate in these effects.

Differential effects of 5-HT2C receptor ligands on place conditioning and locomotor activity in rats

Effects of the 5-hydroxytryptamine (5-HT)(1A/1B/2C) receptor agonist N-[3-(trifluoromethyl)phenyl] piperazine (TFMPP, 0-3.0 mg/kg s.c.) and the 5-HT2C receptor agonist 8,9-dichloro-2,3,4,4a-tetrahydro-1H-pyrazino[1,2-a]quinoxalin-5(6H)-one (WAY 161503, 0-3.0 mg/kg s.c.) in place conditioning were measured in male Sprague-Dawley rats. Effects of TFMPP, alone and with the 5-HT(1A) receptor antagonist N-[2-[4-(2-methoxyphenyl)-1-piperazinyl] ethyl]-N-2-pyridinyl-cyclohexanecarboxamine (WAY 100635), the 5-HT(1B) receptor antagonist N-[4-methoxy-3-(4-methyl-1-piperazinyl) phenyl]-2'-methyl-4'-(5-methyl-1,2,4-oxadiazol-3-yl)-1,1'-biphenyl-4-carboxamide (GR 127935) or the 5-HT2C receptor antagonist 6-chloro-5-methyl-1-[[2-(2-methylpyrid-3-yloxy)pyrid-5-yl]carbamoyl]indoline (SB 242084) and of WAY 161503 alone and with SB 242084 on locomotor activity were also assessed. Neither TFMPP nor WAY 161503 induced place conditioning. WAY 161503 (1.0 and 3.0 mg/kg s.c.) decreased locomotor activity; SB 242084 (1.0 mg/kg i.p.) blocked this effect. Reduced locomotor activity following TFMPP was blocked by SB 242084 but not WAY 100635 (0.1 mg/kg s.c.) or GR 127935 (3.0 mg/kg s.c.). Behaviourally relevant levels of 5-HT2C receptor stimulation may not exert reinforcing effects, although other studies indicate that such manipulations alter reinforcing effects of drugs of abuse.

Differential effects of intra-midbrain raphe and systemic 8-OH-DPAT on VTA self-stimulation thresholds in rats

RATIONALE

Intra-median raphe nucleus (MRN) administration of the 5-HT(1A) receptor agonist 8-OH-DPAT decreases lateral hypothalamic self-stimulation thresholds and is reported to have biphasic effects following systemic administration. These experiments attempted to extend the previous findings to mesolimbic pathway self-stimulation at ventral tegmental area (VTA) electrodes.

OBJECTIVES

This study was conducted to provide comparative data for systemic and intra-dorsal raphe nucleus (DRN) and intra-MRN effects of 8-OH-DPAT on VTA self-stimulation.

METHODS

Male Sprague-Dawley rats with VTA electrodes were trained to respond for electrical stimulation. Systemic and intra-midbrain raphe 8-OH-DPAT effects on rate-frequency thresholds were measured. Systemic administration of WAY 100635 was used to confirm 5-HT(1A) receptor mediation of 8-OH-DPAT effects.

RESULTS

8-OH-DPAT (0.003-0.3 mg kg(-1) SC) increased rate-frequency thresholds and decreased maximal response rates. WAY 100635 alone (0.0125-0.1 mg kg(-1) SC) did not alter these measures. Intra-DRN and intra-MRN 8-OH-DPAT (5.0 microg) decreased rate-frequency thresholds without altering maximal response rates. Intra-DRN 8-OH-DPAT (0.1-5.0 microg) induced a slight decrease and intra-MRN 8-OH-DPAT a slight increase in locomotor activity. WAY 100635 (0.1 mg kg(-1)) blocked effects of 8-OH-DPAT on VTA self-stimulation.

CONCLUSION

These results confirm threshold-decreasing effects of intra-MRN 8-OH-DPAT and extend this to the DRN and to VTA thresholds. Monophasic dose dependent increases in VTA thresholds following systemic 8-OH-DPAT are not equivalent to reports for hypothalamic self-stimulation. Differences between studies may be attributable to stimulation site and/or differences in threshold measurement procedures. Effects of WAY 100635 in this study indicate 5-HT(1A) receptor mediation of these 8-OH-DPAT effects.

Nucleus accumbens serotonin1A receptors control cocaine-induced hyperactivity but not local serotonin increase: an in vivo microdialysis study

The nucleus accumbens (Nac) is an important structure for cocaine-induced hyperactivity and receives a dense serotonergic (5-HT) innervation. Previous studies showed that a systemic activation of 5-HT(1A) receptors potentiates cocaine-induced hyperlocomotion, but attenuates the cocaine-induced 5-HT increase in the Nac. In order to address the role of Nac 5-HT(1A) receptors in the control of cocaine-induced and spontaneous behavioural activity and local 5-HT release, we used in vivo microdialysis in freely moving rats. The 5-HT(1A)-receptor agonist, 8-OH-DPAT (0, 1 and 10 microM), was applied locally into the Nac by reverse dialysis followed by a cocaine (10 mg/kg) or saline i.p. injection. The Nac 5-HT(1A)-receptor activation potentiated cocaine-induced hyperlocomotion, but attenuated rearing behaviour dose-dependently. Parallel to that, the cocaine-induced increase in Nac 5-HT dialysate level was unaffected, as were the decreases in 5-HIAA and DOPAC dialysate levels after cocaine. In saline treated rats, the local application of 8-OH-DPAT into the Nac affected neither spontaneous behavioural activity nor 5-HT, 5-HIAA or DOPAC dialysate levels in the Nac. These data suggest that Nac 5-HT(1A) receptors exert a bi-directional control of cocaine-induced hyperactivity, while not affecting spontaneous behaviour. Furthermore, accumbal 5-HT(1A) receptors do not appear to be directly involved in the acute effects of cocaine on 5-HT, 5-HIAA or DOPAC levels in the Nac.

Serotonin and drug reward: focus on 5-HT2C receptors

Pharmacological manipulation of the 5-hydroxytryptamine (5-HT; serotonin) system has long been associated with a regulation of feeding behaviour, however, the initial part of this article reviews evidence that central 5-HT systems similarly modulate reward-related behaviours, particularly drug reward. The second part of this article considers what we believe to be strong emerging pharmacological and genetic evidence that many of these effects are mediated through 5-HT(2C) receptor signalling mechanisms. Finally, we consider the potential for selective 5-HT(2C) agonists as therapies for substance abuse disorders and the medical implications for different 5-HT(2C) receptor isoforms generated by RNA editing.

Hippocampus 5-HT1A-receptors attenuate cocaine-induced hyperlocomotion and the increase in hippocampal but not nucleus accumbens 5-HT

Cocaine induces an increase in hippocampal and nucleus accumbens (Nac) serotonin (5-HT) concentration parallel to locomotor activation. Both effects can be modulated by systemic 5-HT(1A)-receptor agonism/antagonism. Given the contribution of the hippocampus to spontaneous behavioral activity, these observations suggest a role for hippocampal 5-HT as well in the modulation of cocaine effects on behavior. To determine the role of hippocampal 5-HT(1A)-receptors in cocaine effects on behavior and hippocampal 5-HT release, we used in vivo microdialysis in freely moving rats. The 5-HT(1A)-receptor agonist, 8-OH-DPAT (0, 0.1, 1 and 10 microM), was applied locally into the hippocampus by reversed dialysis followed by a cocaine (10 mg/kg) or saline i.p. injection. The hippocampal 5-HT(1A)-receptor activation attenuated cocaine-induced hyperlocomotion and rearing behavior dose-dependently. Parallel to that, the cocaine-induced 5-HT increase was attenuated dose-dependently in the hippocampus but was left unaffected in the Nac. The intra-hippocampal application of 8-OH-DPAT affected neither behavioral activity nor 5-HT concentration in the hippocampus and in the Nac. In accord with these findings, hippocampal 5-HT(1A)-receptors may not be directly involved in the regulation of spontaneous behavior or basal 5-HT concentration in the hippocampus and Nac. However, the results indicate an inhibitory role of hippocampal 5-HT(1A)-receptors in cocaine-induced hyperactivity and in the 5-HT increase evoked by cocaine in the hippocampus but not in the Nac.

Global 5-HT depletion attenuates the ability of amphetamine to decrease impulsive choice on a delay-discounting task in rats

RATIONALE

Psychomotor stimulant drugs such as methylphenidate and amphetamine decrease impulsive behaviour in attention deficit hyperactivity disorder patients by unknown mechanisms. Although most behavioural effects of amphetamine are attributed to the dopaminergic system, some recent evidence suggests a role for serotonin in this paradoxical "calming" effect.

OBJECTIVES

To investigate whether forebrain serotonin depletion affects the action of amphetamine in the rat on a delayed reward task where impulsive choice is measured as the selection of a smaller immediate over a larger delayed reward.

METHODS

. Following behavioural training, rats received i.c.v. infusions of either vehicle (n=10) or the serotonergic neurotoxin 5,7-DHT (n=10). Post-operatively, animals received i.p. d-amphetamine (0.3,1.0,1.5, and 2.3 mg/kg/ml), and d-amphetamine co-administered with the dopamine antagonist cis-z-flupenthixol.

RESULTS

5,7-DHT (i.c.v.) itself did not affect choice behaviour, despite depleting forebrain serotonin levels by over 85%. Amphetamine increased choice for the large reward, i.e. decreased impulsivity. This effect was attenuated by 5-HT depletion, particularly in animals showing a high level of impulsive choice. Co-administration of cis-z-flupenthixol (0.125 mg/kg) with d-amphetamine abolished the effect of amphetamine in the lesioned group, whereas this was only partially attenuated in the vehicle control group.

CONCLUSIONS

These data suggest that the ability of amphetamine to decrease impulsivity is not solely due to its effects on dopaminergic systems, but may also depend on serotonergic neurotransmission.

The role of corticotropin-releasing factor in the median raphe nucleus in relapse to alcohol

Using an animal model of drug relapse, we found that intermittent footshock stress reinstates alcohol seeking, an effect attenuated by the 5-HT reuptake blocker fluoxetine and by corticotropin-releasing factor (CRF) receptor antagonists. Here we studied the role of the 5-HT cell body region of the median raphe nucleus (MRN) and CRF receptors in this site in reinstatement of alcohol seeking. Rats were given alcohol in a two-bottle choice procedure (water vs alcohol) for 25 d and were then trained for 1 hr/d to press a lever for alcohol (12% w/v) for 23-30 d. Subsequently, lever pressing for alcohol was extinguished by terminating drug delivery for 5-9 d. Tests for reinstatement of alcohol seeking were then performed under extinction conditions. Intra-MRN infusions of 8-OH-DPAT [8-hydroxy-2-(di-n-propylamino)tetralin] (a 5-HT1A agonist that decreases 5-HT cell firing and release) reinstated alcohol seeking. Reinstatement of alcohol seeking also was observed after intra-MRN infusions of low doses of CRF (3-10 ng), which mimicked the effect of ventricular infusions of higher doses of the peptide (300-1000 ng). Finally, intra-MRN infusions of the CRF receptor antagonist d-Phe CRF (50 ng) blocked the effect of intermittent footshock (10 min) on reinstatement. These data suggest that an interaction between CRF and 5-HT neurons within the MRN is involved in footshock stress-induced reinstatement of alcohol seeking.

Opponent interactions between serotonin and dopamine

Anatomical and pharmacological evidence suggests that the dorsal raphe serotonin system and the ventral tegmental and substantia nigra dopamine system may act as mutual opponents. In the light of the temporal difference model of the involvement of the dopamine system in reward learning, we consider three aspects of motivational opponency involving dopamine and serotonin. We suggest that a tonic serotonergic signal reports the long-run average reward rate as part of an average-case reinforcement learning model; that a tonic dopaminergic signal reports the long-run average punishment rate in a similar context; and finally speculate that a phasic serotonin signal might report an ongoing prediction error for future punishment.

Dansyl-PQRamide, a possible neuropeptide FF receptor antagonist, induces conditioned place preference

Neuropeptide FF (NPFF) is an endogenous anti-opioid peptide. NPFF could potentiate the naloxone-precipitated morphine withdrawal syndromes in morphine-dependent rats, indicating the possible involvement of the endogenous NPFF system in opioid analgesia and dependence. The present study was performed to examine the effects of dansyl-PQRamide (dns-PQRa), a putative NPFF antagonist, on conditioned place preference (CPP), in addition, its interaction with the opioid system. Two CPP experiments were conducted. First, rats were treated with dns-PQRa (4-13 mg/kg, i.p.) and paired with the non-preferred compartment while the vehicle was paired with the preferred compartment. Second, similar to experiment 1 except naloxone (1 mg/kg, i.p.) was given 10 min prior to each dns-PQRa administration. The post-drug place preference was examined after 4 alternative pairings. Another group of animals after repetitive dns-PQRa treatments were analyzed for levels of neurotransmitters in discrete brain areas. Dns-PQRa (4-13 mg/kg, i.p.) induced a significant dose-dependent CPP. The dns-PQRa-induced CPP was completely blocked by pretreatment with 1 mg/kg i.p. naloxone, while naloxone alone did not induce any place aversion. The chronic dns-PQRa-treated (13 mg/kg, i.p., b.i.d.) rats caused a significant increase in 3,4-dihydroxyphenylacetic acid and 5-hydroxyindoleacetic acid in the olfactory tubercle compared to the vehicle-treated controls. There was also an increase in the turnover of serotonin in the olfactory tubercle, nucleus accumbens and medial prefrontal cortex. These results suggest that blockade of the NPFF system produces rewarding, possibly via an inhibition of the anti-opioid action of NPFF. These results also reveal a close relationship between NPFF, drug rewarding and the dopaminergic and serotoninergic neurons in the mesolimbic system.

Mechanism of action of flibanserin in the learned helplessness paradigm in rats

The mechanism of action of flibanserin, a 5-HT(1A) receptor agonist and a 5-HT(2A) receptor antagonist, was investigated in learned helplessness in rats. The effect of flibanserin (32 mg/kg, i.p. 30 min before testing) on learned helplessness was not antagonized by the (a) 5-HT synthesis inhibitor parachlorophenylalanine (pCPA; 150 mg/kg p.o.x3 times), which reduced brain 5-HT by 89%; (b) 5-HT(1A) receptor antagonists (+/-)-N-tert-butyl-3-4-(2-ethoxyphenyl)piperazin-1yl-2-phenyl propionamide [WAY100135; 10 mg/kg, i.p. 30 min before flibanserin, or 40 mg/kg, s.c. 15 min before flibanserin] and tertatolol (2.5 and 5 mg/kg, i.p. 30 min before flibanserin); and (c) 5-HT(2) receptor agonist (+/-)-2,5-dimethoxy-4-iodoamphetamine (DOI; 3 mg/kg, s.c. simultaneously with flibanserin). The effect of flibanserin on learned helplessness was antagonized by the dopamine D(1) receptor antagonist [R]-3-methyl-7-chloro-8-hydroxy-1-phenyl-2,3,4,5-tetrahydro-1H-3-benzazepine (SCH 23390; 0.1 mg/kg, i.p. 30 min before flibanserin) and by the opioid receptor antagonist naloxone (3 mg/kg, s.c. 15 min before flibanserin). Flibanserin (32 and 64 mg/kg) did not induce conditioned place preference. In conclusion, flibanserin improved rats' performance in the learned helplessness paradigm, by stimulating dopamine D1 and opioid receptors, probably indirectly, since flibanserin has a low affinity for these receptors.

The rewarding properties of neuropeptide Y in perifornical hypothalamus vs. nucleus accumbens

There is a high coexistence of substance abuse in humans with eating disorders. One theory offered to account for this fact is that a common biochemical substrate may exist that mediates both processes. Brain neuropeptide Y (NPY) is one neurochemical system that might contribute to these separate, yet related, problems. To clarify the role of NPY in mediating reward processes and the possible interaction between reward and feeding, the present study examined the effects of injecting NPY bilaterally into the perifornical hypothalamus (PFH) vs. the nucleus accumbens (NAC) on intake of preferred vs. non-preferred food types, as well as on conditioned place preference (CPP) learning. NPY (24, 78, 156 and 235 pmol/side) stimulated intake of both regular powdered chow and sucrose when injected into the PFH, but not the NAC. A CPP that was negatively correlated with food intake occurred with the low (24 pmol/side) dose of NPY in the PFH, while a CPP that was not correlated with food intake was produced with the same dose in the NAC. The extent of the CPPs produced by NPY injection in both brain sites mirrored that produced by peripheral injection of amphetamine (2.5 mg/kg). These results indicate that NPY elicits reward-related behavior, but not feeding, from the NAC, and both behaviors from the PFH. However, the feeding effect derived from the PFH appears to overshadow a rewarding effect derived from this site. Considered together, these findings suggest that altered NPY functioning in both brain regions may contribute to some of the pathophysiological processes observed in eating disordered patients who have additional proclivities for substance abuse.

Localization of brain reinforcement mechanisms: intracranial self-administration and intracranial place-conditioning studies

Intracranial self-administration (ICSA) and intracranial place conditioning (ICPC) methodologies have been mainly used to study drug reward mechanisms, but they have also been applied toward examining brain reward mechanisms. ICSA studies in rodents have established that the ventral tegmental area (VTA) is a site supporting morphine and ethanol reinforcement. ICPC studies confirmed that injection of morphine into the VTA produces conditioned place preference (CPP). Further confirmation that activation of opioid receptors within the VTA is reinforcing comes from the findings that the endogenous opioid peptide met-enkephalin injected into the VTA produces CPP, and that the mu- and delta-opioid agonists, DAMGO and DPDPE, are self-infused into the VTA. Activation of the VTA dopamine (DA) system may produce reinforcing effects in general because (a) neurotensin is self-administered into the VTA, and injection of neurotensin into the VTA produces CPP and enhances DA release in the nucleus accumbens (NAC), and (b) GABA(A) antagonists are self-administered into the anterior VTA and injections of GABA(A) antagonists into the anterior VTA enhance DA release in the NAC. The NAC also appears to have a major role in brain reward mechanisms, whereas most data from ICSA and ICPC studies do not support an involvement of the caudate-putamen in reinforcement processes. Rodents will self-infuse a variety of drugs of abuse (e.g. amphetamine, morphine, phencyclidine and cocaine) into the NAC, and this occurs primarily in the shell region. ICPC studies also indicate that injection of amphetamine into the shell portion of the NAC produces CPP. Activation of the DA system within the shell subregion of the NAC appears to play a key role in brain reward mechanisms. Rats will ICSA the DA uptake blocker, nomifensine, into the NAC shell; co-infusion with a D2 antagonist can block this behavior. In addition, rats will self-administer a mixture of a D1 plus a D2 agonist into the shell, but not the core, region of the NAC. The ICSA of this mixture can be blocked with the co-infusion of either a D1 or a D2 antagonist. However, the interactions of other transmitter systems within the NAC may also play key roles because NMDA antagonists and the muscarinic agonist carbachol are self-infused into the NAC. The medial prefrontal (MPF) cortex supports the ICSA of cocaine and phencyclidine. The DA system also seems to play a role in this behavior since cocaine self-infusion into the MPF cortex can be blocked by co-infusing a D2 antagonist, or with 6-OHDA lesions of the MPF cortex. Limited studies have been conducted on other CNS regions to elucidate their role in brain and drug reward mechanisms using ICSA or ICPC procedures. Among these regions, ICPC findings suggest that cocaine and amphetamine are rewarding in the rostral ventral pallidum (VP); ICSA and ICPC studies indicate that morphine is rewarding in the dorsal hippocampus, central gray and lateral hypothalamus. Finally, substance P mediated systems within the caudal VP (nucleus basalis magnocellularis) and serotonin systems of the dorsal and median raphe nuclei may also be important anatomical components involved in brain reward mechanisms. Overall, the ICSA and ICPC studies indicate that there are a number of receptors, neuronal pathways, and discrete CNS sites involved in brain reward mechanisms.