Median raphe injections of 8-OH-DPAT lower frequency thresholds for lateral hypothalamic self-stimulation

What Can Reinforcement Learning Models of Dopamine and Serotonin Tell Us about the Action of Antidepressants?

Although evidence suggests that antidepressants are effective at treating depression, the mechanisms behind antidepressant action remain unclear, especially at the cognitive/computational level. In recent years, reinforcement learning (RL) models have increasingly been used to characterise the roles of neurotransmitters and to probe the computations that might be altered in psychiatric disorders like depression. Hence, RL models might present an opportunity for us to better understand the computational mechanisms underlying antidepressant effects. Moreover, RL models may also help us shed light on how these computations may be implemented in the brain (e.g., in midbrain, striatal, and prefrontal regions) and how these neural mechanisms may be altered in depression and remediated by antidepressant treatments. In this paper, we evaluate the ability of RL models to help us understand the processes underlying antidepressant action. To do this, we review the preclinical literature on the roles of dopamine and serotonin in RL, draw links between these findings and clinical work investigating computations altered in depression, and appraise the evidence linking modification of RL processes to antidepressant function. Overall, while there is no shortage of promising ideas about the computational mechanisms underlying antidepressant effects, there is insufficient evidence directly implicating these mechanisms in the response of depressed patients to antidepressant treatment. Consequently, future studies should investigate these mechanisms in samples of depressed patients and assess whether modifications in RL processes mediate the clinical effect of antidepressant treatments.

A Role for Serotonin in Modulating Opposing Drive and Brake Circuits of Impulsivity

Impulsivity generally refers to a deficit in inhibition, with a focus on understanding the neural circuits which constitute the "brake" on actions and gratification. It is likely that increased impulsivity can arise not only from reduced inhibition, but also from a heightened or exaggerated excitatory "drive." For example, an action which has more vigor, or is fueled by either increased incentive salience or a stronger action-outcome association, may be harder to inhibit. From this perspective, this review focuses on impulse control as a competition over behavioral output between an initially learned response-reward outcome association, and a subsequently acquired opposing inhibitory association. Our goal is to present a synthesis of research from humans and animal models that supports this dual-systems approach to understanding the behavioral and neural substrates that contribute to impulsivity, with a focus on the neuromodulatory role of serotonin. We review evidence for the role of serotonin signaling in mediating the balance of the "drive" and "brake" circuits. Additionally, we consider parallels of these competing instrumental systems in impulsivity within classical conditioning processes (e.g., extinction) in order to point us to potential behavioral and neural mechanisms that may modulate the competing instrumental associations. Finally, we consider how the balance of these competing associations might contribute to, or be extracted from, our experimental assessments of impulsivity. A careful understanding of the underlying behavioral and circuit level contributions to impulsivity is important for understanding the pathogenesis of increased impulsivity present in a number of psychiatric disorders. Pathological levels of impulsivity in such disorders are likely subserved by deficits in the balance of motivational and inhibitory processes.

The Combination of Galanin (1–15) and Escitalopram in Rats Suggests a New Strategy for Alcohol Use Disorder Comorbidity with Depression

Alcohol use disorder (AUD) is highly prevalent, and over 50% of AUD patients also suffer major depressive disorders. Selective 5-HT reuptake inhibitors (SSRIs) can reduce rodent ethanol drinking but exert modest clinical efficacy in alcoholic individuals. Finding new pharmacological strategies that could modulate alcohol consumption and depression is necessary. We have analyzed the effect of Galanin (1–15) [GAL(1–15)] on escitalopram (ESC)-mediated effect in alcohol consumption using the alcohol self-administration test, the nuclei involved in the effect, and whether GAL(1–15) + ESC modulated the response in despair or anxiety tests in animals under chronic alcohol intake. GAL(1–15) + ESC combination substantially reduced alcohol intake in the alcohol self-administration test and, moreover, enhanced the reduction of reward capacity of ESC on different reinforcers such as sucrose or saccharine. GAL(1–15) + ESC coadministration significantly decreases the number of C-Fos-IR TH cell bodies in the VTA, and PCA analysis suggests that one functional network, including VTA, RMTg and DR, is involved in these effects. Significantly in rats with chronic alcohol consumption, GAL(1–15) reversed adverse ESC-mediated effects in the depression-related behavioural test and forced swimming test. The results open up the possibility of using GAL(1–15) in combination with the SSRI Escitalopram as a novel strategy in AUD comorbidity with depression.

Serotonergic regulation of the dopaminergic system: Implications for reward-related functions

Serotonin is a critical neuromodulator involved in development and behavior. Its role in reward is however still debated. Here, we first review classical studies involving electrical stimulation protocols and pharmacological approaches. Contradictory results on the serotonergic' involvement in reward emerge from these studies. These differences might be ascribable to either the diversity of cellular types within the raphe nuclei or/and the specific projection pathways of serotonergic neurons. We continue to review more recent work, using optogenetic approaches to activate serotonergic cells in the Raphe to VTA pathway. From these studies, it appears that activation of this pathway can lead to reinforcement learning mediated through the excitation of dopaminergic neurons by serotonergic neurons co-transmitting glutamate. Finally, given the importance of serotonin during development on adult emotion, the effect of abnormal early-life levels of serotonin on the dopaminergic system will also be discussed. Understanding the interaction between the serotonergic and dopaminergic systems during development and adulthood is critical to gain insight into the specific facets of neuropsychiatric disorders.

Serotonergic inhibition of responding for conditioned but not primary reinforcers

Serotonin is widely implicated as a modulator of brain reward function. However, laboratory studies have not yielded a consensus on which specific reward-related processes are influenced by serotonin and in what manner. Here we explored the role of serotonin in cue-reward learning in mice. In a first series of experiments, we found that acute administration of the serotonin reuptake inhibitors citalopram, fluoxetine, or duloxetine all reduced lever pressing reinforced on an FR1 schedule with presentation of a cue that had been previously paired with delivery of food. However, citalopram had no effect on responding that was reinforced with both cue and food on an FR1 schedule. Furthermore, citalopram did not affect nose poke responses that produced no auditory, visual, or proprioceptive cues but were reinforced with food pellets on a progressive ratio schedule. We next performed region-specific knock out of tryptophan hydroxylase-2 (Tph2), the rate-limiting enzyme in serotonin synthesis. Viral delivery of Cre recombinase was targeted to dorsal or median raphe nuclei (DRN, MRN), the major sources of ascending serotonergic projections. MRN but not DRN knockouts were impaired in development of cue-elicited approach during Pavlovian conditioning; both groups were subsequently hyper-responsive when lever pressing for cue presentation. The inhibitory effect of citalopram was attenuated in DRN but not MRN knockouts. Our findings are in agreement with prior studies showing serotonin to suppress responding for conditioned reinforcers. Furthermore, these results suggest an inhibitory role of MRN serotonin neurons in the initial attribution of motivational properties to a reward-predictive cue, but not in its subsequent maintenance. In contrast, the DRN appears to promote the reduction of motivational value attached to a cue when it is presented repeatedly in the absence of primary reward.

Reward sensitivity, affective neuroscience personality, symptoms of attention-deficit/hyperactivity disorder, and TPH2-703G/T (rs4570625) genotype

OBJECTIVE

Reward sensitivity is an increasingly used construct in psychiatry, yet its possible inner structure and relationship with other affective variables are not well known.

METHODS

A reward sensitivity measurement scale was constructed on the basis of large item pool collected from birth cohort representative samples (the Estonian Children Personality Behaviour and Health Study; original n = 1238). Affective Neuroscience Personality Scale (ANPS) and the Adult Attention deficit hyperactivity disorder (ADHD) Self-Report Scale (ASRS) were administered in young adulthood. A variant (rs4570625) of the gene encoding tryptophan hydroxylase 2 (TPH2) that is responsible for the synthesis of central serotonin was genotyped.

RESULTS

Reward sensitivity consisted of two orthogonal components, operationally defined as Openness to Rewards and Insatiability by Reward, that respectively characterise the striving towards multiple rewards and the strong pursuit and fixation to a particular reward. While SEEKING and PLAY (and to lower extent CARE) of the ANPS co-varied with Openness to Rewards, FEAR, SADNESS, and ANGER were related to Insatiability by Reward. The total score of ASRS was moderately correlated with Insatiability by Reward, while the association with Openness to Rewards was negligible. However, ASRS Inattention had some negative relationship with the Social Experience facet of Openness to Rewards. The T/T homozygotes for the TPH2 promoter polymorphism had lower Insatiability by Reward but not Openness to Rewards.

CONCLUSIONS

Behaviours sensitive to rewards are separable to the components of variability and fixation, and these components are differentially related to affective aspects of personality, attention, and hyperactivity as well as to TPH2 genotype.

Dorsal Raphe Dual Serotonin-Glutamate Neurons Drive Reward by Establishing Excitatory Synapses on VTA Mesoaccumbens Dopamine Neurons

Dorsal raphe (DR) serotonin neurons provide a major input to the ventral tegmental area (VTA). Here, we show that DR serotonin transporter (SERT) neurons establish both asymmetric and symmetric synapses on VTA dopamine neurons, but most of these synapses are asymmetric. Moreover, the DR-SERT terminals making asymmetric synapses on VTA dopamine neurons coexpress vesicular glutamate transporter 3 (VGluT3; transporter for accumulation of glutamate for its synaptic release), suggesting the excitatory nature of these synapses. VTA photoactivation of DR-SERT fibers promotes conditioned place preference, elicits excitatory currents on mesoaccumbens dopamine neurons, increases their firing, and evokes dopamine release in nucleus accumbens. These effects are blocked by VTA inactivation of glutamate and serotonin receptors, supporting the idea of glutamate release in VTA from dual DR SERT-VGluT3 inputs. Our findings suggest a path-specific input from DR serotonergic neurons to VTA that promotes reward by the release of glutamate and activation of mesoaccumbens dopamine neurons.

Effects of 5-HT1A, 5-HT2A and 5-HT2C receptor agonists and antagonists on responding for a conditioned reinforcer and its enhancement by methylphenidate

OBJECTIVES

These experiments examined the effects of selective 5-HT_1A, 5-HT_2A and 5-HT_2C receptor ligands on responding for a conditioned reinforcer (CRf). Effects of these ligands were measured under basal conditions and following elevated dopamine (DA) activity produced by the DA reuptake inhibitor methylphenidate.

METHODS

Water-restricted rats learned to associate a conditioned stimulus (CS) with water in operant chambers. Subsequently, two response levers were made available; responding on one lever delivered the CS (now a CRf), while responding on the second lever had no consequences. The effects of agonist and antagonists of 5-HT_1A (8-hydroxy-2(di-n-propylamino)tetralin hydrobromide (8-OH-DPAT) and N-[2-[4-(2-methoxyphenyl)-1-piperazinyl]ethyl]-N-2-pyridinylcyclohexanecarboxamide (WAY100635)), 5-HT_2A (DOI and M100907) and 5-HT_2C (Ro60-0175 and SB242084) receptors on responding were examined alone, as well as in the presence of methylphenidate.

RESULTS

Responding for a CRf was reduced by the agonists 8-OH-DPAT, DOI and Ro60-0175. 8-OH-DPAT also reduced responding for water and seemed to impair responding in a non-specific fashion. None of the receptor antagonists affected responding. Methylphenidate dose-dependently enhanced responding for a CRf, and this was attenuated by DOI and Ro60-0175. Conversely, the 5-HT_2C receptor antagonist SB242084 potentiated the effect of methylphenidate.

CONCLUSIONS

No evidence was found for a behaviourally selective effect of 5-HT_1A receptor ligands on responding for a CRf. Activation of 5-HT_2A receptors selectively inhibits responding for a CRf. 5-HT_2C receptor ligands exerted bidirectional modulation of responding for a CRf, especially when DA activity was increased. This indicates that 5-HT_2C receptor activity is an important modulator of DA-dependent reward-related behaviours.

A glutamatergic reward input from the dorsal raphe to ventral tegmental area dopamine neurons

Electrical stimulation of the dorsal raphe (DR) and ventral tegmental area (VTA) activates the fibres of the same reward pathway but the phenotype of this pathway and the direction of the reward-relevant fibres have not been determined. Here we report rewarding effects following activation of a DR-originating pathway consisting of vesicular glutamate transporter 3 (VGluT3) containing neurons that form asymmetric synapses onto VTA dopamine neurons that project to nucleus accumbens. Optogenetic VTA activation of this projection elicits AMPA-mediated synaptic excitatory currents in VTA mesoaccumbens dopaminergic neurons and causes dopamine release in nucleus accumbens. Activation also reinforces instrumental behaviour and establishes conditioned place preferences. These findings indicate that the DR-VGluT3 pathway to VTA utilizes glutamate as a neurotransmitter and is a substrate linking the DR-one of the most sensitive reward sites in the brain--to VTA dopaminergic neurons.

The role of lateral habenula-dorsal raphe nucleus circuits in higher brain functions and psychiatric illness

Serotonergic neurons in the dorsal raphe nucleus (DRN) play an important role in regulation of many physiological functions. The lateral nucleus of the habenular complex (LHb) is closely connected to the DRN both morphologically and functionally. The LHb is a key regulator of the activity of DRN serotonergic neurons, and it also receives reciprocal input from the DRN. The LHb is also a major way-station that receives limbic system input via the stria medullaris and provides output to the DRN and thereby indirectly connects a number of other brain regions to the DRN. The complex interactions of the LHb and DRN contribute to the regulation of numerous important behavioral and physiological mechanisms, including those regulating cognition, reward, pain sensitivity and patterns of sleep and waking. Disruption of these functions is characteristic of major psychiatric illnesses, so there has been a great deal of interest in how disturbed LHb-DRN interactions may contribute to the symptoms of these illnesses. This review summarizes recent research related to the roles of the LHb-DRN system in regulation of higher brain functions and the possible role of disturbed LHb-DRN function in the pathogenesis of psychiatric disorders, especially depression.

Effects of stress and dietary tryptophan enhancement on craving for alcohol in binge and non-binge heavy drinkers

Stress is known to play an important role in alcohol abuse, whereas binge drinking may increase individuals' susceptibility to the development of alcohol dependence. We set out to investigate whether binge drinkers (BDs) or non-BDs (NBDs) are at a greater risk of an increase in their desire for alcohol following experimental stress induction (modified Trier Social Stress Test; Experiment 1) and to explore the biological mechanisms underlying such an effect (Experiment 2). Preclinical evidence suggests that serotonin may mediate stress-induced reinstatement of alcohol intake. We therefore tested whether dietary tryptophan (TRP) enhancement would modulate stress-induced desire for alcohol and whether it would affect the two populations (BD/NBD) differently. In Experiment 1 (14 NBDs, 10 BDs; mean weekly alcohol intake 50.64 U), stress induction selectively increased strong desire for alcohol compared with the nonstressful condition in BDs. Throughout the experiment, BDs reported greater negative reinforcement type of craving than NBDs, but also a higher expectancy of alcohol-induced negative effects. In Experiment 2, 41 participants (22 NBDs, 19 BDs; mean alcohol intake 38.81 U) were given either the TRP-rich (TRP+; 9 BDs, 11 NBD) or the control (CTR; 10 BD, 11 NBD) diet before undergoing stress induction. In BDs, the TRP+ diet prevented the stress-induced increase in strong desire that was observed in individuals receiving the CTR diet. In NBDs, the TRP+ diet appeared to facilitate an increase in strong desire. These findings suggest that BDs may indeed be at a greater risk than NBDs of an increase in their craving for alcohol when stressed. Furthermore, whereas enhancement of 5-hydroxytryptamine function may moderate the impact of stress on craving in BDs, it seems to facilitate stress-induced craving in NBDs, suggesting that the serotonergic system may be differentially involved depending on individual binge drinking status.

The role of the dorsal raphé nucleus in reward-seeking behavior

Pharmacological experiments have shown that the modulation of brain serotonin levels has a strong impact on value-based decision making. Anatomical and physiological evidence also revealed that the dorsal raphé nucleus (DRN), a major source of serotonin, and the dopamine system receive common inputs from brain regions associated with appetitive and aversive information processing. The serotonin and dopamine systems also have reciprocal functional influences on each other. However, the specific mechanism by which serotonin affects value-based decision making is not clear. To understand the information carried by the DRN for reward-seeking behavior, we measured single neuron activity in the primate DRN during the performance of saccade tasks to obtain different amounts of a reward. We found that DRN neuronal activity was characterized by tonic modulation that was altered by the expected and received reward value. Consistent reward-dependent modulation across different task periods suggested that DRN activity kept track of the reward value throughout a trial. The DRN was also characterized by modulation of its activity in the opposite direction by different neuronal subgroups, one firing strongly for the prediction and receipt of large rewards, with the other firing strongly for small rewards. Conversely, putative dopamine neurons showed positive phasic responses to reward-indicating cues and the receipt of an unexpected reward amount, which supports the reward prediction error signal hypothesis of dopamine. I suggest that the tonic reward monitoring signal of the DRN, possibly together with its interaction with the dopamine system, reports a continuous level of motivation throughout the performance of a task. Such a signal may provide "reward context" information to the targets of DRN projections, where it may be integrated further with incoming motivationally salient information.

Location of infarcts and apathy in ischemic stroke

BACKGROUND

Apathy is common in stroke survivors. Unlike poststroke depression, apathy after stroke has not been extensively investigated and the significance of the location of infarcts in the development of apathy following a stroke is unknown. This study examined the association between poststroke apathy (PSA) and the location of infarcts.

METHODS

A cohort of 185 patients with acute ischemic stroke admitted to the Stroke Unit of a university-affiliated regional hospital in Hong Kong was recruited. Three months after the index stroke, a psychiatrist administered the Apathy Evaluation Scale (AES). PSA was defined as an AES score of 37 or above. The presence and location of infarcts were evaluated with magnetic resonance imaging.

RESULTS

Altogether 185 patients met the entry criteria and formed the study sample; 20 (10.8%) had PSA. PSA patients were older and had higher stroke severity and more depressive symptoms. The PSA group also had lower levels of physical and cognitive functioning. Compared with the non-PSA group, PSA patients were more likely to have acute pontine infarcts (35.0% vs. 11.5%; p = 0.011). They had a higher mean number (0.5 ± 0.7 vs. 0.1 ± 0.3; p = 0.003) and larger volume (0.6 ± 1.4 vs. 0.1 ± 0.3 ml; p = 0.002) of acute pontine infarcts. Six variables were entered into the predictive regression model: age, the presence, number and volume of acute pontine infarcts, the number of old infarcts and periventricular white matter hyperintensities scores. The volume of infarcts remained an independent predictor of PSA in the multivariate analysis, with an odds ratio of 3.9 (p = 0.007). The Geriatric Depression Scale, National Institutes of Health Stroke Scale, Barthel Index and Mini-Mental State Examination scores were also entered into the subsequent associative regression model; the volume of acute pontine infarcts remained a significant predictor (odds ratio = 3.8).

CONCLUSIONS

This is the first report of an association between pontine infarcts and the risk of PSA. The results suggest that pontine infarcts may play a role in the development of PSA. The importance of acute pontine infarcts in the pathogenesis of PSA warrants further investigation.

Neurocircuitry of drug reward

In recent years, neuroscientists have produced profound conceptual and mechanistic advances on the neurocircuitry of reward and substance use disorders. Here, we will provide a brief review of intracranial drug self-administration and optogenetic self-stimulation studies that identified brain regions and neurotransmitter systems involved in drug- and reward-related behaviors. Also discussed is a theoretical framework that helps to understand the functional properties of the circuitry involved in these behaviors. The circuitry appears to be homeostatically regulated and mediate anticipatory processes that regulate behavioral interaction with the environment in response to salient stimuli. That is, abused drugs or, at least, some may act on basic motivation and mood processes, regulating behavior-environment interaction. Optogenetics and related technologies have begun to uncover detailed circuit mechanisms linking key brain regions in which abused drugs act for rewarding effects. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'.

Rewarding and incentive motivational effects of excitatory amino acid receptor antagonists into the median raphe and adjacent regions of the rat

RATIONALE

The motivational process that regulates approach behavior toward salient distal stimuli (i.e., incentive motivation) plays a key role in voluntary behavior and motivational disorders such as addiction. This process may be mediated by many neurotransmitter systems and a network of many brain structures, including the median and dorsal raphe regions (MR and DR, respectively).

OBJECTIVE

We sought to examine whether the blockade of excitatory amino acid receptors in the MR and DR is rewarding, using intracranial self-administration, and whether the self-administration effect can be explained by drug's effectiveness to enhance incentive motivation, using a visual sensation seeking procedure.

RESULTS

Rats learned to self-administer the AMPA receptor antagonist ZK 200775 into the vicinity of the MR, DR, or medial oral pontine reticular regions, but not the ventral tegmental area. The NMDA receptor antagonist AP5 was also self-administered into the MR, while it was not readily self-administered into other regions. When ZK 200775 was noncontingently administered into the MR, rats markedly increased approach responses rewarded by brief illumination of a light stimulus. In addition, contingent administration of ZK 200775 into the MR induced a conditioning effect on approach responses.

CONCLUSIONS

Rats self-administer excitatory amino acid receptor antagonists into the MR and adjacent regions. Self-administration effect of AMPA receptor antagonists into the MR can be largely explained by the manipulation's properties to invigorate ongoing approach behavior and induces conditioned approach. Glutamatergic afferents to the median raphe and adjacent regions appear to tonically suppress incentive-motivational processes.

Scarce means with alternative uses: robbins' definition of economics and its extension to the behavioral and neurobiological study of animal decision making

Almost 80 years ago, Lionel Robbins proposed a highly influential definition of the subject matter of economics: the allocation of scarce means that have alternative ends. Robbins confined his definition to human behavior, and he strove to separate economics from the natural sciences in general and from psychology in particular. Nonetheless, I extend his definition to the behavior of non-human animals, rooting my account in psychological processes and their neural underpinnings. Some historical developments are reviewed that render such a view more plausible today than would have been the case in Robbins’ time. To illustrate a neuroeconomic perspective on decision making in non-human animals, I discuss research on the rewarding effect of electrical brain stimulation. Central to this discussion is an empirically based, functional/computational model of how the subjective intensity of the electrical reward is computed and combined with subjective costs so as to determine the allocation of time to the pursuit of reward. Some successes achieved by applying the model are discussed, along with limitations, and evidence is presented regarding the roles played by several different neural populations in processes posited by the model. I present a rationale for marshaling convergent experimental methods to ground psychological and computational processes in the activity of identified neural populations, and I discuss the strengths, weaknesses, and complementarity of the individual approaches. I then sketch some recent developments that hold great promise for advancing our understanding of structure–function relationships in neuroscience in general and in the neuroeconomic study of decision making in particular.

5-HT receptors and reward-related behaviour: a review

The brain's serotonin (5-HT) system is key in the regulation of reward-related behaviours, from eating and drinking to sexual activity. The complexity of studying this system is due, in part, to the fact that 5-HT acts at many receptor subtypes throughout the brain. The recent development of drugs with greater selectivity for individual receptor subtypes has allowed for rapid advancements in our understanding of this system. Use of these drugs in combination with animal models entailing selective reward measures (i.e. intracranial self-stimulation, drug self-administration, conditioned place preference) have resulted in a greater understanding of the pharmacology of reward-related processing and behaviour (particularly regarding drugs of abuse). The putative roles of each 5-HT receptor subtype in the pharmacology of reward are outlined and discussed here. It is concluded that the actions of 5-HT in reward are receptor subtype-dependent (and thus should not be generalized) and that all studied subtypes appear to have a unique profile which is determined by content (e.g. receptor function, localization - both throughout the brain and within the synapse) and context (e.g. type of behavioural paradigm, type of drug). Given evidence of altered reward-related processing and serotonergic function in numerous neuropsychiatric disorders, such as depression, schizophrenia, and addiction, a clearer understanding of the role of 5-HT receptor subtypes in this context may lead to improved drug development and therapeutic approaches.

Activation of dorsal raphe serotonin neurons underlies waiting for delayed rewards

The serotonergic system plays a key role in the control of impulsive behaviors. Forebrain serotonin depletion leads to premature actions and steepens discounting of delayed rewards. However, there has been no direct evidence for serotonin neuron activity in relation to actions for delayed rewards. Here we show that serotonin neurons increase their tonic firing while rats wait for food and water rewards and conditioned reinforcement tones. The rate of tonic firing during the delay period was significantly higher for rewards than for tones, for which rats could not wait as long. When the delay was extended, tonic firing persisted until reward or tone delivery. When rats gave up waiting because of extended delay or reward omission, serotonin neuron firing dropped preceding the exit from reward sites. Serotonin neurons did not show significant response when an expected reward was omitted, which was predicted by the theory that serotonin signals negative reward prediction errors. These results suggest that increased serotonin neuron firing facilitates a rat's waiting behavior in prospect of forthcoming rewards and that higher serotonin activation enables longer waiting.

The roles of dopamine and serotonin in decision making: evidence from pharmacological experiments in humans

Neurophysiological experiments in primates, alongside neuropsychological and functional magnetic resonance investigations in humans, have significantly enhanced our understanding of the neural architecture of decision making. In this review, I consider the more limited database of experiments that have investigated how dopamine and serotonin activity influences the choices of human adults. These include those experiments that have involved the administration of drugs to healthy controls, experiments that have tested genotypic influences upon dopamine and serotonin function, and, finally, some of those experiments that have examined the effects of drugs on the decision making of clinical samples. Pharmacological experiments in humans are few in number and face considerable methodological challenges in terms of drug specificity, uncertainties about pre- vs post-synaptic modes of action, and interactions with baseline cognitive performance. However, the available data are broadly consistent with current computational models of dopamine function in decision making and highlight the dissociable roles of dopamine receptor systems in the learning about outcomes that underpins value-based decision making. Moreover, genotypic influences on (interacting) prefrontal and striatal dopamine activity are associated with changes in choice behavior that might be relevant to understanding exploratory behaviors and vulnerability to addictive disorders. Manipulations of serotonin in laboratory tests of decision making in human participants have provided less consistent results, but the information gathered to date indicates a role for serotonin in learning about bad decision outcomes, non-normative aspects of risk-seeking behavior, and social choices involving affiliation and notions of fairness. Finally, I suggest that the role played by serotonin in the regulation of cognitive biases, and representation of context in learning, point toward a role in the cortically mediated cognitive appraisal of reinforcers when selecting between actions, potentially accounting for its influence upon the processing salient aversive outcomes and social choice.

Brain reward circuitry beyond the mesolimbic dopamine system: a neurobiological theory

Reductionist attempts to dissect complex mechanisms into simpler elements are necessary, but not sufficient for understanding how biological properties like reward emerge out of neuronal activity. Recent studies on intracranial self-administration of neurochemicals (drugs) found that rats learn to self-administer various drugs into the mesolimbic dopamine structures-the posterior ventral tegmental area, medial shell nucleus accumbens and medial olfactory tubercle. In addition, studies found roles of non-dopaminergic mechanisms of the supramammillary, rostromedial tegmental and midbrain raphe nuclei in reward. To explain intracranial self-administration and related effects of various drug manipulations, I outlined a neurobiological theory claiming that there is an intrinsic central process that coordinates various selective functions (including perceptual, visceral, and reinforcement processes) into a global function of approach. Further, this coordinating process for approach arises from interactions between brain structures including those structures mentioned above and their closely linked regions: the medial prefrontal cortex, septal area, ventral pallidum, bed nucleus of stria terminalis, preoptic area, lateral hypothalamic areas, lateral habenula, periaqueductal gray, laterodorsal tegmental nucleus and parabrachical area.

Acute quetiapine dose-dependently exacerbates anhedonia induced by withdrawal from escalating doses of d-amphetamine

Recent clinical studies show that the atypical antipsychotic medication, quetiapine, may be beneficial in the treatment of substance abuse by alleviating the withdrawal-negative affect stage of addiction. Since the effect of quetiapine on central reward function is largely unknown we studied its effects on brain stimulation reward in animals under withdrawal from escalating doses of d-amphetamine. Male Sprague-Dawley rats were trained to produce an operant response to receive a short train of electrical stimulation to the lateral hypothalamus. Measures of reward threshold were determined with the curve-shift method in different groups of rats before, and during four days after treatment with escalating doses (1 to 10mg/kg, i.p.) of d-amphetamine or its vehicle. At 24h of withdrawal, the effects of two doses of quetiapine (2 and 10mg/kg i.p.) were tested. Animals treated with d-amphetamine showed a 25% reward deficit at 24h of withdrawal, an effect that decreased progressively over the next three days. Quetiapine attenuated reward in the vehicle-control animals, and amplified the anhedonia at the moderate, but not the low, dose in the animals under withdrawal. These results show that acute treatment with clinically relevant doses of quetiapine for the treatment of schizophrenia may exacerbate anhedonia induced by amphetamine withdrawal. Further research should investigate whether repeated treatment with quetiapine has the ability to reverse amphetamine withdrawal-induced anhedonia.

Serotonin synthesis, release and reuptake in terminals: a mathematical model

BACKGROUND

Serotonin is a neurotransmitter that has been linked to a wide variety of behaviors including feeding and body-weight regulation, social hierarchies, aggression and suicidality, obsessive compulsive disorder, alcoholism, anxiety, and affective disorders. Full understanding of serotonergic systems in the central nervous system involves genomics, neurochemistry, electrophysiology, and behavior. Though associations have been found between functions at these different levels, in most cases the causal mechanisms are unknown. The scientific issues are daunting but important for human health because of the use of selective serotonin reuptake inhibitors and other pharmacological agents to treat disorders in the serotonergic signaling system.

METHODS

We construct a mathematical model of serotonin synthesis, release, and reuptake in a single serotonergic neuron terminal. The model includes the effects of autoreceptors, the transport of tryptophan into the terminal, and the metabolism of serotonin, as well as the dependence of release on the firing rate. The model is based on real physiology determined experimentally and is compared to experimental data.

RESULTS

We compare the variations in serotonin and dopamine synthesis due to meals and find that dopamine synthesis is insensitive to the availability of tyrosine but serotonin synthesis is sensitive to the availability of tryptophan. We conduct in silico experiments on the clearance of extracellular serotonin, normally and in the presence of fluoxetine, and compare to experimental data. We study the effects of various polymorphisms in the genes for the serotonin transporter and for tryptophan hydroxylase on synthesis, release, and reuptake. We find that, because of the homeostatic feedback mechanisms of the autoreceptors, the polymorphisms have smaller effects than one expects. We compute the expected steady concentrations of serotonin transporter knockout mice and compare to experimental data. Finally, we study how the properties of the the serotonin transporter and the autoreceptors give rise to the time courses of extracellular serotonin in various projection regions after a dose of fluoxetine.

CONCLUSIONS

Serotonergic systems must respond robustly to important biological signals, while at the same time maintaining homeostasis in the face of normal biological fluctuations in inputs, expression levels, and firing rates. This is accomplished through the cooperative effect of many different homeostatic mechanisms including special properties of the serotonin transporters and the serotonin autoreceptors. Many difficult questions remain in order to fully understand how serotonin biochemistry affects serotonin electrophysiology and vice versa, and how both are changed in the presence of selective serotonin reuptake inhibitors. Mathematical models are useful tools for investigating some of these questions.

The GABAB receptor agonist baclofen administered into the median and dorsal raphe nuclei is rewarding as shown by intracranial self-administration and conditioned place preference in rats

RATIONALE

The midbrain raphe regions have long been implicated in affective processes and disorders. There is increasing evidence to suggest that the median (MR) and dorsal raphe nuclei (DR) tonically inhibit reward-related processes.

OBJECTIVES

Stimulation of GABAB receptors in the midbrain raphe nuclei is known to inhibit local neurons, especially serotonergic neurons. We sought to determine if injections of the GABAB receptor agonist baclofen into the MR or DR are rewarding, using intracranial self-administration and conditioned place preference.

RESULTS

Rats quickly learned to lever press for infusions of baclofen (0.1–2.5 mM) into the MR, but not the ventral tegmental area or central linear nucleus. Rats increased lever pressing associated with intra-DR baclofen infusions, but not readily. Baclofen self-administration into the MR or DR was attenuated by coadministration of the GABAB receptor antagonist SCH 50911 (1 mM) or systemic pretreatment with the dopamine receptor antagonist SCH 23390 (0.025 mg/kg, i.p.). In addition, intra-DR and intra-MR injections of baclofen induced conditioned place preference; injection into DR was more effective.

CONCLUSIONS

Baclofen injections into the midbrain raphe nuclei are rewarding. Baclofen was more readily self-administered into the MR than into the DR, while baclofen injections into the DR more readily induced conditioned place preference than those into the MR. These sites may be differentially involved in aspects of reward. These findings suggest that MR or DR neurons containing GABAB receptors are involved in tonic inhibitory control over reward processes.

Reward and the serotonergic system

Anhedonia, as a failure to experience rewarding stimuli, is a key characteristic of many psychiatric disorders including depression and schizophrenia. Investigations on the neurobiological correlates of reward and hedonia/anhedonia have been a growing subject of research demonstrating several neuromodulators to mediate different aspects of reward processing. Whereas the majority of research on reward mainly focused on the dopamine and opioid systems, a serotonergic mechanism has been neglected. However, recent promising results strengthen the pivotal role of serotonin in reward processing. Evidence includes electrophysical and pharmacological as well as genetic and imaging studies. Primate research using single-unit recording of neurons within the dorsal raphe nucleus argues for a serotonergic mediation of reward value, whereas studies using intracranial self-stimulation point to an important contribution of serotonin in modulating motivational aspects of rewarding brain stimulation. Pharmacological studies using agonists and antagonists of serotonergic receptor subtypes and approaches investigating an increase or decrease of the extracellular level of serotonin offer strong evidence for a serotonergic mediation, ranging from aversion to pleasure. This review provides an argument for serotonin as a fundamental mediator of emotional, motivational and cognitive aspects of reward representation, which makes it possibly as important as dopamine for reward processing.

The midbrain raphe nuclei mediate primary reinforcement via GABA(A) receptors

Because rats learn to lever-press for brief electrical stimulation of the median and dorsal raphe nuclei (MRN and DRN, respectively), these brain sites have long been implicated in reward processes. However, it is not clear whether the MRN and DRN integrate reward-related signals or merely contain fibers of passage involved in reward processes. To shed light on this issue, the present study employed chemicals that selectively modulate neurotransmission, in particular the GABA(A) receptor agonist muscimol. Rats quickly learned to lever-press for muscimol infusions (50 and 100 microM) into the MRN or DRN. Muscimol was not self-administered when cannulae were placed just outside these nuclei. The reinforcing effects of muscimol appeared to be greater when the drug was administered into the MRN than into the DRN, as demonstrated by higher infusion rates and better response discrimination. These observations are consistent with the additional finding that muscimol administration into the MRN, but not the DRN, induced conditioned place preference. The reinforcing effects of muscimol administration into the MRN were blocked by coadministration of the GABA(A) antagonist picrotoxin (100 microM) and by pretreatment with the dopamine receptor antagonist SCH 23390 (0.025 mg/kg, i.p.). The present results suggest that median and dorsal raphe neurons presumably inhibited by muscimol via GABA(A) receptors are involved in integration of primary reinforcement, and that median raphe neurons exert tonic inhibition over dopamine-dependent reward circuitry. The midbrain raphe nuclei may be involved in a variety of reward-related phenomena including drug addiction.

Serotonin and psychostimulant addiction: Focus on 5-HT1A-receptors

Serotonin(1A)-receptors (5-HT(1A)-Rs) are important components of the 5-HT system in the brain. As somatodendritic autoreceptors they control the activity of 5-HT neurons, and, as postsynaptic receptors, the activity in terminal areas. Cocaine (COC), amphetamine (AMPH), methamphetamine (METH) and 3,4-methylenedioxymethamphetamine ("Ecstasy", MDMA) are psychostimulant drugs that can lead to addiction-related behavior in humans and in animals. At the neurochemical level, these psychostimulant drugs interact with monoamine transporters and increase extracellular 5-HT, dopamine and noradrenalin activity in the brain. The increase in 5-HT, which, in addition to dopamine, is a core mechanism of action for drug addiction, hyperactivates 5-HT(1A)-Rs. Here, we first review the role of the various 5-HT(1A)-R populations in spontaneous behavior to provide a background to elucidate the contribution of the 5-HT(1A)-Rs to the organization of psychostimulant-induced addiction behavior. The progress achieved in this field shows the fundamental contribution of brain 5-HT(1A)-Rs to virtually all behaviors associated with psychostimulant addiction. Importantly, the contribution of pre- and postsynaptic 5-HT(1A)-Rs can be dissociated and frequently act in opposite directions. We conclude that 5-HT(1A)-autoreceptors mainly facilitate psychostimulant addiction-related behaviors by a limitation of the 5-HT response in terminal areas. Postsynaptic 5-HT(1A)-Rs, in contrast, predominantly inhibit the expression of various addiction-related behaviors directly. In addition, they may also influence the local 5-HT response by feedback mechanisms. The reviewed findings do not only show a crucial role of 5-HT(1A)-Rs in the control of brain 5-HT activity and spontaneous behavior, but also their complex role in the regulation of the psychostimulant-induced 5-HT response and subsequent addiction-related behaviors.

The central extended amygdala network as a proposed circuit underlying reward valuation

The phenomenon of medial forebrain bundle self-stimulation offers a powerful model of reward-based behavior. In particular, it appears to activate a neural system whose natural function is to compute the survival value or utility of present stimuli and to help orchestrate responses toward those inputs. Although the anatomical identity of this system is as yet unknown, recent descriptions of anatomical macrosystems within the basal forebrain lead to the proposal that it may be largely contained within the central extended amygdala network. This paper reviews decades' worth of behavioral and neurophysiological investigations of brain stimulation reward that support or are at least consistent with this idea. The proposed network circuitry underlying self-stimulation is also placed into the larger context of basal forebrain function, specifically, the role of the ventral striatopallidum in linking motivation to behavior, the role of the amygdala in detecting motivationally significant inputs, and the role of the magnocellular complex in communicating reward information to cortical and hippocampal targets.

Differential effects of 5-HT2C receptor ligands on place conditioning and locomotor activity in rats

Effects of the 5-hydroxytryptamine (5-HT)(1A/1B/2C) receptor agonist N-[3-(trifluoromethyl)phenyl] piperazine (TFMPP, 0-3.0 mg/kg s.c.) and the 5-HT2C receptor agonist 8,9-dichloro-2,3,4,4a-tetrahydro-1H-pyrazino[1,2-a]quinoxalin-5(6H)-one (WAY 161503, 0-3.0 mg/kg s.c.) in place conditioning were measured in male Sprague-Dawley rats. Effects of TFMPP, alone and with the 5-HT(1A) receptor antagonist N-[2-[4-(2-methoxyphenyl)-1-piperazinyl] ethyl]-N-2-pyridinyl-cyclohexanecarboxamine (WAY 100635), the 5-HT(1B) receptor antagonist N-[4-methoxy-3-(4-methyl-1-piperazinyl) phenyl]-2'-methyl-4'-(5-methyl-1,2,4-oxadiazol-3-yl)-1,1'-biphenyl-4-carboxamide (GR 127935) or the 5-HT2C receptor antagonist 6-chloro-5-methyl-1-[[2-(2-methylpyrid-3-yloxy)pyrid-5-yl]carbamoyl]indoline (SB 242084) and of WAY 161503 alone and with SB 242084 on locomotor activity were also assessed. Neither TFMPP nor WAY 161503 induced place conditioning. WAY 161503 (1.0 and 3.0 mg/kg s.c.) decreased locomotor activity; SB 242084 (1.0 mg/kg i.p.) blocked this effect. Reduced locomotor activity following TFMPP was blocked by SB 242084 but not WAY 100635 (0.1 mg/kg s.c.) or GR 127935 (3.0 mg/kg s.c.). Behaviourally relevant levels of 5-HT2C receptor stimulation may not exert reinforcing effects, although other studies indicate that such manipulations alter reinforcing effects of drugs of abuse.

Differential effects of intra-midbrain raphe and systemic 8-OH-DPAT on VTA self-stimulation thresholds in rats

RATIONALE

Intra-median raphe nucleus (MRN) administration of the 5-HT(1A) receptor agonist 8-OH-DPAT decreases lateral hypothalamic self-stimulation thresholds and is reported to have biphasic effects following systemic administration. These experiments attempted to extend the previous findings to mesolimbic pathway self-stimulation at ventral tegmental area (VTA) electrodes.

OBJECTIVES

This study was conducted to provide comparative data for systemic and intra-dorsal raphe nucleus (DRN) and intra-MRN effects of 8-OH-DPAT on VTA self-stimulation.

METHODS

Male Sprague-Dawley rats with VTA electrodes were trained to respond for electrical stimulation. Systemic and intra-midbrain raphe 8-OH-DPAT effects on rate-frequency thresholds were measured. Systemic administration of WAY 100635 was used to confirm 5-HT(1A) receptor mediation of 8-OH-DPAT effects.

RESULTS

8-OH-DPAT (0.003-0.3 mg kg(-1) SC) increased rate-frequency thresholds and decreased maximal response rates. WAY 100635 alone (0.0125-0.1 mg kg(-1) SC) did not alter these measures. Intra-DRN and intra-MRN 8-OH-DPAT (5.0 microg) decreased rate-frequency thresholds without altering maximal response rates. Intra-DRN 8-OH-DPAT (0.1-5.0 microg) induced a slight decrease and intra-MRN 8-OH-DPAT a slight increase in locomotor activity. WAY 100635 (0.1 mg kg(-1)) blocked effects of 8-OH-DPAT on VTA self-stimulation.

CONCLUSION

These results confirm threshold-decreasing effects of intra-MRN 8-OH-DPAT and extend this to the DRN and to VTA thresholds. Monophasic dose dependent increases in VTA thresholds following systemic 8-OH-DPAT are not equivalent to reports for hypothalamic self-stimulation. Differences between studies may be attributable to stimulation site and/or differences in threshold measurement procedures. Effects of WAY 100635 in this study indicate 5-HT(1A) receptor mediation of these 8-OH-DPAT effects.

Molecular mechanisms underlying the rewarding effects of cocaine

The initially surprising observation that cocaine retains its rewarding effects in dopamine transporter (DAT) knockout (KO) mice led our laboratory to examine the effects of deletion of other monoaminergic genes on cocaine reward. Our initial approach to this problem was to combine DAT KO mice with serotonin transporter (SERT) KO mice to make combined DAT/SERT KO mice. The combination of these knockouts eliminates cocaine reward as assessed in the conditioned place preference (CPP) paradigm. We have also identified evidence that, in the absence of DAT, there is greater participation in cocaine reward by serotonin (SERT) and norepinephrine (NET) transporters. Both NET and SERT blockers (nisoxetine and fluoxetine) produced significant CPPs in DAT KO mice, but not in wild-type (WT) mice. The striking elimination of cocaine CPP in combined DAT/SERT KO mice contrasts with effects that we have identified in combined NET/SERT knockout mice, which display increases in cocaine reward, and with recent reports that suggest that DAT/NET combined KOs retain substantial cocaine CPP. Overall, these studies indicate important requirements for several monoaminergic system genes to fully explain cocaine reward, in particular those expressed by dopamine and serotonin systems.

Serotonin and drug reward: focus on 5-HT2C receptors

Pharmacological manipulation of the 5-hydroxytryptamine (5-HT; serotonin) system has long been associated with a regulation of feeding behaviour, however, the initial part of this article reviews evidence that central 5-HT systems similarly modulate reward-related behaviours, particularly drug reward. The second part of this article considers what we believe to be strong emerging pharmacological and genetic evidence that many of these effects are mediated through 5-HT(2C) receptor signalling mechanisms. Finally, we consider the potential for selective 5-HT(2C) agonists as therapies for substance abuse disorders and the medical implications for different 5-HT(2C) receptor isoforms generated by RNA editing.

Activation of neural pathways associated with sexual arousal in non-human primates

PURPOSE

To evaluate brain activity associated with sexual arousal, fully conscious male marmoset monkeys were imaged during presentation of odors that naturally elicit high levels of sexual activity and sexual motivation.

MATERIAL AND METHODS

Male monkeys were lightly anesthetized, secured in a head and body restrainer with a built-in birdcage resonator and positioned in a 9.4-Tesla spectrometer. When fully conscious, monkeys were presented with the odors of a novel receptive female or an ovariectomized monkey. Both odors were presented during an imaging trial and the presentation of odors was counterbalanced. Significant changes in both positive and negative BOLD signal were mapped and averaged.

RESULTS

Periovulatory odors significantly increased positive BOLD signal in several cortical areas: the striatum, hippocampus, septum, periaqueductal gray, and cerebellum, in comparison with odors from ovariectomized monkeys. Conversely, negative BOLD signal was significantly increased in the temporal cortex, cingulate cortex, putamen, hippocampus, substantia nigra, medial preoptic area, and cerebellum with presentation of odors from ovariectomized marmosets as compared to periovulatory odors. A common neural circuit comprising the temporal and cingulate cortices, putamen, hippocampus, medial preoptic area, and cerebellum shared both the positive BOLD response to periovulatory odors and the negative BOLD response to odors of ovariectomized females.

CONCLUSION

These data suggest the odor-driven enhancement and suppression of sexual arousal affect neuronal activity in many of the same general brain areas. These areas included not only those associated with sexual activity, but also areas involved in emotional processing and reward.

Effects of 8-OH-DPAT and WAY-100635 on performance on a time-constrained progressive-ratio schedule

RATIONALE

Performance on progressive-ratio schedules has been proposed as a means of assessing the effects of drugs on motivation. We have adopted a mathematical model proposed by Killeen to analyse the effects of drugs acting at 5-HT(1A) receptors on progressive-ratio performance. According to this model, the relationship between response rate and ratio size is described by a bitonic (inverted-U) function. One parameter of the function, a, expresses the motivational or "activating" effect of the reinforcer (duration of activation of responding produced by the reinforcer), whereas another parameter, delta, expresses the minimum time needed to execute a response and is regarded as an index of "motor capacity".

OBJECTIVE

To examine the effect of the selective 5-HT(1A) receptor agonist 8-OH-DPAT [8-hydroxy-2-(di- n-propylamino)tetralin] and the antagonist WAY-100635 [ N-[2-(4-[2-methoxyphenyl]-1-piperazinyl)ethyl]- N-2-pyridinylcyclo-hexanecarboxamide] on progressive-ratio schedule performance.

METHODS

Sixteen rats responded for a food-pellet reinforcer on a time-constrained progressive-ratio schedule (55-min sessions). In phase 1, they received single doses (s.c.) of 8-OH-DPAT (25, 50, 100, 200 microg kg(-1), four treatments at each dose) or the vehicle (0.9% saline solution). In phase 2, they received WAY-100635 (30, 100, 300 microg kg(-1)) according to the same regimen. In phase 3, they received 8-OH-DPAT (100 microg kg(-1)) alone or in combination with WAY-100635 (30 microg kg(-1)). 8-OH-DPAT dose dependently increased the value of a, significant increases being seen with the 50, 100 and 200 microg kg(-1) doses. The highest dose also increased delta. WAY-100635 did not significantly alter either a or delta. WAY-100635 significantly attenuated the effect of 8-OH-DPAT on both a and delta.

CONCLUSIONS

The results suggest that 8-OH-DPAT enhanced the activating effect of the reinforcer (the highest dose may also have induced motor debilitation). The finding that the effect of 8-OH-DPAT on a was attenuated by WAY-100635 implicates 5-HT(1A) receptors in this effect. The results are consistent with previous reports that 8-OH-DPAT facilitates feeding and food-reinforced operant responding in rats and suggest that these effects may be brought about by an increase in food motivation.

Cocaine mechanisms: enhanced cocaine, fluoxetine and nisoxetine place preferences following monoamine transporter deletions

Cocaine blocks uptake by neuronal plasma membrane transporters for dopamine, serotonin and norepinephrine, producing subjective effects in humans that are both euphoric/rewarding and also fearful, jittery and aversive. Mice with gene knockouts of each of these transporters display cocaine reward, manifest by cocaine place preferences that are at least as great as wildtype values. Norepinephrine and serotonin receptor knockouts even display enhanced cocaine reward. One explanation for these observations could be that cocaine produces aversive or anhedonic effects by serotonin or norepinephrine receptor blockade in wildtype mice that are removed in serotonin or norepinephrine receptor knockouts, increasing net cocaine reward. Adaptations to removing one transporter could also change the rewarding valence of blocking the remaining transporters. To test these ideas, drugs that block serotonin transporter (fluoxetine), norepinephrine transporter (nisoxetine) or all three transporters (cocaine) were examined in single- or multiple-transporter knockout mice. Fluoxetine and nisoxetine acquire rewarding properties in several knockouts that are not observed in wildtype mice. Adding serotonin transporter knockout to norepinephrine transporter knockouts dramatically potentiates cocaine reward. These and previous data provide evidence that serotonin and norepinephrine transporter blockade can contribute to the net rewarding valence of cocaine. They identify neuroadaptations that may help to explain the retention of cocaine reward by dopamine and serotonin transporter knockout mice. They are consistent with emerging hypotheses that actions at the three primary brain molecular targets for cocaine each provide distinct contributions to cocaine reward and cocaine aversion in wildtype mice, and that this balance changes in mice that develop without dopamine, norepinephrine or serotonin transporters.

Opponent interactions between serotonin and dopamine

Anatomical and pharmacological evidence suggests that the dorsal raphe serotonin system and the ventral tegmental and substantia nigra dopamine system may act as mutual opponents. In the light of the temporal difference model of the involvement of the dopamine system in reward learning, we consider three aspects of motivational opponency involving dopamine and serotonin. We suggest that a tonic serotonergic signal reports the long-run average reward rate as part of an average-case reinforcement learning model; that a tonic dopaminergic signal reports the long-run average punishment rate in a similar context; and finally speculate that a phasic serotonin signal might report an ongoing prediction error for future punishment.

Molecular mechanisms of cocaine reward: combined dopamine and serotonin transporter knockouts eliminate cocaine place preference

Cocaine blocks uptake by neuronal plasma membrane transporters for dopamine (DAT), serotonin (SERT), and norepinephrine (NET). Cocaine reward/reinforcement has been linked to actions at DAT or to blockade of SERT. However, knockouts of neither DAT, SERT, or NET reduce cocaine reward/reinforcement, leaving substantial uncertainty about cocaine's molecular mechanisms for reward. Conceivably, the molecular bases of cocaine reward might display sufficient redundancy that either DAT or SERT might be able to mediate cocaine reward in the other's absence. To test this hypothesis, we examined double knockout mice with deletions of one or both copies of both the DAT and SERT genes. These mice display viability, weight gain, histologic features, neurochemical parameters, and baseline behavioral features that allow tests of cocaine influences. Mice with even a single wild-type DAT gene copy and no SERT copies retain cocaine reward/reinforcement, as measured by conditioned place-preference testing. However, mice with no DAT and either no or one SERT gene copy display no preference for places where they have previously received cocaine. The serotonin dependence of cocaine reward in DAT knockout mice is thus confirmed by the elimination of cocaine place preference in DAT/SERT double knockout mice. These results provide insights into the brain molecular targets necessary for cocaine reward in knockout mice that develop in their absence and suggest novel strategies for anticocaine medication development.

Immunohistochemical characterisation of Fos-positive cells in brainstem monoaminergic nuclei following intracranial self-stimulation of the medial forebrain bundle in the rat

Fos immunostaining was used as a marker of neuronal activity following intracranial self-stimulation (ICSS) of the medial forebrain bundle (MFB) in the rat, and was combined with immunostaining for tyrosine hydroxylase (TH), serotonin (5-HT), gamma-aminobutyric acid (GABA), or NR1 (one of the glutamate N-methyl- D-aspartate receptor subunits) for purposes of neurochemical identification. ICSS induced a significant but different degree of increase in the number of Fos-immunopositive (Fos+) cells in the six brainstem monoaminergic nuclei examined, which included the ventral tegmental area (VTA), substantia nigra pars compacta (SNc), dorsal raphe nucleus (DR), median raphe nucleus (MR), locus coeruleus (LC), and A7 noradrenaline cells. Densely labelled Fos+ cells were observed in the LC following ICSS, and many of these Fos+ cells were colocalized with TH. Similarly, many of Fos+ cells in the A7 and DR/MR were colocalized with TH and 5-HT, respectively. By contrast, a smaller number of Fos+ cells was detected in the VTA and SNc following the ICSS, and in these regions the majority of Fos+ cells were not colocalized with TH. Although results among regions quantitatively differed, the ICSS induced a significant increase in the number of double-labelled cells (GABA+/Fos+ or NR1+/Fos+) in all of the VTA, DR, and LC, in which the ICSS produced an ipsilaterally weighted increase in Fos-like immunoreactivity. These results suggest that ICSS of the MFB induces differential Fos expression within monoaminergic and GABAergic neurons in brainstem monoaminergic nuclei under modulation by glutamatergic afferents.

Lack of glucocorticoids attenuates the self-stimulation-induced increase in the in vivo synthesis rate of dopamine but not serotonin in the rat nucleus accumbens

Our previous study demonstrated that intracranial self-stimulation of the medial forebrain bundle can increase the in vivo synthesis turnover rate of dopamine (DA) and serotonin (5-HT) in the nucleus accumbens of adrenal-intact rats. The present study examined using microdialysis whether such increases in DA and 5-HT syntheses are influenced by adrenal hormones, which are also activated following intracranial self-stimulation. A decarboxylase inhibitor, NSD-1015, was perfused through reversed microdialysis which enabled the simultaneous measurement of 3,4-dihydroxyphenylalanine (DOPA) and 5-hydroxytryptophan (5-HTP) as an index of the in vivo turnover rate of DA and 5-HT syntheses. Adrenalectomy (ADX) attenuated significantly the self-stimulation-induced increase in dialysate levels of DOPA but not 5-HTP. Corticosterone (Cort) replacement reversed the attenuation in DOPA levels in adrenalectomized rats. The finding indicates that activation of DA synthesis in vivo in the nucleus accumbens during intracranial self-stimulation is dependent on, whereas that of 5-HT synthesis is independent of glucocorticoid modulation.

Lateral hypothalamic serotonin inhibits nucleus accumbens dopamine: implications for sexual satiety

Dopamine (DA) is released in several brain areas, including the nucleus accumbens (NAcc), before and during copulation in male rats. DA agonists administered into this area facilitate, and DA antagonists inhibit, numerous motivated behaviors, including male sexual behavior. Serotonin (5-HT) is generally inhibitory to male sexual behavior. We reported previously that 5-HT is released in the anterior lateral hypothalamic area (LHA(A)) and that a selective serotonin reuptake inhibitor microinjected into that area delayed and slowed copulation. Our present results, using high temporal resolution microdialysis, (1) confirm previous electrochemical evidence that extracellular levels of DA increase in the NAcc during copulation and decrease during the postejaculatory interval (PEI) and (2) reveal that LHA(A) 5-HT can inhibit both basal and female-elicited DA release in the NAcc. These findings suggest that the neural circuit promoting sexual quiescence during the PEI includes serotonergic input to the LHA(A), which in turn inhibits DA release in the NAcc. These findings may also provide insights concerning the inhibitory control of other motivated behaviors activated by the NAcc and may have relevance for understanding the sexual side effects common to antidepressant medications.

Lesions of midline midbrain structures leave medial forebrain bundle self-stimulation intact

Previous work with psychophysically-based collision methods and pharmacological manipulation suggests a role in medial forebrain bundle (MFB) self-stimulation for neurons lying along the midline between the cerebral hemispheres, in the mid- and/or hindbrain. Also, recently-proposed models of the anatomical substrate for medial forebrain bundle stimulation reward suggest that at least part of the directly-activated axons of this substrate arise from mid- and/or hindbrain somata, bifurcate, and send bilateral projections to the MFB of each hemisphere. Branches of these axons are thought to cross the midline at some point near the ventral tegmental area. This study examines the effects on MFB stimulation reward of lesioning midbrain structures that lie along the midline between hemispheres. In 13 rats, lesions of the median raphe, the decussation of the superior cerebellar peduncle, or the interpeduncular nucleus were all ineffective in altering the stimulation frequency required to maintain half-maximal levels of operant responding for stimulation reward. These results are discussed in terms of implications for recent models of the anatomical substrate for brain stimulation reward.

Midbrain periaqueductal lesions do not degrade medial forebrain bundle stimulation reward

To investigate the possible role of the midbrain central grey and dorsal raphe in medial forebrain bundle (MFB) self-stimulation, 12 rats received monopolar stimulation electrodes in both the lateral hypothalamic and ventral tegmental MFB and an ipsilateral lesioning electrode in either the central grey or dorsal raphe. Baseline rate-frequency data were collected at several currents at each stimulation site until the frequency required to maintain half-maximal responding stabilized and then an electrolytic lesion was made by passing either 20 or 60 s of anodal constant current through the lesioning electrode. Post-lesion rate-frequency data indicated that lesions of the central grey and dorsal raphe had little appreciable effect on the rewarding nature of MFB stimulation. One rat's lesion damaged the median raphe and produced sustained downward shifts in required frequency, suggesting post-lesion enhancement of the stimulation's rewarding effect.

Continued trends in the conditioned place preference literature from 1992 to 1996, inclusive, with a cross-indexed bibliography

In light of the overwhelming response to the previous publication in Neuroscience and Biobehavioral Reviews (1993, 17, 21-41) regarding trends in place conditioning (either preference or aversion), the present work constitutes a five-year follow-up to review the empirical research in this behavioral paradigm from 1992 to 1996, inclusively. The behavioral technique has grown as indicated by the number of publications over the last five years which equals those authored over the 35 years covered by our last survey. The previous work used descriptive statistics to explore topical issues, whereas the present work discusses trends since that time and hopes to provide an exhaustive bibliography of the CPP literature, including articles, published abstracts, book chapters and reviews, as well as providing a cross-index of identified key words/drugs tested.

Lesions of pontomesencephalic cholinergic nuclei do not substantially disrupt the reward value of medial forebrain bundle stimulation

This study examines the effects of lesioning the pedunculopontine tegmentum (PPTg) and laterodorsal tegmentum (LDTg) on the reward effectiveness of medial forebrain bundle (MFB) stimulation. Although the focus is on the effects of unilateral lesions made ipsilateral to stimulation sites in the hypothalamic and ventral tegmental MFB, the effects of contralateral lesions of both targets are also investigated. Reward effectiveness was assessed using the rate-frequency curve shift paradigm. In nine rats with unilateral PPTg lesions and five rats with unilateral LDTg lesions, the frequency required to maintain half-maximal response rats was generally not changed by more than 0.1 log units relative to prelesion baseline mean. In three rats with contralateral PPTg lesions and four rats with contralateral LDTg lesions, required frequency was also not substantially changed. The results are interpreted in terms of a previously proposed hypothesis regarding the role in MFB self-stimulation of ascending cholinergic input from the pontomesencephalon to ventral tegmental dopaminergic neurons.

Acute and chronic fluoxetine treatment decreases the sensitivity of rats to rewarding brain stimulation

The effects of fluoxetine on rewarding brain stimulation were determined in eight Wistar rats using a rate-independent discrete-trial threshold measure. Rats were implanted with bipolar, stainless steel electrodes either into the ventral tegmental area (VTA) or medial forebrain bundle (MFB). Acute administration of fluoxetine significantly raised the reward threshold (decreased sensitivity) at doses of 2.5, 5.0, 10.0, and 20.0 mg/kg, i.p., without altering latency of response. There were no significant differences between VTA and MFB groups. To determine the effects of chronic treatment, daily injections of 5.0 mg/kg fluoxetine were administered to rats for 21 days. Chronic treatment of fluoxetine continued to significantly elevate reward thresholds with no evidence of tolerance. The results of these experiments suggest that fluoxetine does not possess abuse potential and that serotonin produces an inhibitory effect on the mesolimbic dopaminergic reward system. Furthermore, these results suggest that the antidepressant effects of fluoxetine are not the direct result of excitation of brain reward systems, at least in the same manner as abused substances, for example, cocaine.

Injection of 5-HT into the nucleus accumbens reduces the effects of d-amphetamine on responding for conditioned reward

Injection of d-amphetamine into the nucleus accumbens potentiates responding for stimuli paired with a primary reward. A previous study showed that this potentiating effect of d-amphetamine on responding for conditioned reward (CR) was attenuated by peripherally injected d-fenfluramine, a 5-hydroxytryptamine (5-HT) releaser and re-uptake inhibitor. The present experiments further examined the effects of manipulating 5-HT function within the nucleus accumbens on responding for CR, and on the potentiation of CR responding following intra-accumbens injection of d-amphetamine. Water deprived rats were trained to associate a compound stimulus with water delivery during a conditioning phase. During a test phase water was not delivered, but the compound stimulus was delivered according to a random ratio 2 schedule following a response on one of two levers. Rats responded at a higher rate on the lever delivering this CR. d-Amphetamine (10 micrograms) injected into the nucleus accumbens enhanced responding on the CR lever. Co-injections of 5-HT (5 and 10 micrograms) into the nucleus accumbens abolished the response-potentiating effect of d-amphetamine but were without effect on the base-line level of responding for CR. This reduction by 5-HT of the response potentiating effect of d-amphetamine was prevented by prior treatment with the 5-HT receptor antagonist metergoline (1 mg/kg). Responding for water was not altered by 5-HT and so the effects of 5-HT on responding for CR cannot be due to a change in the motivation to seek the primary reward. Thus, elevating 5-HT activity within the nucleus accumbens antagonises the effect of d-amphetamine on responding for CR within the nucleus accumbens. These results suggest that 5-HT within the nucleus accumbens may play an important role in mediating incentive motivation by modulating dopaminergic neurotransmission.

Effects of d-fenfluramine and metergoline on responding for conditioned reward and the response potentiating effect of nucleus accumbens d-amphetamine

These studies investigated the effects of the 5-hydroxytryptamine (5-HT) releaser, and re-uptake inhibitor, d-fenfluramine, and the non-selective 5-HT receptor antagonist metergoline, on responding for conditioned reward (CR), and on the potentiation of responding for CR following amphetamine injected into the nucleus accumbens. Water deprived rats were trained to associate a compound stimulus with water delivery during a conditioning phase. During a test phase, water was not delivered but the compound stimulus was delivered according to a random ratio 2 schedule following a response on one of two levers; responding on the other lever was not reinforced. Overall, rats responded at a higher rate on the lever delivering the CR. d-Amphetamine (1, 3 and 10 micrograms) injected into the nucleus accumbens dose-dependently enhanced responding on the CR lever. Treatment with d-fenfluramine (0.5 and 1 mg/kg) reduced responding for the CR, and abolished the potentiating effect of d-amphetamine. Responding on the inactive lever was also reduced by 1 mg/kg but not 0.5 mg/kg d-fenfluramine. The reduction of d-amphetamine's effect on responding for CR was prevented by prior treatment with the 5-HT receptor antagonist metergoline (1 mg/kg). Control experiments showed that changes in thirst and motor performance, as well as deficits in learning ability, cannot account for the effects of d-fenfluramine in this paradigm. In a separate experiment, 1 mg/kg metergoline failed to enhance responding for CR, and to augment the response potentiating effect of a low dose (2 micrograms) of d-amphetamine injected into the nucleus accumbens.(ABSTRACT TRUNCATED AT 250 WORDS)