Ventral tegmental area neurons in learned appetitive behavior and positive reinforcement

Personality traits are differentially associated with patterns of reward and novelty processing in the human substantia nigra/ventral tegmental area

BACKGROUND

The long-standing observation that the novelty-seeking personality trait is a predictor of drug use and other reinforcable risky behaviors raises the question as to how novelty and reward processing functionally interact in mesolimbic dopaminergic circuitry and how this interaction is modulated by the novelty-seeking personality trait.

METHODS

Functional magnetic resonance imaging (fMRI) hemodynamic responses to novelty and reward (monetary incentive) from the substantia nigra/ventral tegmental area (SN/VTA), the nucleus accumbens (NAcc), and the hippocampus of 29 subjects were correlated with novelty-seeking scores. These correlations were compared with those obtained for scores of reward-dependence. The fMRI data were taken from two experiments in which the interaction of novelty and reward was manipulated as a within-subject variable, and long-term memory for the critical stimuli was assessed after 24 hours.

RESULTS

Novelty-seeking was positively correlated with SN/VTA activation elicited by novel cues that did not predict reward, whereas reward-dependence was related to activations elicited by novel cues that predicted reward. The positive correlation between SN/VTA responses to novelty and novelty-seeking scores was accompanied by a negative correlation with reward-related SN/VTA activation and memory enhancement.

CONCLUSIONS

SN/VTA responses to novelty and reward are differentially affected by personality traits of novelty-seeking and reward-dependence. Importantly, novelty-seekers were more responsive to novel cues in the absence of reward and needed less reward to boost their memory for novel cues. These observations strongly suggest that for novelty-seekers, the motivational value of novelty is not necessarily based on actual reward-predicting stimulus properties.

Gata2 is a tissue-specific post-mitotic selector gene for midbrain GABAergic neurons

Midbrain GABAergic neurons control several aspects of behavior, but regulation of their development and diversity is poorly understood. Here, we further refine the midbrain regions active in GABAergic neurogenesis and show their correlation with the expression of the transcription factor Gata2. Using tissue-specific inactivation and ectopic expression, we show that Gata2 regulates GABAergic neuron development in the mouse midbrain, but not in rhombomere 1, where it is needed in the serotonergic lineage. Without Gata2, all the precursors in the embryonic midbrain fail to activate GABAergic neuron-specific gene expression and instead switch to a glutamatergic phenotype. Surprisingly, this fate switch is also observed throughout the neonatal midbrain, except for the GABAergic neurons located in the ventral dopaminergic nuclei, suggesting a distinct developmental pathway for these neurons. These studies identify Gata2 as an essential post-mitotic selector gene of the GABAergic neurotransmitter identity and demonstrate developmental heterogeneity of GABAergic neurons in the midbrain.

Reward prediction error signals by reticular formation neurons

As a key part of the brain's reward system, midbrain dopamine neurons are thought to generate signals that reflect errors in the prediction of reward. However, recent evidence suggests that "upstream" brain areas may make important contributions to the generation of prediction error signals. To address this issue, we recorded neural activity in midbrain reticular formation (MRNm) while rats performed a spatial working memory task. A large proportion of these neurons displayed positive and negative reward prediction error-related activity that was strikingly similar to that observed in dopamine neurons. Therefore, MRNm may be a source of reward prediction error signals.

Midbrain dopamine neurons: projection target determines action potential duration and dopamine D(2) receptor inhibition

Broad action potentials (APs) and dopamine (DA) D(2) receptor (D(2)R)-mediated inhibition are widely used to identify midbrain DA neurons. However, when these measures are taken alone they do not predict DA content in ventral tegmental area (VTA) neurons. In fact, some VTA neuronal properties correlate better with projection target than neurotransmitter content. Here we report that amygdala (AMYG)-projecting VTA DA neurons have brief APs and lack D(2)R agonist (quinpirole; 1 microM) autoinhibition. However, they are hyperpolarized by both the GABA(B) agonist baclofen (1 microM) and the kappa-opioid receptor agonist U69593 [(+)-(5alpha,7alpha,8beta)-N-methyl-N-[7-(1-pyrrolidinyl)-1-oxaspiro[4.5]dec-8-yl]benzeneacetamide; 1 microM]. Furthermore, we show that accurate prediction of DA content in VTA neurons is possible when the projection target is known: in both nucleus accumbens- and AMYG-projecting neural populations, AP durations are significantly longer in DA than non-DA neurons. Among prefrontal cortex-projecting neurons, quinpirole sensitivity, but not AP duration, is a predictor of DA content. Therefore, in the VTA, AP duration and inhibition by D(2)R agonists may be valid markers of DA content in neurons of known projection target.

Parallel and interactive learning processes within the basal ganglia: relevance for the understanding of addiction

In this review we discuss the evidence that drug addiction, defined as a maladaptive compulsive habit, results from the progressive subversion by addictive drugs of striatum-dependent operant and Pavlovian learning mechanisms that are usually involved in the control over behaviour by stimuli associated with natural reinforcement. Although mainly organized through segregated parallel cortico-striato-pallido-thalamo-cortical loops involved in motor or emotional functions, the basal ganglia, and especially the striatum, are key mediators of the modulation of behavioural responses, under the control of both action-outcome and stimulus-response mechanisms, by incentive motivational processes and Pavlovian associations. Here we suggest that protracted exposure to addictive drugs recruits serial and dopamine-dependent, striato-nigro-striatal ascending spirals from the nucleus accumbens to more dorsal regions of the striatum that underlie a shift from action-outcome to stimulus-response mechanisms in the control over drug seeking. When this progressive ventral to dorsal striatum shift is combined with drug-associated Pavlovian influences from limbic structures such as the amygdala and the orbitofrontal cortex, drug seeking behaviour becomes established as an incentive habit. This instantiation of implicit sub-cortical processing of drug-associated stimuli and instrumental responding might be a key mechanism underlying the development of compulsive drug seeking and the high vulnerability to relapse which are hallmarks of drug addiction.

Social modulation during songbird courtship potentiates midbrain dopaminergic neurons

Synaptic transmission onto dopaminergic neurons of the mammalian ventral tegmental area (VTA) can be potentiated by acute or chronic exposure to addictive drugs. Because rewarding behavior, such as social affiliation, can activate the same neural circuitry as addictive drugs, we tested whether the intense social interaction of songbird courtship may also potentiate VTA synaptic function. We recorded glutamatergic synaptic currents from VTA of male zebra finches who had experienced distinct social and behavioral conditions during the previous hour. The level of synaptic transmission to VTA neurons, as assayed by the ratio of α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid (AMPA) to N-methyl-D-aspartic acid (NMDA) glutamate receptor mediated synaptic currents, was increased after males sang to females, and also after they saw females without singing, but not after they sang while alone. Potentiation after female exposure alone did not appear to result from stress, as it was not blocked by inhibition of glucocorticoid receptors. This potentiation was restricted to synapses of dopaminergic projection neurons, and appeared to be expressed postsynaptically. This study supports a model in which VTA dopaminergic neurons are more strongly activated during singing used for courtship than during non-courtship singing, and thus can provide social context-dependent modulation to forebrain areas. More generally, these results demonstrate that an intense social encounter can trigger the same pathways of neuronal plasticity as addictive drugs.

Prominent activation of brainstem and pallidal afferents of the ventral tegmental area by cocaine

Blockade of monoamine transporters by cocaine should not necessarily lead to certain observed consequences of cocaine administration, including increased firing of ventral mesencephalic dopamine (DA) neurons and accompanying impulse-stimulated release of DA in the forebrain and cortex. Accordingly, we hypothesize that the dopaminergic-activating effect of cocaine requires stimulation of the dopaminergic neurons by afferents of the ventral tegmental area (VTA). We sought to determine if afferents of the VTA are activated following cocaine administration. Rats were injected in the VTA with retrogradely transported Fluoro-Gold and, after 1 week, were allowed to self-administer cocaine or saline via jugular catheters for 2 h on 6 consecutive days. Other rats received a similar amount of investigator-administered cocaine through jugular catheters. Afterward, the rats were killed and the brains processed immunohistochemically for retrogradely transported tracer and Fos, the protein product of the neuronal activation-associated immediate early gene, c-fos. Forebrain neurons exhibiting both Fos and tracer immunoreactivity were enriched in both cocaine groups relative to the controls only in the globus pallidus and ventral pallidum, which, together, represented a minor part of total forebrain retrogradely labeled neurons. In contrast, both modes of cocaine administration strongly increased double-labeling relative to the controls in the brainstem, specifically in the caudal ventromedial mesencephalon and rostromedial pontine tegmentum. It is concluded that a previously unappreciated activation of pallidal and brainstem afferents may contribute to the modulation of dopaminergic neuronal activity following cocaine administration.

Leptin neuroprotection in the CNS: mechanisms and therapeutic potentials

Leptin is well known as a hormone important in the central control of appetitive behaviors via receptor-mediated actions in the hypothalamus, where leptin adjusts food intake to maintain homeostasis with the body's energy stores. Recent evidence has shown that leptin and its receptors are widespread in the CNS and may provide neuronal survival signals. This review summarizes our current knowledge of how leptin functions in the brain and then focuses on the ability of leptin to mitigate neuronal damage in experimental models of human neurological disorders. Damage to the brain by acute events such as stroke, or long-term loss of neurons associated with neurodegenerative diseases, including Parkinson's and Alzheimer's disease, may be amenable to treatment using leptin to limit death of susceptible cells. Leptin-mediated pro-survival signaling is now known to prevent the death of neurons in these models. The signaling cascades that leptin generates are shared by other neuroprotective molecules including insulin and erythropoietin, and are thus a component of the neurotrophic effects mediated by endogenous hormones. Coupled with evidence that leptin dysregulation in human disease also results in enhanced neuronal susceptibility to damage, development of leptin as a therapeutic methodology is an attractive and viable possibility.

Contributions of the amygdala and medial prefrontal cortex to incentive cue responding

Reward-seeking behavior is controlled by neuronal circuits that include the basolateral nucleus of amygdala (BLA), medial prefrontal cortex (mPFC), nucleus accumbens (NAc) and ventral tegmental area. Using a discriminative stimulus (DS) task in which an intermittently presented cue (DS) directs rats to make an operant response for sucrose, we previously demonstrated that dopamine receptor antagonism in the NAc reduced reinforced cue responding, whereas general inactivation of the NAc increased behavioral responding in the absence of the cue. Because they send major glutamatergic projections to the NAc, the BLA and mPFC may also contribute to reward-seeking behaviors modulated by the NAc. In this study we compare the effects of BLA and mPFC inactivation on rats' performance of a DS task. BLA inactivation by combined GABA(A) and GABA(B) agonists impaired cue responding with minimal effects on operant behavior in the absence of cues. Dorsal medial prefrontal cortex (dmPFC) inactivation also inhibited cue-evoked reward-seeking. In contrast, ventral medial prefrontal cortex (vmPFC) inactivation disinhibited responding to unrewarded cues with less influence on reinforced cue responding. These findings demonstrate that the BLA and dmPFC facilitate cue-evoked reward-seeking, whereas, in the same task the vmPFC exerts inhibitory control over unrewarded behaviors.

Cocaine but not natural reward self-administration nor passive cocaine infusion produces persistent LTP in the VTA

Persistent drug-seeking behavior is hypothesized to co-opt the brain's natural reward-motivational system. Although ventral tegmental area (VTA) dopamine (DA) neurons represent a crucial component of this system, the synaptic adaptations underlying natural rewards and drug-related motivation have not been fully elucidated. Here, we show that self-administration of cocaine, but not passive cocaine infusions, produced a persistent potentiation of VTA excitatory synapses, which was still present after 3 months abstinence. Further, enhanced synaptic function in VTA was evident even after 3 weeks of extinction training. Food or sucrose self-administration induced only a transient potentiation of VTA glutamatergic signaling. Our data show that synaptic function in VTA DA neurons is readily but reversibly enhanced by natural reward-seeking behavior, while voluntary cocaine self-administration induced a persistent synaptic enhancement that is resistant to behavioral extinction. Such persistent synaptic potentiation in VTA DA neurons may represent a fundamental cellular phenomenon driving pathological drug-seeking behavior.

Affective neuroscience of pleasure: reward in humans and animals

INTRODUCTION

Pleasure and reward are generated by brain circuits that are largely shared between humans and other animals.

DISCUSSION

Here, we survey some fundamental topics regarding pleasure mechanisms and explicitly compare humans and animals.

CONCLUSION

Topics surveyed include liking, wanting, and learning components of reward; brain coding versus brain causing of reward; subjective pleasure versus objective hedonic reactions; roles of orbitofrontal cortex and related cortex regions; subcortical hedonic hotspots for pleasure generation; reappraisals of dopamine and pleasure-electrode controversies; and the relation of pleasure to happiness.

Voluntary ethanol intake enhances excitatory synaptic strength in the ventral tegmental area

BACKGROUND

Addiction has been considered a disorder of motivational control over behavior, and the ventral tegmental area (VTA), in conjunction with other limbic brain structures, is thought to play a critical role in the regulation of a number of motivated behaviors including seeking of addictive drugs such as alcohol. Of particular interest is the ability of prolonged exposure of addictive drugs to enhance the function of alpha-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid (AMPA)-type glutamatergic receptors (AMPAR) in the VTA, as glutamate receptor activation can significantly regulate VTA neuron activity. Here, we examined whether voluntary ethanol intake altered VTA AMPAR function.

METHODS

We utilized in vitro electrophysiology to examine glutamatergic function in the VTA neurons 12 to 24 hours after the last self-administration bout, which occurred 35 to 50 days after the initiation of ethanol self-administration under a 2-bottle intermittent access model.

RESULTS

Voluntary intermittent ethanol intake in a 2-bottle paradigm enhanced postsynaptic AMPAR function, indicated by an increased ratio of evoked AMPAR to N-methyl-d-aspartic acid receptor currents, and by an increase in the amplitude of spontaneous miniature excitatory postsynaptic currents (mEPSCs) measured in the presence of tetrodotoxin to prevent action potential-dependent release. In contrast, ethanol self-administration did not alter evoked presynaptic glutamate release, indicated by no change in the paired-pulse ratio of 2 AMPAR EPSCs evoked 50 ms apart, although spontaneous glutamate release was significantly enhanced, indicated by enhanced mEPSC frequency.

CONCLUSIONS

Our results suggest that postsynaptic AMPAR function in VTA neurons was significantly enhanced after ethanol self-administration. As increased VTA AMPAR function can significantly regulate firing and enhance the reinforcing and activating effects of drugs of abuse, the increased AMPAR activity observed here may facilitate the drive to consume ethanol.

Dorsomedial prefrontal cortex contribution to behavioral and nucleus accumbens neuronal responses to incentive cues

Cue-elicited phasic changes in firing of nucleus accumbens (NAc) neurons can facilitate reward-seeking behavior. Here, we test the hypothesis that the medial prefrontal cortex (mPFC), which sends a dense glutamatergic projection to the NAc core, contributes to NAc neuronal firing responses to reward-predictive cues. Rats trained to perform an operant response to a cue for sucrose were implanted with recording electrodes in the core of the NAc and microinjection cannulas in the dorsal mPFC (dmPFC). The cue-evoked firing of NAc neurons was reduced by bilateral injection of GABA(A) and GABA(B) agonists into the dmPFC concomitant with loss of behavioral responding to the cue. In addition, unilateral dmPFC inactivation reduced ipsilateral cue excitations and contralateral cue inhibitions. These findings indicate that cue-evoked excitations and inhibitions of NAc core neurons depend on dmPFC projections to the NAc and that these phasic changes contribute to the behavioral response to reward-predictive cues.

Neuropeptide interactions and REM sleep: a role for Urotensin II?

Urotensin II (UII) is a peptide with structural similarity to the somatostatin family with potent vasoconstrictor activity. UII receptor is expressed broadly in the periphery, and most notably in the heart and microvessels. In the brain, the UII receptor can be detected in the spinal cord and in cholinergic nuclei in the brainstem known to be involved in REM sleep regulation. Recent data suggest that, in addition to their vasoactive properties, UII receptor ligands may have excitatory activity on a selective group of neurons that modulate REM sleep. This review focuses on the implications of these findings for the neurobiology of REM sleep regulation and discusses the possible impact of UII and other neuropeptides on the balance of the alternation between sleep states.

Organization of ventral tegmental area projections to the ventral tegmental area-nigral complex in the rat

The ventral tegmental area (VTA) is a nodal link in reward circuitry. Based on its striatal output, it has been subdivided in a caudomedial part which targets the ventromedial striatum, and a lateral part which targets the ventrolateral striatum [Ikemoto S (2007) Dopamine reward circuitry: two projection systems from the ventral midbrain to the nucleus accumbens-olfactory tubercle complex. Brain Res Rev 56:27-78]. Whether these two VTA parts are interconnected and to what extent the VTA innervates the substantia nigra compacta (SNc) and retrorubral nucleus (RR) are critical issues for understanding information processing in the basal ganglia. Here, VTA projections to the VTA-nigral complex were examined in rats, using Phaseolus vulgaris leucoagglutinin (PHA-L) as anterograde tracer. The results show that the dorsolateral VTA projects to itself, as well as to the dorsal tier of the SNc and RR, largely avoiding the caudomedial VTA. The ventrolateral VTA innervates mainly the interfascicular nucleus. The components of the caudomedial VTA (the interfascicular, paranigral and caudal linear nuclei) are connected with each other. In addition, the caudomedial VTA (especially the paranigral and caudal linear nuclei) innervates the lateral VTA, and, to a lesser degree, the SNc and RR. The caudal pole of the VTA sends robust, bilateral projections to virtually all the VTA-nigral complex, which terminate in the dorsal and ventral tiers. Modest inputs from the medial supramammillary nucleus to ventromedial parts of the VTA-nigral complex were also identified. In double-immunostained sections, PHA-L-labeled varicosities were sometimes found apposed to tyrosine hydroxylase-positive neurons in the ventral mesencephalon. Overall, the results underscore that VTA projections to the VTA-nigral complex are substantial and topically organized. In general, these projections, like the spiralated striato-nigro-striatal loops, display a medial-to-lateral organization. This anatomical arrangement conceivably permits the ventromedial striatum to influence the activity of the lateral striatum. The caudal pole of the VTA appears to be a critical site for a global recruitment of the mesotelencephalic system.

General and outcome-specific forms of Pavlovian-instrumental transfer: the effect of shifts in motivational state and inactivation of the ventral tegmental area

This study compared the contribution of the general activating and specific cueing properties of Pavlovian stimuli to Pavlovian-instrumental transfer (PIT) and the role of the ventral tegmental area (VTA) in mediating these effects. In Experiment 1, hungry rats initially received Pavlovian training, in which three distinct auditory stimuli predicted the delivery of three different food outcomes. Next, the rats were trained to perform two instrumental actions, each earning a unique outcome selected from the three used in Pavlovian conditioning. Finally, the effects of the three stimuli on performance of the two actions were assessed in extinction. Presentation of a stimulus that had been paired with the same outcome as an action increased its performance relative to the other action, demonstrating that PIT effects can be outcome selective. In contrast, presentation of the stimulus that predicted the outcome that was not earned during instrumental training facilitated the performance of both actions indiscriminately. This effect, but not the outcome-selective effect, was abolished by a shift from a hungry to a relatively sated state. Experiment 2 examined the effects of inactivation of the VTA on these two forms of PIT. VTA inactivation was found to attenuate PIT but, unlike satiety, did not appear to differentially affect the general or the outcome-selective forms of PIT. The VTA appears therefore to play an important but general role in the initiation of instrumental actions, enabling cues to influence performance whether they enhance responding by changes in arousal or by retrieving particular actions based on their consequences.

Orexin signaling in the ventral tegmental area is required for high-fat appetite induced by opioid stimulation of the nucleus accumbens

The overriding of satiety and homeostatic control mechanisms by cognitive, rewarding, and emotional aspects of palatable foods may contribute to the evolving obesity crisis, but little is known about neural pathways and mechanisms responsible for crosstalk between the "cognitive" and "metabolic" brain in the control of appetite. Here we show that neural connections between the nucleus accumbens and hypothalamus might be part of this link. Using the well known model of selective stimulation of high-fat intake induced by intra-accumbens injection of the mu-opioid receptor agonist D-Ala2-N-Me-Phe4-gly5-ol-enkephalin (DAMGO), we demonstrate that orexin signaling in the ventral tegmental area is important for this reward-driven appetite to override metabolic repletion signals in presatiated rats. We further show that accumbens DAMGO in the absence of food selectively increases the proportion of orexin neurons expressing c-Fos in parts of the perifornical hypothalamus and that neural projections originating in DAMGO-responsive sites of the nucleus accumbens make close anatomical contacts with hypothalamic orexin neurons. These findings suggest that direct accumbens-hypothalamic projections can stimulate hypothalamic orexin neurons, which in turn through orexin-1 receptor signaling in the ventral tegmental area and possibly other sites interfaces with the motivational and motor systems to increase intake of palatable food.

The neuro-behavioural syndrome of brainstem disease

We describe two patients with isolated brainstem lesions who exhibited behavioural and cognitive changes that are commonly associated with frontal lobe pathology, as leading clinical features. These cases illustrate the role of distributed neural networks in cognitive and behavioural processes. The brainstem, frontal-subcortical and limbic systems are extensively and reciprocally linked via neurotransmitter projection pathways. We argue that cognitive and behavioural features in patients with brainstem lesions reflect remote effects of brainstem structures on frontal lobe and limbic regions, as a consequence of disruption to ascending neurotransmitter pathways.