The ventral pallidum and hedonic reward: neurochemical maps of sucrose "liking" and food intake

The acute effects of nicotine on corticostriatal responses to distinct phases of reward processing

Nicotine enhances the reinforcement of non-drug rewards by increasing nucleus accumbens (NAcc) reactivity to anticipatory cues. This anticipatory effect is selective as no clear evidence has emerged showing that nicotine acutely changes reward receipt reactivity. However, repeated rewarding experiences shift peak brain reactivity from hedonic reward outcome to the motivational anticipatory cue yielding more habitual cue-induced behavior. Given nicotine's influence on NAcc reactivity and connectivity, it is plausible that nicotine acutely induces this shift and alters NAcc functional connectivity during reward processing. To evaluate this currently untested hypothesis, a randomized crossover design was used in which healthy non-smokers were administered placebo and nicotine (2-mg lozenge). Brain activation to monetary reward anticipation and outcome was evaluated with functional magnetic resonance imaging. Relative to placebo, nicotine induced more NAcc reactivity to reward anticipation. Greater NAcc activation during anticipation was significantly associated with lower NAcc activation to outcome. During outcome, nicotine reduced NAcc functional connectivity with cortical regions including the anterior cingulate cortex, orbitofrontal cortex, and insula. These regions showed the same negative relationship between reward anticipation and outcome as noted in the NAcc. The current findings significantly improve our understanding of how nicotine changes corticostriatal circuit function and communication during distinct phases of reward processing and critically show that these alterations happen acutely following a single dose. The implications of this work explain nicotinic modulation of general reward function, which offer insights into the initial drive to smoke and the subsequent difficulty in cessation.

Cocaine abuse and midbrain circuits: Functional anatomy of hypocretin/orexin transmission and therapeutic prospect

Cocaine abuse remains a pervasive public health problem, and treatments thus far have proven ineffective for long-term abstinence maintenance. Intensive research on the neurobiology underlying drug abuse has led to the consideration of many candidate transmitter systems to target for intervention. Among these, the hypocretin/orexin (hcrt/ox) neuropeptide system holds largely untapped yet clinically viable therapeutic potential. Hcrt/ox originates from the hypothalamus and projects widely across the mammalian central nervous system to produce neuroexcitatory actions via two excitatory G-protein coupled receptor subtypes. Functionally, hcrt/ox promotes arousal/wakefulness and facilitates energy homeostasis. In the early 2000s, hcrt/ox transmission was shown to underlie mating behavior in male rats suggesting a novel role in reward-seeking. Soon thereafter, hcrt/ox neurons were shown to respond to drug-associated stimuli, and hcrt/ox transmission was found to facilitate motivated responding for intravenous cocaine. Notably, blocking hcrt/ox transmission using systemic or site-directed pharmacological antagonists markedly reduced motivated drug-taking as well as drug-seeking in tests of relapse. This review will unfold the current state of knowledge implicating hcrt/ox receptor transmission in the context of cocaine abuse and provide detailed background on animal models and underlying midbrain circuits. Specifically, attention will be paid to the mesoaccumbens, tegmental, habenular, pallidal and preoptic circuits. The review will conclude with discussion of recent preclinical studies assessing utility of suvorexant - the first and only FDA-approved hcrt/ox receptor antagonist - against cocaine-associated behaviors.

Cocaine Dysregulates Dynorphin Modulation of Inhibitory Neurotransmission in the Ventral Pallidum in a Cell-Type-Specific Manner

Cocaine-driven changes in the modulation of neurotransmission by neuromodulators are poorly understood. The ventral pallidum (VP) is a key structure in the reward system, in which GABA neurotransmission is regulated by opioid neuropeptides, including dynorphin. However, it is not known whether dynorphin acts differently on different cell types in the VP and whether its effects are altered by withdrawal from cocaine. Here, we trained wild-type, D1-Cre, A2A-Cre, or vGluT2-Cre:Ai9 male and female mice in a cocaine conditioned place preference protocol followed by 2 weeks of abstinence, and then recorded GABAergic synaptic input evoked either electrically or optogenetically onto identified VP neurons before and after applying dynorphin. We found that after cocaine CPP and abstinence dynorphin attenuated inhibitory input to VPGABA neurons through a postsynaptic mechanism. This effect was absent in saline mice. Furthermore, this effect was seen specifically on the inputs from nucleus accumbens medium spiny neurons expressing either the D1 or the D2 dopamine receptor. Unlike its effect on VPGABA neurons, dynorphin surprisingly potentiated the inhibitory input on VPvGluT2 neurons, but this effect was abolished after cocaine CPP and abstinence. Thus, dynorphin has contrasting influences on GABA input to VPGABA and VPvGluT2 neurons and these influences are affected differentially by cocaine CPP and abstinence. Collectively, our data suggest a role for dynorphin in withdrawal through its actions in the VP. As VPGABA and VPvGluT2 neurons have contrasting effects on drug-seeking behavior, our data may indicate a complex role for dynorphin in withdrawal from cocaine.SIGNIFICANCE STATEMENT The ventral pallidum consists mainly of GABAergic reward-promoting neurons, but it also encloses a subgroup of aversion-promoting glutamatergic neurons. Dynorphin, an opioid neuropeptide abundant in the ventral pallidum, shows differential modulation of GABA input to GABAergic and glutamatergic pallidal neurons and may therefore affect both the rewarding and aversive aspects of withdrawal. Indeed, abstinence after repeated exposure to cocaine alters dynorphin actions in a cell-type-specific manner; after abstinence dynorphin suppresses the inhibitory drive on the "rewarding" GABAergic neurons but ceases to modulate the inhibitory drive on the "aversive" glutamatergic neurons. This reflects a complex role for dynorphin in cocaine reward and abstinence.

Differential rearing alters taste reactivity to ethanol, sucrose, and quinine

RATIONALE

Early-life environment influences reinforcer and drug motivation in adulthood; however, the impact on specific components of motivation, including hedonic value ("liking"), remains unknown.

OBJECTIVES

The current study determined whether differential rearing alters liking and aversive responding to ethanol, sucrose, and quinine in an ethanol-naïve rat model.

METHODS

Male and female rats were reared for 30 days starting at postnatal day 21 in either an enriched (EC), isolated (IC), or standard condition (SC). Thereafter, all rats had indwelling intraoral fistulae implanted and their taste reactivity to water, ethanol (5, 10, 20, 30, 40% v/v), sucrose (0.1, 0.25, 0.5 M), and quinine (0.1, 0.5 mM) was recorded and analyzed.

RESULTS

EC rats had higher amounts of liking responses to ethanol, sucrose, and quinine and higher amounts of aversive responses to ethanol and quinine compared to IC rats. While EC and IC rats' responses were different from each other, they both tended to be similar to SCs, who fell in between the EC and IC groups.

CONCLUSIONS

These results suggest that environmental enrichment may enhance sensitivity to a variety of tastants, thereby enhancing liking, while isolation may dull sensitivity, thereby dulling liking. Altogether, the evidence suggests that isolated rats have a shift in the allostatic set-point which may, in part, drive increased responding for a variety of rewards including ethanol and sucrose. Enriched rats have enhanced liking of both sucrose and ethanol suggesting that enrichment may offer a unique phenotype with divergent preferences for incentive motivation.

Novel rewards occlude the reward positivity, and what to do about it

Both the Reward Positivity (RewP) and the novelty N2 component appear within the same spatio-temporal window. This signal overlap impedes the assessment of the RewP evoked by complex novel rewards like affective or motivational imagery. Here we conducted a series of experiments which successfully isolated signals of reward and novelty through spectral decomposition as well as with experimental manipulations that systematically removed the influence of novelty on the reward-evoking image. Together, these findings help explain the nature of this component overlap and provide methodological and analytic techniques for isolating reward- and novelty-specific computations to complex stimuli.

Complementary Roles for Ventral Pallidum Cell Types and Their Projections in Relapse

The ventral pallidum (VP) is a key node in the neural circuits controlling relapse to drug seeking. How this role relates to different VP cell types and their projections is poorly understood. Using male rats, we show how different forms of relapse to alcohol-seeking are assembled from VP cell types and their projections to lateral hypothalamus (LH) and ventral tegmental area (VTA). Using RNAScope in situ hybridization to characterize activity of different VP cell types during relapse to alcohol-seeking provoked by renewal (context-induced reinstatement), we found that VP Gad1 and parvalbumin (PV), but not vGlut2, neurons show relapse-associated changes in c-Fos expression. Next, we used retrograde tracing, chemogenetic, and electrophysiological approaches to study the roles of VPGad1 and VPPV neurons in relapse. We show that VPGad1 neurons contribute to contextual control over relapse (renewal), but not to relapse during reacquisition, via projections to LH, where they converge with ventral striatal inputs onto LHGad1 neurons. This convergence of striatopallidal inputs at the level of individual LHGad1 neurons may be critical to balancing propensity for relapse versus abstinence. In contrast, VPPV neurons contribute to relapse during both renewal and reacquisition via projections to VTA. These findings identify a double dissociation in the roles for different VP cell types and their projections in relapse. VPGad1 neurons control relapse during renewal via projections to LH. VPPV neurons control relapse during both renewal and reacquisition via projections to VTA. Targeting these different pathways may provide tailored interventions for different forms of relapse.SIGNIFICANCE STATEMENT Relapse to drug or reward seeking after a period of extinction or abstinence remains a key impediment to successful treatment. The ventral pallidum, located in the ventral basal ganglia, has long been recognized as an obligatory node in a 'final common pathway' for relapse. Yet how this role relates to the considerable VP cellular and circuit heterogeneity is not well understood. We studied the cellular and circuit architecture for VP in relapse control. We show that different forms of relapse have complementary VP cellular and circuit architectures, raising the possibility that targeting these different neural architectures may provide tailored interventions for different forms of relapse.

Opposing Contributions of GABAergic and Glutamatergic Ventral Pallidal Neurons to Motivational Behaviors

The ventral pallidum (VP) is critical for invigorating reward seeking and is also involved in punishment avoidance, but how it contributes to such opposing behavioral actions remains unclear. Here, we show that GABAergic and glutamatergic VP neurons selectively control behavior in opposing motivational contexts. In vivo recording combined with optogenetics in mice revealed that these two populations oppositely encode positive and negative motivational value, are differentially modulated by animal's internal state, and determine the behavioral response during motivational conflict. Furthermore, GABAergic VP neurons are essential for movements toward reward in a positive motivational context but suppress movements in an aversive context. In contrast, glutamatergic VP neurons are essential for movements to avoid a threat but suppress movements in an appetitive context. Our results indicate that GABAergic and glutamatergic VP neurons encode the drive for approach and avoidance, respectively, with the balance between their activities determining the type of motivational behavior.

Projection-Specific Potentiation of Ventral Pallidal Glutamatergic Outputs after Abstinence from Cocaine

The ventral pallidum (VP) is a central node in the reward system that is strongly implicated in reward and addiction. Although the majority of VP neurons are GABAergic and encode reward, recent studies revealed a novel glutamatergic neuronal population in the VP [VP neurons expressing the vesicular glutamate transporter 2 (VP_VGluT2)], whose activation generates aversion. Withdrawal from drugs has been shown to induce drastic synaptic changes in neuronal populations associated with reward, such as the ventral tegmental area (VTA) or nucleus accumbens neurons, but less is known about cocaine-induced synaptic changes in neurons classically linked with aversion. Here, we demonstrate that VP_VGluT2 neurons contact different targets with different intensities, and that cocaine conditioned place preference (CPP) training followed by abstinence selectively potentiates their synapses on targets that encode aversion. Using whole-cell patch-clamp recordings combined with optogenetics in male and female transgenic mice, we show that VP_VGluT2 neurons preferentially contact aversion-related neurons, such as lateral habenula neurons and VTA GABAergic neurons, with minor input to reward-related neurons, such as VTA dopamine and VP GABA neurons. Moreover, after cocaine CPP and abstinence, the VP_VGluT2 input to the aversion-related structures is potentiated, whereas the input to the reward-related structures is depressed. Thus, cocaine CPP followed by abstinence may allow VP_VGluT2 neurons to recruit aversion-related targets more readily and therefore be part of the mechanism underlying the aversive symptoms seen after withdrawal.SIGNIFICANCE STATEMENT The biggest problem in drug addiction is the high propensity to relapse. One central driver for relapse events is the negative aversive symptoms experienced by addicts during withdrawal. In this work, we propose a possible mechanism for the intensification of aversive feelings after withdrawal that involves the glutamatergic neurons of the ventral pallidum. We show not only that these neurons are most strongly connected to aversive targets, such as the lateral habenula, but also that, after abstinence, their synapses on aversive targets are strengthened, whereas the synapses on other rewarding targets are weakened. These data illustrate how after abstinence from cocaine, aversive pathways change in a manner that may contribute to relapse.

Ventral pallidum is essential for cocaine relapse after voluntary abstinence in rats

Addiction is a chronic relapsing disorder, and during recovery many people experience several relapse events as they attempt to voluntarily abstain from drug. New preclinical relapse models have emerged that capture this common human experience, and mounting evidence indicates that resumption of drug seeking after voluntary abstinence recruits neural circuits distinct from those recruited during reinstatement after experimenter-imposed abstinence, or abstinence due to extinction training. Ventral pallidum (VP), a key limbic node involved in drug seeking, has well-established roles in conventional reinstatement models tested following extinction training, but it is unclear whether this region also participates in more translationally relevant models of relapse. Here we show that chemogenetic inhibition of VP neurons decreased cocaine-, context-, and cue-induced relapse tested after voluntary, punishment-induced abstinence. This effect was strongest in the most compulsive, punishment-resistant rats, and reinstatement was associated with neural activity in anatomically defined VP subregions. VP inhibition also attenuated the propensity of rats to display "abortive lever pressing," a species-typical risk assessment behavior seen here during punished drug taking, likely resulting from concurrent approach and avoidance motivations. These results indicate that VP, unlike other connected limbic brain regions, is essential for resumption of drug seeking after voluntary abstinence. Since VP inhibition effects were strongest in the most compulsively cocaine-seeking individuals, this may also indicate that VP plays a particularly important role in the most pathological, addiction-like behavior, making it an attractive target for future therapeutic interventions.

Genetic Access to Gustatory Disgust-Associated Neurons in the Interstitial Nucleus of the Posterior Limb of the Anterior Commissure in Male Mice

Orofacial and somatic disgust reactions are observed in rats following intraoral infusion of not only bitter quinine (innate disgust) but also sweet saccharin previously paired with illness (learned disgust). It remains unclear, however, whether these innate and learned disgust reactions share a common neural basis and which brain regions, if any, host it. In addition, there is no established method to genetically access neurons whose firing is associated with disgust (disgust-associated neurons). Here, we examined the expression of cFos and Arc, two markers of neuronal activity, in the interstitial nucleus of the posterior limb of the anterior commissure (IPAC) of male mice that showed innate disgust and mice that showed learned disgust. Furthermore, we used a targeted recombination in active populations (TRAP) method to genetically label the disgust-associated neurons in the IPAC with YFP. We found a significant increase of both cFos-positive neurons and Arc-positive neurons in the IPAC of mice that showed innate disgust and mice that showed learned disgust. In addition, TRAP following quinine infusion (Quinine-TRAP) resulted in significantly more YFP-positive neurons in the IPAC, compared to TRAP following water infusion. A significant number of the YFP-positive neurons following Quinine-TRAP were co-labeled with Arc following the second quinine infusion, confirming that Quinine-TRAP preferentially labeled quinine-activated neurons in the IPAC. Our results suggest that the IPAC activity is associated with both innate and learned disgust and that disgust-associated neurons in the IPAC are genetically accessible by TRAP.

Dissociable effects of dopamine D1 and D2 receptors on compulsive ingestion and pivoting movements elicited by disinhibiting the ventral pallidum

Previous studies have shown that infusion of a GABAA receptor antagonist, such as bicuculline (bic), into the ventral (pallidum VP) of rats elicits vigorous ingestion in sated subjects and abnormal pivoting movements. Here, we assessed if the ingestive effects generalize to the lateral preoptic area (LPO) and tested both effects for modulation by dopamine receptor signaling. Groups of rats received injections of the dopamine D2 receptor antagonist, haloperidol (hal), the D1 antagonist, SCH-23390 (SCH), or vehicle (veh) followed by infusions of bic or veh into the VP or LPO. Ingestion effects were not observed following LPO bic infusions. Compulsive ingestion associated with VP activation was attenuated by hal, but not SCH. VP bic-elicited pivoting was attenuated by neither hal, nor SCH.

Shared genetic influences on adolescent body mass index and brain structure: A voxel-based morphometry study in twins

BACKGROUND

Previous research has demonstrated significant relationships between obesity and brain structure. Both phenotypes are heritable, but it is not known whether they are influenced by common genetic factors. We investigated the genetic etiology of the relationship between individual variability in brain morphology and BMIz using structural MRI in adolescent twins.

METHOD

The sample (n = 258) consisted of 54 monozygotic and 75 dizygotic twin pairs (mean(SD) age = 13.61(0.505), BMIz = 0.608(1.013). Brain structure (volume and density of gray and white matter) was assessed using VBM. Significant voxelwise heritability of brain structure was established using the Accelerated Permutation inference for ACE models (APACE) program, with structural heritability varying from 15 to 97%, depending on region. Bivariate heritability analyses were carried out comparing additive genetic and unique environment models with and without shared genetics on BMIz and the voxels showing significant heritability in the APACE analyses.

RESULTS

BMIz was positively related to gray matter volume in the brainstem and thalamus and negatively related to gray matter volume in the bilateral uncus and medial orbitofrontal cortex, gray matter density in the cerebellum, prefrontal lobe, temporal lobe, and limbic system, and white matter density in the brainstem. Bivariate heritability analyses showed that BMIz and brain structure share ∼1/3 of their genes and that ∼95% of the phenotypic correlation between BMIz and brain structure is due to shared additive genetic influences. These regions included areas related to decision-making, motivation, liking vs. wanting, taste, interoception, reward processing/learning, caloric evaluation, and inhibition.

CONCLUSION

These results suggested genetic factors are responsible for the relationship between BMIz and heritable BMIz related brain structure in areas related to eating behavior.

Endogenous opioid modulation of food intake and body weight: Implications for opioid influences upon motivation and addiction

This review is part of a special issue dedicated to Opioid addiction, and examines the influential role of opioid peptides, opioid receptors and opiate drugs in mediating food intake and body weight control in rodents. This review postulates that opioid mediation of food intake was an example of "positive addictive" properties that provide motivational drives to maintain opioid-seeking behavior and that are not subject to the "negative addictive" properties associated with tolerance, dependence and withdrawal. Data demonstrate that opiate and opioid peptide agonists stimulate food intake through homeostatic activation of sensory, metabolic and energy-related In contrast, general, and particularly mu-selective, opioid receptor antagonists typically block these homeostatically-driven ingestive behaviors. Intake of palatable and hedonic food stimuli is inhibited by general, and particularly mu-selective, opioid receptor antagonists. The selectivity of specific opioid agonists to elicit food intake was confirmed through the use of opioid receptor antagonists and molecular knockdown (antisense) techniques incapacitating specific exons of opioid receptor genes. Further extensive evidence demonstrated that homeostatic and hedonic ingestive situations correspondingly altered the levels and expression of opioid peptides and opioid receptors. Opioid mediation of food intake was controlled by a distributed brain network intimately related to both the appetitive-consummatory sites implicated in food intake as well as sites intimately involved in reward and reinforcement. This emergent system appears to sustain the "positive addictive" properties providing motivational drives to maintain opioid-seeking behavior.

The ventral pallidum as a critical region for fatty acid amide hydrolase inhibition of nausea-induced conditioned gaping in male Sprague-Dawley rats

Here we investigate the involvement of the ventral pallidum (VP) in the anti-nausea effect of fatty acid amide hydrolase (FAAH) inhibition with PF-3845, and examine the pharmacological mechanism of such an effect. We explored the potential of intra-VP PF-3845 to reduce the establishment of lithium chloride (LiCl)-induced conditioned gaping (a model of acute nausea) in male Sprague-Dawley rats. As well, the role of the cannabinoid 1 (CB₁) receptors and the peroxisome proliferator-activated receptors-α (PPARα) in the anti-nausea effect of PF-3845 was examined. Finally, the potential of intra-VP GW7647, a PPARα agonist, to reduce acute nausea was also evaluated. Intra-VP PF-3845 dose-dependently reduced acute nausea by a PPARα mechanism (and not a CB₁ receptor mechanism). Intra-VP administration of GW7647, similarly attenuated acute nausea. These findings suggest that the anti-nausea action of FAAH inhibition may occur in the VP, and may involve activation of PPARα to suppress acute nausea.

Shared Behavioral and Neurocircuitry Disruptions in Drug Addiction, Obesity, and Binge Eating Disorder: Focus on Group I mGluRs in the Mesolimbic Dopamine Pathway

Accumulated data from clinical and preclinical studies suggest that, in drug addiction and states of overeating, such as obesity and binge eating disorder (BED), there is an imbalance in circuits that are critical for motivation, reward saliency, executive function, and self-control. Central to these pathologies and the extensive topic of this Review are the aberrations in dopamine (DA) and glutamate (Glu) within the mesolimbic pathway. Group I metabotropic glutamate receptors (mGlus) are highly expressed in the mesolimbic pathway and are poised in key positions to modulate disruptions in synaptic plasticity and neurotransmitter release observed in drug addiction, obesity, and BED. The use of allosteric modulators of group I mGlus has been studied in drug addiction, as they offer several advantages over traditional orthosteric agents. However, they have yet to be studied in obesity or BED. With the substantial overlap between the neurocircuitry involved in drug addiction and eating disorders, group I mGlus may also provide novel targets for obesity and BED.

Characterization of a Multiple-Scan-Rate Voltammetric Waveform for Real-Time Detection of Met-Enkephalin

Opioid peptides are critically involved in a variety of physiological functions necessary for adaptation and survival, and as such, understanding the precise actions of endogenous opioid peptides will aid in identification of potential therapeutic strategies to treat a variety of disorders. However, few analytical tools are currently available that offer both the sensitivity and spatial resolution required to monitor peptidergic concentration fluctuations in situ on a time scale commensurate with that of neuronal communication. Our group has developed a multiple-scan-rate waveform to enable real-time voltammetric detection of tyrosine containing neuropeptides. Herein, we have evaluated the waveform parameters to increase sensitivity to methionine-enkephalin (M-ENK), an endogenous opioid neuropeptide implicated in pain, stress, and reward circuits. M-ENK dynamics were monitored in adrenal gland tissue, as well as in the dorsal striatum of anesthetized and freely behaving animals. The data reveal cofluctuations of catecholamine and M-ENK in both locations and provide measurements of M-ENK dynamics in the brain with subsecond temporal resolution. Importantly, this work also demonstrates how voltammetric waveforms can be customized to enhance detection of specific target analytes, broadly speaking.

Physiology of energy homeostasis: Models, actors, challenges and the glucoadipostatic loop

The aim of this review is to discuss the physiology of energy homeostasis (EH), which is a debated concept. Thus, we will see that the set-point theory is highly challenged and that other models integrating an anticipative component, such as energy allostasis, seem more relevant to experimental reports and life preservation. Moreover, the current obesity epidemic suggests that EH is poorly efficient in the modern human dietary environment. Non-homeostatic phenomena linked to hedonism and reward seem to profoundly impair EH. In this review, the apparent failed homeostatic responses to energy challenges such as exercise, cafeteria diet, overfeeding and diet-induced weight loss, as well as their putative determinants, are analyzed to highlight the mechanisms of EH. Then, the hormonal, neuronal, and metabolic factors of energy intake or energy expenditure are briefly presented. Last, this review focuses on the contributions of two of the most pivotal and often overlooked determinants of EH: the availability of endogenous energy and the pattern of energy intake. A glucoadipostatic loop model is finally proposed to link energy stored in adipose tissue to EH through changes in eating behavior via leptin and sympathetic nervous system activity.

Modeling cocaine relapse in rodents: Behavioral considerations and circuit mechanisms

Addiction is a chronic relapsing disorder, in that most addicted individuals who choose to quit taking drugs fail to maintain abstinence in the long-term. Relapse is especially likely when recovering addicts encounter risk factors like small "priming" doses of drug, stress, or drug-associated cues and locations. In rodents, these same factors reinstate cocaine seeking after a period of abstinence, and extensive preclinical work has used priming, stress, or cue reinstatement models to uncover brain circuits underlying cocaine reinstatement. Here, we review common rat models of cocaine relapse, and discuss how specific features of each model influence the neural circuits recruited during reinstated drug seeking. To illustrate this point, we highlight the surprisingly specific roles played by ventral pallidum subcircuits in cocaine seeking reinstated by either cocaine-associated cues, or cocaine itself. One goal of such studies is to identify, and eventually to reverse the specific circuit activity that underlies the inability of some humans to control their drug use. Based on preclinical findings, we posit that circuit activity in humans also differs based on the triggers that precipitate craving and relapse, and that associated neural responses could help predict the triggers most likely to elicit relapse in a given person. If so, examining circuit activity could facilitate diagnosis of subgroups of addicted people, allowing individualized treatment based on the most problematic risk factors.

Ventral pallidum encodes relative reward value earlier and more robustly than nucleus accumbens

The ventral striatopallidal system, a basal ganglia network thought to convert limbic information into behavioral action, includes the nucleus accumbens (NAc) and the ventral pallidum (VP), typically described as a major output of NAc. Here, to investigate how reward-related information is transformed across this circuit, we measure the activity of neurons in NAc and VP when rats receive two highly palatable but differentially preferred rewards, allowing us to track the reward-specific information contained within the neural activity of each region. In VP, we find a prominent preference-related signal that flexibly reports the relative value of reward outcomes across multiple conditions. This reward-specific firing in VP is present in a greater proportion of the population and arises sooner following reward delivery than in NAc. Our findings establish VP as a preeminent value signaler and challenge the existing model of information flow in the ventral basal ganglia.

Ventral pallidal modulation of aversion processing

Responding to aversive and rewarding stimuli is essential to survival. The ventral pallidum (VP) is a critical node in the mesolimbic network, being the primary output of the nucleus accumbens and projecting to the lateral habenula (LHb) and ventral tegmental area (VTA). The VP is thus poised to modulate the habenula-tegmental circuitry and contribute to processing both rewarding and aversive stimuli. Here, we integrate human functional imaging, behavioral pharmacology in rodents, and recent optogenetic circuit dissection studies of the VP with a focus on the role of the neurochemically-distinct subpopulations in aversion processing. These recent results support a model in which glutamatergic VP neurons play a unique role in aversion processing, while canonical GABAergic VP neurons promote reinforcement and encode the hedonic value of reward. Genetic ablation of glutamatergic, but not GABAergic VP neurons abolishes devaluation of natural reward (sucrose) by pairing with an aversive stimulus (lithium chloride injection). Both of these populations modulate activity throughout the LHb and VTA, which is necessary for expression of adaptive behavior in response to rewarding or aversive stimuli. Future work will address how neuromodulators such as endogenous opioids or dopamine shape function and plasticity within these distinct populations of VP neurons, when these subpopulations are engaged during learning responses to rewarding and aversive stimuli, and how their activity is altered in models of reward-related disorders. Answering these questions will be necessary to understand the basis and ultimately develop targeted therapies for disorders of reward/aversion processing, such as affective, chronic pain and substance use disorders.

The Experience of Pleasure: A Perspective Between Neuroscience and Psychoanalysis

Pleasure is more than a mere sensory event, but rather it can be conceptualized as a complex, multiform experience involving memory, motivation, homeostasis, and, sometimes, negative affects. According to Freud, affect is a perceptual modality that registers the internal drive state of the subject rather than the objective experience of the external world, and the quality of this perceptual modality is calibrated in degrees of pleasure and displeasure. Within this conceptual framework, the aim of drive is always pleasure, and objects become significant in so far as they provide a way of discharging drives pressure. Subsequent conceptual psychoanalytic developments have partially rejected such metapsychological theorizations, postulating that other intrinsic motivations that are independent from libido can be observed in humans. Intrinsic motivation broadly refers to a set of psychological concepts including the inherent propensity to pursue one's choices, to seek out novelty and challenges, to satisfy curiosity and competence, and to extend one's capacities and control over events. What these concepts have in common is an inner endorsement of one's action, which is the sense that action is self-generated and is one's own. The notions of pleasure, drives, and affects are all of utmost importance for a neuropsychoanalytic understanding of mental functioning, due to their capability to explain desire, thought, and behavior from the perspective of human subjective experience. The purpose of this paper is thus to discuss psychoanalytic conceptual developments that have addressed pleasure, drives, and affects, in the light of recent findings coming from neurosciences. In particular, we will explore for insights from Panksepp's theory of primary-process emotional feelings, including the notion of "wanting" and "liking" as dissociable components of reward. In the last part of the paper, we will indicate possible theoretical implications for a neuropsychoanalytic understanding of libido-independent intrinsic motivations and their relationship with the self, including neuroscientific observations on self-related processes, agency, body-ownerships, and attachment.

Histamine Excites Rat GABAergic Ventral Pallidum Neurons via Co-activation of H1 and H2 Receptors

The ventral pallidum (VP) is a crucial component of the limbic loop of the basal ganglia and participates in the regulation of reward, motivation, and emotion. Although the VP receives afferent inputs from the central histaminergic system, little is known about the effect of histamine on the VP and the underlying receptor mechanism. Here, we showed that histamine, a hypothalamic-derived neuromodulator, directly depolarized and excited the GABAergic VP neurons which comprise a major cell type in the VP and are responsible for encoding cues of incentive salience and reward hedonics. Both postsynaptic histamine H1 and H2 receptors were found to be expressed in the GABAergic VP neurons and co-mediate the excitatory effect of histamine. These results suggested that the central histaminergic system may actively participate in VP-mediated motivational and emotional behaviors via direct modulation of the GABAergic VP neurons. Our findings also have implications for the role of histamine and the central histaminergic system in psychiatric disorders.

Current perspectives on incentive salience and applications to clinical disorders

Affective neuroscience research has revealed that reward contains separable components of 'liking', 'wanting', and learning. Here we focus on current 'liking' and 'wanting' findings and applications to clinical disorders. 'Liking' is the hedonic impact derived from a pleasant experience, and is amplified by opioid and related signals in discrete sites located in limbic-related brain areas. 'Wanting' refers to incentive salience, a motivation process for reward, and is mediated by larger systems involving mesocorticolimbic dopamine. Deficits in incentive salience may contribute to avolitional features of depression and related disorders, whereas deficits in hedonic impact may produce true anhedonia. Excesses in incentive salience, on the other hand, can lead to addiction, especially when narrowly focused on a particular target. Finally, a fearful form of motivational salience may even contribute to some paranoia symptoms of schizophrenia and related disorders.

Dynamic Encoding of Incentive Salience in the Ventral Pallidum: Dependence on the Form of the Reward Cue

Some rats are especially prone to attribute incentive salience to a cue (conditioned stimulus, CS) paired with food reward (sign-trackers, STs), but the extent they do so varies as a function of the form of the CS. Other rats respond primarily to the predictive value of a cue (goal-trackers, GTs), regardless of its form. Sign-tracking is associated with greater cue-induced activation of mesolimbic structures than goal-tracking; however, it is unclear how the form of the CS itself influences activity in neural systems involved in incentive salience attribution. Thus, our goal was to determine how different cue modalities affect neural activity in the ventral pallidum (VP), which is known to encode incentive salience attribution, as rats performed a two-CS Pavlovian conditioned approach task in which both a lever-CS and a tone-CS predicted identical food reward. The lever-CS elicited sign-tracking in some rats (STs) and goal-tracking in others (GTs), whereas the tone-CS elicited only goal-tracking in all rats. The lever-CS elicited robust changes in neural activity (sustained tonic increases or decreases in firing) throughout the VP in STs, relative to GTs. These changes were not seen when STs were exposed to the tone-CS, and in GTs there were no differences in firing between the lever-CS and tone-CS. We conclude that neural activity throughout the VP encodes incentive signals and is especially responsive when a cue is of a form that promotes the attribution of incentive salience to it, especially in predisposed individuals.

Somatostatin Neurons in the Basal Forebrain Promote High-Calorie Food Intake

Obesity has become a global issue, and the overconsumption of food is thought to be a major contributor. However, the regulatory neural circuits that regulate palatable food consumption remain unclear. Here, we report that somatostatin (SOM) neurons and GABAergic (VGAT) neurons in the basal forebrain (BF) play specific roles in regulating feeding. Optogenetic stimulation of BF SOM neurons increased fat and sucrose intake within minutes and promoted anxiety-like behaviors. Furthermore, optogenetic stimulation of projections from BF SOM neurons to the lateral hypothalamic area (LHA) selectively resulted in fat intake. In addition, activation of BF VGAT neurons rapidly induced general food intake and gnawing behaviors. Whole-brain mapping of inputs and outputs showed that BF SOM neurons form bidirectional connections with several brain areas important in feeding and regulation of emotion. Collectively, these results suggest that BF SOM neurons play a selective role in hedonic feeding.

Ventral pallidal encoding of reward-seeking behavior depends on the underlying associative structure

Despite its being historically conceptualized as a motor expression site, emerging evidence suggests the ventral pallidum (VP) plays a more active role in integrating information to generate motivation. Here, we investigated whether rat VP cue responses would encode and contribute similarly to the vigor of reward-seeking behaviors trained under Pavlovian versus instrumental contingencies, when these behavioral responses consist of superficially similar locomotor response patterns but may reflect distinct underlying decision-making processes. We find that cue-elicited activity in many VP neurons predicts the latency of instrumental reward seeking, but not of Pavlovian response latency. Further, disruption of VP signaling increases the latency of instrumental but not Pavlovian reward seeking. This suggests that VP encoding of and contributions to response vigor are specific to the ability of incentive cues to invigorate reward-seeking behaviors upon which reward delivery is contingent.

Sounds or other cues associated with receiving a reward can have a powerful effect on an individual’s behavior or emotions. For example, the sound of an ice cream truck might cause salivation and motivate an individual to stand in a long line. Cues may prompt specific actions necessary to receive a reward, for example, approaching the ice cream truck and paying to get an ice cream. This is called instrumental conditioning. Some cues predict reward delivery, without requiring a specific action. This is called Pavlovian conditioning. Pavlovian cues can still prompt actions, such as approaching the truck, even though the action is not required. But exactly what happens in the brain to generate these actions during the two types of learning, is unclear.

Learning more about these reward-driven brain mechanisms might help scientists to develop better treatments for people with addiction or other conditions that involve compulsive reward-seeking behavior. Currently, scientists do not know enough about how the brain triggers this kind of behavior or how these processes lead to relapse in individuals who have been abstinent. Basic studies on the brain mechanisms that trigger reward-seeking behavior are needed.

Now, Richard et al. show that a greater activity in neurons, or brain cells, in a part of the brain called the ventral pallidum predicts a faster response to a reward cue. In the experiments, some rats were trained to approach a certain location when they heard a particular sound in order to receive sugar water, a form of instrumental conditioning. Another group of rats underwent Pavlovian training and learned to expect sugar water every time they heard sound even if they did nothing. Both groups learned to approach the sugar water location when they heard the cue, despite the different training requirements.

Richard et al. measured the activity of neurons in the ventral pallidum when the rats in the two groups heard the reward-associated sound. The experiments showed that the amount of activity in the brain cells in this area predicted whether a rat would approach the sugar-water delivery area and how quickly they would approach the reward after hearing the cue. The predictions were most reliable for rats that had to do something to get the sugar water. When Richard et al. reduced the activity in these cells they found the rats took longer to approach the reward source, but only when this action was required to receive sugar water. The experiments show that the ventral pallidum may provide the motivation to undertake reward-seeking behavior.

Paradoxical accentuation of motivation following accumbens-pallidum disconnection

The nucleus accumbens (NAc) and ventral pallidum (VP) are reciprocally connected, and activity within this circuit is thought to promote reward learning. Inconsistent with this notion, we find that disconnecting NAc medial shell and VP greatly enhances the attribution of value to a cue that is paired with reward. This result suggests that medial NAc shell and VP are both needed for attributing value to cues yet can also oppose one-another's functional contribution.

Opponent control of behavioral reinforcement by inhibitory and excitatory projections from the ventral pallidum

The ventral pallidum (VP) lies at the interface between sensory, motor, and cognitive processing-with a particular role in mounting behavioral responses to rewards. Though the VP is predominantly GABAergic, glutamate neurons were recently identified, though their relative abundances and respective roles are unknown. Here, we show that VP glutamate neurons are concentrated in the rostral ventromedial VP and project to qualitatively similar targets as do VP GABA neurons. At the functional level, we used optogenetics to show that activity in VP GABA neurons can drive positive reinforcement, particularly through projections to the ventral tegmental area (VTA). On the other hand, activation of VP glutamate neurons leads to behavioral avoidance, particularly through projections to the lateral habenula. These findings highlight cell-type and projection-target specific roles for VP neurons in behavioral reinforcement, dysregulation of which could contribute to the emergence of negative symptoms associated with drug addiction and other neuropsychiatric disease.

Evidence of structure and persistence in motivational attraction to serial Pavlovian cues

Sign-tracking is a form of autoshaping where animals develop conditioned responding directed toward stimuli predictive of an outcome even though the outcome is not contingent on the animal's behavior. Sign-tracking behaviors are thought to arise out of the attribution of incentive salience (i.e., motivational value) to reward-predictive cues. It is not known how incentive salience would be attributed to serially occurring cues, despite cues often occurring in a sequence in the real world as reward approaches. The experiments presented here demonstrate that reward-proximal cue responding is not altered by the presence of a distal reward cue (Experiment 1), and similarly that reward-distal cue responding which animals favor, is not altered by the presence of a reward-proximal cue (Experiment 2). Extinction of reward-proximal cues after training of the serial sequence leads to a generalized reduction in lever responding (Experiment 3). Together, we show that both Pavlovian serial lever cues acquire motivational value. These experiments also provide support to the notion that sign-tracking responses are insensitive to changes in outcome value, and that responding to serial cues creates a distinct context for outcome value.

D1, but not D2, receptor blockade within the infralimbic and medial orbitofrontal cortex impairs cocaine seeking in a region-specific manner

Evidence suggests that the infralimbic cortex (IL), a subregion of the ventromedial prefrontal cortex (vmPFC), suppresses cocaine-seeking behavior in a self-administration paradigm, whereas the more anterior vmPFC subregion, the medial orbitofrontal cortex (mOFC), has received very little attention in this regard. Despite the established dopaminergic innervation of the vmPFC, whether dopamine receptor blockade in each subregion alters the reinstatement of cocaine seeking is unclear. To address this issue, male Sprague-Dawley rats underwent 2 weeks of cocaine self-administration, followed by extinction training and reinstatement testing. Immediately prior to each reinstatement test, rats received microinjections of the D1 receptor antagonist SCH 23390, the D2 receptor antagonist sulpiride or their respective vehicles. D1 receptor blockade in the IL reduced cued reinstatement but had no effect on cocaine prime and cue + cocaine-prime reinstatement, whereas D2 receptor blockade in the IL had no effect on reinstatement. For the mOFC, however, D1 receptor blockade reduced cocaine seeking in all reinstatement types, whereas blocking D2 receptors in the mOFC had no effect on any form of cocaine seeking. These findings suggest different roles for D1 receptors in the IL versus the mOFC in regulating cocaine-seeking behavior. Moreover, even as previous work indicates that IL inactivation does not affect reinstatement but, rather, induces cocaine seeking during extinction, the present findings suggest that dopamine receptor activation in the IL is necessary for cocaine seeking under some circumstances.

Opioid and orexin hedonic hotspots in rat orbitofrontal cortex and insula

Hedonic hotspots are brain sites where particular neurochemical stimulations causally amplify the hedonic impact of sensory rewards, such as "liking" for sweetness. Here, we report the mapping of two hedonic hotspots in cortex, where mu opioid or orexin stimulations enhance the hedonic impact of sucrose taste. One hedonic hotspot was found in anterior orbitofrontal cortex (OFC), and another was found in posterior insula. A suppressive hedonic coldspot was also found in the form of an intervening strip stretching from the posterior OFC through the anterior and middle insula, bracketed by the two cortical hotspots. Opioid/orexin stimulations in either cortical hotspot activated Fos throughout a distributed "hedonic circuit" involving cortical and subcortical structures. Conversely, cortical coldspot stimulation activated circuitry for "hedonic suppression." Finally, food intake was increased by stimulations at several prefrontal cortical sites, indicating that the anatomical substrates in cortex for enhancing the motivation to eat are discriminable from those for hedonic impact.

Wanting and liking: Separable components in problematic eating behavior?

Some individuals may have an addictive-like response to certain foods, possibly contributing to problematic eating. Highly processed foods, with added fats and/or refined carbohydrates, are suggested to be most associated with addictive-like eating. The incentive sensitization theory suggests that wanting (e.g. craving) may drive compulsive drug use rather than liking (e.g. enjoyment), but it is unknown whether highly processed foods elicit similar wanting and liking patterns as drugs of abuse, or whether individual differences exist. The current study examines the association of highly processed foods with craving and liking, and whether these relationships differ by food addiction symptomology, cognitive restraint, or body mass index (BMI). Participants (n = 216) reported craving and liking for 35 foods and completed the Yale Food Addiction Scale (YFAS) and Three Factor Eating Questionnaire (TFEQ). Highly processed foods were craved more overall. Craving of highly processed foods was predicted negatively by restraint and positively by YFAS score. Liking of highly processed foods was predicted negatively by restraint and positively by BMI. In conclusion, craving and liking appear distinct with respect to highly processed foods, and may be influenced by addictive-like eating, cognitive restraint, and BMI. This suggests that the incentive sensitization framework may also be relevant for problematic food consumption, especially for individuals reporting food addiction symptoms.

Loss of Plasticity in the D2-Accumbens Pallidal Pathway Promotes Cocaine Seeking

Distinct populations of D1- and D2-dopamine receptor-expressing medium spiny neurons (D1-/D2-MSNs) comprise the nucleus accumbens, and activity in D1-MSNs promotes, whereas activity in D2-MSNs inhibits, motivated behaviors. We used chemogenetics to extend D1-/D2-MSN cell specific regulation to cue-reinstated cocaine seeking in a mouse model of self-administration and relapse, and found that either increasing activity in D1-MSNs or decreasing activity in D2-MSNs augmented cue-induced reinstatement. Both D1- and D2-MSNs provide substantial GABAergic innervation to the ventral pallidum, and chemogenetic inhibition of ventral pallidal neurons blocked the augmented reinstatement elicited by chemogenetic regulation of either D1- or D2-MSNs. Because D1- and D2-MSNs innervate overlapping populations of ventral pallidal neurons, we next used optogenetics to examine whether changes in synaptic plasticity in D1- versus D2-MSN GABAergic synapses in the ventral pallidum could explain the differential regulation of VP activity. In mice trained to self-administer cocaine, GABAergic LTD was abolished in D2-, but not in D1-MSN synapses. A μ opioid receptor antagonist restored GABA currents in D2-, but not D1-MSN synapses of cocaine-trained mice, indicating that increased enkephalin tone on presynaptic μ opioid receptors was responsible for occluding the LTD. These results identify a behavioral function for D1-MSN innervation of the ventral pallidum, and suggest that losing LTD_GABA in D2-MSN, but not D1-MSN input to ventral pallidum may promote cue-induced reinstatement of cocaine-seeking.

SIGNIFICANCE STATEMENT

More than 90% of ventral striatum is composed of two cell types, those expressing dopamine D1 or D2 receptors, which exert opposing roles on motivated behavior. Both cell types send GABAergic projections to the ventral pallidum and were found to differentially promote cue-induced reinstatement of cocaine seeking via the ventral pallidum. Furthermore, after cocaine self-administration, synaptic plasticity was selectively lost in D2, but not D1 inputs to the ventral pallidum. The selective impairment in D2 afferents may promote the influence of D1 inputs to drive relapse to cocaine seeking.

Multiple Mechanisms for Processing Reward Uncertainty in the Primate Basal Forebrain

The ability to use information about the uncertainty of future outcomes is critical for adaptive behavior in an uncertain world. We show that the basal forebrain (BF) contains at least two distinct neural-coding strategies to support this capacity. The dorsal-lateral BF, including the ventral pallidum (VP), contains reward-sensitive neurons, some of which are selectively suppressed by uncertain-reward predictions (U(-)). In contrast, the medial BF (mBF) contains reward-sensitive neurons, some of which are selectively enhanced (U(+)) by uncertain-reward predictions. In a two-alternative choice-task, U(-) neurons were selectively suppressed while monkeys chose uncertain options over certain options. During the same choice-epoch, U(+) neurons signaled the subjective reward value of the choice options. Additionally, after the choice was reported, U(+) neurons signaled reward uncertainty until the choice outcome. We suggest that uncertainty-related suppression of VP may participate in the mediation of uncertainty-seeking actions, whereas uncertainty-related enhancement of the mBF may direct cognitive resources to monitor and learn from uncertain-outcomes.

SIGNIFICANCE STATEMENT

To survive in an uncertain world, we must approach uncertainty and learn from it. Here we provide evidence for two mostly distinct mechanisms for processing uncertainty about rewards within different subregions of the primate basal forebrain (BF). We found that uncertainty suppressed the representation of certain (or safe) reward values by some neurons in the dorsal-lateral BF, in regions occupied by the ventral pallidum. This uncertainty-related suppression was evident as monkeys made risky choices. We also found that uncertainty-enhanced the activity of many medial BF neurons, most prominently after the monkeys' choices were completed (as they awaited uncertain outcomes). Based on these findings, we propose that different subregions of the BF could support action and learning under uncertainty in distinct but complimentary manners.

Salt Appetite, and the Influence of Opioids

Due to the biological importance of sodium and its relative scarcity within many natural environments, 'salt appetite' has evolved whereby dietary salt is highly sought after and palatable when tasted. In addition to peripheral responses, salt depletion is detected within the brain via circumventricular organs and 11β-hydroxysteroid dehydrogenase type 2 (HSD2) neurons to increase salt appetite. Salt appetite is comprised of two main components. One component is the incentive salience or motivation for salt (i.e. how much salt is 'wanted'). Incentive salience is dynamic and largely depends on internal homeostatic conditions in combination with the detection of relevant cues. It involves the mesolimbic system and structures such as the central amygdala, and opioid signalling within these regions can increase salt intake in rodents. A second key feature is the hedonic palatability of salt (i.e. how much it is 'liked') when it is tasted. After detection on the tongue, gustatory information passes through the brainstem nucleus of the solitary tract and thalamus, before being consciously detected within the gustatory cerebral cortex. The positive or negative hedonic value of this stimulus is also dynamic, and is encoded by a network including the nucleus accumbens, ventral pallidum, and lateral parabrachial nucleus. Opioid signalling within these areas can alter salt intake, and 'liking'. The overconsumption of dietary salt likely contributes to hypertension and associated diseases, and hence further characterising the role played by opioid signalling has important implications for human health.

The lateral hypothalamus to lateral habenula projection, but not the ventral pallidum to lateral habenula projection, regulates voluntary ethanol consumption

The lateral habenula (LHb) is an epithalamic brain region implicated in aversive processing via negative modulation of midbrain dopamine (DA) and serotonin (5-HT) systems. Given the role of the LHb in inhibiting DA and 5-HT systems, it is thought to be involved in various psychiatric pathologies, including drug addiction. In support, it has been shown that LHb plays a critical role in cocaine- and ethanol-related behaviors, most likely by mediating drug-induced aversive conditioning. In our previous work, we showed that LHb lesions increased voluntary ethanol consumption and operant ethanol self-administration and blocked yohimbine-induced reinstatement of ethanol self-administration. LHb lesions also attenuated ethanol-induced conditioned taste aversion suggesting that a mechanism for the increased intake of ethanol may be reduced aversion learning. However, whether afferents to the LHb are required for mediating effects of the LHb on these behaviors remained to be investigated. Our present results show that lesioning the fiber bundle carrying afferent inputs to the LHb, the stria medullaris (SM), increases voluntary ethanol consumption, suggesting that afferent structures projecting to the LHb are important for mediating ethanol-directed behaviors. We then chose two afferent structures as the focus of our investigation. We specifically studied the role of the inputs from the lateral hypothalamus (LH) and ventral pallidum (VP) to the LHb in ethanol-directed behaviors. Our results show that the LH-LHb projection is necessary for regulating voluntary ethanol consumption. These results are an important first step towards understanding the functional role of afferents to LHb with regard to ethanol consumption.

Optogenetic Inhibition of Ventral Pallidum Neurons Impairs Context-Driven Salt Seeking

Salt appetite, in which animals can immediately seek out salt when under a novel state of sodium deprivation, is a classic example of how homeostatic systems interface with learned associations to produce an on-the-fly updating of motivated behavior. Neural activity in the ventral pallidum (VP) has been shown to encode changes in the value of salt under such conditions, both the value of salt itself (Tindell et al., 2006) and the motivational value of its predictive cues (Tindell et al., 2009; Robinson and Berridge, 2013). However, it is not known whether the VP is necessary for salt appetite in terms of seeking out salt or consuming salt following sodium depletion. Here, we used a conditioned place-preference procedure to investigate the effects of optogenetically inhibiting the VP on context-driven salt seeking and the consumption of salt following deprivation. Male rats learned to associate one context with sucrose and another context with less-desirable salt. Following sodium depletion, and in the absence of either sucrose or salt, we found that inhibiting the VP selectively reduced the elevation in time spent in the salt-paired context. VP inhibition had minimal effects on the consumption of salt once it was made available. To our knowledge, this is the first evidence that the VP or any brain region is necessary for the ability to use contextual cues to guide salt seeking. These results highlight a dissociation between deficit-driven reward seeking and reward consumption to replenish those deficits, with the former process being particularly sensitive to on-line VP activity.SIGNIFICANCE STATEMENT Salt appetite, in which rats will immediately seek out a once-undesirable concentrated salt solution after being depleted of bodily sodium despite never having tasted salt as a positive reward, is a phenomenon showing how animals can update their motivational goals without any new learning or conditioning. This salt-seeking behavior is also observed when the animal is presented with salt-paired cues. The neural circuitry necessary for context-driven salt-seeking behavior is unknown. We used a novel conditioned place preference procedure to show that optogenetic inhibition of the ventral pallidum (VP), a region known for processing reward, impairs context-driven salt seeking and has minimal effects on the consumption of salt itself following sodium depletion. These results highlight the importance of the VP in context-driven reward-seeking behavior.

Elevation of 2-AG by monoacylglycerol lipase inhibition in the visceral insular cortex interferes with anticipatory nausea in a rat model

Anticipatory nausea (AN) is a conditioned nausea reaction experienced by chemotherapy patients upon returning to the clinic. Currently, there are no specific treatments for this phenomenon, with the classic antiemetic treatments (e.g., ondansetron) providing no relief. The rat model of AN, contextually elicited conditioned gaping reactions in rats, provides a tool for assessing potential treatments for this difficult to treat disorder. Systemically administered drugs which elevate the endocannabinoids, anandamide (AEA) and 2-arachidonoyl glycerol (2-AG), by interfering with their respective degrading enzymes, fatty acid amide hydrolase (FAAH) and monoacyl glycerol lipase (MAGL) interfere with AN in the rat model. We have shown that MAGL inhibition within the visceral insular cortex (VIC) interferes with acute nausea in the gaping model (Sticht et al., 2015). Here we report that bilateral infusion of the MAGL inhibitor, MJN110 (but neither the FAAH inhibitor, PF3845, nor ondansetron) into the VIC suppressed contextually elicited conditioned gaping, and this effect was reversed by coadministration of the CB1 antagonist, AM251. These findings suggest that 2-AG within the VIC plays a critical role in the regulation of both acute nausea and AN. Because there are currently no specific therapeutics for chemotherapy patients that develop anticipatory nausea, MAGL inhibition by MJN110 may be a candidate treatment. (PsycINFO Database Record

Activation of mu-opioid receptors in the ventral pallidum decreases the negative hedonic evaluation of a conditioned aversive taste in rats

Conditioned taste aversion (CTA) causes a shift in the hedonic evaluation of a conditioned stimulus (CS) from positive to negative, and reduces the CS intake. Mu-opioid receptors (MORs) in the ventral pallidum (VP) are known to be involved in the hedonic evaluation of positive rewarding stimuli; however, their involvement in evaluation of a negative aversive stimulus is still unclear. To explore the neural mechanisms of the negative hedonic evaluation of the CS in CTA, we examined the effects of the activation of VP MORs on the behavioral responses of rats to a CS. Rats implanted with guide cannulae into the bilateral VP received a pairing of 5mM saccharin solution as a CS with an intraperitoneal injection of 0.15M lithium chloride as an unconditioned stimulus. On the test day, after microinjections of MOR agonist [D-Ala², N-MePhe⁴, Gly-ol]-enkephalin (DAMGO) into the VP, we observed the behavioral responses to the intraorally infused CS solution. The DAMGO injections caused a larger number of ingestive taste reactivity responses to the CS solution. We also measured the consumption of the CS solution in a separate group of rats, using a single-bottle test. The DAMGO injected rats drank a higher volume of the CS solution than the saline injected rats. These results indicate that the activation of MORs in the VP results in the attenuation of aversion to the CS solution, thereby inducing the larger CS intake. Therefore, it is likely that VP MORs are involved in not only positive but also negative hedonic evaluation.

Selective Enhancement of Dopamine Release in the Ventral Pallidum of Methamphetamine-Sensitized Mice

Drugs of abuse induce sensitization, which is defined as enhanced response to additional drug following a period of withdrawal. Sensitization occurs in both humans and animal models of drug reinforcement and contributes substantially to the addictive nature of drugs of abuse, because it is thought to represent enhanced motivational wanting for drug. The ventral pallidum, a key member of the reward pathway, contributes to behaviors associated with reward, such as sensitization. Dopamine inputs to the ventral pallidum have not been directly characterized. Here we provide anatomical, neurochemical, and behavioral evidence demonstrating that dopamine terminals in the ventral pallidum contribute to reward in mice. We report subregional differences in dopamine release, measured by ex vivo fast-scan cyclic voltammetry: rostral ventral pallidum exhibits increased dopamine release and uptake compared with caudal ventral pallidum, which is correlated with tissue expression of dopaminergic proteins. We then subjected mice to a methamphetamine-sensitization protocol to investigate the contribution of dopaminergic projections to the region in reward related behavior. Methamphetamine-sensitized animals displayed a 508% and 307% increase in baseline dopamine release in the rostral and caudal ventral pallidum, respectively. Augmented dopamine release in the rostral ventral pallidum was significantly correlated with sensitized locomotor activity. Moreover, this presynaptic dopaminergic plasticity occurred only in the ventral pallidum and not in the ventral or dorsal striatum, suggesting that dopamine release in the ventral pallidum may be integrally important to drug-induced sensitization.

Chemogenetic manipulation of ventral pallidal neurons impairs acquisition of sign-tracking in rats

Cues associated with rewarding events acquire value themselves as a result of the incentive value of the reward being transferred to the cue. Consequently, presentation of a reward-paired cue can trigger reward-seeking behaviours towards the cue itself (i.e. sign-tracking). The ventral pallidum (VP) has been demonstrated to be involved in a number of motivated behaviours, both conditioned and unconditioned. However, its contribution to the acquisition of incentive value is unknown. Using a discriminative autoshaping procedure with levers, the effects of disrupting VP activity in rats on the emergence of sign-tracking was investigated using chemogenetics, i.e. Designer Receptors Exclusively Activated by Designer Drugs (DREADDs). Transient disruption of VP neurons [activation of the inhibitory hM4D(Gi) DREADD through systemic injections of clozapine N-oxide (CNO) prior to each autoshaping session] impaired acquisition of sign-tracking (lever press rate) without having any effect on approach to the site of reward delivery (i.e. goal-tracking) or on the expression of sign-tracking after it was acquired. In addition, electrophysiological recordings were conducted in freely behaving rats following VP DREADD activation. The majority of VP units that were responsive to CNO injections exhibited rapid inhibition relative to baseline, a subset of CNO-responsive units showed delayed excitation, and a smaller subset displayed a mixed response of inhibition and excitation following CNO injections. It is argued that disruption of VP during autoshaping specifically disrupted the transfer of incentive value that was attributed to the lever cue, suggesting a surprisingly fundamental role for the VP in acquiring, compared with expressing, Pavlovian incentive values.

Neural Basis of Anhedonia and Amotivation in Patients with Schizophrenia: The Role of Reward System

Anhedonia, the inability to feel pleasure, and amotivation, the lack of motivation, are two prominent negative symptoms of schizophrenia, which contribute to the poor social and occupational behaviors in the patients. Recently growing evidence shows that anhedonia and amotivation are tied together, but have distinct neural correlates. It is important to note that both of these symptoms may derive from deficient functioning of the reward network. A further analysis into the neuroimaging findings of schizophrenia shows that the neural correlates overlap in the reward network including the ventral striatum, anterior cingulate cortex and orbitofrontal cortex. Other neuroimaging studies have demonstrated the involvement of the default mode network in anhedonia. The identification of a specific deficit in hedonic and motivational capacity may help to elucidate the mechanisms behind social functioning deficits in schizophrenia, and may also lead to more targeted treatment of negative symptoms.

Pontomesencephalic Tegmental Afferents to VTA Non-dopamine Neurons Are Necessary for Appetitive Pavlovian Learning

The ventral tegmental area (VTA) receives phenotypically distinct innervations from the pedunculopontine tegmental nucleus (PPTg). While PPTg-to-VTA inputs are thought to play a critical role in stimulus-reward learning, direct evidence linking PPTg-to-VTA phenotypically distinct inputs in the learning process remains lacking. Here, we used optogenetic approaches to investigate the functional contribution of PPTg excitatory and inhibitory inputs to the VTA in appetitive Pavlovian conditioning. We show that photoinhibition of PPTg-to-VTA cholinergic or glutamatergic inputs during cue presentation dampens the development of anticipatory approach responding to the food receptacle during the cue. Furthermore, we employed in vivo optetrode recordings to show that photoinhibition of PPTg cholinergic or glutamatergic inputs significantly decreases VTA non-dopamine (non-DA) neural activity. Consistently, photoinhibition of VTA non-DA neurons disrupts the development of cue-elicited anticipatory approach responding. Taken together, our study reveals a crucial regulatory mechanism by PPTg excitatory inputs onto VTA non-DA neurons during appetitive Pavlovian conditioning.

Accumbal μ-Opioid Receptors Modulate Ethanol Intake in Alcohol-Preferring Alko Alcohol Rats

BACKGROUND

The nucleus accumbens shell is a key brain area mediating the reinforcing effects of ethanol (EtOH). Previously, it has been shown that the density of μ-opioid receptors in the nucleus accumbens shell is higher in alcohol-preferring Alko Alcohol (AA) rats than in alcohol-avoiding Alko Non-Alcohol rats. In addition, EtOH releases opioid peptides in the nucleus accumbens and opioid receptor antagonists are able to modify EtOH intake, all suggesting an opioidergic mechanism in the control of EtOH consumption. As the exact mechanisms of opioidergic involvement remains to be elucidated, the aim of this study was to clarify the role of accumbal μ- and κ-opioid receptors in controlling EtOH intake in alcohol-preferring AA rats.

METHODS

Microinfusions of the μ-opioid receptor antagonist CTOP (0.3 and 1 μg/site), μ-opioid receptor agonist DAMGO (0.03 and 0.1 μg/site), nonselective opioid receptor agonist morphine (30 μg/site), and κ-opioid receptor agonist U50488H (0.3 and 1 μg/site) were administered via bilateral guide cannulas into the nucleus accumbens shell of AA rats that voluntarily consumed 10% EtOH solution in an intermittent, time-restricted (90-minute) 2-bottle choice access paradigm.

RESULTS

CTOP (1 μg/site) significantly increased EtOH intake. Conversely, DAMGO resulted in a decreasing trend in EtOH intake. Neither morphine nor U50488H had any effect on EtOH intake in the used paradigm.

CONCLUSIONS

The results provide further evidence for the role of accumbens shell μ-opioid receptors but not κ-opioid receptors in mediating reinforcing effects of EtOH and in regulating EtOH consumption. The results also provide support for views suggesting that the nucleus accumbens shell has a major role in mediating EtOH reward.

Enhanced neural response to anticipation, effort and consummation of reward and aversion during bupropion treatment

BACKGROUND

We have previously shown that the selective serotonergic reuptake inhibitor, citalopram, reduces the neural response to reward and aversion in healthy volunteers. We suggest that this inhibitory effect might underlie the emotional blunting reported by patients on these medications. Bupropion is a dopaminergic and noradrenergic reuptake inhibitor and has been suggested to have more therapeutic effects on reward-related deficits. However, how bupropion affects the neural responses to reward and aversion is unclear.

METHOD

Seventeen healthy volunteers (9 female, 8 male) received 7 days bupropion (150 mg/day) and 7 days placebo treatment, in a double-blind crossover design. Our functional magnetic resonance imaging task consisted of three phases; an anticipatory phase (pleasant or unpleasant cue), an effort phase (button presses to achieve a pleasant taste or to avoid an unpleasant taste) and a consummatory phase (pleasant or unpleasant tastes). Volunteers also rated wanting, pleasantness and intensity of the tastes.

RESULTS

Relative to placebo, bupropion increased activity during the anticipation phase in the ventral medial prefrontal cortex (vmPFC) and caudate. During the effort phase, bupropion increased activity in the vmPFC, striatum, dorsal anterior cingulate cortex and primary motor cortex. Bupropion also increased medial orbitofrontal cortex, amygdala and ventral striatum activity during the consummatory phase.

CONCLUSIONS

Our results are the first to show that bupropion can increase neural responses during the anticipation, effort and consummation of rewarding and aversive stimuli. This supports the notion that bupropion might be beneficial for depressed patients with reward-related deficits and blunted affect.