Which cue to 'want'? Opioid stimulation of central amygdala makes goal-trackers show stronger goal-tracking, just as sign-trackers show stronger sign-tracking

Inhibition of Dopamine Neurons Prevents Incentive Value Encoding of a Reward Cue: With Revelations from Deep Phenotyping

The survival of an organism is dependent on its ability to respond to cues in the environment. Such cues can attain control over behavior as a function of the value ascribed to them. Some individuals have an inherent tendency to attribute reward-paired cues with incentive motivational value, or incentive salience. For these individuals, termed sign-trackers, a discrete cue that precedes reward delivery becomes attractive and desirable in its own right. Prior work suggests that the behavior of sign-trackers is dopamine-dependent, and cue-elicited dopamine in the NAc is believed to encode the incentive value of reward cues. Here we exploited the temporal resolution of optogenetics to determine whether selective inhibition of ventral tegmental area (VTA) dopamine neurons during cue presentation attenuates the propensity to sign-track. Using male tyrosine hydroxylase (TH)-Cre Long Evans rats, it was found that, under baseline conditions, ∼84% of TH-Cre rats tend to sign-track. Laser-induced inhibition of VTA dopamine neurons during cue presentation prevented the development of sign-tracking behavior, without affecting goal-tracking behavior. When laser inhibition was terminated, these same rats developed a sign-tracking response. Video analysis using DeepLabCutTM revealed that, relative to rats that received laser inhibition, rats in the control group spent more time near the location of the reward cue even when it was not present and were more likely to orient toward and approach the cue during its presentation. These findings demonstrate that cue-elicited dopamine release is critical for the attribution of incentive salience to reward cues.SIGNIFICANCE STATEMENT Activity of dopamine neurons in the ventral tegmental area (VTA) during cue presentation is necessary for the development of a sign-tracking, but not a goal-tracking, conditioned response in a Pavlovian task. We capitalized on the temporal precision of optogenetics to pair cue presentation with inhibition of VTA dopamine neurons. A detailed behavioral analysis with DeepLabCutTM revealed that cue-directed behaviors do not emerge without dopamine neuron activity in the VTA. Importantly, however, when optogenetic inhibition is lifted, cue-directed behaviors increase, and a sign-tracking response develops. These findings confirm the necessity of dopamine neuron activity in the VTA during cue presentation to encode the incentive value of reward cues.

Separating desire from prediction of outcome value

Individuals typically want what they expect to like, often based on memories of previous positive experiences. However, in some situations desire can decouple completely from memories and from learned predictions of outcome value. The potential for desire to separate from prediction arises from independent operating rules that control motivational incentive salience. Incentive salience, or 'wanting', is a type of mesolimbic desire that evolved for adaptive goals, but can also generate maladaptive addictions. Two proof-of-principle examples are presented here to show how motivational 'wanting' can soar above memory-based predictions of outcome value: (i) 'wanting what is remembered to be disgusting', and (ii) 'wanting what is predicted to hurt'. Consequently, even outcomes remembered and predicted to be negatively aversive can become positively 'wanted'. Similarly, in human addictions, people may experience powerful cue-triggered cravings for outcomes that are not predicted to be enjoyable.

Inhibition of dopamine neurons prevents incentive value encoding of a reward cue: With revelations from deep phenotyping

The survival of an organism is dependent on their ability to respond to cues in the environment. Such cues can attain control over behavior as a function of the value ascribed to them. Some individuals have an inherent tendency to attribute reward-paired cues with incentive motivational value, or incentive salience. For these individuals, termed sign-trackers, a discrete cue that precedes reward delivery becomes attractive and desirable in its own right. Prior work suggests that the behavior of sign-trackers is dopamine-dependent, and cue-elicited dopamine in the nucleus accumbens is believed to encode the incentive value of reward cues. Here we exploited the temporal resolution of optogenetics to determine whether selective inhibition of ventral tegmental area (VTA) dopamine neurons during cue presentation attenuates the propensity to sign-track. Using male tyrosine hydroxylase (TH)-Cre Long Evans rats it was found that, under baseline conditions, ∼84% of TH-Cre rats tend to sign-track. Laser-induced inhibition of VTA dopamine neurons during cue presentation prevented the development of sign-tracking behavior, without affecting goal-tracking behavior. When laser inhibition was terminated, these same rats developed a sign-tracking response. Video analysis using DeepLabCut revealed that, relative to rats that received laser inhibition, rats in the control group spent more time near the location of the reward cue even when it was not present and were more likely to orient towards and approach the cue during its presentation. These findings demonstrate that cue-elicited dopamine release is critical for the attribution of incentive salience to reward cues.

Significance Statement

Activity of dopamine neurons in the ventral tegmental area (VTA) during cue presentation is necessary for the development of a sign-tracking, but not a goal-tracking, conditioned response in a Pavlovian task. We capitalized on the temporal precision of optogenetics to pair cue presentation with inhibition of VTA dopamine neurons. A detailed behavioral analysis with DeepLabCut revealed that cue-directed behaviors do not emerge without VTA dopamine. Importantly, however, when optogenetic inhibition is lifted, cue-directed behaviors increase, and a sign-tracking response develops. These findings confirm the necessity of VTA dopamine during cue presentation to encode the incentive value of reward cues.

"Wanting" versus "needing" related value: An fMRI meta-analysis

Consumption and its excesses are sometimes explained by imbalance of need or lack of control over "wanting." "Wanting" assigns value to cues that predict rewards, whereas "needing" assigns value to biologically significant stimuli that one is deprived of. Here we aimed at studying how the brain activation patterns related to value of "wanted" stimuli differs from that of "needed" stimuli using activation likelihood estimation neuroimaging meta-analysis approaches. We used the perception of a cue predicting a reward for "wanting" related value and the perception of food stimuli in a hungry state as a model for "needing" related value. We carried out separate, contrasts, and conjunction meta-analyses to identify differences and similarities between "wanting" and "needing" values. Our overall results for "wanting" related value show consistent activation of the ventral tegmental area, striatum, and pallidum, regions that both activate behavior and direct choice, while for "needing" related value, we found an overall consistent activation of the middle insula and to some extent the caudal-ventral putamen, regions that only direct choice. Our study suggests that wanting has more control on consumption and behavioral activation.

Implication of the Central Nucleus of the Amygdala in Cardiovascular Regulation and Limiting Maximum Exercise Performance During High-intensity Exercise in Rats

To date, the mechanism of central fatigue during high-intensity exercise has remained unclear. Here we elucidate the central mechanisms of cardiovascular regulation during high-intensity exercise with a focus on the hypothesis that amygdala activation acts to limit maximum exercise performance. In the first of three experiments, we probed the involvement of the central nucleus of the amygdala (CeA) in such regulation. Wistar rats were subjected to a maximum exercise test and their total running time and cardiovascular responses were compared before and after bilateral CeA lesions. Next, probing the role of central pathways, we tested whether high-intensity exercise activated neurons in CeA and/or the hypothalamic paraventricular nucleus (PVN) that project to the nucleus tractus solitarius (NTS). Finally, to understand the potential autonomic mechanisms affecting maximum exercise performance, we measured the cardiovascular responses in anesthetized rats to electrical microstimulation of the CeA, PVN, or both. We have found that (1) CeA lesions resulted in an increase in the total exercise time and the time at which an abrupt increase in arterial pressure appeared, indicating an apparent suppression of fatigue. (2) We confirmed that high-intensity exercise activated both the PVN-NTS and CeA-NTS pathways. Moreover, we discovered that (3) while stimulation of the CeA or PVN alone both induced pressor responses, their simultaneous stimulation also increased muscle vascular resistance. These results are evidence that cardiovascular responses during high-intensity exercise are affected by CeA activation, which acts to limit maximum exercise performance, and may implicate autonomic control modulating the PVN-NTS pathway via the CeA.

Nicotine Enhances Goal-Tracking in Ethanol and Food Pavlovian Conditioned Approach Paradigms

Rationale

Nicotine promotes alcohol intake through pharmacological and behavioral interactions. As an example of the latter, nicotine can facilitate approach toward food- and alcohol-associated stimuli ("sign-tracking") in lever-Pavlovian conditioned approach (PavCA) paradigms. However, we recently reported that nicotine can also enhance approach toward locations of reward delivery ("goal-tracking") triggered by ethanol-predictive stimuli when the location of ethanol delivery is non-static (i.e., a retractable sipper bottle).

Objective

To determine whether the non-static nature of the reward location could have biased the development of goal-tracking in our previous study (Loney et al., 2019); we assessed the effect of nicotine in a lever-PavCA paradigm wherein the location of ethanol delivery was static (i.e., a stationary liquid receptacle). Then, to determine whether nicotine's enhancement of goal-tracking is unique to ethanol-predictive stimuli, we assessed the effect of systemic nicotine on approach triggered by food-predictive stimuli in a lever-PavCA paradigm.

Methods

Long-Evans rats were used in two PavCA experiments wherein a lever predicted the receipt of ethanol (15% vol/vol; experiment 1) or food (experiment 2) into a stationary receptacle. Prior to testing, rats were administered nicotine (0.4 mg/kg subcutaneously) or saline systemically.

Results

In both experiments, nicotine increased measures of goal-tracking, but not sign-tracking.

Conclusion

Nicotine can facilitate approach to reward locations without facilitating approach to reward-predictive stimuli. As such, conceptualization of the mechanisms by which nicotine affects behavior must be expanded to explain an enhancement of goal-tracking by nicotine.

Interactive Mechanisms of Supraspinal Sites of Opioid Analgesic Action: A Festschrift to Dr. Gavril W. Pasternak

Almost a half century of research has elaborated the discoveries of the central mechanisms governing the analgesic responses of opiates, including their receptors, endogenous peptides, genes and their putative spinal and supraspinal sites of action. One of the central tenets of "gate-control theories of pain" was the activation of descending supraspinal sites by opiate drugs and opioid peptides thereby controlling further noxious input. This review in the Special Issue dedicated to the research of Dr. Gavril Pasternak indicates his contributions to the understanding of supraspinal mediation of opioid analgesic action within the context of the large body of work over this period. This review will examine (a) the relevant supraspinal sites mediating opioid analgesia, (b) the opioid receptor subtypes and opioid peptides involved, (c) supraspinal site analgesic interactions and their underlying neurophysiology, (d) molecular (particularly AS) tools identifying opioid receptor actions, and (e) relevant physiological variables affecting site-specific opioid analgesia. This review will build on classic initial studies, specify the contributions that Gavril Pasternak and his colleagues did in this specific area, and follow through with studies up to the present.

Incentive motivation: 'wanting' roles of central amygdala circuitry

The central nucleus of amygdala (CeA) mediates positively-valenced reward motivation as well as negatively-valenced fear. Optogenetic or neurochemical stimulation of CeA circuitry can generate intense incentive motivation to pursue and consume a paired natural food, sex, or addictive drug reward, and even create maladaptive 'wanting what hurts' such as attraction to a shock rod. Evidence indicates CeA stimulations selectively amplify incentive motivation ('wanting') but not hedonic impact ('liking') of the same reward. Further, valence flips can occur for CeA contributions to motivational salience. That is, CeA stimulation can promote either incentive motivation or fearful motivation, even in the same individual, depending on situation. These findings may carry implications for understanding CeA roles in neuropsychiatric disorders involving aberrant motivational salience, ranging from addiction to paranoia and anxiety disorders.

Behavioral determinants in the expression of the Kamin blocking effect: Implications for associative learning theory

Associative learning makes important contributions to our behavior and decisions. The Kamin blocking effect is an associative learning phenomenon that plays a central role in understanding of the psychological principles underlying associative learning. However, several recent failures to replicate the blocking effect suggest that the conditions necessary for blocking are poorly understood. To understand the conditions necessary for blocking, here we review studies into the expression of blocking in subjects that either approach and interact with the conditioned cue (sign trackers) or approach and interact with the reward location (goal trackers) during appetitive classical conditioning. Psychological theory and the neurophysiological correlates of appetitive classical conditioning make opposing predictions regarding the expression of blocking in sign and goal trackers. We reconcile these opposing predictions in a qualitative model using two parallel learning processes. Such models offer a better framework for understanding the psychological associative structures acquired during learning, their interactions contributing to the conditioned response, and how they affect subsequent learning and the expression of the Kamin blocking effect.

Chronic fluoxetine treatment impairs motivation and reward learning by affecting neuronal plasticity in the central amygdala

BACKGROUND AND PURPOSE

The therapeutic effects of fluoxetine are believed to be due to increasing neuronal plasticity and reversing some learning deficits. Nevertheless, a growing amount of evidence shows adverse effects of this drug on cognition and some forms of neuronal plasticity.

EXPERIMENTAL APPROACH

To study the effects of chronic fluoxetine treatment, we combine an automated assessment of motivation and learning in mice with an investigation of neuronal plasticity in the central amygdala and basolateral amygdala. We use immunohistochemistry to visualize neuronal types and perineuronal nets, along with DI staining to assess dendritic spine morphology. Gel zymography is used to test fluoxetine's impact on matrix metalloproteinase-9, an enzyme involved in synaptic plasticity.

KEY RESULTS

We show that chronic fluoxetine treatment in non-stressed mice increases perineuronal nets-dependent plasticity in the basolateral amygdala, while impairing MMP-9-dependent plasticity in the central amygdala. Further, we illustrate how the latter contributes to anhedonia and deficits of reward learning. Behavioural impairments are accompanied by alterations in morphology of dendritic spines in the central amygdala towards an immature state, most likely reflecting animals' inability to adapt. We strengthen the link between the adverse effects of fluoxetine and its influence on MMP-9 by showing that behaviour of MMP-9 knockout animals remains unaffected by the drug.

CONCLUSION AND IMPLICATIONS

Chronic fluoxetine treatment differentially affects various forms of neuronal plasticity, possibly explaining its opposing effects on brain and behaviour. These findings are of immediate clinical relevance since reported side effects of fluoxetine pose a potential threat to patients.

'Liking' and 'wanting' in eating and food reward: Brain mechanisms and clinical implications

It is becoming clearer how neurobiological mechanisms generate 'liking' and 'wanting' components of food reward. Mesocorticolimbic mechanisms that enhance 'liking' include brain hedonic hotspots, which are specialized subregions that are uniquely able to causally amplify the hedonic impact of palatable tastes. Hedonic hotspots are found in nucleus accumbens medial shell, ventral pallidum, orbitofrontal cortex, insula cortex, and brainstem. In turn, a much larger mesocorticolimbic circuitry generates 'wanting' or incentive motivation to obtain and consume food rewards. Hedonic and motivational circuitry interact together and with hypothalamic homeostatic circuitry, allowing relevant physiological hunger and satiety states to modulate 'liking' and 'wanting' for food rewards. In some conditions such as drug addiction, 'wanting' is known to dramatically detach from 'liking' for the same reward, and this may also occur in over-eating disorders. Via incentive sensitization, 'wanting' selectively becomes higher, especially when triggered by reward cues when encountered in vulnerable states of stress, etc. Emerging evidence suggests that some cases of obesity and binge eating disorders may reflect an incentive-sensitization brain signature of cue hyper-reactivity, causing excessive 'wanting' to eat. Future findings on the neurobiological bases of 'liking' and 'wanting' can continue to improve understanding of both normal food reward and causes of clinical eating disorders.

The central amygdala recruits mesocorticolimbic circuitry for pursuit of reward or pain

How do brain mechanisms create maladaptive attractions? Here intense maladaptive attractions are created in laboratory rats by pairing optogenetic channelrhodopsin (ChR2) stimulation of central nucleus of amygdala (CeA) in rats with encountering either sucrose, cocaine, or a painful shock-delivering object. We find that pairings make the respective rats pursue either sucrose exclusively, or cocaine exclusively, or repeatedly self-inflict shocks. CeA-induced maladaptive attractions, even to the painful shock-rod, recruit mesocorticolimbic incentive-related circuitry. Shock-associated cues also gain positive incentive value and are pursued. Yet the motivational effects of paired CeA stimulation can be reversed to negative valence in a Pavlovian fear learning situation, where CeA ChR2 pairing increases defensive reactions. Finally, CeA ChR2 valence can be switched to neutral by pairing with innocuous stimuli. These results reveal valence plasticity and multiple modes for motivation via mesocorticolimbic circuitry under the control of CeA activation.

Neural circuits linking sleep and addiction: Animal models to understand why select individuals are more vulnerable to substance use disorders after sleep deprivation

Individuals differ widely in their drug-craving behaviors. One reason for these differences involves sleep. Sleep disturbances lead to an increased risk of substance use disorders and relapse in only some individuals. While animal studies have examined the impact of sleep on reward circuitry, few have addressed the role of individual differences in the effects of altered sleep. There does, however, exist a rodent model of individual differences in reward-seeking behavior: the sign/goal-tracker model of Pavlovian conditioned approach. In this model, only some rats show the key behavioral traits associated with addiction, including impulsivity and poor attentional control, making this an ideal model system to examine individually distinct sleep-reward interactions. Here, we describe how the limbic neural circuits responsible for individual differences in incentive motivation overlap with those involved in sleep-wake regulation, and how this model can elucidate the common underlying mechanisms. Consideration of individual differences in preclinical models would improve our understanding of how sleep interacts with motivational systems, and why sleep deprivation contributes to addiction in only select individuals.

Endogenous opioid modulation of food intake and body weight: Implications for opioid influences upon motivation and addiction

This review is part of a special issue dedicated to Opioid addiction, and examines the influential role of opioid peptides, opioid receptors and opiate drugs in mediating food intake and body weight control in rodents. This review postulates that opioid mediation of food intake was an example of "positive addictive" properties that provide motivational drives to maintain opioid-seeking behavior and that are not subject to the "negative addictive" properties associated with tolerance, dependence and withdrawal. Data demonstrate that opiate and opioid peptide agonists stimulate food intake through homeostatic activation of sensory, metabolic and energy-related In contrast, general, and particularly mu-selective, opioid receptor antagonists typically block these homeostatically-driven ingestive behaviors. Intake of palatable and hedonic food stimuli is inhibited by general, and particularly mu-selective, opioid receptor antagonists. The selectivity of specific opioid agonists to elicit food intake was confirmed through the use of opioid receptor antagonists and molecular knockdown (antisense) techniques incapacitating specific exons of opioid receptor genes. Further extensive evidence demonstrated that homeostatic and hedonic ingestive situations correspondingly altered the levels and expression of opioid peptides and opioid receptors. Opioid mediation of food intake was controlled by a distributed brain network intimately related to both the appetitive-consummatory sites implicated in food intake as well as sites intimately involved in reward and reinforcement. This emergent system appears to sustain the "positive addictive" properties providing motivational drives to maintain opioid-seeking behavior.

Nicotine Produces a High-Approach, Low-Avoidance Phenotype in Response to Alcohol-Associated Cues in Male Rats

BACKGROUND

Nicotine and alcohol use are highly comorbid. Modulation of drug-paired extrinsic and intrinsic cues likely plays a role in this interaction, as cues can acquire motivational properties and augment drug seeking. The motivational properties of cues can be measured through Pavlovian conditioning paradigms, in which cues either elicit approach following pairing with the reinforcing properties of alcohol or elicit avoidance following pairing with the aversive consequences of alcohol. The present experiments tested whether nicotine would enhance the incentive properties of an appetitive ethanol (EtOH) cue and diminish the avoidance of an aversive EtOH cue in Pavlovian paradigms.

METHODS

In experiment 1, male Long-Evans rats with or without prior chronic intermittent access to EtOH were administered nicotine or saline injections prior to Pavlovian conditioned approach (PavCA) sessions, during which conditioned approach to the cue ("sign-tracking") or the EtOH delivery location ("goal-tracking") was measured. In experiment 2, male Long-Evans rats were administered nicotine or saline injections prior to pairing a flavor cue with increasing doses of EtOH (i.p.) in an adaptation of the conditioned taste avoidance (CTA) paradigm.

RESULTS

Results from PavCA indicate that, regardless of EtOH exposure, nicotine enhanced responding elicited by EtOH-paired cues with no effect on a similar cue not explicitly paired with EtOH. Furthermore, nicotine reduced sensitivity to EtOH-induced CTA, as indicated by a rightward shift in the dose-response curve of passively administered EtOH. The ED₅₀ , or the dose of EtOH that produced a 50% reduction in intake relative to baseline, was significantly higher in nicotine-treated rats compared to saline-treated rats.

CONCLUSIONS

We conclude that nicotine increases the approach and diminishes the avoidance elicited by Pavlovian cues paired, respectively, with the reinforcing and aversive properties of EtOH consumption in male rats. As such, nicotine may enhance alcoholism liability by engendering an attentional bias toward cues that predict the reinforcing outcomes of drinking.

Early life stress alters opioid receptor mRNA levels within the nucleus accumbens in a sex-dependent manner

Early life stress (ELS) strongly impacts mental health, but little is known about its interaction with biological sex and postnatal development to influence risk and resilience to psychopathologies. A number of psychiatric disorders, such as social anhedonia and drug addiction, involve dysfunctional opioid signaling; moreover, there is evidence for differential central opioid function in males vs. females. The present study examined opioid receptor gene expression in the nucleus accumbens (NAc) and amygdala of male and female rats subjected to a neonatal predator odor exposure (POE) paradigm to model ELS. Brain tissue was collected at two developmental time points: neonatal and juvenile. Results showed that, following the neonatal POE experience, opioid receptor mRNA levels in the NAc were differentially regulated at the neonatal and juvenile time points. POE downregulated neonatal mu- and kappa-opioid receptor mRNA levels in neonatal females, but upregulated mu- and delta-opioid receptor mRNA levels in juvenile females. Intriguingly, POE had no significant effect on NAc opioid receptor mRNA levels in males at either time point, indicating that the impact of POE on opioid system development is sex-dependent. Finally, POE failed to alter amygdalar opioid receptor gene expression in either sex at either time-point. The spatiotemporally- and sex-specific impact of ELS within the developing brain may confer differential risk or resilience for males and females to develop atypical opioid-regulated behaviors associated with conditions such as depression and addiction.

Opioid modulation of cognitive impairment in depression

The failure of traditional antidepressant medications to adequately target cognitive impairment is associated with poor treatment response, increased risk of relapse, and greater lifetime disability. Opioid receptor antagonists are currently under development as novel therapeutics for major depressive disorder (MDD) and other stress-related illnesses. Although it is known that dysregulation of the endogenous opioid system is observed in patients diagnosed with MDD, the impact of opioidergic neurotransmission on cognitive impairment has not been systematically evaluated. Here we review the literature indicating that opioid manipulations can alter cognitive functions in humans. Furthermore, we detail the preclinical studies that demonstrate the ability of mu-opioid receptor and kappa-opioid receptor ligands to modulate several cognitive processes. Specifically, this review focuses on domains within higher order cognitive processing, including attention and executive functioning, which can differentiate cognitive processes influenced by motivational state.

Manipulating the revision of reward value during the intertrial interval increases sign tracking and dopamine release

Recent computational models of sign tracking (ST) and goal tracking (GT) have accounted for observations that dopamine (DA) is not necessary for all forms of learning and have provided a set of predictions to further their validity. Among these, a central prediction is that manipulating the intertrial interval (ITI) during autoshaping should change the relative ST-GT proportion as well as DA phasic responses. Here, we tested these predictions and found that lengthening the ITI increased ST, i.e., behavioral engagement with conditioned stimuli (CS) and cue-induced phasic DA release. Importantly, DA release was also present at the time of reward delivery, even after learning, and DA release was correlated with time spent in the food cup during the ITI. During conditioning with shorter ITIs, GT was prominent (i.e., engagement with food cup), and DA release responded to the CS while being absent at the time of reward delivery after learning. Hence, shorter ITIs restored the classical DA reward prediction error (RPE) pattern. These results validate the computational hypotheses, opening new perspectives on the understanding of individual differences in Pavlovian conditioning and DA signaling.

Repeated cocaine exposure dysregulates cognitive control over cue-evoked reward-seeking behavior during Pavlovian-to-instrumental transfer

Drug-paired cues acquire powerful motivational properties, but only lead to active drug-seeking behavior if they are potent enough to overwhelm the cognitive control processes that serve to suppress such urges. Studies using the Pavlovian-to-instrumental transfer (PIT) task have shown that rats pretreated with cocaine or amphetamine exhibit heightened levels of cue-motivated food-seeking behavior, suggesting that exposure to these drugs sensitizes the incentive motivational system. However, the PIT testing protocol can also create conflict between two competing behavioral responses to the reward-paired cue: active reward seeking (e.g., lever pressing) and passive conditioned food-cup approach behavior. We therefore investigated whether repeated cocaine exposure alters the way in which rats use cue-based reward expectations to resolve such conflict. In-depth analysis of previously published and new research confirmed that when drug-naïve rats are given a cue that signals the timing of a delayed noncontingent reward, they adaptively transition from reward seeking to conditioned approach behavior, facilitating efficient collection of the predicted reward. In contrast, cocaine-exposed rats exhibit pronounced behavioral dysregulation, increasing, rather than suppressing, their reward-seeking behavior over time, disrupting their ability to passively collect reward. Such findings speak to the important and sometimes overlooked role that cognitive control plays in determining the motivational impact of cues associated with drug and nondrug rewards.

Optogenetic activation of the central amygdala generates addiction-like preference for reward

Drug and behavioural addictions are characterized by an intense and focused pursuit of a single reward above all others. Pursuit of the addictive reward is often compulsively sought despite adverse consequences and better alternative outcomes. Here, we explored the ability of the central amygdala (CeA) to powerfully bias choice, causing specific rewards to be almost compulsively preferred. Rats were trained on an operant choice task in which they could choose to respond on either of the two levers to receive a sucrose reward, one of which was paired with optogenetic stimulation of the CeA using channelrhodopsin-2 (ChR2). Rats developed an almost exclusive preference for the laser-paired reward over the otherwise equal unpaired reward. We found that this preference for stimulation-paired reward persists even when a much larger sucrose reward is offered as an alternative (contingency management) or when this preferred reward is paired with adverse consequences such as progressively larger electric foot shock, time delays or effort requirements. We also report that when challenged with foot shock, a small proportion of these animals (≈20%) retained an exclusive laser-paired reward preference, whereas others began to seek the alternate reward when the shock reached high levels. Lastly, we confirmed that optogenetic CeA stimulation was not independently rewarding if delivered in the absence of a paired sucrose reward. These results suggest a role for the CeA in focusing motivation and desire to excessive levels, generating addiction-like behaviour that persists in the face of more rewarding alternatives and adverse consequences.

Dynamic Encoding of Incentive Salience in the Ventral Pallidum: Dependence on the Form of the Reward Cue

Some rats are especially prone to attribute incentive salience to a cue (conditioned stimulus, CS) paired with food reward (sign-trackers, STs), but the extent they do so varies as a function of the form of the CS. Other rats respond primarily to the predictive value of a cue (goal-trackers, GTs), regardless of its form. Sign-tracking is associated with greater cue-induced activation of mesolimbic structures than goal-tracking; however, it is unclear how the form of the CS itself influences activity in neural systems involved in incentive salience attribution. Thus, our goal was to determine how different cue modalities affect neural activity in the ventral pallidum (VP), which is known to encode incentive salience attribution, as rats performed a two-CS Pavlovian conditioned approach task in which both a lever-CS and a tone-CS predicted identical food reward. The lever-CS elicited sign-tracking in some rats (STs) and goal-tracking in others (GTs), whereas the tone-CS elicited only goal-tracking in all rats. The lever-CS elicited robust changes in neural activity (sustained tonic increases or decreases in firing) throughout the VP in STs, relative to GTs. These changes were not seen when STs were exposed to the tone-CS, and in GTs there were no differences in firing between the lever-CS and tone-CS. We conclude that neural activity throughout the VP encodes incentive signals and is especially responsive when a cue is of a form that promotes the attribution of incentive salience to it, especially in predisposed individuals.

Food Addiction and Binge Eating: Lessons Learned from Animal Models

The feeding process is required for basic life, influenced by environment cues and tightly regulated according to demands of the internal milieu by regulatory brain circuits. Although eating behaviour cannot be considered "addictive" under normal circumstances, people can become "addicted" to this behaviour, similarly to how some people are addicted to drugs. The symptoms, cravings and causes of "eating addiction" are remarkably similar to those experienced by drug addicts, and both drug-seeking behaviour as eating addiction share the same neural pathways. However, while the drug addiction process has been highly characterised, eating addiction is a nascent field. In fact, there is still a great controversy over the concept of "food addiction". This review aims to summarize the most relevant animal models of "eating addictive behaviour", emphasising binge eating disorder, that could help us to understand the neurobiological mechanisms hidden under this behaviour, and to improve the psychotherapy and pharmacological treatment in patients suffering from these pathologies.

Optogenetic Central Amygdala Stimulation Intensifies and Narrows Motivation for Cocaine

Addiction is often characterized by intense motivation for a drug, which may be narrowly focused at the expense of other rewards. Here, we examined the role of amygdala-related circuitry in the amplification and narrowing of motivation focus for intravenous cocaine. We paired optogenetic channelrhodopsin (ChR2) stimulation in either central nucleus of amygdala (CeA) or basolateral amygdala (BLA) of female rats with one particular nose-poke porthole option for earning cocaine infusions (0.3 mg/kg, i.v.). A second alternative porthole earned identical cocaine but without ChR2 stimulation. Consequently, CeA rats quickly came to pursue their CeA ChR2-paired cocaine option intensely and exclusively, elevating cocaine intake while ignoring their alternative cocaine alone option. By comparison, BLA ChR2 pairing failed to enhance cocaine motivation. CeA rats also emitted consummatory bites toward their laser-paired porthole, suggesting that higher incentive salience made that cue more attractive. A separate progressive ratio test of incentive motivation confirmed that CeA ChR2 amplified rats' motivation, raising their breakpoint effort price for cocaine by 10-fold. However, CeA ChR2 laser on its own lacked any reinforcement value: laser by itself was never self-stimulated, not even by the same rats in which it amplified motivation for cocaine. Conversely, CeA inhibition by muscimol/baclofen microinjections prevented acquisition of cocaine self-administration and laser preference, whereas CeA inhibition by optogenetic halorhodopsin suppressed cocaine intake, indicating that CeA circuitry is needed for ordinary cocaine motivation. We conclude that CeA ChR2 excitation paired with a cocaine option specifically focuses and amplifies motivation to produce intense pursuit and consumption focused on that single target.SIGNIFICANCE STATEMENT In addiction, intense incentive motivation often becomes narrowly focused on a particular drug of abuse. Here we show that pairing central nucleus of amygdala (CeA) optogenetic stimulation with one option for earning intravenous cocaine makes that option almost the exclusive focus of intense pursuit and consumption. CeA stimulation also elevated the effort cost rats were willing to pay for cocaine and made associated cues become intensely attractive. However, we also show that CeA laser had no reinforcing properties at all when given alone for the same rats. Therefore, CeA laser pairing makes its associated cocaine option and cues become powerfully attractive in a nearly addictive fashion.

Abundant collateralization of temporal lobe projections to the accumbens, bed nucleus of stria terminalis, central amygdala and lateral septum

Behavioral flexibility is subserved in part by outputs from the cerebral cortex to telencephalic subcortical structures. In our earlier evaluation of the organization of the cortical-subcortical output system (Reynolds and Zahm, J Neurosci 25:11757-11767, 2005), retrograde double-labeling was evaluated in the prefrontal cortex following tracer injections into pairs of the following subcortical telencephalic structures: caudate-putamen, core and shell of the accumbens (Acb), bed nucleus of stria terminalis (BST) and central nucleus of the amygdala (CeA). The present study was done to assess patterns of retrograde labeling in the temporal lobe after similar paired tracer injections into most of the same telencephalic structures plus the lateral septum (LS). In contrast to the modest double-labeling observed in the prefrontal cortex in the previous study, up to 60-80 % of neurons in the basal and accessory basal amygdaloid nuclei and amygdalopiriform transition area exhibited double-labeling in the present study. The most abundant double-labeling was generated by paired injections into structures affiliated with the extended amygdala, including the CeA, BST and Acb shell. Injections pairing the Acb core with the BST or CeA produced significantly fewer double-labeled neurons. The ventral subiculum exhibited modest amounts of double-labeling associated with paired injections into the Acb, BST, CeA and LS. The results raise the issue of how an extraordinarily collateralized output from the temporal lobe may contribute to behavioral flexibility.

Endogenous central amygdala mu-opioid receptor signaling promotes sodium appetite in mice

Due to the importance of dietary sodium and its paucity within many inland environments, terrestrial animals have evolved an instinctive sodium appetite that is commensurate with sodium deficiency. Despite a well-established role for central opioid signaling in sodium appetite, the endogenous influence of specific opioid receptor subtypes within distinct brain regions remains to be elucidated. Using selective pharmacological antagonists of opioid receptor subtypes, we reveal that endogenous mu-opioid receptor (MOR) signaling strongly drives sodium appetite in sodium-depleted mice, whereas a role for kappa (KOR) and delta (DOR) opioid receptor signaling was not detected, at least in sodium-depleted mice. Fos immunohistochemistry revealed discrete regions of the mouse brain displaying an increased number of activated neurons during sodium gratification: the rostral portion of the nucleus of the solitary tract (rNTS), the lateral parabrachial nucleus (LPB), and the central amygdala (CeA). The CeA was subsequently targeted with bilateral infusions of the MOR antagonist naloxonazine, which significantly reduced sodium appetite in mice. The CeA is therefore identified as a key node in the circuit that contributes to sodium appetite. Moreover, endogenous opioids, acting via MOR, within the CeA promote this form of appetitive behavior.

Deep brain stimulation in the central nucleus of the amygdala decreases 'wanting' and 'liking' of food rewards

We investigated the potential of deep brain stimulation (DBS) in the central nucleus of the amygdala (CeA) in rats to modulate functional reward mechanisms. The CeA is the major output of the amygdala with direct connections to the hypothalamus and gustatory brainstem, and indirect connections with the nucleus accumbens. Further, the CeA has been shown to be involved in learning, emotional integration, reward processing, and regulation of feeding. We hypothesized that DBS, which is used to treat movement disorders and other brain dysfunctions, might block reward motivation. In rats performing a lever-pressing task to obtain sugar pellet rewards, we stimulated the CeA and control structures, and compared stimulation parameters. During CeA stimulation, animals stopped working for rewards and rejected freely available rewards. Taste reactivity testing during DBS exposed aversive reactions to normally liked sucrose tastes and even more aversive taste reactions to normally disliked quinine tastes. Interestingly, given the opportunity, animals implanted in the CeA would self-stimulate with 500 ms trains of stimulation at the same frequency and current parameters as continuous stimulation that would stop reward acquisition. Neural recordings during DBS showed that CeA neurons were still active and uncovered inhibitory-excitatory patterns after each stimulus pulse indicating possible entrainment of the neural firing with DBS. In summary, DBS modulation of CeA may effectively usurp normal neural activity patterns to create an 'information lesion' that not only decreased motivational 'wanting' of food rewards, but also blocked 'liking' of rewards.

Is Internet Pornography Causing Sexual Dysfunctions? A Review with Clinical Reports

Traditional factors that once explained men's sexual difficulties appear insufficient to account for the sharp rise in erectile dysfunction, delayed ejaculation, decreased sexual satisfaction, and diminished libido during partnered sex in men under 40. This review (1) considers data from multiple domains, e.g., clinical, biological (addiction/urology), psychological (sexual conditioning), sociological; and (2) presents a series of clinical reports, all with the aim of proposing a possible direction for future research of this phenomenon. Alterations to the brain's motivational system are explored as a possible etiology underlying pornography-related sexual dysfunctions. This review also considers evidence that Internet pornography's unique properties (limitless novelty, potential for easy escalation to more extreme material, video format, etc.) may be potent enough to condition sexual arousal to aspects of Internet pornography use that do not readily transition to real-life partners, such that sex with desired partners may not register as meeting expectations and arousal declines. Clinical reports suggest that terminating Internet pornography use is sometimes sufficient to reverse negative effects, underscoring the need for extensive investigation using methodologies that have subjects remove the variable of Internet pornography use. In the interim, a simple diagnostic protocol for assessing patients with porn-induced sexual dysfunction is put forth.

Neural Activity in the Ventral Pallidum Encodes Variation in the Incentive Value of a Reward Cue

There is considerable individual variation in the extent to which reward cues are attributed with incentive salience. For example, a food-predictive conditioned stimulus (CS; an illuminated lever) becomes attractive, eliciting approach toward it only in some rats ("sign trackers," STs), whereas others ("goal trackers," GTs) approach the food cup during the CS period. The purpose of this study was to determine how individual differences in Pavlovian approach responses are represented in neural firing patterns in the major output structure of the mesolimbic system, the ventral pallidum (VP). Single-unit in vivo electrophysiology was used to record neural activity in the caudal VP during the performance of ST and GT conditioned responses. All rats showed neural responses to both cue onset and reward delivery but, during the CS period, STs showed greater neural activity than GTs both in terms of the percentage of responsive neurons and the magnitude of the change in neural activity. Furthermore, neural activity was positively correlated with the degree of attraction to the cue. Given that the CS had equal predictive value in STs and GTs, we conclude that neural activity in the VP largely reflects the degree to which the CS was attributed with incentive salience.

SIGNIFICANCE STATEMENT

Cues associated with reward can acquire motivational properties (i.e., incentive salience) that cause them to have a powerful influence on desire and motivated behavior. There are individual differences in sensitivity to reward-paired cues, with some individuals attaching greater motivational value to cues than others. Here, we investigated the neural activity associated with these individual differences in incentive salience. We found that cue-evoked neural firing in the ventral pallidum (VP) reflected the strength of incentive motivation, with the greatest neural responses occurring in individuals that demonstrated the strongest attraction to the cue. This suggests that the VP plays an important role in the process by which cues gain control over motivation and behavior.

Transient inactivation of the nucleus accumbens (NAc) shell prominently ameliorates responses to acute stress in female rats

It is clear that the stress response differs between females and males. Moreover, the nucleus accumbens shell is considered a critical area in the brain's response to stress. In the present study we investigate the effect of the transient inactivation of the NAc shell on the metabolic and hormonal disturbance induced by acute stress in female rats. Female Wistar rats were canulated uni- or bilaterally in the NAc shell before stress induction. Electric foot shock was applied to the animals and lidocaine hydrochloride was administered intra-acumbally 5min before each stress session. Food and water intake, delay to eating time, plasma corticosterone, estradiol and progesterone were measured after stress administration. Our results indicate that food intake increased whereas water intake decreased in stress group, furthermore, delay in the onset of eating also was observed. In addition, plasma corticosterone and progesterone concentrations were increased whereas estradiol was decreased. Transient inactivation of right side of NAc shell inhibited the stress effect on food intake; however, the effect of stress was exacerbated when the left part of the NAc shell was inhibited. Transient inactivation of both NAc shell sides augmented the stress effect on water intake. The same results also obtained for the effect of stress on delay to eating time. Lidocaine administration inhibited the effects of stress on all of the hormones we tested. It can be concluded that the NAc shell plays an important role in the mediation of stress responses in female rats and this influence shows asymmetrical manner.

Dorsolateral neostriatum contribution to incentive salience: opioid or dopamine stimulation makes one reward cue more motivationally attractive than another

Pavlovian cues for rewards can become attractive incentives: approached and 'wanted' as the rewards themselves. The motivational attractiveness of a previously learned cue is not fixed, but can be dynamically amplified during re-encounter by simultaneous activation of brain limbic circuitry. Here it was reported that opioid or dopamine microinjections in the dorsolateral quadrant of the neostriatum (DLS) of rats selectively amplify attraction toward a previously learned Pavlovian cue in an individualized fashion, at the expense of a competing cue. In an autoshaping (sign-tracking vs. goal-tracking) paradigm, microinjection of the mu opioid receptor agonist (DAMGO) or dopamine indirect agonist (amphetamine) in the DLS of sign-tracker individuals selectively enhanced their sign-tracking attraction toward the reward-predictive lever cue. By contrast, DAMGO or amphetamine in the DLS of goal-trackers selectively enhanced prepotent attraction toward the reward-proximal cue of sucrose dish. Amphetamine also enhanced goal-tracking in some sign-tracker individuals (if they ever defected to the dish even once). That DLS enhancement of cue attraction was due to stronger motivation, not stronger habits, was suggested by: (i) sign-trackers flexibly followed their cue to a new location when the lever was suddenly moved after DLS DAMGO microinjection; and (ii) DAMGO in the DLS also made sign-trackers work harder on a new instrumental nose-poke response required to earn presentations of their Pavlovian lever cue (instrumental conditioned reinforcement). Altogether, the current results suggest that DLS circuitry can enhance the incentive salience of a Pavlovian reward cue, selectively making that cue a stronger motivational magnet.

Roles of "Wanting" and "Liking" in Motivating Behavior: Gambling, Food, and Drug Addictions

The motivation to seek out and consume rewards has evolutionarily been driven by the urge to fulfill physiological needs. However in a modern society dominated more by plenty than scarcity, we tend to think of motivation as fueled by the search for pleasure. Here, we argue that two separate but interconnected subcortical and unconscious processes direct motivation: "wanting" and "liking." These two psychological and neuronal processes and their related brain structures typically work together, but can become dissociated, particularly in cases of addiction. In drug addiction, for example, repeated consumption of addictive drugs sensitizes the mesolimbic dopamine system, the primary component of the "wanting" system, resulting in excessive "wanting" for drugs and their cues. This sensitizing process is long-lasting and occurs independently of the "liking" system, which typically remains unchanged or may develop a blunted pleasure response to the drug. The result is excessive drug-taking despite minimal pleasure and intense cue-triggered craving that may promote relapse long after detoxification. Here, we describe the roles of "liking" and "wanting" in general motivation and review recent evidence for a dissociation of "liking" and "wanting" in drug addiction, known as the incentive sensitization theory (Robinson and Berridge 1993). We also make the case that sensitization of the "wanting" system and the resulting dissociation of "liking" and "wanting" occurs in both gambling disorder and food addiction.

The role of the opioid system in binge eating disorder

Binge eating disorder is characterized by excessive, uncontrollable consumption of palatable food within brief periods of time. Excessive intake of palatable food is thought to be driven by hedonic, rather than energy homeostatic, mechanisms. However, reward processing does not only comprise consummatory actions; a key component is represented by the anticipatory phase directed at procuring the reward. This phase is highly influenced by environmental food-associated stimuli, which can robustly enhance the desire to eat even in the absence of physiological needs. The opioid system (endogenous peptides and their receptors) has been strongly linked to the rewarding aspects of palatable food intake, and perhaps represents the key system involved in hedonic overeating. Here we review evidence suggesting that the opioid system can also be regarded as one of the systems that regulates the anticipatory incentive processes preceding binge eating hedonic episodes.

Endogenous opioids and feeding behavior: A decade of further progress (2004-2014). A Festschrift to Dr. Abba Kastin

Functional elucidation of the endogenous opioid system temporally paralleled the creation and growth of the journal, Peptides, under the leadership of its founding editor, Dr. Abba Kastin. He was prescient in publishing annual and uninterrupted reviews on Endogenous Opiates and Behavior that served as a microcosm for the journal under his stewardship. This author published a 2004 review, "Endogenous opioids and feeding behavior: a thirty-year historical perspective", summarizing research in this field between 1974 and 2003. The present review "closes the circle" by reviewing the last 10 years (2004-2014) of research examining the role of endogenous opioids and feeding behavior. The review summarizes effects upon ingestive behavior following administration of opioid receptor agonists, in opioid receptor knockout animals, following administration of general opioid receptor antagonists, following administration of selective mu, delta, kappa and ORL-1 receptor antagonists, and evaluating opioid peptide and opioid receptor changes in different food intake models.

Rats that sign-track are resistant to Pavlovian but not instrumental extinction

Individuals vary in the extent to which they attribute incentive salience to a discrete cue (conditioned stimulus; CS) that predicts reward delivery (unconditioned stimulus; US), which results in some individuals approaching and interacting with the CS (sign-trackers; STs) more than others (goal-trackers; GTs). Here we asked how periods of non-reinforcement influence conditioned responding in STs vs. GTs, in both Pavlovian and instrumental tasks. After classifying rats as STs or GTs by pairing a retractable lever (the CS) with the delivery of a food pellet (US), we introduced periods of non-reinforcement, first by simply withholding the US (i.e., extinction training; experiment 1), then by signaling alternating periods of reward (R) and non-reward (NR) within the same session (experiments 2 and 3). We also examined how alternating R and NR periods influenced instrumental responding for food (experiment 4). STs and GTs did not differ in their ability to discriminate between R and NR periods in the instrumental task. However, in Pavlovian settings STs and GTs responded to periods of non-reward very differently. Relative to STs, GTs very rapidly modified their behavior in response to periods of non-reward, showing much faster extinction and better and faster discrimination between R and NR conditions. These results highlight differences between Pavlovian and instrumental extinction learning, and suggest that if a Pavlovian CS is strongly attributed with incentive salience, as in STs, it may continue to bias attention toward it, and to facilitate persistent and relatively inflexible responding, even when it is no longer followed by reward.

Sex and strain influence attribution of incentive salience to reward cues in mice

The propensity to attribute incentive salience to reward cues, measured by Pavlovian sign-tracking, is strongly associated with addiction-related traits including cocaine self-administration, impulsivity, novelty reactivity, and novelty preference. Despite its critical role in addiction, the genetic underpinnings of incentive salience attribution and its relationship to drug addiction are unknown. Mouse genetics can be a powerful means to discover genetic mechanisms underlying this relationship. However, feasibility of genetic dissection of sign-tracking in mice is unknown as only a single study limited to male C57BL/6J mice has rigorously examined this behavior, and limited sign-tracking was observed. Highly diverse mouse populations such as the Collaborative Cross (CC) and Diversity Outbred population (DO) possess a greater range of behavioral and genetic variation than conventional laboratory strains. In the present study, we evaluated sign-tracking and the related phenotype goal-tracking in mice of both sexes from five inbred CC and DO founder strains. Male CAST/EiJ mice exhibited robust sign-tracking; male NOD, male C57BL/6J, and female A/J mice also exhibited significant sign-tracking. Male and female mice from all strains exhibited significant goal-tracking, and significant strain and sex differences were observed. Sign-tracking in males was genetically correlated with exploration of a novel environment, and heritability of sign-tracking and goal-tracking ranged from .32 to .41. These data highlight the importance of considering genetic diversity when evaluating the occurrence of specific behavioral traits in the laboratory mouse and demonstrate that the CC and DO mouse populations can be used to discover mechanisms underlying genetic relationships among sign-tracking and addiction-related behaviors.

Amphetamine-induced sensitization and reward uncertainty similarly enhance incentive salience for conditioned cues

Amphetamine and stress can sensitize mesolimbic dopamine-related systems. In Pavlovian autoshaping, repeated exposure to uncertainty of reward prediction can enhance motivated sign-tracking or attraction to a discrete reward-predicting cue (lever-conditioned stimulus; CS+), as well as produce cross-sensitization to amphetamine. However, it remains unknown how amphetamine sensitization or repeated restraint stress interact with uncertainty in controlling CS+ incentive salience attribution reflected in sign-tracking. Here rats were tested in 3 successive phases. First, different groups underwent either induction of amphetamine sensitization or repeated restraint stress, or else were not sensitized or stressed as control groups (either saline injections only, or no stress or injection at all). All next received Pavlovian autoshaping training under either certainty conditions (100% CS-UCS association) or uncertainty conditions (50% CS-UCS association and uncertain reward magnitude). During training, rats were assessed for sign-tracking to the CS+ lever versus goal-tracking to the sucrose dish. Finally, all groups were tested for psychomotor sensitization of locomotion revealed by an amphetamine challenge. Our results confirm that reward uncertainty enhanced sign-tracking attraction toward the predictive CS+ lever, at the expense of goal-tracking. We also reported that amphetamine sensitization promoted sign-tracking even in rats trained under CS-UCS certainty conditions, raising them to sign-tracking levels equivalent to the uncertainty group. Combining amphetamine sensitization and uncertainty conditions did not add together to elevate sign-tracking further above the relatively high levels induced by either manipulation alone. In contrast, repeated restraint stress enhanced subsequent amphetamine-elicited locomotion, but did not enhance CS+ attraction.

Lateral hypothalamus, nucleus accumbens, and ventral pallidum roles in eating and hunger: interactions between homeostatic and reward circuitry

The study of the neural bases of eating behavior, hunger, and reward has consistently implicated the lateral hypothalamus (LH) and its interactions with mesocorticolimbic circuitry, such as mesolimbic dopamine projections to nucleus accumbens (NAc) and ventral pallidum (VP), in controlling motivation to eat. The NAc and VP play special roles in mediating the hedonic impact (“liking”) and motivational incentive salience (“wanting”) of food rewards, and their interactions with LH help permit regulatory hunger/satiety modulation of food motivation and reward. Here, we review some progress that has been made regarding this circuitry and its functions: the identification of localized anatomical hedonic hotspots within NAc and VP for enhancing hedonic impact; interactions of NAc/VP hedonic hotspots with specific LH signals such as orexin; an anterior-posterior gradient of sites in NAc shell for producing intense appetitive eating vs. intense fearful reactions; and anatomically distributed appetitive functions of dopamine and mu opioid signals in NAc shell and related structures. Such findings help improve our understanding of NAc, VP, and LH interactions in mediating affective and motivation functions, including “liking” and “wanting” for food rewards.

Pleasure systems in the brain

Pleasure is mediated by well-developed mesocorticolimbic circuitry and serves adaptive functions. In affective disorders, anhedonia (lack of pleasure) or dysphoria (negative affect) can result from breakdowns of that hedonic system. Human neuroimaging studies indicate that surprisingly similar circuitry is activated by quite diverse pleasures, suggesting a common neural currency shared by all. Wanting for reward is generated by a large and distributed brain system. Liking, or pleasure itself, is generated by a smaller set of hedonic hot spots within limbic circuitry. Those hot spots also can be embedded in broader anatomical patterns of valence organization, such as in a keyboard pattern of nucleus accumbens generators for desire versus dread. In contrast, some of the best known textbook candidates for pleasure generators, including classic pleasure electrodes and the mesolimbic dopamine system, may not generate pleasure after all. These emerging insights into brain pleasure mechanisms may eventually facilitate better treatments for affective disorders.

Individual variation in the motivational and neurobiological effects of an opioid cue

A discrete cue associated with intravenous injections of cocaine acquires greater control over motivated behavior in some rats ('sign-trackers', STs) than others ('goal-trackers', GTs). It is not known, however, if such variation generalizes to cues associated with other drugs. We asked, therefore, whether a discrete cue (a light) associated with the intravenous administration of an opioid drug (the short-acting mu receptor agonist, remifentanil) acquires incentive motivational properties differently in STs and GTs, as indicated by tests of Pavlovian conditioned approach and conditioned reinforcement. Consistent with studies using cocaine, STs approached a classically conditioned opioid cue more readily than GTs, and in a test of conditioned reinforcement worked more avidly to get it. Interestingly, STs and GTs did not differ in the acquisition of a conditioned orienting response. In addition, the performance of conditioned approach behavior, but not conditioned orientation, was attenuated by pretreatment with the dopamine receptor antagonist, flupenthixol, into the core of the nucleus accumbens. Lastly, food and opioid cues engaged similar amygdalo-striatal-thalamic circuitry to a much greater extent in STs than GTs, as indicated by Fos expression. Taken together, these data demonstrate that, similar to food and cocaine cues: (1) a discrete opioid cue attains greater incentive motivational value in STs than GTs; (2) the attribution of incentive motivational properties to an opioid cue is dopamine dependent; and (3) an opioid cue engages the so-called 'motive circuit' only if it is imbued with incentive salience.

The attribution of incentive salience to Pavlovian alcohol cues: a shift from goal-tracking to sign-tracking

Environmental stimuli that are reliably paired with alcohol may acquire incentive salience, a property that can operate in the use and abuse of alcohol. Here we investigated the incentive salience of Pavlovian alcohol cues using a preclinical animal model. Male, Long-Evans rats (Harlan) with unrestricted access to food and water were acclimated to drinking 15% ethanol (v/v) in their home-cages. Rats then received Pavlovian autoshaping training in which the 10 s presentation of a retractable lever served as the conditioned stimulus (CS) and 15% ethanol served as the unconditioned stimulus (US) (0.2 ml/CS; 12 CS presentations/session; 27 sessions). Next, in an operant test of conditioned reinforcement, nose pokes into an active aperture delivered presentations of the lever-CS, whereas nose pokes into an inactive aperture had no consequences. Across initial autoshaping sessions, goal-tracking behavior, as measured by entries into the fluid port where ethanol was delivered, developed rapidly. However, with extended training goal-tracking diminished, and sign-tracking responses, as measured by lever-CS activations, emerged. Control rats that received explicitly unpaired CS and US presentations did not show goal-tracking or sign-tracking responses. In the test for conditioned reinforcement, rats with CS-US pairings during autoshaping training made more active relative to inactive nose pokes, whereas rats in the unpaired control group did not. Moreover, active nose pokes were positively correlated with sign-tracking behavior during autoshaping. Extended training may produce a shift in the learned properties of Pavlovian alcohol cues, such that after initially predicting alcohol availability they acquire robust incentive salience.

Model-based and model-free Pavlovian reward learning: revaluation, revision, and revelation

Evidence supports at least two methods for learning about reward and punishment and making predictions for guiding actions. One method, called model-free, progressively acquires cached estimates of the long-run values of circumstances and actions from retrospective experience. The other method, called model-based, uses representations of the environment, expectations, and prospective calculations to make cognitive predictions of future value. Extensive attention has been paid to both methods in computational analyses of instrumental learning. By contrast, although a full computational analysis has been lacking, Pavlovian learning and prediction has typically been presumed to be solely model-free. Here, we revise that presumption and review compelling evidence from Pavlovian revaluation experiments showing that Pavlovian predictions can involve their own form of model-based evaluation. In model-based Pavlovian evaluation, prevailing states of the body and brain influence value computations, and thereby produce powerful incentive motivations that can sometimes be quite new. We consider the consequences of this revised Pavlovian view for the computational landscape of prediction, response, and choice. We also revisit differences between Pavlovian and instrumental learning in the control of incentive motivation.

State-dependent μ-opioid modulation of social motivation

Social mammals engage in affiliative interactions both when seeking relief from negative affect and when searching for pleasure and joy. These two motivational states are both modulated by μ-opioid transmission. The μ-opioid receptor (MOR) system in the brain mediates pain relief and reward behaviors, and is implicated in social reward processing and affiliative bonding across mammalian species. However, pharmacological manipulation of the μ-opioid system has yielded opposite effects on rodents and primates: in rodents, social motivation is generally increased by MOR agonists and reduced by antagonists, whereas the opposite pattern has been shown in primates. Here, we address this paradox by taking into account differences in motivational state. We first review evidence for μ-opioid mediation of reward processing, emotion regulation, and affiliation in humans, non-human primates, rodents and other species. Based on the consistent cross-species similarities in opioid functioning, we propose a unified, state-dependent model for μ-opioid modulation of affiliation across the mammalian species. Finally, we show that this state-dependent model is supported by evidence from both rodent and primate studies, when species and age differences in social separation response are taken into account.

Optogenetic excitation of central amygdala amplifies and narrows incentive motivation to pursue one reward above another

Choosing one reward above another is important for achieving adaptive life goals. Yet hijacked into excessive intensity in disorders such as addiction, single-minded pursuit becomes maladaptive. Here, we report that optogenetic channelrhodopsin stimulation of neurons in central nucleus of amygdala (CeA), paired with earning a particular sucrose reward in rats, amplified and narrowed incentive motivation to that single reward target. Therefore, CeA rats chose and intensely pursued only the laser-paired sucrose reward while ignoring an equally good sucrose alternative. In contrast, reward-paired stimulation of basolateral amygdala did not hijack choice. In a separate measure of incentive motivation, CeA stimulation also increased the progressive ratio breakpoint or level of effort exerted to obtain sucrose reward. However, CeA stimulation by itself failed to support behavioral self-stimulation in the absence of any paired external food reward, suggesting that CeA photo-excitation specifically transformed the value of its external reward (rather than adding an internal reinforcement state). Nor did CeA stimulation by itself induce any aversive state that motivated escape. Finally, CeA stimulation also failed to enhance 'liking' reactions elicited by sucrose taste and did not simply increase the general motivation to eat. This pattern suggests that CeA photo-excitation specifically enhances and narrows incentive motivation to pursue an associated external reward at the expense of another comparable reward.