The attribution of incentive salience to a stimulus that signals an intravenous injection of cocaine

Which cue to 'want'? Opioid stimulation of central amygdala makes goal-trackers show stronger goal-tracking, just as sign-trackers show stronger sign-tracking

Pavlovian cues that have been paired with reward can gain incentive salience. Drug addicts find drug cues motivationally attractive and binge eaters are attracted by food cues. But the level of incentive salience elicited by a cue re-encounter still varies across time and brain states. In an animal model, cues become attractive and 'wanted' in an 'autoshaping' paradigm, where different targets of incentive salience emerge for different individuals. Some individuals (sign-trackers) find a predictive discrete cue attractive while others find a reward contiguous goal cue more attractive (location where reward arrives: goal-trackers). Here we assessed whether central amygdala mu opioid receptor stimulation enhances the phasic incentive salience of the goal-cue for goal-trackers during moments of predictive cue presence (expressed in both approach and consummatory behaviors to goal cue), just as it enhances the attractiveness of the predictive cue target for sign-trackers. Using detailed video analysis we measured the approaches, nibbles, sniffs, and bites directed at their preferred target for both sign-trackers and goal-trackers. We report that DAMGO microinjections in central amygdala made goal-trackers, like sign-trackers, show phasic increases in appetitive nibbles and sniffs directed at the goal-cue expressed selectively whenever the predictive cue was present. This indicates enhancement of incentive salience attributed by both goal trackers and sign-trackers, but attributed in different directions: each to their own target cue. For both phenotypes, amygdala opioid stimulation makes the individual's prepotent cue into a stronger motivational magnet at phasic moments triggered by a CS that predicts the reward UCS.

A review of preclinical research demonstrating that drug and non-drug reinforcers differentially affect behavior

This review describes and summarizes current preclinical research revealing important differences between drug and non-drug reinforcers in terms of their effects on behavior. Despite research showing that drugs are not especially strong reinforcers in animals, a number of other behavioral differences potentially relevant to addiction have been reported in studies that have compared drug and non-drug reinforcers. Several of these effects appear only after long-term access to drugs. These include an escalation of drug intake, an increased persistence in responding for the drug, and a decreased sensitivity to the effects of punishers or other suppressors of drug seeking. Further differences between drug and non-drug reinforcers include the effects that reinforcer-paired stimuli have on behavior. Drug cues, as compared to food cues, have been shown to exert greater control over reinforcer-seeking behavior after periods of abstinence. Similarly, behavior previously reinforced by drugs, but not food, has been shown to be susceptible to stress-induced reinstatement after extinction. The behavioral differences between drug and non-drug reinforcers reviewed here may identify special features of drugs that lead to addiction.

The role of conditioning history and reinforcer strength in the reinforcement enhancing effects of nicotine in rats

RATIONALE

Nicotine (NIC) administration can increase behaviors that result in delivery of non-drug reinforcers (e.g., salient sensory stimuli). However, little is known about the circumstances under which NIC increases these behaviors.

OBJECTIVE

The present studies sought to extend the reinforcement enhancing effects of NIC to sucrose rewards for which intensity could be systematically manipulated.

METHOD

In Experiment 1, rats were trained to respond for sucrose (30% w/v) on a progressive ratio (PR) schedule of reinforcement and were pretreated with NIC (0.4 mg/kg free-base) or physiological saline (SAL). The intensity of the sucrose reward was manipulated over subsequent testing sessions (0-60% w/v). Similar procedures were used in Experiment 2; however, each subject received only one sucrose concentration (0-20%) to control for conditioning history. In Experiment 3, a fixed ratio 3 (FR3) schedule of reinforcement was used to investigate putative activating effects of NIC. Experiment 4 investigated whether NIC pretreatment would reduce sucrose intake in limited-access drinks.

RESULTS

In Experiment 1, NIC increased the motivation to obtain all sucrose concentrations, including water. However, when conditioning history was controlled (Experiment 2) the reinforcement enhancing effects of NIC were systematically related to the strength of the reinforcer. In Experiment 3, NIC neither increased nor decreased responding for sucrose. In Experiment 4, NIC reduced sucrose intake, but only at concentrations that resulted in peak drink volumes (5-20%).

CONCLUSION

The results suggest that the reinforcement enhancing effects of NIC depend on conditioning history and do not appear to be the result of simple behavioral activation.

Amphetamine-induced incentive sensitization of sign-tracking behavior in adolescent and adult female rats

Age-specific behavioral and neural characteristics may predispose adolescents to initiate and escalate use of alcohol and drugs. Adolescents may avidly seek novel experiences, including drugs of abuse, because of enhanced incentive motivation for drugs and natural rewards, perhaps especially when that incentive motivation is sensitized by prior drug exposure. Using a Pavlovian conditioned approach (PCA) procedure, sign-tracking (ST) and goal-tracking (GT) behavior was examined in amphetamine-sensitized and control adolescent and adult female Sprague-Dawley rats, with expression of elevated ST behavior used to index enhanced incentive motivation for reward-associated cues. Rats were first exposed to a sensitizing regimen of amphetamine injections (3.0 mg/kg/ml d-amphetamine per day) or given saline (0.9% wt/vol) once daily for 4 days. Expression of ST and GT was then examined over 8 days of PCA training consisting of 25 pairings of an 8-s presentation of an illuminated lever immediately followed by response-independent delivery of a banana-flavored food pellet. Results showed that adults clearly displayed more ST behavior than adolescents, reflected via both more contacts with, and shorter latencies to approach, the lever. Prior amphetamine sensitization increased ST (but not GT) behaviors regardless of age. Thus, when indexed via ST, incentive motivation was found to be greater in adults than adolescents, with a prior history of amphetamine exposure generally sensitizing incentive motivation for cues predicting a food reward regardless of age.

Ethanol drinking-in-the-dark facilitates behavioral sensitization to ethanol in C57BL/6J, BALB/cByJ, but not in mu-opioid receptor deficient CXBK mice

BACKGROUND

Neuroplasticity associated with drug-induced behavioral sensitization has been associated with excessive drug pursuit and consumption characteristic of addiction. Repeated intraperitoneal (ip) injections of ethanol (EtOH) can induce psychomotor sensitization in mice. In terms of its clinical relevance, however, it is important to determine whether this phenomenon can also be produced by voluntary EtOH consumption.

METHODS

The present investigation used a drinking-in-the-dark (DID) methodology to induce high levels of EtOH drinking in mice; EtOH replaces water for 2 or 4h, starting 3h after the beginning of the dark cycle. Animals followed a 3-week DID protocol prior to an evaluation of EtOH-induced locomotor activity (acute and repeated EtOH). For the first week, animals had access to 20% EtOH. On weeks 2 and 3, different concentrations of EtOH (10, 20 or 30%) were used. Three different inbred strains of mice were used: C57BL/6J (B6), BALB/cByJ (BALB), and CXBK. The CXBK mouse line was used because of its reduced expression and functioning of brain mu-opioid receptors, which have been suggested to participate in the development of EtOH-induced sensitization. B6 and BALB mice were used as controls.

RESULTS

B6 and CXBK mice presented comparable levels of EtOH drinking (approx. 3g/kg in 2h), that were higher than those showed by BALB. All animals, regardless of genotype, adjusted volume of EtOH intake to obtain stable g/kg of EtOH across concentrations. Previous EtOH DID produced (B6) or potentiated (BALB) sensitization to EtOH; this effect was not seen in CXBK. Western blot analysis showed a reduced number of mu-opioid receptors in several brain regions of CXBK as compared to that of B6 and BALB mice.

CONCLUSIONS

In summary, here we show that the DID methodology can be used to trigger EtOH-induced neuroplasticity supporting psychomotor sensitization, a process that might require participation of mu-opioid receptors.

Cues paired with either rapid or slower self-administered cocaine injections acquire similar conditioned rewarding properties

The faster drugs of abuse reach the brain, the more addictive they can be. It is not known why this is. Environmental stimuli associated with drugs can promote the development and persistence of addiction by invigorating and precipitating drug-seeking behaviour. We determined, therefore, whether cues associated with the self-administration of rapidly delivered cocaine (injected intravenously over 5 versus 90 seconds) would acquire greater conditioned rewarding properties, as assessed by the performance of an operant response reinforced solely by the cues. Rats nose-poked for intravenous cocaine infusions delivered either over 5 or 90 seconds. Discrete visual cues accompanied each infusion. The rats could then press a lever to obtain the cues—now a conditioned reward—or an inactive lever. Rats in both the 5- and 90-second groups pressed more on the active versus inactive lever following extensive (24 sessions) but not following limited (3 sessions) self-administration training. There were no group differences in this behaviour. Following withdrawal from cocaine self-administration, lever discrimination progressively abated in both groups and was lost by withdrawal day 30. However, the rewarding properties of the cues were not “forgotten” because on withdrawal days 32–33, amphetamine selectively enhanced active-lever pressing, and did so to a similar extent in both groups. Thus, cues paired with rapid or slower cocaine delivery acquire similar conditioned rewarding properties. We conclude, therefore, that the rapid delivery of cocaine to the brain promotes addiction by mechanisms that might not involve a greater ability of drug cues to control behaviour.

Individual variation in the motivational properties of cocaine

Cues in the environment associated with drug use draw the attention of addicts, elicit approach, and motivate drug-seeking and drug-taking behavior, making abstinence difficult. However, preclinical studies have identified large individual differences in the extent to which reward cues acquire these incentive motivational properties. For example, only in some rats does a spatially discrete food cue become attractive, eliciting approach and engagement with it, and acts as an effective conditioned reinforcer. Moreover, a discrete cocaine cue also acquires greater motivational control over behavior in rats prone to attribute incentive salience to a food cue. In this study, we asked whether there is similar individual variation in the extent to which interoceptive cues produced by cocaine itself instigate cocaine-seeking behavior. After quantifying individual variation in the propensity to attribute incentive salience to a food cue, rats were trained to self-administer cocaine in the absence of an explicit conditional stimulus. We then assessed motivation for cocaine by: (1) performance on a progressive ratio schedule, and (2) the degree to which a cocaine 'prime' reinstated cocaine-seeking following extinction of self-administration behavior. We found that rats prone to attribute incentive salience to a food cue worked harder for cocaine, and showed more robust cocaine-induced reinstatement. We conclude that there is considerable individual variation in the motivational properties of cocaine itself, and this can be predicted by the propensity to attribute incentive salience to reward cues.

Reversal of apomorphine locomotor sensitization by a single post-conditioning trial treatment with a low autoreceptor dose of apomorphine: a memory re-consolidation approach

Sensitization is a common feature of psychostimulants and sensitization effects are generally considered to be linked to the addictive properties of these drugs. We used a conventional paired/unpaired Pavlovian protocol to induce a context specific sensitization to the locomotor stimulant effect of a high dose of apomorphine (2.0mg/kg). Two days following a 5 session sensitization induction phase, a brief 5min non-drug test for conditioning was conducted. Only the paired groups exhibited locomotor stimulant conditioned response effects. Immediately following this brief test for conditioning, the paired and the unpaired groups received injections of 0.05mg/kg apomorphine, 2.0mg/kg apomorphine or vehicle designed to differentially impact memory re-consolidation of the conditioning. Two days later, all groups received a sensitization challenge test with 2.0mg/kg apomorphine. The 2.0mg/kg apomorphine post-trial treatment potentiated sensitization while the 0.05mg/kg eliminated sensitization. These effects were only observed in the paired groups. The activation of dopaminergic systems by the high dose of apomorphine strengthened the drug/environment association whereas the inhibition of dopamine activity by the low auto-receptor dose eliminated this association. The results point to the importance of conditioning to context specific sensitization and targeting memory re-consolidation of conditioning as a paradigm to modify sensitization.

Cue-reactors: individual differences in cue-induced craving after food or smoking abstinence

Background

Pavlovian conditioning plays a critical role in both drug addiction and binge eating. Recent animal research suggests that certain individuals are highly sensitive to conditioned cues, whether they signal food or drugs. Are certain humans also more reactive to both food and drug cues?

Methods

We examined cue-induced craving for both cigarettes and food, in the same individuals (n = 15 adult smokers). Subjects viewed smoking-related or food-related images after abstaining from either smoking or eating.

Results

Certain individuals reported strong cue-induced craving after both smoking and food cues. That is, subjects who reported strong cue-induced craving for cigarettes also rated stronger cue-induced food craving.

Conclusions

In humans, like in nonhumans, there may be a “cue-reactive” phenotype, consisting of individuals who are highly sensitive to conditioned stimuli. This finding extends recent reports from nonhuman studies. Further understanding this subgroup of smokers may allow clinicians to individually tailor therapies for smoking cessation.

The psychological and neurochemical mechanisms of drug memory reconsolidation: implications for the treatment of addiction

Memory reconsolidation is the process by which memories, destabilised at retrieval, require restabilisation to persist in the brain. It has been demonstrated that even old, well-established memories require reconsolidation following retrieval; therefore, memory reconsolidation could potentially be exploited to disrupt, or even erase, aberrant memories that underlie psychiatric disorders, thereby providing a novel therapeutic target. Drug addiction is one such disorder; it is both chronic and relapsing, and one prominent risk factor for a relapse episode is the presentation of environmental cues that have previously been associated with drugs of abuse. This 'cue-induced relapse' can be accounted for in psychological terms by reinforcing memories of the pavlovian association between the cue and the drug, which can thus influence behaviour through at least three psychologically and neurobiologically dissociable mechanisms: conditioned reinforcement, conditioned approach and conditioned motivation. As each of these psychological processes could contribute to the resumption of drug-seeking following abstinence, it is important to develop treatments that can reduce drug-seeking re-established via influences on each or all of these pavlovian processes, in order to minimise the risk of a subsequent relapse. Investigation of the memory reconsolidation mechanisms of the memories underlying conditioned reinforcement, conditioned approach and conditioned motivation indicate that they depend upon different neurochemical systems, including the glutamatergic and adrenergic systems within limbic corticostriatal circuitry. We also discuss here the subsequent translation to the clinic of this preclinical work.

A cocaine cue acts as an incentive stimulus in some but not others: implications for addiction

BACKGROUND

In addicts drug cues attract attention, elicit approach, and motivate drug-seeking and drug-taking behavior, and addicts find it difficult to resist such cues. In preclinical studies we have found, however, that food cues acquire incentive motivational properties only in a subset of individuals. For example, a food cue becomes attractive, eliciting approach and engagement with it, and acts as an effective conditional reinforcer in some rats but not others. We asked, therefore, whether rats that have a propensity to attribute incentive salience to a food cue are the same ones that attribute incentive value to a drug (cocaine) cue.

METHODS

We first used a Pavlovian conditioned approach procedure to determine which individual rats attributed incentive salience to a food cue. A second cue was then associated with the IV self-administration of cocaine. Later, the ability of the cocaine cue to maintain self-administration behavior and to reinstate self-administration after extinction was assessed.

RESULTS

We report that in individuals that had a propensity to attribute incentive salience to a food cue, a cocaine cue spurred motivation to take drugs (its removal greatly diminished self-administration) and reinstated robust drug-seeking after extinction. However, in those individuals that failed to attribute incentive salience to a food cue, the cocaine cue was relatively devoid of incentive motivational properties.

CONCLUSIONS

We conclude that it is possible to determine, before any drug experience, which individuals will most likely have difficulty resisting drug cues, a trait that might confer susceptibility to addiction.

An animal model of genetic vulnerability to behavioral disinhibition and responsiveness to reward-related cues: implications for addiction

Rats selectively bred based on high or low reactivity to a novel environment were characterized for other behavioral and neurobiological traits thought to be relevant to addiction vulnerability. The two lines of animals, which differ in their propensity to self-administer drugs, also differ in the value they attribute to cues associated with reward, in impulsive behavior, and in their dopamine system. When a cue was paired with food or cocaine reward bred high-responder rats (bHRs) learned to approach the cue, whereas bred low-responder rats (bLRs) learned to approach the location of food delivery, suggesting that bHRs but not bLRs attributed incentive value to the cue. Moreover, although less impulsive on a measure of 'impulsive choice', bHRs were more impulsive on a measure of 'impulsive action'- ie, they had difficulty withholding an action to receive a reward, indicative of 'behavioral disinhibition'. The dopamine agonist quinpirole caused greater psychomotor activation in bHRs relative to bLRs, suggesting dopamine supersensitivity. Indeed, relative to bLRs, bHRs also had a greater proportion of dopamine D2(high) receptors, the functionally active form of the receptor, in the striatum, in spite of lower D2 mRNA levels and comparable total D2 binding. In addition, fast-scan cyclic voltammetry revealed that bHRs had more spontaneous dopamine 'release events' in the core of the nucleus accumbens than bLRs. Thus, bHRs exhibit parallels to 'externalizing disorders' in humans, representing a genetic animal model of addiction vulnerability associated with a propensity to attribute incentive salience to reward-related cues, behavioral disinhibition, and increased dopaminergic 'tone.'

Effects of disconnection of amygdala dopamine and nucleus accumbens N-methyl-d-aspartate receptors on ethanol-seeking behavior in mice

There is a strong interest in harnessing the genetic manipulations that are possible in mice to investigate the functional neural mechanisms modulating the associative processes that control drug-seeking behavior. However, it is unknown whether intracranial techniques, such as the disconnection procedure commonly used in rats to examine serial connectivity between implicated areas, can be successfully applied to mice. We have previously demonstrated that the expression of ethanol-seeking behavior in mice is dependent upon amygdala (Amy) dopamine and nucleus accumbens (Acb) N-methyl-d-aspartate (NMDA) receptor activation (Gremel & Cunningham, 2009). Here, we used a neuropharmacological disconnection procedure to investigate whether dopamine activation of the Amy directly leading to increases in Acb glutamate release and binding of NMDA receptors modulates the expression of ethanol-seeking behavior. Immediately before testing the expression of an ethanol-induced conditioned place preference, mice were given an Amy infusion of flupenthixol and either an ipsilateral or contralateral Acb infusion of AP-5. Although both ipsilateral and contralateral manipulations reduced the expression of ethanol conditioned place preference, in a separate experiment we demonstrated that a unilateral Acb infusion of AP-5, but not Amy flupenthixol, is sufficient to disrupt preference. The finding of a significant blockade by unilateral AP-5 into the Acb precludes any conclusions about a unique role for the Amy/Acb neuroanatomical connection in this model of ethanol-seeking behavior. Further, the current results suggest potential limitations in transferring techniques from rats to mice in order to study serial interactions between neural areas underlying motivated behaviors. Nevertheless, these findings provide evidence showing that Acb NMDA receptors play an important role in the expression of ethanol-conditioned behavior.

Influence of conditioned reinforcement on the response-maintaining effects of quinpirole in rats

D2-like agonists, such as quinpirole, maintain responding in monkeys, rats, and mice when they are substituted for cocaine. This study examined the influence of operant history and cocaine-paired stimuli (CS) on quinpirole-maintained responding in rats trained to nose poke for cocaine. Upon acquisition of responding for cocaine, substitutions were performed in the presence or absence of injection-CS pairings. Although cocaine maintained responding regardless of whether injections were accompanied by CS, quinpirole maintained responding only when CS were paired with injections. To assess the influence of operant history, injections of cocaine, quinpirole, remifentanil, nicotine, or saline were made available on a previously inactive lever, while nose pokes continued to result in CS presentation. Although responding was reallocated from the nose poke to the lever when cocaine or remifentanil was available, lever presses remained low, and nose poking persisted when quinpirole or nicotine was made contingent upon lever presses. Finally, quinpirole pretreatments resulted in high rates of nose poking when nose pokes resulted in CS presentation alone, but failed to maintain nose poking when the CS was omitted. Taken together, these results suggest that the response-maintaining effects of quinpirole are primarily mediated by an enhancement of the conditioned reinforcing effects of earlier CS, rather than by a reinforcing effect of quinpirole.

Regional specificity in the real-time development of phasic dopamine transmission patterns during acquisition of a cue-cocaine association in rats

Drug seeking is significantly regulated by drug-associated cues and associative learning between environmental cues and cocaine reward is mediated by dopamine transmission within the nucleus accumbens (NAc). However, dopamine transmission during early acquisition of a cue-cocaine association has never been assessed because of the technical difficulties associated with resolving cue-evoked and cocaine-evoked dopamine release within the same conditioning trial. Here, we used fast-scan cyclic voltammetry to measure sub-second fluctuations in dopamine concentration within the NAc core and shell during the initial acquisition of a cue-cocaine Pavlovian association. Within the NAc core, cue-evoked dopamine release developed during conditioning. However, within the NAc shell, the predictive cue appeared to cause an unconditioned decrease in dopamine concentration. The pharmacological effects of cocaine also differed between sub-regions, as cocaine increased phasic dopamine release events within the NAc shell but not the core. Thus, real-time measurements not only revealed the initial development of a conditioned neurochemical response but also demonstrated differential phasic dopamine transmission patterns across NAc sub-regions during the acquisition of a cue-cocaine association.

A neural computational model of incentive salience

Incentive salience is a motivational property with 'magnet-like' qualities. When attributed to reward-predicting stimuli (cues), incentive salience triggers a pulse of 'wanting' and an individual is pulled toward the cues and reward. A key computational question is how incentive salience is generated during a cue re-encounter, which combines both learning and the state of limbic brain mechanisms. Learning processes, such as temporal-difference models, provide one way for stimuli to acquire cached predictive values of rewards. However, empirical data show that subsequent incentive values are also modulated on the fly by dynamic fluctuation in physiological states, altering cached values in ways requiring additional motivation mechanisms. Dynamic modulation of incentive salience for a Pavlovian conditioned stimulus (CS or cue) occurs during certain states, without necessarily requiring (re)learning about the cue. In some cases, dynamic modulation of cue value occurs during states that are quite novel, never having been experienced before, and even prior to experience of the associated unconditioned reward in the new state. Such cases can include novel drug-induced mesolimbic activation and addictive incentive-sensitization, as well as natural appetite states such as salt appetite. Dynamic enhancement specifically raises the incentive salience of an appropriate CS, without necessarily changing that of other CSs. Here we suggest a new computational model that modulates incentive salience by integrating changing physiological states with prior learning. We support the model with behavioral and neurobiological data from empirical tests that demonstrate dynamic elevations in cue-triggered motivation (involving natural salt appetite, and drug-induced intoxication and sensitization). Our data call for a dynamic model of incentive salience, such as presented here. Computational models can adequately capture fluctuations in cue-triggered 'wanting' only by incorporating modulation of previously learned values by natural appetite and addiction-related states.

Effects of abstinence or extinction on cocaine seeking as a function of withdrawal duration

The resumption of drug-seeking behavior after abstinence or extinction is commonly studied model for relapse in addiction. For the benefits of extinction training over a given withdrawal period to be determined, it is necessary to discriminate between the potentially overlapping occurrence of incubation with that of spontaneous recovery. This comparison has been assessed using a between-subjects design in groups of abstinent and extinguished rats tested at various withdrawal periods after cocaine self-administration. Multiple forms of priming were used to evoke the resumption of drug seeking, as different priming stimuli have been reported to use distinct neurobiological mechanisms and therefore may exhibit different temporal characteristics. In abstinent animals (30 days), neither the noncontingent conditioned stimuli-primed nor the noncontingent cocaine-primed drug seeking displayed incubation, whereas the drug seeking provoked by exposure to the contextual cues of the operant chamber significantly increased. In extinguished animals, evidence of spontaneous recovery of responding was observed after priming with exposure to either contextual or cocaine-priming stimuli. Finally, extinction training remained effective in reducing the reinstatement response levels after contextual or cocaine priming even if such training was initiated after an extended period (24 days) of abstinence. These findings provide further insight into the time-dependent effects of abstinence and extinction on the resumption of drug-seeking behavior.

Which cue to "want?" Central amygdala opioid activation enhances and focuses incentive salience on a prepotent reward cue

The central nucleus of the amygdala (CeA) helps translate learning into motivation, and here, we show that opioid stimulation of CeA magnifies and focuses learned incentive salience onto a specific reward cue (pavlovian conditioned stimulus, or CS). This motivation enhancement makes that cue more attractive, noticeable, and liable to elicit appetitive and consummatory behaviors. To reveal the focusing of incentive salience, we exploited individual differences in an autoshaping paradigm in which a rat prefers to approach, nibble, and sniff one of two reward-associated stimuli (its prepotent stimulus). The individually prepotent cue is either a predictive CS+ that signals reward (8 s metal lever insertion) or instead the metal cup that delivers sucrose pellets (the reward source). Results indicated that CeA opioid activation by microinjection of the mu agonist DAMGO (0.1 microg) selectively and reversibly enhanced the attractiveness of whichever reward CS was that rat's prepotent cue. CeA DAMGO microinjections made rats more vigorously approach their particular prepotent CS and to energetically sniff and nibble it in a nearly frenzied consummatory manner. Only the prepotent cue was enhanced as an incentive target, and alternative cues were not enhanced. Conversely, inactivation of CeA by muscimol microinjection (0.25 microg) suppressed approach, nibbles, and sniffs of the prepotent CS. Confirming modulation of incentive salience, unconditioned food intake was similarly increased by DAMGO microinjection and decreased by muscimol in CeA. We conclude that opioid neurotransmission in CeA helps determine which environmental stimuli become most "wanted," and how "wanted" they become. This may powerfully guide reward-seeking behavior.

Involvement of amygdala dopamine and nucleus accumbens NMDA receptors in ethanol-seeking behavior in mice

Although progress has been made identifying neural mechanisms underlying ethanol's primary reinforcing effects, few studies have examined the mechanisms mediating ethanol-induced conditioned effects. A recent lesion study suggests that expression of ethanol-conditioned behaviors depends upon an intact amygdala and nucleus accumbens core. However, specific mechanisms within these nuclei are unknown. In the present experiments, we used site-specific microinfusions of dopamine and NMDA receptor antagonists to examine the roles of accumbens and amygdala in the expression of ethanol conditioned place preference (CPP) in mice. In experiments 1 and 2, a D1/D2/D3 receptor antagonist (flupenthixol) was infused into accumbens or amygdala before testing, whereas experiment 3 used pretest infusions of an NMDA antagonist (AP-5) to examine the role of intra-accumbens NMDA receptors. Dopamine antagonism of accumbens was without effect, but intra-amygdala infusions of flupenthixol blocked CPP expression. Moreover, this effect was dependent upon dopamine antagonism within the basolateral nucleus but not the central nucleus of the amygdala. Antagonism of NMDA receptors in accumbens also blocked CPP expression. The present findings suggest that expression of the ethanol-conditioned response depends upon amygdala dopamine and accumbens NMDA receptors. These are the first studies in any species to show a role for amygdala dopamine receptors and the first studies in mice to implicate accumbens NMDA receptors in ethanol-induced conditioned effects.

Dissecting components of reward: 'liking', 'wanting', and learning

In recent years significant progress has been made delineating the psychological components of reward and their underlying neural mechanisms. Here we briefly highlight findings on three dissociable psychological components of reward: 'liking' (hedonic impact), 'wanting' (incentive salience), and learning (predictive associations and cognitions). A better understanding of the components of reward, and their neurobiological substrates, may help in devising improved treatments for disorders of mood and motivation, ranging from depression to eating disorders, drug addiction, and related compulsive pursuits of rewards.

Review. The incentive sensitization theory of addiction: some current issues

We present a brief overview of the incentive sensitization theory of addiction. This posits that addiction is caused primarily by drug-induced sensitization in the brain mesocorticolimbic systems that attribute incentive salience to reward-associated stimuli. If rendered hypersensitive, these systems cause pathological incentive motivation ('wanting') for drugs. We address some current questions including: what is the role of learning in incentive sensitization and addiction? Does incentive sensitization occur in human addicts? Is the development of addiction-like behaviour in animals associated with sensitization? What is the best way to model addiction symptoms using animal models? And, finally, what are the roles of affective pleasure or withdrawal in addiction?

Parallel and interactive learning processes within the basal ganglia: relevance for the understanding of addiction

In this review we discuss the evidence that drug addiction, defined as a maladaptive compulsive habit, results from the progressive subversion by addictive drugs of striatum-dependent operant and Pavlovian learning mechanisms that are usually involved in the control over behaviour by stimuli associated with natural reinforcement. Although mainly organized through segregated parallel cortico-striato-pallido-thalamo-cortical loops involved in motor or emotional functions, the basal ganglia, and especially the striatum, are key mediators of the modulation of behavioural responses, under the control of both action-outcome and stimulus-response mechanisms, by incentive motivational processes and Pavlovian associations. Here we suggest that protracted exposure to addictive drugs recruits serial and dopamine-dependent, striato-nigro-striatal ascending spirals from the nucleus accumbens to more dorsal regions of the striatum that underlie a shift from action-outcome to stimulus-response mechanisms in the control over drug seeking. When this progressive ventral to dorsal striatum shift is combined with drug-associated Pavlovian influences from limbic structures such as the amygdala and the orbitofrontal cortex, drug seeking behaviour becomes established as an incentive habit. This instantiation of implicit sub-cortical processing of drug-associated stimuli and instrumental responding might be a key mechanism underlying the development of compulsive drug seeking and the high vulnerability to relapse which are hallmarks of drug addiction.

The influence of subthalamic nucleus lesions on sign-tracking to stimuli paired with food and drug rewards: facilitation of incentive salience attribution?

It is well known that the subthalamic nucleus (STN) plays an important role in regulating motor function, but recent studies suggest the STN is also involved in regulating motivated behavior. For example, bilateral lesions of the STN increase motivation for both food and cocaine as assessed by 'breakpoint' on a progressive ratio schedule. However, the psychological mechanism(s) by which STN lesions increase motivation for rewards is unknown. We hypothesized that STN lesions might influence one specific component of motivation, the attribution of incentive value (incentive salience) to reward-related cues. We tested this hypothesis by quantifying the ability of a discrete cue that had been paired with the non-contingent delivery of either food or cocaine to elicit approach towards it (ie, to produce a 'sign-tracking' conditioned response, CR). STN lesions made prior to training increased asymptotic levels of sign-tracking behavior directed towards a cue paired with either food or cocaine. In addition, when STN lesions were made after animals had already undergone Pavlovian training, and animals were tested under extinction conditions, the STN lesion still facilitated a sign-tracking CR. Finally, reintroduction of the US (food) following extinction immediately restored robust sign-tracking behavior in animals with STN lesions. We speculate, therefore, that the STN is part of a neural system that moderates the amount of incentive salience attributed to reward-related stimuli. Activity in this neural system may help mitigate the development of compulsive behavioral disorders, such as addiction, which are characterized by pathological control over behavior by reward-associated cues.

Affective neuroscience of pleasure: reward in humans and animals

INTRODUCTION

Pleasure and reward are generated by brain circuits that are largely shared between humans and other animals.

DISCUSSION

Here, we survey some fundamental topics regarding pleasure mechanisms and explicitly compare humans and animals.

CONCLUSION

Topics surveyed include liking, wanting, and learning components of reward; brain coding versus brain causing of reward; subjective pleasure versus objective hedonic reactions; roles of orbitofrontal cortex and related cortex regions; subcortical hedonic hotspots for pleasure generation; reappraisals of dopamine and pleasure-electrode controversies; and the relation of pleasure to happiness.

Individual differences in the attribution of incentive salience to reward-related cues: Implications for addiction

Drugs of abuse acquire different degrees of control over thoughts and actions based not only on the effects of drugs themselves, but also on predispositions of the individual. Those individuals who become addicted are unable to shift their thoughts and actions away from drugs and drug-associated stimuli. Thus in addicts, exposure to places or things (cues) that has been previously associated with drug-taking often instigates renewed drug-taking. We and others have postulated that drug-associated cues acquire the ability to maintain and instigate drug-taking behavior in part because they acquire incentive motivational properties through Pavlovian (stimulus-stimulus) learning. In the case of compulsive behavioral disorders, including addiction, such cues may be attributed with pathological incentive value ("incentive salience"). For this reason, we have recently begun to explore individual differences in the tendency to attribute incentive salience to cues that predict rewards. When discrete cues are associated with the non-contingent delivery of food or drug rewards some animals come to quickly approach and engage the cue even if it is located at a distance from where the reward will be delivered. In these animals the reward-predictive cue itself becomes attractive, eliciting approach towards it, presumably because it is attributed with incentive salience. Animals that develop this type of conditional response are called "sign-trackers". Other animals, "goal-trackers", do not approach the reward-predictive cue, but upon cue presentation they immediately go to the location where food will be delivered (the "goal"). For goal-trackers the reward-predictive cue is not attractive, presumably because it is not attributed with incentive salience. We review here preliminary data suggesting that these individual differences in the tendency to attribute incentive salience to cues predictive of reward may confer vulnerability or resistance to compulsive behavioral disorders, including addiction. It will be important, therefore, to study how environmental, neurobiological and genetic interactions determine the extent to which individuals attribute incentive value to reward-predictive stimuli.

Behavioral characteristics and neurobiological substrates shared by Pavlovian sign-tracking and drug abuse

Drug abuse researchers have noted striking similarities between behaviors elicited by Pavlovian sign-tracking procedures and prominent symptoms of drug abuse. In Pavlovian sign-tracking procedures, repeated paired presentations of a small object (conditioned stimulus, CS) with a reward (unconditioned stimulus, US) elicits a conditioned response (CR) that typically consists of approaching the CS, contacting the CS, and expressing consummatory responses at the CS. Sign-tracking CR performance is poorly controlled and exhibits spontaneous recovery and long-term retention, effects that resemble relapse. Sign-tracking resembles psychomotor activation, a syndrome of behavioral responses evoked by addictive drugs, and the effects of sign-tracking on corticosterone levels and activation of dopamine pathways resemble the neurobiological effects of abused drugs. Finally, the neurobiological profile of individuals susceptible to sign-tracking resembles the pathophysiological profile of vulnerability to drug abuse, and vulnerability to sign-tracking predicts vulnerability to impulsive responding and alcohol self-administration. Implications of sign-tracking for models of drug addiction are considered.

Effects of acute tyrosine/phenylalanine depletion on the selective processing of smoking-related cues and the relative value of cigarettes in smokers

RATIONALE

Acute tyrosine/phenylalanine depletion (ATPD) is a validated neurobiological challenge that results in reduced dopaminergic neurotransmission, allowing examination of the effects of a hypodopaminergic state on craving-related processes.

OBJECTIVES

We studied 16 nonabstaining smokers (>10 cigarettes/day; 9 males; age 20-33 years) to whom was administered a tyrosine/phenylalanine-free mixture (TYR/PHE-free) and a balanced amino acid mixture (BAL) in a double-blind, counterbalanced, crossover design.

METHODS

Subjective cigarette craving, attentional bias to smoking-related word cues, relative value of cigarettes, negative mood, and expired carbon monoxide (CO) levels were measured at various timepoints through 300 min. Participants smoked at hourly intervals to prevent acute nicotine withdrawal during testing.

RESULTS

The TYR/PHE-free mixture, as compared to the BAL mixture, was associated with a greater increase in CO levels from baseline (p = 0.01). Adjusting for the potential confounding influence of between-condition differences in CO levels across time, TYR/PHE-free mixture was associated with increased demand for cigarettes (p = 0.01) and decreased attentional bias toward smoking-related words (p = 0.003). There were no significant differences between conditions in either subjective craving or depressed or anxious mood (p values > 0.05).

CONCLUSION

Among nonabstaining daily smokers, acute dopaminergic depletion via ATPD may influence smoking behavior and indices of smoking-related motivation, such as attentional bias to smoking cues and relative cigarette value, which are not readily captured by subjective craving.

Goal- and signal-directed incentive: conditioned approach, seeking, and consumption established with unsweetened alcohol in rats

RATIONALE

Many theories of addictive behavior propose that cues signaling drug administration influence the likelihood of drug-taking and drug-seeking behavior.

OBJECTIVES

We investigated the behavioral impact of cues associated with unsweetened ethanol and their interaction with responding maintained by ethanol self-administration. Our goal was to establish the influence of such cues on ethanol seeking.

MATERIALS AND METHODS

The experiment used a matching contingency and saccharin-fading procedure to establish equal levels of responding to two spatially distinct levers using unsweetened 10% ethanol solution. After ethanol self-administration was established, a brief cue light located alternately over each lever location was either paired or unpaired (control) with the opportunity to consume the same ethanol solution. Finally, self-administration was re-established, and the effect of the cue was measured in a transfer design.

RESULTS

The reaction to lights paired with the opportunity to ingest unsweetened ethanol had three main effects: (1) induction of operant behavior reinforced by ethanol, (2) stimulation of ethanol-seeking behavior (drinker entries), and (3) cue-directed approach and contact behavior (i.e. autoshaping or sign-tracking). Cue-directed behavior to the light interacted with choice behavior in a manner predicted by the location of the cue light, enhancing responding only when the approach response did not interfere with the operant response.

CONCLUSIONS

These findings replicate and extend the effects of Pavlovian conditioning on ethanol-seeking and support-conditioned incentive theories of addictive behavior. Signals for ethanol influence spatial choice behavior and may be relevant to attentional bias shown to alcohol-associated stimuli in humans.

Individual differences in the attribution of incentive salience to a reward-related cue: influence on cocaine sensitization

When a discrete cue (a "sign") is presented repeatedly in anticipation of a food reward the cue can become imbued with incentive salience, leading some animals to approach and engage it, a phenomenon known as "sign-tracking" (the animals are sign-trackers; STs). In contrast, other animals do not approach the cue, but upon cue presentation go to the location where food will be delivered (the goal). These animals are known as goal-trackers (GTs). It has been hypothesized that individuals who attribute excessive incentive salience to reward-related cues may be especially vulnerable to develop compulsive behavioral disorders, including addiction. We were interested, therefore, in whether individual differences in the propensity to sign-track are associated with differences in responsivity to cocaine. Using an autoshaping procedure in which lever (conditioned stimulus) presentation was immediately followed by the response-independent delivery of a food pellet (unconditioned stimulus), rats were first characterized as STs or GTs and subsequently studied for the acute psychomotor response to cocaine and the propensity for cocaine-induced psychomotor sensitization. We found that GTs were more sensitive than STs to the acute locomotor activating effects of cocaine, but STs showed a greater propensity for psychomotor sensitization upon repeated treatment. These data suggest that individual differences in the tendency to attribute incentive salience to a discrete reward-related cue, and to approach and engage it, are associated with susceptibility to a form of cocaine-induced plasticity that may contribute to the development of addiction.

Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens

The ability to predict favorable outcomes using environmental cues is an essential part of learned behavior. Dopamine neurons in the midbrain encode such stimulus-reward relationships in a manner consistent with contemporary learning models, but it is unclear how encoding this translates into actual dopamine release in target regions. Here, we sampled dopamine levels in the rat nucleus accumbens on a rapid (100 ms) timescale using electrochemical technology during a classical conditioning procedure. Early in conditioning, transient dopamine-release events signaled a primary reward, but not predictive cues. After repeated cue-reward pairings, dopamine signals shifted in time to predictive cue onset and were no longer observed at reward delivery. In the absence of stimulus-reward conditioning, there was no shift in the dopamine signal. Consistent with proposed roles in reward prediction and incentive salience, these results indicate that rapid dopamine release provides a reward signal that is dynamically modified by associative learning.

Explaining the escalation of drug use in substance dependence: models and appropriate animal laboratory tests

Escalation of drug use, a hallmark of drug dependence, has traditionally been interpreted as reflecting the development of tolerance to the drug's effects. However, on the basis of animal behavioral data, several groups have recently proposed alternative explanations, i.e. that such an escalation of drug use might not be based on (1) tolerance, but rather be indicative of (2) sensitization to the drug's reinforcing effect, (3) reward allostasis, (4) an increase in the incentive salience of drug-associated stimuli, (5) an increase in the reinforcing strength of the drug reinforcer relative to alternative reinforcers, or (6) habit formation. From the pharmacological perspective, models 1-3 allow predictions about the change in the shape of drug dose-effect curves that are based on mathematically defined models governing receptor-ligand interaction and signal transduction. These predictions are tested in the present review, which also describes the other currently championed models for drug use escalation and other components of apparent 'reinforcement' (in its original meaning, like 'tolerance' or 'sensitization', a purely descriptive term). It evaluates the animal experimental approaches employed to support or prove the existence of each of the models and reinforcement components, and recapitulates the clinical evidence, which strongly suggests that escalation of drug use is predominantly based on an increase in the frequency of intoxication events rather than an increase in the dose taken at each intoxication event. Two apparent discrepancies in animal experiments are that (a) sensitization to overall reinforcement has been found more often for psychostimulants than for opioids, and that (b) tolerance to the reinforcing and other effects has been observed more often for opioids than for cocaine. These discrepancies are resolved by the finding that cocaine levels seem to be more tightly regulated at submaximum reinforcing levels than opioid levels are. Consequently, animals self-administering opioids are more likely to expose themselves to higher above-threshold doses than animals self-administering psychostimulants, rendering the development of tolerance to opioids more likely than tolerance to psychostimulants. The review concludes by making suggestions on how to improve the current behavioral experimental approaches.

Rapid induction of Pavlovian approach to an ethanol-paired visual cue in mice

RATIONALE

Although many studies have shown Pavlovian conditioned approach to cues paired with natural reinforcers, it has been quite difficult to induce such behavior with drug reinforcers.

OBJECTIVES

This experiment tested a novel Pavlovian procedure for inducing approach to a conditioned stimulus (CS) paired with ethanol.

METHODS

Mice (NZB/B1NJ, DBA/2J) received intraperitoneal injections of ethanol (2 g/kg) immediately before 10-min exposure to a rectangular chamber that contained a distinctive visual cue (star) at one end (Paired group, CS+ trials). On alternate days, saline injection preceded apparatus exposure with no distinctive cues (CS- trials). Unpaired control mice received ethanol in the home cage 60-75 min after each CS+ trial.

RESULTS

NZB/B1NJ Paired group mice spent increasing amounts of time (>85% of the session) in proximity to the star, whereas Unpaired group mice did not. DBA/2J Paired group mice spent slightly more time on the star side than Unpaired group mice but did not show an acquisition curve. Postconditioning tests showed a strong preference for the star side in Paired groups from both strains after saline injection. However, only NZB/B1NJ mice showed a preference after ethanol.

CONCLUSIONS

This study provides the first unambiguous demonstration of Pavlovian conditioned approach to an ethanol-paired visual stimulus in the absence of any contingency between the animal's behavior and drug exposure. This effect, which is remarkable both in terms of its magnitude and the rapidity with which it was produced (within 2-3 trials), may be related to the cue-associated craving that accompanies alcohol and drug addiction.

Individual differences in the propensity to approach signals vs goals promote different adaptations in the dopamine system of rats

RATIONALE

The way an individual responds to cues associated with rewards may be a key determinant of vulnerability to compulsive behavioral disorders.

OBJECTIVES

We studied individual differences in Pavlovian conditioned approach behavior and examined the expression of neurobiological markers associated with the dopaminergic system, the same neural system implicated in incentive motivational processes.

METHODS

Pavlovian autoshaping procedures consisted of the brief presentation of an illuminated retractable lever (conditioned stimulus) followed by the response-independent delivery of a food pellet (unconditioned stimulus), which lead to a Pavlovian conditioned response. In situ hybridization was performed on brains obtained either following the first or last (fifth) day of training.

RESULTS

Two phenotypes emerged. Sign-trackers (ST) exhibited behavior that seemed to be largely controlled by the cue that signaled impending reward delivery; whereas goal-trackers (GT) preferentially approached the location where the reward was delivered. Following a single training session, ST showed greater expression of dopamine D1 receptor mRNA relative to GT. After 5 days of training, GT exhibited greater expression levels of tyrosine hydroxylase, dopamine transporter, and dopamine D2 receptor mRNA relative to ST.

CONCLUSIONS

These findings suggest that the development of approach behavior towards signals vs goal leads to distinct adaptations in the dopamine system. The sign-tracker vs goal-tracker phenotype may prove to be a valuable animal model to investigate individual differences in the way incentive salience is attributed to environmental stimuli, which may contribute to the development of addiction and other compulsive behavioral disorders.

The debate over dopamine's role in reward: the case for incentive salience

INTRODUCTION

Debate continues over the precise causal contribution made by mesolimbic dopamine systems to reward. There are three competing explanatory categories: 'liking', learning, and 'wanting'. Does dopamine mostly mediate the hedonic impact of reward ('liking')? Does it instead mediate learned predictions of future reward, prediction error teaching signals and stamp in associative links (learning)? Or does dopamine motivate the pursuit of rewards by attributing incentive salience to reward-related stimuli ('wanting')? Each hypothesis is evaluated here, and it is suggested that the incentive salience or 'wanting' hypothesis of dopamine function may be consistent with more evidence than either learning or 'liking'. In brief, recent evidence indicates that dopamine is neither necessary nor sufficient to mediate changes in hedonic 'liking' for sensory pleasures. Other recent evidence indicates that dopamine is not needed for new learning, and not sufficient to directly mediate learning by causing teaching or prediction signals. By contrast, growing evidence indicates that dopamine does contribute causally to incentive salience. Dopamine appears necessary for normal 'wanting', and dopamine activation can be sufficient to enhance cue-triggered incentive salience. Drugs of abuse that promote dopamine signals short circuit and sensitize dynamic mesolimbic mechanisms that evolved to attribute incentive salience to rewards. Such drugs interact with incentive salience integrations of Pavlovian associative information with physiological state signals. That interaction sets the stage to cause compulsive 'wanting' in addiction, but also provides opportunities for experiments to disentangle 'wanting', 'liking', and learning hypotheses. Results from studies that exploited those opportunities are described here.

CONCLUSION

In short, dopamine's contribution appears to be chiefly to cause 'wanting' for hedonic rewards, more than 'liking' or learning for those rewards.

The nucleus accumbens and Pavlovian reward learning

The ability to form associations between predictive environmental events and rewarding outcomes is a fundamental aspect of learned behavior. This apparently simple ability likely requires complex neural processing evolved to identify, seek, and use natural rewards and redirect these activities based on updated sensory information. Emerging evidence from both animal and human research suggests that this type of processing is mediated in part by the nucleus accumbens (NAc) and a closely associated network of brain structures. The NAc is required for a number of reward-related behaviors and processes specific information about reward availability, value, and context. In addition, this structure is critical for the acquisition and expression of most Pavlovian stimulus-reward relationships, and cues that predict rewards produce robust changes in neural activity in the NAc. Although processing within the NAc may enable or promote Pavlovian reward learning in natural situations, it has also been implicated in aspects of human drug addiction, including the ability of drug-paired cues to control behavior. This article provides a critical review of the existing animal and human literature concerning the role of the NAc in Pavlovian learning with nondrug rewards and considers some clinical ture concerning the role of the NAc in Pavlovian learning with nondrug implications of these findings.

The habitual brain: an "adapted habit" theory of substance use disorders

Behavioral habits are essential to human and animal life. We consider the many ways that habits - which are normally adaptive - can be expressed as drug use behavior and addiction. Although habit theories of substance use disorders have been proposed (e.g., Tiffany, 1990), the behavioral science and underlying neurobiology of habit development, maintenance, and change is only now being studied. We first define "adapted habit." We then propose that the etiology of an adapted habit represents the combination of: (a) initial "capture" of a habit, (b) development of behavioral action schemata, and (c) an overlay of cognitive expectancies concerning aspects of the habit. This combination conspires to make an intractable adapted habit such as substance abuse and addiction. Many intractable habits change, including substance use disorders such as cigarette smoking. As part of a science of habits, we need a real understanding of how to change habits to avoid or minimize harm.