Nicotine enhances responding with conditioned reinforcement

Alcohol and the dopamine system

The mesolimbic dopamine pathway plays a major role in drug reinforcement and is likely involved also in the development of drug addiction. Ethanol, like most addictive drugs, acutely activates the mesolimbic dopamine system and releases dopamine, and ethanol-associated stimuli also appear to trigger dopamine release. In addition, chronic exposure to ethanol reduces the baseline function of the mesolimbic dopamine system. The molecular mechanisms underlying ethanol´s interaction with this system remain, however, to be unveiled. Here research on the actions of ethanol in the mesolimbic dopamine system, focusing on the involvement of cystein-loop ligand-gated ion channels, opiate receptors, gastric peptides and acetaldehyde is briefly reviewed. In summary, a great complexity as regards ethanol´s mechanism(s) of action along the mesolimbic dopamine system has been revealed. Consequently, several new targets and possibilities for pharmacotherapies for alcohol use disorder have emerged.

Development of a nicotine aerosol self-administration model in rats and the effects of e-liquid flavors

Electronic nicotine delivery system (ENDS) use is maintained by the positive reinforcement associated with preferred flavors. These flavors become conditioned reinforcers through pairings with primary reinforcers. This study sought to extend prior research with intravenous nicotine self-administration and develop a more ecologically valid preclinical model of aerosol self-administration in rats that incorporated flavors paired with sucrose. Rats were first trained to respond for oral sucrose with or without raspberry flavor to establish the flavor as a conditioned reinforcer for some groups. Rats were then exposed to aerosol self-administration. All groups responded for raspberry-flavored aerosol with or without nicotine. Rats responded more for raspberry flavored sucrose than unflavored sucrose. Despite raspberry increasing responding for sucrose, the flavor did not function as a conditioned reinforcer during aerosol self-administration and did not increase responding for nicotine. Throughout the aerosol self-administration phase, most groups responded more on the active than inactive lever, and some groups increased their response when the fixed ratio value was increased. At the end of the study, rats in nicotine groups earned similar or fewer aerosol deliveries than rats in vehicle groups. Aerosolized nicotine did not function as a reinforcer in this study, whereas aerosolized raspberry flavor may have maintained self-administration. Further preclinical investigation is needed to articulate the impact of flavors on ENDS use and whether they offset some aversive effects of nicotine or maintain responding on their own. If flavors reduce some aversive effects of self-administered nicotine, then policies to regulate flavors in e-liquids are prudent.

β2* nicotinic acetylcholine receptor subtypes mediate nicotine-induced enhancement of Pavlovian conditioned responding to an alcohol cue

Nicotine enhances Pavlovian conditioned responses to reward-associated cues. We investigated through which nicotinic acetylcholine receptor (nAChR) subtypes nicotine acts to produce this behavioral effect to an alcohol-associated cue. Male Long-Evans rats with freely available food and water were first accustomed to drinking 15% ethanol in their home cages using an intermittent access, two-bottle choice procedure. Then the rats were given 15 Pavlovian conditioning sessions in which a 15-s audiovisual conditioned stimulus (CS) predicted the delivery of 0.2 ml of ethanol, the unconditioned stimulus (US). Each session contained 12 CS-US trials. A control group received explicitly unpaired presentations of the CS and US. We measured Pavlovian conditioned approach to the site of US delivery during presentations of the CS, accounting for pre-CS baseline activity. Before each conditioning session, rats were injected subcutaneously with nicotine (0.4 mg/kg) or saline (1 ml/kg). During nAChR antagonist test sessions, rats were first injected systemically with the β2*-selective nAChR antagonist dihydro-beta-erythroidine (DHβE; 3 mg/kg) or the α7-selective nAChR antagonist methyllycaconitine (MLA; 6 mg/kg), followed by their assigned nicotine or saline injection before assessing their conditioned response to the alcohol-associated cue. Consistent with previous reports, nicotine enhanced the Pavlovian conditioned response to the alcohol-paired cue. DHβE attenuated this enhancement, whereas MLA did not. These results suggest that nicotine acts via β2*, but not α7, nAChRs to amplify Pavlovian conditioned responding to an alcohol cue. These findings contribute to a growing literature that identifies nAChRs as potential targets for pharmacological treatment of co-morbid alcohol and tobacco use disorders.

Stimulus functions of nicotine

Behavioral pharmacology has made vital contributions to the concepts and methods used in tobacco and other drug use research, and is largely responsible for the now generally accepted notion that nicotine is the primary component in tobacco that engenders and maintains tobacco use. One of the most important contributions of behavioral pharmacology to the science of drug use is the notion that drugs can act as environmental stimuli that control behavior in many of the same ways as other stimuli (e.g., visual, gustatory, olfactory). The purpose of this chapter is to provide an overview of research that illustrates the respondent and operant stimulus functions of nicotine, using a contemporary taxonomy of stimulus functions as a general framework. Each function is formally defined and examples from research on the behavioral pharmacology of nicotine are presented. Some of the factors that modulate each function are also discussed. The role of nicotine's stimulus functions in operant and respondent theories of tobacco use is examined and some suggestions for future research are presented. The chapter illustrates how a taxonomy of stimulus functions can guide conceptions of tobacco use and direct research and theory accordingly.

Nicotine-induced enhancement of a sensory reinforcer in adult rats: antagonist pretreatment effects

RATIONALE AND OBJECTIVES

The reinforcement-enhancing effect (REE) of nicotine refers to the drug's ability to enhance the strength of other primary and conditioned reinforcers. The main aim was to investigate neuropharmacological mechanisms underlying nicotine's strengthening of a primary visual reinforcer (i.e., a light cue), using a subcutaneous (SC) dose previously shown to provide plasma nicotine levels associated with habitual smoking.

METHODS

Adult male rats pressed an "active" lever to illuminate a brief cue light during daily 60-min sessions. Rats that showed a clear REE were tested with systemically administered pretreatment drugs followed by nicotine (0.1 mg/kg SC) or saline challenge, in within-subject counterbalanced designs. Pretreatments were mecamylamine (nicotinic, 0.1-1 mg/kg SC), SCH 39166 (D1-like dopaminergic, 0.003-0.2 mg/kg SC), naloxone (opioid, 1 and 5 mg/kg SC), prazosin (alpha1-adrenergic antagonist, 1 and 2 mg/kg IP), rimonabant (CB1 cannabinoid inverse agonist, 3 mg/kg IP), sulpiride (D2-like dopaminergic antagonist, 40 mg/kg SC), or propranolol (beta-adrenergic antagonist, 10 mg/kg IP).

RESULTS

The nicotine REE was abolished by three antagonists at doses that did not impact motor output, i.e., mecamylamine (1 mg/kg), SCH 39166 (0.01 and 0.03 mg/kg), and naloxone (5 mg/kg). Prazosin and rimonabant both attenuated the nicotine REE, but rimonabant also suppressed responding more generally. The nicotine REE was not significantly altered by sulpiride or propranolol.

CONCLUSIONS

In adult male rats, the reinforcement-enhancing effect of low-dose nicotine depends on nicotinic receptor stimulation and on neurotransmission via D1/D5 dopaminergic, opioid, alpha1-adrenergic, and CB1 cannabinoid receptors.

5-HT2A and 5-HT2C receptors as potential targets for the treatment of nicotine use and dependence

Nicotine use and dependence, typically achieved through cigarette smoking, but increasingly through vape products, is the leading cause of preventable death today. Despite a recognition that many current smokers would like to quit, the success rate at doing so is low and indicative of the persistent nature of nicotine dependence and the high urge to relapse. There are currently three main forms of pharmacotherapy approved as aids to treat nicotine dependence: a variety of nicotine replacement products (NRT's), the mixed NA/DA reuptake inhibitor bupropion (Zyban®), and the preferential nicotinic α4β2 receptor agonist drug, varenicline (Chantix®); the latter being generally recognized to be the most effective. However, each of these approaches afford only limited efficacy, and various other pharmacological approaches are being explored. This chapter focusses on approaches targeted to the serotonin (5-HT) system, namely, selective serotonin reuptake inhibitors (SSRI's) which served a pioneer role in the investigation of serotoninergic modulators in human smoking cessation trials; and secondly drugs selectively interacting with the 5-HT2A and 5-HT2C receptor systems. From an efficacy perspective, measured as smoking abstinence, the 5-HT2A agonist psychedelics, namely psilocybin, seem to show the most promise; although as the article highlights, these findings are both preliminary and there are significant challenges to the route to approval, and therapeutic use of this class should they reach approval status. Additional avenues include 5-HT2C receptor agonists, which until recently was pioneered by lorcaserin, and 5-HT2A receptor antagonists represented by pimavanserin. Each of these approaches has distinct profiles across preclinical tests of nicotine dependence, and may have therapeutic potential. It is anticipated as diagnostic and predictive biomarkers emerge, they may provide opportunities for subject stratification and opportunities for personalizing smoking cessation treatment. The clinical assessment of SSRI, 5-HT2A and/or 5-HT2C receptor-based treatments may be best served by this process.

The pharmacological stressor yohimbine, but not U50,488, increases responding for conditioned reinforcers paired with ethanol or sucrose

RATIONALE

Environmental stimuli paired with alcohol can function as conditioned reinforcers (CRfs) and trigger relapse to alcohol-seeking. In animal models, pharmacological stressors can enhance alcohol consumption and reinstate alcohol-seeking, but it is unknown whether stress can potentiate the conditioned reinforcing properties of alcohol-paired stimuli.

OBJECTIVES

We examined whether the pharmacological stressors, the α-2 adrenoreceptor antagonist yohimbine (vehicle, 1.25, 2.5 mg/kg; IP) and the K-opioid receptor agonist U50,488 (vehicle, 1.25, 2.5 mg/kg; SC), increase responding for conditioned reinforcement, and if their effects interact with the nature of the reward (alcohol vs. sucrose). We subsequently examined the effects of yohimbine (vehicle, 1.25, 2.5 mg/kg; IP) on responding for sensory reinforcement.

METHODS

Male Long-Evans underwent Pavlovian conditioning, wherein a tone-light conditioned stimulus (CS) was repeatedly paired with 12% EtOH or 21.7% sucrose. Next, tests of responding for a CRf were conducted. Responding on the CRf lever delivered the CS, whereas responding on the other lever had no consequences. In a separate cohort of rats, the effects of yohimbine on responding just for the sensory reinforcer were examined.

RESULTS

Both doses of yohimbine, but not U50,488, increased responding for conditioned reinforcement. This enhancement occurred independently of the nature of the reward used during Pavlovian conditioning. Yohimbine-enhanced responding for a CRf was reproducible and stable over five tests; it even persisted when the CS was omitted. Both doses of yohimbine also increased responding for sensory reinforcement.

CONCLUSIONS

Yohimbine increases operant responding for a variety of sensory and conditioned reinforcers. This enhancement may be independent of its stress-like effects.

Nicotine Self-Administration With Tobacco Flavor Additives in Male Rats

INTRODUCTION

Nicotine can robustly increase responding for conditioned reinforcers (CRs), stimuli that acquire reinforcing properties based on association with primary reinforcers. Menthol and licorice are tobacco flavoring agents also found in sweet foods (eg, candy and ice cream), making them putative CRs before they are consumed in tobacco. We sought to determine if intravenous self-administration (IVSA) of nicotine was enhanced by the inclusion of oral tobacco flavor CRs.

METHODS

Menthol (160 or 320 µM) or licorice root extract (0.1% or 1%) were established as CRs (paired with 20% sucrose) or "neutral" stimuli (paired with water) in separate groups. During subsequent IVSA tests, nicotine was delivered in conjunction with oral presentations of the CR.

RESULTS

In experiment 1, a menthol CR significantly shifted the peak nicotine dose from 15 µg/kg/infusion (Neutral group) to 3.25 µg/kg/infusion (CR group). In experiment 2, a menthol CR significantly increased operant licks for nicotine (3 µg/kg/infusion) relative to control groups. In experiment 3, both licorice and menthol CRs significantly increased operant licks for nicotine (7.5 µg/kg/infusion) relative to an "inactive" sipper. The licorice CR increased nicotine IVSA in proportion to the strength of the flavor, but both menthol concentrations increased nicotine IVSA to a similar extent.

CONCLUSION

Tobacco flavor additives with conditioned reinforcing properties promote acquisition of nicotine self-administration at low unit doses and may have robust impact on tobacco consumption when nicotine yield is low.

IMPLICATIONS

Tobacco flavor additives are found in rewarding foods (eg, ice cream) and gain palatability based on associations with primary rewards (eg, sugar) making them "conditioned reinforcers." Nicotine increases the motivation for flavor conditioned reinforcers and the present studies show that tobacco flavor additives can interact with nicotine to promote more nicotine self-administration. The interaction between flavors additives and nicotine may promote nicotine exposure and subsequently dependence.

Nicotinic Acetylcholine Receptor Signaling in the Hypothalamus: Mechanisms Related to Nicotine's Effects on Food Intake

Despite health risks associated with smoking, up to 20% of the US population persist in this behavior; many smoke to control body weight or appetite, and fear of post-cessation weight gain can motivate continued smoking. Nicotine and tobacco use is associated with lower body weight, and cessation yields an average weight gain of about 4 kg, which is thought to reflect a return to the body weight of a typical nonsmoker. Nicotine replacement therapies can delay this weight gain but do not prevent it altogether, and the underlying mechanism for how nicotine is able to reduce weight is not fully understood. In rodent models, nicotine reduces weight gain, reduces food consumption, and alters energy expenditure, but these effects vary with duration and route of nicotine administration. Nicotine, acting through nicotinic acetylcholine receptors (nAChRs), increases the firing rate of both orexigenic agouti-related peptide and anorexigenic proopiomelanocortin neurons in the arcuate nucleus of the hypothalamus (ARC). Manipulation of nAChR subunit expression within the ARC can block the ability of nicotine and the nicotinic agonist cytisine from decreasing food intake; however, it is unknown exactly how this reduces food intake. This review summarizes the clinical and preclinical work on nicotine, food intake, and weight gain, then explores the feeding circuitry of the ARC and how it is regulated by nicotine. Finally, we propose a novel hypothesis for how nicotine acts on this hypothalamic circuit to reduce food intake. Implications: This review provides a comprehensive and updated summary of the clinical and preclinical work examining nicotine and food intake, as well as a summary of recent work examining feeding circuits of the hypothalamus. Synthesis of these two topics has led to new understanding of how nAChR signaling regulates food intake circuits in the hypothalamus.

The acute effects of nicotine on corticostriatal responses to distinct phases of reward processing

Nicotine enhances the reinforcement of non-drug rewards by increasing nucleus accumbens (NAcc) reactivity to anticipatory cues. This anticipatory effect is selective as no clear evidence has emerged showing that nicotine acutely changes reward receipt reactivity. However, repeated rewarding experiences shift peak brain reactivity from hedonic reward outcome to the motivational anticipatory cue yielding more habitual cue-induced behavior. Given nicotine's influence on NAcc reactivity and connectivity, it is plausible that nicotine acutely induces this shift and alters NAcc functional connectivity during reward processing. To evaluate this currently untested hypothesis, a randomized crossover design was used in which healthy non-smokers were administered placebo and nicotine (2-mg lozenge). Brain activation to monetary reward anticipation and outcome was evaluated with functional magnetic resonance imaging. Relative to placebo, nicotine induced more NAcc reactivity to reward anticipation. Greater NAcc activation during anticipation was significantly associated with lower NAcc activation to outcome. During outcome, nicotine reduced NAcc functional connectivity with cortical regions including the anterior cingulate cortex, orbitofrontal cortex, and insula. These regions showed the same negative relationship between reward anticipation and outcome as noted in the NAcc. The current findings significantly improve our understanding of how nicotine changes corticostriatal circuit function and communication during distinct phases of reward processing and critically show that these alterations happen acutely following a single dose. The implications of this work explain nicotinic modulation of general reward function, which offer insights into the initial drive to smoke and the subsequent difficulty in cessation.

Nicotine Facilitation of Conditioned Place Preference to Food Reward in Humans

Nicotine has recently been shown to enhance the motivational value of non-nicotine stimuli in nonhumans. To investigate whether nicotine also enhances reward in humans, we used a virtual translation of the conditioned place preference (CPP) paradigm to examine nicotine's reward-enhancing effects using a low-dose 2 mg nicotine lozenge targeted to a mild use population. Methods: Sixty-eight nicotine-using undergraduates were randomly assigned to receive either a 2 mg nicotine or placebo lozenge prior to conditioning. During each of six, three-minute conditioning sessions, participants were confined to one of two VR rooms. In one room, they received real chocolate M&Ms, whereas no M&Ms were administered in the other room. Following conditioning, a three-minute free-access test session occurred during which participants had unrestricted access to both rooms without reward. Results: Individuals who received nicotine demonstrated a CPP by spending significantly more time in the room previously paired with M&Ms compared to the unrewarded room (p = 0.04). Those who received placebo did not demonstrate a CPP (p > 0.05). Moreover, we observed no significant differences between treatment groups in terms of the amount of time spent in each virtual room. Conclusion: While nicotine seems to facilitate CPP expression for a virtual environment previously paired with chocolate food rewards, further characterization of the mechanism by which this occurs is needed.

Ethanol→Nicotine & Nicotine→Ethanol drug-sequence discriminations: Conditional stimulus control with two interoceptive drug elements in rats

Self-administration of ethanol (E) and nicotine (N) occurs frequently in tandem orders (i.e., N→E vs. E→N) and thereby produces differing interoceptive profiles of subjective effects in humans. If the interoceptive stimulus characteristics of N→E differ from E→N, it is possible that such differences contribute to their co-dependence. The rationale for the present investigation was to determine whether ethanol, when preceded or followed by nicotine, produces different discriminative stimulus effects in rats. In two experiments, using a one-manipulandum operant drug discrimination procedure, rats were trained to discriminate temporal sequential administrations of ethanol (1.0 g/kg) that was followed or preceded by nicotine (0.3 mg/kg). Sessions alternated between food-reinforcement sessions on a variable interval 30-sec schedule (i.e., S^D) and non-reinforcement sessions (i.e., S^Δ). In Experiment 1, administrations of ethanol were followed or preceded by a 10-min interval of nicotine. Training sessions took place 10 min following the second drug injection. Four groups of rats were trained to discriminate only one sequence from sequential administrations of saline, and each drug sequence was counterbalanced across groups for their roles as S^D or S^Δ. There was robust stimulus control. N→E and E→N functioned equally well as S^D or S^Δ. Experiment 2 used two groups of rats. For one group, the E→N sequence functioned as the S^D and the N→E sequence functioned as the S^Δ. The drug sequences were counterbalanced for the other group. Brief non-reinforcement tests revealed significantly greater responding during the S^D sequence compared to the S^Δ sequence for both groups. These results suggest that different drug sequences of ethanol followed or preceded by nicotine established reliable discriminative stimulus control over operant responding, potentially because of characteristic differences in the overlapping pharmacokinetic profiles of the NE compound. The results are discussed in terms of: 1) conditional stimulus control among two interoceptive drug states; and 2) the clinical modulation of human alcohol consumption and tobacco smoking.

Effects of nicotine conditioning history on alcohol and methamphetamine self-administration in rats

BACKGROUND

Smoking constitutes a significant public health risk. Alcohol and methamphetamine use disorders are also highly co-morbid with smoking, further increasing negative health outcomes. An important question in determining the underlying neurobiology of nicotine poly-drug use is understanding whether having a positive history with nicotine effects alters later drug-taking behavior.

METHODS

The current experiments sought to elucidate whether having an appetitive nicotine conditioning history would affect later alcohol or methamphetamine self-administration. Adult male and female Long-Evans rats were first trained on a discriminated goal-tracking task in which the interoceptive effects of nicotine predicted sucrose reinforcement. As a control, pseudo-conditioned groups were included that had equated nicotine and sucrose experience. Rats were then shifted to either alcohol self-administration or methamphetamine self-administration.

RESULTS

Nicotine conditioning history had no effect on acquisition or maintenance of alcohol self-administration in males or females. In contrast, an appetitive nicotine conditioning history decreased methamphetamine self-administration in female rats, but not males.

CONCLUSIONS

In female, but not male, rats, an appetitive conditioning history with nicotine decreases methamphetamine, but not alcohol, self-administration. This dissociation suggests that the effects may be due to a specific increase in the reinforcing value of methamphetamine. This may have implications for better understanding the progression of drug use from nicotine to methamphetamine.

Can the discriminative stimulus effects of nicotine function concurrently as modulatory opponents in operant and pavlovian occasion setting paradigms in rats?

Nicotine promotes interoceptive changes in the nervous system. Such interoceptive stimuli play important roles in modulating addictive behavior. Operant and Pavlovian stimulus control modulate responsiveness to environmental stimuli related to drug-seeking and self-administration. Nicotine functions as a discriminative stimulus in modulating operant behavior as well as Pavlovian feature stimuli in modulating the conditional responding (CR) to exteroceptive CS→US contingencies. Elucidation of the interaction of these interoceptive stimulus control functions is vital for a comprehensive understanding of nicotine use/abuse, which might lead to better behavioral treatment strategies. This experiment evaluated the interaction among Pavlovian feature positive (FP) and feature negative (FN) effects of nicotine on concurrently occurring operant S^D and S^Δ effects. Sixteen rats were trained in a Pavlovian and operant bidirectional contingency paradigm, using nicotine (0.3 mg/kg) and non-drug (saline) states as interoceptive cues for operant discriminative stimulus conditions (S^D and S^Δ) as well as Pavlovian FP and FN for a light-CS, either leading to a shared food pellet outcome or non-outcome. Nicotine and saline sessions were intermixed. For one group of rats (n = 8), nicotine served as an S^D for lever pressing (variable interval 60 s) and simultaneously functioned as an FN for CS-light→noUS relation on the same sessions. On intermixed sessions, saline served as the S^Δ for lever pressing (non-reinforced) and FP, during which the 8-sec light preceded delivery of the food pellet (variable time ITI = 60 s). For the other group (n = 8) nicotine served as the S^Δ (lever pressing non-reinforced) and FP for the CS, with saline serving in the reverse roles. Consecutive brief non-reinforcement tests revealed that: A) rates of lever pressing were significantly greater in S^D than S^Δ with nicotine and saline suggesting strong operant discriminative stimulus control; B) FP responding to the light CS with nicotine and saline was evident; and C) FN suppression of the CR with nicotine was not evident but weak under saline. These data suggest that nicotine can function as an interoceptive context that hierarchically can enter into concurrently opposing modulatory relations in Pavlovian and operant drug discrimination procedures.

Adolescent and adult nicotine exposure differentially impacts oral nicotine and oral saccharin self-administration in mice

Smokers that begin during adolescence are more likely to develop nicotine dependence than those who begin as adults. However, the factors that contribute to this remain largely unknown. Here we utilized a novel operant oral nicotine self-administration procedure in mice to assess the consequences of adolescent nicotine exposure on nicotine and saccharin (non-drug) reinforcement in adults. Animals were given non-contingent exposure to either saline or nicotine using the osmotic minipumps during both adolescence and adulthood for 2 weeks. Reinforcing efficacy for oral nicotine and saccharin was assessed using the progressive ratio schedule 2-weeks following the washout period in adults. Non-contingent nicotine exposure in adolescence drastically increased operant responding for oral nicotine but reduced responding for oral saccharin in the group re-exposed to nicotine in adulthood. Interestingly, adolescent nicotine-exposed mice that received saline exposure as adults exhibited higher preference for oral saccharin. However, breakpoints for oral nicotine in these mice remained comparable to control animals. Surprisingly, both adolescent and adult nicotine exposure increased inactive lever responding during self-administration presumably reflecting impulsive responding. Our data suggest that adolescent nicotine exposure produces an increase in reinforcement sensitivity in adulthood as reflected by increased saccharin self-administration but this sensitivity becomes biased towards nicotine self-administration when re-exposed to nicotine in adulthood. Moreover, nicotine/saccharin reinforcement could be impacted by changes in cognitive control, such as increased impulsivity. These distinct behavioral mechanisms may act in concert to facilitate maladaptive nicotine taking in smokers that initiate nicotine use during adolescence.

Effects of nicotine self-administration on incentive salience in male Sprague Dawley rats

RATIONALE

Prolonged use of nicotine appears to enhance incentive salience, a motivational-cognitive process that transforms an otherwise neutral stimulus into a "wanted" stimulus. It has been suggested that nicotinic enhancement of incentive salience contributes to the potential of relapse in individuals with tobacco addiction. However, there are two main limitations of prior research that caution this claim: (a) the use of passive experimentally delivered nicotine and (b) the use of sign-tracking as an index of incentive salience, without acknowledging the competing nature of goal- and sign-tracking responses.

OBJECTIVES

To determine whether nicotinic enhancement of incentive salience attributed to non-nicotinic stimuli occurs when rats self-administer nicotine, and whether it is facilitated by a prior history of nicotine self-administration.

METHODS

Twenty-three male rats were trained daily, for 24 days, on a nicotine self-administration (SA) paradigm in the morning, and on a four-conditioned-stimuli Pavlovian conditioned approach (4-CS PCA) task in the afternoon. Self-administration was followed by extinction and cue reinstatement. A subcutaneous nicotine challenge was performed during the last 7 days of the study.

RESULTS

Nicotine self-administration selectively enhanced sign-tracking in the 4-CS PCA. Upon extinction, sign-tracking quickly declined to control levels. Experimenter-administered nicotine enhanced sign-tracking similarly regardless of nicotine history.

CONCLUSIONS

The results suggest that nicotinic enhancement of incentive salience is transient, and a previous history of nicotine use does not cause further sensitization. Taken together, these results suggest that nicotine enhances incentive salience, particularly-and perhaps exclusively-while onboard.

Reinforcement enhancement by nicotine in adult rats: behavioral selectivity and relation to mode of delivery and blood nicotine levels

RATIONALE

Reinforcement-enhancing effects of nicotine occur in human subjects and laboratory rats. However, the doses used in animal studies typically exceed smoking-associated levels of exposure, and generalized behavioral activation by nicotine can potentially confound data interpretation.

METHODS

During daily 60-min sessions, male adult rats pressed an "active" lever to illuminate a brief cue light. Pressing on either the active or inactive lever retracted both levers for 60 s. Nicotine (0.025-0.2 mg/kg) was given either by continuous intravenous (IV) infusion, or spaced IV pulses (3-s or 30-s/pulse), or pre-session subcutaneous (SC) injection.

RESULTS

Almost all rats responded preferentially for the cue light for several weeks. After several home-cage nicotine injections, reinforcement enhancement occurred even within the first nicotine test session. Nicotine increased active lever responding without altering inactive lever responding, with effects reliably observed at doses as low as 0.1 mg/kg SC or 0.1 mg/kg/session IV. Within the session, the 0.1 mg/kg dose maximally increased active lever responding by 2-3-fold, coinciding with serum levels of 25 ng/ml. Intravenous nicotine (tested at 0.1 mg/kg/60-min session) was equally effective whether delivered by continuous infusion or in a series of equally spaced 0.003 mg/kg pulses each of 3-s or 30-s duration.

CONCLUSIONS

Low doses of nicotine can potentiate responding for a primary sensory reinforcer without producing a generalized increase in lever pressing. Reinforcer enhancement by nicotine generalized to several modes of drug delivery, appeared to track circulating levels of drug, and occurred even at serum levels within the daytime range of moderate cigarette smokers.

Chronic Nicotine Exposure Initiated in Adolescence and Unpaired to Behavioral Context Fails to Enhance Sweetened Ethanol Seeking

Nicotine use in adolescence is pervasive in the United States and, according to the Gateway Hypothesis, may lead to progression towards other addictive substances. Given the prevalence of nicotine and ethanol comorbidity, it is difficult to ascertain if nicotine is a gateway drug for ethanol. Our study investigated the relationship between adolescent exposure to nicotine and whether this exposure alters subsequent alcohol seeking behavior. We hypothesized that rats exposed to nicotine beginning in adolescence would exhibit greater alcohol seeking behavior than non-exposed siblings. To test our hypothesis, beginning at P28, female rats were initially exposed to once daily nicotine (0.4 mg/kg, SC) or saline for 5 days. Following these five initial injections, animals were trained to nose-poke for sucrose reinforcement (10%, w/v), gradually increasing to sweetened ethanol (10% sucrose; 10% ethanol, w/v) on an FR5 reinforcement schedule. Nicotine injections were administered after the behavioral sessions to minimize acute effects of nicotine on operant self-administration. We measured the effects of nicotine exposure on the following aspects of ethanol seeking: self-administration, naltrexone (NTX)-induced decreases, habit-directed behavior, motivation, extinction and reinstatement. Nicotine exposure did not alter self-administration or the effectiveness of NTX to reduce alcohol seeking. Nicotine exposure blocked habit-directed ethanol seeking. Finally, nicotine did not alter extinction learning or cue-induced reinstatement to sweetened ethanol seeking. Our findings suggest that nicotine exposure outside the behavioral context does not escalate ethanol seeking. Further, the Gateway Hypothesis likely applies to scenarios in which nicotine is either self-administered or physiologically active during the behavioral session.

Strong seduction: impulsivity and the impact of contextual cues on instrumental behavior in alcohol dependence

Alcohol-related cues acquire incentive salience through Pavlovian conditioning and then can markedly affect instrumental behavior of alcohol-dependent patients to promote relapse. However, it is unclear whether similar effects occur with alcohol-unrelated cues. We tested 116 early-abstinent alcohol-dependent patients and 91 healthy controls who completed a delay discounting task to assess choice impulsivity, and a Pavlovian-to-instrumental transfer (PIT) paradigm employing both alcohol-unrelated and alcohol-related stimuli. To modify instrumental choice behavior, we tiled the background of the computer screen either with conditioned stimuli (CS) previously generated by pairing abstract pictures with pictures indicating monetary gains or losses, or with pictures displaying alcohol or water beverages. CS paired to money gains and losses affected instrumental choices differently. This PIT effect was significantly more pronounced in patients compared to controls, and the group difference was mainly driven by highly impulsive patients. The PIT effect was particularly strong in trials in which the instrumental stimulus required inhibition of instrumental response behavior and the background CS was associated to monetary gains. Under that condition, patients performed inappropriate approach behavior, contrary to their previously formed behavioral intention. Surprisingly, the effect of alcohol and water pictures as background stimuli resembled that of aversive and appetitive CS, respectively. These findings suggest that positively valenced background CS can provoke dysfunctional instrumental approach behavior in impulsive alcohol-dependent patients. Consequently, in real life they might be easily seduced by environmental cues to engage in actions thwarting their long-term goals. Such behaviors may include, but are not limited to, approaching alcohol.

Nicotine Acutely Enhances Reinforcement from Non-Drug Rewards in Humans

Preclinical research documents that, aside from the primary and secondary reinforcing effects of nicotine intake itself, nicotine also acutely enhances the reinforcing efficacy of non-drug reinforcers ("rewards"). Study of these effects in humans has largely been overlooked, but very recent findings suggest they may have clinical implications for more fully understanding the persistence of tobacco dependence. This overview first outlines the topic and notes some recent human studies indirectly addressing nicotine effects on related responses (e.g., subjective ratings), explaining why those findings do not directly confirm enhancement of behavioral reinforcement per se due to nicotine. Then, the methodology used in the subsequently presented studies is described, demonstrating how those studies specifically did demonstrate enhancement of reinforced responding for non-drug rewards. The main section focuses on the limited controlled research to date directly assessing nicotine's acute reinforcement-enhancing effects in humans, particularly as it relates to reinforced behavioral responding for non-drug rewards in non-human animal models. After detailing those few existing human studies, we address potential consequences of these effects for dependence and tobacco cessation efforts and then suggest directions for future research. This research indicates that nicotine per se increases responding in humans that is reinforced by some rewards (auditory stimuli via music, visual stimuli via video), but perhaps not by others (e.g., money). These reinforcement-enhancing effects in smokers are not due to dependence or withdrawal relief and can be restored by a small amount of nicotine (similar to a smoking lapse), including from e-cigarettes, a non-tobacco nicotine product. Future clinical research should examine factors determining which types of rewards are (or are not) enhanced by nicotine, consequences of the loss of these nicotine effects after quitting smoking, potential individual differences in these effects, and the possibility that nicotine via nicotine replacement therapy and non-nicotine quit medications may attenuate loss of these effects upon quitting. Further study with humans of nicotine's reinforcement-enhancing effects may provide a more complete understanding of smoking persistence and added mechanisms of cessation medication efficacy.

Individual Differences in the Attribution of Incentive Salience to a Pavlovian Alcohol Cue

Individual differences exist in the attribution of incentive salience to conditioned stimuli associated with food. Here, we investigated whether individual differences also manifested with a Pavlovian alcohol conditioned stimulus (CS). We compiled data from five experiments that used a Pavlovian autoshaping paradigm and tests of conditioned reinforcement. In all experiments, male, Long-Evans rats with unrestricted access to food and water were acclimated to 15% ethanol. Next, rats received Pavlovian autoshaping training, in which a 10 s presentation of a retractable lever served as the CS and 0.2 mL of 15% ethanol served as the unconditioned stimulus (US). Finally, rats underwent conditioned reinforcement tests in which nose-pokes to an active aperture led to brief presentations of the lever-CS, but nose-pokes to an inactive aperture had no consequence. Rats were categorized as sign-trackers, goal-trackers and intermediates based on a response bias score that reflected their tendencies to sign-track or goal-track at different times during training. We found that distinct groups of rats either consistently interacted with the lever-CS (“sign-trackers”) or routinely approached the port during the lever-CS (“goal-trackers”) across a majority of the training sessions. However, some individuals (“shifted sign-trackers”) with an early tendency to goal-track later shifted to comparable asymptotic levels of sign-tracking as the group identified as sign-trackers. The lever-CS functioned as a conditioned reinforcer for sign-trackers and shifted sign-trackers, but not for goal-trackers. These results provide evidence of robust individual differences in the extent to which a Pavlovian alcohol cue gains incentive salience and functions as a conditioned reinforcer.

Predictive but not emotional value of Pavlovian stimuli leads to pavlovian-to-instrumental transfer

•

Pavlovian stimuli (CSs) of different reward value induce outcome specific transfer.

•

Knowledge of the predicted outcome appears necessary for the transfer to occur.

•

Emotional response to CSs occurs without knowledge of predicted outcome.

•

Emotional response to CSs is not sufficient to elicit transfer.

Reward-predictive stimuli augment instrumental reward-seeking in humans, an effect denoted Pavlovian-to-instrumental transfer (PIT), but the role of differential reward value of these stimuli and of emotional conditioned responses in PIT remains unknown.

Fifty one participants experienced a Pavlovian phase that associated two stimuli with either 10p (CS10) or 50p (CS50). Next, participants underwent instrumental training for two responses reinforced with either 10p or 50p. Finally, the transfer phase continued as had instrumental training, now in the presence of the Pavlovian stimuli.

Participants were dichotomised as aware/unaware according to their expectancy awareness of the CS → outcome associations. Only aware participants demonstrated PIT (increased choice and number of responses on the 10p and 50p response key in the presence of CS10 and CS50 respectively), yet both aware and unaware groups rated the 50p stimulus as more pleasant than the 10p stimulus.

These findings suggest that expectancy of reward is necessary for PIT; however, emotional conditioned responses appear not sufficient to influence PIT. Future research should attempt to manipulate emotional conditioned responses in a PIT context, to test the sufficiency of reward expectancy in PIT.

Naloxone Decreases Responding for Conditioned Reinforcement in Rats

That opioids can mediate unconditioned reinforcement is well established, but there is little evidence indicating whether they modify conditioned reinforcement. Here, a tone which initially served as a discriminative stimulus for the availability of water reinforcement was established as a conditioned stimulus. When later given a choice between pressing a lever producing the tone (but not water) or one which produced no effect, rats chose the tone-producing lever 66% of the time. Naloxone (3.0 mg/kg) reduced overall responding and completely eliminated the preference for the tone-producing lever. Results are briefly discussed in terms of the importance of understanding mechanisms serving conditioned reinforcement.

The tendency to sign-track predicts cue-induced reinstatement during nicotine self-administration, and is enhanced by nicotine but not ethanol

RATIONALE

Some individuals are particularly responsive to reward-associated stimuli ("cues"), including the effects of these cues on craving and relapse to drug-seeking behavior. In the cases of nicotine and alcohol, cues may acquire these abilities via the incentive-enhancing properties of the drug.

OBJECTIVES

To determine the interaction between cue-responsivity and nicotine reinforcement, we studied the patterns of nicotine self-administration in rats categorized based on their tendency to approach a food-predictive cue ("sign-trackers") or a reward-delivery location ("goal-trackers"). In a second experiment, we determined whether nicotine and ethanol altered the incentive value of a food cue.

METHODS

Rats were classified as sign- or goal-trackers during a Pavlovian conditioned approach paradigm. Rats then self-administered intravenous nicotine (0.03 mg/kg infusions) followed by extinction and cue-induced reinstatement tests. We also tested the effects of nicotine (0.4 mg/kg base s.c.) or ethanol (0.7 g/kg i.p.) on the approach to, and reinforcing efficacy of, a food cue.

RESULTS

Sign-trackers showed greater reinstatement in response to a nicotine cue. Further, nicotine enhanced sign-tracking but not goal-tracking to a food cue and also enhanced responding for the food cue during the conditioned reinforcement test. Conversely, ethanol reduced sign-tracking and increased goal-tracking, but had no effect on conditioned reinforcement.

CONCLUSIONS

Our studies demonstrate that the tendency to attribute incentive value to a food cue predicts enhanced cue-induced reinstatement. Additionally, the incentive value of food cues is differentially modulated by nicotine and ethanol, which may be related to the reinforcing effects of these drugs.

Extending the Role of Associative Learning Processes in Nicotine Addiction

Compulsive smoking is a worldwide public health problem. Although research has confirmed the importance of associative learning processes in nicotine addiction, therapies targeting nicotine-associated cues still have a high relapse rate. Most theories conceptualize nicotine as an ‘outcome’ that reinforces behaviors and/or changes the affective value of stimuli. Albeit important, this view does not capture the complexity of associative processes involved in nicotine addiction. For example, nicotine serves as a conditional stimulus acquiring new appetitive/affective properties when paired with a non-drug reward. Also, nicotine functions as an occasion setter that participates in higher-order associative processes that likely permit a more pervasive influence of conditioned cues that are resistant to typically cue-exposure therapy techniques. Finally, nicotine appears to amplify the salience of other stimuli that have some incentive value resulting in enhanced nicotine selfadministration and conditioned reinforcement processes. Future smoking intervention strategies should take into consideration these additional associative learning processes.

Nicotine Enhances Footshock- and Lithium Chloride-Conditioned Place Avoidance in Male Rats

INTRODUCTION

Numerous studies have shown that nicotine (NIC) can enhance the reinforcing effects of non-NIC stimuli through a nonassociative mechanism. To date, it is unclear whether NIC reinforcement enhancement serves to increase behaviors motivated by rewarding stimuli only, or whether NIC potentiates behavior motivated by all stimuli, regardless of valence.

METHODS

The current study used a place conditioning procedure to examine whether acute NIC injection modulates avoidance of an environment previously associated with an aversive stimulus. Separate groups of rats underwent place conditioning using either lithium chloride (125mg/kg/ml, i.p.) or footshock (0.75 mA) as the aversive stimulus. Other rats served as nonconditioned controls. The magnitude of place avoidance was assessed after acute NIC (0.1 or 0.4mg/kg/ml, s.c.) or saline.

RESULTS

Rats avoided chambers previously paired with either lithium chloride or footshock, and conditioned place avoidance was significantly enhanced by NIC pre-treatment.

CONCLUSIONS

These results demonstrate that the ability of NIC to enhance motivated behavior extends to behaviors elicited by aversive stimuli, evidence that NIC affects behavior motivated by a broader range of stimuli than previously appreciated.

IMPLICATIONS

The current study examined whether the reinforcement enhancement properties of NIC apply to aversive stimuli by testing NIC enhancement of conditioned place avoidance in rats. The results demonstrate that NIC enhances the motivational impact of these distinct aversive stimuli, providing novel evidence that NIC affects behavior motivated by a broader range of stimuli than has previously been demonstrated.

Neuroscience of learning and memory for addiction medicine: from habit formation to memory reconsolidation

Identifying effective pharmacological treatments for addictive disorders has remained an elusive goal. Many different classes of drugs have shown some efficacy in preclinical models, but the number of effective clinical therapeutics has remained stubbornly low. The persistence of drug use and the high frequency of relapse is at least partly attributable to the enduring ability of environmental stimuli associated with drug use to maintain behavioral patterns of drug use and induce craving during abstinence. We propose that stimuli associated with drug use exert such powerful control over behavior through the development of abnormally strong memories, and their ability to initiate subconscious sequences of motor actions (habits) that promote uncontrolled drug use. In this chapter, we will review the evidence suggesting that drugs of abuse strengthen associations with cues in the environment and facilitate habit formation. We will also discuss potential mechanisms for disrupting memories associated with drug use to help improve treatments for addiction.

Individual variation in the motivational properties of a nicotine cue: sign-trackers vs. goal-trackers

RATIONALE

Individuals vary in the extent to which they attribute incentive salience to reward cues. Discrete food and drug (cocaine and opioid) cues become more attractive, eliciting approach toward them, and more "wanted," in that they serve as more effective conditioned reinforcers, in some rats (sign-trackers, STs), than in others (goal-trackers, GTs).

OBJECTIVES

We asked whether there is similar variation in the extent to which a cue associated with a drug from another class, nicotine, acquires incentive motivational properties.

METHODS

First, a Pavlovian conditioned approach procedure was used to identify rats that attribute incentive salience to a food cue (i.e., STs and GTs). We then measured the extent to which a cue (a light) paired with intravenous nicotine injections acquired two properties of an incentive stimulus: (1) the ability to elicit approach toward it, and (2) the ability to act as a conditioned reinforcer.

RESULTS

In contrast to previous findings with food, cocaine, and opioid cues, we found that the nicotine cue was equally attractive in STs and GTs, eliciting dose-dependent approach behavior in both. However, the nicotine cue was a more effective conditioned reinforcer in STs than in GTs.

CONCLUSIONS

We suggest the dissociation between these two measures of incentive salience attribution may be related to the fact that when present (as in the test of Pavlovian approach), nicotine can act as a potent "incentive amplifier," and by this action, nicotine may render cues especially salient for all animals.

Prenatal stress induces vulnerability to nicotine addiction and alters D2 receptors' expression in the nucleus accumbens in adult rats

Prenatal stress (PS) can induce several long-lasting behavioral and molecular abnormalities in rats. It can also be considered as a risk factor for many psychiatric diseases like schizophrenia, depression or PTSD and predispose to addiction. In this study, we investigated the effect of prenatal stress on the reinforcing properties of nicotine in the CPP paradigm. Then, we examined the mRNA expression of the D2 dopaminergic receptors using the quantitative real-time PCR technique in the nucleus accumbens (NAcc). We found that prenatally stressed rats exhibited a greater place preference for the nicotine-paired compartment than the control rats. Moreover, we observed an overexpression of the DRD2 gene in adult offspring stressed in utero and a downregulation in the PS NIC group (PS rats treated with nicotine) compared with their control counterparts (C NIC). These data suggest that maternal stress can permanently alter the offspring's addictive behavior and D2 receptors' expression.

Examination of the effects of varenicline, bupropion, lorcaserin, or naltrexone on responding for conditioned reinforcement in nicotine-exposed rats

Smoking tobacco remains one of the leading causes of preventable deaths in North America. Nicotine reinforces smoking behavior, in part, by enhancing the reinforcing properties of reward-related stimuli, or conditioned stimuli (CSs), associated with tobacco intake. To investigate how pharmaceutical interventions may affect this property of nicotine, we examined the effect of four US Food and Drug Administration (FDA) approved drugs on the ability of nicotine to enhance operant responding for a CS as a conditioned reinforcer. Thirsty rats were exposed to 13 Pavlovian sessions where a CS was paired with water delivery. Nicotine (0.4 mg/kg) injections were administered before each Pavlovian session. Then, in separate groups of rats, the effects of varenicline (1 mg/kg), bupropion (10 and 30 mg/kg), lorcaserin (0.6 mg/kg), and naltrexone (2 mg/kg), and their interaction with nicotine on responding for conditioned reinforcement were examined. Varenicline and lorcaserin each reduced nicotine-enhanced responding for conditioned reinforcement, whereas naltrexone had a modest effect of reducing response enhancements by nicotine. In contrast, bupropion enhanced the effect of nicotine on this measure. The results of these studies may inform how pharmaceutical interventions can affect smoking cessation attempts and relapse through diverse mechanisms, either substituting for, or interacting with, the reinforcement-enhancing properties of nicotine.

The attribution of incentive salience to Pavlovian alcohol cues: a shift from goal-tracking to sign-tracking

Environmental stimuli that are reliably paired with alcohol may acquire incentive salience, a property that can operate in the use and abuse of alcohol. Here we investigated the incentive salience of Pavlovian alcohol cues using a preclinical animal model. Male, Long-Evans rats (Harlan) with unrestricted access to food and water were acclimated to drinking 15% ethanol (v/v) in their home-cages. Rats then received Pavlovian autoshaping training in which the 10 s presentation of a retractable lever served as the conditioned stimulus (CS) and 15% ethanol served as the unconditioned stimulus (US) (0.2 ml/CS; 12 CS presentations/session; 27 sessions). Next, in an operant test of conditioned reinforcement, nose pokes into an active aperture delivered presentations of the lever-CS, whereas nose pokes into an inactive aperture had no consequences. Across initial autoshaping sessions, goal-tracking behavior, as measured by entries into the fluid port where ethanol was delivered, developed rapidly. However, with extended training goal-tracking diminished, and sign-tracking responses, as measured by lever-CS activations, emerged. Control rats that received explicitly unpaired CS and US presentations did not show goal-tracking or sign-tracking responses. In the test for conditioned reinforcement, rats with CS-US pairings during autoshaping training made more active relative to inactive nose pokes, whereas rats in the unpaired control group did not. Moreover, active nose pokes were positively correlated with sign-tracking behavior during autoshaping. Extended training may produce a shift in the learned properties of Pavlovian alcohol cues, such that after initially predicting alcohol availability they acquire robust incentive salience.

Revisiting the effect of nicotine on interval timing

This paper reviews the evidence for nicotine-induced acceleration of the internal clock when timing in the seconds-to-minutes timescale, and proposes an alternative explanation to this evidence: that nicotine reduces the threshold for responses that result in more reinforcement. These two hypotheses were tested in male Wistar rats using a novel timing task. In this task, rats were trained to seek food at one location after 8s since trial onset and at a different location after 16s. Some rats received the same reward at both times (group SAME); some received a larger reward at 16s (group DIFF). Steady baseline performance was followed by 3 days of subcutaneous nicotine administration (0.3mg/kg), baseline recovery, and an antagonist challenge (mecamylamine, 1.0mg/kg). Nicotine induced a larger, immediate reduction in latencies to switch (LTS) in group DIFF than in group SAME. This effect was sustained throughout nicotine administration. Mecamylamine pretreatment and nicotine discontinuation rapidly recovered baseline performance. These results support a response-threshold account of nicotinic disruption of timing performance, possibly mediated by nicotinic acetylcholine receptors. A detailed analysis of the distribution of LTSs suggests that anomalous effects of nicotine on LTS dispersion may be due to loss of temporal control of behavior.

The incentive amplifying effects of nicotine are reduced by selective and non-selective dopamine antagonists in rats

Nicotine is a psychomotor stimulant with 'reinforcement enhancing' effects--the actions of nicotine in the brain increase responding for non-nicotine rewards. We hypothesized that this latter effect of nicotine depends on increased incentive properties of anticipatory cues; consistent with this hypothesis, multiple laboratories have reported that nicotine increases sign tracking, i.e. approach to a conditioned stimulus (CS), in Pavlovian conditioned-approach tasks. Incentive motivation and sign tracking are mediated by mesolimbic dopamine (DA) transmission and nicotine facilitates mesolimbic DA release. Therefore, we hypothesized that the incentive-promoting effects of nicotine would be impaired by DA antagonists. To test this hypothesis, separate groups of rats were injected with nicotine (0.4mg/kg base) or saline prior to Pavlovian conditioning sessions in which a CS (30s illumination of a light or presentation of a lever) was immediately followed by a sweet reward delivered in an adjacent location. Both saline and nicotine pretreated rats exhibited similar levels of conditioned approach to the reward location (goal tracking), but nicotine pretreatment significantly increased approach to the CS (sign tracking), regardless of type (lever or light). The DAD1 antagonist SCH-23390 and the DAD2/3 antagonist eticlopride reduced conditioned approach in all rats, but specifically reduced goal tracking in the saline pretreated rats and sign tracking in the nicotine pretreated rats. The non-selective DA antagonist flupenthixol reduced sign-tracking in nicotine rats at all doses tested; however, only the highest dose of flupenthixol reduced goal tracking in both nicotine and saline groups. The reductions in conditioned approach behavior, especially those by SCH-23390, were dissociated from simple motor suppressant effects of the antagonists. These experiments are the first to investigate the effects of dopaminergic drugs on the facilitation of sign-tracking engendered by nicotine and they implicate dopaminergic systems both in conditioned approach as well as the incentive-promoting effects of nicotine.

Role of cues and contexts on drug-seeking behaviour

Environmental stimuli are powerful mediators of craving and relapse in substance-abuse disorders. This review examined how animal models have been used to investigate the cognitive mechanisms through which cues are able to affect drug-seeking behaviour. We address how animal models can describe the way drug-associated cues come to facilitate the development and persistence of drug taking, as well as how these cues are critical to the tendency to relapse that characterizes substance-abuse disorders. Drug-associated cues acquire properties of conditioned reinforcement, incentive motivation and discriminative control, which allow them to influence drug-seeking behaviour. Using these models, researchers have been able to investigate the pharmacology subserving the behavioural impact of environmental stimuli, some of which we highlight. Subsequently, we examine whether the impact of drug-associated stimuli can be attenuated via a process of extinction, and how this question is addressed in the laboratory. We discuss how preclinical research has been translated into behavioural therapies targeting substance abuse, as well as highlight potential developments to therapies that might produce more enduring changes in behaviour.

Quantifying nicotine's value-enhancement effect using a behavioral economic approach

Nicotine increases the value of some reinforcing stimuli, and this effect may contribute to nicotine's widespread abuse. We aimed to quantify this effect using a behavioral economic analysis. Six Long- Evans rats were exposed to a modified observing response procedure. In this procedure, presses to one lever resulted either in food according to a variable-interval 15 s schedule or extinction; presses to a second, observing lever illuminated stimuli correlated with the schedule in effect on the food/extinction lever (i.e., conditioned reinforcers). The FR requirement on the observing lever increased across sessions. The number of presentations of the conditioned reinforcers was plotted as a function of FR value to generate a demand curve. Nicotine was then administered at a dose of 0.3 mg/kg. All demand curves were fitted to the exponential demand equation and a parameter reflecting reinforcer value was evaluated. Nicotine increased the value of the conditioned reinforcers as measured by this equation; nicotine also increased responding on the food/extinction lever. This analysis demonstrates that nicotine increases the value of conditioned reinforcers under certain conditions. The current procedure allows for a novel method of analyzing demand for conditioned reinforcers.

Boosting visual cortex function and plasticity with acetylcholine to enhance visual perception

The cholinergic system is a potent neuromodulatory system that plays critical roles in cortical plasticity, attention and learning. In this review, we propose that the cellular effects of acetylcholine (ACh) in the primary visual cortex during the processing of visual inputs might induce perceptual learning; i.e., long-term changes in visual perception. Specifically, the pairing of cholinergic activation with visual stimulation increases the signal-to-noise ratio, cue detection ability and long-term facilitation in the primary visual cortex. This cholinergic enhancement would increase the strength of thalamocortical afferents to facilitate the treatment of a novel stimulus while decreasing the cortico-cortical signaling to reduce recurrent or top-down modulation. This balance would be mediated by different cholinergic receptor subtypes that are located on both glutamatergic and GABAergic neurons of the different cortical layers. The mechanisms of cholinergic enhancement are closely linked to attentional processes, long-term potentiation (LTP) and modulation of the excitatory/inhibitory balance. Recently, it was found that boosting the cholinergic system during visual training robustly enhances sensory perception in a long-term manner. Our hypothesis is that repetitive pairing of cholinergic and sensory stimulation over a long period of time induces long-term changes in the processing of trained stimuli that might improve perceptual ability. Various non-invasive approaches to the activation of the cholinergic neurons have strong potential to improve visual perception.

Responding for a conditioned reinforcer, and its enhancement by nicotine, is blocked by dopamine receptor antagonists and a 5-HT(2C) receptor agonist but not by a 5-HT(2A) receptor antagonist

An aspect of nicotine reinforcement that may contribute to tobacco addiction is the effect of nicotine to enhance the motivational properties of reward-associated cues, or conditioned stimuli (CSs). Several studies have now shown that nicotine enhances responding for a stimulus that has been paired with a natural reinforcer. This effect of nicotine to enhance responding for a conditioned reinforcer is likely due to nicotine-induced enhancements in mesolimbic dopaminergic activity, but this has not been directly assessed. In this study, we assessed roles for dopamine (DA) D1 or D2 receptors, and two serotonin (5-HT) receptor subtypes known to modulate DA activity, the 5-HT2C or 5-HT2A subtypes, on nicotine-enhanced responding for a conditioned reinforcer. Water-restricted rats were exposed to Pavlovian conditioning sessions, where a CS was paired with water delivery. Then, in a second phase, animals were required to perform a novel, lever-pressing response for presentations of the CS as a conditioned reinforcer. Nicotine (0.4 mg/kg) enhanced responding for the conditioned reinforcer. To examine potential roles for dopamine (DA) and serotonin (5-HT) receptors in this effect, separate groups of animals were used to assess the impact of administering the D1 receptor antagonist SCH 23390, D2 receptor antagonist eticlopride, 5-HT2C receptor agonist Ro 60-0175, or 5-HT2A receptor antagonist M100907 on nicotine-enhanced responding for conditioned reinforcement. SCH 23390, eticlopride, and Ro 60-0175 all reduced responding for conditioned reinforcement, and the ability of nicotine to enhance this effect. M100907 did not alter this behavior. Together, these studies indicate that DA D1 and D2 receptors, but not 5-HT2A receptors, contribute to the effect of nicotine to enhance responding for a conditioned reinforcer. This effect can also be modulated by 5-HT2C receptor activation.

Nicotine enhances the expression of a sucrose or cocaine conditioned place preference in adult male rats

Nicotine has been shown to enhance the motivational properties of non-nicotine stimuli. This reinforcement-enhancing property of nicotine has the potential to promote the use of other illicit substances as well as maladaptive patterns of food intake. Therefore, the current study aimed to examine whether nicotine enhances preference for contexts paired with cocaine or sucrose utilizing a place conditioning procedure. Separate groups of adult male rats were administered sucrose or cocaine in one of two compartments of a standard CPP chamber on four consecutive days. Preference was then assessed following no injection, a single subcutaneous (s.c.) injection of nicotine, and a s.c. saline injection. The animals preferred the chamber paired with either sucrose or cocaine, as evident from an increased time spent in the paired chamber compared to baseline. Nicotine further increased the time spent in the sucrose- or cocaine-paired chamber, consistent with a reinforcement-enhancement effect. Previous results demonstrate an interaction between nicotine and intake of other drugs or food. The present findings provide an additional mechanism that may underlie these effects and which may have implications for drug dependence and obesity.

The effects of nicotine exposure during Pavlovian conditioning in rats on several measures of incentive motivation for a conditioned stimulus paired with water

RATIONALE

Nicotine enhances approach toward and operant responding for conditioned stimuli (CSs), but the effect of exposure during different phases of Pavlovian incentive learning on these measures remains to be determined.

OBJECTIVES

These studies examined the effects of administering nicotine early, late or throughout Pavlovian conditioning trials on discriminated approach behavior, nicotine-enhanced responding for conditioned reinforcement, extinction, and the reinstatement of responding for conditioned reinforcement. We also tested the effect of nicotine on approach to a lever-CS in a Pavlovian autoshaping procedure and for this CS to serve as a conditioned reinforcer.

METHODS

Thirsty rats were exposed to 13 conditioning sessions where a light/tone CS was paired with the delivery of water. Nicotine was administered either prior to the first or last seven sessions, or throughout the entire conditioning procedure. Responding for conditioned reinforcement, extinction, and the reinstatement of responding by the stimulus and nicotine were compared across exposure groups. Separately, the effects of nicotine on conditioned approach toward a lever-CS during autoshaping, and responding for that CS as a conditioned reinforcer, were examined.

RESULTS

Nicotine exposure was necessary for nicotine-enhanced responding for conditioned reinforcement and the ability for nicotine and the stimulus to additively reinstate responding on the reinforced lever. Nicotine increased contacts with a lever-CS during autoshaping, and removal of nicotine abolished this effect. Prior nicotine exposure was necessary for nicotine-enhanced responding reinforced by the lever.

CONCLUSIONS

Enhancements in the motivating properties of CSs by nicotine occur independently from duration and timing effects of nicotine exposure during conditioning.

Synergistic interaction between caloric restriction and amphetamine in food-unrelated approach behavior of rats

RATIONALE

Approach behavior is regulated by the brain integrating information about environment and body state. Psychoactive drugs interact with this process.

OBJECTIVES

We examined the extent to which caloric (i.e., food) restriction, amphetamine (AMPH) and lithium interact in potentiating locomotor activity and responding reinforced by visual stimulus (VS), a reward unrelated to energy homeostasis.

METHODS

Rats either had ad libitum access to food or received daily rations that maintained 85-90 % of their original body weights. Leverpressing turned on a cue light for 1 s and turned off house light for 5 s. AMPH and lithium were administered through intraperitoneal injections and diet, respectively.

RESULTS

Food restriction or AMPH (1 mg/kg) alone had little effect on VS-reinforced responding; however, the combination of the two conditions markedly potentiated VS-reinforced responding (fourfold). Food restriction lasting 7 days or longer was needed to augment AMPH's effect on VS-reinforced responding. AMPH (0.3-3 mg/kg) potentiated locomotor activity similarly between food-restricted and ad libitum groups. Repeated injections of AMPH-sensitized locomotor activity, but not VS-reinforced responding. In addition, while chronic lithium treatments (0.2 % lithium carbonate chow) reduced VS-reinforced responding, chronic lithium further augmented AMPH-potentiated VS-reinforced responding.

CONCLUSIONS

Food restriction interacts with psychoactive drugs to potentiate goal-directed responding unrelated to food seeking in a much more powerful manner than previously thought. The novel finding that lithium can augment a psychostimulant effect of AMPH suggests caution when combining lithium and psychostimulant drugs in clinical settings.

Repeated nicotine exposure during adolescence alters reward-related learning in male and female rats

RATIONALE

Repeated nicotine exposure causes neuroadaptations in limbic cortico-striatal circuits involved in learning and motivation. Such alterations are relevant to addiction because they are suggested to mediate the ability of smoking-associated stimuli to control behavior and to enhance nicotine-seeking and -taking behaviors. Female smokers report higher cue reactivity relative to their male counter parts, yet little is known about putative gender-specific effects of adolescent nicotine exposure on reward-related learning. Prior repeated nicotine exposure in adult male rats enhances Pavlovian approach behavior and conditioned reinforcement.

OBJECTIVE

Given that smoking is typically initiated during adolescence, here we assessed the extent to which adolescent nicotine exposure impacts Pavlovian approach and conditioned reinforcement in male and female rats.

METHODS

Rats were injected with nicotine on postnatal days 31-45 prior to training on Pavlovian approach behavior starting on day 51. They were trained to associate a conditioned stimulus (CS), illumination of a magazine light, and tone, with an unconditioned stimulus (US), the delivery of water, for 10-daily sessions, and then were tested on the acquisition of responding with conditioned reinforcement.

RESULTS

Adolescent nicotine exposure selectively increased approach to the magazine during the CS in males but decreased approach to the magazine during the CS in female rats. Vehicle-exposed female rats, however, showed greater magazine approach during the CS than did male control rats. Prior nicotine exposure also enhanced conditioned reinforcement in both male and female rats.

CONCLUSIONS

Repeated exposure to nicotine during adolescence had opposite effects on Pavlovian approach behavior in male and female rats but enhanced acquisition of a new response with conditioned reinforcement. Novel information on how nicotine exposure influences reward-related learning during adolescence may increase our understanding of neurobiological mechanisms involved in the initiation of smoking behavior.

Effects of nicotine on olfactogustatory incentives: preference, palatability, and operant choice tests

INTRODUCTION

The use of additives in tobacco may capitalize on the incentive motivational properties of tastes and scents such as mint (menthol), vanilla, and strawberry. These incentives are intended to increase tobacco experimentation, but their salience may also be enhanced by the incentive amplifying effects of nicotine (NIC). The goal of the present studies was to investigate the potential interaction between the incentive amplifying effects of NIC and gustatory incentives.

METHODS

One of two discriminable tastes (grape or cherry Kool-Aid®; 0.05% wt/vol; unsweetened) was paired with sucrose (20% wt/vol; conditioned stimulus [CS+]) in deionized water, whereas the other taste (CS-) was presented in deionized water. Experiment 1 investigated the effects of NIC pretreatment on preference for the CS+ versus CS- in 2-bottle choice tests. Experiment 2 investigated the effects of NIC on palatability of the CS+ and CS- using orofacial taste reactions. Experiment 3 investigated the effects of NIC on reinforcement by the CS+ and CS- using a concurrent choice operant task.

RESULTS

NIC pretreatment robustly increased operant responding for the CS+ but did not alter responding for the CS- in the operant choice task (Experiment 3). However, NIC pretreatment did not alter intake or palatability of the CS+ or CS- (Experiments 1 and 2).

CONCLUSIONS

NIC increases the reinforcing effects of gustatory incentive stimuli, even though these stimuli were not paired with NIC administration. The findings suggest that adding taste incentives to tobacco products may increase the attractiveness of these products to consumers and the probability of repeated use.

Reinforcement enhancing effects of nicotine via smoking

RATIONALE

In animals, nicotine enhances reinforcement from stimuli unrelated to nicotine intake. Human research is suggestive but has not clearly shown a similar influence of nicotine.

OBJECTIVES

We assessed acute effects of nicotine via smoking on enhancement of positive (money, music) or negative (termination of noise) reinforcers, or no "reward" (control). These different rewards determined the generalizability of nicotine effects.

MATERIALS AND METHODS

Dependent (n = 25) and nondependent (n = 27) smokers participated in three sessions, each after overnight abstinence. Using a within-subjects design, sessions involved no smoking or smoking denicotinized (0.05 mg) or nicotine (0.6 mg) Quest(R) brand cigarettes. For comparison, a fourth session involved no abstinence prior to smoking one's own brand to gauge responses under typical nicotine satiation. Reinforcement was assessed by responses on a simple operant computer task for the rewards, each available singly on a progressive ratio schedule during separate trials.

RESULTS

The reinforcing effect of music, but not other rewards, was greater due to the nicotine cigarette, compared to the denicotinized cigarette or no smoking. Reinforcement enhancing effects of nicotine did not differ between dependent and nondependent groups, indicating no influence of withdrawal relief. Responding due to acute nicotine after abstinence was very similar to responding to one's own brand after no abstinence.

CONCLUSIONS

Acute nicotine intake per se from smoking after abstinence enhances the reinforcing value of rewards unassociated with smoking, perhaps in a manner comparable to ad lib smoking after no abstinence. Nicotine's reinforcement enhancing effects may be specific to certain rewards, perhaps those sensory in nature.

Potential therapeutic uses of mecamylamine and its stereoisomers

Mecamylamine (3-methylaminoisocamphane hydrochloride) is a nicotinic parasympathetic ganglionic blocker, originally utilized as a therapeutic agent to treat hypertension. Mecamylamine administration produces several deleterious side effects at therapeutically relevant doses. As such, mecamylamine's use as an antihypertensive agent was phased out, except in severe hypertension. Mecamylamine easily traverses the blood-brain barrier to reach the central nervous system (CNS), where it acts as a nicotinic acetylcholine receptor (nAChR) antagonist, inhibiting all known nAChR subtypes. Since nAChRs play a major role in numerous physiological and pathological processes, it is not surprising that mecamylamine has been evaluated for its potential therapeutic effects in a wide variety of CNS disorders, including addiction. Importantly, mecamylamine produces its therapeutic effects on the CNS at doses 3-fold lower than those used to treat hypertension, which diminishes the probability of peripheral side effects. This review focuses on the pharmacological properties of mecamylamine, the differential effects of its stereoisomers, S(+)- and R(-)-mecamylamine, and the potential for effectiveness in treating CNS disorders, including nicotine and alcohol addiction, mood disorders, cognitive impairment and attention deficit hyperactivity disorder.

Possible reinforcement enhancing effects of bupropion during initial smoking abstinence

INTRODUCTION

Due to a drop in nicotine, smoking cessation may attenuate reinforcement from sensory stimuli unrelated to nicotine intake. Recent rodent research suggests that bupropion may reverse this attenuation, perhaps helping explain its efficacy in aiding cessation.

METHODS

In a within-subjects, crossover study, smokers responded on a simple computer task for brief music reward available on a progressive ratio 50% schedule. Testing was done on three separate occasions: after ad lib smoking during prequit baseline and on the first day of two brief quit attempts while taking bupropion or placebo, in counter-balanced order. Number of operant responses was the measure of reinforcement. To more clearly assess abstinence and medication effects, those meeting 24-hr abstinence criteria (CO < 5 ppm; n = 5) or clearly failing to abstain (CO > 10 ppm; n = 5) during both medication conditions were compared.

RESULTS

Among abstainers, repeated measures ANOVA showed that reinforced responding decreased by nearly 50% from baseline after quitting on placebo (p = .03), while responding after quitting on bupropion was similar to that during baseline (-17%; p = .20). In contrast, those unable to abstain showed virtually identical reinforced responding due to either medication or baseline.

CONCLUSIONS

These exploratory findings confirm that responding for a reward unrelated to smoking decreases after abstinence and are consistent with animal research showing bupropion effects on enhancing reinforced responding.

The effect of nicotine on sign-tracking and goal-tracking in a Pavlovian conditioned approach paradigm in rats

RATIONALE

Nicotine (NIC) potently increases operant responding for non-NIC reinforcers, and this effect may depend on drug-mediated increases in incentive motivation. According to this hypothesis, NIC should also potently increase approach to Pavlovian-conditioned stimuli associated with rewards.

OBJECTIVE

The present studies explored the effects of NIC on Pavlovian-conditioned approach responses.

METHOD

To do so, liquid dippers were used to deliver an unconditioned stimulus (US; 0.1 ml sucrose) after presentation of a conditioned stimulus (CS; 30 s illumination of a stimulus light)-both the CS and US were presented in receptacles equipped to monitor head entries.

RESULTS

In experiment 1, the CS and US were presented in the same receptacle, but NIC pretreatment (0.4 mg/kg base) did not increase conditioned approach responses. Delivery of the sucrose US was then shifted to receptacle in a different location. All rats learned to approach the new US location (goal-tracking) at similar rates. Approach to the CS receptacle (sign-tracking) declined for saline-pretreated rats, but NIC pretreatment increased sign-tracking. In experiment 2, NIC pretreatment increased sign-tracking when the CS and US were spatially separated during acquisition. In experiment 3, NIC pretreatments were replaced with saline, but the effect of NIC persisted for an additional 24 test sessions.

CONCLUSION

The findings suggest that NIC increases incentive motivation and that this effect is long-lasting, persisting beyond the pharmacological effects of NIC.

Nicotine-induced enhancement of responding for conditioned reinforcement in rats: role of prior nicotine exposure and α4β2 nicotinic receptors

RATIONALE

Stimuli associated with nicotine can become motivationally significant and may play a role in tobacco dependence. Previous work indicates that nicotine enhances responding for a conditioned reinforcer (CR).

OBJECTIVES

These studies examined the effects of prior exposure to nicotine on responding for a CR, persistence of this response, and the role of α4β2 or α7 nicotinic receptor subtypes.

METHODS

Water deprived rats were given 13 Pavlovian conditioning sessions where a light/tone conditioned stimulus (CS) was paired with the delivery of water. Then, rats were presented with two levers: one delivered the CS (now a CR), the other was inactive. Experiments examined the effect of nicotine administered prior to Pavlovian conditioning sessions on approach behavior during CS presentations, operant responding for CR in the presence and absence of nicotine, and the persistence of responding for CR. The effects of nicotinic acetylcholine receptor (nAChR) antagonism with mecamylamine and α4β2 or α7 nAChR antagonism with dihydro-beta-erythroidine (DHβE) or methyllycaconitine (MLA) on nicotine-enhanced responding for CR were examined.

RESULTS

Nicotine enhanced approach behavior during CS presentations and potentiated operant responding for CR, an effect sensitized as a result of nicotine exposure during conditioning. Responding for CR and its potentiation by nicotine was stable over multiple tests. Enhanced responding for the CR induced by nicotine was blocked by mecamylamine and DHβE, but not MLA.

CONCLUSIONS

Nicotine enhances Pavlovian discriminated approach and shows sensitized nicotine-induced enhancements in responding for CR, an effect depending on α4β2 nAChRs.