Differential control over drug-seeking behavior by drug-associated conditioned reinforcers and discriminative stimuli predictive of drug availability

Relapse after intermittent access to cocaine: Discriminative cues more effectively trigger drug seeking than do conditioned cues

RATIONALE

When people with drug addiction encounter cues associated with drug use, this can trigger cravings and relapse. These cues can include conditioned stimuli (CSs) signaling drug delivery and discriminative stimuli (DSs) signaling drug availability. Compared to CS effects, DS effects are less explored in preclinical studies on cue-induced relapse.

OBJECTIVE

We compared CS and DS effects on reward seeking following abstinence from intermittent-access cocaine (or sucrose) self-administration.

METHODS

During 15-20 intermittent-access sessions, rats self-administered i.v. cocaine or sucrose pellets paired with a light-tone CS. Cocaine/sucrose was available for 5-min (signalled by a light; DS+) and unavailable for 25 min (signalled by different lighting conditions; DS-), and this cycled for 4 h/session. Following abstinence, we measured cocaine/sucrose seeking under extinction triggered by CS and DS presentation, and instrumental responding reinforced by these cues.

RESULTS

Across intermittent-access sessions, rats increased lever pressing for cocaine or sucrose during DS+ periods and decreased responding during DS- periods. On days 2 and 21 of abstinence, only presentation of the DS+ or DS+ and CS combined elicited increased cocaine/sucrose-seeking behaviour (i.e., increased active lever presses). Presenting the DS- alongside the DS+ suppressed the increased cocaine-seeking behaviour otherwise produced by the DS+ . Finally, on day 21 of abstinence, rats showed equivalent levels of lever pressing reinforced by the DS+ , CS and by the DS+ and CS combined, suggesting comparable conditioned reinforcing value.

CONCLUSIONS

After intermittent self-administration, cocaine-associated DSs and CSs acquire similar conditioned reinforcing properties, but DSs more effectively trigger increases in drug seeking.

Modulation of cue value and the augmentation of heroin seeking in chronically food-restricted male rats under withdrawal

Food restriction augments drug seeking in abstinent rats. The underlying motivational mechanisms, however, remain unclear. We hypothesized that caloric restriction enhances the incentive value attributed to drug-associated cues and, in turn, augments drug seeking. Male rats were trained to lever-press for heroin, and then moved to the animal colony for a forced-abstinence period. Rats were maintained on free access to food (Sated) or subjected to 14 days of food restriction (FDR). In a series of experiments, we assessed the effect of food-restriction on the incentive value of heroin-associated cues. Tests included performance under a progressive ratio (PR) schedule of reinforcement maintained by heroin-associated cues, acquisition of a novel operant response reinforced by drug-associated cues, effect of food-restriction on operant response reinforced by neutral cues, acquisition of a novel operant response reinforced by drug-associated or neutral cues, and the effect of food-restriction on operant response reinforced by drug-associated or neutral cues, under a discrete choice procedure. Food-restriction did not change breakpoints in PR maintained by heroin-associated cues. FDR rats acquired the novel response at a greater level compared to the Sated group. Food-restriction-induced increase in novel-response rate was observed for both heroin-paired and the neutral cue. Responding for a heroin-associated cue was greater than for the neutral cue in both Sated and FDR groups. Response rate for the neutral cue, however, was greater in the FDR versus Sated group. Our findings suggest that food restriction increases the conditioned motivational properties of environmental stimuli, including, but not exclusive to, heroin-paired cues.

Double dissociation of perirhinal nicotinic acetylcholine receptors and dopamine D2 receptors in modulation of object memory consolidation by nicotine, cocaine and their conditioned stimuli

There are indications that drug conditioned stimuli (CS) may activate neurochemical systems of memory modulation that are activated by the drugs themselves. To directly test this hypothesis, a cholinergic nicotinic receptor antagonist (mecamylamine; MEC: 0, 10 or 30 µg/side) and a dopamine D2 receptor antagonist (l-741,626: 0, 0.63, 2.5 µg/side) were infused in the perirhinal cortex (PRh) to block modulation of object recognition memory consolidation induced by 0.4 mg/kg nicotine, 20 mg/kg cocaine, or their CSs. To establish these CSs, male Sprague-Dawley rats were confined for 2 h in a chamber, the CS+, after injections of 0.4 mg/kg nicotine, or 20 mg/kg cocaine, and in another chamber, the CS-, after injections of vehicle. This was repeated over 10 days (5 drug/CS+ and 5 vehicle/CS- pairings in total). It was found that the memory enhancing action of post-sample nicotine was blocked by intra-PRh infusions of both MEC doses, and 30 µg/side MEC also blocked the memory enhancing action of the nicotine CS. Interestingly, intra-PRh MEC did not block the memory enhancing effect of cocaine, nor that of the cocaine CS. In contrast, the memory enhancing action of post-sample cocaine administration was blocked by both l-741,626 doses, and 2.5 µg/side also blocked the effect of the cocaine CS, but not the memory effects of nicotine or of the nicotine CS. This functional double dissociation strongly indicates that drug CSs modulate memory consolidation by activating neural systems that are activated by the drugs themselves.

Inhibitory and excitatory alcohol-seeking cues distinct roles in behavior, neurochemistry, and mesolimbic pathway in alcohol preferring (P) rats

Cues associated with alcohol use can readily enhance self-reported cravings for alcohol, which increases the likelihood of reusing alcohol. Understanding the neuronal mechanisms involved in alcohol-seeking behavior is important for developing strategies to treat alcohol use disorder. In all experiments, adult female alcohol-preferring (P) rats were exposed to three conditioned odor cues; CS+ associated with EtOH self-administration, CS- associated with the absence of EtOH (extinction training), and a CS0, a neutral stimulus. The data indicated that presentation of an excitatory conditioned cue (CS+) can enhance EtOH- seeking while the CS- can inhibit EtOH-seeking under multiple test conditions. Presentation of the CS+ activates a subpopulation of dopamine neurons within the interfascicular nucleus of the posterior ventral tegmental area (posterior VTA) and basolateral amygdala (BLA). Pharmacological inactivation of the BLA with GABA agonists inhibits the ability of the CS+ to enhance EtOH-seeking but does not alter context-induced EtOH-seeking or the ability of the CS- to inhibit EtOH-seeking. Presentation of the conditioned odor cues in a non-drug-paired environment indicated that presentation of the CS+ increased dopamine levels in the BLA. In contrast, presentation of the CS- decreased both glutamate and dopamine levels in the BLA. Further analysis revealed that presentation of a CS+ EtOH-associated conditioned cue activates GABA interneurons but not glutamate projection neurons. Overall, the data indicate that excitatory and inhibitory conditioned cues can contrarily alter EtOH-seeking behaviors and that different neurocircuitries are mediating these distinct cues in critical brain regions. Pharmacotherapeutics for craving should inhibit the CS+ and enhance the CS- neurocircuits.

Hierarchical cue control of cocaine seeking in the face of cost

RATIONALE

Addiction is characterized by intermittent drug seeking despite rising costs. This behavior is heavily influenced by environmental stimuli that signal drug availability and reinforce drug seeking.

OBJECTIVE

To establish the relationship between three key aspects of human drug use in rats: the intermittent, binge nature of drug intake, the motivational conflict of drug seeking in the face of escalating negative costs, and the ability of different drug cues to interact to modulate relapse.

METHODS

Male and female rats were trained to self-administer cocaine on an intermittent access schedule, where brief drug-availability states were signaled by a shift in the ambient lighting of the environment, and cocaine infusions were signaled by a separate proximal discrete cue. Rats then went through a conflict procedure, where foot shock intensity associated with cocaine seeking was escalated until intake was suppressed. We then completed relapse tests where the drug-delivery cue was noncontingently presented alone, or in the context of dynamic drug-availability state transitions.

RESULTS

Intermittent access spurred psychomotor sensitization and binge-like cocaine intake. The intensity of binge-like drug taking during training was predictive of later drug seeking despite escalating costs during conflict. In relapse tests, the ability of a proximal discrete drug cue to trigger relapse was gated by the presence of a global cue signaling drug-availability state transitions.

CONCLUSIONS

Our results suggest that the pattern of drug intake plays a role in many features of addiction, including modifying an individual's willingness to endure high costs associated with drug seeking. Furthermore, our studies indicate that drug-related sensory information can be hierarchically organized to exert a dynamic modulating influence on drug-seeking motivation.

The effects of passive and active administration of heroin, and associated conditioned stimuli, on consolidation of object memory

Mode of administration (i.e., active vs passive) could influence the modulatory action that drugs of abuse exert on memory consolidation. Similarly, drug conditioned stimuli modulate memory consolidation and, therefore, acquisition and extinction of this conditioned response could also be influenced by mode of drug administration. Exploring these questions in male Sprague-Dawley rats, Study 1 assessed memory modulation by post-training 0, 0.3 and 1 mg/kg heroin injected subcutaneously in operant chambers (i.e., drug conditioned context). Study 2 asked a similar question but in rats trained to self-administer 0.05 mg/kg/infusion heroin intravenously, as well as in rats that received identical amounts of intravenous heroin but passively, using a yoked design. The period of heroin exposure was followed by repeated drug-free confinement in the conditioned context, and by sessions during which responses on the active lever had no scheduled consequences. Study 2 also included a cue-induced reinstatement session during which lever responses reactivated a light cue previously paired with intravenous heroin infusions. The post-training effects of injected/self-administered/yoked heroin, extinction and reinstatement sessions on memory consolidation were tested using the object location memory task. It was found that post-sample heroin enhanced memory in injected and yoked, but not self-administering, rats. However, post-sample exposure to the heroin cues (i.e., context or/and light cue) modulated memory equally in all groups. Taken together, these data support the conclusion that mode of administration impacts the cognitive consequences of exposure to drugs but not of environmental stimuli linked to their reinforcing effects.

Investigating discriminative stimulus modulation of opioid seeking after conflict-induced abstinence in sign- and goal-tracking rats

RATIONALE

Discriminative stimuli (DS) are cues that predict reward availability. DS are resistant to extinction and motivate drug seeking even after long periods of abstinence. Previous studies have demonstrated that sign-tracking (ST) and goal-tracking (GT) differences in Pavlovian approach predict distinct cue-modulated vulnerabilities to cocaine reinstatement. GT rats show heightened reinstatement to contextual and DS, while ST rats show heightened reinstatement to discrete stimuli. Here we examine whether DS modulate reinstatement after electric barrier-induced abstinence and whether tracking-related relapse vulnerabilities generalize to opioid relapse.

OBJECTIVES

We examine whether DS-modulated reinstatement to fentanyl seeking persists in the presence of reduced adverse consequences after electric barrier-induced abstinence. We also examine whether tracking differences predict the magnitude of DS-modulated reinstatement of fentanyl seeking after electric barrier-induced abstinence.

METHODS

We used Pavlovian lever autoshaping (PLA) training to determine sign-, goal-, and intermediate tracking groups in male and female Sprague Dawley rats. We then trained rats in a DS model of intermittent fentanyl self-administration, and extinguished drug seeking by imposing an electric barrier of increasing intensity. We then measured the level of DS-modulated reinstatement in the presence of a reduced electric barrier intensity.

RESULTS

We report that DS strongly modulate fentanyl seeking after electric barrier-induced abstinence. DS-modulation of fentanyl acquisition, electric barrier-induced abstinence, and reinstatement was similar for sign- and goal-tracking groups.

CONCLUSIONS

Discriminative stimuli powerfully motivate opioid seeking, despite continued aversive consequences. Pavlovian approach differences do not predict the level of DS-modulated reinstatement to fentanyl seeking after conflict-induced abstinence.

Drug-associated cues and drug dosage contribute to increased opioid seeking after abstinence

Patients with opioid use disorder experience high rates of relapse during recovery, despite successful completion of rehabilitation programs. A key factor contributing to this problem is the long-lasting nature of drug-seeking behavior associated with opioid use. We modeled this behavior in a rat drug self-administration paradigm in which drug-seeking is higher after extended abstinence than during the acute abstinence phase. The goal of this study was to determine the contribution of discrete or discriminative drug cues and drug dosage to time-dependent increases in drug-seeking. We examined heroin-seeking after 2 or 21 days of abstinence from two different self-administration cue-context environments using high or low doses of heroin and matched animals for their drug intake history. When lower dosages of heroin are used in discriminative or discrete cue protocols, drug intake history contributed to drug-seeking after abstinence, regardless of abstinence length. Incubation of opioid craving at higher dosages paired with discrete drug cues was not dependent on drug intake. Thus, interactions between drug cues and drug dosage uniquely determined conditions permissible for incubation of heroin craving. Understanding factors that contribute to long-lasting opioid-seeking can provide essential insight into environmental stimuli and drug-taking patterns that promote relapse after periods of successful abstinence.

Neurochemical substrates linked to impulsive and compulsive phenotypes in addiction: A preclinical perspective

Drug compulsion manifests in some but not all individuals and implicates multifaceted processes including failures in top-down cognitive control as drivers for the hazardous pursuit of drug use in some individuals. As a closely related construct, impulsivity encompasses rash or risky behaviour without foresight and underlies most forms of drug taking behaviour, including drug use during adverse emotional states (i.e., negative urgency). While impulsive behavioural dimensions emerge from drug-induced brain plasticity, burgeoning evidence suggests that impulsivity also predates the emergence of compulsive drug use. Although the neural substrates underlying the apparently causal relationship between trait impulsivity and drug compulsion are poorly understood, significant advances have come from the interrogation of defined limbic cortico-striatal circuits involved in motivated behaviour and response inhibition, together with chemical neuromodulatory influences from the ascending neurotransmitter systems. We review what is presently known about the neurochemical mediation of impulsivity, in its various forms, and ask whether commonalities exist in the neurochemistry of compulsive drug-motivated behaviours that might explain individual risk for addiction.

Addiction is driven by excessive goal-directed drug choice under negative affect: translational critique of habit and compulsion theory

Drug addiction may be a goal-directed choice driven by excessive drug value in negative affective states, a habit driven by strong stimulus-response associations, or a compulsion driven by insensitivity to costs imposed on drug seeking. Laboratory animal and human evidence for these three theories is evaluated. Excessive goal theory is supported by dependence severity being associated with greater drug choice/economic demand. Drug choice is demonstrably goal-directed (driven by the expected value of the drug) and can be augmented by stress/negative mood induction and withdrawal-effects amplified in those with psychiatric symptoms and drug use coping motives. Furthermore, psychiatric symptoms confer risk of dependence, and coping motives mediate this risk. Habit theory of addiction has weaker support. Habitual behaviour seen in drug-exposed animals often does not occur in complex decision scenarios, or where responding is rewarded, so habit is unlikely to explain most human addictive behaviour where these conditions apply. Furthermore, most human studies have not found greater propensity to habitual behaviour in drug users or as a function of dependence severity, and the minority that have can be explained by task disengagement producing impaired explicit contingency knowledge. Compulsion theory of addiction also has weak support. The persistence of punished drug seeking in animals is better explained by greater drug value (evinced by the association with economic demand) than by insensitivity to costs. Furthermore, human studies have provided weak evidence that propensity to discount cost imposed on drug seeking is associated with dependence severity. These data suggest that human addiction is primarily driven by excessive goal-directed drug choice under negative affect, and less by habit or compulsion. Addiction is pathological because negative states powerfully increase expected drug value acutely outweighing abstinence goals.

Cocaine, nicotine, and their conditioned contexts enhance consolidation of object memory in rats

To test the hypothesis that drugs of abuse and their conditioned stimuli (CSs) enhance memory consolidation, the effects of post-training exposure to cocaine and nicotine were compared to the effects of post-training exposure to contextual stimuli that were paired with the effects of these drugs. Using the object recognition (OR) task, it was first demonstrated that both 10 and 20 mg/kg cocaine, and 0.2 and 0.4 mg/kg nicotine, enhanced recognition memory when administered immediately after, but not 6 h after the sample phase. To establish the drug CSs, rats were confined for 2 h in a chamber (the CS+) after injections of 20 mg/kg cocaine, or 0.4 mg/kg nicotine, and in another chamber (the CS−) after injections of vehicle. This was repeated over 10 d (5 drug/CS+ and 5 vehicle/CS− pairings in total). At the end of this conditioning period, when tested in a drug-free state, rats displayed conditioned hyperactivity in the CS+ relative to the CS−. More important, immediate, but not delayed, post-sample exposure to the cocaine CS+, or nicotine CS+, enhanced OR memory. Therefore, this study reports for the first time that contextual stimuli paired with cocaine and nicotine, like the drugs themselves, have the ability to enhance memory consolidation.

Addictive behaviour in experimental animals: prospects for translation

Since the introduction of intravenous drug self-administration methodology over 50 years ago, experimental investigation of addictive behaviour has delivered an enormous body of data on the neural, psychological and molecular mechanisms of drug reward and reinforcement and the neuroadaptations to chronic use. Whether or not these behavioural and molecular studies are viewed as modelling the underpinnings of addiction in humans, the discussion presented here highlights two areas-the impact of drug-associated conditioned stimuli-or drug cues-on drug seeking and relapse, and compulsive cocaine seeking. The degree to which these findings translate to the clinical state of addiction is considered in terms of the underlying neural circuitry and also the ways in which this understanding has helped develop new treatments for addiction. The psychological and neural mechanisms underlying drug memory reconsolidation and extinction established in animal experiments show particular promise in delivering new treatments for relapse prevention to the clinic.This article is part of a discussion meeting issue 'Of mice and mental health: facilitating dialogue between basic and clinical neuroscientists'.

Differential stimulus control of drug-seeking: multimodal reinstatement

In animal models of substance-use disorder, individuals that repeatedly self-administer drugs of abuse have long-lasting neuronal adaptations that do not occur ostensibly in control animals only exposed to natural reinforcers (e.g. food). Because any treatment for substance-use disorder will be given to individuals with drug-taking histories, adequate dissociation of the specific neurobehavioral mechanisms underlying drug reinforcement, natural reinforcement and their associated cue effects requires an experimental model that exposes individuals to both reinforcer conditions, along with their associated stimuli. Furthermore, contingent stimuli that reinforce drug seeking through second-order relationships may produce reinstatement of drug seeking through different neurobehavioral means than non-contingent exposure to stimuli that signal the availability of a drug reinforcer, effectively producing different modes of stimulus-induced reinstatement. Toward experimental isolation of the relationships mentioned, herein, we used a within-session multiple schedule of reinforcement containing both discriminative (S^D ) and conditioned (CS) stimuli to study stimulus control of drug-taking and food-taking behavior, along with how these functionally distinct cues may differentially reinstate drug-seeking and food-seeking behavior within a single animal. We demonstrate specific stimulus control over drug and food taking; furthermore, we demonstrate that the same stimulus (i.e. cue light) operating as an S^D or CS produced differential reinstatement of drug-taking and food-taking behavior. The results suggest that contingent CSs and non-contingent S^D s produce reinstatement through different neurobehavioral processes and, within-session multiple schedules, can be used to study different modes of specific stimulus control over drug and food seeking in a single animal with both drug-taking and food-taking history.

The Winding Road to Relapse: Forging a New Understanding of Cue-Induced Reinstatement Models and Their Associated Neural Mechanisms

In drug addiction, cues previously associated with drug use can produce craving and frequently trigger the resumption of drug taking in individuals vulnerable to relapse. Environmental stimuli associated with drugs or natural reinforcers can become reliably conditioned to increase behavior that was previously reinforced. In preclinical models of addiction, these cues enhance both drug self-administration and reinstatement of drug seeking. In this review, we will dissociate the roles of conditioned stimuli as reinforcers from their modulatory or discriminative functions in producing drug-seeking behavior. As well, we will examine possible differences in neurobiological encoding underlying these functional differences. Specifically, we will discuss how models of drug addiction and relapse should more systematically evaluate these different types of stimuli to better understand the neurobiology underlying craving and relapse. In this way, behavioral and pharmacotherapeutic interventions may be better tailored to promote drug use cessation outcomes and long-term abstinence.

Projection-Target-Defined Effects of Orexin and Dynorphin on VTA Dopamine Neurons

Circuit-specific signaling of ventral tegmental area (VTA) dopamine neurons drives different aspects of motivated behavior, but the neuromodulatory control of these circuits is unclear. We tested the actions of co-expressed lateral hypothalamic peptides, orexin A (oxA) and dynorphin (dyn), on projection-target-defined dopamine neurons in mice. We determined that VTA dopamine neurons that project to the nucleus accumbens lateral shell (lAcbSh), medial shell (mAcbSh), and basolateral amygdala (BLA) are largely non-overlapping cell populations with different electrophysiological properties. Moreover, the neuromodulatory effects of oxA and dyn on these three projections differed. OxA selectively increased firing in lAcbSh- and mAcbSh-projecting dopamine neurons. Dyn decreased firing in the majority of mAcbSh- and BLA-projecting dopamine neurons but reduced firing only in a small fraction of those that project to the lAcbSh. In conclusion, the oxA-dyn input to the VTA may drive reward-seeking behavior by tuning dopaminergic output in a projection-target-dependent manner.

The infralimbic and prelimbic cortices contribute to the inhibitory control of cocaine-seeking behavior during a discriminative stimulus task in rats

The infralimbic and prelimbic (IL and PL, respectively) regions of the medial prefrontal cortex regulate the control of drug-seeking behavior. However, their roles in cocaine seeking in a discriminative stimulus (DS)-based self-administration task are unclear. To address this issue, male Sprague Dawley rats were trained on a DS task in which, on a trial-by-trial basis, a DS+ indicated that a lever press would produce a cocaine infusion, whereas a distinct DS- indicated that a lever press would produce nothing. IL and PL inactivation via GABA receptor activation decreased performance accuracy and disinhibited behavioral responding on DS- trials, resulting in greater lever pressing during the DS- presentation. This was accompanied by a decrease in cocaine infusions obtained, a finding confirmed in a subsequent experiment using a standard FR1 cocaine self-administration paradigm. We repeated the DS study using a food reward and found that inactivation of each region decreased performance accuracy but had no effect on the total number of food pellets earned. Additional experiments with the cocaine DS task found that dopamine receptor blockade in the IL, but not PL, reduced performance accuracy and disinhibited behavioral responding on DS- trials, whereas AMPA receptor blockade in the IL and PL had no effect on performance accuracy. These findings strongly suggest that, in a DS-based self-administration task in which rats must actively decide whether to engage in lever pressing (DS+) or withhold lever pressing (DS-) on a trial-by-trial basis, both the IL and PL contribute to the inhibitory control of drug-seeking behavior.

Diverse Roads to Relapse: A Discriminative Cue Signaling Cocaine Availability Is More Effective in Renewing Cocaine Seeking in Goal Trackers Than Sign Trackers and Depends on Basal Forebrain Cholinergic Activity

Stimuli associated with taking drugs are notorious instigators of relapse. There is, however, considerable variation in the motivational properties of such stimuli, both as a function of the individual and the nature of the stimulus. The behavior of some individuals (sign trackers, STs) is especially influenced by cues paired with reward delivery, perhaps because they are prone to process information via dopamine-dependent, cue-driven, incentive salience systems. Other individuals (goal trackers, GTs) are better able to incorporate higher-order contextual information, perhaps because of better executive/attentional control over behavior, which requires frontal cortical cholinergic activity. We hypothesized, therefore, that a cue that "sets the occasion" for drug taking (a discriminative stimulus, DS) would reinstate cocaine seeking more readily in GTs than STs and that this would require intact cholinergic neurotransmission. To test this, male STs and GTs were trained to self-administer cocaine using an intermittent access schedule with periods of cocaine availability and unavailability signaled by a DS+ and a DS-, respectively. Thereafter, half of the rats received an immunotoxic lesion that destroyed 40-50% of basal forebrain cholinergic neurons and later, after extinction training, were tested for the ability of noncontingent presentations of the DS+ to reinstate cocaine seeking behavior. The DS+ was much more effective in reinstating cocaine seeking in GTs than STs and this effect was abolished by cholinergic losses despite the fact that all rats continued to orient to the DS+ We conclude that vulnerability to relapse involves interactions between individual cognitive-motivational biases and the form of the drug cue encountered.SIGNIFICANCE STATEMENT The most predictable outcome of a diagnosis of addiction is a high chance for relapse. When addicts encounter cues previously associated with drug, their attention may be unduly attracted to such cues and these cues can evoke motivational states that instigate and maintain drug-seeking behavior. Although sign-tracking rats were previously demonstrated to exhibit greater relapse vulnerability to Pavlovian drug cues paired with drug delivery, here, we demonstrate that their counterparts, the goal trackers, are more vulnerable if the drug cue acts to signal drug availability and that the forebrain cholinergic system mediates such vulnerability. Given the importance of contextual cues for triggering relapse and the human cognitive-cholinergic capacity for the processing of such cues, goal trackers model essential aspects of relapse vulnerability.

Extended nicotine self-administration increases sensitivity to nicotine, motivation to seek nicotine and the reinforcing properties of nicotine-paired cues

An array of pharmacological and environmental factors influence the development and maintenance of tobacco addiction. The nature of these influences likely changes across the course of an extended smoking history, during which time drug seeking can become involuntary and uncontrolled. The present study used an animal model to examine the factors that drive nicotine-seeking behavior after either brief (10 days) or extended (40 days) self-administration training. In Experiment 1, extended training increased rats' sensitivity to nicotine, indicated by a leftward shift in the dose-response curve, and their motivation to work for nicotine, indicated by an increase in the break point achieved under a progressive ratio schedule. In Experiment 2, extended training imbued the nicotine-paired cue with the capacity to maintain responding to the same high level as nicotine itself. However, Experiment 3 showed that the mechanisms involved in responding for nicotine or a nicotine-paired cue are dissociable, as treatment with the partial nicotine receptor agonist, varenicline, suppressed responding for nicotine but potentiated responding for the nicotine-paired cue. Hence, across extended nicotine self-administration, pharmacological and environmental influences over nicotine seeking increase such that nicotine seeking is controlled by multiple sources, and therefore highly resistant to change.

A test of stress, cues, and re-exposure to large wins as potential reinstaters of suboptimal decision making in rats

The present experiment investigated potential reinstaters of suboptimal economic decision making in rats. Rats were first trained on a version of the rat Gambling Task under conditions designed to promote choice of a suboptimal option that occasionally resulted in large “wins” (four sucrose pellets). In a second phase, preference for this economically suboptimal option was reduced by substantially increasing the probability of punishment when this option was chosen. Then, three events were tested for their ability to reinstate choice of the suboptimal option. A brief period of re-exposure to a high frequency of large wins significantly increased choice of the suboptimal option. The pharmacological stressor yohimbine did not reinstate suboptimal choice, but did increase impulsive action as indexed by premature responding. Presentation of cues previously associated with large wins did not alter behavior. Results suggest reinstaters of suboptimal choice may differ from reinstaters of extinguished drug- and food-seeking behavior.

A hierarchical instrumental decision theory of nicotine dependence

It is important to characterize the learning processes governing tobacco-seeking in order to understand how best to treat this behavior. Most drug learning theories have adopted a Pavlovian framework wherein the conditioned response is the main motivational process. We favor instead a hierarchical instrumental decision account, wherein expectations about the instrumental contingency between voluntary tobacco-seeking and the receipt of nicotine reward determines the probability of executing this behavior. To support this view, we review titration and nicotine discrimination research showing that internal signals for deprivation/satiation modulate expectations about the current incentive value of smoking, thereby modulating the propensity of this behavior. We also review research on cue-reactivity which has shown that external smoking cues modulate expectations about the probability of the tobacco-seeking response being effective, thereby modulating the propensity of this behavior. Economic decision theory is then considered to elucidate how expectations about the value and probability of response-nicotine contingency are integrated to form an overall utility estimate for that option for comparison with qualitatively different, nonsubstitute reinforcers, to determine response selection. As an applied test for this hierarchical instrumental decision framework, we consider how well it accounts for individual liability to smoking uptake and perseveration, pharmacotherapy, cue-extinction therapies, and plain packaging. We conclude that the hierarchical instrumental account is successful in reconciling this broad range of phenomenon precisely because it accepts that multiple diverse sources of internal and external information must be integrated to shape the decision to smoke.

GIRK Channels: A Potential Link Between Learning and Addiction

The ability of drug-associated cues to reinitiate drug craving and seeking, even after long periods of abstinence, has led to the hypothesis that addiction represents a form of pathological learning, in which drugs of abuse hijack normal learning and memory processes to support long-term addictive behaviors. In this chapter, we review evidence suggesting that G protein-gated inwardly rectifying potassium (GIRK/Kir3) channels are one mechanism through which numerous drugs of abuse can modulate learning and memory processes. We will examine the role of GIRK channels in two forms of experience-dependent long-term changes in neuronal function: homeostatic plasticity and synaptic plasticity. We will also discuss how drug-induced changes in GIRK-mediated signaling can lead to changes that support the development and maintenance of addiction.

Plain cigarette packs do not exert Pavlovian to instrumental transfer of control over tobacco-seeking

AIMS

To gain insight into the potential impact of plain tobacco packaging policy, two experiments were undertaken to test whether 'prototype' plain compared with branded UK cigarette pack stimuli would differentially elicit instrumental tobacco-seeking in a nominal Pavlovian to instrumental transfer (PIT) procedure.

DESIGN, SETTING AND PARTICIPANTS

Two experiments were undertaken at the University of Bristol UK, with a convenience sample of adult smokers (experiment 1, n = 23, experiment 2, n = 121).

MEASUREMENT

In both experiments, smokers were trained on a concurrent choice procedure in which two responses earned points for cigarettes and chocolate, respectively, before images of branded and plain packs were tested for capacity to elicit the tobacco-seeking response in extinction. The primary outcome was percentage choice of the tobacco- over the chocolate-seeking response in plain pack, branded pack and no-stimulus conditions.

FINDINGS

Both experiments found that branded packs primed a greater percentage of tobacco-seeking (overall mean = 62%) than plain packs (overall mean = 53%) and the no-stimulus condition (overall mean = 52%; Ps ≤ 0.01, ŋp (2) s ≥ 0.16), and that there was no difference in percentage tobacco-seeking between plain packs and the no-stimulus condition (Ps ≥ 0.17, ŋp (2) s ≤ 0.04). Plain tobacco packs showed an overall 9% reduction in the priming of a tobacco choice response compared to branded tobacco packs.

CONCLUSIONS

Plain packaging may reduce smoking in current smokers by degrading cue-elicited tobacco-seeking.

Neural and psychological mechanisms underlying compulsive drug seeking habits and drug memories--indications for novel treatments of addiction

This review discusses the evidence for the hypothesis that the development of drug addiction can be understood in terms of interactions between Pavlovian and instrumental learning and memory mechanisms in the brain that underlie the seeking and taking of drugs. It is argued that these behaviours initially are goal-directed, but increasingly become elicited as stimulus-response habits by drug-associated conditioned stimuli that are established by Pavlovian conditioning. It is further argued that compulsive drug use emerges as the result of a loss of prefrontal cortical inhibitory control over drug seeking habits. Data are reviewed that indicate these transitions from use to abuse to addiction depend upon shifts from ventral to dorsal striatal control over behaviour, mediated in part by serial connectivity between the striatum and midbrain dopamine systems. Only some individuals lose control over their drug use, and the importance of behavioural impulsivity as a vulnerability trait predicting stimulant abuse and addiction in animals and humans, together with consideration of an emerging neuroendophenotype for addiction are discussed. Finally, the potential for developing treatments for addiction is considered in light of the neuropsychological advances that are reviewed, including the possibility of targeting drug memory reconsolidation and extinction to reduce Pavlovian influences on drug seeking as a means of promoting abstinence and preventing relapse.

Positive reinforcement mediated by midbrain dopamine neurons requires D1 and D2 receptor activation in the nucleus accumbens

The neural basis of positive reinforcement is often studied in the laboratory using intracranial self-stimulation (ICSS), a simple behavioral model in which subjects perform an action in order to obtain exogenous stimulation of a specific brain area. Recently we showed that activation of ventral tegmental area (VTA) dopamine neurons supports ICSS behavior, consistent with proposed roles of this neural population in reinforcement learning. However, VTA dopamine neurons make connections with diverse brain regions, and the specific efferent target(s) that mediate the ability of dopamine neuron activation to support ICSS have not been definitively demonstrated. Here, we examine in transgenic rats whether dopamine neuron-specific ICSS relies on the connection between the VTA and the nucleus accumbens (NAc), a brain region also implicated in positive reinforcement. We find that optogenetic activation of dopaminergic terminals innervating the NAc is sufficient to drive ICSS, and that ICSS driven by optical activation of dopamine neuron somata in the VTA is significantly attenuated by intra-NAc injections of D1 or D2 receptor antagonists. These data demonstrate that the NAc is a critical efferent target sustaining dopamine neuron-specific ICSS, identify receptor subtypes through which dopamine acts to promote this behavior, and ultimately help to refine our understanding of the neural circuitry mediating positive reinforcement.

Positive reinforcement mediated by midbrain dopamine neurons requires D1 and D2 receptor activation in the nucleus accumbens

The neural basis of positive reinforcement is often studied in the laboratory using intracranial self-stimulation (ICSS), a simple behavioral model in which subjects perform an action in order to obtain exogenous stimulation of a specific brain area. Recently we showed that activation of ventral tegmental area (VTA) dopamine neurons supports ICSS behavior, consistent with proposed roles of this neural population in reinforcement learning. However, VTA dopamine neurons make connections with diverse brain regions, and the specific efferent target(s) that mediate the ability of dopamine neuron activation to support ICSS have not been definitively demonstrated. Here, we examine in transgenic rats whether dopamine neuron-specific ICSS relies on the connection between the VTA and the nucleus accumbens (NAc), a brain region also implicated in positive reinforcement. We find that optogenetic activation of dopaminergic terminals innervating the NAc is sufficient to drive ICSS, and that ICSS driven by optical activation of dopamine neuron somata in the VTA is significantly attenuated by intra-NAc injections of D1 or D2 receptor antagonists. These data demonstrate that the NAc is a critical efferent target sustaining dopamine neuron-specific ICSS, identify receptor subtypes through which dopamine acts to promote this behavior, and ultimately help to refine our understanding of the neural circuitry mediating positive reinforcement.

Pavlovian conditioned approach, extinction, and spontaneous recovery to an audiovisual cue paired with an intravenous heroin infusion

RATIONALE

Novel stimuli paired with exposure to addictive drugs can elicit approach through Pavlovian learning. While such approach behavior, or sign tracking, has been documented for cocaine and alcohol, it has not been shown to occur with opiate drugs like heroin. Most Pavlovian conditioned approach paradigms use an operandum as the sign, so that sign tracking can be easily automated.

OBJECTIVES

We were interested in assessing whether approach behavior occurs to an audiovisual cue paired with an intravenous heroin infusion. If so, would this behavior exhibit characteristics of other Pavlovian conditioned behaviors, such as extinction and spontaneous recovery?

METHODS

Rats were repeatedly exposed to an audiovisual cue, similar to that used in standard self-administration models, along with an intravenous heroin infusion. Sign tracking was measured in an automated fashion by analyzing motion pixels within the cue zone during each cue presentation.

RESULTS

We were able to observe significant sign tracking after only five pairings of the conditioned stimulus (CS) with the unconditioned stimulus (US). This behavior rapidly extinguished over 2 days, but exhibited pronounced spontaneous recovery 3 weeks later.

CONCLUSIONS

We conclude that sign tracking measured by these methods exhibits all the characteristics of a classically conditioned behavior. This model can be used to examine the Pavlovian component of drug memories, alone, or in combination with self-administration methods.

Individual variation in resisting temptation: implications for addiction

When exposed to the sights, sounds, smells and/or places that have been associated with rewards, such as food or drugs, some individuals have difficulty resisting the temptation to seek out and consume them. Others have less difficulty restraining themselves. Thus, Pavlovian reward cues may motivate maladaptive patterns of behavior to a greater extent in some individuals than in others. We are just beginning to understand the factors underlying individual differences in the extent to which reward cues acquire powerful motivational properties, and therefore, the ability to act as incentive stimuli. Here we review converging evidence from studies in both human and non-human animals suggesting that a subset of individuals are more "cue reactive", in that certain reward cues are more likely to attract these individuals to them and motivate actions to get them. We suggest that those individuals for whom Pavlovian reward cues become especially powerful incentives may be more vulnerable to impulse control disorders, such as binge eating and addiction.

Lack of increased immediate early gene expression in rats reinstating cocaine-seeking behavior to discrete sensory cues

Drug-seeking behavior elicited by drug-associated cues contributes to relapse in addiction; however, whether relapse elicited by drug-associated conditioned reinforcers (CR) versus discriminative stimuli (DS) involves distinct or overlapping neuronal populations is unknown. To address this question, we developed a novel cocaine self-administration and cue-induced reinstatement paradigm that exposed the same rats to distinct cocaine-associated CR and DS. Rats were trained to self-administer cocaine in separate sessions. In one, a DS signaled cocaine availability; in the other, cocaine delivery was paired with a different CR. After extinction training and reinstatement testing, where both cues were presented in separate sessions, rats were sacrificed and processed for cellular analysis of temporal activity by fluorescent in situ hybridization (CatFISH) for activity regulated cytoskeleton-associated protein (Arc) mRNA and for radioactive in situ hybridization for Arc and zif268 mRNAs. CatFISH did not reveal significant changes in Arc mRNA expression. Similar results were obtained with radioactive in situ hybridization. We have shown that while rats reinstate drug seeking in response to temporally discrete presentations of distinct drug-associated cues, such reinstatement is not associated with increased transcriptional activation of Arc or zif268 mRNAs, suggesting that expression of these genes may not be necessary for cue-induced reinstatement of drug-seeking behavior.

An Exploration of Responses to Drug Conditioned Stimuli during Treatment for Substance Dependence

Although it is well established that drug conditioned stimuli produce a variety of conditioned responses, it is not known whether such stimuli can also reinforce an arbitrary operant response and thus serve as conditioned reinforcers. Volunteers (n = 39) recruited from a residential treatment center for substance dependence were tested on a task in which presses on computer keys activated images of drugs/drug paraphernalia on a progressive ratio schedule of reinforcement. They also completed a personalized craving questionnaire and a personalized Implicit Association Test. A significant bias in responding was found for images of preferred drugs/route of drug administration. Craving, however, was low and the images generated negative evaluative reactions. Two additional studies were performed to ascertain the generalizability of the effects to a different population of drug-using individuals (i.e., students who drink) and to incentive stimuli of a different nature (i.e., sexual). The additional studies partially replicated and extended the central findings of the main study. Therefore, although these data should be considered preliminary in light of small group sizes, it is concluded that cue specificity and availability of the unconditioned stimuli (drugs and sex) plays a role in modulating responding maintained by conditioned reinforcers.

Bidirectional modulation of cocaine expectancy by phasic glutamate fluctuations in the nucleus accumbens

While glutamate in the nucleus accumbens (NAS) contributes to the promotion of drug-seeking by drug-predictive cues, it also appears to play a role in the inhibition of drug-seeking following extinction procedures. Thus we measured extracellular fluctuations of NAS glutamate in response to discriminative stimuli that signaled either cocaine availability or cocaine omission. We trained rats to self-administer intravenous cocaine and then to recognize discriminative odor cues that predicted either sessions where cocaine was available or alternating sessions where it was not (saline substituted for cocaine). Whereas responding in cocaine availability sessions remained stable, responding in cocaine omission sessions progressively declined to chance levels. We then determined the effects of each odor cue on extracellular glutamate in the core and shell subregions of NAS preceding and accompanying lever pressing under an extinction condition. Glutamate levels were elevated in both core and shell by the availability odor and depressed in the core but not the shell by the omission odor. Infusion of kynurenic acid (an antagonist for ionotropic glutamate receptors) into core but not shell suppressed responding associated with the availability odor, but had no effect on the suppression associated with the omission odor. Thus cocaine-predictive cues appear to promote cocaine seeking in part by elevating glutamatergic neurotransmission in the core of NAS, whereas cocaine-omission cues appear to suppress cocaine seeking in part by depressing glutamatergic receptor activation in the same region.

18-Methoxycoronaridine blocks context-induced reinstatement following cocaine self-administration in rats

Numerous studies utilizing drug self-administration have shown the importance of conditioned cues in maintaining and reinstating addictive behaviors. However, most used simple cues that fail to replicate the complexity of cues present in human craving and addiction. We have recently shown that music can induce behavioral and neurochemical changes in rats following classical conditioning with psychostimulants. However, such effects have yet to be characterized utilizing operant self-administration procedures, particularly with regard to craving and relapse. The goal of the present study was to validate the effectiveness of music as a contextual conditioned stimulus using cocaine in an operant reinstatement model of relapse. Rats were trained to lever press for cocaine with a musical cue, and were subsequently tested during reinstatement sessions to determine how musical conditioning affected drug seeking behavior. Additionally, in vivo microdialysis was used to determine basolateral amygdala involvement during reinstatement. Lastly, tests were conducted to determine whether the putative anti-addictive agent 18-methoxycoronaridine (18-MC) could attenuate cue-induced drug seeking behavior. Our results show that music-conditioned animals exhibited increased drug seeking behaviors when compared to controls during reinstatement test sessions. Furthermore, music-conditioned subjects exhibited increased extracellular dopamine in the basolateral amygdala during reinstatement sessions. Perhaps most importantly, 18-MC blocked musical cue-induced reinstatement. Thus,music can be a powerful contextual conditioned cue in rats, capable of inducing changes in both brain neurochemistry and drug seeking behavior during abstinence. The fact that 18-MC blocked cue-induced reinstatement suggests that α3β4 nicotinic receptors may be involved in the mechanism of craving, and that 18-MC may help prevent relapse to drug addiction in humans.

Perhaps More Consideration of Pavlovian-Operant Interaction May Improve the Clinical Efficacy of Behaviorally Based Drug Treatment Programs

Drug abuse remains costly. Drug-related cues can evoke cue-reactivity and craving, contributing to relapse. The Pavlovian extinction-based cue-exposure therapy (CET) has not been very successful in treating drug abuse. A functional operant analysis of complex rituals involved in CET is outlined and reinterpreted as an operant heterogeneous chain maintained by observing responses, conditioned reinforcers, and discriminative stimuli. It is further noted that operant functions are not predicated on Pavlovian processes but can be influenced by them in contributing to relapse; several empirical studies from the animal and human literature highlight this view. Cue-reactivity evoked by Pavlovian processes is conceptualized as an operant establishing/motivating operation. CET may be more effective in incorporating an operant-based approach that takes into account the complexity of Pavlovian-operant interaction. Extinction of the operant chain coupled with the shaping of alternative behaviors is proposed as an integrated therapy. It is proposed that operant-based drug abuse treatments (contingency management, voucher programs, and the therapeutic work environment) might consider incorporating cue-reactivity, as establishing/motivating operations, to increase long-term success-a hybrid approach based on Pavlovian-operant interaction.

Novel cues reinstate cocaine-seeking behavior and induce Fos protein expression as effectively as conditioned cues

Cue reinstatement of extinguished cocaine-seeking behavior is a widely used model of cue-elicited craving in abstinent human addicts. This study examined Fos protein expression in response to cocaine cues or to novel cues as a control for activation produced by test novelty. Rats were trained to self-administer cocaine paired with either a light or a tone cue, or received yoked saline and cue presentations, and then underwent daily extinction training. They were then tested for reinstatement of extinguished cocaine-seeking behavior elicited by response-contingent presentations of either the cocaine-paired cue or a novel cue (that is, tone for those trained with a light or vice versa). Surprisingly, conditioned and novel cues both reinstated responding and increased Fos similarly in most brain regions. Exceptions included the anterior cingulate, which was sensitive to test cue modality in saline controls and the dorsomedial caudate-putamen, where Fos was correlated with responding in the novel, but not conditioned, cue groups. In subsequent experiments, we observed a similar pattern of reinstatement in rats trained and tested for sucrose-seeking behavior, whereas rats trained and tested with the cues only reinstated to a novel, and not a familiar, light or tone. The results suggest that novel cues reinstate responding to a similar extent as conditioned cues regardless of whether animals have a reinforcement history with cocaine or sucrose, and that both types of cues activate similar brain circuits. Several explanations as to why converging processes may drive drug and novel cue reinforcement and seeking behavior are discussed.

Thinking outside the cleft to understand synaptic activity: contribution of the cystine-glutamate antiporter (System xc-) to normal and pathological glutamatergic signaling

System x(c)(-) represents an intriguing target in attempts to understand the pathological states of the central nervous system. Also called a cystine-glutamate antiporter, system x(c)(-) typically functions by exchanging one molecule of extracellular cystine for one molecule of intracellular glutamate. Nonvesicular glutamate released during cystine-glutamate exchange activates extrasynaptic glutamate receptors in a manner that shapes synaptic activity and plasticity. These findings contribute to the intriguing possibility that extracellular glutamate is regulated by a complex network of release and reuptake mechanisms, many of which are unique to glutamate and rarely depicted in models of excitatory signaling. Because system x(c)(-) is often expressed on non-neuronal cells, the study of cystine-glutamate exchange may advance the emerging viewpoint that glia are active contributors to information processing in the brain. It is noteworthy that system x(c)(-) is at the interface between excitatory signaling and oxidative stress, because the uptake of cystine that results from cystine-glutamate exchange is critical in maintaining the levels of glutathione, a critical antioxidant. As a result of these dual functions, system x(c)(-) has been implicated in a wide array of central nervous system diseases ranging from addiction to neurodegenerative disorders to schizophrenia. In the current review, we briefly discuss the major cellular components that regulate glutamate homeostasis, including glutamate release by system x(c)(-). This is followed by an in-depth discussion of system x(c)(-) as it relates to glutamate release, cystine transport, and glutathione synthesis. Finally, the role of system x(c)(-) is surveyed across a number of psychiatric and neurodegenerative disorders.

A review of preclinical research demonstrating that drug and non-drug reinforcers differentially affect behavior

This review describes and summarizes current preclinical research revealing important differences between drug and non-drug reinforcers in terms of their effects on behavior. Despite research showing that drugs are not especially strong reinforcers in animals, a number of other behavioral differences potentially relevant to addiction have been reported in studies that have compared drug and non-drug reinforcers. Several of these effects appear only after long-term access to drugs. These include an escalation of drug intake, an increased persistence in responding for the drug, and a decreased sensitivity to the effects of punishers or other suppressors of drug seeking. Further differences between drug and non-drug reinforcers include the effects that reinforcer-paired stimuli have on behavior. Drug cues, as compared to food cues, have been shown to exert greater control over reinforcer-seeking behavior after periods of abstinence. Similarly, behavior previously reinforced by drugs, but not food, has been shown to be susceptible to stress-induced reinstatement after extinction. The behavioral differences between drug and non-drug reinforcers reviewed here may identify special features of drugs that lead to addiction.

Linking ADHD, impulsivity, and drug abuse: a neuropsychological perspective

In this chapter, we consider the relevance of impulsivity as both a psychological construct and endophenotype underlying attention-deficit/hyperactivity disorder (ADHD) and drug addiction. The case for executive dysfunction in ADHD and drug addiction is critically reviewed in the context of dissociable cognitive control processes mediated by the dorsolateral prefrontal cortex (DLPFC), the orbital and ventral medial prefrontal cortex (VMPFC). We argue that such neuroanatomical divisions within the prefrontal cortex are likely to account for the multidimensional basis of impulsivity conceptually categorized in terms of "motoric" and "choice" impulsivity. The relevance of this distinction for the etiology of ADHD and drug addiction is integrated within a novel theoretical framework. This scheme embraces animal learning theory to help explain the heterogeneity of impulse control disorders, which are exemplified by ADHD as a vulnerability disorder for drug addiction.

Music-induced context preference following cocaine conditioning in rats

Traditional models of drug-seeking behavior have shown that exposure to associated environmental cues can trigger relapse. These learned associations take place during repeated drug administration, resulting in conditioned reinforcement. Although considerable investigation has occurred regarding simple conditioned stimuli, less is known about complex environmental cues, particularly those that may be salient in human addiction. Recent studies indicate that music can serve as a contextual conditioned stimulus in rats and influence drug-seeking behavior during abstinence. The purpose of the present study was to further assess the effectiveness of music as a conditioned stimulus in rats, to determine rats' preferences for two contrasting pieces of music, and to determine rats' preferences for music versus silence. To this end, we created an apparatus that gave instrumental control of musical choice (Miles Davis vs. Beethoven) to the rats themselves. After determining baseline musical preference, animals were conditioned with cocaine (10 mg/kg) to the music they initially preferred least, with alternating conditioning sessions pairing saline with the music preferred most. The animals were subsequently tested in a drug-free state to determine what effect this conditioning had on musical preference. The results indicate that music serves as an effective contextual conditioned stimulus, significantly increasing both musical preference and locomotor activity after repeated cocaine conditioning. Furthermore, we found that rats initially favor silence over music, but that this preference can be altered as a result of cocaine-paired conditioning. These findings demonstrate that, after repeated association with reward (cocaine), music can engender a conditioned context preference in rats; these findings are consistent with other evidence showing that musical contextual cues can reinstate drug-seeking behavior in rats.

Effects of sensitization on the detection of an instrumental contingency

While prior exposure to drugs of abuse permanently changes many behaviors, the underlying psychological mechanisms are relatively obscure. Here, the effects of sensitization on the detection of an action-outcome relationship were assessed, using a particularly stringent contingency degradation procedure. Rats were trained to leverpress until the probability of reinforcement for a response on one lever, or alternative reinforcement for a response on a second lever was reduced to 0.05 per second. Sensitization was then carried out (1mg/kg d-amphetamine/day for 7 days). Then, one reinforcer was also made available for a lack of response on either lever (p=0.05/s), maintaining its contiguity with the original response but eliminating its contingent relationship. Sensitized animals were more active, particularly early in the contingency degradation phase, but reduced responding directed at the degraded action-outcome contingency at a similar rate as controls. However, controls also reduced responding directed at the nondegraded contingency until very late in training, while sensitized animals maintained nondegraded responding at baseline levels. It was suggested that the relatively specific response shown by sensitized animals may reflect either improved action-outcome utilization or discrimination of relevant task features.

PG01037, a novel dopamine D3 receptor antagonist, inhibits the effects of methamphetamine in rats

Our previous studies have shown that the selective dopamine D(3) receptor antagonists SB-277011A or NGB 2904 significantly attenuate cocaine self-administration under a progressive-ratio reinforcement schedule and cocaine-, methamphetamine- or nicotine-enhanced brain stimulation reward. However, the poor bioavailability of SB-277011A has limited its potential use in humans. In the present study, we investigated the effects of the novel D(3) receptor antagonist PG01037 on methamphetamine self-administration, methamphetamine-associated cue-induced reinstatement of drug seeking and methamphetamine-enhanced brain stimulation reward. Rats were allowed to intravenously self-administer methamphetamine under fixed-ratio 2 and progressive-ratio reinforcement conditions, and then the effects of PG01037 on methamphetamine self-administration and cue-induced reinstatement were assessed. Additional groups of rats were trained for intracranial electrical brain stimulation reward and the effects of PG01037 and methamphetamine on brain stimulation reward were assessed. Acute intraperitoneal administration of PG01037 (3, 10, 30 mg/kg) failed to alter methamphetamine or sucrose self-administration under fixed-ratio 2 reinforcement, but significantly lowered the break-point levels for methamphetamine or sucrose self-administration under progressive-ratio reinforcement. In addition, PG01037 significantly inhibited methamphetamine-associated cue-triggered reinstatement of drug-seeking behavior and methamphetamine-enhanced brain stimulation reward. These data suggest that the novel D(3) antagonist PG01037 significantly attenuates the rewarding effects as assessed by progressive-ratio self-administration and brain stimulation reward, and inhibits methamphetamine-associated cue-induced reinstatement of drug-seeking behavior These findings support the potential use of PG01037 or other selective D(3) antagonists in the treatment of methamphetamine addiction.

Music and methamphetamine: conditioned cue-induced increases in locomotor activity and dopamine release in rats

Associations between drugs of abuse and cues facilitate the acquisition and maintenance of addictive behaviors. Although significant research has been done to elucidate the role that simple discriminative or discrete conditioned stimuli (e.g., a tone or a light) play in addiction, less is known about complex environmental cues. The purpose of the present study was to examine the role of a musical conditioned stimulus by assessing locomotor activity and in vivo microdialysis. Two groups of rats were given non-contingent injections of methamphetamine (1.0 mg/kg) or vehicle and placed in standard conditioning chambers. During these conditioning sessions both groups were exposed to a continuous conditioned stimulus, in the form of a musical selection ("Four" by Miles Davis) played repeatedly for 90 min. After seven consecutive conditioning days subjects were given one day of rest, and subsequently tested for locomotor activity or dopamine release in the absence of drugs while the musical conditioned stimulus was continually present. The brain regions examined included the basolateral amygdala, nucleus accumbens, and prefrontal cortex. The results show that music is an effective contextual conditioned stimulus, significantly increasing locomotor activity after repeated association with methamphetamine. Furthermore, this musical conditioned stimulus significantly increased extracellular dopamine levels in the basolateral amygdala and nucleus accumbens. These findings support other evidence showing the importance of these brain regions in conditioned learning paradigms, and demonstrate that music is an effective conditioned stimulus warranting further investigation.

Pavlovian to instrumental transfer: a neurobehavioural perspective

Pavlovian-to-instrumental transfer (PIT) is a key concept in developing our understanding of cue-controlled behaviours. Here we have reviewed the literature on behavioural and neurobiological factors that influence PIT. Meta-analyses of the data for individual groups in PIT studies revealed that PIT is related to both the order and amounts of instrumental and Pavlovian training, and that it is critically determined by competition between instrumental and Pavlovian responses. We directly addressed the role of response competition in PIT in two experiments which showed that extensive Pavlovian conditioning produced more Pavlovian magazine visits and weaker PIT than moderate Pavlovian conditioning (Experiment 1); and that PIT lost after extensive Pavlovian conditioning was restored by Pavlovian extinction training (Experiment 2). These findings confirm that response competition is indeed an important determinant of PIT. This has significant implications for lesion and inactivation studies that assess the neurobiological substrates of PIT, as well as attempts to demonstrate PIT in the drug self-administration paradigm where the effect is yet to be reliably shown.

Cortical and sub-cortical effects in primate models of cocaine use: implications for addiction and the increased risk of psychiatric illness

Drug abuse is a serious risk factor for the incidence and severity of multiple psychiatric illnesses. Understanding the neurobiological consequences of repeated exposure to abused drugs can help to inform how those risks are manifested in terms of specific neurochemical mechanisms and brain networks. This review examines selective studies in non-human primates that employed a cocaine self-administration model. Neurochemical consequences of chronic exposure appear to differ from observations in rodent studies. Whereas chronic intermittent exposure in the rodent is usually associated with a dose-dependent increase in dopaminergic response to a cocaine challenge, in the rhesus monkey, high cumulative exposure was not observed to cause a sensitized dopamine response. These non-human primate observations are concordant with clinical findings in human users. The results of cue exposure studies on dopaminergic transmission are also reviewed. Direct microdialysis measurements indicate that there is not a sustained increase in dopamine associated with cocaine-linked cues. As an alternative to striatal dopaminergic mechanisms mediating cue effects, single unit studies in prefrontal cortex during self-administration in monkeys suggests the orbitofrontal and anterior cingulate cortex are strongly engaged by cocaine cues. Based on the strong clinical imaging literature on cortical and cognitive dysfunction associated with addiction, it is proposed that the strong engagement of cortical systems during repeated cocaine reinforcement results in maladaptive changes that contribute to the risks of drug use for exacerbation of other psychiatric disorders.

Dopamine signaling in the nucleus accumbens of animals self-administering drugs of abuse

Abuse of psychoactive substances can lead to drug addiction. In animals, addiction is best modeled by drug self-administration paradigms. It has been proposed that the crucial common denominator for the development of drug addiction is the ability of drugs of abuse to increase extracellular concentrations of dopamine in the nucleus accumbens (NAcc). Studies using in vivo microdialysis and chronoamperometry in the behaving animal have demonstrated that drugs of abuse increase tonic dopamine concentrations in the NAcc. However, it is known that dopamine neurons respond to reward-related stimuli on a subsecond timescale. Thus, it is necessary to collect neurochemical information with this level of temporal resolution, as achieved with in vivo fast-scan cyclic voltammetry (FSCV), to fully understand the role of phasic dopamine release in normal behavior and drug addiction. We review studies that investigated the effects of drugs of abuse on NAcc dopamine levels in freely moving animals using in vivo microdialysis, chronoamperometry, and FSCV. After a brief introduction of dopamine signal transduction and anatomy and a section on current theories on the role of dopamine in natural goal-directed behavior, a discussion of techniques for the in vivo assessment of extracellular dopamine in behaving animals is presented. Then, we review studies using these techniques to investigate changes in phasic and tonic dopamine signaling in the NAcc during (1) response-dependent and -independent administration of abused drugs, (2) the presentation of drug-conditioned stimuli and operant behavior in self-administration paradigms, (3) drug withdrawal, and (4) cue-induced reinstatement of drug seeking. These results are then integrated with current ideas on the role of dopamine in addiction with an emphasis on a model illustrating phasic and tonic NAcc dopamine signaling during different stages of drug addiction. This model predicts that phasic dopamine release in response to drug-related stimuli will be enhanced over stimuli associated with natural reinforcers, which may result in aberrant goal-directed behaviors contributing to drug addiction.

A preliminary examination of the relationships between posttraumatic stress symptoms and crack/cocaine, heroin, and alcohol dependence

High rates of co-occurrence between posttraumatic stress (PTS) and substance use disorders (SUDs) have led to the suggestion that substance use among individuals experiencing PTS symptoms might serve a self-medication function. However, research is still needed to provide a more comprehensive evaluation of the unique associations between PTS symptom clusters and substances (licit and illicit) with both anxiolytic/depressant and stimulant properties. Consequently, this study examined the relationship between severity of different PTS symptom clusters and heroin, crack/cocaine, and alcohol dependence among 48 treatment-seeking SUD patients with a history of traumatic exposure. No evidence was found for a relationship between PTS symptom clusters and crack/cocaine or alcohol dependence; however, results suggested a relationship between hyperarousal and avoidance (inversely related) symptoms and heroin dependence. Results are discussed in terms of their implications for understanding motivations underlying the substance of choice among individuals with PTS symptoms, as well as the development of treatments for co-occurring PTS and SUDs.

Influence of conditioned reinforcement on the response-maintaining effects of quinpirole in rats

D2-like agonists, such as quinpirole, maintain responding in monkeys, rats, and mice when they are substituted for cocaine. This study examined the influence of operant history and cocaine-paired stimuli (CS) on quinpirole-maintained responding in rats trained to nose poke for cocaine. Upon acquisition of responding for cocaine, substitutions were performed in the presence or absence of injection-CS pairings. Although cocaine maintained responding regardless of whether injections were accompanied by CS, quinpirole maintained responding only when CS were paired with injections. To assess the influence of operant history, injections of cocaine, quinpirole, remifentanil, nicotine, or saline were made available on a previously inactive lever, while nose pokes continued to result in CS presentation. Although responding was reallocated from the nose poke to the lever when cocaine or remifentanil was available, lever presses remained low, and nose poking persisted when quinpirole or nicotine was made contingent upon lever presses. Finally, quinpirole pretreatments resulted in high rates of nose poking when nose pokes resulted in CS presentation alone, but failed to maintain nose poking when the CS was omitted. Taken together, these results suggest that the response-maintaining effects of quinpirole are primarily mediated by an enhancement of the conditioned reinforcing effects of earlier CS, rather than by a reinforcing effect of quinpirole.

Orbitofrontal and anterior cingulate cortex neurons selectively process cocaine-associated environmental cues in the rhesus monkey

Encounters with stimuli associated with drug use are believed to contribute to relapse. To probe the neurobiology of environmentally triggered drug use, we have conducted single-unit recordings in rhesus monkeys during presentation of two distinct types of drug paired cues that differentially support drug-seeking. The animals were highly conditioned to these cues via exposure during self-administration procedures conducted over a 4 year period. The cues studied were a discriminative cue that signaled response-contingent availability of cocaine, and a discrete cue that was temporally paired with the cocaine infusion (0.1 or 0.5 mg/kg). Two cortical regions consistently activated by cocaine-associated cues in human imaging studies are the orbitofrontal (OFC) and anterior cingulate cortex (ACC), though little is known about cortical neuronal activity responses to drug cues. We simultaneously recorded single-unit activity in OFC and ACC as well as in dorsal striatum in rhesus monkeys during cocaine self-administration. Dorsal striatal neurons were less engaged by drug cues than cortical regions. Between OFC and ACC, distinct functionality was apparent in neuronal responses. OFC neurons preferentially responded to the discriminative cue, consistent with a role in cue-induced drug-seeking. In contrast, the ACC did not respond more to the discriminative cue than to the discrete cue. Also distinct from the OFC, ACC showed sustained firing throughout the 18 s duration of the discrete cue. This pattern of sustained activation in ACC is consistent with a role in reward expectation and/or in mediating behavioral effects of discrete cues paired with drug infusions.

Effects of training and withdrawal periods on heroin seeking induced by conditioned cue in an animal of model of relapse

RATIONALE

A high incidence of relapse can be triggered by exposure to conditioned cues previously associated with heroin. Extended access to drug and withdrawal are thought to affect the motivation for drug seeking.

OBJECTIVES

The present study evaluated how different periods of training to self-administer heroin and different periods of withdrawal affected drug seeking.

MATERIALS AND METHODS

Following 1 to 14 days of heroin self-administration, rats were left in the home environment for 1 or 14 days. Subsequently, rats were evaluated for extinction of nose poke during the first hour after being returned to the training apparatus. One hour later, a conditioned stimulus was presented to initiate cue-induced reinstatement.

RESULTS

Extending the training period from 1 to 14 days caused an escalation of reinstatement of drug seeking induced by conditioned cues. Increasing the withdrawal period from 1 to 14 days produced a similar increase in reinstatement of drug seeking induced by cues. Reinstatement of drug seeking induced by cues was augmented by pretreatment with naltrexone (1, 5 mg/kg) 24 h prior to reinstatement on day 1, but not at 14 days of withdrawal from heroin self-administration.

CONCLUSIONS

These experiments demonstrate that increasing the duration of either heroin self-administration or the withdrawal periods from heroin self-administration augments the reinstatement induced by cues that were associated previously with heroin reinforcement. Additionally, we provide one of the first demonstrations that opiate withdrawal induces heroin seeking, as assessed in the reinstatement model.