Drug intake is sufficient, but conditioning is not necessary for the emergence of compulsive cocaine seeking after extended self-administration

Random interval schedule of reinforcement influences punishment resistance for cocaine in rats

In an animal model of compulsive drug use, a subset of rats continues to self-administer cocaine despite footshock consequences and is considered punishment resistant. We recently found that punishment resistance is associated with habits that persist under conditions that typically encourage a transition to goal-directed control. Given that random ratio (RR) and random interval (RI) schedules of reinforcement influence whether responding is goal-directed or habitual, we investigated the influence of these schedules on punishment resistance for cocaine or food. Male and female Sprague Dawley rats were trained to self-administer either intravenous cocaine or food pellets on a seeking-taking chained schedule of reinforcement, with the seeking lever requiring completion of either an RR20 or RI60 schedule. Rats were then given four days of punishment testing with footshock administered at the completion of seeking on a random one-third of trials. For cocaine-trained rats, the RI60 schedule led to greater punishment resistance (i.e., more trials completed) than the RR20 schedule in males and females. For food-trained rats, the RI60 schedule led to greater punishment resistance (i.e., higher reward rates) than the RR20 schedule in female rats, although male rats showed punishment resistance on both RR20 and RI60 schedules. For both cocaine and food, we found that seeking responses were suppressed to a greater degree than reward rate with the RI60 schedule, whereas response rate and reward rate were equally suppressed with the RR20 schedule. This dissociation between punishment effects on reward rate and response rate with the RI60 schedule can be explained by the nonlinear relation between these variables on RI schedules, but it does not account for the enhanced resistance to punishment. Overall, the results show greater punishment resistance with the RI60 schedule as compared to the RR20 schedule, indicating that schedules of reinforcement are an influencing factor on resistance to negative consequences.

Punishment resistance for cocaine is associated with inflexible habits in rats

Addiction is characterized by continued drug use despite negative consequences. In an animal model, a subset of rats continues to self-administer cocaine despite footshock consequences, showing punishment resistance. We sought to test the hypothesis that punishment resistance arises from failure to exert goal-directed control over habitual cocaine seeking. While habits are not inherently permanent or maladaptive, continued use of habits under conditions that should encourage goal-directed control makes them maladaptive and inflexible. We trained male and female Sprague Dawley rats on a seeking-taking chained schedule of cocaine self-administration. We then exposed them to four days of punishment testing in which footshock was delivered randomly on one-third of trials. Before and after punishment testing (four days pre-punishment and ≥ four days post-punishment), we assessed whether cocaine seeking was goal-directed or habitual using outcome devaluation via cocaine satiety. We found that punishment resistance was associated with continued use of habits, whereas punishment sensitivity was associated with increased goal-directed control. Although punishment resistance for cocaine was not predicted by habitual responding pre-punishment, it was associated with habitual responding post-punishment. In parallel studies of food self-administration, we similarly observed that punishment resistance was associated with habitual responding post-punishment but not pre-punishment in males, although it was associated with habitual responding both pre- and post-punishment in females, indicating that punishment resistance was predicted by habitual responding in food-seeking females. These findings indicate that punishment resistance is related to habits that have become inflexible and persist under conditions that should encourage a transition to goal-directed behavior.

Making and breaking habits: Revisiting the definitions and behavioral factors that influence habits in animals

Habits have garnered significant interest in studies of associative learning and maladaptive behavior. However, habit research has faced scrutiny and challenges related to the definitions and methods. Differences in the conceptualizations of habits between animal and human studies create difficulties for translational research. Here, we review the definitions and commonly used methods for studying habits in animals and humans and discuss potential alternative ways to assess habits, such as automaticity. To better understand habits, we then focus on the behavioral factors that have been shown to make or break habits in animals, as well as potential mechanisms underlying the influence of these factors. We discuss the evidence that habitual and goal-directed systems learn in parallel and that they seem to interact in competitive and cooperative manners. Finally, we draw parallels between habitual responding and compulsive drug seeking in animals to delineate the similarities and differences in these behaviors.

Punishment resistance for cocaine is associated with inflexible habits in rats

Addiction is characterized by continued drug use despite negative consequences. In an animal model, a subset of rats continues to self-administer cocaine despite footshock consequences, showing punishment resistance. We sought to test the hypothesis that punishment resistance arises from failure to exert goal-directed control over habitual cocaine seeking. While habits are not inherently permanent or maladaptive, continued use of habits under conditions that should encourage goal-directed control makes them maladaptive and inflexible. We trained male and female Sprague Dawley rats on a seeking-taking chained schedule of cocaine self-administration (2 h/day). We then exposed them to 4 days of punishment testing, in which footshock (0.4 mA, 0.3 s) was delivered randomly on one-third of trials, immediately following completion of seeking and prior to extension of the taking lever. Before and after punishment testing (4 days pre-punishment and ≥4 days post-punishment), we assessed whether cocaine seeking was goal-directed or habitual using outcome devaluation via cocaine satiety. We found that punishment resistance was associated with continued use of habits, whereas punishment sensitivity was associated with increased goal-directed control. Although punishment resistance was not predicted by habitual responding pre-punishment, it was associated with habitual responding post-punishment. In parallel studies of food self-administration, we similarly observed that punishment resistance was associated with habitual responding post-punishment but not pre-punishment. These findings indicate that punishment resistance is related to habits that have become inflexible and persist under conditions that should encourage a transition to goal-directed behavior.

Pathways to the persistence of drug use despite its adverse consequences

The persistence of drug taking despite its adverse consequences plays a central role in the presentation, diagnosis, and impacts of addiction. Eventual recognition and appraisal of these adverse consequences is central to decisions to reduce or cease use. However, the most appropriate ways of conceptualizing persistence in the face of adverse consequences remain unclear. Here we review evidence that there are at least three pathways to persistent use despite the negative consequences of that use. A cognitive pathway for recognition of adverse consequences, a motivational pathway for valuation of these consequences, and a behavioral pathway for responding to these adverse consequences. These pathways are dynamic, not linear, with multiple possible trajectories between them, and each is sufficient to produce persistence. We describe these pathways, their characteristics, brain cellular and circuit substrates, and we highlight their relevance to different pathways to self- and treatment-guided behavior change.

Role of preexisting inhibitory control deficits vs. drug use history in mediating insensitivity to aversive consequences in a rat model of polysubstance use

RATIONALE

The nature and predictors of insensitivity to aversive consequences of heroin + cocaine polysubstance use are not well characterized.

OBJECTIVES

Translational methods incorporating a tightly controlled animal model of drug self-administration and measures of inhibitory control and avoidance behavior might be helpful for clarifying this issue.

METHODS

The key approach for distinguishing potential contributions of pre-existing inhibitory control deficits vs. drug use history in meditating insensitivity to aversive consequences was comparison of two rat strains: Wistar (WIS/Crl), an outbred strain, and the spontaneously hypertensive rat (SHR/NCrl), an inbred strain shown previously to exhibit heightened cocaine and heroin self-administration and poor inhibitory control relative to WIS/Crl.

RESULTS

In separate tasks, SHR/NCrl displayed greater impulsive action and compulsive-like behavior than WIS/Crl prior to drug exposure. Under two different schedules of drug delivery, SHR/NCrl self-administered more cocaine than WIS/Crl, but self-administered a similar amount of heroin + cocaine as WIS/Crl. When half the session cycles were punished by random foot shock, SHR/NCrl initially were less sensitive to punishment than WIS/Crl when self-administering cocaine, but were similarly insensitive to punishment when self-administering heroin + cocaine. Based on correlation analyses, only trait impulsivity predicted avoidance capacity in rats self-administering cocaine and receiving yoked-saline. In contrast, only amount of drug use predicted avoidance capacity in rats self-administering heroin + cocaine. Additionally, baseline drug seeking and taking predicted punishment insensitivity in rats self-administering cocaine or heroin + cocaine.

CONCLUSIONS

Based on the findings revealed in this animal model, human laboratory research concerning the nature and predictors of insensitivity to aversive consequences in heroin and cocaine polysubstance vs. monosubstance users is warranted.

Effects of the GluN2B antagonist, Ro 25-6981, on extinction consolidation following adolescent- or adult-onset methamphetamine self-administration in male and female rats

Previous work suggests adolescent rats have deficient extinction consolidation relative to adults. Although the mechanisms underlying this age difference are currently unknown, studies in adult rats have implicated GluN2B-containing N-methyl-d-aspartate (NMDA) receptor function in extinction consolidation of drug-associated memory. Importantly, GluN2B neurotransmission emerges during adolescent development, and drugs of abuse during adolescence may delay the development of extinction consolidation by disrupting the ontogeny of GluN2B function. Here, we trained Sprague-Dawley rats of both sexes to self-administer methamphetamine [METH, 0.1 mg/kg/infusion intravenous (i.v.)] beginning during adolescence [postnatal (P) day 41] or adulthood (P91). Rats were given short access (2 h) to self-administer METH in seven daily sessions followed by 14 sessions with long access (6 h). Subsequently, rats underwent four daily 30-minute extinction sessions with immediate postsession injections of either a GluN2B antagonist [Ro25-6981; 6 mg/kg, intraperitoneal (i.p.)] or a vehicle solution. After four daily 2-h extinction sessions, a priming injection (1 mg/kg METH, i.p.) was given prior to a final 2-h reinstatement session. During LgA, adolescent-onset rats earn more METH than adult-onset rats and display greater drug-loading behavior. Rats reduced their drug-seeking behavior across the extinction sessions, with no significant group differences. Rats reinstated drug-seeking following the METH-priming injection, with females displaying greater reinstatement than males. These results do not support our a priori hypothesis that adolescent-onset METH use disrupts the ontogeny of GluN2B transmission and contributes to age-of-onset differences in extinction of METH-seeking. However, our findings suggest that age-of-onset contributes to excessive METH-taking, while sex confers vulnerability to relapse to METH-seeking.

Subthalamic low-frequency oscillations predict vulnerability to cocaine addiction

Identifying vulnerable individuals before they transition to a compulsive pattern of drug seeking and taking is a key challenge in addiction to develop efficient prevention strategies. Oscillatory activity within the subthalamic nucleus (STN) has been associated with compulsive-related disorders. To study compulsive cocaine-seeking behavior, a core component of drug addiction, we have used a rat model in which cocaine seeking despite a foot-shock contingency only emerges in some vulnerable individuals having escalated their cocaine intake. We show that abnormal oscillatory activity within the alpha/theta and low-beta bands during the escalation of cocaine intake phase predicts the subsequent emergence of compulsive-like seeking behavior. In fact, mimicking STN pathological activity in noncompulsive rats during cocaine escalation turns them into compulsive ones. We also find that 30 Hz, but not 130 Hz, STN deep brain stimulation (DBS) reduces pathological cocaine seeking in compulsive individuals. Our results identify an early electrical signature of future compulsive-like cocaine-seeking behavior and further advocates the use of frequency-dependent STN DBS for the treatment of addiction.

Consolidating the Circuit Model for Addiction

Addiction is a disease characterized by compulsive drug seeking and consumption observed in 20-30% of users. An addicted individual will favor drug reward over natural rewards, despite major negative consequences. Mechanistic research on rodents modeling core components of the disease has identified altered synaptic transmission as the functional substrate of pathological behavior. While the initial version of a circuit model for addiction focused on early drug adaptive behaviors observed in all individuals, it fell short of accounting for the stochastic nature of the transition to compulsion. The model builds on the initial pharmacological effect common to all addictive drugs-an increase in dopamine levels in the mesolimbic system. Here, we consolidate this early model by integrating circuits underlying compulsion and negative reinforcement. We discuss the genetic and epigenetic correlates of individual vulnerability. Many recent data converge on a gain-of-function explanation for circuit remodeling, revealing blueprints for novel addiction therapies.

The transition to compulsion in addiction

Compulsion is a cardinal symptom of drug addiction (severe substance use disorder). However, compulsion is observed in only a small proportion of individuals who repeatedly seek and use addictive substances. Here, we integrate accounts of the neuropharmacological mechanisms that underlie the transition to compulsion with overarching learning theories, to outline how compulsion develops in addiction. Importantly, we emphasize the conceptual distinctions between compulsive drug-seeking behaviour and compulsive drug-taking behaviour (that is, use). In the latter, an individual cannot stop using a drug despite major negative consequences, possibly reflecting an imbalance in frontostriatal circuits that encode reward and aversion. By contrast, an individual may compulsively seek drugs (that is, persist in seeking drugs despite the negative consequences of doing so) when the neural systems that underlie habitual behaviour dominate goal-directed behavioural systems, and when executive control over this maladaptive behaviour is diminished. This distinction between different aspects of addiction may help to identify its neural substrates and new treatment strategies.

Addiction is driven by excessive goal-directed drug choice under negative affect: translational critique of habit and compulsion theory

Drug addiction may be a goal-directed choice driven by excessive drug value in negative affective states, a habit driven by strong stimulus-response associations, or a compulsion driven by insensitivity to costs imposed on drug seeking. Laboratory animal and human evidence for these three theories is evaluated. Excessive goal theory is supported by dependence severity being associated with greater drug choice/economic demand. Drug choice is demonstrably goal-directed (driven by the expected value of the drug) and can be augmented by stress/negative mood induction and withdrawal-effects amplified in those with psychiatric symptoms and drug use coping motives. Furthermore, psychiatric symptoms confer risk of dependence, and coping motives mediate this risk. Habit theory of addiction has weaker support. Habitual behaviour seen in drug-exposed animals often does not occur in complex decision scenarios, or where responding is rewarded, so habit is unlikely to explain most human addictive behaviour where these conditions apply. Furthermore, most human studies have not found greater propensity to habitual behaviour in drug users or as a function of dependence severity, and the minority that have can be explained by task disengagement producing impaired explicit contingency knowledge. Compulsion theory of addiction also has weak support. The persistence of punished drug seeking in animals is better explained by greater drug value (evinced by the association with economic demand) than by insensitivity to costs. Furthermore, human studies have provided weak evidence that propensity to discount cost imposed on drug seeking is associated with dependence severity. These data suggest that human addiction is primarily driven by excessive goal-directed drug choice under negative affect, and less by habit or compulsion. Addiction is pathological because negative states powerfully increase expected drug value acutely outweighing abstinence goals.

Dorsolateral striatal miR-134 modulates excessive methamphetamine intake in self-administering rats

Increasing evidence indicates that excessive drug consumption is sufficient for the transition from recreational and controlled drug use to uncontrolled use and addiction. However, the underlying mechanisms are debated. Some neurobehavioral and neuroimaging evidence indicates that dorsolateral striatum (dlStr)-dependent habit learning plays a key role in excessive drug intake and the transition to addiction, but little is known about the molecular events. The present study investigated whether dlStr miR-134, an important regulator of synaptic transmission and plasticity, is involved in excessive methamphetamine intake. We established excessive and uncontrolled methamphetamine self-administration model in rats by permitting animals extended access to drug (6 h/session/d, LgA group), whereas animals that were limited to access to drug (2 h/session/d, ShA group) exhibited low and controlled self-administration. miR-134 expression in dlStr was significantly increased and its target LIMK1 expression was decreased in the LgA group, but not in the ShA group, compared with the saline control group. However, passive methamphetamine exposure did not alter miR-134 and LIMK1 levels in dlStr. We also found that down-regulation of miR-134 in dlStr through local microinjection of a lentivirus carrying miR-134 sponge (LV-miR-134-Sil) significantly reduced methamphetamine infusions and excessive consumption in LgA group, rather than ShA group. These results indicated that dlStr miR-134, perhaps via its target LIMK1, contributed to excessive and uncontrolled methamphetamine intake, supporting the hypothesis that stimulus-response habit formation is an important mechanism underlying the transition from controlled drug use to uncontrolled drug use and addiction.

Addictive behaviour in experimental animals: prospects for translation

Since the introduction of intravenous drug self-administration methodology over 50 years ago, experimental investigation of addictive behaviour has delivered an enormous body of data on the neural, psychological and molecular mechanisms of drug reward and reinforcement and the neuroadaptations to chronic use. Whether or not these behavioural and molecular studies are viewed as modelling the underpinnings of addiction in humans, the discussion presented here highlights two areas-the impact of drug-associated conditioned stimuli-or drug cues-on drug seeking and relapse, and compulsive cocaine seeking. The degree to which these findings translate to the clinical state of addiction is considered in terms of the underlying neural circuitry and also the ways in which this understanding has helped develop new treatments for addiction. The psychological and neural mechanisms underlying drug memory reconsolidation and extinction established in animal experiments show particular promise in delivering new treatments for relapse prevention to the clinic.This article is part of a discussion meeting issue 'Of mice and mental health: facilitating dialogue between basic and clinical neuroscientists'.

Behavioral and neural mechanisms underlying habitual and compulsive drug seeking

Addiction is characterized by compulsive drug use despite negative consequences. Here we review studies that indicate that compulsive drug use, and in particular punishment resistance in animal models of addiction, is related to impaired cortical control over habitual behavior. In humans and animals, instrumental behavior is supported by goal-directed and habitual systems that rely on distinct corticostriatal networks. Chronic exposure to addictive drugs or stress has been shown to bias instrumental response strategies toward habit learning, and impair prefrontal cortical (PFC) control over responding. Moreover, recent work has implicated prelimbic PFC hypofunction in the punishment resistance that has been observed in a subset of animals with an extended history of cocaine self-administration. This may be related to a broader role for prelimbic PFC in mediating adaptive responding and behavioral flexibility, including exerting goal-directed control over behavior. We hypothesize that impaired cortical control and reduced flexibility between habitual and goal-directed systems may be critically involved in the development of maladaptive, compulsive drug use.

An extended history of drug self-administration results in multiple sources of control over drug seeking behavior

It is widely recognized that across the development of drug addiction, cues associated with drug use come to exert increasing control over drug seeking and taking behaviors. However, there remain gaps in our knowledge regarding how the different types of drug related cues affect drug seeking and taking behaviors, and how the emergence of cue control over these behaviors relates to the onset of drug seeking compulsions. This paper reviews the literature on drug self-administration in animals to address these gaps. It first identifies the different types of cues that acquire control over reward seeking behavior generally, and examines whether the same types of cues acquire control over drug seeking behavior specifically. It then examines how the role of drug related cues in motivating and reinforcing drug seeking behavior changes across an extended drug-taking history, with a particular focus on the case of nicotine. The evidence reviewed shows that, after an extended history of drug taking, drug seeking behaviors are controlled by contextual cues associated with the development of drug seeking habits, response contingent cues that accompany delivery of the drug, as well as internal states that correlate with levels of drug intake. These multiple sources of control over drug seeking are discussed in relation to the generation of an addicted phenotype in animal models and the hypothesized progression from internal control over drug use to compulsive drug seeking.

Knockdown of hypocretin attenuates extended access of cocaine self-administration in rats

The hypocretin/orexin (HCRT) neuropeptide system regulates feeding, arousal state, stress responses, and reward, especially under conditions of enhanced motivational relevance. In particular, HCRT neurotransmission facilitates drug-seeking behavior in circumstances that demand increased effort and/or motivation to take the drug. The present study used a shRNA-encoding adeno-associated viral vector to knockdown Hcrt expression throughout the dorsal hypothalamus in adult rats and determine the role of HCRT in cocaine self-administration. Chronic Hcrt silencing did not impact cocaine self-administration under short-access conditions, but robustly attenuated cocaine intake under extended access conditions, a model that mimics key features of compulsive cocaine taking. In addition, Hcrt silencing decreased motivation for both cocaine and a highly palatable food reward (i.e., sweetened condensed milk; SCM) under a progressive ratio schedule of reinforcement, but did not alter responding for SCM under a fixed ratio schedule. Importantly, Hcrt silencing did not affect food or water consumption, and had no consequence for general measures of arousal and stress reactivity. At the molecular level, chronic Hcrt knockdown reduced the number of neurons expressing dynorphin (DYN), and to a smaller extent melanin-concentrating hormone (MCH), in the dorsal hypothalamus. These original findings support the hypothesis that HCRT neurotransmission promotes operant responding for both drug and non-drug rewards, preferentially under conditions requiring a high degree of motivation. Furthermore, the current study provides compelling evidence for the involvement of the HCRT system in cocaine self-administration also under low-effort conditions in rats allowed extended access, possibly via functional interactions with DYN and MCH signaling.

A Multilevel Computational Characterization of Endophenotypes in Addiction

Addiction is characterized by a profound intersubject (phenotypic) variability in the expression of addictive symptomatology and propensity to relapse following treatment. However, laboratory investigations have primarily focused on common neural substrates in addiction and have not yet been able to identify mechanisms that can account for the multifaceted phenotypic behaviors reported in the literature. To fill this knowledge gap theoretically, here we simulated phenotypic variations in addiction symptomology and responses to putative treatments, using both a neural model, based on cortico-striatal circuit dynamics, and an algorithmic model of reinforcement learning (RL). These simulations rely on the widely accepted assumption that both the ventral, model-based, goal-directed system and the dorsal, model-free, habitual system are vulnerable to extra-physiologic dopamine reinforcements triggered by addictive rewards. We found that endophenotypic differences in the balance between the two circuit or control systems resulted in an inverted-U shape in optimal choice behavior. Specifically, greater unbalance led to a higher likelihood of developing addiction and more severe drug-taking behaviors. Furthermore, endophenotypes with opposite asymmetrical biases among cortico-striatal circuits expressed similar addiction behaviors, but responded differently to simulated treatments, suggesting personalized treatment development could rely on endophenotypic rather than phenotypic differentiations. We propose our simulated results, confirmed across neural and algorithmic levels of analysis, inform on a fundamental and, to date, neglected quantitative method to characterize clinical heterogeneity in addiction.

Compulsive sucrose- and cocaine-seeking behaviors in male and female Wistar rats

RATIONALE

Compulsive cocaine use is a key feature of cocaine addiction and understanding the factors that promote the development of such a behavior will provide important insights into the mechanism of cocaine addiction and is essential for the clinical management of the disorder.

OBJECTIVES

This study aimed to determine how the preexisting compulsive reward-seeking behavior is related to the development of compulsive cocaine-seeking behavior in male and female rats and the potential impact of the reward value and estrous cycle on such behaviors.

METHODS

Adult male and female Wistar rats were first trained to self-administer sucrose pellets under a chained schedule, and then, the intensity-response effects of footshock punishment on sucrose SA reinforced by different values of sucrose were measured. Subsequently, the same rats went on to self-administer intravenous cocaine and the punishment intensity-response effects on cocaine SA reinforced by different doses of cocaine were similarly determined. For the female rats, the measurements were made during different phases of the estrous cycle.

RESULTS

The rats showed a wide range of levels of the compulsive behaviors despite the similar training history. Surprisingly, the compulsive sucrose-seeking behavior did not predict the compulsive cocaine-seeking behavior in either sex. Increasing cocaine dose significantly increased the compulsive cocaine-seeking behavior in the female but not male rats. Estrous cycle did not have impact on the compulsive behaviors.

CONCLUSION

Preexisting differences in compulsive sucrose-seeking behavior do not predict compulsive cocaine-seeking behavior. Compulsive cocaine-seeking behavior is influenced by cocaine dose but not estrous cycle in the female rats.

Modeling the development of drug addiction in male and female animals

An increasing emphasis has been placed on the development and use of animal models of addiction that capture defining features of human drug addiction, including escalation/binge drug use, enhanced motivation for the drug, preference for the drug over other reward options, use despite negative consequences, and enhanced drug-seeking/relapse vulnerability. The need to examine behavior in both males and females has also become apparent given evidence demonstrating that the addiction process occurs differently in males and females. This review discusses the procedures that are used to model features of addiction in animals, as well as factors that influence their development. Individual differences are also discussed, with a particular focus on sex differences. While no one procedure consistently produces all characteristics, different models have been developed to focus on certain characteristics. A history of escalating/binge patterns of use appears to be critical for producing other features characteristic of addiction, including an enhanced motivation for the drug, enhanced drug seeking, and use despite negative consequences. These characteristics tend to emerge over abstinence, and appear to increase rather than decrease in magnitude over time. In females, these characteristics develop sooner during abstinence and/or following less drug exposure as compared to males, and for psychostimulant addiction, may require estradiol. Although preference for the drug over other reward options has been demonstrated in non-human primates, it has been more difficult to establish in rats. Future research is needed to define the parameters that optimally induce each of these features of addiction in the majority of animals. Such models are essential for advancing our understanding of human drug addiction and its treatment in men and women.

Reward Prediction Errors in Drug Addiction and Parkinson's Disease: from Neurophysiology to Neuroimaging

PURPOSE OF REVIEW

Surprises are important sources of learning. Cognitive scientists often refer to surprises as "reward prediction errors," a parameter that captures discrepancies between expectations and actual outcomes. Here, we integrate neurophysiological and functional magnetic resonance imaging (fMRI) results addressing the processing of reward prediction errors and how they might be altered in drug addiction and Parkinson's disease.

RECENT FINDINGS

By increasing phasic dopamine responses, drugs might accentuate prediction error signals, causing increases in fMRI activity in mesolimbic areas in response to drugs. Chronic substance dependence, by contrast, has been linked with compromised dopaminergic function, which might be associated with blunted fMRI responses to pleasant non-drug stimuli in mesocorticolimbic areas. In Parkinson's disease, dopamine replacement therapies seem to induce impairments in learning from negative outcomes. The present review provides a holistic overview of reward prediction errors across different pathologies and might inform future clinical strategies targeting impulsive/compulsive disorders.

A neuronal activation correlate in striatum and prefrontal cortex of prolonged cocaine intake

Maladaptive changes in the involvement of striatal and frontal cortical regions in drug use are thought to underlie the progression to habitual drug use and loss of cognitive control over drug intake that occur with accumulating drug experience. The present experiments focus on changes in neuronal activity in these regions associated with short-term (10 days) and long-term (60 days) self-administration of cocaine. Quantitative in situ hybridization for the immediate early gene Mkp1 was combined with statistical parametric mapping to assess the distribution of neuronal activity. We hypothesized that neuronal activity in striatum would increase in its dorsal part and that activity in frontal cortex would decrease with prolonged cocaine self-administration experience. Expression of Mkp1 was profoundly increased after cocaine self-administration, and the magnitude of this effect was greater after short-term compared to long-term self-administration. Increased neuronal activity was seen in both dorsal and ventral sectors of the striatum after 10 days exposure to cocaine. However, enhanced activity was restricted to dorsomedial and dorsocentral striatum after 60 days cocaine self-administration. In virtually all medial prefrontal and most orbitofrontal areas, increased expression of Mkp1 was observed after 10 days of cocaine taking, whereas after 60 days, enhanced expression was restricted to caudal parts of medial prefrontal and caudomedial parts of orbitofrontal cortex. Our data reveal functional changes in cellular activity in striatum and frontal cortex with increasing cocaine self-administration experience. These changes might reflect the neural processes that underlie the descent from recreational drug taking to compulsive cocaine use.

Hypocretin Neurotransmission Within the Central Amygdala Mediates Escalated Cocaine Self-administration and Stress-Induced Reinstatement in Rats

BACKGROUND

Cocaine addiction is characterized by patterns of compulsive drug-taking, including preoccupation with obtaining cocaine and loss of control over drug intake. The lateral hypothalamic hypocretin/orexin (HCRT) system has been implicated in drug-taking and the reinstatement of drug-seeking. Evidence suggests that HCRT may drive drug-seeking through activation of specific brain regions implicated in stress system dysfunction, including the central amygdala (CeA). The role of HCRT in the persistence of compulsive-like cocaine-taking has yet to be fully elucidated.

METHODS

Systemic and intra-CeA microinfusions of the HCRT-receptor 1 antagonist, SB-334867, were administered to rats allowed either short (1 hour; ShA) or long (6 hours; LgA) access to cocaine self-administration. Animals were tested for fixed and progressive ratio responding for cocaine and stress-induced reinstatement of drug-seeking. In addition, using electrophysiological techniques on in vitro slices, we investigated gamma-aminobutyric acidergic (GABAergic) neurotransmission in the medial CeA and the sensitivity of GABAergic synapses to modulation of the HCRT system in ShA or LgA rats.

RESULTS

We found systemic administration of SB-334867 (0, 7.5, 15, 30 mg/kg) dose dependently decreased cocaine intake specifically in LgA rats but not in ShA rats. Microinjections of SB-334867 (20 nmol) bilaterally into the CeA significantly reduced cocaine intake in LgA rats. We also observed a significant attenuation of yohimbine-induced reinstatement of cocaine-seeking after intra-CeA SB-334867 (10 nmol) administration. Finally, electrophysiological data indicated enhanced GABAergic neurotransmission within the medial CeA in LgA rats, which was blocked with SB-334867 (10 μmol/L).

CONCLUSIONS

These findings suggest that HCRT neurotransmission within the CeA is implicated in compulsive-like cocaine-seeking.

Stable immediate early gene expression patterns in medial prefrontal cortex and striatum after long-term cocaine self-administration

The transition from casual to compulsive drug use is thought to occur as a consequence of repeated drug taking leading to neuroadaptive changes in brain circuitry involved in emotion and cognition. At the basis of such neuroadaptations lie changes in the expression of immediate early genes (IEGs) implicated in transcriptional regulation, synaptic plasticity and intracellular signalling. However, little is known about how IEG expression patterns change during long-term drug self-administration. The present study, therefore, compares the effects of 10 and 60-day self-administration of cocaine and sucrose on the expression of 17 IEGs in brain regions implicated in addictive behaviour, i.e. dorsal striatum, ventral striatum and medial prefrontal cortex (mPFC). Increased expression after cocaine self-administration was found for 6 IEGs in dorsal and ventral striatum (c-fos, Mkp1, Fosb/ΔFosb, Egr2, Egr4, and Arc) and 10 IEGs in mPFC (same 6 IEGs as in striatum, plus Bdnf, Homer1, Sgk1 and Rgs2). Five of these 10 IEGs (Egr2, Fosb/ΔFosb, Bdnf, Homer1 and Jun) and Trkb in mPFC were responsive to long-term sucrose self-administration. Importantly, no major differences were found between IEG expression patterns after 10 or 60 days of cocaine self-administration, except Fosb/ΔFosb in dorsal striatum and Egr2 in mPFC, whereas the amount of cocaine obtained per session was comparable for short-term and long-term self-administration. These steady changes in IEG expression are, therefore, associated with stable self-administration behaviour rather than the total amount of cocaine consumed. Thus, sustained impulses to IEG regulation during prolonged cocaine self-administration may evoke neuroplastic changes underlying compulsive drug use.

The Naturally Occurring Compound Garcinia Indica Selectively Impairs the Reconsolidation of a Cocaine-Associated Memory

Sustained abstinence from cocaine use is frequently compromised by exposure to environmental stimuli that have previously been strongly associated with drug taking. Such cues trigger memories of the effects of the drug, leading to craving and potential relapse. Our work has demonstrated that manipulating cocaine-cue memories by destabilizing them through interfering with the reconsolidation process is one potential therapeutic tool by which to prolong abstinence. Here, we examine the use of the naturally occurring amnestic agent garcinol to manipulate an established cocaine-cue memory. Rats underwent 12 days of cocaine self-administration training during which time active lever presses resulted in an i.v. infusion of cocaine that was paired with a light/tone cue. Next rats underwent lever extinction for 8 days followed by light/tone reactivation and a test of cue-induced cocaine-seeking behavior. Systemic injection of garcinol 30 min after reactivation significantly impaired the reconsolidation of the cocaine-associated cue memory. Further testing revealed that garcinol had no effect on drug-induced cocaine-seeking, but was capable of blocking the initial conditioned reinforcing properties of the cue and prevents the acquisition of a new response. Additional experiments showed that the effects of garcinol are specific to reactivated memories only, temporally constrained, cue-specific, long-lasting, and persist following extended cocaine access. These data provide strong evidence that the naturally occurring compound, garcinol, may be a potentially useful tool to sustain abstinence from drug abuse.

Drug Addiction: Updating Actions to Habits to Compulsions Ten Years On

A decade ago, we hypothesized that drug addiction can be viewed as a transition from voluntary, recreational drug use to compulsive drug-seeking habits, neurally underpinned by a transition from prefrontal cortical to striatal control over drug seeking and taking as well as a progression from the ventral to the dorsal striatum. Here, in the light of burgeoning, supportive evidence, we reconsider and elaborate this hypothesis, in particular the refinements in our understanding of ventral and dorsal striatal mechanisms underlying goal-directed and habitual drug seeking, the influence of drug-associated Pavlovian-conditioned stimuli on drug seeking and relapse, and evidence for impairments in top-down prefrontal cortical inhibitory control over this behavior. We further review animal and human studies that have begun to define etiological factors and individual differences in the propensity to become addicted to drugs, leading to the description of addiction endophenotypes, especially for cocaine addiction. We consider the prospect of novel treatments for addiction that promote abstinence from and relapse to drug use.

Extinction and the associative structure of heterogeneous instrumental chains

Drug abuse, overeating, and smoking are all examples of instrumental behaviors that often involve chains or sequences of behavior. A behavior chain is minimally composed of a procurement response that is required in order for a subsequent consumption response to be reinforced. Despite the translational importance of behavior chains, few studies have attempted to understand what binds them together and takes them apart. This article surveys the development of the heterogeneous instrumental chain method and introduces recent findings that have used extinction to analyze the associative content of (what is learned in) the chain. Chained responses that are occasion-set by their own discriminative stimuli may be directly associated; extinction of the procurement response weakens its associated consumption response, and extinction of the consumption response weakens its associated procurement response. Extinction itself involves learning to inhibit the response. Extinguished chained responses are subject to renewal when they are tested either back in the acquisition context or in a new context. In addition, a consumption response that is extinguished outside its chain is renewed when returned to the context of the preceding response in the chain. Research on heterogeneous behavior chains can provide important insights into an important but often overlooked aspect of instrumental learning.

N-acetylcysteine Facilitates Self-Imposed Abstinence After Escalation of Cocaine Intake

BACKGROUND

N-acetylcysteine (NAC) has been suggested to prevent relapse to cocaine seeking. However, the psychological processes underlying its potential therapeutic benefit remain largely unknown.

METHODS

We investigated the hallmark features of addiction that were influenced by chronic NAC treatment in rats given extended access to cocaine: escalation, motivation, self-imposed abstinence in the face of punishment, or propensity to relapse. For this, Sprague Dawley rats were given access either to 1 hour (short access) or 6 hours (long access [LgA]) self-administration (SA) sessions until LgA rats displayed a robust escalation. Rats then received daily saline or NAC (60 mg/kg, intraperitoneal) treatment and were tested under a progressive ratio and several consecutive sessions in which lever presses were punished by mild electric foot shocks.

RESULTS

NAC increased the sensitivity to punishment in LgA rats only, thereby promoting abstinence. Following the cessation of punishment, NAC-treated LgA rats failed to recover fully their prepunishment cocaine intake levels and resumed cocaine SA at a lower rate than short access and vehicle-treated LgA rats. However, NAC altered neither the escalation of SA nor the motivation for cocaine. At the neurobiological level, NAC reversed cocaine-induced decreases in the glutamate type 1 transporter observed in both the nucleus accumbens and the dorsolateral striatum. NAC also increased the expression of Zif268 in the nucleus accumbens and dorsolateral striatum of LgA rats.

CONCLUSIONS

Our results indicate that NAC contributes to the restoration of control over cocaine SA following adverse consequences, an effect associated with plasticity mechanisms in both the ventral and dorsolateral striatum.

Compulsivity in obsessive-compulsive disorder and addictions

Compulsive behaviors are driven by repetitive urges and typically involve the experience of limited voluntary control over these urges, a diminished ability to delay or inhibit these behaviors, and a tendency to perform repetitive acts in a habitual or stereotyped manner. Compulsivity is not only a central characteristic of obsessive-compulsive disorder (OCD) but is also crucial to addiction. Based on this analogy, OCD has been proposed to be part of the concept of behavioral addiction along with other non-drug-related disorders that share compulsivity, such as pathological gambling, skin-picking, trichotillomania and compulsive eating. In this review, we investigate the neurobiological overlap between compulsivity in substance-use disorders, OCD and behavioral addictions as a validation for the construct of compulsivity that could be adopted in the Research Domain Criteria (RDoC). The reviewed data suggest that compulsivity in OCD and addictions is related to impaired reward and punishment processing with attenuated dopamine release in the ventral striatum, negative reinforcement in limbic systems, cognitive and behavioral inflexibility with diminished serotonergic prefrontal control, and habitual responding with imbalances between ventral and dorsal frontostriatal recruitment. Frontostriatal abnormalities of compulsivity are promising targets for neuromodulation and other interventions for OCD and addictions. We conclude that compulsivity encompasses many of the RDoC constructs in a trans-diagnostic fashion with a common brain circuit dysfunction that can help identifying appropriate prevention and treatment targets.

Differential vulnerability to the punishment of cocaine related behaviours: effects of locus of punishment, cocaine taking history and alternative reinforcer availability

BACKGROUND

The availability of alternative reinforcement has been shown to reduce drug use, but it remains unclear whether it facilitates a reduction or cessation of drug seeking or taking.

OBJECTIVES

We compared the effects of punishment of cocaine seeking or taking behaviour after brief or extended cocaine-taking histories when behavioural reallocation was facilitated or not by making available an alternative ingestive reinforcer (sucrose).

METHODS

In the first experiment, punishment of either seeking or taking responses was introduced immediately after training on the seeking-taking chained schedule. In the second experiment, punishment of cocaine seeking was introduced after 12 additional days of either 1 or 6 h daily access to cocaine self-administration. In both experiments, beginning 1 week before the introduction of punishment, a subset of rats had concurrent nose poke access to sucrose while seeking or taking cocaine.

RESULTS

The presence of an alternative source of reinforcement markedly facilitated behavioural reallocation from punished cocaine taking after acquisition. It also facilitated punishment-induced suppression of cocaine seeking after an extensive cocaine self-administration history likely by prompting goal-directed motivational control over drug use. However, a significant proportion of rats were deemed compulsive-maintaining drug use after an extensive cocaine history despite the presence of abstinence-promoting positive and negative incentives.

CONCLUSION

Making available an alternative reinforcer facilitates disengagement from punished cocaine use through at least two different processes but remains ineffective in a subpopulation of vulnerable animals, which continued to seek cocaine despite the aversive consequence of punishment and the presence of the alternative positive reinforcer.

Effects of pramipexole on the acquisition of responding with opioid-conditioned reinforcement in the rat

RATIONALE

Dopamine D3 receptor-preferring ligands may be able to modify the conditioned reinforcing effects of drug-associated stimuli. In evaluating the effects of these compounds, it is important to clarify the extent to which responding depends on (1) conditioned reinforcement vs. other behavioral mechanisms and (2) dopamine D3 vs. D2 receptor activity.

OBJECTIVES

To use behaviorally stringent new-response acquisition procedures to characterize the effects of the D3-preferring agonist, pramipexole, on the conditioned reinforcing effects of a stimulus paired with the opioid agonist, remifentanil.

METHODS

First, in Pavlovian conditioning (PAV) sessions, rats received response-independent IV injections of remifentanil and presentations of a light-noise stimulus. In separate groups, injections and stimuli either always co-occurred ("paired PAV") or occurred with no consistent relationship ("random PAV" control). Next, in instrumental acquisition (ACQ) sessions, all animals could respond in two nose-poke manipulanda: an active nose-poke, which produced the stimulus alone, or an inactive nose-poke. Pramipexole was injected SC prior to ACQ sessions with or without pretreatments of the D3-preferring antagonist, SB-277011A, or the D2-preferring antagonist, L-741,626.

RESULTS

After paired PAV, but not random PAV, rats acquired nose-poke responding during ACQ (i.e., active > inactive). Pramipexole dose-dependently increased active responding without changing inactive responding. Pramipexole-induced increases in responding were blocked by pretreatment with L-741,626, but not SB-277011A.

CONCLUSIONS

Pramipexole specifically enhanced remifentanil-conditioned reinforcement: active responding was selectively increased only after the stimulus was paired with remifentanil. Although pramipexole is D3-preferring, the antagonist effects obtained presently suggest an important role for the D2 receptor in opioid-conditioned reinforcement.

Using conditioned suppression to investigate compulsive drug seeking in rats

BACKGROUND

Persistent drug seeking despite harmful consequences is a defining characteristic of addiction. Recent preclinical studies have demonstrated the occurrence of this hallmark feature of addictive behaviour in rodents. For example, it has been shown that the ability of an aversive conditioned stimulus (CS) to suppress cocaine seeking was diminished after an extended self-administration history. The present study aimed to optimize the experimental conditions to examine conditioned suppression of sucrose and cocaine seeking in rats, and its dependence on the longevity of self-administration experience.

METHODS

We investigated whether conditioned suppression depends on the intensity and quantity of footshocks during conditioning. In addition, the effects of CS omission, extinction and reconditioning were investigated, as well as the influence of the CS interval sequence on conditioned suppression. We also compared conditioned suppression after a limited and extended sucrose or cocaine self-administration history.

RESULTS

We found that conditioned suppression depended on the intensity rather than the quantity of footshocks, whereby a higher footshock intensity was necessary to induce suppression of cocaine seeking compared to sucrose seeking. Conditioned suppression was most pronounced when the test started with presentation of the aversive CS, and conditioned suppression could be extinguished and reacquired. In addition, conditioned suppression of cocaine, but not sucrose seeking was reduced after extended self-administration experience.

CONCLUSIONS

These data provide a detailed analysis of conditioned suppression of cocaine and sucrose seeking. Importantly, we confirm the usefulness of conditioned suppression to study persistent drug seeking after prolonged drug self-administration.

Neural and psychological mechanisms underlying compulsive drug seeking habits and drug memories--indications for novel treatments of addiction

This review discusses the evidence for the hypothesis that the development of drug addiction can be understood in terms of interactions between Pavlovian and instrumental learning and memory mechanisms in the brain that underlie the seeking and taking of drugs. It is argued that these behaviours initially are goal-directed, but increasingly become elicited as stimulus-response habits by drug-associated conditioned stimuli that are established by Pavlovian conditioning. It is further argued that compulsive drug use emerges as the result of a loss of prefrontal cortical inhibitory control over drug seeking habits. Data are reviewed that indicate these transitions from use to abuse to addiction depend upon shifts from ventral to dorsal striatal control over behaviour, mediated in part by serial connectivity between the striatum and midbrain dopamine systems. Only some individuals lose control over their drug use, and the importance of behavioural impulsivity as a vulnerability trait predicting stimulant abuse and addiction in animals and humans, together with consideration of an emerging neuroendophenotype for addiction are discussed. Finally, the potential for developing treatments for addiction is considered in light of the neuropsychological advances that are reviewed, including the possibility of targeting drug memory reconsolidation and extinction to reduce Pavlovian influences on drug seeking as a means of promoting abstinence and preventing relapse.

Excessive cocaine use results from decreased phasic dopamine signaling in the striatum

Drug addiction is a neuropsychiatric disorder marked by escalating drug use. Dopamine neurotransmission in the ventromedial striatum (VMS) mediates acute reinforcing effects of abused drugs, but with protracted use the dorsolateral striatum is thought to assume control over drug seeking. We measured striatal dopamine release during a cocaine self-administration regimen that produced escalation of drug taking in rats. Surprisingly, we found that phasic dopamine decreased in both regions as the rate of cocaine intake increased, with the decrement in dopamine in the VMS significantly correlated with the rate of escalation. Administration of the dopamine precursor L-DOPA at a dose that replenished dopamine signaling in the VMS reversed escalation, thereby demonstrating a causal relationship between diminished dopamine transmission and excessive drug use. Together these data provide mechanistic and therapeutic insight into the excessive drug intake that emerges following protracted use.

Incubation of cocaine seeking following brief cocaine experience in mice is enhanced by mGluR1 blockade

The incubation of cocaine craving describes the time-dependent augmentation of cue-induced cocaine seeking during withdrawal from prolonged cocaine self-administration and requires time-dependent changes in neuroplasticity at the level of glutamatergic synapses in the nucleus accumbens (NAc). In contrast to most studies that use multiple cocaine-cue conditioning sessions, the present study tested mice with limited cocaine experience (i.e., a single conditioning session) in the incubation of cue-mediated cocaine seeking and its associated changes in the glutamate system. Mice that self-administered cocaine during a single session exhibited a time-dependent increase in their response for the drug-associated cue as compared to mice that self-administered saline. This behavior was associated with changes in AMPA and NMDA receptor binding characteristics. Furthermore, Group I metabotropic glutamate receptor (mGluR1) mRNA levels were altered in several brain regions, including the NAc. Because of the pivotal role of mGluR1 in the control of cocaine-induced plasticity, we investigated the role of mGluR1 in the formation of drug cue-mediated cocaine seeking. After prolonged withdrawal, mice in which an mGluR1 antagonist was administered following cocaine self-administration displayed increased cocaine seeking compared to vehicle-treated mice. These results suggest that limited cocaine experience is sufficient to induce neurobiological changes that enable an initially neutral cue to acquire motivational value that increases over time, an effect that likely involves glutamate signaling through mGluR1.

Addiction as a stress surfeit disorder

Drug addiction has been conceptualized as a chronically relapsing disorder of compulsive drug seeking and taking that progresses through three stages: binge/intoxication, withdrawal/negative affect, and preoccupation/anticipation. Drug addiction impacts multiple motivational mechanisms and can be conceptualized as a disorder that progresses from positive reinforcement (binge/intoxication stage) to negative reinforcement (withdrawal/negative affect stage). The construct of negative reinforcement is defined as drug taking that alleviates a negative emotional state. Our hypothesis is that the negative emotional state that drives such negative reinforcement is derived from dysregulation of key neurochemical elements involved in the brain stress systems within the frontal cortex, ventral striatum, and extended amygdala. Specific neurochemical elements in these structures include not only recruitment of the classic stress axis mediated by corticotropin-releasing factor (CRF) in the extended amygdala as previously hypothesized but also recruitment of dynorphin-κ opioid aversive systems in the ventral striatum and extended amygdala. Additionally, we hypothesized that these brain stress systems may be engaged in the frontal cortex early in the addiction process. Excessive drug taking engages activation of CRF not only in the extended amygdala, accompanied by anxiety-like states, but also in the medial prefrontal cortex, accompanied by deficits in executive function that may facilitate the transition to compulsive-like responding. Excessive activation of the nucleus accumbens via the release of mesocorticolimbic dopamine or activation of opioid receptors has long been hypothesized to subsequently activate the dynorphin-κ opioid system, which in turn can decrease dopaminergic activity in the mesocorticolimbic dopamine system. Blockade of the κ opioid system can also block anxiety-like and reward deficits associated with withdrawal from drugs of abuse and block the development of compulsive-like responding during extended access to drugs of abuse, suggesting another powerful brain stress/anti-reward system that contributes to compulsive drug seeking. Thus, brain stress response systems are hypothesized to be activated by acute excessive drug intake, to be sensitized during repeated withdrawal, to persist into protracted abstinence, and to contribute to the development and persistence of addiction. The recruitment of anti-reward systems provides a powerful neurochemical basis for the negative emotional states that are responsible for the dark side of addiction. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'.

Escalation of drug self-administration as a hallmark of persistent addiction liability

Drug addiction is a progressive, relapsing disease comprised of interlocking stages of disordered motivation. Numerous animal models describing various stages of the addiction process have been developed over the past few decades, providing considerable advantages for the modeling of drug addiction compared with other complex psychiatric disease states. Escalation of drug self-administration has emerged as a widely accepted operant conditioning model of excessive drug intake. We further argue here that drug-escalated animals represent a comprehensive model of addiction according to the manifestations of behavioral neuroadaptations resulting directly or indirectly from excessive drug consumption. In particular, drug-escalated animals exhibit a host of symptoms in line with multiple Diagnostic and Statistical Manual of Mental Disorders criteria for substance dependence, which can be summarized as an emergence of uncontrollable drug-taking and drug-seeking behaviors as a consequence of within-circuit and between-circuit neuroadaptations. Such a transition from impulsive drug sampling to compulsive intake represents a highly valid conceptualization of the addiction timeline in humans, and further investigation of persistent or near-permanent (e.g. epigenetic) neuroadaptations generated by operant drug intake escalation models will continue to provide mechanisms and therapeutic interventions for reversing the aberrant neuroplasticity underlying addiction.

Addiction is a Reward Deficit and Stress Surfeit Disorder

Drug addiction can be defined by a three-stage cycle - binge/intoxication, withdrawal/negative affect, and preoccupation/anticipation - that involves allostatic changes in the brain reward and stress systems. Two primary sources of reinforcement, positive and negative reinforcement, have been hypothesized to play a role in this allostatic process. The negative emotional state that drives negative reinforcement is hypothesized to derive from dysregulation of key neurochemical elements involved in the brain reward and stress systems. Specific neurochemical elements in these structures include not only decreases in reward system function (within-system opponent processes) but also recruitment of the brain stress systems mediated by corticotropin-releasing factor (CRF) and dynorphin-κ opioid systems in the ventral striatum, extended amygdala, and frontal cortex (both between-system opponent processes). CRF antagonists block anxiety-like responses associated with withdrawal, block increases in reward thresholds produced by withdrawal from drugs of abuse, and block compulsive-like drug taking during extended access. Excessive drug taking also engages the activation of CRF in the medial prefrontal cortex, paralleled by deficits in executive function that may facilitate the transition to compulsive-like responding. Neuropeptide Y, a powerful anti-stress neurotransmitter, has a profile of action on compulsive-like responding for ethanol similar to a CRF1 antagonist. Blockade of the κ opioid system can also block dysphoric-like effects associated with withdrawal from drugs of abuse and block the development of compulsive-like responding during extended access to drugs of abuse, suggesting another powerful brain stress system that contributes to compulsive drug seeking. The loss of reward function and recruitment of brain systems provide a powerful neurochemical basis that drives the compulsivity of addiction.

Compulsive drug use and its neural substrates

Drug addiction is a chronic relapsing brain disease, characterized by compulsive drug use. Despite the fact that drug addiction affects millions of people worldwide, treatments for this disorder are limited in number and efficacy. In our opinion, understanding the neural underpinnings of drug addiction would open new avenues for the development of innovative treatments for this disorder. Based on an awareness that drug use and drug reward do not equal drug addiction, there has been increasing interest in developing animal models of addiction that mimick the loss of control over drug use more closely than existing models aimed at studying drug reward. The present review provides an overview of animal studies of compulsive drug use and the neural mechanisms involved. First, the employed models are summarized, with a particular emphasis on models of escalation of drug use and resistance to punishment. Next, we discuss mechanisms within the (ventral and dorsal) striatum and (central) amygdala that have recently been implicated in the compulsive seeking and taking of alcohol and cocaine. The studies discussed here provide a promising line of research that will advance our knowledge of the neural circuits involved in the self-destructive behavior that characterizes drug addiction.

From the ventral to the dorsal striatum: devolving views of their roles in drug addiction

We revisit our hypothesis that drug addiction can be viewed as the endpoint of a series of transitions from initial voluntarily drug use to habitual, and ultimately compulsive drug use. We especially focus on the transitions in striatal control over drug seeking behaviour that underlie these transitions since functional heterogeneity of the striatum was a key area of Ann Kelley's research interests and one in which she made enormous contributions. We also discuss the hypothesis in light of recent data that the emergence of a compulsive drug seeking habit both reflects a shift to dorsal striatal control over behaviour and impaired prefontal cortical inhibitory control mechanisms. We further discuss aspects of the vulnerability to compulsive drug use and in particular the impact of impulsivity. In writing this review we acknowledge the untimely death of an outstanding scientist and a dear personal friend.

Molecular, cellular, and structural mechanisms of cocaine addiction: a key role for microRNAs

The rewarding properties of cocaine play a key role in establishing and maintaining the drug-taking habit. However, as exposure to cocaine increases, drug use can transition from controlled to compulsive. Importantly, very little is known about the neurobiological mechanisms that control this switch in drug use that defines addiction. MicroRNAs (miRNAs) are small non-protein coding RNA transcripts that can regulate the expression of messenger RNAs that code for proteins. Because of their highly pleiotropic nature, each miRNA has the potential to regulate hundreds or even thousands of protein-coding RNA transcripts. This property of miRNAs has generated considerable interest in their potential involvement in complex psychiatric disorders such as addiction, as each miRNA could potentially influence the many different molecular and cellular adaptations that arise in response to drug use that are hypothesized to drive the emergence of addiction. Here, we review recent evidence supporting a key role for miRNAs in the ventral striatum in regulating the rewarding and reinforcing properties of cocaine in animals with limited exposure to the drug. Moreover, we discuss evidence suggesting that miRNAs in the dorsal striatum control the escalation of drug intake in rats with extended cocaine access. These findings highlight the central role for miRNAs in drug-induced neuroplasticity in brain reward systems that drive the emergence of compulsive-like drug use in animals, and suggest that a better understanding of how miRNAs control drug intake will provide new insights into the neurobiology of drug addiction.

Positive Allosteric Modulation of mGluR5 Accelerates Extinction Learning but Not Relearning Following Methamphetamine Self-Administration

Recent studies have implicated glutamate neurotransmission as an important substrate for the extinction of conditioned behaviors, including responding for drug reinforcement. Positive allosteric modulation of the type-5 metabotropic glutamate receptor (mGluR5) in particular has emerged as a treatment strategy for the enhancement of extinction of drug-motivated behaviors. Here, we investigated the effects of the mGluR5 positive allosteric modulator CDPPB, a compound known for its cognitive enhancing effects in rodents, on extinction learning in rats with different histories of methamphetamine (METH) training. Rats were trained to self-administer METH under two conditions: 16 daily sessions of short access (90 min/day, ShA), or eight daily sessions of short access followed by eight sessions of long access (6 h/day, LgA). Control rats self-administered sucrose pellets in daily 30 min sessions. Next, rats were administered vehicle or 30 mg/kg CDPPB prior to seven consecutive daily extinction sessions, subjected to additional extinction sessions to re-establish a post-treatment baseline, and then tested for reinstatement of behavior in the presence of METH- or sucrose-paired cues. Rats were then subjected to a second series of extinction sessions, preceded by vehicle or 30 mg/kg CDPPB, and an additional test for cue-triggered reinstatement. CDPPB treatment resulted in a more rapid extinction of responding on the active lever, especially in the early sessions of the first extinction sequence. However, treatment effects were minimal during subsequent cue reinstatement tests and non-existent during the second series of extinction sessions. Rats with histories of ShA, LgA, and sucrose training expressed similar behavioral sensitivities to CDPPB, with LgA rats demonstrating a modestly higher treatment effect. Positive allosteric modulation of mGluR5 may therefore have some beneficial effects on efforts to facilitate extinction learning and reduce methamphetamine seeking.

Attenuation of methamphetamine seeking by the mGluR2/3 agonist LY379268 in rats with histories of restricted and escalated self-administration

Recent findings implicate group II metabotropic glutamate receptors (mGluR(2/3)) in the reinforcing effects of psychostimulants and have identified these receptors as potential treatment targets for drug addiction. Here, we investigated the effects of mGluR(2/3) stimulation on cue- and drug-primed reinstatement in rats with different histories of methamphetamine (METH) self-administration training, under two conditions: 16 daily sessions of short access (90 min/day, ShA), or 8 daily sessions of short access followed by 8 sessions of long access (6 h/day, LgA). Following self-administration and subsequent extinction training, rats were pretreated with the selective mGluR(2/3) agonist LY379268 (variable dose, 0-3 mg/kg), exposed to METH-paired cues or a priming injection of METH (1 mg/kg), and tested for reinstatement of METH-seeking behavior. LgA rats self-administered greater amounts of METH during the second half of training, but when pretreated with vehicle, ShA and LgA rats showed cue- and drug-primed reinstatement at equivalent response rates. However, LgA rats demonstrated greater sensitivity to mGluR(2/3) stimulation with attenuated responding during cue-induced reinstatement after 0.3 mg/kg and higher doses of LY379268, whereas ShA rats decreased cue-induced reinstatement behavior following 1.0 mg/kg and 3.0 mg/kg LY379268. Additionally, both LgA and ShA rats exhibited decreased METH-primed reinstatement behavior following 0.3 mg/kg and higher doses of LY379268. A separate group of control rats was trained to self-administer sucrose pellets, and demonstrated attenuated cue-induced sucrose-seeking behavior following 1.0 and 3.0 mg/kg LY379268. Together, the results indicate that LY379268 has differential attenuating effects on cue-induced reinstatement behavior in rats with different histories of METH intake. This article is part of a Special Issue entitled 'Metabotropic Glutamate Receptors'.