Extinction of drug seeking: Neural circuits and approaches to augmentation

A multivariate regressor of patterned dopamine release predicts relapse to cocaine

Understanding mesolimbic dopamine adaptations underlying vulnerability to drug relapse is essential to inform prognostic tools for effective treatment strategies. However, technical limitations have hindered the direct measurement of sub-second dopamine release in vivo for prolonged periods of time, making it difficult to gauge the weight that these dopamine abnormalities have in determining future relapse incidence. Here, we use the fluorescent sensor GrabDA to record, with millisecond resolution, every single cocaine-evoked dopamine transient in the nucleus accumbens (NAc) of freely moving mice during self-administration. We reveal low-dimensional features of patterned dopamine release that are strong predictors of cue-induced reinstatement of cocaine seeking. Additionally, we report sex-specific differences in cocaine-related dopamine responses related to a greater resistance to extinction in males compared with females. These findings provide important insights into the sufficiency of NAc dopamine signaling dynamics-in interaction with sex-for recapitulating persistent cocaine seeking and future relapse vulnerability.

Inhibitory and excitatory alcohol-seeking cues distinct roles in behavior, neurochemistry, and mesolimbic pathway in alcohol preferring (P) rats

Cues associated with alcohol use can readily enhance self-reported cravings for alcohol, which increases the likelihood of reusing alcohol. Understanding the neuronal mechanisms involved in alcohol-seeking behavior is important for developing strategies to treat alcohol use disorder. In all experiments, adult female alcohol-preferring (P) rats were exposed to three conditioned odor cues; CS+ associated with EtOH self-administration, CS- associated with the absence of EtOH (extinction training), and a CS0, a neutral stimulus. The data indicated that presentation of an excitatory conditioned cue (CS+) can enhance EtOH- seeking while the CS- can inhibit EtOH-seeking under multiple test conditions. Presentation of the CS+ activates a subpopulation of dopamine neurons within the interfascicular nucleus of the posterior ventral tegmental area (posterior VTA) and basolateral amygdala (BLA). Pharmacological inactivation of the BLA with GABA agonists inhibits the ability of the CS+ to enhance EtOH-seeking but does not alter context-induced EtOH-seeking or the ability of the CS- to inhibit EtOH-seeking. Presentation of the conditioned odor cues in a non-drug-paired environment indicated that presentation of the CS+ increased dopamine levels in the BLA. In contrast, presentation of the CS- decreased both glutamate and dopamine levels in the BLA. Further analysis revealed that presentation of a CS+ EtOH-associated conditioned cue activates GABA interneurons but not glutamate projection neurons. Overall, the data indicate that excitatory and inhibitory conditioned cues can contrarily alter EtOH-seeking behaviors and that different neurocircuitries are mediating these distinct cues in critical brain regions. Pharmacotherapeutics for craving should inhibit the CS+ and enhance the CS- neurocircuits.

INVOLVEMENT OF CORTICAL PROJECTIONS TO BASOLATERAL AMYGDALA IN CONTEXT-INDUCED REINSTATEMENT OF ETHANOL-SEEKING IN RATS

Ethanol is the most consumed substance of abuse in the world, and its misuse may lead to the development of alcohol use disorder (AUD). High relapse rates remain a relevant problem in the treatment of AUD. Exposure to environmental cues previously associated with ethanol intake could trigger ethanol-seeking behavior. However, the neural mechanisms involved in this phenomenon are not entirely clear. In this context, cortical projections to the basolateral amygdala (BLA) play a role in appetitive and aversive learned behaviors. Therefore, we aimed to evaluate the activation of the cortical projections from the prelimbic (PL), orbitofrontal (OFC), and infralimbic (IL), to the BLA in the context-induced reinstatement of ethanol-seeking. Male Long-Evans rats were trained to self-administer 10% ethanol in Context A. Subsequently, lever pressing in the presence of the discrete cue was extinguished in Context B. After nine extinction sessions, rats underwent intracranial surgery for the unilateral injection of red fluorescent retrograde tracer into the BLA. The context-induced reinstatement of ethanol-seeking was assessed by re-exposing the rats to Context A or B under extinction conditions. Finally, we combined retrograde neuronal tracing with Fos to identify activated cortical inputs to BLA during the reinstatement of ethanol-seeking behavior. We found that PL, but not OFC or IL, retrogradely-labeled neurons from BLA presented increased Fos expression during the re-exposure to the ethanol-associated context, suggesting that PL projection to BLA is involved in the context-induced reinstatement of ethanol-seeking behavior.

Neural correlates of recall and extinction in a rat model of appetitive Pavlovian conditioning

Extinction is a fundamental form of inhibitory learning that is important for adapting to changing environmental contingencies. While numerous studies have investigated the neural correlates of extinction using Pavlovian fear conditioning and appetitive operant reward-seeking procedures, less is known about the neural circuitry mediating the extinction of appetitive Pavlovian responding. Here, we aimed to generate an extensive brain activation map of extinction learning in a rat model of appetitive Pavlovian conditioning. Male Long-Evans rats were trained to associate a conditioned stimulus (CS; 20 s white noise) with the delivery of a 10% sucrose unconditioned stimulus (US; 0.3 ml/CS) to a fluid port. Control groups also received CS presentations, but sucrose was delivered either during the inter-trial interval or in the home-cage. After conditioning, 1 or 6 extinction sessions were conducted in which the CS was presented but sucrose was withheld. We performed Fos immunohistochemistry and network connectivity analyses on a set of cortical, striatal, thalamic, and amygdalar brain regions. Neural activity in the prelimbic cortex, ventral orbitofrontal cortex, nucleus accumbens core, and paraventricular nucleus of the thalamus was greater during recall relative to extinction. Conversely, prolonged extinction following 6 sessions induced increased neural activity in the infralimbic cortex, medial orbitofrontal cortex, and nucleus accumbens shell compared to home-cage controls. All these structures were similarly recruited during recall on the first extinction session. These findings provide novel evidence for the contribution of brain areas and neural networks that are differentially involved in the recall versus extinction of appetitive Pavlovian conditioned responding.

MMM - The molecular model of memory

Identifying mechanisms underlying neurons ability to process information including acquisition, storage, and retrieval plays an important role in the understanding of the different types of memory, pathogenesis of many neurological diseases affecting memory and therapeutic target discovery. However, the traditional understanding of the mechanisms of memory associated with the electrical signals having a unique combination of frequency and amplitude does not answer the question how the memories can survive for life-long periods of time, while exposed to synaptic noise. Recent evidence suggests that, apart from neuronal circuits, a diversity of the molecular memory (MM) carriers, are essential for memory performance. The molecular model of memory (MMM) is proposed, according to which each item of incoming information (the elementary memory item - eMI) is encoded by both circuitries, with the unique for a given MI electrical parameters, and also the MM carriers, unique by its molecular composition. While operating as the carriers of incoming information, the MMs, are functioning within the neuron plasma membrane. Inactive (latent) initially, during acquisition each of the eMIs is activated to become a virtual copy of some real fact or events bygone. This activation is accompanied by the considerable remodeling of the MM molecule associated with the resonance effect.

The enduring behavioral and neurobiological effects of a flavor cue paired with alcohol drinking during adolescence on the incentive properties of the flavor cue in adulthood in female alcohol-preferring (P) rats

BACKGROUND

Alcohol use disorders (AUDs) affect 15 million people nationwide, 4% of which are adolescents (ages 12-17) and adolescents who binge drink significantly increase their likelihood of suffering from an AUD in adulthood. Research shows that cues (i.e. flavors) paired with alcohol (EtOH) produce significant cue-induced alcohol craving and contribute to relapse in adolescent and adult populations. However, there is a lack of research focused on how cues that accompany EtOH drinking during adolescence, affect EtOH craving later in life. The current study sought to examine the sex- and developmental-dependent effects of adolescent exposure to flavor cues associated with EtOH on operant-lick behavior and cue-induced dopamine (DA) levels within the nucleus accumbens shell (AcbSh; reward structure) in adulthood.

METHODS

Adolescent alcohol-preferring (P) rats were randomly assigned to one of 4 groups and received 24 hr. access to three bottles on their home cage: Paired: 0.1% blueberry flavor extract (BB) + 15% v/v EtOH and 2 water bottles; Unpaired: 0.1% BB, 15% v/v EtOH, and water; 15% EtOH alone, and 2 water bottles; BB alone and 2 water bottles. Home cage fluid consumption was measured for 2-weeks. On the third week bottles were removed and all animals underwent 9 days of operant training using an operant sipper paradigm. This consisted of two sipper spouts connected to the computer by a lickometer, which registered tongue contacts with the sipper tube (Paired: BB+EtOH or water; Unpaired BB or EtOH; EtOH alone: EtOH or water; BB alone: BB or water). When the fixed ratio (FR) requirement for number of licks/tongue contacts was met, a liquid delivery solenoid dispensed 0.05 ml of fluid into the sipper tube. Following the final operant session all rats remained in their home-cage for approximately 40 days until adulthood at which point they were returned to the operant chambers and tested for appetitive and consummatory behavior in response to the flavor cue (all rats: BB or water; NO EtOH). Two weeks after the final operant session all rats underwent microdialysis testing to examine cue-induced DA levels in the AcbSh.

RESULTS

Data indicated that animals in the paired group exhibited a significantly greater level of licking at the BB sipper and a significantly greater level of DA release in response to the flavor cue compared to the other groups.

CONCLUSIONS

Overall, the data suggest that cues paired with EtOH during adolescence may produce persistent changes to the behavioral and neurobiological mechanisms that contribute to an increased risk of developing an AUD later in life.

Glucagon-Like Peptide-1 Agonist Exendin-4 Facilitates the Extinction of Cocaine-Induced Condition Place Preference

Accumulating studies suggest that the glucagon-like peptide-1 receptor agonist exendin-4 (Ex4) and toll-like receptor 4 (TLR4) play a pivotal role in the maladaptive behavior of cocaine. However, few studies have assessed whether Ex4 can facilitate the extinction of drug-associated behavior and attenuate the reinstatement of cocaine-induced condition place preference (CPP) in mice. The main objective of the present study was to evaluate Ex4's ability to regulate the extinction and reinstatement of cocaine-induced CPP. C57BL/6 mice were conditioned to either cocaine (20 mg/kg) or an equivalent volume of saline to establish a cocaine-mediated CPP paradigm. To investigate the potential effects of Ex4 on extinction, animals received an intraperitoneal injection of Ex4 either immediately or 6 h after each extinction or only on the test day. The persistence of extinction was measured using the reinstatement paradigm evoked by 10 mg/kg of cocaine. To explore the possible impacts of Ex4 and neuroinflammation on cocaine, the expression levels of TLR4 within the hippocampus was detected using western blotting. As a result, we found that systemic administration of Ex4 immediately after each extinction training, instead of 6 h after each extinction and on the day of extinction test, was capable of facilitating extinction in the confined or non-confined CPP extinction paradigms and blocking the cocaine-primed reinstatement of cocaine-induced CPP. Additionally, we also observed that Ex4 was competent to alleviate TLR4 signaling that has been up-regulated by cocaine. Altogether, our findings indicated that the combination of Ex4 with daily extinction training was sufficient to facilitate extinction of the conditioned behavior, attenuate reinstatement of cocaine-induced CPP and inhibit TLR4 signaling. Thus, Ex4 deserves further investigation as a potential intervention for the treatment of cocaine use disorder.

Sex differences in the effect of chronic delivery of the buprenorphine analogue BU08028 on heroin relapse and choice in a rat model of opioid maintenance

BACKGROUND AND PURPOSE

Maintenance treatment with opioid agonists (buprenorphine, methadone) decreases opioid use and relapse. We recently modelled maintenance treatment in rats and found that chronic delivery of buprenorphine or the μ opioid receptor partial agonist TRV130 decreased relapse to oxycodone seeking and taking. Here, we tested the buprenorphine analogue BU08028 on different heroin relapse-related measures and heroin versus food choice.

EXPERIMENTAL APPROACH

For relapse assessment, we trained male and female rats to self-administer heroin (6 h·day^-1 , 14 days) in Context A and then implanted osmotic minipumps containing BU08028 (0, 0.03 or 0.1 mg·kg^-1 ·d^-1 ). Effects of chronic BU08028 delivery were tested on (1) incubation of heroin-seeking in a non-drug Context B, (2) extinction responding reinforced by heroin-associated discrete cues in Context B, (3) reinstatement of heroin-seeking induced by re-exposure to Context A and (4) re-acquisition of heroin self-administration in Context A. For choice assessment, we tested the effect of chronic BU08028 delivery on heroin versus food choice.

KEY RESULTS

Chronic BU08028 delivery decreased incubation of heroin seeking. Unexpectedly, BU08028 increased re-acquisition of heroin self-administration selectively in females. Chronic BU08028 had minimal effects on context-induced reinstatement and heroin versus food choice in both sexes. Finally, exploratory post hoc analyses suggest that BU08028 decreased extinction responding selectively in males.

CONCLUSIONS AND IMPLICATIONS

Chronic BU08028 delivery had both beneficial and detrimental, sex-dependent, effects on different triggers of heroin relapse and minimal effects on heroin choice in both sexes. Results suggest that BU08028 would not be an effective opioid maintenance treatment in humans.

Circuit and neuropeptide mechanisms of the paraventricular thalamus across stages of alcohol and drug use

The paraventricular nucleus of the thalamus (PVT) is a midline thalamic brain region that has emerged as a critical circuit node in the regulation of behaviors across domains of affect and motivation, stress responses, and alcohol- and drug-related behaviors. The influence of the PVT in this diverse array of behaviors is a function of its ability to integrate and convey information about salience and valence through its connections with cortical, hypothalamic, hindbrain, and limbic brain regions. While understudied to date, recent studies suggest that several PVT efferents play critical and complex roles in drug and alcohol-related phenotypes. The PVT is also the site of signaling for many neuropeptides released from the synaptic terminals of distal inputs and local neuropeptidergic neurons within. While there is some evidence that neuropeptides including orexin, neurotensin, substance P, and cocaine and amphetamine-related transcript (CART) signal in the PVT to regulate alcohol/drug intake and reinstatement, there remains an overall lack of understanding of the roles of neuropeptides in the PVT in addiction-related behaviors, especially in a circuit-specific context. In this review, we present the current status of preclinical research regarding PVT circuits and neuropeptide modulation of the PVT in three aspects of the addiction cycle: reward/acquisition, withdrawal, and relapse, with a focus on alcohol, opioids (particularly morphine), and psychostimulants (particularly cocaine). Given the PVT's unique position within the broader neural landscape, we further discuss the potential ways in which neuropeptides may regulate these behaviors through their actions upon PVT circuits.

Escalation and reinstatement of fentanyl self-administration in male and female rats

RATIONALE

Escalation of drug intake and craving are two DSM-5 hallmark symptoms of opioid use disorder (OUD).

OBJECTIVES

This study determined if escalation of intake as modeled by long access (LgA) self-administration (SA) and craving measured by reinstatement are related.

METHODS

Adult male and female Sprague-Dawley rats were trained to self-administer fentanyl across 7 daily 1-h short access (ShA) sessions, followed by 21 SA sessions of either 1- or 6-h duration (ShA or LgA). Following 14 1-h extinction sessions, Experiment 1 assessed reinstatement induced by either fentanyl (10 or 30 µg/kg) or yohimbine (1 or 2 mg/kg), and Experiment 2 assessed reinstatement induced by a drug-associated cue light.

RESULTS

Females acquired fentanyl SA faster than males. When shifted to LgA sessions, LgA rats escalated fentanyl intake, but ShA rats did not; no reliable sex difference in the rate of escalation was observed. In extinction, compared to ShA rats, LgA rats initially responded less and showed less decay of responding across sessions. A priming injection of fentanyl induced reinstatement, with LgA rats reinstating more than ShA rats at the 30 µg/kg dose. Yohimbine (1 mg/kg) also induced reinstatement, but there was no effect of access group or sex. With cue-induced reinstatement, LgA females reinstated less than LgA males and ShA females.

CONCLUSION

Among the different reinstatement tests assessed, escalation of fentanyl SA increased only drug-primed reinstatement, suggesting a limited relationship between escalation of drug intake and craving (reinstatement) for OUD.

Cognition in the Chronic Pain Experience: Preclinical Insights

Acutely, pain is protective. It promotes escape from, and future avoidance of, noxious stimuli through strong and often lifetime associative memories. However, with persistent acute pain or when pain becomes chronic, these memories can promote negative emotions and poor decisions often associated with deleterious behaviors. In this review, we discuss how preclinical studies can provide insights into the relationship between cognition and chronic pain. We also discuss the concept of pain as a cognitive disorder and new strategies for treating chronic pain that emphasize inhibiting the formation of pain memories or promoting 'forgetting' of established pain memories.

Dopamine and relapse to drug seeking

The actions of dopamine are essential to relapse to drug seeking but we still lack a precise understanding of how dopamine achieves these effects. Here we review recent advances from animal models in understanding how dopamine controls relapse to drug seeking. These advances have been enabled by important developments in understanding the basic neurochemical, molecular, anatomical, physiological and functional properties of the major dopamine pathways in the mammalian brain. The literature shows that although different forms of relapse to seeking different drugs of abuse each depend on dopamine, there are distinct dopamine mechanisms for relapse. Different circuit-level mechanisms, different populations of dopamine neurons and different activity profiles within these dopamine neurons, are important for driving different forms of relapse. This diversity highlights the need to better understand when, where and how dopamine contributes to relapse behaviours.

In a Rat Model of Opioid Maintenance, the G Protein-Biased Mu Opioid Receptor Agonist TRV130 Decreases Relapse to Oxycodone Seeking and Taking and Prevents Oxycodone-Induced Brain Hypoxia

BACKGROUND

Maintenance treatment with opioid agonists (buprenorphine, methadone) is effective for opioid addiction but does not eliminate opioid use in all patients. We modeled maintenance treatment in rats that self-administered the prescription opioid oxycodone. The maintenance medication was either buprenorphine or the G protein-biased mu opioid receptor agonist TRV130. We then tested prevention of oxycodone seeking and taking during abstinence using a modified context-induced reinstatement procedure, a rat relapse model.

METHODS

We trained rats to self-administer oxycodone (6 hours/day, 14 days) in context A; infusions were paired with discrete tone-light cues. We then implanted osmotic pumps containing buprenorphine or TRV130 (0, 3, 6, or 9 mg/kg/day) and performed 3 consecutive tests: lever pressing reinforced by oxycodone-associated discrete cues in nondrug context B (extinction responding), context-induced reinstatement of oxycodone seeking in context A, and reacquisition of oxycodone self-administration in context A. We also tested whether TRV130 maintenance would protect against acute oxycodone-induced decreases in nucleus accumbens oxygen levels.

RESULTS

In male rats, buprenorphine and TRV130 decreased extinction responding and reacquisition of oxycodone self-administration but had a weaker (nonsignificant) effect on context-induced reinstatement. In female rats, buprenorphine decreased responding in all 3 tests, while TRV130 decreased only extinction responding. In both sexes, TRV130 prevented acute brain hypoxia induced by moderate doses of oxycodone.

CONCLUSIONS

TRV130 decreased oxycodone seeking and taking during abstinence in a partly sex-specific manner and prevented acute oxycodone-induced brain hypoxia. We propose that G protein-biased mu opioid receptor agonists, currently in development as analgesics, should be considered as relapse prevention maintenance treatment for opioid addiction.

Improving translation of animal models of addiction and relapse by reverse translation

Critical features of human addiction are increasingly being incorporated into complementary animal models, including escalation of drug intake, punished drug seeking and taking, intermittent drug access, choice between drug and non-drug rewards, and assessment of individual differences based on criteria in the fourth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV). Combined with new technologies, these models advanced our understanding of brain mechanisms of drug self-administration and relapse, but these mechanistic gains have not led to improvements in addiction treatment. This problem is not unique to addiction neuroscience, but it is an increasing source of disappointment and calls to regroup. Here we first summarize behavioural and neurobiological results from the animal models mentioned above. We then propose a reverse translational approach, whose goal is to develop models that mimic successful treatments: opioid agonist maintenance, contingency management and the community-reinforcement approach. These reverse-translated 'treatments' may provide an ecologically relevant platform from which to discover new circuits, test new medications and improve translation.

Transient synaptic potentiation in nucleus accumbens shell during refraining from cocaine seeking

Repeated exposure to drug-associated cues without reward (extinction) leads to refraining from drug seeking in rodents. We determined if refraining is associated with transient synaptic plasticity (t-SP) in nucleus accumbens shell (NAshell), akin to the t-SP measured in the NAcore during cue-induced reinstatement of drug seeking. Using whole cell patch electrophysiology, we found that medium spiny neurons (MSNs) in NAshell expressed increased ratio of AMPA to NMDA glutamate receptor currents during refraining, which normalized to baseline levels by the end of the 2-hour extinction session. Unlike t-SP observed in NAcore during reinstated drug seeking, neither dendrite spine head enlargement nor activation of matrix metalloproteases (MMP2/9) accompanied the increased AMPA:NMDA in NAshell during refraining. Refraining was also not associated with changes in paired pulse ratio, NMDA receptor current decay time, or AMPA receptor rectification index in NAshell MSNs. Our preliminary data in transgenic mice suggest that t-SP may increase D2-MSN inputs relative to D1-MSN inputs.

Berberine Facilitates Extinction of Drug-Associated Behavior and Inhibits Reinstatement of Drug Seeking

A high rate of relapse is a major clinical problem among drug-addicted individuals. Persistent traces of drug-associated reward memories contribute to intense craving and often trigger relapse. A number of interventions on drug-associated memories have shown significant benefits in relapse prevention. Among them are pre- or post-extinction pharmacological manipulations that facilitate the extinction of drug-associated behavior. Berberine, a bioactive isoquinoline alkaloid, has been recently reported to provide therapeutic benefits for a number of central nervous system (CNS) disorders, including morphine addiction. The present study aimed to investigate whether berberine could serve as a post-extinction pharmacological intervention agent to reduce risks of reinstatement of drug seeking. We found that an intragastric administration of berberine at doses of 25 and 50 mg/kg during the critical time window significantly facilitated the extinction of morphine-reward related behavior in free access and confined conditioned place preference (CPP) extinction paradigms, and subsequently, it prevented reinstatement and spontaneous recovery of morphine-induced CPP in mice. Intriguingly, the berberine treatment with or without extinction training altered expression of plasticity-related proteins such as brain-derived neurotrophic factor (BDNF), AMPA receptors (GluA1 and GluA2) in the nucleus accumbens (NAc). Moreover, the post-extinction berberine treatment significantly reduced reinstatement of cocaine-induced CPP and operant intravenous self-administration (IVSA) memories in rats. Altogether, our findings suggest that extinction training combined with the post-extinction berberine treatment can facilitate extinction of drug-associated behavior making it an attractive therapeutic candidate in relapse prevention.

Nonhuman animal models of substance use disorders: Translational value and utility to basic science

BACKGROUND

The National Institute on Drug Abuse (NIDA) recently released a Request for Information (RFI) soliciting comments on nonhuman animal models of substance use disorders (SUD).

METHODS

A literature review was performed to address the four topics outlined in the RFI and one topic inspired by the RFI: (1) animal models that best recapitulate SUD, (2) animal models that best balance the trade-offs between resources and ecological validity, (3) animal models whose translational value are frequently misrepresented or overrepresented by the scientific community, (4) aspects of SUD that are not currently being modeled in animals, and (5) animal models that are optimal for examining the basic mechanisms by which drugs produce their abuse-related effects.

RESULTS

Models that employ response-contingent drug administration, use complex schedules of reinforcement, measure behaviors that mimic the distinguishing features of SUD, and use animals that are phylogenetically similar to humans have the greatest translational value. Models that produce stable and reproducible baselines of behavior, lessen the number of uncontrolled variables, and minimize the influence of extraneous factors are best at examining basic mechanisms contributing to drug reward and reinforcement.

CONCLUSIONS

Nonhuman animal models of SUD have undergone significant refinements to increase their utility for basic science and translational value for SUD. The existing literature describes numerous examples of how these models may best be utilized to answer mechanistic questions of drug reward and identify potential therapeutic interventions for SUD. Progress in the field could be accelerated by further collaborations between researchers using animals versus humans.

Conditioned stimuli affect ethanol-seeking by female alcohol-preferring (P) rats: the role of repeated-deprivations, cue-pretreatment, and cue-temporal intervals

RATIONALE

Evidence indicates that drug-paired stimuli can evoke drug-craving leading to drug-seeking and repeated relapse periods can influence drug-seeking behaviors.

OBJECTIVES

The present study examined (1) the effect of an interaction between repeated deprivation cycles and excitatory conditioning stimuli (CS+) on ethanol (EtOH)-seeking; (2) the effects of EtOH-paired cue-exposure in a non-drug-paired environment on subsequent conditioning in a drug-paired environment; and (3) the temporal effects of conditioned cues on subsequent EtOH-seeking.

METHODS

Adult female alcohol-preferring (P) rats were exposed to three conditioned odor cues; CS+ associated with EtOH self-administration, CS- associated with the absence of EtOH (extinction training), and a neutral stimulus (CS0) presented in a neutral non-drug-paired environment. The rats underwent four deprivation cycles or were non-deprived, following extinction they were maintained in a home cage for an EtOH-free period, and then exposed to no cue, CS+, CS-, or CS0 to assess the effect of the conditioned cues on EtOH-seeking behavior.

RESULTS

Repeated deprivations enhanced and prolonged the duration of CS+ effects on EtOH-seeking. Presentation of the CS- in a non-drug-paired environment blocked the ability of a CS+ to enhance EtOH-seeking in a drug-paired environment. Presentation of the CS+ or CS- in a non-drug-paired environment 2 or 4 h earlier significantly altered EtOH-seeking.

CONCLUSION

Results indicated an interaction between repeated deprivation cycles and CS+ resulted in a potentiation of CS+ evoked EtOH-seeking. In addition, a CS- may have therapeutic potential by providing prophylactic protection against relapse behavior in the presence of cues in the drug-using environment.

Separate vmPFC Ensembles Control Cocaine Self-Administration Versus Extinction in Rats

Recent studies suggest that the ventral medial prefrontal cortex (vmPFC) encodes both operant drug self-administration and extinction memories. Here, we examined whether these opposing memories are encoded by distinct neuronal ensembles within the vmPFC with different outputs to the nucleus accumbens (NAc) in male and female rats. Using cocaine self-administration (3 h/d for 14 d) and extinction procedures, we demonstrated that vmPFC was similarly activated (indexed by Fos) during cocaine-seeking tests after 0 (no-extinction) or 7 extinction sessions. Selective Daun02 lesioning of the self-administration ensemble (no-extinction) decreased cocaine seeking, whereas Daun02 lesioning of the extinction ensemble increased cocaine seeking. Retrograde tracing with fluorescent cholera toxin subunit B injected into NAc combined with Fos colabeling in vmPFC indicated that vmPFC self-administration ensembles project to NAc core while extinction ensembles project to NAc shell. Functional disconnection experiments (Daun02 lesioning of vmPFC and acute dopamine D1-receptor blockade with SCH39166 in NAc core or shell) confirm that vmPFC ensembles interact with NAc core versus shell to play dissociable roles in cocaine self-administration versus extinction, respectively. Our results demonstrate that neuronal ensembles mediating cocaine self-administration and extinction comingle in vmPFC but have distinct outputs to the NAc core and shell that promote or inhibit cocaine seeking.SIGNIFICANCE STATEMENT Neuronal ensembles within the vmPFC have recently been shown to play a role in self-administration and extinction of food seeking. Here, we used the Daun02 chemogenetic inactivation procedure, which allows selective inhibition of neuronal ensembles identified by the activity marker Fos, to demonstrate that different ensembles for cocaine self-administration and extinction memories coexist in the ventral mPFC and interact with distinct subregions of the nucleus accumbens.

Brain and Cognition for Addiction Medicine: From Prevention to Recovery Neural Substrates for Treatment of Psychostimulant-Induced Cognitive Deficits

Addiction to psychostimulants like cocaine, methamphetamine, and nicotine poses a continuing medical and social challenge both in the United States and all over the world. Despite a desire to quit drug use, return to drug use after a period of abstinence is a common problem among individuals dependent on psychostimulants. Recovery for psychostimulant drug-dependent individuals is particularly challenging because psychostimulant drugs induce significant changes in brain regions associated with cognitive functions leading to cognitive deficits. These cognitive deficits include impairments in learning/memory, poor decision making, and impaired control of behavioral output. Importantly, these drug-induced cognitive deficits often impact adherence to addiction treatment programs and predispose abstinent addicts to drug use relapse. Additionally, these cognitive deficits impact effective social and professional rehabilitation of abstinent addicts. The goal of this paper is to review neural substrates based on animal studies that could be pharmacologically targeted to reverse psychostimulant-induced cognitive deficits such as impulsivity and impairment in learning and memory. Further, the review will discuss neural substrates that could be used to facilitate extinction learning and thus reduce emotional and behavioral responses to drug-associated cues. Moreover, the review will discuss some non-pharmacological approaches that could be used either alone or in combination with pharmacological compounds to treat the above-mentioned cognitive deficits. Psychostimulant addiction treatment, which includes treatment for cognitive deficits, will help promote abstinence and allow for better rehabilitation and integration of abstinent individuals into society.

Modeling cocaine relapse in rodents: Behavioral considerations and circuit mechanisms

Addiction is a chronic relapsing disorder, in that most addicted individuals who choose to quit taking drugs fail to maintain abstinence in the long-term. Relapse is especially likely when recovering addicts encounter risk factors like small "priming" doses of drug, stress, or drug-associated cues and locations. In rodents, these same factors reinstate cocaine seeking after a period of abstinence, and extensive preclinical work has used priming, stress, or cue reinstatement models to uncover brain circuits underlying cocaine reinstatement. Here, we review common rat models of cocaine relapse, and discuss how specific features of each model influence the neural circuits recruited during reinstated drug seeking. To illustrate this point, we highlight the surprisingly specific roles played by ventral pallidum subcircuits in cocaine seeking reinstated by either cocaine-associated cues, or cocaine itself. One goal of such studies is to identify, and eventually to reverse the specific circuit activity that underlies the inability of some humans to control their drug use. Based on preclinical findings, we posit that circuit activity in humans also differs based on the triggers that precipitate craving and relapse, and that associated neural responses could help predict the triggers most likely to elicit relapse in a given person. If so, examining circuit activity could facilitate diagnosis of subgroups of addicted people, allowing individualized treatment based on the most problematic risk factors.

Context-induced relapse to cocaine seeking after punishment-imposed abstinence is associated with activation of cortical and subcortical brain regions

We recently developed a rat model of context-induced relapse to alcohol seeking after punishment-imposed abstinence to mimic relapse after self-imposed abstinence due to adverse consequences of drug use. Here, we determined the model's generality to cocaine and have begun to explore brain mechanisms of context-induced relapse to cocaine seeking after punishment-imposed abstinence, using the activity marker Fos. In exp. 1, we trained rats to self-administer cocaine (0.75 mg/kg/infusion, 6 hours/day, 12 days) in context A. Next, we transferred them to context B where for the paired group, but not unpaired group, 50 percent of cocaine-reinforced lever presses caused aversive footshock. We then tested the rats for cocaine seeking under extinction conditions in contexts A and B. We also retested them for relapse after retraining in context A and repunishment in context B. In exp. 2, we used Fos immunoreactivity to determine relapse-associated neuronal activation in brain regions of rats exposed to context A, context B or neither context. Results showed the selective shock-induced suppression of cocaine self-administration and context-induced relapse after punishment-imposed abstinence in rats exposed to paired, but not unpaired, footshock. Additionally, context-induced relapse was associated with selective activation of dorsal and ventral medial prefrontal cortex, anterior insula, dorsal striatum, basolateral amygdala, paraventricular nucleus of the thalamus, lateral habenula, substantia nigra, ventral subiculum, and dorsal raphe, but not nucleus accumbens, central amygdala, lateral hypothalamus, ventral tegmental area and other brain regions. Together, context-induced relapse after punishment-imposed abstinence generalizes to rats with a history of cocaine self-administration and is associated with selective activation of cortical and subcortical regions.

Effect of N-acetylcysteine on motivation, seeking and relapse to ethanol self-administration

Alcohol use disorder is a chronic and highly relapsing disorder, characterized by a loss of control over alcohol consumption and craving. Several studies suggest a key role of glutamate in this disorder. In recent years, the modulation of cystine/glutamate exchange via the x_c^- system has emerged as a new therapeutic alternative for reducing the excitatory glutamatergic transmission observed after ethanol self-administration in both rats and humans. The objective of this study was to determine whether a treatment with N-acetylcysteine (NAC), a cystine prodrug, could reduce ethanol self-administration, ethanol-seeking behavior and reacquisition of ethanol self-administration. Male Long Evans rats were trained to self-administer 20 percent ethanol in operant cages for several weeks. Once the consumption surpassed 1 g of ethanol/kg body weight/15 minutes, the effect of an acute intraperitoneal injection of NAC (0, 25, 50 or 100 mg/kg) 1 hour before the beginning of each test was evaluated on different aspects of the operant self-administration behavior. We demonstrated antimotivational properties of NAC (100 mg/kg), as ethanol-reinforced responding was reduced in a fixed ratio (-35 percent) and in a progressive ratio schedule (-81 percent). NAC also reduced ethanol-seeking behavior (-77 percent) evaluated as extinction responding in a single extinction session. NAC was able to reduce reacquisition in rats that were abstinent for 17 days, while NAC had no effect on ethanol relapse in rats previously exposed to six extinction sessions. Overall, our results demonstrate that NAC limits motivation, seeking behavior and reacquisition in rats, making it a potential new treatment for the maintenance of abstinence.

Divergent prefrontal dopaminergic mechanisms mediate drug- and fear-associated cue extinction during adolescence versus adulthood

Cue-associated learning is vital to guiding behaviour for survival. Adolescence represents a key developmental stage for perturbations in cue-related learning, including a characteristic deficit in cue extinction learning. The present review summarizes evidence from animal and human literature that cue extinction is critically mediated by prefrontal dopamine, a system that undergoes dramatic reorganization during adolescence. We propose that extinction learning and memory is governed by a developmentally dynamic balance of dopamine receptors in the prefrontal cortex, which changes across adolescence into adulthood. This is contrary to the previous idea that extinction deficits during adolescence reflect inefficiency in the same neural circuitry as adults. This leads to proposal of the novel theory that cue extinction involves divergent prefrontal dopaminergic mechanisms depending on the age of extinction.

Interplay of prefrontal cortex and amygdala during extinction of drug seeking

Extinction of Pavlovian conditioning is a complex process that involves brain regions such as the medial prefrontal cortex (mPFC), the amygdala and the locus coeruleus. In particular, noradrenaline (NA) coming from the locus coeruleus has been recently shown to play a different role in two subregions of the mPFC, the prelimbic (PL) and the infralimbic (IL) regions. How these regions interact in conditioning and subsequent extinction is an open issue. We studied these processes using two approaches: computational modelling and NA manipulation in a conditioned place preference paradigm (CPP) in mice. In the computational model, NA in PL and IL causes inputs arriving to these regions to be amplified, thus allowing them to modulate learning processes in amygdala. The model reproduces results from studies involving depletion of NA from PL, IL, or both in CPP. In addition, we simulated new experiments of NA manipulations in mPFC, making predictions on the possible results. We searched the parameters of the model and tested the robustness of the predictions by performing a sensitivity analysis. We also present an empirical experiment where, in accord with the model, a double depletion of NA from both PL and IL in CPP with amphetamine impairs extinction. Overall the proposed model, supported by anatomical, physiological, and behavioural data, explains the differential role of NA in PL and IL and opens up the possibility to understand extinction mechanisms more in depth and hence to aid the development of treatments for disorders such as addiction.

Differential behavioral and molecular alterations upon protracted abstinence from cocaine versus morphine, nicotine, THC and alcohol

Unified theories of addiction are challenged by differing drug-seeking behaviors and neurobiological adaptations across drug classes, particularly for narcotics and psychostimulants. We previously showed that protracted abstinence to opiates leads to despair behavior and social withdrawal in mice, and we identified a transcriptional signature in the extended amygdala that was also present in animals abstinent from nicotine, Δ9-tetrahydrocannabinol (THC) and alcohol. Here we examined whether protracted abstinence to these four drugs would also share common behavioral features, and eventually differ from abstinence to the prototypic psychostimulant cocaine. We found similar reduced social recognition, increased motor stereotypies and increased anxiety with relevant c-fos response alterations in morphine, nicotine, THC and alcohol abstinent mice. Protracted abstinence to cocaine, however, led to strikingly distinct, mostly opposing adaptations at all levels, including behavioral responses, neuronal activation and gene expression. Together, these data further document the existence of common hallmarks for protracted abstinence to opiates, nicotine, THC and alcohol that develop within motivation/emotion brain circuits. In our model, however, these do not apply to cocaine, supporting the notion of unique mechanisms in psychostimulant abuse.

Single Prazosin Infusion in Prelimbic Cortex Fosters Extinction of Amphetamine-Induced Conditioned Place Preference

Exposure to drug-associated cues to induce extinction is a useful strategy to contrast cue-induced drug seeking. Norepinephrine (NE) transmission in medial prefrontal cortex has a role in the acquisition and extinction of conditioned place preference induced by amphetamine. We have reported recently that NE in prelimbic cortex delays extinction of amphetamine-induced conditioned place preference (CPP). A potential involvement of α1-adrenergic receptors in the extinction of appetitive conditioned response has been also suggested, although their role in prelimbic cortex has not been yet fully investigated. Here, we investigated the effects of the α1-adrenergic receptor antagonist prazosin infusion in the prelimbic cortex of C57BL/6J mice on expression and extinction of amphetamine-induced CPP. Acute prelimbic prazosin did not affect expression of amphetamine-induced CPP on the day of infusion, while in subsequent days it produced a clear-cut advance of extinction of preference for the compartment previously paired with amphetamine (Conditioned stimulus, CS). Moreover, prazosin-treated mice that had extinguished CS preference showed increased mRNA expression of brain-derived neurotrophic factor (BDNF) and post-synaptic density 95 (PSD-95) in the nucleus accumbens shell or core, respectively, thus suggesting that prelimbic α1-adrenergic receptor blockade triggers neural adaptations in subcortical areas that could contribute to the extinction of cue-induced drug-seeking behavior. These results show that the pharmacological blockade of α1-adrenergic receptors in prelimbic cortex by a single infusion is able to induce extinction of amphetamine-induced CPP long before control (vehicle) animals, an effect depending on contingent exposure to retrieval, since if infused far from or after reactivation it did not affect preference. Moreover, they suggest strongly that the behavioral effects depend on post-treatment neuroplasticity changes in corticolimbic network, triggered by a possible "priming" effect of prazosin, and point to a potential therapeutic power of the antagonist for maladaptive memories.

Neural systems mediating the inhibition of cocaine-seeking behaviors

Over the past decades, research has targeted the neurobiology regulating cocaine-seeking behaviors, largely in the hopes of identifying potential targets for the treatment of cocaine addiction. Although much of this work has focused on those systems driving cocaine seeking, recently, studies examining the inhibition of cocaine-related behaviors have made significant progress in uncovering the neural systems that attenuate cocaine seeking. Such systems include the infralimbic cortex, nucleus accumbens shell, and hypothalamus. Research in this field has focused largely on the infralimbic cortex, as activity in this region appears to attenuate cocaine seeking during reinstatement and contribute to extinction learning. However, an overarching theory of function for this region that includes its role in other types of reward seeking and learning remains to be determined. Furthermore, the precise relationship between other regions involved in attenuating cocaine-seeking behavior and the infralimbic cortex remains unclear. Recent advances in the use of viral vectors combined with optogenetics, chemogenetics, and other approaches have greatly affected our capacity to investigate those systems inhibiting behavior dependent on cocaine-associated memories. This review will present current understanding regarding the neurobiology underlying the inhibition of such behaviors, especially focusing on the extinction of such memories, and explore how viral-vector targeting of specific brain circuits has begun to alter, and will continue to enrich, our knowledge regarding this issue.

Distinct Fos-Expressing Neuronal Ensembles in the Ventromedial Prefrontal Cortex Mediate Food Reward and Extinction Memories

In operant learning, initial reward-associated memories are thought to be distinct from subsequent extinction-associated memories. Memories formed during operant learning are thought to be stored in "neuronal ensembles." Thus, we hypothesize that different neuronal ensembles encode reward- and extinction-associated memories. Here, we examined prefrontal cortex neuronal ensembles involved in the recall of reward and extinction memories of food self-administration. We first trained rats to lever press for palatable food pellets for 7 d (1 h/d) and then exposed them to 0, 2, or 7 daily extinction sessions in which lever presses were not reinforced. Twenty-four hours after the last training or extinction session, we exposed the rats to either a short 15 min extinction test session or left them in their homecage (a control condition). We found maximal Fos (a neuronal activity marker) immunoreactivity in the ventral medial prefrontal cortex of rats that previously received 2 extinction sessions, suggesting that neuronal ensembles in this area encode extinction memories. We then used the Daun02 inactivation procedure to selectively disrupt ventral medial prefrontal cortex neuronal ensembles that were activated during the 15 min extinction session following 0 (no extinction) or 2 prior extinction sessions to determine the effects of inactivating the putative food reward and extinction ensembles, respectively, on subsequent nonreinforced food seeking 2 d later. Inactivation of the food reward ensembles decreased food seeking, whereas inactivation of the extinction ensembles increased food seeking. Our results indicate that distinct neuronal ensembles encoding operant reward and extinction memories intermingle within the same cortical area.

SIGNIFICANCE STATEMENT

A current popular hypothesis is that neuronal ensembles in different prefrontal cortex areas control reward-associated versus extinction-associated memories: the dorsal medial prefrontal cortex (mPFC) promotes reward seeking, whereas the ventral mPFC inhibits reward seeking. In this paper, we use the Daun02 chemogenetic inactivation procedure to demonstrate that Fos-expressing neuronal ensembles mediating both food reward and extinction memories intermingle within the same ventral mPFC area.

Role of Ventral Subiculum in Context-Induced Relapse to Alcohol Seeking after Punishment-Imposed Abstinence

In many human alcoholics, abstinence is self-imposed because of the negative consequences of excessive alcohol use, and relapse is often triggered by exposure to environmental contexts associated with prior alcohol drinking. We recently developed a rat model of this human condition in which we train alcohol-preferring P rats to self-administer alcohol in one context (A), punish the alcohol-reinforced responding in a different context (B), and then test for relapse to alcohol seeking in Contexts A and B without alcohol or shock. Here, we studied the role of projections to nucleus accumbens (NAc) shell from ventral subiculum (vSub), basolateral amygdala, paraventricular thalamus, and ventral medial prefrontal cortex in context-induced relapse after punishment-imposed abstinence. First, we measured double-labeling of the neuronal activity marker Fos with the retrograde tracer cholera toxin subunit B (injected in NAc shell) and demonstrated that context-induced relapse is associated with selective activation of the vSub→NAc shell projection. Next, we reversibly inactivated the vSub with GABA receptor agonists (muscimol+baclofen) before the context-induced relapse tests and provided evidence for a causal role of vSub in this relapse. Finally, we used a dual-virus approach to restrict expression of the inhibitory κ opioid-receptor based DREADD (KORD) in vSub→NAc shell projection neurons. We found that systemic injections of the KORD agonist salvinorin B, which selectively inhibits KORD-expressing neurons, decreased context-induced relapse to alcohol seeking. Our results demonstrate a critical role of vSub in context-induced relapse after punishment-imposed abstinence and further suggest a role of the vSub→NAc projection in this relapse.

SIGNIFICANCE STATEMENT

In many human alcoholics, abstinence is self-imposed because of the negative consequences of excessive use, and relapse is often triggered by exposure to environmental contexts associated with prior alcohol use. Until recently, an animal model of this human condition did not exist. We developed a rat model of this human condition in which we train alcohol-preferring P rats to self-administer alcohol in one context (A), punish the alcohol-reinforced responding in a different context (B), and test for relapse to alcohol seeking in Contexts A and B. Here, we used neuroanatomical, neuropharmacological, and chemogenetic methods to demonstrate a role of ventral subiculum and potentially its projections to nucleus accumbens in context-induced relapse after punishment-imposed abstinence.

Role of projections from ventral subiculum to nucleus accumbens shell in context-induced reinstatement of heroin seeking in rats

RATIONALE AND OBJECTIVE

In humans, exposure to contexts previously associated with heroin use can provoke relapse. In rats, exposure to heroin-paired contexts after extinction of drug-reinforced responding in different contexts reinstates heroin seeking. We previously demonstrated that the projections from ventral medial prefrontal cortex (vmPFC) to nucleus accumbens (NAc) shell play a role in this reinstatement. The ventral subiculum (vSub) sends glutamate projections to NAc shell and vmPFC. Here, we determined whether these projections contribute to context-induced reinstatement.

METHODS

We trained rats to self-administer heroin (0.05-0.1 mg/kg/infusion) for 3 h per day for 12 days; drug infusions were paired with a discrete tone-light cue. Lever pressing in the presence of the discrete cue was subsequently extinguished in a different context. We then tested the rats for reinstatement in the heroin- and extinction-associated contexts under extinction conditions. We combined Fos with the retrograde tracer Fluoro-Gold (FG) to determine projection-specific activation during the context-induced reinstatement tests. We also used anatomical disconnection procedures to determine whether the vSub → NAc shell and vSub → vmPFC projections are functionally involved in this reinstatement.

RESULTS

Exposure to the heroin but not the extinction context reinstated lever pressing. Context-induced reinstatement of heroin seeking was associated with increased Fos expression in vSub neurons, including those projecting to NAc shell and vmPFC. Anatomical disconnection of the vSub → NAc shell projection, but not the vSub → vmPFC projection, decreased this reinstatement.

CONCLUSIONS

Our data indicate that the vSub → NAc shell glutamatergic projection, but not the vSub → vmPFC projection, contributes to context-induced reinstatement of heroin seeking.

Norepinephrine in prelimbic cortex delays extinction of amphetamine-induced conditioned place preference

RATIONALE

Drug-associated cues exposure to induce extinction is a useful strategy to contrast cue-induced drug seeking. Treatments aimed at reducing motivational properties of cues are considered highly promising since they could decrease their ability to induce drug-conditioned behaviors. Norepinephrine (NE) in the medial prefrontal cortex (mPFC) is critical for attribution of motivational salience to highly salient stimuli, suggesting a major role in prelimbic (PL) mpFC to modulate the motivational properties of drug-related cues, invigorating them, and consequently, delaying extinction.

OBJECTIVES

To investigate if NE in PL fosters the maintenance of drug-seeking behavior, we assessed its role on amphetamine-induced conditioned place preference (CPP). Moreover, to affirm the specificity of NE in PL, we also assessed the role of NE in the infralimbic (IL) mPFC.

METHODS

The effects of selective NE depletion in the PL or in the IL of C57BL/6J mice were assessed on the expression of amphetamine-induced CPP before and after extinction procedure.

RESULTS

NE-depleted mice in PL extinguished preference for Amph-paired chamber long before sham animals. By contrast, IL-depleted animals maintained place preference for more than 4 weeks after the procedure of extinction, having at that moment interrupted the test.

CONCLUSIONS

Inactivation of NE in PL cortex blunts amphetamine-induced CPP, thus fostering extinction and showing to be critical for the maintenance of conditioned Amph-seeking behavior. Opposite effects of NE depletion in IL, seemingly in agreement with literature on extinction, are discussed in terms of balance of activity between PL and IL in extinction.

Exaggerated acquisition and resistance to extinction of avoidance behavior in treated heroin-dependent men

OBJECTIVE

Addiction is often conceptualized as a behavioral strategy for avoiding negative experiences. In rodents, opioid intake has been associated with abnormal acquisition and extinction of avoidance behavior. Here, we tested the hypothesis that these findings would generalize to human opioid-dependent subjects.

METHOD

Adults meeting DSM-IV criteria for heroin dependence and treated with opioid medication (n = 27) and healthy controls (n = 26) were recruited between March 2013 and October 2013 and given a computer-based task to assess avoidance behavior. For this task, subjects controlled a spaceship and could either gain points by shooting an enemy spaceship or hide in safe areas to avoid on-screen aversive events. Hiding duration during different periods of the task was used to measure avoidance behavior.

RESULTS

While groups did not differ on escape responding (hiding) during the aversive event, heroin-dependent men (but not women) made more avoidance responses during a warning signal that predicted the aversive event (analysis of variance, sex × group interaction, P = .007). Heroin-dependent men were also slower to extinguish the avoidance response when the aversive event no longer followed the warning signal (P = .011). This behavioral pattern resulted in reduced opportunity to obtain reward without reducing risk of punishment. Results suggest that, in male patients, differences in avoidance behavior cannot be easily explained by impaired task performance or by exaggerated motor activity.

CONCLUSIONS

This study provides evidence for abnormal acquisition and extinction of avoidance behavior in opioid-dependent patients. Interestingly, data suggest that abnormal avoidance is demonstrated only by male patients. Findings shed light on cognitive and behavioral manifestations of opioid addiction and may facilitate development of therapeutic approaches to help affected individuals.

Animal models of drug relapse and craving: From drug priming-induced reinstatement to incubation of craving after voluntary abstinence

High rates of relapse to drug use during abstinence is a defining feature of drug addiction. In abstinent drug users, drug relapse is often precipitated by acute exposure to the self-administered drug, drug-associated cues, stress, as well as by short-term and protracted withdrawal symptoms. In this review, we discuss different animal models that have been used to study behavioral and neuropharmacological mechanisms of these relapse-related phenomena. In the first part, we discuss relapse models in which abstinence is achieved through extinction training, including the established reinstatement model, as well as the reacquisition and resurgence models. In the second part, we discuss recent animal models in which drug relapse is assessed after either forced abstinence (e.g., the incubation of drug craving model) or voluntary (self-imposed) abstinence achieved either by introducing adverse consequences to ongoing drug self-administration (e.g., punishment) or by an alternative nondrug reward using a discrete choice (drug vs. palatable food) procedure. We conclude by briefly discussing the potential implications of the recent developments of animal models of drug relapse after voluntary abstinence to the development of medications for relapse prevention.

Epigenetics and memory: causes, consequences and treatments for post-traumatic stress disorder and addiction

Understanding the interaction between fear and reward at the circuit and molecular levels has implications for basic scientific approaches to memory and for understanding the etiology of psychiatric disorders. Both stress and exposure to drugs of abuse induce epigenetic changes that result in persistent behavioral changes, some of which may contribute to the formation of a drug addiction or a stress-related psychiatric disorder. Converging evidence suggests that similar behavioral, neurobiological and molecular mechanisms control the extinction of learned fear and drug-seeking responses. This may, in part, account for the fact that individuals with post-traumatic stress disorder have a significantly elevated risk of developing a substance use disorder and have high rates of relapse to drugs of abuse, even after long periods of abstinence. At the behavioral level, a major challenge in treatments is that extinguished behavior is often not persistent, returning with changes in context, the passage of time or exposure to mild stressors. A common goal of treatments is therefore to weaken the ability of stressors to induce relapse. With the discovery of epigenetic mechanisms that create persistent molecular signals, recent work on extinction has focused on how modulating these epigenetic targets can create lasting extinction of fear or drug-seeking behavior. Here, we review recent evidence pointing to common behavioral, systems and epigenetic mechanisms in the regulation of fear and drug seeking. We suggest that targeting these mechanisms in combination with behavioral therapy may promote treatment and weaken stress-induced relapse.

Context-induced reinstatement of methamphetamine seeking is associated with unique molecular alterations in Fos-expressing dorsolateral striatum neurons

Context-induced reinstatement of drug seeking is a well established animal model for assessing the neural mechanisms underlying context-induced drug relapse, a major factor in human drug addiction. Neural activity in striatum has previously been shown to contribute to context-induced reinstatement of heroin, cocaine, and alcohol seeking, but not yet for methamphetamine seeking. In this study, we found that context-induced reinstatement of methamphetamine seeking increased expression of the neural activity marker Fos in dorsal but not ventral striatum. Reversible inactivation of neural activity in dorsolateral but not dorsomedial striatum using the GABA agonists muscimol and baclofen decreased context-induced reinstatement. Based on our previous findings that Fos-expressing neurons play a critical role in conditioned drug effects, we assessed whether context-induced reinstatement was associated with molecular alterations selectively induced within context-activated Fos-expressing neurons. We used fluorescence-activated cell sorting to isolate reinstatement-activated Fos-positive neurons from Fos-negative neurons in dorsal striatum and used quantitative PCR to assess gene expression within these two populations of neurons. Context-induced reinstatement was associated with increased expression of the immediate early genes Fos and FosB and the NMDA receptor subunit gene Grin2a in only Fos-positive neurons. RNAscope in situ hybridization confirmed that Grin2a, as well as Grin2b, expression were increased in only Fos-positive neurons from dorsolateral, but not dorsomedial, striatum. Our results demonstrate an important role of dorsolateral striatum in context-induced reinstatement of methamphetamine seeking and that this reinstatement is associated with unique gene alterations in Fos-expressing neurons.

Roles of the orexin system in central motor control

The neuropeptides orexin-A and orexin-B are produced by one group of neurons located in the lateral hypothalamic/perifornical area. However, the orexins are widely released in entire brain including various central motor control structures. Especially, the loss of orexins has been demonstrated to associate with several motor deficits. Here, we first summarize the present knowledge that describes the anatomical and morphological connections between the orexin system and various central motor control structures. In the next section, the direct influence of orexins on related central motor control structures is reviewed at molecular, cellular, circuitry, and motor activity levels. After the summarization, the characteristic and functional relevance of the orexin system's direct influence on central motor control function are demonstrated and discussed. We also propose a hypothesis as to how the orexin system orchestrates central motor control in a homeostatic regulation manner. Besides, the importance of the orexin system's phasic modulation on related central motor control structures is highlighted in this regulation manner. Finally, a scheme combining the homeostatic regulation of orexin system on central motor control and its effects on other brain functions is presented to discuss the role of orexin system beyond the pure motor activity level, but at the complex behavioral level.

Role of corticostriatal circuits in context-induced reinstatement of drug seeking

Drug addiction is characterized by persistent relapse vulnerability during abstinence. In abstinent drug users, relapse is often precipitated by re-exposure to environmental contexts that were previously associated with drug use. This clinical scenario is modeled in preclinical studies using the context-induced reinstatement procedure, which is based on the ABA renewal procedure. In these studies, context-induced reinstatement of drug seeking is reliably observed in laboratory animals that were trained to self-administer drugs abused by humans. In this review, we summarize neurobiological findings from preclinical studies that have focused on the role of corticostriatal circuits in context-induced reinstatement of heroin, cocaine, and alcohol seeking. We also discuss neurobiological similarities and differences in the corticostriatal mechanisms of context-induced reinstatement across these drug classes. We conclude by briefly discussing future directions in the study of context-induced relapse to drug seeking in rat models. Our main conclusion from the studies reviewed is that there are both similarities (accumbens shell, ventral hippocampus, and basolateral amygdala) and differences (medial prefrontal cortex and its projections to accumbens) in the neural mechanisms of context-induced reinstatement of cocaine, heroin, and alcohol seeking.

Neural and psychological mechanisms underlying compulsive drug seeking habits and drug memories--indications for novel treatments of addiction

This review discusses the evidence for the hypothesis that the development of drug addiction can be understood in terms of interactions between Pavlovian and instrumental learning and memory mechanisms in the brain that underlie the seeking and taking of drugs. It is argued that these behaviours initially are goal-directed, but increasingly become elicited as stimulus-response habits by drug-associated conditioned stimuli that are established by Pavlovian conditioning. It is further argued that compulsive drug use emerges as the result of a loss of prefrontal cortical inhibitory control over drug seeking habits. Data are reviewed that indicate these transitions from use to abuse to addiction depend upon shifts from ventral to dorsal striatal control over behaviour, mediated in part by serial connectivity between the striatum and midbrain dopamine systems. Only some individuals lose control over their drug use, and the importance of behavioural impulsivity as a vulnerability trait predicting stimulant abuse and addiction in animals and humans, together with consideration of an emerging neuroendophenotype for addiction are discussed. Finally, the potential for developing treatments for addiction is considered in light of the neuropsychological advances that are reviewed, including the possibility of targeting drug memory reconsolidation and extinction to reduce Pavlovian influences on drug seeking as a means of promoting abstinence and preventing relapse.

A critical role of lateral hypothalamus in context-induced relapse to alcohol seeking after punishment-imposed abstinence

In human alcoholics, abstinence is often self-imposed, despite alcohol availability, because of the negative consequences of excessive use. During abstinence, relapse is often triggered by exposure to contexts associated with alcohol use. We recently developed a rat model that captures some features of this human condition: exposure to the alcohol self-administration environment (context A), after punishment-imposed suppression of alcohol self-administration in a different environment (context B), provoked renewal of alcohol seeking in alcohol-preferring P rats. The mechanisms underlying context-induced renewal of alcohol seeking after punishment-imposed abstinence are unknown. Here, we studied the role of the lateral hypothalamus (LH) and its forebrain projections in this effect. We first determined the effect of context-induced renewal of alcohol seeking on Fos (a neuronal activity marker) expression in LH. We next determined the effect of LH reversible inactivation by GABAA + GABAB receptor agonists (muscimol + baclofen) on this effect. Finally, we determined neuronal activation in brain areas projecting to LH during context-induced renewal tests by measuring double labeling of the retrograde tracer cholera toxin subunit B (CTb; injected in LH) with Fos. Context-induced renewal of alcohol seeking after punishment-imposed abstinence was associated with increased Fos expression in LH. Additionally, renewal was blocked by muscimol + baclofen injections into LH. Finally, double-labeling analysis of CTb + Fos showed that context-induced renewal of alcohol seeking after punishment-imposed abstinence was associated with selective activation of accumbens shell neurons projecting to LH. The results demonstrate an important role of LH in renewal of alcohol seeking after punishment-imposed abstinence and suggest a role of accumbens shell projections to LH in this form of relapse.

Biological substrates of addiction

This review is an introduction to addiction, the reward circuitry, and laboratory addiction models. Addiction is a chronic disease hallmarked by a state of compulsive drug seeking that persists despite negative consequences. Most of the advances in addiction research have centered on the canonical and contemporary drugs of abuse; however, addictions to other activities and stimuli also exist. Substances of abuse have the potential to induce long-lasting changes in the brain at the behavioral, circuit, and synaptic levels. Addiction-related behavioral changes involve initiation, escalation, and obsession to drug seeking and much of the current research is focused on mapping these manifestations to specific neural pathways. Drug abuse is well known to recruit components of the mesolimbic dopamine system, including the nucleus accumbens and ventral tegmental area. In addition, altered function of a wide variety of brain regions is tightly associated with specific manifestations of drug abuse. These regions peripheral to the mesolimbic pathway likely play a role in specific observed comorbidities and endophenotypes that can facilitate, or be caused by, substance abuse. Alterations in synaptic structure, function, and connectivity, as well as epigenetic and genetic mechanisms are thought to underlie the pathologies of addiction. In preclinical models, these persistent changes are studied at the levels of molecular pharmacology and biochemistry, ex vivo and in vivo electrophysiology, radiography, and behavior. Coordinating research efforts across these disciplines and examining cell type- and circuit-specific phenomena are crucial components for translating preclinical findings to viable medical interventions that effectively treat addiction and related disorders. WIREs Cogn Sci 2014, 5:151-171. doi: 10.1002/wcs.1273 Conflict of interest: The authors have declared no conflicts of interest for this article. For further resources related to this article, please visit the WIREs website.