Context-induced relapse after extinction versus punishment: similarities and differences

The multiple faces of footshock punishment in animal research on addiction

Continued drug use despite negative consequences is a hallmark of addiction commonly modelled in rodents using punished drug intake. Over the years, addiction research highlighted two subpopulations of punishment sensitive and resistant animals. While helpful to interrogate the neurobiology of drug-related behaviors, these procedures carry some weaknesses that need to be recognized and eventually defused. Mainly focusing on footshock-related work, we will first discuss the criteria used to define punishment-resistant animals and how their relative arbitrariness may impact our findings. With the overarching goal of improving our interpretation of the punishment-resistant phenotype, we will evaluate how tailored punishment protocols may better apprehend resistance to punishment, and how testing the robustness of punishment resistance could yield new results and strengthen interpretations. Second, we will question whether and to what extent punishment sensitivity, as currently defined, is reflective of abstinence and suggest that punishment resistance is, in fact, a prerequisite to model abstinence from addiction. Again, we will examine how challenging the robustness of the punishment-sensitive phenotype may help to better characterize it. Finally, we will evaluate whether diminished relapse-like behavior after repeated punishment-induced abstinence could not only contribute to better understand the mechanisms of abstinence, but also uniquely model progressive recovery (i.e., after repeated failed attempts at recovery) which is the norm in people with addiction. Altogether, by questioning the strengths and weaknesses of our models, we would like to open discussions on the different ways we interpret punishment sensitivity and resistance and the aspects that remain to be explored.

Involvement of Pre-limbic Cortex-Nucleus accumbens projections in Context-Induced alcohol seeking

Alcohol use disorder (AUD) remains a critical public health issue worldwide, characterized by high relapse rates often triggered by contextual cues. This research investigates the neural mechanisms behind context-induced reinstatement of alcohol-seeking behavior, focusing on the nucleus accumbens and its interactions with the prelimbic cortex, employing Male Long-Evans rats in an ABA renewal model. In our experimental setup, rats were trained to self-administer 10 % ethanol in Context A, followed by extinction of lever pressing in the presence of discrete cues in Context B. The context-induced reinstatement of ethanol-seeking was then assessed by re-exposing rats to Context A or B under extinction conditions, aiming to simulate the environmental cues' influence on relapse behaviors. Three experiments were conducted: Experiment 1 utilized Fos-immunohistochemistry to examine neuronal activation in the nucleus accumbens; Experiment 2 applied the baclofen + muscimol inactivation technique to probe the functional importance of the nucleus accumbens core; Experiment 3 used Fos-immunofluorescence along with Retrobeads injection to investigate activation of neurons projecting from the prelimbic cortex to the nucleus accumbens core. Our findings revealed significant increases in Fos-immunoreactive nuclei within the nucleus accumbens core and shell during the reinstatement phase in Context A, underscoring the environment's potent effect on ethanol-seeking behavior. Additionally, inactivation of the nucleus accumbens core markedly reduced reinstatement, and there was a notable activation of neurons from the prelimbic cortex to the nucleus accumbens core in the ethanol-associated context. These results highlight the critical role of the nucleus accumbens core and its corticostriatal projections in the neural circuitry underlying context-driven ethanol seeking.

Relapse after electric barrier-induced voluntary abstinence: A review

Relapse to drug use during abstinence is a defining feature of addiction. To date, however, results from studies using rat relapse/reinstatement models have yet to result in FDA-approved medications for relapse prevention. To address this translational gap, we and others have developed rat models of relapse after voluntary abstinence from drug self-administration. One of these models is the electric barrier conflict model. Here, we introduce the model, and then review studies on behavioral and neuropharmacological mechanisms of cue-induced relapse and incubation of drug seeking (time-dependent increase in drug seeking during abstinence) after electric barrier-induced abstinence. We also briefly discuss future directions and potential clinical implications. One major conclusion of our review is that the brain mechanisms controlling drug relapse after electrical barrier-induced voluntary abstinence are likely distinct from those controlling relapse after homecage forced abstinence.

Examining a punishment-related brain circuit with miniature fluorescence microscopes and deep learning

In humans experiencing substance use disorder (SUD), abstinence from drug use is often motivated by a desire to avoid some undesirable consequence of further use: health effects, legal ramifications, etc. This process can be experimentally modeled in rodents by training and subsequently punishing an operant response in a context-induced reinstatement procedure. Understanding the biobehavioral mechanisms underlying punishment learning is critical to understanding both abstinence and relapse in individuals with SUD. To date, most investigations into the neural mechanisms of context-induced reinstatement following punishment have utilized discrete loss-of-function manipulations that do not capture ongoing changes in neural circuitry related to punishment-induced behavior change. Here, we describe a two-pronged approach to analyzing the biobehavioral mechanisms of punishment learning using miniature fluorescence microscopes and deep learning algorithms. We review recent advancements in both techniques and consider a target neural circuit.

Infralimbic cortex plays a similar role in the punishment and extinction of instrumental behavior

Learning to stop responding is a fundamental process in instrumental learning. Animals may learn to stop responding under a variety of conditions that include punishment-where the response earns an aversive stimulus in addition to a reinforcer-and extinction-where a reinforced response now earns nothing at all. Recent research suggests that punishment and extinction may be related manifestations of a common retroactive interference process. In both paradigms, animals learn to stop performing a specific response in a specific context, suggesting direct inhibition of the response by the context. This process may depend on the infralimbic cortex (IL), which has been implicated in a variety of interference-based learning paradigms including extinction and habit learning. Despite the behavioral parallels between extinction and punishment, a corresponding role for IL in punishment has not been identified. Here we report that, in a simple arrangement where either punishment or extinction was conducted in a context that differed from the context in which the behavior was first acquired, IL inactivation reduced response suppression in the inhibitory context, but not responding when it "renewed" in the original context. In a more complex arrangement in which two responses were first trained in different contexts and then extinguished or punished in the opposite one, IL inactivation had no effect. The results advance our understanding of the effects of IL in retroactive interference and the behavioral mechanisms that can produce suppression of a response.

Transcriptional characterization of cocaine withdrawal versus extinction within nucleus accumbens

Substance use disorder is characterized by a maladaptive imbalance wherein drug seeking persists despite negative consequences or drug unavailability. This imbalance correlates with neurobiological alterations some of which are amplified during forced abstinence, thereby compromising the capacity of extinction-based approaches to prevent relapse. Cocaine use disorder (CUD) exemplifies this phenomenon in which neurobiological modifications hijack brain reward regions such as the nucleus accumbens (NAc) to manifest craving and withdrawal-like symptoms. While increasing evidence links transcriptional changes in the NAc to specific phases of addiction, genome-wide changes in gene expression during withdrawal vs. extinction (WD/Ext) have not been examined in a context- and NAc-subregion-specific manner. Here, we used cocaine self-administration (SA) in rats combined with RNA-sequencing (RNA-seq) of NAc subregions (core and shell) to transcriptionally profile the impact of experiencing withdrawal in the home cage or in the previous drug context or experiencing extinction training. As expected, home-cage withdrawal maintained drug seeking in the previous drug context, whereas extinction training reduced it. By contrast, withdrawal involving repetitive exposure to the previous drug context increased drug-seeking behavior. Bioinformatic analyses of RNA-seq data revealed gene expression patterns, networks, motifs, and biological functions specific to these behavioral conditions and NAc subregions. Comparing transcriptomic analysis of the NAc of patients with CUD highlighted conserved gene signatures, especially with rats that were repetitively exposed to the previous drug context. Collectively, these behavioral and transcriptional correlates of several withdrawal-extinction settings reveal fundamental and translational information about potential molecular mechanisms to attenuate drug-associated memories.

A comparison of renewal, spontaneous recovery, and reacquisition after punishment and extinction

Punishment and extinction are both effective methods of reducing instrumental responding and may involve similar learning mechanisms. To characterize the similarities and differences between them, we examined three well-established recovery or "relapse" effects -renewal, spontaneous recovery, and reacquisition - following either punishment or extinction of an instrumental response. In Experiment 1a, both punished and extinguished responses renewed to similar degrees following a context change at test (ABA renewal). In Experiment 1b, responding spontaneously recovered to similar degrees following punishment or extinction. In Experiment 2, responding was rapidly reacquired when the response was reinforced again following extinction but not following punishment, as predicted by the idea that the reinforcer delivered in reacquisition is part of the context of punishment, but not extinction. The results collectively suggest that both punishment and extinction produce similar context-dependent retroactive interference effects. More broadly, they also suggest that punished and extinguished responses may be equally likely to return following a change of context despite the intuition that punishment might provide a more extreme and effective means of suppressing behavior. To our knowledge, this is the first direct behavioral comparison of response recovery after punishment and extinction within individual experiments.

Role of Piriform Cortex and Its Afferent Projections in Relapse to Fentanyl Seeking after Food Choice-Induced Voluntary Abstinence

We previously demonstrated a role of piriform cortex (Pir) in relapse to fentanyl seeking after food choice-induced voluntary abstinence. Here, we used this model to further study the role of Pir and its afferent projections in fentanyl relapse. We trained male and female rats to self-administer palatable food pellets for 6 d (6 h/day) and fentanyl (2.5 µg/kg/infusion, i.v.) for 12 d (6 h/day). We assessed relapse to fentanyl seeking after 12 voluntary abstinence sessions, achieved through a discrete choice procedure between fentanyl and palatable food (20 trials/session). We determined projection-specific activation of Pir afferents during fentanyl relapse with Fos plus the retrograde tracer cholera toxin B (injected into Pir). Fentanyl relapse was associated with increased Fos expression in anterior insular cortex (AI) and prelimbic cortex (PL) neurons projecting to Pir. We next used an anatomical disconnection procedure to determine the causal role of these two projections (AI→Pir and PL→Pir) in fentanyl relapse. Contralateral but not ipsilateral disconnection of AI→Pir projections decreased fentanyl relapse but not reacquisition of fentanyl self-administration. In contrast, contralateral but not ipsilateral disconnection of PL→Pir projections modestly decreased reacquisition but not relapse. Fluorescence-activated cell sorting and quantitative PCR data showed molecular changes within Pir Fos-expressing neurons associated with fentanyl relapse. Finally, we found minimal or no sex differences in fentanyl self-administration, fentanyl versus food choice, and fentanyl relapse. Our results indicate that AI→Pir and PL→Pir projections play dissociable roles in nonreinforced relapse to fentanyl seeking versus reacquisition of fentanyl self-administration after food choice-induced voluntary abstinence.SIGNIFICANCE STATEMENT We previously showed a role of Pir in fentanyl relapse after food choice-induced voluntary abstinence in rats, a procedure mimicking human abstinence or a significant reduction in drug self-administration because of the availability of alternative nondrug rewards. Here, we aimed to further characterize the role of Pir in fentanyl relapse by investigating the role of Pir afferent projections and analyzing molecular changes in relapse-activated Pir neurons. We identified dissociable roles of two Pir afferent projections (AI→Pir and PL→Pir) in relapse to fentanyl seeking versus reacquisition of fentanyl self-administration after voluntary abstinence. We also characterized molecular changes within Pir Fos-expressing neurons associated with fentanyl relapse.

Effect of Selective Lesions of Nucleus Accumbens µ-Opioid Receptor-Expressing Cells on Heroin Self-Administration in Male and Female Rats: A Study with Novel Oprm1-Cre Knock-in Rats

The brain µ-opioid receptor (MOR) is critical for the analgesic, rewarding, and addictive effects of opioid drugs. However, in rat models of opioid-related behaviors, the circuit mechanisms of MOR-expressing cells are less known because of a lack of genetic tools to selectively manipulate them. We introduce a CRISPR-based Oprm1-Cre knock-in transgenic rat that provides cell type-specific genetic access to MOR-expressing cells. After performing anatomic and behavioral validation experiments, we used the Oprm1-Cre knock-in rats to study the involvement of NAc MOR-expressing cells in heroin self-administration in male and female rats. Using RNAscope, autoradiography, and FISH chain reaction (HCR-FISH), we found no differences in Oprm1 expression in NAc, dorsal striatum, and dorsal hippocampus, or MOR receptor density (except dorsal striatum) or function between Oprm1-Cre knock-in rats and wildtype littermates. HCR-FISH assay showed that iCre is highly coexpressed with Oprm1 (95%-98%). There were no genotype differences in pain responses, morphine analgesia and tolerance, heroin self-administration, and relapse-related behaviors. We used the Cre-dependent vector AAV1-EF1a-Flex-taCasp3-TEVP to lesion NAc MOR-expressing cells. We found that the lesions decreased acquisition of heroin self-administration in male Oprm1-Cre rats and had a stronger inhibitory effect on the effort to self-administer heroin in female Oprm1-Cre rats. The validation of an Oprm1-Cre knock-in rat enables new strategies for understanding the role of MOR-expressing cells in rat models of opioid addiction, pain-related behaviors, and other opioid-mediated functions. Our initial mechanistic study indicates that lesioning NAc MOR-expressing cells had different effects on heroin self-administration in male and female rats.SIGNIFICANCE STATEMENT The brain µ-opioid receptor (MOR) is critical for the analgesic, rewarding, and addictive effects of opioid drugs. However, in rat models of opioid-related behaviors, the circuit mechanisms of MOR-expressing cells are less known because of a lack of genetic tools to selectively manipulate them. We introduce a CRISPR-based Oprm1-Cre knock-in transgenic rat that provides cell type-specific genetic access to brain MOR-expressing cells. After performing anatomical and behavioral validation experiments, we used the Oprm1-Cre knock-in rats to show that lesioning NAc MOR-expressing cells had different effects on heroin self-administration in males and females. The new Oprm1-Cre rats can be used to study the role of brain MOR-expressing cells in animal models of opioid addiction, pain-related behaviors, and other opioid-mediated functions.

Acute food deprivation-induced relapse to heroin seeking after short and long punishment-imposed abstinence in male rats

RATIONAL

Stress is a major trigger for drug relapse in humans and animal models, even after prolonged abstinence. However, animal models for stress-induced relapse were criticized for the lack of predictive and face validity.

OBJECTIVES

Here we investigated the effect of acute food deprivation stress in a novel stress-induced relapse model using voluntary, punishment-imposed abstinence from heroin. We also performed a detailed characterization of the development of punishment-imposed abstinence.

METHODS

Male rats were trained to self-administered heroin (0.1 mg/kg/infusion) for 2 weeks, using the seeking-taking chained schedule. Pressing the 'seeking' lever led to the insertion of the 'taking' lever and pressing the take lever resulted in heroin infusion. Following self-administration training, rats were exposed to 8 or 21 days of heroin-seeking punishment. During punishment, 30% of the completed seek links resulted in a mild escalating footshock instead of take lever presentation. Next, rats were tested for heroin seeking under extinction conditions after 24 h of food deprivation and sated conditions.

RESULTS

Probabilistic punishment of seeking lever responses resulted in gradual suppression of heroin seeking and taking. Exposure to food-deprivation stress induced a robust relapse to heroin seeking after short and long punishment-imposed abstinence periods, without significant effects of time, i.e., no incubation of heroin seeking. Individual differences were observed in the development of punishment-induced abstinence and stress-induced relapse.

CONCLUSIONS

These results suggest that stress is a reliable trigger to relapse even after a prolonged period of punishment-induced, voluntary abstinence.

Learning processes in relapse to alcohol use: lessons from animal models

RATIONALE

Alcohol use is reliably preceded by discrete and contextual stimuli which, through diverse learning processes, acquire the capacity to promote alcohol use and relapse to alcohol use.

OBJECTIVE

We review contemporary extinction, renewal, reinstatement, occasion setting, and sex differences research within a conditioning framework of relapse to alcohol use to inform the development of behavioural and pharmacological therapies.

KEY FINDINGS

Diverse learning processes and corresponding neurobiological substrates contribute to relapse to alcohol use. Results from animal models indicate that cortical, thalamic, accumbal, hypothalamic, mesolimbic, glutamatergic, opioidergic, and dopaminergic circuitries contribute to alcohol relapse through separable learning processes. Behavioural therapies could be improved by increasing the endurance and generalizability of extinction learning and should incorporate whether discrete cues and contexts influence behaviour through direct excitatory conditioning or occasion setting mechanisms. The types of learning processes that most effectively influence responding for alcohol differ in female and male rats.

CONCLUSION

Sophisticated conditioning experiments suggest that diverse learning processes are mediated by distinct neural circuits and contribute to relapse to alcohol use. These experiments also suggest that gender-specific behavioural and pharmacological interventions are a way towards efficacious therapies to prevent relapse to alcohol use.

Learning to stop responding

Learning to stop responding is an important process that allows behavior to adapt to a changing and variable environment. This article reviews recent research in this laboratory and others that has studied how animals learn to stop responding in operant extinction, punishment, and feature-negative learning. Extinction and punishment are shown to be similar in two fundamental ways. First, the response-suppressing effects of both are highly context-specific. Second, the response-suppressing effects of both can be remarkably response-specific: Inhibition of one response transfers little to other responses. Learning to inhibit the response so specifically may result from the correction of "response error," the difference between the level of responding and what the current reinforcer supports. In contrast, the inhibition of responding that develops in feature-negative learning, where the response is reinforced during one discriminative stimulus (A) but not in a compound of A and stimulus B, is less response-specific: The inhibition of responding by stimulus B transfers and inhibits a second response, especially if the second response has itself been inhibited before. The results thus indicate both response-specific and response-general forms of behavioral inhibition. One possibility is that response-specific inhibition is learned when the circumstances encourage the organism to pay attention to the response-to what it is actually doing-as behavioral suppression is learned.

Role of ventral subiculum neuronal ensembles in incubation of oxycodone craving after electric barrier-induced voluntary abstinence

High relapse rate is a key feature of opioid addiction. In humans, abstinence is often voluntary due to negative consequences of opioid seeking. To mimic this human condition, we recently introduced a rat model of incubation of oxycodone craving after electric barrier-induced voluntary abstinence. Incubation of drug craving refers to time-dependent increases in drug seeking after cessation of drug self-administration. Here, we used the activity marker Fos, muscimol-baclofen (GABAa + GABAb receptor agonists) global inactivation, Daun02-selective inactivation of putative relapse-associated neuronal ensembles, and fluorescence-activated cell sorting of Fos-positive cells and quantitative polymerase chain reaction to demonstrate a key role of vSub neuronal ensembles in incubation of oxycodone craving after voluntary abstinence, but not homecage forced abstinence. We also used a longitudinal functional magnetic resonance imaging method and showed that functional connectivity changes in vSub-related circuits predict opioid relapse after abstinence induced by adverse consequences of opioid seeking.

New Approaches for Alcohol Use Disorder Treatment via Memory Retrieval and Reconsolidation Manipulations

Relapse to alcohol seeking and drinking is a major clinical challenge in alcohol use disorder and is frequently brought about by cue-induced craving, caused by exposure to cues that evoke alcohol-related memories. It has been postulated that memories become labile for manipulation shortly after their retrieval and then restabilize in a "memory reconsolidation" process. Disruption or interference with the reconsolidation of drug-associated memories has been suggested as a possible strategy to reduce or even prevent cue-induced craving and relapse. Here, we review literature demonstrating the capacity of behavioral or pharmacological manipulations to reduce relapse in animal models and humans when applied after a short retrieval of memories associated with alcohol, suggestively disrupting the reconsolidation of such memories. We suggest that while there is a clear potential of using post-retrieval manipulations to target specific relapse-evoking memories, future research should be more systematic, standardized, and translational. Specifically, we discuss several critical limitations and boundary conditions, which should be addressed to improve consistency and replicability in the field and lead to the development of an efficient reconsolidation-based relapse prevention therapy.

Ventral pallidum GABA neurons bidirectionally control opioid relapse across rat behavioral models

Opioid addiction is a chronic, relapsing disorder. Whether addicted individuals are forced to abstain or they decide themselves to quit using drugs, relapse rates are high—especially upon encountering contexts and stimuli associated with prior opioid use. Rodents similarly show context- and cue-induced reinstatement of drug seeking following abstinence, and intriguingly, the neural circuits underlying these relapse-like behaviors differ when abstinence is involuntarily imposed, responding is extinguished, or animals decide themselves to cease taking drug. Here, we employ two complementary rat behavioral models of relapse-like behavior for the highly reinforcing opioid drug remifentanil, and asked whether GABAergic neurons in the ventral pallidum (VP^GABA) control opioid seeking under these behavioral conditions. Specifically, we asked how chemogenetically stimulating VP^GABA neurons with clozapine-N-oxide (CNO) influences the ability of contextual or discrete remifentanil-paired cues to reinstate drug seeking following either voluntary abstinence (punishment-induced; Group^Punish), or extinction training (Group^Ext). In Group^Punish rats, we also chemogenetically inhibited VP^GABA neurons, and examined spontaneous VP activity (Fos) during cued reinstatement. In both Group^Punish and Group^Ext rats, stimulating Gq-signaling in VP^GABA neurons augmented remifentanil reinstatement in a cue- and context-dependent manner. Conversely, engaging inhibitory Gi-signaling in VP^GABA neurons in Group^Punish suppressed cue-induced reinstatement, and cue-triggered seeking was correlated with Fos expression in rostral, but not caudal VP. Neither stimulating nor inhibiting VP^GABA neurons influenced unpunished remifentanil self-administration. We conclude that VP^GABA neurons bidirectionally control opioid seeking regardless of the specific relapse model employed, highlighting their fundamental role in opioid relapse-like behavior across behavioral models, and potentially across species.

Role of anterior insula cortex in context-induced relapse of nicotine-seeking

Tobacco use is the leading cause of preventable death worldwide, and relapse during abstinence remains the critical barrier to successful treatment of tobacco addiction. During abstinence, environmental contexts associated with nicotine use can induce craving and contribute to relapse. The insular cortex (IC) is thought to be a critical substrate of nicotine addiction and relapse. However, its specific role in context-induced relapse of nicotine-seeking is not fully known. In this study, we report a novel rodent model of context-induced relapse to nicotine-seeking after punishment-imposed abstinence, which models self-imposed abstinence through increasing negative consequences of excessive drug use. Using the neuronal activity marker Fos we find that the anterior (aIC), but not the middle or posterior IC, shows increased activity during context-induced relapse. Combining Fos with retrograde labeling of aIC inputs, we show projections to aIC from contralateral aIC and basolateral amygdala exhibit increased activity during context-induced relapse. Next, we used fiber photometry in aIC and observed phasic increases in aIC activity around nicotine-seeking responses during self-administration, punishment, and the context-induced relapse tests. Next, we used chemogenetic inhibition in both male and female rats to determine whether activity in aIC is necessary for context-induced relapse. We found that chemogenetic inhibition of aIC decreased context-induced nicotine-seeking after either punishment- or extinction-imposed abstinence. These findings highlight the critical role nicotine-associated contexts play in promoting relapse, and they show that aIC activity is critical for this context-induced relapse following both punishment and extinction-imposed abstinence.

Neurodevelopmental origins of substance use disorders: Evidence from animal models of early-life adversity and addiction

Addiction is a chronic relapsing disorder with devastating personal, societal, and economic consequences. In humans, early-life adversity (ELA) such as trauma, neglect, and resource scarcity are linked with increased risk of later-life addiction, but the brain mechanisms underlying this link are still poorly understood. Here, we focus on data from rodent models of ELA and addiction, in which causal effects of ELA on later-life responses to drugs and the neurodevelopmental mechanisms by which ELA increases vulnerability to addiction can be determined. We first summarize evidence for a link between ELA and addiction in humans, then describe how ELA is commonly modeled in rodents. Since addiction is a heterogeneous disease with many individually varying behavioral aspects that may be impacted by ELA, we next discuss common rodent assays of addiction-like behaviors. We then summarize the specific addiction-relevant behavioral phenotypes caused by ELA in male and female rodents and discuss some of the underlying changes in brain reward and stress circuits that are likely responsible. By better understanding the behavioral and neural mechanisms by which ELA promotes addiction vulnerability, we hope to facilitate development of new approaches for preventing or treating addiction in those with a history of ELA.

Alcohol Seeking Under Risk of Punishment Is Associated With Activation of Cortical and Subcortical Brain Regions

In humans, stimuli associated with alcohol availability can provoke relapse during abstinence. In this study, we investigated the role of discriminative stimuli (DS) in the control of alcohol seeking in two types of behavioral tests. The first test examined the ability of an alcohol-associated DS to promote alcohol seeking (relapse) after punishment-imposed abstinence in the presence of a different DS. Following this, we tested whether the differentially associated DS can promote and suppress alcohol self-administration in a within-session discrimination task. During the within-session discrimination task, we also tested the rate of alcohol self-administration when two DS are presented in a compound. We first trained Long-Evans male rats (n = 24) to self-administer alcohol in the presence of one DS (reward-associated discriminative stimulus, rewDS) and then punished that behavior in the presence of a different DS (punishment-associated discriminative stimulus, punDS). On the test, we found that rats tested with the rewDS showed higher alcohol seeking than rats tested with the punDS. This result shows that a single Cue DS can promote alcohol seeking in a manner comparable to contexts. Subsequently, we trained 16 of these rats in a within-session trial-based discrimination task, comprised of intervening 2-min trials of rewDS, punDS, or conflict with rewDS and punDS in compound and a reduced probability of punishment. We found that alcohol self-administration is bi-directionally regulated by the rewDS and punDS. In conflict trials, alcohol self-administration was at a rate that was intermediate between the rewDS and punDS trials. In a final test, rats were presented with one of the three trial conditions and perfused for Fos immunohistochemistry. We found Fos expression was higher in the rats tested in the conflict condition in three interconnected sub-cortical brain regions. This study demonstrated the important role that alcohol-associated DS plays an important role in promoting relapse to alcohol seeking after punishment-imposed abstinence. We also implemented a within-session discrimination task that allows for the study of alcohol seeking under motivational conflict, which may be relevant for alcohol use despite negative consequences. The results from the Fos data suggest that higher alcohol seeking in approach-avoidance motivational conflict is associated with activation of sub-cortical regions but not cortical regions.

Inactivation of the infralimbic cortex decreases discriminative stimulus-controlled relapse to cocaine seeking in rats

Persistent susceptibility to cue-induced relapse is a cardinal feature of addiction. Discriminative stimuli (DSs) are one type of drug-associated cue that signal drug availability (DS+) or unavailability (DS-) and control drug seeking prior to relapse. We previously established a trial-based procedure in rats to isolate DSs from context, conditioned stimuli, and other drug-associated cues during cocaine self-administration and demonstrated DS-controlled cocaine seeking up to 300 abstinence days. The behavioral and neural mechanisms underlying trial-based DS-control of drug seeking have rarely been investigated. Here we show that following discrimination training in our trial-based procedure, the DS+ and DS- independently control the expression and suppression of cocaine seeking during abstinence. Using microinjections of GABA_A + GABA_B receptor agonists (muscimol + baclofen) in medial prefrontal cortex, we report that infralimbic, but not prelimbic, subregion of medial prefrontal cortex is critical to persistent DS-controlled relapse to cocaine seeking after prolonged abstinence, but not DS-guided discriminated cocaine seeking or DS-controlled cocaine self-admininstration. Finally, using ex vivo whole-cell recordings from pyramidal neurons in the medial prefrontal cortex, we demonstrate that the disruption of DS-controlled cocaine seeking following infralimbic cortex microinjections of muscimol+baclofen is likely a result of suppression of synaptic transmission in the region via a presynaptic mechanism of action.

Ventral pallidum cellular and pathway specificity in drug seeking

The ventral pallidum (VP) is central to the reinforcing effects across a variety of drugs and relapse to drug seeking. Emerging studies from animal models of reinstatement reveal a complex neurobiology of the VP that contributes to different aspects of relapse to drug seeking. This review builds on classical understanding of the VP as part of the final common pathway of relapse but also discusses the properties of the VP as an independent structure. These include VP neural anatomical subregions, cellular heterogeneity, circuitry, neurotransmitters and peptides. Collectively, this review provides a current understanding of the VP from molecular to circuit level architecture that contributes to both the appetitive and aversive symptoms of drug addiction. We show the complex neurobiology of the VP in drug seeking, emphasizing its critical role in addiction, and review strategic approaches that target the VP to reduce relapse rates.

Animal Models of Drug Relapse and Craving after Voluntary Abstinence: A Review

Relapse to drug use during abstinence is a defining feature of addiction. During the last several decades, this clinical scenario has been studied at the preclinical level using classic relapse/reinstatement models in which drug seeking is assessed after experimenter-imposed home-cage forced abstinence or extinction of the drug-reinforced responding in the self-administration chambers. To date, however, results from studies using rat relapse/reinstatement models have yet to result in Food and Drug Administration-approved medications for relapse prevention. The reasons for this state of affairs are complex and multifaceted, but one potential reason is that, in humans, abstinence is often self-imposed or voluntary and occurs either because the negative consequences of drug use outweigh the drug's rewarding effects or because of the availability of nondrug alternative rewards that are chosen over the drug. Based on these considerations, we and others have recently developed rat models of relapse after voluntary abstinence, achieved either by introducing adverse consequences to drug taking (punishment) or seeking (electric barrier) or by providing mutually exclusive choices between the self-administered drug and nondrug rewards (palatable food or social interaction). In this review, we provide an overview of these translationally relevant relapse models and discuss recent neuropharmacological findings from studies using these models. We also discuss sex as a biological variable, future directions, and clinical implications of results from relapse studies using voluntary abstinence models. Our main conclusion is that the neuropharmacological mechanisms controlling relapse to drug seeking after voluntary abstinence are often different from the mechanisms controlling relapse after home-cage forced abstinence or reinstatement after extinction. SIGNIFICANCE STATEMENT: This review describes recently developed rat models of relapse after voluntary abstinence, achieved either by introducing adverse consequences to drug taking or seeking or by providing mutually exclusive choices between the self-administered drug and nondrug rewards. This review discusses recent neuropharmacological findings from studies using these models and discusses future directions and clinical implications.

Circuit selectivity in drug versus natural reward seeking behaviors

Substance use disorder (SUD) is characterized, in part by behavior biased toward drug use and away from natural sources of reward (e.g., social interaction, food, sex). The neurobiological underpinnings of SUDs reveal distinct brain regions where neuronal activity is necessary for the manifestation of SUD-characteristic behaviors. Studies that specifically examine how these regions are involved in behaviors motivated by drug versus natural reward allow determinations of which regions are necessary for regulating seeking of both reward types, and appraisals of novel SUD therapies for off-target effects on behaviors motivated by natural reward. Here, we evaluate studies directly comparing regulatory roles for specific brain regions in drug versus natural reward. While it is clear that many regions drive behaviors motivated by all reward types, based on the literature reviewed we propose a set of interconnected regions that become necessary for behaviors motivated by drug, but not natural rewards. The circuitry is selectively necessary for drug seeking includes an Action/Reward subcircuit, comprising nucleus accumbens, ventral pallidum, and ventral tegmental area, a Prefrontal subcircuit comprising prelimbic, infralimbic, and insular cortices, a Stress subcircuit comprising the central nucleus of the amygdala and the bed nucleus of the stria terminalis, and a Diencephalon circuit including lateral hypothalamus. Evidence was mixed for nucleus accumbens shell, insular cortex, and ventral pallidum. Studies for all other brain nuclei reviewed supported a necessary role in regulating both drug and natural reward seeking. Finally, we discuss emerging strategies to further disambiguate the necessity of brain regions in drug- versus natural reward-associated behaviors.

Targeting the Reconsolidation of Licit Drug Memories to Prevent Relapse: Focus on Alcohol and Nicotine

Alcohol and nicotine are widely abused legal substances worldwide. Relapse to alcohol or tobacco seeking and consumption after abstinence is a major clinical challenge, and is often evoked by cue-induced craving. Therefore, disruption of the memory for the cue–drug association is expected to suppress relapse. Memories have been postulated to become labile shortly after their retrieval, during a “memory reconsolidation” process. Interference with the reconsolidation of drug-associated memories has been suggested as a possible strategy to reduce or even prevent cue-induced craving and relapse. Here, we surveyed the growing body of studies in animal models and in humans assessing the effectiveness of pharmacological or behavioral manipulations in reducing relapse by interfering with the reconsolidation of alcohol and nicotine/tobacco memories. Our review points to the potential of targeting the reconsolidation of these memories as a strategy to suppress relapse to alcohol drinking and tobacco smoking. However, we discuss several critical limitations and boundary conditions, which should be considered to improve the consistency and replicability in the field, and for development of an efficient reconsolidation-based relapse-prevention therapy.

Enhancement of cue-induced reinstatement of alcohol seeking by acute total sleep restriction in male Wistar rats

Clinical studies suggest that sleep impairment is a barrier to successful treatment in alcohol use disorder (AUD) patients, with sleep disruption associated with relapse to alcohol taking. To date, no preclinical study has evaluated the relationship between impaired sleep and alcohol relapse. In the present study, we used a self-administration model to investigate the effects of sleep restriction on reinstatement induced by alcohol-paired environmental cues. Using a sucrose fading protocol, male Wistar rats (N = 8) were trained to self-administer alcohol under a fixed-ratio 2 schedule of alcohol delivery such that completion of every second response resulted in the delivery of the alcohol solution and activation of the alcohol-paired cue light. Once self-administration was stable, behavior was extinguished by omitting delivery of the alcohol solution and the alcohol-paired cues. When responding reached low, stable levels, alcohol seeking was induced by re-presentation of the alcohol-paired cues but with no alcohol solution available for self-administration. To evaluate the effects of sleep restriction on cue-induced alcohol seeking, reinstatement tests were conducted after 6-h of total (slow wave + rapid eye movement [REM]) sleep restriction using the gentle handling method or after 6-h of REM sleep-only restriction using the flower pot method. Relevant control conditions also were evaluated. The results showed that acute restriction of total sleep, but not REM sleep primarily, significantly augmented cue-induced reinstatement of alcohol seeking. This increase was specific to total sleep restriction conditions and cannot be attributed to differences in alcohol intake, responding, or days to extinction. Our findings imply that acute slow wave sleep restriction is necessary and/or sufficient for the enhancement of cue-induced alcohol seeking and, further, suggest that decreased slow wave sleep in AUD patients places individuals at a unique risk for relapse.

BEHAVIORAL AND NEUROBIOLOGICAL MECHANISMS OF PAVLOVIAN AND INSTRUMENTAL EXTINCTION LEARNING

This article reviews the behavioral neuroscience of extinction, the phenomenon in which a behavior that has been acquired through Pavlovian or instrumental (operant) learning decreases in strength when the outcome that reinforced it is removed. Behavioral research indicates that neither Pavlovian nor operant extinction depends substantially on erasure of the original learning but instead depends on new inhibitory learning that is primarily expressed in the context in which it is learned, as exemplified by the renewal effect. Although the nature of the inhibition may differ in Pavlovian and operant extinction, in either case the decline in responding may depend on both generalization decrement and the correction of prediction error. At the neural level, Pavlovian extinction requires a tripartite neural circuit involving the amygdala, prefrontal cortex, and hippocampus. Synaptic plasticity in the amygdala is essential for extinction learning, and prefrontal cortical inhibition of amygdala neurons encoding fear memories is involved in extinction retrieval. Hippocampal-prefrontal circuits mediate fear relapse phenomena, including renewal. Instrumental extinction involves distinct ensembles in corticostriatal, striatopallidal, and striatohypothalamic circuits as well as their thalamic returns for inhibitory (extinction) and excitatory (renewal and other relapse phenomena) control over operant responding. The field has made significant progress in recent decades, although a fully integrated biobehavioral understanding still awaits.

Associative processes in addiction relapse models: A review of their Pavlovian and instrumental mechanisms, history, and terminology

Animal models of relapse to drug-seeking have borrowed heavily from associative learning approaches. In studies of relapse-like behaviour, animals learn to self-administer drugs then receive a period of extinction during which they learn to inhibit the operant response. Several triggers can produce a recovery of responding which form the basis of a variety of models. These include the passage of time (spontaneous recovery), drug availability (rapid reacquisition), extinction of an alternative response (resurgence), context change (renewal), drug priming, stress, and cues (reinstatement). In most cases, the behavioural processes driving extinction and recovery in operant drug self-administration studies are similar to those in the Pavlovian and behavioural literature, such as context effects. However, reinstatement in addiction studies have several differences with Pavlovian reinstatement, which have emerged over several decades, in experimental procedures, associative mechanisms, and terminology. Interestingly, in cue-induced reinstatement, drug-paired cues that are present during acquisition are omitted during lever extinction. The unextinguished drug-paired cue may limit the model’s translational relevance to cue exposure therapy and renders its underlying associative mechanisms ambiguous. We review major behavioural theories that explain recovery phenomena, with a particular focus on cue-induced reinstatement because it is a widely used model in addiction. We argue that cue-induced reinstatement may be explained by a combination of behavioural processes, including reacquisition of conditioned reinforcement and Pavlovian to Instrumental Transfer. While there are important differences between addiction studies and the behavioural literature in terminology and procedures, it is clear that understanding associative learning processes is essential for studying relapse.

Orexin-1 receptor signaling within the lateral hypothalamus, but not bed nucleus of the stria terminalis, mediates context-induced relapse to alcohol seeking

BACKGROUND

The lateral hypothalamic orexin (hypocretin) system has a well-established role in the motivation for reward. This has particular relevance to substance use disorders since orexin-1 receptors play a critical role in alcohol-seeking behavior, acting at multiple nodes in relapse-associated networks.

AIMS

This study aimed to further our understanding of the role of orexin-1 receptor signaling within the lateral hypothalamus and bed nucleus of the stria terminalis, specifically in context-induced relapse to alcohol-seeking following punishment-imposed abstinence.

METHODS

We trained inbred male alcohol-preferring rats to self-administer alcohol in one environment or context (Context A) and subsequently punished their alcohol-reinforced lever presses in a different environment (Context B) using contingent foot shock punishment. Finally, we tested rats for relapse-like behavior in either context following systemic, intra-lateral hypothalamus or intra-bed nucleus of the stria terminalis orexin-1 receptor antagonism with SB-334867.

RESULTS/OUTCOMES

We found that systemic orexin-1 receptor antagonism significantly reduced alcohol-seeking in both contexts. Intra-lateral hypothalamus orexin-1 receptor antagonism significantly reduced alcohol-seeking in Context A whereas intra-bed nucleus of the stria terminalis orexin-1 receptor antagonism had no effect on alcohol-seeking behavior.

CONCLUSIONS/INTERPRETATION

Our results suggest a role for the orexin-1 receptor system in context-induced relapse to alcohol-seeking. Specifically, intra-lateral hypothalamus orexin microcircuits contribute to alcohol-seeking.

Improving translation of animal models of addiction and relapse by reverse translation

Critical features of human addiction are increasingly being incorporated into complementary animal models, including escalation of drug intake, punished drug seeking and taking, intermittent drug access, choice between drug and non-drug rewards, and assessment of individual differences based on criteria in the fourth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV). Combined with new technologies, these models advanced our understanding of brain mechanisms of drug self-administration and relapse, but these mechanistic gains have not led to improvements in addiction treatment. This problem is not unique to addiction neuroscience, but it is an increasing source of disappointment and calls to regroup. Here we first summarize behavioural and neurobiological results from the animal models mentioned above. We then propose a reverse translational approach, whose goal is to develop models that mimic successful treatments: opioid agonist maintenance, contingency management and the community-reinforcement approach. These reverse-translated 'treatments' may provide an ecologically relevant platform from which to discover new circuits, test new medications and improve translation.

Expression of a heroin contextually conditioned immune effect in male rats requires CaMKIIα-expressing neurons in dorsal, but not ventral, subiculum and hippocampal CA1

The physiological and motivational effects of heroin and other abused drugs become associated with environmental (contextual) stimuli during repeated drug use. As a result, these contextual stimuli gain the ability to elicit drug-like conditioned effects. For example, after context-heroin pairings, exposure to the heroin-paired context alone produces similar effects on peripheral immune function as heroin itself. Conditioned immune effects can significantly exacerbate the adverse health consequences of heroin use. Our laboratory has shown that exposure to a heroin-paired context suppresses lipopolysaccharide (LPS)-induced splenic nitric oxide (NO) production in male rats, and this effect is mediated in part by the dorsal hippocampus (dHpc). However, specific dHpc output regions, whose efferents might mediate conditioned immune effects, have not been identified, nor has the contribution of ventral hippocampus (vHpc) been investigated. Here, we evaluated the role of CaMKIIα-expressing neurons in the dHpc and vHpc main output regions by expressing G_i-coupled designer receptors exclusively activated by designer drugs (DREADDs) under a CaMKIIα promoter in the dorsal subiculum and CA1 (dSub, dCA1) or ventral subiculum and CA1 (vSub, vCA1). After context-heroin conditioning, clozapine-N-oxide (CNO, DREADD agonist) or vehicle was administered systemically prior to heroin-paired context (or home-cage control) exposure and LPS immune challenge. Chemogenetic inhibition of CaMKIIα-expressing neurons in dHpc, but not vHpc, output regions attenuated the expression of conditioned splenic NO suppression. These results establish that the main dHpc output regions, the dSub and dCA1, are critical for this context-heroin conditioned immune effect.

Rage Against the Machine: Advancing the study of aggression ethology via machine learning

RATIONALE

Aggression, comorbid with neuropsychiatric disorders, exhibits with diverse clinical presentations and places a significant burden on patients, caregivers, and society. This diversity is observed because aggression is a complex behavior that can be ethologically demarcated as either appetitive (rewarding) or reactive (defensive), each with its own behavioral characteristics, functionality, and neural basis that may transition from adaptive to maladaptive depending on genetic and environmental factors. There has been a recent surge in the development of preclinical animal models for studying appetitive aggression-related behaviors and identifying the neural mechanisms guiding their progression and expression. However, adoption of these procedures is often impeded by the arduous task of manually scoring complex social interactions. Manual observations are generally susceptible to observer drift, long analysis times, and poor inter-rater reliability, and are further incompatible with the sampling frequencies required of modern neuroscience methods.

OBJECTIVES

In this review, we discuss recent advances in the preclinical study of appetitive aggression in mice, paired with our perspective on the potential for machine learning techniques in producing automated, robust scoring of aggressive social behavior. We discuss critical considerations for implementing valid computer classifications within behavioral pharmacological studies.

KEY RESULTS

Open-source automated classification platforms can match or exceed the performance of human observers while removing the confounds of observer drift, bias, and inter-rater reliability. Furthermore, unsupervised approaches can identify previously uncharacterized aggression-related behavioral repertoires in model species.

DISCUSSION AND CONCLUSIONS

Advances in open-source computational approaches hold promise for overcoming current manual annotation caveats while also introducing and generalizing computational neuroethology to the greater behavioral neuroscience community. We propose that currently available open-source approaches are sufficient for overcoming the main limitations preventing wide adoption of machine learning within the context of preclinical aggression behavioral research.

Dissociable mesolimbic dopamine circuits control responding triggered by alcohol-predictive discrete cues and contexts

Context can influence reactions to environmental cues and this elemental process has implications for substance use disorder. Using an animal model, we show that an alcohol-associated context elevates entry into a fluid port triggered by a conditioned stimulus (CS) that predicted alcohol (CS-triggered alcohol-seeking). This effect persists across multiple sessions and, after it diminishes in extinction, the alcohol context retains the capacity to augment reinstatement. Systemically administered eticlopride and chemogenetic inhibition of ventral tegmental area (VTA) dopamine neurons reduce CS-triggered alcohol-seeking. Chemogenetically silencing VTA dopamine terminals in the nucleus accumbens (NAc) core reduces CS-triggered alcohol-seeking, irrespective of context, whereas silencing VTA dopamine terminals in the NAc shell selectively reduces the elevation of CS-triggered alcohol-seeking in an alcohol context. This dissociation reveals new roles for divergent mesolimbic dopamine circuits in the control of responding to a discrete cue for alcohol and in the amplification of this behaviour in an alcohol context.

Effects of response cost magnitude on resurgence of human operant behavior

Extensive research has been dedicated to the study of resurgence following extinction and differential reinforcement of alternative behavior. Less is known about the effects of punishment on resurgence. This study extended previous research by examining whether the magnitude of response cost punishment affects resurgence of human operant behavior. College students engaged in a computer task using the three-phase resurgence procedure where points were used to reinforce target (Phase 1) or alternative (Phase 2) behavior. Across three groups, Phase 2 contingencies for the target response were manipulated. In one group, only extinction was implemented. In the other two groups, response cost was also implemented. Response cost was equal to or double the number of points that could be gained for alternative responding. Resurgence was similar in Phase 3 across the three groups, demonstrating that neither the addition nor the magnitude of punishment differentially affected response recovery under these conditions. Future research should examine other parameters of punishment (e.g., delay, schedule) and how these variables interact with different parameters of alternative reinforcement to increase our understanding of the conditions under which resurgence may be exacerbated or minimized.

Touchscreen-based assessment of risky-choice in mice

Addictions are characterized by choices made to satisfy the addiction despite the risk it could produce an adverse consequence. Here, we developed a murine version of a 'risky decision-making' task (RDT), in which mice could respond on a touchscreen panel to obtain either a large milkshake reward associated with varying probability of footshock, or a smaller amount of the same reward that was never punished. Results showed that (the following font is incorrectly smaller/subscripted) mice shifted choice from the large to small reward stimulus as shock probability increased. Immunohistochemical analysis revealed more Fos-positive cells in prelimbic cortex (PL) and basal amygdala (BA) after RDT testing, and a strong anti-correlation between infralimbic cortex (IL) activity and choice of the large reward stimulus under likely (75-100 % probability) punishment. These findings establish an assay for risky choice in mice and provide preliminary insight into the underlying neural substrates.

Prefrontal Regulation of Punished Ethanol Self-administration

BACKGROUND

A clinical hallmark of alcohol use disorder is persistent drinking despite potential adverse consequences. The ventromedial prefrontal cortex (vmPFC) and dorsomedial prefrontal cortex (dmPFC) are positioned to exert top-down control over subcortical regions, such as the nucleus accumbens shell (NAcS) and basolateral amygdala, which encode positive and negative valence of ethanol (EtOH)-related stimuli. Prior rodent studies have implicated these regions in regulation of punished EtOH self-administration (EtOH-SA).

METHODS

We conducted in vivo electrophysiological recordings in mouse vmPFC and dmPFC to obtain neuronal correlates of footshock-punished EtOH-SA. Ex vivo recordings were performed in NAcS D₁ receptor-expressing medium spiny neurons receiving vmPFC input to examine punishment-related plasticity in this pathway. Optogenetic photosilencing was employed to assess the functional contribution of the vmPFC, dmPFC, vmPFC projections to NAcS, or vmPFC projections to basolateral amygdala, to punished EtOH-SA.

RESULTS

Punishment reduced EtOH lever pressing and elicited aborted presses (lever approach followed by rapid retraction). Neurons in the vmPFC and dmPFC exhibited phasic firing to EtOH lever presses and aborts, but only in the vmPFC was there a population-level shift in coding from lever presses to aborts with punishment. Closed-loop vmPFC, but not dmPFC, photosilencing on a postpunishment probe test negated the reduction in EtOH lever presses but not in aborts. Punishment was associated with altered plasticity at vmPFC inputs to D₁ receptor-expressing medium spiny neurons in the NAcS. Photosilencing vmPFC projections to the NAcS, but not to the basolateral amygdala, partially reversed suppression of EtOH lever presses on probe testing.

CONCLUSIONS

These findings demonstrate a key role for the vmPFC in regulating EtOH-SA after punishment, with implications for understanding the neural basis of compulsive drinking in alcohol use disorder.

Increased relapse to cocaine-seeking in a genetic model for depression

The greatest difficulty in treating cocaine addiction is the enormous rates of relapse, which occur despite immense negative consequences. Relapse risks are even greater in addicts with comorbid depression, perhaps because they use drugs to alleviate depressive symptoms. Only a few preclinical studies have examined this comorbidity, mostly exploring depressive-like effects following drug exposure. We examined rats from two different depression-like models: (a) chronic-mild-stress (CMS), which respond to antidepressant medications and (b) depressed-rat-line (DRL), a genetic model of selective breeding, which is less responsive to antidepressant medications. We tested addictive behaviors in a cocaine self-administration procedure, including the "conflict model," where drug-seeking and relapse encounter adverse consequences: an electrified grid in front of the drug-delivering lever. Following behavioral testing, we explored a potential association between behavioral outcomes and protein expression of brain-derived neurotrophic factor (BDNF). We found that DRL rats self-administer more cocaine compared with both CMS and controls, while CMS and control groups did not differ significantly. Notably, DRL but not CMS rats, displayed higher rates of relapse than controls, and expressed higher levels of BDNF in the prelimbic cortex (PLC). Potential translation of these results suggest that medication-resistant depressed patients tend to consume more drugs and are more susceptible to relapse. The increase in PLC BDNF levels is consistent with previous rat models of depression, and concomitantly, with its suggested role in promoting cocaine-seeking.

Effect of the dopamine stabilizer (-)-OSU6162 on potentiated incubation of opioid craving after electric barrier-induced voluntary abstinence

In the classical incubation of drug craving rat model, drug seeking is assessed after homecage forced abstinence. However, human abstinence is often voluntary because negative consequences of drug seeking outweigh the desire for the drug. Here, we developed a rat model of incubation of opioid craving after electric barrier-induced voluntary abstinence and determined whether the dopamine stabilizer (-)-OSU6162 would decrease this new form of incubation. We trained male and female rats to self-administer oxycodone (0.1 mg/kg/infusion, 6 h/day) for 14 days. We then exposed them to either homecage forced abstinence or voluntary abstinence induced by an electric barrier of increasing intensity near the drug-paired lever. On abstinence days 1, 15, or 30, we tested the rats for oxycodone seeking without shock and drug. We also examined the effect of (-)-OSU6162 (7.5 and 15 mg/kg) on oxycodone seeking on abstinence day 1 or after 15 days of either voluntary or forced abstinence. Independent of sex, the time-dependent increase in oxycodone seeking after cessation of opioid self-administration (incubation of opioid craving) was stronger after voluntary abstinence than after forced abstinence. In males, (-)-OSU6162 decreased incubated (day 15) but not non-incubated (day 1) oxycodone seeking after either voluntary or forced abstinence. In females, (-)-OSU6162 modestly decreased incubated oxycodone seeking after voluntary but not forced abstinence. Results suggest that voluntary abstinence induced by negative consequences of drug seeking can paradoxically potentiate opioid craving and relapse. We propose the dopamine stabilizer (-)-OSU6162 may serve as an adjunct pharmacological treatment to prevent relapse in male opioid users.

Considering Drug-Associated Contexts in Substance Use Disorders and Treatment Development

Environmental contexts that are reliably associated with the use of pharmacologically active substances are hypothesized to contribute to substance use disorders. In this review, we provide an updated summary of parallel preclinical and human studies that support this hypothesis. Research conducted in rats shows that environmental contexts that are reliably paired with drug use can renew extinguished drug-seeking behavior and amplify responding elicited by discrete, drug-predictive cues. Akin to drug-associated contexts, interoceptive drug stimuli produced by the psychopharmacological effects of drugs can also influence learning and memory processes that play a role in substance use disorders. Findings from human laboratory studies show that drug-associated contexts, including social stimuli, can have profound effects on cue reactivity, drug use, and drug-related cognitive expectancies. This translationally relevant research supports the idea that treatments for substance use disorders could be improved by considering drug-associated contexts as a factor in treatment interventions. We conclude this review with ideas for how to integrate drug-associated contexts into treatment-oriented research based on 4 approaches: pharmacology, brain stimulation, mindfulness-based relapse prevention, and cognitive behavioral group therapy. Throughout, we focus on alcohol- and tobacco-related research, which are two of the most prevalent and commonly misused drugs worldwide for which there are known treatments.

Nonhuman animal models of substance use disorders: Translational value and utility to basic science

BACKGROUND

The National Institute on Drug Abuse (NIDA) recently released a Request for Information (RFI) soliciting comments on nonhuman animal models of substance use disorders (SUD).

METHODS

A literature review was performed to address the four topics outlined in the RFI and one topic inspired by the RFI: (1) animal models that best recapitulate SUD, (2) animal models that best balance the trade-offs between resources and ecological validity, (3) animal models whose translational value are frequently misrepresented or overrepresented by the scientific community, (4) aspects of SUD that are not currently being modeled in animals, and (5) animal models that are optimal for examining the basic mechanisms by which drugs produce their abuse-related effects.

RESULTS

Models that employ response-contingent drug administration, use complex schedules of reinforcement, measure behaviors that mimic the distinguishing features of SUD, and use animals that are phylogenetically similar to humans have the greatest translational value. Models that produce stable and reproducible baselines of behavior, lessen the number of uncontrolled variables, and minimize the influence of extraneous factors are best at examining basic mechanisms contributing to drug reward and reinforcement.

CONCLUSIONS

Nonhuman animal models of SUD have undergone significant refinements to increase their utility for basic science and translational value for SUD. The existing literature describes numerous examples of how these models may best be utilized to answer mechanistic questions of drug reward and identify potential therapeutic interventions for SUD. Progress in the field could be accelerated by further collaborations between researchers using animals versus humans.

Ventral pallidum is essential for cocaine relapse after voluntary abstinence in rats

Addiction is a chronic relapsing disorder, and during recovery many people experience several relapse events as they attempt to voluntarily abstain from drug. New preclinical relapse models have emerged that capture this common human experience, and mounting evidence indicates that resumption of drug seeking after voluntary abstinence recruits neural circuits distinct from those recruited during reinstatement after experimenter-imposed abstinence, or abstinence due to extinction training. Ventral pallidum (VP), a key limbic node involved in drug seeking, has well-established roles in conventional reinstatement models tested following extinction training, but it is unclear whether this region also participates in more translationally relevant models of relapse. Here we show that chemogenetic inhibition of VP neurons decreased cocaine-, context-, and cue-induced relapse tested after voluntary, punishment-induced abstinence. This effect was strongest in the most compulsive, punishment-resistant rats, and reinstatement was associated with neural activity in anatomically defined VP subregions. VP inhibition also attenuated the propensity of rats to display "abortive lever pressing," a species-typical risk assessment behavior seen here during punished drug taking, likely resulting from concurrent approach and avoidance motivations. These results indicate that VP, unlike other connected limbic brain regions, is essential for resumption of drug seeking after voluntary abstinence. Since VP inhibition effects were strongest in the most compulsively cocaine-seeking individuals, this may also indicate that VP plays a particularly important role in the most pathological, addiction-like behavior, making it an attractive target for future therapeutic interventions.

Context-Dependent and Context-Independent Effects of D1 Receptor Antagonism in the Basolateral and Central Amygdala during Cocaine Self-Administration

One way that drugs of abuse perturb the dopamine system is by triggering large amounts of extracellular dopamine to efflux into limbic regions. The basolateral (BLA) and central (CeA) nuclei of the amygdala have been shown to play distinct roles in value representation of primary and conditioned reward. However, the precise role of dopaminergic receptors in the BLA and the CeA during reward-related behaviors remains to be determined. Here we investigate the effects of dopamine D1 receptor blockade in the BLA and the CeA during asymptotic performance of cocaine self-administration and in a novel application of contextual renewal under continued access conditions. After more than three weeks of chained seek-take self-administration of cocaine, male Long Evans rats were given a bilateral intra-BLA or intra-CeA infusion of the D1 antagonist SCH-23390 (2 µg/0.3 µl) for multiple days. Intra-BLA D1 receptor blockade before, but not after the self-administration session, gradually suppressed drug seeking and taking responses and persisted with a change in context with continued D1 blockade. In contrast, intra-CeA D1 receptor blockade caused a rapid reduction in self-administration that showed renewal with a change in context with continued D1 blockade. Further, conditioned place aversion developed with intra-BLA but not intra-CeA infusions. Collectively, these results demonstrate that dopamine D1 receptors in the BLA and CeA both contribute to drug seeking and taking, but may do so through distinct mechanisms.

Animal Models of (or for) Aggression Reward, Addiction, and Relapse: Behavior and Circuits

Inappropriate and pathological aggression plays a leading role in the suffering and death of millions of people, and further places an untenable strain on the caregivers and families of those afflicted. In some cases, such as addictive drugs, aggression can be highly rewarding (appetitive) and continually pursued despite short- and long-term negative consequences. Similarly, recidivism (relapse) rates for repeat violent offenders are as high as relapse rates for drug addicts. Appetitive aggression and relapse to aggression seeking can be modeled in mice studies using conditioned place preference and self-administration procedures followed by a period of abstinence and subsequent tests for relapse to aggression preference and aggression seeking. These procedures allow for the study of the mechanisms that control the appetitive versus the consummatory (attack) phases of aggressive behavior. In this review, we first discuss the behavioral procedures developed to probe appetitive aggression in mouse models, spanning from Pavlovian to operant tasks, and we also describe the recently proposed phenomenon of "aggression addiction." Next, we discuss the pharmacological and circuit mechanisms of aggression conditioned place preference and aggression self-administration, seeking, and relapse, highlighting mechanistic congruence and divergence between appetitive and consummatory phases of aggression. We conclude by discussing clinical implications of the studies reviewed.

Relapse to opioid seeking in rat models: behavior, pharmacology and circuits

Lifetime relapse rates remain a major obstacle in addressing the current opioid crisis. Relapse to opioid use can be modeled in rodent studies where drug self-administration is followed by a period of abstinence and a subsequent test for drug seeking. Abstinence can be achieved through extinction training, forced abstinence, or voluntary abstinence. Voluntary abstinence can be accomplished by introducing adverse consequences of continued drug self-administration (e.g., punishment or electric barrier) or by introducing an alternative nondrug reward in a discrete choice procedure (drug versus palatable food or social interaction). In this review, we first discuss pharmacological and circuit mechanisms of opioid seeking, as assessed in the classical extinction-reinstatement model, where reinstatement is induced by reexposure to the self-administered drug (drug priming), discrete cues, discriminative cues, drug-associated contexts, different forms of stress, or withdrawal states. Next, we discuss pharmacological and circuit mechanisms of relapse after forced or voluntary abstinence, including the phenomenon of "incubation of heroin craving" (the time-dependent increases in heroin seeking during abstinence). We conclude by discussing future directions of preclinical relapse-related studies using opioid drugs.

Extinction of instrumental (operant) learning: interference, varieties of context, and mechanisms of contextual control

This article reviews recent research on the extinction of instrumental (or operant) conditioning from the perspective that it is an example of a general retroactive interference process. Previous discussions of interference have focused primarily on findings from Pavlovian conditioning. The present review shows that extinction in instrumental learning has much in common with other examples of retroactive interference in instrumental learning (e.g., omission learning, punishment, second-outcome learning, discrimination reversal learning, and differential reinforcement of alternative behavior). In each, the original learning can be largely retained after conflicting information is learned, and behavior is cued or controlled by the current context. The review also suggests that a variety of stimuli can play the role of context, including room and apparatus cues, temporal cues, drug state, deprivation state, stress state, and recent reinforcers, discrete cues, or behaviors. In instrumental learning situations, the context can control behavior through its direct association with the reinforcer or punisher, through its hierarchical relation with response-outcome associations, or its direct association (inhibitory or excitatory) with the response. In simple instrumental extinction and habit learning, the latter mechanism may play an especially important role.

Common neurocircuitry mediating drug and fear relapse in preclinical models

BACKGROUND

Comorbidity of anxiety disorders, stressor- and trauma-related disorders, and substance use disorders is extremely common. Moreover, therapies that reduce pathological fear and anxiety on the one hand, and drug-seeking on the other, often prove short-lived and are susceptible to relapse. Considerable advances have been made in the study of the neurobiology of both aversive and appetitive extinction, and this work reveals shared neural circuits that contribute to both the suppression and relapse of conditioned responses associated with trauma or drug use.

OBJECTIVES

The goal of this review is to identify common neural circuits and mechanisms underlying relapse across domains of addiction biology and aversive learning in preclinical animal models. We focus primarily on neural circuits engaged during the expression of relapse.

KEY FINDINGS

After extinction, brain circuits involving the medial prefrontal cortex and hippocampus come to regulate the expression of conditioned responses by the amygdala, bed nucleus of the stria terminalis, and nucleus accumbens. During relapse, hippocampal projections to the prefrontal cortex inhibit the retrieval of extinction memories resulting in a loss of inhibitory control over fear- and drug-associated conditional responding.

CONCLUSIONS

The overlapping brain systems for both fear and drug memories may explain the co-occurrence of fear and drug-seeking behaviors.

Operant Costs Modulate Dopamine Release to Self-Administered Cocaine

The costs associated with obtaining illicit drugs can fluctuate depending upon the relative drug availability. As a consequence of the changing costs, the effort that one must exert to obtain drugs is dynamic. Considerable evidence illustrates a critical role for dopamine in the ventral medial striatum in mediating drug reinforcement. However, little is known regarding how dopamine release is affected by changes in the costs associated with earning drugs. We used fast-scan cyclic voltammetry to determine how changes in the operant requirement affected dopamine release to self-administered cocaine in male rats. Dopamine release to cocaine infusions increased across trials during self-administration sessions using a fixed-ratio reinforcement schedule with a low operant requirement. However, increasing the operant requirement abolished the within-session elevation in dopamine release to drug rewards. This effect was not due to underlying changes in preinfusion dopamine levels and was not explained by cocaine levels in the brain. This within-session increase in dopamine release to cocaine infusions reemerged when the operant requirement was lowered. Under a progressive ratio reinforcement schedule, there was no increase in dopamine release to drug rewards across trials, which contrasts with prior studies demonstrating an increase in dopamine release to food rewards. Collectively, these findings illustrate that the influence of operant costs on reward-evoked dopamine release depends upon type of reward that can be earned (e.g., food or drug).SIGNIFICANCE STATEMENT The mesolimbic dopamine system is involved with mediating drug reinforcement. Although the costs associated with earning drugs are dynamic, no studies to date have examined how dopamine release to drug rewards is affected by changing costs. By performing fast-scan cyclic voltammetry recordings in rats self-administering cocaine, the present work demonstrates that changing the operant costs reversibly modulates the dopamine response to cocaine rewards. Furthermore, these findings highlight that the influence of costs on dopamine release to drug rewards differs from the established effect of costs on dopamine release to food rewards.

Anterior Insular Cortex is Critical for the Propensity to Relapse Following Punishment-Imposed Abstinence of Alcohol Seeking

Humans with alcohol use disorder typically abstain because of the negative consequences associated with excessive drinking, and exposure to contexts previously associated with alcohol use can trigger relapse. We used a rat model that captures a characteristic of this human condition: namely voluntary abstinence from alcohol use because of contingent punishment. There is substantial variability in the propensity to relapse following extended periods of abstinence, and this is a critical feature preventing the successful treatment of alcohol use disorder. Here we examined relapse following acute or prolonged abstinence. In male alcohol preferring P rats, we found an increased propensity to relapse in Context B, the punishment context after prolonged abstinence. Next, we found that neither alcohol intake history nor the motivational strength of alcohol predicted the propensity to relapse. We next examined the putative circuitry of context-induced relapse to alcohol seeking following prolonged abstinence using Fos as a marker of neuronal activation. The anterior insular cortex (AI) was the only brain region examined where Fos expression correlated with alcohol seeking behavior in Context B after prolonged abstinence. Finally, we used local infusion of GABA_A and GABA_B receptor agonists (muscimol + baclofen) to show a causal role of the AI in context-induced relapse in Context B, the punishment context after prolonged abstinence. Our results show that there is substantial individual variability in the propensity to relapse in the punishment-associated context after prolonged abstinence, and this is mediated by activity in the AI.SIGNIFICANCE STATEMENT A key feature of alcohol use disorder is that sufferers show an enduring propensity to relapse throughout their lifetime. Relapse typically occurs despite the knowledge of adverse consequences including health complications or relationship breakdowns. Here we use a recently developed rodent model that recapitulates this behavior. After an extended period of abstinence, relapse propensity is markedly increased in the "adverse consequence" environment, akin to humans with alcohol use disorder relapsing in the face of adversity. From a circuitry perspective, we demonstrate a causal role of the anterior insular cortex in relapse to alcohol seeking after extended abstinence following punishment imposed voluntary cessation of alcohol use.