Optogenetic evidence that pallidal projections, not nigral projections, from the nucleus accumbens core are necessary for reinstating cocaine seeking

Treadmill exercise training inhibits morphine CPP by reversing morphine effects on GABA neurotransmission in D2-MSNs of the accumbens-pallidal pathway in male mice

Relapse is a major challenge in the treatment of drug addiction, and exercise has been shown to decrease relapse to drug seeking in animal models. However, the neural circuitry mechanisms by which exercise inhibits morphine relapse remain unclear. In this study, we report that 4-week treadmill training prevented morphine conditioned place preference (CPP) expression during abstinence by acting through the nucleus accumbens (NAc)-ventral pallidum (VP) pathway. We found that neuronal excitability was reduced in D2-dopamine receptor-expressing medium spiny neurons (D2-MSNs) following repeated exposure to morphine and forced abstinence. Enhancing the excitability of NAc D2-MSNs via treadmill training decreased the expression of morphine CPP. We also found that the effects of treadmill training were mediated by decreasing enkephalin levels and that restoring opioid modulation of GABA neurotransmission in the VP, which increased neurotransmitter release from NAc D2-MSNs to VP, decreased morphine CPP. Our findings suggest the inhibitory effect of exercise on morphine CPP is mediated by reversing morphine-induced neuroadaptations in the NAc-to-VP pathway.

Differential rearing alters Fos in the accumbens core and ventral palidum following reinstatement of cocaine seeking in male Sprague-Dawley rats

Rearing rats in environmental enrichment produces a protective effect when exposed to stimulants, as enriched rats display attenuated cocaine seeking during reinstatement. However, less is known about what changes in the brain are responsible for this protective effect. The current study investigated differences in Fos protein expression following reinstatement of cocaine seeking in differentially reared rats. Rats were reared in either enriched (EC) or impoverished (IC) conditions for 30 days, after which rats self-administered cocaine in 2-h sessions. Following self-administration, rats underwent extinction and cue-induced or cocaine-primed reinstatement of cocaine seeking, brains were extracted, and Fos immunohistochemistry was performed. IC rats sought cocaine significantly more than EC rats during cue-induced reinstatement, and cocaine seeking was positively correlated with Fos expression in the nucleus accumbens core and ventral pallidum. IC rats displayed greater Fos expression than EC rats in the accumbens and ventral pallidum, suggesting a role of these areas in the enrichment-induced protective effect.

A large-scale c-Fos brain mapping study on extinction of cocaine-primed reinstatement

Individuals with cocaine addiction can experience many craving episodes and subsequent relapses, which represents the main obstacle to recovery. Craving is often favored when abstinent individuals ingest a small dose of cocaine, encounter cues associated with drug use or are exposed to stressors. Using a cocaine-primed reinstatement model in rat, we recently showed that cocaine-conditioned interoceptive cues can be extinguished with repeated cocaine priming in the absence of drug reinforcement, a phenomenon we called extinction of cocaine priming. Here, we applied a large-scale c-Fos brain mapping approach following extinction of cocaine priming in male rats to identify brain regions implicated in processing the conditioned interoceptive stimuli of cocaine priming. We found that cocaine-primed reinstatement is associated with increased c-Fos expression in key brain regions (e.g., dorsal and ventral striatum, several prefrontal areas and insular cortex), while its extinction mostly disengages them. Moreover, while reinstatement behavior was correlated with insular and accumbal activation, extinction of cocaine priming implicated parts of the ventral pallidum, the mediodorsal thalamus and the median raphe. These brain patterns of activation and inhibition suggest that after repeated priming, interoceptive signals lose their conditioned discriminative properties and that action-outcome associations systems are mobilized in search for new contingencies, a brain state that may predispose to rapid relapse.

Ventral pallidum GABA and glutamate neurons drive approach and avoidance through distinct modulation of VTA cell types

The ventral pallidum (VP) contains GABA and glutamate neurons projecting to ventral tegmental area (VTA) whose stimulation drives approach and avoidance, respectively. Yet little is known about the mechanisms by which VP cell types shape VTA activity and drive behavior. Here, we found that both VP GABA and glutamate neurons were activated during approach to reward or by delivery of an aversive stimulus. Stimulation of VP GABA neurons inhibited VTA GABA, but activated dopamine and glutamate neurons. Remarkably, stimulation-evoked activation was behavior-contingent such that VTA recruitment was inhibited when evoked by the subject's own action. Conversely, VP glutamate neurons activated VTA GABA, as well as dopamine and glutamate neurons, despite driving aversion. However, VP glutamate neurons evoked dopamine in aversion-associated ventromedial nucleus accumbens (NAc), but reduced dopamine release in reward-associated dorsomedial NAc. These findings show how heterogeneous VP projections to VTA can be engaged to shape approach and avoidance behaviors.

Nucleus accumbens core dopamine D2 receptors are required for performance of the odor span task in male rats

RATIONALE

The nucleus accumbens (NAc) core gates motivationally relevant behavioral action sequences through afferents from cortical and subcortical brain regions. While the role of the NAc core in reward and effort-based decision making is well established, its role in working memory (WM) processes is incompletely understood. The odor span task (OST) has been proposed as a measure of non-spatial working memory capacity (WMC) as it requires rodents to select a novel odor from an increasing number of familiar odors to obtain a food reward.

OBJECTIVE

To assess the role of the NAc core in the OST using (1) reversible chemical inactivation and (2) selective blockade of dopamine D1 and D2 receptors in the area.

METHODS

Well-trained male rats were tested on the OST following intra-NAc core infusions of muscimol/baclofen, the D1 receptor antagonist SCH-23390 (1 μg/hemisphere) and the D2 receptor antagonist eticlopride (1 μg/hemisphere). Behavioral measurements included the average odor span, maximum odor span, choice latency, searching vigor, and patterns of responding during foraging that may relate to impulsivity.

RESULTS

Chemical inactivation of the NAc core significantly decreased odor span relative to sham and vehicle conditions. Selective antagonism of D2, but not D1, receptors in the NAc core also produced deficits in odor span. We found that secondary behavioral measures of choice latency, searching vigor, and responding to the first odor stimulus encountered were largely unaffected by treatment.

CONCLUSIONS

These findings suggest that D2 receptors in the NAc core are required for OST performance.

Recruitment of inhibitory neuronal pathways regulating dopaminergic activity for the control of cocaine seeking

Drug seeking is associated with the ventral tegmental area (VTA) dopaminergic (DA) activity. Previously, we have shown that brief optogenetic inhibition of VTA DA neurons with 1 s pulses delivered every 9 s attenuates cocaine seeking under extinction conditions in rats without producing overt signs of dysphoria or locomotor sedation. Whether recruitment of neuronal pathways inhibiting VTA neuronal activity would suppress drug seeking remains unknown. Here, we asked if optogenetic stimulation of the lateral habenula (LHb) efferents in the rostromedial tegmental nucleus (RMTg) as well as RMTg efferents in VTA would reduce drug seeking. To investigate this, we measured how recruitment of elements of this inhibitory pathway affects cocaine seeking in male rats under extinction conditions. The effectiveness of brief optogenetic manipulations was confirmed electrophysiologically at the level of electrical activity of VTA DA neurons. Real-time conditioned place aversion (RT-CPA) and open field tests were performed to control for potential dysphoric/sedating effects of brief optogenetic stimulation of LHb-RMTg-VTA circuitry. Optogenetic stimulation of either RMTg or LHb inhibited VTA DAergic neuron firing, whereas similar stimulation of RMTg efferents in VTA or LHb efferents in RMTg reduced cocaine seeking under extinction conditions. Moreover, stimulation of LHb-RMTg efferents produced an effect that was maintained 24 h later, during cocaine seeking test without stimulation. This effect was specific, as brief optogenetic stimulation did not affect locomotor activity and was not aversive. Our results indicate that defined inhibitory pathways can be recruited to inhibit cocaine seeking, providing potential new targets for non-pharmacological treatment of drug craving.

Extrapyramidal Side Effects with Chronic Atypical Antipsychotic Can Be Predicted by Labeling Pattern of FosB and phosphoThr34-DARPP-32 in Nucleus Accumbens

Extrapyramidal side effects (EPS) can be induced by neuroleptics that regulate the expression of transcription factor FosB and dopaminergic mediator DARPP-32 in the striatum. However, the long-term neurobiological changes in striatal projection neurons resulting from a cumulative dosage of typical and atypical antipsychotics are poorly understood. The present study aimed to determine the differential and long-lasting changes in FosB distribution and DARPP-32 phosphorylation in the striatum and nucleus accumbens (NAc) associated with chronic antipsychotic-induced EPS. Male C57Bl/6J mice received daily injections of Olanzapine (Olz, 15 mg/kg), Clozapine (Clz, 20 mg/kg), or Haloperidol (Hal, 1 mg/kg), for a period of 11 weeks with a 4-day withdrawal period before the last dosage. Catalepsy for detection of EPS, along with open-field and rotarod tests, were assessed as behavioral correlates of motor responses. Additionally, FosB and phosphorylated-DARPP-32 immunohistochemistry were examined in striatal regions after treatment. All antipsychotics produced catalepsy and reduced open-field exploration, such as impaired rota-rod performance after Olz and Hal. The washout period was critical for Clz-induced side effects reduction. Both Olz and Clz increased FosB in NAc Shell-region, and phosphoThr34-DARPP-32 in NAc. Only Clz reduced phosphoThr75-DARPP-32 in the dorsal striatum and showed FosB/phosphoThr34-Darpp-32-ir in the NAc Core region. This study provides evidence that atypical antipsychotics such as Olz and Clz also give rise to EPS effects frequently associated with a cumulative dosage of typical neuroleptics such as Hal. Nevertheless, FosB/phosphoThr34-Darpp-32-ir in the NAc Core region is associated with hypokinetic movements inhibition.

Ventral pallidum GABA and glutamate neurons drive approach and avoidance through distinct modulation of VTA cell types

The ventral pallidum (VP) contains GABA and glutamate (Glut) neurons projecting to ventral tegmental area (VTA) whose stimulation drives approach and avoidance, respectively. Yet little is known about the cell-type-specific mechanisms by which VP projections to VTA drive behavior. Here, we found that both VP GABA and Glut neurons were activated during approach to reward or delivery of an aversive stimulus. Stimulation of VP GABA neurons inhibited VTA GABA, but activated dopamine (DA) and glutamate neurons. Remarkably, this cell-type-specific recruitment was behavior-contingent such that VTA recruitment was inhibited when evoked by the subject's own action. Conversely, VP Glut neurons activated VTA GABA, as well as DA and Glut neurons, despite driving aversion. However, VP Glut neurons evoked DA in reward-associated ventromedial nucleus accumbens (NAc), but reduced DA in aversion-associated dorsomedial NAc. These findings show how heterogeneous VP cell types can engage VTA cell types to shape approach and avoidance behaviors.

Epigenetic function during heroin self-administration controls future relapse-associated behavior in a cell type-specific manner

Opioid use produces enduring associations between drug reinforcement/euphoria and discreet or diffuse cues in the drug-taking environment. These powerful associations can trigger relapse in individuals recovering from opioid use disorder (OUD). Here, we sought to determine whether the epigenetic enzyme, histone deacetylase 5 (HDAC5), regulates relapse-associated behavior in an animal model of OUD. We examined the effects of nucleus accumbens (NAc) HDAC5 on both heroin- and sucrose-seeking behaviors using operant self-administration paradigms. We utilized cre-dependent viral-mediated approaches to investigate the cell-type-specific effects of HDAC5 on heroin-seeking behavior, gene expression, and medium spiny neuron (MSN) cell and synaptic physiology. We found that NAc HDAC5 functions during the acquisition phase of heroin self-administration to limit future relapse-associated behavior. Moreover, overexpressing HDAC5 in the NAc suppressed context-associated and reinstated heroin-seeking behaviors, but it did not alter sucrose seeking. We also found that HDAC5 functions within dopamine D1 receptor-expressing MSNs to suppress cue-induced heroin seeking, and within dopamine D2 receptor-expressing MSNs to suppress drug-primed heroin seeking. Assessing cell-type-specific transcriptomics, we found that HDAC5 reduced expression of multiple ion transport genes in both D1- and D2-MSNs. Consistent with this observation, HDAC5 also produced firing rate depression in both MSN classes. These findings revealed roles for HDAC5 during active heroin use in both D1- and D2-MSNs to limit distinct triggers of drug-seeking behavior. Together, our results suggest that HDAC5 might limit relapse vulnerability through regulation of ion channel gene expression and suppression of MSN firing rates during active heroin use.

Ventral pallidal regulation of motivated behaviors and reinforcement

The interconnected nuclei of the ventral basal ganglia have long been identified as key regulators of motivated behavior, and dysfunction of this circuit is strongly implicated in mood and substance use disorders. The ventral pallidum (VP) is a central node of the ventral basal ganglia, and recent studies have revealed complex VP cellular heterogeneity and cell- and circuit-specific regulation of reward, aversion, motivation, and drug-seeking behaviors. Although the VP is canonically considered a relay and output structure for this circuit, emerging data indicate that the VP is a central hub in an extensive network for reward processing and the regulation of motivation that extends beyond classically defined basal ganglia borders. VP neurons respond temporally faster and show more advanced reward coding and prediction error processing than neurons in the upstream nucleus accumbens, and regulate the activity of the ventral mesencephalon dopamine system. This review will summarize recent findings in the literature and provide an update on the complex cellular heterogeneity and cell- and circuit-specific regulation of motivated behaviors and reinforcement by the VP with a specific focus on mood and substance use disorders. In addition, we will discuss mechanisms by which stress and drug exposure alter the functioning of the VP and produce susceptibility to neuropsychiatric disorders. Lastly, we will outline unanswered questions and identify future directions for studies necessary to further clarify the central role of VP neurons in the regulation of motivated behaviors. Significance: Research in the last decade has revealed a complex cell- and circuit-specific role for the VP in reward processing and the regulation of motivated behaviors. Novel insights obtained using cell- and circuit-specific interrogation strategies have led to a major shift in our understanding of this region. Here, we provide a comprehensive review of the VP in which we integrate novel findings with the existing literature and highlight the emerging role of the VP as a linchpin of the neural systems that regulate motivation, reward, and aversion. In addition, we discuss the dysfunction of the VP in animal models of neuropsychiatric disorders.

Comparative Transcriptional Analyses in the Nucleus Accumbens Identifies RGS2 as a Key Mediator of Depression-Related Behavior

BACKGROUND

Major depressive disorder is one of the most commonly diagnosed mental illnesses worldwide, with a higher prevalence in women than in men. Although currently available pharmacological therapeutics help many individuals, they are not effective for most. Animal models have been important for the discovery of molecular alterations in stress and depression, but difficulties in adapting animal models of depression for females has impeded progress in developing novel therapeutic treatments that may be more efficacious for women.

METHODS

Using the California mouse social defeat model, we took a multidisciplinary approach to identify stress-sensitive molecular targets that have translational relevance for women. We determined the impact of stress on transcriptional profiles in male and female California mouse nucleus accumbens (NAc) and compared these results with data from postmortem samples of the NAc from men and women diagnosed with major depressive disorder.

RESULTS

Our cross-species computational analyses identified Rgs2 (regulator of G protein signaling 2) as a transcript downregulated by social defeat stress in female California mice and in women with major depressive disorder. RGS2 plays a key role in signal regulation of neuropeptide and neurotransmitter receptors. Viral vector-mediated overexpression of Rgs2 in the NAc restored social approach and sucrose preference in stressed female California mice.

CONCLUSIONS

These studies show that Rgs2 acting in the NAc has functional properties that translate to changes in anxiety- and depression-related behavior. Future studies should investigate whether targeting Rgs2 represents a novel target for treatment-resistant depression in women.

Ventral pallidum GABA neurons bidirectionally control opioid relapse across rat behavioral models

Opioid addiction is a chronic, relapsing disorder. Whether addicted individuals are forced to abstain or they decide themselves to quit using drugs, relapse rates are high-especially upon encountering contexts and stimuli associated with prior opioid use. Rodents similarly show context- and cue-induced reinstatement of drug seeking following abstinence, and intriguingly, the neural circuits underlying these relapse-like behaviors differ when abstinence is involuntarily imposed, responding is extinguished, or animals decide themselves to cease taking drug. Here, we employ two complementary rat behavioral models of relapse-like behavior for the highly reinforcing opioid drug remifentanil, and asked whether GABAergic neurons in the ventral pallidum (VPGABA) control opioid seeking under these behavioral conditions. Specifically, we asked how chemogenetically stimulating VPGABA neurons with clozapine-N-oxide (CNO) influences the ability of contextual or discrete remifentanil-paired cues to reinstate drug seeking following either voluntary abstinence (punishment-induced; GroupPunish), or extinction training (GroupExt). In GroupPunish rats, we also chemogenetically inhibited VPGABA neurons, and examined spontaneous VP activity (Fos) during cued reinstatement. In both GroupPunish and GroupExt rats, stimulating Gq-signaling in VPGABA neurons augmented remifentanil reinstatement in a cue- and context-dependent manner. Conversely, engaging inhibitory Gi-signaling in VPGABA neurons in GroupPunish suppressed cue-induced reinstatement, and cue-triggered seeking was correlated with Fos expression in rostral, but not caudal VP. Neither stimulating nor inhibiting VPGABA neurons influenced unpunished remifentanil self-administration. We conclude that VPGABA neurons bidirectionally control opioid seeking regardless of the specific relapse model employed, highlighting their fundamental role in opioid relapse-like behavior across behavioral models, and potentially across species.

Activation of mesocorticolimbic dopamine projections initiates cue-induced reinstatement of reward seeking in mice

Drug addiction is characterized by relapse when addicts are re-exposed to drug-associated environmental cues, but the neural mechanisms underlying cue-induced relapse are unclear. In the present study we investigated the role of a specific dopaminergic (DA) pathway from ventral tegmental area (VTA) to nucleus accumbens core (NAcore) in mouse cue-induced relapse. Optical intracranial self-stimulation (oICSS) was established in DAT-Cre transgenic mice. We showed that optogenetic excitation of DA neurons in the VTA or their projection terminals in NAcore, NAshell or infralimbic prefrontal cortex (PFC-IL) was rewarding. Furthermore, activation of the VTA-NAcore pathway alone was sufficient and necessary to induce reinstatement of oICSS. In cocaine self-administration model, cocaine-associated cues activated VTA DA neurons as assessed by intracellular GCaMP signals. Cue-induced reinstatement of cocaine-seeking was triggered by optogenetic stimulation of the VTA-NAcore pathway, and inhibited by chemogenetic inhibition of this pathway. Together, these results demonstrate that cue-induced reinstatement of reward seeking is in part mediated by activation of the VTA-NAcore DA pathway.

Astrocytes in the ventral pallidum extinguish heroin seeking through GAT-3 upregulation and morphological plasticity at D1-MSN terminals

GABAergic projections from the nucleus accumbens core to the dorsolateral ventral pallidum are necessary for drug-conditioned cues to initiate relapse-like drug seeking. Astrocytes in the ventral pallidum are situated perisynaptically and regulate GABA transmission through expression of GABA uptake transporters, but whether they are involved in regulating drug seeking is unknown. To determine the contribution of ventral pallidal astrocytes to heroin seeking, we labeled astrocytes in male and female rats with a membrane-bound fluorescent tag and used confocal microscopy to quantify astroglial expression of the GABA transporter GAT-3 and astrocyte synaptic proximity after withdrawal from heroin self-administration and during 15 min of cued heroin seeking. We found that GAT-3 was upregulated in rats that had extinguished heroin seeking, but not in animals that were withdrawn from heroin without extinction training or in rats that extinguished sucrose seeking. When GAT-3 upregulation was reversed using a vivo-morpholino oligo, heroin seeking was restored in the extinguished context and extinction of cued heroin seeking was disrupted compared to control animals. Although astrocyte synaptic proximity was not altered overall after heroin withdrawal, examination of astrocyte proximity to accumbens D1- or D2-expressing afferents revealed a selective increase in astrocyte proximity with D1-expressing terminals during extinction of heroin self-administration. Experimentally-induced reduction of astrocyte synaptic proximity through knockdown of the astrocyte-selective actin-binding protein ezrin also markedly disrupted extinction of heroin seeking. Notably, GAT-3 or ezrin knockdown had no impact on context- or cue-induced seeking in sucrose-trained animals. These data show that astrocytes in the ventral pallidum undergo plasticity after extinction of heroin use that reduces seeking and highlight the importance of astrocyte-neuron interactions in shaping behaviors associated with opioid use disorder.

The role of the nucleus accumbens and ventral pallidum in feeding and obesity

Obesity is a growing global epidemic that stems from the increasing availability of highly-palatable foods and the consequent enhanced calorie consumption. Extensive research has shown that brain regions that are central to reward seeking modulate feeding and evidence linking obesity to pathology in such regions have recently started to accumulate. In this review we focus on the contribution of two major interconnected structures central to reward processing, the nucleus accumbens and the ventral pallidum, to obesity. We first review the known literature linking these structures to feeding behavior, then discuss recent advances connecting pathology in the nucleus accumbens and ventral pallidum to obesity, and finally examine the similarities and differences between drug addiction and obesity in the context of these two structures. The understanding of how pathology in brain regions involved in reward seeking and consumption may drive obesity and how mechanistically similar obesity and addiction are, is only now starting to be revealed. We hope that future research will advance knowledge in the field and open new avenues to studying and treating obesity.

Ventral pallidum cellular and pathway specificity in drug seeking

The ventral pallidum (VP) is central to the reinforcing effects across a variety of drugs and relapse to drug seeking. Emerging studies from animal models of reinstatement reveal a complex neurobiology of the VP that contributes to different aspects of relapse to drug seeking. This review builds on classical understanding of the VP as part of the final common pathway of relapse but also discusses the properties of the VP as an independent structure. These include VP neural anatomical subregions, cellular heterogeneity, circuitry, neurotransmitters and peptides. Collectively, this review provides a current understanding of the VP from molecular to circuit level architecture that contributes to both the appetitive and aversive symptoms of drug addiction. We show the complex neurobiology of the VP in drug seeking, emphasizing its critical role in addiction, and review strategic approaches that target the VP to reduce relapse rates.

Neurochemical mechanisms and neurocircuitry underlying the contribution of stress to cocaine seeking

In individuals with substance use disorders, stress is a critical determinant of relapse susceptibility. In some cases, stressors directly trigger cocaine use. In others, stressors interact with other stimuli to promote drug seeking, thereby setting the stage for relapse. Here, we review the mechanisms and neurocircuitry that mediate stress-triggered and stress-potentiated cocaine seeking. Stressors trigger cocaine seeking by activating noradrenergic projections originating in the lateral tegmentum that innervate the bed nucleus of the stria terminalis to produce beta adrenergic receptor-dependent regulation of neurons that release corticotropin releasing factor (CRF) into the ventral tegmental area (VTA). CRF promotes the activation of VTA dopamine neurons that innervate the prelimbic prefrontal cortex resulting in D1 receptor-dependent excitation of a pathway to the nucleus accumbens core that mediates cocaine seeking. The stage-setting effects of stress require glucocorticoids, which exert rapid non-canonical effects at several sites within the mesocorticolimbic system. In the nucleus accumbens, corticosterone attenuates dopamine clearance via the organic cation transporter 3 to promote dopamine signaling. In the prelimbic cortex, corticosterone mobilizes the endocannabinoid, 2-arachidonoylglycerol (2-AG), which produces CB1 receptor-dependent reductions in inhibitory transmission, thereby increasing excitability of neurons which comprise output pathways responsible for cocaine seeking. Factors that influence the role of stress in cocaine seeking, including prior history of drug use, biological sex, chronic stress/co-morbid stress-related disorders, adolescence, social variables, and genetics are discussed. Better understanding when and how stress contributes to drug seeking should guide the development of more effective interventions, particularly for those whose drug use is stress related.

Memories are not written in stone: Re-writing fear memories by means of non-invasive brain stimulation and optogenetic manipulations

The acquisition of fear associative memory requires brain processes of coordinated neural activity within the amygdala, prefrontal cortex (PFC), hippocampus, thalamus and brainstem. After fear consolidation, a suppression of fear memory in the absence of danger is crucial to permit adaptive coping behavior. Acquisition and maintenance of fear extinction critically depend on amygdala-PFC projections. The robust correspondence between the brain networks encompassed cortical and subcortical hubs involved into fear processing in humans and in other species underscores the potential utility of comparing the modulation of brain circuitry in humans and animals, as a crucial step to inform the comprehension of fear mechanisms and the development of treatments for fear-related disorders. The present review is aimed at providing a comprehensive description of the literature on recent clinical and experimental researches regarding the noninvasive brain stimulation and optogenetics. These innovative manipulations applied over specific hubs of fear matrix during fear acquisition, consolidation, reconsolidation and extinction allow an accurate characterization of specific brain circuits and their peculiar interaction within the specific fear processing.

BEHAVIORAL AND NEUROBIOLOGICAL MECHANISMS OF PAVLOVIAN AND INSTRUMENTAL EXTINCTION LEARNING

This article reviews the behavioral neuroscience of extinction, the phenomenon in which a behavior that has been acquired through Pavlovian or instrumental (operant) learning decreases in strength when the outcome that reinforced it is removed. Behavioral research indicates that neither Pavlovian nor operant extinction depends substantially on erasure of the original learning but instead depends on new inhibitory learning that is primarily expressed in the context in which it is learned, as exemplified by the renewal effect. Although the nature of the inhibition may differ in Pavlovian and operant extinction, in either case the decline in responding may depend on both generalization decrement and the correction of prediction error. At the neural level, Pavlovian extinction requires a tripartite neural circuit involving the amygdala, prefrontal cortex, and hippocampus. Synaptic plasticity in the amygdala is essential for extinction learning, and prefrontal cortical inhibition of amygdala neurons encoding fear memories is involved in extinction retrieval. Hippocampal-prefrontal circuits mediate fear relapse phenomena, including renewal. Instrumental extinction involves distinct ensembles in corticostriatal, striatopallidal, and striatohypothalamic circuits as well as their thalamic returns for inhibitory (extinction) and excitatory (renewal and other relapse phenomena) control over operant responding. The field has made significant progress in recent decades, although a fully integrated biobehavioral understanding still awaits.

Neural Substrates and Circuits of Drug Addiction

Drug addiction is a chronic relapsing disorder, and a significant amount of research has been devoted to understand the factors that contribute to the development, loss of control, and persistence of compulsive addictive behaviors. In this review, we provide an overview of various theories of addiction to drugs of abuse and the neurobiology involved in elements of the addiction cycle. Specific focus is devoted to the role of the mesolimbic pathway in acute drug reinforcement and occasional drug use, the role of the mesocortical pathway and associated areas (e.g., the dorsal striatum) in escalation/dependence, and the contribution of these pathways and associated circuits to conditioned responses, drug craving, and loss of behavioral control that may underlie drug relapse. By enhancing the understanding of the neurobiological factors that mediate drug addiction, continued preclinical and clinical research will aid in the development of novel therapeutic interventions that can serve as effective long-term treatment strategies for drug-dependent individuals.

Opposing Regulation of Cocaine Seeking by Glutamate and GABA Neurons in the Ventral Pallidum

Projections from the nucleus accumbens to the ventral pallidum (VP) regulate relapse in animal models of addiction. The VP contains GABAergic (VP_GABA) and glutamatergic (VP_Glu) neurons, and a subpopulation of GABAergic neurons co-express enkephalin (VP_Penk). Rabies tracing reveals that VP_Glu and VP_Penk neurons receive preferential innervation from upstream D1- relative to D2-expressing accumbens neurons. Chemogenetic stimulation of VP_Glu neurons inhibits, whereas stimulation of VP_GABA and VP_Penk neurons potentiates cocaine seeking in mice withdrawn from intravenous cocaine self-administration. Calcium imaging reveals cell type-specific activity patterns when animals learn to suppress drug seeking during extinction training versus engaging in cue-induced cocaine seeking. During cued seeking, VP_GABA neurons increase their overall activity, and VP_Penk neurons are selectively activated around nose pokes for cocaine. In contrast, VP_Glu neurons increase their spike rate following extinction training. These data show that VP subpopulations differentially encode and regulate cocaine seeking, with VP_Penk and VP_GABA neurons facilitating and VP_Glu neurons inhibiting cocaine seeking.

Heinsbroek et al. show that glutamate and GABA neurons in ventral pallidum differentially regulate cued cocaine seeking. Calcium activity in glutamate neurons increases when mice refrain from cocaine seeking. Activating glutamate neurons inhibits cocaine seeking. Calcium activity increases in GABA neurons during cocaine seeking, and activating GABA or enkephalin neurons induces cocaine seeking.

Hyperfunction of the stress response system and novelty-induced hyperactivity correlate with enhanced cocaine-induced conditioned place preference in NCAM-deficient mice

Several studies in humans and rodents suggest an association between impulsivity and activity of the stress response on the one hand and addiction vulnerability on the other. The neural cell adhesion molecule (NCAM) has been related to several neuropsychiatric disorders in humans. Constitutively NCAM-deficient (-/-) mice display enhanced novelty-induced behavior and hyperfunction of the hypothalamic-pituitary-adrenal axis. Here we hypothesize that NCAM deficiency causes an altered response to cocaine. Cocaine-induced behaviors of NCAM-/- mice and wild-type (+/+) littermates were analyzed in the conditioned place preference (CPP) test. c-fos mRNA levels were investigated by quantitative polymerase chain reaction (qPCR) to measure neural activation after exposure to the cocaine-associated context. NCAM-/- mice showed an elevated cocaine-induced sensitization, enhanced CPP, impaired extinction, and potentiated cocaine-induced hyperlocomotion and CPP after extinction. NCAM-/- showed no potentiated CPP as compared with NCAM+/+ littermates when a natural rewarding stimulus (ie, an unfamiliar female) was used, suggesting that the behavioral alterations of NCAM-/- mice observed in the CPP test are specific to the effects of cocaine. Activation of the prefrontal cortex and nucleus accumbens induced by the cocaine-associated context was enhanced in NCAM-/- compared with NCAM+/+ mice. Finally, cocaine-induced behavior correlated positively with novelty-induced behavior and plasma corticosterone levels in NCAM-/- mice and negatively with NCAM mRNA levels in the hippocampus and nucleus accumbens in wild-type mice. Our findings indicate that NCAM deficiency affects cocaine-induced CPP in mice and support the view that hyperfunction of the stress response system and reactivity to novelty predict the behavioral responses to cocaine.

'Liking' and 'wanting' in eating and food reward: Brain mechanisms and clinical implications

It is becoming clearer how neurobiological mechanisms generate 'liking' and 'wanting' components of food reward. Mesocorticolimbic mechanisms that enhance 'liking' include brain hedonic hotspots, which are specialized subregions that are uniquely able to causally amplify the hedonic impact of palatable tastes. Hedonic hotspots are found in nucleus accumbens medial shell, ventral pallidum, orbitofrontal cortex, insula cortex, and brainstem. In turn, a much larger mesocorticolimbic circuitry generates 'wanting' or incentive motivation to obtain and consume food rewards. Hedonic and motivational circuitry interact together and with hypothalamic homeostatic circuitry, allowing relevant physiological hunger and satiety states to modulate 'liking' and 'wanting' for food rewards. In some conditions such as drug addiction, 'wanting' is known to dramatically detach from 'liking' for the same reward, and this may also occur in over-eating disorders. Via incentive sensitization, 'wanting' selectively becomes higher, especially when triggered by reward cues when encountered in vulnerable states of stress, etc. Emerging evidence suggests that some cases of obesity and binge eating disorders may reflect an incentive-sensitization brain signature of cue hyper-reactivity, causing excessive 'wanting' to eat. Future findings on the neurobiological bases of 'liking' and 'wanting' can continue to improve understanding of both normal food reward and causes of clinical eating disorders.

Effects of brief inhibition of the ventral tegmental area dopamine neurons on the cocaine seeking during abstinence

Preclinical studies strongly suggest that cocaine seeking depends on the neuronal activity of the ventral tegmental area (VTA) and phasic dopaminergic (DA) signaling. Notably, VTA pharmacological inactivation or dopamine receptor blockade in the forebrain may induce behavioral inhibition in general and acute aversive states in particular, thus reducing cocaine seeking indirectly. Such artifacts hinder successful translation of these findings in clinical studies and practice. Here, we aimed to evaluate if dynamic VTA manipulations effectively reduce cocaine seeking. We used male tyrosine hydroxylase (TH) IRES-Cre⁺ rats along with optogenetic tools to inhibit directly and briefly VTA DA neurons during conditioned stimulus (CS)-induced cocaine seeking under extinction conditions. The behavioral effects of optogenetic inhibition were also assessed in the real-time dynamic place aversion, conditioned place aversion, and CS-induced food-seeking tests. We found that brief and nondysphoric/nonsedative pulses of VTA photo-inhibition (1 s every 9 s, ie, for 10% of time) attenuated CS-induced cocaine seeking under extinction conditions in rats expressing archaerhodopsin selectively on the TH⁺ neurons. Furthermore, direct inhibition of the VTA DA activity reduced CS-induced cocaine seeking 24 hours after photo-modulation. Importantly, such effect appears to be selective for cocaine seeking as similar inhibition of the VTA DA activity had no effect on CS-induced food seeking. Thus, briefly inhibiting VTA DA activity during CS-induced cocaine seeking drastically and selectively reduces seeking without behavioral artifacts such as sedation or dysphoria. Our results point to the therapeutic possibilities of coupling nonpharmacologic treatments with extinction training in reducing cocaine addiction.

Off-Peak 594-nm Light Surpasses On-Peak 532-nm Light in Silencing Distant ArchT-Expressing Neurons In Vivo

For large brain volume manipulations using optogenetics, both effective opsin excitation and efficient light delivery with minimal light absorption are required to minimize the illuminating light intensity and concomitant off-target effects. ArchT, a widely used potent inhibitory opsin, is commonly activated by 532-nm light, which lies on its in vitro excitation peak. However, 532-nm light also lies on a peak range of the hemoglobin absorption spectrum. Therefore, we predicted that 594-nm light is superior in suppressing distant ArchT-expressing neurons, which is slightly off the ArchT-excitation-plateau and largely off the peak of the hemoglobin absorption spectrum. We quantitatively tested this prediction by the electrophysiological recording of the rat cortex in vivo. At illumination distances greater than 500 μm, 594-nm light was more effective than 532-nm light. Its superiority increased with distance. These results validate our prediction and highlight the significance of excitation-absorption trade-off in selecting illumination wavelength for optogenetics in vivo.

•

Wavelength-dependency of optogenetic neuronal control was directly measured in vivo

•

Off-peak light silence 1-mm-distant ArchT-neuron twice more than on-peak light in vivo

•

Superiority of off-peak light at distance arose from its less absorption of light

•

Simulation of light propagation supported unexpectedly large effect of hemoglobin

The ventral pallidum and relapse in alcohol seeking

Alcohol-use disorders are chronically relapsing conditions characterized by cycles of use, abstinence and relapse. The ventral pallidum (VP) is a key node in the neural circuits controlling relapse to alcohol seeking and a key target of pharmacotherapies for relapse prevention. There has been a significant increase in our understanding of the molecular, anatomical, pharmacological and functional properties of the ventral pallidum, laying foundations for a new understanding of its role in relapse to alcohol seeking and motivation. Here we review these advances, placing special emphasis on how advances in understanding in the cellular and circuit architectures of ventral pallidum contributes to the relapse to alcohol seeking. We show how this knowledge improves mechanistic understanding of current relapse prevention pharmacotherapies, how it may be used to tailor these against different forms of relapse and how it may help provide insights into the mental health problems frequently co-morbid with alcohol-use disorders.

Cocaine abuse and midbrain circuits: Functional anatomy of hypocretin/orexin transmission and therapeutic prospect

Cocaine abuse remains a pervasive public health problem, and treatments thus far have proven ineffective for long-term abstinence maintenance. Intensive research on the neurobiology underlying drug abuse has led to the consideration of many candidate transmitter systems to target for intervention. Among these, the hypocretin/orexin (hcrt/ox) neuropeptide system holds largely untapped yet clinically viable therapeutic potential. Hcrt/ox originates from the hypothalamus and projects widely across the mammalian central nervous system to produce neuroexcitatory actions via two excitatory G-protein coupled receptor subtypes. Functionally, hcrt/ox promotes arousal/wakefulness and facilitates energy homeostasis. In the early 2000s, hcrt/ox transmission was shown to underlie mating behavior in male rats suggesting a novel role in reward-seeking. Soon thereafter, hcrt/ox neurons were shown to respond to drug-associated stimuli, and hcrt/ox transmission was found to facilitate motivated responding for intravenous cocaine. Notably, blocking hcrt/ox transmission using systemic or site-directed pharmacological antagonists markedly reduced motivated drug-taking as well as drug-seeking in tests of relapse. This review will unfold the current state of knowledge implicating hcrt/ox receptor transmission in the context of cocaine abuse and provide detailed background on animal models and underlying midbrain circuits. Specifically, attention will be paid to the mesoaccumbens, tegmental, habenular, pallidal and preoptic circuits. The review will conclude with discussion of recent preclinical studies assessing utility of suvorexant - the first and only FDA-approved hcrt/ox receptor antagonist - against cocaine-associated behaviors.

Cocaine Dysregulates Dynorphin Modulation of Inhibitory Neurotransmission in the Ventral Pallidum in a Cell-Type-Specific Manner

Cocaine-driven changes in the modulation of neurotransmission by neuromodulators are poorly understood. The ventral pallidum (VP) is a key structure in the reward system, in which GABA neurotransmission is regulated by opioid neuropeptides, including dynorphin. However, it is not known whether dynorphin acts differently on different cell types in the VP and whether its effects are altered by withdrawal from cocaine. Here, we trained wild-type, D1-Cre, A2A-Cre, or vGluT2-Cre:Ai9 male and female mice in a cocaine conditioned place preference protocol followed by 2 weeks of abstinence, and then recorded GABAergic synaptic input evoked either electrically or optogenetically onto identified VP neurons before and after applying dynorphin. We found that after cocaine CPP and abstinence dynorphin attenuated inhibitory input to VPGABA neurons through a postsynaptic mechanism. This effect was absent in saline mice. Furthermore, this effect was seen specifically on the inputs from nucleus accumbens medium spiny neurons expressing either the D1 or the D2 dopamine receptor. Unlike its effect on VPGABA neurons, dynorphin surprisingly potentiated the inhibitory input on VPvGluT2 neurons, but this effect was abolished after cocaine CPP and abstinence. Thus, dynorphin has contrasting influences on GABA input to VPGABA and VPvGluT2 neurons and these influences are affected differentially by cocaine CPP and abstinence. Collectively, our data suggest a role for dynorphin in withdrawal through its actions in the VP. As VPGABA and VPvGluT2 neurons have contrasting effects on drug-seeking behavior, our data may indicate a complex role for dynorphin in withdrawal from cocaine.SIGNIFICANCE STATEMENT The ventral pallidum consists mainly of GABAergic reward-promoting neurons, but it also encloses a subgroup of aversion-promoting glutamatergic neurons. Dynorphin, an opioid neuropeptide abundant in the ventral pallidum, shows differential modulation of GABA input to GABAergic and glutamatergic pallidal neurons and may therefore affect both the rewarding and aversive aspects of withdrawal. Indeed, abstinence after repeated exposure to cocaine alters dynorphin actions in a cell-type-specific manner; after abstinence dynorphin suppresses the inhibitory drive on the "rewarding" GABAergic neurons but ceases to modulate the inhibitory drive on the "aversive" glutamatergic neurons. This reflects a complex role for dynorphin in cocaine reward and abstinence.

Amperometric measurements of cocaine cue and novel context-evoked glutamate and nitric oxide release in the nucleus accumbens core

Cue-induced reinstatement of cocaine seeking after self-administration (SA) and extinction relies on glutamate release in the nucleus accumbens core (NAcore), which activates neuronal nitric oxide synthase interneurons. Nitric oxide (NO) is required for structural plasticity in NAcore medium spiny neurons, as well as cued cocaine seeking. However, NO release in the NAcore during reinstatement has yet to be directly measured. Furthermore, the temporal relationship between glutamate release and the induction of an NO response also remains unknown. Using wireless amperometric recordings in awake behaving rats, we quantified the magnitude and temporal dynamics of novel context- and cue-induced reinstatement-evoked glutamate and NO release in the NAcore. We found that re-exposure to cocaine-conditioned stimuli following SA and extinction increased extracellular glutamate, leading to release of NO in the NAcore. In contrast, exposing drug-naïve rats to a novel context led to a lower magnitude rise in glutamate in the NAcore relative to cue-induced reinstatement. Interestingly, novel context exposure evoked a higher magnitude NO response relative to cue-induced reinstatement. Despite differences in magnitude, novel context evoked-NO release in the NAcore was also temporally delayed when compared to glutamate. These results demonstrate a dissociation between the magnitude of cocaine cue- and novel context-evoked glutamate and NO release in the NAcore, yet similarity in the temporal dynamics of their release. Together, these data contribute to a greater understanding of the relationship between glutamate and NO, two neurotransmitters implicated in encoding the valence of distinct contextual stimuli.

Complementary Roles for Ventral Pallidum Cell Types and Their Projections in Relapse

The ventral pallidum (VP) is a key node in the neural circuits controlling relapse to drug seeking. How this role relates to different VP cell types and their projections is poorly understood. Using male rats, we show how different forms of relapse to alcohol-seeking are assembled from VP cell types and their projections to lateral hypothalamus (LH) and ventral tegmental area (VTA). Using RNAScope in situ hybridization to characterize activity of different VP cell types during relapse to alcohol-seeking provoked by renewal (context-induced reinstatement), we found that VP Gad1 and parvalbumin (PV), but not vGlut2, neurons show relapse-associated changes in c-Fos expression. Next, we used retrograde tracing, chemogenetic, and electrophysiological approaches to study the roles of VPGad1 and VPPV neurons in relapse. We show that VPGad1 neurons contribute to contextual control over relapse (renewal), but not to relapse during reacquisition, via projections to LH, where they converge with ventral striatal inputs onto LHGad1 neurons. This convergence of striatopallidal inputs at the level of individual LHGad1 neurons may be critical to balancing propensity for relapse versus abstinence. In contrast, VPPV neurons contribute to relapse during both renewal and reacquisition via projections to VTA. These findings identify a double dissociation in the roles for different VP cell types and their projections in relapse. VPGad1 neurons control relapse during renewal via projections to LH. VPPV neurons control relapse during both renewal and reacquisition via projections to VTA. Targeting these different pathways may provide tailored interventions for different forms of relapse.SIGNIFICANCE STATEMENT Relapse to drug or reward seeking after a period of extinction or abstinence remains a key impediment to successful treatment. The ventral pallidum, located in the ventral basal ganglia, has long been recognized as an obligatory node in a 'final common pathway' for relapse. Yet how this role relates to the considerable VP cellular and circuit heterogeneity is not well understood. We studied the cellular and circuit architecture for VP in relapse control. We show that different forms of relapse have complementary VP cellular and circuit architectures, raising the possibility that targeting these different neural architectures may provide tailored interventions for different forms of relapse.

Ventral pallidum is essential for cocaine relapse after voluntary abstinence in rats

Addiction is a chronic relapsing disorder, and during recovery many people experience several relapse events as they attempt to voluntarily abstain from drug. New preclinical relapse models have emerged that capture this common human experience, and mounting evidence indicates that resumption of drug seeking after voluntary abstinence recruits neural circuits distinct from those recruited during reinstatement after experimenter-imposed abstinence, or abstinence due to extinction training. Ventral pallidum (VP), a key limbic node involved in drug seeking, has well-established roles in conventional reinstatement models tested following extinction training, but it is unclear whether this region also participates in more translationally relevant models of relapse. Here we show that chemogenetic inhibition of VP neurons decreased cocaine-, context-, and cue-induced relapse tested after voluntary, punishment-induced abstinence. This effect was strongest in the most compulsive, punishment-resistant rats, and reinstatement was associated with neural activity in anatomically defined VP subregions. VP inhibition also attenuated the propensity of rats to display "abortive lever pressing," a species-typical risk assessment behavior seen here during punished drug taking, likely resulting from concurrent approach and avoidance motivations. These results indicate that VP, unlike other connected limbic brain regions, is essential for resumption of drug seeking after voluntary abstinence. Since VP inhibition effects were strongest in the most compulsively cocaine-seeking individuals, this may also indicate that VP plays a particularly important role in the most pathological, addiction-like behavior, making it an attractive target for future therapeutic interventions.

Chemogenetic inhibition of direct pathway striatal neurons normalizes pathological, cue-induced reinstatement of drug-seeking in rats

Addiction to drugs such as cocaine is marked by cycles of compulsive drug-taking and drug-seeking behavior. Although the transition to addiction is thought to recruit neural processes in dorsal striatum, little is known regarding the role of dorsal striatal projections to the substantia nigra (i.e. the direct pathway) in regulating these behaviors. Combining a Cre-recombinase-dependent chemogenetic approach with a cocaine self-administration paradigm that produces both low-risk and high-risk addiction phenotypes, we examined the effect of transiently decreasing direct pathway activity in the dorsomedial striatum on drug-taking and drug-seeking under conditions of normal and pathological drug use. Surprisingly, transient inhibition of direct pathway striatal neurons had no effect on several measures of addictive behavior during ongoing drug use, including loss of control over drug intake, high motivation to obtain drug and drug use despite negative consequences (i.e. drug use paired with foot shock). However, chemogenetic inhibition of these neurons during reinstatement reduced cue-induced drug-seeking, but only in the high-risk addiction phenotype group. Cue-induced reinstatement was relatively normal in the low-risk addiction phenotype group, as well as following reinstatement to cues associated with sucrose pellet consumption. These results demonstrate that dorsomedial direct pathway striatal neurons play a very specific role in addictive behaviors, which is to regulate the pathological drug-seeking that accompanies relapse.

Ventral Pallidum Is the Primary Target for Accumbens D1 Projections Driving Cocaine Seeking

Outputs from the nucleus accumbens (NAc) include projections to the ventral pallidum and the ventral tegmental area and subtantia nigra in the ventral mesencephalon. The medium spiny neurons (MSN) that give rise to these pathways are GABAergic and consist of two populations of equal number that are segregated by differentially expressed proteins, including D1- and D2-dopamine receptors. Afferents to the ventral pallidum arise from both D1- and D2-MSNs, whereas the ventral mesencephalon is selectively innervated by D1-MSN. To determine the extent of collateralization of D1-MSN to these axon terminal fields we used retrograde labeling in transgenic mice expressing tdTomato selectively in D1-MSN, and found that a large majority of D1-MSN in either the shell or core subcompartments of the accumbens collateralized to both output structures. Approximately 70% of D1-MSNs projecting to the ventral pallidum collateralized to the ventral mesencephalon, whereas >90% of mesencephalic D1-MSN afferents collateralized to the ventral pallidum. In contrast, <10% of dorsal striatal D1-MSNs collateralized to both the globus pallidus and ventral mesencephalon. D1-MSN activation is required for conditioned cues to induce cocaine seeking. To determine which D1-MSN projection mediates cued cocaine seeking, we selectively transfected D1-MSNs in transgenic rats with an inhibitory Gi-coupled DREADD. Activation of the transfected Gi-DREADD with clozapine-N-oxide administered into the ventral pallidum, but not into the ventral mesencephalon, blocked cue-induced cocaine seeking. These data show that, although accumbens D1-MSNs largely collateralize to both the ventral pallidum and ventral mesencephalon, only D1-MSN innervation of the ventral pallidum is necessary for cue-induced cocaine seeking.SIGNIFICANCE STATEMENT Activity in D1 dopamine receptor-expressing neurons in the NAc is required for rodents to respond to cocaine-conditioned cues and relapse to drug seeking behaviors. The D1-expressing neurons project to both the ventral pallidum and ventral mesencephalon, and we found that a majority of the neurons that innervate the ventral pallidum also collateralize to the ventral mesencephalon. However, despite innervating both structures, only D1 innervation of the ventral pallidum mediates cue-induced cocaine seeking.

Postmeal Optogenetic Inhibition of Dorsal or Ventral Hippocampal Pyramidal Neurons Increases Future Intake

Memory of a recently eaten meal can serve as a powerful mechanism for controlling future eating behavior because it provides a record of intake that likely outlasts most physiological signals generated by the meal. In support, impairing the encoding of a meal in humans increases the amount ingested at the next eating episode. However, the brain regions that mediate the inhibitory effects of memory on future intake are unknown. In the present study, we tested the hypothesis that dorsal hippocampal (dHC) and ventral hippocampal (vHC) glutamatergic pyramidal neurons play a critical role in the inhibition of energy intake during the postprandial period by optogenetically inhibiting these neurons at specific times relative to a meal. Male Sprague Dawley rats were given viral vectors containing CaMKIIα-eArchT3.0-eYFP or CaMKIIα-GFP and fiber optic probes into dHC of one hemisphere and vHC of the other. Compared to intake on a day in which illumination was not given, inhibition of dHC or vHC glutamatergic neurons after the end of a chow, sucrose, or saccharin meal accelerated the onset of the next meal and increased the amount consumed during that next meal when the neurons were no longer inhibited. Inhibition given during a meal did not affect the amount consumed during that meal or the next one but did hasten meal initiation. These data show that dHC and vHC glutamatergic neuronal activity during the postprandial period is critical for limiting subsequent ingestion and suggest that these neurons inhibit future intake by consolidating the memory of the preceding meal.

Common neurocircuitry mediating drug and fear relapse in preclinical models

BACKGROUND

Comorbidity of anxiety disorders, stressor- and trauma-related disorders, and substance use disorders is extremely common. Moreover, therapies that reduce pathological fear and anxiety on the one hand, and drug-seeking on the other, often prove short-lived and are susceptible to relapse. Considerable advances have been made in the study of the neurobiology of both aversive and appetitive extinction, and this work reveals shared neural circuits that contribute to both the suppression and relapse of conditioned responses associated with trauma or drug use.

OBJECTIVES

The goal of this review is to identify common neural circuits and mechanisms underlying relapse across domains of addiction biology and aversive learning in preclinical animal models. We focus primarily on neural circuits engaged during the expression of relapse.

KEY FINDINGS

After extinction, brain circuits involving the medial prefrontal cortex and hippocampus come to regulate the expression of conditioned responses by the amygdala, bed nucleus of the stria terminalis, and nucleus accumbens. During relapse, hippocampal projections to the prefrontal cortex inhibit the retrieval of extinction memories resulting in a loss of inhibitory control over fear- and drug-associated conditional responding.

CONCLUSIONS

The overlapping brain systems for both fear and drug memories may explain the co-occurrence of fear and drug-seeking behaviors.

Modeling cocaine relapse in rodents: Behavioral considerations and circuit mechanisms

Addiction is a chronic relapsing disorder, in that most addicted individuals who choose to quit taking drugs fail to maintain abstinence in the long-term. Relapse is especially likely when recovering addicts encounter risk factors like small "priming" doses of drug, stress, or drug-associated cues and locations. In rodents, these same factors reinstate cocaine seeking after a period of abstinence, and extensive preclinical work has used priming, stress, or cue reinstatement models to uncover brain circuits underlying cocaine reinstatement. Here, we review common rat models of cocaine relapse, and discuss how specific features of each model influence the neural circuits recruited during reinstated drug seeking. To illustrate this point, we highlight the surprisingly specific roles played by ventral pallidum subcircuits in cocaine seeking reinstated by either cocaine-associated cues, or cocaine itself. One goal of such studies is to identify, and eventually to reverse the specific circuit activity that underlies the inability of some humans to control their drug use. Based on preclinical findings, we posit that circuit activity in humans also differs based on the triggers that precipitate craving and relapse, and that associated neural responses could help predict the triggers most likely to elicit relapse in a given person. If so, examining circuit activity could facilitate diagnosis of subgroups of addicted people, allowing individualized treatment based on the most problematic risk factors.

Prefrontal-accumbens opioid plasticity: Implications for relapse and dependence

In addiction, an individual's ability to inhibit drug seeking and drug taking is thought to reflect a pathological strengthening of drug-seeking behaviors or impairments in the capacity to control maladaptive behavior. These processes are not mutually exclusive and reflect drug-induced modifications within prefrontal cortical and nucleus accumbens circuits, however unlike psychostimulants such as cocaine, far less is known about the temporal, anatomical, and cellular dynamics of these changes. We discuss what is known regarding opioid-induced adaptations in intrinsic membrane physiology and pre-/postsynaptic neurotransmission in principle pyramidal and medium spiny neurons in the medial prefrontal cortex and nucleus accumbens from electrophysiological studies and explore how circuit specific adaptations may contribute to unique facets of opioid addiction.

Neuronal mechanisms mediating pathological reward-related behaviors: A focus on silent synapses in the nucleus accumbens

The compulsive drive to seek drugs despite negative consequences relies heavily on drug-induced alterations that occur within the reward neurocircuit. These alterations include changes in neuromodulator and neurotransmitter systems that ultimately lock behaviors into an inflexible and permanent state. To provide clinicians with improved treatment options, researchers are trying to identify, as potential targets of therapeutic intervention, the neural mechanisms mediating an "addictive-like state". Here, we discuss how drug-induced generation of silent synapses in the nucleus accumbens may be a potential therapeutic target capable of reversing drug-related behaviors.

Nicotine aversion is mediated by GABAergic interpeduncular nucleus inputs to laterodorsal tegmentum

Nicotine use can lead to dependence through complex processes that are regulated by both its rewarding and aversive effects. Recent studies show that aversive nicotine doses activate excitatory inputs to the interpeduncular nucleus (IPN) from the medial habenula (MHb), but the downstream targets of the IPN that mediate aversion are unknown. Here we show that IPN projections to the laterodorsal tegmentum (LDTg) are GABAergic using optogenetics in tissue slices from mouse brain. Selective stimulation of these IPN axon terminals in LDTg in vivo elicits avoidance behavior, suggesting that these projections contribute to aversion. Nicotine modulates these synapses in a concentration-dependent manner, with strong enhancement only seen at higher concentrations that elicit aversive responses in behavioral tests. Optogenetic inhibition of the IPN-LDTg connection blocks nicotine conditioned place aversion, suggesting that the IPN-LDTg connection is a critical part of the circuitry that mediates the aversive effects of nicotine.

Dynamic Encoding of Incentive Salience in the Ventral Pallidum: Dependence on the Form of the Reward Cue

Some rats are especially prone to attribute incentive salience to a cue (conditioned stimulus, CS) paired with food reward (sign-trackers, STs), but the extent they do so varies as a function of the form of the CS. Other rats respond primarily to the predictive value of a cue (goal-trackers, GTs), regardless of its form. Sign-tracking is associated with greater cue-induced activation of mesolimbic structures than goal-tracking; however, it is unclear how the form of the CS itself influences activity in neural systems involved in incentive salience attribution. Thus, our goal was to determine how different cue modalities affect neural activity in the ventral pallidum (VP), which is known to encode incentive salience attribution, as rats performed a two-CS Pavlovian conditioned approach task in which both a lever-CS and a tone-CS predicted identical food reward. The lever-CS elicited sign-tracking in some rats (STs) and goal-tracking in others (GTs), whereas the tone-CS elicited only goal-tracking in all rats. The lever-CS elicited robust changes in neural activity (sustained tonic increases or decreases in firing) throughout the VP in STs, relative to GTs. These changes were not seen when STs were exposed to the tone-CS, and in GTs there were no differences in firing between the lever-CS and tone-CS. We conclude that neural activity throughout the VP encodes incentive signals and is especially responsive when a cue is of a form that promotes the attribution of incentive salience to it, especially in predisposed individuals.

Paradoxical accentuation of motivation following accumbens-pallidum disconnection

The nucleus accumbens (NAc) and ventral pallidum (VP) are reciprocally connected, and activity within this circuit is thought to promote reward learning. Inconsistent with this notion, we find that disconnecting NAc medial shell and VP greatly enhances the attribution of value to a cue that is paired with reward. This result suggests that medial NAc shell and VP are both needed for attributing value to cues yet can also oppose one-another's functional contribution.

Noradrenergic signaling in the VTA modulates cocaine craving

Exposure to drug-associated cues evokes drug-seeking behavior and is regarded as a major cause of relapse. Conditional stimulus upregulates noradrenaline (NA) system activity, but the drug-seeking behavior depends particularly on phasic dopamine signaling downstream from the ventral tegmental area (VTA). The VTA dopamine-ergic activity is regulated via the signaling of alpha₁ -adrenergic and alpha₂ -adrenergic receptors (α₁ -ARs and α₂ -ARs); thus, the impact of the conditional stimulus on drug-seeking behavior might involve NAergic signaling in the VTA. To date, the role of VTA ARs in regulating cocaine seeking was not studied. We found that cocaine seeking under extinction conditions in male Sprague-Dawley rats was attenuated by intra-VTA prazosin or terazosin-two selective α₁ -AR antagonists. In contrast, cocaine seeking was facilitated by intra-VTA administration of the selective α₁ -AR agonist phenylephrine as well as α₂ -AR antagonist RX 821002, whereas the selective β-AR antagonist propranolol had no effects. In addition, blockade of α₁ -AR in the VTA prevented α₂ -AR antagonist-induced enhancement of cocaine seeking. Importantly, the potential non-specific effects of the VTA AR blockade on cocaine seeking could be excluded, because none of the AR antagonists influenced sucrose seeking under extinction conditions or locomotor activity in the open field test. These results demonstrate that NAergic signaling potently and selectively regulates cocaine seeking during early cocaine withdrawal via VTA α₁ -AR and α₂ -AR but not β-AR. Our findings provide new insight into the NAergic mechanisms that underlie cocaine craving.

Innate immune signaling in the ventral tegmental area contributes to drug-primed reinstatement of cocaine seeking

Cocaine addiction is a chronic relapsing disorder characterized by persistent perturbations to an organism's homeostatic processes that result in maladaptive drug seeking. Although considerable attention has been directed at the consequences of neuronal changes following chronic cocaine taking, few studies have examined the role of microglia, the brain's resident immune cells, following chronic cocaine administration. Toll-Like Receptor 4 (TLR4) is a molecular pattern receptor that recognizes pathogens, danger signals, and xenobiotics and induces proinflammatory signaling in the central nervous system. TLR4 is generally considered to be expressed primarily by microglia. Here, we used a rodent model of cocaine addiction to investigate the role of TLR4 in the ventral tegmental area (VTA) in cocaine seeking. Male Sprague-Dawley rats were trained to self-administer cocaine in daily 2-h sessions for 15days. Following self-administration, rats underwent extinction training and were tested in a drug-primed reinstatement paradigm. Pharmacological antagonism of TLR4 in the VTA using lipopolysaccharide from the bacterium Rhodobacter sphaeroides (LPS-RS) significantly reduced cocaine-primed reinstatement of drug seeking but had no effect on sucrose seeking. TLR4 activation within the VTA using the TLR4 activator, lipopolysaccharide, was sufficient to moderately reinstate cocaine seeking. We also assessed changes in proinflammatory cytokine expression in the VTA following cocaine self-administration. Cocaine self-administration increased the expression of mRNA for the proinflammatory cytokine interleukin-1ß, but not tumor necrosis factor alpha, in the VTA. Pharmacological antagonism of the interleukin-1 receptor in the VTA reduced cocaine-primed drug seeking. These results are consistent with the hypothesis that chronic cocaine produces inflammatory signaling that contributes to cocaine seeking.

Integration of Descending Command Systems for the Generation of Context-Specific Locomotor Behaviors

Over the past decade there has been a renaissance in our understanding of spinal cord circuits; new technologies are beginning to provide key insights into descending circuits which project onto spinal cord central pattern generators. By integrating work from both the locomotor and animal behavioral fields, we can now examine context-specific control of locomotion, with an emphasis on descending modulation arising from various regions of the brainstem. Here we examine approach and avoidance behaviors and the circuits that lead to the production and arrest of locomotion.

Loss of Plasticity in the D2-Accumbens Pallidal Pathway Promotes Cocaine Seeking

Distinct populations of D1- and D2-dopamine receptor-expressing medium spiny neurons (D1-/D2-MSNs) comprise the nucleus accumbens, and activity in D1-MSNs promotes, whereas activity in D2-MSNs inhibits, motivated behaviors. We used chemogenetics to extend D1-/D2-MSN cell specific regulation to cue-reinstated cocaine seeking in a mouse model of self-administration and relapse, and found that either increasing activity in D1-MSNs or decreasing activity in D2-MSNs augmented cue-induced reinstatement. Both D1- and D2-MSNs provide substantial GABAergic innervation to the ventral pallidum, and chemogenetic inhibition of ventral pallidal neurons blocked the augmented reinstatement elicited by chemogenetic regulation of either D1- or D2-MSNs. Because D1- and D2-MSNs innervate overlapping populations of ventral pallidal neurons, we next used optogenetics to examine whether changes in synaptic plasticity in D1- versus D2-MSN GABAergic synapses in the ventral pallidum could explain the differential regulation of VP activity. In mice trained to self-administer cocaine, GABAergic LTD was abolished in D2-, but not in D1-MSN synapses. A μ opioid receptor antagonist restored GABA currents in D2-, but not D1-MSN synapses of cocaine-trained mice, indicating that increased enkephalin tone on presynaptic μ opioid receptors was responsible for occluding the LTD. These results identify a behavioral function for D1-MSN innervation of the ventral pallidum, and suggest that losing LTD_GABA in D2-MSN, but not D1-MSN input to ventral pallidum may promote cue-induced reinstatement of cocaine-seeking.

SIGNIFICANCE STATEMENT

More than 90% of ventral striatum is composed of two cell types, those expressing dopamine D1 or D2 receptors, which exert opposing roles on motivated behavior. Both cell types send GABAergic projections to the ventral pallidum and were found to differentially promote cue-induced reinstatement of cocaine seeking via the ventral pallidum. Furthermore, after cocaine self-administration, synaptic plasticity was selectively lost in D2, but not D1 inputs to the ventral pallidum. The selective impairment in D2 afferents may promote the influence of D1 inputs to drive relapse to cocaine seeking.