Cocaine and sucrose rewards recruit different seeking ensembles in the nucleus accumbens core

A cocaine-activated ensemble exerts increased control over behavior while decreasing in size

BACKGROUND

Substance use disorder (SUD) is characterized by long-lasting changes in reward-related brain regions, such as the nucleus accumbens (NAc). Previous work has shown that cocaine exposure induces plasticity in broad, genetically-defined cell types in the NAc; however, in response to a stimulus, only a small percent of neurons are transcriptionally active - termed an ensemble. Here, we identify an Arc-expressing neuronal ensemble that has a unique trajectory of recruitment and causally controls drug self-administration after repeated, but not acute, cocaine exposure.

METHOD

Using Arc-CreERT2 transgenic mice, we expressed transgenes in Arc+ ensembles activated by cocaine exposure [either acute (1 x 10mg/kg IP), or repeated (10 x 10mg/kg IP)]. Using genetic, optical, and physiological recording and manipulation strategies, we assessed the contribution of these ensembles to behaviors associated with SUD.

RESULTS

Repeated cocaine exposure reduced the size of the ensemble, while simultaneously increasing its control over behavior. Neurons within the repeated cocaine ensemble were hyperexcitable and their optogenetic excitation was sufficient for reinforcement. Finally, lesioning the repeated cocaine, but not acute cocaine, ensemble blunted cocaine self-administration. Thus, repeated cocaine exposure reduced the size of the ensemble while simultaneously increasing its contributions to drug reinforcement.

CONCLUSIONS

We show that repeated, but not acute, cocaine exposure induces a physiologically distinct ensemble characterized by the expression of the immediate early gene Arc, that is uniquely capable of modulating reinforcement behavior.

Optogenetic inhibition of light-captured alcohol-taking striatal engrams facilitates extinction and suppresses reinstatement

Background

Alcohol use disorder (AUD) is a complex condition, and it remains unclear which specific neuronal substrates mediate alcohol-seeking and -taking behaviors. Engram cells and their related ensembles, which encode learning and memory, may play a role in this process. We aimed to assess the precise neural substrates underlying alcohol-seeking and -taking behaviors and determine how they may affect one another.

Methods

Using FLiCRE (Fast Light and Calcium-Regulated Expression; a newly developed technique which permits the trapping of acutely activated neuronal ensembles) and operant-self administration (OSA), we tagged striatal neurons activated during alcohol-taking behaviors. We used FLiCRE to express an inhibitory halorhodopsin in alcohol-taking neurons, permitting loss-of-function manipulations.

Results

We found that the inhibition of OSA-tagged alcohol-taking neurons decreased both alcohol-seeking and -taking behaviors in future OSA trials. In addition, optogenetic inhibition of these OSA-tagged alcohol-taking neurons during extinction training facilitated the extinction of alcohol-seeking behaviors. Furthermore, inhibition of these OSA-tagged alcohol-taking neurons suppressed the reinstatement of alcohol-seeking behaviors, but, interestingly, it did not significantly suppress alcohol-taking behaviors during reinstatement.

Conclusions

Our findings suggest that alcohol-taking neurons are crucial for future alcohol-seeking behaviors during extinction and reinstatement. These results may help in the development of new therapeutic approaches to enhance extinction and suppress relapse in individuals with AUD.

Drugs of abuse hijack a mesolimbic pathway that processes homeostatic need

Drugs of abuse are thought to promote addiction in part by "hijacking" brain reward systems, but the underlying mechanisms remain undefined. Using whole-brain FOS mapping and in vivo single-neuron calcium imaging, we found that drugs of abuse augment dopaminoceptive ensemble activity in the nucleus accumbens (NAc) and disorganize overlapping ensemble responses to natural rewards in a cell type-specific manner. Combining FOS-Seq, CRISPR-perturbation, and single-nucleus RNA sequencing, we identified Rheb as a molecular substrate that regulates cell type-specific signal transduction in NAc while enabling drugs to suppress natural reward consumption. Mapping NAc-projecting regions activated by drugs of abuse revealed input-specific effects on natural reward consumption. These findings characterize the dynamic, molecular and circuit basis of a common reward pathway, wherein drugs of abuse interfere with the fulfillment of innate needs.

Reprioritizing motivations in addiction

Drugs of abuse alter neuronal signaling.

Accumulation of NMDA receptors in accumbal neuronal ensembles mediates increased conditioned place preference for cocaine after prolonged withdrawal

Cue-induced cocaine craving gradually intensifies following abstinence, a phenomenon known as the incubation of drug craving. Neuronal ensembles activated by initial cocaine use, are critically involved in this process. However, the mechanisms by which neuronal changes occurring in the ensembles after withdrawal contribute to incubation remain largely unknown. Here we labeled neuronal ensembles in the shell of nucleus accumbens (NAcSh) activated by cocaine conditioned place preference (CPP) training. NAcSh ensembles showed an increasing activity induced by CPP test after 21-day withdrawal. Inhibiting synaptic transmission of NAcSh ensembles suppressed the preference for cocaine paired-side after 21-day withdrawal, demonstrating a critical role of NAcSh ensembles in increased preference for cocaine. The density of dendritic spines in dopamine D1 receptor expressing ensembles was increased after 21-day withdrawal. Moreover, the expression of Grin1, a subunit of the N-methyl-D-aspartate (NMDA) receptor, specifically increased in the NAcSh ensembles after cocaine withdrawal in both CPP and self-administration (SA) mouse models. Targeted knockdown or dysfunction of Grin1 in NAcSh ensembles significantly suppressed craving for cocaine. Our results suggest that the accumulation of NMDA receptors in NAcSh ensembles mediates increased craving for cocaine after prolonged withdrawal, thereby providing potential molecular targets for treatment of drug addiction.

Differential genetic expression within reward-specific ensembles in mice

Maladaptive reward seeking is a hallmark of cocaine use disorder. To develop therapeutic targets, it is critical to understand the neurobiological changes specific to cocaine-seeking without altering the seeking of natural rewards, e.g., sucrose. The prefrontal cortex (PFC) and the nucleus accumbens core (NAcore) are known regions associated with cocaine- and sucrose-seeking ensembles, i.e., a sparse population of co-activated neurons. Within ensembles, transcriptomic alterations in the PFC and NAcore underlie the learning and persistence of cocaine- and sucrose-seeking behavior. However, transcriptomes exclusively driving cocaine seeking independent from sucrose seeking have not yet been defined using a within-subject approach. Using Ai14:cFos-TRAP2 transgenic mice in a dual cocaine and sucrose self-administration model, we fluorescently sorted (FACS) and characterized (RNAseq) the transcriptomes defining cocaine- and sucrose-seeking ensembles. We found reward- and region-specific transcriptomic changes that will help develop clinically relevant genetic approaches to decrease cocaine-seeking behavior without altering non-drug reward-based positive reinforcement.

Perineuronal nets in the rat medial prefrontal cortex alter hippocampal-prefrontal oscillations and reshape cocaine self-administration memories

The medial prefrontal cortex (mPFC) is a major contributor to relapse to cocaine in humans and to reinstatement behavior in rodent models of cocaine use disorder. Output from the mPFC is modulated by parvalbumin (PV)-containing fast-spiking interneurons, the majority of which are surrounded by perineuronal nets (PNNs). Here we tested whether chondroitinase ABC (ABC)- mediated removal of PNNs prevented the acquisition or reconsolidation of a cocaine self-administration memory. ABC injections into the dorsal mPFC prior to training attenuated the acquisition of cocaine self-administration. Also, ABC given 3 days prior to but not 1 hr after memory reactivation blocked cue-induced reinstatement. However, reduced reinstatement was present only in rats given a novel reactivation contingency, suggesting that PNNs are required for the updating of a familiar memory. In naive rats, ABC injections into mPFC did not alter excitatory or inhibitory puncta on PV cells but reduced PV intensity. Whole-cell recordings revealed a greater inter-spike interval 1 hr after ABC, but not 3 days later. In vivo recordings from the mPFC and dorsal hippocampus (dHIP) during novel memory reactivation revealed that ABC in the mPFC prevented reward-associated increases in beta and gamma activity as well as phase-amplitude coupling between the dHIP and mPFC. Together, our findings show that PNN removal attenuates the acquisition of cocaine self-administration memories and disrupts reconsolidation of the original memory when combined with a novel reactivation session. Further, reduced dHIP/mPFC coupling after PNN removal may serve as a key biomarker for how to disrupt reconsolidation of cocaine memories and reduce relapse.

Transcriptional correlates of cocaine-associated learning in striatal ARC ensembles

Learned associations between the rewarding effects of drugs and the context in which they are experienced underlie context-induced relapse. Previous work demonstrates the importance of sparse neuronal populations - called neuronal ensembles - in associative learning and cocaine seeking, but it remains unknown whether the encoding vs. retrieval of cocaine-associated memories involves similar or distinct mechanisms of ensemble activation and reactivation in nucleus accumbens (NAc). We use ArcCreER T2 mice to establish that mostly distinct NAc ensembles are recruited by initial vs. repeated exposures to cocaine, which are then differentially reactivated and exert distinct effects during cocaine-related memory retrieval. Single-nuclei RNA-sequencing of these ensembles demonstrates predominant recruitment of D1 medium spiny neurons and identifies transcriptional properties that are selective to cocaine-recruited NAc neurons and could explain distinct excitability features. These findings fundamentally advance our understanding of how cocaine drives pathological memory formation during repeated exposures.

Cellular and molecular basis of drug addiction: The role of neuronal ensembles in addiction

Addiction has been conceptualized as a disease of learning and memory. Learned associations between environmental cues and unconditioned rewards induced by drug administration, which play a critical role in addiction, have been shown to be encoded in sparsely distributed populations of neurons called neuronal ensembles. This review aims to highlight how synaptic remodeling and alterations in signaling pathways that occur specifically in neuronal ensembles contribute to the pathogenesis of addiction. Furthermore, a causal link between transcriptional and epigenetic modifications in neuronal ensembles and the development of the addictive state is proposed. Translational studies of molecular and cellular changes in neuronal ensembles that contribute to drug-seeking behavior, will allow the identification of molecular and circuit targets and interventions for substance use disorders.

Neurobiological mechanisms underlying psychostimulant use

Rates of individuals struggling with psychostimulant use disorder (PSUD), defined as chronic use of psychostimulants despite negative consequences, are growing rapidly over the last few decades. However, there are no current pharmacotherapeutics to aid individuals in maintaining drug abstinence. Identifying the underlying neurobiological mechanisms that promote persistent craving and taking of psychostimulants is critical to creating novel pharmacological treatments for PSUD. Psychostimulant use dysregulates processes within the brain that are responsible for decision-making, reward, and memory formation to drive future drug-seeking. Here, we describe novel findings and theories on how psychostimulants impact mechanisms related to transcription, mitochondrial function, and synaptic plasticity within the reward system to drive drug-seeking. We also highlight work examining how psychostimulants impact neural networks through rewiring circuitry to drive addiction-related behaviors. Overall, this review aims to feature the latest progress in understanding the biological basis of PSUD and promising mechanisms for PSUD pharmacotherapeutics.

Prefrontal Dopamine in Flexible Adaptation to Environmental Changes: A Game for Two Players

Deficits in cognitive flexibility have been characterized in affective, anxiety, and neurodegenerative disorders. This paper reviews data, mainly from studies on animal models, that support the existence of a cortical-striatal brain circuit modulated by dopamine (DA), playing a major role in cognitive/behavioral flexibility. Moreover, we reviewed clinical findings supporting misfunctioning of this circuit in Parkinson's disease that could be responsible for some important non-motoric symptoms. The reviewed findings point to a role of catecholaminergic transmission in the medial prefrontal cortex (mpFC) in modulating DA's availability in the nucleus accumbens (NAc), as well as a role of NAc DA in modulating the motivational value of natural and conditioned stimuli. The review section is accompanied by a preliminary experiment aimed at testing weather the extinction of a simple Pavlovian association fosters increased DA transmission in the mpFC and inhibition of DA transmission in the NAc.

A novel perspective on the role of nucleus accumbens neurons in encoding associative learning

The nucleus accumbens (NAc) has been considered a key brain region for encoding reward/aversion and cue-outcome associations. These processes are encoded by medium spiny neurons that express either dopamine receptor D1 (D1-MSNs) or D2 (D2-MSNs). Despite the well-established role of NAc neurons in encoding reward/aversion, the underlying processing by D1-/D2-MSNs remains largely unknown. Recent electrophysiological, optogenetic and calcium imaging studies provided insight on the complex role of D1- and D2-MSNs in these behaviours and helped to clarify their involvement in associative learning. Here, we critically discuss findings supporting an intricate and complementary role of NAc D1- and D2-MSNs in associative learning, emphasizing the need for additional studies in order to fully understand the role of these neurons in behaviour.

Activity-dependent labeling and manipulation of fentanyl-recruited striatal ensembles using ArcTRAP approach

Understanding the memory substrates underlying substance abuse requires the permanent tagging and manipulation of drug-recruited neural ensembles. Here, we present a protocol for activity-dependent labeling and chemogenetic manipulation of fentanyl-activated striatal ensembles using the ArcTRAP approach. We outline the necessary steps to breed ArcTRAP mice, prepare drugs and reagents, conduct behavioral training, and perform tagging and manipulation. This approach can be adapted to investigate drug-recruited ensembles in other brain regions, providing a versatile tool for exploring the neural mechanisms underlying addiction. For complete details on the use and execution of this protocol, please refer to Wang et al.1.

Accelerated social representational drift in the nucleus accumbens in a model of autism

Impaired social interaction is one of the core deficits of autism spectrum disorder (ASD) and may result from social interactions being less rewarding. How the nucleus accumbens (NAc), as a key hub of reward circuitry, encodes social interaction and whether these representations are altered in ASD remain poorly understood. We identified NAc ensembles encoding social interactions by calcium imaging using miniaturized microscopy. NAc population activity, specifically D1 receptor-expressing medium spiny neurons (D1-MSNs) activity, predicted social interaction epochs. Despite a high turnover of NAc neurons modulated by social interaction, we found a stable population code for social interaction in NAc which was dramatically degraded in Cntnap2-/- mouse model of ASD. Surprisingly, non-specific optogenetic inhibition of NAc core neurons increased social interaction time and significantly improved sociability in Cntnap2-/- mice. Inhibition of D1- or D2-MSNs showed reciprocal effects, with D1 inhibition decreasing social interaction and D2 inhibition increasing interaction. Therefore, social interactions are preferentially, specifically and dynamically encoded by NAc neurons and social representations are degraded in this autism model.

External globus pallidus input to the dorsal striatum regulates habitual seeking behavior in male mice

The external globus pallidus (GPe) coordinates action-selection through GABAergic projections throughout the basal ganglia. GPe arkypallidal (arky) neurons project exclusively to the dorsal striatum, which regulates goal-directed and habitual seeking. However, the role of GPe arky neurons in reward-seeking remains unknown. Here, we identified that a majority of arky neurons target the dorsolateral striatum (DLS). Using fiber photometry, we found that arky activities were higher during random interval (RI; habit) compared to random ratio (RR; goal) operant conditioning. Support vector machine analysis demonstrated that arky neuron activities have sufficient information to distinguish between RR and RI behavior. Genetic ablation of this arkyGPe→DLS circuit facilitated a shift from goal-directed to habitual behavior. Conversely, chemogenetic activation globally reduced seeking behaviors, which was blocked by systemic D1R agonism. Our findings reveal a role of this arkyGPe→DLS circuit in constraining habitual seeking in male mice, which is relevant to addictive behaviors and other compulsive disorders.

Intrusive thinking: Circuit and synaptic mechanisms of a transdiagnostic psychiatric symptom

Spontaneous thought is an adaptive cognitive process that can produce novel and insightful thought sequences useful in guiding future behavior. In many psychiatric disorders, spontaneous thinking becomes intrusive and uncontrolled, and can trigger symptoms such as craving, repetitive negative thinking and trauma-related memories. We link studies using clinical imaging and rodent modeling towards understanding the neurocircuitry and neuroplasticity of intrusive thinking. We propose a framework in which drugs or stress change the homeostatic set point of brain reward circuitry, which then impacts subsequent plasticity induced by drug/stress conditioned cues (metaplastic allostasis). We further argue for the importance of examining not only the canonical pre- and postsynapse, but also the adjacent astroglial protrusions and extracellular matrix that together form the tetrapartite synapse and that plasticity throughout the tetrapartite synapse is necessary for cue-induced drug or stress behaviors. This analysis reveals that drug use or trauma cause long-lasting allostatic brain plasticity that sets the stage for subsequent drug/trauma-associated cues to induce transient plasticity that can lead to intrusive thinking.

A multivariate regressor of patterned dopamine release predicts relapse to cocaine

Understanding mesolimbic dopamine adaptations underlying vulnerability to drug relapse is essential to inform prognostic tools for effective treatment strategies. However, technical limitations have hindered the direct measurement of sub-second dopamine release in vivo for prolonged periods of time, making it difficult to gauge the weight that these dopamine abnormalities have in determining future relapse incidence. Here, we use the fluorescent sensor GrabDA to record, with millisecond resolution, every single cocaine-evoked dopamine transient in the nucleus accumbens (NAc) of freely moving mice during self-administration. We reveal low-dimensional features of patterned dopamine release that are strong predictors of cue-induced reinstatement of cocaine seeking. Additionally, we report sex-specific differences in cocaine-related dopamine responses related to a greater resistance to extinction in males compared with females. These findings provide important insights into the sufficiency of NAc dopamine signaling dynamics-in interaction with sex-for recapitulating persistent cocaine seeking and future relapse vulnerability.

Astrocyte activities in the external globus pallidus regulate action-selection strategies in reward-seeking behaviors

An imbalance in goal-directed and habitual behavioral control is a hallmark of decision-making-related disorders, including addiction. Although external globus pallidus (GPe) is critical for action selection, which harbors enriched astrocytes, the role of GPe astrocytes involved in action-selection strategies remained unknown. Using in vivo calcium signaling with fiber photometry, we found substantially attenuated GPe astrocytic activity during habitual learning compared to goal-directed learning. The support vector machine analysis predicted the behavioral outcomes. Chemogenetic activation of the astrocytes or inhibition of GPe pan-neuronal activities facilitates the transition from habit to goal-directed reward-seeking behavior. Next, we found increased astrocyte-specific GABA (γ-aminobutyric acid) transporter type 3 (GAT3) messenger RNA expression during habit learning. Notably, the pharmacological inhibition of GAT3 occluded astrocyte activation-induced transition from habitual to goal-directed behavior. On the other hand, attentional stimuli shifted the habit to goal-directed behaviors. Our findings suggest that the GPe astrocytes regulate the action selection strategy and behavioral flexibility.

K v 7 Channel Opener Retigabine Reduces Self-Administration of Cocaine but Not Sucrose in Rats

The increasing rates of drug misuse highlight the urgency of identifying improved therapeutics for treatment. Most drug-seeking behaviors that can be modeled in rodents utilize the repeated intravenous self-administration (SA) of drugs. Recent studies examining the mesolimbic pathway suggest that K v 7/KCNQ channels may contribute in the transition from recreational to chronic drug use. However, to date, all such studies used noncontingent, experimenter-delivered drug model systems, and the extent to which this effect generalizes to rats trained to self-administer drug is not known. Here, we tested the ability of retigabine (ezogabine), a K v 7 channel opener, to regulate instrumental behavior in male Sprague Dawley rats. We first validated the ability of retigabine to target experimenter-delivered cocaine in a CPP assay and found that retigabine reduced the acquisition of place preference. Next, we trained rats for cocaine-SA under a fixed-ratio or progressive-ratio reinforcement schedule and found that retigabine-pretreatment attenuated the self-administration of low to moderate doses of cocaine. This was not observed in parallel experiments, with rats self-administering sucrose, a natural reward. Compared to sucrose-SA, cocaine-SA was associated with reductions in the expression of the K v 7.5 subunit in the nucleus accumbens, without alterations in K v 7.2 and K v 7.3. Therefore, these studies reveal a reward specific reduction in SA behavior considered relevant for the study of long-term compulsive-like behavior and supports the notion that K v 7 is a potential therapeutic target for human psychiatric diseases with dysfunctional reward circuitry.

Striatal μ-opioid receptor activation triggers direct-pathway GABAergic plasticity and induces negative affect

Withdrawal from chronic opioid use often causes hypodopaminergic states and negative affect, which may drive relapse. Direct-pathway medium spiny neurons (dMSNs) in the striatal patch compartment contain μ-opioid receptors (MORs). It remains unclear how chronic opioid exposure and withdrawal impact these MOR-expressing dMSNs and their outputs. Here, we report that MOR activation acutely suppressed GABAergic striatopallidal transmission in habenula-projecting globus pallidus neurons. Notably, withdrawal from repeated morphine or fentanyl administration potentiated this GABAergic transmission. Furthermore, intravenous fentanyl self-administration enhanced GABAergic striatonigral transmission and reduced midbrain dopaminergic activity. Fentanyl-activated striatal neurons mediated contextual memory retrieval required for conditioned place preference tests. Importantly, chemogenetic inhibition of striatal MOR+ neurons rescued fentanyl withdrawal-induced physical symptoms and anxiety-like behaviors. These data suggest that chronic opioid use triggers GABAergic striatopallidal and striatonigral plasticity to induce a hypodopaminergic state, which may promote negative emotions and relapse.

Epigenetic function during heroin self-administration controls future relapse-associated behavior in a cell type-specific manner

Opioid use produces enduring associations between drug reinforcement/euphoria and discreet or diffuse cues in the drug-taking environment. These powerful associations can trigger relapse in individuals recovering from opioid use disorder (OUD). Here, we sought to determine whether the epigenetic enzyme, histone deacetylase 5 (HDAC5), regulates relapse-associated behavior in an animal model of OUD. We examined the effects of nucleus accumbens (NAc) HDAC5 on both heroin- and sucrose-seeking behaviors using operant self-administration paradigms. We utilized cre-dependent viral-mediated approaches to investigate the cell-type-specific effects of HDAC5 on heroin-seeking behavior, gene expression, and medium spiny neuron (MSN) cell and synaptic physiology. We found that NAc HDAC5 functions during the acquisition phase of heroin self-administration to limit future relapse-associated behavior. Moreover, overexpressing HDAC5 in the NAc suppressed context-associated and reinstated heroin-seeking behaviors, but it did not alter sucrose seeking. We also found that HDAC5 functions within dopamine D1 receptor-expressing MSNs to suppress cue-induced heroin seeking, and within dopamine D2 receptor-expressing MSNs to suppress drug-primed heroin seeking. Assessing cell-type-specific transcriptomics, we found that HDAC5 reduced expression of multiple ion transport genes in both D1- and D2-MSNs. Consistent with this observation, HDAC5 also produced firing rate depression in both MSN classes. These findings revealed roles for HDAC5 during active heroin use in both D1- and D2-MSNs to limit distinct triggers of drug-seeking behavior. Together, our results suggest that HDAC5 might limit relapse vulnerability through regulation of ion channel gene expression and suppression of MSN firing rates during active heroin use.

Whole-brain tracking of cocaine and sugar rewards processing

Natural rewards, such as food, and sex are appetitive stimuli available for animals in their natural environment. Similarly, addictive rewards such as drugs of abuse possess strong, positive valence, but their action relies on their pharmacological properties. Nevertheless, it is believed that both of these kinds of rewards activate similar brain circuitry. The present study aimed to discover which parts of the brain process the experience of natural and addictive rewards. To holistically address this question, we used a single-cell whole-brain imaging approach to find patterns of activation for acute and prolonged sucrose and cocaine exposure. We analyzed almost 400 brain structures and created a brain-wide map of specific, c-Fos-positive neurons engaged by these rewards. Acute but not prolonged sucrose exposure triggered a massive c-Fos expression throughout the brain. Cocaine exposure on the other hand potentiated c-Fos expression with prolonged use, engaging more structures than sucrose treatment. The functional connectivity analysis unraveled an increase in brain modularity after the initial exposure to both types of rewards. This modularity was increased after repeated cocaine, but not sucrose, intake. To check whether discrepancies between the processing of both types of rewards can be found on a cellular level, we further studied the nucleus accumbens, one of the most strongly activated brain structures by both sucrose and cocaine experience. We found a high overlap between natural and addictive rewards on the level of c-Fos expression. Electrophysiological measurements of cellular correlates of synaptic plasticity revealed that natural and addictive rewards alike induce the accumulation of silent synapses. These results strengthen the hypothesis that in the nucleus accumbens drugs of abuse cause maladaptive neuronal plasticity in the circuitry that typically processes natural rewards.

Net gain and loss: influence of natural rewards and drugs of abuse on perineuronal nets

Overindulgence, excessive consumption, and a pattern of compulsive use of natural rewards, such as certain foods or drugs of abuse, may result in the development of obesity or substance use disorder, respectively. Natural rewards and drugs of abuse can trigger similar changes in the neurobiological substrates that drive food- and drug-seeking behaviors. This review examines the impact natural rewards and drugs of abuse have on perineuronal nets (PNNs). PNNs are specialized extracellular matrix structures that ensheathe certain neurons during development over the critical period to provide synaptic stabilization and a protective microenvironment for the cells they surround. This review also analyzes how natural rewards and drugs of abuse impact the density and maturation of PNNs within reward-associated circuitry of the brain, which may contribute to maladaptive food- and drug-seeking behaviors. Finally, we evaluate the relatively few studies that have degraded PNNs to perturb reward-seeking behaviors. Taken together, this review sheds light on the complex way PNNs are regulated by natural rewards and drugs and highlights a need for future studies to delineate the molecular mechanisms that underlie the modification and maintenance of PNNs following exposure to rewarding stimuli.

From ensembles to meta-ensembles: Specific reward encoding by correlated network activity

Neuronal ensembles are local, sparsely distributed populations of neurons that are reliably re-activated by a specific stimulus, context or task. Such discrete cell populations can be defined either functionally, by electrophysiological recordings or in vivo calcium imaging, or anatomically, using the expression of markers such as the immediate early gene cFos. A typical example of tasks that involve the formation of neuronal ensembles is reward learning, such as the cue-reward pairing during operant conditioning. These ensembles are re-activated during cue-presentation and increasing evidence suggests that this re-activation is the neurophysiological basis for the execution of reward-seeking behavior. Whilst the pursuit of rewards is a common daily activity, it is also related to the consumption of drugs, such as alcohol, and may result in problematic behaviors including addiction. Recent research has identified neuronal ensembles in several reward-related brain regions that control distinct aspects of a conditioned response, e.g., contextual information about the availability of a specific reward or the actions needed to retrieve this reward under the given circumstances. Here, we review studies using the activity marker cFos to identify and characterize neuronal ensembles related to alcohol and non-drug rewards with a special emphasis on the discrimination between different rewards by meta-ensembles, i.e., by dynamic co-activation of multiple ensembles across different brain areas.

Plasticity in astrocyte subpopulations regulates heroin relapse

Opioid use disorder (OUD) produces detrimental personal and societal consequences. Astrocytes are a major cell group in the brain that receives little attention in mediating OUD. We determined how astrocytes and the astroglial glutamate transporter, GLT-1, in the nucleus accumbens core adapt and contribute to heroin seeking in rats. Seeking heroin, but not sucrose, produced two transient forms of plasticity in different astroglial subpopulations. Increased morphological proximity to synapses occurred in one subpopulation and increased extrasynaptic GLT-1 expression in another. Augmented synapse proximity by astroglia occurred selectively at D2-dopamine receptor-expressing dendrites, while changes in GLT-1 were not neuron subtype specific. mRNA-targeted antisense inhibition of either morphological or GLT-1 plasticity promoted cue-induced heroin seeking. Thus, we show that heroin cues induce two distinct forms of transient plasticity in separate astroglial subpopulations that dampen heroin relapse.

A Subset of Nucleus Accumbens Neurons Receiving Dense and Functional Prelimbic Cortical Input Are Required for Cocaine Seeking

Background

Prelimbic cortical projections to the nucleus accumbens core are critical for cue-induced cocaine seeking, but the identity of the accumbens neuron(s) targeted by this projection, and the transient neuroadaptations contributing to relapse within these cells, remain unknown.

Methods

Male Sprague-Dawley rats underwent cocaine or sucrose self-administration, extinction, and cue-induced reinstatement. Pathway-specific chemogenetics, patch-clamp electrophysiology, in vivo electrochemistry, and high-resolution confocal microscopy were used to identify and characterize a small population of nucleus accumbens core neurons that receive dense prelimbic cortical input to determine their role in regulating cue-induced cocaine and natural reward seeking.

Results

Chemogenetic inhibition of prelimbic cortical projections to the nucleus accumbens core suppressed cue-induced cocaine relapse and normalized real-time cue-evoked increases in accumbens glutamate release to that of sucrose seeking animals. Furthermore, chemogenetic inhibition of the population of nucleus accumbens core neurons receiving the densest prelimbic cortical input suppressed cocaine, but not sucrose seeking. These neurons also underwent morphological plasticity during the peak of cocaine seeking in the form of dendritic spine expansion and increased ensheathment by astroglial processes at large spines.

Conclusion

We identified and characterized a unique subpopulation of nucleus accumbens neurons that receive dense prelimbic cortical input. The functional specificity of this subpopulation is underscored by their ability to mediate cue-induced cocaine relapse, but not sucrose seeking. This subset of cells represents a novel target for addiction therapeutics revealed by anterograde targeting to interrogate functional circuits imbedded within a known network.

Cocaine-induced projection-specific and cell type-specific adaptations in the nucleus accumbens

Cocaine craving, seeking, and relapse are mediated, in part, by cocaine-induced adaptive changes in the brain reward circuits. The nucleus accumbens (NAc) integrates and prioritizes different emotional and motivational inputs to the reward system by processing convergent glutamatergic projections from the medial prefrontal cortex, basolateral amygdala, ventral hippocampus, and other limbic and paralimbic brain regions. Medium spiny neurons (MSNs) are the principal projection neurons in the NAc, which can be divided into two major subpopulations, namely dopamine receptor D1- versus D2-expressing MSNs, with complementing roles in reward-associated behaviors. After cocaine experience, NAc MSNs exhibit complex and differential adaptations dependent on cocaine regimen, withdrawal time, cell type, location (NAc core versus shell), and related input and output projections, or any combination of these factors. Detailed characterization of these cellular adaptations has been greatly facilitated by the recent development of optogenetic/chemogenetic techniques combined with transgenic tools. In this review, we discuss such cell type- and projection-specific adaptations induced by cocaine experience. Specifically, (1) D1 and D2 NAc MSNs frequently exhibit differential adaptations in spinogenesis, glutamatergic receptor trafficking, and intrinsic membrane excitability, (2) cocaine experience differentially changes the synaptic transmission at different afferent projections onto NAc MSNs, (3) cocaine-induced NAc adaptations exhibit output specificity, e.g., being different at NAc-ventral pallidum versus NAc-ventral tegmental area synapses, and (4) the input, output, subregion, and D1/D2 cell type may together determine cocaine-induced circuit plasticity in the NAc. In light of the projection- and cell-type specificity, we also briefly discuss ensemble and circuit mechanisms contributing to cocaine craving and relapse after drug withdrawal.

Extrasynaptic therapeutic targets in substance use and stress disorders

Treatments for substance use and stress disorders are based on ameliorating behavioral symptoms, not on reversing the synaptic pathology that has the potential to cure disorders. This failing arises in part from a research focus on how pre- and postsynaptic physiology is changed even though key neuropathology exists in the perisynaptic neuropil that homeostatically regulates synaptic transmission. We explore recent findings from the substance use and stress disorder literature pointing to a key role for perisynaptic astroglia and signaling in the extracellular matrix (ECM) in regulating synaptic pathology. We conclude that drugs and stress initiate long-lasting changes in brain synapses via enduring neuroadaptations in astroglia and the ECM, and that modulating extrasynaptic regulators may be therapeutically useful.

The role of the nucleus accumbens and ventral pallidum in feeding and obesity

Obesity is a growing global epidemic that stems from the increasing availability of highly-palatable foods and the consequent enhanced calorie consumption. Extensive research has shown that brain regions that are central to reward seeking modulate feeding and evidence linking obesity to pathology in such regions have recently started to accumulate. In this review we focus on the contribution of two major interconnected structures central to reward processing, the nucleus accumbens and the ventral pallidum, to obesity. We first review the known literature linking these structures to feeding behavior, then discuss recent advances connecting pathology in the nucleus accumbens and ventral pallidum to obesity, and finally examine the similarities and differences between drug addiction and obesity in the context of these two structures. The understanding of how pathology in brain regions involved in reward seeking and consumption may drive obesity and how mechanistically similar obesity and addiction are, is only now starting to be revealed. We hope that future research will advance knowledge in the field and open new avenues to studying and treating obesity.

A Novel Assay Allowing Drug Self-Administration, Extinction, and Reinstatement Testing in Head-Restrained Mice

Multiphoton microscopy is one of several new technologies providing unprecedented insight into the activity dynamics and function of neural circuits. Unfortunately, some of these technologies require experimentation in head-restrained animals, limiting the behavioral repertoire that can be integrated and studied. This issue is especially evident in drug addiction research, as no laboratories have coupled multiphoton microscopy with simultaneous intravenous drug self-administration, a behavioral paradigm that has predictive validity for treatment outcomes and abuse liability. Here, we describe a new experimental assay wherein head-restrained mice will press an active lever, but not inactive lever, for intravenous delivery of heroin or cocaine. Similar to freely moving animals, we find that lever pressing is suppressed through daily extinction training and subsequently reinstated through the presentation of relapse-provoking triggers (drug-associative cues, the drug itself, and stressors). Finally, we show that head-restrained mice will show similar patterns of behavior for oral delivery of a sucrose reward, a common control used for drug self-administration experiments. Overall, these data demonstrate the feasibility of combining drug self-administration experiments with technologies that require head-restraint, such as multiphoton imaging. The assay described could be replicated by interested labs with readily available materials to aid in identifying the neural underpinnings of substance use disorder.

Neuroplasticity and Multilevel System of Connections Determine the Integrative Role of Nucleus Accumbens in the Brain Reward System

A growing body of evidence suggests that nucleus accumbens (NAc) plays a significant role not only in the physiological processes associated with reward and satisfaction but also in many diseases of the central nervous system. Summary of the current state of knowledge on the morphological and functional basis of such a diverse function of this structure may be a good starting point for further basic and clinical research. The NAc is a part of the brain reward system (BRS) characterized by multilevel organization, extensive connections, and several neurotransmitter systems. The unique role of NAc in the BRS is a result of: (1) hierarchical connections with the other brain areas, (2) a well-developed morphological and functional plasticity regulating short- and long-term synaptic potentiation and signalling pathways, (3) cooperation among several neurotransmitter systems, and (4) a supportive role of neuroglia involved in both physiological and pathological processes. Understanding the complex function of NAc is possible by combining the results of morphological studies with molecular, genetic, and behavioral data. In this review, we present the current views on the NAc function in physiological conditions, emphasizing the role of its connections, neuroplasticity processes, and neurotransmitter systems.

Endocannabinoid Modulation of Nucleus Accumbens Microcircuitry and Terminal Dopamine Release

The nucleus accumbens (NAc) is located in the ventromedial portion of the striatum and is vital to valence-based predictions and motivated action. The neural architecture of the NAc allows for complex interactions between various cell types that filter incoming and outgoing information. Dopamine (DA) input serves a crucial role in modulating NAc function, but the mechanisms that control terminal DA release and its effect on NAc neurons continues to be elucidated. The endocannabinoid (eCB) system has emerged as an important filter of neural circuitry within the NAc that locally shapes terminal DA release through various cell type- and site-specific actions. Here, we will discuss how eCB signaling modulates terminal DA release by shaping the activity patterns of NAc neurons and their afferent inputs. We then discuss recent technological advancements that are capable of dissecting how distinct cell types, their afferent projections, and local neuromodulators influence valence-based actions.

Epigenetic Mechanisms Mediate Nicotine-Induced Reward and Behaviour in Zebrafish

Nicotine induces long-term changes in the neural activity of the mesocorticolimbic reward pathway structures. The mechanisms involved in this process have not been fully characterized. The hypothesis discussed here proposed that epigenetic regulation participates in the installation of persistent adaptations and long-lasting synaptic plasticity generated by nicotine action on the mesolimbic dopamine neurons of zebrafish. The epigenetic mechanisms induced by nicotine entail histone and DNA chemical modifications, which have been described to lead to changes in gene expression. Among the enzymes that catalyze epigenetic chemical modifications, histone deacetylases (HDACs) remove acetyl groups from histones, thereby facilitating DNA relaxation and making DNA more accessible to gene transcription. DNA methylation, which is dependent on DNA methyltransferase (DNMTs) activity, inhibits gene expression by recruiting several methyl binding proteins that prevent RNA polymerase binding to DNA. In zebrafish, phenylbutyrate (PhB), an HDAC inhibitor, abolishes nicotine rewarding properties together with a series of typical reward-associated behaviors. Furthermore, PhB and nicotine alter long- and short-term object recognition memory in zebrafish, respectively. Regarding DNA methylation effects, a methyl group donor L-methionine (L-met) was found to dramatically reduce nicotine-induced conditioned place preference (CPP) in zebrafish. Simultaneous treatment with DNMT inhibitor 5-aza-2’-deoxycytidine (AZA) was found to reverse the L-met effect on nicotine-induced CPP as well as nicotine reward-specific effects on genetic expression in zebrafish. Therefore, pharmacological interventions that modulate epigenetic regulation of gene expression should be considered as a potential therapeutic method to treat nicotine addiction.

Circuit selectivity in drug versus natural reward seeking behaviors

Substance use disorder (SUD) is characterized, in part by behavior biased toward drug use and away from natural sources of reward (e.g., social interaction, food, sex). The neurobiological underpinnings of SUDs reveal distinct brain regions where neuronal activity is necessary for the manifestation of SUD-characteristic behaviors. Studies that specifically examine how these regions are involved in behaviors motivated by drug versus natural reward allow determinations of which regions are necessary for regulating seeking of both reward types, and appraisals of novel SUD therapies for off-target effects on behaviors motivated by natural reward. Here, we evaluate studies directly comparing regulatory roles for specific brain regions in drug versus natural reward. While it is clear that many regions drive behaviors motivated by all reward types, based on the literature reviewed we propose a set of interconnected regions that become necessary for behaviors motivated by drug, but not natural rewards. The circuitry is selectively necessary for drug seeking includes an Action/Reward subcircuit, comprising nucleus accumbens, ventral pallidum, and ventral tegmental area, a Prefrontal subcircuit comprising prelimbic, infralimbic, and insular cortices, a Stress subcircuit comprising the central nucleus of the amygdala and the bed nucleus of the stria terminalis, and a Diencephalon circuit including lateral hypothalamus. Evidence was mixed for nucleus accumbens shell, insular cortex, and ventral pallidum. Studies for all other brain nuclei reviewed supported a necessary role in regulating both drug and natural reward seeking. Finally, we discuss emerging strategies to further disambiguate the necessity of brain regions in drug- versus natural reward-associated behaviors.

Egr2 induction in spiny projection neurons of the ventrolateral striatum contributes to cocaine place preference in mice

Drug addiction develops due to brain-wide plasticity within neuronal ensembles, mediated by dynamic gene expression. Though the most common approach to identify such ensembles relies on immediate early gene expression, little is known of how the activity of these genes is linked to modified behavior observed following repeated drug exposure. To address this gap, we present a broad-to-specific approach, beginning with a comprehensive investigation of brain-wide cocaine-driven gene expression, through the description of dynamic spatial patterns of gene induction in subregions of the striatum, and finally address functionality of region-specific gene induction in the development of cocaine preference. Our findings reveal differential cell-type specific dynamic transcriptional recruitment patterns within two subdomains of the dorsal striatum following repeated cocaine exposure. Furthermore, we demonstrate that induction of the IEG Egr2 in the ventrolateral striatum, as well as the cells within which it is expressed, are required for the development of cocaine seeking.

The human brain is ever changing, constantly rewiring itself in response to new experiences, knowledge or information from the environment. Addictive drugs such as cocaine can hijack the genetic mechanisms responsible for this plasticity, creating dangerous, obsessive drug-seeking and consuming behaviors.

Cocaine-induced plasticity is difficult to apprehend, however, as brain regions or even cell populations can react differently to the compound. For instance, sub-regions in the striatum – the brain area that responds to rewards and helps to plan movement – show distinct responses during progressive exposure to cocaine. And while researchers know that the drug immediately changes how neurons switch certain genes on and off, it is still unclear how these genetic modifications later affect behavior.

Mukherjee, Gonzales et al. explored these questions at different scales, first focusing on how progressive cocaine exposure changed the way various gene programs were activated across the entire brain. This revealed that programs in the striatum were the most affected by the drug.

Examining this region more closely showed that cocaine switches on genes in specific ‘spiny projection’ neuron populations, depending on where these cells are located and the drug history of the mouse. Finally, Mukherjee, Gonzales et al. used genetically modified mice to piece together cocaine exposure, genetic changes and modifications in behavior. These experiments revealed that the drive to seek cocaine depended on activation of the Egr2 gene in populations of spiny projection neurons in a specific sub-region of the striatum. The gene, which codes for a protein that regulates how genes are switched on and off, was itself strongly activated by cocaine intake.

Cocaine addiction can have devastating consequences for individuals. Grasping how this drug alters the brain could pave the way for new treatments, while also providing information on the basic mechanisms underlying brain plasticity.

Neuronal activity associated with cocaine preference: Effects of differential cocaine intake

Differences in overall cocaine intake can directly affect neuroadaptations, and this relationship can make it difficult to interpret neurobiological changes seen in drug-choice studies, since drug intake varies between subjects. Herein, a choice procedure that controls for cocaine intake was utilized to explore if neuronal activity, measured as cFos expression in the orbitofrontal cortex (OFC) and nucleus accumbens (NAc), was reflective of preference. Results demonstrated that cFos expression, in both the OFC and NAc, was independent of cocaine preference when cocaine intake was kept constant across individuals. However, when cocaine intake was systematically varied, the expression of cFos associated with cocaine preference was related to overall cocaine intake in the OFC, but not the NAc. Altogether, these results demonstrate that cocaine intake during choice can affect neurobiological outcome measures; thus, the neurobehavioral mechanisms underlying cocaine preference may be better isolated when controlling for cocaine frequency and intake. In all, some caution is warranted when interpreting results from choice studies evaluating the neurobehavioral mechanisms that underlie drug preference when drug frequency and intake are uncontrolled, and future research is needed to determine the role of drug frequency and intake on neurobiological measures associated with drug choice.