Targeted disruption of cocaine-activated nucleus accumbens neurons prevents context-specific sensitization

Animal models for studying therapeutic targets and treatments for alcohol use disorder

Over the decades, preclinical models have been developed and refined to investigate the rewarding effects of addictive substances and the neurobiological underpinnings of alcohol and other drug use disorders. This chapter delves into the methodological foundations, advantages, and limitations of leading animal models used to study alcohol use disorders (AUDs). Some models focus on the early stages of alcohol use and abuse. For instance, conditioned place preference assesses associative learning between a specific context and the effects of the drug, while locomotor sensitization measures increased locomotor activity following repeated drug exposure. In contrast, contingent models such as operant and non-operant alcohol self-administration protocols gauge voluntary intake, preference, motivation, and seeking behavior for alcohol solutions among experimental subjects. Additionally, we discuss the chronic intermittent alcohol vapor model, extensively utilized to induce a phenotype resembling dependence through non-contingent inhalation of alcohol vapor, resulting in elevated blood alcohol concentrations. Given the focus on pharmacological treatments for AUDs, we explore how different animal models can be employed to evaluate potential therapies and extrapolate findings to alcohol-related behaviors in humans. This chapter aims to provide readers with a comprehensive understanding of various animal models for AUDs, aiding in the interpretation of preclinical studies and the selection of suitable models for future research endeavors.

Astrocytic Regulation of Cocaine Locomotor Sensitization in EcoHIV Infected Mice

Cocaine use disorder (CUD) is highly comorbid with HIV infection and worsens HIV outcomes. Preclinical research on the outcomes of HIV infection may yield crucial information on neurobehavioral changes resulting from chronic drug exposure in people living with HIV (PLWH). Repeated exposure to cocaine alters behavioral responses to cocaine. This includes development of cocaine locomotor sensitization - or increased locomotor responses to the same doses of cocaine - which depends on nucleus accumbens (NAc) neural plasticity. NAc astrocytes are key regulators of neural activity and plasticity, and their function can be impaired by cocaine exposure and HIV infection, thus implicating them as potential regulators of HIV-induced changes in behavioral response to cocaine. To characterize the effects of HIV infection on cocaine locomotor sensitization, we employed the EcoHIV mouse model to assess changes in locomotor responses after repeated cocaine (10mg/kg) exposure and challenge. EcoHIV infection potentiated expression of cocaine sensitization. We also identified EcoHIV-induced increases in expression of the astrocytic nuclear marker Sox9 selectively in the NAc core. To investigate whether modulation of NAc astrocytes could reverse EcoHIV-induced deficits, we employed a chemogenetic approach. We found that chemogenetic activation of NAc astrocyte Gq signaling attenuated EcoHIV-enhanced cocaine sensitization. We propose that HIV infection contributes to cocaine behavioral sensitization and induces adaptations in NAc astrocytes, while promoting NAc astrocytic Gq-signaling can recover EcoHIV-induced behavioral changes. These findings identify potential cellular substrates of disordered cocaine-driven behavior in the context of HIV infection and point toward strategies to reduce cocaine-related behavior in PLWH.

The mutated cytoplasmic fragile X messenger ribonucleoprotein 1 (FMR1)-interacting protein 2 (CYFIP2 S968F) regulates cocaine-induced reward behaviour and plasticity in the nucleus accumbens

BACKGROUND AND PURPOSE

Cytoplasmic fragile X messenger ribonucleoprotein 1 (FMR1)-interacting protein 2 (CYFIP2), as a component of the Wiskott-Aldrich syndrome protein family verprolin-homologous protein (WAVE) regulatory complex, is involved in actin polymerization, contributing to neuronal development and structural plasticity. Mutating serine-968 to phenylalanine (S968F) in CYFIP2 causes an altered cocaine response in mice. The neuronal mechanisms underlying this response remain unknown.

EXPERIMENTAL APPROACH

We performed cocaine reward-related behavioural tests and examined changes in synaptic protein phenotypes and neuronal morphology in the nucleus accumbens (NAc), using CYFIP2 S968F knock-in mice to investigate the role of CYFIP2 in regulating cocaine reward.

KEY RESULTS

CYFIP2 S968F mutation attenuated cocaine-induced behavioural sensitization and conditioned place preference. Cocaine-induced c-Fos was not observed in the NAc of CYFIP2 S968F knock-in mice. However, c-Fos induction was still evident in the medial prefrontal cortex (mPFC). CYFIP2 S968F mutation altered cocaine-associated CYFIP2 signalling, glutamatergic protein expression and synaptic density in the NAc following cocaine exposure. To further determine the role of CYFIP2 in NAc neuronal activity and the mPFC projecting to the NAc activity-mediating reward response, we used optogenetic tools to stimulate the NAc or mPFC-NAc pathway and observed that optogenetic activation of the NAc or mPFC-NAc pathway induced reward-related behaviours. This effect was not observed in the S968F mutation in CYFIP2.

CONCLUSION AND IMPLICATIONS

These results suggest that CYFIP2 plays a role in controlling cocaine-mediated neuronal function and structural plasticity in the NAc, and that CYFIP2 could serve as a target for regulating cocaine reward.

NPAS4 supports cocaine-conditioned cues in rodents by controlling the cell type-specific activation balance in the nucleus accumbens

Powerful associations that link drugs of abuse with cues in the drug-paired environment often serve as prepotent relapse triggers. Drug-associated contexts and cues activate ensembles of nucleus accumbens (NAc) neurons, including D1-class medium spiny neurons (MSNs) that typically promote, and D2-class MSNs that typically oppose, drug seeking. We found that in mice, cocaine conditioning upregulated transiently the activity-regulated transcription factor, Neuronal PAS Domain Protein 4 (NPAS4), in a small subset of NAc neurons. The NPAS4+ NAc ensemble was required for cocaine conditioned place preference. We also observed that NPAS4 functions within NAc D2-, but not D1-, MSNs to support cocaine-context associations and cue-induced cocaine, but not sucrose, seeking. Together, our data show that the NPAS4+ ensemble of NAc neurons is essential for cocaine-context associations in mice, and that NPAS4 itself functions in NAc D2-MSNs to support cocaine-context associations by suppressing drug-induced counteradaptations that oppose relapse-related behaviour.

Reelin marks cocaine-activated striatal ensembles, promotes neuronal excitability, and regulates cocaine reward

Drugs of abuse activate defined neuronal ensembles in brain reward structures such as the nucleus accumbens (NAc), which are thought to promote the enduring synaptic, circuit, and behavioral consequences of drug exposure. While the molecular and cellular effects arising from experience with drugs like cocaine are increasingly well understood, the mechanisms that sculpt NAc ensemble participation are largely unknown. Here, we leveraged unbiased single-nucleus transcriptional profiling to identify expression of the secreted glycoprotein Reelin (encoded by the Reln gene) as a marker of cocaine-activated neuronal ensembles within the rat NAc. Multiplexed in situ detection confirmed selective expression of the immediate early gene Fos in Reln+ neurons after cocaine experience, and also revealed enrichment of Reln mRNA in Drd1 + medium spiny neurons (MSNs) in both the rat and human brain. Using a novel CRISPR interference strategy enabling selective Reln knockdown in the adult NAc, we observed altered expression of genes linked to calcium signaling, emergence of a transcriptional trajectory consistent with loss of cocaine sensitivity, and a striking decrease in MSN intrinsic excitability. At the behavioral level, loss of Reln prevented cocaine locomotor sensitization, abolished cocaine place preference memory, and decreased cocaine self-administration behavior. Together, these results identify Reelin as a critical mechanistic link between ensemble participation and cocaine-induced behavioral adaptations.

A Cocaine-Activated Ensemble Exerts Increased Control Over Behavior While Decreasing in Size

BACKGROUND

Substance use disorder is characterized by long-lasting changes in reward-related brain regions, such as the nucleus accumbens. Previous work has shown that cocaine exposure induces plasticity in broad, genetically defined cell types in the nucleus accumbens; however, in response to a stimulus, only a small percentage of neurons are transcriptionally active-termed an ensemble. Here, we identify an Arc-expressing neuronal ensemble that has a unique trajectory of recruitment and causally controls drug self-administration after repeated, but not acute, cocaine exposure.

METHODS

Using Arc-CreERT2 transgenic mice, we expressed transgenes in Arc+ ensembles activated by cocaine exposure (either acute [1 × 10 mg/kg intraperitoneally] or repeated [10 × 10 mg/kg intraperitoneally]). Using genetic, optical, and physiological recording and manipulation strategies, we assessed the contribution of these ensembles to behaviors associated with substance use disorder.

RESULTS

Repeated cocaine exposure reduced the size of the ensemble while simultaneously increasing its control over behavior. Neurons within the repeated cocaine ensemble were hyperexcitable, and their optogenetic excitation was sufficient for reinforcement. Finally, lesioning the repeated cocaine, but not the acute cocaine, ensemble blunted cocaine self-administration. Thus, repeated cocaine exposure reduced the size of the ensemble while simultaneously increasing its contributions to drug reinforcement.

CONCLUSIONS

We showed that repeated, but not acute, cocaine exposure induced a physiologically distinct ensemble characterized by the expression of the immediate early gene Arc, which was uniquely capable of modulating reinforcement behavior.

Relapse after electric barrier-induced voluntary abstinence: A review

Relapse to drug use during abstinence is a defining feature of addiction. To date, however, results from studies using rat relapse/reinstatement models have yet to result in FDA-approved medications for relapse prevention. To address this translational gap, we and others have developed rat models of relapse after voluntary abstinence from drug self-administration. One of these models is the electric barrier conflict model. Here, we introduce the model, and then review studies on behavioral and neuropharmacological mechanisms of cue-induced relapse and incubation of drug seeking (time-dependent increase in drug seeking during abstinence) after electric barrier-induced abstinence. We also briefly discuss future directions and potential clinical implications. One major conclusion of our review is that the brain mechanisms controlling drug relapse after electrical barrier-induced voluntary abstinence are likely distinct from those controlling relapse after homecage forced abstinence.

Engram mechanisms of memory linking and identity

Memories are thought to be stored in neuronal ensembles referred to as engrams. Studies have suggested that when two memories occur in quick succession, a proportion of their engrams overlap and the memories become linked (in a process known as prospective linking) while maintaining their individual identities. In this Review, we summarize the key principles of memory linking through engram overlap, as revealed by experimental and modelling studies. We describe evidence of the involvement of synaptic memory substrates, spine clustering and non-linear neuronal capacities in prospective linking, and suggest a dynamic somato-synaptic model, in which memories are shared between neurons yet remain separable through distinct dendritic and synaptic allocation patterns. We also bring into focus retrospective linking, in which memories become associated after encoding via offline reactivation, and discuss key temporal and mechanistic differences between prospective and retrospective linking, as well as the potential differences in their cognitive outcomes.

Hippocampus-to-amygdala pathway drives the separation of remote memories of related events

The mammalian brain can store and retrieve memories of related events as distinct memories and remember common features of those experiences. How it computes this function remains elusive. Here, we show in rats that recent memories of two closely timed auditory fear events share overlapping neuronal ensembles in the basolateral amygdala (BLA) and are functionally linked. However, remote memories have reduced neuronal overlap and are functionally independent. The activity of parvalbumin (PV)-expressing neurons in the BLA plays a crucial role in forming separate remote memories. Chemogenetic blockade of PV preserves individual remote memories but prevents their segregation, resulting in reciprocal associations. The hippocampus drives this process through specific excitatory connections with BLA GABAergic interneurons. These findings provide insights into the neuronal mechanisms that minimize the overlap between distinct remote memories and enable the retrieval of related memories separately.

Distinct engrams control fear and extinction memory

Memories are stored in engram cells, which are necessary and sufficient for memory recall. Recalling a memory might undergo reconsolidation or extinction. It has been suggested that the original memory engram is reactivated during reconsolidation so that memory can be updated. Conversely, during extinction training, a new memory is formed that suppresses the original engram. Nonetheless, it is unknown whether extinction creates a new engram or modifies the original fear engram. In this study, we utilized the Daun02 procedure, which uses c-Fos-lacZ rats to induce apoptosis of strongly activated neurons and examine whether a new memory trace emerges as a result of a short or long reactivation, or if these processes rely on modifications within the original engram located in the basolateral amygdala (BLA) and infralimbic (IL) cortex. By eliminating neurons activated during consolidation and reactivation, we observed significant impacts on fear memory, highlighting the importance of the BLA engram in these processes. Although we were unable to show any impact when removing the neurons activated after the test of a previously extinguished memory in the BLA, disrupting the IL extinction engram reactivated the aversive memory that was suppressed by the extinction memory. Thus, we demonstrated that the IL cortex plays a crucial role in the network involved in extinction, and disrupting this specific node alone is sufficient to impair extinction behavior. Additionally, our findings indicate that extinction memories rely on the formation of a new memory, supporting the theory that extinction memories rely on the formation of a new memory, whereas the reconsolidation process reactivates the same original memory trace.

Nucleus accumbens neuronal ensembles vary with cocaine reinforcement in male and female rats

Neuronal ensembles in the medial prefrontal cortex mediate cocaine self-administration via projections to the nucleus accumbens. We have recently shown that neuronal ensembles in the prelimbic cortex form rapidly to mediate cocaine self-administration. However, the role of neuronal ensembles within the nucleus accumbens in initial cocaine-seeking behaviour remains unknown. Here, we sought to expand the current literature by testing the necessity of the cocaine self-administration ensemble in the nucleus accumbens core (NAcCore) 1 day after male and female rats acquire cocaine self-administration by using the Daun02 inactivation procedure. We found that disrupting the NAcCore ensembles after a no-cocaine reward-seeking test increased subsequent cocaine seeking, while disrupting NAcCore ensembles following a cocaine self-administration session decreased subsequent cocaine seeking. We then characterized neuronal cell type in the NAcCore using RNAscope in situ hybridization. In the no-cocaine session, we saw reduced dopamine D1 type neuronal activation, while in the cocaine self-administration session, we found preferential dopamine D1 type neuronal activity in the NAcCore.

Mystery of the memory engram: History, current knowledge, and unanswered questions

The quest to understand the memory engram has intrigued humans for centuries. Recent technological advances, including genetic labelling, imaging, optogenetic and chemogenetic techniques, have propelled the field of memory research forward. These tools have enabled researchers to create and erase memory components. While these innovative techniques have yielded invaluable insights, they often focus on specific elements of the memory trace. Genetic labelling may rely on a particular immediate early gene as a marker of activity, optogenetics may activate or inhibit one specific type of neuron, and imaging may capture activity snapshots in a given brain region at specific times. Yet, memories are multifaceted, involving diverse arrays of neuronal subpopulations, circuits, and regions that work in concert to create, store, and retrieve information. Consideration of contributions of both excitatory and inhibitory neurons, micro and macro circuits across brain regions, the dynamic nature of active ensembles, and representational drift is crucial for a comprehensive understanding of the complex nature of memory.

Exploring the memory: existing activity-dependent tools to tag and manipulate engram cells

The theory of engrams, proposed several years ago, is highly crucial to understanding the progress of memory. Although it significantly contributes to identifying new treatments for cognitive disorders, it is limited by a lack of technology. Several scientists have attempted to validate this theory but failed. With the increasing availability of activity-dependent tools, several researchers have found traces of engram cells. Activity-dependent tools are based on the mechanisms underlying neuronal activity and use a combination of emerging molecular biological and genetic technology. Scientists have used these tools to tag and manipulate engram neurons and identified numerous internal connections between engram neurons and memory. In this review, we provide the background, principles, and selected examples of applications of existing activity-dependent tools. Using a combination of traditional definitions and concepts of engram cells, we discuss the applications and limitations of these tools and propose certain developmental directions to further explore the functions of engram cells.

All IEGs Are Not Created Equal-Molecular Sorting Within the Memory Engram

When neurons are recruited to form the memory engram, they are driven to activate the expression of a series of immediate-early genes (IEGs). While these IEGs have been used relatively indiscriminately to identify the so-called engram neurons, recent research has demonstrated that different IEG ensembles can be physically and functionally distinct within the memory engram. This inherent heterogeneity of the memory engram is driven by the diversity in the functions and distributions of different IEGs. This process, which we call molecular sorting, is analogous to sorting the entire population of engram neurons into different sub-engrams molecularly defined by different IEGs. In this chapter, we will describe the molecular sorting process by systematically reviewing published work on engram ensemble cells defined by the following four major IEGs: Fos, Npas4, Arc, and Egr1. By comparing and contrasting these likely different components of the memory engram, we hope to gain a better understanding of the logic and significance behind the molecular sorting process for memory functions.

Engrams of Fear Memory Attenuation

Fear attenuation is an etiologically relevant process for animal survival, since once acquired information needs to be continuously updated in the face of changing environmental contingencies. Thus, when situations are encountered that were originally perceived as fearful but are no longer so, fear must be attenuated, otherwise, it risks becoming maladaptive. But what happens to the original memory trace of fear during fear attenuation? In this chapter, we review the studies that have started to approach this question from an engram perspective. We find evidence pointing to both the original memory trace of fear being suppressed, as well as it being updated towards safety. These seemingly conflicting results reflect a well-established dichotomy in the field of fear memory attenuation, namely whether fear attenuation is mediated by an inhibitory mechanism that suppresses fear expression, called extinction, or by an updating mechanism that allows the fear memory to reconsolidate in a different form, called reconsolidation-updating. Which of these scenarios takes the upper hand is ultimately influenced by the behavioral paradigms used to induce fear attenuation, but is an important area for further study as the precise cell populations underlying fear attenuation and the molecular mechanisms therein can now be understood at unprecedented resolution.

Approaches and considerations of studying neuronal ensembles: a brief review

First theorized by Hebb, neuronal ensembles have provided a framework for understanding how the mammalian brain operates, especially regarding learning and memory. Neuronal ensembles are discrete, sparsely distributed groups of neurons that become activated in response to a specific stimulus and are thought to provide an internal representation of the world. Beyond the study of region-wide or projection-wide activation, the study of ensembles offers increased specificity and resolution to identify and target specific memories or associations. Neuroscientists interested in the neurobiology of learning, memory, and motivated behavior have used electrophysiological-, calcium-, and protein-based proxies of neuronal activity in preclinical models to better understand the neurobiology of learned and motivated behaviors. Although these three approaches may be used to pursue the same general goal of studying neuronal ensembles, technical differences lead to inconsistencies in the output and interpretation of data. This mini-review highlights some of the methodologies used in electrophysiological-, calcium-, and protein-based studies of neuronal ensembles and discusses their strengths and weaknesses.

Cellular and molecular basis of drug addiction: The role of neuronal ensembles in addiction

Addiction has been conceptualized as a disease of learning and memory. Learned associations between environmental cues and unconditioned rewards induced by drug administration, which play a critical role in addiction, have been shown to be encoded in sparsely distributed populations of neurons called neuronal ensembles. This review aims to highlight how synaptic remodeling and alterations in signaling pathways that occur specifically in neuronal ensembles contribute to the pathogenesis of addiction. Furthermore, a causal link between transcriptional and epigenetic modifications in neuronal ensembles and the development of the addictive state is proposed. Translational studies of molecular and cellular changes in neuronal ensembles that contribute to drug-seeking behavior, will allow the identification of molecular and circuit targets and interventions for substance use disorders.

Quantification of prefrontal cortical neuronal ensembles following conditioned fear learning in a Fos-LacZ transgenic rat with photoacoustic imaging in Vivo

Understanding the neurobiology of complex behaviors requires measurement of activity in the discrete population of active neurons, neuronal ensembles, which control the behavior. Conventional neuroimaging techniques ineffectively measure neuronal ensemble activity in the brain in vivo because they assess the average regional neuronal activity instead of the specific activity of the neuronal ensemble that mediates the behavior. Our functional molecular photoacoustic tomography (FM-PAT) system allows direct imaging of Fos-dependent neuronal ensemble activation in Fos-LacZ transgenic rats in vivo. We tested four experimental conditions and found increased FM-PAT signal in prefrontal cortical areas in rats undergoing conditioned fear or novel context exposure. A parallel immunofluorescence ex vivo study of Fos expression found similar findings. These findings demonstrate the ability of FM-PAT to measure Fos-expressing neuronal ensembles directly in vivo and support a mechanistic role for the prefrontal cortex in higher-order processing of response to specific stimuli or environmental cues.

Advancing the preclinical study of comorbid neuroHIV and substance use disorders: Current perspectives and future directions

Human immunodeficiency virus (HIV) remains a persistent public health concern throughout the world. Substance use disorders (SUDs) are a common comorbidity that can worsen treatment outcomes for people living with HIV. The relationship between HIV infection and SUD outcomes is likely bidirectional, making clear interrogation of neurobehavioral outcomes challenging in clinical populations. Importantly, the mechanisms through which HIV and addictive drugs disrupt homeostatic immune and CNS function appear to be highly overlapping and synergistic within HIV-susceptible reward and motivation circuitry in the central nervous system. Decades of animal research have revealed invaluable insights into mechanisms underlying the pathophysiology SUDs and HIV, although translational studies examining comorbid SUDs and HIV are very limited due to the technical challenges of modeling HIV infection preclinically. In this review, we discuss preclinical animal models of HIV and highlight key pathophysiological characteristics of each model, with a particular emphasis on rodent models of HIV. We then review the implementation of these models in preclinical SUD research and identify key gaps in knowledge in the field. Finally, we discuss how cutting-edge behavioral neuroscience tools, which have revealed key insights into the neurobehavioral mechanisms of SUDs, can be applied to preclinical animal models of HIV to reveal potential, novel treatment avenues for comorbid HIV and SUDs. Here, we argue that future preclinical SUD research would benefit from incorporating comorbidities such as HIV into animal models and would facilitate the discovery of more refined, subpopulation-specific mechanisms and effective SUD prevention and treatment targets.

Activity-dependent labeling and manipulation of fentanyl-recruited striatal ensembles using ArcTRAP approach

Understanding the memory substrates underlying substance abuse requires the permanent tagging and manipulation of drug-recruited neural ensembles. Here, we present a protocol for activity-dependent labeling and chemogenetic manipulation of fentanyl-activated striatal ensembles using the ArcTRAP approach. We outline the necessary steps to breed ArcTRAP mice, prepare drugs and reagents, conduct behavioral training, and perform tagging and manipulation. This approach can be adapted to investigate drug-recruited ensembles in other brain regions, providing a versatile tool for exploring the neural mechanisms underlying addiction. For complete details on the use and execution of this protocol, please refer to Wang et al.1.

Global brain c-Fos profiling reveals major functional brain networks rearrangements after alcohol reexposure

Many fundamental questions on alcohol use disorder (AUD) are frequently difficult to address by examining a single brain structure, but should be viewed from the whole brain perspective. c-Fos is a marker of neuronal activation. Global brain c-Fos profiling in rodents represents a promising platform to study brain functional networks rearrangements in AUD. We used a mouse model of alcohol drinking in IntelliCage. We trained mice to voluntarily drink alcohol, next subjected them to withdrawal and alcohol reexposure. We have developed a dedicated image computational workflow to identify c-Fos-positive cells in three-dimensional images obtained after whole-brain optical clearing and imaging in the light-sheet microscope. We provide a complete list of 169 brain structures with annotated c-Fos expression. We analyzed functional networks, brain modularity and engram index. Brain c-Fos levels in animals reexposed to alcohol were different from both control and binge drinking animals. Structures involved in reward processing, decision making and characteristic for addictive behaviors, such as precommissural nucleus, nucleus Raphe, parts of colliculus and tecta stood out particularly. Alcohol reexposure leads to a massive change of brain modularity including a formation of numerous smaller functional modules grouping structures involved in addiction development. Binge drinking can lead to substantial functional remodeling in the brain. We provide a list of structures that can be used as a target in pharmacotherapy but also point to the networks and modules that can hold therapeutic potential demonstrated by a clinical trial in patients.

The Recruitment of a Neuronal Ensemble in the Central Nucleus of the Amygdala During the First Extinction Episode Has Persistent Effects on Extinction Expression

BACKGROUND

Adaptive behavior depends on the delicate and dynamic balance between acquisition and extinction memories. Disruption of this balance, particularly when the extinction of memory loses control over behavior, is the root of treatment failure of maladaptive behaviors such as substance abuse or anxiety disorders. Understanding this balance requires a better understanding of the underlying neurobiology and its contribution to behavioral regulation.

METHODS

We microinjected Daun02 in Fos-lacZ transgenic rats following a single extinction training episode to delete extinction-recruited neuronal ensembles in the basolateral amygdala (BLA) and central nucleus of the amygdala (CN) and examined their contribution to behavior in an appetitive Pavlovian task. In addition, we used immunohistochemistry and neuronal staining methods to identify the molecular markers of activated neurons in the BLA and CN during extinction learning or retrieval.

RESULTS

CN neurons were preferentially engaged following extinction, and deletion of these extinction-activated ensembles in the CN but not the BLA impaired the retrieval of extinction despite additional extinction training and promoted greater levels of behavioral restoration in spontaneous recovery and reinstatement. Disrupting extinction processing in the CN in turn increased activity in the BLA. Our results also show a specific role for CN PKCδ+ neurons in behavioral inhibition but not during initial extinction learning.

CONCLUSIONS

We showed that the initial extinction-recruited CN ensemble is critical to the acquisition-extinction balance and that greater behavioral restoration does not mean weaker extinction contribution. These findings provide a novel avenue for thinking about the neural mechanisms of extinction and for developing treatments for cue-triggered appetitive behaviors.

Psychostimulant Drugs Activate Cell-type Specific and Topographic cFos Expression in the Lumbar Spinal Cord

Psychostimulant drugs, such as cocaine, d-amphetamine and methylphenidate, alter a wide range of behaviors including locomotor activity and somatosensory perception. These altered behaviors are accompanied by the activation of specific neuronal populations within reward-, emotion- and locomotion-related circuits. However, whether such regulation occurs at the level of the spinal cord, a key node for neural circuits integrating and coordinating sensory and motor functions has never been addressed. By evaluating the temporal and spatial expression pattern of the phosphorylated form of the immediate early gene cFos at Ser32 (pS32-cFos), used as a proxy of neuronal activation, we demonstrate that, in adult male mice, d-amphetamine increases pS32-cFos expression in both inhibitory and excitatory neurons in dorsal and ventral horns at the lumbar spinal cord level. Interestingly, a fraction of neurons activated by a first exposure to d-amphetamine can be re-activated following d-amphetamine re-exposure. Similar expression patterns were observed in response to cocaine and methylphenidate, but not following morphine and dozilcipine administration. Finally, the blockade of dopamine reuptake was sufficient to recapitulate the increase in pS32-cFos expression induced by psychostimulant drugs. Our work provides evidence that cFos expression can be activated in lumbar spinal cord in response to acute psychostimulants administration.

Exploring specific biomarkers regarding neurobehavioral toxicity of lead dioxide nanoparticles in medaka fish in different water matrices

Nano-scale lead dioxide (nPbO₂) is an industrial metal oxide nanoparticle that can be also formed as a corrosion by-product from chlorination of Pb-containing plumbing materials. nPbO₂ governs release of toxic lead ion in drinking water and receiving organisms; however, its modes of toxic action regarding neurobehavioral toxicity remain unclear. This study evaluated the toxicity mechanism of nPbO₂ (10 and 20 mg/L) versus its released Pb(II)_aq (100 μg/L) in terms of aqueous chemistry, bioavailability and neurobehavioral toxicity to medaka fish in different water matrices. In very hard water (VHW), dissolved salts enhanced the aggregation and sedimentation of nPbO₂, resulting in higher bioavailability and altered locomotion of treated fish than those fish exposed to nPbO₂ in soft water with humic acid (SW + HA). Transcriptomic results identified six differentially expressed genes with greater altered expression with nPbO₂ than the control or Pb(II)_aq exposure. With VHW exposure, nPbO₂ caused greater altered expression of genes involved in cell adhesion (nlgn1 and epd), cell cytoskeleton (α1-tubulin), and relevant apoptosis (c-fos, birc5.1-a and casp3), as compared with SW + HA or Pb(II)_aq exposure. This study provides novel molecular mechanistic insights into the neurobehavioral nanotoxicity using nPbO₂ and medaka fish as surrogates, suggesting nPbO₂ promotes neurobehavioral dysfunction, leading to adverse outcomes from gene alteration to the organismal level. The identified biomarkers responded specifically to the nPbO₂-induced neurotoxicity in different water matrices can be used for evaluating toxicity risks of small metal oxide particulates on human or aquatic life under environmentally relevant exposures.

Role of ventral subiculum neuronal ensembles in incubation of oxycodone craving after electric barrier-induced voluntary abstinence

High relapse rate is a key feature of opioid addiction. In humans, abstinence is often voluntary due to negative consequences of opioid seeking. To mimic this human condition, we recently introduced a rat model of incubation of oxycodone craving after electric barrier-induced voluntary abstinence. Incubation of drug craving refers to time-dependent increases in drug seeking after cessation of drug self-administration. Here, we used the activity marker Fos, muscimol-baclofen (GABAa + GABAb receptor agonists) global inactivation, Daun02-selective inactivation of putative relapse-associated neuronal ensembles, and fluorescence-activated cell sorting of Fos-positive cells and quantitative polymerase chain reaction to demonstrate a key role of vSub neuronal ensembles in incubation of oxycodone craving after voluntary abstinence, but not homecage forced abstinence. We also used a longitudinal functional magnetic resonance imaging method and showed that functional connectivity changes in vSub-related circuits predict opioid relapse after abstinence induced by adverse consequences of opioid seeking.

Synaptic ensembles between raphe and D1R-containing accumbens shell neurons underlie postisolation sociability in males

Social animals expend considerable energy to maintain social bonds throughout their life. Male and female mice show sexually dimorphic behaviors, yet the underlying neural mechanisms of sociability and their dysregulation during social disconnection remain unknown. Dopaminergic neurons in dorsal raphe nucleus (DRN^TH) is known to contribute to a loneliness-like state and modulate sociability. We identified that activated subpopulations in DRN^TH and nucleus accumbens shell (NAc^sh) during 24 hours of social isolation underlie the increase in isolation-induced sociability in male but not in female mice. This effect was reversed by chemogenetically and optogenetically inhibiting the DRN^TH-NAc^sh circuit. Moreover, synaptic connectivity among the activated neuronal ensembles in this circuit was increased, primarily in D₁ receptor-expressing neurons in NAc^sh. The increase in synaptic density functionally correlated with elevated dopamine release into NAc^sh. Overall, specific synaptic ensembles in DRN^TH-NAc^sh mediate sex differences in isolation-induced sociability, indicating that sex-dependent circuit dynamics underlie the expression of sexually dimorphic behaviors.

Necessity and recruitment of cue-specific neuronal ensembles within the basolateral amygdala during appetitive reversal learning

Through Pavlovian appetitive conditioning, environmental cues can become predictors of food availability. Over time, however, the food, and thus the value of the associated cues, can change based on environmental variations. This change in outcome necessitates updating of the value of the cue to appropriately alter behavioral responses to these cues. The basolateral amygdala (BLA) is critical in updating the outcomes of learned cues. However, it is unknown if the same BLA neuronal ensembles that are recruited in the initial associative memory are required when the new cue-outcome association is formed during reversal learning. The current study used the Daun02 inactivation method that enables selective targeting and disruption of activated neuronal ensembles in Fos-lacZ transgenic rats. Rats were implanted with bilateral cannulas that target the BLA and underwent appetitive discriminative conditioning in which rats had to discriminate between two auditory stimuli. One stimulus (CS+) co-terminated with food delivery, and the other stimulus was unrewarded (CS-; counterbalanced). Rats were then tested for CS+ or CS- memory retrieval and infused with either Daun02 or a vehicle solution into the BLA to inactivate either CS+ or CS- neuronal ensembles that were activated during that test. To assess if the same neuronal ensembles are necessary to update the value of the new association when the outcomes are changed, rats underwent reversal learning: the CS+ was no longer followed by food (reversal CS-, rCS-), and the CS- was now followed by food (reversal CS+; rCS+). The group that received Daun02 following CS+ session showed a decrease in conditioned responding and increased latency to the rCS- (previously CS+) during the first session of reversal learning, specifically during the first trial. This indicates that the neuronal ensemble that was activated during the recall of the CS+ memory was the same neuronal ensemble needed for learning the new outcome of the same CS, now rCS-. Additionally, the group that received Daun02 following CS- session was slower to respond to the rCS+ (previously CS-) during reversal learning. This indicates that the neuronal ensemble that was activated during the recall of the CS- memory was the same neuronal ensemble needed for learning the new outcome of the same CS. These results demonstrate that different neuronal ensembles within the BLA mediate memory recall of CS+ and CS- cues and reactivation of each cue-specific neuronal ensemble is necessary to update the value of that specific cue to respond appropriately during reversal learning. These results also indicate substantial plasticity within the BLA for behavioral flexibility as both groups eventually showed similar terminal levels of reversal learning.

Neuronal circuitry for recognition memory of object and place in rodent models

Rats and mice are used for studying neuronal circuits underlying recognition memory due to their ability to spontaneously remember the occurrence of an object, its place and an association of the object and place in a particular environment. A joint employment of lesions, pharmacological interventions, optogenetics and chemogenetics is constantly expanding our knowledge of the neural basis for recognition memory of object, place, and their association. In this review, we summarize current studies on recognition memory in rodents with a focus on the novel object preference, novel location preference and object-in-place paradigms. The evidence suggests that the medial prefrontal cortex- and hippocampus-connected circuits contribute to recognition memory for object and place. Under certain conditions, the striatum, medial septum, amygdala, locus coeruleus and cerebellum are also involved. We propose that the neuronal circuitry for recognition memory of object and place is hierarchically connected and constructed by different cortical (perirhinal, entorhinal and retrosplenial cortices), thalamic (nucleus reuniens, mediodorsal and anterior thalamic nuclei) and primeval (hypothalamus and interpeduncular nucleus) modules interacting with the medial prefrontal cortex and hippocampus.

From ensembles to meta-ensembles: Specific reward encoding by correlated network activity

Neuronal ensembles are local, sparsely distributed populations of neurons that are reliably re-activated by a specific stimulus, context or task. Such discrete cell populations can be defined either functionally, by electrophysiological recordings or in vivo calcium imaging, or anatomically, using the expression of markers such as the immediate early gene cFos. A typical example of tasks that involve the formation of neuronal ensembles is reward learning, such as the cue-reward pairing during operant conditioning. These ensembles are re-activated during cue-presentation and increasing evidence suggests that this re-activation is the neurophysiological basis for the execution of reward-seeking behavior. Whilst the pursuit of rewards is a common daily activity, it is also related to the consumption of drugs, such as alcohol, and may result in problematic behaviors including addiction. Recent research has identified neuronal ensembles in several reward-related brain regions that control distinct aspects of a conditioned response, e.g., contextual information about the availability of a specific reward or the actions needed to retrieve this reward under the given circumstances. Here, we review studies using the activity marker cFos to identify and characterize neuronal ensembles related to alcohol and non-drug rewards with a special emphasis on the discrimination between different rewards by meta-ensembles, i.e., by dynamic co-activation of multiple ensembles across different brain areas.

Prelimbic Ensembles Mediate Cocaine Seeking After Behavioral Acquisition and Once Rats Are Well-Trained

Substance use disorder (SUD) is a chronic relapsing condition characterized by continued use of drugs despite negative consequences. SUD is thought to involve disordered learning and memory wherein drug-paired cues gain increased salience, and ultimately drive craving and relapse. These types of associations are thought to be encoded within sparsely distributed sets of neurons, called neuronal ensembles, that drive encoded behaviors through synchronous activity of the participant neurons. We have previously found that Fos-expressing neuronal ensembles within the prefrontal cortex are required for well-trained cocaine seeking. However, less is known about how quickly cortical neuronal ensembles form during the initiation of cocaine seeking behavior. Here, we seek to further elucidate the role of Fos-expressing neuronal ensembles within the prelimbic cortex (PL) after the initial acquisition of cocaine self-administration (SA), or, after 10 days of additional SA training (well-trained). We trained Fos-LacZ transgenic rats to lever press for cocaine under an FR1 schedule of reinforcement. Once rats met acquisition criteria for cocaine self-administration, we ablated Fos-expressing neuronal ensembles in the PL using the Daun02 inactivation method, either 1 or 10 days after the rats met the acquisition criteria. Targeted ablation of Fos-expressing neuronal ensembles in the PL attenuated active lever pressing both 1 day and 10 days after rats acquired cocaine self-administration. Together, this suggests that Fos-expressing neuronal ensembles rapidly form in the PL and continue to mediate maintained cocaine seeking behavior.

Epigenetic Effects of Addictive Drugs in the Nucleus Accumbens

Substance use induces long-lasting behavioral changes and drug craving. Increasing evidence suggests that epigenetic gene regulation contributes to the development and expression of these long-lasting behavioral alterations. Here we systematically review extensive evidence from rodent models of drug-induced changes in epigenetic regulation and epigenetic regulator proteins. We focus on histone acetylation and histone methylation in a brain region important for drug-related behaviors: the nucleus accumbens. We also discuss how experimentally altering these epigenetic regulators via systemically administered compounds or nucleus accumbens-specific manipulations demonstrate the importance of these proteins in the behavioral effects of drugs and suggest potential therapeutic value to treat people with substance use disorder. Finally, we discuss limitations and future directions for the field of epigenetic studies in the behavioral effects of addictive drugs and suggest how to use these insights to develop efficacious treatments.

Understanding the physical basis of memory: Molecular mechanisms of the engram

Memory, defined as the storage and use of learned information in the brain, is necessary to modulate behavior and critical for animals to adapt to their environments and survive. Despite being a cornerstone of brain function, questions surrounding the molecular and cellular mechanisms of how information is encoded, stored, and recalled remain largely unanswered. One widely held theory is that an engram is formed by a group of neurons that are active during learning, which undergoes biochemical and physical changes to store information in a stable state, and that are later reactivated during recall of the memory. In the past decade, the development of engram labeling methodologies has proven useful to investigate the biology of memory at the molecular and cellular levels. Engram technology allows the study of individual memories associated with particular experiences and their evolution over time, with enough experimental resolution to discriminate between different memory processes: learning (encoding), consolidation (the passage from short-term to long-term memories), and storage (the maintenance of memory in the brain). Here, we review the current understanding of memory formation at a molecular and cellular level by focusing on insights provided using engram technology.

SMART: An Open-Source Extension of WholeBrain for Intact Mouse Brain Registration and Segmentation

Mapping immediate early gene (IEG) expression across intact mouse brains allows for unbiased identification of brain-wide activity patterns underlying complex behaviors. Accurate registration of sample brains to a common anatomic reference is critical for precise assignment of IEG-positive ("active") neurons to known brain regions of interest (ROIs). While existing automated voxel-based registration methods provide a high-throughput solution, they require substantial computing power, can be difficult to implement and fail when brains are damaged or only partially imaged. Additionally, it is challenging to cross-validate these approaches or compare them to any preexisting literature based on serial coronal sectioning. Here, we present the open-source R package SMART (Semi-Manual Alignment to Reference Templates) that extends the WholeBrain R package framework to automated segmentation and semi-automated registration of intact mouse brain light-sheet fluorescence microscopy (LSFM) datasets. The SMART package was created for novice programmers and introduces a streamlined pipeline for aligning, registering, and segmenting LSFM volumetric datasets across the anterior-posterior (AP) axis, using a simple "choice game" and interactive menus. SMART provides the flexibility to register whole brains, partial brains or discrete user-chosen images, and is fully compatible with traditional sectioned coronal slice-based analyses. We demonstrate SMART's core functions using example datasets and provide step-by-step video tutorials for installation and implementation of the package. We also present a modified iDISCO+ tissue clearing procedure for uniform immunohistochemical labeling of the activity marker Fos across intact mouse brains. The SMART pipeline, in conjunction with the modified iDISCO+ Fos procedure, is ideally suited for examination and orthogonal cross-validation of brain-wide neuronal activation datasets.

Fos-expressing neuronal ensembles in rat infralimbic cortex encode initial and maintained oxycodone seeking in rats

Neuronal ensembles within the infralimbic cortex (IL) and their projections to the nucleus accumbens (NAc) mediate opiate seeking in well-trained rats. However, it is unclear how early this circuitry is recruited during oxycodone self-administration. Here, we used retrograde labelling (CTb) and immunohistochemistry to identify NAc-projecting neurons in the IL that were activated during initial oxycodone seeking. Next, we sought to determine the role of IL neuronal ensembles in initial oxycodone self-administration. We used the Daun02 procedure in male and female Fos-LacZ rats to chemogenetically inactivate IL Fos-expressing neurons at different time points in oxycodone self-administration training: immediately after meeting criteria for acquisition of behaviour and following nine daily sessions with increasing schedules of reinforcement (FR1, FR2 and FR3) in which rats demonstrated stable oxycodone intake under increasing effort to self-administer. We found that Daun02 infusions attenuated oxycodone seeking at both the initial learning and well-trained time points. These results suggest that IL neuronal ensembles are formed during initial learning of oxycodone self-administration and required for the maintenance and expression of oxycodone seeking.

Melding Synthetic Molecules and Genetically Encoded Proteins to Forge New Tools for Neuroscience

Unraveling the complexity of the brain requires sophisticated methods to probe and perturb neurobiological processes with high spatiotemporal control. The field of chemical biology has produced general strategies to combine the molecular specificity of small-molecule tools with the cellular specificity of genetically encoded reagents. Here, we survey the application, refinement, and extension of these hybrid small-molecule:protein methods to problems in neuroscience, which yields powerful reagents to precisely measure and manipulate neural systems. Expected final online publication date for the Annual Review of Neuroscience, Volume 45 is July 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

ΔFOSB: A Potentially Druggable Master Orchestrator of Activity-Dependent Gene Expression

ΔFOSB is a uniquely stable member of the FOS family of immediate early gene AP1 transcription factors. Its accumulation in specific cell types and tissues in response to a range of chronic stimuli is associated with biological phenomena as diverse as memory formation, drug addiction, stress resilience, and immune cell activity. Causal connections between ΔFOSB expression and the physiological and behavioral sequelae of chronic stimuli have been established in rodent and, in some cases, primate models for numerous healthy and pathological states with such preclinical observations often supported by human data demonstrating tissue-specific ΔFOSB expression associated with several specific syndromes. However, the viability of ΔFOSB as a target for therapeutic intervention might be questioned over presumptive concerns of side effects given its expression in such a wide range of cell types and circumstances. Here, we summarize numerous insights from the past three decades of research into ΔFOSB structure, function, mechanisms of induction, and regulation of target genes that support its potential as a druggable target. We pay particular attention to the potential for targeting distinct ΔFOSB isoforms or distinct ΔFOSB-containing multiprotein complexes to achieve cell type or tissue specificity to overcome off-target concerns. We also cover critical gaps in knowledge that currently limit the exploitation of ΔFOSB's therapeutic possibilities and how they may be addressed. Finally, we summarize both current and potential future strategies for generating small molecules or genetic tools for the manipulation of ΔFOSB in the clinic.

Direct measurement of neuronal ensemble activity using photoacoustic imaging in the stimulated Fos-LacZ transgenic rat brain: A proof-of-principle study

Measuring neuroactivity underlying complex behaviors facilitates understanding the microcircuitry that supports these behaviors. We have developed a functional and molecular photoacoustic tomography (F/M-PAT) system which allows direct imaging of Fos-expressing neuronal ensembles in Fos-LacZ transgenic rats with a large field-of-view and high spatial resolution. F/M-PAT measures the beta-galactosidase catalyzed enzymatic product of exogenous chromophore X-gal within ensemble neurons. We used an ex vivo imaging method in the Wistar Fos-LacZ transgenic rat, to detect neuronal ensembles in medial prefrontal cortex (mPFC) following cocaine administration or a shock-tone paired stimulus. Robust and selective F/M-PAT signal was detected in mPFC neurons after both conditions (compare to naive controls) demonstrating successful and direct detection of Fos-expressing neuronal ensembles using this approach. The results of this study indicate that F/M-PAT can be used in conjunction with Fos-LacZ rats to monitor neuronal ensembles that underlie a range of behavioral processes, such as fear learning or addiction.

Factors modulating the incubation of drug and non-drug craving and their clinical implications

It was suggested in 1986 that cue-induced cocaine craving increases progressively during early abstinence and remains high during extended periods of time. Clinical evidence now supports this hypothesis and that this increase is not specific to cocaine but rather generalize across several drugs of abuse. Investigators have identified an analogous incubation phenomenon in rodents, in which time-dependent increases in cue-induced drug seeking are observed after abstinence from intravenous drug or palatable food self-administration. Incubation of craving is susceptible to variation in magnitude as a function of biological and/or the environmental circumstances surrounding the individual. During the last decade, the neurobiological correlates of the modulatory role of biological (sex, age, genetic factors) and environmental factors (environmental enrichment and physical exercise, sleep architecture, acute and chronic stress, abstinence reinforcement procedures) on incubation of drug craving has been investigated. In this review, we summarized the behavioral procedures adopted, the key underlying neurobiological correlates and clinical implications of these studies.

Dynamic dichotomy of accumbal population activity underlies cocaine sensitization

Locomotor sensitization (LS) is an early behavioral adaptation to addictive drugs, driven by the increase of dopamine in the Nucleus Accumbens (NAc). However, the effect on accumbal population activity remains elusive. Here, we used single-cell calcium imaging in mice to record the activity of dopamine-1-receptor (D1R) and dopamine-2-receptor (D2R) expressing spiny projection neurons (SPNs) during cocaine LS. Acute exposure to cocaine elevated D1R SPN activity and reduced D2R SPN activity, albeit with high variability between neurons. During LS, the number of D1R and D2R neurons responding in opposite directions increased. Moreover, preventing LS by inhibition of the ERK signaling pathway decreased the number of cocaine responsive D1R SPNs, but had little effect on D2R SPNs. These results indicate that accumbal population dichotomy is dynamic and contains a subgroup of D1R SPNs that eventually drives LS. Insights into the drug-related activity dynamics provides a foundation for understanding the circuit-level addiction pathogenesis.

Molecular Tools for Targeted Control of Nerve Cell Electrical Activity. Part II

In modern life sciences, the issue of a specific, exogenously directed manipulation of a cell's biochemistry is a highly topical one. In the case of electrically excitable cells, the aim of the manipulation is to control the cells' electrical activity, with the result being either excitation with subsequent generation of an action potential or inhibition and suppression of the excitatory currents. The techniques of electrical activity stimulation are of particular significance in tackling the most challenging basic problem: figuring out how the nervous system of higher multicellular organisms functions. At this juncture, when neuroscience is gradually abandoning the reductionist approach in favor of the direct investigation of complex neuronal systems, minimally invasive methods for brain tissue stimulation are becoming the basic element in the toolbox of those involved in the field. In this review, we describe three approaches that are based on the delivery of exogenous, genetically encoded molecules sensitive to external stimuli into the nervous tissue. These approaches include optogenetics (overviewed in Part I), as well as chemogenetics and thermogenetics (described here, in Part II), which is significantly different not only in the nature of the stimuli and structure of the appropriate effector proteins, but also in the details of experimental applications. The latter circumstance is an indication that these are rather complementary than competing techniques.

Inactivation of the infralimbic cortex decreases discriminative stimulus-controlled relapse to cocaine seeking in rats

Persistent susceptibility to cue-induced relapse is a cardinal feature of addiction. Discriminative stimuli (DSs) are one type of drug-associated cue that signal drug availability (DS+) or unavailability (DS-) and control drug seeking prior to relapse. We previously established a trial-based procedure in rats to isolate DSs from context, conditioned stimuli, and other drug-associated cues during cocaine self-administration and demonstrated DS-controlled cocaine seeking up to 300 abstinence days. The behavioral and neural mechanisms underlying trial-based DS-control of drug seeking have rarely been investigated. Here we show that following discrimination training in our trial-based procedure, the DS+ and DS- independently control the expression and suppression of cocaine seeking during abstinence. Using microinjections of GABAA + GABAB receptor agonists (muscimol + baclofen) in medial prefrontal cortex, we report that infralimbic, but not prelimbic, subregion of medial prefrontal cortex is critical to persistent DS-controlled relapse to cocaine seeking after prolonged abstinence, but not DS-guided discriminated cocaine seeking or DS-controlled cocaine self-admininstration. Finally, using ex vivo whole-cell recordings from pyramidal neurons in the medial prefrontal cortex, we demonstrate that the disruption of DS-controlled cocaine seeking following infralimbic cortex microinjections of muscimol+baclofen is likely a result of suppression of synaptic transmission in the region via a presynaptic mechanism of action.

Endocannabinoid Modulation of Nucleus Accumbens Microcircuitry and Terminal Dopamine Release

The nucleus accumbens (NAc) is located in the ventromedial portion of the striatum and is vital to valence-based predictions and motivated action. The neural architecture of the NAc allows for complex interactions between various cell types that filter incoming and outgoing information. Dopamine (DA) input serves a crucial role in modulating NAc function, but the mechanisms that control terminal DA release and its effect on NAc neurons continues to be elucidated. The endocannabinoid (eCB) system has emerged as an important filter of neural circuitry within the NAc that locally shapes terminal DA release through various cell type- and site-specific actions. Here, we will discuss how eCB signaling modulates terminal DA release by shaping the activity patterns of NAc neurons and their afferent inputs. We then discuss recent technological advancements that are capable of dissecting how distinct cell types, their afferent projections, and local neuromodulators influence valence-based actions.

Animal Models of Drug Relapse and Craving after Voluntary Abstinence: A Review

Relapse to drug use during abstinence is a defining feature of addiction. During the last several decades, this clinical scenario has been studied at the preclinical level using classic relapse/reinstatement models in which drug seeking is assessed after experimenter-imposed home-cage forced abstinence or extinction of the drug-reinforced responding in the self-administration chambers. To date, however, results from studies using rat relapse/reinstatement models have yet to result in Food and Drug Administration-approved medications for relapse prevention. The reasons for this state of affairs are complex and multifaceted, but one potential reason is that, in humans, abstinence is often self-imposed or voluntary and occurs either because the negative consequences of drug use outweigh the drug's rewarding effects or because of the availability of nondrug alternative rewards that are chosen over the drug. Based on these considerations, we and others have recently developed rat models of relapse after voluntary abstinence, achieved either by introducing adverse consequences to drug taking (punishment) or seeking (electric barrier) or by providing mutually exclusive choices between the self-administered drug and nondrug rewards (palatable food or social interaction). In this review, we provide an overview of these translationally relevant relapse models and discuss recent neuropharmacological findings from studies using these models. We also discuss sex as a biological variable, future directions, and clinical implications of results from relapse studies using voluntary abstinence models. Our main conclusion is that the neuropharmacological mechanisms controlling relapse to drug seeking after voluntary abstinence are often different from the mechanisms controlling relapse after home-cage forced abstinence or reinstatement after extinction. SIGNIFICANCE STATEMENT: This review describes recently developed rat models of relapse after voluntary abstinence, achieved either by introducing adverse consequences to drug taking or seeking or by providing mutually exclusive choices between the self-administered drug and nondrug rewards. This review discusses recent neuropharmacological findings from studies using these models and discusses future directions and clinical implications.

Fos-expressing neuronal ensemble in rat ventromedial prefrontal cortex encodes cocaine seeking but not food seeking in rats

Neuronal ensembles in ventromedial prefrontal cortex (vmPFC) play a role in both cocaine and palatable food seeking. However, it is unknown whether similar or different vmPFC neuronal ensembles mediate food and cocaine seeking. Here, we used the Daun02 inactivation procedure to assess whether the neuronal ensembles mediating food and cocaine seeking can be functionally distinguished. We trained male and female Fos-LacZ rats to self-administer palatable food pellets and cocaine on alternating days for 18 days. We then exposed the rats to a brief nonreinforced food- or cocaine-seeking test to induce Fos and β-gal in neuronal ensembles associated with food or cocaine seeking, respectively and infused Daun02 into vmPFC to ablate the β-gal-expressing ensembles. Two days later, we tested the rats for food or cocaine seeking under extinction conditions. Although inactivation of the food-seeking ensemble did not influence food or cocaine seeking, inactivation of the cocaine-seeking ensemble reduced cocaine seeking but not food seeking. Results indicate that the neuronal ensemble activated by cocaine seeking in vmPFC is functionally separate from the ensemble activated by food seeking.

Food-Seeking Behavior Is Mediated by Fos-Expressing Neuronal Ensembles Formed at First Learning in Rats

Neuronal ensembles in the infralimbic cortex (IL) develop after prolonged food self-administration training. However, rats demonstrate evidence of learning the food self-administration response as early as day 1, with responding quickly increasing to asymptotic levels. Since the contribution of individual brain regions to task performance shifts over the course of training, it remains unclear whether IL ensembles are gradually formed and refined over the course of extensive operant training, or whether functionally-relevant ensembles might be recruited and formed as early as the initial acquisition of food self-administration behavior. Here, we aimed to determine the role of IL ensembles at the earliest possible point after demonstrable learning of a response-outcome association. We first allowed rats to lever press for palatable food pellets and stopped training rats once their behavior evidenced the response-outcome association (learners). We compared their food-seeking behavior and neuronal activation (Fos protein expression) to similarly trained rats that did not form this association (non-learners). Learners had greater food-seeking behavior and neuronal activation within the medial prefrontal cortex (mPFC), suggesting that mPFC subregions might encode initial food self-administration memories. To test the functional relevance of mPFC Fos-expressing ensembles to subsequent food seeking, we tested region-wide inactivation of the IL using muscimol+baclofen and neuronal ensemble-specific ablation using the Daun02 inactivation procedure. Both region-wide inactivation and ensemble-specific inactivation of the IL significantly decreased food seeking. These data suggest that IL neuronal ensembles form during initial learning of food self-administration behavior, and furthermore, that these ensembles play a functional role in food seeking.

A Synaptic Framework for the Persistence of Memory Engrams

The ability to store and retrieve learned information over prolonged periods of time is an essential and intriguing property of the brain. Insight into the neurobiological mechanisms that underlie memory consolidation is of utmost importance for our understanding of memory persistence and how this is affected in memory disorders. Recent evidence indicates that a given memory is encoded by sparsely distributed neurons that become highly activated during learning, so-called engram cells. Research by us and others confirms the persistent nature of cortical engram cells by showing that these neurons are required for memory expression up to at least 1 month after they were activated during learning. Strengthened synaptic connectivity between engram cells is thought to ensure reactivation of the engram cell network during retrieval. However, given the continuous integration of new information into existing neuronal circuits and the relatively rapid turnover rate of synaptic proteins, it is unclear whether a lasting learning-induced increase in synaptic connectivity is mediated by stable synapses or by continuous dynamic turnover of synapses of the engram cell network. Here, we first discuss evidence for the persistence of engram cells and memory-relevant adaptations in synaptic plasticity, and then propose models of synaptic adaptations and molecular mechanisms that may support memory persistence through the maintenance of enhanced synaptic connectivity within an engram cell network.

Egr2 induction in spiny projection neurons of the ventrolateral striatum contributes to cocaine place preference in mice

Drug addiction develops due to brain-wide plasticity within neuronal ensembles, mediated by dynamic gene expression. Though the most common approach to identify such ensembles relies on immediate early gene expression, little is known of how the activity of these genes is linked to modified behavior observed following repeated drug exposure. To address this gap, we present a broad-to-specific approach, beginning with a comprehensive investigation of brain-wide cocaine-driven gene expression, through the description of dynamic spatial patterns of gene induction in subregions of the striatum, and finally address functionality of region-specific gene induction in the development of cocaine preference. Our findings reveal differential cell-type specific dynamic transcriptional recruitment patterns within two subdomains of the dorsal striatum following repeated cocaine exposure. Furthermore, we demonstrate that induction of the IEG Egr2 in the ventrolateral striatum, as well as the cells within which it is expressed, are required for the development of cocaine seeking.

The human brain is ever changing, constantly rewiring itself in response to new experiences, knowledge or information from the environment. Addictive drugs such as cocaine can hijack the genetic mechanisms responsible for this plasticity, creating dangerous, obsessive drug-seeking and consuming behaviors.

Cocaine-induced plasticity is difficult to apprehend, however, as brain regions or even cell populations can react differently to the compound. For instance, sub-regions in the striatum – the brain area that responds to rewards and helps to plan movement – show distinct responses during progressive exposure to cocaine. And while researchers know that the drug immediately changes how neurons switch certain genes on and off, it is still unclear how these genetic modifications later affect behavior.

Mukherjee, Gonzales et al. explored these questions at different scales, first focusing on how progressive cocaine exposure changed the way various gene programs were activated across the entire brain. This revealed that programs in the striatum were the most affected by the drug.

Examining this region more closely showed that cocaine switches on genes in specific ‘spiny projection’ neuron populations, depending on where these cells are located and the drug history of the mouse. Finally, Mukherjee, Gonzales et al. used genetically modified mice to piece together cocaine exposure, genetic changes and modifications in behavior. These experiments revealed that the drive to seek cocaine depended on activation of the Egr2 gene in populations of spiny projection neurons in a specific sub-region of the striatum. The gene, which codes for a protein that regulates how genes are switched on and off, was itself strongly activated by cocaine intake.

Cocaine addiction can have devastating consequences for individuals. Grasping how this drug alters the brain could pave the way for new treatments, while also providing information on the basic mechanisms underlying brain plasticity.

Drug-activated cells: From immediate early genes to neuronal ensembles in addiction

Beyond their rapid rewarding effects, drugs of abuse can durably alter an individual's response to their environment as illustrated by the compulsive drug seeking and risk of relapse triggered by drug-associated stimuli. The persistence of these associations even long after cessation of drug use demonstrates the enduring mark left by drugs on brain reward circuits. However, within these circuits, neuronal populations are differently affected by drug exposure and growing evidence indicates that relatively small subsets of neurons might be involved in the encoding and expression of drug-mediated associations. The identification of sparse neuronal populations recruited in response to drug exposure has benefited greatly from the study of immediate early genes (IEGs) whose induction is critical in initiating plasticity programs in recently activated neurons. In particular, the development of technologies to manipulate IEG-expressing cells has been fundamental to implicate broadly distributed neuronal ensembles coincidently activated by either drugs or drug-associated stimuli and to then causally establish their involvement in drug responses. In this review, we summarize the literature regarding IEG regulation in different learning paradigms and addiction models to highlight their role as a marker of activity and plasticity. As the exploration of neuronal ensembles in addiction improves our understanding of drug-associated memory encoding, it also raises several questions regarding the cellular and molecular characteristics of these discrete neuronal populations as they become incorporated in drug-associated neuronal ensembles. We review recent efforts towards this goal and discuss how they will offer a more comprehensive understanding of addiction pathophysiology.

Alcohol and sweet reward are encoded by distinct meta-ensembles

Cue-reward associations form distinct memories that can drive appetitive behaviors and cravings for both drugs and natural rewards. It is still unclear how such memories are encoded in the brain's reward system. We trained rats to concurrently self-administer either alcohol or a sweet saccharin solution as drug or natural rewards, respectively. Memory recall due to cue exposure reactivated reward-associated functional ensembles in reward-related brain regions, marked by a neural cFos response. While the local ensembles activated by cue presentation for either reward consisted of similar numbers of neurons, using advanced statistical network theory, we found robust reward-specific co-activation patterns across brain regions. Interestingly, the resulting meta-ensemble networks differed by the most influential regions, which in case of saccharin comprised the prefrontal cortex, while for alcohol seeking control shifted to insular cortex with strong involvement of the amygdala. Our results support the view of memory representation as a differential co-activation of local neuronal ensembles. This article is part of the special issue on 'Neurocircuitry Modulating Drug and Alcohol Abuse'.