Distinct Fos-Expressing Neuronal Ensembles in the Ventromedial Prefrontal Cortex Mediate Food Reward and Extinction Memories

A cocaine-activated ensemble exerts increased control over behavior while decreasing in size

BACKGROUND

Substance use disorder (SUD) is characterized by long-lasting changes in reward-related brain regions, such as the nucleus accumbens (NAc). Previous work has shown that cocaine exposure induces plasticity in broad, genetically-defined cell types in the NAc; however, in response to a stimulus, only a small percent of neurons are transcriptionally active - termed an ensemble. Here, we identify an Arc-expressing neuronal ensemble that has a unique trajectory of recruitment and causally controls drug self-administration after repeated, but not acute, cocaine exposure.

METHOD

Using Arc-CreERT2 transgenic mice, we expressed transgenes in Arc+ ensembles activated by cocaine exposure [either acute (1 x 10mg/kg IP), or repeated (10 x 10mg/kg IP)]. Using genetic, optical, and physiological recording and manipulation strategies, we assessed the contribution of these ensembles to behaviors associated with SUD.

RESULTS

Repeated cocaine exposure reduced the size of the ensemble, while simultaneously increasing its control over behavior. Neurons within the repeated cocaine ensemble were hyperexcitable and their optogenetic excitation was sufficient for reinforcement. Finally, lesioning the repeated cocaine, but not acute cocaine, ensemble blunted cocaine self-administration. Thus, repeated cocaine exposure reduced the size of the ensemble while simultaneously increasing its contributions to drug reinforcement.

CONCLUSIONS

We show that repeated, but not acute, cocaine exposure induces a physiologically distinct ensemble characterized by the expression of the immediate early gene Arc, that is uniquely capable of modulating reinforcement behavior.

Cellular and molecular basis of drug addiction: The role of neuronal ensembles in addiction

Addiction has been conceptualized as a disease of learning and memory. Learned associations between environmental cues and unconditioned rewards induced by drug administration, which play a critical role in addiction, have been shown to be encoded in sparsely distributed populations of neurons called neuronal ensembles. This review aims to highlight how synaptic remodeling and alterations in signaling pathways that occur specifically in neuronal ensembles contribute to the pathogenesis of addiction. Furthermore, a causal link between transcriptional and epigenetic modifications in neuronal ensembles and the development of the addictive state is proposed. Translational studies of molecular and cellular changes in neuronal ensembles that contribute to drug-seeking behavior, will allow the identification of molecular and circuit targets and interventions for substance use disorders.

The Role of Ryanodine Receptor 2 in Drug-Associated Learning

Type-2 ryanodine receptor (RyR2) ion channels facilitate the release of Ca 2+ from stores and serve an important function in neuroplasticity. The role for RyR2 in hippocampal-dependent learning and memory is well established and chronic hyperphosphorylation of RyR2 (RyR2P) is associated with pathological calcium leakage and cognitive disorders, including Alzheimer's disease. By comparison, little is known about the role of RyR2 in the ventral medial prefrontal cortex (vmPFC) circuitry important for working memory, decision making, and reward seeking. Here, we evaluated the basal expression and localization of RyR2 and RyR2P in the vmPFC. Next, we employed an operant model of sucrose, cocaine, or morphine self-administration (SA) followed by a (reward-free) recall test, to reengage vmPFC neurons and reactivate reward-seeking and re-evaluated the expression and localization of RyR2 and RyR2P in vmPFC. Under basal conditions, RyR2 was expressed in pyramidal cells but not regularly detected in PV/SST interneurons. On the contrary, RyR2P was rarely observed in PFC somata and was restricted to a different subcompartment of the same neuron - the apical dendrites of layer-5 pyramidal cells. Chronic SA of drug (cocaine or morphine) and nondrug (sucrose) rewards produced comparable increases in RyR2 protein expression. However, recalling either drug reward impaired the usual localization of RyR2P in dendrites and markedly increased its expression in somata immunoreactive for Fos, a marker of highly activated neurons. These effects could not be explained by chronic stress or drug withdrawal and instead appeared to require a recall experience associated with prior drug SA. In addition to showing the differential distribution of RyR2/RyR2P and affirming the general role of vmPFC in reward learning, this study provides information on the propensity of addictive drugs to redistribute RyR2P ion channels in a neuronal population engaged in drug-seeking. Hence, focusing on the early impact of addictive drugs on RyR2 function may serve as a promising approach to finding a treatment for substance use disorders.

Prefrontal cortex melanocortin 4 receptors (MC4R) mediate food intake behavior in male mice

BACKGROUND

Melanocortin 4 receptor (MC4R) activity in the hypothalamus is crucial for regulation of metabolism and food intake. The peptide ligands for the MC4R are associated with feeding, energy expenditure, and also with complex behaviors that orchestrate energy intake and expenditure, but the downstream neuroanatomical and neurochemical targets associated with these behaviors are elusive. In addition to strong expression in the hypothalamus, the MC4R is highly expressed in the medial prefrontal cortex, a region involved in executive function and decision-making.

METHODS

Using viral techniques in genetically modified male mice combined with molecular techniques, we identify and define the effects on feeding behavior of a novel population of MC4R expressing neurons in the infralimbic (IL) region of the cortex.

RESULTS

Here, we describe a novel population of MC4R-expressing neurons in the IL of the mouse prefrontal cortex that are glutamatergic, receive input from melanocortinergic neurons, and project to multiple regions that coordinate appetitive responses to food-related stimuli. The neurons are stimulated by application of MC4R-specific peptidergic agonist, THIQ. Deletion of MC4R from the IL neurons causes increased food intake and body weight gain and impaired executive function in simple food-related behavior tasks.

CONCLUSION

Together, these data suggest that MC4R neurons of the IL play a critical role in the regulation of food intake in male mice.

Altered neuronal activity in the ventromedial prefrontal cortex drives nicotine intake escalation

Nicotine addiction develops after prolonged drug use and escalation of drug intake. However, because of difficulties in demonstrating escalation of nicotine use in rats, its underlying neuroadaptations still remain poorly understood. Here we report that access to unusually high doses of nicotine (i.e., from 30 µg to 240 µg/kg/injection) for self-administration precipitated a rapid and robust escalation of nicotine intake and increased the motivation for the drug in rats. This nicotine intake escalation also induced long-lasting changes in vmPFC neuronal activity both before and during nicotine self-administration. Specifically, after escalation of nicotine intake, basal vmPFC neuronal activity increased above pre-escalation and control activity levels, while ongoing nicotine self-administration restored these neuronal changes. Finally, simulation of the restoring effects of nicotine with in vivo optogenetic inhibition of vmPFC neurons caused a selective de-escalation of nicotine self-administration.

INVOLVEMENT OF CORTICAL PROJECTIONS TO BASOLATERAL AMYGDALA IN CONTEXT-INDUCED REINSTATEMENT OF ETHANOL-SEEKING IN RATS

Ethanol is the most consumed substance of abuse in the world, and its misuse may lead to the development of alcohol use disorder (AUD). High relapse rates remain a relevant problem in the treatment of AUD. Exposure to environmental cues previously associated with ethanol intake could trigger ethanol-seeking behavior. However, the neural mechanisms involved in this phenomenon are not entirely clear. In this context, cortical projections to the basolateral amygdala (BLA) play a role in appetitive and aversive learned behaviors. Therefore, we aimed to evaluate the activation of the cortical projections from the prelimbic (PL), orbitofrontal (OFC), and infralimbic (IL), to the BLA in the context-induced reinstatement of ethanol-seeking. Male Long-Evans rats were trained to self-administer 10% ethanol in Context A. Subsequently, lever pressing in the presence of the discrete cue was extinguished in Context B. After nine extinction sessions, rats underwent intracranial surgery for the unilateral injection of red fluorescent retrograde tracer into the BLA. The context-induced reinstatement of ethanol-seeking was assessed by re-exposing the rats to Context A or B under extinction conditions. Finally, we combined retrograde neuronal tracing with Fos to identify activated cortical inputs to BLA during the reinstatement of ethanol-seeking behavior. We found that PL, but not OFC or IL, retrogradely-labeled neurons from BLA presented increased Fos expression during the re-exposure to the ethanol-associated context, suggesting that PL projection to BLA is involved in the context-induced reinstatement of ethanol-seeking behavior.

Learning processes in relapse to alcohol use: lessons from animal models

RATIONALE

Alcohol use is reliably preceded by discrete and contextual stimuli which, through diverse learning processes, acquire the capacity to promote alcohol use and relapse to alcohol use.

OBJECTIVE

We review contemporary extinction, renewal, reinstatement, occasion setting, and sex differences research within a conditioning framework of relapse to alcohol use to inform the development of behavioural and pharmacological therapies.

KEY FINDINGS

Diverse learning processes and corresponding neurobiological substrates contribute to relapse to alcohol use. Results from animal models indicate that cortical, thalamic, accumbal, hypothalamic, mesolimbic, glutamatergic, opioidergic, and dopaminergic circuitries contribute to alcohol relapse through separable learning processes. Behavioural therapies could be improved by increasing the endurance and generalizability of extinction learning and should incorporate whether discrete cues and contexts influence behaviour through direct excitatory conditioning or occasion setting mechanisms. The types of learning processes that most effectively influence responding for alcohol differ in female and male rats.

CONCLUSION

Sophisticated conditioning experiments suggest that diverse learning processes are mediated by distinct neural circuits and contribute to relapse to alcohol use. These experiments also suggest that gender-specific behavioural and pharmacological interventions are a way towards efficacious therapies to prevent relapse to alcohol use.

Optogenetic stimulation of infralimbic cortex projections to the paraventricular thalamus attenuates context-induced renewal

Contexts associated with prior reinforcement can renew extinguished conditioned responding. The prelimbic (PL) and infralimbic (IL) cortices are thought to mediate the expression and suppression of conditioned responding, respectively. Evidence suggests that PL inputs to the paraventricular nucleus of the thalamus (PVT) drive the expression of cue-induced reinstatement of drug seeking and that IL inputs to the PVT mediate fear extinction retrieval. However, the role of these projections in renewal of appetitive Pavlovian conditioned responding is unknown. We trained male and female Long-Evans rats to associate a conditioned stimulus (CS; 10 s white noise) with delivery of a 10% sucrose unconditioned stimulus (US; .2 ml/CS) to a fluid port in a distinct context (Context A). We then extinguished responding by presenting the CS without the US in a different context (Context B). At test, rats were returned to Context A, and optogenetic stimulation was delivered to either the IL-to-PVT or PL-to-PVT pathway during CS presentations. Optically stimulating the IL-to-PVT, but not the PL-to-PVT pathway, attenuated ABA renewal of CS port entries, and this effect was similar in males and females. Further, rats self-administered optical stimulation of the IL-to-PVT but not the PL-to-PVT pathway suggesting that activation of the IL-to-PVT pathway is reinforcing. The effectiveness of optical stimulation parameters to activate neurons in the IL, PL and PVT was confirmed using Fos immunohistochemistry. These findings provide evidence for novel neural mechanisms in renewal of responding to a sucrose-predictive CS, as well as more generally in contextual processing and appetitive associative learning.

Neural correlates of recall and extinction in a rat model of appetitive Pavlovian conditioning

Extinction is a fundamental form of inhibitory learning that is important for adapting to changing environmental contingencies. While numerous studies have investigated the neural correlates of extinction using Pavlovian fear conditioning and appetitive operant reward-seeking procedures, less is known about the neural circuitry mediating the extinction of appetitive Pavlovian responding. Here, we aimed to generate an extensive brain activation map of extinction learning in a rat model of appetitive Pavlovian conditioning. Male Long-Evans rats were trained to associate a conditioned stimulus (CS; 20 s white noise) with the delivery of a 10% sucrose unconditioned stimulus (US; 0.3 ml/CS) to a fluid port. Control groups also received CS presentations, but sucrose was delivered either during the inter-trial interval or in the home-cage. After conditioning, 1 or 6 extinction sessions were conducted in which the CS was presented but sucrose was withheld. We performed Fos immunohistochemistry and network connectivity analyses on a set of cortical, striatal, thalamic, and amygdalar brain regions. Neural activity in the prelimbic cortex, ventral orbitofrontal cortex, nucleus accumbens core, and paraventricular nucleus of the thalamus was greater during recall relative to extinction. Conversely, prolonged extinction following 6 sessions induced increased neural activity in the infralimbic cortex, medial orbitofrontal cortex, and nucleus accumbens shell compared to home-cage controls. All these structures were similarly recruited during recall on the first extinction session. These findings provide novel evidence for the contribution of brain areas and neural networks that are differentially involved in the recall versus extinction of appetitive Pavlovian conditioned responding.

Infralimbic Projections to the Nucleus Accumbens Shell and Amygdala Regulate the Encoding of Cocaine Extinction Learning

Prior evidence indicates that the infralimbic cortex (IL) mediates the ongoing inhibition of cocaine seeking following self-administration and extinction training in rats, specifically through projections to the nucleus accumbens shell (NAshell). Our own data indicate that IL activity immediately following an unreinforced lever press is critical for encoding the extinction contingencies in such procedures. Whether extinction encoding requires activity in the IL exclusively or also activity in its outputs, such as those to the NAshell and amygdala, is unknown. To address this issue, we used a closed-loop optogenetic approach in female and male Sprague Dawley rats to silence IL-NAshell or IL-amygdala activity following an unreinforced lever press during extinction training. Optical illumination (20 s) was given either immediately after a lever press or following a 20 s delay. IL-NAshell inhibition immediately following an unreinforced lever press increased lever pressing during extinction training and impaired retention of extinction learning, as assessed during subsequent extinction sessions without optical inhibition. Likewise, IL-amygdala inhibition given in the same manner impaired extinction retention during sessions without inhibition. Control experiments indicate that critical encoding of extinction learning does not require activity in these pathways beyond the initial 20 s post-lever press period, as delayed IL-NAshell and IL-amygdala inhibition had no effect on extinction learning. These results suggest that a larger network extending from the IL to the NAshell and amygdala is involved in encoding extinction contingencies following cocaine self-administration.SIGNIFICANCE STATEMENT Infralimbic cortex (IL) activity following an unreinforced lever press during extinction learning encodes the extinction of cocaine-seeking behavior. However, the larger circuitry controlling such encoding has not been investigated. Using closed-loop optogenetic pathway targeting, we found that inhibition of IL projections to the nucleus accumbens shell and to the amygdala impaired the extinction of cocaine seeking. Importantly, these effects were only observed when activity was disrupted during the first 20 s post-lever press and not when given following a 20 s delay. These findings suggest that successful cocaine extinction encoding requires activity across a larger circuit beyond simply inputs to the IL.

The Recruitment of a Neuronal Ensemble in the Central Nucleus of the Amygdala During the First Extinction Episode Has Persistent Effects on Extinction Expression

BACKGROUND

Adaptive behavior depends on the delicate and dynamic balance between acquisition and extinction memories. Disruption of this balance, particularly when the extinction of memory loses control over behavior, is the root of treatment failure of maladaptive behaviors such as substance abuse or anxiety disorders. Understanding this balance requires a better understanding of the underlying neurobiology and its contribution to behavioral regulation.

METHODS

We microinjected Daun02 in Fos-lacZ transgenic rats following a single extinction training episode to delete extinction-recruited neuronal ensembles in the basolateral amygdala (BLA) and central nucleus of the amygdala (CN) and examined their contribution to behavior in an appetitive Pavlovian task. In addition, we used immunohistochemistry and neuronal staining methods to identify the molecular markers of activated neurons in the BLA and CN during extinction learning or retrieval.

RESULTS

CN neurons were preferentially engaged following extinction, and deletion of these extinction-activated ensembles in the CN but not the BLA impaired the retrieval of extinction despite additional extinction training and promoted greater levels of behavioral restoration in spontaneous recovery and reinstatement. Disrupting extinction processing in the CN in turn increased activity in the BLA. Our results also show a specific role for CN PKCδ+ neurons in behavioral inhibition but not during initial extinction learning.

CONCLUSIONS

We showed that the initial extinction-recruited CN ensemble is critical to the acquisition-extinction balance and that greater behavioral restoration does not mean weaker extinction contribution. These findings provide a novel avenue for thinking about the neural mechanisms of extinction and for developing treatments for cue-triggered appetitive behaviors.

Role of ventral subiculum neuronal ensembles in incubation of oxycodone craving after electric barrier-induced voluntary abstinence

High relapse rate is a key feature of opioid addiction. In humans, abstinence is often voluntary due to negative consequences of opioid seeking. To mimic this human condition, we recently introduced a rat model of incubation of oxycodone craving after electric barrier-induced voluntary abstinence. Incubation of drug craving refers to time-dependent increases in drug seeking after cessation of drug self-administration. Here, we used the activity marker Fos, muscimol-baclofen (GABAa + GABAb receptor agonists) global inactivation, Daun02-selective inactivation of putative relapse-associated neuronal ensembles, and fluorescence-activated cell sorting of Fos-positive cells and quantitative polymerase chain reaction to demonstrate a key role of vSub neuronal ensembles in incubation of oxycodone craving after voluntary abstinence, but not homecage forced abstinence. We also used a longitudinal functional magnetic resonance imaging method and showed that functional connectivity changes in vSub-related circuits predict opioid relapse after abstinence induced by adverse consequences of opioid seeking.

Diverging Effects of Adolescent Ethanol Exposure on Tripartite Synaptic Development across Prefrontal Cortex Subregions

Adolescence is a developmental period that encompasses, but is not limited to, puberty and continues into early adulthood. During this period, maturation and refinement are observed across brain regions such as the prefrontal cortex (PFC), which is critical for cognitive function. Adolescence is also a time when excessive alcohol consumption in the form of binge drinking peaks, increasing the risk of long-term cognitive deficits and the risk of developing an alcohol use disorder later in life. Animal models have revealed that adolescent ethanol (EtOH) exposure results in protracted disruption of neuronal function and performance on PFC-dependent tasks that require higher-order decision-making. However, the role of astrocytes in EtOH-induced disruption of prefrontal cortex-dependent function has yet to be elucidated. Astrocytes have complex morphologies with an extensive network of peripheral astrocyte processes (PAPs) that ensheathe pre- and postsynaptic terminals to form the 'tripartite synapse.' At the tripartite synapse, astrocytes play several critical roles, including synaptic maintenance, dendritic spine maturation, and neurotransmitter clearance through proximity-dependent interactions. Here, we investigate the effects of adolescent binge EtOH exposure on astrocyte morphology, PAP-synaptic proximity, synaptic stabilization proteins, and dendritic spine morphology in subregions of the PFC that are important in the emergence of higher cognitive function. We found that adolescent binge EtOH exposure resulted in subregion specific changes in astrocyte morphology and astrocyte-neuronal interactions. While this did not correspond to a loss of astrocytes, synapses, or dendritic spines, there was a corresponding region-specific and EtOH-dependent shift in dendritic spine phenotype. Lastly, we found that changes in astrocyte-neuronal interactions were not a consequence of changes in the expression of key synaptic structural proteins neurexin, neuroligin 1, or neuroligin 3. These data demonstrate that adolescent EtOH exposure results in enduring effects on neuron-glia interactions that persist into adulthood in a subregion-specific PFC manner, suggesting selective vulnerability. Further work is necessary to understand the functional and behavioral implications.

Necessity and recruitment of cue-specific neuronal ensembles within the basolateral amygdala during appetitive reversal learning

Through Pavlovian appetitive conditioning, environmental cues can become predictors of food availability. Over time, however, the food, and thus the value of the associated cues, can change based on environmental variations. This change in outcome necessitates updating of the value of the cue to appropriately alter behavioral responses to these cues. The basolateral amygdala (BLA) is critical in updating the outcomes of learned cues. However, it is unknown if the same BLA neuronal ensembles that are recruited in the initial associative memory are required when the new cue-outcome association is formed during reversal learning. The current study used the Daun02 inactivation method that enables selective targeting and disruption of activated neuronal ensembles in Fos-lacZ transgenic rats. Rats were implanted with bilateral cannulas that target the BLA and underwent appetitive discriminative conditioning in which rats had to discriminate between two auditory stimuli. One stimulus (CS+) co-terminated with food delivery, and the other stimulus was unrewarded (CS-; counterbalanced). Rats were then tested for CS+ or CS- memory retrieval and infused with either Daun02 or a vehicle solution into the BLA to inactivate either CS+ or CS- neuronal ensembles that were activated during that test. To assess if the same neuronal ensembles are necessary to update the value of the new association when the outcomes are changed, rats underwent reversal learning: the CS+ was no longer followed by food (reversal CS-, rCS-), and the CS- was now followed by food (reversal CS+; rCS+). The group that received Daun02 following CS+ session showed a decrease in conditioned responding and increased latency to the rCS- (previously CS+) during the first session of reversal learning, specifically during the first trial. This indicates that the neuronal ensemble that was activated during the recall of the CS+ memory was the same neuronal ensemble needed for learning the new outcome of the same CS, now rCS-. Additionally, the group that received Daun02 following CS- session was slower to respond to the rCS+ (previously CS-) during reversal learning. This indicates that the neuronal ensemble that was activated during the recall of the CS- memory was the same neuronal ensemble needed for learning the new outcome of the same CS. These results demonstrate that different neuronal ensembles within the BLA mediate memory recall of CS+ and CS- cues and reactivation of each cue-specific neuronal ensemble is necessary to update the value of that specific cue to respond appropriately during reversal learning. These results also indicate substantial plasticity within the BLA for behavioral flexibility as both groups eventually showed similar terminal levels of reversal learning.

From ensembles to meta-ensembles: Specific reward encoding by correlated network activity

Neuronal ensembles are local, sparsely distributed populations of neurons that are reliably re-activated by a specific stimulus, context or task. Such discrete cell populations can be defined either functionally, by electrophysiological recordings or in vivo calcium imaging, or anatomically, using the expression of markers such as the immediate early gene cFos. A typical example of tasks that involve the formation of neuronal ensembles is reward learning, such as the cue-reward pairing during operant conditioning. These ensembles are re-activated during cue-presentation and increasing evidence suggests that this re-activation is the neurophysiological basis for the execution of reward-seeking behavior. Whilst the pursuit of rewards is a common daily activity, it is also related to the consumption of drugs, such as alcohol, and may result in problematic behaviors including addiction. Recent research has identified neuronal ensembles in several reward-related brain regions that control distinct aspects of a conditioned response, e.g., contextual information about the availability of a specific reward or the actions needed to retrieve this reward under the given circumstances. Here, we review studies using the activity marker cFos to identify and characterize neuronal ensembles related to alcohol and non-drug rewards with a special emphasis on the discrimination between different rewards by meta-ensembles, i.e., by dynamic co-activation of multiple ensembles across different brain areas.

Prelimbic Ensembles Mediate Cocaine Seeking After Behavioral Acquisition and Once Rats Are Well-Trained

Substance use disorder (SUD) is a chronic relapsing condition characterized by continued use of drugs despite negative consequences. SUD is thought to involve disordered learning and memory wherein drug-paired cues gain increased salience, and ultimately drive craving and relapse. These types of associations are thought to be encoded within sparsely distributed sets of neurons, called neuronal ensembles, that drive encoded behaviors through synchronous activity of the participant neurons. We have previously found that Fos-expressing neuronal ensembles within the prefrontal cortex are required for well-trained cocaine seeking. However, less is known about how quickly cortical neuronal ensembles form during the initiation of cocaine seeking behavior. Here, we seek to further elucidate the role of Fos-expressing neuronal ensembles within the prelimbic cortex (PL) after the initial acquisition of cocaine self-administration (SA), or, after 10 days of additional SA training (well-trained). We trained Fos-LacZ transgenic rats to lever press for cocaine under an FR1 schedule of reinforcement. Once rats met acquisition criteria for cocaine self-administration, we ablated Fos-expressing neuronal ensembles in the PL using the Daun02 inactivation method, either 1 or 10 days after the rats met the acquisition criteria. Targeted ablation of Fos-expressing neuronal ensembles in the PL attenuated active lever pressing both 1 day and 10 days after rats acquired cocaine self-administration. Together, this suggests that Fos-expressing neuronal ensembles rapidly form in the PL and continue to mediate maintained cocaine seeking behavior.

Glial cells in anorexia

Anorexia is a loss of appetite or an inability to eat and is often associated with eating disorders. However, animal anorexia is physiologically regulated as a part of the life cycle; for instance, during hibernation, migration or incubation. Anorexia nervosa (AN), on the other hand, is a common eating disorder among adolescent females that experience an intense fear of gaining weight due to body image distortion that results in voluntary avoidance of food intake and, thus, severe weight loss. It has been shown that the neurobiology of feeding extends beyond the hypothalamus. The prefrontal cortex (PFC) is involved in food choice and body image perception, both relevant in AN. However, little is known about the neurobiology of AN, and the lack of effective treatments justifies the use of animal models. Glial cells, the dominant population of nerve cells in the central nervous system, are key in maintaining brain homeostasis. Accordingly, recent studies suggest that glial function may be compromised by anorexia. In this review, we summarize recent findings about anorexia and glial cells.

A systematic and meta-analytic review on the neural correlates of viewing high- and low-calorie foods among normal-weight adults

In the context of current-day online shopping, people select foods based on pictures and using their visual systems. Although there are some reviews of previous neuroimaging studies on appetitive behaviors, the findings on neural activation in response to pictures of high- and low-calorie foods seem inconsistent. This study aims to systematically review, integrate, and meta-analyze neuroimaging evidence of viewing high- and low-calorie foods. There were 25 samples from 24 studies, totalizing 489 normal-weight participants (311 female, 160 male, and 18 of unknown sex). We conducted a systematic review and Activation Likelihood Estimation (ALE) meta-analysis on viewing high-calorie foods (versus non-foods), low-calorie foods (versus non-foods), and high- versus low-calorie foods. In systematic review, several brain regions were shown to be activated when viewing high- or low-calorie foods (versus non-foods) and viewing high- versus low-calorie foods, including the prefrontal cortex, orbitofrontal cortex, amygdala, insula, ventral striatum, hippocampus, superior parietal lobe, and fusiform gyrus. However, the ALE meta-analysis showed that the left orbitofrontal cortex, left amygdala, insula, superior parietal lobe, and fusiform gyrus were activated when viewing high-calorie foods (versus non-foods); the left fusiform gyrus was activated when viewing low-calorie foods (versus non-foods); and no cluster was activated when viewing high- versus low-calorie foods. Our research suggests an appetitive brain network that includes visual perception and attentional processing, sensory input integration, subjective reward value encoding, decision-making, and top-down cognitive control. Future studies should control for the effects of methodological and physiological variables when examining the neural correlates of viewing high- and low-calorie foods.

Extinction of Cocaine Memory Depends on a Feed-Forward Inhibition Circuit Within the Medial Prefrontal Cortex

BACKGROUND

Cocaine-associated environments (i.e., contexts) evoke persistent memories of cocaine reward and thereby contribute to the maintenance of addictive behavior in cocaine users. From a therapeutic perspective, enhancing inhibitory control over cocaine-conditioned responses is of pivotal importance but requires a more detailed understanding of the neural circuitry that can suppress context-evoked cocaine memories, e.g., through extinction learning. The ventral medial prefrontal cortex (vmPFC) and dorsal medial prefrontal cortex (dmPFC) are thought to bidirectionally regulate responding to cocaine cues through their projections to other brain regions. However, whether these mPFC subregions interact to enable adaptive responding to cocaine-associated contextual stimuli has remained elusive.

METHODS

We used antero- and retrograde tracing combined with chemogenetic intervention to examine the role of vmPFC-to-dmPFC projections in extinction of cocaine-induced place preference in mice. In addition, electrophysiological recordings and optogenetics were used to determine whether parvalbumin-expressing inhibitory interneurons and pyramidal neurons in the dmPFC are innervated by vmPFC projections.

RESULTS

We found that vmPFC-to-dmPFC projecting neurons are activated during unreinforced re-exposure to a cocaine-associated context, and selective suppression of these cells impairs extinction learning. Parvalbumin-expressing inhibitory interneurons in the dmPFC receive stronger monosynaptic excitatory input from vmPFC projections than local dmPFC pyramidal neurons, consequently resulting in disynaptic inhibition of pyramidal neurons. In line with this, we show that chemogenetic suppression of dmPFC parvalbumin-expressing inhibitory interneurons impairs extinction learning.

CONCLUSIONS

Our data reveal that vmPFC projections mediate extinction of a cocaine-associated contextual memory through recruitment of feed-forward inhibition in the dmPFC, thereby providing a novel neuronal substrate that promotes extinction-induced inhibitory control.

Immediate Early Gene c-fos in the Brain: Focus on Glial Cells

The c-fos gene was first described as a proto-oncogene responsible for the induction of bone tumors. A few decades ago, activation of the protein product c-fos was reported in the brain after seizures and other noxious stimuli. Since then, multiple studies have used c-fos as a brain activity marker. Although it has been attributed to neurons, growing evidence demonstrates that c-fos expression in the brain may also include glial cells. In this review, we collect data showing that glial cells also express this proto-oncogene. We present evidence demonstrating that at least astrocytes, oligodendrocytes, and microglia express this immediate early gene (IEG). Unlike neurons, whose expression changes used to be associated with depolarization, glial cells seem to express the c-fos proto-oncogene under the influence of proliferation, differentiation, growth, inflammation, repair, damage, plasticity, and other conditions. The collected evidence provides a complementary view of c-fos as an activity marker and urges the introduction of the glial cell perspective into brain activity studies. This glial cell view may provide additional information related to the brain microenvironment that is difficult to obtain from the isolated neuron paradigm. Thus, it is highly recommended that detection techniques are improved in order to better differentiate the phenotypes expressing c-fos in the brain and to elucidate the specific roles of c-fos expression in glial cells.

Drug versus non-drug behaviors: A dual-reward model of sex differences and neurobiological mechanisms in rats

Substance Use Disorders (SUDs) are an impactful problem characterized by chronic relapse and engagement in drug-related behaviors at the expense of non-drug behaviors. Brain regions implicated in drug and non-drug-related behaviors often overlap, complicating investigations of neurobiological mechanisms underlying SUDs. Here we presented a within-subject model for studying self-administration, reinforcer competition, extinction, and cued reinstatement of cocaine- and food-seeking in rats. Due to differences in cocaine- and food-reinforced behavior, we transformed data to proportions of baseline, revealing increased resistance to extinction and disproportionately greater cued reinstatement of cocaine seeking relative to food seeking. Consistent with previous reports, females showed greater preference for cocaine reinforcement than males, though these findings failed to reach statistical significance. To demonstrate the model's utility for investigating neurobiological mechanisms, we included proof-of-concept calcium imaging data demonstrating the utility of the behavioral model for detecting cellular activity patterns associated with cocaine- and food-seeking behaviors. Future studies utilizing this model should improve understanding of the development and expression of pathological behaviors characteristic of SUDs in humans, sex differences in these behaviors, and their neurobiological correlates. Thus, the model has utility for improving understanding of SUDs, leading to novel treatments to reduce the pathological behaviors associated with SUDs.

The rodent medial prefrontal cortex and associated circuits in orchestrating adaptive behavior under variable demands

Emerging evidence implicates rodent medial prefrontal cortex (mPFC) in tasks requiring adaptation of behavior to changing information from external and internal sources. However, the computations within mPFC and subsequent outputs that determine behavior are incompletely understood. We review the involvement of mPFC subregions, and their projections to the striatum and amygdala in two broad types of tasks in rodents: 1) appetitive and aversive Pavlovian and operant conditioning tasks that engage mPFC-striatum and mPFC-amygdala circuits, and 2) foraging-based tasks that require decision making to optimize reward. We find support for region-specific function of the mPFC, with dorsal mPFC and its projections to the dorsomedial striatum supporting action control with higher cognitive demands, and ventral mPFC engagement in translating affective signals into behavior via discrete projections to the ventral striatum and amygdala. However, we also propose that defined mPFC subdivisions operate as a functional continuum rather than segregated functional units, with crosstalk that allows distinct subregion-specific inputs (e.g., internal, affective) to influence adaptive behavior supported by other subregions.

Fos-expressing neuronal ensembles in rat infralimbic cortex encode initial and maintained oxycodone seeking in rats

Neuronal ensembles within the infralimbic cortex (IL) and their projections to the nucleus accumbens (NAc) mediate opiate seeking in well-trained rats. However, it is unclear how early this circuitry is recruited during oxycodone self-administration. Here, we used retrograde labelling (CTb) and immunohistochemistry to identify NAc-projecting neurons in the IL that were activated during initial oxycodone seeking. Next, we sought to determine the role of IL neuronal ensembles in initial oxycodone self-administration. We used the Daun02 procedure in male and female Fos-LacZ rats to chemogenetically inactivate IL Fos-expressing neurons at different time points in oxycodone self-administration training: immediately after meeting criteria for acquisition of behaviour and following nine daily sessions with increasing schedules of reinforcement (FR1, FR2 and FR3) in which rats demonstrated stable oxycodone intake under increasing effort to self-administer. We found that Daun02 infusions attenuated oxycodone seeking at both the initial learning and well-trained time points. These results suggest that IL neuronal ensembles are formed during initial learning of oxycodone self-administration and required for the maintenance and expression of oxycodone seeking.

Comparison of prefrontal cortex sucrose seeking ensembles engaged in multiple seeking sessions: Context is key

Encoding of memories, including those associated with prior drug or reward, is thought to take place within distinct populations of neurons, termed ensembles. Neuronal ensembles for drug- and reward-seeking have been identified in regions of the medial prefrontal cortex, but much of our understanding of these ensembles is based on experiments that take place in a single reward-associated environment and measure ensemble encoding over short durations of time. In contrast, reward seeking behavior is evident across different reward-associated environments and persists over time. Using TetTag mice and Fos immunohistochemistry, we examined the relationship between persistent sucrose-seeking and ensemble encoding in mice that undergo seeking sessions in the same or different sucrose self-administration contexts 2 weeks apart. We found that prelimbic (PrL) and anterior cingulate cortex ensembles tagged in the first seeking session were highly sensitive to the context in which a second seeking session took place: reactivation of these ensembles was reduced in the same context but elevated in a distinct sucrose self-administration context. Correlational analyses revealed that ensemble reactivation in the PrL was proportional to the persistence of sucrose seeking behavior across sessions in differing ways in female mice. In the same context, reactivation was proportional to the persistence of non-reinforced operant responses, whereas in a distinct context, reactivation was proportional to the persistence of non-reinforced head entries into the sucrose receptacle. This study underlines the importance of the medial prefrontal cortex importance in maintaining a reward-seeking ensemble over time and identifies context-dependent changes in behavioral correlates of ensemble reactivation.

Corticostriatal Suppression of Appetitive Pavlovian Conditioned Responding

The capacity to suppress learned responses is essential for animals to adapt in dynamic environments. Extinction is a process by which animals learn to suppress conditioned responding when an expected outcome is omitted. The infralimbic (IL) cortex to nucleus accumbens shell (NAcS) neural circuit is implicated in suppressing conditioned responding after extinction, especially in the context of operant cocaine-seeking behavior. However, the role of the IL-to-NAcS neural circuit in the extinction of responding to appetitive Pavlovian cues is unknown, and the psychological mechanisms involved in response suppression following extinction are unclear. We trained male Long Evans rats to associate a 10 s auditory conditioned stimulus (CS; 14 trials per session) with a sucrose unconditioned stimulus (US; 0.2 ml per CS) in a specific context, and then following extinction in a different context, precipitated a renewal of CS responding by presenting the CS alone in the original Pavlovian conditioning context. Unilateral, optogenetic stimulation of the IL-to-NAcS circuit selectively during CS trials suppressed renewal. In a separate experiment, IL-to-NAcS stimulation suppressed CS responding regardless of prior extinction and impaired extinction retrieval. Finally, IL-to-NAcS stimulation during the CS did not suppress the acquisition of Pavlovian conditioning but was required for the subsequent expression of CS responding. These results are consistent with multiple studies showing that the IL-to-NAcS neural circuit is involved in the suppression of operant cocaine-seeking, extending these findings to appetitive Pavlovian cues. The suppression of appetitive Pavlovian responding following IL-to-NAcS circuit stimulation, however, does not appear to be an extinction-dependent process.SIGNIFICANCE STATEMENT Extinction is a form of inhibitory learning through which animals learn to suppress conditioned responding in the face of nonreinforcement. We investigated the role of the IL cortex inputs to the NAcS in the extinction of responding to appetitive Pavlovian cues and the psychological mechanisms involved in response suppression following extinction. Using in vivo optogenetics, we found that stimulating the IL-to-NAcS neural circuit suppressed context-induced renewal of conditioned responding after extinction. In a separate experiment, stimulating the IL-to-NAcS circuit suppressed conditioned responding in an extinction-independent manner. These findings can be used by future research aimed at understanding how corticostriatal circuits contribute to behavioral flexibility and mental disorders that involve the suppression of learned behaviors.

Infralimbic cortex functioning across motivated behaviors: Can the differences be reconciled?

The rodent infralimbic cortex (IL) is implicated in higher order executive functions such as reward seeking and flexible decision making. However, the precise nature of its role in these processes is unclear. Early evidence indicated that the IL promotes the extinction and ongoing inhibition of fear conditioning and cocaine seeking. However, evidence spanning other behavioral domains, such as natural reward seeking and habit-based learning, suggests a more nuanced understanding of IL function. As techniques have advanced and more studies have examined IL function, identifying a unifying explanation for its behavioral function has become increasingly difficult. Here, we discuss evidence of IL function across motivated behaviors, including associative learning, drug seeking, natural reward seeking, and goal-directed versus habit-based behaviors, and emphasize how context-specific encoding and heterogeneous IL neuronal populations may underlie seemingly conflicting findings in the literature. Together, the evidence suggests that a major IL function is to facilitate the encoding and updating of contingencies between cues and behaviors to guide subsequent behaviors.

Inactivation of the infralimbic cortex decreases discriminative stimulus-controlled relapse to cocaine seeking in rats

Persistent susceptibility to cue-induced relapse is a cardinal feature of addiction. Discriminative stimuli (DSs) are one type of drug-associated cue that signal drug availability (DS+) or unavailability (DS-) and control drug seeking prior to relapse. We previously established a trial-based procedure in rats to isolate DSs from context, conditioned stimuli, and other drug-associated cues during cocaine self-administration and demonstrated DS-controlled cocaine seeking up to 300 abstinence days. The behavioral and neural mechanisms underlying trial-based DS-control of drug seeking have rarely been investigated. Here we show that following discrimination training in our trial-based procedure, the DS+ and DS- independently control the expression and suppression of cocaine seeking during abstinence. Using microinjections of GABA_A + GABA_B receptor agonists (muscimol + baclofen) in medial prefrontal cortex, we report that infralimbic, but not prelimbic, subregion of medial prefrontal cortex is critical to persistent DS-controlled relapse to cocaine seeking after prolonged abstinence, but not DS-guided discriminated cocaine seeking or DS-controlled cocaine self-admininstration. Finally, using ex vivo whole-cell recordings from pyramidal neurons in the medial prefrontal cortex, we demonstrate that the disruption of DS-controlled cocaine seeking following infralimbic cortex microinjections of muscimol+baclofen is likely a result of suppression of synaptic transmission in the region via a presynaptic mechanism of action.

Circuit selectivity in drug versus natural reward seeking behaviors

Substance use disorder (SUD) is characterized, in part by behavior biased toward drug use and away from natural sources of reward (e.g., social interaction, food, sex). The neurobiological underpinnings of SUDs reveal distinct brain regions where neuronal activity is necessary for the manifestation of SUD-characteristic behaviors. Studies that specifically examine how these regions are involved in behaviors motivated by drug versus natural reward allow determinations of which regions are necessary for regulating seeking of both reward types, and appraisals of novel SUD therapies for off-target effects on behaviors motivated by natural reward. Here, we evaluate studies directly comparing regulatory roles for specific brain regions in drug versus natural reward. While it is clear that many regions drive behaviors motivated by all reward types, based on the literature reviewed we propose a set of interconnected regions that become necessary for behaviors motivated by drug, but not natural rewards. The circuitry is selectively necessary for drug seeking includes an Action/Reward subcircuit, comprising nucleus accumbens, ventral pallidum, and ventral tegmental area, a Prefrontal subcircuit comprising prelimbic, infralimbic, and insular cortices, a Stress subcircuit comprising the central nucleus of the amygdala and the bed nucleus of the stria terminalis, and a Diencephalon circuit including lateral hypothalamus. Evidence was mixed for nucleus accumbens shell, insular cortex, and ventral pallidum. Studies for all other brain nuclei reviewed supported a necessary role in regulating both drug and natural reward seeking. Finally, we discuss emerging strategies to further disambiguate the necessity of brain regions in drug- versus natural reward-associated behaviors.

Fos-expressing neuronal ensemble in rat ventromedial prefrontal cortex encodes cocaine seeking but not food seeking in rats

Neuronal ensembles in ventromedial prefrontal cortex (vmPFC) play a role in both cocaine and palatable food seeking. However, it is unknown whether similar or different vmPFC neuronal ensembles mediate food and cocaine seeking. Here, we used the Daun02 inactivation procedure to assess whether the neuronal ensembles mediating food and cocaine seeking can be functionally distinguished. We trained male and female Fos-LacZ rats to self-administer palatable food pellets and cocaine on alternating days for 18 days. We then exposed the rats to a brief nonreinforced food- or cocaine-seeking test to induce Fos and β-gal in neuronal ensembles associated with food or cocaine seeking, respectively and infused Daun02 into vmPFC to ablate the β-gal-expressing ensembles. Two days later, we tested the rats for food or cocaine seeking under extinction conditions. Although inactivation of the food-seeking ensemble did not influence food or cocaine seeking, inactivation of the cocaine-seeking ensemble reduced cocaine seeking but not food seeking. Results indicate that the neuronal ensemble activated by cocaine seeking in vmPFC is functionally separate from the ensemble activated by food seeking.

Food-Seeking Behavior Is Mediated by Fos-Expressing Neuronal Ensembles Formed at First Learning in Rats

Neuronal ensembles in the infralimbic cortex (IL) develop after prolonged food self-administration training. However, rats demonstrate evidence of learning the food self-administration response as early as day 1, with responding quickly increasing to asymptotic levels. Since the contribution of individual brain regions to task performance shifts over the course of training, it remains unclear whether IL ensembles are gradually formed and refined over the course of extensive operant training, or whether functionally-relevant ensembles might be recruited and formed as early as the initial acquisition of food self-administration behavior. Here, we aimed to determine the role of IL ensembles at the earliest possible point after demonstrable learning of a response-outcome association. We first allowed rats to lever press for palatable food pellets and stopped training rats once their behavior evidenced the response-outcome association (learners). We compared their food-seeking behavior and neuronal activation (Fos protein expression) to similarly trained rats that did not form this association (non-learners). Learners had greater food-seeking behavior and neuronal activation within the medial prefrontal cortex (mPFC), suggesting that mPFC subregions might encode initial food self-administration memories. To test the functional relevance of mPFC Fos-expressing ensembles to subsequent food seeking, we tested region-wide inactivation of the IL using muscimol+baclofen and neuronal ensemble-specific ablation using the Daun02 inactivation procedure. Both region-wide inactivation and ensemble-specific inactivation of the IL significantly decreased food seeking. These data suggest that IL neuronal ensembles form during initial learning of food self-administration behavior, and furthermore, that these ensembles play a functional role in food seeking.

BEHAVIORAL AND NEUROBIOLOGICAL MECHANISMS OF PAVLOVIAN AND INSTRUMENTAL EXTINCTION LEARNING

This article reviews the behavioral neuroscience of extinction, the phenomenon in which a behavior that has been acquired through Pavlovian or instrumental (operant) learning decreases in strength when the outcome that reinforced it is removed. Behavioral research indicates that neither Pavlovian nor operant extinction depends substantially on erasure of the original learning but instead depends on new inhibitory learning that is primarily expressed in the context in which it is learned, as exemplified by the renewal effect. Although the nature of the inhibition may differ in Pavlovian and operant extinction, in either case the decline in responding may depend on both generalization decrement and the correction of prediction error. At the neural level, Pavlovian extinction requires a tripartite neural circuit involving the amygdala, prefrontal cortex, and hippocampus. Synaptic plasticity in the amygdala is essential for extinction learning, and prefrontal cortical inhibition of amygdala neurons encoding fear memories is involved in extinction retrieval. Hippocampal-prefrontal circuits mediate fear relapse phenomena, including renewal. Instrumental extinction involves distinct ensembles in corticostriatal, striatopallidal, and striatohypothalamic circuits as well as their thalamic returns for inhibitory (extinction) and excitatory (renewal and other relapse phenomena) control over operant responding. The field has made significant progress in recent decades, although a fully integrated biobehavioral understanding still awaits.

Acute, but not longer-term, exposure to environmental enrichment attenuates Pavlovian cue-evoked conditioned approach and Fos expression in the prefrontal cortex in mice

Exposure to environmental enrichment can modify the impact of motivationally relevant stimuli. For instance, previous studies in rats have found that even a brief, acute (~1 day), but not chronic, exposure to environmentally enriched (EE) housing attenuates instrumental lever pressing for sucrose-associated cues in a conditioned reinforcement setup. Moreover, acute EE reduces corticoaccumbens activity, as measured by decreases in expression of the neuronal activity marker "Fos." Currently, it is not known whether acute EE also reduces sucrose seeking and corticoaccumbens activity elicited by non-contingent or "forced" exposure to sucrose cues, which more closely resembles cue exposure encountered in daily life. We therefore measured the effects of acute/intermittent (1 day or 6 day of EE prior to test day) versus chronic (EE throughout conditioning lasting until test day) EE on the ability of a Pavlovian sucrose cue to elicit sucrose seeking (conditioned approach) and Fos expression in the medial prefrontal cortex (mPFC), orbitofrontal cortex (OFC), and nucleus accumbens (NAc) in mice. One day, but not 6 day or chronic EE , reduced sucrose seeking and Fos in the deep layers of the dorsal mPFC. By contrast, 1 day, 6 day, and chronic EE all reduced Fos in the shallow layers of the OFC. None of the EE manipulations modulated NAc Fos expression. We reveal how EE reduces behavioral reactivity to sucrose cues by reducing activity in select prefrontal cortical brain areas. Our work further demonstrates the robustness of EE in its ability to modulate various forms of reward-seeking across species.

A Synaptic Framework for the Persistence of Memory Engrams

The ability to store and retrieve learned information over prolonged periods of time is an essential and intriguing property of the brain. Insight into the neurobiological mechanisms that underlie memory consolidation is of utmost importance for our understanding of memory persistence and how this is affected in memory disorders. Recent evidence indicates that a given memory is encoded by sparsely distributed neurons that become highly activated during learning, so-called engram cells. Research by us and others confirms the persistent nature of cortical engram cells by showing that these neurons are required for memory expression up to at least 1 month after they were activated during learning. Strengthened synaptic connectivity between engram cells is thought to ensure reactivation of the engram cell network during retrieval. However, given the continuous integration of new information into existing neuronal circuits and the relatively rapid turnover rate of synaptic proteins, it is unclear whether a lasting learning-induced increase in synaptic connectivity is mediated by stable synapses or by continuous dynamic turnover of synapses of the engram cell network. Here, we first discuss evidence for the persistence of engram cells and memory-relevant adaptations in synaptic plasticity, and then propose models of synaptic adaptations and molecular mechanisms that may support memory persistence through the maintenance of enhanced synaptic connectivity within an engram cell network.

Drug-activated cells: From immediate early genes to neuronal ensembles in addiction

Beyond their rapid rewarding effects, drugs of abuse can durably alter an individual's response to their environment as illustrated by the compulsive drug seeking and risk of relapse triggered by drug-associated stimuli. The persistence of these associations even long after cessation of drug use demonstrates the enduring mark left by drugs on brain reward circuits. However, within these circuits, neuronal populations are differently affected by drug exposure and growing evidence indicates that relatively small subsets of neurons might be involved in the encoding and expression of drug-mediated associations. The identification of sparse neuronal populations recruited in response to drug exposure has benefited greatly from the study of immediate early genes (IEGs) whose induction is critical in initiating plasticity programs in recently activated neurons. In particular, the development of technologies to manipulate IEG-expressing cells has been fundamental to implicate broadly distributed neuronal ensembles coincidently activated by either drugs or drug-associated stimuli and to then causally establish their involvement in drug responses. In this review, we summarize the literature regarding IEG regulation in different learning paradigms and addiction models to highlight their role as a marker of activity and plasticity. As the exploration of neuronal ensembles in addiction improves our understanding of drug-associated memory encoding, it also raises several questions regarding the cellular and molecular characteristics of these discrete neuronal populations as they become incorporated in drug-associated neuronal ensembles. We review recent efforts towards this goal and discuss how they will offer a more comprehensive understanding of addiction pathophysiology.

Alcohol and sweet reward are encoded by distinct meta-ensembles

Cue-reward associations form distinct memories that can drive appetitive behaviors and cravings for both drugs and natural rewards. It is still unclear how such memories are encoded in the brain's reward system. We trained rats to concurrently self-administer either alcohol or a sweet saccharin solution as drug or natural rewards, respectively. Memory recall due to cue exposure reactivated reward-associated functional ensembles in reward-related brain regions, marked by a neural cFos response. While the local ensembles activated by cue presentation for either reward consisted of similar numbers of neurons, using advanced statistical network theory, we found robust reward-specific co-activation patterns across brain regions. Interestingly, the resulting meta-ensemble networks differed by the most influential regions, which in case of saccharin comprised the prefrontal cortex, while for alcohol seeking control shifted to insular cortex with strong involvement of the amygdala. Our results support the view of memory representation as a differential co-activation of local neuronal ensembles. This article is part of the special issue on 'Neurocircuitry Modulating Drug and Alcohol Abuse'.

Cocaine and sucrose rewards recruit different seeking ensembles in the nucleus accumbens core

Poorly regulated reward seeking is a central feature of substance use disorder. Recent research shows that rewarding drug-related experiences induce synchronous activation of a discrete number of neurons in the nucleus accumbens that are causally linked to reward-related contexts. Here we comprehensively characterize the specific ensemble of neurons built through experience that are linked to seeking behavior. We additionally address the question of whether or not addictive drugs usurp the neuronal networks recruited by natural rewards by evaluating cocaine- and sucrose-associated ensembles within the same mouse. We used FosCreERT2/+/Ai14 transgenic mice to tag cells activated by and potentially encoding cocaine and sucrose seeking. We tagged ~1% of neurons in the core subregion of the accumbens (NAcore) activated during cue-induced seeking for cocaine or sucrose. The majority of tagged cells in the seeking ensembles were D1-MSNs, and specifically activated during seeking, not during extinction or when mice remained in the home cage. To compare different reward-specific ensembles within the same mouse, we used a dual cocaine and sucrose self-administration protocol allowing reward-specific seeking. Using this model, we found ~70% distinction between the cells constituting the cocaine- compared to the sucrose-seeking ensemble. Establishing that cocaine recruits an ensemble of NAcore neurons largely distinct from neurons recruited into an ensemble coding for sucrose seeking suggest a finely tuned specificity of ensembles. The findings allow further exploration of the mechanisms that transform reward-based positive reinforcement into maladaptive drug seeking.

Improving translation of animal models of addiction and relapse by reverse translation

Critical features of human addiction are increasingly being incorporated into complementary animal models, including escalation of drug intake, punished drug seeking and taking, intermittent drug access, choice between drug and non-drug rewards, and assessment of individual differences based on criteria in the fourth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV). Combined with new technologies, these models advanced our understanding of brain mechanisms of drug self-administration and relapse, but these mechanistic gains have not led to improvements in addiction treatment. This problem is not unique to addiction neuroscience, but it is an increasing source of disappointment and calls to regroup. Here we first summarize behavioural and neurobiological results from the animal models mentioned above. We then propose a reverse translational approach, whose goal is to develop models that mimic successful treatments: opioid agonist maintenance, contingency management and the community-reinforcement approach. These reverse-translated 'treatments' may provide an ecologically relevant platform from which to discover new circuits, test new medications and improve translation.

Prefrontal Regulation of Punished Ethanol Self-administration

BACKGROUND

A clinical hallmark of alcohol use disorder is persistent drinking despite potential adverse consequences. The ventromedial prefrontal cortex (vmPFC) and dorsomedial prefrontal cortex (dmPFC) are positioned to exert top-down control over subcortical regions, such as the nucleus accumbens shell (NAcS) and basolateral amygdala, which encode positive and negative valence of ethanol (EtOH)-related stimuli. Prior rodent studies have implicated these regions in regulation of punished EtOH self-administration (EtOH-SA).

METHODS

We conducted in vivo electrophysiological recordings in mouse vmPFC and dmPFC to obtain neuronal correlates of footshock-punished EtOH-SA. Ex vivo recordings were performed in NAcS D₁ receptor-expressing medium spiny neurons receiving vmPFC input to examine punishment-related plasticity in this pathway. Optogenetic photosilencing was employed to assess the functional contribution of the vmPFC, dmPFC, vmPFC projections to NAcS, or vmPFC projections to basolateral amygdala, to punished EtOH-SA.

RESULTS

Punishment reduced EtOH lever pressing and elicited aborted presses (lever approach followed by rapid retraction). Neurons in the vmPFC and dmPFC exhibited phasic firing to EtOH lever presses and aborts, but only in the vmPFC was there a population-level shift in coding from lever presses to aborts with punishment. Closed-loop vmPFC, but not dmPFC, photosilencing on a postpunishment probe test negated the reduction in EtOH lever presses but not in aborts. Punishment was associated with altered plasticity at vmPFC inputs to D₁ receptor-expressing medium spiny neurons in the NAcS. Photosilencing vmPFC projections to the NAcS, but not to the basolateral amygdala, partially reversed suppression of EtOH lever presses on probe testing.

CONCLUSIONS

These findings demonstrate a key role for the vmPFC in regulating EtOH-SA after punishment, with implications for understanding the neural basis of compulsive drinking in alcohol use disorder.

A persistent alcohol cue memory trace drives relapse to alcohol seeking after prolonged abstinence

Alcohol use disorder is characterized by a high risk of relapse during periods of abstinence. Relapse is often triggered by retrieval of persistent alcohol memories upon exposure to alcohol-associated environmental cues, but little is known about the neuronal circuitry that supports the long-term storage of alcohol cue associations. We found that a small ensemble of neurons in the medial prefrontal cortex (mPFC) of mice was activated during cue-paired alcohol self-administration (SA) and that selective suppression of these neurons 1 month later attenuated cue-induced relapse to alcohol seeking. Inhibition of alcohol seeking was specific to these neurons as suppression of a non-alcohol-related or sucrose SA-activated mPFC ensemble did not affect relapse behavior. Hence, the mPFC neuronal ensemble activated during cue-paired alcohol consumption functions as a lasting memory trace that mediates cue-evoked relapse long after cessation of alcohol intake, thereby providing a potential target for treatment of alcohol relapse vulnerability.

Optogenetic reactivation of prefrontal social neural ensembles mimics social buffering of fear

Social buffering occurs when the presence of a companion attenuates the physiological and/or behavioral effects of a stressful or fear-provoking event. It represents a way in which social interactions can immediately and potently modulate behavior. As such, social buffering is one mechanism by which strong social support increases resilience to mental illness. Although the behavioral and neuroendocrine impacts of social buffering are well studied in multiple species, including humans, the neuronal underpinnings of this behavioral phenomenon remain largely unexplored. Previous work has shown that the infralimbic prefrontal cortex (IL-PFC) is important for processing social information and, in separate studies, for modulating fear and anxiety. Thus, we hypothesized that socially active cells within the IL-PFC may integrate social information to modulate fear responsivity. To test this hypothesis, we employed social buffering paradigms in male and female mice. Similar to prior studies in rats, we found that the presence of a cagemate reduced freezing in fear- and anxiety-provoking contexts. In accordance with previous work, we demonstrated that interaction with a novel or familiar conspecific induces activity in the IL-PFC as evidenced by increased immediate early gene (IEG) expression. We then utilized an activity-dependent tagging murine line, the ArcCreER^T2 mice, to express channelrhodopsin (ChR2) in neurons active during the social encoding of a new cagemate. We found that optogenetic reactivation of these socially active neuronal ensembles phenocopied the effects of cagemate presence in male and female mice in learned and innate fear contexts without being inherently rewarding or altering locomotion. These data suggest that a social neural ensemble within the IL-PFC may contribute to social buffering of fear. These neurons may represent a novel therapeutic target for fear and anxiety disorders.

"Chasing the first high": memory sampling in drug choice

Although vivid memories of drug experiences are prevalent within clinical contexts and addiction folklore ("chasing the first high"), little is known about the relevance of cognitive processes governing memory retrieval to substance use disorder. Drawing on recent work that identifies episodic memory's influence on decisions for reward, we propose a framework in which drug choices are biased by selective sampling of individual memories during two phases of addiction: (i) downward spiral into persistent use and (ii) relapse. Consideration of how memory retrieval influences the addiction process suggests novel treatment strategies. Rather than try to break learned associations between drug cues and drug rewards, treatment should aim to strengthen existing and/or create new associations between drug cues and drug-inconsistent rewards.

Extinction of cue-evoked food-seeking recruits a GABAergic interneuron ensemble in the dorsal medial prefrontal cortex of mice

Animals must quickly adapt food-seeking strategies to locate nutrient sources in dynamically changing environments. Learned associations between food and environmental cues that predict its availability promote food-seeking behaviors. However, when such cues cease to predict food availability, animals undergo "extinction" learning, resulting in the inhibition of food-seeking responses. Repeatedly activated sets of neurons, or "neuronal ensembles," in the dorsal medial prefrontal cortex (dmPFC) are recruited following appetitive conditioning and undergo physiological adaptations thought to encode cue-reward associations. However, little is known about how the recruitment and intrinsic excitability of such dmPFC ensembles are modulated by extinction learning. Here, we used in vivo 2-Photon imaging in male Fos-GFP mice that express green fluorescent protein (GFP) in recently behaviorally activated neurons to determine the recruitment of activated pyramidal and GABAergic interneuron dmPFC ensembles during extinction. During extinction, we revealed a persistent activation of a subset of interneurons which emerged from a wider population of interneurons activated during the initial extinction session. This activation pattern was not observed in pyramidal cells, and extinction learning did not modulate the excitability properties of activated pyramidal cells. Moreover, extinction learning reduced the likelihood of reactivation of pyramidal cells activated during the initial extinction session. Our findings illuminate novel neuronal activation patterns in the dmPFC underlying extinction of food-seeking, and in particular, highlight an important role for interneuron ensembles in this inhibitory form of learning.

Distinct Populations of Neurons Activated by Heroin and Cocaine in the Striatum as Assessed by catFISH

Despite the still prevailing notion of a shared substrate of action for all addictive drugs, there is evidence suggesting that opioid and psychostimulant drugs differ substantially in terms of their neurobiological and behavioral effects. These differences may reflect separate neural circuits engaged by the two drugs. Here we used the catFISH (cellular compartment analysis of temporal activity by fluorescence in situ hybridization) technique to investigate the degree of overlap between neurons engaged by heroin versus cocaine in adult male Sprague Dawley rats. The catFISH technique is a within-subject procedure that takes advantage of the different transcriptional time course of the immediate-early genes homer 1a and arc to determine to what extent two stimuli separated by an interval of 25 min engage the same neuronal population. We found that throughout the striatal complex the neuronal populations activated by noncontingent intravenous injections of cocaine (800 μg/kg) and heroin (100 and 200 μg/kg), administered at an interval of 25 min from each other, overlapped to a much lesser extent than in the case of two injections of cocaine (800 μg/kg), also 25 min apart. The greatest reduction in overlap between populations activated by cocaine and heroin was in the dorsomedial and dorsolateral striatum (∼30% and ∼22%, respectively, of the overlap observed for the sequence cocaine-cocaine). Our results point toward a significant separation between neuronal populations activated by heroin and cocaine in the striatal complex. We propose that our findings are a proof of concept that these two drugs are encoded differently in a brain area believed to be a common neurobiological substrate to drug abuse.

The basolateral amygdala-medial prefrontal cortex circuitry regulates behavioral flexibility during appetitive reversal learning

Environmental cues can become predictors of food availability through Pavlovian conditioning. Two forebrain regions important in this associative learning are the basolateral amygdala (BLA) and medial prefrontal cortex (mPFC). Recent work showed the BLA-mPFC pathway is activated when a cue reliably signals food, suggesting the BLA informs the mPFC of the cue's value. The current study tested this hypothesis by altering the value of 2 food cues using reversal learning and illness-induced devaluation paradigms. Rats that received unilateral excitotoxic lesions of the BLA and mPFC contralaterally placed, along with ipsilateral and sham controls, underwent discriminative conditioning, followed by reversal learning and then devaluation. All groups successfully discriminated between 2 auditory stimuli that were followed by food delivery (conditional stimulus [CS] +) or not rewarded (CS-), demonstrating this learning does not require BLA-mPFC communication. When the outcomes of the stimuli were reversed, the rats with disconnected BLA-mPFC (contralateral condition) showed increased responding to the CSs, especially to the rCS + (original CS-) during the first session, suggesting impaired cue memory recall and behavioral inhibition compared to the other groups. For devaluation, all groups successfully learned conditioned taste aversion; however, there was no evidence of cue devaluation or differences between groups. Interestingly, at the end of testing, the nondevalued contralateral group was still responding more to the original CS + (rCS-) compared to the devalued contralateral group. These results suggest a potential role for BLA-mPFC communication in guiding appropriate responding during periods of behavioral flexibility when the outcomes, and thus the values, of learned cues are altered. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

Medial Prefrontal Cortex Neural Plasticity, Orexin Receptor 1 Signaling, and Connectivity with the Lateral Hypothalamus Are Necessary in Cue-Potentiated Feeding

Cognitive processes contribute to the control of feeding behavior and help organism's survival when they support physiological needs. They can become maladaptive, such as when learned food cues drive feeding in the absence of hunger. Associative learning is the basis for cue-driven food seeking and consumption, and behavioral paradigms with Pavlovian cue-food conditioning are well established. Yet, the neural mechanisms underlying circuit plasticity across cue-food learning, cue memory recall, and subsequent food motivation are unknown. Here, we demonstrated the medial prefrontal cortex (mPFC) is a site of learning-induced plasticity and signaling of the neuropeptide orexin within the mPFC mediates cue potentiated feeding (CPF). First, using a marker of neuronal activation, c-fos, we confirmed that the mPFC is activated during CPF. Next, to assess whether the same mPFC neuronal ensemble is activated during cue-food learning and later CPF, we used the Daun02 chemogenetic inactivation method in c-fos-lacZ transgenic male and female rats. Selective inactivation of the mPFC neurons that were active during the last cue-food training session abolished CPF during test, demonstrating that the mPFC is a site of plasticity. We postulated that integration of food cue memory and feeding motivation requires mPFC communications with lateral hypothalamus and showed that disconnection of that system abolished CPF. Then we showed that lateral hypothalamus orexin-producing neurons project to the mPFC. Finally, we blocked orexin receptor 1 signaling in the mPFC and showed that it is a neuromodulator necessary for the cue-driven consumption. Together, our findings identify a causal function for the mPFC in the cognitive motivation to eat.SIGNIFICANCE STATEMENT Obesity has reached epidemic proportions, and the associated health consequences are serious and costly. The causes of obesity are complex because, in addition to physiological energy and nutrient needs, environmental cues can drive feeding through hedonic and cognitive processes. Learned food cues from the environment can powerfully stimulate appetite and food consumption in the absence of hunger. Using an animal model for cue-potentiated feeding, the current study determined the mPFC neuronal plasticity and neuropeptide orexin signaling are critical circuit and neurotransmitter mechanisms involved in this form of cognitive motivation to eat. These findings identify key targets for potential treatment of excessive appetite and overeating.

Why we need nonhuman primates to study the role of ventromedial prefrontal cortex in the regulation of threat- and reward-elicited responses

The ventromedial prefrontal cortex (vmPFC) is consistently implicated in the cognitive and emotional symptoms of many psychiatric disorders, but the causal mechanisms of its involvement remain unknown. In part, this is because of the poor characterization of the disorders and their symptoms, and the focus of experimental studies in animals on subcortical (rather than cortical) dysregulation. Moreover, even in those experimental studies that have focused on the vmPFC, the preferred animal model for such research has been the rodent, in which there are marked differences in the organization of this region to that seen in humans, and thus the extent of functional homology is unclear. There is also a paucity of well-defined behavioral paradigms suitable for translating disorder-relevant findings across species. With these considerations in mind, we discuss the value of nonhuman primates (NHPs) in bridging the translational gap between human and rodent studies. We focus on recent investigations into the involvement in reward and threat processing of 2 major regions of the vmPFC, areas 25 and 32 in NHPs and their anatomical homologs, the infralimbic and prelimbic cortex, in rodents. We highlight potential similarities, but also differences between species, and consider them in light of the extent to which anatomical homology reflects functional homology, the expansion of the PFC in human and NHPs, and most importantly how they can guide future studies to improve the translatability of findings from preclinical animal studies into the clinic.

Reward Devaluation Attenuates Cue-Evoked Sucrose Seeking and Is Associated with the Elimination of Excitability Differences between Ensemble and Non-ensemble Neurons in the Nucleus Accumbens

Animals must learn relationships between foods and the environmental cues that predict their availability for survival. Such cue–food associations are encoded in sparse sets of neurons or “neuronal ensembles” in the nucleus accumbens (NAc). For these ensemble-encoded, cue-controlled appetitive responses to remain adaptive, they must allow for their dynamic updating depending on acute changes in internal states such as physiological hunger or the perceived desirability of food. However, how these neuronal ensembles are recruited and physiologically modified following the update of such learned associations is unclear. To investigate this, we examined the effects of devaluation on ensemble plasticity at the levels of recruitment, intrinsic excitability, and synaptic physiology in sucrose-conditioned Fos-GFP mice that express green fluorescent protein (GFP) in recently activated neurons. Neuronal ensemble activation patterns and their physiology were examined using immunohistochemistry and slice electrophysiology, respectively. Reward-specific devaluation following 4 d of ad libitum sucrose consumption, but not general caloric devaluation, attenuated cue-evoked sucrose seeking. This suggests that changes in the hedonic and/or incentive value of sucrose, and not caloric need, drove this behavior. Moreover, devaluation attenuated the size of the neuronal ensemble recruited by the cue in the NAc shell. Finally, it eliminated the relative enhanced excitability of ensemble (GFP⁺) neurons against non-ensemble (GFP⁻) neurons observed under non-devalued conditions, and did not induce any ensemble-specific changes in excitatory synaptic physiology. Our findings provide new insights into neuronal ensemble mechanisms that underlie the changes in the incentive and/or hedonic impact of cues that support adaptive food seeking.

Dorsomedial prefrontal cortex neurons encode nicotine-cue associations

The role of medial prefrontal cortex (mPFC) in regulating nicotine taking and seeking remains largely unexplored. In this study we took advantage of the high time-resolution of optogenetic intervention by decreasing (Arch3.0) or increasing (ChR2) the activity of neurons in the dorsal and ventral mPFC during 5-s nicotine cue presentations in order to evaluate their contribution to cued nicotine seeking and taking. Wistar rats were trained to self-administer intravenous nicotine in 1 h self-administration sessions twice a day for a minimum of 10 days. Subsequently, dmPFC or vmPFC neuronal activity was modulated during or following presentation of the 5-s nicotine cue, both under extinction and self-administration conditions. We also used in vivo electrophysiology to record the activity of dmPFC neurons during nicotine self-administration and extinction tests. We show that optogenetic inhibition of dmPFC neurons during, but not following, response-contingent presentations of the nicotine cue increased nicotine seeking. We found no effect on nicotine self-administration or on food seeking in an extinction test. We also show that this effect is specific to dmPFC, because optogenetic inhibition of vmPFC had no effect on nicotine seeking and taking. In vivo recordings revealed that dmPFC network neuronal activity was modulated more strongly following nicotine cue presentation in extinction, compared to following nicotine self-administration. Our results strongly suggest that a population of neurons within the dmPFC is involved in encoding the incentive value of nicotine-associated cues.

Developing neuroscience-based treatments for alcohol addiction: A matter of choice?

Excessive alcohol use is the cause of an ongoing public health crisis, and accounts for ~5% of global disease burden. A minority of people with recreational alcohol use develop alcohol addiction (hereafter equated with "alcohol dependence" or simply "alcoholism"), a condition characterized by a systematically biased choice preference for alcohol at the expense of healthy rewards, and continued use despite adverse consequences ("compulsivity"). Alcoholism is arguably the most pressing area of unmet medical needs in psychiatry, with only a small fraction of patients receiving effective, evidence-based treatments. Medications currently approved for the treatment of alcoholism have small effect sizes, and their clinical uptake is negligible. No mechanistically new medications have been approved since 2004, and promising preclinical results have failed to translate into novel treatments. This has contributed to a reemerging debate whether and to what extent alcohol addiction represents a medical condition, or reflects maladaptive choices without an underlying brain pathology. Here, we review this landscape, and discuss the challenges, lessons learned, and opportunities to retool drug development in this important therapeutic area.