Distinct memory engrams in the infralimbic cortex of rats control opposing environmental actions on a learned behavior

Approaches and considerations of studying neuronal ensembles: a brief review

First theorized by Hebb, neuronal ensembles have provided a framework for understanding how the mammalian brain operates, especially regarding learning and memory. Neuronal ensembles are discrete, sparsely distributed groups of neurons that become activated in response to a specific stimulus and are thought to provide an internal representation of the world. Beyond the study of region-wide or projection-wide activation, the study of ensembles offers increased specificity and resolution to identify and target specific memories or associations. Neuroscientists interested in the neurobiology of learning, memory, and motivated behavior have used electrophysiological-, calcium-, and protein-based proxies of neuronal activity in preclinical models to better understand the neurobiology of learned and motivated behaviors. Although these three approaches may be used to pursue the same general goal of studying neuronal ensembles, technical differences lead to inconsistencies in the output and interpretation of data. This mini-review highlights some of the methodologies used in electrophysiological-, calcium-, and protein-based studies of neuronal ensembles and discusses their strengths and weaknesses.

Inhibitory and excitatory alcohol-seeking cues distinct roles in behavior, neurochemistry, and mesolimbic pathway in alcohol preferring (P) rats

Cues associated with alcohol use can readily enhance self-reported cravings for alcohol, which increases the likelihood of reusing alcohol. Understanding the neuronal mechanisms involved in alcohol-seeking behavior is important for developing strategies to treat alcohol use disorder. In all experiments, adult female alcohol-preferring (P) rats were exposed to three conditioned odor cues; CS+ associated with EtOH self-administration, CS- associated with the absence of EtOH (extinction training), and a CS0, a neutral stimulus. The data indicated that presentation of an excitatory conditioned cue (CS+) can enhance EtOH- seeking while the CS- can inhibit EtOH-seeking under multiple test conditions. Presentation of the CS+ activates a subpopulation of dopamine neurons within the interfascicular nucleus of the posterior ventral tegmental area (posterior VTA) and basolateral amygdala (BLA). Pharmacological inactivation of the BLA with GABA agonists inhibits the ability of the CS+ to enhance EtOH-seeking but does not alter context-induced EtOH-seeking or the ability of the CS- to inhibit EtOH-seeking. Presentation of the conditioned odor cues in a non-drug-paired environment indicated that presentation of the CS+ increased dopamine levels in the BLA. In contrast, presentation of the CS- decreased both glutamate and dopamine levels in the BLA. Further analysis revealed that presentation of a CS+ EtOH-associated conditioned cue activates GABA interneurons but not glutamate projection neurons. Overall, the data indicate that excitatory and inhibitory conditioned cues can contrarily alter EtOH-seeking behaviors and that different neurocircuitries are mediating these distinct cues in critical brain regions. Pharmacotherapeutics for craving should inhibit the CS+ and enhance the CS- neurocircuits.

Formation and fate of an engram in the lateral amygdala supporting a rewarding memory in mice

Memories allow past experiences to guide future decision making and behavior. Sparse ensembles of neurons, known as engrams, are thought to store memories in the brain. Most previous research has focused on engrams supporting threatening or fearful memories where results show that neurons involved in a particular engram ("engram neurons") are both necessary and sufficient for memory expression. Far less is understood about engrams supporting appetitive or rewarding memories. As circumstances and environments are dynamic, the fate of a previously acquired engram with changing circumstances is unknown. Here we examined how engrams supporting a rewarding cue-cocaine memory are formed and whether this original engram is important in reinstatement of memory-guided behavior following extinction. Using a variety of techniques, we show that neurons in the lateral amygdala are allocated to an engram based on relative neuronal excitability at training. Furthermore, once allocated, these neurons become both necessary and sufficient for behavior consistent with recall of that rewarding memory. Allocated neurons are also critical for cocaine-primed reinstatement of memory-guided behavior following extinction. Moreover, artificial reactivation of initially allocated neurons supports reinstatement-like behavior following extinction even in the absence of cocaine-priming. Together, these findings suggest that cocaine priming after extinction reactivates the original engram, and that memory-guided reinstatement behavior does not occur in the absence of this reactivation. Although we focused on neurons in one brain region only, our findings that manipulations of lateral amygdala engram neurons alone were sufficient to impact memory-guided behavior indicate that the lateral amygdala is a critical hub region in what may be a larger brain-wide engram.

Learning processes in relapse to alcohol use: lessons from animal models

RATIONALE

Alcohol use is reliably preceded by discrete and contextual stimuli which, through diverse learning processes, acquire the capacity to promote alcohol use and relapse to alcohol use.

OBJECTIVE

We review contemporary extinction, renewal, reinstatement, occasion setting, and sex differences research within a conditioning framework of relapse to alcohol use to inform the development of behavioural and pharmacological therapies.

KEY FINDINGS

Diverse learning processes and corresponding neurobiological substrates contribute to relapse to alcohol use. Results from animal models indicate that cortical, thalamic, accumbal, hypothalamic, mesolimbic, glutamatergic, opioidergic, and dopaminergic circuitries contribute to alcohol relapse through separable learning processes. Behavioural therapies could be improved by increasing the endurance and generalizability of extinction learning and should incorporate whether discrete cues and contexts influence behaviour through direct excitatory conditioning or occasion setting mechanisms. The types of learning processes that most effectively influence responding for alcohol differ in female and male rats.

CONCLUSION

Sophisticated conditioning experiments suggest that diverse learning processes are mediated by distinct neural circuits and contribute to relapse to alcohol use. These experiments also suggest that gender-specific behavioural and pharmacological interventions are a way towards efficacious therapies to prevent relapse to alcohol use.

The Recruitment of a Neuronal Ensemble in the Central Nucleus of the Amygdala During the First Extinction Episode Has Persistent Effects on Extinction Expression

BACKGROUND

Adaptive behavior depends on the delicate and dynamic balance between acquisition and extinction memories. Disruption of this balance, particularly when the extinction of memory loses control over behavior, is the root of treatment failure of maladaptive behaviors such as substance abuse or anxiety disorders. Understanding this balance requires a better understanding of the underlying neurobiology and its contribution to behavioral regulation.

METHODS

We microinjected Daun02 in Fos-lacZ transgenic rats following a single extinction training episode to delete extinction-recruited neuronal ensembles in the basolateral amygdala (BLA) and central nucleus of the amygdala (CN) and examined their contribution to behavior in an appetitive Pavlovian task. In addition, we used immunohistochemistry and neuronal staining methods to identify the molecular markers of activated neurons in the BLA and CN during extinction learning or retrieval.

RESULTS

CN neurons were preferentially engaged following extinction, and deletion of these extinction-activated ensembles in the CN but not the BLA impaired the retrieval of extinction despite additional extinction training and promoted greater levels of behavioral restoration in spontaneous recovery and reinstatement. Disrupting extinction processing in the CN in turn increased activity in the BLA. Our results also show a specific role for CN PKCδ+ neurons in behavioral inhibition but not during initial extinction learning.

CONCLUSIONS

We showed that the initial extinction-recruited CN ensemble is critical to the acquisition-extinction balance and that greater behavioral restoration does not mean weaker extinction contribution. These findings provide a novel avenue for thinking about the neural mechanisms of extinction and for developing treatments for cue-triggered appetitive behaviors.

From ensembles to meta-ensembles: Specific reward encoding by correlated network activity

Neuronal ensembles are local, sparsely distributed populations of neurons that are reliably re-activated by a specific stimulus, context or task. Such discrete cell populations can be defined either functionally, by electrophysiological recordings or in vivo calcium imaging, or anatomically, using the expression of markers such as the immediate early gene cFos. A typical example of tasks that involve the formation of neuronal ensembles is reward learning, such as the cue-reward pairing during operant conditioning. These ensembles are re-activated during cue-presentation and increasing evidence suggests that this re-activation is the neurophysiological basis for the execution of reward-seeking behavior. Whilst the pursuit of rewards is a common daily activity, it is also related to the consumption of drugs, such as alcohol, and may result in problematic behaviors including addiction. Recent research has identified neuronal ensembles in several reward-related brain regions that control distinct aspects of a conditioned response, e.g., contextual information about the availability of a specific reward or the actions needed to retrieve this reward under the given circumstances. Here, we review studies using the activity marker cFos to identify and characterize neuronal ensembles related to alcohol and non-drug rewards with a special emphasis on the discrimination between different rewards by meta-ensembles, i.e., by dynamic co-activation of multiple ensembles across different brain areas.

Prelimbic Ensembles Mediate Cocaine Seeking After Behavioral Acquisition and Once Rats Are Well-Trained

Substance use disorder (SUD) is a chronic relapsing condition characterized by continued use of drugs despite negative consequences. SUD is thought to involve disordered learning and memory wherein drug-paired cues gain increased salience, and ultimately drive craving and relapse. These types of associations are thought to be encoded within sparsely distributed sets of neurons, called neuronal ensembles, that drive encoded behaviors through synchronous activity of the participant neurons. We have previously found that Fos-expressing neuronal ensembles within the prefrontal cortex are required for well-trained cocaine seeking. However, less is known about how quickly cortical neuronal ensembles form during the initiation of cocaine seeking behavior. Here, we seek to further elucidate the role of Fos-expressing neuronal ensembles within the prelimbic cortex (PL) after the initial acquisition of cocaine self-administration (SA), or, after 10 days of additional SA training (well-trained). We trained Fos-LacZ transgenic rats to lever press for cocaine under an FR1 schedule of reinforcement. Once rats met acquisition criteria for cocaine self-administration, we ablated Fos-expressing neuronal ensembles in the PL using the Daun02 inactivation method, either 1 or 10 days after the rats met the acquisition criteria. Targeted ablation of Fos-expressing neuronal ensembles in the PL attenuated active lever pressing both 1 day and 10 days after rats acquired cocaine self-administration. Together, this suggests that Fos-expressing neuronal ensembles rapidly form in the PL and continue to mediate maintained cocaine seeking behavior.

Extinction of Cocaine Memory Depends on a Feed-Forward Inhibition Circuit Within the Medial Prefrontal Cortex

BACKGROUND

Cocaine-associated environments (i.e., contexts) evoke persistent memories of cocaine reward and thereby contribute to the maintenance of addictive behavior in cocaine users. From a therapeutic perspective, enhancing inhibitory control over cocaine-conditioned responses is of pivotal importance but requires a more detailed understanding of the neural circuitry that can suppress context-evoked cocaine memories, e.g., through extinction learning. The ventral medial prefrontal cortex (vmPFC) and dorsal medial prefrontal cortex (dmPFC) are thought to bidirectionally regulate responding to cocaine cues through their projections to other brain regions. However, whether these mPFC subregions interact to enable adaptive responding to cocaine-associated contextual stimuli has remained elusive.

METHODS

We used antero- and retrograde tracing combined with chemogenetic intervention to examine the role of vmPFC-to-dmPFC projections in extinction of cocaine-induced place preference in mice. In addition, electrophysiological recordings and optogenetics were used to determine whether parvalbumin-expressing inhibitory interneurons and pyramidal neurons in the dmPFC are innervated by vmPFC projections.

RESULTS

We found that vmPFC-to-dmPFC projecting neurons are activated during unreinforced re-exposure to a cocaine-associated context, and selective suppression of these cells impairs extinction learning. Parvalbumin-expressing inhibitory interneurons in the dmPFC receive stronger monosynaptic excitatory input from vmPFC projections than local dmPFC pyramidal neurons, consequently resulting in disynaptic inhibition of pyramidal neurons. In line with this, we show that chemogenetic suppression of dmPFC parvalbumin-expressing inhibitory interneurons impairs extinction learning.

CONCLUSIONS

Our data reveal that vmPFC projections mediate extinction of a cocaine-associated contextual memory through recruitment of feed-forward inhibition in the dmPFC, thereby providing a novel neuronal substrate that promotes extinction-induced inhibitory control.

Fos-expressing neuronal ensembles in rat infralimbic cortex encode initial and maintained oxycodone seeking in rats

Neuronal ensembles within the infralimbic cortex (IL) and their projections to the nucleus accumbens (NAc) mediate opiate seeking in well-trained rats. However, it is unclear how early this circuitry is recruited during oxycodone self-administration. Here, we used retrograde labelling (CTb) and immunohistochemistry to identify NAc-projecting neurons in the IL that were activated during initial oxycodone seeking. Next, we sought to determine the role of IL neuronal ensembles in initial oxycodone self-administration. We used the Daun02 procedure in male and female Fos-LacZ rats to chemogenetically inactivate IL Fos-expressing neurons at different time points in oxycodone self-administration training: immediately after meeting criteria for acquisition of behaviour and following nine daily sessions with increasing schedules of reinforcement (FR1, FR2 and FR3) in which rats demonstrated stable oxycodone intake under increasing effort to self-administer. We found that Daun02 infusions attenuated oxycodone seeking at both the initial learning and well-trained time points. These results suggest that IL neuronal ensembles are formed during initial learning of oxycodone self-administration and required for the maintenance and expression of oxycodone seeking.

Infralimbic cortex functioning across motivated behaviors: Can the differences be reconciled?

The rodent infralimbic cortex (IL) is implicated in higher order executive functions such as reward seeking and flexible decision making. However, the precise nature of its role in these processes is unclear. Early evidence indicated that the IL promotes the extinction and ongoing inhibition of fear conditioning and cocaine seeking. However, evidence spanning other behavioral domains, such as natural reward seeking and habit-based learning, suggests a more nuanced understanding of IL function. As techniques have advanced and more studies have examined IL function, identifying a unifying explanation for its behavioral function has become increasingly difficult. Here, we discuss evidence of IL function across motivated behaviors, including associative learning, drug seeking, natural reward seeking, and goal-directed versus habit-based behaviors, and emphasize how context-specific encoding and heterogeneous IL neuronal populations may underlie seemingly conflicting findings in the literature. Together, the evidence suggests that a major IL function is to facilitate the encoding and updating of contingencies between cues and behaviors to guide subsequent behaviors.

Inactivation of the infralimbic cortex decreases discriminative stimulus-controlled relapse to cocaine seeking in rats

Persistent susceptibility to cue-induced relapse is a cardinal feature of addiction. Discriminative stimuli (DSs) are one type of drug-associated cue that signal drug availability (DS+) or unavailability (DS-) and control drug seeking prior to relapse. We previously established a trial-based procedure in rats to isolate DSs from context, conditioned stimuli, and other drug-associated cues during cocaine self-administration and demonstrated DS-controlled cocaine seeking up to 300 abstinence days. The behavioral and neural mechanisms underlying trial-based DS-control of drug seeking have rarely been investigated. Here we show that following discrimination training in our trial-based procedure, the DS+ and DS- independently control the expression and suppression of cocaine seeking during abstinence. Using microinjections of GABA_A + GABA_B receptor agonists (muscimol + baclofen) in medial prefrontal cortex, we report that infralimbic, but not prelimbic, subregion of medial prefrontal cortex is critical to persistent DS-controlled relapse to cocaine seeking after prolonged abstinence, but not DS-guided discriminated cocaine seeking or DS-controlled cocaine self-admininstration. Finally, using ex vivo whole-cell recordings from pyramidal neurons in the medial prefrontal cortex, we demonstrate that the disruption of DS-controlled cocaine seeking following infralimbic cortex microinjections of muscimol+baclofen is likely a result of suppression of synaptic transmission in the region via a presynaptic mechanism of action.

Fos-expressing neuronal ensemble in rat ventromedial prefrontal cortex encodes cocaine seeking but not food seeking in rats

Neuronal ensembles in ventromedial prefrontal cortex (vmPFC) play a role in both cocaine and palatable food seeking. However, it is unknown whether similar or different vmPFC neuronal ensembles mediate food and cocaine seeking. Here, we used the Daun02 inactivation procedure to assess whether the neuronal ensembles mediating food and cocaine seeking can be functionally distinguished. We trained male and female Fos-LacZ rats to self-administer palatable food pellets and cocaine on alternating days for 18 days. We then exposed the rats to a brief nonreinforced food- or cocaine-seeking test to induce Fos and β-gal in neuronal ensembles associated with food or cocaine seeking, respectively and infused Daun02 into vmPFC to ablate the β-gal-expressing ensembles. Two days later, we tested the rats for food or cocaine seeking under extinction conditions. Although inactivation of the food-seeking ensemble did not influence food or cocaine seeking, inactivation of the cocaine-seeking ensemble reduced cocaine seeking but not food seeking. Results indicate that the neuronal ensemble activated by cocaine seeking in vmPFC is functionally separate from the ensemble activated by food seeking.

Food-Seeking Behavior Is Mediated by Fos-Expressing Neuronal Ensembles Formed at First Learning in Rats

Neuronal ensembles in the infralimbic cortex (IL) develop after prolonged food self-administration training. However, rats demonstrate evidence of learning the food self-administration response as early as day 1, with responding quickly increasing to asymptotic levels. Since the contribution of individual brain regions to task performance shifts over the course of training, it remains unclear whether IL ensembles are gradually formed and refined over the course of extensive operant training, or whether functionally-relevant ensembles might be recruited and formed as early as the initial acquisition of food self-administration behavior. Here, we aimed to determine the role of IL ensembles at the earliest possible point after demonstrable learning of a response-outcome association. We first allowed rats to lever press for palatable food pellets and stopped training rats once their behavior evidenced the response-outcome association (learners). We compared their food-seeking behavior and neuronal activation (Fos protein expression) to similarly trained rats that did not form this association (non-learners). Learners had greater food-seeking behavior and neuronal activation within the medial prefrontal cortex (mPFC), suggesting that mPFC subregions might encode initial food self-administration memories. To test the functional relevance of mPFC Fos-expressing ensembles to subsequent food seeking, we tested region-wide inactivation of the IL using muscimol+baclofen and neuronal ensemble-specific ablation using the Daun02 inactivation procedure. Both region-wide inactivation and ensemble-specific inactivation of the IL significantly decreased food seeking. These data suggest that IL neuronal ensembles form during initial learning of food self-administration behavior, and furthermore, that these ensembles play a functional role in food seeking.

BEHAVIORAL AND NEUROBIOLOGICAL MECHANISMS OF PAVLOVIAN AND INSTRUMENTAL EXTINCTION LEARNING

This article reviews the behavioral neuroscience of extinction, the phenomenon in which a behavior that has been acquired through Pavlovian or instrumental (operant) learning decreases in strength when the outcome that reinforced it is removed. Behavioral research indicates that neither Pavlovian nor operant extinction depends substantially on erasure of the original learning but instead depends on new inhibitory learning that is primarily expressed in the context in which it is learned, as exemplified by the renewal effect. Although the nature of the inhibition may differ in Pavlovian and operant extinction, in either case the decline in responding may depend on both generalization decrement and the correction of prediction error. At the neural level, Pavlovian extinction requires a tripartite neural circuit involving the amygdala, prefrontal cortex, and hippocampus. Synaptic plasticity in the amygdala is essential for extinction learning, and prefrontal cortical inhibition of amygdala neurons encoding fear memories is involved in extinction retrieval. Hippocampal-prefrontal circuits mediate fear relapse phenomena, including renewal. Instrumental extinction involves distinct ensembles in corticostriatal, striatopallidal, and striatohypothalamic circuits as well as their thalamic returns for inhibitory (extinction) and excitatory (renewal and other relapse phenomena) control over operant responding. The field has made significant progress in recent decades, although a fully integrated biobehavioral understanding still awaits.

Acute, but not longer-term, exposure to environmental enrichment attenuates Pavlovian cue-evoked conditioned approach and Fos expression in the prefrontal cortex in mice

Exposure to environmental enrichment can modify the impact of motivationally relevant stimuli. For instance, previous studies in rats have found that even a brief, acute (~1 day), but not chronic, exposure to environmentally enriched (EE) housing attenuates instrumental lever pressing for sucrose-associated cues in a conditioned reinforcement setup. Moreover, acute EE reduces corticoaccumbens activity, as measured by decreases in expression of the neuronal activity marker "Fos." Currently, it is not known whether acute EE also reduces sucrose seeking and corticoaccumbens activity elicited by non-contingent or "forced" exposure to sucrose cues, which more closely resembles cue exposure encountered in daily life. We therefore measured the effects of acute/intermittent (1 day or 6 day of EE prior to test day) versus chronic (EE throughout conditioning lasting until test day) EE on the ability of a Pavlovian sucrose cue to elicit sucrose seeking (conditioned approach) and Fos expression in the medial prefrontal cortex (mPFC), orbitofrontal cortex (OFC), and nucleus accumbens (NAc) in mice. One day, but not 6 day or chronic EE , reduced sucrose seeking and Fos in the deep layers of the dorsal mPFC. By contrast, 1 day, 6 day, and chronic EE all reduced Fos in the shallow layers of the OFC. None of the EE manipulations modulated NAc Fos expression. We reveal how EE reduces behavioral reactivity to sucrose cues by reducing activity in select prefrontal cortical brain areas. Our work further demonstrates the robustness of EE in its ability to modulate various forms of reward-seeking across species.

A Synaptic Framework for the Persistence of Memory Engrams

The ability to store and retrieve learned information over prolonged periods of time is an essential and intriguing property of the brain. Insight into the neurobiological mechanisms that underlie memory consolidation is of utmost importance for our understanding of memory persistence and how this is affected in memory disorders. Recent evidence indicates that a given memory is encoded by sparsely distributed neurons that become highly activated during learning, so-called engram cells. Research by us and others confirms the persistent nature of cortical engram cells by showing that these neurons are required for memory expression up to at least 1 month after they were activated during learning. Strengthened synaptic connectivity between engram cells is thought to ensure reactivation of the engram cell network during retrieval. However, given the continuous integration of new information into existing neuronal circuits and the relatively rapid turnover rate of synaptic proteins, it is unclear whether a lasting learning-induced increase in synaptic connectivity is mediated by stable synapses or by continuous dynamic turnover of synapses of the engram cell network. Here, we first discuss evidence for the persistence of engram cells and memory-relevant adaptations in synaptic plasticity, and then propose models of synaptic adaptations and molecular mechanisms that may support memory persistence through the maintenance of enhanced synaptic connectivity within an engram cell network.

Alcohol and sweet reward are encoded by distinct meta-ensembles

Cue-reward associations form distinct memories that can drive appetitive behaviors and cravings for both drugs and natural rewards. It is still unclear how such memories are encoded in the brain's reward system. We trained rats to concurrently self-administer either alcohol or a sweet saccharin solution as drug or natural rewards, respectively. Memory recall due to cue exposure reactivated reward-associated functional ensembles in reward-related brain regions, marked by a neural cFos response. While the local ensembles activated by cue presentation for either reward consisted of similar numbers of neurons, using advanced statistical network theory, we found robust reward-specific co-activation patterns across brain regions. Interestingly, the resulting meta-ensemble networks differed by the most influential regions, which in case of saccharin comprised the prefrontal cortex, while for alcohol seeking control shifted to insular cortex with strong involvement of the amygdala. Our results support the view of memory representation as a differential co-activation of local neuronal ensembles. This article is part of the special issue on 'Neurocircuitry Modulating Drug and Alcohol Abuse'.

Cocaine and sucrose rewards recruit different seeking ensembles in the nucleus accumbens core

Poorly regulated reward seeking is a central feature of substance use disorder. Recent research shows that rewarding drug-related experiences induce synchronous activation of a discrete number of neurons in the nucleus accumbens that are causally linked to reward-related contexts. Here we comprehensively characterize the specific ensemble of neurons built through experience that are linked to seeking behavior. We additionally address the question of whether or not addictive drugs usurp the neuronal networks recruited by natural rewards by evaluating cocaine- and sucrose-associated ensembles within the same mouse. We used FosCreERT2/+/Ai14 transgenic mice to tag cells activated by and potentially encoding cocaine and sucrose seeking. We tagged ~1% of neurons in the core subregion of the accumbens (NAcore) activated during cue-induced seeking for cocaine or sucrose. The majority of tagged cells in the seeking ensembles were D1-MSNs, and specifically activated during seeking, not during extinction or when mice remained in the home cage. To compare different reward-specific ensembles within the same mouse, we used a dual cocaine and sucrose self-administration protocol allowing reward-specific seeking. Using this model, we found ~70% distinction between the cells constituting the cocaine- compared to the sucrose-seeking ensemble. Establishing that cocaine recruits an ensemble of NAcore neurons largely distinct from neurons recruited into an ensemble coding for sucrose seeking suggest a finely tuned specificity of ensembles. The findings allow further exploration of the mechanisms that transform reward-based positive reinforcement into maladaptive drug seeking.

Trial-based Discrimination Procedure for Studying Drug Relapse in Rats

In abstinent drug addicts, cues formerly associated with drug-taking experiences gain relapse-inducing potency ('incubate') over time. Animal models of incubation may help in developing treatments for relapse prevention. However, these models have primarily focused on the role of conditioned stimuli (CSs) signaling drug delivery and not on discriminative stimuli (DSs), which signal drug availability and are also known to play a major role in drug relapse. We recently showed that DS-controlled cocaine seeking in rats also incubates during abstinence and persists up to 300 days. We used a trial-based procedure to train male and female rats to discriminate between two light cues: one light cue (DS+) signaled the availability of cocaine reward and the second light cue (DS-) signaled the absence of reward. Rats learned to press a central retractable lever during trials in which the DS+ cue was presented and to suppress responding when the DS- cue was presented. Here, we provide a detailed protocol for the behavioral procedure used in our study. The trial-based design of this behavior lends itself well to time-locked in vivo recording and manipulation approaches that can be used to identify neurobiological mechanisms underlying the contributions of DSs to drug relapse.

The Emergence of a Stable Neuronal Ensemble from a Wider Pool of Activated Neurons in the Dorsal Medial Prefrontal Cortex during Appetitive Learning in Mice

Animals selectively respond to environmental cues associated with food reward to optimize nutrient intake. Such appetitive conditioned stimulus-unconditioned stimulus (CS-US) associations are thought to be encoded in select, stable neuronal populations or neuronal ensembles, which undergo physiological modifications during appetitive conditioning. These ensembles in the medial prefrontal cortex (mPFC) control well-established, cue-evoked food seeking, but the mechanisms involved in the genesis of these ensembles are unclear. Here, we used male Fos-GFP mice that express green fluorescent protein (GFP) in recently behaviorally activated neurons, to reveal how dorsal mPFC neurons are recruited and modified to encode CS-US memory representations using an appetitive conditioning task. In the initial conditioning session, animals did not exhibit discriminated, cue-selective food seeking, but did so in later sessions indicating that a CS-US association was established. Using microprism-based in vivo 2-Photon imaging, we revealed that only a minority of neurons activated during the initial session was consistently activated throughout subsequent conditioning sessions and during cue-evoked memory recall. Notably, using ex vivo electrophysiology, we found that neurons activated following the initial session exhibited transient hyperexcitability. Chemogenetically enhancing the excitability of these neurons throughout subsequent conditioning sessions interfered with the development of reliable cue-selective food seeking, indicated by persistent, nondiscriminated performance. We demonstrate how appetitive learning consistently activates a subset of neurons to form a stable neuronal ensemble during the formation of a CS-US association. This ensemble may arise from a pool of hyperexcitable neurons activated during the initial conditioning session.SIGNIFICANCE STATEMENT Appetitive conditioning endows cues associated with food with the ability to guide food-seeking, through the formation of a food-cue association. Neuronal ensembles in the mPFC control established cue-evoked food-seeking. However, how neurons undergo physiological modifications and become part of an ensemble during conditioning remain unclear. We found that only a minority of dorsal mPFC neurons activated on the initial conditioning session became consistently activated during conditioning and memory recall. These initially activated neurons were also transiently hyperexcitable. We demonstrate the following: (1) how stable neuronal ensemble formation in the dorsal mPFC underlies appetitive conditioning; and (2) how this ensemble may arise from hyperexcitable neurons activated before the establishment of cue-evoked food seeking.

Reward Devaluation Attenuates Cue-Evoked Sucrose Seeking and Is Associated with the Elimination of Excitability Differences between Ensemble and Non-ensemble Neurons in the Nucleus Accumbens

Animals must learn relationships between foods and the environmental cues that predict their availability for survival. Such cue–food associations are encoded in sparse sets of neurons or “neuronal ensembles” in the nucleus accumbens (NAc). For these ensemble-encoded, cue-controlled appetitive responses to remain adaptive, they must allow for their dynamic updating depending on acute changes in internal states such as physiological hunger or the perceived desirability of food. However, how these neuronal ensembles are recruited and physiologically modified following the update of such learned associations is unclear. To investigate this, we examined the effects of devaluation on ensemble plasticity at the levels of recruitment, intrinsic excitability, and synaptic physiology in sucrose-conditioned Fos-GFP mice that express green fluorescent protein (GFP) in recently activated neurons. Neuronal ensemble activation patterns and their physiology were examined using immunohistochemistry and slice electrophysiology, respectively. Reward-specific devaluation following 4 d of ad libitum sucrose consumption, but not general caloric devaluation, attenuated cue-evoked sucrose seeking. This suggests that changes in the hedonic and/or incentive value of sucrose, and not caloric need, drove this behavior. Moreover, devaluation attenuated the size of the neuronal ensemble recruited by the cue in the NAc shell. Finally, it eliminated the relative enhanced excitability of ensemble (GFP⁺) neurons against non-ensemble (GFP⁻) neurons observed under non-devalued conditions, and did not induce any ensemble-specific changes in excitatory synaptic physiology. Our findings provide new insights into neuronal ensemble mechanisms that underlie the changes in the incentive and/or hedonic impact of cues that support adaptive food seeking.

Dorsomedial prefrontal cortex neurons encode nicotine-cue associations

The role of medial prefrontal cortex (mPFC) in regulating nicotine taking and seeking remains largely unexplored. In this study we took advantage of the high time-resolution of optogenetic intervention by decreasing (Arch3.0) or increasing (ChR2) the activity of neurons in the dorsal and ventral mPFC during 5-s nicotine cue presentations in order to evaluate their contribution to cued nicotine seeking and taking. Wistar rats were trained to self-administer intravenous nicotine in 1 h self-administration sessions twice a day for a minimum of 10 days. Subsequently, dmPFC or vmPFC neuronal activity was modulated during or following presentation of the 5-s nicotine cue, both under extinction and self-administration conditions. We also used in vivo electrophysiology to record the activity of dmPFC neurons during nicotine self-administration and extinction tests. We show that optogenetic inhibition of dmPFC neurons during, but not following, response-contingent presentations of the nicotine cue increased nicotine seeking. We found no effect on nicotine self-administration or on food seeking in an extinction test. We also show that this effect is specific to dmPFC, because optogenetic inhibition of vmPFC had no effect on nicotine seeking and taking. In vivo recordings revealed that dmPFC network neuronal activity was modulated more strongly following nicotine cue presentation in extinction, compared to following nicotine self-administration. Our results strongly suggest that a population of neurons within the dmPFC is involved in encoding the incentive value of nicotine-associated cues.

Developing neuroscience-based treatments for alcohol addiction: A matter of choice?

Excessive alcohol use is the cause of an ongoing public health crisis, and accounts for ~5% of global disease burden. A minority of people with recreational alcohol use develop alcohol addiction (hereafter equated with "alcohol dependence" or simply "alcoholism"), a condition characterized by a systematically biased choice preference for alcohol at the expense of healthy rewards, and continued use despite adverse consequences ("compulsivity"). Alcoholism is arguably the most pressing area of unmet medical needs in psychiatry, with only a small fraction of patients receiving effective, evidence-based treatments. Medications currently approved for the treatment of alcoholism have small effect sizes, and their clinical uptake is negligible. No mechanistically new medications have been approved since 2004, and promising preclinical results have failed to translate into novel treatments. This has contributed to a reemerging debate whether and to what extent alcohol addiction represents a medical condition, or reflects maladaptive choices without an underlying brain pathology. Here, we review this landscape, and discuss the challenges, lessons learned, and opportunities to retool drug development in this important therapeutic area.

Anti-relapse neurons in the infralimbic cortex of rats drive relapse-suppression by drug omission cues

Drug addiction is a chronic relapsing disorder of compulsive drug use. Studies of the neurobehavioral factors that promote drug relapse have yet to produce an effective treatment. Here we take a different approach and examine the factors that suppress-rather than promote-relapse. Adapting Pavlovian procedures to suppress operant drug response, we determined the anti-relapse action of environmental cues that signal drug omission (unavailability) in rats. Under laboratory conditions linked to compulsive drug use and heightened relapse risk, drug omission cues suppressed three major modes of relapse-promotion (drug-predictive cues, stress, and drug exposure) for cocaine and alcohol. This relapse-suppression is, in part, driven by omission cue-reactive neurons, which constitute small subsets of glutamatergic and GABAergic cells, in the infralimbic cortex. Future studies of such neural activity-based cellular units (neuronal ensembles/memory engram cells) for relapse-suppression can be used to identify alternate targets for addiction medicine through functional characterization of anti-relapse mechanisms.

Opioid and chemokine regulation of cortical synaptodendritic damage in HIV-associated neurocognitive disorders

Human immunodeficiency virus (HIV)-associated neurocognitive disorders (HAND) persist despite effective antiretroviral therapies (ART). Evidence suggests that modern HAND is driven by subtle synaptodendritic damage in select brain regions, as ART-treated patients do not display overt neuronal death in postmortem brain studies. HAND symptoms are also aggravated by drug abuse, particularly with injection opioids. Opioid use produces region-specific synaptodendritic damage in similar brain regions, suggesting a convergent mechanism that may enhance HAND progression in opioid-using patients. Importantly, studies indicate that synaptodendritic damage and cognitive impairment in HAND may be reversible. Activation of the homeostatic chemokine receptor CXCR4 by its natural ligand CXCL12 positively regulates neuronal survival and dendritic spine density in cortical neurons, reducing functional deficits. However, the molecular mechanisms that underlie CXCR4, as well as opioid-mediated regulation of dendritic spines are not completely defined. Here, we will consolidate studies that describe the region-specific synaptodendritic damage in the cerebral cortex of patients and animal models of HAND, describe the pathways by which opioids may contribute to cortical synaptodendritic damage, and discuss the prospects of using the CXCR4 signaling pathway to identify new approaches to reverse dendritic spine deficits. Additionally, we will discuss novel research questions that have emerged from recent studies of CXCR4 and µ-opioid actions in the cortex. Understanding the pathways that underlie synaptodendritic damage and rescue are necessary for developing novel, effective therapeutics for this growing patient population.

Separate vmPFC Ensembles Control Cocaine Self-Administration Versus Extinction in Rats

Recent studies suggest that the ventral medial prefrontal cortex (vmPFC) encodes both operant drug self-administration and extinction memories. Here, we examined whether these opposing memories are encoded by distinct neuronal ensembles within the vmPFC with different outputs to the nucleus accumbens (NAc) in male and female rats. Using cocaine self-administration (3 h/d for 14 d) and extinction procedures, we demonstrated that vmPFC was similarly activated (indexed by Fos) during cocaine-seeking tests after 0 (no-extinction) or 7 extinction sessions. Selective Daun02 lesioning of the self-administration ensemble (no-extinction) decreased cocaine seeking, whereas Daun02 lesioning of the extinction ensemble increased cocaine seeking. Retrograde tracing with fluorescent cholera toxin subunit B injected into NAc combined with Fos colabeling in vmPFC indicated that vmPFC self-administration ensembles project to NAc core while extinction ensembles project to NAc shell. Functional disconnection experiments (Daun02 lesioning of vmPFC and acute dopamine D1-receptor blockade with SCH39166 in NAc core or shell) confirm that vmPFC ensembles interact with NAc core versus shell to play dissociable roles in cocaine self-administration versus extinction, respectively. Our results demonstrate that neuronal ensembles mediating cocaine self-administration and extinction comingle in vmPFC but have distinct outputs to the NAc core and shell that promote or inhibit cocaine seeking.SIGNIFICANCE STATEMENT Neuronal ensembles within the vmPFC have recently been shown to play a role in self-administration and extinction of food seeking. Here, we used the Daun02 chemogenetic inactivation procedure, which allows selective inhibition of neuronal ensembles identified by the activity marker Fos, to demonstrate that different ensembles for cocaine self-administration and extinction memories coexist in the ventral mPFC and interact with distinct subregions of the nucleus accumbens.

Role of prefrontal cortex in the extinction of drug memories

It has been recognized that drug addiction engages aberrant process of learning and memory, and substantial studies have focused on developing effective treatment to erase the enduring drug memories to reduce the propensity to relapse. Extinction, a behavioral intervention exposing the individuals to the drug-associated cues repeatedly, can weaken the craving and relapse induced by drug-associated cues, but its clinic efficacy is limited. A clear understanding of the neuronal circuitry and molecular mechanism underlying extinction of drug memory will facilitate the successful use of extinction therapy in clinic. As a key component of mesolimbic system, medial prefrontal cortex (mPFC) has received particular attention largely in that PFC stands at the core of neural circuits for memory extinction and manipulating mPFC influences extinction of drug memories and subsequent relapse. Here, we review the recent advances in both animal models of drug abuse and human addicted patients toward the understanding of the mechanistic link between mPFC and drug memory, with particular emphasis on how mPFC contributes to the extinction of drug memory at levels ranging from neuronal architecture, synaptic plasticity to molecular signaling and epigenetic regulation, and discuss the clinic relevance of manipulating the extinction process of drug memory to prevent craving and relapse through enhancing mPFC function.

Prelimbic cortex is a common brain area activated during cue-induced reinstatement of cocaine and heroin seeking in a polydrug self-administration rat model

Many preclinical studies examined cue-induced relapse to heroin and cocaine seeking in animal models, but most of these studies examined only one drug at a time. In human addicts, however, polydrug use of cocaine and heroin is common. We used a polydrug self-administration relapse model in rats to determine similarities and differences in brain areas activated during cue-induced reinstatement of heroin and cocaine seeking. We trained rats to lever press for cocaine (1.0 mg/kg per infusion, 3-hr/day, 18 day) or heroin (0.03 mg/kg per infusion) on alternating days (9 day for each drug); drug infusions were paired with either intermittent or continuous light cue. Next, the rats underwent extinction training followed by tests for cue-induced reinstatement where they were exposed to either heroin- or cocaine-associated cues. We observed cue-selective reinstatement of drug seeking: the heroin cue selectively reinstated heroin seeking and the cocaine cue selectively reinstated cocaine seeking. We used Fos immunohistochemistry to assess cue-induced neuronal activation in different subregions of the medial prefrontal cortex, dorsal striatum, nucleus accumbens, and amygdala. Fos expression results indicated that only the prelimbic cortex (PL) was activated by both heroin and cocaine cues; in contrast, no significant cue-induced neuronal activation was observed in other brain areas. RNA in situ hybridization indicated that the proportion of glutamatergic and GABAergic markers in PL Fos-expressing cells was similar for the heroin and cocaine cue-activated neurons. Overall, the results indicate that PL may be a common brain area involved in both heroin and cocaine seeking during polydrug use.

Chasing the addicted engram: identifying functional alterations in Fos-expressing neuronal ensembles that mediate drug-related learned behavior

Given that addiction has been characterized as a disorder of maladaptive learning and memory, one critical question is whether there are unique physical adaptations within neuronal ensembles that support addiction-related learned behavior. The search for the physical mechanisms of encoding these and other memories in the brain, often called the engram as a whole, continues despite decades of research. As we develop new technologies and tools that allow us to study cue- and behavior-activated Fos-expressing neuronal ensembles, the possibility of identifying the engrams of learning and memory is moving into the realm of reality rather than speculation. It has become clear from recent studies that there are specific functional, electrophysiological alterations unique to Fos-expressing ensemble neurons that may participate in encoding memories. The ultimate goal is to identify the addicted engram and reverse the physical changes that support this maladaptive form of learning.

Infralimbic cortex is required for learning alternatives to prelimbic promoted associations through reciprocal connectivity

Prefrontal cortical areas mediate flexible adaptive control of behavior, but the specific contributions of individual areas and the circuit mechanisms through which they interact to modulate learning have remained poorly understood. Using viral tracing and pharmacogenetic techniques, we show that prelimbic (PreL) and infralimbic cortex (IL) exhibit reciprocal PreL↔IL layer 5/6 connectivity. In set-shifting tasks and in fear/extinction learning, activity in PreL is required during new learning to apply previously learned associations, whereas activity in IL is required to learn associations alternative to previous ones. IL→PreL connectivity is specifically required during IL-dependent learning, whereas reciprocal PreL↔IL connectivity is required during a time window of 12–14 h after association learning, to set up the role of IL in subsequent learning. Our results define specific and opposing roles of PreL and IL to together flexibly support new learning, and provide circuit evidence that IL-mediated learning of alternative associations depends on direct reciprocal PreL↔IL connectivity.

Prelimbic (PL) and infralimbic (IL) cortical areas are known to have complementary roles in learning and decision making. Here the authors report reciprocal connectivity between the two areas and elucidate their functional impact on different aspects of learning.

Neural Activity in Ventral Medial Prefrontal Cortex Is Modulated More Before Approach Than Avoidance During Reinforced and Extinction Trial Blocks

Ventromedial prefrontal cortex (vmPFC) is thought to provide regulatory control over Pavlovian fear responses and has recently been implicated in appetitive approach behavior, but much less is known about its role in contexts in which appetitive and aversive outcomes can be obtained and avoided, respectively. To address this issue, we recorded from single neurons in vmPFC while male rats performed our combined approach and avoidance task under reinforced and non-reinforced (extinction) conditions. Surprisingly, we found that cues predicting reward modulated cell firing in vmPFC more often and more robustly than cues preceding avoidable shock; in addition, firing of vmPFC neurons was both response (press or no-press) and outcome (reinforced or extinction) selective. These results suggest a complex role for vmPFC in regulating behavior and support its role in appetitive contexts during both reinforced and non-reinforced conditions.SIGNIFICANCE STATEMENT Selecting context-appropriate behaviors to gain reward or avoid punishment is critical for survival. Although the role of ventromedial prefrontal cortex (vmPFC) in mediating fear responses is well established, vmPFC has also been implicated in the regulation of reward-guided approach and extinction. Many studies have used indirect methods and simple behavioral procedures to study vmPFC, which leaves the literature incomplete. We recorded vmFPC neural activity during a complex cue-driven combined approach and avoidance task and during extinction. Surprisingly, we found very little vmPFC modulation to cues predicting avoidable shock, whereas cues predicting reward approach robustly modulated vmPFC firing in a response- and outcome-selective manner. This suggests a more complex role for vmPFC than current theories suggest, specifically regarding context-specific behavioral optimization.

Pathways from epigenomics and glycobiology towards novel biomarkers of addiction and its radical cure

The recent demonstration that addiction-relevant neuronal ensembles defined by known master transcription factors and their connectome is networked throughout mesocorticolimbic reward circuits and resonates harmonically at known frequencies implies that single-cell pan-omics techniques can improve our understanding of Substance Use Disorders (SUD's). Application of machine learning algorithms to such data could find diagnostic utility as biomarkers both to define the presence of the disorder and to quantitate its severity and find myriad applications in a developmental pipeline towards therapeutics and cure. Recent epigenomic studies have uncovered a wealth of clinically important data relating to synapse-nucleus signalling, memory storage, lineage-fate determination and cellular control and are contributing greatly to our understanding of all SUD's. Epigenetics interacts extensively with glycobiology. Glycans decorate DNA, RNA and many circulating critical proteins particularly immunoglobulins. Glycosylation is emerging as a major information-laden post-translational protein modification with documented application for biomarker development. The integration of these two emerging cutting-edge technologies provides a powerful and fertile algorithmic-bioinformatic space for the development both of SUD biomarkers and novel cutting edge therapeutics.

HYPOTHESES

These lines of evidence provide fertile ground for hypotheses relating to both diagnosis and treatment. They suggest that biomarkers derived from epigenomics complemented by glycobiology may potentially provide a bedside diagnostic tool which could be developed into a clinically useful biomarker to gauge both the presence and the severity of SUD's. Moreover they suggest that modern information-based therapeutics acting on the epigenome, via RNA interference or by DNA antisense oligonucleotides may provide a novel 21st century therapeutic development pipeline towards the radical cure of addictive disorders. Such techniques could be focussed and potentiated by neurotrophic vectors or the application of interfering electric or magnetic fields deep in the medial temporal lobes of the brain.

Behavioral, cellular, and synaptic tagging frameworks

Behavioral tagging is the transformation of a short-term memory induced by a weak experience into a long-term memory through temporal association with a novel experience. This phenomenon was discovered to recapitulate synaptic tagging and capture at the behavioral level. Significant progress has been made in determining the molecular machinery associated with synaptic tagging and capture and behavioral tagging theories. However, the tag setting and recruitment of plasticity-related proteins that occur within the spatiotemporally constrained cell ensemble at the network level (cellular tagging) in the brain where multimodal sensory information is input are just beginning to be understood. Here, we review the evidence for behavioral tagging and the mechanism underlying memory allocation at the network level leading to the overlap of cell ensembles. We also discuss the functional significance of overlapping cell ensembles in association of standard Pavlovian conditioning and distinct memories. Finally, we describe the role of neuronal ensemble overlap in behavioral tagging.

Regional Differences in Striatal Neuronal Ensemble Excitability Following Cocaine and Extinction Memory Retrieval in Fos-GFP Mice

Learned associations between drugs of abuse and the drug administration environment have an important role in addiction. In rodents, exposure to a drug-associated environment elicits conditioned psychomotor activation, which may be weakened following extinction (EXT) learning. Although widespread drug-induced changes in neuronal excitability have been observed, little is known about specific changes within neuronal ensembles activated during the recall of drug-environment associations. Using a cocaine-conditioned locomotion (CL) procedure, the present study assessed the excitability of neuronal ensembles in the nucleus accumbens core and shell (NAc^core and NAc^shell), and dorsal striatum (DS) following cocaine conditioning and EXT in Fos-GFP mice that express green fluorescent protein (GFP) in activated neurons (GFP+). During conditioning, mice received repeated cocaine injections (20 mg/kg) paired with a locomotor activity chamber (Paired) or home cage (Unpaired). Seven to 13 days later, both groups were re-exposed to the activity chamber under drug-free conditions and Paired, but not Unpaired, mice exhibited CL. In a separate group of mice, CL was extinguished by repeatedly exposing mice to the activity chamber under drug-free conditions. Following the expression and EXT of CL, GFP+ neurons in the NAc^core (but not NAc^shell and DS) displayed greater firing capacity compared to surrounding GFP- neurons. This difference in excitability was due to a generalized decrease in GFP- excitability following CL and a selective increase in GFP+ excitability following its EXT. These results suggest a role for both widespread and ensemble-specific changes in neuronal excitability following recall of drug-environment associations.

Choice for Drug or Natural Reward Engages Largely Overlapping Neuronal Ensembles in the Infralimbic Prefrontal Cortex

Cue-reward associations form distinct memories that can drive appetitive behaviors and are involved in craving for both drugs and natural rewards. Distinct sets of neurons, so-called neuronal ensembles, in the infralimbic area (IL) of the medial prefrontal cortex (mPFC) play a key role in alcohol seeking. Whether this ensemble is specific for alcohol or controls reward seeking in general remains unclear. Here, we compared IL ensembles formed upon recall of drug (alcohol) or natural reward (saccharin) memories in male Wistar rats. Using an experimental framework that allows identification of two distinct reward-associated ensembles within the same animal, we found that cue-induced seeking of either alcohol or saccharin activated ensembles of similar size and organization, whereby these ensembles consist of largely overlapping neuronal populations. Thus, the IL seems to act as a general integration hub for reward seeking behavior, but also contains subsets of neurons that encode for the different rewards.SIGNIFICANCE STATEMENT Cue-reward associations form distinct memories that can act as drivers of appetitive behaviors and are involved in craving for natural rewards as well as for drugs. Distinct sets of neurons, so-called neuronal ensembles, in the infralimbic area of the mPFC play a key role in cue-triggered reward seeking. However, it is unclear whether these ensembles act as broadly tuned controllers of approach behavior or represent the learned associations between specific cues and rewards. Using an experimental framework that allows identification of two distinct reward-associated ensembles within the same animal we find largely overlapping neuronal populations. Repeated activation by two distinct events could reflect the linking of the two memory traces within the same neuron.

Corticostriatal plasticity, neuronal ensembles, and regulation of drug-seeking behavior

The idea that interconnected neuronal ensembles code for specific behaviors has been around for decades; however, recent technical improvements allow studying these networks and their causal role in initiating and maintaining behavior. In particular, the role of ensembles in drug-seeking behaviors in the context of addiction is being actively investigated. Concurrent with breakthroughs in quantifying ensembles, research has identified a role for synaptic glutamate spillover during relapse. In particular, the transient relapse-associated changes in glutamatergic synapses on accumbens neurons, as well as in adjacent astroglia and extracellular matrix, are key elements of the synaptic plasticity encoded by drug use and the metaplasticity induced by drug-associated cues that precipitate drug-seeking behaviors. Here, we briefly review the recent discoveries related to ensembles in the addiction field and then endeavor to link these discoveries with drug-induced striatal plasticity and cue-induced metaplasticity toward deeper neurobiological understandings of drug seeking.

Dead or alive? The manipulation of neuronal ensembles and pathways by daunorubicin

Some of the outstanding questions in neuroscience today are aimed at understanding the cellular and network mechanisms responsible for learned behaviours. Being able to identify and subsequently manipulate those specific neurones previously activated in a behavioural episode is key to this endeavour. A number of different methods have now been developed that enable this to be achieved. In this article, we highlight the Daun02–daunorubicin method of disrupting neuronal activity. Despite the fact that the Daun02–daunorubicin method has been used for a number of years and has been applied across a number of different experimental systems, the mechanism by which Daun02–daunorubicin disrupts neuronal activity is not clear. In this article, we summarise some of the advances that have been made by using this technology and we discuss potential mechanisms by which Daun02–daunorubicin disrupts neuronal function.

Molecular and synaptic mechanisms regulating drug-associated memories: Towards a bidirectional treatment strategy

The successful treatment of substance use disorders is dependent on the establishment of a long-term abstinent state. Relapse can be suppressed by interfering with memories of drug use that are evoked by re-exposure to drug-associated contexts and cues. Two strategies for accomplishing this goal are either to prevent drug-memory reconsolidation or to induce the formation of a competing, extinction memory. However, clinical attempts to prolong abstinence by behavioral modification of drug-related memories have had limited success. One approach to improve behavioral treatment strategies is to identify the molecular mechanisms that regulate these memory processes and then use pharmacological tools as supplements to improve efficacy. Still, due to the involvement of several overlapping signaling cascades in both reconsolidation and extinction, it is difficult to specifically modify one of the two processes. For example, attempting to elicit extinction may instead initiate reconsolidation, resulting in the unintentional strengthening of drug-related memories. A better approach is to identify diverging components of the two processes, whereby a single medication would simultaneously weaken reconsolidation and enhance extinction. This review will provide an overview of the neural substrates that are involved in the regulation of drug-associated memories, and will discuss emerging approaches to pharmacologically weaken these memories, including recent efforts to precisely and bidirectionally target reconsolidation and extinction. Ultimately, pharmacologically-enhanced memory-based approaches have the potential to produce more informed relapse-prevention therapies.

Bidirectional Modulation of Intrinsic Excitability in Rat Prelimbic Cortex Neuronal Ensembles and Non-Ensembles after Operant Learning

Learned associations between environmental stimuli and rewards drive goal-directed learning and motivated behavior. These memories are thought to be encoded by alterations within specific patterns of sparsely distributed neurons called neuronal ensembles that are activated selectively by reward-predictive stimuli. Here, we use the Fos promoter to identify strongly activated neuronal ensembles in rat prelimbic cortex (PLC) and assess altered intrinsic excitability after 10 d of operant food self-administration training (1 h/d). First, we used the Daun02 inactivation procedure in male FosLacZ-transgenic rats to ablate selectively Fos-expressing PLC neurons that were active during operant food self-administration. Selective ablation of these neurons decreased food seeking. We then used male FosGFP-transgenic rats to assess selective alterations of intrinsic excitability in Fos-expressing neuronal ensembles (FosGFP⁺) that were activated during food self-administration and compared these with alterations in less activated non-ensemble neurons (FosGFP^-). Using whole-cell recordings of layer V pyramidal neurons in an ex vivo brain slice preparation, we found that operant self-administration increased excitability of FosGFP⁺ neurons and decreased excitability of FosGFP^- neurons. Increased excitability of FosGFP⁺ neurons was driven by increased steady-state input resistance. Decreased excitability of FosGFP^- neurons was driven by increased contribution of small-conductance calcium-activated potassium (SK) channels. Injections of the specific SK channel antagonist apamin into PLC increased Fos expression but had no effect on food seeking. Overall, operant learning increased intrinsic excitability of PLC Fos-expressing neuronal ensembles that play a role in food seeking but decreased intrinsic excitability of Fos^- non-ensembles.SIGNIFICANCE STATEMENT Prefrontal cortex activity plays a critical role in operant learning, but the underlying cellular mechanisms are unknown. Using the chemogenetic Daun02 inactivation procedure, we found that a small number of strongly activated Fos-expressing neuronal ensembles in rat PLC play an important role in learned operant food seeking. Using GFP expression to identify Fos-expressing layer V pyramidal neurons in prelimbic cortex (PLC) of FosGFP-transgenic rats, we found that operant food self-administration led to increased intrinsic excitability in the behaviorally relevant Fos-expressing neuronal ensembles, but decreased intrinsic excitability in Fos^- neurons using distinct cellular mechanisms.

Mechanistic Resolution Required to Mediate Operant Learned Behaviors: Insights from Neuronal Ensemble-Specific Inactivation

Many learned behaviors are directed by complex sets of highly specific stimuli or cues. The neural mechanisms mediating learned associations in these behaviors must be capable of storing complex cue information and distinguishing among different learned associations—we call this general concept “mechanistic resolution”. For many years, our understanding of the circuitry of these learned behaviors has been based primarily on inactivation of specific cell types or whole brain areas regardless of which neurons were activated during the cue-specific behaviors. However, activation of all cells or specific cell types in a brain area do not have enough mechanistic resolution to encode or distinguish high-resolution learned associations in these behaviors. Instead, these learned associations are likely encoded within specific patterns of sparsely distributed neurons called neuronal ensembles that are selectively activated by the cues. This review article focuses on studies of neuronal ensembles in operant learned responding to obtain food or drug rewards. These studies suggest that the circuitry of operant learned behaviors may need to be re-examined using ensemble-specific manipulations that have the requisite level of mechanistic resolution.

Cortical and amygdalar neuronal ensembles in alcohol seeking, drinking and withdrawal

Alcohol induces many alterations in the brain that are thought to contribute to alcohol addiction. Most of the known alterations are induced in all neurons of a brain area or all neurons of a given cell type, regardless of whether they were activated during behavior. While these alterations can have important modulatory effects on behavior, they cannot explain why animals respond specifically to alcohol-paired cues as opposed to all other non-paired cues and evoke highly specific goal-directed learned responses in models of drug craving. As an alternative, we hypothesize another class of alterations that are induced only within sparsely distributed patterns of neurons, called neuronal ensembles, that are selectively activated by alcohol-specific cues during behavior and encode the long-term memories underlying these learned behaviors in animal models of alcohol addiction. Here we review recent studies and techniques used to identify the role of neuronal ensembles in animal models of different phases of the alcohol addiction cycle. This article is part of the Special Issue entitled "Alcoholism".