Mechanistic Resolution Required to Mediate Operant Learned Behaviors: Insights from Neuronal Ensemble-Specific Inactivation

Striatal μ-opioid receptor activation triggers direct-pathway GABAergic plasticity and induces negative affect

Withdrawal from chronic opioid use often causes hypodopaminergic states and negative affect, which may drive relapse. Direct-pathway medium spiny neurons (dMSNs) in the striatal patch compartment contain μ-opioid receptors (MORs). It remains unclear how chronic opioid exposure and withdrawal impact these MOR-expressing dMSNs and their outputs. Here, we report that MOR activation acutely suppressed GABAergic striatopallidal transmission in habenula-projecting globus pallidus neurons. Notably, withdrawal from repeated morphine or fentanyl administration potentiated this GABAergic transmission. Furthermore, intravenous fentanyl self-administration enhanced GABAergic striatonigral transmission and reduced midbrain dopaminergic activity. Fentanyl-activated striatal neurons mediated contextual memory retrieval required for conditioned place preference tests. Importantly, chemogenetic inhibition of striatal MOR+ neurons rescued fentanyl withdrawal-induced physical symptoms and anxiety-like behaviors. These data suggest that chronic opioid use triggers GABAergic striatopallidal and striatonigral plasticity to induce a hypodopaminergic state, which may promote negative emotions and relapse.

Prelimbic Ensembles Mediate Cocaine Seeking After Behavioral Acquisition and Once Rats Are Well-Trained

Substance use disorder (SUD) is a chronic relapsing condition characterized by continued use of drugs despite negative consequences. SUD is thought to involve disordered learning and memory wherein drug-paired cues gain increased salience, and ultimately drive craving and relapse. These types of associations are thought to be encoded within sparsely distributed sets of neurons, called neuronal ensembles, that drive encoded behaviors through synchronous activity of the participant neurons. We have previously found that Fos-expressing neuronal ensembles within the prefrontal cortex are required for well-trained cocaine seeking. However, less is known about how quickly cortical neuronal ensembles form during the initiation of cocaine seeking behavior. Here, we seek to further elucidate the role of Fos-expressing neuronal ensembles within the prelimbic cortex (PL) after the initial acquisition of cocaine self-administration (SA), or, after 10 days of additional SA training (well-trained). We trained Fos-LacZ transgenic rats to lever press for cocaine under an FR1 schedule of reinforcement. Once rats met acquisition criteria for cocaine self-administration, we ablated Fos-expressing neuronal ensembles in the PL using the Daun02 inactivation method, either 1 or 10 days after the rats met the acquisition criteria. Targeted ablation of Fos-expressing neuronal ensembles in the PL attenuated active lever pressing both 1 day and 10 days after rats acquired cocaine self-administration. Together, this suggests that Fos-expressing neuronal ensembles rapidly form in the PL and continue to mediate maintained cocaine seeking behavior.

Contingent Amygdala Inputs Trigger Heterosynaptic LTP at Hippocampus-To-Accumbens Synapses

The nucleus accumbens shell (NAcSh) is a key brain region where environmental cues acquire incentive salience to reinforce motivated behaviors. Principal medium spiny neurons (MSNs) in the NAcSh receive extensive glutamatergic projections from limbic regions, among which, the ventral hippocampus (vH) transmits information enriched in contextual cues, and the basolateral amygdala (BLA) encodes real-time arousing states. The vH and BLA project convergently to NAcSh MSNs, both activated in a time-locked manner on a cue-conditioned motivational action. In brain slices prepared from male and female mice, we show that co-activation of the two projections induces long-term potentiation (LTP) at vH-to-NAcSh synapses without affecting BLA-to-NAcSh synapses, revealing a heterosynaptic mechanism through which BLA signals persistently increase the temporally contingent vH-to-NAcSh transmission. Furthermore, this LTP is more prominent in dopamine D1 receptor-expressing (D1) MSNs than D2 MSNs and can be prevented by inhibition of either D1 receptors or dopaminergic terminals in NAcSh. This heterosynaptic LTP may provide a dopamine-guided mechanism through which vH-encoded cue inputs that are contingent to BLA activation acquire increased circuit representation to reinforce behavior.SIGNIFICANCE STATEMENT In motivated behaviors, environmental cues associated with arousing stimuli acquire increased incentive salience, processes mediated in part by the nucleus accumbens (NAc). NAc principal neurons receive glutamatergic projections from the ventral hippocampus (vH) and basolateral amygdala (BLA), which transmit information encoding contextual cues and affective states, respectively. Our results show that co-activation of the two projections induces long-term potentiation (LTP) at vH-to-NAc synapses without affecting BLA-to-NAc synapses, revealing a heterosynaptic mechanism through which BLA signals potentiate the temporally contingent vH-to-NAc transmission. Furthermore, this LTP is prevented by inhibition of either D1 receptors or dopaminergic axons. This heterosynaptic LTP may provide a dopamine-guided mechanism through which vH-encoded cue inputs that are contingent to BLA activation acquire increased circuit representation to reinforce behavior.

Inactivation of the infralimbic cortex decreases discriminative stimulus-controlled relapse to cocaine seeking in rats

Persistent susceptibility to cue-induced relapse is a cardinal feature of addiction. Discriminative stimuli (DSs) are one type of drug-associated cue that signal drug availability (DS+) or unavailability (DS-) and control drug seeking prior to relapse. We previously established a trial-based procedure in rats to isolate DSs from context, conditioned stimuli, and other drug-associated cues during cocaine self-administration and demonstrated DS-controlled cocaine seeking up to 300 abstinence days. The behavioral and neural mechanisms underlying trial-based DS-control of drug seeking have rarely been investigated. Here we show that following discrimination training in our trial-based procedure, the DS+ and DS- independently control the expression and suppression of cocaine seeking during abstinence. Using microinjections of GABAA + GABAB receptor agonists (muscimol + baclofen) in medial prefrontal cortex, we report that infralimbic, but not prelimbic, subregion of medial prefrontal cortex is critical to persistent DS-controlled relapse to cocaine seeking after prolonged abstinence, but not DS-guided discriminated cocaine seeking or DS-controlled cocaine self-admininstration. Finally, using ex vivo whole-cell recordings from pyramidal neurons in the medial prefrontal cortex, we demonstrate that the disruption of DS-controlled cocaine seeking following infralimbic cortex microinjections of muscimol+baclofen is likely a result of suppression of synaptic transmission in the region via a presynaptic mechanism of action.

Food-Seeking Behavior Is Mediated by Fos-Expressing Neuronal Ensembles Formed at First Learning in Rats

Neuronal ensembles in the infralimbic cortex (IL) develop after prolonged food self-administration training. However, rats demonstrate evidence of learning the food self-administration response as early as day 1, with responding quickly increasing to asymptotic levels. Since the contribution of individual brain regions to task performance shifts over the course of training, it remains unclear whether IL ensembles are gradually formed and refined over the course of extensive operant training, or whether functionally-relevant ensembles might be recruited and formed as early as the initial acquisition of food self-administration behavior. Here, we aimed to determine the role of IL ensembles at the earliest possible point after demonstrable learning of a response-outcome association. We first allowed rats to lever press for palatable food pellets and stopped training rats once their behavior evidenced the response-outcome association (learners). We compared their food-seeking behavior and neuronal activation (Fos protein expression) to similarly trained rats that did not form this association (non-learners). Learners had greater food-seeking behavior and neuronal activation within the medial prefrontal cortex (mPFC), suggesting that mPFC subregions might encode initial food self-administration memories. To test the functional relevance of mPFC Fos-expressing ensembles to subsequent food seeking, we tested region-wide inactivation of the IL using muscimol+baclofen and neuronal ensemble-specific ablation using the Daun02 inactivation procedure. Both region-wide inactivation and ensemble-specific inactivation of the IL significantly decreased food seeking. These data suggest that IL neuronal ensembles form during initial learning of food self-administration behavior, and furthermore, that these ensembles play a functional role in food seeking.

Motivational competition and the paraventricular thalamus

Although significant progress has been made in understanding the behavioral and brain mechanisms for motivational systems, much less is known about competition between motivational states or motivational conflict (e.g., approach - avoidance conflict). Despite being produced under diverse conditions, behavior during motivational competition has two signatures: bistability and metastability. These signatures reveal the operation of positive feedback mechanisms in behavioral selection. Different neuronal architectures can instantiate this selection to achieve bistability and metastability in behavior, but each relies on circuit-level inhibition to achieve rapid and stable selection between competing tendencies. Paraventricular thalamus (PVT) is identified as critical to this circuit level inhibition, resolving motivational competition via its extensive projections to local inhibitory networks in the ventral striatum and extended amygdala, enabling adaptive responding under motivational conflict.

Consequences of VGluT3 deficiency on learning and memory in mice

The aim of the present study was to test the hypothesis that vesicular glutamate transporter 3 (VGluT3) deficiency is associated with cognitive impairments. Male VGluT3 knockout (KO) and wild type (WT) mice were exposed to a behavioral test battery covering paradigms based on spontaneous exploratory behavior and reinforcement-based learning tests. Reversal learning was examined to test the cognitive flexibility. The VGluT3 KO mice clearly exhibited the ability to learn. The social recognition memory of KO mice was intact. The y-maze test revealed weaker working memory of VGluT3 KO mice. No significant learning impairments were noticed in operant conditioning or holeboard discrimination paradigm. In avoidance-based learning tests (Morris water maze and active avoidance), KO mice exhibited slightly slower learning process compared to WT mice, but not a complete learning impairment. In tests based on simple associations (operant conditioning, avoidance learning) an attenuation of cognitive flexibility was observed in KO mice. In conclusion, knocking out VGluT3 results in mild disturbances in working memory and learning flexibility. Apparently, this glutamate transporter is not a major player in learning and memory formation in general. Based on previous characteristics of VGluT3 KO mice we would have expected a stronger deficit. The observed hypolocomotion did not contribute to the mild cognitive disturbances herein reported, either.

Visualizing Infralimbic Control over Incubation of Cocaine Craving

The infralimbic prefrontal cortex serves complex roles in controlling drug-seeking behavior. In this issue of Neuron, Cameron et al. (2019) provide new insights into engagement and function of the infralimbic cortex → nucleus accumbens corticostriatal pathway in the incubation of cocaine craving.

Separate vmPFC Ensembles Control Cocaine Self-Administration Versus Extinction in Rats

Recent studies suggest that the ventral medial prefrontal cortex (vmPFC) encodes both operant drug self-administration and extinction memories. Here, we examined whether these opposing memories are encoded by distinct neuronal ensembles within the vmPFC with different outputs to the nucleus accumbens (NAc) in male and female rats. Using cocaine self-administration (3 h/d for 14 d) and extinction procedures, we demonstrated that vmPFC was similarly activated (indexed by Fos) during cocaine-seeking tests after 0 (no-extinction) or 7 extinction sessions. Selective Daun02 lesioning of the self-administration ensemble (no-extinction) decreased cocaine seeking, whereas Daun02 lesioning of the extinction ensemble increased cocaine seeking. Retrograde tracing with fluorescent cholera toxin subunit B injected into NAc combined with Fos colabeling in vmPFC indicated that vmPFC self-administration ensembles project to NAc core while extinction ensembles project to NAc shell. Functional disconnection experiments (Daun02 lesioning of vmPFC and acute dopamine D1-receptor blockade with SCH39166 in NAc core or shell) confirm that vmPFC ensembles interact with NAc core versus shell to play dissociable roles in cocaine self-administration versus extinction, respectively. Our results demonstrate that neuronal ensembles mediating cocaine self-administration and extinction comingle in vmPFC but have distinct outputs to the NAc core and shell that promote or inhibit cocaine seeking.SIGNIFICANCE STATEMENT Neuronal ensembles within the vmPFC have recently been shown to play a role in self-administration and extinction of food seeking. Here, we used the Daun02 chemogenetic inactivation procedure, which allows selective inhibition of neuronal ensembles identified by the activity marker Fos, to demonstrate that different ensembles for cocaine self-administration and extinction memories coexist in the ventral mPFC and interact with distinct subregions of the nucleus accumbens.

Sucrose Abstinence and Environmental Enrichment Effects on Mesocorticolimbic DARPP32 in Rats

Dopamine- and cAMP-regulated neuronal phosphoprotein 32 kDa (DARPP32) is a signaling molecule that could serve as a molecular switch, promoting or restraining sucrose seeking. We measured DARPP32 and pThr34 DARPP32 in the brains of male Long-Evans rats with a history of sucrose self-administration followed by 1 or 30 days of abstinence and exposure to either overnight (acute) or one month (chronic) environmental enrichment (EE). Brains were extracted following a 1 h cue reactivity test or no exposure to the test environment. Micropunches (prelimbic, infralimbic, and anterior cingulate areas of the medial prefrontal cortex, orbitofrontal cortex, dorsal striatum, nucleus accumbens, and ventral tegmental area) were then processed using Western blot. Abstinence increased, while EE decreased, sucrose seeking. DARPP32 and pThr34 DARPP32 levels were affected by testing, abstinence, and/or EE in most regions. Especially salient results were observed in the nucleus accumbens core, a region associated with relapse behaviors. Both acute and chronic EE reduced DARPP32 in the nucleus accumbens core and acute EE increased the ratio of phosphorylated to total DARPP32. Degree of DARPP32 phosphorylation negatively correlated with sucrose seeking. These findings demonstrate a potential role for DARPP32 in mediating the “anti-craving” effect of EE.

Chasing the addicted engram: identifying functional alterations in Fos-expressing neuronal ensembles that mediate drug-related learned behavior

Given that addiction has been characterized as a disorder of maladaptive learning and memory, one critical question is whether there are unique physical adaptations within neuronal ensembles that support addiction-related learned behavior. The search for the physical mechanisms of encoding these and other memories in the brain, often called the engram as a whole, continues despite decades of research. As we develop new technologies and tools that allow us to study cue- and behavior-activated Fos-expressing neuronal ensembles, the possibility of identifying the engrams of learning and memory is moving into the realm of reality rather than speculation. It has become clear from recent studies that there are specific functional, electrophysiological alterations unique to Fos-expressing ensemble neurons that may participate in encoding memories. The ultimate goal is to identify the addicted engram and reverse the physical changes that support this maladaptive form of learning.