Operant sensation seeking in the mouse

BNST GluN2D-containing NMDARs contribute to ethanol intake but not negative affective behaviors in female mice

Alcohol use disorder (AUD) is a chronic, relapsing disease, highly comorbid with anxiety and depression. The bed nucleus of the stria terminalis (BNST), and Crh + neurons in this region are thought to play a key role in chronic ethanol-induced increases in volitional ethanol intake. This role has been hypothesized to be driven by emergent BNST-dependent negative affective behaviors. Indeed, we report here that in female mice undergoing a home cage chronic drinking forced abstinence model (CDFA), excitatory transmission undergoes time-dependent upregulation in BNST Crh + cells. Excitatory NMDA receptors (NMDARs) are a major target of ethanol, and chronic ethanol exposure has been shown to regulate NMDAR function and expression. GluN2D subunit-containing NMDARs have emerged as a target of interest due to their limited distribution and potential roles in affective behavior. We find that knockdown of dorsal BNST (dBNST) GluN2D expression significantly decreases ethanol intake in female, but not male, mice. While BNST Grin2b expression was significantly increased in protracted abstinence following CDFA, no differences in Grin2d expression were observed in dBNST or specifically in dBNST Crh + neurons. Finally, to determine the impact of GluN2D expression on negative affective behaviors, open field, elevated zero maze, and forced swim tasks were used to measure anxiety- and depressive-like behaviors in constitutive and conditional BNST GluN2D knockout mice. Surprisingly, we find that deletion of GluN2D fails to alter negative affect in ethanol-naïve female mice. Together, these data suggest a role for BNST GluN2D-containing NMDARs in ethanol drinking behaviors but not abstinence from ethanol, highlighting potential sex differences and behavioral specificity in the context of AUD behaviors. Overall, these data further suggest roles for BNST synaptic signaling in volitional ethanol intake that are partially independent of actions on affective behavior.

State-dependent modulation of positive and negative affective valences by a parabrachial nucleus-to-ventral tegmental area pathway in mice

Appropriately responding to various sensory signals in the environment is essential for animal survival. Accordingly, animal behaviors are closely related to external and internal states, which include the positive and negative emotional values of sensory signals triggered by environmental factors. While the lateral parabrachial nucleus (LPB) plays a key role in nociception and supports negative valences, it also transmits signals including positive valences. However, the downstream neuronal mechanisms of positive and negative valences have not been fully explored. In the present study, we investigated the ventral tegmental area (VTA) as a projection target for LPB neurons. Optogenetic activation of LPB-VTA terminals in male mice elicits positive reinforcement in an operant task and induces both avoidance and attraction in a place-conditioning task. Inhibition of glutamic acid decarboxylase (GAD) 65-expressing cells in the VTA promotes avoidance behavior induced by photoactivation of the LPB-VTA pathway. These findings indicate that the LPB-VTA pathway is one of the LPB outputs for the transmission of positive and negative valence signals, at least in part, with GABAergic modification in VTA.

Systemic kappa opioid receptor antagonism accelerates reinforcement learning via augmentation of novelty processing in male mice

Selective inhibition of kappa opioid receptors (KORs) is highly anticipated as a pharmacotherapeutic intervention for substance use disorders and depression. The accepted explanation for KOR antagonist-induced amelioration of aberrant behaviors posits that KORs globally function as a negative valence system; antagonism thereby blunts the behavioral influence of negative internal states such as anhedonia and negative affect. While effects of systemic KOR manipulations have been widely reproduced, explicit evaluation of negative valence as an explanatory construct is lacking. Here, we tested a series of falsifiable hypotheses generated a priori based on the negative valence model by pairing reinforcement learning tasks with systemic pharmacological KOR blockade in male C57BL/6J mice. The negative valence model failed to predict multiple experimental outcomes: KOR blockade accelerated contingency learning during both positive and negative reinforcement without altering innate responses to appetitive or aversive stimuli. We next proposed novelty processing, which influences learning independent of valence, as an alternative explanatory construct. Hypotheses based on novelty processing predicted subsequent observations: KOR blockade increased exploration of a novel, but not habituated, environment and augmented the reinforcing efficacy of novel visual stimuli in a sensory reinforcement task. Together, these results revise and extend long-standing theories of KOR system function.

Establishment of multi-stage intravenous self-administration paradigms in mice

Genetically tractable animal models provide needed strategies to resolve the biological basis of drug addiction. Intravenous self-administration (IVSA) is the gold standard for modeling psychostimulant and opioid addiction in animals, but technical limitations have precluded the widespread use of IVSA in mice. Here, we describe IVSA paradigms for mice that capture the multi-stage nature of the disorder and permit predictive modeling. In these paradigms, C57BL/6J mice with long-standing indwelling jugular catheters engaged in cocaine- or remifentanil-associated lever responding that was fixed ratio-dependent, dose-dependent, extinguished by withholding the drug, and reinstated by the presentation of drug-paired cues. The application of multivariate analysis suggested that drug taking in both paradigms was a function of two latent variables we termed incentive motivation and discriminative control. Machine learning revealed that vulnerability to drug seeking and relapse were predicted by a mouse's a priori response to novelty, sensitivity to drug-induced locomotion, and drug-taking behavior. The application of these behavioral and statistical-analysis approaches to genetically-engineered mice will facilitate the identification of neural circuits driving addiction susceptibility and relapse and focused therapeutic development.

An optimized procedure for robust volitional cocaine intake in mice

Substance use disorder (SUD) is a behavioral disorder characterized by volitional drug consumption. Mouse models of SUD allow for the use of molecular, genetic, and circuit-level tools, providing enormous potential for defining the underlying mechanisms of this disorder. However, the relevance of results depends on the validity of the mouse models used. Self-administration models have long been the preferred preclinical model for SUD as they allow for volitional drug consumption, thus providing strong face validity. While previous work has defined the parameters that influence intravenous cocaine self-administration in other species-such as rats and primates-many of these parameters have not been explicitly assessed in mice. In a series of experiments, we showed that commonly used mouse models of self-administration, where behavior is maintained on a fixed-ratio schedule of reinforcement, show similar levels of responding in the presence and absence of drug delivery-demonstrating that it is impossible to determine when drug consumption is and is not volitional. To address these issues, we have developed a novel mouse self-administration procedure where animals do not need to be pretrained on sucrose and behavior is maintained on a variable-ratio schedule of reinforcement. This procedure increases rates of reinforcement behavior, increases levels of drug intake, and results in clearer delineation between drug-reinforced and saline conditions. Together, these data highlight a major issue with fixed-ratio models in mice that complicates subsequent analysis and provide a simple approach to minimize these confounds with variable-ratio schedules of reinforcement. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

BNST GluN2D-Containing NMDA Receptors Influence Anxiety- and Depressive-like Behaviors and ModulateCell-Specific Excitatory/Inhibitory Synaptic Balance

Excitatory signaling mediated by NMDARs has been shown to regulate mood disorders. However, current treatments targeting NMDAR subtypes have shown limited success in treating patients, highlighting a need for alternative therapeutic targets. Here, we identify a role for GluN2D-containing NMDARs in modulating emotional behaviors and neural activity in the bed nucleus of the stria terminalis (BNST). Using a GluN2D KO mouse line (GluN2D-/-), we assessed behavioral phenotypes across tasks modeling emotional behavior. We then used a combination of ex vivo electrophysiology and in vivo fiber photometry to assess changes in BNST plasticity, cell-specific physiology, and cellular activity profiles. GluN2D-/- male mice exhibit evidence of exacerbated negative emotional behavior, and a deficit in BNST synaptic potentiation. We also found that GluN2D is functionally expressed on corticotropin-releasing factor (CRF)-positive BNST cells implicated in driving negative emotional states, and recordings in mice of both sexes revealed increased excitatory and reduced inhibitory drive onto GluN2D-/- BNST-CRF cells ex vivo and increased activity in vivo Using a GluN2D conditional KO line (GluN2Dflx/flx) to selectively delete the subunit from the BNST, we find that BNST-GluN2Dflx/flx male mice exhibit increased depressive-like behaviors, as well as altered NMDAR function and increased excitatory drive onto BNST-CRF neurons. Together, this study supports a role for GluN2D-NMDARs in regulating emotional behavior through their influence on excitatory signaling in a region-specific manner, and suggests that these NMDARs may serve as a novel target for selectively modulating glutamate signaling in stress-responsive structures and cell populations.SIGNIFICANCE STATEMENT Excitatory signaling mediated through NMDARs plays an important role in shaping emotional behavior; however, the receptor subtypes/brain regions through which this occurs are poorly understood. Here, we demonstrate that loss of GluN2D-containing NMDARs produces an increase in anxiety- and depressive-like behaviors in mice, deficits in BNST synaptic potentiation, and increased activity in BNST-CRF neurons known to drive negative emotional behavior. Further, we determine that deleting GluN2D in the BNST leads to increased depressive-like behaviors and increased excitatory drive onto BNST-CRF cells. Collectively, these results demonstrate a role for GluN2D-NMDARs in regulating the activity of stress-responsive structures and neuronal populations in the adult brain, suggesting them as a potential target for treating negative emotional states in mood-related disorders.

Endocannabinoid control of the insular-bed nucleus of the stria terminalis circuit regulates negative affective behavior associated with alcohol abstinence

Negative affect is a core symptom domain associated with an array of neurological and psychiatric disorders and is only partially targeted by current therapies, highlighting the need for better, more targeted treatment options. This study focuses on negative affective symptoms associated with prolonged alcohol abstinence, one of the leading causes of relapse. Using a mouse model of chronic alcohol consumption followed by forced abstinence (CDFA), prolonged alcohol abstinence increased c-fos expression and spontaneous glutamatergic neurotransmission in the dorsal bed nucleus of the stria terminalis (dBNST), a region heavily implicated in negative affect in both humans and rodents. Further, pharmacologically enhancing endogenous cannabinoids (eCB) with JZL184 prevents abstinence-induced increases in dBNST neuronal activity, underscoring the therapeutic potential of drugs targeting the brain's eCB system. Next, we used a channelrhodopsin-assisted mapping strategy to identify excitatory inputs to the dBNST that could contribute to CDFA-induced negative affect. We identified the insular cortex (insula), a region involved in regulating interoception, as a dense, functional, eCB-sensitive input to the dBNST. Using a chemogenetic strategy to locally mimic eCB signaling, we demonstrate that the insula strongly influences the CDFA behavioral phenotype and dBNST neuronal activity. Lastly, we used an anterograde strategy for transynaptic targeting of Cre expression in combination with a Gq-DREADD to selectively recruit dBNST neurons receiving insula projections. Chemogenetic recruitment of these neurons mimicked behavioral and c-fos responses observed in CDFA. Collectively, this study supports a role for the insula-BNST neural circuit in negative affective disturbances and highlights the therapeutic potential of the eCB system for treating negative affective disorders.

α2A-Adrenergic Receptor Activation Decreases Parabrachial Nucleus Excitatory Drive onto BNST CRF Neurons and Reduces Their Activity In Vivo

Stress contributes to numerous psychiatric disorders. Corticotropin releasing factor (CRF) signaling and CRF neurons in the bed nucleus of the stria terminalis (BNST) drive negative affective behaviors, thus agents that decrease activity of these cells may be of therapeutic interest. Here, we show that acute restraint stress increases cFos expression in CRF neurons in the mouse dorsal BNST, consistent with a role for these neurons in stress-related behaviors. We find that activation of α_2A-adrenergic receptors (ARs) by the agonist guanfacine reduced cFos expression in these neurons both in stressed and unstressed conditions. Further, we find that α- and β-ARs differentially regulate excitatory drive onto these neurons. Pharmacological and channelrhodopsin-assisted mapping experiments suggest that α_2A-ARs specifically reduce excitatory drive from parabrachial nucleus (PBN) afferents onto CRF neurons. Given that the α_2A-AR is a G_i-linked GPCR, we assessed the impact of activating the G_i-coupled DREADD hM4Di in the PBN on restraint stress regulation of BNST CRF neurons. CNO activation of PBN hM4Di reduced stress-induced Fos in BNST Crh neurons. Further, using Prkcd as an additional marker of BNST neuronal identity, we uncovered a female-specific upregulation of the coexpression of Prkcd/Crh in BNST neurons following stress, which was prevented by ovariectomy. These findings show that stress activates BNST CRF neurons, and that α_2A-AR activation suppresses the in vivo activity of these cells, at least in part by suppressing excitatory drive from PBN inputs onto CRF neurons.SIGNIFICANCE STATEMENT Stress is a major variable contributing to mood disorders. Here, we show that stress increases activation of BNST CRF neurons that drive negative affective behavior. We find that the clinically well tolerated α_2A-AR agonist guanfacine reduces activity of these cells in vivo, and reduces excitatory PBN inputs onto these cells ex vivo Additionally, we uncover a novel sex-dependent coexpression of Prkcd with Crh in female BNST neurons after stress, an effect abolished by ovariectomy. These results demonstrate input-specific interactions between norepinephrine and CRF, and point to an action by which guanfacine may reduce negative affective responses.

Systems genetics of sensation seeking

Sensation seeking is a multifaceted, heritable trait which predicts the development of substance use and abuse in humans; similar phenomena have been observed in rodents. Genetic correlations among sensation seeking and substance use indicate shared biological mechanisms, but the genes and networks underlying these relationships remain elusive. Here, we used a systems genetics approach in the BXD recombinant inbred mouse panel to identify shared genetic mechanisms underlying substance use and preference for sensory stimuli, an intermediate phenotype of sensation seeking. Using the operant sensation seeking (OSS) paradigm, we quantified preference for sensory stimuli in 120 male and 127 female mice from 62 BXD strains and the C57BL/6J and DBA/2J founder strains. We used relative preference for the active and inactive levers to dissociate preference for sensory stimuli from locomotion and exploration phenotypes. We identified genomic regions on chromosome 4 (155.236‐155.742 Mb) and chromosome 13 (72.969‐89.423 Mb) associated with distinct behavioral components of OSS. Using publicly available behavioral data and mRNA expression data from brain regions involved in reward processing, we identified (a) genes within these behavioral QTL exhibiting genome‐wide significant cis‐eQTL and (b) genetic correlations among OSS phenotypes, ethanol phenotypes and mRNA expression. From these analyses, we nominated positional candidates for behavioral QTL associated with distinct OSS phenotypes including Gnb1 and Mef2c. Genetic covariation of Gnb1 expression, preference for sensory stimuli and multiple ethanol phenotypes suggest that heritable variation in Gnb1 expression in reward circuitry partially underlies the widely reported relationship between sensation seeking and substance use.

Dorsal BNST α2A-Adrenergic Receptors Produce HCN-Dependent Excitatory Actions That Initiate Anxiogenic Behaviors

Stress is a precipitating agent in neuropsychiatric disease and initiates relapse to drug-seeking behavior in addicted patients. Targeting the stress system in protracted abstinence from drugs of abuse with anxiolytics may be an effective treatment modality for substance use disorders. α_2A-adrenergic receptors (α_2A-ARs) in extended amygdala structures play key roles in dampening stress responses. Contrary to early thinking, α_2A-ARs are expressed at non-noradrenergic sites in the brain. These non-noradrenergic α_2A-ARs play important roles in stress responses, but their cellular mechanisms of action are unclear. In humans, the α_2A-AR agonist guanfacine reduces overall craving and uncouples craving from stress, yet minimally affects relapse, potentially due to competing actions in the brain. Here, we show that heteroceptor α_2A-ARs postsynaptically enhance dorsal bed nucleus of the stria terminalis (dBNST) neuronal activity in mice of both sexes. This effect is mediated by hyperpolarization-activated cyclic nucleotide-gated cation channels because inhibition of these channels is necessary and sufficient for excitatory actions. Finally, this excitatory action is mimicked by clozapine-N-oxide activation of the G_i-coupled DREADD hM4Di in dBNST neurons and its activation elicits anxiety-like behavior in the elevated plus maze. Together, these data provide a framework for elucidating cell-specific actions of GPCR signaling and provide a potential mechanism whereby competing anxiogenic and anxiolytic actions of guanfacine may affect its clinical utility in the treatment of addiction.SIGNIFICANCE STATEMENT Stress affects the development of neuropsychiatric disorders including anxiety and addiction. Guanfacine is an α2A-adrenergic receptor (α2A-AR) agonist with actions in the bed nucleus of the stria terminalis (BNST) that produces antidepressant actions and uncouples stress from reward-related behaviors. Here, we show that guanfacine increases dorsal BNST neuronal activity through actions at postsynaptic α2A-ARs via a mechanism that involves hyperpolarization-activated cyclic nucleotide gated cation channels. This action is mimicked by activation of the designer receptor hM4Di expressed in the BNST, which also induces anxiety-like behaviors. Together, these data suggest that postsynaptic α2A-ARs in BNST have excitatory actions on BNST neurons and that these actions can be phenocopied by the so-called "inhibitory" DREADDs, suggesting that care must be taken regarding interpretation of data obtained with these tools.

Cannabinoid Receptor 1 and Fatty Acid Amide Hydrolase Contribute to Operant Sensation Seeking in Mice

A large body of evidence in humans and preclinical models supports a role for the endocannabinoid system in the proper execution of motivated or goal-directed behaviors. Operant sensation seeking (OSS) is a task that uses varied sensory stimuli as a reinforcer to maintain operant responding in mice. The purpose of the studies in this report was to begin to explore the role of endocannabinoid signaling in OSS utilizing cannabinoid receptor 1 (CB1R) and fatty acid amide hydrolase (FAAH) knock out mice. Compared to wild type littermate controls, CB1R knock out mice exhibited significantly fewer active responses and earned significantly fewer reinforcers in fixed ratio and progressive ratio schedules. On the other hand, FAAH knock out mice exhibited increased active responses and earned more reinforcers than wild type littermates in fixed ratio but not progressive ratio schedules. These findings support the role of endocannabinoid signaling in motivated behaviors and also expand our understanding of the signaling processes involved in OSS.

Responses to drugs of abuse and non-drug rewards in leptin deficient ob/ob mice

RATIONALE

Although leptin receptors are found in hypothalamic nuclei classically associated with homeostatic feeding mechanisms, they are also present in brain regions known to regulate hedonic-based feeding, natural reward processing, and responses to drugs of abuse. The ob/ob mouse is deficient in leptin signaling, and previous work has found altered mesolimbic dopamine signaling and sensitivity to the locomotor activating effects of amphetamine in these mice.

OBJECTIVES

We directly assessed responses to three drugs of abuse and non-drug rewards in the leptin-deficient ob/ob mouse.

METHODS

Ob/ob mice were tested in assays of sweet preference, novelty seeking, and drug reward/reinforcement.

RESULTS

In assays of novelty seeking, novel open field activity and operant sensation seeking were reduced in ob/ob mice, although novel object interaction and novel environment preference were comparable to wild types. We also found that ob/ob mice had specific phenotypes in regard to cocaine: conditioned place preference for 2.5 mg/kg was increased, while the locomotor response to 10 mg/kg was reduced, and cocaine self-administration was the same as wild types. Ob/ob mice also acquired self-administration of the potent opioid remifentanil, but breakpoints for the drug were significantly reduced. Finally, we found significant differences in ethanol drinking in ob/ob mice that correlated negatively with body weight and positively with operant sensation seeking.

CONCLUSIONS

In conclusion, ob/ob mice displayed task-specific deficits in novelty seeking and dissociable differences in reward/reinforcement associated with cocaine, remifentanil, and ethanol.

Stimulus dynamics increase the self-administration of compound visual and auditory stimuli

Animals will acquire an operant task using sensory stimuli as a primary reinforcer. Many operant tasks use sensory stimuli as cues that are paired with other primary reinforcers. Recent studies have called attention to this potential confound, but there has not been a parametric assessment of the effect of stimulus variability on operant responding. We found that stimulus variability increased the amount of operant responding exhibited by mice, a phenomenon observed under both fixed- and progressive-ratio schedules.

Natural rewards, neuroplasticity, and non-drug addictions

There is a high degree of overlap between brain regions involved in processing natural rewards and drugs of abuse. "Non-drug" or "behavioral" addictions have become increasingly documented in the clinic, and pathologies include compulsive activities such as shopping, eating, exercising, sexual behavior, and gambling. Like drug addiction, non-drug addictions manifest in symptoms including craving, impaired control over the behavior, tolerance, withdrawal, and high rates of relapse. These alterations in behavior suggest that plasticity may be occurring in brain regions associated with drug addiction. In this review, I summarize data demonstrating that exposure to non-drug rewards can alter neural plasticity in regions of the brain that are affected by drugs of abuse. Research suggests that there are several similarities between neuroplasticity induced by natural and drug rewards and that, depending on the reward, repeated exposure to natural rewards might induce neuroplasticity that either promotes or counteracts addictive behavior.

(3-Cyano-5-fluorophenyl)biaryl negative allosteric modulators of mGlu(5): Discovery of a new tool compound with activity in the OSS mouse model of addiction

Glutamate is the major excitatory transmitter in the mammalian CNS, exerting its effects through both ionotropic and metabotropic glutamate receptors. The metabotropic glutamate receptors (mGlus) belong to family C of the G-protein-coupled receptors (GPCRs). The eight mGlus identified to date are classified into three groups based on their structure, preferred signal transduction mechanisms, and pharmacology (Group I: mGlu(1) and mGlu(5); Group II: mGlu(2) and mGlu(3); Group III: mGlu(4), mGlu(6), mGlu(7), and mGlu(8)). Non-competitive antagonists, also known as negative allosteric modulators (NAMs), of mGlu(5) offer potential therapeutic applications in diseases such as pain, anxiety, gastroesophageal reflux disease (GERD), Parkinson's disease (PD), fragile X syndrome, and addiction. The development of SAR in a (3-cyano-5-fluorophenyl)biaryl series using our functional cell-based assay is described in this communication. Further characterization of a selected compound, 3-fluoro-5-(2-methylbenzo[d]thiazol-5-yl)benzonitrile, in additional cell based assays as well as in vitro assays designed to measure its metabolic stability and protein binding indicated its potential utility as an in vivo tool. Subsequent evaluation of the same compound in a pharmacokinetic study using intraperitoneal dosing in mice showed good exposure in both plasma and brain samples. The compound was efficacious in a mouse marble burying model of anxiety, an assay known to be sensitive to mGlu(5) antagonists. A new operant model of addiction termed operant sensation seeking (OSS) was chosen as a second behavioral assay. The compound also proved efficacious in the OSS model and constitutes the first reported example of efficacy with a small molecule mGlu(5) NAM in this novel assay.

Operant sensation seeking requires metabotropic glutamate receptor 5 (mGluR5)

Pharmacological and genetic studies have suggested that the metabotropic glutamate receptor 5 (mGluR5) is critically involved in mediating the reinforcing effects of drugs of abuse, but not food. The purpose of this study was to use mGluR5 knockout (KO), heterozygous (Het), and wildtype (WT) mice to determine if mGluR5 modulates operant sensation seeking (OSS), an operant task that uses varied sensory stimuli as a reinforcer. We found that mGluR5 KO mice had significantly reduced OSS responding relative to WT mice, while Het mice displayed a paradoxical increase in OSS responding. Neither KO nor Het mice exhibited altered operant responding for food as a reinforcer. Further, we assessed mGluR5 KO, Het and WT mice across a battery of cocaine locomotor, place preference and anxiety related tests. Although KO mice showed expected differences in some locomotor and anxiety measures, Het mice either exhibited no phenotype or an intermediate one. In total, these data demonstrate a key role for mGluR5 in OSS, indicating an important role for this receptor in reinforcement-based behavior.