Pathway-specific modulation of nucleus accumbens in reward and aversive behavior via selective transmitter receptors

Using caffeine as a chemical means to induce flow states

Flow is an intrinsically rewarding state characterised by positive affect and total task absorption. Because cognitive and physical performance are optimal in flow, chemical means to facilitate this state are appealing. Caffeine, a non-selective adenosine receptor antagonist, has been emphasized as a potential flow-inducer. Thus, we review the psychological and biological effects of caffeine that, conceptually, enhance flow. Caffeine may facilitate flow through various effects, including: i) upregulation of dopamine D1/D2 receptor affinity in reward-associated brain areas, leading to greater energetic arousal and 'wanting'; ii) protection of dopaminergic neurons; iii) increases in norepinephrine release and alertness, which offset sleep-deprivation and hypoarousal; iv) heightening of parasympathetic high frequency heart rate variability, resulting in improved cortical stress appraisal, v) modification of striatal endocannabinoid-CB1 receptor-signalling, leading to enhanced stress tolerance; and vi) changes in brain network activity in favour of executive function and flow. We also discuss the application of caffeine to treat attention deficit hyperactivity disorder and caveats. We hope to inspire studies assessing the use of caffeine to induce flow.

The cortico-striatal circuitry in autism-spectrum disorders: a balancing act

The basal ganglia are major targets of cortical inputs and, in turn, modulate cortical function via their projections to the motor and prefrontal cortices. The role of the basal ganglia in motor control and reward is well documented and there is also extensive evidence that they play a key role in social and repetitive behaviors. The basal ganglia influence the activity of the cerebral cortex via two major projections from the striatum to the output nuclei, the globus pallidus internus and the substantia nigra, pars reticulata. This modulation involves a direct projection known as the direct pathway and an indirect projection via the globus pallidus externus and the subthalamic nucleus, known as the indirect pathway. This review discusses the respective contribution of the direct and indirect pathways to social and repetitive behaviors in neurotypical conditions and in autism spectrum disorders.

An opponent striatal circuit for distributional reinforcement learning

Machine learning research has achieved large performance gains on a wide range of tasks by expanding the learning target from mean rewards to entire probability distributions of rewards - an approach known as distributional reinforcement learning (RL)1. The mesolimbic dopamine system is thought to underlie RL in the mammalian brain by updating a representation of mean value in the striatum2,3, but little is known about whether, where, and how neurons in this circuit encode information about higher-order moments of reward distributions4. To fill this gap, we used high-density probes (Neuropixels) to acutely record striatal activity from well-trained, water-restricted mice performing a classical conditioning task in which reward mean, reward variance, and stimulus identity were independently manipulated. In contrast to traditional RL accounts, we found robust evidence for abstract encoding of variance in the striatum. Remarkably, chronic ablation of dopamine inputs disorganized these distributional representations in the striatum without interfering with mean value coding. Two-photon calcium imaging and optogenetics revealed that the two major classes of striatal medium spiny neurons - D1 and D2 MSNs - contributed to this code by preferentially encoding the right and left tails of the reward distribution, respectively. We synthesize these findings into a new model of the striatum and mesolimbic dopamine that harnesses the opponency between D1 and D2 MSNs5-15 to reap the computational benefits of distributional RL.

Tonic dopamine and biases in value learning linked through a biologically inspired reinforcement learning model

A hallmark of various psychiatric disorders is biased future predictions. Here we examined the mechanisms for biased value learning using reinforcement learning models incorporating recent findings on synaptic plasticity and opponent circuit mechanisms in the basal ganglia. We show that variations in tonic dopamine can alter the balance between learning from positive and negative reward prediction errors, leading to biased value predictions. This bias arises from the sigmoidal shapes of the dose-occupancy curves and distinct affinities of D1- and D2-type dopamine receptors: changes in tonic dopamine differentially alters the slope of the dose-occupancy curves of these receptors, thus sensitivities, at baseline dopamine concentrations. We show that this mechanism can explain biased value learning in both mice and humans and may also contribute to symptoms observed in psychiatric disorders. Our model provides a foundation for understanding the basal ganglia circuit and underscores the significance of tonic dopamine in modulating learning processes.

Cannabidiol tempers alcohol intake and neuroendocrine and behavioural correlates in alcohol binge drinking adolescent rats. Focus on calcitonin gene-related peptide's brain levels

Alcohol binge drinking is common among adolescents and may challenge the signalling systems that process affective stimuli, including calcitonin gene-related peptide (CGRP) signalling. Here, we employed a rat model of adolescent binge drinking to evaluate reward-, social- and aversion-related behaviour, glucocorticoid output and CGRP levels in affect-related brain regions. As a potential rescue, the effect of the phytocannabinoid cannabidiol was explored. Adolescent male rats underwent the intermittent 20% alcohol two-bottle choice paradigm; at the binge day (BD) and the 24 h withdrawal day (WD), we assessed CGRP expression in medial prefrontal cortex (mPFC), nucleus accumbens (NAc), amygdala, hypothalamus and brainstem; in addition, we evaluated sucrose preference, social motivation and drive, nociceptive response, and serum corticosterone levels. Cannabidiol (40 mg/kg, i.p.) was administered before each drinking session, and its effect was measured on the above-mentioned readouts. At BD and WD, rats displayed decreased CGRP expression in mPFC, NAc and amygdala; increased CGRP levels in the brainstem; increased response to rewarding- and nociceptive stimuli and decreased social drive; reduced serum corticosterone levels. Cannabidiol reduced alcohol consumption and preference; normalised the abnormal corticolimbic CGRP expression, and the reward and aversion-related hyper-responsivity, as well as glucocorticoid levels in alcohol binge-like drinking rats. Overall, CGRP can represent both a mediator and a target of alcohol binge-like drinking and provides a further piece in the intricate puzzle of alcohol-induced behavioural and neuroendocrine sequelae. CBD shows promising effects in limiting adolescent alcohol binge drinking and rebalancing the bio-behavioural abnormalities.

A novel perspective on the role of nucleus accumbens neurons in encoding associative learning

The nucleus accumbens (NAc) has been considered a key brain region for encoding reward/aversion and cue-outcome associations. These processes are encoded by medium spiny neurons that express either dopamine receptor D1 (D1-MSNs) or D2 (D2-MSNs). Despite the well-established role of NAc neurons in encoding reward/aversion, the underlying processing by D1-/D2-MSNs remains largely unknown. Recent electrophysiological, optogenetic and calcium imaging studies provided insight on the complex role of D1- and D2-MSNs in these behaviours and helped to clarify their involvement in associative learning. Here, we critically discuss findings supporting an intricate and complementary role of NAc D1- and D2-MSNs in associative learning, emphasizing the need for additional studies in order to fully understand the role of these neurons in behaviour.

Social stress under binge-like alcohol withdrawal in adolescence: evidence of cannabidiol effect on maladaptive plasticity in rats

BACKGROUND

Alcohol binge drinking may compromise the functioning of the nucleus accumbens (NAc), i.e. the neural hub for processing reward and aversive responses.

METHODS

As socially stressful events pose particular challenges at developmental stages, this research applied the resident-intruder paradigm as a model of social stress, to highlight behavioural neuroendocrine and molecular maladaptive plasticity in rats at withdrawal from binge-like alcohol exposure in adolescence. In search of a rescue agent, cannabidiol (CBD) was selected due to its favourable effects on alcohol- and stress-related harms.

RESULTS

Binge-like alcohol exposed intruder rats displayed a compromised defensive behaviour against the resident and a blunted response of the stress system, in addition to indexes of abnormal dopamine (DA)/glutamate plasticity and dysfunctional spine dynamics in the NAc. CBD administration (60 mg/kg) was able to: (1) increase social exploration in the binge-like alcohol exposed intruder rats, at the expenses of freezing time, and in control rats, which received less aggressive attacks from the resident; (2) reduce corticosterone levels independently on alcohol previous exposure; (3) restore DA transmission and (4) facilitate excitatory postsynaptic strength and remodelling.

CONCLUSIONS

Overall, the maladaptive behavioural and synaptic plasticity promoted by the intersection between binge-like alcohol withdrawal and exposure to adverse social stress can be rescued by a CBD détente effect that results in a successful defensive strategy, supported by a functional endocrine and synaptic plasticity. The current data highlight CBD's relevant therapeutic potential in alcohol- and stress-related harms, and prompt further investigation on its molecular targets.

Rewiring of Prelimbic Inputs to the Nucleus Accumbens Core Underlies Cocaine-Induced Behavioral Sensitization

BACKGROUND

Unbalanced activity of medium spiny neurons (MSNs) of the direct and indirect pathways mediates reward-related behaviors induced by addictive drugs. Prelimbic (PL) input to MSNs in the nucleus accumbens core (NAcC) plays a key role in cocaine-induced early locomotor sensitization (LS). However, the adaptive plastic changes at PL-to-NAcC synapses underlying early LS remain unclear.

METHODS

Using transgenic mice and retrograde tracing, we identified NAcC-projecting pyramidal neurons (PNs) in the PL cortex based on the expression of dopamine receptor types (D1R or D2R). To examine cocaine-induced alterations in PL-to-NAcC synapses, we measured excitatory postsynaptic current amplitudes evoked by optostimulation of PL afferents to MSNs. Riluzole was chosen to test the effects of PL excitability on cocaine-induced changes of PL-to-NAcC synapses.

RESULTS

NAcC-projecting PNs were segregated into D1R- and D2R-expressing PNs (D1- and D2-PNs, respectively), and their excitability was opposingly regulated by respective dopamine agonists. Both D1- and D2-PNs exhibited balanced innervation of direct MSNs and indirect MSNs in naïve animals. Repeated cocaine injections resulted in biased synaptic strength toward direct MSNs through presynaptic mechanisms in both D1- and D2-PNs, although D2R activation reduced the D2-PN excitability. Under group 1 metabotropic glutamate receptors coactivation, however, D2R activation enhanced the D2-PN excitability. The cocaine-induced rewiring accompanied LS, and both rewiring and LS were precluded by PL infusion of riluzole, which reduced the intrinsic excitability of PL neurons.

CONCLUSIONS

These findings indicate that cocaine-induced rewiring of PL-to-NAcC synapses correlates well with early behavioral sensitization and that rewiring and LS can be prevented by riluzole-induced reduction of excitability of PL neurons.

Synaptic and cellular endocannabinoid signaling mechanisms regulate stress-induced plasticity of nucleus accumbens somatostatin neurons

Interneuron populations within the nucleus accumbens (NAc) orchestrate excitatory-inhibitory balance, undergo experience-dependent plasticity, and gate-motivated behavior, all biobehavioral processes heavily modulated by endogenous cannabinoid (eCB) signaling. While eCBs are well known to regulate synaptic plasticity onto NAc medium spiny neurons and modulate NAc function at the behavioral level, how eCBs regulate NAc interneuron function is less well understood. Here, we show that eCB signaling differentially regulates glutamatergic and feedforward GABAergic transmission onto NAc somatostatin-expressing interneurons (NAcSOM+) in an input-specific manner, while simultaneously increasing postsynaptic excitability of NAcSOM+ neurons, ultimately biasing toward vHPC (ventral hippocampal), and away from BLA (basolateral amygdalalar), activation of NAcSOM+ neurons. We further demonstrate that NAcSOM+ are activated by stress in vivo and undergo stress-dependent plasticity, evident as a global increase in intrinsic excitability and an increase in excitation-inhibition balance specifically at vHPC, but not BLA, inputs onto NAcSOM+ neurons. Importantly, both forms of stress-induced plasticity are dependent on eCB signaling at cannabinoid type 1 receptors. These findings reveal eCB-dependent mechanisms that sculpt afferent input and excitability of NAcSOM+ neurons and demonstrate a key role for eCB signaling in stress-induced plasticity of NAcSOM+-associated circuits.

Recapitulating phenotypes of alcohol dependence via overexpression of Oprk1 in the ventral tegmental area of non-dependent TH::Cre rats

The dynorphin (DYN)/kappa-opioid receptor (KOR) system is involved in dysphoria and negative emotional states. Dysregulation of KOR function promotes maladaptive behavioral regulation during withdrawal associated with alcohol dependence. Mesolimbic dopaminergic (DA) projections from the ventral tegmental area (VTA) innervate the extended amygdala circuitry and presynaptic KORs attenuate DA in these regions leading to an excessive alcohol consumption and negative affective-like behavior, whereas mesocortical KOR-regulated DA projections have been implicated in executive function and decision-making. Thus, the neuroadaptations occurring in DYN/KOR systems are important aspects to consider for the development of personalized therapeutic solutions. Herein, we study the contribution of the VTA DA neuron Oprk1 (KOR gene) in excessive alcohol consumption, negative emotional state, and executive function. To do so, Oprk1 mRNA expression and KOR function were characterized to confirm alcohol dependence-induced dysregulation in the VTA. Then, a transgenic Cre-Lox rat model (male and female TH::Cre rats) was used to allow for conditional and inducible overexpression of Oprk1 in VTA DA neurons. The effect of this overexpression was evaluated on operant alcohol self-administration, negative emotional states, and executive function. We found that VTA Oprk1 overexpression recapitulates some phenotypes of alcohol dependence including escalated alcohol self-administration and depressive-like behavior. However, working memory performance was not impacted following VTA Oprk1 overexpression in TH::Cre rats. This supports the hypothesis that dysregulated KOR signaling within the mesolimbic DA system is an important contributor to symptoms of alcohol dependence and shows that understanding Oprk1-mediated contributions to alcohol use disorder (AUD) should be an important future goal.

Striatopallidal adenosine A2A receptor modulation of goal-directed behavior: Homeostatic control with cognitive flexibility

Dysfunction of goal-directed behaviors under stressful or pathological conditions results in impaired decision-making and loss of flexibility of thoughts and behaviors, which underlie behavioral deficits ranging from depression, obsessive-compulsive disorders and drug addiction. Tackling the neuromodulators fine-tuning this core behavioral element may facilitate the development of effective strategies to control these deficits present in multiple psychiatric disorders. The current investigation of goal-directed behaviors has concentrated on dopamine and glutamate signaling in the corticostriatal pathway. In accordance with the beneficial effects of caffeine intake on mood and cognitive dysfunction, we now propose that caffeine's main site of action - adenosine A2A receptors (A2AR) - represent a novel target to homeostatically control goal-directed behavior and cognitive flexibility. A2AR are abundantly expressed in striatopallidal neurons and colocalize and interact with dopamine D2, NMDA and metabotropic glutamate 5 receptors to integrate dopamine and glutamate signaling. Specifically, striatopallidal A2AR (i) exert an overall "break" control of a variety of cognitive processes, making A2AR antagonists a novel strategy for improving goal-directed behavior; (ii) confer homeostatic control of goal-directed behavior by acting at multiple sites with often opposite effects, to enhance cognitive flexibility; (iii) integrate dopamine and adenosine signaling through multimeric A2AR-D2R heterocomplexes allowing a temporally precise fine-tuning in response to local signaling changes. As the U.S. Food and Drug Administration recently approved the A2AR antagonist Nourianz® (istradefylline) to treat Parkinson's disease, striatal A2AR-mediated control of goal-directed behavior may offer a new and real opportunity for improving deficits of goal-directed behavior and enhance cognitive flexibility under various neuropsychiatric conditions. This article is part of the Special Issue on "Purinergic Signaling: 50 years".

Aging in nucleus accumbens and its impact on alcohol use disorders

Ethanol is one of the most widely consumed drugs in the world and prolonged excessive ethanol intake might lead to alcohol use disorders (AUDs), which are characterized by neuroadaptations in different brain regions, such as in the reward circuitry. In addition, the global population is aging, and it appears that they are increasing their ethanol consumption. Although research involving the effects of alcohol in aging subjects is limited, differential effects have been described. For example, studies in human subjects show that older adults perform worse in tests assessing working memory, attention, and cognition as compared to younger adults. Interestingly, in the field of the neurobiological basis of ethanol actions, there is a significant dichotomy between what we know about the effects of ethanol on neurochemical targets in young animals and how it might affect them in the aging brain. To be able to understand the distinct effects of ethanol in the aging brain, the following questions need to be answered: (1) How does physiological aging impact the function of an ethanol-relevant region (e.g., the nucleus accumbens)? and (2) How does ethanol affect these neurobiological systems in the aged brain? This review discusses the available data to try to understand how aging affects the nucleus accumbens (nAc) and its neurochemical response to alcohol. The data show that there is little information on the effects of ethanol in aged mice and rats, and that many studies had considered 2-3-month-old mice as adults, which needs to be reconsidered since more recent literature defines 6 months as young adults and >18 months as an older mouse. Considering the actual relevance of an aged worldwide population and that this segment is drinking more frequently, it appears at least reasonable to explore how ethanol affects the brain in adult and aged models.

Current Perspectives on Selective Dopamine D3 Receptor Antagonists/Partial Agonists as Pharmacotherapeutics for Opioid and Psychostimulant Use Disorders

Over three decades of evidence indicate that dopamine (DA) D3 receptors (D3R) are involved in the control of drug-seeking behavior and may play an important role in the pathophysiology of substance use disorders (SUD). The expectation that a selective D3R antagonist/partial agonist would be efficacious for the treatment of SUD is based on the following key observations. First, D3R are distributed in strategic areas belonging to the mesolimbic DA system such as the ventral striatum, midbrain, and ventral pallidum, which have been associated with behaviors controlled by the presentation of drug-associated cues. Second, repeated exposure to drugs of abuse produces neuroadaptations in the D3R system. Third, the synthesis and characterization of highly potent and selective D3R antagonists/partial agonists have further strengthened the role of the D3R in SUD. Based on extensive preclinical and preliminary clinical evidence, the D3R shows promise as a target for the development of pharmacotherapies for SUD as reflected by their potential to (1) regulate the motivation to self-administer drugs and (2) disrupt the responsiveness to drug-associated stimuli that play a key role in reinstatement of drug-seeking behavior triggered by re-exposure to the drug itself, drug-associated environmental cues, or stress. The availability of PET ligands to assess clinically relevant receptor occupancy by selective D3R antagonists/partial agonists, the definition of reliable dosing, and the prospect of using human laboratory models may further guide the design of clinical proof of concept studies. Pivotal clinical trials for more rapid progression of this target toward regulatory approval are urgently required. Finally, the discovery that highly selective D3R antagonists, such as R-VK4-116 and R-VK4-40, do not adversely affect peripheral biometrics or cardiovascular effects alone or in the presence of oxycodone or cocaine suggests that this class of drugs has great potential in safely treating psychostimulant and/or opioid use disorders.

Adaptive control of synaptic plasticity integrates micro- and macroscopic network function

Synaptic plasticity configures interactions between neurons and is therefore likely to be a primary driver of behavioral learning and development. How this microscopic-macroscopic interaction occurs is poorly understood, as researchers frequently examine models within particular ranges of abstraction and scale. Computational neuroscience and machine learning models offer theoretically powerful analyses of plasticity in neural networks, but results are often siloed and only coarsely linked to biology. In this review, we examine connections between these areas, asking how network computations change as a function of diverse features of plasticity and vice versa. We review how plasticity can be controlled at synapses by calcium dynamics and neuromodulatory signals, the manifestation of these changes in networks, and their impacts in specialized circuits. We conclude that metaplasticity-defined broadly as the adaptive control of plasticity-forges connections across scales by governing what groups of synapses can and can't learn about, when, and to what ends. The metaplasticity we discuss acts by co-opting Hebbian mechanisms, shifting network properties, and routing activity within and across brain systems. Asking how these operations can go awry should also be useful for understanding pathology, which we address in the context of autism, schizophrenia and Parkinson's disease.

The modulatory role of dopamine receptors within the hippocampal cornu ammonis area 1 in stress-induced analgesia in an animal model of persistent inflammatory pain

The intrinsic pain inhibitory mechanisms can be activated by fear, anxiety, and stress. Stressful experiences produce analgesia, referred to as stress-induced analgesia (SIA). Major components of the limbic system, including the ventral tegmental area, nucleus accumbens, amygdala, and hippocampus, are involved in the SIA. In this study, we tried to understand the role of dopamine receptors in the cornu ammonis area 1 (CA1) of the hippocampus in the forced swim stress (FSS)-induced analgesia. Stereotaxic surgery was unilaterally performed on 129 adult male Wistar rats weighing 220-280 g. SCH23390 (0.25, 1, and 4 μg/0.5 μl saline) or sulpiride (0.25, 1, and 4 μg/0.5 μl DMSO), as D1- and D2-like dopamine receptor antagonists, respectively, were microinjected into the CA1 area, 5 min before exposure to FSS for a 6-min period. The vehicle groups received saline or DMSO instead of SCH23390 or sulpiride, respectively. The formalin test was done using formalin injection (50 μl; 2.5%) into the plantar surface of the rat's hind paw immediately after exposure to FSS. The results demonstrated that FSS produces analgesia during the early and late phases of the formalin test. However, intra-CA1 microinjection of SCH23390 or sulpiride attenuated the FSS-induced analgesia in both phases of the formalin test. This study provides new insight into the role of D1- and D2-like dopamine receptors in the CA1 area in the FSS-induced analgesia during persistent inflammatory pain.

The Ventral Tegmental Area and Nucleus Accumbens as Circadian Oscillators: Implications for Drug Abuse and Substance Use Disorders

Circadian rhythms convergently evolved to allow for optimal synchronization of individuals’ physiological and behavioral processes with the Earth’s 24-h periodic cycling of environmental light and temperature. Whereas the suprachiasmatic nucleus (SCN) is considered the primary pacemaker of the mammalian circadian system, many extra-SCN oscillatory brain regions have been identified to not only exhibit sustainable rhythms in circadian molecular clock function, but also rhythms in overall region activity/function and mediated behaviors. In this review, we present the most recent evidence for the ventral tegmental area (VTA) and nucleus accumbens (NAc) to serve as extra-SCN oscillators and highlight studies that illustrate the functional significance of the VTA’s and NAc’s inherent circadian properties as they relate to reward-processing, drug abuse, and vulnerability to develop substance use disorders (SUDs).

A distinct D1-MSN subpopulation down-regulates dopamine to promote negative emotional state

Dopamine (DA) level in the nucleus accumbens (NAc) is critical for reward and aversion encoding. DA released from the ventral mesencephalon (VM) DAergic neurons increases the excitability of VM-projecting D1-dopamine receptor-expressing medium spiny neurons (D1-MSNs) in the NAc to enhance DA release and augment rewards. However, how such a DA positive feedback loop is regulated to maintain DA homeostasis and reward-aversion balance remains elusive. Here we report that the ventral pallidum (VP) projection of NAc D1-MSNs (D1^NAc-VP) is inhibited by rewarding stimuli and activated by aversive stimuli. In contrast to the VM projection of D1-MSN (D1^NAc-VM), activation of D1^NAc-VP projection induces aversion, but not reward. D1^NAc-VP MSNs are distinct from the D1^NAc-VM MSNs, which exhibit conventional functions of D1-MSNs. Activation of D1^NAc-VP projection stimulates VM GABAergic transmission, inhibits VM DAergic neurons, and reduces DA release into the NAc. Thus, D1^NAc-VP and D1^NAc-VM MSNs cooperatively control NAc dopamine balance and reward-aversion states.

A Review of DNA Risk Alleles to Determine Epigenetic Repair of mRNA Expression to Prove Therapeutic Effectiveness in Reward Deficiency Syndrome (RDS): Embracing "Precision Behavioral Management"

This is a review of research on "Precision Behavioral Management" of substance use disorder (SUD). America is experiencing a high prevalence of substance use disorder, primarily involving legal and illegal opioid use. A 3000% increase in treatment for substance abuse has occurred between 2000 and 2016. Unfortunately, present day treatment of opioid abuse involves providing replacement therapy with powerful opioids to, at best, induce harm reduction, not prophylaxis. These interventions do not enhance gene expression and restore the balance of the brain reward system's neurotransmitters. We are proposing a generalized approach called "Precision Behavioral Management". This approach includes 1) using the Genetic Addiction Risk Severity (GARS, a 10 candidate polymorphic gene panel shown to predict ASI-alcohol and drug severity) to assess early pre-disposition to substance use disorder; 2) using a validated reward deficiency syndrome (RDS) questionnaire; 3) utilization of the Comprehensive Analysis of Reported Drugs (CARD™) to assess treatment compliance and abstinence from illicit drugs during treatment, and, importantly; 4) utilization of a "Pro-dopamine regulator (KB220)" (via IV or oral [KB220Z] delivery systems) to optimize gene expression, restore the balance of the Brain Reward Cascade's neurotransmitter systems and prevent relapse by induction of dopamine homeostasis, and; 5) utilization of targeted DNA polymorphic reward genes to direct mRNA genetic expression profiling during the treatment process. Incorporation of these events can be applied to not only the under-considered African-American RDS community, but all victims of RDS, as a demonstration of a paradigm shift that uniquely provides a novel putative "standard of care" based on DNA guided precision nutrition therapy to induce "dopamine homeostasis" and rebalance neurotransmitters in the Brain Reward Cascade. We are also developing a Reward Deficiency Syndrome Diagnostic Criteria (RDSDC) to assist in potential tertiary treatment.

Endocannabinoid Modulation of Nucleus Accumbens Microcircuitry and Terminal Dopamine Release

The nucleus accumbens (NAc) is located in the ventromedial portion of the striatum and is vital to valence-based predictions and motivated action. The neural architecture of the NAc allows for complex interactions between various cell types that filter incoming and outgoing information. Dopamine (DA) input serves a crucial role in modulating NAc function, but the mechanisms that control terminal DA release and its effect on NAc neurons continues to be elucidated. The endocannabinoid (eCB) system has emerged as an important filter of neural circuitry within the NAc that locally shapes terminal DA release through various cell type- and site-specific actions. Here, we will discuss how eCB signaling modulates terminal DA release by shaping the activity patterns of NAc neurons and their afferent inputs. We then discuss recent technological advancements that are capable of dissecting how distinct cell types, their afferent projections, and local neuromodulators influence valence-based actions.

Aberrant Striatal Value Representation in Huntington's Disease Gene Carriers 25 Years Before Onset

BACKGROUND

In this study, we asked whether differences in striatal activity during a reinforcement learning (RL) task with gain and loss domains could be one of the earliest functional imaging features associated with carrying the Huntington's disease (HD) gene. Based on previous work, we hypothesized that HD gene carriers would show either neural or behavioral asymmetry between gain and loss learning.

METHODS

We recruited 35 HD gene carriers, expected to demonstrate onset of motor symptoms in an average of 26 years, and 35 well-matched gene-negative control subjects. Participants were placed in a functional magnetic resonance imaging scanner, where they completed an RL task in which they were required to learn to choose between abstract stimuli with the aim of gaining rewards and avoiding losses. Task behavior was modeled using an RL model, and variables from this model were used to probe functional magnetic resonance imaging data.

RESULTS

In comparison with well-matched control subjects, gene carriers more than 25 years from motor onset showed exaggerated striatal responses to gain-predicting stimuli compared with loss-predicting stimuli (p = .002) in our RL task. Using computational analysis, we also found group differences in striatal representation of stimulus value (p = .0004). We found no group differences in behavior, cognitive scores, or caudate volumes.

CONCLUSIONS

Behaviorally, gene carriers 9 years from predicted onset have been shown to learn better from gains than from losses. Our data suggest that a window exists in which HD-related functional neural changes are detectable long before associated behavioral change and 25 years before predicted motor onset. These represent the earliest functional imaging differences between HD gene carriers and control subjects.

Laterodorsal tegmentum-ventral tegmental area projections encode positive reinforcement signals

The laterodorsal tegmentum (LDT) is a brainstem nucleus classically involved in REM sleep and attention, and that has recently been associated with reward‐related behaviors, as it controls the activity of ventral tegmental area (VTA) dopaminergic neurons, modulating dopamine release in the nucleus accumbens. To further understand the role of LDT–VTA inputs in reinforcement, we optogenetically manipulated these inputs during different behavioral paradigms in male rats. We found that in a two‐choice instrumental task, optical activation of LDT–VTA projections shifts and amplifies preference to the laser‐paired reward in comparison to an otherwise equal reward; the opposite was observed with inhibition experiments. In a progressive ratio task, LDT–VTA activation boosts motivation, that is, enhances the willingness to work to get the reward associated with LDT–VTA stimulation; and the reverse occurs when inhibiting these inputs. Animals abolished preference if the reward was omitted, suggesting that LDT–VTA stimulation adds/decreases value to the stimulation‐paired reward. In addition, we show that LDT–VTA optical activation induces robust preference in the conditioned and real‐time place preference tests, while optical inhibition induces aversion. The behavioral findings are supported by electrophysiological recordings and c‐fos immunofluorescence correlates in downstream target regions. In LDT–VTA ChR2 animals, we observed an increase in the recruitment of lateral VTA dopamine neurons and D1 neurons from nucleus accumbens core and shell; whereas in LDT–VTA NpHR animals, D2 neurons appear to be preferentially recruited. Collectively, these data show that the LDT–VTA inputs encode positive reinforcement signals and are important for different dimensions of reward‐related behaviors.

Striatopallidal Pathway Distinctly Modulates Goal-Directed Valuation and Acquisition of Instrumental Behavior via Striatopallidal Output Projections

The striatopallidal pathway is specialized for control of motor and motivational behaviors, but its causal role in striatal control of instrumental learning remains undefined (partly due to the confounding motor effects). Here, we leveraged the transient and "time-locked" optogenetic manipulations with the reward delivery to minimize motor confounding effect, to better define the striatopallidal control of instrumental behaviors. Optogenetic (Arch) silencing of the striatopallidal pathway in the dorsomedial striatum (DMS) and dorsolateral striatum (DLS) promoted goal-directed and habitual behaviors, respectively, without affecting acquisition of instrumental behaviors, indicating striatopallidal pathway suppression of instrumental behaviors under physiological condition. Conversely, striatopallidal pathway activation mainly affected the acquisition of instrumental behaviors with the acquisition suppression achieved by either optogenetic (ChR2) or chemicogenetic (hM3q) activation, by strong (10 mW, but not weak 1 mW) optogenetic activation, by the time-locked (but not random) optogenetic activation with the reward and by the DMS (but not DLS) striatopallidal pathway. Lastly, striatopallidal pathway modulated instrumental behaviors through striatopallidal output projections into the external globus pallidus (GPe) since optogenetic activation of the striatopallidal pathway in the DMS and of the striatopallidal output projections in the GPe similarly suppressed goal-directed behavior. Thus, the striatopallidal pathway confers distinctive and inhibitory controls of animal's sensitivity to goal-directed valuation and acquisition of instrumental behaviors under normal and over-activation conditions, through the output projections into GPe.

Involvement of the dopamine system in the effect of chronic social isolation during adolescence on social behaviors in male C57 mice

In the early stage of life, experiencing social isolation can generate long-lasting deleterious effects on behaviors and brain development. However, the effects of chronic social isolation during adolescence on social behaviors and its underlying neurobiological mechanisms remain unclear. The present study found that four weeks of social isolation during adolescence impaired social recognition ability in the three-chamber test and five-trial social recognition test, and increased aggressive-like behaviors, but reduced environmental exploration, as showed in the social interaction test. Chronic social isolation decreased levels of dopamine D2 receptor in the shell of the nucleus accumbens (NAcc) and medial prefrontal cortex. It also reduced TH in the NAcc. Using in vivo fiber photometry, it was also found that isolated mice displayed a reduction in NAcc shell activity upon exploring unfamiliar social stimuli. An injection of a 100 ng dose of the D2R agonist quinpirole into the shell of the NAcc reversed behavioral abnormalities induced by chronic social isolation. These data suggest that the dopamine system is involved in alterations in social behaviors induced by chronic social isolation. This finding sheds light on the mechanism underlying abnormalities in social behavior induced by adolescent chronic social isolation and provides a promising target to treat mental diseases relevant to social isolation.

Neural circuits of social behaviors: Innate yet flexible

Social behaviors, such as mating, fighting, and parenting, are fundamental for survival of any vertebrate species. All members of a species express social behaviors in a stereotypical and species-specific way without training because of developmentally hardwired neural circuits dedicated to these behaviors. Despite being innate, social behaviors are flexible. The readiness to interact with a social target or engage in specific social acts can vary widely based on reproductive state, social experience, and many other internal and external factors. Such high flexibility gives vertebrates the ability to release the relevant behavior at the right moment and toward the right target. This maximizes reproductive success while minimizing the cost and risk associated with behavioral expression. Decades of research have revealed the basic neural circuits underlying each innate social behavior. The neural mechanisms that support behavioral plasticity have also started to emerge. Here we provide an overview of these social behaviors and their underlying neural circuits and then discuss in detail recent findings regarding the neural processes that support the flexibility of innate social behaviors.

The Distinct Functions of Dopaminergic Receptors on Pain Modulation: A Narrative Review

Chronic pain is considered an economic burden on society as it often results in disability, job loss, and early retirement. Opioids are the most common analgesics prescribed for the management of moderate to severe pain. However, chronic exposure to these drugs can result in opioid tolerance and opioid-induced hyperalgesia. On pain modulation strategies, exploiting the multitarget drugs with the ability of the superadditive or synergistic interactions attracts more attention. In the present report, we have reviewed the analgesic effects of different dopamine receptors, particularly D1 and D2 receptors, in different regions of the central nervous system, including the spinal cord, striatum, nucleus accumbens (NAc), and periaqueductal gray (PAG). According to the evidence, these regions are not only involved in pain modulation but also express a high density of DA receptors. The findings can be categorized as follows: (1) D2-like receptors may exert a higher analgesic potency, but D1-like receptors act in different manners across several mechanisms in the mentioned regions; (2) in the spinal cord and striatum, antinociception of DA is mainly mediated by D2-like receptors, while in the NAc and PAG, both D1- and D2-like receptors are involved as analgesic targets; and (3) D2-like receptor agonists can act as adjuvants of μ-opioid receptor agonists to potentiate analgesic effects and provide a better approach to pain relief.

Effects of Early-Life Stress on the Brain and Behaviors: Implications of Early Maternal Separation in Rodents

Early-life stress during the prenatal and postnatal periods affects the formation of neural networks that influence brain function throughout life. Previous studies have indicated that maternal separation (MS), a typical rodent model equivalent to early-life stress and, more specifically, to child abuse and/or neglect in humans, can modulate the hypothalamic-pituitary-adrenal (HPA) axis, affecting subsequent neuronal function and emotional behavior. However, the neural basis of the long-lasting effects of early-life stress on brain function has not been clarified. In the present review, we describe the alterations in the HPA-axis activity-focusing on serum corticosterone (CORT)-and in the end products of the HPA axis as well as on the CORT receptor in rodents. We then introduce the brain regions activated during various patterns of MS, including repeated MS and single exposure to MS at various stages before weaning, via an investigation of c-Fos expression, which is a biological marker of neuronal activity. Furthermore, we discuss the alterations in behavior and gene expression in the brains of adult mice exposed to MS. Finally, we ask whether MS repeats itself and whether intergenerational transmission of child abuse and neglect is possible.

Epistatic effect of Ankyrin repeat and kinase domain containing 1 - Dopamine receptor D2 and catechol-o-methyltransferase single nucleotide polymorphisms on the risk for hazardous use of alcohol in Lithuanian population

AIM

The Lithuanian population has outstanding rates of alcohol consumption and alcohol related mortality. Alteration of brain dopaminergic system play a role in the risk for addiction disorders. We evaluated the association of one single nucleotide polymorphism rs1800497 in the Ankyrin Repeat and Kinase Domain Containing 1 - Dopamine Receptor D2 complex (ANKK1-DRD2) and a catechol-o-methyltransferase (COMT) rs4680 single nucleotide polymorphism with the risk for alcohol use disorder and impulsiveness in Lithuanian population. Both genetic polymorphisms are known to alter brain dopaminergic activity, thus we also investigated the possible interaction effect of these polymorphisms.

METHODS

The study included 329 participants recruited from the local community. Hazardous alcohol use was evaluated using the Alcohol Use Disorder Identification Test (AUDIT). Impulsiveness was measured using the Barratt Impulsiveness Scale - 11 (BIS-11). Between group differences of AUDIT and BIS-11 scores were examined stratified by genetic polymorphisms and their combinations. The independent effect of each polymorphism and their interaction for hazardous alcohol use were evaluated using adjusted logistic regression analyses.

RESULTS

The ANKK1-DRD2 rs1800497 polymorphism was associated with total AUDIT score, but not with the hazardous use of alcohol, as indicated by the AUDIT test cut-off of 8. The COMT rs4680 GG genotype was associated with the hazardous use of alcohol (adjusted OR = 2.094, p = 0.029), but this association was not statistically significant after adjustment for multiple comparisons. Presence of both COMT rs4680 and ANKK1-DRD2 rs1800497 GGxCT/TT polymorphisms was associated with significantly increased risk for hazardous use of alcohol (adjusted OR = 5.016, p = 0.005). The COMT rs4680 and ANKK1-DRD2 rs1800497 genetic polymorphisms, and their combination were not associated with impulsiveness.

CONCLUSIONS

Our study demonstrated that the interaction of COMT rs4680 and ANKK1-DRD2 rs1800497 genetic polymorphisms is associated with a hazardous use of alcohol.

Double dissociation between actions of dopamine D1 and D2 receptors of the ventral and dorsolateral striatum to produce reinstatement of cocaine seeking behavior

One of the hallmarks of addiction is the enduring vulnerability to relapse. Following repeated use, cocaine (COC) induces neuroadaptations within the dopamine (DA) system, arguably underlying several aspects of COC-seeking behavior. Peripheral stimulation of D2, but not D1, receptors induces relapse. However, where in the brain these effects occur is still matter of debate. The D1 and D2 receptors (D1R; D2R) are highly expressed in the nucleus accumbens (NAcc) and the dorsolateral striatum (DLS), but their specific involvement in the reinstatement of COC-seeking remains elusive. We assessed the reinstating effects of intracerebral infusions of agonists of D1R (SKF82958) or D2R (quinelorane) within the NAcc or DLS of rats after extinction of COC self-administration (COC SA). To assess whether we could block peripheral D2 agonist (quinelorane) induced reinstatement, we simultaneously infused either a D1R (SCH23390) or a D2R (raclopride) antagonist within the NAcc or DLS. When infused into the NAcc, but not into the DLS, SKF82958 induced reinstatement of COC-seeking; conversely, quinelorane had no effect when injected into the NAcc, but induced reinstatement when infused into the DLS while the D1R agonist has no effect. While administration of raclopride into the NAcc or DLS impedes the reinstating effect of a systemic quinelorane injection, the infusion of SCH23390 into the NAcc or DLS surprisingly, blocks the reinstatement induced by the peripheral D2R stimulation. Our results point to a double dissociation between D1R and D2R of the NAcc and DLS, highlighting their complex interactions within both structures, in the reinstatement of COC-seeking behavior.

Computational Characteristics of the Striatal Dopamine System Described by Reinforcement Learning With Fast Generalization

Generalization is the ability to apply past experience to similar but non-identical situations. It not only affects stimulus-outcome relationships, as observed in conditioning experiments, but may also be essential for adaptive behaviors, which involve the interaction between individuals and their environment. Computational modeling could potentially clarify the effect of generalization on adaptive behaviors and how this effect emerges from the underlying computation. Recent neurobiological observation indicated that the striatal dopamine system achieves generalization and subsequent discrimination by updating the corticostriatal synaptic connections in differential response to reward and punishment. In this study, we analyzed how computational characteristics in this neurobiological system affects adaptive behaviors. We proposed a novel reinforcement learning model with multilayer neural networks in which the synaptic weights of only the last layer are updated according to the prediction error. We set fixed connections between the input and hidden layers to maintain the similarity of inputs in the hidden-layer representation. This network enabled fast generalization of reward and punishment learning, and thereby facilitated safe and efficient exploration of spatial navigation tasks. Notably, it demonstrated a quick reward approach and efficient punishment aversion in the early learning phase, compared to algorithms that do not show generalization. However, disturbance of the network that causes noisy generalization and impaired discrimination induced maladaptive valuation. These results suggested the advantage and potential drawback of computation by the striatal dopamine system with regard to adaptive behaviors.

Learned avoidance requires VTA KOR-mediated reductions in dopamine

Proper learning from an aversive experience is essential for survival, yet it is an aberrant process in a wide range of mental disorders, as well as dopaminergic neurodegenerative disease. While the mesolimbic dopamine system is known to be essential for reward learning, the characterization of a potential pattern of dopamine signaling that guides avoidance remains unknown. Aversive stimuli may directly modulate dopamine signaling through the dynorphin/kappa opioid receptor (KOR) system, as kappa opioid receptors are expressed in this neural circuit and their activation is aversive in both rodents and humans. Ventral tegmental area (VTA) KORs are ideally positioned to directly shape aversion-induced reductions in dopamine signaling, but their role in this process has received little consideration. To determine the necessity of VTA KOR activity in the regulation of dopamine signaling and avoidance, we tested the effects of VTA KOR blockade on real time dopaminergic responses to aversive stimuli and learned avoidance in male Sprague-Dawley rats. We found that blockade of VTA KORs attenuated aversion-induced reductions in dopamine, and this treatment also prevented avoidance following the aversive experience. To determine whether aversion-induced reductions in striatal dopamine are necessary for avoidance, we tested avoidance following treatment with an intra nucleus accumbens D2 receptor agonist. This treatment also prevented avoidance and is consistent with the view that aversion-induced reductions in dopamine reduce dopamine signaling at high affinity D2 receptors and disinhibit an aversion-sensitive striatal output circuit to promote avoidance.

Nucleus accumbens pathways control cell-specific gene expression in the medial prefrontal cortex

The medial prefrontal cortex (mPFC) is a critical component of a cortico-basal ganglia-thalamo-cortical loop regulating limbic and cognitive functions. Within this circuit, two distinct nucleus accumbens (NAc) output neuron types, dopamine D1 or D2 receptor-expressing neurons, dynamically control the flow of information through basal ganglia nuclei that eventually project back to the mPFC to complete the loop. Thus, chronic dysfunction of the NAc may result in mPFC transcriptomal changes, which in turn contribute to disease conditions associated with the mPFC and basal ganglia. Here, we used RNA sequencing to analyse differentially expressed genes (DEGs) in the mPFC following a reversible neurotransmission blocking technique in D1 or D2 receptor-expressing NAc neurons, respectively (D1-RNB, or D2-RNB). Gene Set Enrichment Analysis revealed that gene sets of layer 5b and 6 pyramidal neurons were enriched in DEGs of the mPFC downregulated in both NAc D1- and D2-RNB mice. In contrast, gene sets of layer 5a pyramidal neurons were enriched in upregulated DEGs of the mPFC in D1-RNB mice, and downregulated DEGs of the mPFC in D2-RNB mice. These findings reveal for the first time that NAc output pathways play an important role in controlling mPFC gene expression.

GPR88 in D1R-Type and D2R-Type Medium Spiny Neurons Differentially Regulates Affective and Motor Behavior

The orphan receptor GPR88 is highly expressed in D1 receptor (D1R)- and D2R-medium spiny neurons (MSNs) and has been associated to striatum-dependent functions in rodents. The total deletion of Gpr88 in mice was shown to decrease anxiety-like behaviors, increase stereotypies and locomotion, and impair motor coordination and motor learning. Knowing the opposing role of D1R- and D2R-MSNs, we here investigated the respective roles of GPR88 in the two MSN subtypes for these behaviors. To do so, we compared effects of a conditional Gpr88 gene knock-out (KO) in D1R-MSNs (D1R-Gpr88 mice) or D2R-MSNs (A_2AR-Gpr88 mice) with effects of the total Gpr88 KO (CMV-Gpr88 mice). Overall, most phenotypes of CMV-Gpr88 mice were recapitulated in A_2AR-Gpr88 mice, including reduced marble burying, increased social interactions, increased locomotor activity and stereotypies in the open field, and reduced motor coordination in the rotarod. Exceptions were the reduced habituation to the open field and reduced motor skill learning, which were observed in CMV-Gpr88 and D1R-Gpr88 mice, but not in A_2AR-Gpr88 mice. D1R-Gpr88 mice otherwise showed no other phenotype in this study. Our data together show that GPR88 modulates the function of both D1R- and D2R-MSNs, and that GPR88 activity in these two neuron populations has very different and dissociable impacts on behavior. We suggest that GPR88 in D2R-MSNs shapes defensive and social behavior and contributes in maintaining the inhibition of basal ganglia outputs to control locomotion, stereotypies and motor coordination, while GPR88 in D1R-MSNs promotes novelty habituation and motor learning.

Translating striatal activity from brain slice to whole animal neurophysiology: A guide for neuroscience research integrating diverse levels of analysis

An important goal of this review is highlighting research in neuroscience as examples of multilevel functional and anatomical analyses addressing basic science issues and applying results to the understanding of diverse disorders. The research of Dr. Michael Levine, a leader in neuroscience, exemplifies this approach by uncovering fundamental properties of basal ganglia function and translating these findings to clinical applications. The review focuses on neurophysiological research connecting results from in vitro and in vivo recordings. A second goal is to utilize these research connections to produce novel, accurate descriptions for corticostriatal processing involved in varied, complex functions. Medium spiny neurons in striatum act as integrators combining input with baseline activity creating motivational "events." Basic research on corticostriatal synapses is described and links developed to issues with clinical relevance such as inhibitory gating, self-injurious behavior, and relative reward valuation. Work is highlighted on dopamine-glutamate interactions. Individual medium spiny neurons express both D₁ and D₂ receptors and encode information in a bivalent manner depending upon the mix of receptors involved. Current work on neurophysiology of reward processing has taken advantage of these basic approaches at the cellular and molecular levels. Future directions in studying physiology of reward processing and action sequencing could profit by incorporating the divergent ways dopamine modulates incoming neurochemical signals. Primary investigators leading research teams should mirror Mike Levine's efforts in "climbing the mountain" of scientific inquiry by performing analyses at different levels of inquiry, integrating the findings, and building comprehensive answers to problems unsolvable without this bold approach.

Cell-type and projection-specific dopaminergic encoding of aversive stimuli in addiction

Drug addiction is a major public health concern across the world for which there are limited treatment options. In order to develop new therapies to correct the behavioral deficits that result from repeated drug use, we need to understand the neural circuit dysfunction that underlies the pathophysiology of the disorder. Because the initial reinforcing effects of drugs are dependent on increases in dopamine in reward-related brain regions such as the mesolimbic dopamine pathway, a large focus of addiction research has centered on the dysregulation of this system and its control of positive reinforcement and motivation. However, in addition to the processing of positive, rewarding stimuli, there are clear deficits in the encoding and valuation of information about potential negative outcomes and how they control decision making and motivation. Further, aversive stimuli can motivate or suppress behavior depending on the context in which they are encountered. We propose a model where rewarding and aversive information guides the execution of specific motivated actions through mesocortical and mesolimbic dopamine acting on D1- and D2- receptor containing neuronal populations. Volitional drug exposure alters the processing of rewarding and aversive stimuli through remodeling of these dopaminergic circuits, causing maladaptive drug seeking, self-administration in the face of negative consequences, and drug craving. Together, this review discusses the dysfunction of the circuits controlling different types of aversive learning as well as how these guide specific discrete behaviors, and provides a conceptual framework for how they should be considered in preclinical addiction models.

Defining circuit-specific roles for G protein-coupled receptors in aversive learning

The encoding of negative valence in response to noxious stimuli/experiences and in turn, the behavioral representation of negative affective states is essential for survival. Recent advances in neuroscience have determined multiple sites of neural plasticity and key circuits of connectivity across these regions in mediating aversive behavior. G protein-coupled receptors (GPCRs), owing to their neuromodulatory role, are especially important to refining our understanding of the molecular substrates involved in these circuits. In this review, we will focus on recent, contemporary findings that explore neural circuit-specific roles for neurotransmitter/peptide GPCRs and the importance of using novel approaches to illuminate the molecular mechanisms central to aversive learning.

The Virtual-Environment-Foraging Task enables rapid training and single-trial metrics of rule acquisition and reversal in head-fixed mice

Behavioural flexibility is an essential survival skill, yet our understanding of its neuronal substrates is still limited. While mouse research offers unique tools to dissect the neuronal circuits involved, the measurement of flexible behaviour in mice often suffers from long training times, poor experimental control, and temporally imprecise binary (hit/miss) performance readouts. Here we present a virtual-environment task for mice that tackles these limitations. It offers fast training of vision-based rule reversals (~100 trials per reversal) with full stimulus control and continuous behavioural readouts. By generating multiple non-binary performance metrics per trial, it provides single-trial estimates not only of response accuracy and speed, but also of underlying processes like choice certainty and alertness (discussed in detail in a companion paper). Based on these metrics, we show that mice can predict new task rules long before they are able to execute them, and that this delay varies across animals. We also provide and validate single-trial estimates of whether an error was committed with or without awareness of the task rule. By tracking in unprecedented detail the cognitive dynamics underlying flexible behaviour, this task enables new investigations into the neuronal interactions that shape behavioural flexibility moment by moment.

Preproenkephalin-expressing ventral pallidal neurons control inhibitory avoidance learning

The ventral pallidum (VP) is a critical component of the basal ganglia neurocircuitry regulating learning and decision making; however, its precise role in controlling associative learning of environmental stimuli conditioned to appetitive or aversive outcomes is still unclear. Here, we investigated the expression of preproenkephalin, a polypeptide hormone previously shown to be expressed in nucleus accumbens neurons controlling aversive learning, within GABAergic and glutamatergic VP neurons. Next, we explored the behavioral consequences of chemicogenetic inhibition or excitation of preproenkephalin-expressing VP neurons on associative learning of reward- or aversion-paired stimuli in autoshaping and inhibitory avoidance tasks, respectively. We reveal for the first time that preproenkephalin is expressed predominantly in GABAergic rather than glutamatergic VP neurons, and that excitation of these preproenkephalin-expressing VP neurons was sufficient to impair inhibitory avoidance learning. These findings indicate the necessity for inhibition of preproenkephalin-expressing VP neurons for avoidance learning, and suggest these neurons as a potential therapeutic target for psychiatric disorders associated with maladaptive aversive learning.

[Homeostatic regulation of basal ganglia circuit for flexible behavior]

Behavioral inflexibility has been reported in various psychiatric disorders including drug addiction and schizophrenia. Considerable evidence has demonstrated a critical role for the basal ganglia in the flexibility of behavioral strategies. These processes are guided by the activity of two discrete neuron types, dopamine D1- or D2-receptor expressing medium spiny neurons (D1-/D2-MSNs) in the basal ganglia circuit. We used a reversible neurotransmission blocking technique to examine the role of D1- and D2-MSNs in the acquisition and reversal learning of a place discrimination task in the IntelliCage. We demonstrated that D1- and D2-MSNs do not mediate the acquisition of the task, but that suppression of activity in D2-MSNs impairs reversal learning and increased perseverative errors. Additionally, global knockout of the dopamine D2L receptor isoform produced a similar behavioral phenotype to D2-MSN-blocked mice. We also showed that D2L receptors are necessary for visual discrimination and reversal learning. These results suggest that D2L receptors and D2-MSNs have a critical role in the homeostatic regulation of basal ganglia circuit for flexible behaviors.

Chemokine receptor CCR2 contributes to neuropathic pain and the associated depression via increasing NR2B-mediated currents in both D1 and D2 dopamine receptor-containing medium spiny neurons in the nucleus accumbens shell

Patients with neuropathic pain are usually accompanied by depression. Chemokine-mediated neuroinflammation is involved in a variety of diseases, including neurodegenerative diseases, depression, and chronic pain. The nucleus accumbens (NAc) is an important area in mediating pain sensation and depression. Here we report that spinal nerve ligation (SNL) induced upregulation of chemokine CCL2 and its major receptor CCR2 in both dopamine D1 and D2 receptor (D1R and D2R)-containing neurons in the NAc. Inhibition of CCR2 by shRNA lentivirus in the NAc shell attenuated SNL-induced pain hypersensitivity and depressive behaviors. Conversely, intra-NAc injection of CCL2-expressing lentivirus-induced nociceptive and depressive behaviors in naïve mice. Whole-cell patch clamp recording of D1R-positive or D2R-positive medium spiny neurons (MSNs) showed that SNL increased NMDA receptor (NMDAR)-mediated currents that are induced by stimulation of prefrontal cortical afferents to MSNs, which was inhibited by a CCR2 antagonist. Furthermore, Ccr2 shRNA also reduced NMDAR-mediated currents, and this reduction was mainly mediated via NR2B subunit. Consistently, NR2B, colocalized with CCR2 in the NAc, was phosphorylated after SNL and was inhibited by intra-NAc injection of Ccr2 shRNA. Furthermore, SNL or CCL2 induced ERK activation in the NAc. Inhibition of ERK by a MEK inhibitor reduced NR2B phosphorylation induced by SNL or CCL2. Finally, intra-NAc injection of NR2B antagonist or MEK inhibitor attenuated SNL-induced pain hypersensitivity and depressive behaviors. Collectively, these results suggest that CCL2/CCR2 signaling in the NAc shell is important in mediating neuropathic pain and depression via regulating NR2B-mediated NMDAR function in D1R- and D2R-containing neurons following peripheral nerve injury.

Contributions of medial prefrontal cortex to decision making involving risk of punishment

The prefrontal cortex (PFC) plays an important role in several forms of cost-benefit decision making. Its contributions to decision making under risk of explicit punishment, however, are not well understood. A rat model was used to investigate the role of the medial PFC (mPFC) and its monoaminergic innervation in a Risky Decision-making Task (RDT), in which rats chose between a small, "safe" food reward and a large, "risky" food reward accompanied by varying probabilities of mild footshock punishment. Inactivation of mPFC increased choice of the large, risky reward when the punishment probability increased across the session ("ascending RDT"), but decreased choice of the large, risky reward when the punishment probability decreased across the session ("descending RDT"). In contrast, enhancement of monoamine availability via intra-mPFC amphetamine reduced choice of the large, risky reward only in the descending RDT. Systemic administration of amphetamine reduced choice of the large, risky reward in both the ascending and descending RDT; however, this reduction was not attenuated by concurrent mPFC inactivation, indicating that mPFC is not a critical locus of amphetamine's effects on risk taking. These findings suggest that mPFC plays an important role in adapting choice behavior in response to shifting risk contingencies, but not necessarily in risk-taking behavior per se.

Estradiol and the control of feeding behavior

This review lays out the evidence for the role of E2 in homeostatic and hedonic feeding across several species. While significant effort has been expended on homeostatic feeding research, more studies for hedonic feeding need to be conducted (i.e. are there increases in meal size and enhanced motivation to natural food rewards). By identifying the underlying neural circuitry involved, one can better delineate the mechanisms by which E2 influences feeding behavior. By utilizing more selective neural targeting techniques, such as optogenetics, significant progress can be made toward this goal. Together, behavioral and physiological techniques will help us to better understand neural deficits that can increase the risk for obesity in the absence of E2 (menopause) and aid in developing therapeutic strategies.

Essential Control of the Function of the Striatopallidal Neuron by Pre-coupled Complexes of Adenosine A2A-Dopamine D2 Receptor Heterotetramers and Adenylyl Cyclase

The central adenosine system and adenosine receptors play a fundamental role in the modulation of dopaminergic neurotransmission. This is mostly achieved by the strategic co-localization of different adenosine and dopamine receptor subtypes in the two populations of striatal efferent neurons, striatonigral and striatopallidal, that give rise to the direct and indirect striatal efferent pathways, respectively. With optogenetic techniques it has been possible to dissect a differential role of the direct and indirect pathways in mediating "Go" responses upon exposure to reward-related stimuli and "NoGo" responses upon exposure to non-rewarded or aversive-related stimuli, respectively, which depends on their different connecting output structures and their differential expression of dopamine and adenosine receptor subtypes. The striatopallidal neuron selectively expresses dopamine D₂ receptors (D2R) and adenosine A_2A receptors (A2AR), and numerous experiments using multiple genetic and pharmacological in vitro, in situ and in vivo approaches, demonstrate they can form A2AR-D2R heteromers. It was initially assumed that different pharmacological interactions between dopamine and adenosine receptor ligands indicated the existence of different subpopulations of A2AR and D2R in the striatopallidal neuron. However, as elaborated in the present essay, most evidence now indicates that all interactions can be explained with a predominant population of striatal A2AR-D2R heteromers forming complexes with adenylyl cyclase subtype 5 (AC5). The A2AR-D2R heteromer has a tetrameric structure, with two homodimers, which allows not only multiple allosteric interactions between different orthosteric ligands, agonists, and antagonists, but also the canonical Gs-Gi antagonistic interaction at the level of AC5. We present a model of the function of the A2AR-D2R heterotetramer-AC5 complex, which acts as an integrative device of adenosine and dopamine signals that determine the excitability and gene expression of the striatopallidal neurons. The model can explain most behavioral effects of A2AR and D2R ligands, including the psychostimulant effects of caffeine. The model is also discussed in the context of different functional striatal compartments, mainly the dorsal and the ventral striatum. The current accumulated knowledge of the biochemical properties of the A2AR-D2R heterotetramer-AC5 complex offers new therapeutic possibilities for Parkinson's disease, schizophrenia, SUD and other neuropsychiatric disorders with dysfunction of dorsal or ventral striatopallidal neurons.

Shaping vulnerability to addiction - the contribution of behavior, neural circuits and molecular mechanisms

Substance use disorders continue to impose increasing medical, financial and emotional burdens on society in the form of morbidity and overdose, family disintegration, loss of employment and crime, while advances in prevention and treatment options remain limited. Importantly, not all individuals exposed to abused substances effectively develop the disease. Genetic factors play a significant role in determining addiction vulnerability and interactions between innate predisposition, environmental factors and personal experiences are also critical. Thus, understanding individual differences that contribute to the initiation of substance use as well as on long-term maladaptations driving compulsive drug use and relapse propensity is of critical importance to reduce this devastating disorder. In this paper, we discuss current topics in the field of addiction regarding individual vulnerability related to behavioral endophenotypes, neural circuits, as well as genetics and epigenetic mechanisms. Expanded knowledge of these factors is of importance to improve and personalize prevention and treatment interventions in the future.

GABA and Glutamate Synaptic Coadaptations to Chronic Ethanol in the Striatum

Alcohol (ethanol) is a widely used and abused drug with approximately 90% of adults over the age of 18 consuming alcohol at some point in their lifetime. Alcohol exerts its actions through multiple neurotransmitter systems within the brain, most notably the GABAergic and glutamatergic systems. Alcohol's actions on GABAergic and glutamatergic neurotransmission have been suggested to underlie the acute behavioral effects of ethanol. The striatum is the primary input nucleus of the basal ganglia that plays a role in motor and reward systems. The effect of ethanol on GABAergic and glutamatergic neurotransmission within striatal circuitry has been thought to underlie ethanol taking, seeking, withdrawal and relapse. This chapter reviews the effects of ethanol on GABAergic and glutamatergic transmission, highlighting the dynamic changes in striatal circuitry from acute to chronic exposure and withdrawal.