Nucleus Accumbens Dopamine D1-Receptor-Expressing Neurons Control the Acquisition of Sign-Tracking to Conditioned Cues in Mice

Temporal dynamics of nucleus accumbens neurons in male mice during reward seeking

The nucleus accumbens (NAc) regulates reward-motivated behavior, but the temporal dynamics of NAc neurons that enable "free-willed" animals to obtain rewards remain elusive. Here, we recorded Ca2+ activity from individual NAc neurons when mice performed self-paced lever-presses for sucrose. NAc neurons exhibited three temporally-sequenced clusters, defined by times at which they exhibited increased Ca2+ activity: approximately 0, -2.5 or -5 sec relative to the lever-pressing. Dopamine D1 receptor (D1)-expressing neurons and D2-neurons formed the majority of the -5-sec versus -2.5-sec clusters, respectively, while both neuronal subtypes were represented in the 0-sec cluster. We found that pre-press activity patterns of D1- or D2-neurons could predict subsequent lever-presses. Inhibiting D1-neurons at -5 sec or D2-neurons at -2.5 sec, but not at other timepoints, reduced sucrose-motivated lever-pressing. We propose that the time-specific activity of D1- and D2-neurons mediate key temporal features of the NAc through which reward motivation initiates reward-seeking behavior.

Sex-dependent differences in the ability of nicotine to modulate discrimination learning and cognitive flexibility in mice

Nicotine, an addictive compound found in tobacco, functions as an agonist of nicotinic acetylcholine receptors (nAChRs) in the brain. Interestingly, nicotine has been reported to act as a cognitive enhancer in both human subjects and experimental animals. However, its effects in animal studies have not always been consistent, and sex differences have been identified in the effects of nicotine on several behaviors. Specifically, the role that sex plays in modulating the effects of nicotine on discrimination learning and cognitive flexibility in rodents is still unclear. Here, we evaluated sex-dependent differences in the effect of daily nicotine intraperitoneal (i.p.) administration at various doses (0.125, 0.25, and 0.5 mg/kg) on visual discrimination (VD) learning and reversal (VDR) learning in mice. In male mice, 0.5 mg/kg nicotine significantly improved performance in the VDR, but not the VD, task, while 0.5 mg/kg nicotine significantly worsened performance in the VD, but not VDR task in female mice. Furthermore, 0.25 mg/kg nicotine significantly worsened performance in the VD and VDR task only in female mice. Next, to investigate the cellular mechanisms that underlie the sex difference in the effects of nicotine on cognition, transcriptomic analyses were performed focusing on the medial prefrontal cortex tissue samples from male and female mice that had received continuous administration of nicotine for 3 or 18 days. As a result of pathway enrichment analysis and protein-protein interaction analysis using gene sets of differentially expressed genes, decreased expression of postsynaptic-related genes in males and increased expression of innate immunity-related genes in females were identified as possible molecular mechanisms related to sex differences in the effects of nicotine on cognition in discrimination learning and cognitive flexibility. Our result suggests that nicotine modulates cognitive function in a sex-dependent manner by alternating the expression of specific gene sets in the medial prefrontal cortex.

Role of nucleus accumbens D1-type medium spiny neurons in the expression and extinction of sign-tracking

While sign-tracking, also known as autoshaping, has been studied for many decades, only recently has the tendency to show sign-tracking behavior been linked to the development and persistence of addiction. Sign-tracking is dependent upon dopamine activity in the nucleus accumbens (NAc). The NAc is comprised predominantly of medium spiny projection neurons (MSN) that can be differentiated by their D1-like or D2-like dopamine receptor expression. Here we determined how reducing activity of D1-type MSNs in the NAc affects the expression and extinction of sign-tracking. To address this, we transfected the NAc of transgenic male and female rats that selectively express Cre recombinase in D1-type MSNs with a DIO viral vector expressing hM4Di. Cre- rats were given the same viral infusion but did not express the hM4Di receptor and therefore served as controls. Rats were then conditioned to associate lever presentations with pellet delivery. After sign-tracking was established, all rats were administered clozapine-n-oxide (CNO) prior to three additional conditioning sessions to assess the effects of NAc D1-MSNs inhibition on sign-tracking in the presence of reward. CNO treatment did not alter the expression of sign-tracking in Cre+ or Cre- rats. Next rats underwent extinction training where lever presentations occurred without pellet delivery and all rats received a CNO injection prior to each extinction session. In these extinction conditions, Cre+ rats exhibited robust extinction of sign-tracking across sessions, whereas Cre- rats did not. To determine if D1-MSN inhibition merely produced a temporary cessation of sign-tracking or instead had facilitated a persistent loss of sign-tracking, we evaluated the reemergence of sign-tracking in a test for reconditioning. During testing, reintroduction of the CS-US pairing did not promote the reemergence of sign-tracking in Cre+ rats, but restored sign-tracking in Cre- rats. Thus, chemogenetic inhibition of NAc D1-MSNs promoted extinction of sign-tracking. Collectively, these data suggest that D1-MSNs play an important role in resistance to extinction that typifies sign-tracking behavior.

α4-Containing GABAA Receptors on DRD2 Neurons of the Nucleus Accumbens Mediate Instrumental Responding for Conditioned Reinforcers and Its Potentiation by Cocaine

Extrasynaptic GABAA receptors (GABAARs) composed of α4, β, and δ subunits mediate GABAergic tonic inhibition and are potential molecular targets in the modulation of behavioral responses to natural and drug rewards. These GABAARs are highly expressed within the nucleus accumbens (NAc), where they influence the excitability of the medium spiny neurons. Here, we explore their role in modulating behavioral responses to food-conditioned cues and the behavior-potentiating effects of cocaine. α4-Subunit constitutive knock-out mice (α4-/-) showed higher rates of instrumental responding for reward-paired stimuli in a test of conditioned reinforcement (CRf). A similar effect was seen following viral knockdown of GABAAR α4 subunits within the NAc. Local infusion of the α4βδ-GABAAR-preferring agonist THIP (4,5,6,7-tetrahydroisoxazolo[5,4-c]pyridin-3-ol; Gaboxadol) into the NAc had no effect on responding when given alone but reduced cocaine potentiation of responding for conditioned reinforcers in wild-type, but not α4-/- mice. Finally, specific deletion of α4-subunits from dopamine D2, but not D1, receptor-expressing neurons (DRD2 and DRD1 neurons), mimicked the phenotype of the constitutive knockout, potentiating CRf responding, and blocking intra-accumbal THIP attenuation of cocaine-potentiated CRf responding. These data demonstrate that α4-GABAAR-mediated inhibition of DRD2 neurons reduces instrumental responding for a conditioned reinforcer and its potentiation by cocaine and emphasize the importance of GABAergic signaling within the NAc in mediating the effects of cocaine.

Error-related signaling in nucleus accumbens D2 receptor-expressing neurons guides inhibition-based choice behavior in mice

Learned associations between environmental cues and the outcomes they predict (cue-outcome associations) play a major role in behavioral control, guiding not only which responses we should perform, but also which we should inhibit, in order to achieve a specific goal. The encoding of such cue-outcome associations, as well as the performance of cue-guided choice behavior, is thought to involve dopamine D1 and D2 receptor-expressing medium spiny neurons (D1-/D2-MSNs) of the nucleus accumbens (NAc). Here, using a visual discrimination task in male mice, we assessed the role of NAc D1-/D2-MSNs in cue-guided inhibition of inappropriate responding. Cell-type specific neuronal silencing and in-vivo imaging revealed NAc D2-MSNs to contribute to inhibiting behavioral responses, with activation of NAc D2-MSNs following response errors playing an important role in optimizing future choice behavior. Our findings indicate that error-signaling by NAc D2-MSNs contributes to the ability to use environmental cues to inhibit inappropriate behavior.

Continuous cholinergic-dopaminergic updating in the nucleus accumbens underlies approaches to reward-predicting cues

The ability to learn Pavlovian associations from environmental cues predicting positive outcomes is critical for survival, motivating adaptive behaviours. This cued-motivated behaviour depends on the nucleus accumbens (NAc). NAc output activity mediated by spiny projecting neurons (SPNs) is regulated by dopamine, but also by cholinergic interneurons (CINs), which can release acetylcholine and glutamate via the activity of the vesicular acetylcholine transporter (VAChT) or the vesicular glutamate transporter (VGLUT3), respectively. Here we investigated behavioural and neurochemical changes in mice performing a touchscreen Pavlovian approach task by recording dopamine, acetylcholine, and calcium dynamics from D1- and D2-SPNs using fibre photometry in control, VAChT or VGLUT3 mutant mice to understand how these signals cooperate in the service of approach behaviours toward reward-predicting cues. We reveal that NAc acetylcholine-dopaminergic signalling is continuously updated to regulate striatal output underlying the acquisition of Pavlovian approach learning toward reward-predicting cues.

Nucleus Accumbens Core Dopamine D2 Receptor-Expressing Neurons Control Reversal Learning but Not Set-Shifting in Behavioral Flexibility in Male Mice

The ability to use environmental cues to flexibly guide responses is crucial for adaptive behavior and is thought to be controlled within a series of cortico-basal ganglia-thalamo-cortical loops. Previous evidence has indicated that different prefrontal cortical regions control dissociable aspects of behavioral flexibility, with the medial prefrontal cortex (mPFC) necessary for the ability to shift attention to a novel strategy (set-shifting) and the orbitofrontal cortex (OFC) necessary for shifting attention between learned stimulus-outcome associations (reversal learning). The nucleus accumbens (NAc) is a major downstream target of both the mPFC and the OFC; however, its role in controlling reversal learning and set-shifting abilities is still unclear. Here we investigated the contribution of the two major NAc neuronal populations, medium spiny neurons expressing either dopamine D1 or D2 receptors (D1-/D2-MSNs), in guiding reversal learning and set-shifting in an attentional set-shifting task (ASST). Persistent inhibition of neurotransmitter release from NAc D2-MSNs, but not D1-MSNs, resulted in an impaired ability for reversal learning, but not set-shifting in male mice. These findings suggest that NAc D2-MSNs play a critical role in suppressing responding toward specific learned cues that are now associated with unfavorable outcomes (i.e., in reversal stages), but not in the suppression of more general learned strategies (i.e., in set-shifting). This study provides further evidence for the anatomical separation of reversal learning and set-shifting abilities within cortico-basal ganglia-thalamo-cortical loops.

The Lack of Dopamine Transporter Is Associated With Conditional Associative Learning Impairments and Striatal Proteomic Changes

Dopamine (DA) is critically involved in different functions of the central nervous system (CNS) including control of voluntary movement, affect, reward, sleep, and cognition. One of the key components of DA neurotransmission is DA reuptake by the DA transporter (DAT), ensuring rapid clearance of DA from the synaptic cleft. Thus, lack of DAT leads to persistent high extracellular DA levels. While there is strong evidence for a role of striatal dopaminergic activity in learning and memory processes, little is known about the contribution of DAT deficiency to conditional learning impairments and underlying molecular processes. DAT-knockout (DAT-KO) rats were tested in a set of behavioral experiments evaluating conditional associative learning, which requires unaltered striatal function. In parallel, a large-scale proteomic analysis of the striatum was performed to identify molecular factors probably underlying behavioral patterns. DAT-KO rats were incapable to acquire a new operant skill in Pavlovian/instrumental autoshaping, although the conditional stimulus-unconditional stimulus (CS-US) association seems to be unaffected. These findings suggest that DAT directly or indirectly contributes to the reduction of transference of incentive salience from the reward to the CS. We propose that specific impairment of conditional learning might be caused by molecular adaptations to the hyperdopaminergic state, presumably by dopamine receptor 1 (DRD1) hypofunction, as proposed by proteomic analysis. Whether DRD1 downregulation can cause cognitive deficits in the hyperdopaminergic state is the subject of discussion, and further studies are needed to answer this question. This study may be useful for the interpretation of previous and the design of future studies in the dopamine field.

Trends in big data analyses by multicenter collaborative translational research in psychiatry

The underlying pathologies of psychiatric disorders, which cause substantial personal and social losses, remain unknown, and their elucidation is an urgent issue. To clarify the core pathological mechanisms underlying psychiatric disorders, in addition to laboratory-based research that incorporates the latest findings, it is necessary to conduct large-sample-size research and verify reproducibility. For this purpose, it is critical to conduct multicenter collaborative research across various fields, such as psychiatry, neuroscience, molecular biology, genomics, neuroimaging, cognitive science, neurophysiology, psychology, and pharmacology. Moreover, collaborative research plays an important role in the development of young researchers. In this respect, the Enhancing Neuroimaging Genetics through Meta-Analysis (ENIGMA) consortium and Cognitive Genetics Collaborative Research Organization (COCORO) have played important roles. In this review, we first overview the importance of multicenter collaborative research and our target psychiatric disorders. Then, we introduce research findings on the pathophysiology of psychiatric disorders from neurocognitive, neurophysiological, neuroimaging, genetic, and basic neuroscience perspectives, focusing mainly on the findings obtained by COCORO. It is our hope that multicenter collaborative research will contribute to the elucidation of the pathological basis of psychiatric disorders.

Impaired leptin responsiveness in the nucleus accumbens of leptin-overexpressing transgenic mice with dysregulated sucrose and lipid preference independent of obesity

While hypothalamic leptin resistance can occur prior to establishment of obesity, clarification is needed as to whether the impaired response to leptin in the reward-related nuclei occurs independently of obesity. To answer this question, we attempted to dissociate the normally coexisting leptin resistance from obesity. We investigated phenotypes of leptin-overexpressing transgenic mice fed for 1 week with 60 % high-fat diet (HFD) (LepTg-HFD1W mice). After 1 week, we observed that LepTg-HFD1W mice weighed as same as wild type (WT) mice fed standard chow diet (CD) for 1 week (WT-CD1W mice). However, compared to WT-CD1W mice, LepTg-HFD1W mice exhibited attenuated leptin-induced anorexia, decreased leptin-induced c-fos immunostaining in nucleus accumbens (NAc), one of important site of reward system, decreased leptin-stimulated pSTAT3 immunostaining in hypothalamus. Furthermore, neither sucrose nor lipid preference was suppressed by leptin in LepTg-HFD1W mice. On the contrary, leptin significantly suppressed both preferences in WT mice fed HFD (WT-HFD1 W mice). These results indicate that leptin responsiveness decreases in NAc independently of obesity. Additionally, in this situation, suppressive effect of leptin on the hedonic feeding results in impaired regulation. Such findings suggest the impaired leptin responsiveness in NAc partially contributes to dysregulated hedonic feeding behavior independently of obesity.

Striatonigrostriatal Spirals in Addiction

A biological reward system is integral to all animal life and humans are no exception. For millennia individuals have investigated this system and its influences on human behavior. In the modern day, with the US facing an ongoing epidemic of substance use without an effective treatment, these investigations are of paramount importance. It is well known that basal ganglia contribute to rewards and are involved in learning, approach behavior, economic choices, and positive emotions. This review aims to elucidate the physiological role of striatonigrostriatal (SNS) spirals, as part of basal ganglia circuits, in this reward system and their pathophysiological role in perpetuating addiction. Additionally, the main functions of neurotransmitters such as dopamine and glutamate and their receptors in SNS circuits will be summarized. With this information, the claim that SNS spirals are crucial intermediaries in the shift from goal-directed behavior to habitual behavior will be supported, making this circuit a viable target for potential therapeutic intervention in those with substance use disorders.

Nucleus accumbens pathways control cell-specific gene expression in the medial prefrontal cortex

The medial prefrontal cortex (mPFC) is a critical component of a cortico-basal ganglia-thalamo-cortical loop regulating limbic and cognitive functions. Within this circuit, two distinct nucleus accumbens (NAc) output neuron types, dopamine D1 or D2 receptor-expressing neurons, dynamically control the flow of information through basal ganglia nuclei that eventually project back to the mPFC to complete the loop. Thus, chronic dysfunction of the NAc may result in mPFC transcriptomal changes, which in turn contribute to disease conditions associated with the mPFC and basal ganglia. Here, we used RNA sequencing to analyse differentially expressed genes (DEGs) in the mPFC following a reversible neurotransmission blocking technique in D1 or D2 receptor-expressing NAc neurons, respectively (D1-RNB, or D2-RNB). Gene Set Enrichment Analysis revealed that gene sets of layer 5b and 6 pyramidal neurons were enriched in DEGs of the mPFC downregulated in both NAc D1- and D2-RNB mice. In contrast, gene sets of layer 5a pyramidal neurons were enriched in upregulated DEGs of the mPFC in D1-RNB mice, and downregulated DEGs of the mPFC in D2-RNB mice. These findings reveal for the first time that NAc output pathways play an important role in controlling mPFC gene expression.

Diminished food-related motivation in adult rats treated with methamphetamine during adolescence

Drug use among adolescents continues to be an area of concern because of the possibility of long-lasting physical and mental changes. The aim of this study was to determine whether methamphetamine exposure during adolescence results in long-lasting neurobehavioral alterations in adulthood. Sprague-Dawley rats were injected with methamphetamine (4 mg/kg/day) during postnatal days 28-37. Once rats reached postnatal days 150, they were placed in standard operant chambers, where they were trained to respond to a lever for sucrose pellets, the experimental reinforcement. Methamphetamine exposure during adolescence did not result in a noteworthy impairment in the development of the correct lever touch response in the autoshaped learning test with 4 seconds delayed reinforcement. These rats were also tested for the motivation to obtain sucrose pellets under a progressive ratio schedule of the reinforcement on postnatal days 170. Decreased lever-pressing response was noted in male rats exposed to methamphetamine during adolescence, but not in female rats. These results indicate that methamphetamine exposure during adolescence results in a decrease in the motivation for a natural reinforcer later in adulthood, particularly in male rats. From our data, we suggest that male brains are less capable of facilitating recovery than female brains after methamphetamine-induced perturbation of brain function during the adolescent period.

Role of basal ganglia neurocircuitry in the pathology of psychiatric disorders

Over the last few decades, advances in human and animal-based techniques have greatly enhanced our understanding of the neural mechanisms underlying psychiatric disorders. Many of these studies have indicated connectivity between and alterations within basal ganglia structures to be particularly pertinent to the development of symptoms associated with several of these disorders. Here we summarize the connectivity, molecular composition, and function of sites within basal ganglia neurocircuits. Then we review the current literature from both human and animal studies concerning altered basal ganglia function in five common psychiatric disorders: obsessive-compulsive disorder, substance-related and addiction disorders, major depressive disorder, generalized anxiety disorder, and schizophrenia. Finally, we present a model based upon the findings of these studies that highlights the striatum as a particularly attractive target for restoring normal function to basal ganglia neurocircuits altered within psychiatric disorder patients.

Preproenkephalin-expressing ventral pallidal neurons control inhibitory avoidance learning

The ventral pallidum (VP) is a critical component of the basal ganglia neurocircuitry regulating learning and decision making; however, its precise role in controlling associative learning of environmental stimuli conditioned to appetitive or aversive outcomes is still unclear. Here, we investigated the expression of preproenkephalin, a polypeptide hormone previously shown to be expressed in nucleus accumbens neurons controlling aversive learning, within GABAergic and glutamatergic VP neurons. Next, we explored the behavioral consequences of chemicogenetic inhibition or excitation of preproenkephalin-expressing VP neurons on associative learning of reward- or aversion-paired stimuli in autoshaping and inhibitory avoidance tasks, respectively. We reveal for the first time that preproenkephalin is expressed predominantly in GABAergic rather than glutamatergic VP neurons, and that excitation of these preproenkephalin-expressing VP neurons was sufficient to impair inhibitory avoidance learning. These findings indicate the necessity for inhibition of preproenkephalin-expressing VP neurons for avoidance learning, and suggest these neurons as a potential therapeutic target for psychiatric disorders associated with maladaptive aversive learning.

[Homeostatic regulation of basal ganglia circuit for flexible behavior]

Behavioral inflexibility has been reported in various psychiatric disorders including drug addiction and schizophrenia. Considerable evidence has demonstrated a critical role for the basal ganglia in the flexibility of behavioral strategies. These processes are guided by the activity of two discrete neuron types, dopamine D1- or D2-receptor expressing medium spiny neurons (D1-/D2-MSNs) in the basal ganglia circuit. We used a reversible neurotransmission blocking technique to examine the role of D1- and D2-MSNs in the acquisition and reversal learning of a place discrimination task in the IntelliCage. We demonstrated that D1- and D2-MSNs do not mediate the acquisition of the task, but that suppression of activity in D2-MSNs impairs reversal learning and increased perseverative errors. Additionally, global knockout of the dopamine D2L receptor isoform produced a similar behavioral phenotype to D2-MSN-blocked mice. We also showed that D2L receptors are necessary for visual discrimination and reversal learning. These results suggest that D2L receptors and D2-MSNs have a critical role in the homeostatic regulation of basal ganglia circuit for flexible behaviors.