Positive reinforcement mediated by midbrain dopamine neurons requires D1 and D2 receptor activation in the nucleus accumbens

From valence encoding to motivated behavior: A focus on the nucleus accumbens circuitry

How do our brains determine whether something is good or bad? The brain's ability to evaluate stimuli as positive or negative - by attributing valence - is fundamental to survival and decision-making. Different brain regions have been associated with valence encoding, including the nucleus accumbens (NAc). The NAc is predominantly composed of GABAergic medium spiny neurons (MSNs), which segregate into two distinct populations based on their dopamine receptor expression: D1-receptor-expressing (D1-MSNs) and D2-receptor-expressing neurons (D2-MSNs). Classical models propose a binary functional role, where D1-MSNs exclusively mediated reward and positive valence, while D2-MSNs processed aversion and negative valence. However, we now recognize that NAc MSN subpopulations operate in a more complex manner than previously thought, often working cooperatively rather than antagonistically in valence-related behaviors. This review synthesizes our current knowledge of valence-encoding neurocircuitry, with emphasis on the NAc. We examine electrophysiological, calcium imaging, optogenetic, chemogenetic and pharmacological studies detailing the contribution of NAc medium spiny neurons for rewarding and aversive responses. Finally, we explore emerging technical innovations that promise to advance our understanding of how the mammalian brain encodes valence and translates it into behavior.

Opponent control of reinforcement by striatal dopamine and serotonin

The neuromodulators dopamine (DA) and serotonin (5-hydroxytryptamine; 5HT) powerfully regulate associative learning1-8. Similarities in the activity and connectivity of these neuromodulatory systems have inspired competing models of how DA and 5HT interact to drive the formation of new associations9-14. However, these hypotheses have not been tested directly because it has not been possible to interrogate and manipulate multiple neuromodulatory systems in a single subject. Here we establish a mouse model that enables simultaneous genetic access to the brain's DA and 5HT neurons. Anterograde tracing revealed the nucleus accumbens (NAc) to be a putative hotspot for the integration of convergent DA and 5HT signals. Simultaneous recording of DA and 5HT axon activity, together with genetically encoded DA and 5HT sensor recordings, revealed that rewards increase DA signalling and decrease 5HT signalling in the NAc. Optogenetically dampening DA or 5HT reward responses individually produced modest behavioural deficits in an appetitive conditioning task, while blunting both signals together profoundly disrupted learning and reinforcement. Optogenetically reproducing DA and 5HT reward responses together was sufficient to drive the acquisition of new associations and supported reinforcement more potently than either manipulation did alone. Together, these results demonstrate that striatal DA and 5HT signals shape learning by exerting opponent control of reinforcement.

Sequence termination cues drive habits via dopamine-mediated credit assignment

Mesolimbic dopamine (DA) neurons are central to sequence learning and habit formation. Yet, the mechanisms by which cue-induced DA neural activity drives goal-directed or habitual sequence execution remain unknown. We designed two novel tasks to investigate how sequence initiation and termination cues influence DA-driven behavioral strategies and learning. We found that sequence initiation and termination cues differentially affect reward expectation during action sequences, with only the termination cue contributing to greater outcome devaluation insensitivity, automaticity and behavioral chunking. Mesolimbic fiber photometry recording revealed that this habit-like behavior was associated with a rapid backpropagation in DA signals from the reward to the immediately preceding cue and with attenuated DA reward prediction error signals, which reflected greater behavioral inflexibility. Finally, in absence of external cues, brief optogenetic stimulation of VTA DA neurons at sequence termination was sufficient to drive automaticity and behavioral chunking. Our results highlight the critical role of cue-evoked DA signals at sequence termination in mediating credit assignment and driving the development of habitual action sequence execution.

Conditional deletion of the AMPA-GluA1 and NMDA-GluN1 receptor subunit genes in midbrain D1 neurons does not alter cocaine reward in mice

Synaptic plasticity in the mesolimbic dopamine (DA) system contributes to the neural adaptations underlying addictive behaviors and relapse. However, the specific behavioral relevance of glutamatergic excitatory drive onto dopamine D1 receptor (D1R)-expressing neurons in mediating the reinforcing effect of cocaine remains unclear. Here, we investigated how midbrain AMPAR and NMDAR function modulate cocaine reward-related behavior using mutant mouse lines lacking the glutamate receptor genes Gria1 or Grin1 in D1R-expressing neurons (GluA1D1CreERT2 or GluN1D1CreERT2, respectively). We found that conditional genetic deletion of either GluA1 or GluN1 within this neuronal sub-population did not impact the ability of acute cocaine injection to increase intracranial self-stimulation (ICSS) ratio or reduced brain reward threshold compared to littermate controls. Additionally, our data demonstrate that deletion of GluA1 and GluN1 receptor subunits within D1R-expressing neurons did not affect cocaine reinforcement in an operant self-administration paradigm, as mutant mice showed comparable cocaine responses and intake to controls. Given the pivotal role of glutamate receptors in mediating relapse behavior, we further explored the impact of genetic deletion of AMPAR and NMDAR onto D1R-expressing neurons on cue-induced reinstatement following extinction. Surprisingly, deletion of AMPAR and NMDAR onto these neurons did not impair cue-induced reinstatement of cocaine-seeking behavior. These findings suggest that glutamatergic activity via NMDAR and AMPAR in D1R-expressing neurons may not exclusively mediate the reinforcing effects of cocaine and cue-induced reinstatement.

The nucleus accumbens in reward and aversion processing: insights and implications

The nucleus accumbens (NAc), a central component of the brain's reward circuitry, has been implicated in a wide range of behaviors and emotional states. Emerging evidence, primarily drawing from recent rodent studies, suggests that the function of the NAc in reward and aversion processing is multifaceted. Prolonged stress or drug use induces maladaptive neuronal function in the NAc circuitry, which results in pathological conditions. This review aims to provide comprehensive and up-to-date insights on the role of the NAc in motivated behavior regulation and highlights areas that demand further in-depth analysis. It synthesizes the latest findings on how distinct NAc neuronal populations and pathways contribute to the processing of opposite valences. The review examines how a range of neuromodulators, especially monoamines, influence the NAc's control over various motivational states. Furthermore, it delves into the complex underlying mechanisms of psychiatric disorders such as addiction and depression and evaluates prospective interventions to restore NAc functionality.

Optical Intracranial Self-Stimulation (oICSS): A New Behavioral Model for Studying Drug Reward and Aversion in Rodents

Brain-stimulation reward, also known as intracranial self-stimulation (ICSS), is a commonly used procedure for studying brain reward function and drug reward. In electrical ICSS (eICSS), an electrode is surgically implanted into the medial forebrain bundle (MFB) in the lateral hypothalamus or the ventral tegmental area (VTA) in the midbrain. Operant lever responding leads to the delivery of electrical pulse stimulation. The alteration in the stimulation frequency-lever response curve is used to evaluate the impact of pharmacological agents on brain reward function. If a test drug induces a leftward or upward shift in the eICSS response curve, it implies a reward-enhancing or abuse-like effect. Conversely, if a drug causes a rightward or downward shift in the functional response curve, it suggests a reward-attenuating or aversive effect. A significant drawback of eICSS is the lack of cellular selectivity in understanding the neural substrates underlying this behavior. Excitingly, recent advancements in optical ICSS (oICSS) have facilitated the development of at least three cell type-specific oICSS models-dopamine-, glutamate-, and GABA-dependent oICSS. In these new models, a comparable stimulation frequency-lever response curve has been established and employed to study the substrate-specific mechanisms underlying brain reward function and a drug's rewarding versus aversive effects. In this review article, we summarize recent progress in this exciting research area. The findings in oICSS have not only increased our understanding of the neural mechanisms underlying drug reward and addiction but have also introduced a novel behavioral model in preclinical medication development for treating substance use disorders.

Sensory Cues Potentiate VTA Dopamine Mediated Reinforcement

Sensory cues are critical for shaping decisions and invigorating actions during reward seeking. Dopamine neurons in the ventral tegmental area (VTA) are central in this process, supporting associative learning in Pavlovian and instrumental settings. Studies of intracranial self-stimulation (ICSS) behavior, which show that animals will work hard to receive stimulation of dopamine neurons, support the notion that dopamine transmits a reward or value signal to support learning. Recent studies have begun to question this, however, emphasizing dopamine's value-free functions, leaving its contribution to behavioral reinforcement somewhat muddled. Here, we investigated the role of sensory stimuli in dopamine-mediated reinforcement, using an optogenetic ICSS paradigm in tyrosine hydroxylase (TH)-Cre rats. We find that while VTA dopamine neuron activation in the absence of explicit external cues is sufficient to maintain robust self-stimulation, the presence of cues dramatically potentiates ICSS behavior. Our results support a framework where dopamine can have some base value as a reinforcer, but the impact of this signal is modulated heavily by the sensory learning context.

Hypothalamic CRF neurons facilitate brain reward function

Aversive stimuli activate corticotropin-releasing factor (CRF)-expressing neurons in the paraventricular nucleus of hypothalamus (PVNCRF neurons) and other brain stress systems to facilitate avoidance behaviors. Appetitive stimuli also engage the brain stress systems, but their contributions to reward-related behaviors are less well understood. Here, we show that mice work vigorously to optically activate PVNCRF neurons in an operant chamber, indicating a reinforcing nature of these neurons. The reinforcing property of these neurons is not mediated by activation of the hypothalamic-pituitary-adrenal (HPA) axis. We found that PVNCRF neurons send direct projections to the ventral tegmental area (VTA), and selective activation of these projections induced robust self-stimulation behaviors, without activation of the HPA axis. Similar to the PVNCRF cell bodies, self-stimulation of PVNCRF-VTA projection was dramatically attenuated by systemic pretreatment of CRF receptor 1 or dopamine D1 receptor (D1R) antagonist and augmented by corticosterone synthesis inhibitor metyrapone, but not altered by dopamine D2 receptor (D2R) antagonist. Furthermore, we found that activation of PVNCRF-VTA projections increased c-Fos expression in the VTA dopamine neurons and rapidly triggered dopamine release in the nucleus accumbens (NAc), and microinfusion of D1R or D2R antagonist into the NAc decreased the self-stimulation of these projections. Together, our findings reveal an unappreciated role of PVNCRF neurons and their VTA projections in driving reward-related behaviors, independent of their core neuroendocrine functions. As activation of PVNCRF neurons is the final common path for many stress systems, our study suggests a novel mechanism underlying the positive reinforcing effect of stressful stimuli.

Zona incerta dopamine neurons encode motivational vigor in food seeking

Energy deprivation triggers food seeking to ensure homeostatic consumption, but the neural coding of motivational vigor in food seeking during physical hunger remains unknown. Here, we report that ablation of dopamine (DA) neurons in zona incerta (ZI) but not ventral tegmental area potently impaired food seeking after fasting. ZI DA neurons and their projections to paraventricular thalamus (PVT) were quickly activated for food approach but inhibited during food consumption. Chemogenetic manipulation of ZI DA neurons bidirectionally regulated feeding motivation to control meal frequency but not meal size for food intake. Activation of ZI DA neurons promoted, but silencing of these neurons blocked, contextual memory associate with food reward. In addition, selective activation of ZI DA projections to PVT promoted food seeking for food consumption and transited positive-valence signals. Together, these findings reveal that ZI DA neurons encode motivational vigor in food seeking for food consumption through their projections to PVT.

Sensory cues potentiate VTA dopamine mediated reinforcement

Sensory cues are critical for shaping decisions and invigorating actions during reward seeking. Dopamine neurons in the ventral tegmental area (VTA) are critical in this process, supporting associative learning in Pavlovian and instrumental settings. Studies of intracranial self stimulation (ICSS) behavior, which show that animals will work hard to receive stimulation of dopamine neurons, support the notion that dopamine transmits a reward or value signal to support learning. Recent studies have begun to question this, however, emphasizing dopamine's value-free functions, leaving its contribution to behavioral reinforcement somewhat muddled. Here, we investigated the role of sensory stimuli in dopamine-mediated reinforcement, using an optogenetic ICSS paradigm in tyrosine hydroxylase (TH)-cre rats. We find that while VTA dopamine neuron activation in the absence of any external cueing stimulus is sufficient to maintain robust self stimulation, the presence of cues dramatically potentiates ICSS behavior. Our results support a framework where dopamine can have some base value as a reinforcer, but the impact of this signal is modulated heavily by the sensory learning context.

Zona incerta dopamine neurons encode motivational vigor in food seeking

Energy deprivation triggers food seeking to ensure homeostatic consumption, but the neural coding of motivational vigor in food seeking during physical hunger remains unknown. Here, we report that ablation of dopamine (DA) neurons in zona incerta (ZI) but not ventral tegmental area potently impaired food seeking after fasting. ZI DA neurons were quickly activated for food approach but inhibited during food consumption. Chemogenetic manipulation of ZI DA neurons bidirectionally regulated feeding motivation to control meal frequency but not meal size for food intake. In addition, activation of ZI DA neurons and their projections to paraventricular thalamus transited positive-valence signals to promote acquisition and expression of contextual food memory. Together, these findings reveal that ZI DA neurons encode motivational vigor in food seeking for homeostatic eating.

One Sentence Summary

Activation of ZI DA neurons vigorously drives and maintains food-seeking behaviors to ensure food consumption triggered by energy deprivation through inhibitory DA ZI-PVT transmissions that transit positive-valence signals associated with contextual food memory.

Dopamine error signal to actively cope with lack of expected reward

To obtain more of a particular uncertain reward, animals must learn to actively overcome the lack of reward and adjust behavior to obtain it again. The neural mechanisms underlying such coping with reward omission remain unclear. Here, we developed a task in rats to monitor active behavioral switch toward the next reward after no reward. We found that some dopamine neurons in the ventral tegmental area exhibited increased responses to unexpected reward omission and decreased responses to unexpected reward, following the opposite responses of the well-known dopamine neurons that signal reward prediction error (RPE). The dopamine increase reflected in the nucleus accumbens correlated with behavioral adjustment to actively overcome unexpected no reward. We propose that these responses signal error to actively cope with lack of expected reward. The dopamine error signal thus cooperates with the RPE signal, enabling adaptive and robust pursuit of uncertain reward to ultimately obtain more reward.

Epigenetic function during heroin self-administration controls future relapse-associated behavior in a cell type-specific manner

Opioid use produces enduring associations between drug reinforcement/euphoria and discreet or diffuse cues in the drug-taking environment. These powerful associations can trigger relapse in individuals recovering from opioid use disorder (OUD). Here, we sought to determine whether the epigenetic enzyme, histone deacetylase 5 (HDAC5), regulates relapse-associated behavior in an animal model of OUD. We examined the effects of nucleus accumbens (NAc) HDAC5 on both heroin- and sucrose-seeking behaviors using operant self-administration paradigms. We utilized cre-dependent viral-mediated approaches to investigate the cell-type-specific effects of HDAC5 on heroin-seeking behavior, gene expression, and medium spiny neuron (MSN) cell and synaptic physiology. We found that NAc HDAC5 functions during the acquisition phase of heroin self-administration to limit future relapse-associated behavior. Moreover, overexpressing HDAC5 in the NAc suppressed context-associated and reinstated heroin-seeking behaviors, but it did not alter sucrose seeking. We also found that HDAC5 functions within dopamine D1 receptor-expressing MSNs to suppress cue-induced heroin seeking, and within dopamine D2 receptor-expressing MSNs to suppress drug-primed heroin seeking. Assessing cell-type-specific transcriptomics, we found that HDAC5 reduced expression of multiple ion transport genes in both D1- and D2-MSNs. Consistent with this observation, HDAC5 also produced firing rate depression in both MSN classes. These findings revealed roles for HDAC5 during active heroin use in both D1- and D2-MSNs to limit distinct triggers of drug-seeking behavior. Together, our results suggest that HDAC5 might limit relapse vulnerability through regulation of ion channel gene expression and suppression of MSN firing rates during active heroin use.

Ventral pallidal regulation of motivated behaviors and reinforcement

The interconnected nuclei of the ventral basal ganglia have long been identified as key regulators of motivated behavior, and dysfunction of this circuit is strongly implicated in mood and substance use disorders. The ventral pallidum (VP) is a central node of the ventral basal ganglia, and recent studies have revealed complex VP cellular heterogeneity and cell- and circuit-specific regulation of reward, aversion, motivation, and drug-seeking behaviors. Although the VP is canonically considered a relay and output structure for this circuit, emerging data indicate that the VP is a central hub in an extensive network for reward processing and the regulation of motivation that extends beyond classically defined basal ganglia borders. VP neurons respond temporally faster and show more advanced reward coding and prediction error processing than neurons in the upstream nucleus accumbens, and regulate the activity of the ventral mesencephalon dopamine system. This review will summarize recent findings in the literature and provide an update on the complex cellular heterogeneity and cell- and circuit-specific regulation of motivated behaviors and reinforcement by the VP with a specific focus on mood and substance use disorders. In addition, we will discuss mechanisms by which stress and drug exposure alter the functioning of the VP and produce susceptibility to neuropsychiatric disorders. Lastly, we will outline unanswered questions and identify future directions for studies necessary to further clarify the central role of VP neurons in the regulation of motivated behaviors. Significance: Research in the last decade has revealed a complex cell- and circuit-specific role for the VP in reward processing and the regulation of motivated behaviors. Novel insights obtained using cell- and circuit-specific interrogation strategies have led to a major shift in our understanding of this region. Here, we provide a comprehensive review of the VP in which we integrate novel findings with the existing literature and highlight the emerging role of the VP as a linchpin of the neural systems that regulate motivation, reward, and aversion. In addition, we discuss the dysfunction of the VP in animal models of neuropsychiatric disorders.

The interaction of membrane estradiol receptors and metabotropic glutamate receptors in adaptive and maladaptive estradiol-mediated motivated behaviors in females

Estrogen receptors were initially identified as intracellular, ligand-regulated transcription factors that result in genomic change upon ligand binding. However, rapid estrogen receptor signaling initiated outside of the nucleus was also known to occur via mechanisms that were less clear. Recent studies indicate that these traditional receptors, estrogen receptor α and estrogen receptor β, can also be trafficked to act at the surface membrane. Signaling cascades from these membrane-bound estrogen receptors (mERs) can rapidly alter cellular excitability and gene expression, particularly through the phosphorylation of CREB. A principal mechanism of neuronal mER action has been shown to occur through glutamate-independent transactivation of metabotropic glutamate receptors (mGlu), which elicits multiple signaling outcomes. The interaction of mERs with mGlu has been shown to be important in many diverse functions in females, including driving motivated behaviors. Experimental evidence suggests that a large part of estradiol-induced neuroplasticity and motivated behaviors, both adaptive and maladaptive, occurs through estradiol-dependent mER activation of mGlu. Herein we will review signaling through estrogen receptors, both "classical" nuclear receptors and membrane-bound receptors, as well as estradiol signaling through mGlu. We will focus on how the interactions of these receptors and their downstream signaling cascades are involved in driving motivated behaviors in females, discussing a representative adaptive motivated behavior (reproduction) and maladaptive motivated behavior (addiction).

Neural circuits provide insights into reward and aversion

Maladaptive changes in the neural circuits associated with reward and aversion result in some common symptoms, such as drug addiction, anxiety, and depression. Historically, the study of these circuits has been hampered by technical limitations. In recent years, however, much progress has been made in understanding the neural mechanisms of reward and aversion owing to the development of technologies such as cell type-specific electrophysiology, neuronal tracing, and behavioral manipulation based on optogenetics. The aim of this paper is to summarize the latest findings on the mechanisms of the neural circuits associated with reward and aversion in a review of previous studies with a focus on the ventral tegmental area (VTA), nucleus accumbens (NAc), and basal forebrain (BF). These findings may inform efforts to prevent and treat mental illnesses associated with dysfunctions of the brain's reward and aversion system.

The neural circuits of monogamous behavior

The interest in studying the neural circuits related to mating behavior and mate choice in monogamous species lies in the parallels found between human social structure and sexual behavior and that of other mammals that exhibit social monogamy, potentially expanding our understanding of human neurobiology and its underlying mechanisms. Extensive research has suggested that social monogamy, as opposed to non-monogamy in mammals, is a consequence of the neural encoding of sociosensory information from the sexual partner with an increased reward value. Thus, the reinforced value of the mate outweighs the reward value of mating with any other potential sexual partners. This mechanism reinforces the social relationship of a breeding pair, commonly defined as a pair bond. In addition to accentuated prosocial behaviors toward the partner, other characteristic behaviors may appear, such as territorial and partner guarding, selective aggression toward unfamiliar conspecifics, and biparental care. Concomitantly, social buffering and distress upon partner separation are also observed. The following work intends to overview and compare known neural and functional circuits that are related to mating and sexual behavior in monogamous mammals. We will particularly discuss reports on Cricetid rodents of the Microtus and Peromyscus genus, and New World primates (NWP), such as the Callicebinae subfamily of the titi monkey and the marmoset (Callithrix spp.). In addition, we will mention the main factors that modulate the neural circuits related to social monogamy and how that modulation may reflect phenotypic differences, ultimately creating the widely observed diversity in social behavior.

Reactivating hippocampal-mediated memories during reconsolidation to disrupt fear

Memories are stored in the brain as cellular ensembles activated during learning and reactivated during retrieval. Using the Tet-tag system in mice, we label dorsal dentate gyrus neurons activated by positive, neutral or negative experiences with channelrhodopsin-2. Following fear-conditioning, these cells are artificially reactivated during fear memory recall. Optical stimulation of a competing positive memory is sufficient to update the memory during reconsolidation, thereby reducing conditioned fear acutely and enduringly. Moreover, mice demonstrate operant responding for reactivation of a positive memory, confirming its rewarding properties. These results show that interference from a rewarding experience can counteract negative affective states. While memory-updating, induced by memory reactivation, involves a relatively small set of neurons, we also find that activating a large population of randomly labeled dorsal dentate gyrus neurons is effective in promoting reconsolidation. Importantly, memory-updating is specific to the fear memory. These findings implicate the dorsal dentate gyrus as a potential therapeutic node for modulating memories to suppress fear.

The PACAP Paradox: Dynamic and Surprisingly Pleiotropic Actions in the Central Regulation of Energy Homeostasis

Pituitary Adenylate Cyclase-Activating Polypeptide (PACAP), a pleiotropic neuropeptide, is widely distributed throughout the body. The abundance of PACAP expression in the central and peripheral nervous systems, and years of accompanying experimental evidence, indicates that PACAP plays crucial roles in diverse biological processes ranging from autonomic regulation to neuroprotection. In addition, PACAP is also abundantly expressed in the hypothalamic areas like the ventromedial and arcuate nuclei (VMN and ARC, respectively), as well as other brain regions such as the nucleus accumbens (NAc), bed nucleus of stria terminalis (BNST), and ventral tegmental area (VTA) - suggesting that PACAP is capable of regulating energy homeostasis via both the homeostatic and hedonic energy balance circuitries. The evidence gathered over the years has increased our appreciation for its function in controlling energy balance. Therefore, this review aims to further probe how the pleiotropic actions of PACAP in regulating energy homeostasis is influenced by sex and dynamic changes in energy status. We start with a general overview of energy homeostasis, and then introduce the integral components of the homeostatic and hedonic energy balance circuitries. Next, we discuss sex differences inherent to the regulation of energy homeostasis via these two circuitries, as well as the activational effects of sex steroid hormones that bring about these intrinsic disparities between males and females. Finally, we explore the multifaceted role of PACAP in regulating homeostatic and hedonic feeding through its actions in regions like the NAc, BNST, and in particular the ARC, VMN and VTA that occur in sex- and energy status-dependent ways.

Advancements in the Quest to Map, Monitor, and Manipulate Neural Circuitry

Neural circuits and the cells that comprise them represent the functional units of the brain. Circuits relay and process sensory information, maintain homeostasis, drive behaviors, and facilitate cognitive functions such as learning and memory. Creating a functionally-precise map of the mammalian brain requires anatomically tracing neural circuits, monitoring their activity patterns, and manipulating their activity to infer function. Advancements in cell-type-specific genetic tools allow interrogation of neural circuits with increased precision. This review provides a broad overview of recombination-based and activity-driven genetic targeting approaches, contemporary viral tracing strategies, electrophysiological recording methods, newly developed calcium, and voltage indicators, and neurotransmitter/neuropeptide biosensors currently being used to investigate circuit architecture and function. Finally, it discusses methods for acute or chronic manipulation of neural activity, including genetically-targeted cellular ablation, optogenetics, chemogenetics, and over-expression of ion channels. With this ever-evolving genetic toolbox, scientists are continuing to probe neural circuits with increasing resolution, elucidating the structure and function of the incredibly complex mammalian brain.

Activation of histamine type 2 receptors enhances intrinsic excitability of medium spiny neurons in the nucleus accumbens

Abstract

Histaminergic neurons are exclusively located in the hypothalamic tuberomammillary nucleus, from where they project to many brain areas including the nucleus accumbens (NAc), a brain area that integrates diverse monoaminergic inputs to coordinate motivated behaviours. While the NAc expresses various histamine receptor subtypes, the mechanisms by which histamine modulates NAc activity are still poorly understood. Using whole‐cell patch‐clamp recordings, we found that pharmacological activation of histamine 2 (H2) receptors elevates the excitability of NAc medium spiny neurons (MSNs), while activation of H1 receptors failed to significantly affect MSN excitability. The evoked firing of MSNs increased after seconds of local H2 agonist administration and remained elevated for minutes. H2 receptor (H2R) activation accelerated subthreshold depolarization in response to current injection, reduced the latency to fire, diminished action potential afterhyperpolarization and increased the action potential half‐width. The increased excitability was protein kinase A‐dependent and associated with decreased A‐type K⁺ currents. In addition, selective pharmacological inhibition of the Kv4.2 channel, the main molecular determinant of A‐type K⁺ currents in MSNs, mimicked and occluded the increased excitability induced by H2R activation. Our results indicate that histaminergic transmission in the NAc increases MSN intrinsic excitability through H2R‐dependent modulation of Kv4.2 channels. Activation of H2R will significantly alter spike firing in MSNs in vivo, and this effect could be an important mechanism by which these receptors mediate certain aspects of goal‐induced behaviours.

Key points

Histamine is synthesized and released by hypothalamic neurons of the tuberomammillary nucleus and serves as a general modulator for whole‐brain activity including the nucleus accumbens.

Histamine receptors type 2 (HR2), which are expressed in the nucleus accumbens, couple to Gαs/off proteins which elevate cyclic adenosine monophosphate levels and activate protein kinase A.

Whole‐cell patch‐clamp recordings revealed that H2R activation increased the evoked firing in medium spiny neurons of the nucleus accumbens via protein kinase A‐dependent mechanisms.

HR2 activation accelerated subthreshold depolarization in response to current injection, reduced the latency to fire, diminished action potential medium after‐hyperpolarization and increased the action potential half‐width. HR2 activation also reduced A‐type potassium current.

Selective pharmacological inhibition of the Kv4.2 channel mimicked and occluded the increased excitability induced by H2R activation.

Aversive motivation and cognitive control

Aversive motivation plays a prominent role in driving individuals to exert cognitive control. However, the complexity of behavioral responses attributed to aversive incentives creates significant challenges for developing a clear understanding of the neural mechanisms of this motivation-control interaction. We review the animal learning, systems neuroscience, and computational literatures to highlight the importance of experimental paradigms that incorporate both motivational context manipulations and mixed motivational components (e.g., bundling of appetitive and aversive incentives). Specifically, we postulate that to understand aversive incentive effects on cognitive control allocation, a critical contextual factor is whether such incentives are associated with negative reinforcement or punishment. We further illustrate how the inclusion of mixed motivational components in experimental paradigms enables increased precision in the measurement of aversive influences on cognitive control. A sharpened experimental and theoretical focus regarding the manipulation and assessment of distinct motivational dimensions promises to advance understanding of the neural, monoaminergic, and computational mechanisms that underlie the interaction of motivation and cognitive control.

Adenosine Receptors in Neuropsychiatric Disorders: Fine Regulators of Neurotransmission and Potential Therapeutic Targets

Adenosine exerts an important role in the modulation of central nervous system (CNS) activity. Through the interaction with four G-protein coupled receptor (GPCR) subtypes, adenosine subtly regulates neurotransmission, interfering with the dopaminergic, glutamatergic, noradrenergic, serotoninergic, and endocannabinoid systems. The inhibitory and facilitating actions of adenosine on neurotransmission are mainly mediated by A₁ and A_2A adenosine receptors (ARs), respectively. Given their role in the CNS, ARs are promising therapeutic targets for neuropsychiatric disorders where altered neurotransmission represents the most likely etiological hypothesis. Activating or blocking ARs with specific pharmacological agents could therefore restore the balance of altered neurotransmitter systems, providing the rationale for the potential treatment of these highly debilitating conditions. In this review, we summarize and discuss the most relevant studies concerning AR modulation in psychotic and mood disorders such as schizophrenia, bipolar disorders, depression, and anxiety, as well as neurodevelopment disorders such as autism spectrum disorder (ASD), fragile X syndrome (FXS), attention-deficit hyperactivity disorder (ADHD), and neuropsychiatric aspects of neurodegenerative disorders.

GSK3β Activity in Reward Circuit Functioning and Addiction

Glycogen synthase kinase-3β (GSK3β), primarily described as a regulator of glycogen metabolism, is a molecular hub linking numerous signaling pathways and regulates many cellular processes like cytoskeletal rearrangement, cell migration, apoptosis, and proliferation. In neurons, the kinase is engaged in molecular events related to the strengthening and weakening of synapses, which is a subcellular manifestation of neuroplasticity. Dysregulation of GSK3β activity has been reported in many neuropsychiatric conditions, like schizophrenia, major depressive disorder, bipolar disorder, and Alzheimer’s disease. In this review, we describe the kinase action in reward circuit-related structures in health and disease. The effect of pharmaceuticals used in the treatment of addiction in the context of GSK3β activity is also discussed.

Dopamine, behavior, and addiction

Addictive drugs are habit-forming. Addiction is a learned behavior; repeated exposure to addictive drugs can stamp in learning. Dopamine-depleted or dopamine-deleted animals have only unlearned reflexes; they lack learned seeking and learned avoidance. Burst-firing of dopamine neurons enables learning-long-term potentiation (LTP)-of search and avoidance responses. It sets the stage for learning that occurs between glutamatergic sensory inputs and GABAergic motor-related outputs of the striatum; this learning establishes the ability to search and avoid. Independent of burst-firing, the rate of single-spiking-or "pacemaker firing"-of dopaminergic neurons mediates motivational arousal. Motivational arousal increases during need states and its level determines the responsiveness of the animal to established predictive stimuli. Addictive drugs, while usually not serving as an external stimulus, have varying abilities to activate the dopamine system; the comparative abilities of different addictive drugs to facilitate LTP is something that might be studied in the future.

Dopamine Circuit Mechanisms of Addiction-Like Behaviors

Addiction is a complex disease that impacts millions of people around the world. Clinically, addiction is formalized as substance use disorder (SUD), with three primary symptom categories: exaggerated substance use, social or lifestyle impairment, and risky substance use. Considerable efforts have been made to model features of these criteria in non-human animal research subjects, for insight into the underlying neurobiological mechanisms. Here we review evidence from rodent models of SUD-inspired criteria, focusing on the role of the striatal dopamine system. We identify distinct mesostriatal and nigrostriatal dopamine circuit functions in behavioral outcomes that are relevant to addictions and SUDs. This work suggests that striatal dopamine is essential for not only positive symptom features of SUDs, such as elevated intake and craving, but also for impairments in decision making that underlie compulsive behavior, reduced sociality, and risk taking. Understanding the functional heterogeneity of the dopamine system and related networks can offer insight into this complex symptomatology and may lead to more targeted treatments.

Laterodorsal tegmentum-ventral tegmental area projections encode positive reinforcement signals

The laterodorsal tegmentum (LDT) is a brainstem nucleus classically involved in REM sleep and attention, and that has recently been associated with reward-related behaviors, as it controls the activity of ventral tegmental area (VTA) dopaminergic neurons, modulating dopamine release in the nucleus accumbens. To further understand the role of LDT-VTA inputs in reinforcement, we optogenetically manipulated these inputs during different behavioral paradigms in male rats. We found that in a two-choice instrumental task, optical activation of LDT-VTA projections shifts and amplifies preference to the laser-paired reward in comparison to an otherwise equal reward; the opposite was observed with inhibition experiments. In a progressive ratio task, LDT-VTA activation boosts motivation, that is, enhances the willingness to work to get the reward associated with LDT-VTA stimulation; and the reverse occurs when inhibiting these inputs. Animals abolished preference if the reward was omitted, suggesting that LDT-VTA stimulation adds/decreases value to the stimulation-paired reward. In addition, we show that LDT-VTA optical activation induces robust preference in the conditioned and real-time place preference tests, while optical inhibition induces aversion. The behavioral findings are supported by electrophysiological recordings and c-fos immunofluorescence correlates in downstream target regions. In LDT-VTA ChR2 animals, we observed an increase in the recruitment of lateral VTA dopamine neurons and D1 neurons from nucleus accumbens core and shell; whereas in LDT-VTA NpHR animals, D2 neurons appear to be preferentially recruited. Collectively, these data show that the LDT-VTA inputs encode positive reinforcement signals and are important for different dimensions of reward-related behaviors.

The cross-hemispheric nigrostriatal pathway prevents the expression of levodopa-induced dyskinesias

Parkinson's disease (PD) is a neurodegenerative movement disorder that is routinely treated with levodopa. Unfortunately, long-term dopamine replacement therapy using levodopa leads to levodopa-induced dyskinesias (LID), a significant and disabling side-effect. Clinical findings indicate that LID typically only occurs following the progression of PD motor symptoms from the unilateral (Hoehn and Yahr (HY) Stage I) to the bilateral stage (HY Stage II). This suggests the presence of some compensatory interhemispheric mechanisms that delay the occurrence of LID. We therefore investigated the role of interhemispheric connections of the nigrostriatal pathway on LID expression in a rat model of PD. The striatum of one hemisphere of rats was first injected with a retrograde tracer to label the ipsi- and cross-hemispheric nigrostriatal pathways. Rats were then split into groups and unilaterally lesioned in the striatum or medial forebrain bundle of the tracer-injected hemisphere to induce varying levels of hemiparkinsonism. Finally, rats were treated with levodopa and tested for the expression of LID. Distinct subsets emerged from rats that underwent the same lesioning paradigm based on LID. Strikingly, non-dyskinetic rats had significant sparing of their cross-hemispheric nigrostriatal pathway projecting from the unlesioned hemisphere. In contrast, dyskinetic rats only had a small proportion of this cross-hemispheric nigrostriatal pathway survive lesioning. Crucially, both non-dyskinetic and dyskinetic rats had nearly identical levels of ipsi-hemispheric nigrostriatal pathway survival and parkinsonian motor deficits. Our data suggest that the survival of the cross-hemispheric nigrostriatal pathway plays a crucial role in preventing the expression of LID and represents a potentially novel target to halt the progression of this devastating side-effect of a common anti-PD therapeutic.

Illuminating subcortical GABAergic and glutamatergic circuits for reward and aversion

Reinforcement, reward, and aversion are fundamental processes for guiding appropriate behaviors. Longstanding theories have pointed to dopaminergic neurons of the ventral tegmental area (VTA) and the limbic systems' descending pathways as crucial systems for modulating these behaviors. The application of optogenetic techniques in neurotransmitter- and projection-specific circuits has supported and enhanced many preexisting theories but has also revealed many unexpected results. Here, we review the past decade of optogenetic experiments to study the neural circuitry of reinforcement and reward/aversion with a focus on the mesolimbic dopamine system and brain areas along the medial forebrain bundle (MFB). The cumulation of these studies to date has revealed generalizable findings across molecularly defined cell types in areas of the basal forebrain and anterior hypothalamus. Optogenetic stimulation of GABAergic neurons in these brain regions drives reward and can support positive reinforcement and optogenetic stimulation of glutamatergic neurons in these regions drives aversion. We also review studies of the activity dynamics of neurotransmitter defined populations in these areas which have revealed varied response patterns associated with motivated behaviors.

Selective filtering of excitatory inputs to nucleus accumbens by dopamine and serotonin

The detailed mechanisms by which dopamine (DA) and serotonin (5-HT) act in the nucleus accumbens (NAc) to influence motivated behaviors in distinct ways remain largely unknown. Here, we examined whether DA and 5-HT selectively modulate excitatory synaptic transmission in NAc medium spiny neurons in an input-specific manner. DA reduced excitatory postsynaptic currents (EPSCs) generated by paraventricular thalamus (PVT) inputs but not by ventral hippocampus (vHip), basolateral amygdala (BLA), or medial prefrontal cortex (mPFC) inputs. In contrast, 5-HT reduced EPSCs generated by inputs from all areas except the mPFC. Release of endogenous DA and 5-HT by methamphetamine (METH) and (±)3,4-methylenedioxymethamphetamine (MDMA), respectively, recapitulated these input-specific synaptic effects. Optogenetic inhibition of PVT inputs enhanced cocaine-conditioned place preference, whereas mPFC input inhibition reduced the enhancement of sociability elicited by MDMA. These findings suggest that the distinct, input-specific filtering of excitatory inputs in the NAc by DA and 5-HT contribute to their discrete behavioral effects.

A hindbrain dopaminergic neural circuit prevents weight gain by reinforcing food satiation

The neural circuitry mechanism that underlies dopaminergic (DA) control of innate feeding behavior is largely uncharacterized. Here, we identified a subpopulation of DA neurons situated in the caudal ventral tegmental area (cVTA) directly innervating DRD1-expressing neurons within the lateral parabrachial nucleus (LPBN). This neural circuit potently suppresses food intake via enhanced satiation response. Notably, this cohort of DAcVTA neurons is activated immediately before the cessation of each feeding bout. Acute inhibition of these DA neurons before bout termination substantially suppresses satiety and prolongs the consummatory feeding. Activation of postsynaptic DRD1LPBN neurons inhibits feeding, whereas genetic deletion of Drd1 within the LPBN causes robust increase in food intake and subsequent weight gain. Furthermore, the DRD1LPBN signaling manifests the central mechanism in methylphenidate-induced hypophagia. In conclusion, our study illuminates a hindbrain DAergic circuit that controls feeding through dynamic regulation in satiety response and meal structure.

Selenoprotein P Modulates Methamphetamine Enhancement of Vesicular Dopamine Release in Mouse Nucleus Accumbens Via Dopamine D2 Receptors

Dopamine (DA) transmission plays a critical role in processing rewarding and pleasurable stimuli. Increased synaptic DA release in the nucleus accumbens (NAc) is a central component of the physiological effects of drugs of abuse. The essential trace element selenium mitigates methamphetamine-induced neurotoxicity. Selenium can also alter DA production and turnover. However, studies have not directly addressed the role of selenium in DA neurotransmission. Selenoprotein P (SELENOP1) requires selenium for synthesis and transports selenium to the brain, in addition to performing other functions. We investigated whether SELENOP1 directly impacts (1) DA signaling and (2) the dopaminergic response to methamphetamine. We used fast-scan cyclic voltammetry to investigate DA transmission and the response to methamphetamine in NAc slices from C57/BL6J SELENOP1 KO mice. Recordings from SELENOP1 KO mouse slices revealed reduced levels of evoked DA release and slower DA uptake rates. Methamphetamine caused a dramatic increase in vesicular DA release in SELENOP1 KO mice not observed in wild-type controls. This elevated response was attenuated by SELENOP1 application through a selenium-independent mechanism involving SELENOP1-apolipoprotein E receptor 2 (ApoER2) interaction to promote dopamine D2 receptor (D2R) function. In wild-type mice, increased vesicular DA release in response to methamphetamine was revealed by blocking D2R activation, indicating that the receptor suppresses the methamphetamine-induced vesicular increase. Our data provide evidence of a direct physiological role for SELENOP1 in the dopaminergic response to methamphetamine and suggest a signaling role for the protein in DA transmission.

Disruptions in effort-based decision-making following acute optogenetic stimulation of ventral tegmental area dopamine cells

The dopamine system has been implicated in decision-making particularly when associated with effortful behavior. We examined acute optogenetic stimulation of dopamine cells in the ventral tegmental area (VTA) as mice engaged in an effort-based decision-making task. Tyrosine hydroxylase-Cre mice were injected with Cre-dependent ChR2 or eYFP control virus in the VTA. While eYFP control mice showed effortful discounting, stimulation of dopamine cells in ChR2 mice disrupted effort-based decision-making by reducing choice toward the lever associated with a preferred outcome and greater effort. Surprisingly, disruptions in effortful discounting were observed in subsequent test sessions conducted in the absence of optogenetic stimulation, however during these sessions ChR2 mice displayed enhanced high choice responding across trial blocks. These findings suggest increases in VTA dopamine cell activity can disrupt effort-based decision-making in distinct ways dependent on the timing of optogenetic stimulation.

Adaptive Changes in the Central Control of Energy Homeostasis Occur in Response to Variations in Energy Status

Energy homeostasis is regulated in coordinate fashion by the brain-gut axis, the homeostatic energy balance circuitry in the hypothalamus and the hedonic energy balance circuitry comprising the mesolimbcortical A10 dopamine pathway. Collectively, these systems convey and integrate information regarding nutrient status and the rewarding properties of ingested food, and formulate it into a behavioral response that attempts to balance fluctuations in consumption and food-seeking behavior. In this review we start with a functional overview of the homeostatic and hedonic energy balance circuitries; identifying the salient neural, hormonal and humoral components involved. We then delve into how the function of these circuits differs in males and females. Finally, we turn our attention to the ever-emerging roles of nociceptin/orphanin FQ (N/OFQ) and pituitary adenylate cyclase-activating polypeptide (PACAP)-two neuropeptides that have garnered increased recognition for their regulatory impact in energy homeostasis-to further probe how the imposed regulation of energy balance circuitry by these peptides is affected by sex and altered under positive (e.g., obesity) and negative (e.g., fasting) energy balance states. It is hoped that this work will impart a newfound appreciation for the intricate regulatory processes that govern energy homeostasis, as well as how recent insights into the N/OFQ and PACAP systems can be leveraged in the treatment of conditions ranging from obesity to anorexia.

Down-regulation of habenular calcium-dependent secretion activator 2 induces despair-like behavior

Calcium-dependent secretion activator 2 (CAPS2) regulates the trafficking and exocytosis of neuropeptide-containing dense-core vesicles (DCVs). CAPS2 is prominently expressed in the medial habenula (MHb), which is related to depressive behavior; however, how MHb neurons cause depressive symptoms and the role of CAPS2 remains unclear. We hypothesized that dysfunction of MHb CAPS neurons might cause defects in neuropeptide secretion and the activity of monoaminergic centers, resulting in depressive-like behaviors. In this study, we examined (1) CAPS2 expression in the habenula of depression animal models and major depressive disorder patients and (2) the effects of down-regulation of MHb CAPS2 on the animal behaviors, synaptic transmission in the interpeduncular nucleus (IPN), and neuronal activity of monoamine centers. Habenular CAPS2 expression was decreased in the rat chronic restraint stress model, mouse learned helplessness model, and showed tendency to decrease in depression patients who died by suicide. Knockdown of CAPS2 in the mouse habenula evoked despair-like behavior and a reduction of the release of DCVs in the IPN. Neuronal activity of IPN and monoaminergic centers was also reduced. These results implicate MHb CAPS2 as playing a pivotal role in depressive behavior through the regulation of neuropeptide secretion of the MHb-IPN pathway and the activity of monoaminergic centers.

The contribution of medium spiny neuron subtypes in the nucleus accumbens core to compulsive-like ethanol drinking

Compulsive alcohol use, or drinking that persists despite negative or aversive consequences, is a defining characteristic of alcohol use disorder. Here, chemogenetic technology (i.e. Designer Receptors Exclusively Activated by Designer Drugs; DREADDs) was used to inhibit or excite the NAc core or selectively inhibit D₁-or D₂ receptor-expressing neurons in the NAc core to understand the role of the NAc core and how these subpopulations of neurons may influence compulsive-like ethanol (EtOH) drinking using C57BL/6J, Drd1-cre, and Drd2-cre male and female mice. Compulsive-like EtOH drinking was modeled with a two-bottle choice, drinking in the dark paradigm. The major finding of this study was that mice decreased compulsive-like EtOH intake when the NAc core was inhibited and there was no change of EtOH + quinine intake when the NAc core was excited. Interestingly, inhibition of D₁-or D₂ receptor-expressing neurons did not alter compulsive-like EtOH intake. Control experiments showed that NAc core excitation and selective inhibition of D₁-or D₂-receptor-expressing neurons had no effect on baseline EtOH drinking, intake of water, or intake of quinine-adulterated water. CNO reduced amphetamine-induced locomotion in the D₁-^CRE+ (but not the D₂^CRE+) group in a control experiment. Finally, pharmacological antagonism of D₁ and D₂ receptors together, but not separately, reduced quinine-resistant EtOH drinking. These results suggest that the NAc core is a critical region involved in compulsive-like EtOH consumption, and that both D₁-and D₂ receptor-expressing medium spiny neurons participate in controlling this behavior.

Brain functional networks associated with social bonding in monogamous voles

Previous studies have related pair-bonding in Microtus ochrogaster, the prairie vole, with plastic changes in several brain regions. However, the interactions between these socially relevant regions have yet to be described. In this study, we used resting-state magnetic resonance imaging to explore bonding behaviors and functional connectivity of brain regions previously associated with pair-bonding. Thirty-two male and female prairie voles were scanned at baseline, 24 hr, and 2 weeks after the onset of cohabitation. By using network-based statistics, we identified that the functional connectivity of a corticostriatal network predicted the onset of affiliative behavior, while another predicted the amount of social interaction during a partner preference test. Furthermore, a network with significant changes in time was revealed, also showing associations with the level of partner preference. Overall, our findings revealed the association between network-level functional connectivity changes and social bonding.

Cell-type-specific asynchronous modulation of PKA by dopamine in learning

Reinforcement learning models postulate that dopamine (DA) releasing neurons (DANs) encode information about action and action outcome and provide a teaching signal to striatal spiny projection neurons (SPNs) in the form of DA release¹. DA is thought to guide learning via dynamic and differential modulation of protein kinase A (PKA) in each class of SPN². However, the real-time relationship between DA and SPN PKA remains untested in behaving animals. Here, we monitor the activity of DANs, extracellular DA levels, and net PKA activity in SPNs in the nucleus accumbens in mice during learning. We find positive and negative modulation of DA that evolves across training and is both necessary and sufficient to explain concurrent fluctuations in SPN PKA activity. The modulations of PKA in SPNs that express type-1 and type-2 DA receptors are dichotomous such that they are selectively sensitive to increases and decreases in DA, respectively, which occur at different phases of learning. Thus, PKA-dependent pathways in each class of SPNs are asynchronously engaged by positive or negative DA signals during learning.

'Liking' and 'wanting' in eating and food reward: Brain mechanisms and clinical implications

It is becoming clearer how neurobiological mechanisms generate 'liking' and 'wanting' components of food reward. Mesocorticolimbic mechanisms that enhance 'liking' include brain hedonic hotspots, which are specialized subregions that are uniquely able to causally amplify the hedonic impact of palatable tastes. Hedonic hotspots are found in nucleus accumbens medial shell, ventral pallidum, orbitofrontal cortex, insula cortex, and brainstem. In turn, a much larger mesocorticolimbic circuitry generates 'wanting' or incentive motivation to obtain and consume food rewards. Hedonic and motivational circuitry interact together and with hypothalamic homeostatic circuitry, allowing relevant physiological hunger and satiety states to modulate 'liking' and 'wanting' for food rewards. In some conditions such as drug addiction, 'wanting' is known to dramatically detach from 'liking' for the same reward, and this may also occur in over-eating disorders. Via incentive sensitization, 'wanting' selectively becomes higher, especially when triggered by reward cues when encountered in vulnerable states of stress, etc. Emerging evidence suggests that some cases of obesity and binge eating disorders may reflect an incentive-sensitization brain signature of cue hyper-reactivity, causing excessive 'wanting' to eat. Future findings on the neurobiological bases of 'liking' and 'wanting' can continue to improve understanding of both normal food reward and causes of clinical eating disorders.

The effects of early life stress on motivated behaviors: A role for gonadal hormones

Motivated behaviors are controlled by the mesocorticolimbic dopamine (DA) system, consisting of projections from the ventral tegmental area (VTA) to the nucleus accumbens (NAc) and prefrontal cortex (PFC), with input from structures including the medial preoptic area (mPOA). Sex differences are present in this circuit, and gonadal hormones (e.g., estradiol and testosterone) are important for regulating DA transmission. Early life stress (ELS) also regulates the mesocorticolimbic DA system. ELS modifies motivated behaviors and the underlying DA circuitry, increasing risk for disorders such as substance use disorder, major depression, and schizophrenia. ELS has been shown to change gonadal hormone signaling in both sexes. Thus, one way that ELS could impact mesocorticolimbic DA is by altering the efficacy of gonadal hormones. This review provides evidence for this idea by integrating the gonadal hormone, motivation, and ELS literature to argue that ELS alters gonadal hormone signaling to impact motivated behavior. We also discuss the importance of these effects in the context of understanding risk and treatments for psychiatric disorders in men and women.

Dopamine and Addiction

Addiction is commonly identified with habitual nonmedical self-administration of drugs. It is usually defined by characteristics of intoxication or by characteristics of withdrawal symptoms. Such addictions can also be defined in terms of the brain mechanisms they activate; most addictive drugs cause elevations in extracellular levels of the neurotransmitter dopamine. Animals unable to synthesize or use dopamine lack the conditioned reflexes discussed by Pavlov or the appetitive behavior discussed by Craig; they have only unconditioned consummatory reflexes. Burst discharges (phasic firing) of dopamine-containing neurons are necessary to establish long-term memories associating predictive stimuli with rewards and punishers. Independent discharges of dopamine neurons (tonic or pacemaker firing) determine the motivation to respond to such cues. As a result of habitual intake of addictive drugs, dopamine receptors expressed in the brain are decreased, thereby reducing interest in activities not already stamped in by habitual rewards.

Early Life Stress- and Drug-Induced Histone Modifications Within the Ventral Tegmental Area

Psychiatric illnesses are a major public health concern due to their prevalence and heterogeneity of symptom presentation resulting from a lack of efficacious treatments. Although dysregulated dopamine (DA) signaling has been observed in a myriad of psychiatric conditions, different pathophysiological mechanisms have been implicated which impede the development of adequate treatments that work across all patient populations. The ventral tegmental area (VTA), a major source of DA neurons in the brain reward pathway, has been shown to have altered activity that contributes to reward dysregulation in mental illnesses and drug addiction. It has now become better appreciated that epigenetic mechanisms contribute to VTA DA dysfunction, such as through histone modifications, which dynamically regulate transcription rates of critical genes important in synaptic plasticity underlying learning and memory. Here, we provide a focused review on differential histone modifications within the VTA observed in both humans and animal models, as well as their relevance to disease-based phenotypes, specifically focusing on epigenetic dysregulation of histones in the VTA associated with early life stress (ELS) and drugs of abuse. Locus- and cell-type-specific targeting of individual histone modifications at specific genes within the VTA presents novel therapeutic targets which can result in greater efficacy and better long-term health outcomes in susceptible individuals that are at increased risk for substance use and psychiatric disorders.

Double dissociation between actions of dopamine D1 and D2 receptors of the ventral and dorsolateral striatum to produce reinstatement of cocaine seeking behavior

One of the hallmarks of addiction is the enduring vulnerability to relapse. Following repeated use, cocaine (COC) induces neuroadaptations within the dopamine (DA) system, arguably underlying several aspects of COC-seeking behavior. Peripheral stimulation of D2, but not D1, receptors induces relapse. However, where in the brain these effects occur is still matter of debate. The D1 and D2 receptors (D1R; D2R) are highly expressed in the nucleus accumbens (NAcc) and the dorsolateral striatum (DLS), but their specific involvement in the reinstatement of COC-seeking remains elusive. We assessed the reinstating effects of intracerebral infusions of agonists of D1R (SKF82958) or D2R (quinelorane) within the NAcc or DLS of rats after extinction of COC self-administration (COC SA). To assess whether we could block peripheral D2 agonist (quinelorane) induced reinstatement, we simultaneously infused either a D1R (SCH23390) or a D2R (raclopride) antagonist within the NAcc or DLS. When infused into the NAcc, but not into the DLS, SKF82958 induced reinstatement of COC-seeking; conversely, quinelorane had no effect when injected into the NAcc, but induced reinstatement when infused into the DLS while the D1R agonist has no effect. While administration of raclopride into the NAcc or DLS impedes the reinstating effect of a systemic quinelorane injection, the infusion of SCH23390 into the NAcc or DLS surprisingly, blocks the reinstatement induced by the peripheral D2R stimulation. Our results point to a double dissociation between D1R and D2R of the NAcc and DLS, highlighting their complex interactions within both structures, in the reinstatement of COC-seeking behavior.

Involvement of the endogenous opioid system in the beneficial influence of physical exercise on amphetamine-induced addiction parameters

Psychostimulant drugs addiction is a chronic public health problem and individuals remain susceptible to relapses increasing public expenses even after withdrawal and treatment. Our research group has focused on finding new therapies to be employed in drug addiction treatment, suggesting the physical exercise as a promising tool. This way, it is necessary to know the mechanisms involved in the beneficial influences of physical exercise observing the pathway that could be explored in drug addiction treatment. Male Wistar rats were conditioned with amphetamine (AMPH) following the conditioned place preference (CPP) protocol and subsequently submitted to swimming for 5 weeks (1 h per day, 5 days per week). Half of the animals were injected with Naloxone (0.3 mg/mL/kg body weight, i.p.) 5 min prior each physical exercise day. After AMPH-CPP re-exposure, our outcomes showed that physical exercise, in addition to minimizing the relapse behavior in the CPP, it increased D1R, D2R and DAT in the Ventral Tegmental Area (VTA), but not in the Nucleus accumbens (NAc). Interestingly, while naloxone inhibited the partial beneficial influence of the exercise on drug-relapse behavior, exercise-induced changes in the dopaminergic system were not observed in the group administered with naloxone as well. Based on these evidences, besides reinforcing the beneficial influence of the physical exercise on AMPH-induced drug addiction, we propose the involvement of endogenous opioid system activation, not as a single one, but as a possible mechanism of action resulting from the physical activity practice, thus characterizing an important therapeutic approach, which may contribute to drug withdrawal consequently preventing relapse.

Accumbal Dopamine Release Tracks the Expectation of Dopamine Neuron-Mediated Reinforcement

Dopamine (DA) transmission in the nucleus accumbens (NAc) facilitates cue-reward associations and appetitive action. Reward-related accumbal DA release dynamics are traditionally ascribed to ventral tegmental area (VTA) DA neurons. Activation of VTA to NAc DA signaling is thought to reinforce action and transfer reward-related information to predictive cues, allowing cues to guide behavior and elicit dopaminergic activity. Here, we use optogenetics to control DA neuron activity and voltammetry to simultaneously record accumbal DA release in order to quantify how reinforcer-evoked dopaminergic activity shapes conditioned mesolimbic DA transmission. We find that cues predicting access to DA neuron self-stimulation elicit conditioned responding and NAc DA release. However, cue-evoked DA release does not reflect the cost or magnitude of DA neuron activation. Accordingly, conditioned accumbal DA release selectively tracks the expected availability of DA-neuron-mediated reinforcement. This work provides insight into how mesolimbic DA transmission drives and encodes appetitive action.

Vulnerability to helpless behavior is regulated by the circadian clock component CRYPTOCHROME in the mouse nucleus accumbens

The nucleus accumbens (NAc), a central component of the midbrain dopamine reward circuit, exhibits disturbed circadian rhythms in the postmortem brains of depressed patients. We hypothesized that normal mood regulation requires proper circadian timing in the NAc, and that mood disorders are associated with dysfunctions of the NAc cellular circadian clock. In mice exhibiting stress-induced depression-like behavior (helplessness), we found altered circadian clock function and high nighttime expression of the core circadian clock component CRYPTOCHROME (CRY) in the NAc. In the NAc of helpless mice, we found that higher expression of CRY is associated with decreased activation of dopamine 1 receptor-expressing medium spiny neurons (D1R-MSNs). Furthermore, D1R-MSN-specific CRY-knockdown in the NAc reduced susceptibility to stress-induced helplessness and increased NAc neuronal activation at night. Finally, we show that CRY inhibits D1R-induced G protein activation, likely by interacting with the Gs protein. Altered circadian rhythms and CRY expression were also observed in human fibroblasts from major depressive disorder patients. Our data reveal a causal role for CRY in regulating the midbrain dopamine reward system, and provide a mechanistic link between the NAc circadian clock and vulnerability to depression.

Heterogeneity in striatal dopamine circuits: Form and function in dynamic reward seeking

The striatal dopamine system has long been studied in the context of reward learning, motivation, and movement. Given the prominent role dopamine plays in a variety of adaptive behavioral states, as well as diseases like addiction, it is essential to understand the full complexity of dopamine neurons and the striatal systems they target. A growing number of studies are uncovering details of the heterogeneity in dopamine neuron subpopulations. Here, we review that work to synthesize current understanding of dopamine system heterogeneity across three levels, anatomical organization, functions in behavior, and modes of action, wherein we focus on signaling profiles and local mechanisms for modulation of dopamine release. Together, these studies reveal new and emerging dimensions of the striatal dopamine system, informing its contribution to dynamic motivational and decision-making processes.