Topography of Reward and Aversion Encoding in the Mesolimbic Dopaminergic System

Nucleus accumbens sub-regions experience distinct dopamine release responses following acute and chronic morphine exposure

It is well established that dopamine neurons of the ventral tegmental area (VTA) play a critical role in reward and aversion as well as pathologies including drug dependence and addiction. The distinct effects of acute and chronic opioid exposure have been previously characterized at VTA synapses. Recent work suggests that distinct VTA projections that target the medial and lateral shell of the nucleus accumbens (NAc), may play opposing roles in modulating behavior. It is possible that these two anatomically and functionally distinct pathways also have disparate roles in opioid reward, tolerance, and withdrawal in the brain. In this study we monitored dopamine release in the medial or lateral shell of the NAc of male mice during a week-long morphine treatment paradigm. We measured dopamine release in response to an intravenous morphine injection both acutely and following a week of repeated morphine. We also measured dopamine in response to a naloxone injection both prior to and following repeated morphine treatment. Morphine induced a transient increase in dopamine in the medial NAc shell that was much larger than the slower rise observed in the lateral shell. Surprisingly, chronic morphine treatment induced a sensitization of the medial dopamine response to morphine that opposed a diminished response observed in the saline-treated control group. This study expands on our current understanding of the medial NAc shell as hub of opioid-induced dopamine fluctuation. It also highlights the need for future opioid studies to appreciate the heterogeneity of dopamine neurons.

Significance Statement

The social and economic consequences of the opioid epidemic are tragic and far-reaching. Yet, opioids are indisputably necessary in clinical settings where they remain the most useful treatment for severe pain. To combat this crisis, we must improve our understanding of opioid function in the brain, particularly the neural mechanisms that underlie opioid dependence and addictive behaviors. This study uses fiber photometry to examine dopamine changes that occur in response to repeated morphine, and morphine withdrawal, at multiple stages of a longitudinal opioid-dependence paradigm. We reveal key differences in how dopamine levels respond to opioid administration in distinct sub-regions of the ventral striatum and lay a foundation for future opioid research that appreciates our contemporary understanding of the dopamine system.

Neurobiology and systems biology of stress resilience

Stress resilience is the phenomenon that some people maintain their mental health despite exposure to adversity or show only temporary impairments followed by quick recovery. Resilience research attempts to unravel the factors and mechanisms that make resilience possible and to harness its insights for the development of preventative interventions in individuals at risk for acquiring stress-related dysfunctions. Biological resilience research has been lagging behind the psychological and social sciences but has seen a massive surge in recent years. At the same time, progress in this field has been hampered by methodological challenges related to finding suitable operationalizations and study designs, replicating findings, and modeling resilience in animals. We embed a review of behavioral, neuroimaging, neurobiological, and systems biological findings in adults in a critical methods discussion. We find preliminary evidence that hippocampus-based pattern separation and prefrontal-based cognitive control functions protect against the development of pathological fears in the aftermath of singular, event-type stressors [as found in fear-related disorders, including simpler forms of posttraumatic stress disorder (PTSD)] by facilitating the perception of safety. Reward system-based pursuit and savoring of positive reinforcers appear to protect against the development of more generalized dysfunctions of the anxious-depressive spectrum resulting from more severe or longer-lasting stressors (as in depression, generalized or comorbid anxiety, or severe PTSD). Links between preserved functioning of these neural systems under stress and neuroplasticity, immunoregulation, gut microbiome composition, and integrity of the gut barrier and the blood-brain barrier are beginning to emerge. On this basis, avenues for biological interventions are pointed out.

Functional diversity of dopamine axons in prefrontal cortex during classical conditioning

Midbrain dopamine neurons impact neural processing in the prefrontal cortex (PFC) through mesocortical projections. However, the signals conveyed by dopamine projections to the PFC remain unclear, particularly at the single-axon level. Here, we investigated dopaminergic axonal activity in the medial PFC (mPFC) during reward and aversive processing. By optimizing microprism-mediated two-photon calcium imaging of dopamine axon terminals, we found diverse activity in dopamine axons responsive to both reward and aversive stimuli. Some axons exhibited a preference for reward, while others favored aversive stimuli, and there was a strong bias for the latter at the population level. Long-term longitudinal imaging revealed that the preference was maintained in reward- and aversive-preferring axons throughout classical conditioning in which rewarding and aversive stimuli were paired with preceding auditory cues. However, as mice learned to discriminate reward or aversive cues, a cue activity preference gradually developed only in aversive-preferring axons. We inferred the trial-by-trial cue discrimination based on machine learning using anticipatory licking or facial expressions, and found that successful discrimination was accompanied by sharper selectivity for the aversive cue in aversive-preferring axons. Our findings indicate that a group of mesocortical dopamine axons encodes aversive-related signals, which are modulated by both classical conditioning across days and trial-by-trial discrimination within a day.

Roles of feedback and feed-forward networks of dopamine subsystems: insights from Drosophila studies

Across animal species, dopamine-operated memory systems comprise anatomically segregated, functionally diverse subsystems. Although individual subsystems could operate independently to support distinct types of memory, the logical interplay between subsystems is expected to enable more complex memory processing by allowing existing memory to influence future learning. Recent comprehensive ultrastructural analysis of the Drosophila mushroom body revealed intricate networks interconnecting the dopamine subsystems-the mushroom body compartments. Here, we review the functions of some of these connections that are beginning to be understood. Memory consolidation is mediated by two different forms of network: A recurrent feedback loop within a compartment maintains sustained dopamine activity required for consolidation, whereas feed-forward connections across compartments allow short-term memory formation in one compartment to open the gate for long-term memory formation in another compartment. Extinction and reversal of aversive memory rely on a similar feed-forward circuit motif that signals omission of punishment as a reward, which triggers plasticity that counteracts the original aversive memory trace. Finally, indirect feed-forward connections from a long-term memory compartment to short-term memory compartments mediate higher-order conditioning. Collectively, these emerging studies indicate that feedback control and hierarchical connectivity allow the dopamine subsystems to work cooperatively to support diverse and complex forms of learning.

Distributional coding of associative learning in discrete populations of midbrain dopamine neurons

Midbrain dopamine neurons are thought to play key roles in learning by conveying the difference between expected and actual outcomes. Recent evidence suggests diversity in dopamine signaling, yet it remains poorly understood how heterogeneous signals might be organized to facilitate the role of downstream circuits mediating distinct aspects of behavior. Here, we investigated the organizational logic of dopaminergic signaling by recording and labeling individual midbrain dopamine neurons during associative behavior. Our findings show that reward information and behavioral parameters are not only heterogeneously encoded but also differentially distributed across populations of dopamine neurons. Retrograde tracing and fiber photometry suggest that populations of dopamine neurons projecting to different striatal regions convey distinct signals. These data, supported by computational modeling, indicate that such distributional coding can maximize dynamic range and tailor dopamine signals to facilitate specialized roles of different striatal regions.

Brain state-dependent responses of midbrain dopaminergic neurons to footshock under urethane anaesthesia

For a long time, it has been assumed that dopaminergic (DA) neurons in both the ventral tegmental area (VTA) and the substantia nigra pars compacta (SNc) uniformly respond to rewarding and aversive stimuli by either increasing or decreasing their activity, respectively. This response was believed to signal information about the perceived stimuli's values. The identification of VTA&SNc DA neurons that are excited by both rewarding and aversive stimuli has led to the categorisation of VTA&SNc DA neurons into two subpopulations: one signalling the value and the other signalling the salience of the stimuli. It has been shown that the general state of the brain can modulate the electrical activity of VTA&SNc DA neurons, but it remains unknown whether this factor may also influence responses to aversive stimuli, such as a footshock (FS). To address this question, we have recorded the responses of VTA&SNc DA neurons to FSs across cortical activation and slow wave activity brain states in urethane-anaesthetised rats. Adding to the knowledge of aversion signalling by midbrain DA neurons, we report that significant proportion of VTA&SNc DA neurons can change their responses to an aversive stimulus in a brain state-dependent manner. The majority of these neurons decreased their activity in response to FS during cortical activation but switched to increasing it during slow wave activity. It can be hypothesised that this subpopulation of DA neurons may be involved in the 'dual signalling' of both the value and the salience of the stimuli, depending on the general state of the brain.

Functional Diversity of Dopamine Axons in Prefrontal Cortex During Classical Conditioning

Midbrain dopamine neurons impact neural processing in the prefrontal cortex (PFC) through mesocortical projections. However, the signals conveyed by dopamine projections to the PFC remain unclear, particularly at the single-axon level. Here, we investigated dopaminergic axonal activity in the medial PFC (mPFC) during reward and aversive processing. By optimizing microprism-mediated two-photon calcium imaging of dopamine axon terminals, we found diverse activity in dopamine axons responsive to both reward and aversive stimuli. Some axons exhibited a preference for reward, while others favored aversive stimuli, and there was a strong bias for the latter at the population level. Long-term longitudinal imaging revealed that the preference was maintained in reward- and aversive-preferring axons throughout classical conditioning in which rewarding and aversive stimuli were paired with preceding auditory cues. However, as mice learned to discriminate reward or aversive cues, a cue activity preference gradually developed only in aversive-preferring axons. We inferred the trial-by-trial cue discrimination based on machine learning using anticipatory licking or facial expressions, and found that successful discrimination was accompanied by sharper selectivity for the aversive cue in aversive-preferring axons. Our findings indicate that a group of mesocortical dopamine axons encodes aversive-related signals, which are modulated by both classical conditioning across days and trial-by-trial discrimination within a day.

Mesoaccumbal glutamate neurons drive reward via glutamate release but aversion via dopamine co-release

Ventral tegmental area (VTA) projections to the nucleus accumbens (NAc) drive reward-related motivation. Although dopamine neurons are predominant, a substantial glutamatergic projection is also present, and a subset of these co-release both dopamine and glutamate. Optogenetic stimulation of VTA glutamate neurons not only supports self-stimulation but can also induce avoidance behavior, even in the same assay. Here, we parsed the selective contribution of glutamate or dopamine co-release from VTA glutamate neurons to reinforcement and avoidance. We expressed channelrhodopsin-2 (ChR2) in mouse VTA glutamate neurons in combination with CRISPR-Cas9 to disrupt either the gene encoding vesicular glutamate transporter 2 (VGLUT2) or tyrosine hydroxylase (Th). Selective disruption of VGLUT2 abolished optogenetic self-stimulation but left real-time place avoidance intact, whereas CRISPR-Cas9 deletion of Th preserved self-stimulation but abolished place avoidance. Our results demonstrate that glutamate release from VTA glutamate neurons is positively reinforcing but that dopamine release from VTA glutamate neurons can induce avoidance behavior.

An excitatory projection from the basal forebrain to the ventral tegmental area that underlies anorexia-like phenotypes

Maladaptation in balancing internal energy needs and external threat cues may result in eating disorders. However, brain mechanisms underlying such maladaptations remain elusive. Here, we identified that the basal forebrain (BF) sends glutamatergic projections to glutamatergic neurons in the ventral tegmental area (VTA) in mice. Glutamatergic neurons in both regions displayed correlated responses to various stressors. Notably, in vivo manipulation of BF terminals in the VTA revealed that the glutamatergic BF → VTA circuit reduces appetite, increases locomotion, and elicits avoidance. Consistently, activation of VTA glutamatergic neurons reduced body weight, blunted food motivation, and caused hyperactivity with behavioral signs of anxiety, all hallmarks of typical anorexia symptoms. Importantly, activation of BF glutamatergic terminals in the VTA reduced dopamine release in the nucleus accumbens. Collectively, our results point to overactivation of the glutamatergic BF → VTA circuit as a potential cause of anorexia-like phenotypes involving reduced dopamine release.

Morphine- and foot shock-responsive neuronal ensembles in the VTA possess different connectivity and biased GPCR signaling pathway

Background: Neurons in the ventral tegmental area (VTA) are sensitive to stress and their maladaptation have been implicated in the psychiatric disorders such as anxiety and addiction, etc. The cellular properties of the VTA neurons in response to different stressors related to different emotional processing remain to be investigated. Methods: By combining immediate early gene (IEG)-dependent labeling, rabies virus tracing, ensemble-specific transcriptomic analysis and fiber photometry recording in the VTA of male mice, the spatial distribution, brain-wide connectivity and cellular signaling pathways in the VTA neuronal ensembles in response to morphine (Mor-Ens) or foot shock (Shock-Ens) stimuli were investigated. Results: Optogenetic activation of the Mor-Ens drove approach behavior, whereas chemogenetic activation of the Shock-Ens increased the anxiety level in mice. Mor-Ens were clustered and enriched in the ventral VTA, contained a higher proportion of dopaminergic neurons, received more inputs from the dorsal medial striatum and the medial hypothalamic zone, and exhibited greater axonal arborization in the zona incerta and ventral pallidum. Whereas Shock-Ens were more dispersed, contained a higher proportion of GABAergic neurons, and received more inputs from the ventral pallidum and the lateral hypothalamic area. The downstream targets of the G protein and β-arrestin pathways, PLCβ3 and phosphorylated AKT1Thr308, were relatively enriched in the Mor-Ens and Shock-Ens, respectively. Cariprazine, the G-protein-biased agonist for the dopamine D2 receptor, increased the response of Mor-Ens to sucrose water and decreased the anxiety-like behavior during morphine withdrawal, whereas the β-arrestin-biased agonist UNC9994 decreased the response of Shock-Ens to tail suspension. Conclusions: Taken together, these findings reveal the heterogeneous connectivity and signaling pathways of the VTA neurons in response to morphine and foot shock, providing new insights for development of specific interventions for psychiatric disorders caused by various stressors associated with different VTA neuronal functions.

Sex differences in the impact of social status on social reward and associated mesolimbic activation

Social stress plays an important role in the etiology of many neuropsychiatric disorders and can lead to a variety of behavioral deficits such as social withdrawal. One way that social stress may contribute to psychiatric disorders is by reducing social motivation and the rewarding properties of social interactions. We investigated the impact of social stress on social reward in the context of winning versus losing agonistic encounters in Syrian hamsters (Mesocricetus auratus). First, we tested the hypothesis that social stress resulting from either stable low, or subordinate, social status or from social defeat reduces the rewarding properties of social interactions. Using an Operant Social Preference (OSP) task to measure social reward/motivation, we found that both subordinate and socially defeated males made significantly fewer entries into chambers containing novel, same-sex conspecifics compared to males who were dominant (i.e., stably won the agonistic encounters). In females, however, there were no differences in social entries between winners and losers. In a second experiment, we found more activation of the mesolimbic dopamine system (MDS) as assessed with cFos immunohistochemistry in the lateral ventral tegmental area (lVTA) and the nucleus accumbens (NAc) shell of male winners compared to losers. In females, however, there were no differences in activation in the lVTA between winners and losers. Surprisingly, however, winning females displayed significantly more activation in the NAc shell as compared to losing females, despite the lack of behavioral differences. Thus, behavioral and histological data suggest that there are sex differences in the impact of social status on social reward and associated mesolimbic activation.

Stress relief as a natural resilience mechanism against depression-like behaviors

Relief, the appetitive state after the termination of aversive stimuli, is evolutionarily conserved. Understanding the behavioral role of this well-conserved phenomenon and its underlying neurobiological mechanisms are open and important questions. Here, we discover that the magnitude of relief from physical stress strongly correlates with individual resilience to depression-like behaviors in chronic stressed mice. Notably, blocking stress relief causes vulnerability to depression-like behaviors, whereas natural rewards supplied shortly after stress promotes resilience. Stress relief is mediated by reward-related mesolimbic dopamine neurons, which show minute-long, persistent activation after stress termination. Circuitry-wise, activation or inhibition of circuits downstream of the ventral tegmental area during the transient relief period bi-directionally regulates depression resilience. These results reveal an evolutionary function of stress relief in depression resilience and identify the neural substrate mediating this effect. Importantly, our data suggest a behavioral strategy of augmenting positive valence of stress relief with natural rewards to prevent depression.

Functional architecture of dopamine neurons driving fear extinction learning

The ability to extinguish fear responses to stimuli that no longer predict danger is critical for adaptive behavior and increases the likelihood of survival. During fear extinction, dopamine (DA) neurons signal the absence of the expected aversive outcome, and this extinction prediction error (EPE) signal is crucial for initiating and driving extinction learning. However, the neural circuits underlying the EPE signal have remained elusive. Here, we investigate the input-output circuitry of EPE-encoding DA neurons in male mice. By employing projection-specific fiber photometry and optogenetics, we demonstrate that these neurons project to a restricted subregion of the nucleus accumbens. Comprehensive anatomical analyses, as well as projection-specific chemogenetic manipulations combined with recordings of DA biosensors, further uncover the dorsal raphe as one key input structure critical for generating the EPE signal. Together, our results reveal for the first time the functional architecture of EPE-encoding DA neurons crucial for driving fear extinction learning.

Mu Opioid Receptor-Expressing Neurons in the Dorsal Raphe Nucleus Are Involved in Reward Processing and Affective Behaviors

BACKGROUND

Mu opioid receptors (MORs) are key for reward processing, mostly studied in dopaminergic pathways. MORs are also expressed in the dorsal raphe nucleus (DRN), which is central for the modulation of reward and mood, but MOR function in the DRN remains underexplored. Here, we investigated whether MOR-expressing neurons of the DRN (DRN-MOR neurons) participate in reward and emotional responses.

METHODS

We characterized DRN-MOR neurons anatomically using immunohistochemistry and functionally using fiber photometry in responses to morphine and rewarding/aversive stimuli. We tested the effect of opioid uncaging on the DRN on place conditioning. We examined the effect of DRN-MOR neuron optostimulation on positive reinforcement and mood-related behaviors. We mapped their projections and selected DRN-MOR neurons projecting to the lateral hypothalamus for a similar optogenetic experimentation.

RESULTS

DRN-MOR neurons form a heterogeneous neuronal population essentially composed of GABAergic (gamma-aminobutyric acidergic) and glutamatergic neurons. Calcium activity of DRN-MOR neurons was inhibited by rewarding stimuli and morphine. Local photo-uncaging of oxymorphone in the DRN produced conditioned place preference. DRN-MOR neuron optostimulation triggered real-time place preference and was self-administered, promoted social preference, and reduced anxiety and passive coping. Finally, specific optostimulation of DRN-MOR neurons projecting to the lateral hypothalamus recapitulated the reinforcing effects of total DRN-MOR neuron stimulation.

CONCLUSIONS

Our data show that DRN-MOR neurons respond to rewarding stimuli and that their optoactivation has reinforcing effects and promotes positive emotional responses, an activity which is partially mediated by their projections to the lateral hypothalamus. Our study also suggests a complex regulation of DRN activity by MOR opioids, involving mixed inhibition/activation mechanisms that fine-tune DRN function.

Contributions of the Sodium Leak Channel NALCN to Pacemaking of Medial Ventral Tegmental Area and Substantia Nigra Dopaminergic Neurons

We tested the role of the sodium leak channel, NALCN, in pacemaking of dopaminergic neuron (DAN) subpopulations from adult male and female mice. In situ hybridization revealed NALCN RNA in all DANs, with lower abundance in medial ventral tegmental area (VTA) relative to substantia nigra pars compacta (SNc). Despite lower relative abundance of NALCN, we found that acute pharmacological blockade of NALCN in medial VTA DANs slowed pacemaking by 49.08%. We also examined the electrophysiological properties of projection-defined VTA DAN subpopulations identified by retrograde labeling. Inhibition of NALCN reduced pacemaking in DANs projecting to medial nucleus accumbens (NAc) and others projecting to lateral NAc by 70.74% and 31.98%, respectively, suggesting that NALCN is a primary driver of pacemaking in VTA DANs. In SNc DANs, potentiating NALCN by lowering extracellular calcium concentration speeded pacemaking in wildtype but not NALCN conditional knockout mice, demonstrating functional presence of NALCN. In contrast to VTA DANs, however, pacemaking in SNc DANs was unaffected by inhibition of NALCN. Instead, we found that inhibition of NALCN increased the gain of frequency-current plots at firing frequencies slower than spontaneous firing. Similarly, inhibition of the hyperpolarization-activated cyclic nucleotide-gated (HCN) conductance increased gain but had little effect on pacemaking. Interestingly, simultaneous inhibition of NALCN and HCN resulted in significant reduction in pacemaker rate. Thus, we found NALCN makes substantial contributions to driving pacemaking in VTA DAN subpopulations. In SNc DANs, NALCN is not critical for pacemaking but inhibition of NALCN makes cells more sensitive to hyperpolarizing stimuli.SIGNIFICANCE STATEMENT Pacemaking in midbrain dopaminergic neurons (DAN) relies on multiple subthreshold conductances, including a sodium leak. Whether the sodium leak channel, NALCN, contributes to pacemaking in DANs located in the VTA and the SNc has not yet been determined. Using electrophysiology and pharmacology, we show that NALCN plays a prominent role in driving pacemaking in projection-defined VTA DAN subpopulations. By contrast, pacemaking in SNc neurons does not rely on NALCN. Instead, the presence of NALCN regulates the excitability of SNc DANs by reducing the gain of the neuron's response to inhibitory stimuli. Together, these findings will inform future efforts to obtain DAN subpopulation-specific treatments for use in neuropsychiatric disorders.

Association between vmPFC gray matter volume and smoking initiation in adolescents

Smoking of cigarettes among young adolescents is a pressing public health issue. However, the neural mechanisms underlying smoking initiation and sustenance during adolescence, especially the potential causal interactions between altered brain development and smoking behaviour, remain elusive. Here, using large longitudinal adolescence imaging genetic cohorts, we identify associations between left ventromedial prefrontal cortex (vmPFC) gray matter volume (GMV) and subsequent self-reported smoking initiation, and between right vmPFC GMV and the maintenance of smoking behaviour. Rule-breaking behaviour mediates the association between smaller left vmPFC GMV and smoking behaviour based on longitudinal cross-lagged analysis and Mendelian randomisation. In contrast, smoking behaviour associated longitudinal covariation of right vmPFC GMV and sensation seeking (especially hedonic experience) highlights a potential reward-based mechanism for sustaining addictive behaviour. Taken together, our findings reveal vmPFC GMV as a possible biomarker for the early stages of nicotine addiction, with implications for its prevention and treatment.

Past, present, and future of tools for dopamine detection

Dopamine (DA) is a critical neuromodulator involved in various brain functions. To understand how DA regulates neural circuits and behaviors in the physiological and pathological conditions, it is essential to have tools that enable the direct detection of DA dynamics in vivo. Recently, genetically encoded DA sensors based on G protein-coupled receptors revolutionized this field, as it allows us to track in vivo DA dynamic with unprecedented spatial-temporal resolution, high molecular specificity, and sub-second kinetics. In this review, we first summarize traditional DA detection methods. Then we focus on the development of genetically encoded DA sensors and feature its significance to understanding dopaminergic neuromodulation across diverse behaviors and species. Finally, we present our perspectives about the future direction of the next-generation DA sensors and extend their potential applications. Overall, this review offers a comprehensive perspective on the past, present, and future of DA detection tools, with important implications for the study of DA functions in health and disease.

From Prediction to Action: Dissociable Roles of Ventral Tegmental Area and Substantia Nigra Dopamine Neurons in Instrumental Reinforcement

Reward seeking requires the coordination of motor programs to achieve goals. Midbrain dopamine neurons are critical for reinforcement, and their activation is sufficient for learning about cues, actions, and outcomes. Here we examine in detail the mechanisms underlying the ability of ventral tegmental area (VTA) and substantia nigra (SNc) dopamine neurons to support instrumental learning. By exploiting numerous behavioral tasks in combination with time-limited optogenetic manipulations in male and female rats, we reveal that VTA and SNc dopamine neurons generate reinforcement through separable psychological processes. VTA dopamine neurons imbue actions and their associated cues with motivational value that allows flexible and persistent pursuit, whereas SNc dopamine neurons support time-limited, precise, action-specific learning that is nonscalable and inflexible. This architecture is reminiscent of actor-critic reinforcement learning models with VTA and SNc instructing the critic and actor, respectively. Our findings indicate that heterogeneous dopamine systems support unique forms of instrumental learning that ultimately result in disparate reward-seeking strategies.SIGNIFICANCE STATEMENT Dopamine neurons in the midbrain are essential for learning, motivation, and movement. Here we describe in detail the ability of VTA and SNc dopamine neurons to generate instrumental reinforcement, a process where an agent learns about actions they can emit to earn reward. While rats will avidly work and learn to respond for activation of VTA and SNc dopamine neurons, we find that only VTA dopamine neurons imbue actions and their associated cues with motivational value that spur continued pursuit of reward. Our data support a hypothesis that VTA and SNc dopamine neurons engage distinct psychological processes that have consequences for our understanding of these neurons in health and disease.

Collateral projections from the ventral tegmental area/substantia nigra pars compacta to the nucleus accumbens and insular cortex in the rat

Midbrain dopaminergic (DAergic) regions including ventral tegmental area (VTA) and substantia nigra pars compacta (SNc) are involved in diverse brain functions. Previous studies demonstrated that the VTA/SNc to nucleus accumbens (NAc) pathway is critical in reward and motivation. Moreover, DAergic innervations within the insular cortex (IC) are reported to play important roles in pain regulation. To investigate whether VTA/SNc sends collateral projections to NAc and IC, we injected retrograde tracer Fluoro-Gold (FG) into the NAc and Fluorescent retrograde tracer beads (RetroBeads) into the ipsilateral IC in rats. Then, to detect whether collateral projection neurons participate in neuropathic pain, parts of the rats received the spare nerve injury (SNI) surgery. The immunofluorescence staining results showed that FG, RetroBeads, and FG/RetroBeads double-labeled neurons were distributed in the VTA/SNc bilaterally with an ipsilateral predominance. The proportion of FG/RetroBeads double-labeled neurons to the total number of FG and RetroBeads-labeled neurons was 16.7% and 30.3%, respectively. About 90.3% of FG/RetroBeads double-labeled neurons showed DAergic neuron marker tyrosine hydroxylase (TH)-immunoreactive (IR), whereas, only 7.5% exhibited a subset of GABAergic inhibitory projection neuron marker parvalbumin (PV)-IR. One week after SNI, about 53.1% and 33.6% of FG- and RetroBeads-labeled neurons were FG/Fos- and RetroBeads/Fos-IR neurons, respectively. Finally, about 35.9% of the FG/RetroBeads double-labeled neurons showed Fos-IR. The present study indicates that parts of DAergic and PV-IR GABAergic neurons in the VTA/SNc send collateral projections to both NAc and IC, which are activated under SNI-induced neuropathic pain, and probably contribute to the regulation of nociception.

Description and comparison of brain distribution of oxytocin receptors in Rhabdomys pumillio and Rhabdomys dilectus

Oxytocin receptor (OXTR) distribution in the brain has been associated with different reproductive and social strategies of species. Rhabdomys pumilio (R. pumilio) and Rhabdomys dilectus (R. dilectus) are two sister rodent species that live in large/medium (but flexible) or small (mostly solitary) social groups respectively. In this study, we describe and compare the distribution of OXTR in these two species. OXTR binding in the brain of R. pumilio (8 females and 5 males) and R. dilectus (8 females and 5 males) adults was determined using autoradiography. Our results revealed significant differences in the nucleus accumbens, diagonal band, medial preoptic area, lateral habenula, superior colliculus, periaqueductal area and anterior paraventricular nucleus (higher in R. dilectus), and the dorsal lateral septum and anterior bed nucleus of the stria terminalis (higher in R. pumilio). OXTR density in other brain regions, such as the amygdala nuclei and hippocampus, did not differ between the two species. Sex differences were found in the medial preoptic area and ventral region of the lateral septum in R. pumilio (OXTR density higher in males) and in the anterior paraventricular thalamic nucleus, ventromedial nucleus of the hypothalamus and basolateral amygdala of R. dilectus (OXTR density higher in females). A sex difference in the density of OXTR was also found in the posterior region of the bed nucleus of the stria terminalis, where it was higher in males than in females of both species. This study shows species-specific brain distribution of OXTR in R. pumilio and R. dilectus that are unique, but with similarities with other polygynous or promiscuous rodent species that live in variable size groups, such as R. norvergicus, C. sociabilis, S. teguina and M. musculus.

Mesolimbic dopamine release precedes actively sought aversive stimuli in mice

In some models, animals approach aversive stimuli more than those housed in an enriched environment. Here, we found that male mice in an impoverished and unstimulating (i.e., boring) chamber without toys sought aversive air puffs more often than those in an enriched chamber. Using this animal model, we identified the insular cortex as a regulator of aversion-seeking behavior. Activation and inhibition of the insular cortex increased and decreased the frequencies of air-puff self-stimulation, respectively, and the firing patterns of insular neuron ensembles predicted the self-stimulation timing. Dopamine levels in the ventrolateral striatum decreased with passive air puffs but increased with actively sought puffs. Around 20% of mice developed intense self-stimulation despite being offered toys, which was prevented by administering opioid receptor antagonists. This study establishes a basis for comprehending the neural underpinnings of usually avoided stimulus-seeking behaviors.

Modulation of aversive value coding in the vertebrate and invertebrate brain

Avoiding potentially dangerous situations is key for the survival of any organism. Throughout life, animals learn to avoid environments, stimuli or actions that can lead to bodily harm. While the neural bases for appetitive learning, evaluation and value-based decision-making have received much attention, recent studies have revealed more complex computations for aversive signals during learning and decision-making than previously thought. Furthermore, previous experience, internal state and systems level appetitive-aversive interactions seem crucial for learning specific aversive value signals and making appropriate choices. The emergence of novel methodologies (computation analysis coupled with large-scale neuronal recordings, neuronal manipulations at unprecedented resolution offered by genetics, viral strategies and connectomics) has helped to provide novel circuit-based models for aversive (and appetitive) valuation. In this review, we focus on recent vertebrate and invertebrate studies yielding strong evidence that aversive value information can be computed by a multitude of interacting brain regions, and that past experience can modulate future aversive learning and therefore influence value-based decisions.

Cellular bases for reward-related dopamine actions

Dopamine neurons exhibit transient increases and decreases in their firing rate upon reward and punishment for learning. This bidirectional modulation of dopamine dynamics occurs on the order of hundreds of milliseconds, and it is sensitively detected to reinforce the preceding sensorimotor events. These observations indicate that the mechanisms of dopamine detection at the projection sites are of remarkable precision, both in time and concentration. A major target of dopamine projection is the striatum, including the ventral region of the nucleus accumbens, which mainly comprises dopamine D1 and D2 receptor (D1R and D2R)-expressing spiny projection neurons. Although the involvement of D1R and D2R in dopamine-dependent learning has been suggested, the exact cellular bases for detecting transient dopamine signaling remain unclear. This review discusses recent cellular studies on the novel synaptic mechanisms for detecting dopamine transient signals associated with learning. Analyses of behavior based on these mechanisms have further revealed new behavioral aspects that are closely associated with these synaptic mechanisms. Thus, it is gradually possible to mechanistically explain behavioral learning via synaptic and cellular bases in rodents.

Excitatory Projections from the Prefrontal Cortex to Nucleus Accumbens Core D1-MSNs and κ Opioid Receptor Modulate Itch-Related Scratching Behaviors

Itch is an uncomfortable and complex sensation that elicits the desire to scratch. The nucleus accumbens (NAc) activity is important in driving sensation, motivation, and emotion. Excitatory afferents from the medial prefrontal cortex (mPFC), amygdala, and hippocampus are crucial in tuning the activity of dopamine receptor D1-expressing and D2-expressing medium spiny neurons (Drd1-MSN and Drd2-MSN) in the NAc. However, a cell-type and neural circuity-based mechanism of the NAc underlying acute itch remains unclear. We found that acute itch induced by compound 48/80 (C48/80) decreased the intrinsic membrane excitability in Drd1-MSNs, but not in Drd2-MSNs, in the NAc core of male mice. Chemogenetic activation of Drd1-MSNs alleviated C48/80-induced scratching behaviors but not itch-related anxiety-like behaviors. In addition, C48/80 enhanced the frequency of spontaneous EPSCs (sEPSCs) and reduced the paired-pulse ratio (PPR) of electrical stimulation-evoked EPSCs in Drd1-MSNs. Furthermore, C48/80 increased excitatory synaptic afferents to Drd1-MSNs from the mPFC, not from the basolateral amygdala (BLA) or ventral hippocampus (vHipp). Consistently, the intrinsic excitability of mPFC-NAc projecting pyramidal neurons was increased after C48/80 treatment. Chemogenetic inhibition of mPFC-NAc excitatory synaptic afferents relieved the scratching behaviors. Moreover, pharmacological activation of κ opioid receptor (KOR) in the NAc core suppressed C48/80-induced scratching behaviors, and the modulation of KOR activity in the NAc resulted in the changes of presynaptic excitatory inputs to Drd1-MSNs in C48/80-treated mice. Together, these results reveal the neural plasticity in synapses of NAc Drd1-MSNs from the mPFC underlying acute itch and indicate the modulatory role of the KOR in itch-related scratching behaviors.SIGNIFICANCE STATEMENT Itch stimuli cause strongly scratching desire and anxiety in patients. However, the related neural mechanisms remain largely unclear. In the present study, we demonstrated that the pruritogen compound 48/80 (C48/80) shapes the excitability of dopamine receptor D1-expressing medium spiny neurons (Drd1-MSNs) in the nucleus accumbens (NAc) core and the glutamatergic synaptic afferents from medial prefrontal cortex (mPFC) to these neurons. Chemogenetic activation of Drd1-MSNs or inhibition of mPFC-NAc excitatory synaptic afferents relieves the scratching behaviors. In addition, pharmacological activation of κ opioid receptor (KOR) in the NAc core alleviates C48/80-induced itch. Thus, targeting mPFC-NAc Drd1-MSNs or KOR may provide effective treatments for itch.

Case report: Clinical lycanthropy in Huntington's disease

We describe the case of a patient diagnosed with Huntington's disease (HD), who, following a two-year history of anxiety with obsessional preoccupations, developed psychosis with clinical lycanthropy: a prominent delusional idea that he was a werewolf. Although there was no benefit from various antidepressants and antipsychotics, there was remarkable improvement of his symptoms following prescription of Clozapine. His choreiform movement disorder also improved as his mental state settled. Although some reported cases of clinical lycanthropy are related to neurological conditions, this is the first case in a patient with HD. We also discuss the relevance of cultural and personal factors in the expression of a delusion that incorporates disgust, and the potential role of somatosensory aberrations and misidentification of self.

Nociceptive Stimuli Activate the Hypothalamus-Habenula Circuit to Inhibit the Mesolimbic Reward System and Cocaine-Seeking Behaviors

Nociceptive signals interact with various regions of the brain, including those involved in physical sensation, reward, cognition, and emotion. Emerging evidence points to a role of nociception in the modulation of the mesolimbic reward system. The mechanism by which nociception affects dopamine (DA) signaling and reward is unclear. The lateral hypothalamus (LH) and the lateral habenula (LHb) receive somatosensory inputs and are structurally connected with the mesolimbic DA system. Here, we show that the LH-LHb pathway is necessary for nociceptive modulation of this system using male Sprague Dawley rats. Our extracellular single-unit recordings and head-mounted microendoscopic calcium imaging revealed that nociceptive stimulation by tail pinch excited LHb and LH neurons, which was inhibited by chemical lesion of the LH. Tail pinch increased activity of GABA neurons in ventral tegmental area, decreased the extracellular DA level in the nucleus accumbens ventrolateral shell in intact rats, and reduced cocaine-increased DA concentration, which was blocked by disruption of the LH. Furthermore, tail pinch attenuated cocaine-induced locomotor activity, 22 and 50 kHz ultrasonic vocalizations, and reinstatement of cocaine-seeking behavior, which was inhibited by chemogenetic silencing of the LH-LHb pathway. Our findings suggest that nociceptive stimulation recruits the LH-LHb pathway to inhibit mesolimbic DA system and drug reinstatement.SIGNIFICANCE STATEMENT The LHb and the LH have been implicated in processing nociceptive signals and modulating DA release in the mesolimbic DA system. Here, we show that the LH-LHb pathway is critical for nociception-induced modulation of mesolimbic DA release and cocaine reinstatement. Nociceptive stimulation alleviates extracellular DA release in the mesolimbic DA system, cocaine-induced psychomotor activities, and reinstatement of cocaine-seeking behaviors through the LH-LHb pathway. These findings provide novel evidence for sensory modulation of the mesolimbic DA system and drug addiction.

Distinct Roles of Dopamine Receptor Subtypes in the Nucleus Accumbens during Itch Signal Processing

Ventral tegmental area (VTA) dopaminergic neurons, which are well known for their central roles in reward and motivation-related behaviors, have been shown to participate in itch processing via their projection to the nucleus accumbens (NAc). However, the functional roles of different dopamine receptor subtypes in subregions of the NAc during itch processing remain unknown. With pharmacological approaches, we found that the blockade of dopamine D1 receptors (D1R), but not dopamine D2 receptors (D2R), in the lateral shell (LaSh) of the NAc impaired pruritogen-induced scratching behavior in male mice. In contrast, pharmacological activation of D2R in both the LaSh and medial shell (MeSh) of the NAc attenuated the scratching behavior induced by pruritogens. Consistently, we found that dopamine release, as detected by a dopamine sensor, was elevated in the LaSh rather than the MeSh of the NAc at the onset of scratching behavior. Furthermore, the elevation of dopamine release in the LaSh of the NAc persisted even though itch-relieving behavior was blocked, suggesting that the dopamine signal in the NAc LaSh represents a motivational component of itch processing. Our study revealed different dynamics of dopamine release that target neurons expressing two dopamine receptors subtypes within different subregions of the NAc, and emphasized that D1R in the LaSh of the NAc is important in itch signal processing.SIGNIFICANCE STATEMENT Dopamine has been implicated in itch signal processing. However, the mechanism underlying the functional role of dopamine in itch processing remains largely unknown. Here, we examined the role of dopamine D1 receptor (D1R) and D2R in the nucleus accumbens (NAc) shell during pruritogen-induced scratching behavior. We demonstrated that D1R in the NAc lateral shell (LaSh) play an important role in motivating itch-induced scratching behavior, while activation of D2R would terminate scratching behavior. Our study revealed the diverse functional roles of dopamine signals in the NAc shell during itch processing.

Dopaminergic circuits underlying associative aversive learning

Associative aversive learning enables animals to predict and avoid threats and thus is critical for survival and adaptive behavior. Anxiety disorders are characterized with deficits in normal aversive learning mechanisms and hence understanding the neural circuits underlying aversive learning and memory has high clinical relevance. Recent studies have revealed the dopamine system as one of the key modulators of aversive learning. In this review, we highlight recent advances that provide insights into how distinct dopaminergic circuits contribute to aversive learning and memory.

Stressed and wired: The effects of stress on the VTA circuits underlying motivated behavior

Stress affects many brain regions, including the ventral tegmental area (VTA), which is critically involved in reward processing. Excessive stress can reduce reward-seeking behaviors but also exacerbate substance use disorders, two seemingly contradictory outcomes. Recent research has revealed that the VTA is a heterogenous structure with diverse populations of efferents and afferents serving different functions. Stress has correspondingly diverse effects on VTA neuron activity, tending to decrease lateral VTA dopamine (DA) neuron activity, while increasing medial VTA DA and GABA neuron activity. Here we review the differential effects of stress on the activity of these distinct VTA neuron populations and how they contribute to decreases in reward-seeking behavior or increases in drug self-administration.

A mechanistic overview of approaches for the treatment of psychostimulant dependence

Psychostimulant use disorder is a major health issue around the world with enormous individual, family-related and societal consequences, yet there are no effective pharmacological treatments available. In this review, a target-based overview of pharmacological treatments toward psychostimulant addiction will be presented. We will go through therapeutic approaches targeting different aspects of psychostimulant addiction with focus on three major areas; 1) drugs targeting signalling, and metabolism of the dopamine system, 2) drugs targeting either AMPA receptors or metabotropic glutamate receptors of the glutamate system and 3) drugs targeting the severe side-effects of quitting long-term psychostimulant use. For each of these major modes of intervention, findings from pre-clinical studies in rodents to clinical trials in humans will be listed, and future perspectives of the different treatment strategies as well as their potential side-effects will be discussed. Pharmaceuticals modulating the dopamine system, such as antipsychotics, DAT-inhibitors, and disulfiram, have shown some promising results. Cognitive enhancers have been found to increase aspects of behavioural control, and drugs targeting the glutamate system such as modulators of metabotropic glutamate receptors and AMPA receptors have provided interesting changes in relapse behaviour. Furthermore, CRF-antagonists directed toward alleviating the symptoms of the withdrawal stage have been examined with interesting resulting changes in behaviour. There are promising results investigating therapeutics for psychostimulant addiction, but further preclinical work and additional human studies with a more stratified patient selection are needed to prove sufficient evidence of efficacy and tolerability.

The Arousal-motor Hypothesis of Dopamine Function: Evidence that Dopamine Facilitates Reward Seeking in Part by Maintaining Arousal

Dopamine facilitates approach to reward via its actions on dopamine receptors in the nucleus accumbens. For example, blocking either D1 or D2 dopamine receptors in the accumbens reduces the proportion of reward-predictive cues to which rats respond with cued approach. Recent evidence indicates that accumbens dopamine also promotes wakefulness and arousal, but the relationship between dopamine's roles in arousal and reward seeking remains unexplored. Here, we show that the ability of systemic or intra-accumbens injections of the D1 antagonist SCH23390 to reduce cued approach to reward depends on the animal's state of arousal. Handling the animal, a manipulation known to increase arousal, was sufficient to reverse the behavioral effects of the antagonist. In addition, SCH23390 reduced spontaneous locomotion and increased time spent in sleep postures, both consistent with reduced arousal, but also increased time spent immobile in postures inconsistent with sleep. In contrast, the ability of the D2 antagonist haloperidol to reduce cued approach was not reversible by handling. Haloperidol reduced spontaneous locomotion but did not increase sleep postures, instead increasing immobility in non-sleep postures. We place these results in the context of the extensive literature on dopamine's contributions to behavior, and propose the arousal-motor hypothesis. This novel synthesis, which proposes that two main functions of dopamine are to promote arousal and facilitate motor behavior, accounts both for our findings and many previous behavioral observations that have led to disparate and conflicting conclusions.

Responses and functions of dopamine in nucleus accumbens core during social behaviors

Social behaviors are among the most important motivated behaviors. How dopamine (DA), a "reward" signal, releases during social behaviors has been a topic of interest for decades. Here, we use a genetically encoded DA sensor, GRABDA2m, to record DA activity in the nucleus accumbens (NAc) core during various social behaviors in male and female mice. We find that DA releases during approach, investigation and consummation phases of social behaviors signal animals' motivation, familiarity of the social target, and valence of the experience, respectively. Positive and negative social experiences evoke opposite DA patterns. Furthermore, DA releases during mating and fighting are sexually dimorphic with a higher level in males than in females. At the functional level, increasing DA in NAc enhances social interest toward a familiar conspecific and alleviates defeat-induced social avoidance. Altogether, our results reveal complex information encoded by NAc DA activity during social behaviors and their multistage functional roles.

A molecularly defined D1 medium spiny neuron subtype negatively regulates cocaine addiction

The striatum plays a critical role in regulating addiction-related behaviors. The conventional dichotomy model suggests that striatal D1/D2 medium spiny neurons (MSNs) positively/negatively regulate addiction-related behaviors. However, this model does not account for the neuronal heterogeneity and functional diversity of the striatum, and whether MSN subtypes beyond the pan-D1/D2 populations play distinct roles in drug addiction remains unknown. We characterized the role of a tachykinin 2-expressing D1 MSN subtype (Tac2+), present in both rodent and primate striatum, using cocaine addiction mouse models. We found that acute cocaine administration reduces Tac2 neuronal activity, and cocaine conditioning alters neuronal response related to cocaine reward contextual associations. In addition, activation/inhibition of Tac2+ neurons attenuates/promotes cocaine-induced conditioned place preference and cocaine intravenous self-administration. Furthermore, stimulation of the NAc-to-lateral hypothalamic projection of Tac2+ neurons suppresses cocaine reward behavior. Our study reveals an unconventional negative regulatory function of D1 MSNs in drug addiction that operates in a subtype- and projection-specific manner.

Neural signals implicated in the processing of appetitive and aversive events in social and non-social contexts

In 2014, we participated in a special issue of Frontiers examining the neural processing of appetitive and aversive events. Specifically, we reviewed brain areas that contribute to the encoding of prediction errors and value versus salience, attention and motivation. Further, we described how we disambiguated these cognitive processes and their neural substrates by using paradigms that incorporate both appetitive and aversive stimuli. We described a circuit in which the orbitofrontal cortex (OFC) signals expected value and the basolateral amygdala (BLA) encodes the salience and valence of both appetitive and aversive events. This information is integrated by the nucleus accumbens (NAc) and dopaminergic (DA) signaling in order to generate prediction and prediction error signals, which guide decision-making and learning via the dorsal striatum (DS). Lastly, the anterior cingulate cortex (ACC) is monitoring actions and outcomes, and signals the need to engage attentional control in order to optimize behavioral output. Here, we expand upon this framework, and review our recent work in which within-task manipulations of both appetitive and aversive stimuli allow us to uncover the neural processes that contribute to the detection of outcomes delivered to a conspecific and behaviors in social contexts. Specifically, we discuss the involvement of single-unit firing in the ACC and DA signals in the NAc during the processing of appetitive and aversive events in both social and non-social contexts.

Mesoaccumbal Dopamine Heterogeneity: What Do Dopamine Firing and Release Have to Do with It?

Ventral tegmental area (VTA) dopamine (DA) neurons are often thought to uniformly encode reward prediction errors. Conversely, DA release in the nucleus accumbens (NAc), the prominent projection target of these neurons, has been implicated in reinforcement learning, motivation, aversion, and incentive salience. This contrast between heterogeneous functions of DA release versus a homogeneous role for DA neuron activity raises numerous questions regarding how VTA DA activity translates into NAc DA release. Further complicating this issue is increasing evidence that distinct VTA DA projections into defined NAc subregions mediate diverse behavioral functions. Here, we evaluate evidence for heterogeneity within the mesoaccumbal DA system and argue that frameworks of DA function must incorporate the precise topographic organization of VTA DA neurons to clarify their contribution to health and disease.

Multimodal detection of dopamine by sniffer cells expressing genetically encoded fluorescent sensors

Dopamine supports locomotor control and higher brain functions such as motivation and learning. Consistently, dopaminergic dysfunction is involved in a spectrum of neurological and neuropsychiatric diseases. Detailed data on dopamine dynamics is needed to understand how dopamine signals translate into cellular and behavioral responses, and to uncover pathological disturbances in dopamine-related diseases. Genetically encoded fluorescent dopamine sensors have recently enabled unprecedented monitoring of dopamine dynamics in vivo. However, these sensors' utility for in vitro and ex vivo assays remains unexplored. Here, we present a blueprint for making dopamine sniffer cells for multimodal dopamine detection. We generated sniffer cell lines with inducible expression of seven different dopamine sensors and perform a head-to-head comparison of sensor properties to guide users in sensor selection. In proof-of-principle experiments, we apply the sniffer cells to record endogenous dopamine release from cultured neurons and striatal slices, and for determining tissue dopamine content. Furthermore, we use the sniffer cells to measure dopamine uptake and release via the dopamine transporter as a radiotracer free, high-throughput alternative to electrochemical- and radiotracer-based assays. Importantly, the sniffer cell framework can readily be applied to the growing list of genetically encoded fluorescent neurotransmitter sensors.

A unidirectional but not uniform striatal landscape of dopamine signaling for motivational stimuli

SignificanceAlthough it is undisputed that striatal dopamine plays a prominent role in motivated behavior and learning, the precise information conveyed by dopamine signals as such is under active debate. For a long time, the idea dominated that dopamine encodes a reward prediction error and that this signal is broadcast uniformly throughout the brain. However, here, we capture dopamine dynamics across many striatal regions and demonstrate that dopamine release is, regionally, extremely heterogeneous and that a reward prediction error-like signal is predominantly found in the relatively small limbic domain of the striatum. Another striking organizing principle is that stimulus valence directs dopamine concentration homogeneously across all regions (i.e., appetitive stimuli increase dopamine and aversive stimuli decrease dopamine).

Pushing the frontiers: tools for monitoring neurotransmitters and neuromodulators

Neurotransmitters and neuromodulators have a wide range of key roles throughout the nervous system. However, their dynamics in both health and disease have been challenging to assess, owing to the lack of in vivo tools to track them with high spatiotemporal resolution. Thus, developing a platform that enables minimally invasive, large-scale and long-term monitoring of neurotransmitters and neuromodulators with high sensitivity, high molecular specificity and high spatiotemporal resolution has been essential. Here, we review the methods available for monitoring the dynamics of neurotransmitters and neuromodulators. Following a brief summary of non-genetically encoded methods, we focus on recent developments in genetically encoded fluorescent indicators, highlighting how these novel indicators have facilitated advances in our understanding of the functional roles of neurotransmitters and neuromodulators in the nervous system. These studies present a promising outlook for the future development and use of tools to monitor neurotransmitters and neuromodulators.

Cannabidiol impairs the rewarding effects of methamphetamine: Involvement of dopaminergic receptors in the nucleus accumbens

Cannabidiol, as component of cannabis, can potentially hinder the rewarding impact of drug abuse; however, its mechanism is ambiguous. Moreover, the nucleus accumbens (NAc), as a key area in the reward circuit, extensively receives dopaminergic projections from the ventral tegmentum area. To elucidate the role of accumbal D1 and D2 dopamine receptor families in Cannabidiol's inhibitory impact on the acquisition and expression phases of methamphetamine (MET), the conditioned place preference (CPP) procedure as a common method to assay reward characteristics of drugs was carried out. Six groups of rats were treated by various doses of SCH23390 or Sulpiride (0.25, 1, and 4 μg/0.5 μL) in the NAc as D1 or D2 dopamine receptor family antagonists, respectively, prior to infusion of Cannabidiol (10 μg/5 μL) in the lateral ventricle (LV) over conditioning phase in the acquisition experiments. In the second step of the study, animals received SCH23390 or Sulpiride in the NAc before Cannabidiol (50 μg/5 μL) infusion into the LV in the expression phase of MET to illuminate the influence of SCH23390 or Sulpiride on the inhibitory impact of Cannabidiol on the expression of MET-induced CPP. Intra-NAc administration of either SCH23390 or Sulpiride impaired Cannabidiol's suppressive impact on the expression phase, while just Sulpiride could suppress the Cannabidiol's impact on the acquisition phase of the MET-induced CPP. Also, the inhibitory impact of Sulpiride was stranger in both phases of MET reward. It seems that Cannabidiol prevents the expression and acquisition phases of MET-induced CPP partly through the dopaminergic system in the NAc.

Colocalized, bidirectional optogenetic modulations in freely behaving mice with a wireless dual-color optoelectronic probe

Optogenetic methods provide efficient cell-specific modulations, and the ability of simultaneous neural activation and inhibition in the same brain region of freely moving animals is highly desirable. Here we report bidirectional neuronal activity manipulation accomplished by a wireless, dual-color optogenetic probe in synergy with the co-expression of two spectrally distinct opsins (ChrimsonR and stGtACR2) in a rodent model. The flexible probe comprises vertically assembled, thin-film microscale light-emitting diodes with a lateral dimension of 125 × 180 µm², showing colocalized red and blue emissions and enabling chronic in vivo operations with desirable biocompatibilities. Red or blue irradiations deterministically evoke or silence neurons co-expressing the two opsins. The probe interferes with dopaminergic neurons in the ventral tegmental area of mice, increasing or decreasing dopamine levels. Such bidirectional regulations further generate rewarding and aversive behaviors and interrogate social interactions among multiple mice. These technologies create numerous opportunities and implications for brain research.

Seeking motivation and reward: roles of dopamine, hippocampus and supramammillo-septal pathway

Reinforcement learning and goal-seeking behavior are thought to be mediated by midbrain dopamine neurons. However, little is known about neural substrates of curiosity and exploratory behavior, which occur in the absence of clear goal or reward. This is despite behavioral scientists having long suggested that curiosity and exploratory behaviors are regulated by an innate drive. We refer to such behavior as information-seeking behavior and propose 1) key neural substrates and 2) the concept of environment prediction error as a framework to understand information-seeking processes. The cognitive aspect of information-seeking behavior, including the perception of salience and uncertainty, involves, in part, the pathways from the posterior hypothalamic supramammillary region to the hippocampal formation. The vigor of such behavior is modulated by the following: supramammillary glutamatergic neurons; their projections to medial septal glutamatergic neurons; and the projections of medial septal glutamatergic neurons to ventral tegmental dopaminergic neurons. Phasic responses of dopaminergic neurons are characterized as signaling potentially important stimuli rather than rewards. This paper describes how novel stimuli and uncertainty trigger seeking motivation and how these neural substrates modulate information-seeking behavior.

A distinct D1-MSN subpopulation down-regulates dopamine to promote negative emotional state

Dopamine (DA) level in the nucleus accumbens (NAc) is critical for reward and aversion encoding. DA released from the ventral mesencephalon (VM) DAergic neurons increases the excitability of VM-projecting D1-dopamine receptor-expressing medium spiny neurons (D1-MSNs) in the NAc to enhance DA release and augment rewards. However, how such a DA positive feedback loop is regulated to maintain DA homeostasis and reward-aversion balance remains elusive. Here we report that the ventral pallidum (VP) projection of NAc D1-MSNs (D1^NAc-VP) is inhibited by rewarding stimuli and activated by aversive stimuli. In contrast to the VM projection of D1-MSN (D1^NAc-VM), activation of D1^NAc-VP projection induces aversion, but not reward. D1^NAc-VP MSNs are distinct from the D1^NAc-VM MSNs, which exhibit conventional functions of D1-MSNs. Activation of D1^NAc-VP projection stimulates VM GABAergic transmission, inhibits VM DAergic neurons, and reduces DA release into the NAc. Thus, D1^NAc-VP and D1^NAc-VM MSNs cooperatively control NAc dopamine balance and reward-aversion states.

Behavior and Fos activation reveal that male and female rats differentially assess affective valence during CTA learning and expression

Females are more affected by psychiatric illnesses including eating disorders, depression, and post-traumatic stress disorder than males. However, the neural mechanisms mediating these sex differences are poorly understood. Animal models can be useful in exploring such neural mechanisms. Conditioned taste aversion (CTA) is a behavioral task that assesses how animals process the competition between associated reinforcing and aversive stimuli in subsequent task performance, a process critical to healthy behavior in many domains. The purpose of the present study was to identify sex differences in this behavior and associated neural responses. We hypothesized that females would value the rewarding stimulus (Boost®) relative to the aversive stimulus (LiCl) more than males in performing CTA. We evaluated behavior (Boost® intake, LiCl-induced behaviors, ultrasonic vocalizations (USVs), CTA performance) and Fos activation in relevant brain regions after the acute stimuli [acute Boost® (AB), acute LiCl (AL)] and the context-only task control (COT), Boost® only task (BOT) and Boost®-LiCl task (BLT). Acutely, females drank more Boost® than males but showed similar aversive behaviors after LiCl. Females and males performed CTA similarly. Both sexes produced 55 kHz USVs anticipating BOT and inhibited these calls in the BLT. However, more females emitted both 22 kHz and 55 kHz USVs in the BLT than males: the latter correlated with less CTA. Estrous cycle stage also influenced 55 kHz USVs. Fos responses were similar in males and females after AB or AL. Females engaged the gustatory cortex and ventral tegmental area (VTA) more than males during the BOT and males engaged the amygdala more than females in both the BOT and BLT. Network analysis of correlated Fos responses across brain regions identified two unique networks characterizing the BOT and BLT, in both of which the VTA played a central role. In situ hybridization with RNAscope identified a population of D1-receptor expressing cells in the CeA that responded to Boost® and D2 receptor-expressing cells that responded to LiCl. The present study suggests that males and females differentially process the affective valence of a stimulus to produce the same goal-directed behavior.

The Aversion Function of the Limbic Dopaminergic Neurons and Their Roles in Functional Neurological Disorders

The Freudian theory of conversion suggested that the major symptoms of functional neurological disorders (FNDs) are due to internal conflicts at motivation, especially at the sex drive or libido. FND patients might behave properly at rewarding situations, but they do not know how to behave at aversive situations. Sex drive is the major source of dopamine (DA) release in the limbic area; however, the neural mechanism involved in FND is not clear. Dopaminergic (DAergic) neurons have been shown to play a key role in processing motivation-related information. Recently, DAergic neurons are found to be involved in reward-related prediction error, as well as the prediction of aversive information. Therefore, it is suggested that DA might change the rewarding reactions to aversive reactions at internal conflicts of FND. So DAergic neurons in the limbic areas might induce two major motivational functions: reward and aversion at internal conflicts. This article reviewed the recent advances on studies about DAergic neurons involved in aversive stimulus processing at internal conflicts and summarizes several neural pathways, including four limbic system brain regions, which are involved in the processing of aversion. Then the article discussed the vital function of these neural circuits in addictive behavior, depression treatment, and FNDs. In all, this review provided a prospect for future research on the aversion function of limbic system DA neurons and the therapy of FNDs.

L-Type Calcium Channel Blockers: A Potential Novel Therapeutic Approach to Drug Dependence

This review describes interactions between compounds, primarily dihydropyridines, that block L-type calcium channels and drugs that cause dependence, and the potential importance of these interactions. The main dependence-inducing drugs covered are alcohol, psychostimulants, opioids, and nicotine. In preclinical studies, L-type calcium channel blockers prevent or reduce important components of dependence on these drugs, particularly their reinforcing actions and the withdrawal syndromes. The channel blockers also reduce the development of tolerance and/or sensitization, and they have no intrinsic dependence liability. In some instances, their effects include reversal of brain changes established during drug dependence. Prolonged treatment with alcohol, opioids, psychostimulant drugs, or nicotine causes upregulation of dihydropyridine binding sites. Few clinical studies have been carried out so far, and reports are conflicting, although there is some evidence of effectiveness of L-channel blockers in opioid withdrawal. However, the doses of L-type channel blockers used clinically so far have necessarily been limited by potential cardiovascular problems and may not have provided sufficient central levels of the drugs to affect neuronal dihydropyridine binding sites. New L-type calcium channel blocking compounds are being developed with more selective actions on subtypes of L-channel. The preclinical evidence suggests that L-type calcium channels may play a crucial role in the development of dependence to different types of drugs. Mechanisms for this are proposed, including changes in the activity of mesolimbic dopamine neurons, genomic effects, and alterations in synaptic plasticity. Newly developed, more selective L-type calcium channel blockers could be of considerable value in the treatment of drug dependence. SIGNIFICANCE STATEMENT: Dependence on drugs is a very serious health problem with little effective treatment. Preclinical evidence shows drugs that block particular calcium channels, the L-type, reduce dependence-related effects of alcohol, opioids, psychostimulants, and nicotine. Clinical studies have been restricted by potential cardiovascular side effects, but new, more selective L-channel blockers are becoming available. L-channel blockers have no intrinsic dependence liability, and laboratory evidence suggests they reverse previously developed effects of dependence-inducing drugs. They could provide a novel approach to addiction treatment.

Thalamo-Nucleus Accumbens Projections in Motivated Behaviors and Addiction

The ventral striatum, also called nucleus accumbens (NAc), has long been known to integrate information from cortical, thalamic, midbrain and limbic nuclei to mediate goal-directed behaviors. Until recently thalamic afferents have been overlooked when studying the functions and connectivity of the NAc. However, findings from recent studies have shed light on the importance and roles of precise Thalamus to NAc connections in motivated behaviors and in addiction. In this review, we summarize studies using techniques such as chemo- and optogenetics, electrophysiology and in vivo calcium imaging to elucidate the complex functioning of the thalamo-NAc afferents, with a particular highlight on the projections from the Paraventricular Thalamus (PVT) to the NAc. We will focus on the recent advances in the understanding of the roles of these neuronal connections in motivated behaviors, with a special emphasis on their implications in addiction, from cue-reward association to the mechanisms driving relapse.

Interpreting the role of the striatum during multiple phases of motor learning

The synaptic pathways in the striatum are central to basal ganglia functions including motor control, learning and organization, action selection, acquisition of motor skills, cognitive function, and emotion. Here, we review the role of the striatum and its connections in motor learning and performance. The development of new techniques to record neuronal activity and animal models of motor disorders using neurotoxin, pharmacological, and genetic manipulations are revealing pathways that underlie motor performance and motor learning, as well as how they are altered by pathophysiological mechanisms. We discuss approaches that can be used to analyze complex motor skills, particularly in rodents, and identify specific questions central to understanding how striatal circuits mediate motor learning.

Adaptive Changes in the Central Control of Energy Homeostasis Occur in Response to Variations in Energy Status

Energy homeostasis is regulated in coordinate fashion by the brain-gut axis, the homeostatic energy balance circuitry in the hypothalamus and the hedonic energy balance circuitry comprising the mesolimbcortical A10 dopamine pathway. Collectively, these systems convey and integrate information regarding nutrient status and the rewarding properties of ingested food, and formulate it into a behavioral response that attempts to balance fluctuations in consumption and food-seeking behavior. In this review we start with a functional overview of the homeostatic and hedonic energy balance circuitries; identifying the salient neural, hormonal and humoral components involved. We then delve into how the function of these circuits differs in males and females. Finally, we turn our attention to the ever-emerging roles of nociceptin/orphanin FQ (N/OFQ) and pituitary adenylate cyclase-activating polypeptide (PACAP)-two neuropeptides that have garnered increased recognition for their regulatory impact in energy homeostasis-to further probe how the imposed regulation of energy balance circuitry by these peptides is affected by sex and altered under positive (e.g., obesity) and negative (e.g., fasting) energy balance states. It is hoped that this work will impart a newfound appreciation for the intricate regulatory processes that govern energy homeostasis, as well as how recent insights into the N/OFQ and PACAP systems can be leveraged in the treatment of conditions ranging from obesity to anorexia.