Aversive behavior induced by optogenetic inactivation of ventral tegmental area dopamine neurons is mediated by dopamine D2 receptors in the nucleus accumbens

Natural phasic inhibition of dopamine neurons signals cognitive rigidity

When animals unexpectedly fail, their dopamine neurons undergo phasic inhibition that canonically drives extinction learning-a cognitive-flexibility mechanism for discarding outdated strategies. However, the existing evidence equates natural and artificial phasic inhibition, despite their spatiotemporal differences. Addressing this gap, we targeted a GABAA-receptor antagonist precisely to dopamine neurons, yielding three unexpected findings. First, this intervention blocked natural phasic inhibition selectively, leaving tonic activity unaffected. Second, blocking natural phasic inhibition accelerated extinction learning-opposite to canonical mechanisms. Third, our approach selectively benefitted perseverative mice, restoring rapid extinction without affecting new reward learning. Our findings reveal that extinction learning is rapid by default and slowed by natural phasic inhibition-challenging foundational learning theories, while delineating a synaptic mechanism and therapeutic target for cognitive rigidity.

Medial prefrontal cortex suppresses reward-seeking behavior with risk of punishment by reducing sensitivity to reward

Reward-seeking behavior is frequently associated with risk of punishment. There are two types of punishment: positive punishment, which is defined as addition of an aversive stimulus, and negative punishment, involves the omission of a rewarding outcome. Although the medial prefrontal cortex (mPFC) is important in avoiding punishment, whether it is important for avoiding both positive and negative punishment and how it contributes to such avoidance are not clear. In this study, we trained male mice to perform decision-making tasks under the risks of positive (air-puff stimulus) and negative (reward omission) punishment, and modeled their behavior with reinforcement learning. Following the training, we pharmacologically inhibited the mPFC. We found that pharmacological inactivation of mPFC enhanced the reward-seeking choice under the risk of positive, but not negative, punishment. In reinforcement learning models, this behavioral change was well-explained as an increase in sensitivity to reward, rather than a decrease in the strength of aversion to punishment. Our results suggest that mPFC suppresses reward-seeking behavior by reducing sensitivity to reward under the risk of positive punishment.

D1 and D2 medium spiny neurons in the nucleus accumbens core have distinct and valence-independent roles in learning

At the core of value-based learning is the nucleus accumbens (NAc). D1- and D2-receptor-containing medium spiny neurons (MSNs) in the NAc core are hypothesized to have opposing valence-based roles in behavior. Using optical imaging and manipulation approaches in mice, we show that neither D1 nor D2 MSNs signal valence. D1 MSN responses were evoked by stimuli regardless of valence or contingency. D2 MSNs were evoked by both cues and outcomes, were dynamically changed with learning, and tracked valence-free prediction error at the population and individual neuron level. Finally, D2 MSN responses to cues were necessary for associative learning. Thus, D1 and D2 MSNs work in tandem, rather than in opposition, by signaling specific properties of stimuli to control learning.

Recruitment of inhibitory neuronal pathways regulating dopaminergic activity for the control of cocaine seeking

Drug seeking is associated with the ventral tegmental area (VTA) dopaminergic (DA) activity. Previously, we have shown that brief optogenetic inhibition of VTA DA neurons with 1 s pulses delivered every 9 s attenuates cocaine seeking under extinction conditions in rats without producing overt signs of dysphoria or locomotor sedation. Whether recruitment of neuronal pathways inhibiting VTA neuronal activity would suppress drug seeking remains unknown. Here, we asked if optogenetic stimulation of the lateral habenula (LHb) efferents in the rostromedial tegmental nucleus (RMTg) as well as RMTg efferents in VTA would reduce drug seeking. To investigate this, we measured how recruitment of elements of this inhibitory pathway affects cocaine seeking in male rats under extinction conditions. The effectiveness of brief optogenetic manipulations was confirmed electrophysiologically at the level of electrical activity of VTA DA neurons. Real-time conditioned place aversion (RT-CPA) and open field tests were performed to control for potential dysphoric/sedating effects of brief optogenetic stimulation of LHb-RMTg-VTA circuitry. Optogenetic stimulation of either RMTg or LHb inhibited VTA DAergic neuron firing, whereas similar stimulation of RMTg efferents in VTA or LHb efferents in RMTg reduced cocaine seeking under extinction conditions. Moreover, stimulation of LHb-RMTg efferents produced an effect that was maintained 24 h later, during cocaine seeking test without stimulation. This effect was specific, as brief optogenetic stimulation did not affect locomotor activity and was not aversive. Our results indicate that defined inhibitory pathways can be recruited to inhibit cocaine seeking, providing potential new targets for non-pharmacological treatment of drug craving.

Tonic dopamine and biases in value learning linked through a biologically inspired reinforcement learning model

A hallmark of various psychiatric disorders is biased future predictions. Here we examined the mechanisms for biased value learning using reinforcement learning models incorporating recent findings on synaptic plasticity and opponent circuit mechanisms in the basal ganglia. We show that variations in tonic dopamine can alter the balance between learning from positive and negative reward prediction errors, leading to biased value predictions. This bias arises from the sigmoidal shapes of the dose-occupancy curves and distinct affinities of D1- and D2-type dopamine receptors: changes in tonic dopamine differentially alters the slope of the dose-occupancy curves of these receptors, thus sensitivities, at baseline dopamine concentrations. We show that this mechanism can explain biased value learning in both mice and humans and may also contribute to symptoms observed in psychiatric disorders. Our model provides a foundation for understanding the basal ganglia circuit and underscores the significance of tonic dopamine in modulating learning processes.

Dopaminergic systems create reward seeking despite adverse consequences

Resource-seeking behaviours are ordinarily constrained by physiological needs and threats of danger, and the loss of these controls is associated with pathological reward seeking1. Although dysfunction of the dopaminergic valuation system of the brain is known to contribute towards unconstrained reward seeking2,3, the underlying reasons for this behaviour are unclear. Here we describe dopaminergic neural mechanisms that produce reward seeking despite adverse consequences in Drosophila melanogaster. Odours paired with optogenetic activation of a defined subset of reward-encoding dopaminergic neurons become cues that starved flies seek while neglecting food and enduring electric shock punishment. Unconstrained seeking of reward is not observed after learning with sugar or synthetic engagement of other dopaminergic neuron populations. Antagonism between reward-encoding and punishment-encoding dopaminergic neurons accounts for the perseverance of reward seeking despite punishment, whereas synthetic engagement of the reward-encoding dopaminergic neurons also impairs the ordinary need-dependent dopaminergic valuation of available food. Connectome analyses reveal that the population of reward-encoding dopaminergic neurons receives highly heterogeneous input, consistent with parallel representation of diverse rewards, and recordings demonstrate state-specific gating and satiety-related signals. We propose that a similar dopaminergic valuation system dysfunction is likely to contribute to maladaptive seeking of rewards by mammals.

Striatal Dopamine Signals and Reward Learning

We are constantly bombarded by sensory information and constantly making decisions on how to act. In order to optimally adapt behavior, we must judge which sequences of sensory inputs and actions lead to successful outcomes in specific circumstances. Neuronal circuits of the basal ganglia have been strongly implicated in action selection, as well as the learning and execution of goal-directed behaviors, with accumulating evidence supporting the hypothesis that midbrain dopamine neurons might encode a reward signal useful for learning. Here, we review evidence suggesting that midbrain dopaminergic neurons signal reward prediction error, driving synaptic plasticity in the striatum underlying learning. We focus on phasic increases in action potential firing of midbrain dopamine neurons in response to unexpected rewards. These dopamine neurons prominently innervate the dorsal and ventral striatum. In the striatum, the released dopamine binds to dopamine receptors, where it regulates the plasticity of glutamatergic synapses. The increase of striatal dopamine accompanying an unexpected reward activates dopamine type 1 receptors (D1Rs) initiating a signaling cascade that promotes long-term potentiation of recently active glutamatergic input onto striatonigral neurons. Sensorimotor-evoked glutamatergic input, which is active immediately before reward delivery will thus be strengthened onto neurons in the striatum expressing D1Rs. In turn, these neurons cause disinhibition of brainstem motor centers and disinhibition of the motor thalamus, thus promoting motor output to reinforce rewarded stimulus-action outcomes. Although many details of the hypothesis need further investigation, altogether, it seems likely that dopamine signals in the striatum might underlie important aspects of goal-directed reward-based learning.

A putative loop connection between VTA dopamine neurons and nucleus accumbens encodes positive valence to compensate for hunger

Dopamine (DA) signal play pivotal roles in regulating motivated behaviors, including feeding behavior, but the role of midbrain DA neurons in modulating food intake and neural circuitry mechanisms remain largely unknown. Here, we found that activating but not inhibiting ventral tegmental area (VTA) DA neurons reduces mouse food intake. Furthermore, DA neurons in ventral VTA, especially neurons projecting to the medial nucleus accumbens (NAc), are activated by refeeding in the 24 h fasted mice. Combing neural circuitry tracing, optogenetic, chemogenetic, and pharmacological manipulations, we established that the VTA→medial NAc→VTA loop circuit is critical for the VTA DA neurons activation-induced food intake reduction. Moreover, activating either VTA DA neurons or dopaminergic axons in medial NAc elevates positive valence, which will compensate for the hungry-induced food intake. Thus, our study identifies a subset of positive valence-encoded VTA DA neurons forming possible loop connections with medial NAc that are anorexigenic.

Effects of acid-sensing ion channel-1A (ASIC1A) on cocaine-induced synaptic adaptations

Chronic drug abuse is thought to induce synaptic changes in nucleus accumbens medium spiny neurons (MSNs) that promote subsequent craving and drug-seeking behavior. Accumulating data suggest acid-sensing ion channels (ASICs) may play a critical role. In drug naïve mice, disrupting the ASIC1A subunit produced a variety of synaptic changes reminiscent of wild-type mice following cocaine withdrawal, including increased AMPAR/NMDAR ratio, increased AMPAR rectification, and increased dendrite spine density. Importantly, these changes in Asic1a -/- mice were normalized by a single dose of cocaine. Here we sought to understand the temporal effects of cocaine exposure in Asic1a -/- mice and the cellular site of ASIC1A action. Six hours after cocaine exposure, there was no effect. However, 15 h, 24 h and 4 days after cocaine exposure there was a significant reduction in AMPAR/NMDAR ratio in Asic1a -/- mice. Within 7 days the AMPAR/NMDAR ratio had returned to baseline levels. Cocaine-evoked changes in AMPAR rectification and dendritic spine density followed a similar time course with significant reductions in rectification and dendritic spines 24 h after cocaine exposure in Asic1a -/- mice. To test the cellular site of ASIC1A action on these responses, we disrupted ASIC1A specifically in a subpopulation of MSNs. We found that effects of ASIC1A disruption were cell autonomous and restricted to neurons in which the channels are disrupted. We further tested whether ASIC1A disruption differentially affects MSNs subtypes and found AMPAR/NMDAR ratio was elevated in dopamine receptor 1-expressing MSNs, suggesting a preferential effect for these cells. Finally, we tested if protein synthesis was involved in synaptic adaptations that occurred after ASIC1A disruption, and found the protein synthesis inhibitor anisomycin normalized AMPAR-rectification and AMPAR/NMDAR ratio in drug-naïve Asic1a -/- mice to control levels, observed in wild-type mice. Together, these results provide valuable mechanistic insight into the effects of ASICs on synaptic plasticity and drug-induced effects and raise the possibility that ASIC1A might be therapeutically manipulated to oppose drug-induced synaptic changes and behavior.

Restoring the firing activity of ventral tegmental area neurons by lateral hypothalamic deep brain stimulation following morphine administration in rats: LH DBS and the spiking activity of VTA neurons

We have previously shown that high-frequency deep brain stimulation (DBS) of the lateral hypothalamus (LH) compromises morphine-induced addiction-like behavior in rats. The exact mechanism underlying this effect is not known. Here, we investigated the assumption that DBS in the LH influences the firing activity of neurons in the ventral tegmental area (VTA). To that end, male Wistar rats received morphine (5 mg/kg; s.c.) for three days and underwent extracellular single unit recording under general anesthesia one day later. During the recording, the rats received an intraoperative injection of morphine (5 mg/kg; s.c.) plus DBS in the LH (130 Hz pulse frequency, 150 μA amplitude, and 100 μs pulse width). One group of animals also received preoperative DBS after each morphine injection before the recording. The spiking frequency of VTA neurons was measured at three successive phases: (1) baseline (5-15 min); (2) DBS-on (morphine + DBS for 30 min); and (3) After-DBS (over 30 min after termination of DBS). Results showed that morphine suppressed the firing activity of a large population of non-DA neurons, whereas it activated most DA neurons. Intraoperative DBS reversed morphine suppression of non-DA firing, but did not alter the excitatory effect of morphine on DA neurons firing. With repeated preoperative application of DBS, non-DA neurons returned to the morphine-induced suppressive state, but DA neurons released from the excitatory effect of morphine. It is concluded that the development of morphine reward is associated with a hypoactivity of VTA non-DA neurons and a hyperactivity of DA neurons, and that DBS modulation of the spiking activity may contribute to the blockade of morphine addiction-like behavior.

Error-related signaling in nucleus accumbens D2 receptor-expressing neurons guides inhibition-based choice behavior in mice

Learned associations between environmental cues and the outcomes they predict (cue-outcome associations) play a major role in behavioral control, guiding not only which responses we should perform, but also which we should inhibit, in order to achieve a specific goal. The encoding of such cue-outcome associations, as well as the performance of cue-guided choice behavior, is thought to involve dopamine D1 and D2 receptor-expressing medium spiny neurons (D1-/D2-MSNs) of the nucleus accumbens (NAc). Here, using a visual discrimination task in male mice, we assessed the role of NAc D1-/D2-MSNs in cue-guided inhibition of inappropriate responding. Cell-type specific neuronal silencing and in-vivo imaging revealed NAc D2-MSNs to contribute to inhibiting behavioral responses, with activation of NAc D2-MSNs following response errors playing an important role in optimizing future choice behavior. Our findings indicate that error-signaling by NAc D2-MSNs contributes to the ability to use environmental cues to inhibit inappropriate behavior.

A novel small molecule, AS1, reverses the negative hedonic valence of noxious stimuli

BACKGROUND

Pain is the primary reason people seek medical care, with chronic pain affecting ~ 20% of people in the USA. However, many existing analgesics are ineffective in treating chronic pain, while others (e.g., opioids) have undesirable side effects. Here, we describe the screening of a small molecule library using a thermal place aversion assay in larval zebrafish to identify compounds that alter aversion to noxious thermal stimuli and could thus serve as potential analgesics.

RESULTS

From our behavioral screen, we discovered a small molecule, Analgesic Screen 1 (AS1), which surprisingly elicited attraction to noxious painful heat. When we further explored the effects of this compound using other behavioral place preference assays, we found that AS1 was similarly able to reverse the negative hedonic valence of other painful (chemical) and non-painful (dark) aversive stimuli without being inherently rewarding. Interestingly, targeting molecular pathways canonically associated with analgesia did not replicate the effects of AS1. A neuronal imaging assay revealed that clusters of dopaminergic neurons, as well as forebrain regions located in the teleost equivalent of the basal ganglia, were highly upregulated in the specific context of AS1 and aversive heat. Through a combination of behavioral assays and pharmacological manipulation of dopamine circuitry, we determined that AS1 acts via D1 dopamine receptor pathways to elicit this attraction to noxious stimuli.

CONCLUSIONS

Together, our results suggest that AS1 relieves an aversion-imposed "brake" on dopamine release, and that this unique mechanism may provide valuable insight into the development of new valence-targeting analgesic drugs, as well as medications for other valence-related neurological conditions, such as anxiety and post-traumatic stress disorder (PTSD).

PAQR8 and PAQR9 expression is altered in the ventral tegmental area of aged rats infected with varicella zoster virus

Infection with varicella zoster virus (VZV) results in chicken pox and reactivation of VZV results in herpes zoster (HZ) or what is often referred to as shingles. Patients with HZ experience decreased motivation and increased emotional distress consistent with functions of the ventral tegmental area (VTA) of the brain. In addition, activity within the ventral tegmental area is altered in patients with HZ. HZ primarily affects individuals that are older and the VTA changes with age. To begin to determine if the VTA has a role in HZ symptoms, a screen of 10,000 genes within the VTA in young and old male rats was completed after injecting the whisker pad with VZV. The two genes that had maximal change were membrane progesterone receptors PAQR8 (mPRβ) and PAQR9 (mPRε). Neurons and non-neuronal cells expressed both PAQR8 and PAQR9. PAQR8 and PAQR9 protein expression was significantly reduced after VZV injection of young males. In old rats PAQR9 protein expression was significantly increased after VZV injection and PAQR9 protein expression was reduced in aged male rats versus young rats. Consistent with previous results, pain significantly increased after VZV injection of the whisker pad and aged animals showed significantly more pain than young animals. Our data suggests that PAQR8 and PAQR9 expression is altered by VZV injection and that these changes are affected by age.

Nucleus accumbens shell modulates seizure propagation in a mouse temporal lobe epilepsy model

Temporal lobe epilepsy (TLE) is the most common form of epilepsy with focal seizures which in some conditions can develop into secondarily generalized tonic-clonic seizures by the propagation of epileptic activities in the temporal lobe to other brain areas. The nucleus accumbens (NAc) has been suggested as a treatment target for TLE as accumulating evidence indicates that the NAc, especially its shell, participates in the process of epileptic seizures of patients and animal models with TLE. The majority of neurons in the NAc are GABAergic medium spiny neurons (MSNs) expressing dopamine receptor D1 (D1R) or dopamine receptor D2 (D2R). However, the direct evidence of the NAc shell participating in the propagation of TLE seizures is missing, and its cell type-specific modulatory roles in TLE seizures are unknown. In this study, we microinjected kainic acid into basolateral amygdala (BLA) to make a mouse model of TLE with initial focal seizures and secondarily generalized seizures (SGSs). We found that TLE seizures caused robust c-fos expression in the NAc shell and increased neuronal excitability of D1R-expressing MSN (D1R-MSN) and D2R-expressing MSN (D2R-MSN). Pharmacological inhibition of the NAc shell alleviated TLE seizures by reducing the number of SGSs and seizure stages. Cell-type-specific chemogenetic inhibition of either D1R-MSN or D2R-MSN showed similar effects with pharmacological inhibition of the NAc shell. Both pharmacological and cell-type-specific chemogenetic inhibition of the NAc shell did not alter the onset time of focal seizures. Collectively, these findings indicate that the NAc shell and its D1R-MSN or D2R-MSN mainly participate in the propagation and generalization of the TLE seizures.

Glutamate inputs from the laterodorsal tegmental nucleus to the ventral tegmental area are essential for the induction of cocaine sensitization in male mice

RATIONALE

Drug-induced potentiation of ventral tegmental area (VTA) glutamate signaling contributes critically to the induction of sensitization - an enhancement in responding to a drug following exposure which is thought to reflect neural changes underlying drug addiction. The laterodorsal tegmental nucleus (LDTg) provides one of several sources of glutamate input to the VTA.

OBJECTIVE

We used optogenetic techniques to test either the role of LDTg glutamate cells or their VTA afferents in the development of cocaine sensitization in male VGluT2::Cre mice. These were inhibited using halorhodopsin during each of five daily cocaine exposure injections. The expression of locomotor sensitization was assessed following a cocaine challenge injection 1-week later.

RESULTS

The locomotor sensitization seen in control mice was absent in male mice subjected to inhibition of LDTg-VTA glutamatergic circuitry during cocaine exposure. As sensitization of nucleus accumbens (NAcc) dopamine (DA) overflow is also induced by this drug exposure regimen, we used microdialysis to measure NAcc DA overflow on the test for sensitization. Consistent with the locomotor sensitization results, inhibition of LDTg glutamate afferents to the VTA during cocaine exposure prevented the sensitization of NAcc DA overflow observed in control mice.

CONCLUSIONS

These data identify the LDTg as the source of VTA glutamate critical for the development of cocaine sensitization in male mice. Accordingly, the LDTg may give rise to the synapses in the VTA at which glutamatergic plasticity, known to contribute to the enhancement of addictive behaviors, occurs.

Phosphorylation Signals Downstream of Dopamine Receptors in Emotional Behaviors: Association with Preference and Avoidance

Dopamine regulates emotional behaviors, including rewarding and aversive behaviors, through the mesolimbic dopaminergic pathway, which projects dopamine neurons from the ventral tegmental area to the nucleus accumbens (NAc). Protein phosphorylation is critical for intracellular signaling pathways and physiological functions, which are regulated by neurotransmitters in the brain. Previous studies have demonstrated that dopamine stimulated the phosphorylation of intracellular substrates, such as receptors, ion channels, and transcription factors, to regulate neuronal excitability and synaptic plasticity through dopamine receptors. We also established a novel database called KANPHOS that provides information on phosphorylation signals downstream of monoamines identified by our kinase substrate screening methods, including dopamine, in addition to those reported in the literature. Recent advances in proteomics techniques have enabled us to clarify the mechanisms through which dopamine controls rewarding and aversive behaviors through signal pathways in the NAc. In this review, we discuss the intracellular phosphorylation signals regulated by dopamine in these two emotional behaviors.

Dysregulation of dopamine neurotransmission in the nucleus accumbens in immobilization-induced hypersensitivity

Cast immobilization causes sensory hypersensitivity, which is also a symptom of neuropathic pain and chronic pain. However, the mechanisms underlying immobilization-induced hypersensitivity remain unclear. The present study investigated the role of dopamine neurotransmission in the nucleus accumbens shell (NAcSh) of rats with cast immobilization-induced mechanical hypersensitivity using in vivo microdialysis. Cast immobilization of the hind limb decreased the paw withdrawal threshold (PWT). Mechanical stimulation of the cast-immobilized hind limb induced a decrease in dopamine in the NAcSh, and this decrease was associated with the upregulation of presynaptic D2-like receptors. A D2-like receptor antagonist infused into the NAcSh reversed the decrease in PWT in rats with cast immobilization, whereas a D2-like receptor agonist infused into the NAcSh induced a decrease in PWT in control rats. In addition, the expression of the D2 receptor (Drd2) mRNA in the NAcSh was increased by cast immobilization. Importantly, systemic administration of the D2-like receptor antagonist reversed the decrease in PWT in rats with cast immobilization. As dopamine levels regulated by presynaptic D2-like receptors did not correlate with the PWT, it is presumed that the D2-like receptor antagonist or agonist acts on postsynaptic D2-like receptors. These results suggest that immobilization-induced mechanical hypersensitivity is attributable to the upregulation of postsynaptic D2-like receptors in the NAc. Blockade of D2-like receptors in the NAcSh is a potential therapeutic strategy for immobilization-induced hypersensitivity.

Effect of D1- and D2-like Dopamine Receptor Antagonists on the Rewarding and Anxiolytic Effects of Neurotensin in the Ventral Pallidum

Background: Neurotensin (NT) acts as a neurotransmitter and neuromodulator in the central nervous system. It was shown previously that NT in the ventral pallidum (VP) has rewarding and anxiolytic effects. NT exerts its effect in interaction with dopamine (DA) receptors in numerous brain areas; however, this has not yet been investigated in the VP. The aim of this study was to examine whether the inhibition of D1-like and D2-like DA receptors of the VP can modify the above mentioned effects of NT. Methods: Microinjection cannulas were implanted by means of stereotaxic operations into the VP of male Wistar rats. The rewarding effect of NT was examined by means of a conditioned place preference test. Anxiety was investigated with an elevated plus maze test. To investigate the possible interaction, D1-like DA receptor antagonist SCH23390 or D2-like DA receptor antagonist sulpiride were microinjected prior to NT. All of the drugs were also injected independently to analyze their effects alone. Results: In the present experiments, both the rewarding and anxiolytic effects of NT in the VP were prevented by both D1-like and D2-like DA receptor antagonists. Administered on their own, the antagonists did not influence reward and anxiety. Conclusion: Our present results show that the activity of the D1-like and D2-like DA receptors of the VP is a necessary requirement for both the rewarding and anxiolytic effects of NT.

The D2-like Dopamine Receptor Agonist Quinpirole Microinjected Into the Ventral Pallidum Dose-Dependently Inhibits the VTA and Induces Place Aversion

BACKGROUND

The ventral pallidum (VP) is a dopaminoceptive forebrain structure regulating the ventral tegmental area (VTA) dopaminergic population activity. We have recently demonstrated that in the VP, the D2-like dopamine (DA) receptor agonist quinpirole dose dependently facilitates memory consolidation in inhibitory avoidance and spatial learning. According to our hypothesis, quinpirole microinjected into the VP can modulate the VTA DAergic activity and influence motivation and learning processes of rats.

METHODS

Quinpirole was microinjected at 3 different doses into the VP of male rats, and controls received vehicle. Single unit recordings were employed to assess VTA DAergic activity. To investigate the possible reinforcing or aversive effect of quinpirole in the VP, the conditioned place preference paradigm was used.

RESULTS

Our results showed that intra-VP quinpirole microinjection regulates VTA DAergic neurons according to an inverted U-shaped dose-response curve. The largest dose of quinpirole decreased the population activity and strongly reduced burst activity of the DAergic neurons in the first hour after its application. In contrast, the 2 smaller doses increased DA population activity, but their effect started with a delay 1 hour after their microinjection. The CPP experiments revealed that the largest dose of quinpirole in the VP induced place aversion in the rats. Furthermore, the largest dose of quinpirole induced an acute locomotor activity reduction, while the medium dose led to a long-duration increase in locomotion.

CONCLUSIONS

In summary, quinpirole dose dependently regulates VTA DAergic activity as well as the motivation and motor behavior of the rats at the level of the VP.

Chronic Pain in the Elderly: Mechanisms and Perspectives

Chronic pain affects a large part of the population causing functional disability, being often associated with coexisting psychological disorders, such as depression and anxiety, besides cognitive deficits, and sleep disturbance. The world elderly population has been growing over the last decades and the negative consequences of chronic pain for these individuals represent a current clinical challenge. The main painful complaints in the elderly are related to neurodegenerative and musculoskeletal conditions, peripheral vascular diseases, arthritis, and osteoarthritis, contributing toward poorly life quality, social isolation, impaired physical activity, and dependence to carry out daily activities. Organ dysfunction and other existing diseases can significantly affect the perception and responses to chronic pain in this group. It has been proposed that elderly people have an altered pain experience, with changes in pain processing mechanisms, which might be associated with the degeneration of circuits that modulate the descending inhibitory pathways of pain. Aging has also been linked to an increase in the pain threshold, a decline of painful sensations, and a decrease in pain tolerance. Still, elderly patients with chronic pain show an increased risk for dementia and cognitive impairment. The present review article is aimed to provide the state-of-art of pre-clinical and clinical research about chronic pain in elderly, emphasizing the altered mechanisms, comorbidities, challenges, and potential therapeutic alternatives.

Optogenetic stimulation of dynorphinergic neurons within the dorsal raphe activate kappa opioid receptors in the ventral tegmental area and ablation of dorsal raphe prodynorphin or kappa receptors in dopamine neurons blocks stress potentiation of cocaine reward

Behavioral stress exposure increases the risk of drug-taking in individuals with substance use disorders by mechanisms involving the dynorphins, which are the endogenous neuropeptides for the kappa opioid receptor (KOR). KOR agonists have been shown to encode dysphoria, aversion, and changes in reward valuation, and kappa opioid antagonists are in clinical development for treating substance use disorders. In this study, we confirmed that KORs were expressed in dopaminergic neurons in the ventral tegmental area (VTA) of male C57BL6/J mice. Genetic ablation of KORs from dopamine neurons blocked the potentiating effects of repeated forced swim stress on cocaine conditioned place preference (CPP). KOR activation inhibited dopamine neuron GCaMP6m calcium activity in VTA during swim stress and caused a rebound enhancement during the period after stress exposure. Transient optogenetic inhibition of VTA dopamine neurons with AAV5-DIO-SwiChR was acutely aversive in a real time place preference assay and blunted cocaine CPP when inhibition was administered concurrently with cocaine conditioning. However, when inhibition preceded cocaine conditioning by 30 min, cocaine CPP was enhanced. Retrograde tracing with CAV2-DIO-ZsGreen identified a population of prodynorphin^Cre neurons in the dorsal raphe nucleus (DRN) projecting to the VTA. Optogenetic stimulation of dynorphinergic neurons within the DRN by Channelrhodopsin2 activated KOR in VTA and ablation of prodynorphin blocked stress potentiation of cocaine CPP. Together, these studies demonstrate the presence of a dynorphin/KOR midbrain circuit that projects from the DRN to VTA and is involved in altering the dynamic response of dopamine neuron activity to enhance drug reward learning.

Current Understanding of the Neural Circuitry in the Comorbidity of Chronic Pain and Anxiety

Chronic pain patients often develop mental disorders, and anxiety disorders are common. We hypothesize that the comorbid anxiety results from an imbalance between the reward and antireward system due to persistent pain, which leads to the dysfunction of the pain and anxiety regulatory system. In this review, we will focus on changes in neuroplasticity, especially in neural circuits, during chronic pain and anxiety as observed in animal studies. Several neural circuits within specific regions of the brain, including the nucleus accumbens, lateral habenular, parabrachial nucleus, medial septum, anterior cingulate cortex, amygdala, hippocampus, medial prefrontal cortex, and bed nucleus of the stria terminalis, will be discussed based on novel findings after chemogenetic or optogenetic manipulation. We believe that these animal studies provide novel insights into human conditions and can guide clinical practice.

D1 Receptor Mediated Dopaminergic Neurotransmission Facilitates Remote Memory of Contextual Fear Conditioning

Dopaminergic neurotransmission via dopamine D1 receptors (D1Rs) is considered to play an important role not only in reward-based learning but also in aversive learning. The contextual and auditory cued fear conditioning tests involve the processing of classical fear conditioning and evaluates aversive learning memory. It is possible to evaluate aversive learning memory in two different types of neural transmission circuits. In addition, when evaluating the role of dopaminergic neurotransmission via D1R, to avoid the effects in D1R-mediated neural circuitry alterations during development, it is important to examine using mice who D1R expression in the mature stage is suppressed. Herein, we investigated the role of dopaminergic neurotransmission via D1Rs in aversive memory formation in contextual and auditory cued fear conditioning tests using D1R knockdown (KD) mice, in which the expression of D1Rs could be conditionally and reversibly controlled with doxycycline (Dox) treatment. For aversive memory, we examined memory formation using recent memory 1 day after conditioning, and remote memory 4 weeks after conditioning. Furthermore, immunostaining of the brain tissues of D1RKD mice was performed after aversive footshock stimulation to investigate the distribution of activated c-Fos, an immediate-early gene, in the hippocampus (CA1, CA3, dentate gyrus), striatum, amygdala, and prefrontal cortex during aversive memory formation. After aversive footshock stimulation, immunoblotting was performed using hippocampal, striatal, and amygdalar samples from D1RKD mice to investigate the increase in the amount of c-Fos and phosphorylated SNAP-25 at Ser187 residue. When D1R expression was suppressed using Dox, behavioral experiments revealed impaired contextual fear learning in remote aversion memory following footshock stimulation. Furthermore, expression analysis showed a slight increase in the post-stimulation amount of c-Fos in the hippocampus and striatum, and a significant increase in the amount of phosphorylated SNAP-25 in the hippocampus, striatum, and prefrontal cortex before and after stimulation. These findings indicate that deficiency in D1R-mediated dopaminergic neurotransmission is an important factor in impairing contextual fear memory formation for remote memory.

Characterization of orexin input to dopamine neurons of the ventral tegmental area projecting to the medial prefrontal cortex and shell of nucleus accumbens

Orexin neurons are involved in homeostatic regulatory processes, including arousal and feeding, and provide a major input from the hypothalamus to the ventral tegmental area (VTA) of the midbrain. VTA neurons are a central hub processing reward and motivation and target the medial prefrontal cortex (mPFC) and the shell part of nucleus accumbens (NAcs). We investigated whether subpopulations of dopamine (DA) neurons in the VTA projecting either to the mPFC or the medial division of shell part of nucleus accumbens (mNAcs) receive differential input from orexin neurons and whether orexin exerts differential electrophysiological effects upon these cells. VTA neurons projecting to the mPFC or the mNAcs were traced retrogradely by Cav2-Cre virus and identified by expression of yellow fluorescent protein (YFP). Immunocytochemical analysis showed that a higher proportion of all orexin-innervated DA neurons projected to the mNAcs (34.5%) than to the mPFC (5.2%). Of all sampled VTA neurons projecting either to the mPFC or mNAcs, the dopaminergic (68.3 vs. 79.6%) and orexin-innervated DA neurons (68.9 vs. 64.4%) represented the major phenotype. Whole-cell current clamp recordings were obtained from fluorescently labeled neurons in slices during baseline periods and bath application of orexin A. Orexin similarly increased the firing rate of VTA dopamine neurons projecting to mNAcs (1.99 ± 0.61 Hz to 2.53 ± 0.72 Hz) and mPFC (0.40 ± 0.22 Hz to 1.45 ± 0.56 Hz). Thus, the hypothalamic orexin system targets mNAcs and to a lesser extent mPFC-projecting dopaminergic neurons of the VTA and exerts facilitatory effects on both clusters of dopamine neurons.

Towards translational optogenetics

Optogenetics is widely used to interrogate the neural circuits underlying disease and has most recently been harnessed for therapeutic applications. The optogenetic toolkit consists of light-responsive proteins that modulate specific cellular functions, vectors for the delivery of the transgenes that encode the light-responsive proteins to targeted cellular populations, and devices for the delivery of light of suitable wavelengths at effective fluence rates. A refined toolkit with a focus towards translational uses would include efficient and safer viral and non-viral gene-delivery vectors, increasingly red-shifted photoresponsive proteins, nanomaterials that efficiently transduce near-infrared light deep into tissue, and wireless implantable light-delivery devices that allow for spatiotemporally precise interventions at clinically relevant tissue depths. In this Review, we examine the current optogenetics toolkit and the most notable preclinical and translational uses of optogenetics, and discuss future methodological and translational developments and bottlenecks.

The rostromedial tegmental (RMTg) "brake" on dopamine and behavior: A decade of progress but also much unfinished work

Between 2005 and 2009, several research groups identified a strikingly dense inhibitory input to midbrain dopamine neurons arising from a previously uncharted region posterior to the ventral tegmental area (VTA). This region is now denoted as either the rostromedial tegmental nucleus (RMTg) or the "tail of the VTA" (tVTA), and is recognized to express distinct genetic markers, encode negative "prediction errors" (inverse to dopamine neurons), and play critical roles in behavioral inhibition and punishment learning. RMTg neurons are also influenced by many categories of abused drugs, and may drive some aversive responses to such drugs, particularly cocaine and alcohol. However, despite much progress, many important questions remain about RMTg molecular/genetic properties, diversity of projection targets, and applications to addiction, depression, and other neuropsychiatric disorders. This article is part of the special Issue on 'Neurocircuitry Modulating Drug and Alcohol Abuse'.

Circuit Investigation of Social Interaction and Substance Use Disorder Using Miniscopes

Substance use disorder (SUD) is comorbid with devastating health issues, social withdrawal, and isolation. Successful clinical treatments for SUD have used social interventions. Neurons can encode drug cues, and drug cues can trigger relapse. It is important to study how the activity in circuits and embedded cell types that encode drug cues develop in SUD. Exploring shared neurobiology between social interaction (SI) and SUD may explain why humans with access to social treatments still experience relapse. However, circuitry remains poorly characterized due to technical challenges in studying the complicated nature of SI and SUD. To understand the neural correlates of SI and SUD, it is important to: (1) identify cell types and circuits associated with SI and SUD, (2) record and manipulate neural activity encoding drug and social rewards over time, (3) monitor unrestrained animal behavior that allows reliable drug self-administration (SA) and SI. Miniaturized fluorescence microscopes (miniscopes) are ideally suited to meet these requirements. They can be used with gradient index (GRIN) lenses to image from deep brain structures implicated in SUD. Miniscopes can be combined with genetically encoded reporters to extract cell-type specific information. In this mini-review, we explore how miniscopes can be leveraged to uncover neural components of SI and SUD and advance potential therapeutic interventions.

Illuminating subcortical GABAergic and glutamatergic circuits for reward and aversion

Reinforcement, reward, and aversion are fundamental processes for guiding appropriate behaviors. Longstanding theories have pointed to dopaminergic neurons of the ventral tegmental area (VTA) and the limbic systems' descending pathways as crucial systems for modulating these behaviors. The application of optogenetic techniques in neurotransmitter- and projection-specific circuits has supported and enhanced many preexisting theories but has also revealed many unexpected results. Here, we review the past decade of optogenetic experiments to study the neural circuitry of reinforcement and reward/aversion with a focus on the mesolimbic dopamine system and brain areas along the medial forebrain bundle (MFB). The cumulation of these studies to date has revealed generalizable findings across molecularly defined cell types in areas of the basal forebrain and anterior hypothalamus. Optogenetic stimulation of GABAergic neurons in these brain regions drives reward and can support positive reinforcement and optogenetic stimulation of glutamatergic neurons in these regions drives aversion. We also review studies of the activity dynamics of neurotransmitter defined populations in these areas which have revealed varied response patterns associated with motivated behaviors.

Remote control of neural function by X-ray-induced scintillation

Scintillators emit visible luminescence when irradiated with X-rays. Given the unlimited tissue penetration of X-rays, the employment of scintillators could enable remote optogenetic control of neural functions at any depth of the brain. Here we show that a yellow-emitting inorganic scintillator, Ce-doped Gd₃(Al,Ga)₅O₁₂ (Ce:GAGG), can effectively activate red-shifted excitatory and inhibitory opsins, ChRmine and GtACR1, respectively. Using injectable Ce:GAGG microparticles, we successfully activated and inhibited midbrain dopamine neurons in freely moving mice by X-ray irradiation, producing bidirectional modulation of place preference behavior. Ce:GAGG microparticles are non-cytotoxic and biocompatible, allowing for chronic implantation. Pulsed X-ray irradiation at a clinical dose level is sufficient to elicit behavioral changes without reducing the number of radiosensitive cells in the brain and bone marrow. Thus, scintillator-mediated optogenetics enables minimally invasive, wireless control of cellular functions at any tissue depth in living animals, expanding X-ray applications to functional studies of biology and medicine.

Striatopallidal Pathway Distinctly Modulates Goal-Directed Valuation and Acquisition of Instrumental Behavior via Striatopallidal Output Projections

The striatopallidal pathway is specialized for control of motor and motivational behaviors, but its causal role in striatal control of instrumental learning remains undefined (partly due to the confounding motor effects). Here, we leveraged the transient and "time-locked" optogenetic manipulations with the reward delivery to minimize motor confounding effect, to better define the striatopallidal control of instrumental behaviors. Optogenetic (Arch) silencing of the striatopallidal pathway in the dorsomedial striatum (DMS) and dorsolateral striatum (DLS) promoted goal-directed and habitual behaviors, respectively, without affecting acquisition of instrumental behaviors, indicating striatopallidal pathway suppression of instrumental behaviors under physiological condition. Conversely, striatopallidal pathway activation mainly affected the acquisition of instrumental behaviors with the acquisition suppression achieved by either optogenetic (ChR2) or chemicogenetic (hM3q) activation, by strong (10 mW, but not weak 1 mW) optogenetic activation, by the time-locked (but not random) optogenetic activation with the reward and by the DMS (but not DLS) striatopallidal pathway. Lastly, striatopallidal pathway modulated instrumental behaviors through striatopallidal output projections into the external globus pallidus (GPe) since optogenetic activation of the striatopallidal pathway in the DMS and of the striatopallidal output projections in the GPe similarly suppressed goal-directed behavior. Thus, the striatopallidal pathway confers distinctive and inhibitory controls of animal's sensitivity to goal-directed valuation and acquisition of instrumental behaviors under normal and over-activation conditions, through the output projections into GPe.

Advances in understanding meso-cortico-limbic-striatal systems mediating risky reward seeking

The risk of an aversive consequence occurring as the result of a reward-seeking action can have a profound effect on subsequent behavior. Such aversive events can be described as punishers, as they decrease the probability that the same action will be produced again in the future and increase the exploration of less risky alternatives. Punishment can involve the omission of an expected rewarding event ("negative" punishment) or the addition of an unpleasant event ("positive" punishment). Although many individuals adaptively navigate situations associated with the risk of negative or positive punishment, those suffering from substance use disorders or behavioral addictions tend to be less able to curtail addictive behaviors despite the aversive consequences associated with them. Here, we discuss the psychological processes underpinning reward seeking despite the risk of negative and positive punishment and consider how behavioral assays in animals have been employed to provide insights into the neural mechanisms underlying addictive disorders. We then review the critical contributions of dopamine signaling to punishment learning and risky reward seeking, and address the roles of interconnected ventral striatal, cortical, and amygdala regions to these processes. We conclude by discussing the ample opportunities for future study to clarify critical gaps in the literature, particularly as related to delineating neural contributions to distinct phases of the risky decision-making process.

Dopamine D2R is Required for Hippocampal-dependent Memory and Plasticity at the CA3-CA1 Synapse

Dopamine receptors play an important role in motivational, emotional, and motor responses. In addition, growing evidence suggests a key role of hippocampal dopamine receptors in learning and memory. It is well known that associative learning and synaptic plasticity of CA3-CA1 requires the dopamine D1 receptor (D1R). However, the specific role of the dopamine D2 receptor (D2R) on memory-related neuroplasticity processes is still undefined. Here, by using two models of D2R loss, D2R knockout mice (Drd2-/-) and mice with intrahippocampal injections of Drd2-small interfering RNA (Drd2-siRNA), we aimed to investigate how D2R is involved in learning and memory as well as in long-term potentiation of the hippocampus. Our studies revealed that the genetic inactivation of D2R impaired the spatial memory, associative learning, and the classical conditioning of eyelid responses. Similarly, deletion of D2R reduced the activity-dependent synaptic plasticity in the hippocampal CA1-CA3 synapse. Our results demonstrate the first direct evidence that D2R is essential in behaving mice for trace eye blink conditioning and associated changes in hippocampal synaptic strength. Taken together, these results indicate a key role of D2R in regulating hippocampal plasticity changes and, in consequence, acquisition and consolidation of spatial and associative forms of memory.

The convergence of aversion and reward signals in individual neurons of the mice lateral habenula

The lateral habenula (LHb) and ventral tegmental area (VTA) are two structures closely connected, and they serve as aversion and reward junction of the brain, respectively. This study investigated whether single neurons in the LHb/VTA respond to both aversion and reward stimuli and how these neurons regulate aversion and reward processing. Using optogenetic combined with multi-channel recording of LHb / VTA neuronal discharge, we found that most single neurons in the LHb/ VTA respond to both aversion and reward stimuli. Interestingly, majority of neurons in LHb were aversion-activated and reward-inhibited neurons, consisting mainly of glutamatergic neurons, while most neurons in VTA were reward-activated and aversion-inhibited neurons, which inhibited by glutamatergic neurons in the LHb. Furthermore, optogenetic activation or inhibition of glutamatergic neurons in LHb and their terminals in VTA could induce aversive or reward behaviors. These results indicate that identical neurons in the LHb and VTA have different responses to reward and aversion stimuli. The aversion behaviors induced by activating LHb glutamatergic neurons may be due to its inhibition on reward-activated neurons in VTA. This study suggests that interplay between the LHb and VTA neurons may play a key role in regulating reward and aversion behaviors.

Accumbal D2R-medium spiny neurons regulate aversive behaviors through PKA-Rap1 pathway

The nucleus accumbens (NAc) plays a crucial role in various mental activities, including positive and negative reinforcement. We previously hypothesized that a balance between dopamine (DA) and adenosine signals regulates the PKA-Rap1 pathway in medium spiny neurons expressing DA D1 receptors (D1R-MSNs) or D2 receptors (D2R-MSNs) and demonstrated that the PKA-Rap1 pathway in D1R-MSNs is responsible for positive reinforcement. Here, we show the role of the PKA-Rap1 pathway in accumbal D2R-MSNs in negative reinforcement. Mice were exposed to electric foot shock as an aversive stimulus. We monitored the phosphorylation level of Rap1gap S563, which leads to the activation of Rap1. Electric foot shocks increased the phosphorylation level of GluN1 S897 and Rap1gap S563 in the NAc. The aversive stimulus-evoked phosphorylation of Rap1gap S563 was detected in accumbal D2R-MSNs and inhibited by pretreatment with adenosine A2a receptor (A2aR) antagonist. A2aR antagonist-treated mice showed impaired aversive memory in passive avoidance tests. AAV-mediated inhibition of PKA, Rap1, or MEK1 in accumbal D2R-MSNs impaired aversive memory in passive avoidance tests, whereas activation of this pathway potentiated aversive memory. Optogenetic inactivation of mesolimbic DAergic neurons induced place aversion in real-time place aversion tests. Aversive response was attenuated by inhibition of PKA-Rap1 signaling in accumbal D2R-MSNs. These results suggested that accumbal D2R-MSNs regulate aversive behaviors through the A2aR-PKA-Rap1-MEK pathway. Our findings provide a novel molecular mechanism for regulating negative reinforcement.

Dopamine and Addiction

Addiction is commonly identified with habitual nonmedical self-administration of drugs. It is usually defined by characteristics of intoxication or by characteristics of withdrawal symptoms. Such addictions can also be defined in terms of the brain mechanisms they activate; most addictive drugs cause elevations in extracellular levels of the neurotransmitter dopamine. Animals unable to synthesize or use dopamine lack the conditioned reflexes discussed by Pavlov or the appetitive behavior discussed by Craig; they have only unconditioned consummatory reflexes. Burst discharges (phasic firing) of dopamine-containing neurons are necessary to establish long-term memories associating predictive stimuli with rewards and punishers. Independent discharges of dopamine neurons (tonic or pacemaker firing) determine the motivation to respond to such cues. As a result of habitual intake of addictive drugs, dopamine receptors expressed in the brain are decreased, thereby reducing interest in activities not already stamped in by habitual rewards.

Signaling models for dopamine-dependent temporal contiguity in striatal synaptic plasticity

Animals remember temporal links between their actions and subsequent rewards. We previously discovered a synaptic mechanism underlying such reward learning in D1 receptor (D1R)-expressing spiny projection neurons (D1 SPN) of the striatum. Dopamine (DA) bursts promote dendritic spine enlargement in a time window of only a few seconds after paired pre- and post-synaptic spiking (pre-post pairing), which is termed as reinforcement plasticity (RP). The previous study has also identified underlying signaling pathways; however, it still remains unclear how the signaling dynamics results in RP. In the present study, we first developed a computational model of signaling dynamics of D1 SPNs. The D1 RP model successfully reproduced experimentally observed protein kinase A (PKA) activity, including its critical time window. In this model, adenylate cyclase type 1 (AC1) in the spines/thin dendrites played a pivotal role as a coincidence detector against pre-post pairing and DA burst. In particular, pre-post pairing (Ca2+ signal) stimulated AC1 with a delay, and the Ca2+-stimulated AC1 was activated by the DA burst for the asymmetric time window. Moreover, the smallness of the spines/thin dendrites is crucial to the short time window for the PKA activity. We then developed a RP model for D2 SPNs, which also predicted the critical time window for RP that depended on the timing of pre-post pairing and phasic DA dip. AC1 worked for the coincidence detector in the D2 RP model as well. We further simulated the signaling pathway leading to Ca2+/calmodulin-dependent protein kinase II (CaMKII) activation and clarified the role of the downstream molecules of AC1 as the integrators that turn transient input signals into persistent spine enlargement. Finally, we discuss how such timing windows guide animals' reward learning.

The projections from the anterior cingulate cortex to the nucleus accumbens and ventral tegmental area contribute to neuropathic pain-evoked aversion in rats

Although the anterior cingulate cortex (ACC) plays a vital role in neuropathic pain-related aversion, the underlying mechanisms haven't been fully studied. The mesolimbic dopamine system encodes reward and aversion, and participates in the exacerbation of chronic pain. Therefore, we investigated whether the ACC modulates aversion to neuropathic pain via control of the mesolimbic dopamine system, in a rat model of chronic constriction injury (CCI) to the sciatic nerve. Using anterograde and retrograde tracings, we confirmed that a subgroup of ACC neurons projected to the nucleus accumbens (NAc) and ventral tegmental area (VTA), which are two crucial nodes of the mesolimbic dopamine system. Combining electrophysiology in juvenile rats 7 days post-CCI, we found that the NAc/VTA-projecting neurons were hyperexcitable after CCI. Chemogenetic inhibition of these projections induced conditioned place preference in young adult rats 10-14 days post-CCI, without modulating the evoked pain threshold, whereas activation of these projections in sham rats mimicked aversive behavior. Furthermore, the function of the ACC projections was probably mediated by NAc D2-type medium spiny neurons and VTA GABAergic neurons. Taken together, our findings suggest that projections from the ACC to the NAc and VTA mediate neuropathic pain-related aversive behavior.

Dopamine D2 receptors in discrimination learning and spine enlargement

Dopamine D2 receptors (D2Rs) are densely expressed in the striatum and have been linked to neuropsychiatric disorders such as schizophrenia^1,2. High-affinity binding of dopamine suggests that D2Rs detect transient reductions in dopamine concentration (the dopamine dip) during punishment learning^3-5. However, the nature and cellular basis of D2R-dependent behaviour are unclear. Here we show that tone reward conditioning induces marked stimulus generalization in a manner that depends on dopamine D1 receptors (D1Rs) in the nucleus accumbens (NAc) of mice, and that discrimination learning refines the conditioning using a dopamine dip. In NAc slices, a narrow dopamine dip (as short as 0.4 s) was detected by D2Rs to disinhibit adenosine A_2A receptor (A_2AR)-mediated enlargement of dendritic spines in D2R-expressing spiny projection neurons (D2-SPNs). Plasticity-related signalling by Ca²⁺/calmodulin-dependent protein kinase II and A_2ARs in the NAc was required for discrimination learning. By contrast, extinction learning did not involve dopamine dips or D2-SPNs. Treatment with methamphetamine, which dysregulates dopamine signalling, impaired discrimination learning and spine enlargement, and these impairments were reversed by a D2R antagonist. Our data show that D2Rs refine the generalized reward learning mediated by D1Rs.

Learned avoidance requires VTA KOR-mediated reductions in dopamine

Proper learning from an aversive experience is essential for survival, yet it is an aberrant process in a wide range of mental disorders, as well as dopaminergic neurodegenerative disease. While the mesolimbic dopamine system is known to be essential for reward learning, the characterization of a potential pattern of dopamine signaling that guides avoidance remains unknown. Aversive stimuli may directly modulate dopamine signaling through the dynorphin/kappa opioid receptor (KOR) system, as kappa opioid receptors are expressed in this neural circuit and their activation is aversive in both rodents and humans. Ventral tegmental area (VTA) KORs are ideally positioned to directly shape aversion-induced reductions in dopamine signaling, but their role in this process has received little consideration. To determine the necessity of VTA KOR activity in the regulation of dopamine signaling and avoidance, we tested the effects of VTA KOR blockade on real time dopaminergic responses to aversive stimuli and learned avoidance in male Sprague-Dawley rats. We found that blockade of VTA KORs attenuated aversion-induced reductions in dopamine, and this treatment also prevented avoidance following the aversive experience. To determine whether aversion-induced reductions in striatal dopamine are necessary for avoidance, we tested avoidance following treatment with an intra nucleus accumbens D2 receptor agonist. This treatment also prevented avoidance and is consistent with the view that aversion-induced reductions in dopamine reduce dopamine signaling at high affinity D2 receptors and disinhibit an aversion-sensitive striatal output circuit to promote avoidance.

Sex and the dopaminergic system: Insights from addiction studies

Sex differences are present in psychiatric disorders associated with disrupted dopamine function, and thus, sex differences in dopamine neurobiology may underlie these clinical disparities. In this chapter, we review sex differences in the dopaminergic system with a focus on substance use disorders, especially tobacco smoking, as our exemplar disorder. This chapter is organized into five sections describing sex differences in the dopaminergic system: (1) neurobiology, (2) role of sex hormones, (3) genetic underpinnings, (4) cognitive function, and (5) influence on addiction. In each section, we provide an overview of the topic area, summarize sex differences identified to date, highlight addiction research, especially clinical neuroimaging studies, and suggest avenues for future research.

Nucleus accumbens medium spiny neurons subtypes signal both reward and aversion

Deficits in decoding rewarding (and aversive) signals are present in several neuropsychiatric conditions such as depression and addiction, emphasising the importance of studying the underlying neural circuits in detail. One of the key regions of the reward circuit is the nucleus accumbens (NAc). The classical view on the field postulates that NAc dopamine receptor D1-expressing medium spiny neurons (D1-MSNs) convey reward signals, while dopamine receptor D2-expressing MSNs (D2-MSNs) encode aversion. Here, we show that both MSN subpopulations can drive reward and aversion, depending on their neuronal stimulation pattern. Brief D1- or D2-MSN optogenetic stimulation elicited positive reinforcement and enhanced cocaine conditioning. Conversely, prolonged activation induced aversion, and in the case of D2-MSNs, decreased cocaine conditioning. Brief stimulation was associated with increased ventral tegmenta area (VTA) dopaminergic tone either directly (for D1-MSNs) or indirectly via ventral pallidum (VP) (for D1- and D2-MSNs). Importantly, prolonged stimulation of either MSN subpopulation induced remarkably distinct electrophysiological effects in these target regions. We further show that blocking κ-opioid receptors in the VTA (but not in VP) abolishes the behavioral effects induced by D1-MSN prolonged stimulation. In turn, blocking δ-opioid receptors in the VP (but not in VTA) blocks the behavioral effects elicited by D2-MSN prolonged stimulation. Our findings demonstrate that D1- and D2-MSNs can bidirectionally control reward and aversion, explaining the existence of controversial studies in the field, and highlights that the proposed striatal functional opposition needs to be reconsidered.

Differential contributions of striatal dopamine D1 and D2 receptors to component processes of value-based decision making

Dopamine has been implicated in value-based learning and decision making by signaling reward prediction errors and facilitating cognitive flexibility, incentive motivation, and voluntary movement. Dopamine receptors can roughly be divided into the D1 and D2 subtypes, and it has been hypothesized that these two types of receptors have an opposite function in facilitating reward-related and aversion-related behaviors, respectively. Here, we tested the contribution of striatal dopamine D1 and D2 receptors to processes underlying value-based learning and decision making in rats, employing a probabilistic reversal learning paradigm. Using computational trial-by-trial analysis of task behavior after systemic or intracranial treatment with dopamine D1 and D2 receptor agonists and antagonists, we show that negative feedback learning can be modulated through D2 receptor signaling and positive feedback learning through D1 receptor signaling in the ventral striatum. Furthermore, stimulation of D2 receptors in the ventral or dorsolateral (but not dorsomedial) striatum promoted explorative choice behavior, suggesting an additional function of dopamine in these areas in value-based decision making. Finally, treatment with most dopaminergic drugs affected response latencies and number of trials completed, which was also seen after infusion of D2, but not D1 receptor-acting drugs into the striatum. Together, our data support the idea that dopamine D1 and D2 receptors have complementary functions in learning on the basis of emotionally valenced feedback, and provide evidence that dopamine facilitates value-based and motivated behaviors through distinct striatal regions.

Three Rostromedial Tegmental Afferents Drive Triply Dissociable Aspects of Punishment Learning and Aversive Valence Encoding

Persistence of reward seeking despite punishment or other negative consequences is a defining feature of mania and addiction, and numerous brain regions have been implicated in such punishment learning, but in disparate ways that are difficult to reconcile. We now show that the ability of an aversive punisher to inhibit reward seeking depends on coordinated activity of three distinct afferents to the rostromedial tegmental nucleus (RMTg) arising from cortex, brainstem, and habenula that drive triply dissociable RMTg responses to aversive cues, outcomes, and prediction errors, respectively. These three pathways drive correspondingly dissociable aspects of punishment learning. The RMTg in turn drives negative, but not positive, valence encoding patterns in the ventral tegmental area (VTA). Hence, punishment learning involves pathways and functions that are highly distinct, yet tightly coordinated.

Monoaminergic modulation of decision-making under risk of punishment in a rat model

The ability to decide advantageously among options that vary in both their risks and rewards is critical for survival and well-being. Previous work shows that some forms of risky decision-making are robustly modulated by monoamine signaling, but it is less clear how monoamine signaling modulates decision-making under risk of explicit punishment. The goal of these experiments was to determine how this form of decision-making is modulated by dopamine, serotonin, and norepinephrine signaling, using a task in which rats choose between a small, 'safe' food reward and a large food reward associated with variable risks of punishment. Preference for the large, risky reward (risk-taking) was reduced by administration of a D2/3 dopamine receptor agonist (bromocriptine) and a selective D2 agonist (sumanirole). The selective D3 agonist PD128907 appeared to attenuate reward discrimination abilities but did not affect risk-taking per se. In contrast, drugs targeting serotonergic and noradrenergic signaling had few if any effects on choice behavior. These data suggest that in contrast to other forms of risky decision-making, decision-making under risk of punishment is selectively modulated by dopamine signaling, predominantly through D2 receptors.

A Paranigral VTA Nociceptin Circuit that Constrains Motivation for Reward

Nociceptin and its receptor are widely distributed throughout the brain in regions associated with reward behavior, yet how and when they act is unknown. Here, we dissected the role of a nociceptin peptide circuit in reward seeking. We generated a prepronociceptin (Pnoc)-Cre mouse line that revealed a unique subpopulation of paranigral ventral tegmental area (pnVTA) neurons enriched in prepronociceptin. Fiber photometry recordings during progressive ratio operant behavior revealed pnVTAPnoc neurons become most active when mice stop seeking natural rewards. Selective pnVTAPnoc neuron ablation, inhibition, and conditional VTA nociceptin receptor (NOPR) deletion increased operant responding, revealing that the pnVTAPnoc nucleus and VTA NOPR signaling are necessary for regulating reward motivation. Additionally, optogenetic and chemogenetic activation of this pnVTAPnoc nucleus caused avoidance and decreased motivation for rewards. These findings provide insight into neuromodulatory circuits that regulate motivated behaviors through identification of a previously unknown neuropeptide-containing pnVTA nucleus that limits motivation for rewards.

Mechanical allodynia induced by optogenetic sensory nerve excitation activates dopamine signaling and metabolism in medial nucleus accumbens

The mesolimbic dopaminergic signaling, such as that originating from the ventral tegmental area (VTA) neurons in the medial part of the nucleus accumbens (mNAc), plays a role in complex sensory and affective components of pain. To date, we have demonstrated that optogenetic sensory nerve stimulation rapidly alters the dopamine (DA) content within the mNAc. However, the physiological role and biochemical processes underlying such rapid and regional dynamics of DA remain unclear. In this study, using imaging mass spectrometry (IMS), we observed that sensitized pain stimulation by optogenetic sensory nerve activation increased DA and 3-Methoxytyramine (3-MT; a post-synaptic metabolite obtained following DA degradation) in the mNAc of the experimental mice. To delineate the mechanism associated with elevation of DA and 3-MT, the de novo synthesized DA in the VTA/substantia nigra terminal areas was evaluated using IMS by visualizing the metabolic conversion of stable isotope-labeled tyrosine (¹³C¹⁵N-Tyr) to DA. Our approach revealed that at steady state, the de novo synthesized DA occupied >10% of the non-labeled DA pool in the NAc within 1.5 h of isotope-labeled Tyr administration, despite no significant increase following pain stimulation. These results suggested that sensitized pain triggered an increase in the release and postsynaptic intake of DA in the mNAc, followed by its degradation, and likely delayed de novo DA synthesis. In conclusion, we demonstrated that short, peripheral nerve excitation with mechanical stimulation accelerates the mNAc-specific DA signaling and metabolism which might be associated with the development of mechanical allodynia.

Rostrocaudal subregions of the ventral tegmental area are differentially impacted by chronic stress

RATIONALE

The ventral tegmental area (VTA) is implicated in the pathophysiology of depression and addictive disorders and is subject to the detrimental effects of stress. Chronic stress may differentially alter the activity pattern of its different subregions along the rostrocaudal and dorsoventral axes, which may relate to the variable behavioral sensitivity to stress mediated by these subregions.

OBJECTIVES

Here, chronic stress-exposed rats were tested for depressive-like reactivity. In situ hybridization for zif268 as a marker of neuronal activation was combined with in vivo single-unit recording of dopaminergic neurons to assess modifications in the activity of the rostral VTA (rVTA) and caudal VTA (cVTA). Changes in the expression of stress-responsive glucocorticoid receptors (GR) and brain-derived neurotrophic factor (BDNF) were also assessed.

RESULTS

Stress-induced anhedonia-like, hyper-anxious, and passive-like responding were associated with reductions in dopaminergic burst activity in the cVTA and an increase in local GABAergic activity, particularly in GABA_A receptor sensitivity. On the other hand, stress increased single-spiking activity, burst activity, and zif268 mRNA levels in the rVTA, which were associated with increased glutamatergic tonus and enhanced GR and AMPA receptor (AMPAR) expression. rVTA and cVTA activity differentially correlated with sucrose preference and passivity measures.

CONCLUSIONS

These data demonstrate that the rVTA and cVTA respond differently to stress and suggest that while cVTA activity may be related to passivity-like states, the activity of both subregions appears to be related to anhedonia and the processing of incentive value. These region-dependent abnormalities indicate the multi-modular composition of the VTA, which could provide multiple substrates for different symptom features.

Defining circuit-specific roles for G protein-coupled receptors in aversive learning

The encoding of negative valence in response to noxious stimuli/experiences and in turn, the behavioral representation of negative affective states is essential for survival. Recent advances in neuroscience have determined multiple sites of neural plasticity and key circuits of connectivity across these regions in mediating aversive behavior. G protein-coupled receptors (GPCRs), owing to their neuromodulatory role, are especially important to refining our understanding of the molecular substrates involved in these circuits. In this review, we will focus on recent, contemporary findings that explore neural circuit-specific roles for neurotransmitter/peptide GPCRs and the importance of using novel approaches to illuminate the molecular mechanisms central to aversive learning.