A Neural Circuit Mechanism for Encoding Aversive Stimuli in the Mesolimbic Dopamine System

A feature-specific prediction error model explains dopaminergic heterogeneity

The hypothesis that midbrain dopamine (DA) neurons broadcast a reward prediction error (RPE) is among the great successes of computational neuroscience. However, recent results contradict a core aspect of this theory: specifically that the neurons convey a scalar, homogeneous signal. While the predominant family of extensions to the RPE model replicates the classic model in multiple parallel circuits, we argue that these models are ill suited to explain reports of heterogeneity in task variable encoding across DA neurons. Instead, we introduce a complementary 'feature-specific RPE' model, positing that individual ventral tegmental area DA neurons report RPEs for different aspects of an animal's moment-to-moment situation. Further, we show how our framework can be extended to explain patterns of heterogeneity in action responses reported among substantia nigra pars compacta DA neurons. This theory reconciles new observations of DA heterogeneity with classic ideas about RPE coding while also providing a new perspective of how the brain performs reinforcement learning in high-dimensional environments.

Muscarinic receptor activation preferentially inhibits rebound in vulnerable dopaminergic neurons

Dopaminergic subpopulations of the substantia nigra pars compacta (SNc) differentially degenerate in Parkinson's disease and are characterized by unique electrophysiological properties. The vulnerable population expresses a T-type calcium channel-mediated afterdepolarization (ADP) and shows rebound activity upon release from inhibition, whereas the resilient population does not have an ADP and is slower to fire after hyperpolarization. This rebound activity can trigger dopamine release in the striatum, an important component of basal ganglia function. Using whole-cell patch clamp electrophysiology on ex vivo slices from adult mice of both sexes, we find that muscarinic activation with the non-selective muscarinic agonist Oxotremorine inhibits rebound activity more strongly in vulnerable vs resilient SNc neurons. Here, we show that this effect depends on the direct activation of muscarinic receptors on the SNc dopaminergic neurons. Through a series of pharmacological and transgenic knock-out experiments, we tested whether the muscarinic inhibition of rebound was mediated through the canonical rebound-related ion channels: T-type calcium channels, hyperpolarization-activated cation channels (HCN), and A-type potassium channels. We find that muscarinic receptor activation inhibits HCN-mediated current (I h ) in vulnerable SNc neurons, but that I h activity is not necessary for the muscarinic inhibition of rebound activity. Similarly, we find that Oxotremorine inhibits rebound activity independently of T-type calcium channels and A-type potassium channels. Together these findings reveal new principles governing acetylcholine and dopamine interactions, showing that muscarinic receptors directly affect SNc rebound activity in the midbrain at the somatodendritic level and differentially modify information processing in distinct SNc subpopulations.

Significance Statement

Dopaminergic neurons in the substantia nigra pars compacta (SNc) can be divided into functional subpopulations with distinct basal ganglia connectivity and different degeneration patterns in Parkinson's disease. We show that the vulnerable and resilient subpopulations of SNc dopaminergic neurons are differentially modulated by muscarinic receptor activation. Specifically, muscarinic receptor activation inhibits rebound activity more strongly in the vulnerable SNc neurons than in the resilient. We find that this inhibition occurs through a non-canonical rebound-related pathway and is not mediated through the channels best known for modulating rebound in midbrain dopaminergic neurons. These findings are important because they reveal novel acetylcholine-dopamine interactions that occur in the midbrain and affect information processing in distinct basal ganglia circuits.

Explaining dopamine through prediction errors and beyond

The most influential account of phasic dopamine holds that it reports reward prediction errors (RPEs). The RPE-based interpretation of dopamine signaling is, in its original form, probably too simple and fails to explain all the properties of phasic dopamine observed in behaving animals. This Perspective helps to resolve some of the conflicting interpretations of dopamine that currently exist in the literature. We focus on the following three empirical challenges to the RPE theory of dopamine: why does dopamine (1) ramp up as animals approach rewards, (2) respond to sensory and motor features and (3) influence action selection? We argue that the prediction error concept, once it has been suitably modified and generalized based on an analysis of each computational problem, answers each challenge. Nonetheless, there are a number of additional empirical findings that appear to demand fundamentally different theoretical explanations beyond encoding RPE. Therefore, looking forward, we discuss the prospects for a unifying theory that respects the diversity of dopamine signaling and function as well as the complex circuitry that both underlies and responds to dopaminergic transmission.

Dopamine neurons drive spatiotemporally heterogeneous striatal dopamine signals during learning

Environmental cues, through Pavlovian learning, become conditioned stimuli that invigorate and guide animals toward rewards. Dopamine (DA) neurons in the ventral tegmental area (VTA) and substantia nigra (SNc) are crucial for this process, via engagement of a reciprocally connected network with their striatal targets. Critically, it remains unknown how dopamine neuron activity itself engages dopamine signals throughout the striatum, across learning. Here, we investigated how optogenetic Pavlovian cue conditioning of VTA or SNc dopamine neurons directs cue-evoked behavior and shapes subregion-specific striatal dopamine dynamics. We used a fluorescent biosensor to monitor dopamine in the nucleus accumbens (NAc) core and shell, dorsomedial striatum (DMS), and dorsolateral striatum (DLS). We demonstrate spatially heterogeneous, learning-dependent dopamine changes across striatal regions. Although VTA stimulation-evoked robust dopamine release in NAc core, shell, and DMS, predictive cues preferentially recruited dopamine release in NAc core, starting early in training, and DMS, late in training. Negative prediction error signals, reflecting a violation in the expectation of dopamine neuron activation, only emerged in the NAc core and DMS. Despite the development of vigorous movement late in training, conditioned dopamine signals did not emerge in the DLS, even during Pavlovian conditioning with SNc dopamine neuron activation, which elicited robust DLS dopamine release. Together, our studies show a broad dissociation in the fundamental prediction and reward-related information generated by VTA and SNc dopamine neuron populations and signaled by dopamine across the striatum. Further, they offer new insight into how larger-scale adaptations across the striatal network emerge during learning to coordinate behavior.

Dopamine Dysregulation in Reward and Autism Spectrum Disorder

Autism spectrum disorder (ASD) is primarily characterized by core deficits in social skills, communication, and cognition and by repetitive stereotyped behaviors. These manifestations are variable between individuals, and ASD pathogenesis is complex, with over a thousand implicated genes, many epigenetic factors, and multiple environmental influences. The mesolimbic dopamine (DA) mediated brain reward system is held to play a key role, but the rapidly expanding literature reveals intricate, nuanced signaling involving a wide array of mesolimbic loci, neurotransmitters and receptor subtypes, and neuronal variants. How altered DA signaling may constitute a downstream convergence of the manifold causal origins of ASD is not well understood. A clear working framework of ASD pathogenesis may help delineate common stages and potential diagnostic and interventional opportunities. Hence, we summarize the known natural history of ASD in the context of emerging data and perspectives to update ASD reward signaling. Then, against this backdrop, we proffer a provisional framework that organizes ASD pathogenesis into successive levels, including (1) genetic and epigenetic changes, (2) disrupted mesolimbic reward signaling pathways, (3) dysregulated neurotransmitter/DA signaling, and finally, (4) altered neurocognitive and social behavior and possible antagonist/agonist based ASD interventions. This subdivision of ASD into a logical progression of potentially addressable parts may help facilitate the rational formulation of diagnostics and targeted treatments.

A chemogenetic approach for dopamine imaging with tunable sensitivity

Genetically-encoded dopamine (DA) sensors enable high-resolution imaging of DA release, but their ability to detect a wide range of extracellular DA levels, especially tonic versus phasic DA release, is limited by their intrinsic affinity. Here we show that a human-selective dopamine receptor positive allosteric modulator (PAM) can be used to boost sensor affinity on-demand. The PAM enhances DA detection sensitivity across experimental preparations (in vitro, ex vivo and in vivo) via one-photon or two-photon imaging. In vivo photometry-based detection of optogenetically-evoked DA release revealed that DETQ administration produces a stable 31 minutes window of potentiation without effects on animal behavior. The use of the PAM revealed region-specific and metabolic state-dependent differences in tonic DA levels and enhanced single-trial detection of behavior-evoked phasic DA release in cortex and striatum. Our chemogenetic strategy can potently and flexibly tune DA imaging sensitivity and reveal multi-modal (tonic/phasic) DA signaling across preparations and imaging approaches.

Nucleus accumbens sub-regions experience distinct dopamine release responses following acute and chronic morphine exposure

It is well established that dopamine neurons of the ventral tegmental area (VTA) play a critical role in reward and aversion as well as pathologies including drug dependence and addiction. The distinct effects of acute and chronic opioid exposure have been previously characterized at VTA synapses. Recent work suggests that distinct VTA projections that target the medial and lateral shell of the nucleus accumbens (NAc), may play opposing roles in modulating behavior. It is possible that these two anatomically and functionally distinct pathways also have disparate roles in opioid reward, tolerance, and withdrawal in the brain. In this study we monitored dopamine release in the medial or lateral shell of the NAc of male mice during a week-long morphine treatment paradigm. We measured dopamine release in response to an intravenous morphine injection both acutely and following a week of repeated morphine. We also measured dopamine in response to a naloxone injection both prior to and following repeated morphine treatment. Morphine induced a transient increase in dopamine in the medial NAc shell that was much larger than the slower rise observed in the lateral shell. Surprisingly, chronic morphine treatment induced a sensitization of the medial dopamine response to morphine that opposed a diminished response observed in the saline-treated control group. This study expands on our current understanding of the medial NAc shell as hub of opioid-induced dopamine fluctuation. It also highlights the need for future opioid studies to appreciate the heterogeneity of dopamine neurons.

Significance Statement

The social and economic consequences of the opioid epidemic are tragic and far-reaching. Yet, opioids are indisputably necessary in clinical settings where they remain the most useful treatment for severe pain. To combat this crisis, we must improve our understanding of opioid function in the brain, particularly the neural mechanisms that underlie opioid dependence and addictive behaviors. This study uses fiber photometry to examine dopamine changes that occur in response to repeated morphine, and morphine withdrawal, at multiple stages of a longitudinal opioid-dependence paradigm. We reveal key differences in how dopamine levels respond to opioid administration in distinct sub-regions of the ventral striatum and lay a foundation for future opioid research that appreciates our contemporary understanding of the dopamine system.

Oral pre- and early postnatal cannabis exposure disinhibits ventral tegmental area dopamine neuron activity but does not influence cocaine preference in offspring in mice

Cannabis consumption has increased from 1.5% to 2.5% in Canada between 2012 and 2019. Clinical studies have indicated effects of prenatal cannabis exposure on birth weight, substance use, and neurodevelopmental disorders, but are confounded by several difficult to control variables. Animal models allow for examination of the mechanism of cannabis-induced changes in neurodevelopment and behavior, while controlling dose and timing. Several animal models of prenatal cannabis exposure exist which provide varying levels of construct validity, control of dose, and exposure to maternal stress. Using a voluntary oral consumption model, mouse dams received 5 mg/kg Δ9-tetrahydrocannabinol (THC) whole cannabis oil in peanut butter daily from gestational day 1 (GD1) to postnatal day 10 (PD10). At GD1, GD18, PD1, PD10, and PD15, maternal plasma was collected; pup brains were collected from GD18 onward. Pup brains had higher levels of THC and cannabidiol at each time point, each of which persisted in maternal plasma and pup brains past the end of treatment (PD15). Male and female adolescent offspring were examined for changes to ventral tegmental area (VTA) dopamine neuron activity and cocaine-seeking behavior. Prenatal and early postnatal (GD1-PD10) cannabis-exposed male, but not female mice had decreased gamma-aminobutyric acid (GABAergic) input, depolarized resting membrane potential, and increased spontaneous firing of VTA dopamine neurons. Cannabis-exposed offspring showed faster decay of N-methyl-D-aspartate (NMDA) currents in both sexes. However, no differences in cocaine-seeking behavior were noted. These data characterize a voluntary prenatal cannabis exposure model and demonstrates VTA dopamine neuronal activity is disinhibited in offspring.

Neurobiology and systems biology of stress resilience

Stress resilience is the phenomenon that some people maintain their mental health despite exposure to adversity or show only temporary impairments followed by quick recovery. Resilience research attempts to unravel the factors and mechanisms that make resilience possible and to harness its insights for the development of preventative interventions in individuals at risk for acquiring stress-related dysfunctions. Biological resilience research has been lagging behind the psychological and social sciences but has seen a massive surge in recent years. At the same time, progress in this field has been hampered by methodological challenges related to finding suitable operationalizations and study designs, replicating findings, and modeling resilience in animals. We embed a review of behavioral, neuroimaging, neurobiological, and systems biological findings in adults in a critical methods discussion. We find preliminary evidence that hippocampus-based pattern separation and prefrontal-based cognitive control functions protect against the development of pathological fears in the aftermath of singular, event-type stressors [as found in fear-related disorders, including simpler forms of posttraumatic stress disorder (PTSD)] by facilitating the perception of safety. Reward system-based pursuit and savoring of positive reinforcers appear to protect against the development of more generalized dysfunctions of the anxious-depressive spectrum resulting from more severe or longer-lasting stressors (as in depression, generalized or comorbid anxiety, or severe PTSD). Links between preserved functioning of these neural systems under stress and neuroplasticity, immunoregulation, gut microbiome composition, and integrity of the gut barrier and the blood-brain barrier are beginning to emerge. On this basis, avenues for biological interventions are pointed out.

Rethinking dopamine-guided action sequence learning

As opposed to those requiring a single action for reward acquisition, tasks necessitating action sequences demand that animals learn action elements and their sequential order and sustain the behaviour until the sequence is completed. With repeated learning, animals not only exhibit precise execution of these sequences but also demonstrate enhanced smoothness and efficiency. Previous research has demonstrated that midbrain dopamine and its major projection target, the striatum, play crucial roles in these processes. Recent studies have shown that dopamine from the substantia nigra pars compacta (SNc) and the ventral tegmental area (VTA) serve distinct functions in action sequence learning. The distinct contributions of dopamine also depend on the striatal subregions, namely the ventral, dorsomedial and dorsolateral striatum. Here, we have reviewed recent findings on the role of striatal dopamine in action sequence learning, with a focus on recent rodent studies.

Oxytocin receptor function regulates neural signatures of pair bonding and fidelity in the nucleus accumbens

The formation of enduring relationships dramatically influences future behavior, promoting affiliation between familiar individuals. How such attachments are encoded to elicit and reinforce specific social behaviors in distinct ethological contexts remains unknown. Signaling via the oxytocin receptor (Oxtr) in the nucleus accumbens (NAc) facilitates social reward as well as pair bond formation between mates in socially monogamous prairie voles 1-9 . How Oxtr function influences activity in the NAc during pair bonding to promote affiliative behavior with partners and rejection of other potential mates has not been determined. Using longitudinal in vivo fiber photometry in wild-type prairie voles and those lacking Oxtr, we demonstrate that Oxtr function sex-specifically regulates pair bonding behaviors and associated activity in the NAc. Oxtr function influences prosocial behavior in females in a state-dependent manner. Females lacking Oxtr demonstrate reduced prosocial behaviors and lower activity in the NAc during initial chemosensory investigation of novel males. Upon pair bonding, affiliative behavior with partners and neural activity in the NAc during these interactions increase, but these changes do not require Oxtr function. Conversely, males lacking Oxtr display increased prosocial investigation of novel females. Using the altered patterns of behavior and activity in the NAc of males lacking Oxtr during their first interactions with a female, we can predict their future preference for a partner or stranger days later. These results demonstrate that Oxtr function sex-specifically influences the early development of pair bonds by modulating prosociality and the neural processing of sensory cues and social interactions with novel individuals, unmasking underlying sex differences in the neural pathways regulating the formation of long-term relationships.

Ventral tegmental area interneurons revisited: GABA and glutamate projection neurons make local synapses

The ventral tegmental area (VTA) contains projection neurons that release the neurotransmitters dopamine, GABA, and/or glutamate from distal synapses. VTA also contains GABA neurons that synapse locally on to VTA dopamine neurons, synapses widely credited to a population of so-called VTA interneurons. Interneurons in cortex, striatum, and elsewhere have well-defined morphological features, physiological properties, and molecular markers, but such features have not been clearly described in VTA. Indeed, there is scant evidence that local and distal synapses originate from separate populations of VTA GABA neurons. In this study we tested whether several markers expressed in non-dopamine VTA neurons are selective markers of interneurons, defined as neurons that synapse locally but not distally. Challenging previous assumptions, we found that VTA neurons genetically defined by expression of parvalbumin, somatostatin, neurotensin, or mu-opioid receptor project to known VTA targets including nucleus accumbens, ventral pallidum, lateral habenula, and prefrontal cortex. Moreover, we provide evidence that VTA GABA and glutamate projection neurons make functional inhibitory or excitatory synapses locally within VTA. These findings suggest that local collaterals of VTA projection neurons could mediate functions prior attributed to VTA interneurons. This study underscores the need for a refined understanding of VTA connectivity to explain how heterogeneous VTA circuits mediate diverse functions related to reward, motivation, or addiction.

Distinct µ-opioid ensembles trigger positive and negative fentanyl reinforcement

Fentanyl is a powerful painkiller that elicits euphoria and positive reinforcement1. Fentanyl also leads to dependence, defined by the aversive withdrawal syndrome, which fuels negative reinforcement2,3 (that is, individuals retake the drug to avoid withdrawal). Positive and negative reinforcement maintain opioid consumption, which leads to addiction in one-fourth of users, the largest fraction for all addictive drugs4. Among the opioid receptors, µ-opioid receptors have a key role5, yet the induction loci of circuit adaptations that eventually lead to addiction remain unknown. Here we injected mice with fentanyl to acutely inhibit γ-aminobutyric acid-expressing neurons in the ventral tegmental area (VTA), causing disinhibition of dopamine neurons, which eventually increased dopamine in the nucleus accumbens. Knockdown of µ-opioid receptors in VTA abolished dopamine transients and positive reinforcement, but withdrawal remained unchanged. We identified neurons expressing µ-opioid receptors in the central amygdala (CeA) whose activity was enhanced during withdrawal. Knockdown of µ-opioid receptors in CeA eliminated aversive symptoms, suggesting that they mediate negative reinforcement. Thus, optogenetic stimulation caused place aversion, and mice readily learned to press a lever to pause optogenetic stimulation of CeA neurons that express µ-opioid receptors. Our study parses the neuronal populations that trigger positive and negative reinforcement in VTA and CeA, respectively. We lay out the circuit organization to develop interventions for reducing fentanyl addiction and facilitating rehabilitation.

Molecular and circuit determinants in the globus pallidus mediating control of cocaine-induced behavioral plasticity

The globus pallidus externus (GPe) is a central component of the basal ganglia circuit, receiving strong input from the indirect pathway and regulating a variety of functions, including locomotor output and habit formation. We recently showed that it also acts as a gatekeeper of cocaine-induced behavioral plasticity, as inhibition of parvalbumin-positive cells in the GPe (GPe PV ) prevents the development of cocaine-induced reward and sensitization. However, the molecular and circuit mechanisms underlying this function are unknown. Here we show that GPe PV cells control cocaine reward and sensitization by inhibiting GABAergic neurons in the substantia nigra pars reticulata (SNr GABA ), and ultimately, selectively modulating the activity of ventral tegmental area dopamine (VTA DA ) cells projecting to the lateral shell of the nucleus accumbens (NAcLat). A major input to GPe PV cells is the indirect pathway of the dorsomedial striatum (DMS D 2 ), which receives DAergic innervation from collaterals of VTA DA →NAcLat cells, making this a closed-loop circuit. Cocaine likely facilitates reward and sensitization not directly through actions in the GPe, but rather in the upstream DMS, where the cocaine-induced elevation of DA triggers a depression in DMS D 2 cell activity. This cocaine-induced elevation in DA levels can be blocked by inhibition of GPe PV cells, closing the loop. Interestingly, the level of GPe PV cell activity prior to cocaine administration is correlated with the extent of reward and sensitization that animals experience in response to future administration of cocaine, indicating that GPe PV cell activity is a key predictor of future behavioral responses to cocaine. Single nucleus RNA-sequencing of GPe cells indicated that genes encoding voltage-gated potassium channels KCNQ3 and KCNQ5 that control intrinsic cellular excitability are downregulated in GPe PV cells following a single cocaine exposure, contributing to the elevation in GPe PV cell excitability. Acutely activating channels containing KCNQ3 and/or KCNQ5 using the small molecule carnosic acid, a key psychoactive component of Salvia rosmarinus (rosemary) extract, reduced GPe PV cell excitability and also impaired cocaine reward, sensitization, and volitional cocaine intake, indicating its potential as a therapeutic to counteract psychostimulant use disorder. Our findings illuminate the molecular and circuit mechanisms by which the GPe orchestrates brain-wide changes in response to cocaine that are required for reward, sensitization, and self-administration behaviors.

Ventral pallidum GABA and glutamate neurons drive approach and avoidance through distinct modulation of VTA cell types

The ventral pallidum (VP) contains GABA and glutamate neurons projecting to ventral tegmental area (VTA) whose stimulation drives approach and avoidance, respectively. Yet little is known about the mechanisms by which VP cell types shape VTA activity and drive behavior. Here, we found that both VP GABA and glutamate neurons were activated during approach to reward or by delivery of an aversive stimulus. Stimulation of VP GABA neurons inhibited VTA GABA, but activated dopamine and glutamate neurons. Remarkably, stimulation-evoked activation was behavior-contingent such that VTA recruitment was inhibited when evoked by the subject's own action. Conversely, VP glutamate neurons activated VTA GABA, as well as dopamine and glutamate neurons, despite driving aversion. However, VP glutamate neurons evoked dopamine in aversion-associated ventromedial nucleus accumbens (NAc), but reduced dopamine release in reward-associated dorsomedial NAc. These findings show how heterogeneous VP projections to VTA can be engaged to shape approach and avoidance behaviors.

Valence ambiguity dynamically shapes striatal dopamine heterogeneity

Adaptive decision making relies on dynamic updating of learned associations where environmental cues come to predict positive and negatively valenced stimuli, such as food or threat. Flexible cue-guided behaviors depend on a network of brain systems, including dopamine signaling in the striatum, which is critical for learning and maintenance of conditioned behaviors. Critically, it remains unclear how dopamine signaling encodes multi-valent, dynamic learning contexts, where positive and negative associations must be rapidly disambiguated. To understand this, we employed a Pavlovian discrimination paradigm, where cues predicting positive and negative outcomes were intermingled during conditioning sessions, and their meaning was serially reversed across training. We found that rats readily distinguished these cues, and updated their behavior rapidly upon valence reversal. Using fiber photometry, we recorded dopamine signaling in three major striatal subregions -,the dorsolateral striatum (DLS), the nucleus accumbens core, and the nucleus accumbens medial shell - and found heterogeneous responses to positive and negative conditioned cues and their predicted outcomes. Valence ambiguity introduced by cue reversal reshaped striatal dopamine on different timelines: nucleus accumbens core and shell signals updated more readily than those in the DLS. Together, these results suggest that striatal dopamine flexibly encodes multi-valent learning contexts, and these signals are dynamically modulated by changing contingencies to resolve ambiguity about the meaning of environmental cues.

Functional diversity of dopamine axons in prefrontal cortex during classical conditioning

Midbrain dopamine neurons impact neural processing in the prefrontal cortex (PFC) through mesocortical projections. However, the signals conveyed by dopamine projections to the PFC remain unclear, particularly at the single-axon level. Here, we investigated dopaminergic axonal activity in the medial PFC (mPFC) during reward and aversive processing. By optimizing microprism-mediated two-photon calcium imaging of dopamine axon terminals, we found diverse activity in dopamine axons responsive to both reward and aversive stimuli. Some axons exhibited a preference for reward, while others favored aversive stimuli, and there was a strong bias for the latter at the population level. Long-term longitudinal imaging revealed that the preference was maintained in reward- and aversive-preferring axons throughout classical conditioning in which rewarding and aversive stimuli were paired with preceding auditory cues. However, as mice learned to discriminate reward or aversive cues, a cue activity preference gradually developed only in aversive-preferring axons. We inferred the trial-by-trial cue discrimination based on machine learning using anticipatory licking or facial expressions, and found that successful discrimination was accompanied by sharper selectivity for the aversive cue in aversive-preferring axons. Our findings indicate that a group of mesocortical dopamine axons encodes aversive-related signals, which are modulated by both classical conditioning across days and trial-by-trial discrimination within a day.

A dopamine mechanism for reward maximization

Individual survival and evolutionary selection require biological organisms to maximize reward. Economic choice theories define the necessary and sufficient conditions, and neuronal signals of decision variables provide mechanistic explanations. Reinforcement learning (RL) formalisms use predictions, actions, and policies to maximize reward. Midbrain dopamine neurons code reward prediction errors (RPE) of subjective reward value suitable for RL. Electrical and optogenetic self-stimulation experiments demonstrate that monkeys and rodents repeat behaviors that result in dopamine excitation. Dopamine excitations reflect positive RPEs that increase reward predictions via RL; against increasing predictions, obtaining similar dopamine RPE signals again requires better rewards than before. The positive RPEs drive predictions higher again and thus advance a recursive reward-RPE-prediction iteration toward better and better rewards. Agents also avoid dopamine inhibitions that lower reward prediction via RL, which allows smaller rewards than before to elicit positive dopamine RPE signals and resume the iteration toward better rewards. In this way, dopamine RPE signals serve a causal mechanism that attracts agents via RL to the best rewards. The mechanism improves daily life and benefits evolutionary selection but may also induce restlessness and greed.

The basal forebrain to lateral habenula circuitry mediates social behavioral maladaptation

Elucidating the neural basis of fear allows for more effective treatments for maladaptive fear often observed in psychiatric disorders. Although the basal forebrain (BF) has an essential role in fear learning, its function in fear expression and the underlying neuronal and circuit substrates are much less understood. Here we report that BF glutamatergic neurons are robustly activated by social stimulus following social fear conditioning in male mice. And cell-type-specific inhibition of those excitatory neurons largely reduces social fear expression. At the circuit level, BF glutamatergic neurons make functional contacts with the lateral habenula (LHb) neurons and these connections are potentiated in conditioned mice. Moreover, optogenetic inhibition of BF-LHb glutamatergic pathway significantly reduces social fear responses. These data unravel an important function of the BF in fear expression via its glutamatergic projection onto the LHb, and suggest that selective targeting BF-LHb excitatory circuitry could alleviate maladaptive fear in relevant disorders.

Roles of feedback and feed-forward networks of dopamine subsystems: insights from Drosophila studies

Across animal species, dopamine-operated memory systems comprise anatomically segregated, functionally diverse subsystems. Although individual subsystems could operate independently to support distinct types of memory, the logical interplay between subsystems is expected to enable more complex memory processing by allowing existing memory to influence future learning. Recent comprehensive ultrastructural analysis of the Drosophila mushroom body revealed intricate networks interconnecting the dopamine subsystems-the mushroom body compartments. Here, we review the functions of some of these connections that are beginning to be understood. Memory consolidation is mediated by two different forms of network: A recurrent feedback loop within a compartment maintains sustained dopamine activity required for consolidation, whereas feed-forward connections across compartments allow short-term memory formation in one compartment to open the gate for long-term memory formation in another compartment. Extinction and reversal of aversive memory rely on a similar feed-forward circuit motif that signals omission of punishment as a reward, which triggers plasticity that counteracts the original aversive memory trace. Finally, indirect feed-forward connections from a long-term memory compartment to short-term memory compartments mediate higher-order conditioning. Collectively, these emerging studies indicate that feedback control and hierarchical connectivity allow the dopamine subsystems to work cooperatively to support diverse and complex forms of learning.

Distributional coding of associative learning in discrete populations of midbrain dopamine neurons

Midbrain dopamine neurons are thought to play key roles in learning by conveying the difference between expected and actual outcomes. Recent evidence suggests diversity in dopamine signaling, yet it remains poorly understood how heterogeneous signals might be organized to facilitate the role of downstream circuits mediating distinct aspects of behavior. Here, we investigated the organizational logic of dopaminergic signaling by recording and labeling individual midbrain dopamine neurons during associative behavior. Our findings show that reward information and behavioral parameters are not only heterogeneously encoded but also differentially distributed across populations of dopamine neurons. Retrograde tracing and fiber photometry suggest that populations of dopamine neurons projecting to different striatal regions convey distinct signals. These data, supported by computational modeling, indicate that such distributional coding can maximize dynamic range and tailor dopamine signals to facilitate specialized roles of different striatal regions.

Phytomedicine Fructus Aurantii-derived two absorbed compounds unlock antidepressant and prokinetic multi-functions via modulating 5-HT3/GHSR

ETHNOPHARMACOLOGICAL RELEVANCE

Fructus Aurantii (FA), a well-known phytomedicine, has been employed to evoke antidepressant and prokinetic multi-functions. Therein, systematically identifying bioactive components and the referred mechanism is essential for FA.

AIM OF THE STUDY

This study was planned to answer "2 W" (What and Why), such as which components and pathways contribute to FA's multi-functions. We aimed to identify bioactive compounds as the key for opening the lock of FA's multi-functions, and the molecule mechanisms are their naturally matched lock cylinder.

MATERIALS AND METHODS

The phytochemical content of FA extract was determined, and the compounds were identified in rats pretreated with FA using liquid chromatography with mass spectrometry (LC-MS). The contribution strategy was used to assess bioactive compounds' efficacy (doses = their content in FA) in model rats with the mechanism. The changes in functional brain regions were determined via 7.0 T functional magnetic resonance imaging-blood oxygen level-dependent (fMRI-BOLD).

RESULT

Eight phytochemicals' content was detected, and merely six components were identified in rats in vivo. Meranzin hydrate + hesperidin (MH), as the primary contributor of FA, exerted antidepressant and prokinetic effects (improvement of indexes for immobility time, gastric emptying, intestinal transit, CRH, ghrelin, ACTH, DA, NA, 5-HT, CORT, and 5-HT3) by regulating 5-HT3/Growth hormone secretagogue receptor (GHSR) pathway. These results were validated by 5-HT2A, 5-HT3, and GHSR receptor antagonists combined with molecule docking. MH restored the excessive BOLD activation of the left accumbens nucleus, left corpus callosum and hypothalamus preoptic region.

CONCLUSION

Absorbed MH accounts for FA's anti-depressant and prokinetic efficacy in acutely-stressed rats, primarily via 5-HT3/GHSR shared regulation.

Brain state-dependent responses of midbrain dopaminergic neurons to footshock under urethane anaesthesia

For a long time, it has been assumed that dopaminergic (DA) neurons in both the ventral tegmental area (VTA) and the substantia nigra pars compacta (SNc) uniformly respond to rewarding and aversive stimuli by either increasing or decreasing their activity, respectively. This response was believed to signal information about the perceived stimuli's values. The identification of VTA&SNc DA neurons that are excited by both rewarding and aversive stimuli has led to the categorisation of VTA&SNc DA neurons into two subpopulations: one signalling the value and the other signalling the salience of the stimuli. It has been shown that the general state of the brain can modulate the electrical activity of VTA&SNc DA neurons, but it remains unknown whether this factor may also influence responses to aversive stimuli, such as a footshock (FS). To address this question, we have recorded the responses of VTA&SNc DA neurons to FSs across cortical activation and slow wave activity brain states in urethane-anaesthetised rats. Adding to the knowledge of aversion signalling by midbrain DA neurons, we report that significant proportion of VTA&SNc DA neurons can change their responses to an aversive stimulus in a brain state-dependent manner. The majority of these neurons decreased their activity in response to FS during cortical activation but switched to increasing it during slow wave activity. It can be hypothesised that this subpopulation of DA neurons may be involved in the 'dual signalling' of both the value and the salience of the stimuli, depending on the general state of the brain.

Dopamine neurons drive spatiotemporally heterogeneous striatal dopamine signals during learning

Environmental cues, through Pavlovian learning, become conditioned stimuli that invigorate and guide animals toward acquisition of rewards. Dopamine neurons in the ventral tegmental area (VTA) and substantia nigra (SNC) are crucial for this process. Dopamine neurons are embedded in a reciprocally connected network with their striatal targets, the functional organization of which remains poorly understood. Here, we investigated how learning during optogenetic Pavlovian cue conditioning of VTA or SNC dopamine neurons directs cue-evoked behavior and shapes subregion-specific striatal dopamine dynamics. We used a fluorescent dopamine biosensor to monitor dopamine in the nucleus accumbens (NAc) core and shell, dorsomedial striatum (DMS), and dorsolateral striatum (DLS). We demonstrate spatially heterogeneous, learning-dependent dopamine changes across striatal regions. While VTA stimulation evoked robust dopamine release in NAc core, shell, and DMS, cues predictive of this activation preferentially recruited dopamine release in NAc core, starting early in training, and DMS, late in training. Corresponding negative prediction error signals, reflecting a violation in the expectation of dopamine neuron activation, only emerged in the NAc core and DMS, and not the shell. Despite development of vigorous movement late in training, conditioned dopamine signals did not similarly emerge in the DLS, even during Pavlovian conditioning with SNC dopamine neuron activation, which elicited robust DLS dopamine release. Together, our studies show broad dissociation in the fundamental prediction and reward-related information generated by different dopamine neuron populations and signaled by dopamine across the striatum. Further, they offer new insight into how larger-scale plasticity across the striatal network emerges during Pavlovian learning to coordinate behavior.

Treadmill exercise pretreatment ameliorated structural synaptic plasticity impairments of medial prefrontal cortex in vascular dementia rat and improved recognition memory

This study aimed to investigate structural synaptic plasticity in the medial prefrontal cortex of rats under treadmill exercise pretreatment or naive conditions in a vascular dementia model, followed by recognition memory performance in a novel object recognition task. In this study, 24 Sprague-Dawley rats were obtained and randomly assigned into 4 groups as follows: control group (Con group, n = 6), vascular dementia (VD group, n = 6), exercise and vascular dementia group (Exe + VD group, n = 6), and exercise group (Exe group, n = 6). Initially, 4 weeks of treadmill exercise intervention was administered to the rats in the Exe + VD and Exe groups. Then, to establish the vascular dementia model, the rats both in the VD and Exe + VD groups were subjected to bilateral common carotids arteries surgery. One week later, open-field task and novel recognition memory task were adopted to evaluate anxiety-like behavior and recognition memory in each group. Then, immunofluorescence and Golgi staining were used to evaluate neuronal number and spine density in the rat medial prefrontal cortex. Transmission electron microscopy was used to observe the synaptic ultrastructure. Finally, microdialysis coupled with high-performance liquid chromatography was used to assess the levels of 5-HT and dopamine in the medial prefrontal cortex. The behavior results showed that 4 weeks of treadmill exercise pretreatment significantly alleviated recognition memory impairment and anxiety-like behavior in VD rats (P < 0.01), while the rats in VD group exhibited impaired recognition memory and anxiety-like behavior when compared with the Con group (P < 0.001). Additionally, NeuN immunostaining results revealed a significant decrease of NeuN-marked neuron in the VD group compared to Con group (P < 0.01), but a significantly increase in this molecular marker was found in the Exe + VD group compared to the Con group (P < 0.01). Golgi staining results showed that the medial prefrontal cortex neurons in the VD group displayed fewer dendritic spines than those in the Con group (P < 0.01), and there were more spines on the dendrites of medial prefrontal cortex cells in Exe + VD rats than in VD rats (P < 0.01). Transmission electron microscopy further revealed that there was a significant reduction of synapses intensity in the medial prefrontal cortex of rats in the VD group when compared with the Con group(P < 0.01), but physical exercise was found to significantly increased synapses intensity in the VD model (P < 0.01). Lastly, the levels of dopamine and 5-HT in the medial prefrontal cortex of rats in the VD group was significantly lower compared to the Con group (P < 0.01), and treadmill exercise was shown to significantly increased the levels of dopamine and 5-HT in the VD rats (P < 0.05). Treadmill exercise pretreatment ameliorated structural synaptic plasticity impairments of medial prefrontal cortex in VD rat and improved recognition memory.

Glutamate inputs send prediction error of reward, but not negative value of aversive stimuli, to dopamine neurons

Midbrain dopamine neurons are thought to signal reward prediction errors (RPEs), but the mechanisms underlying RPE computation, particularly the contributions of different neurotransmitters, remain poorly understood. Here, we used a genetically encoded glutamate sensor to examine the pattern of glutamate inputs to dopamine neurons in mice. We found that glutamate inputs exhibit virtually all of the characteristics of RPE rather than conveying a specific component of RPE computation, such as reward or expectation. Notably, whereas glutamate inputs were transiently inhibited by reward omission, they were excited by aversive stimuli. Opioid analgesics altered dopamine negative responses to aversive stimuli into more positive responses, whereas excitatory responses of glutamate inputs remained unchanged. Our findings uncover previously unknown synaptic mechanisms underlying RPE computations; dopamine responses are shaped by both synergistic and competitive interactions between glutamatergic and GABAergic inputs to dopamine neurons depending on valences, with competitive interactions playing a role in responses to aversive stimuli.

Neuromodulator regulation and emotions: insights from the crosstalk of cell signaling

The unraveling of the regulatory mechanisms that govern neuronal excitability is a major challenge for neuroscientists worldwide. Neurotransmitters play a critical role in maintaining the balance between excitatory and inhibitory activity in the brain. The balance controls cognitive functions and emotional responses. Glutamate and γ-aminobutyric acid (GABA) are the primary excitatory and inhibitory neurotransmitters of the brain, respectively. Disruptions in the balance between excitatory and inhibitory transmission are implicated in several psychiatric disorders, including anxiety disorders, depression, and schizophrenia. Neuromodulators such as dopamine and acetylcholine control cognition and emotion by regulating the excitatory/inhibitory balance initiated by glutamate and GABA. Dopamine is closely associated with reward-related behaviors, while acetylcholine plays a role in aversive and attentional behaviors. Although the physiological roles of neuromodulators have been extensively studied neuroanatomically and electrophysiologically, few researchers have explored the interplay between neuronal excitability and cell signaling and the resulting impact on emotion regulation. This review provides an in-depth understanding of "cell signaling crosstalk" in the context of neuronal excitability and emotion regulation. It also anticipates that the next generation of neurochemical analyses, facilitated by integrated phosphorylation studies, will shed more light on this topic.

Lights, fiber, action! A primer on in vivo fiber photometry

Fiber photometry is a key technique for characterizing brain-behavior relationships in vivo. Initially, it was primarily used to report calcium dynamics as a proxy for neural activity via genetically encoded indicators. This generated new insights into brain functions including movement, memory, and motivation at the level of defined circuits and cell types. Recently, the opportunity for discovery with fiber photometry has exploded with the development of an extensive range of fluorescent sensors for biomolecules including neuromodulators and peptides that were previously inaccessible in vivo. This critical advance, combined with the new availability of affordable "plug-and-play" recording systems, has made monitoring molecules with high spatiotemporal precision during behavior highly accessible. However, while opening exciting new avenues for research, the rapid expansion in fiber photometry applications has occurred without coordination or consensus on best practices. Here, we provide a comprehensive guide to help end-users execute, analyze, and suitably interpret fiber photometry studies.

D1 and D2 medium spiny neurons in the nucleus accumbens core have distinct and valence-independent roles in learning

At the core of value-based learning is the nucleus accumbens (NAc). D1- and D2-receptor-containing medium spiny neurons (MSNs) in the NAc core are hypothesized to have opposing valence-based roles in behavior. Using optical imaging and manipulation approaches in mice, we show that neither D1 nor D2 MSNs signal valence. D1 MSN responses were evoked by stimuli regardless of valence or contingency. D2 MSNs were evoked by both cues and outcomes, were dynamically changed with learning, and tracked valence-free prediction error at the population and individual neuron level. Finally, D2 MSN responses to cues were necessary for associative learning. Thus, D1 and D2 MSNs work in tandem, rather than in opposition, by signaling specific properties of stimuli to control learning.

Functional Diversity of Dopamine Axons in Prefrontal Cortex During Classical Conditioning

Midbrain dopamine neurons impact neural processing in the prefrontal cortex (PFC) through mesocortical projections. However, the signals conveyed by dopamine projections to the PFC remain unclear, particularly at the single-axon level. Here, we investigated dopaminergic axonal activity in the medial PFC (mPFC) during reward and aversive processing. By optimizing microprism-mediated two-photon calcium imaging of dopamine axon terminals, we found diverse activity in dopamine axons responsive to both reward and aversive stimuli. Some axons exhibited a preference for reward, while others favored aversive stimuli, and there was a strong bias for the latter at the population level. Long-term longitudinal imaging revealed that the preference was maintained in reward- and aversive-preferring axons throughout classical conditioning in which rewarding and aversive stimuli were paired with preceding auditory cues. However, as mice learned to discriminate reward or aversive cues, a cue activity preference gradually developed only in aversive-preferring axons. We inferred the trial-by-trial cue discrimination based on machine learning using anticipatory licking or facial expressions, and found that successful discrimination was accompanied by sharper selectivity for the aversive cue in aversive-preferring axons. Our findings indicate that a group of mesocortical dopamine axons encodes aversive-related signals, which are modulated by both classical conditioning across days and trial-by-trial discrimination within a day.

Nucleus accumbens neurons dynamically respond to appetitive and aversive associative learning

To survive, individuals must learn to associate cues in the environment with emotionally relevant outcomes. This association is partially mediated by the nucleus accumbens (NAc), a key brain region of the reward circuit that is mainly composed by GABAergic medium spiny neurons (MSNs), that express either dopamine receptor D1 or D2. Recent studies showed that both populations can drive reward and aversion, however, the activity of these neurons during appetitive and aversive Pavlovian conditioning remains to be determined. Here, we investigated the relevance of D1- and D2-neurons in associative learning, by measuring calcium transients with fiber photometry during appetitive and aversive Pavlovian tasks in mice. Sucrose was used as a positive valence unconditioned stimulus (US) and foot shock was used as a negative valence US. We show that during appetitive Pavlovian conditioning, D1- and D2-neurons exhibit a general increase in activity in response to the conditioned stimuli (CS). Interestingly, D1- and D2-neurons present distinct changes in activity after sucrose consumption that dynamically evolve throughout learning. During the aversive Pavlovian conditioning, D1- and D2-neurons present an increase in the activity in response to the CS and to the US (shock). Our data support a model in which D1- and D2-neurons are concurrently activated during appetitive and aversive conditioning.

Optogenetic action potentials and intrinsic pacemaker interplay in retrogradely identified midbrain dopamine neurons

Dissecting the diversity of midbrain dopamine (DA) neurons by optotagging is a promising addition to better identify their functional properties and contribution to motivated behavior. Retrograde molecular targeting of DA neurons with specific axonal projection allows further refinement of this approach. Here, we focus on adult mouse DA neurons in the substantia nigra pars compacta (SNc) projecting to dorsal striatum (DS) by demonstrating the selectivity of a floxed AAV9-based retrograde channelrhodopsin-eYFP (ChR-eYFP) labeling approach in DAT-cre mice. Furthermore, we show the utility of a sparse labeling version for anatomical single-cell reconstruction and demonstrate that ChR-eYFR expressing DA neurons retain intrinsic functional properties indistinguishable from conventionally retrogradely red-beads-labeled neurons. We systematically explore the properties of optogenetically evoked action potentials (oAPs) and their interaction with intrinsic pacemaking in this defined subpopulation of DA neurons. We found that the shape of the oAP and its first derivative, as a proxy for extracellularly recorded APs, is highly distinct from spontaneous APs (sAPs) of the same neurons and systematically varies across the pacemaker duty cycle. The timing of the oAP also affects the backbone oscillator of the intrinsic pacemaker by introducing transient "compensatory pauses". Characterizing this systematic interplay between oAPs and sAPs in defined DA neurons will also facilitate a refinement of DA neuron optotagging in vivo.

65 years of research on dopamine's role in classical fear conditioning and extinction: A systematic review

Dopamine, a catecholamine neurotransmitter, has historically been associated with the encoding of reward, whereas its role in aversion has received less attention. Here, we systematically gathered the vast evidence of the role of dopamine in the simplest forms of aversive learning: classical fear conditioning and extinction. In the past, crude methods were used to augment or inhibit dopamine to study its relationship with fear conditioning and extinction. More advanced techniques such as conditional genetic, chemogenic and optogenetic approaches now provide causal evidence for dopamine's role in these learning processes. Dopamine neurons encode conditioned stimuli during fear conditioning and extinction and convey the signal via activation of D1-4 receptor sites particularly in the amygdala, prefrontal cortex and striatum. The coordinated activation of dopamine receptors allows for the continuous formation, consolidation, retrieval and updating of fear and extinction memory in a dynamic and reciprocal manner. Based on the reviewed literature, we conclude that dopamine is crucial for the encoding of classical fear conditioning and extinction and contributes in a way that is comparable to its role in encoding reward.

Mesoaccumbal glutamate neurons drive reward via glutamate release but aversion via dopamine co-release

Ventral tegmental area (VTA) projections to the nucleus accumbens (NAc) drive reward-related motivation. Although dopamine neurons are predominant, a substantial glutamatergic projection is also present, and a subset of these co-release both dopamine and glutamate. Optogenetic stimulation of VTA glutamate neurons not only supports self-stimulation but can also induce avoidance behavior, even in the same assay. Here, we parsed the selective contribution of glutamate or dopamine co-release from VTA glutamate neurons to reinforcement and avoidance. We expressed channelrhodopsin-2 (ChR2) in mouse VTA glutamate neurons in combination with CRISPR-Cas9 to disrupt either the gene encoding vesicular glutamate transporter 2 (VGLUT2) or tyrosine hydroxylase (Th). Selective disruption of VGLUT2 abolished optogenetic self-stimulation but left real-time place avoidance intact, whereas CRISPR-Cas9 deletion of Th preserved self-stimulation but abolished place avoidance. Our results demonstrate that glutamate release from VTA glutamate neurons is positively reinforcing but that dopamine release from VTA glutamate neurons can induce avoidance behavior.

The role of prospective contingency in the control of behavior and dopamine signals during associative learning

Associative learning depends on contingency, the degree to which a stimulus predicts an outcome. Despite its importance, the neural mechanisms linking contingency to behavior remain elusive. Here we examined the dopamine activity in the ventral striatum - a signal implicated in associative learning - in a Pavlovian contingency degradation task in mice. We show that both anticipatory licking and dopamine responses to a conditioned stimulus decreased when additional rewards were delivered uncued, but remained unchanged if additional rewards were cued. These results conflict with contingency-based accounts using a traditional definition of contingency or a novel causal learning model (ANCCR), but can be explained by temporal difference (TD) learning models equipped with an appropriate inter-trial-interval (ITI) state representation. Recurrent neural networks trained within a TD framework develop state representations like our best 'handcrafted' model. Our findings suggest that the TD error can be a measure that describes both contingency and dopaminergic activity.

State and rate-of-change encoding in parallel mesoaccumbal dopamine pathways

The nervous system uses fast- and slow-adapting sensory detectors in parallel to enable neuronal representations of external states and their temporal dynamics. It is unknown whether this dichotomy also applies to internal representations that have no direct correlation in the physical world. Here we find that two distinct dopamine (DA) neuron subtypes encode either a state or its rate-of-change. In mice performing a reward-seeking task, we found that the animal's behavioral state and rate-of-change were encoded by the sustained activity of DA neurons in medial ventral tegmental area (VTA) DA neurons and transient activity in lateral VTA DA neurons, respectively. The neural activity patterns of VTA DA cell bodies matched DA release patterns within anatomically defined mesoaccumbal pathways. Based on these results, we propose a model in which the DA system uses two parallel lines for proportional-differential encoding of a state variable and its temporal dynamics.

An Ascending Excitatory Circuit from the Dorsal Raphe for Sensory Modulation of Pain

The dorsal raphe nucleus (DRN) is an important nucleus in pain regulation. However, the underlying neural pathway and the function of specific cell types remain unclear. Here, we report a previously unrecognized ascending facilitation pathway, the DRN to the mesoaccumbal dopamine (DA) circuit, for regulating pain. Chronic pain increased the activity of DRN glutamatergic, but not serotonergic, neurons projecting to the ventral tegmental area (VTA) (DRNGlu-VTA) in male mice. The optogenetic activation of DRNGlu-VTA circuit induced a pain-like response in naive male mice, and its inhibition produced an analgesic effect in male mice with neuropathic pain. Furthermore, we discovered that DRN ascending pathway regulated pain through strengthened excitatory transmission onto the VTA DA neurons projecting to the ventral part of nucleus accumbens medial shell (vNAcMed), thereby activated the mesoaccumbal DA neurons. Correspondingly, optogenetic manipulation of this three-node pathway bilaterally regulated pain behaviors. These findings identified a DRN ascending excitatory pathway that is crucial for pain sensory processing, which can potentially be exploited toward targeting pain disorders.

Neurobiology of Pathogen Avoidance and Mate Choice: Current and Future Directions

Animals are under constant threat of parasitic infection. This has influenced the evolution of social behaviour and has strong implications for sexual selection and mate choice. Animals assess the infection status of conspecifics based on various sensory cues, with odours/chemical signals and the olfactory system playing a particularly important role. The detection of chemical cues and subsequent processing of the infection threat that they pose facilitates the expression of disgust, fear, anxiety, and adaptive avoidance behaviours. In this selective review, drawing primarily from rodent studies, the neurobiological mechanisms underlying the detection and assessment of infection status and their relations to mate choice are briefly considered. Firstly, we offer a brief overview of the aspects of mate choice that are relevant to pathogen avoidance. Then, we specifically focus on the olfactory detection of and responses to conspecific cues of parasitic infection, followed by a brief overview of the neurobiological systems underlying the elicitation of disgust and the expression of avoidance of the pathogen threat. Throughout, we focus on current findings and provide suggestions for future directions and research.

Amygdalo-nigral inputs target dopaminergic and GABAergic neurons in the primate: a view from dendrites and soma

The central nucleus (CeN) of the amygdala is an important afferent to the DA system that mediates motivated learning. We previously found that CeN terminals in nonhuman primates primarily overlap the elongated lateral VTA (parabrachial pigmented nucleus, PBP, A10), and retrorubral field(A8) subregion. Here, we examined CeN afferent contacts on cell somata and proximal dendrites of DA and GABA neurons, and distal dendrites of each, using confocal and electron microscopy (EM) methods, respectively. At the soma/proximal dendrites, the proportion of TH+ and GAD1+ cells receiving at least one CeN afferent contact was surprisingly similar (TH = 0.55: GAD1=0.55 in PBP; TH = 0.56; GAD1 =0.51 in A8), with the vast majority of contacted TH+ and GAD1+ soma/proximal dendrites received 1-2 contacts. Similar numbers of tracer-labeled terminals also contacted TH-positive and GAD1-positive small dendrites and/or spines (39% of all contacted dendrites were either TH- or GAD1-labeled). Overall, axon terminals had more symmetric (putative inhibitory) axonal contacts with no difference in the relative distribution in the PBP versus A8, or onto TH+ versus GAD1+ dendrites/spines in either region. The striking uniformity in the amygdalonigral projection across the PBP-A8 terminal field suggests that neither neurotransmitter phenotype nor midbrain location dictates likelihood of a terminal contact. We discuss how this afferent uniformity can play out in recently discovered differences in DA:GABA cell densities between the PBP and A8, and affect specific outputs.

Significance statement

The amygdala's central nucleus (CeN) channels salient cues to influence both appetitive and aversive responses via DA outputs. In higher species, the broad CeN terminal field overlaps the parabrachial pigmented nucleus ('lateral A10') and the retrorubral field (A8). We quantified terminal contacts in each region on DA and GABAergic soma/proximal dendrites and small distal dendrites. There was striking uniformity in contacts on DA and GABAergic cells, regardless of soma and dendritic compartment, in both regions. Most contacts were symmetric (putative inhibitory) with little change in the ratio of inhibitory to excitatory contacts by region.We conclude that post-synaptic shifts in DA-GABA ratios are key to understanding how these relatively uniform inputs can produce diverse effects on outputs.

Morphine- and foot shock-responsive neuronal ensembles in the VTA possess different connectivity and biased GPCR signaling pathway

Background: Neurons in the ventral tegmental area (VTA) are sensitive to stress and their maladaptation have been implicated in the psychiatric disorders such as anxiety and addiction, etc. The cellular properties of the VTA neurons in response to different stressors related to different emotional processing remain to be investigated. Methods: By combining immediate early gene (IEG)-dependent labeling, rabies virus tracing, ensemble-specific transcriptomic analysis and fiber photometry recording in the VTA of male mice, the spatial distribution, brain-wide connectivity and cellular signaling pathways in the VTA neuronal ensembles in response to morphine (Mor-Ens) or foot shock (Shock-Ens) stimuli were investigated. Results: Optogenetic activation of the Mor-Ens drove approach behavior, whereas chemogenetic activation of the Shock-Ens increased the anxiety level in mice. Mor-Ens were clustered and enriched in the ventral VTA, contained a higher proportion of dopaminergic neurons, received more inputs from the dorsal medial striatum and the medial hypothalamic zone, and exhibited greater axonal arborization in the zona incerta and ventral pallidum. Whereas Shock-Ens were more dispersed, contained a higher proportion of GABAergic neurons, and received more inputs from the ventral pallidum and the lateral hypothalamic area. The downstream targets of the G protein and β-arrestin pathways, PLCβ3 and phosphorylated AKT1Thr308, were relatively enriched in the Mor-Ens and Shock-Ens, respectively. Cariprazine, the G-protein-biased agonist for the dopamine D2 receptor, increased the response of Mor-Ens to sucrose water and decreased the anxiety-like behavior during morphine withdrawal, whereas the β-arrestin-biased agonist UNC9994 decreased the response of Shock-Ens to tail suspension. Conclusions: Taken together, these findings reveal the heterogeneous connectivity and signaling pathways of the VTA neurons in response to morphine and foot shock, providing new insights for development of specific interventions for psychiatric disorders caused by various stressors associated with different VTA neuronal functions.

Lateral hypothalamic glutamatergic inputs to VTA glutamatergic neurons mediate prioritization of innate defensive behavior over feeding

The lateral hypothalamus (LH) is involved in feeding behavior and defense responses by interacting with different brain structures, including the Ventral Tegmental Area (VTA). Emerging evidence indicates that LH-glutamatergic neurons infrequently synapse on VTA-dopamine neurons but preferentially establish multiple synapses on VTA-glutamatergic neurons. Here, we demonstrated that LH-glutamatergic inputs to VTA promoted active avoidance, long-term aversion, and escape attempts. By testing feeding in the presence of a predator, we observed that ongoing feeding was decreased, and that this predator-induced decrease in feeding was abolished by photoinhibition of the LH-glutamatergic inputs to VTA. By VTA specific neuronal ablation, we established that predator-induced decreases in feeding were mediated by VTA-glutamatergic neurons but not by dopamine or GABA neurons. Thus, we provided evidence for an unanticipated neuronal circuitry between LH-glutamatergic inputs to VTA-glutamatergic neurons that plays a role in prioritizing escape, and in the switch from feeding to escape in mice.

An opponent striatal circuit for distributional reinforcement learning

Machine learning research has achieved large performance gains on a wide range of tasks by expanding the learning target from mean rewards to entire probability distributions of rewards - an approach known as distributional reinforcement learning (RL)1. The mesolimbic dopamine system is thought to underlie RL in the mammalian brain by updating a representation of mean value in the striatum2,3, but little is known about whether, where, and how neurons in this circuit encode information about higher-order moments of reward distributions4. To fill this gap, we used high-density probes (Neuropixels) to acutely record striatal activity from well-trained, water-restricted mice performing a classical conditioning task in which reward mean, reward variance, and stimulus identity were independently manipulated. In contrast to traditional RL accounts, we found robust evidence for abstract encoding of variance in the striatum. Remarkably, chronic ablation of dopamine inputs disorganized these distributional representations in the striatum without interfering with mean value coding. Two-photon calcium imaging and optogenetics revealed that the two major classes of striatal medium spiny neurons - D1 and D2 MSNs - contributed to this code by preferentially encoding the right and left tails of the reward distribution, respectively. We synthesize these findings into a new model of the striatum and mesolimbic dopamine that harnesses the opponency between D1 and D2 MSNs5-15 to reap the computational benefits of distributional RL.

Corticotropin-releasing factor-dopamine interactions in male and female macaque: Beyond the classic VTA

Dopamine (DA) is involved in stress and stress-related illnesses, including many psychiatric disorders. Corticotropin-releasing factor (CRF) plays a role in stress responses and targets the ventral midbrain DA system, which is composed of DA and non-DA cells, and divided into specific subregions. Although CRF inputs to the midline A10 nuclei ("classic VTA") are known, in monkeys, CRF-containing terminals are also highly enriched in the expanded A10 parabrachial pigmented nucleus (PBP) and in the A8 retrorubral field subregions. We characterized CRF-labeled synaptic terminals on DA (tyrosine hydroxylase, TH+) and non-DA (TH-) cell types in the PBP and A8 regions using immunoreactive electron microscopy (EM) in male and female macaques. CRF labeling was present mostly in axon terminals, which mainly contacted TH-negative dendrites in both subregions. Most CRF-positive terminals had symmetric profiles. In both PBP and A8, CRF symmetric (putative inhibitory) synapses onto TH-negative dendrites were significantly greater than asymmetric (putative excitatory) profiles. This overall pattern was similar in males and females, despite shifts in the size of these effects between regions depending on sex. Because stress and gonadal hormone shifts can influence CRF expression, we also did hormonal assays over a 6-month time period and found little variability in basal cortisol across similarly housed animals at the same age. Together our findings suggest that at baseline, CRF-positive synaptic terminals in the primate PBP and A8 are poised to regulate DA indirectly through synaptic contacts onto non-DA neurons.

Asymmetric coding of reward prediction errors in human insula and dorsomedial prefrontal cortex

The signed value and unsigned salience of reward prediction errors (RPEs) are critical to understanding reinforcement learning (RL) and cognitive control. Dorsomedial prefrontal cortex (dMPFC) and insula (INS) are key regions for integrating reward and surprise information, but conflicting evidence for both signed and unsigned activity has led to multiple proposals for the nature of RPE representations in these brain areas. Recently developed RL models allow neurons to respond differently to positive and negative RPEs. Here, we use intracranially recorded high frequency activity (HFA) to test whether this flexible asymmetric coding strategy captures RPE coding diversity in human INS and dMPFC. At the region level, we found a bias towards positive RPEs in both areas which paralleled behavioral adaptation. At the local level, we found spatially interleaved neural populations responding to unsigned RPE salience and valence-specific positive and negative RPEs. Furthermore, directional connectivity estimates revealed a leading role of INS in communicating positive and unsigned RPEs to dMPFC. These findings support asymmetric coding across distinct but intermingled neural populations as a core principle of RPE processing and inform theories of the role of dMPFC and INS in RL and cognitive control.

Nucleus accumbens core single cell ensembles bidirectionally respond to experienced versus observed aversive events

Fear learning is a critical feature of survival skills among mammals. In rodents, fear learning manifests itself through direct experience of the aversive event or social transmission of aversive stimuli such as observing and acting on conspecifics' distress. The neuronal network underlying the social transmission of information largely overlaps with the brain regions that mediate behavioral responses to aversive and rewarding stimuli. In this study, we recorded single cell activity patterns of nucleus accumbens (NAc) core neurons using in vivo optical imaging of calcium transients via miniature scopes. This cutting-edge imaging methodology not only allows us to record activity patterns of individual neurons but also lets us longitudinally follow these individual neurons across time and different behavioral states. Using this approach, we identified NAc core single cell ensembles that respond to experienced and/or observed aversive stimuli. Our results showed that experienced and observed aversive stimuli evoke NAc core ensemble activity that is largely positive, with a smaller subset of negative responses. The size of the NAc single cell ensemble response was greater for experienced aversive stimuli compared to observed aversive events. Our results also revealed sex differences in the NAc core single cell ensembles responses to experience aversive stimuli, where females showed a greater accumbal response. Importantly, we found a subpopulation within the NAc core single cell ensembles that show a bidirectional response to experienced aversive stimuli versus observed aversive stimuli (i.e., negative response to experienced and positive response to observed). Our results suggest that the NAc plays a role in differentiating somatosensory experience from social observation of aversion at a single cell level. These results have important implications for psychopathologies where social information processing is maladaptive, such as autism spectrum disorders.

Stress relief as a natural resilience mechanism against depression-like behaviors

Relief, the appetitive state after the termination of aversive stimuli, is evolutionarily conserved. Understanding the behavioral role of this well-conserved phenomenon and its underlying neurobiological mechanisms are open and important questions. Here, we discover that the magnitude of relief from physical stress strongly correlates with individual resilience to depression-like behaviors in chronic stressed mice. Notably, blocking stress relief causes vulnerability to depression-like behaviors, whereas natural rewards supplied shortly after stress promotes resilience. Stress relief is mediated by reward-related mesolimbic dopamine neurons, which show minute-long, persistent activation after stress termination. Circuitry-wise, activation or inhibition of circuits downstream of the ventral tegmental area during the transient relief period bi-directionally regulates depression resilience. These results reveal an evolutionary function of stress relief in depression resilience and identify the neural substrate mediating this effect. Importantly, our data suggest a behavioral strategy of augmenting positive valence of stress relief with natural rewards to prevent depression.

Functional architecture of dopamine neurons driving fear extinction learning

The ability to extinguish fear responses to stimuli that no longer predict danger is critical for adaptive behavior and increases the likelihood of survival. During fear extinction, dopamine (DA) neurons signal the absence of the expected aversive outcome, and this extinction prediction error (EPE) signal is crucial for initiating and driving extinction learning. However, the neural circuits underlying the EPE signal have remained elusive. Here, we investigate the input-output circuitry of EPE-encoding DA neurons in male mice. By employing projection-specific fiber photometry and optogenetics, we demonstrate that these neurons project to a restricted subregion of the nucleus accumbens. Comprehensive anatomical analyses, as well as projection-specific chemogenetic manipulations combined with recordings of DA biosensors, further uncover the dorsal raphe as one key input structure critical for generating the EPE signal. Together, our results reveal for the first time the functional architecture of EPE-encoding DA neurons crucial for driving fear extinction learning.

Nicotine addiction: More than just dopamine

Despite decades of research and anti-tobacco messaging, nicotine addiction remains an important public health problem leading to hundreds of thousands of deaths each year. While fundamental studies have identified molecular, circuit-level and behavioral mechanisms important for nicotine reinforcement and withdrawal, recent studies have identified additional pathways that are important for both nicotine seeking and aversion. In particular, although dopaminergic mechanisms are necessary for nicotine-dependent reward and drug-seeking, novel glutamate and GABA signaling mechanisms in the mesolimbic system have been identified for their contributions to reward-related behaviors. An additional area of active investigation for nicotine addiction focuses on molecular mechanisms in the habenula-interpeduncular pathway driving nicotine aversion and withdrawal. Across all these domains, sex differences in the molecular basis of nicotine-induced behaviors have emerged that identify important new directions for future research. Recent studies reviewed here highlight additional pathways that could provide therapeutic targets for smoking cessation and problematic nicotine vaping.

Cell type specificity for circuit output in the midbrain dopaminergic system

Midbrain dopaminergic neurons are a relatively small group of neurons in the mammalian brain controlling a wide range of behaviors. In recent years, increasingly sophisticated tracing, imaging, transcriptomic, and machine learning approaches have provided substantial insights into the anatomical, molecular, and functional heterogeneity of dopaminergic neurons. Despite this wealth of new knowledge, it remains unclear whether and how the diverse features defining dopaminergic subclasses converge to delineate functional ensembles within the dopaminergic system. Here, we review recent studies investigating various aspects of dopaminergic heterogeneity and discuss how development, behavior, and disease influence subtype characteristics. We then outline what further approaches could be pursued to gain a more inclusive picture of dopaminergic diversity, which could be crucial to understanding the functional architecture of this system.

Prefrontal Dopamine in Flexible Adaptation to Environmental Changes: A Game for Two Players

Deficits in cognitive flexibility have been characterized in affective, anxiety, and neurodegenerative disorders. This paper reviews data, mainly from studies on animal models, that support the existence of a cortical-striatal brain circuit modulated by dopamine (DA), playing a major role in cognitive/behavioral flexibility. Moreover, we reviewed clinical findings supporting misfunctioning of this circuit in Parkinson's disease that could be responsible for some important non-motoric symptoms. The reviewed findings point to a role of catecholaminergic transmission in the medial prefrontal cortex (mpFC) in modulating DA's availability in the nucleus accumbens (NAc), as well as a role of NAc DA in modulating the motivational value of natural and conditioned stimuli. The review section is accompanied by a preliminary experiment aimed at testing weather the extinction of a simple Pavlovian association fosters increased DA transmission in the mpFC and inhibition of DA transmission in the NAc.