Distinct signals in medial and lateral VTA dopamine neurons modulate fear extinction at different times

A feature-specific prediction error model explains dopaminergic heterogeneity

The hypothesis that midbrain dopamine (DA) neurons broadcast a reward prediction error (RPE) is among the great successes of computational neuroscience. However, recent results contradict a core aspect of this theory: specifically that the neurons convey a scalar, homogeneous signal. While the predominant family of extensions to the RPE model replicates the classic model in multiple parallel circuits, we argue that these models are ill suited to explain reports of heterogeneity in task variable encoding across DA neurons. Instead, we introduce a complementary 'feature-specific RPE' model, positing that individual ventral tegmental area DA neurons report RPEs for different aspects of an animal's moment-to-moment situation. Further, we show how our framework can be extended to explain patterns of heterogeneity in action responses reported among substantia nigra pars compacta DA neurons. This theory reconciles new observations of DA heterogeneity with classic ideas about RPE coding while also providing a new perspective of how the brain performs reinforcement learning in high-dimensional environments.

Explaining dopamine through prediction errors and beyond

The most influential account of phasic dopamine holds that it reports reward prediction errors (RPEs). The RPE-based interpretation of dopamine signaling is, in its original form, probably too simple and fails to explain all the properties of phasic dopamine observed in behaving animals. This Perspective helps to resolve some of the conflicting interpretations of dopamine that currently exist in the literature. We focus on the following three empirical challenges to the RPE theory of dopamine: why does dopamine (1) ramp up as animals approach rewards, (2) respond to sensory and motor features and (3) influence action selection? We argue that the prediction error concept, once it has been suitably modified and generalized based on an analysis of each computational problem, answers each challenge. Nonetheless, there are a number of additional empirical findings that appear to demand fundamentally different theoretical explanations beyond encoding RPE. Therefore, looking forward, we discuss the prospects for a unifying theory that respects the diversity of dopamine signaling and function as well as the complex circuitry that both underlies and responds to dopaminergic transmission.

Memory Trace for Fear Extinction: Fragile yet Reinforceable

Fear extinction is a biological process in which learned fear behavior diminishes without anticipated reinforcement, allowing the organism to re-adapt to ever-changing situations. Based on the behavioral hypothesis that extinction is new learning and forms an extinction memory, this new memory is more readily forgettable than the original fear memory. The brain's cellular and synaptic traces underpinning this inherently fragile yet reinforceable extinction memory remain unclear. Intriguing questions are about the whereabouts of the engram neurons that emerged during extinction learning and how they constitute a dynamically evolving functional construct that works in concert to store and express the extinction memory. In this review, we discuss recent advances in the engram circuits and their neural connectivity plasticity for fear extinction, aiming to establish a conceptual framework for understanding the dynamic competition between fear and extinction memories in adaptive control of conditioned fear responses.

65 years of research on dopamine's role in classical fear conditioning and extinction: A systematic review

Dopamine, a catecholamine neurotransmitter, has historically been associated with the encoding of reward, whereas its role in aversion has received less attention. Here, we systematically gathered the vast evidence of the role of dopamine in the simplest forms of aversive learning: classical fear conditioning and extinction. In the past, crude methods were used to augment or inhibit dopamine to study its relationship with fear conditioning and extinction. More advanced techniques such as conditional genetic, chemogenic and optogenetic approaches now provide causal evidence for dopamine's role in these learning processes. Dopamine neurons encode conditioned stimuli during fear conditioning and extinction and convey the signal via activation of D1-4 receptor sites particularly in the amygdala, prefrontal cortex and striatum. The coordinated activation of dopamine receptors allows for the continuous formation, consolidation, retrieval and updating of fear and extinction memory in a dynamic and reciprocal manner. Based on the reviewed literature, we conclude that dopamine is crucial for the encoding of classical fear conditioning and extinction and contributes in a way that is comparable to its role in encoding reward.

Coordinating brain-distributed network activities in memory resistant to extinction

Certain memories resist extinction to continue invigorating maladaptive actions. The robustness of these memories could depend on their widely distributed implementation across populations of neurons in multiple brain regions. However, how dispersed neuronal activities are collectively organized to underpin a persistent memory-guided behavior remains unknown. To investigate this, we simultaneously monitored the prefrontal cortex, nucleus accumbens, amygdala, hippocampus, and ventral tegmental area (VTA) of the mouse brain from initial recall to post-extinction renewal of a memory involving cocaine experience. We uncover a higher-order pattern of short-lived beta-frequency (15-25 Hz) activities that are transiently coordinated across these networks during memory retrieval. The output of a divergent pathway from upstream VTA glutamatergic neurons, paced by a slower (4-Hz) oscillation, actuates this multi-network beta-band coactivation; its closed-loop phase-informed suppression prevents renewal of cocaine-biased behavior. Binding brain-distributed neural activities in this temporally structured manner may constitute an organizational principle of robust memory expression.

Fear extinction rescuing effects of dopamine and L-DOPA in the ventromedial prefrontal cortex

The ventromedial prefrontal cortex (vmPFC; rodent infralimbic cortex (IL)), is posited to be an important locus of fear extinction-facilitating effects of the dopamine (DA) bio-precursor, L-DOPA, but this hypothesis remains to be formally tested. Here, in a model of impaired fear extinction (the 129S1/SvImJ inbred mouse strain; S1), we monitored extracellular DA dynamics via in vivo microdialysis in IL during fear extinction and following L-DOPA administration. Systemic L-DOPA caused sustained elevation of extracellular DA levels in IL and increased neuronal activation in a subpopulation of IL neurons. Systemic L-DOPA enabled extinction learning and promoted extinction retention at one but not ten days after training. Conversely, direct microinfusion of DA into IL produced long-term fear extinction (an effect that was insensitive to ɑ-/ß-adrenoreceptor antagonism). However, intra-IL delivery of a D1-like or D2 receptor agonist did not facilitate extinction. Using ex vivo multi-electrode array IL neuronal recordings, along with ex vivo quantification of immediate early genes and DA receptor signalling markers in mPFC, we found evidence of reduced DA-evoked mPFC network responses in S1 as compared with extinction-competent C57BL/6J mice that were partially driven by D1 receptor activation. Together, our data demonstrate that locally increasing DA in IL is sufficient to produce lasting rescue of impaired extinction. The finding that systemic L-DOPA increased IL DA levels, but had only transient effects on extinction, suggests L-DOPA failed to reach a threshold level of IL DA or produced opposing behavioural effects in other brain regions. Collectively, our findings provide further insight into the neural basis of the extinction-promoting effects of DA and L-DOPA in a clinically relevant animal model, with possible implications for therapeutically targeting the DA system in anxiety and trauma-related disorders.

Stress relief as a natural resilience mechanism against depression-like behaviors

Relief, the appetitive state after the termination of aversive stimuli, is evolutionarily conserved. Understanding the behavioral role of this well-conserved phenomenon and its underlying neurobiological mechanisms are open and important questions. Here, we discover that the magnitude of relief from physical stress strongly correlates with individual resilience to depression-like behaviors in chronic stressed mice. Notably, blocking stress relief causes vulnerability to depression-like behaviors, whereas natural rewards supplied shortly after stress promotes resilience. Stress relief is mediated by reward-related mesolimbic dopamine neurons, which show minute-long, persistent activation after stress termination. Circuitry-wise, activation or inhibition of circuits downstream of the ventral tegmental area during the transient relief period bi-directionally regulates depression resilience. These results reveal an evolutionary function of stress relief in depression resilience and identify the neural substrate mediating this effect. Importantly, our data suggest a behavioral strategy of augmenting positive valence of stress relief with natural rewards to prevent depression.

Functional architecture of dopamine neurons driving fear extinction learning

The ability to extinguish fear responses to stimuli that no longer predict danger is critical for adaptive behavior and increases the likelihood of survival. During fear extinction, dopamine (DA) neurons signal the absence of the expected aversive outcome, and this extinction prediction error (EPE) signal is crucial for initiating and driving extinction learning. However, the neural circuits underlying the EPE signal have remained elusive. Here, we investigate the input-output circuitry of EPE-encoding DA neurons in male mice. By employing projection-specific fiber photometry and optogenetics, we demonstrate that these neurons project to a restricted subregion of the nucleus accumbens. Comprehensive anatomical analyses, as well as projection-specific chemogenetic manipulations combined with recordings of DA biosensors, further uncover the dorsal raphe as one key input structure critical for generating the EPE signal. Together, our results reveal for the first time the functional architecture of EPE-encoding DA neurons crucial for driving fear extinction learning.

Cell type specificity for circuit output in the midbrain dopaminergic system

Midbrain dopaminergic neurons are a relatively small group of neurons in the mammalian brain controlling a wide range of behaviors. In recent years, increasingly sophisticated tracing, imaging, transcriptomic, and machine learning approaches have provided substantial insights into the anatomical, molecular, and functional heterogeneity of dopaminergic neurons. Despite this wealth of new knowledge, it remains unclear whether and how the diverse features defining dopaminergic subclasses converge to delineate functional ensembles within the dopaminergic system. Here, we review recent studies investigating various aspects of dopaminergic heterogeneity and discuss how development, behavior, and disease influence subtype characteristics. We then outline what further approaches could be pursued to gain a more inclusive picture of dopaminergic diversity, which could be crucial to understanding the functional architecture of this system.

Overlapping representations of food and social stimuli in mouse VTA dopamine neurons

Dopamine neurons of the ventral tegmental area (VTADA) respond to food and social stimuli and contribute to both forms of motivation. However, it is unclear whether the same or different VTADA neurons encode these different stimuli. To address this question, we performed two-photon calcium imaging in mice presented with food and conspecifics and found statistically significant overlap in the populations responsive to both stimuli. Both hunger and opposite-sex social experience further increased the proportion of neurons that respond to both stimuli, implying that increasing motivation for one stimulus increases overlap. In addition, single-nucleus RNA sequencing revealed significant co-expression of feeding- and social-hormone-related genes in individual VTADA neurons. Taken together, our functional and transcriptional data suggest overlapping VTADA populations underlie food and social motivation.

Nigrostriatal dopamine modulates the striatal-amygdala pathway in auditory fear conditioning

The auditory striatum, a sensory portion of the dorsal striatum, plays an essential role in learning and memory. In contrast to its roles and underlying mechanisms in operant conditioning, however, little is known about its contribution to classical auditory fear conditioning. Here, we reveal the function of the auditory striatum in auditory-conditioned fear memory. We find that optogenetically inhibiting auditory striatal neurons impairs fear memory formation, which is mediated through the striatal-amygdala pathway. Using calcium imaging in behaving mice, we find that auditory striatal neuronal responses to conditioned tones potentiate across memory acquisition and expression. Furthermore, nigrostriatal dopaminergic projections plays an important role in modulating conditioning-induced striatal potentiation. Together, these findings demonstrate the existence of a nigro-striatal-amygdala circuit for conditioned fear memory formation and expression.

Contributions of the Sodium Leak Channel NALCN to Pacemaking of Medial Ventral Tegmental Area and Substantia Nigra Dopaminergic Neurons

We tested the role of the sodium leak channel, NALCN, in pacemaking of dopaminergic neuron (DAN) subpopulations from adult male and female mice. In situ hybridization revealed NALCN RNA in all DANs, with lower abundance in medial ventral tegmental area (VTA) relative to substantia nigra pars compacta (SNc). Despite lower relative abundance of NALCN, we found that acute pharmacological blockade of NALCN in medial VTA DANs slowed pacemaking by 49.08%. We also examined the electrophysiological properties of projection-defined VTA DAN subpopulations identified by retrograde labeling. Inhibition of NALCN reduced pacemaking in DANs projecting to medial nucleus accumbens (NAc) and others projecting to lateral NAc by 70.74% and 31.98%, respectively, suggesting that NALCN is a primary driver of pacemaking in VTA DANs. In SNc DANs, potentiating NALCN by lowering extracellular calcium concentration speeded pacemaking in wildtype but not NALCN conditional knockout mice, demonstrating functional presence of NALCN. In contrast to VTA DANs, however, pacemaking in SNc DANs was unaffected by inhibition of NALCN. Instead, we found that inhibition of NALCN increased the gain of frequency-current plots at firing frequencies slower than spontaneous firing. Similarly, inhibition of the hyperpolarization-activated cyclic nucleotide-gated (HCN) conductance increased gain but had little effect on pacemaking. Interestingly, simultaneous inhibition of NALCN and HCN resulted in significant reduction in pacemaker rate. Thus, we found NALCN makes substantial contributions to driving pacemaking in VTA DAN subpopulations. In SNc DANs, NALCN is not critical for pacemaking but inhibition of NALCN makes cells more sensitive to hyperpolarizing stimuli.SIGNIFICANCE STATEMENT Pacemaking in midbrain dopaminergic neurons (DAN) relies on multiple subthreshold conductances, including a sodium leak. Whether the sodium leak channel, NALCN, contributes to pacemaking in DANs located in the VTA and the SNc has not yet been determined. Using electrophysiology and pharmacology, we show that NALCN plays a prominent role in driving pacemaking in projection-defined VTA DAN subpopulations. By contrast, pacemaking in SNc neurons does not rely on NALCN. Instead, the presence of NALCN regulates the excitability of SNc DANs by reducing the gain of the neuron's response to inhibitory stimuli. Together, these findings will inform future efforts to obtain DAN subpopulation-specific treatments for use in neuropsychiatric disorders.

A cortico-amygdala neural substrate for endocannabinoid modulation of fear extinction

Preclinical and clinical studies implicate endocannabinoids (eCBs) in fear extinction, but the underlying neural circuit basis of these actions is unclear. Here, we employed in vivo optogenetics, eCB biosensor imaging, ex vivo electrophysiology, and CRISPR-Cas9 gene editing in mice to examine whether basolateral amygdala (BLA)-projecting medial prefrontal cortex (mPFC) neurons represent a neural substrate for the effects of eCBs on extinction. We found that photoexcitation of mPFC axons in BLA during extinction mobilizes BLA eCBs. eCB biosensor imaging showed that eCBs exhibit a dynamic stimulus-specific pattern of activity at mPFC→BLA neurons that tracks extinction learning. Furthermore, using CRISPR-Cas9-mediated gene editing, we demonstrated that extinction memory formation involves eCB activity at cannabinoid CB1 receptors expressed at vmPFC→BLA synapses. Our findings reveal the temporal characteristics and a neural circuit basis of eCBs' effects on fear extinction and inform efforts to target the eCB system as a therapeutic approach in extinction-deficient neuropsychiatric disorders.

Adaptive expression of engrams by retroactive interference

Long-term memories are stored as configurations of neuronal ensembles, termed engrams. Although investigation of engram cell properties and functionality in memory recall has been extensive, less is known about how engram cells are affected by forgetting. We describe a form of interference-based forgetting using an object memory behavioral paradigm. By using activity-dependent cell labeling, we show that although retroactive interference results in decreased engram cell reactivation during recall trials, optogenetic stimulation of the labeled engram cells is sufficient to induce memory retrieval. Forgotten engrams may be reinstated via the presentation of similar or related environmental information. Furthermore, we demonstrate that engram activity is necessary for interference to occur. Taken together, these findings indicate that retroactive interference modules engram expression in a manner that is both reversible and updatable. Inference may constitute a form of adaptive forgetting where, in everyday life, new perceptual and environmental inputs modulate the natural forgetting process.

Tripterygium wilfordii protects against an animal model of autoimmune hepatitis

ETHNOPHARMACOLOGICAL RELEVANCE

Tripterygium wilfordii tablets (TWT) is widely used to treat autoimmune diseases such as rheumatoid arthritis. Celastrol, one main active ingredient in TWT, has been shown to produce a variety of beneficial effects, including anti-inflammatory, anti-obesity, anti-cancer, and immunomodulatory. However, whether TWT could protect against Concanavalin A (Con A)-induced hepatitis remains unclear.

THE AIM OF THE STUDY

This study aims to investigate the protective effect of TWT against Con A-induced hepatitis and elucidate the underlying mechanism.

MATERIALS AND METHODS

Metabolomic analysis, pathological analysis, biochemical analysis, qPCR and Western blot analysis and the Pxr-null mice were used in this study.

RESULTS

The results indicated that TWT and its active ingredient celastrol could protect against Con A-induced acute hepatitis. Plasma metabolomics analysis revealed that metabolic perturbations related to bile acid and fatty acid metabolism induced by Con A were reversed by celastrol. The level of itaconate in the liver was increased by celastrol and speculated as an active endogenous compound mediating the protective effect of celastrol. Administration of 4-octanyl itaconate (4-OI) as a cell-permeable itaconate mimicker was found to attenuate Con A-induced liver injury through activation of the pregnane X receptor (PXR) and enhancement of the transcription factor EB (TFEB)-mediated autophagy.

CONCLUSIONS

Celastrol increased itaconate and 4-OI promoted activation of TFEB-mediated lysosomal autophagy to protect against Con A-induced liver injury in a PXR-dependent manner. Our study reported a protective effect of celastrol against Con A-induced AIH via an increased production of itaconate and upregulation of TFEB. The results highlighted that PXR and TFEB-mediated lysosomal autophagic pathway may offer promising therapeutic target for the treatment of autoimmune hepatitis.

Fear extinction relies on ventral hippocampal safety codes shaped by the amygdala

Extinction memory retrieval is influenced by spatial contextual information that determines responding to conditioned stimuli (CS). However, it is poorly understood whether contextual representations are imbued with emotional values to support memory selection. Here, we performed activity-dependent engram tagging and in vivo single-unit electrophysiological recordings from the ventral hippocampus (vH) while optogenetically manipulating basolateral amygdala (BLA) inputs during the formation of cued fear extinction memory. During fear extinction when CS acquire safety properties, we found that CS-related activity in the vH reactivated during sleep consolidation and was strengthened upon memory retrieval. Moreover, fear extinction memory was facilitated when the extinction context exhibited precise coding of its affective zones. Last, these activity patterns along with the retrieval of the fear extinction memory were dependent on glutamatergic transmission from the BLA during extinction learning. Thus, fear extinction memory relies on the formation of contextual and stimulus safety representations in the vH instructed by the BLA.

Spatial Distribution of Neurons Expressing Single, Double, and Triple Molecular Characteristics of Glutamatergic, Dopaminergic, or GABAergic Neurons in the Mouse Ventral Tegmental Area

The ventral tegmental area (VTA) is a heterogeneous midbrain area that plays a significant role in diverse neural processes such as reward, aversion, and motivation. The VTA contains three main neuronal populations, namely, dopamine (DA), γ-aminobutyric acid (GABA), and glutamate neurons, but some neurons exhibit combinatorial molecular characteristics of dopaminergic, GABAergic, or glutamatergic neurons. However, little information is available regarding detailed distribution of neurons with single, double, and triple molecular characteristics of glutamatergic, dopaminergic, or GABAergic neurons in mice. We present a topographical distribution map of three main neuronal populations expressing a single molecular characteristic of dopaminergic, GABAergic, or glutamatergic neurons, and four neuronal populations co-expressing double or triple molecular characteristics in combinatorial manners, in the mouse VTA, following analysis of triple fluorescent in situ hybridization for the simultaneous detection of tyrosine hydroxylase (TH, marker for dopaminergic neurons), vesicular glutamate transporter 2 (VGLUT2, marker for glutamatergic neurons), and glutamic acid decarboxylase 2 (GAD2, marker for GABAergic neurons) mRNA. We found that the vast majority of neurons expressed a single type of mRNA, and these neurons were intermingled with neurons co-expressing double or triple combinations of VGLUT2, TH, or GAD2 in the VTA. These seven neuronal populations were differentially distributed in the VTA sub-nuclei across the rostro-caudal and latero-medial axes. This histochemical study will lead to a deeper understanding of the complexity of neuronal molecular characteristics in different VTA sub-nuclei, and potentially facilitate clarification of diverse functions of the VTA.

The dopamine neuron synaptic map in the striatum

Dopamine neurons project to the striatum to control movement, cognition, and motivation via slower volume transmission as well as faster dopamine, glutamate, and GABA synaptic actions capable of conveying the temporal information in dopamine neuron firing. To define the scope of these synaptic actions, recordings of dopamine-neuron-evoked synaptic currents were made in four major striatal neuron types, spanning the entire striatum. This revealed that inhibitory postsynaptic currents are widespread, while excitatory postsynaptic currents are localized to the medial nucleus accumbens and the anterolateral-dorsal striatum, and that all synaptic actions are weak in the posterior striatum. Synaptic actions in cholinergic interneurons are the strongest, variably mediating inhibition throughout the striatum and excitation in the medial accumbens, capable of controlling their activity. This mapping shows that dopamine neuron synaptic actions extend throughout the striatum, preferentially target cholinergic interneurons, and define distinct striatal subregions.

Increased sucrose consumption in mice gene-targeted for Vmat2 selectively in NeuroD6-positive neurons of the ventral tegmental area

Ventral tegmental area (VTA) dopamine (DA) neurons are implicated in reward processing, motivation, reward prediction error, and in substance use disorder. Recent studies have identified distinct neuronal subpopulations within the VTA that can be clustered based on their molecular identity, neurotransmitter profile, physiology, projections and behavioral role. One such subpopulation is characterized by expression of the NeuroD6 gene, and projects primarily to the nucleus accumbens medial shell. We recently showed that optogenetic stimulation of these neurons induces real-time place preference while their targeted deletion of the Vmat2 gene caused altered response to rewarding substances, including ethanol and psychostimulants. Based on these recent findings, we wanted to further investigate the involvement of the NeuroD6-positive VTA subpopulation in reward processing. Using the same NeuroD6^Cre+/wt ;Vmat2^flox/flox mice as in our prior study, we now addressed the ability of the mice to process sucrose reward. In order to assess appetitive behavior and motivation to obtain sucrose reward, we tested conditional knockout (cKO) and control littermate mice in an operant sucrose self-administration paradigm. We observed that cKO mice demonstrate higher response rates to the operant task and consume more sucrose rewards than control mice. However, their motivation to obtain sucrose is identical to that of control mice. Our results highlight previous observations that appetitive behavior and motivation to obtain rewards can be served by distinct neuronal circuits, and demonstrate that the NeuroD6 VTA subpopulation is involved in mediating the former, but not the latter. Together with previous studies on the NeuroD6 subpopulation, our findings pinpoint the importance of unraveling the molecular and functional role of VTA subpopulations in order to better understand normal behavior and psychiatric disease.

Exploration driven by a medial preoptic circuit facilitates fear extinction in mice

Repetitive exposure to fear-associated targets is a typical treatment for patients with panic or post-traumatic stress disorder (PTSD). The success of exposure therapy depends on the active exploration of a fear-eliciting target despite an innate drive to avoid it. Here, we found that a circuit running from CaMKIIα-positive neurons of the medial preoptic area to the ventral periaqueductal gray (MPA-vPAG) facilitates the exploration of a fear-conditioned zone and subsequent fear extinction in mice. Activation or inhibition of this circuit did not induce preference/avoidance of a specific zone. Repeated entries into the fear-conditioned zone, induced by the motivation to chase a head-mounted object due to MPA-vPAG circuit photostimulation, facilitated fear extinction. Our results show how the brain forms extinction memory against avoidance of a fearful target and suggest a circuit-based mechanism of exposure therapy.

Age-Related Changes in Risky Decision Making and Associated Neural Circuitry in a Rat Model

Altered decision making at advanced ages can have a significant impact on an individual's quality of life and the ability to maintain personal independence. Relative to young adults, older adults make less impulsive and less risky choices; although these changes in decision making could be considered beneficial, they can also lead to choices with potentially negative consequences (e.g., avoidance of medical procedures). Rodent models of decision making have been invaluable for dissecting cognitive and neurobiological mechanisms that contribute to age-related changes in decision making, but they have predominantly used costs related to timing or probability of reward delivery and have not considered other equally important costs, such as the risk of adverse consequences. The current study therefore used a rat model of decision making involving risk of explicit punishment to examine age-related changes in this form of choice behavior in male rats, and to identify potential cognitive and neurobiological mechanisms that contribute to these changes. Relative to young rats, aged rats displayed greater risk aversion, which was not attributable to reduced motivation for food, changes in shock sensitivity, or impaired cognitive flexibility. Functional MRI analyses revealed that, overall, functional connectivity was greater in aged rats compared with young rats, particularly among brain regions implicated in risky decision making such as basolateral amygdala, orbitofrontal cortex, and ventral tegmental area. Collectively, these findings are consistent with greater risk aversion found in older humans, and reveal age-related changes in brain connectivity.

Behavioural and dopaminergic signatures of resilience

Chronic stress can have lasting adverse consequences in some individuals, yet others are resilient to the same stressor1,2. Susceptible and resilient individuals exhibit differences in the intrinsic properties of mesolimbic dopamine (DA) neurons after the stressful experience is over3-8. However, the causal links between DA, behaviour during stress and individual differences in resilience are unknown. Here we recorded behaviour in mice simultaneously with DA neuron activity in projections to the nucleus accumbens (NAc) (which signals reward9-12) and the tail striatum (TS) (which signals threat13-16) during social defeat. Supervised and unsupervised behavioural quantification revealed that during stress, resilient and susceptible mice use different behavioural strategies and have distinct activity patterns in DA terminals in the NAc (but not the TS). Neurally, resilient mice have greater activity near the aggressor, including at the onset of fighting back. Conversely, susceptible mice have greater activity at the offset of attacks and onset of fleeing. We also performed optogenetic stimulation of NAc-projecting DA neurons in open loop (randomly timed) during defeat or timed to specific behaviours using real-time behavioural classification. Both open-loop and fighting-back-timed activation promoted resilience and reorganized behaviour during defeat towards resilience-associated patterns. Together, these data provide a link between DA neural activity, resilience and resilience-associated behaviour during the experience of stress.

Neural circuits provide insights into reward and aversion

Maladaptive changes in the neural circuits associated with reward and aversion result in some common symptoms, such as drug addiction, anxiety, and depression. Historically, the study of these circuits has been hampered by technical limitations. In recent years, however, much progress has been made in understanding the neural mechanisms of reward and aversion owing to the development of technologies such as cell type-specific electrophysiology, neuronal tracing, and behavioral manipulation based on optogenetics. The aim of this paper is to summarize the latest findings on the mechanisms of the neural circuits associated with reward and aversion in a review of previous studies with a focus on the ventral tegmental area (VTA), nucleus accumbens (NAc), and basal forebrain (BF). These findings may inform efforts to prevent and treat mental illnesses associated with dysfunctions of the brain's reward and aversion system.

Midbrain dopamine neurons signal phasic and ramping reward prediction error during goal-directed navigation

Goal-directed navigation requires learning to accurately estimate location and select optimal actions in each location. Midbrain dopamine neurons are involved in reward value learning and have been linked to reward location learning. They are therefore ideally placed to provide teaching signals for goal-directed navigation. By imaging dopamine neural activity as mice learned to actively navigate a closed-loop virtual reality corridor to obtain reward, we observe phasic and pre-reward ramping dopamine activity, which are modulated by learning stage and task engagement. A Q-learning model incorporating position inference recapitulates our results, displaying prediction errors resembling phasic and ramping dopamine neural activity. The model predicts that ramping is followed by improved task performance, which we confirm in our experimental data, indicating that the dopamine ramp may have a teaching effect. Our results suggest that midbrain dopamine neurons encode phasic and ramping reward prediction error signals to improve goal-directed navigation.

The role of BDNF in mediating the prophylactic effects of (R,S)-ketamine on fear generalization and extinction

Fear generalization is a conserved survival mechanism that can become maladaptive in the face of traumatic situations, a feature central to certain anxiety disorders including posttraumatic stress disorder (PTSD). However, the neural circuitry and molecular mechanisms underlying fear generalization remain unclear. Recent studies have shown that prophylactic treatment with (R,S)-ketamine confers protective effects in stress-induced depressive behaviors and enhances contextual fear discrimination, but the extent to which these effects extend to fear generalization after auditory fear conditioning remains unclear. Here, we build on this work by using a behavioral model of fear generalization in mice involving foot shocks with differential intensity levels during auditory fear conditioning. We find that prophylactic (R,S)-ketamine treatment exerts protective effects that results in enhanced fear discrimination in wild type mice. As the growth factor, brain-derived neurotrophic factor (BDNF), has been shown to mediate the rapid antidepressant actions of (R,S)-ketamine, we used a loss-of-function BDNF mouse line (BDNF Val66Met) to determine whether BDNF is involved in (R,S)-ketamine's prophylactic effects on fear generalization. We found that BDNF Val66Met mice were resistant to the protective effects of prophylactic (R,S)-ketamine administration on fear generalization and extinction. We then used fiber photometry to parse out underlying neural activity and found that in the ventral hippocampus there were significant fear generalization-dependent patterns of activity for wild type and BDNF Val66Met mice that were altered by prophylactic (R,S)-ketamine treatment. Overall, these findings indicate a role for the ventral hippocampus and BDNF signaling in modulating the mitigating effects of prophylactic (R,S)-ketamine treatment on generalized fear.

Characterizing and TRAPing a Social Stress-Activated Neuronal Ensemble in the Ventral Tegmental Area

Social stress is a major contributor to neuropsychiatric issues such as depression, substance abuse and eating disorders. The ventral tegmental area (VTA) is involved in the effects of stress on cognitive and emotional processes perturbed in these disorders. However, the VTA is a cellularly heterogeneous brain area and it remains unclear which of its neuronal populations make up the social stress-sensitive ensemble. The current study characterizes the molecular, topographical and functional properties of VTA social stress-activated cells. First, we used immunohistochemical analysis of Fos protein, a marker of recent increased neuronal activity, to show that acute social stress activates a mainly neuronal ensemble in the VTA (VTA_{Social stress} neurons). Topographical analysis showed that this ensemble, which comprises ∼11% of all VTA neurons, occurs across VTA subregions. Further analysis showed that approximately half of the VTA_{Social stress} neurons express the dopamine synthesis rate-limiting enzyme tyrosine hydroxylase (TH). In a minority of cases this occurred with coexpression of vesicular glutamate transporter 2 (Vglut2). Also part of the ensemble were VTA cells expressing just Vglut2 without TH, and cells expressing the vesicular GABA transporter (VGAT) without TH. Next, using targeted recombination in active populations (TRAP2), we showed that VTA_{Social stress} neurons can be permanently tagged and made tractable for future functional investigations. Using a combination of TRAP2 and patch-clamp electrophysiology we demonstrate that VTA_{Social stress} neurons exhibit higher excitability than their non-TRAPed neighbor cells. Overall, this study shows that acute social stress activates an ensemble of neurons throughout the VTA, comprising distinct molecular identities, and with specific electrophysiological features. It also identifies TRAP2 as a tool to make this ensemble tractable for future functional studies.

Mesoaccumbal Dopamine Heterogeneity: What Do Dopamine Firing and Release Have to Do with It?

Ventral tegmental area (VTA) dopamine (DA) neurons are often thought to uniformly encode reward prediction errors. Conversely, DA release in the nucleus accumbens (NAc), the prominent projection target of these neurons, has been implicated in reinforcement learning, motivation, aversion, and incentive salience. This contrast between heterogeneous functions of DA release versus a homogeneous role for DA neuron activity raises numerous questions regarding how VTA DA activity translates into NAc DA release. Further complicating this issue is increasing evidence that distinct VTA DA projections into defined NAc subregions mediate diverse behavioral functions. Here, we evaluate evidence for heterogeneity within the mesoaccumbal DA system and argue that frameworks of DA function must incorporate the precise topographic organization of VTA DA neurons to clarify their contribution to health and disease.

Autophagy Dysfunction in ALS: from Transport to Protein Degradation

Amyotrophic lateral sclerosis (ALS) is a fatal neurodegenerative disease affecting upper and lower motor neurons (MNs). Since the identification of the first ALS mutation in 1993, more than 40 genes have been associated with the disorder. The most frequent genetic causes of ALS are represented by mutated genes whose products challenge proteostasis, becoming unable to properly fold and consequently aggregating into inclusions that impose proteotoxic stress on affected cells. In this context, increasing evidence supports the central role played by autophagy dysfunctions in the pathogenesis of ALS. Indeed, in early stages of disease, high levels of proteins involved in autophagy are present in ALS MNs; but at the same time, with neurodegeneration progression, autophagy-mediated degradation decreases, often as a result of the accumulation of toxic protein aggregates in affected cells. Autophagy is a complex multistep pathway that has a central role in maintaining cellular homeostasis. Several proteins are involved in its tight regulation, and importantly a relevant fraction of ALS-related genes encodes products that directly take part in autophagy, further underlining the relevance of this key protein degradation system in disease onset and progression. In this review, we report the most relevant findings concerning ALS genes whose products are involved in the several steps of the autophagic pathway, from phagophore formation to autophagosome maturation and transport and finally to substrate degradation.

Nuclear pore complexes - a doorway to neural injury in neurodegeneration

The genetic underpinnings and end-stage pathological hallmarks of neurodegenerative diseases are increasingly well defined, but the cellular pathophysiology of disease initiation and propagation remains poorly understood, especially in sporadic forms of these diseases. Altered nucleocytoplasmic transport is emerging as a prominent pathomechanism of multiple neurodegenerative diseases, including amyotrophic lateral sclerosis, Alzheimer disease, frontotemporal dementia and Huntington disease. The nuclear pore complex (NPC) and interactions between its individual nucleoporin components and nuclear transport receptors regulate nucleocytoplasmic transport, as well as genome organization and gene expression. Specific nucleoporin abnormalities have been identified in sporadic and familial forms of neurodegenerative disease, and these alterations are thought to contribute to disrupted nucleocytoplasmic transport. The specific nucleoporins and nucleocytoplasmic transport proteins that have been linked to different neurodegenerative diseases are partially distinct, suggesting that NPC injury contributes to the cellular specificity of neurodegenerative disease and could be an early initiator of the pathophysiological cascades that underlie neurodegenerative disease. This concept is consistent with the fact that rare genetic mutations in some nucleoporins cause cell-type-specific neurological disease. In this Review, we discuss nucleoporin and NPC disruptions and consider their impact on cellular function and the pathophysiology of neurodegenerative disease.

Historical and Modern Evidence for the Role of Reward Circuitry in Emergence

Increasing evidence supports a role for brain reward circuitry in modulating arousal along with emergence from anesthesia. Emergence remains an important frontier for investigation, since no drug exists in clinical practice to initiate rapid and smooth emergence. This review discusses clinical and preclinical evidence indicating a role for two brain regions classically considered integral components of the mesolimbic brain reward circuitry, the ventral tegmental area and the nucleus accumbens, in emergence from propofol and volatile anesthesia. Then there is a description of modern systems neuroscience approaches to neural circuit investigations that will help span the large gap between preclinical and clinical investigation with the shared aim of developing therapies to promote rapid emergence without agitation or delirium. This article proposes that neuroscientists include models of whole-brain network activity in future studies to inform the translational value of preclinical investigations and foster productive dialogues with clinician anesthesiologists.

Cholinergic interneurons mediate cocaine extinction in male mice through plasticity across medium spiny neuron subtypes

Cholinergic interneurons (ChINs) in the nucleus accumbens (NAc) have been implicated in the extinction of drug associations, as well as related plasticity in medium spiny neurons (MSNs). However, since most previous work relied on artificial manipulations, whether endogenous acetylcholine signaling relates to drug associations is unclear. Moreover, despite great interest in the opposing effects of dopamine on MSN subtypes, whether ChIN-mediated effects vary by MSN subtype is also unclear. Here, we find that high endogenous acetylcholine event frequency correlates with greater extinction of cocaine-context associations across male mice. Additionally, extinction is associated with a weakening of glutamatergic synapses across MSN subtypes. Manipulating ChIN activity bidirectionally controls both the rate of extinction and the associated plasticity at MSNs. Our findings indicate that NAc ChINs mediate drug-context extinction by reducing glutamatergic synaptic strength across MSN subtypes, and that natural variation in acetylcholine signaling may contribute to individual differences in extinction.

Fleming et al. show that individual differences in nucleus accumbens (NAc) acetylcholine signaling correlate with extinction of a cocaine-context association. Manipulations of NAc cholinergic interneuron activity support a model where acetylcholine release weakens glutamatergic presynaptic strength at NAc D1R and D2R medium spiny neurons, promoting cocaine-context extinction.

Photostimulation of Ventral Tegmental Area-Insular Cortex Dopaminergic Inputs Enhances the Salience to Consolidate Aversive Taste Recognition Memory via D1-Like Receptors

Taste memory involves storing information through plasticity changes in the neural network of taste, including the insular cortex (IC) and ventral tegmental area (VTA), a critical provider of dopamine. Although a VTA-IC dopaminergic pathway has been demonstrated, its role to consolidate taste recognition memory remains poorly understood. We found that photostimulation of dopaminergic neurons in the VTA or VTA-IC dopaminergic terminals of TH-Cre mice improves the salience to consolidate a subthreshold novel taste stimulus regardless of its hedonic value, without altering their taste palatability. Importantly, the inhibition of the D1-like receptor into the IC impairs the salience to facilitate consolidation of an aversive taste recognition memory. Finally, our results showed that VTA photostimulation improves the salience to consolidate a conditioned taste aversion memory through the D1-like receptor into the IC. It is concluded that the dopamine activity from the VTA into IC is required to increase the salience enabling the consolidation of a taste recognition memory. Notably, the D1-like receptor activity into the IC is required to consolidate both innate and learned aversive taste memories but not appetitive taste memory.

Forgetting as a form of adaptive engram cell plasticity

One leading hypothesis suggests that memories are stored in ensembles of neurons (or 'engram cells') and that successful recall involves reactivation of these ensembles. A logical extension of this idea is that forgetting occurs when engram cells cannot be reactivated. Forms of 'natural forgetting' vary considerably in terms of their underlying mechanisms, time course and reversibility. However, we suggest that all forms of forgetting involve circuit remodelling that switches engram cells from an accessible state (where they can be reactivated by natural recall cues) to an inaccessible state (where they cannot). In many cases, forgetting rates are modulated by environmental conditions and we therefore propose that forgetting is a form of neuroplasticity that alters engram cell accessibility in a manner that is sensitive to mismatches between expectations and the environment. Moreover, we hypothesize that disease states associated with forgetting may hijack natural forgetting mechanisms, resulting in reduced engram cell accessibility and memory loss.

Habenula orphan G-protein coupled receptors in the pathophysiology of fear and anxiety

The phasic emotion, fear, and the tonic emotion, anxiety, have been conventionally inspected in clinical frameworks to epitomize memory acquisition, storage, and retrieval. However, inappropriate expression of learned fear in a safe environment and its resistance to suppression is a cardinal feature of various fear-related disorders. A significant body of literature suggests the involvement of extra-amygdala circuitry in fear disorders. Consistent with this view, the present review underlies incentives for the association between the habenula and fear memory. G protein-coupled receptors (GPCRs) are important to understand the molecular mechanisms central to fear learning due to their neuromodulatory role. The efficacy of a pharmacological strategy aimed at exploiting habenular-GPCR desensitization machinery can serve as a therapeutic target combating the pathophysiology of fear disorders. Originating from this milieu, the conserved nature of orphan GPCRs in the brain, with some having the highest expression in the habenula can lead to recent endeavors in understanding its functionality in fear circuitry.

Developmental Shifts in Amygdala Activity during a High Social Drive State

Amygdala abnormalities characterize several psychiatric disorders with prominent social deficits and often emerge during adolescence. The basolateral amygdala (BLA) bidirectionally modulates social behavior and has increased sensitivity during adolescence. We tested how an environmentally-driven social state is regulated by the BLA in adults and adolescent male rats. We found that a high social drive state caused by brief social isolation increases age-specific social behaviors and increased BLA neuronal activity. Chemogenetic inactivation of BLA decreased the effect of high social drive on social engagement. High social drive preferentially enhanced BLA activity during social engagement; however, the effect of social opportunity on BLA activity was greater during adolescence. While this identifies a substrate underlying age differences in social drive, we then determined that high social drive increased BLA NMDA GluN2B expression and sensitivity to antagonism increased with age. Further, the effect of a high social drive state on BLA activity during social engagement was diminished by GluN2B blockade in an age-dependent manner. These results demonstrate the necessity of the BLA for environmentally driven social behavior, its sensitivity to social opportunity, and uncover a maturing role for BLA and its GluN2B receptors in social engagement.SIGNIFICANCE STATEMENT Social engagement during adolescence is a key component of healthy development. Social drive provides the impetus for social engagement and abnormalities underlie social symptoms of depression and anxiety. While adolescence is characterized by transitions in social drive and social environment sensitivity, little is known about the neural basis for these changes. We found that amygdala activity is uniquely sensitive to social environment during adolescence compared with adulthood, and is required for expression of heightened social drive. In addition, the neural substrates shift toward NMDA dependence in adulthood. These results are the first to demonstrate a unique neural signature of higher social drive and begin to uncover the underlying factors that heighten social engagement during adolescence.

Diverse midbrain dopaminergic neuron subtypes and implications for complex clinical symptoms of Parkinson's disease

Parkinson’s disease (PD), the most common degenerative movement disorder, is clinically manifested with various motor and non-motor symptoms. Degeneration of midbrain substantia nigra pas compacta (SNc) dopaminergic neurons (DANs) is generally attributed to the motor syndrome. The underlying neuronal mechanisms of non-motor syndrome are largely unexplored. Besides SNc, midbrain ventral tegmental area (VTA) DANs also produce and release dopamine and modulate movement, reward, motivation, and memory. Degeneration of VTA DANs also occurs in postmortem brains of PD patients, implying an involvement of VTA DANs in PD-associated non-motor symptoms. However, it remains to be established that there is a distinct segregation of different SNc and VTA DAN subtypes in regulating different motor and non-motor functions, and that different DAN subpopulations are differentially affected by normal ageing or PD. Traditionally, the distinction among different DAN subtypes was mainly based on the location of cell bodies and axon terminals. With the recent advance of single cell RNA sequencing technology, DANs can be readily classified based on unique gene expression profiles. A combination of specific anatomic and molecular markers shows great promise to facilitate the identification of DAN subpopulations corresponding to different behavior modules under normal and disease conditions. In this review, we first summarize the recent progress in characterizing genetically, anatomically, and functionally diverse midbrain DAN subtypes. Then, we provide perspectives on how the preclinical research on the connectivity and functionality of DAN subpopulations improves our current understanding of cell-type and circuit specific mechanisms of the disease, which could be critically informative for designing new mechanistic treatments.

DNA methylation changes following narrative exposure therapy in a randomized controlled trial with female former child soldiers

The aftermath of traumatization lives on in the neural and epigenetic traces creating a momentum of affliction in the psychological and social realm. Can psychotherapy reorganise these memories through changes in DNA methylation signatures? Using a randomised controlled parallel group design, we examined methylome-wide changes in saliva samples of 84 female former child soldiers from Eastern DR Congo before and six months after Narrative Exposure Therapy. Treatment predicted differentially methylated positions (DMPs) related to ALCAM, RIPOR2, AFAP1 and MOCOS. In addition, treatment associations overlapped at gene level with baseline clinical and social outcomes. Treatment related DMPs are involved in memory formation-the key agent in trauma focused treatments-and enriched for molecular pathways commonly affected by trauma related disorders. Results were partially replicated in an independent sample of 53 female former child soldiers from Northern Uganda. Our results suggest a molecular impact of psychological treatment in women with war-related childhood trauma.Trial registration: Addressing Heightened Levels of Aggression in Traumatized Offenders With Psychotherapeutic Means (ClinicalTrials.gov Identifier: NCT02992561, 14/12/2016).

L-DOPA modulates activity in the vmPFC, nucleus accumbens, and VTA during threat extinction learning in humans

Learning to be safe is central for adaptive behaviour when threats are no longer present. Detecting the absence of an expected threat is key for threat extinction learning and an essential process for the behavioural treatment of anxiety-related disorders. One possible mechanism underlying extinction learning is a dopaminergic mismatch signal that encodes the absence of an expected threat. Here we show that such a dopamine-related pathway underlies extinction learning in humans. Dopaminergic enhancement via administration of L-DOPA (vs. Placebo) was associated with reduced retention of differential psychophysiological threat responses at later test, which was mediated by activity in the ventromedial prefrontal cortex that was specific to extinction learning. L-DOPA administration enhanced signals at the time-point of an expected, but omitted threat in extinction learning within the nucleus accumbens, which were functionally coupled with the ventral tegmental area and the amygdala. Computational modelling of threat expectancies further revealed prediction error encoding in nucleus accumbens that was reduced when L-DOPA was administered. Our results thereby provide evidence that extinction learning is influenced by L-DOPA and provide a mechanistic perspective to augment extinction learning by dopaminergic enhancement in humans.

Illuminating subcortical GABAergic and glutamatergic circuits for reward and aversion

Reinforcement, reward, and aversion are fundamental processes for guiding appropriate behaviors. Longstanding theories have pointed to dopaminergic neurons of the ventral tegmental area (VTA) and the limbic systems' descending pathways as crucial systems for modulating these behaviors. The application of optogenetic techniques in neurotransmitter- and projection-specific circuits has supported and enhanced many preexisting theories but has also revealed many unexpected results. Here, we review the past decade of optogenetic experiments to study the neural circuitry of reinforcement and reward/aversion with a focus on the mesolimbic dopamine system and brain areas along the medial forebrain bundle (MFB). The cumulation of these studies to date has revealed generalizable findings across molecularly defined cell types in areas of the basal forebrain and anterior hypothalamus. Optogenetic stimulation of GABAergic neurons in these brain regions drives reward and can support positive reinforcement and optogenetic stimulation of glutamatergic neurons in these regions drives aversion. We also review studies of the activity dynamics of neurotransmitter defined populations in these areas which have revealed varied response patterns associated with motivated behaviors.

Neurochemical Signaling of Reward and Aversion to Ventral Tegmental Area Glutamate Neurons

Ventral tegmental area (VTA) glutamate neurons signal and participate in reward and aversion-based behaviors. However, the neurochemical mechanisms that underlie how these neurons contribute to motivated behaviors is unknown. We used a combination of optical sensors to identify how distinct neurochemical inputs to VTA glutamate neurons participate in motivated behavior within female and male transgenic mice. Activity of glutamate inputs to VTA glutamate neurons increased for both reward-predicting and aversion-predicting cues and aversive outcomes, but subpopulations of glutamate inputs were increased or decreased by reward. For both reward and aversion-based cues and outcomes, activity of GABA inputs to VTA glutamate neurons mostly decreased. GCaMP recordings showed overall population increases in VTA glutamate neuron intracellular calcium during reward and aversion-based cues and outcomes. Electrophysiological recordings of VTA VGluT2 neurons showed that glutamate receptor activation increases firing while loss of excitation via glutamate receptor blockade decreases firing. GABA-A receptor activation decreased VTA glutamate neuron firing but GABA-A receptor blockade did not significantly change VTA glutamate neuron firing. Electrophysiological recordings in coordination with our sensor data suggest that glutamate inputs strongly regulate VTA glutamate neuron participation in diverse motivated behaviors.SIGNIFICANCE STATEMENT Glutamate and GABA are the primary excitatory and inhibitory neurotransmitters of the nervous system. However, identifying how these neurotransmitters regulate motivated behavior has remained challenging because of a lack of tools (1) capable of measuring neurotransmission at the temporal scale of motivated behaviors and (2) capable of capturing chemical signaling onto genetically-distinct neuronal populations. We have overcome these obstacles by implementing genetically-encoded fluorescent indicators to monitor both glutamate and GABA input dynamics exclusively to ventral tegmental area (VTA) glutamate neurons during reward and aversion-based behaviors. We identify that glutamate and GABA inputs to VTA glutamate neurons differentially and dynamically signal reward and aversion-based cues and outcomes. This research provides foundational evidence that links distinct neurotransmitters to motivated behaviors regulated by VTA glutamate neurons.

Midbrain dopaminergic inputs gate amygdala intercalated cell clusters by distinct and cooperative mechanisms in male mice

Dopaminergic signaling plays an important role in associative learning, including fear and extinction learning. Dopaminergic midbrain neurons encode prediction error-like signals when threats differ from expectations. Within the amygdala, GABAergic intercalated cell (ITC) clusters receive one of the densest dopaminergic projections, but their physiological consequences are incompletely understood. ITCs are important for fear extinction, a function thought to be supported by activation of ventromedial ITCs that inhibit central amygdala fear output. In mice, we reveal two distinct novel mechanisms by which mesencephalic dopaminergic afferents control ITCs. Firstly, they co-release GABA to mediate rapid, direct inhibition. Secondly, dopamine suppresses inhibitory interactions between distinct ITC clusters via presynaptic D1 receptors. Early extinction training augments both GABA co-release onto dorsomedial ITCs and dopamine-mediated suppression of dorso- to ventromedial inhibition between ITC clusters. These findings provide novel insights into dopaminergic mechanisms shaping the activity balance between distinct ITC clusters that could support their opposing roles in fear behavior.

Safety learning and the Pavlovian conditioned inhibition of fear in humans: Current state and future directions

Safety learning occurs when an otherwise neutral stimulus comes to signal the absence of threat, allowing organisms to use safety information to inhibit fear and anxiety in nonthreatening environments. Although it continues to emerge as a topic of relevance in biological and clinical psychology, safety learning remains inconsistently defined and under-researched. Here, we analyse the Pavlovian conditioned inhibition paradigm and its application to the study of safety learning in humans. We discuss existing studies; address outstanding theoretical considerations; and identify prospects for its further application. Though Pavlovian conditioned inhibition presents a theoretically sound model of safety learning, it has been investigated infrequently, with decade-long interims between some studies, and notable methodological variability. Consequently, we argue that the full potential of conditioned inhibition as a model for human safety learning remains untapped, and propose that it could be revisited as a framework for addressing timely questions in the behavioural and clinical sciences.

Central amygdala circuits in valence and salience processing

Behavioral responses to environmental stimuli are dictated by the affective valence of the stimulus, good (positive valence) or bad (negative valence). These stimuli can innately elicit an affective response that promotes approach or avoidance behavior. In addition to innately valenced stimuli, valence can also be assigned to initially neutral stimuli through associative learning. A stimulus of a given valence can vary in salience depending on the strength of the stimulus, the underlying state of the animal, and the context of the stimulus presentation. Salience endows the stimulus with the ability to direct attention and elicit preparatory responses to mount an incentive-based motivated behavior. The central nucleus of the amygdala (CeA) has emerged as an early integration point for valence and salience detection to engage preparatory autonomic responses and behavioral posturing in response to both aversive and appetitive stimuli. There are numerous cell types in the CeA that are involved in valence and salience processing through a variety of connections, and we will review the recent progress that has been made in identifying these circuit elements and their roles in these processes.

Dopamine, Updated: Reward Prediction Error and Beyond

Dopamine neurons have been intensely studied for their roles in reinforcement learning. A dominant theory of how these neurons contribute to learning is through the encoding of a reward prediction error (RPE) signal. Recent advances in dopamine research have added nuance to RPE theory by incorporating the ideas of sensory prediction error, distributional encoding, and belief states. Further nuance is likely to be added shortly by convergent lines of research on dopamine neuron diversity. Finally, a major challenge is to reconcile RPE theory with other current theories of dopamine function to account for dopamine's role in movement, motivation, and goal-directed planning.

Dopamine: The Neuromodulator of Long-Term Synaptic Plasticity, Reward and Movement Control

Dopamine (DA) is a key neurotransmitter involved in multiple physiological functions including motor control, modulation of affective and emotional states, reward mechanisms, reinforcement of behavior, and selected higher cognitive functions. Dysfunction in dopaminergic transmission is recognized as a core alteration in several devastating neurological and psychiatric disorders, including Parkinson's disease (PD), schizophrenia, bipolar disorder, attention deficit hyperactivity disorder (ADHD) and addiction. Here we will discuss the current insights on the role of DA in motor control and reward learning mechanisms and its involvement in the modulation of synaptic dynamics through different pathways. In particular, we will consider the role of DA as neuromodulator of two forms of synaptic plasticity, known as long-term potentiation (LTP) and long-term depression (LTD) in several cortical and subcortical areas. Finally, we will delineate how the effect of DA on dendritic spines places this molecule at the interface between the motor and the cognitive systems. Specifically, we will be focusing on PD, vascular dementia, and schizophrenia.

Dopamine in Fear Extinction

The ability to extinguish fear memories when threats are no longer present is critical for adaptive behavior. Fear extinction represents a new learning process that eventually leads to the formation of extinction memories. Understanding the neural basis of fear extinction has considerable clinical significance as deficits in extinction learning are the hallmark of human anxiety disorders. In recent years, the dopamine (DA) system has emerged as one of the key regulators of fear extinction. In this review article, we highlight recent advances that have demonstrated the crucial role DA plays in mediating different phases of fear extinction. Emerging concepts and outstanding questions for future research are also discussed.

Dorsal Raphe Dopamine Neurons Signal Motivational Salience Dependent on Internal State, Expectation, and Behavioral Context

The ability to recognize motivationally salient events and adaptively respond to them is critical for survival. Here, we tested whether dopamine (DA) neurons in the dorsal raphe nucleus (DRN) contribute to this process in both male and female mice. Population recordings of DRN^DA neurons during associative learning tasks showed that their activity dynamically tracks the motivational salience, developing excitation to both reward-paired and shock-paired cues. The DRN^DA response to reward-predicting cues was diminished after satiety, suggesting modulation by internal states. DRN^DA activity was also greater for unexpected outcomes than for expected outcomes. Two-photon imaging of DRN^DA neurons demonstrated that the majority of individual neurons developed activation to reward-predicting cues and reward but not to shock-predicting cues, which was surprising and qualitatively distinct from the population results. Performing the same fear learning procedures in freely-moving and head-fixed groups revealed that head-fixation itself abolished the neural response to aversive cues, indicating its modulation by behavioral context. Overall, these results suggest that DRN^DA neurons encode motivational salience, dependent on internal and external factors.SIGNIFICANCE STATEMENT Dopamine (DA) contributes to motivational control, composed of at least two functional cell types, one signaling for motivational value and another for motivational salience. Here, we demonstrate that DA neurons in the dorsal raphe nucleus (DRN) encode the motivational salience in associative learning tasks. Neural responses were dynamic and modulated by the animal's internal state. The majority of single-cells developed responses to reward or paired cues, but not to shock-predicting cues. Additional experiments with freely-moving and head-fixed mice showed that head-fixation abolished the development of cue responses during fear learning. This work provides further characterization on the functional roles of overlooked DRN^DA populations and an example that neural responses can be altered by head-fixation, which is commonly used in neuroscience.

A Comparison of Dopaminergic and Cholinergic Populations Reveals Unique Contributions of VTA Dopamine Neurons to Short-Term Memory

We systematically compare the contributions of two dopaminergic and two cholinergic ascending populations to a spatial short-term memory task in rats. In ventral tegmental area dopamine (VTA-DA) and nucleus basalis cholinergic (NB-ChAT) populations, trial-by-trial fluctuations in activity during the delay period relate to performance with an inverted-U, despite the fact that both populations have low activity during that time. Transient manipulations reveal that only VTA-DA neurons, and not the other three populations we examine, contribute causally and selectively to short-term memory. This contribution is most significant during the delay period, when both increases and decreases in VTA-DA activity impair short-term memory. Our results reveal a surprising dissociation between when VTA-DA neurons are most active and when they have the biggest causal contribution to short-term memory, and they also provide support for classic ideas about an inverted-U relationship between neuromodulation and cognition.

The Good, the Bad and the Unknown Aspects of Ghrelin in Stress Coping and Stress-Related Psychiatric Disorders

Ghrelin is a peptide hormone released by specialized X/A cells in the stomach and activated by acylation. Following its secretion, it binds to ghrelin receptors in the periphery to regulate energy balance, but it also acts on the central nervous system where it induces a potent orexigenic effect. Several types of stressors have been shown to stimulate ghrelin release in rodents, including nutritional stressors like food deprivation, but also physical and psychological stressors such as foot shocks, social defeat, forced immobilization or chronic unpredictable mild stress. The mechanism through which these stressors drive ghrelin release from the stomach lining remains unknown and, to date, the resulting consequences of ghrelin release for stress coping remain poorly understood. Indeed, ghrelin has been proposed to act as a stress hormone that reduces fear, anxiety- and depression-like behaviors in rodents but some studies suggest that ghrelin may - in contrast - promote such behaviors. In this review, we aim to provide a comprehensive overview of the literature on the role of the ghrelin system in stress coping. We discuss whether ghrelin release is more than a byproduct of disrupted energy homeostasis following stress exposure. Furthermore, we explore the notion that ghrelin receptor signaling in the brain may have effects independent of circulating ghrelin and in what way this might influence stress coping in rodents. Finally, we examine how the ghrelin system could be utilized as a therapeutic avenue in stress-related psychiatric disorders (with a focus on anxiety- and trauma-related disorders), for example to develop novel biomarkers for a better diagnosis or new interventions to tackle relapse or treatment resistance in patients.