A dopaminergic switch for fear to safety transitions

Pharmacological manipulations of the dorsomedial and dorsolateral striatum during fear extinction reveal opposing roles in fear renewal

Systemic manipulations that enhance dopamine (DA) transmission around the time of fear extinction can strengthen fear extinction and reduce conditioned fear relapse. Prior studies investigating the brain regions where DA augments fear extinction focus on targets of mesolimbic and mesocortical DA systems originating in the ventral tegmental area, given the role of these DA neurons in prediction error. The dorsal striatum (DS), a primary target of the nigrostriatal DA system originating in the substantia nigra (SN), is implicated in behaviors beyond its canonical role in movement, such as reward and punishment, goal-directed action, and stimulus-response associations, but whether DS DA contributes to fear extinction is unknown. We have observed that chemogenetic stimulation of SN DA neurons during fear extinction prevents the return of fear in contexts different from the extinction context, a form of relapse called renewal. This effect of SN DA stimulation is mimicked by a DA D1 receptor (D1R) agonist injected into the DS, thus implicating DS DA in fear extinction. Different DS subregions subserve unique functions of the DS, but it is unclear where in the DS D1R agonist acts during fear extinction to reduce renewal. Furthermore, although fear extinction increases neural activity in DS subregions, whether neural activity in DS subregions is causally involved in fear extinction is unknown. To explore the role of DS subregions in fear extinction, adult, male Long-Evans rats received microinjections of either the D1R agonist SKF38393 or a cocktail consisting of GABAA/GABAB receptor agonists muscimol/baclofen selectively into either dorsomedial (DMS) or dorsolateral (DLS) DS subregions immediately prior to fear extinction, and extinction retention and renewal were subsequently assessed drug-free. While increasing D1R signaling in the DMS during fear extinction did not impact fear extinction retention or renewal, DMS inactivation reduced later renewal. In contrast, DLS inactivation had no effect on fear extinction retention or renewal but increasing D1R signaling in the DLS during extinction reduced fear renewal. These data suggest that DMS and DLS activity during fear extinction can have opposing effects on later fear renewal, with the DMS promoting renewal and the DLS opposing renewal. Mechanisms through which the DS could influence the contextual gating of fear extinction are discussed.

Memory Trace for Fear Extinction: Fragile yet Reinforceable

Fear extinction is a biological process in which learned fear behavior diminishes without anticipated reinforcement, allowing the organism to re-adapt to ever-changing situations. Based on the behavioral hypothesis that extinction is new learning and forms an extinction memory, this new memory is more readily forgettable than the original fear memory. The brain's cellular and synaptic traces underpinning this inherently fragile yet reinforceable extinction memory remain unclear. Intriguing questions are about the whereabouts of the engram neurons that emerged during extinction learning and how they constitute a dynamically evolving functional construct that works in concert to store and express the extinction memory. In this review, we discuss recent advances in the engram circuits and their neural connectivity plasticity for fear extinction, aiming to establish a conceptual framework for understanding the dynamic competition between fear and extinction memories in adaptive control of conditioned fear responses.

Mesostriatal dopamine is sensitive to changes in specific cue-reward contingencies

Learning causal relationships relies on understanding how often one event precedes another. To investigate how dopamine neuron activity and neurotransmitter release change when a retrospective relationship is degraded for a specific pair of events, we used outcome-selective Pavlovian contingency degradation in rats. Conditioned responding was attenuated for the cue-reward contingency that was degraded, as was dopamine neuron activity in the midbrain and dopamine release in the ventral striatum in response to the cue and subsequent reward. Contingency degradation also abolished the trial-by-trial history dependence of the dopamine responses at the time of trial outcome. This profile of changes in cue- and reward-evoked responding is not easily explained by a standard reinforcement learning model. An alternative model based on learning causal relationships was better able to capture dopamine responses during contingency degradation, as well as conditioned behavior following optogenetic manipulations of dopamine during noncontingent rewards. Our results suggest that mesostriatal dopamine encodes the contingencies between meaningful events during learning.

Valence ambiguity dynamically shapes striatal dopamine heterogeneity

Adaptive decision making relies on dynamic updating of learned associations where environmental cues come to predict positive and negatively valenced stimuli, such as food or threat. Flexible cue-guided behaviors depend on a network of brain systems, including dopamine signaling in the striatum, which is critical for learning and maintenance of conditioned behaviors. Critically, it remains unclear how dopamine signaling encodes multi-valent, dynamic learning contexts, where positive and negative associations must be rapidly disambiguated. To understand this, we employed a Pavlovian discrimination paradigm, where cues predicting positive and negative outcomes were intermingled during conditioning sessions, and their meaning was serially reversed across training. We found that rats readily distinguished these cues, and updated their behavior rapidly upon valence reversal. Using fiber photometry, we recorded dopamine signaling in three major striatal subregions -,the dorsolateral striatum (DLS), the nucleus accumbens core, and the nucleus accumbens medial shell - and found heterogeneous responses to positive and negative conditioned cues and their predicted outcomes. Valence ambiguity introduced by cue reversal reshaped striatal dopamine on different timelines: nucleus accumbens core and shell signals updated more readily than those in the DLS. Together, these results suggest that striatal dopamine flexibly encodes multi-valent learning contexts, and these signals are dynamically modulated by changing contingencies to resolve ambiguity about the meaning of environmental cues.

Decoding neural reactivation of threat during fear learning, extinction, and recall in a randomized clinical trial of L-DOPA among women with PTSD

BACKGROUND

Laboratory paradigms are widely used to study fear learning in posttraumatic stress disorder (PTSD). Recent basic science models demonstrate that, during fear learning, patterns of activity in large neuronal ensembles for the conditioned stimuli (CS) begin to reinstate neural activity patterns for the unconditioned stimuli (US), suggesting a direct way of quantifying fear memory strength for the CS. Here, we translate this concept to human neuroimaging and test the impact of post-learning dopaminergic neurotransmission on fear memory strength during fear acquisition, extinction, and recall among women with PTSD in a re-analysis of previously reported data.

METHODS

Participants (N = 79) completed a context-dependent fear acquisition and extinction task on day 1 and extinction recall tests 24 h later. We decoded activity patterns in large-scale functional networks for the US, then applied this decoder to activity patterns toward the CS on day 1 and day 2.

RESULTS

US decoder output for the CS+ increased during acquisition and decreased during extinction in networks traditionally implicated in human fear learning. The strength of US neural reactivation also predicted individuals skin conductance responses. Participants randomized to receive L-DOPA (n = 43) following extinction on day 1 demonstrated less US neural reactivation on day 2 relative to the placebo group (n = 28).

CONCLUSION

These results support neural reactivation as a measure of memory strength between competing memories of threat and safety and further demonstrate the role of dopaminergic neurotransmission in the consolidation of fear extinction memories.

Foxp2 Is Required for Nucleus Accumbens-mediated Multifaceted Limbic Function

The forkhead box protein P2 (Foxp2), initially identified for its role in speech and language development, plays an important role in neural development. Previous studies investigated the function of the Foxp2 gene by deleting or mutating Foxp2 from developmental stages. Little is known about its physiological function in adult brains. Although Foxp2 has been well studied in the dorsal striatum, its function in the nucleus accumbens (NAc) of the ventral striatum remains elusive. Here, we examine the physiological function of Foxp2 in NAc of mouse brains. We conditionally knocked out Foxp2 by microinjections of AAV-EGFP-Cre viruses into the medial shell of NAc of Foxp2 floxed (cKO) mice. Immunostaining showed increased c-Fos positive cells in cKO NAc at basal levels, suggesting an abnormality in Foxp2-deficient NAc cells. Unbiased behavioral profiling of Foxp2 cKO mice showed abnormalities in limbic-associated function. Foxp2 cKO mice exhibited abnormal social novelty without preference for interaction with strangers and familiar mice. In appetitive reward learning, Foxp2 cKO mice failed to learn the time expectancy of food delivery. In fear learning, Foxp2 cKO mice exhibited abnormal increases in freezing levels in response to tone paired with foot shock during fear conditioning. The extinction of the fear response was also altered in Foxp2 cKO mice. In contrast, conditional knockout of Foxp2 in NAc did not affect locomotion, motor coordination, thermal pain sensation, anxiety- and depression-like behaviors. Collectively, our study suggests that Foxp2 has a multifaceted physiological role in NAc in the regulation of limbic function in the adult brain.

65 years of research on dopamine's role in classical fear conditioning and extinction: A systematic review

Dopamine, a catecholamine neurotransmitter, has historically been associated with the encoding of reward, whereas its role in aversion has received less attention. Here, we systematically gathered the vast evidence of the role of dopamine in the simplest forms of aversive learning: classical fear conditioning and extinction. In the past, crude methods were used to augment or inhibit dopamine to study its relationship with fear conditioning and extinction. More advanced techniques such as conditional genetic, chemogenic and optogenetic approaches now provide causal evidence for dopamine's role in these learning processes. Dopamine neurons encode conditioned stimuli during fear conditioning and extinction and convey the signal via activation of D1-4 receptor sites particularly in the amygdala, prefrontal cortex and striatum. The coordinated activation of dopamine receptors allows for the continuous formation, consolidation, retrieval and updating of fear and extinction memory in a dynamic and reciprocal manner. Based on the reviewed literature, we conclude that dopamine is crucial for the encoding of classical fear conditioning and extinction and contributes in a way that is comparable to its role in encoding reward.

Fear extinction rescuing effects of dopamine and L-DOPA in the ventromedial prefrontal cortex

The ventromedial prefrontal cortex (vmPFC; rodent infralimbic cortex (IL)), is posited to be an important locus of fear extinction-facilitating effects of the dopamine (DA) bio-precursor, L-DOPA, but this hypothesis remains to be formally tested. Here, in a model of impaired fear extinction (the 129S1/SvImJ inbred mouse strain; S1), we monitored extracellular DA dynamics via in vivo microdialysis in IL during fear extinction and following L-DOPA administration. Systemic L-DOPA caused sustained elevation of extracellular DA levels in IL and increased neuronal activation in a subpopulation of IL neurons. Systemic L-DOPA enabled extinction learning and promoted extinction retention at one but not ten days after training. Conversely, direct microinfusion of DA into IL produced long-term fear extinction (an effect that was insensitive to ɑ-/ß-adrenoreceptor antagonism). However, intra-IL delivery of a D1-like or D2 receptor agonist did not facilitate extinction. Using ex vivo multi-electrode array IL neuronal recordings, along with ex vivo quantification of immediate early genes and DA receptor signalling markers in mPFC, we found evidence of reduced DA-evoked mPFC network responses in S1 as compared with extinction-competent C57BL/6J mice that were partially driven by D1 receptor activation. Together, our data demonstrate that locally increasing DA in IL is sufficient to produce lasting rescue of impaired extinction. The finding that systemic L-DOPA increased IL DA levels, but had only transient effects on extinction, suggests L-DOPA failed to reach a threshold level of IL DA or produced opposing behavioural effects in other brain regions. Collectively, our findings provide further insight into the neural basis of the extinction-promoting effects of DA and L-DOPA in a clinically relevant animal model, with possible implications for therapeutically targeting the DA system in anxiety and trauma-related disorders.

Stress relief as a natural resilience mechanism against depression-like behaviors

Relief, the appetitive state after the termination of aversive stimuli, is evolutionarily conserved. Understanding the behavioral role of this well-conserved phenomenon and its underlying neurobiological mechanisms are open and important questions. Here, we discover that the magnitude of relief from physical stress strongly correlates with individual resilience to depression-like behaviors in chronic stressed mice. Notably, blocking stress relief causes vulnerability to depression-like behaviors, whereas natural rewards supplied shortly after stress promotes resilience. Stress relief is mediated by reward-related mesolimbic dopamine neurons, which show minute-long, persistent activation after stress termination. Circuitry-wise, activation or inhibition of circuits downstream of the ventral tegmental area during the transient relief period bi-directionally regulates depression resilience. These results reveal an evolutionary function of stress relief in depression resilience and identify the neural substrate mediating this effect. Importantly, our data suggest a behavioral strategy of augmenting positive valence of stress relief with natural rewards to prevent depression.

Functional architecture of dopamine neurons driving fear extinction learning

The ability to extinguish fear responses to stimuli that no longer predict danger is critical for adaptive behavior and increases the likelihood of survival. During fear extinction, dopamine (DA) neurons signal the absence of the expected aversive outcome, and this extinction prediction error (EPE) signal is crucial for initiating and driving extinction learning. However, the neural circuits underlying the EPE signal have remained elusive. Here, we investigate the input-output circuitry of EPE-encoding DA neurons in male mice. By employing projection-specific fiber photometry and optogenetics, we demonstrate that these neurons project to a restricted subregion of the nucleus accumbens. Comprehensive anatomical analyses, as well as projection-specific chemogenetic manipulations combined with recordings of DA biosensors, further uncover the dorsal raphe as one key input structure critical for generating the EPE signal. Together, our results reveal for the first time the functional architecture of EPE-encoding DA neurons crucial for driving fear extinction learning.

Nigrostriatal dopamine modulates the striatal-amygdala pathway in auditory fear conditioning

The auditory striatum, a sensory portion of the dorsal striatum, plays an essential role in learning and memory. In contrast to its roles and underlying mechanisms in operant conditioning, however, little is known about its contribution to classical auditory fear conditioning. Here, we reveal the function of the auditory striatum in auditory-conditioned fear memory. We find that optogenetically inhibiting auditory striatal neurons impairs fear memory formation, which is mediated through the striatal-amygdala pathway. Using calcium imaging in behaving mice, we find that auditory striatal neuronal responses to conditioned tones potentiate across memory acquisition and expression. Furthermore, nigrostriatal dopaminergic projections plays an important role in modulating conditioning-induced striatal potentiation. Together, these findings demonstrate the existence of a nigro-striatal-amygdala circuit for conditioned fear memory formation and expression.

A cortico-amygdala neural substrate for endocannabinoid modulation of fear extinction

Preclinical and clinical studies implicate endocannabinoids (eCBs) in fear extinction, but the underlying neural circuit basis of these actions is unclear. Here, we employed in vivo optogenetics, eCB biosensor imaging, ex vivo electrophysiology, and CRISPR-Cas9 gene editing in mice to examine whether basolateral amygdala (BLA)-projecting medial prefrontal cortex (mPFC) neurons represent a neural substrate for the effects of eCBs on extinction. We found that photoexcitation of mPFC axons in BLA during extinction mobilizes BLA eCBs. eCB biosensor imaging showed that eCBs exhibit a dynamic stimulus-specific pattern of activity at mPFC→BLA neurons that tracks extinction learning. Furthermore, using CRISPR-Cas9-mediated gene editing, we demonstrated that extinction memory formation involves eCB activity at cannabinoid CB1 receptors expressed at vmPFC→BLA synapses. Our findings reveal the temporal characteristics and a neural circuit basis of eCBs' effects on fear extinction and inform efforts to target the eCB system as a therapeutic approach in extinction-deficient neuropsychiatric disorders.

The Basolateral Amygdala: The Core of a Network for Threat Conditioning, Extinction, and Second-Order Threat Conditioning

Threat conditioning, extinction, and second-order threat conditioning studied in animal models provide insight into the brain-based mechanisms of fear- and anxiety-related disorders and their treatment. Much attention has been paid to the role of the basolateral amygdala (BLA) in such processes, an overview of which is presented in this review. More recent evidence suggests that the BLA serves as the core of a greater network of structures in these forms of learning, including associative and sensory cortices. The BLA is importantly regulated by hippocampal and prefrontal inputs, as well as by the catecholaminergic neuromodulators, norepinephrine and dopamine, that may provide important prediction-error or learning signals for these forms of learning. The sensory cortices may be required for the long-term storage of threat memories. As such, future research may further investigate the potential of the sensory cortices for the long-term storage of extinction and second-order conditioning memories.

Dopamine release at the time of a predicted aversive outcome causally controls the trajectory and expression of conditioned behavior

Dopamine release in the nucleus accumbens (NAc) is causally linked to adaptive aversive learning, and its dysregulation is a core phenotype in anxiety and stress disorders. Here, we record NAc core dopamine during a task where mice learn to discriminate between cues signaling two types of outcomes: (1) footshock presentation and (2) footshock omission. We show that dopamine release is evoked by footshock omission. This dopamine response is largest when the omission is unexpected and decreases over learning, and artificially increasing this signal disrupts discrimination learning. Conversely, optogenetic inhibition of dopamine responses to the footshock itself impairs learning. Finally, theory-driven computational modeling suggests that these effects can be explained by dopamine signaling the perceived saliency of predicted aversive events. Together, we elucidate the role of NAc dopamine in aversive learning and offer potential avenues for understanding the neural mechanisms involved in anxiety and stress disorders.

Closed-loop brain stimulation augments fear extinction in male rats

Dysregulated fear reactions can result from maladaptive processing of trauma-related memories. In post-traumatic stress disorder (PTSD) and other psychiatric disorders, dysfunctional extinction learning prevents discretization of trauma-related memory engrams and generalizes fear responses. Although PTSD may be viewed as a memory-based disorder, no approved treatments target pathological fear memory processing. Hippocampal sharp wave-ripples (SWRs) and concurrent neocortical oscillations are scaffolds to consolidate contextual memory, but their role during fear processing remains poorly understood. Here, we show that closed-loop, SWR triggered neuromodulation of the medial forebrain bundle (MFB) can enhance fear extinction consolidation in male rats. The modified fear memories became resistant to induced recall (i.e., 'renewal' and 'reinstatement') and did not reemerge spontaneously. These effects were mediated by D2 receptor signaling-induced synaptic remodeling in the basolateral amygdala. Our results demonstrate that SWR-triggered closed-loop stimulation of the MFB reward system enhances extinction of fearful memories and reducing fear expression across different contexts and preventing excessive and persistent fear responses. These findings highlight the potential of neuromodulation to augment extinction learning and provide a new avenue to develop treatments for anxiety disorders.

Fear extinction relies on ventral hippocampal safety codes shaped by the amygdala

Extinction memory retrieval is influenced by spatial contextual information that determines responding to conditioned stimuli (CS). However, it is poorly understood whether contextual representations are imbued with emotional values to support memory selection. Here, we performed activity-dependent engram tagging and in vivo single-unit electrophysiological recordings from the ventral hippocampus (vH) while optogenetically manipulating basolateral amygdala (BLA) inputs during the formation of cued fear extinction memory. During fear extinction when CS acquire safety properties, we found that CS-related activity in the vH reactivated during sleep consolidation and was strengthened upon memory retrieval. Moreover, fear extinction memory was facilitated when the extinction context exhibited precise coding of its affective zones. Last, these activity patterns along with the retrieval of the fear extinction memory were dependent on glutamatergic transmission from the BLA during extinction learning. Thus, fear extinction memory relies on the formation of contextual and stimulus safety representations in the vH instructed by the BLA.

VTA multifaceted modulation of CA1 local circuits

Excitatory pyramidal (PYR) cell activation of interneurons (INT) produces network oscillations that underlie cognitive processes in the CA1. Neural projections from the ventral tegmental area (VTA) to the hippocampus contribute to novelty detection by modulating CA1 PYR and INT activity. The role of the VTA in the VTA-hippocampus loop is mostly attributed to the dopamine neurons although the VTA glutamate-releasing terminals are dominant in the hippocampus. Because of the traditional focus on VTA dopamine circuits, how VTA glutamate inputs modulate PYR activation of INT in CA1 neuronal ensembles is poorly understood and has not been distinguished from the VTA dopamine inputs. By combining CA1 extracellular recording with VTA photostimulation in anesthetized mice, we compared the effects of VTA dopamine and glutamate input on CA1 PYR/INT connections. Stimulation of VTA glutamate neurons shortened PYR/INT connection time without altering the synchronization or connectivity strength. Conversely, activation of VTA dopamine inputs delayed CA1 PYR/INT connection time and increased the synchronization in putative pairs. Taken together, we conclude that VTA dopamine and glutamate projections produce tract-specific effects on CA1 PYR/INT connectivity and synchrony. As such, selective activation or co-activation of these systems will likely produce a range of modulatory effects on local CA1 circuits.

Acute stress modulates noradrenergic signaling in the ventral tegmental area-amygdalar circuit

Noradrenergic neurotransmission is a critical mediator of stress responses. In turn, exposure to stress induces noradrenergic system adaptations, some of which are implicated in the etiology of stress-related disorders. Adrenergic receptors (ARs) in the ventral tegmental area (VTA) have been demonstrated to regulate phasic dopamine (DA) release in the forebrain, necessary for behavioral responses to conditional cues. However, the impact of stress on noradrenergic modulation of the VTA has not been previously explored. We demonstrate that ARs in the VTA regulate dopaminergic activity in the VTA-BLA (basolateral amygdala) circuit, a key system for processing stress-related stimuli; and that such control is altered by acute stress. We utilized fast-scan cyclic voltammetry to assess the effects of intra-VTA microinfusion of α₁ -AR and α₂ -AR antagonists (terazosin and RX-821002, respectively), on electrically evoked phasic DA release in the BLA in stress-naïve and stressed (unavoidable electric shocks - UES) anesthetized male Sprague-Dawley rats. In addition, we used western blotting to explore UES-induced alterations in AR protein level in the VTA. Intra-VTA terazosin or RX-821002 dose-dependently attenuated DA release in the BLA. Interestingly, UES decreased the effects of intra-VTA α₂ -AR blockade on DA release (24 h but not 7 days after stress), while the effects of terazosin were unchanged. Despite changes in α₂ -AR physiological function in the VTA, UES did not alter α₂ -AR protein levels in either intracellular or membrane fractions. These findings demonstrate that NA-ergic modulation of the VTA-BLA circuit undergoes significant alterations in response to acute stress, with α₂ -AR signaling indicated as a key target.

Genes and pathways associated with fear discrimination identified by genome-wide DNA methylation and RNA-seq analyses in nucleus accumbens in mice

Fear memory is critical for individual survival. However, the maladaptive fear response is one of the hallmarks of fear-related disorders, which is characterized by the failure to discriminate threatening signals from neutral or safe cues. The biological mechanisms of fear discrimination remain to be clarified. In this study, we found that the nucleus accumbens (NAc) was indispensable for the formation of cued fear memory in mice, during which the expression of DNA methyltransferase 3a gene (DNMT3a) increased. Injection of Zebularine, a nonspecific DNMT inhibitor, into NAc immediately after conditioning induced a maladaptive fear response to neutral cue (CS^-). Using whole-genome bisulfite sequencing (WGBS), differentially methylated sites and methylated regions (DMRs) were investigated. 16,226 DMRs in the genenome were identified, in which, 214 genes with significant differences in their methylation levels and mRNA expression profiles were identified through correlation analysis. Notably, 15 genes were synaptic function-related and 8 genes were enriched in the cGMP-PKG signaling pathway. Moreover, inhibition of PKG impaired fear discrimination. Together, our results revealed the profile and role of genome-wide DNA methylation in NAc in the regulation of fear discrimination.

The cerebellum and fear extinction: evidence from rodent and human studies

The role of the cerebellum in emotional control has gained increasing interest, with studies showing it is involved in fear learning and memory in both humans and rodents. This review will focus on the contributions of the cerebellum to the extinction of learned fear responses. Extinction of fearful memories is critical for adaptive behaviour, and is clinically relevant to anxiety disorders such as post-traumatic stress disorder, in which deficits in extinction processes are thought to occur. We present evidence that supports cerebellar involvement in fear extinction, from rodent studies that investigate molecular mechanisms and functional connectivity with other brain regions of the known fear extinction network, to fMRI studies in humans. This evidence is considered in relation to the theoretical framework that the cerebellum is involved in the formation and updating of internal models of the inner and outer world by detecting errors between predicted and actual outcomes. In the case of fear conditioning, these internal models are thought to predict the occurrence of an aversive unconditioned stimulus (US), and when the aversive US is unexpectedly omitted during extinction learning the cerebellum uses prediction errors to update the internal model. Differences between human and rodent studies are highlighted to help inform future work.

Age-Related Changes in Risky Decision Making and Associated Neural Circuitry in a Rat Model

Altered decision making at advanced ages can have a significant impact on an individual's quality of life and the ability to maintain personal independence. Relative to young adults, older adults make less impulsive and less risky choices; although these changes in decision making could be considered beneficial, they can also lead to choices with potentially negative consequences (e.g., avoidance of medical procedures). Rodent models of decision making have been invaluable for dissecting cognitive and neurobiological mechanisms that contribute to age-related changes in decision making, but they have predominantly used costs related to timing or probability of reward delivery and have not considered other equally important costs, such as the risk of adverse consequences. The current study therefore used a rat model of decision making involving risk of explicit punishment to examine age-related changes in this form of choice behavior in male rats, and to identify potential cognitive and neurobiological mechanisms that contribute to these changes. Relative to young rats, aged rats displayed greater risk aversion, which was not attributable to reduced motivation for food, changes in shock sensitivity, or impaired cognitive flexibility. Functional MRI analyses revealed that, overall, functional connectivity was greater in aged rats compared with young rats, particularly among brain regions implicated in risky decision making such as basolateral amygdala, orbitofrontal cortex, and ventral tegmental area. Collectively, these findings are consistent with greater risk aversion found in older humans, and reveal age-related changes in brain connectivity.

Causally mapping human threat extinction relevant circuits with depolarizing brain stimulation methods

Laboratory threat extinction paradigms and exposure-based therapy both involve repeated, safe confrontation with stimuli previously experienced as threatening. This fundamental procedural overlap supports laboratory threat extinction as a compelling analogue of exposure-based therapy. Threat extinction impairments have been detected in clinical anxiety and may contribute to exposure-based therapy non-response and relapse. However, efforts to improve exposure outcomes using techniques that boost extinction - primarily rodent extinction - have largely failed to date, potentially due to fundamental differences between rodent and human neurobiology. In this review, we articulate a comprehensive pre-clinical human research agenda designed to overcome these failures. We describe how connectivity guided depolarizing brain stimulation methods (i.e., TMS and DBS) can be applied concurrently with threat extinction and dual threat reconsolidation-extinction paradigms to causally map human extinction relevant circuits and inform the optimal integration of these methods with exposure-based therapy. We highlight candidate targets including the amygdala, hippocampus, ventromedial prefrontal cortex, dorsal anterior cingulate cortex, and mesolimbic structures, and propose hypotheses about how stimulation delivered at specific learning phases could strengthen threat extinction.

No joy - why bother? Higher anhedonia relates to reduced pleasure from and motivation for threat avoidance

Anhedonia impairs various components of the pleasure cycle, including wanting, liking, and the learning of pleasure-related associations. While successfully controlling threats might be inherently pleasurable, it remains unclear whether anhedonia affects this form of pleasure as well. With aversive pictures as threats, we conducted an online study ( N = 200) to investigate the role of anhedonia during active avoidance learning process. Participants first learned cue-threat associations for different cues (threat vs. safety cues). In a subsequent avoidance learning phase, these cues signaled either avoidable, unavoidable, or no threat; participants could perform avoidance responses to prevent the upcoming threats during those cue presentations. Subjective relief pleasantness was measured after each threat omission. We found that higher trait anticipatory and consummatory anhedonia were both associated with lower relief pleasantness. Higher trait anticipatory anhedonia was also associated with fewer avoidance attempts. Since reduced threat-controlling behavior is reminiscent of a learned-helplessness state, the current results contribute to a better understanding of the connections between anhedonia and learned helplessness that have mostly been studied separately in the context of mood disturbance.

The modulation of emotional and social behaviors by oxytocin signaling in limbic network

Neuropeptides can exert volume modulation in neuronal networks, which account for a well-calibrated and fine-tuned regulation that depends on the sensory and behavioral contexts. For example, oxytocin (OT) and oxytocin receptor (OTR) trigger a signaling pattern encompassing intracellular cascades, synaptic plasticity, gene expression, and network regulation, that together function to increase the signal-to-noise ratio for sensory-dependent stress/threat and social responses. Activation of OTRs in emotional circuits within the limbic forebrain is necessary to acquire stress/threat responses. When emotional memories are retrieved, OTR-expressing cells act as gatekeepers of the threat response choice/discrimination. OT signaling has also been implicated in modulating social-exposure elicited responses in the neural circuits within the limbic forebrain. In this review, we describe the cellular and molecular mechanisms that underlie the neuromodulation by OT, and how OT signaling in specific neural circuits and cell populations mediate stress/threat and social behaviors. OT and downstream signaling cascades are heavily implicated in neuropsychiatric disorders characterized by emotional and social dysregulation. Thus, a mechanistic understanding of downstream cellular effects of OT in relevant cell types and neural circuits can help design effective intervention techniques for a variety of neuropsychiatric disorders.

Dynamic tripartite construct of interregional engram circuits underlies forgetting of extinction memory

Fear extinction allows for adaptive control of learned fear responses but often fails, resulting in a renewal or spontaneous recovery of the extinguished fear, i.e., forgetting of the extinction memory readily occurs. Using an activity-dependent neuronal labeling strategy, we demonstrate that engram neurons for fear extinction memory are dynamically positioned in the medial prefrontal cortex (mPFC), basolateral amygdala (BLA), and ventral hippocampus (vHPC), which constitute an engram construct in the term of directional engram synaptic connectivity from the BLA or vHPC to mPFC, but not that in the opposite direction, for retrieval of extinction memory. Fear renewal or spontaneous recovery switches the extinction engram construct from an accessible to inaccessible state, whereas additional extinction learning or optogenetic induction of long-term potentiation restores the directional engram connectivity and prevents the return of fear. Thus, the plasticity of engram construct underlies forgetting of extinction memory.

Insular cortical circuits as an executive gateway to decipher threat or extinction memory via distinct subcortical pathways

Threat and extinction memories are crucial for organisms’ survival in changing environments. These memories are believed to be encoded by separate ensembles of neurons in the brain, but their whereabouts remain elusive. Using an auditory fear-conditioning and extinction paradigm in male mice, here we discovered that two distinct projection neuron subpopulations in physical proximity within the insular cortex (IC), targeting the central amygdala (CeA) and nucleus accumbens (NAc), respectively, to encode fear and extinction memories. Reciprocal intracortical inhibition of these two IC subpopulations gates the emergence of either fear or extinction memory. Using rabies-virus-assisted tracing, we found IC-NAc projection neurons to be preferentially innervated by intercortical inputs from the orbitofrontal cortex (OFC), specifically enhancing extinction to override fear memory. These results demonstrate that IC serves as an operation node harboring distinct projection neurons that decipher fear or extinction memory under the top-down executive control from OFC.

Ensembles of fear and extinction memories compete and interact to drive opposing behaviors. Here the authors identified insular cortical circuits as an executive gateway that decipher between fear and extinction memories via distinct subcortical pathways.

Asymmetric representation of aversive prediction errors in Pavlovian threat conditioning

Survival in biological environments requires learning associations between predictive sensory cues and threatening outcomes. Such aversive learning may be implemented through reinforcement learning algorithms that are driven by the signed difference between expected and encountered outcomes, termed prediction errors (PEs). While PE-based learning is well established for reward learning, the role of putative PE signals in aversive learning is less clear. Here, we used functional magnetic resonance imaging in humans (21 healthy men and women) to investigate the neural representation of PEs during maintenance of learned aversive associations. Four visual cues, each with a different probability (0, 33, 66, 100%) of being followed by an aversive outcome (electric shock), were repeatedly presented to participants. We found that neural activity at omission (US-) but not occurrence of the aversive outcome (US+) encoded PEs in the medial prefrontal cortex. More expected omission of aversive outcome was associated with lower neural activity. No neural signals fulfilled axiomatic criteria, which specify necessary and sufficient components of PE signals, for signed PE representation in a whole-brain search or in a-priori regions of interest. Our results might suggest that, different from reward learning, aversive learning does not involve signed PE signals that are represented within the same brain region for all conditions.

Overnight fasting affects avoidance learning and relief

OBJECTIVES

prolonged fasting influences threat and reward processing, two fundamental systems underpinning adaptive behaviors. In animals, overnight fasting sensitizes the mesolimbic-dopaminergic activity governing avoidance, reward, and fearextinction learning. Despite evidence that overnight fasting may also affect reward and fear learning in humans, effects on human avoidance learning have not been studied yet. Here, we examined the effects of 16 h-overnight fasting on instrumental avoidance and relief from threat omission.

METHODS

to this end, 50 healthy women were randomly assigned to a Fasting (N = 25) or a Re-feeding group (N = 25) and performed an Avoidance-Relief Task.

RESULTS

we found that fasting decreases unnecessary avoidance during signaled safety; this effect was mediated via a reduction in relief pleasantness during signaled absence of threat. A fasting-induced reduction in relief was also found during fear extinction learning.

DISCUSSION

we conclude that fasting optimizes avoidance and safety learning. Future studies should test whether these effects also hold for anxious individuals.

Rewarded Extinction Increases Amygdalar Connectivity and Stabilizes Long-Term Memory Traces in the vmPFC

Neurobiological evidence in rodents indicates that threat extinction incorporates reward neurocircuitry. Consequently, incorporating reward associations with an extinction memory may be an effective strategy to persistently attenuate threat responses. Moreover, while there is considerable research on the short-term effects of extinction strategies in humans, the long-term effects of extinction are rarely considered. In a within-subjects fMRI study with both female and male participants, we compared counterconditioning (CC; a form of rewarded-extinction) to standard extinction at recent (24 h) and remote (approximately one month) retrieval tests. Relative to standard extinction, rewarded extinction diminished 24-h relapse of arousal and threat expectancy, and reduced activity in brain regions associated with the appraisal and expression of threat (e.g., thalamus, insula, periaqueductal gray). The retrieval of reward-associated extinction memory was accompanied by functional connectivity between the amygdala and the ventral striatum, whereas the retrieval of standard-extinction memories was associated with connectivity between the amygdala and ventromedial prefrontal cortex (vmPFC). One month later, the retrieval of both standard-extinction and rewarded-extinction was associated with amygdala-vmPFC connectivity. However, only rewarded extinction created a stable memory trace in the vmPFC, identified through overlapping multivariate patterns of fMRI activity from extinction to 24-h and one-month retrieval. These findings provide new evidence that reward may generate a more stable and enduring memory trace of attenuated threat in humans.SIGNIFICANCE STATEMENT Prevalent treatments for pathologic fear and anxiety are based on the principles of Pavlovian extinction. Unfortunately, extinction forms weak memories that only temporarily inhibit the retrieval of threat associations. Thus, to increase the translational relevance of extinction research, it is critical to investigate whether extinction can be augmented to form a more enduring memory, especially after long intervals. Here, we used a multiday fMRI paradigm in humans to compare the short-term and long-term neurobehavioral effects of aversive-to-appetitive counterconditioning (CC), a form of augmented extinction. Our results provide novel evidence that including an appetitive stimulus during extinction can reduce short-term threat relapse and stabilize the memory trace of extinction in the ventromedial prefrontal cortex (vmPFC), for at least one month after learning.

ADHD co-morbidities: A review of implication of gene × environment effects with dopamine-related genes

ADHD is a major burden in adulthood, where co-morbid conditions such as depression, substance use disorder and obesity often dominate the clinical picture. ADHD has substantial shared heritability with other mental disorders, contributing to comorbidity. However, environmental risk factors exist but their interaction with genetic makeup, especially in relation to comorbid disorders, remains elusive. This review for the first time summarizes present knowledge on gene x environment (GxE) interactions regarding the dopamine system. Hitherto, mainly candidate (GxE) studies were performed, focusing on the genes DRD4, DAT1 and MAOA. Some evidence suggest that the variable number tandem repeats in DRD4 and MAOA may mediate GxE interactions in ADHD generally, and comorbid conditions specifically. Nevertheless, even for these genes, common variants are bound to suggest risk only in the context of gender and specific environments. For other polymorphisms, evidence is contradictory and less convincing. Particularly lacking are longitudinal studies testing the interaction of well-defined environmental with polygenic risk scores reflecting the dopamine system in its entirety.

Conditional Regulation of Blood Pressure in Response to Emotional Stimuli by the Central Nucleus of the Amygdala in Rats

Humans and animals can determine whether a situation is favorable to them and act accordingly. For this, the autonomic tuning of the cardiovascular system to supply energy to active skeletal muscles through the circulatory system is as important as motor control. However, how the autonomic cardiovascular responses are regulated in dynamically changing environments and the neuronal mechanisms underlying these responses remain unclear. To resolve these issues, we recorded the blood pressure and heart rate of head-restrained rats during dynamically changing appetitive and aversive classical conditioning tasks. The rats displayed various associations between conditioned stimuli and unconditioned stimuli in appetitive (sucrose water), neutral (no outcome), and aversive (air puff) blocks. The blood pressure and heart rate in the appetitive block gradually increased in response to the reward-predicting cue and the response to the actual reward vigorously increased. The reward-predictive response was significantly higher than the responses obtained in the neutral and aversive condition blocks. To investigate whether the reward-predictive pressor response was caused by orofacial movements such as anticipatory licking behavior, we separately analyzed high- and low-licking trials. The conditioned pressor response was observed even in trials with low-licking behaviors. Blood pressure and heart rate responses to the air puff-predicting cue in the aversive block were not significantly different from the responses in the neutral block. The conditioned blood pressure response rapidly changed with condition block switching. Furthermore, to examine the contribution of the amygdala as an emotion center to these conditioned responses, we bilaterally microinjected a GABA_A receptor agonist, muscimol, into the central nucleus of the amygdala. Pharmacological inactivation of the central nucleus of the amygdala significantly decreased the reward-predictive pressor responses. These results suggest that the blood pressure is adaptively and rapidly regulated by emotional conditioned stimuli and that the central nucleus of the amygdala participates in regulating the pressor response in dynamically changing situations.

Dopamine modulates visual threat processing in the superior colliculus via D2 receptors

Innate defensive responses, unlearned behaviors improving individuals’ chances of survival, have been found to involve the dopamine (DA) system. In the superior colliculus (SC), known for its role in defensive behaviors to visual threats, neurons expressing dopaminergic receptors of type 1 (Drd1+) and of type 2 (Drd2+) have been identified. We hypothesized that SC neurons expressing dopaminergic receptors may play a role in promoting innate defensive responses. Optogenetic activation of SC Drd2+ neurons, but not Drd1+ neurons, triggered defensive behaviors. Chemogenetic inhibition of SC Drd2+ neurons decreased looming-induced defensive behaviors, as well as pretreatment with the pharmacological Drd2+ agonist quinpirole, suggesting an essential role of Drd2 receptors in the regulation of innate defensive behavior. Input and output viral tracing revealed SC Drd2+ neurons mainly receive moderate inputs from the locus coeruleus (LC). Our results suggest a sophisticated regulatory role of DA and its receptor system in innate defensive behavior.

•

Optogenetic activation of SC Drd2 + neurons, but not Drd1 + , induces defensive behaviors

•

Repeated activation of SC Drd2 + provokes aversive memory and depression-like behavior

•

Chemogenetic and pharmacological inhibition of SC Drd2 + impaired defensive behaviors

•

Monosynaptic tracing revealed SC Drd2 + neurons mainly receive TH + projections from LC

Parsing neural circuits of fear learning and extinction across basic and clinical neuroscience: Towards better translation

Over the past decades, studies of fear learning and extinction have advanced our understanding of the neurobiology of threat and safety learning. Animal studies can provide mechanistic/causal insights into human brain regions and their functional connectivity involved in fear learning and extinction. Findings in humans, conversely, may further enrich our understanding of neural circuits in animals by providing macroscopic insights at the level of brain-wide networks. Nevertheless, there is still much room for improvement in translation between basic and clinical research on fear learning and extinction. Through the lens of neural circuits, in this article, we aim to review the current knowledge of fear learning and extinction in both animals and humans, and to propose strategies to fill in the current knowledge gap for the purpose of enhancing clinical benefits.

From Biological Synapses to “Intelligent” Robots

This selective review explores biologically inspired learning as a model for intelligent robot control and sensing technology on the basis of specific examples. Hebbian synaptic learning is discussed as a functionally relevant model for machine learning and intelligence, as explained on the basis of examples from the highly plastic biological neural networks of invertebrates and vertebrates. Its potential for adaptive learning and control without supervision, the generation of functional complexity, and control architectures based on self-organization is brought forward. Learning without prior knowledge based on excitatory and inhibitory neural mechanisms accounts for the process through which survival-relevant or task-relevant representations are either reinforced or suppressed. The basic mechanisms of unsupervised biological learning drive synaptic plasticity and adaptation for behavioral success in living brains with different levels of complexity. The insights collected here point toward the Hebbian model as a choice solution for “intelligent” robotics and sensor systems.

Neuronal Circuits Associated with Fear Memory: Potential Therapeutic Targets for Posttraumatic Stress Disorder

Posttraumatic stress disorder (PTSD) is a psychiatric disorder that is associated with long-lasting memories of traumatic experiences. Extinction and discrimination of fear memory have become therapeutic targets for PTSD. Newly developed optogenetics and advanced in vivo imaging techniques have provided unprecedented spatiotemporal tools to characterize the activity, connectivity, and functionality of specific cell types in complicated neuronal circuits. The use of such tools has offered mechanistic insights into the exquisite organization of the circuitry underlying the extinction and discrimination of fear memory. This review focuses on the acquisition of more detailed, comprehensive, and integrated neural circuits to understand how the brain regulates the extinction and discrimination of fear memory. A future challenge is to translate these researches into effective therapeutic treatment for PTSD from the perspective of precise regulation of the neural circuits associated with the extinction and discrimination of fear memories.

Forgetting as a form of adaptive engram cell plasticity

One leading hypothesis suggests that memories are stored in ensembles of neurons (or 'engram cells') and that successful recall involves reactivation of these ensembles. A logical extension of this idea is that forgetting occurs when engram cells cannot be reactivated. Forms of 'natural forgetting' vary considerably in terms of their underlying mechanisms, time course and reversibility. However, we suggest that all forms of forgetting involve circuit remodelling that switches engram cells from an accessible state (where they can be reactivated by natural recall cues) to an inaccessible state (where they cannot). In many cases, forgetting rates are modulated by environmental conditions and we therefore propose that forgetting is a form of neuroplasticity that alters engram cell accessibility in a manner that is sensitive to mismatches between expectations and the environment. Moreover, we hypothesize that disease states associated with forgetting may hijack natural forgetting mechanisms, resulting in reduced engram cell accessibility and memory loss.

Neural Circuits Underlying Behavioral Flexibility: Insights From Drosophila

Behavioral flexibility is critical to survival. Animals must adapt their behavioral responses based on changes in the environmental context, internal state, or experience. Studies in Drosophila melanogaster have provided insight into the neural circuit mechanisms underlying behavioral flexibility. Here we discuss how Drosophila behavior is modulated by internal and behavioral state, environmental context, and learning. We describe general principles of neural circuit organization and modulation that underlie behavioral flexibility, principles that are likely to extend to other species.

The prefrontal cortex, pathological anxiety, and anxiety disorders

Anxiety is experienced in response to threats that are distal or uncertain, involving changes in one's subjective state, autonomic responses, and behavior. Defensive and physiologic responses to threats that involve the amygdala and brainstem are conserved across species. While anxiety responses typically serve an adaptive purpose, when excessive, unregulated, and generalized, they can become maladaptive, leading to distress and avoidance of potentially threatening situations. In primates, anxiety can be regulated by the prefrontal cortex (PFC), which has expanded in evolution. This prefrontal expansion is thought to underlie primates' increased capacity to engage high-level regulatory strategies aimed at coping with and modifying the experience of anxiety. The specialized primate lateral, medial, and orbital PFC sectors are connected with association and limbic cortices, the latter of which are connected with the amygdala and brainstem autonomic structures that underlie emotional and physiological arousal. PFC pathways that interface with distinct inhibitory systems within the cortex, the amygdala, or the thalamus can regulate responses by modulating neuronal output. Within the PFC, pathways connecting cortical regions are poised to reduce noise and enhance signals for cognitive operations that regulate anxiety processing and autonomic drive. Specialized PFC pathways to the inhibitory thalamic reticular nucleus suggest a mechanism to allow passage of relevant signals from thalamus to cortex, and in the amygdala to modulate the output to autonomic structures. Disruption of specific nodes within the PFC that interface with inhibitory systems can affect the negative bias, failure to regulate autonomic arousal, and avoidance that characterize anxiety disorders.

The influence of anesthesia and surgery on fear extinction

Accumulating evidence has demonstrated significant clinical post-traumatic stress disorder (PTSD) symptoms after anesthesia or surgery. Fear extinction dysfunction is a notable feature of PTSD. Although anesthetics and surgery profoundly affect memory processes, their designated effects on fear extinction have not been dissertated. Previous studies have suggested that innate immune system activation disrupts fear extinction, and surgery has been shown to increase the inflammatory response. Thus, in the current study, we examined the effects of propofol, sevoflurane, dexmedetomidine and surgery on fear extinction in adolescent mice, and further tested whether dexmedetomidine could reverse the injury effect of surgery on fear extinction through its anti-inflammatory effects. Our results showed that propofol (200 mg/kg) impaired the acquisition and recall of cued fear extinction, and surgery disrupted cued fear extinction acquisition/recall and consolidation. In contrast to cued fear extinction, contextual fear extinction was not affected by propofol or surgery. Moreover, dexmedetomidine prevented surgery-induced impairment of cued extinction acquisition and recall but not consolidation. Finally, TNF-α and IL-6 levels in the ventromedial prefrontal cortex were not necessary for the dexmedetomidine treatment effect of surgery-induced fear extinction dysfunction. The study results showed that propofol and surgery selective impaired the cued fear extinction stage in adolescent mice, and dexmedetomidine may unleash a protective effect in preventing postoperative PTSD.

Dorsal Raphe 5-HT Neurons Utilize, But Do Not Generate, Negative Aversive Prediction Errors

The dorsal raphe nucleus (DRN) contains the largest population of serotonin (5-HT) neurons in the central nervous system. 5-HT, synthesized via tryptophan hydroxylase 2 (Tph2), is a widely functioning neuromodulator implicated in fear learning. Here, we sought to investigate whether DRN 5-HT is necessary to reduce fear via negative prediction error (–PE). Using male and female TPH2-cre rats, DRN^tph2+ cells were selectively deleted via cre-caspase (rAAV5-Flex-taCasp3-TEVp) in experiment 1. Rats then underwent fear discrimination during which three cues were associated with unique foot shock probabilities: safety p = 0.00, uncertainty p = 0.375, and danger p = 1.00. Rats then received selective extinction to the uncertainty cue, a behavioral manipulation designed to probe –PE. Deleting DRN^tph2+ cells had no impact on initial discrimination but slowed selective extinction. In experiment 2, we used a within-subjects optogenetic inhibition design to causally implicate DRN^tph2+ cells in prediction error signaling. Male and female TPH2-cre rats received intra-DRN infusions of cre-dependent halorhodopsin (rAAV5-Ef1a-DIO-eNpHR3.0-eYFP) or cre-YFP. DRN^tph2+ cells were inhibited specifically during the time of prediction error or a control period. Illumination during either positive prediction error (+PE) or control periods had no impact on fear to the uncertainty cue. Inhibition of DRN^tph2+ cells at the time of –PE did not impact immediate fear, but facilitated selective extinction in postillumination sessions. Together, these results demonstrate a role for DRN^tph2+ cells in using, but not generating, –PE to weaken cue-shock associations.

The Aversion Function of the Limbic Dopaminergic Neurons and Their Roles in Functional Neurological Disorders

The Freudian theory of conversion suggested that the major symptoms of functional neurological disorders (FNDs) are due to internal conflicts at motivation, especially at the sex drive or libido. FND patients might behave properly at rewarding situations, but they do not know how to behave at aversive situations. Sex drive is the major source of dopamine (DA) release in the limbic area; however, the neural mechanism involved in FND is not clear. Dopaminergic (DAergic) neurons have been shown to play a key role in processing motivation-related information. Recently, DAergic neurons are found to be involved in reward-related prediction error, as well as the prediction of aversive information. Therefore, it is suggested that DA might change the rewarding reactions to aversive reactions at internal conflicts of FND. So DAergic neurons in the limbic areas might induce two major motivational functions: reward and aversion at internal conflicts. This article reviewed the recent advances on studies about DAergic neurons involved in aversive stimulus processing at internal conflicts and summarizes several neural pathways, including four limbic system brain regions, which are involved in the processing of aversion. Then the article discussed the vital function of these neural circuits in addictive behavior, depression treatment, and FNDs. In all, this review provided a prospect for future research on the aversion function of limbic system DA neurons and the therapy of FNDs.

Neuromodulation of Memory Formation and Extinction

Memory retrieval is mediated by discharges of acetylcholine, glutamate, gammaaminobutyric acid, norepinephrine, and serotonin/5-hydroxytryptamine circuits. These projections and memory interact through engram circuits, neurobiological traces of memory. Increased excitability in engram circuits of the medial prefrontal cortex and hippocampus results in remote and recent memory retrievals, respectively. However, due to degenerated neurotransmitter projections, the excitability state of engram circuits is decreased in the patient with dementia; and thus, acquired- memory cannot be retrieved by natural cues. Here, we suggest that artificial neuropharmacological stimulations of the acquired-memory with an excitation potential higher than a natural cue can excite engram circuits in the medial prefrontal cortex, which results in the retrieval of lost memories in dementia. The neuropharmacological foundations of engram cell-mediated memory retrieval strategy in severe dementia, in line with this has also been explained. We particularly highlighted the close interactions between periaqueductal gray, locus coeruleus, raphe nuclei, and medial prefrontal cortex and basolateral amygdala as treatment targets for memory loss. Furthermore, the engram circuits projecting raphe nuclei, locus coeruleus, and pontomesencephalic tegmentum complex could be significant targets of memory editing and memory formation in the absence of experience, and a well-defined study of the neural events underlying the interaction of brain stem and memory will be relevant for such developments. We anticipate our perspective to be a starting point for more sophisticated in vivo models for neuropharmacological modulations of memory retrieval in Alzheimer's dementia.

L-DOPA modulates activity in the vmPFC, nucleus accumbens, and VTA during threat extinction learning in humans

Learning to be safe is central for adaptive behaviour when threats are no longer present. Detecting the absence of an expected threat is key for threat extinction learning and an essential process for the behavioural treatment of anxiety-related disorders. One possible mechanism underlying extinction learning is a dopaminergic mismatch signal that encodes the absence of an expected threat. Here we show that such a dopamine-related pathway underlies extinction learning in humans. Dopaminergic enhancement via administration of L-DOPA (vs. Placebo) was associated with reduced retention of differential psychophysiological threat responses at later test, which was mediated by activity in the ventromedial prefrontal cortex that was specific to extinction learning. L-DOPA administration enhanced signals at the time-point of an expected, but omitted threat in extinction learning within the nucleus accumbens, which were functionally coupled with the ventral tegmental area and the amygdala. Computational modelling of threat expectancies further revealed prediction error encoding in nucleus accumbens that was reduced when L-DOPA was administered. Our results thereby provide evidence that extinction learning is influenced by L-DOPA and provide a mechanistic perspective to augment extinction learning by dopaminergic enhancement in humans.

Brain-specific heterozygous loss-of-function of ATP2A2, endoplasmic reticulum Ca2+ pump responsible for Darier's disease, causes behavioral abnormalities and a hyper-dopaminergic state

A report of a family of Darier's disease with mood disorders drew attention when the causative gene was identified as ATP2A2 (or SERCA2), which encodes a Ca2+ pump on the endoplasmic reticulum (ER) membrane and is important for intracellular Ca2+ signaling. Recently, it was found that loss-of-function mutations of ATP2A2 confer a risk of neuropsychiatric disorders including depression, bipolar disorder and schizophrenia. In addition, a genome-wide association study found an association between ATP2A2 and schizophrenia. However, the mechanism of how ATP2A2 contributes to vulnerability to these mental disorders is unknown. Here, we analyzed Atp2a2 heterozygous brain-specific conditional knockout (hetero cKO) mice. The ER membranes prepared from the hetero cKO mouse brain showed decreased Ca2+ uptake activity. In Atp2a2 heterozygous neurons, decays of cytosolic Ca2+ level were slower than control neurons after depolarization. The hetero cKO mice showed altered behavioral responses to novel environments and impairments in fear memory, suggestive of enhanced dopamine signaling. In vivo dialysis demonstrated that extracellular dopamine levels in the NAc were indeed higher in the hetero cKO mice. These results altogether indicate that the haploinsufficiency of Atp2a2 in the brain causes prolonged cytosolic Ca2+ transients, which possibly results in enhanced dopamine signaling, a common feature of mood disorders and schizophrenia. These findings elucidate how ATP2A2 mutations causing a dermatological disease may exert their pleiotropic effects on the brain and confer a risk for mental disorders.

Positive and Neutral Updating Reconsolidate Aversive Episodic Memories via Different Routes

Aversive memories are long-lasting and prone to burden our emotional wellbeing and mental health. Yet, how to remedy the maladaptive effects of aversive memories remains elusive. Using memory reactivation and emotional updating manipulations, we investigated how positive and neutral emotion may update aversive memories for reconsolidation in humans. We found that positive updating after reactivation was equivalent to neutral updating in impairing true memories of a previous aversive event after a 12-hour wakeful delay, but induced more false memory. Moreover, additional 12-hour delay with overnight sleep did not further enlarge true memory differences, but attenuated the effect of reactivation and updating on false memory. Interestingly, the neutral rather than the positive updating reduced the emotional arousal of the aversive memory 24 hours later. Our findings could serve as references for real-world therapeutic applications regarding how positive and neutral updating may reshape aversive memories, especially when taking wake- and sleep-filled reconsolidation into account.

Incerto-thalamic modulation of fear via GABA and dopamine

Fear generalization and deficits in extinction learning are debilitating dimensions of Post-Traumatic Stress Disorder (PTSD). Most understanding of the neurobiology underlying these dimensions comes from studies of cortical and limbic brain regions. While thalamic and subthalamic regions have been implicated in modulating fear, the potential for incerto-thalamic pathways to suppress fear generalization and rescue deficits in extinction recall remains unexplored. We first used patch-clamp electrophysiology to examine functional connections between the subthalamic zona incerta and thalamic reuniens (RE). Optogenetic stimulation of GABAergic ZI → RE cell terminals in vitro induced inhibitory post-synaptic currents (IPSCs) in the RE. We then combined high-intensity discriminative auditory fear conditioning with cell-type-specific and projection-specific optogenetics in mice to assess functional roles of GABAergic ZI → RE cell projections in modulating fear generalization and extinction recall. In addition, we used a similar approach to test the possibility of fear generalization and extinction recall being modulated by a smaller subset of GABAergic ZI → RE cells, the A13 dopaminergic cell population. Optogenetic stimulation of GABAergic ZI → RE cell terminals attenuated fear generalization and enhanced extinction recall. In contrast, optogenetic stimulation of dopaminergic ZI → RE cell terminals had no effect on fear generalization but enhanced extinction recall in a dopamine receptor D1-dependent manner. Our findings shed new light on the neuroanatomy and neurochemistry of ZI-located cells that contribute to adaptive fear by increasing the precision and extinction of learned associations. In so doing, these data reveal novel neuroanatomical substrates that could be therapeutically targeted for treatment of PTSD.

The neurobiology of human fear generalization: meta-analysis and working neural model

Fear generalization to stimuli resembling a conditioned danger-cue (CS+) is a fundamental dynamic of classical fear-conditioning. Despite the ubiquity of fear generalization in human experience and its known pathogenic contribution to clinical anxiety, neural investigations of human generalization have only recently begun. The present work provides the first meta-analysis of this growing literature to delineate brain substrates of conditioned fear-generalization and formulate a working neural model. Included studies (K = 6, N = 176) reported whole-brain fMRI results and applied generalization-gradient methodology to identify brain activations that gradually strengthen (positive generalization) or weaken (negative generalization) as presented stimuli increase in CS+ resemblance. Positive generalization was instantiated in cingulo-opercular, frontoparietal, striatal-thalamic, and midbrain regions (locus coeruleus, periaqueductal grey, ventral tegmental area), while negative generalization was implemented in default-mode network nodes (ventromedial prefrontal cortex, hippocampus, middle temporal gyrus, angular gyrus) and amygdala. Findings are integrated within an updated neural account of generalization centering on the hippocampus, its modulation by locus coeruleus and basolateral amygdala, and the excitation of threat- or safety-related loci by the hippocampus.

Prior experience conditionally inhibits the expression of new learning in Drosophila

Prior experience of a stimulus can inhibit subsequent acquisition or expression of a learned association of that stimulus. However, the neuronal manifestations of this learning effect, named latent inhibition (LI), are poorly understood. Here, we show that prior odor exposure can produce context-dependent LI of later appetitive olfactory memory performance in Drosophila. Odor pre-exposure forms a short-lived aversive memory whose lone expression lacks context-dependence. Acquisition of odor pre-exposure memory requires aversively reinforcing dopaminergic neurons that innervate two mushroom body compartments—one group of which exhibits increasing activity with successive odor experience. Odor-specific responses of the corresponding mushroom body output neurons are suppressed, and their output is necessary for expression of both pre-exposure memory and LI of appetitive memory. Therefore, odor pre-exposure attaches negative valence to the odor itself, and LI of appetitive memory results from a temporary and context-dependent retrieval deficit imposed by competition with the parallel short-lived aversive memory.

•

Odor pre-exposure alters the expression of a learned association of that odor

•

Pre-exposure memory only affects subsequent retrieval if context is consistent

•

Pre-exposure memory can complement or compete with a learned association

•

Odor pre-exposure forms a labile mushroom body-dependent aversive memory

Intercalated amygdala clusters orchestrate a switch in fear state

Adaptive behaviour necessitates the formation of memories for fearful events, but also that these memories can be extinguished. Effective extinction prevents excessive and persistent reactions to perceived threat, as can occur in anxiety and 'trauma- and stressor-related' disorders¹. However, although there is evidence that fear learning and extinction are mediated by distinct neural circuits, the nature of the interaction between these circuits remains poorly understood^2-6. Here, through a combination of in vivo calcium imaging, functional manipulations, and slice physiology, we show that distinct inhibitory clusters of intercalated neurons (ITCs) in the mouse amygdala exert diametrically opposed roles during the acquisition and retrieval of fear extinction memory. Furthermore, we find that the ITC clusters antagonize one another through mutual synaptic inhibition and differentially access functionally distinct cortical- and midbrain-projecting amygdala output pathways. Our findings show that the balance of activity between ITC clusters represents a unique regulatory motif that orchestrates a distributed neural circuitry, which in turn regulates the switch between high- and low-fear states. These findings suggest that the ITCs have a broader role in a range of amygdala functions and associated brain states that underpins the capacity to adapt to salient environmental demands.