Predicting danger: the nature, consequences, and neural mechanisms of predictive fear learning

Emotional salience network involved in constructing two-dimensional fear space in humans

Fear learning is pivotal for organismal survival, ensuring the ability to avoid potential threats through learning based on experiencing minimal fear information. In reality, fear learning requires to form a structured representation of fear experiences from multiple dimensions in order to support flexible use in ever-changing environment. Yet, the underlying neural mechanisms of constructing dimensional fear space remain elusive. Here we set up an innovative approach with two-dimensional fear learning, by utilizing the probability (uncertainty) and subjective pain intensity of threatening mild electric shock with five levels of each dimension. Behaviorally, individuals constructed a two-dimensional fear space after learning phase, as evidenced by significant changes in participant's fearful ratings for each cue associated with a five-by-five grid after (relative to before) learning phase. Analysis of neuroimaging data revealed that the medial temporal lobe, in conjunction with the amygdala, the insula, the anterior cingulate cortex (ACC), the hippocampus, and the dorsolateral prefrontal cortex (dlPFC), collectively contribute to the construction of a two-dimensional fear space consisting of uncertainty and intensity. Activation in the parahippocampal gyrus, insula, and dlPFC was associated with mental navigation within two-dimensional fear space, whereas the engagement of insula, ACC, amygdala, the hippocampus, the dlPFC was associated with a unified fearful scoring cross uncertainty and intensity dimensions after fear learning. Our findings suggest a neurocognitive model through which emotional salience network underlies the construction of a structured representation of fear experiences from multiple dimensions.

What is Learned Determines How Pavlovian Conditioned Fear is Consolidated in the Brain

Activity in the basolateral amygdala complex (BLA) is needed to encode fears acquired through contact with both innate sources of danger (i.e., things that are painful) and learned sources of danger (e.g., being threatened with a gun). However, within the BLA, the molecular processes required to consolidate the two types of fear are not the same: protein synthesis is needed to consolidate the first type of fear (so-called first-order fear) but not the latter (so-called second-order fear). The present study examined why first- and second-order fears differ in this respect. Specifically, it used a range of conditioning protocols in male and female rats, and assessed the effects of a BLA infusion of the protein synthesis inhibitor, cycloheximide, on first- and second-order conditioned fear. The results revealed that the differential protein synthesis requirements for consolidation of first- and second-order fears reflect differences in what is learned in each case. Protein synthesis in the BLA is needed to consolidate fears that result from encoding of relations between stimuli in the environment (stimulus-stimulus associations, typical for first-order fear) but is not needed to consolidate fears that form when environmental stimuli associate directly with fear responses emitted by the animal (stimulus-response associations, typical for second-order fear). Thus, the substrates of Pavlovian fear conditioning in the BLA depend on the way that the environment impinges upon the animal. This is discussed with respect to theories of amygdala function in Pavlovian fear conditioning, and ways in which stimulus-response associations might be consolidated in the brain.

The Rescorla-Wagner model, prediction error, and fear learning

The Rescorla-Wagner model remains one of the most important and influential theoretical accounts of the conditions under which Pavlovian learning occurs. Moreover, the experimental approaches that inspired the model continue to provide powerful behavioral tools to advance mechanistic understanding of how we and other animals learn to fear and learn to reduce fear. Here we consider key features of the Rescorla-Wagner model as applied to study of fear learning. We review evidence for key insights of the model. First, learning to fear and learning to reduce fear are governed by a common, signed prediction error. Second, this error drives variations in effectiveness of the shock US that are causal to whether and how much fear is learned or lost during a conditioning trial. We also consider behavioral and neural findings inconsistent with the model and which will be essential to understand and advance understanding of fear learning.

Computational perspectives on human fear and anxiety

Fear and anxiety are adaptive emotions that serve important defensive functions, yet in excess, they can be debilitating and lead to poor mental health. Computational modelling of behaviour provides a mechanistic framework for understanding the cognitive and neurobiological bases of fear and anxiety, and has seen increasing interest in the field. In this brief review, we discuss recent developments in the computational modelling of human fear and anxiety. Firstly, we describe various reinforcement learning strategies that humans employ when learning to predict or avoid threat, and how these relate to symptoms of fear and anxiety. Secondly, we discuss initial efforts to explore, through a computational lens, approach-avoidance conflict paradigms that are popular in animal research to measure fear- and anxiety-relevant behaviours. Finally, we discuss negative biases in decision-making in the face of uncertainty in anxiety.

Trauma-Informed Design of Supported Housing: A Scoping Review through the Lens of Neuroscience

There is growing recognition of the importance of the design of the built environment in supporting mental health. In this context, trauma-informed design has emerged as a new field of practice targeting the design of the built environment to support wellbeing and ameliorate the physical, psychological and emotional impacts of trauma and related pathologies such as Post Traumatic Stress Disorder (PTSD). With high levels of prevalence of PTSD among people escaping homelessness and domestic violence, a priority area is the identification and application of evidence-based design solutions for trauma-informed supported housing. This study sought to examine the scope of existing evidence on the relationship between trauma, housing and design and the correlation of this evidence with trauma-informed design principles, and to identify gaps and opportunities for future research. In response to the commonly articulated limitations of the evidence-base in built environment design research, we combined a scoping review of literature on trauma, housing and design with insights from neuroscience to focus and extend understanding of the opportunities of trauma-informed design. We found that while limited in scope, there is strong alignment between existing evidence and the principles of trauma-informed design. We also identify three areas of future research related to the key domains of safety and security; control; and enriched environments.

The Opioid Receptor Antagonist Naloxone Enhances First-Order Fear Conditioning, Second-Order Fear Conditioning and Sensory Preconditioning in Rats

The opioid receptor antagonist naloxone enhances Pavlovian fear conditioning when rats are exposed to pairings of an initially neutral stimulus, such as a tone, and a painful foot shock unconditioned stimulus (US; so-called first-order fear conditioning; Pavlov, 1927). The present series of experiments examined whether naloxone has the same effect when conditioning occurs in the absence of US exposure. In Experiments 1a and 1b, rats were exposed to tone-shock pairings in stage 1 (one trial per day for 4 days) and then to pairings of an initially neutral light with the already conditioned tone in stage 2 (one trial per day for 4 days). Experiment 1a confirmed that this training results in second-order fear of the light; and Experiment 1b showed that naloxone enhances this conditioning: rats injected with naloxone in stage 2 froze more than vehicle-injected controls when tested with the light alone (drug-free). In Experiments 2a and 2b, rats were exposed to light-tone pairings in stage 1 (one trial per day for 4 days) and then to tone-shock pairings in stage 2 (one trial per day for 2 days). Experiment 2a confirmed that this training results in sensory preconditioned fear of the light; and Experiment 2b showed that naloxone enhances sensory preconditioning when injected prior to each of the light-tone pairings: rats injected with naloxone in stage 1 froze more than vehicle-injected controls when tested with the light alone (drug-free). These results were taken to mean that naloxone enhances fear conditioning independently of its effect on US processing; and more generally, that opioids regulate the error-correction mechanisms that underlie associative formation.

Environmental certainty influences the neural systems regulating responses to threat and stress

Flexible calibration of threat responding in accordance with the environment is an adaptive process that allows an animal to avoid harm while also maintaining engagement of other goal-directed actions. This calibration process, referred to as threat response regulation, requires an animal to calculate the probability that a given encounter will result in a threat so they can respond accordingly. Here we review the neural correlates of two highly studied forms of threat response suppression: extinction and safety conditioning. We focus on how relative levels of certainty or uncertainty in the surrounding environment alter the acquisition and application of these processes. We also discuss evidence indicating altered threat response regulation following stress exposure, including enhanced fear conditioning, and disrupted extinction and safety conditioning. To conclude, we discuss research using an animal model of coping that examines the impact of stressor controllability on threat responding, highlighting the potential for previous experiences with control, or other forms of coping, to protect against the effects of future adversity.

The Roles of Basolateral Amygdala Parvalbumin Neurons in Fear Learning

The basolateral amygdala (BLA) is obligatory for fear learning. This learning is linked to BLA excitatory projection neurons whose activity is regulated by complex networks of inhibitory interneurons, dominated by parvalbumin (PV)-expressing GABAergic neurons. The roles of these GABAergic interneurons in learning to fear and learning not to fear, activity profiles of these interneurons across the course of fear learning, and whether or how these change across the course of learning all remain poorly understood. Here, we used PV cell-type-specific recording and manipulation approaches in male transgenic PV-Cre rats during pavlovian fear conditioning to address these issues. We show that activity of BLA PV neurons during the moments of aversive reinforcement controls fear learning about aversive events, but activity during moments of nonreinforcement does not control fear extinction learning. Furthermore, we show expectation-modulation of BLA PV neurons during fear learning, with greater activity to an unexpected than expected aversive unconditioned stimulus (US). This expectation-modulation was specifically because of BLA PV neuron sensitivity to aversive prediction error. Finally, we show that BLA PV neuron function in fear learning is conserved across these variations in prediction error. We suggest that aversive prediction-error modulation of PV neurons could enable BLA fear-learning circuits to retain selectivity for specific sensory features of aversive USs despite variations in the strength of US inputs, thereby permitting the rapid updating of fear associations when these sensory features change.SIGNIFICANCE STATEMENT The capacity to learn about sources of danger in the environment is essential for survival. This learning depends on complex microcircuitries of inhibitory interneurons in the basolateral amygdala. Here, we show that parvalbumin-positive GABAergic interneurons in the rat basolateral amygdala are important for fear learning during moments of danger, but not for extinction learning during moments of safety, and that the activity of these neurons is modulated by expectation of danger. This may enable fear-learning circuits to retain selectivity for specific aversive events across variations in expectation, permitting the rapid updating of learning when aversive events change.

Revaluing the Role of vmPFC in the Acquisition of Pavlovian Threat Conditioning in Humans

The role of the ventromedial prefrontal cortex (vmPFC) in human pavlovian threat conditioning has been relegated largely to the extinction or reversal of previously acquired stimulus-outcome associations. However, recent neuroimaging evidence questions this view by also showing activity in the vmPFC during threat acquisition. Here we investigate the casual role of vmPFC in the acquisition of pavlovian threat conditioning by assessing skin conductance response (SCR) and declarative memory of stimulus-outcome contingencies during a differential pavlovian threat-conditioning paradigm in eight patients with a bilateral vmPFC lesion, 10 with a lesion outside PFC and 10 healthy participants (each group included both females and males). Results showed that patients with vmPFC lesion failed to produce a conditioned SCR during threat acquisition, despite no evidence of compromised SCR to unconditioned stimulus or compromised declarative memory for stimulus-outcome contingencies. These results suggest that the vmPFC plays a causal role in the acquisition of new learning and not just in the extinction or reversal of previously acquired learning, as previously thought. Given the role of the vmPFC in schema-related processing and latent structure learning, the vmPFC may be required to construct a detailed representation of the task, which is needed to produce a sustained conditioned physiological response in anticipation of the unconditioned stimulus during threat acquisition.SIGNIFICANCE STATEMENT Pavlovian threat conditioning is an adaptive mechanism through which organisms learn to avoid potential threats, thus increasing their chances of survival. Understanding what brain regions contribute to such a process is crucial to understand the mechanisms underlying adaptive as well as maladaptive learning, and has the potential to inform the treatment of anxiety disorders. Importantly, the role of the ventromedial prefrontal cortex (vmPFC) in the acquisition of pavlovian threat conditioning has been relegated largely to the inhibition of previously acquired learning. Here, we show that the vmPFC actually plays a causal role in the acquisition of pavlovian threat conditioning.

Aberrant reward prediction error during Pavlovian appetitive learning in alexithymia

Extensive literature shows that alexithymia, a subclinical trait defined by difficulties in identifying and describing feelings, is characterized by multifaceted impairments in processing emotional stimuli. Nevertheless, its underlying mechanisms remain elusive. Here, we hypothesize that alexithymia may be characterized by an alteration in learning the emotional value of encountered stimuli and test this by assessing differences between individuals with low (LA) and high (HA) levels of alexithymia in the computation of reward prediction errors (RPEs) during Pavlovian appetitive conditioning. As a marker of RPE, the amplitude of the feedback-related negativity (FRN) event-related potential was assessed while participants were presented with two conditioned stimuli (CS) associated with expected or unexpected feedback, indicating delivery of reward or no-reward. No-reward (vs reward) feedback elicited the FRN both in LA and HA. However, unexpected (vs expected) feedback enhanced the FRN in LA but not in HA, indicating impaired computation of RPE in HA. Thus, although HA show preserved sensitivity to rewards, they cannot use this response to update the value of CS that predict them. This impairment may hinder the construction of internal representations of emotional stimuli, leaving individuals with alexithymia unable to effectively recognize, respond and regulate their response to emotional stimuli.

Increased aggression and reduced aversive learning in honey bees exposed to extremely low frequency electromagnetic fields

Honey bees, Apis mellifera, are a globally significant pollinator species and are currently in decline, with losses attributed to an array of interacting environmental stressors. Extremely low frequency electromagnetic fields (ELF EMFs) are a lesser-known abiotic environmental factor that are emitted from a variety of anthropogenic sources, including power lines, and have recently been shown to have a significant impact on the cognitive abilities and behaviour of honey bees. Here we have investigated the effects of field-realistic levels of ELF EMFs on aversive learning and aggression levels, which are critical factors for bees to maintain colony strength. Bees were exposed for 17 h to 100 μT or 1000 μT ELF EMFs, or a sham control. A sting extension response (SER) assay was conducted to determine the effects of ELF EMFs on aversive learning, while an intruder assay was conducted to determine the effects of ELF EMFs on aggression levels. Exposure to both 100 μT and 1000 μT ELF EMF reduced aversive learning performance by over 20%. Exposure to 100 μT ELF EMFs also increased aggression scores by 60%, in response to intruder bees from foreign hives. These results indicate that short-term exposure to ELF EMFs, at levels that could be encountered in bee hives placed under power lines, reduced aversive learning and increased aggression levels. These behavioural changes could have wider ecological implications in terms of the ability of bees to interact with, and respond appropriately to, threats and negative environmental stimuli.

The Conditions under Which Consolidation of Serial-Order Conditioned Fear Requires De Novo Protein Synthesis in the Basolateral Amygdala Complex

Consolidation of conditioned fear to a stimulus (S1) paired with shock requires de novo protein synthesis in the basolateral amygdala complex (BLA), whereas consolidation of conditioned fear to a stimulus (S2) paired with the fear-eliciting S1 requires DNA methylation but not de novo protein synthesis in the BLA. The present experiments merged these protocols by exposing rats to pairings of a serial S2-S1 compound and shock to examine if/when protein synthesis in the BLA is required to consolidate fear to S2. Rats received a BLA infusion of the protein synthesis inhibitor, cycloheximide, immediately after the S2-S1-shock session and were subsequently tested with S2. The infusion disrupted consolidation of fear to S2 when there had been no prior training of S1 (Experiment 1), the prior training had consisted of unpaired presentations of S1 and shock (Experiment 4), or in pairings of S1 and sucrose (Experiment 5). Consolidation of fear to S2 was unaffected by the infusion of cycloheximide but was disrupted by the DNA methyltransferase inhibitor, 5-AZA, when S1 had been previously fear-conditioned (Experiments 2a, 2b, and 3). These findings imply that what has already been learned about S1 determines the BLA processes that consolidate fear to S2. The already-fear-conditioned S1 blocks the S2-shock association that otherwise forms (and whose consolidation requires de novo protein synthesis in the BLA) while simultaneously acting as a learned source of danger for its S2 associate (whose consolidation requires DNA methylation but not de novo protein synthesis in the BLA).SIGNIFICANCE STATEMENT Protein synthesis is widely thought to be crucial for consolidating new learning into stable memories, including the consolidation of conditioned fear memories in the basolateral amygdala complex (BLA). However, our data provide clear evidence that the requirement for protein synthesis to consolidate conditioned fear in the BLA depends on an animal's previous training history, and the type of learning that is consolidated. Further, within the BLA, our data show that DNA methylation, and not protein synthesis, is necessary to consolidate higher-order conditioned fear, indicating that epigenetic mechanisms may provide a more fundamental mnemonic substrate.

Alexithymia and the Reduced Ability to Represent the Value of Aversively Motivated Actions

Alexithymia is a subclinical trait defined by difficulties in identifying and describing feelings and a cognitive style avoidant of introspection. Extensive literature shows that alexithymia is characterized by multifaceted impairments in processing emotional stimuli. Nevertheless, the mechanisms that may account for such impairments remain elusive. Here, we hypothesize that alexithymia may be understood as impairment in learning the emotional value of one’s own actions and test this comparing performance of participants with high (HA) and low (LA) levels of alexithymia on a probabilistic selection task. Results show that, compared to LA, HA need more time to learn the value of individual stimuli and associated actions as difference in reinforcement rate between stimuli decreases. In addition, HA appear less able to generalize the value of previously learned actions that lead to a negative outcome, to make adaptive choices in a new context, requiring more time to avoid the most negative stimulus between two negative stimuli. Together, the results indicate that individuals with alexithymia show impaired learning of the value of aversively motivated actions. We argue that this impairment may hinder the construction of internal representations of emotional stimuli and actions and represent a mechanism that may account for the difficulties of alexithymia in processing emotional stimuli.

The tail of the ventral tegmental area in behavioral processes and in the effect of psychostimulants and drugs of abuse

The tail of the ventral tegmental area (tVTA) is a recently identified structure that exerts a major inhibitory drive onto midbrain dopamine (DA) neurons. Also referred to as the rostromedial tegmental nucleus (RMTg), the tVTA is a cluster of gamma-aminobutyric acid (GABA)ergic neurons that starts within the posterior end of the VTA, where it is restricted dorsolateral to the caudal part of the interpeduncular nucleus, and extends into the pons. First identified in the rat, the tVTA has been described in many species, including mice and monkeys, as a region exhibiting similar anatomical and behavioral properties; it receives strong excitatory inputs from the lateral habenula (LHb), conveys negative reward-related information, and inhibits midbrain DA neuron activity. As an important inhibitory afferent to midbrain DA neurons, the tVTA is also implicated in drug abuse and in the complex interplay between reward and aversion processes. The overarching goal of this review is to provide the current state of knowledge on the anatomy and connectivity of the tVTA and to discuss recent evidence implicating this structure in reward-related processes and in the effect of psychostimulants and drugs of abuse.

Beyond Extinction: Prolonged Conditioning and Repeated Threat Exposure Abolish Contextual Renewal of Fear-Potentiated Startle Discrimination but Leave Expectancy Ratings Intact

Extinction treatments decrease fear via repeated exposures to the conditioned stimulus (CS) and are associated with a return of fear. Alternatively, fear can be reduced via reductions in the perceived intensity of the unconditioned stimulus (US), e.g., through repeated exposures to the US. Promisingly, the few available studies show that repeated US exposures outperform standard extinction. US exposure treatments can decrease fear via two routes: (1) by weakening the CS-US association (extinction-like mechanism), and/or (2) by weakening the subjective US aversiveness (habituation-like mechanism). The current study further investigated the conditions under which US exposure treatment may reduce renewal, by adding a group in which CS-US pairings continued following fear acquisition. During acquisition, participants learned that one of two visual stimuli (CS+/CS-) predicted the occurrence of an aversive electrocutaneous stimulus (US). Next, the background context changed and participants received one of three interventions: repeated CS exposures, (2) repeated US exposures, or (3) continued CS-US pairings. Following repeated CS exposures, test presentations of the CSs in the original conditioning context revealed intact CS+/CS- differentiation in the fear-potentiated startle reflex, while the differentiation was abolished in the other two groups. Differential US expectancy ratings, on the other hand, were intact in all groups. Skin conductance data were inconclusive because standard context renewal following CS exposures did not occur. Unexpectedly, there was no evidence for a habituation-like process having taken place during US exposures or continued CS-US pairings. The results provide further evidence that US exposures outperform the standard extinction treatment and show that effects are similar when US exposures are part of CS-US pairings.

Basolateral Amygdala Neurons Maintain Aversive Emotional Salience

BLA neurons serve a well-accepted role in fear conditioning and fear extinction. However, the specific learning processes related to their activity at different times during learning remain poorly understood. We addressed this using behavioral tasks isolating distinct aspects of fear learning in male rats. We show that brief optogenetic inhibition of BLA neurons around moments of aversive reinforcement or nonreinforcement causes reductions in the salience of conditioned stimuli, rendering these stimuli less able to be learned about and less able to control fear or safety behaviors. This salience reduction was stimulus-specific, long-lasting, and specific to learning about, or responding to, the same aversive outcome, precisely the goals of therapeutic interventions in human anxiety disorders. Our findings identify a core learning process disrupted by brief BLA optogenetic inhibition. They show that a primary function of the unconditioned stimulus-evoked activity of BLA neurons is to maintain the salience of conditioned stimuli that precede it. This maintenance of salience is a necessary precursor for these stimuli to gain and maintain control over fear and safety behavior.SIGNIFICANCE STATEMENT The amygdala is essential for learning to fear and learning to reduce fear. However, the specific roles served by activity of different amygdala neurons at different times during learning is poorly understood. We used behavioral tasks isolating distinct aspects of learning in rats to show that brief optogenetic inhibition of BLA neurons around moments of reinforcement or nonreinforcement disrupts maintenance of conditioned stimulus salience. This causes a stimulus-specific and long-lasting deficit in the ability of the conditioned stimulus to be learned about or control fear responses. These consequences are the precisely goals of therapeutic interventions in human anxiety disorders. Our findings identify a core learning process disrupted by brief BLA optogenetic inhibition.

Effects of chemogenetic excitation or inhibition of the ventrolateral periaqueductal gray on the acquisition and extinction of Pavlovian fear conditioning

The midbrain periaqueductal gray (PAG) has been implicated in the generation and transmission of a prediction error signal that instructs amygdala-based fear and extinction learning. However, the PAG also plays a key role in the expression of conditioned fear responses. The evidence for a role of the PAG in fear learning and extinction learning has been obtained almost exclusively using PAG-dependent fear responses. It is less clear whether the PAG regulates fear learning when other measures of learned fear are used. Here we combined a chemogenetic approach, permitting excitation or inhibition of neurons in the ventrolateral PAG (VLPAG), with conditioned suppression as the measure of learned fear to assess the role of VLPAG in the acquisition and extinction of fear learning. We show that chemogenetic excitation of VLPAG (with some encroachment on lateral PAG [LPAG]) impairs acquisition of fear and, conversely, chemogenetic inhibition impairs extinction of fear. These effects on fear and extinction learning were specific to the combination of DREADD expression and injection of CNO because they were observed relative to both eYFP controls injected with CNO as well as DREADD expressing controls injected with vehicle. Taken together, these results show that activity of L/VLPAG neurons regulates both the acquisition and extinction of Pavlovian fear learning.

Endogenous opioids regulate social threat learning in humans

Many fearful expectations are shaped by observation of aversive outcomes to others. Yet, the neurochemistry regulating social learning is unknown. Previous research has shown that during direct (Pavlovian) threat learning, information about personally experienced outcomes is regulated by the release of endogenous opioids, and activity within the amygdala and periaqueductal gray (PAG). Here we report that blockade of this opioidergic circuit enhances social threat learning through observation in humans involving activity within the amygdala, midline thalamus and the PAG. In particular, anticipatory responses to learned threat cues (CS) were associated with temporal dynamics in the PAG, coding the observed aversive outcomes to other (observational US). In addition, pharmacological challenge of the opioid receptor function is classified by distinct brain activity patterns during the expression of conditioned threats. Our results reveal an opioidergic circuit that codes the observed aversive outcomes to others into threat responses and long-term memory in the observer.

Though humans often learn about negative outcomes from observing the response of others, the neurochemistry underlying this learning is unknown. Here, authors show that blocking opioid receptors enhances social threat learning and describe the brain regions underlying this effect.

Metabotropic Glutamate Receptors 7 within the Nucleus Accumbens are Involved in Relief Learning in Rats

Relief learning is an appetitive association of a formally neutral cue with relief induced by the offset of an aversive stimulus. Since the nucleus accumbens mediates relief learning and accumbal metabotropic glutamate receptors 7 (mGluR7) modulate appetitive-like processes, we hypothesized that accumbal mGluR7 may be involved in the modulation of relief learning. Therefore, we injected the allosteric mGluR7 agonist AMN082 into the nucleus accumbens and tested the effects of these injections on acquisition and expression of relief memory, as well as on the reactivity to electric stimuli. AMN082 injections blocked acquisition but not expression of relief memory. In addition, accumbal AMN082 injections strongly reduced the locomotor reactivity to electric stimuli indicating antinociceptive effects. These antinociceptive effects might be causal for the blockade of relief learning after AMN082 injections. Taken together, the present study indicates that functional activation of accumbal mGluR7 has antinociceptive effects that interfere with relief learning.

Posterior insular cortex is necessary for conditioned inhibition of fear

Veridical detection of safety versus danger is critical to survival. Learned signals for safety inhibit fear, and so when presented, reduce fear responses produced by danger signals. This phenomenon is termed conditioned inhibition of fear. Here, we report that CS+/CS- fear discrimination conditioning over 5 days in rats leads the CS- to become a conditioned inhibitor of fear, as measured by the classic tests of conditioned inhibition: summation and retardation of subsequent fear acquisition. We then show that NMDA-receptor antagonist AP5 injected to posterior insular cortex (IC) before training completely prevented the acquisition of a conditioned fear inhibitor, while intra-AP5 to anterior and medial IC had no effect. To determine if the IC contributes to the recall of learned fear inhibition, injections of the GABAA agonist muscimol were made to posterior IC before a summation test. This resulted in fear inhibition per se, which obscured inference to the effect of IC inactivation with recall of the safety cue. Control experiments sought to determine if the role of the IC in conditioned inhibition learning could be reduced to simpler fear discrimination function, but fear discrimination and recall were unaffected by AP5 or muscimol, respectively, in the posterior IC. These data implicate a role of posterior IC in the learning of conditioned fear inhibitors.

Reduced anticipation of negative emotional events in alexithymia

Alexithymia is characterized by difficulties in different domains of emotion processing, especially in relation to negative emotions. Nevertheless, its causal mechanisms remain elusive. Reduced anticipation of negative emotional events might be one such mechanism because it enables the individual to prepare to respond effectively to coming events. To test this, changes in skin conductance response (SCR) were recorded during classical fear conditioning in sixty participants with high (HA), medium (MA) and low (LA) levels of alexithymia. Two coloured squares were presented, one was reinforced with a mild electrical stimulation (CS+) while the other was never reinforced (CS−). Critically, despite all groups showing higher SCR to CS+ compared to CS−, SCR to CS+ was lower and extinguished earlier in HA compared to MA and LA. These differences appeared to be attributable neither to differences in the intensity of stimulation received, nor to SCR to the stimulation itself. Groups showed comparable SCR to CS− as well. Therefore, HA exhibited decreased anticipation of the occurrence of a negative emotional event. Disruption of this mechanism may then compromise effective emotion recognition, emotional response and response regulation, which characterise HA, and represent a unifying causal mechanism underlying the difficulties in emotion processing of this group.

Striatal structure and function predict individual biases in learning to avoid pain

Pain is an elemental inducer of avoidance. Here, we demonstrate that people differ in how they learn to avoid pain, with some individuals refraining from actions that resulted in painful outcomes, whereas others favor actions that helped prevent pain. These individual biases were best explained by differences in learning from outcome prediction errors and were associated with distinct forms of striatal responses to painful outcomes. Specifically, striatal responses to pain were modulated in a manner consistent with an aversive prediction error in individuals who learned predominantly from pain, whereas in individuals who learned predominantly from success in preventing pain, modulation was consistent with an appetitive prediction error. In contrast, striatal responses to success in preventing pain were consistent with an appetitive prediction error in both groups. Furthermore, variation in striatal structure, encompassing the region where pain prediction errors were expressed, predicted participants' predominant mode of learning, suggesting the observed learning biases may reflect stable individual traits. These results reveal functional and structural neural components underlying individual differences in avoidance learning, which may be important contributors to psychiatric disorders involving pathological harm avoidance behavior.

Disrupted Prediction Error Links Excessive Amygdala Activation to Excessive Fear

Basolateral amygdala (BLA) is critical for fear learning, and its heightened activation is widely thought to underpin a variety of anxiety disorders. Here we used chemogenetic techniques in rats to study the consequences of heightened BLA activation for fear learning and memory, and to specifically identify a mechanism linking increased activity of BLA glutamatergic neurons to aberrant fear. We expressed the excitatory hM3Dq DREADD in rat BLA glutamatergic neurons and showed that CNO acted selectively to increase their activity, depolarizing these neurons and increasing their firing rates. This chemogenetic excitation of BLA glutamatergic neurons had no effect on the acquisition of simple fear learning, regardless of whether this learning led to a weak or strong fear memory. However, in an associative blocking task, chemogenetic excitation of BLA glutamatergic neurons yielded significant learning to a blocked conditioned stimulus, which otherwise should not have been learned about. Moreover, in an overexpectation task, chemogenetic manipulation of BLA glutamatergic neurons prevented use of negative prediction error to reduce fear learning, leading to significant impairments in fear inhibition. These effects were not attributable to the chemogenetic manipulation enhancing arousal, increasing asymptotic levels of fear learning or fear memory consolidation. Instead, chemogenetic excitation of BLA glutamatergic neurons disrupted use of prediction error to regulate fear learning.

SIGNIFICANCE STATEMENT

Several neuropsychiatric disorders are characterized by heightened activation of the amygdala. This heightened activation has been hypothesized to underlie increased emotional reactivity, fear over generalization, and deficits in fear inhibition. Yet the mechanisms linking heightened amygdala activation to heightened emotional learning are elusive. Here we combined chemogenetic excitation of rat basolateral amygdala glutamatergic neurons with a variety of behavioral approaches to show that, although simple fear learning is unaffected, the use of prediction error to regulate this learning is profoundly disrupted, leading to formation of inappropriate fear associations and impaired fear inhibition.

Proximal vocal threat recruits the right voice-sensitive auditory cortex

The accurate estimation of the proximity of threat is important for biological survival and to assess relevant events of everyday life. We addressed the question of whether proximal as compared with distal vocal threat would lead to a perceptual advantage for the perceiver. Accordingly, we sought to highlight the neural mechanisms underlying the perception of proximal vs distal threatening vocal signals by the use of functional magnetic resonance imaging. Although we found that the inferior parietal and superior temporal cortex of human listeners generally decoded the spatial proximity of auditory vocalizations, activity in the right voice-sensitive auditory cortex was specifically enhanced for proximal aggressive relative to distal aggressive voices as compared with neutral voices. Our results shed new light on the processing of imminent danger signaled by proximal vocal threat and show the crucial involvement of the right mid voice-sensitive auditory cortex in such processing.

Relief learning is dependent on NMDA receptor activation in the nucleus accumbens

BACKGROUND AND PURPOSE

Recently, we demonstrated that the nucleus accumbens (NAC) is required for the acquisition and expression of relief memory. The purpose of this study was to investigate the role of NMDA receptors within the NAC in relief learning.

EXPERIMENTAL APPROACH

The NMDA receptor antagonist 2-amino-5-phosphonopentanoic acid (AP-5) was injected into the NAC. The effects of these injections on the acquisition and expression of relief memory, as well as on the reactivity to aversive electric stimuli, were tested.

KEY RESULTS

Intra-accumbal AP-5 injections blocked the acquisition but not the expression of relief memory. Furthermore, reactivity to aversive electric stimuli was not affected by the AP-5 injections.

CONCLUSION AND IMPLICATION

The present data indicate that NMDA-dependent plasticity within the NAC is crucial for the acquisition of relief memory.

Pharmacogenetic excitation of dorsomedial prefrontal cortex restores fear prediction error

Pavlovian conditioning involves encoding the predictive relationship between a conditioned stimulus (CS) and an unconditioned stimulus, so that synaptic plasticity and learning is instructed by prediction error. Here we used pharmacogenetic techniques to show a causal relation between activity of rat dorsomedial prefrontal cortex (dmPFC) neurons and fear prediction error. We expressed the excitatory hM3Dq designer receptor exclusively activated by a designer drug (DREADD) in dmPFC and isolated actions of prediction error by using an associative blocking design. Rats were trained to fear the visual CS (CSA) in stage I via pairings with footshock. Then in stage II, rats received compound presentations of visual CSA and auditory CS (CSB) with footshock. This prior fear conditioning of CSA reduced the prediction error during stage II to block fear learning to CSB. The group of rats that received AAV-hSYN-eYFP vector that was treated with clozapine-N-oxide (CNO; 3 mg/kg, i.p.) before stage II showed blocking when tested in the absence of CNO the next day. In contrast, the groups that received AAV-hSYN-hM3Dq and AAV-CaMKIIα-hM3Dq that were treated with CNO before stage II training did not show blocking; learning toward CSB was restored. This restoration of prediction error and fear learning was specific to the injection of CNO because groups that received AAV-hSYN-hM3Dq and AAV-CaMKIIα-hM3Dq that were injected with vehicle before stage II training did show blocking. These effects were not attributable to the DREADD manipulation enhancing learning or arousal, increasing fear memory strength or asymptotic levels of fear learning, or altering fear memory retrieval. Together, these results identify a causal role for dmPFC in a signature of adaptive behavior: using the past to predict future danger and learning from errors in these predictions.

Pharmacology of cognitive enhancers for exposure-based therapy of fear, anxiety and trauma-related disorders

Pathological fear and anxiety are highly debilitating and, despite considerable advances in psychotherapy and pharmacotherapy they remain insufficiently treated in many patients with PTSD, phobias, panic and other anxiety disorders. Increasing preclinical and clinical evidence indicates that pharmacological treatments including cognitive enhancers, when given as adjuncts to psychotherapeutic approaches [cognitive behavioral therapy including extinction-based exposure therapy] enhance treatment efficacy, while using anxiolytics such as benzodiazepines as adjuncts can undermine long-term treatment success. The purpose of this review is to outline the literature showing how pharmacological interventions targeting neurotransmitter systems including serotonin, dopamine, noradrenaline, histamine, glutamate, GABA, cannabinoids, neuropeptides (oxytocin, neuropeptides Y and S, opioids) and other targets (neurotrophins BDNF and FGF2, glucocorticoids, L-type-calcium channels, epigenetic modifications) as well as their downstream signaling pathways, can augment fear extinction and strengthen extinction memory persistently in preclinical models. Particularly promising approaches are discussed in regard to their effects on specific aspects of fear extinction namely, acquisition, consolidation and retrieval, including long-term protection from return of fear (relapse) phenomena like spontaneous recovery, reinstatement and renewal of fear. We also highlight the promising translational value of the preclinial research and the clinical potential of targeting certain neurochemical systems with, for example d-cycloserine, yohimbine, cortisol, and L-DOPA. The current body of research reveals important new insights into the neurobiology and neurochemistry of fear extinction and holds significant promise for pharmacologically-augmented psychotherapy as an improved approach to treat trauma and anxiety-related disorders in a more efficient and persistent way promoting enhanced symptom remission and recovery.

Developmental rodent models of fear and anxiety: from neurobiology to pharmacology

Anxiety disorders pose one of the biggest threats to mental health in the world, and they predominantly emerge early in life. However, research of anxiety disorders and fear-related memories during development has been largely neglected, and existing treatments have been developed based on adult models of anxiety. The present review describes animal models of anxiety disorders across development and what is currently known of their pharmacology. To summarize, the underlying mechanisms of intrinsic 'unlearned' fear are poorly understood, especially beyond the period of infancy. Models using 'learned' fear reveal that through development, rats exhibit a stress hyporesponsive period before postnatal day 10, where they paradoxically form odour-shock preferences, and then switch to more adult-like conditioned fear responses. Juvenile rats appear to forget these aversive associations more easily, as is observed with the phenomenon of infantile amnesia. Juvenile rats also undergo more robust extinction, until adolescence where they display increased resistance to extinction. Maturation of brain structures, such as the amygdala, prefrontal cortex and hippocampus, along with the different temporal recruitment and involvement of various neurotransmitter systems (including NMDA, GABA, corticosterone and opioids) are responsible for these developmental changes. Taken together, the studies described in this review highlight that there is a period early in development where rats appear to be more robust in overcoming adverse early life experience. We need to understand the fundamental pharmacological processes underlying anxiety early in life in order to take advantage of this period for the treatment of anxiety disorders.

Relief learning is distinguished from safety learning by the requirement of the nucleus accumbens

Aversive events induce aversive memories (fear learning) and can also establish appetitive memories. This is the case for cues associated with the cessation of an aversive event (relief learning) or occurring in an explicitly unpaired fashion (safety learning). However, the neural basis of relief and safety learning is poorly understood. In particular, it is not clear whether relief learning and safety learning are neuronally distinct. In the present study, we ask whether the nucleus accumbens is required for the acquisition of relief- and/or safety memory. Temporary inactivation of the nucleus accumbens by local injections of the GABA-A receptor agonist muscimol during the learning session abolished relief learning whereas safety learning was not affected. Thus, the requirement for a functional nucleus accumbens distinguishes relief from safety learning, showing that these two forms of learning are neuronally distinct.

Aversive conditioning in honey bees (Apis mellifera anatolica): a comparison of drones and workers

Honey bees provide a model system to elucidate the relationship between sociality and complex behaviors within the same species, as females (workers) are highly social and males (drones) are more solitary. We report on aversive learning studies in drone and worker honey bees (Apis mellifera anatolica) in escape, punishment and discriminative punishment situations. In all three experiments, a newly developed electric shock avoidance assay was used. The comparisons of expected and observed responses were performed with conventional statistical methods and a systematic randomization modeling approach called object oriented modeling. The escape experiment consisted of two measurements recorded in a master-yoked paradigm: frequency of response and latency to respond following administration of shock. Master individuals could terminate an unavoidable shock triggered by a decrementing 30 s timer by crossing the shuttlebox centerline following shock activation. Across all groups, there was large individual response variation. When assessing group response frequency and latency, master subjects performed better than yoked subjects for both workers and drones. In the punishment experiment, individuals were shocked upon entering the shock portion of a bilaterally wired shuttlebox. The shock portion was spatially static and unsignalled. Only workers effectively avoided the shock. The discriminative punishment experiment repeated the punishment experiment but included a counterbalanced blue and yellow background signal and the side of shock was manipulated. Drones correctly responded less than workers when shock was paired with blue. However, when shock was paired with yellow there was no observable difference between drones and workers.

Tired and apprehensive: anxiety amplifies the impact of sleep loss on aversive brain anticipation

Anticipation is an adaptive process, aiding preparatory responses to potentially threatening events. However, excessive anticipatory responding and associated hyper-reactivity in the amygdala and insula are integral to anxiety disorders. Despite the co-occurrence of sleep disruption and anxiety disorders, the impact of sleep loss on affective anticipatory brain mechanisms, and the interaction with anxiety, remains unknown. Here, we demonstrate that sleep loss amplifies preemptive responding in the amygdala and anterior insula during affective anticipation in humans, especially for cues with high predictive certainty. Furthermore, trait anxiety significantly determined the degree of such neural vulnerability to sleep loss: individuals with highest trait anxiety showed the greatest increase in anticipatory insula activity when sleep deprived. Together, these data support a neuropathological model in which sleep disruption may contribute to the maintenance and/or exacerbation of anxiety through its impact on anticipatory brain function. They further raise the therapeutic possibility that targeted sleep restoration in anxiety may ameliorate excessive anticipatory responding and associated clinical symptomatology.

Prazosin differentially affects extinction of cocaine conditioned place preference on the basis of dose and initial preference

Recent work has shown that α1-adrenergic receptor blockade impairs extinction in fear conditioning paradigms in rodents. However, studies of the role of α1-adrenergic receptors in extinction using other conditioning paradigms, such as those examining the conditioned effects of drug of abuse, have yielded inconsistent results. In this article, we reanalyze and extend previously reported findings of the effect of prazosin, an α1-adrenergic receptor antagonist, on the extinction of a cocaine-induced conditioned place preference in rats, using a median split of performance during the initial test for preference. This new reanalysis, which includes further extinction testing, indicated a paradoxical dose effect. A single post-test administration of a lower dose of prazosin, 0.3 mg/kg intraperitoneally, impaired extinction in rats that showed a below-median preference during initial testing, but had no effect on extinction in rats that showed an above-median preference during initial testing. In contrast, a single post-test administration of a higher dose of prazosin, 1.0 mg/kg intraperitoneally, enhanced extinction in rats that showed an above-median preference during initial testing, but had no effect on extinction in rats that showed a below-median preference during initial testing. Consistent with other studies of fear and drug conditioning, these results suggest the involvement of the α1-adrenergic receptor in the formation of extinction memories, but also indicate a potentially important differential effect on extinction on the basis of the dose of prazosin and the strength of the initial learning.

The error in total error reduction

Most models of human and animal learning assume that learning is proportional to the discrepancy between a delivered outcome and the outcome predicted by all cues present during that trial (i.e., total error across a stimulus compound). This total error reduction (TER) view has been implemented in connectionist and artificial neural network models to describe the conditions under which weights between units change. Electrophysiological work has revealed that the activity of dopamine neurons is correlated with the total error signal in models of reward learning. Similar neural mechanisms presumably support fear conditioning, human contingency learning, and other types of learning. Using a computational modeling approach, we compared several TER models of associative learning to an alternative model that rejects the TER assumption in favor of local error reduction (LER), which assumes that learning about each cue is proportional to the discrepancy between the delivered outcome and the outcome predicted by that specific cue on that trial. The LER model provided a better fit to the reviewed data than the TER models. Given the superiority of the LER model with the present data sets, acceptance of TER should be tempered.

Accumbal opioid receptors modulate cue competition in one-trial overshadowing

The contribution of opioid receptors in the nucleus accumbens to contextual and auditory fear conditioning was examined. Impairment in contextual fear conditioning was found when training occurred under accumbal infusions of the opioid receptor agonist morphine in a dose-dependent and receptor specific fashion, only when shock onset coincided with auditory stimulus offset. Contextual fear conditioning was spared, however when the delivery of shock was not signalled by an auditory stimulus, the auditory stimulus was of low intensity (70dB), or an interval (10s or 30s) was interpolated between auditory stimulus offset and shock onset. These results provide evidence that opioid receptors in the nucleus accumbens regulate competition between contextual and discrete auditory stimuli for association formation.

Stimulation of the dorsal periaqueductal gray enhances spontaneous recovery of a conditioned taste aversion

Due to its relevance to clinical practice, extinction of learned fears has been a major focus of recent research. However, less is known about the means by which conditioned fears re-emerge (i.e., spontaneously recover) as time passes or contexts change following extinction. The periaqueductal gray represents the final common pathway mediating defensive reactions to fear and we have reported previously that the dorsolateral PAG (dlPAG) exhibits a small but reliable increase in neural activity (as measured by c-fos protein immunoreactivity) when spontaneous recovery (SR) of a conditioned taste aversion (CTA) is reduced. Here we extend these correlational studies to determine if inducing dlPAG c-fos expression through electrical brain stimulation could cause a reduction in SR of a CTA. Male Sprague-Dawley rats acquired a strong aversion to saccharin (conditioned stimulus; CS) and then underwent CTA extinction through multiple non-reinforced exposures to the CS. Following a 30-day latency period after asymptotic extinction was achieved; rats either received stimulation of the dorsal PAG (dPAG) or stimulation of closely adjacent structures. Sixty minutes following the stimulation, rats were again presented with the saccharin solution as we tested for SR of the CTA. The brain stimulation evoked c-fos expression around the tip of the electrodes. However, stimulation of the dPAG failed to reduce SR of the previously extinguished CTA. In fact, dPAG stimulation caused rats to significantly suppress their saccharin drinking (relative to controls) - indicating an enhanced SR. These data refute a cause-and-effect relationship between enhanced dPAG c-fos expression and a reduction in SR. However, they highlight a role for the dPAG in modulating SR of extinguished CTAs.

Enhanced striatal sensitivity to aversive reinforcement in adolescents versus adults

Neurodevelopmental changes in mesolimbic regions are associated with adolescent risk-taking behavior. Numerous studies have shown exaggerated activation in the striatum in adolescents compared with children and adults during reward processing. However, striatal sensitivity to aversion remains elusive. Given the important role of the striatum in tracking both appetitive and aversive events, addressing this question is critical to understanding adolescent decision-making, as both positive and negative factors contribute to this behavior. In this study, human adult and adolescent participants performed a task in which they received squirts of appetitive or aversive liquid while undergoing fMRI, a novel approach in human adolescents. Compared with adults, adolescents showed greater behavioral and striatal sensitivity to both appetitive and aversive stimuli, an effect that was exaggerated in response to delivery of the aversive stimulus. Collectively, these findings contribute to understanding how neural responses to positive and negative outcomes differ between adolescents and adults and how they may influence adolescent behavior.

Cognition-emotion dysinteraction in schizophrenia

Evolving theories of schizophrenia emphasize a "disconnection" in distributed fronto-striatal-limbic neural systems, which may give rise to breakdowns in cognition and emotional function. We discuss these diverse domains of function from the perspective of disrupted neural circuits involved in "cold" cognitive vs. "hot" affective operations and the interplay between these processes. We focus on three research areas that highlight cognition-emotion dysinteractions in schizophrenia: First, we discuss the role of cognitive deficits in the "maintenance" of emotional information. We review recent evidence suggesting that motivational abnormalities in schizophrenia may in part arise due to a disrupted ability to "maintain" affective information over time. Here, dysfunction in a prototypical "cold" cognitive operation may result in "affective" deficits in schizophrenia. Second, we discuss abnormalities in the detection and ascription of salience, manifest as excessive processing of non-emotional stimuli and inappropriate distractibility. We review emerging evidence suggesting deficits in some, but not other, specific emotional processes in schizophrenia - namely an intact ability to perceive emotion "in-the-moment" but poor prospective valuation of stimuli and heightened reactivity to stimuli that ought to be filtered. Third, we discuss abnormalities in learning mechanisms that may give rise to delusions, the fixed, false, and often emotionally charged beliefs that accompany psychosis. We highlight the role of affect in aberrant belief formation, mostly ignored by current theoretical models. Together, we attempt to provide a consilient overview for how breakdowns in neural systems underlying affect and cognition in psychosis interact across symptom domains. We conclude with a brief treatment of the neurobiology of schizophrenia and the need to close our explanatory gap between cellular-level hypotheses and complex behavioral symptoms observed in this illness.

Cognition-emotion dysinteraction in schizophrenia

Evolving theories of schizophrenia emphasize a "disconnection" in distributed fronto-striatal-limbic neural systems, which may give rise to breakdowns in cognition and emotional function. We discuss these diverse domains of function from the perspective of disrupted neural circuits involved in "cold" cognitive vs. "hot" affective operations and the interplay between these processes. We focus on three research areas that highlight cognition-emotion dysinteractions in schizophrenia: First, we discuss the role of cognitive deficits in the "maintenance" of emotional information. We review recent evidence suggesting that motivational abnormalities in schizophrenia may in part arise due to a disrupted ability to "maintain" affective information over time. Here, dysfunction in a prototypical "cold" cognitive operation may result in "affective" deficits in schizophrenia. Second, we discuss abnormalities in the detection and ascription of salience, manifest as excessive processing of non-emotional stimuli and inappropriate distractibility. We review emerging evidence suggesting deficits in some, but not other, specific emotional processes in schizophrenia - namely an intact ability to perceive emotion "in-the-moment" but poor prospective valuation of stimuli and heightened reactivity to stimuli that ought to be filtered. Third, we discuss abnormalities in learning mechanisms that may give rise to delusions, the fixed, false, and often emotionally charged beliefs that accompany psychosis. We highlight the role of affect in aberrant belief formation, mostly ignored by current theoretical models. Together, we attempt to provide a consilient overview for how breakdowns in neural systems underlying affect and cognition in psychosis interact across symptom domains. We conclude with a brief treatment of the neurobiology of schizophrenia and the need to close our explanatory gap between cellular-level hypotheses and complex behavioral symptoms observed in this illness.

Exercise offers anxiolytic potential: a role for stress and brain noradrenergic-galaninergic mechanisms

Although physical activity reduces anxiety in humans, the neural basis for this response is unclear. Rodent models are essential to understand the mechanisms that underlie the benefits of exercise. However, it is controversial whether exercise exerts anxiolytic-like potential in rodents. Evidence is reviewed to evaluate the effects of wheel running, an experimental mode of exercise in rodents, on behavior in tests of anxiety and on norepinephrine and galanin systems in neural circuits that regulate stress. Stress is proposed to account for mixed behavioral findings in this literature. Indeed, running promotes an adaptive response to stress and alters anxiety-like behaviors in a manner dependent on stress. Running amplifies galanin expression in noradrenergic locus coeruleus (LC) and suppresses stress-induced activity of the LC and norepinephrine output in LC-target regions. Thus, enhanced galanin-mediated suppression of brain norepinephrine in runners is supported by current literature as a mechanism that may contribute to the stress-protective effects of exercise. These data support the use of rodents to study the emotional and neurobiological consequences of exercise.