Different methods of fear reduction are supported by distinct cortical substrates

Orbitofrontal and Prelimbic Cortices Serve Complementary Roles in Adapting Reward Seeking to Learned Anxiety

BACKGROUND

Anxiety is a common symptom of several mental health disorders and adversely affects motivated behaviors. Anxiety can emerge from associating risk of future harm while engaged in goal-guided actions. Using a recently developed behavioral paradigm to model this aspect of anxiety, we investigated the role of 2 cortical subregions, the prelimbic medial frontal cortex (PL) and lateral orbitofrontal cortex (lOFC), which have been implicated in anxiety and outcome expectation, in flexible representation of actions associated with harm risk.

METHODS

A seek-take reward-guided instrumental task design was used to train animals (N = 8) to associate the seek action with a variable risk of punishment. After learning, animals underwent extinction training for this association. Fiber photometry was used to measure and compare neuronal activity in the PL and lOFC during learning and extinction.

RESULTS

Animals increased action suppression in response to punishment contingencies. This increase dissipated after extinction training. These behavioral changes were associated with region-specific changes in neuronal activity. PL neuronal activity preferentially adapted to the threat of punishment, whereas lOFC activity adapted to safe aspects of the task. Moreover, correlated activity between these regions was suppressed during actions associated with harm risk, suggesting that these regions may guide behavior independently under anxiety.

CONCLUSIONS

These findings suggest that the PL and lOFC serve distinct but complementary roles in the representation of learned anxiety. This dissociation may provide a mechanism to explain how overlapping cortical systems are implicated in reward-guided action execution during anxiety.

Persistent disruption of overexpectation learning after inactivation of the lateral orbitofrontal cortex in male rats

RATIONALE AND OBJECTIVE

Learning to inhibit acquired fear responses is fundamental to adaptive behavior. Two procedures that support such learning are extinction and overexpectation. In extinction, an expected outcome is omitted, whereas in overexpectation two individually trained cues are presented in compound to induce an expectation of a greater outcome than that delivered. Previously, we showed that inactivation of the lateral orbitofrontal cortex (lOFC) in experimentally naïve male rats causes a mild impairment in extinction learning but a profound one in overexpectation. The mild extinction impairment was also transient; that is, it was absent in a cohort of rats that had prior history of inhibitory training (overexpectation, extinction) and their associated controls. This raised the question whether lOFC involvement in overexpectation could likewise be attenuated by prior experience.

METHODS

Using a muscimol/baclofen cocktail, we inactivated the lOFC during overexpectation training in rats with prior associative learning history (extinction, overexpectation, control) and examined its contribution to reducing learned fear.

RESULTS

Inactivating the lOFC during compound training in overexpectation persistently disrupted fear reduction on test in naïve rats and regardless of prior experience. Additionally, we confirm that silencing the lOFC only resulted in a mild impairment in extinction learning in naïve rats.

CONCLUSION

We show that prior associative learning experience did not mitigate the deficit in overexpectation caused by lOFC inactivation. Our findings emphasize the importance of this region for this particular form of fear reduction and broaden our understanding of the conditions in which the lOFC modulates behavioral inhibition.

Optogenetic stimulation of infralimbic cortex projections to the paraventricular thalamus attenuates context-induced renewal

Contexts associated with prior reinforcement can renew extinguished conditioned responding. The prelimbic (PL) and infralimbic (IL) cortices are thought to mediate the expression and suppression of conditioned responding, respectively. Evidence suggests that PL inputs to the paraventricular nucleus of the thalamus (PVT) drive the expression of cue-induced reinstatement of drug seeking and that IL inputs to the PVT mediate fear extinction retrieval. However, the role of these projections in renewal of appetitive Pavlovian conditioned responding is unknown. We trained male and female Long-Evans rats to associate a conditioned stimulus (CS; 10 s white noise) with delivery of a 10% sucrose unconditioned stimulus (US; .2 ml/CS) to a fluid port in a distinct context (Context A). We then extinguished responding by presenting the CS without the US in a different context (Context B). At test, rats were returned to Context A, and optogenetic stimulation was delivered to either the IL-to-PVT or PL-to-PVT pathway during CS presentations. Optically stimulating the IL-to-PVT, but not the PL-to-PVT pathway, attenuated ABA renewal of CS port entries, and this effect was similar in males and females. Further, rats self-administered optical stimulation of the IL-to-PVT but not the PL-to-PVT pathway suggesting that activation of the IL-to-PVT pathway is reinforcing. The effectiveness of optical stimulation parameters to activate neurons in the IL, PL and PVT was confirmed using Fos immunohistochemistry. These findings provide evidence for novel neural mechanisms in renewal of responding to a sucrose-predictive CS, as well as more generally in contextual processing and appetitive associative learning.

Neural correlates of recall and extinction in a rat model of appetitive Pavlovian conditioning

Extinction is a fundamental form of inhibitory learning that is important for adapting to changing environmental contingencies. While numerous studies have investigated the neural correlates of extinction using Pavlovian fear conditioning and appetitive operant reward-seeking procedures, less is known about the neural circuitry mediating the extinction of appetitive Pavlovian responding. Here, we aimed to generate an extensive brain activation map of extinction learning in a rat model of appetitive Pavlovian conditioning. Male Long-Evans rats were trained to associate a conditioned stimulus (CS; 20 s white noise) with the delivery of a 10% sucrose unconditioned stimulus (US; 0.3 ml/CS) to a fluid port. Control groups also received CS presentations, but sucrose was delivered either during the inter-trial interval or in the home-cage. After conditioning, 1 or 6 extinction sessions were conducted in which the CS was presented but sucrose was withheld. We performed Fos immunohistochemistry and network connectivity analyses on a set of cortical, striatal, thalamic, and amygdalar brain regions. Neural activity in the prelimbic cortex, ventral orbitofrontal cortex, nucleus accumbens core, and paraventricular nucleus of the thalamus was greater during recall relative to extinction. Conversely, prolonged extinction following 6 sessions induced increased neural activity in the infralimbic cortex, medial orbitofrontal cortex, and nucleus accumbens shell compared to home-cage controls. All these structures were similarly recruited during recall on the first extinction session. These findings provide novel evidence for the contribution of brain areas and neural networks that are differentially involved in the recall versus extinction of appetitive Pavlovian conditioned responding.

Second-order fear conditioning involves formation of competing stimulus-danger and stimulus-safety associations

How do animals process experiences that provide contradictory information? The present study addressed this question using second-order fear conditioning in rats. In second-order conditioning, rats are conditioned to fear a stimulus, S1, through its pairings with foot-shock (stage 1); and some days later, a second stimulus, S2, through its pairings with the already-conditioned S1 (stage 2). However, as foot-shock is never presented during conditioning to S2, we hypothesized that S2 simultaneously encodes 2 contradictory associations: one that drives fear to S2 (S2-danger) and another that reflects the absence of the expected unconditioned stimulus and partially masks that fear (e.g. S2-safety). We tested this hypothesis by manipulating the substrates of danger and safety learning in the brain (using a chemogenetic approach) and assessing the consequences for second-order fear to S2. Critically, silencing activity in the basolateral amygdala (important for danger learning) reduced fear to S2, whereas silencing activity in the infralimbic cortex (important for safety learning) enhanced fear to S2. These bidirectional changes are consistent with our hypothesis that second-order fear conditioning involves the formation of competing S2-danger and S2-safety associations. More generally, they show that a single set of experiences can produce contradictory associations and that the brain resolves the contradiction by encoding these associations in distinct brain regions.

The Recruitment of a Neuronal Ensemble in the Central Nucleus of the Amygdala During the First Extinction Episode Has Persistent Effects on Extinction Expression

BACKGROUND

Adaptive behavior depends on the delicate and dynamic balance between acquisition and extinction memories. Disruption of this balance, particularly when the extinction of memory loses control over behavior, is the root of treatment failure of maladaptive behaviors such as substance abuse or anxiety disorders. Understanding this balance requires a better understanding of the underlying neurobiology and its contribution to behavioral regulation.

METHODS

We microinjected Daun02 in Fos-lacZ transgenic rats following a single extinction training episode to delete extinction-recruited neuronal ensembles in the basolateral amygdala (BLA) and central nucleus of the amygdala (CN) and examined their contribution to behavior in an appetitive Pavlovian task. In addition, we used immunohistochemistry and neuronal staining methods to identify the molecular markers of activated neurons in the BLA and CN during extinction learning or retrieval.

RESULTS

CN neurons were preferentially engaged following extinction, and deletion of these extinction-activated ensembles in the CN but not the BLA impaired the retrieval of extinction despite additional extinction training and promoted greater levels of behavioral restoration in spontaneous recovery and reinstatement. Disrupting extinction processing in the CN in turn increased activity in the BLA. Our results also show a specific role for CN PKCδ+ neurons in behavioral inhibition but not during initial extinction learning.

CONCLUSIONS

We showed that the initial extinction-recruited CN ensemble is critical to the acquisition-extinction balance and that greater behavioral restoration does not mean weaker extinction contribution. These findings provide a novel avenue for thinking about the neural mechanisms of extinction and for developing treatments for cue-triggered appetitive behaviors.

The rodent medial prefrontal cortex and associated circuits in orchestrating adaptive behavior under variable demands

Emerging evidence implicates rodent medial prefrontal cortex (mPFC) in tasks requiring adaptation of behavior to changing information from external and internal sources. However, the computations within mPFC and subsequent outputs that determine behavior are incompletely understood. We review the involvement of mPFC subregions, and their projections to the striatum and amygdala in two broad types of tasks in rodents: 1) appetitive and aversive Pavlovian and operant conditioning tasks that engage mPFC-striatum and mPFC-amygdala circuits, and 2) foraging-based tasks that require decision making to optimize reward. We find support for region-specific function of the mPFC, with dorsal mPFC and its projections to the dorsomedial striatum supporting action control with higher cognitive demands, and ventral mPFC engagement in translating affective signals into behavior via discrete projections to the ventral striatum and amygdala. However, we also propose that defined mPFC subdivisions operate as a functional continuum rather than segregated functional units, with crosstalk that allows distinct subregion-specific inputs (e.g., internal, affective) to influence adaptive behavior supported by other subregions.

Dorsal Raphe 5-HT Neurons Utilize, But Do Not Generate, Negative Aversive Prediction Errors

The dorsal raphe nucleus (DRN) contains the largest population of serotonin (5-HT) neurons in the central nervous system. 5-HT, synthesized via tryptophan hydroxylase 2 (Tph2), is a widely functioning neuromodulator implicated in fear learning. Here, we sought to investigate whether DRN 5-HT is necessary to reduce fear via negative prediction error (–PE). Using male and female TPH2-cre rats, DRN^tph2+ cells were selectively deleted via cre-caspase (rAAV5-Flex-taCasp3-TEVp) in experiment 1. Rats then underwent fear discrimination during which three cues were associated with unique foot shock probabilities: safety p = 0.00, uncertainty p = 0.375, and danger p = 1.00. Rats then received selective extinction to the uncertainty cue, a behavioral manipulation designed to probe –PE. Deleting DRN^tph2+ cells had no impact on initial discrimination but slowed selective extinction. In experiment 2, we used a within-subjects optogenetic inhibition design to causally implicate DRN^tph2+ cells in prediction error signaling. Male and female TPH2-cre rats received intra-DRN infusions of cre-dependent halorhodopsin (rAAV5-Ef1a-DIO-eNpHR3.0-eYFP) or cre-YFP. DRN^tph2+ cells were inhibited specifically during the time of prediction error or a control period. Illumination during either positive prediction error (+PE) or control periods had no impact on fear to the uncertainty cue. Inhibition of DRN^tph2+ cells at the time of –PE did not impact immediate fear, but facilitated selective extinction in postillumination sessions. Together, these results demonstrate a role for DRN^tph2+ cells in using, but not generating, –PE to weaken cue-shock associations.

Mechanisms of higher-order learning in the amygdala

Adaptive behaviour is under the potent control of environmental cues. Such cues can acquire value by virtue of their associations with outcomes of motivational significance, be they appetitive or aversive. There are at least two ways through which an environmental cue can acquire value, through first-order and higher-order conditioning. In first-order conditioning, a neutral cue is directly paired with an outcome of motivational significance. In higher-order conditioning, a cue is indirectly associated with motivational events via a directly conditioned first-order stimulus. The present article reviews some of the associations that support learning in first- and higher-order conditioning, as well as the role of the BLA and the molecular mechanisms involved in these two types of learning.

A prefrontal-bed nucleus of the stria terminalis circuit limits fear to uncertain threat

In many cases of trauma, the same environmental stimuli that become associated with aversive events are experienced on other occasions without adverse consequence. We examined neural circuits underlying partially reinforced fear (PRF), whereby mice received tone-shock pairings on half of conditioning trials. Tone-elicited freezing was lower after PRF conditioning than fully reinforced fear (FRF) conditioning, despite an equivalent number of tone-shock pairings. PRF preferentially activated medial prefrontal cortex (mPFC) and bed nucleus of the stria terminalis (BNST). Chemogenetic inhibition of BNST-projecting mPFC neurons increased PRF, not FRF, freezing. Multiplexing chemogenetics with in vivo neuronal recordings showed elevated infralimbic cortex (IL) neuronal activity during CS onset and freezing cessation; these neural correlates were abolished by chemogenetic mPFC→BNST inhibition. These data suggest that mPFC→BNST neurons limit fear to threats with a history of partial association with an aversive stimulus, with potential implications for understanding the neural basis of trauma-related disorders.

Adaptive behaviour under conflict: Deconstructing extinction, reversal, and active avoidance learning

In complex environments, organisms must respond adaptively to situations despite conflicting information. Under natural (i.e. non-laboratory) circumstances, it is rare that cues or responses are consistently paired with a single outcome. Inconsistent pairings are more common, as are situations where cues and responses are associated with multiple outcomes. Such inconsistency creates conflict, and a response that is adaptive in one scenario may not be adaptive in another. Learning to adjust responses accordingly is important for species to survive and prosper. Here we review the behavioural and brain mechanisms of responding under conflict by focusing on three popular behavioural procedures: extinction, reversal learning, and active avoidance. Extinction involves adapting from reinforcement to non-reinforcement, reversal learning involves swapping the reinforcement of cues or responses, and active avoidance involves performing a response to avoid an aversive outcome, which may conflict with other defensive strategies. We note that each of these phenomena relies on somewhat overlapping neural circuits, suggesting that such circuits may be critical for the general ability to respond appropriately under conflict.