The prelimbic cortex uses higher-order cues to modulate both the acquisition and expression of conditioned fear

Early life adversity drives sex-dependent changes in 5-mC DNA methylation of parvalbumin cells in the prefrontal cortex in rats

Early life adversity (ELA) can result in increased risk for developing affective disorders, such as anxiety or depression, later in life, with women showing increased risk. Interactions between an individual's genes and their environment play key roles in producing, as well as mitigating, later life neuropathology. Our current understanding of the underlying epigenomic drivers of ELA associated anxiety and depression are limited, and this stems in part from the complexity of underlying biochemical processes associated with how early experiences shapes later life behavior. Epigenetic alterations, or experience-driven modifications to DNA, can be leveraged to understand the interplay between genes and the environment. The present study characterized DNA methylation patterning, assessed via evaluation of 5-methylcytosine (5-mC), following ELA in a Sprague Dawley rat model of ELA induced by early caregiver deprivation. This study utilized maternal separation to investigate sex- and age-specific outcomes of ELA on epigenetic patterning in parvalbumin (PV)-containing interneurons in the prefrontal cortex (PFC), a subpopulation of inhibitory neurons which are associated with ELA and affective dysfunction. While global analysis of 5-mC methylation and CpG site specific pyrosequencing of the PV promoter, Pvalb, showed no obvious effects of ELA, when analyses were restricted to assessing 5-mC intensity in colocalized PV cells, there were significant sex and age dependent effects. We found that ELA leads sex-specific changes in PV cell counts, and that cell counts can be predicted by 5-mC intensity, with males and females showing distinct patterns of methylation and PV outcomes. ELA also produced sex-specific effects in corticosterone reactivity, with juvenile females showing a blunted stress hormone response compared to controls. Overall, ELA led to a sex-specific developmental shift in PV profile, which is comparable to profiles that are seen at a later developmental timepoint, and this shift may be mediated in part by epigenomic alterations driven by altered DNA methylation.

Prefrontal Regulation of Safety Learning during Ethologically Relevant Thermal Threat

Learning and adaptation during sources of threat and safety are critical mechanisms for survival. The prelimbic (PL) and infralimbic (IL) subregions of the medial prefrontal cortex (mPFC) have been broadly implicated in the processing of threat and safety. However, how these regions regulate threat and safety during naturalistic conditions involving thermal challenge still remains elusive. To examine this issue, we developed a novel paradigm in which adult mice learned that a particular zone that was identified with visuospatial cues was associated with either a noxious cold temperature ("threat zone") or a pleasant warm temperature ("safety zone"). This led to the rapid development of avoidance behavior when the zone was paired with cold threat or approach behavior when the zone was paired with warm safety. During a long-term test without further thermal reinforcement, mice continued to exhibit robust avoidance or approach to the zone of interest, indicating that enduring spatial-based memories were formed to represent the thermal threat and thermal safety zones. Optogenetic experiments revealed that neural activity in PL and IL was not essential for establishing the memory for the threat zone. However, PL and IL activity bidirectionally regulated memory formation for the safety zone. While IL activity promoted safety memory during normal conditions, PL activity suppressed safety memory especially after a stress pretreatment. Therefore, a working model is proposed in which balanced activity between PL and IL is favorable for safety memory formation, whereas unbalanced activity between these brain regions is detrimental for safety memory after stress.

Prelimbic cortex ensembles promote appetitive learning-associated behavior

Memories of prior rewards bias our actions and future decisions. To determine the neural correlates of an appetitive associative learning task, we trained male mice to discriminate a reward-predicting cue over the course of 7 d. Encoding, recent recall, and remote recall were investigated to determine the areas of the brain recruited at each stage of learning. Using cFos as a proxy for neuronal activity, we found unique brain-wide patterns of activity across days that seem to correlate with distinct stages of learning. In particular, the prelimbic (PL) cortex was significantly recruited during the encoding of a novel association presentation, but its activity decreases as learning continues. To causally dissect the role of the PL in a reward memory across days, we chemogenetically inhibited first the PL entirely and then only tagged memory-bearing cells that were active during encoding in two stages of learning: early and late. Both nonspecific and specific PL inhibition experiments indicate that the PL drives behavior during late stages of learning to facilitate appropriate cue-driven behavior. Overall, our work underscores memory's role in discriminative reward seeking, and points to the PL as a target for modulating disorders in which impaired reward processing is a core component.

The infralimbic and prelimbic cortical areas bidirectionally regulate safety learning during normal and stress conditions

Safety learning is a critical function for behavioral adaptation, environmental fitness, and mental health. Animal models have implicated the prelimbic (PL) and infralimbic (IL) subregions of the medial prefrontal cortex (mPFC) in safety learning. However, whether these regions differentially contribute to safety learning and how their contributions become affected by stress still remain poorly understood. In this study, we evaluated these issues using a novel semi-naturalistic mouse model for threat and safety learning. As mice navigated within a test arena, they learned that specific zones were associated with either noxious cold temperatures ("threat") or pleasant warm temperatures ("safety"). Optogenetic-mediated inhibition revealed critical roles for the IL and PL regions for selectively controlling safety learning during these naturalistic conditions. This form of safety learning was also highly susceptible to stress pre-exposure, and while IL inhibition mimicked the deficits produced by stress, PL inhibition fully rescued safety learning in stress-exposed mice. Collectively, these findings indicate that IL and PL bidirectionally regulate safety learning during naturalistic situations, with the IL region promoting this function and the PL region suppressing it, especially after stress. A model of balanced IL and PL activity is proposed as a fundamental mechanism for controlling safety learning.

Competing contextual processes rely on the infralimbic and prelimbic medial prefrontal cortices in the rat

Ambiguous relationships between events may be established using interference procedures such as latent inhibition, extinction or counterconditioning. Under these conditions, the retrieval of individual associations between a stimulus and outcome is affected by contextual cues. To examine the roles of the dorsal (prelimbic) and ventral (infralimbic) medial prefrontal cortex in the contextual modulation of such associations, we investigated the context specificity of latent inhibition. Male Lister hooded rats were pre-exposed to two separate stimuli, one in each of two distinct contexts. Both stimuli were then paired with the delivery of mild foot-shock in the same one of these contexts. Finally, the strength of the resultant conditioned emotional response (CER) to each stimulus was assessed in each context. For the sham-operated control rats, the CER was attenuated for each stimulus when it was tested in the context in which it had been pre-exposed. Rats who had received lesions to the infralimbic cortex showed this effect only in the conditioning context, whereas rats with lesions to the prelimbic cortex showed the effect only in the context in which conditioning had not taken place. These findings indicate that infralimbic and prelimbic cortices play distinct, and competing, roles in the contextual modulation of initial and later learning.

Contributions of the GABAergic system of the prelimbic cortex and basolateral amygdala to morphine withdrawal-induced contextual fear

Morphine withdrawal can trigger disruptions in neuronal pathways involved in the modulation and expression of anxiety and fear-related behaviors, particularly those involved in associative learning. When it comes to contextual fear, specific subdivisions of the medial prefrontal cortex (mPFC) regulate the expression of defensive behaviors through projections to specific amygdala (AM) nuclei, such as the prelimbic cortex (PrL). The basolateral nucleus (BLA) of the AM has been shown to be involved in the modulation and expression of associative memories of fear, including those associated with opiate withdrawal-related aversive events. The purpose of this study is to determine the role of GABA mechanisms in the PrL and BLA in startle potentiation and freezing behavior caused by morphine-precipitated withdrawal. Our findings show that morphine withdrawal promotes the emergence of contextual conditioned fear in animals when they are exposed to the same environment where the withdrawal sessions were performed. This suggests that the neural circuits underlying the organism's response to conditioned stressors and the circuits modulating the negative affective states induced by drug withdrawal may overlap. The pharmacological manipulation of GABAergic neurotransmission in the PrL and BLA can reverse contextual fear in morphine-withdrawn rats, an effect that appears to be mediated, at least in part, by GABA_A receptors.

Neuronal activity mapping during exploration of a novel environment

Whole-brain mapping is an effective approach to investigate which brain areas are activated by the exploration of a novel environment. Previous studies analyzing neuronal activity promoted by novelty focused mostly on one specific area instead of the whole brain and measured activation using cfos immunohistochemistry. In this study, we utilized TRAP2 mice exposed to a novel and familiar environment to examine neuronal activity in exploratory, learning, and memory circuits. We analyzed the behavior of mice during environment exploration. Brain tissue was processed using tissue clarification and neurons active during exploration of an environment were mapped based on the cfos expression. Neuronal activity after each experience were quantified in regions of interest. We observed increased exploratory behavior in mice exposed to a novel environment in comparison to familiar (170.5 s ± 6.47 vs. 112.5 s ± 9.54, p = 0.0001). Neuronal activity was significantly increased in the dentate gyrus (115.56 ± 53.84 vs. 32.24 ± 12.32, p = 0.02) during the exploration of a novel environment. Moreover, examination of the remaining regions of interest showed some increase in the number of active neurons in the novel condition, however, those differences were not statistically significant. Brief exposure to a novel environment results in increased exploratory behavior and significant neuronal activity in the dentate gyrus.

Preventing adolescent synaptic pruning in mouse prelimbic cortex via local knockdown of α4βδ GABAA receptors increases anxiety response in adulthood

Anxiety is increasingly reported, especially in adolescent females. The etiology is largely unknown, which limits effective treatment. Layer 5 prelimbic cortex (L5PL) increases anxiety responses but undergoes adolescent synaptic pruning, raising the question of the impact of pruning on anxiety. Here we show that preventing L5PL pruning increases anxiety in response to an aversive event in adolescent and adult female mice. Spine density of Golgi-stained neurons decreased ~ 63% from puberty (~ PND35, vaginal opening) to post-puberty (PND56, P < 0.0001). Expression of α4βδ GABA_A receptors (GABARs) transiently increased tenfold in L5PL at puberty (P < 0.00001), but decreased post-pubertally. Both global and local knockdown of these receptors during puberty prevented pruning, increasing spine density post-pubertally (P < 0.0001), an effect reversed by blocking NMDA receptors (NMDARs). Pubertal expression of the NMDAR-dependent spine protein kalirin7 decreased (50%, P < 0.0001), an effect prevented by α4 knock-out, suggesting that α4βδ-induced reductions in kalirin7 underlie pruning. Increased spine density due to local α4 knockdown at puberty decreased open arm time on the elevated plus maze post-pubertally (62%, P < 0.0001) in response to an aversive stimulus, suggesting that increases in L5PL synapses increase anxiety responses. These findings suggest that prelimbic synaptic pruning is necessary to limit anxiety in adulthood and may suggest novel therapies.

Neuronal Nsun2 deficiency produces tRNA epitranscriptomic alterations and proteomic shifts impacting synaptic signaling and behavior

Epitranscriptomic mechanisms linking tRNA function and the brain proteome to cognition and complex behaviors are not well described. Here, we report bi-directional changes in depression-related behaviors after genetic disruption of neuronal tRNA cytosine methylation, including conditional ablation and transgene-derived overexpression of Nsun2 in the mouse prefrontal cortex (PFC). Neuronal Nsun2-deficiency was associated with a decrease in tRNA m5C levels, resulting in deficits in expression of 70% of tRNAGly isodecoders. Altogether, 1488/5820 proteins changed upon neuronal Nsun2-deficiency, in conjunction with glycine codon-specific defects in translational efficiencies. Loss of Gly-rich proteins critical for glutamatergic neurotransmission was associated with impaired synaptic signaling at PFC pyramidal neurons and defective contextual fear memory. Changes in the neuronal translatome were also associated with a 146% increase in glycine biosynthesis. These findings highlight the methylation sensitivity of glycinergic tRNAs in the adult PFC. Furthermore, they link synaptic plasticity and complex behaviors to epitranscriptomic modifications of cognate tRNAs and the proteomic homeostasis associated with specific amino acids.

Moderate prenatal ethanol exposure leads to attention deficits in both male and female rats

BACKGROUND

Attention deficits caused by prenatal ethanol (EtOH) exposure (PE) are a prevalent condition in fetal alcohol spectrum disorders (FASDs). Importantly, the deficits are observed in individuals with FASD who have normal IQs and show no dysmorphic facial features caused by heavy PE. These observations suggest that even moderate PE could lead to attention deficits. This possibility was investigated in the present study using a rat model.

METHODS

Pregnant Sprague Dawley rats were administered EtOH (3 g/kg/day) or vehicle via intragastric gavage on gestational days 8 to 20. The blood EtOH concentration (BEC) in EtOH-treated rats was 87.7 ± 1.2 mg/dl (1 h after the gavage), similar to the BECs reported in other moderate PE studies in rodents. Moderate PE did not produce teratogenic effects on birthweight or litter size. The adult offspring underwent a 2-choice reaction time task.

RESULTS

Moderate PE led to augmented action impulsivity in both sexes, indicated by more rapid response initiation and more premature responses. Deficits were more marked in males than in females. No greater lapses of attention, assessed by incorrect or relatively slow responses, were observed in rats of either sex with moderate PE. In addition, no deficits in learning or motor function were detected after moderate PE. Interestingly, rats with moderate PE completed more trials than controls.

CONCLUSIONS

Our results confirm that moderate PE leads to attention deficits in both sexes, which is demonstrated by greater action impulsivity, but not more lapses of attention. This effect differs from that of heavy PE, as shown in our previous study, which is manifested as impaired action impulsivity and lapses of attention in both sexes.

Central Thalamic-Medial Prefrontal Control of Adaptive Responding in the Rat: Many Players in the Chamber

The medial prefrontal cortex (mPFC) has robust afferent and efferent connections with multiple nuclei clustered in the central thalamus. These nuclei are elements in large-scale networks linking mPFC with the hippocampus, basal ganglia, amygdala, other cortical areas, and visceral and arousal systems in the brainstem that give rise to adaptive goal-directed behavior. Lesions of the mediodorsal nucleus (MD), the main source of thalamic input to middle layers of PFC, have limited effects on delayed conditional discriminations, like DMTP and DNMTP, that depend on mPFC. Recent evidence suggests that MD sustains and amplifies neuronal responses in mPFC that represent salient task-related information and is important for detecting and encoding contingencies between actions and their consequences. Lesions of rostral intralaminar (rIL) and ventromedial (VM) nuclei produce delay-independent impairments of egocentric DMTP and DNMTP that resemble effects of mPFC lesions on response speed and accuracy: results consistent with projections of rIL to striatum and VM to motor cortices. The ventral midline and anterior thalamic nuclei affect allocentric spatial cognition and memory consistent with their connections to mPFC and hippocampus. The dorsal midline nuclei spare DMTP and DNMTP. They have been implicated in behavioral-state control and response to salient stimuli in associative learning. mPFC functions are served during DNMTP by discrete populations of neurons with responses related to motor preparation, movements, lever press responses, reinforcement anticipation, reinforcement delivery, and memory delay. Population analyses show that different responses are timed so that they effectively tile the temporal interval from when DNMTP trials are initiated until the end. Event-related responses of MD neurons during DNMTP are predominantly related to movement and reinforcement, information important for DNMTP choice. These responses closely mirror the activity of mPFC neurons with similar responses. Pharmacological inactivation of MD and adjacent rIL affects the expression of diverse action- and outcome-related responses of mPFC neurons. Lesions of MD before training are associated with a shift away from movement-related responses in mPFC important for DNMTP choice. These results suggest that MD has short-term effects on the expression of event-related activity in mPFC and long-term effects that tune mPFC neurons to respond to task-specific information.

An Emergent Discriminative Learning Is Elicited During Multifrequency Testing

In auditory-conditioned fear learning, the freezing response is independent of the sound frequencies used, but the frequency of the conditioned sound is considered distinct from those of unrelated sounds based on electrophysiological responses in the auditory system. Whether an emergent discriminative learning underlies auditory fear conditioning and which nuclei and pathways are involved in it remain unclear. Using behavioral and electrophysiological assays, we found that the response of medial prefrontal cortex (mPFC) neurons to a conditioned auditory stimulus (CS) was enhanced relative to the response to unrelated frequencies (UFs) after auditory fear conditioning, and mice could distinguish the CS during multifrequency testing, a phenomenon called emergent discriminative learning. After silencing the mPFC with muscimol, emergent discriminative learning was blocked. In addition, the pure tone responses of mPFC neurons were inhibited after injection of lidocaine in the ipsilateral primary auditory cortex (A1), and the emergent discriminative learning was blocked by silencing both sides of A1 with muscimol. This study, therefore, provides evidence for an emergent discriminative learning mediated by mPFC and A1 neurons after auditory fear conditioning.

Interactions between the hippocampus, prefrontal cortex, and amygdala support complex learning and memory

One of the guiding principles of memory research in the preceding decades is multiple memory systems theory, which links specific task demands to specific anatomical structures and circuits that are thought to act orthogonally with respect to each other. We argue that this view does not capture the nature of learning and memory when any degree of complexity is introduced. In most situations, memory requires interactions between these circuits and they can act in a facilitative manner to generate adaptive behavior.

Infant Trauma Alters Social Buffering of Threat Learning: Emerging Role of Prefrontal Cortex in Preadolescence

Within the infant-caregiver attachment system, the primary caregiver holds potent reward value to the infant, exhibited by infants' strong preference for approach responses and proximity-seeking towards the mother. A less well-understood feature of the attachment figure is the caregiver's ability to reduce fear via social buffering, commonly associated with the notion of a "safe haven" in the developmental literature. Evidence suggests this infant system overlaps with the neural network supporting social buffering (attenuation) of fear in the adults of many species, a network known to involve the prefrontal cortex (PFC). Here, using odor-shock conditioning in young developing rats, we assessed when the infant system transitions to the adult-like PFC-dependent social buffering of threat system. Rat pups were odor-shock conditioned (0.55 mA-0.6 mA) at either postnatal day (PN18; dependent on mother) or 28 (newly independent, weaned at PN23). Within each age group, the mother was present or absent during conditioning, with PFC assessment following acquisition using 14C 2-DG autoradiography and cue testing the following day. Since the human literature suggests poor attachment attenuates the mother's ability to socially buffer the infants, half of the pups at each age were reared with an abusive mother from PN8-12. The results showed that for typical control rearing, the mother attenuated fear in both PN18 and PN28 pups, although the PFC [infralimbic (IL) and ventral prelimbic (vPL) cortices] was only engaged at PN28. Abuse rearing completely disrupted social buffering of pups by the mother at PN18. The results from PN28 pups showed that while the mother modulated learning in both control and abuse-reared pups, the behavioral and PFC effects were attenuated after maltreatment. Our data suggest that pups transition to the adult-like PFC social support circuit after independence from the mother (PN28), and this circuit remains functional after early-life trauma, although its effectiveness appears reduced. This is in sharp contrast to the effects of early life trauma during infancy, where social buffering of the infant is more robustly impacted. We suggest that the infant social buffering circuit is disengaged by early-life trauma, while the adolescent PFC-dependent social buffering circuit may use a safety signal with unreliable safety value.

Prelimbic and infralimbic cortical inactivations attenuate contextually driven discriminative responding for reward

The infralimbic (IL) and prelimbic (PL) cortices of the medial prefrontal cortex (mPFC) have been shown to differentially control context-dependent behavior, with the PL implicated in the expression of contextually conditioned fear and drug-seeking, and the IL in the suppression of these behaviors. However, the roles of these subregions in contextually driven natural reward-seeking remain relatively underexplored. The present study further examined the functional dichotomy within the mPFC in the contextual control over cued reward-seeking, using a contextual biconditional discrimination (CBD) task. Rats were first trained to emit a nose poke response to the presentation of an auditory stimulus (e.g., X) for the delivery of sucrose reward, and to withhold a nose poke response to the presentation of another auditory stimulus (e.g., Y) in a context-specific manner (e.g. Context A: X+, Y−; Context B: X−, Y+). Following acquisition, rats received bilateral microinjections of GABA receptor agonists (muscimol and baclofen), or saline into the IL or PL, prior to a CBD training session and a probe test (under extinction conditions). Both IL and PL inactivation resulted in robust impairment in CBD performance, indicating that both subregions are involved in the processing of appetitively motivated contextual memories in reward-seeking.

Loss of Hierarchical Control by Occasion Setters Following Lesions of the Prelimbic and Infralimbic Medial Prefrontal Cortex in Rats

Recent work suggests complementary roles of the prelimbic and infralimbic regions of the rat medial prefrontal cortex in cognitive control processes, with the prelimbic cortex implicated in top-down modulation of associations and the infralimbic cortex playing a role in the inhibition of inappropriate responses. Following selective lesions made to prelimbic or infralimbic regions (or control sham-surgery) rats received simultaneous training on Pavlovian feature negative (A+, XA-) and feature positive (B-, YB+) discriminations designed to lead to hierarchical occasion-setting control by the features (X, Y) over their respective targets (A, B). Evidence for hierarchical control was assessed in a transfer test in which features and targets were swapped (YA, XB). All groups were able to learn the feature negative and feature positive discriminations. Whilst sham-lesioned animals showed no transfer of control by features to novel targets (a hallmark of hierarchical control), rats with lesions of prelimbic or infralimbic regions showed evidence of transfer from the positive feature (Y) to the negative target (A), and from the negative feature (X) to the positive target (B; although this only achieved significance in infralimbic-lesioned animals). These data indicate that damage to either of these regions disrupts hierarchical occasion-setting control, extending our knowledge of their role in cognitive control to encompass flexible behaviours dictated by discrete cues.

An Integrated Model of Action Selection: Distinct Modes of Cortical Control of Striatal Decision Making

Making decisions in environments with few choice options is easy. We select the action that results in the most valued outcome. Making decisions in more complex environments, where the same action can produce different outcomes in different conditions, is much harder. In such circumstances, we propose that accurate action selection relies on top-down control from the prelimbic and orbitofrontal cortices over striatal activity through distinct thalamostriatal circuits. We suggest that the prelimbic cortex exerts direct influence over medium spiny neurons in the dorsomedial striatum to represent the state space relevant to the current environment. Conversely, the orbitofrontal cortex is argued to track a subject's position within that state space, likely through modulation of cholinergic interneurons.

Differential fear conditioning generates prefrontal neural ensembles of safety signals

Fear discrimination is critical for survival, while fear generalization is effective for avoiding dangerous situations. Overgeneralized fear is a typical symptom of anxiety disorders, including generalized anxiety disorder and posttraumatic stress disorder (PTSD). Previous research demonstrated that fear discrimination learning is mediated by prefrontal mechanisms. While the prelimbic (PL) and infralimbic (IL) subdivisions of the medial prefrontal cortex (mPFC) are recognized for their excitatory and inhibitory effects on the fear circuit, respectively, the mechanisms driving fear discrimination are unidentified. To obtain insight into the mechanisms underlying context-specific fear discrimination, we investigated prefrontal neuronal ensembles representing distinct experiences associated with learning to disambiguate between dangerous and similar, but not identical, harmless stimuli. Here, we show distinct quantitative activation differences in response to conditioned and generalized fear experiences, as well as modulation of the neuronal ensembles associated with successful acquisition of context-safety contingencies. These findings suggest that prefrontal neuronal ensembles patterns code functional context-danger and context-safety relationships. The PL subdivision of the mPFC monitors context-danger associations to conditioned fear, whereas differential conditioning sparks additional ensembles associated with the inhibition of generalized fear in both the PL and IL subdivisions of the mPFC. Our data suggest that fear discrimination learning is associated with the modulation of prefrontal subpopulations in a subregion- and experience-specific fashion, and the learning of appropriate responses to conditioned and initially generalized fear experiences is driven by gradual updating and rebalancing of the prefrontal memory representations.

The Bilateral Prefronto-striatal Pathway Is Necessary for Learning New Goal-Directed Actions

The acquisition of new goal-directed actions requires the encoding of action-outcome associations. At a neural level, this encoding has been hypothesized to involve a prefronto-striatal circuit extending between the prelimbic cortex (PL) and the posterior dorsomedial striatum (pDMS); however, no research identifying this pathway with any precision has been reported. We started by mapping the prelimbic input to the dorsal and ventral striatum using a combination of retrograde and anterograde tracing with CLARITY and established that PL-pDMS projections share some overlap with projections to the nucleus accumbens core (NAc) in rats. We then tested whether each of these pathways were functionally required for goal-directed learning; we used a pathway-specific dual-virus chemogenetic approach to selectively silence pDMS-projecting or NAc-projecting PL neurons during instrumental training and tested rats for goal-directed action. We found that silencing PL-pDMS projections abolished goal-directed learning, whereas silencing PL-NAc projections left goal-directed learning intact. Finally, we used a three-virus approach to silence bilateral and contralateral pDMS-projecting PL neurons and again blocked goal-directed learning. These results establish that the acquisition of new goal-directed actions depends on the bilateral PL-pDMS pathway driven by intratelencephalic cortical neurons.

Noradrenergic Modulation of Fear Conditioning and Extinction

The locus coeruleus norepinephrine (LC-NE) system plays a broad role in learning and memory. Here we begin with an overview of the LC-NE system. We then consider how both direct and indirect manipulations of the LC-NE system affect cued and contextual aversive learning and memory. We propose that NE dynamically modulates Pavlovian conditioning and extinction, either promoting or impairing learning aversive processes under different levels of behavioral arousal. We suggest that under high levels of stress (e.g., during/soon after fear conditioning) the locus coeruleus (LC) promotes cued fear learning by enhancing amygdala function while simultaneously blunting prefrontal function. Under low levels of arousal, the LC promotes PFC function to promote downstream inhibition of the amygdala and foster the extinction of cued fear. Thus, LC-NE action on the medial prefrontal cortex (mPFC) might be described by an inverted-U function such that it can either enhance or hinder learning depending on arousal states. In addition, LC-NE seems to be particularly important for the acquisition, consolidation and extinction of contextual fear memories. This may be due to dense adrenoceptor expression in the hippocampus (HPC) which encodes contextual information, and the ability of NE to regulate long-term potentiation (LTP). Moreover, recent work reveals that the diversity of LC-NE functions in aversive learning and memory are mediated by functionally heterogeneous populations of LC neurons that are defined by their projection targets. Hence, LC-NE function in learning and memory is determined by projection-specific neuromodulation that accompanies various states of behavioral arousal.

Prefrontal Corticostriatal Disconnection Blocks the Acquisition of Goal-Directed Action

The acquisition of goal-directed action requires encoding of the association between an action and its specific consequences or outcome. At a neural level, this encoding has been hypothesized to involve a prefrontal corticostriatal circuit involving the projection from the prelimbic cortex (PL) to the posterior dorsomedial striatum (pDMS); however, no direct evidence for this claim has been reported. In a series of experiments, we performed functional disconnection of this pathway using targeted lesions of the anterior corpus callosum to disrupt contralateral corticostriatal projections with asymmetrical lesions of the PL and/or pDMS to block plasticity in this circuit in rats. We first demonstrated that unilaterally blocking the PL input to the pDMS prevented the phosphorylation of extracellular signal-related kinase/mitogen activated protein kinase (pERK/pMAPK) induced by instrumental training. Next, we used a full bilateral disconnection of the PL from the pDMS and assessed goal-directed action using an outcome-devaluation test. Importantly, we found evidence that rats maintaining an ipsilateral and/or contralateral connection between the PL and the pDMS were able to acquire goal-directed actions. In contrast, bilateral PL-pDMS disconnection abolished the acquisition of goal-directed actions. Finally, we used a temporary pharmacological disconnection to disrupt PL inputs to the pDMS by infusing the NMDA antagonist dl-2-amino-5-phosphonopentanoic acid into the pDMS during instrumental training and found that this manipulation also disrupted goal-directed learning. These results establish that, in rats, the acquisition of new goal-directed actions depends on a prefrontal-corticostriatal circuit involving a connection between the PL and the pDMS.SIGNIFICANCE STATEMENT It has been hypothesized that the prelimbic cortex (PL) and posterior dorsomedial striatum (pDMS) in rodents interact in a corticostriatal circuit to mediate goal-directed learning. However, no direct evidence supporting this claim has been reported. Using targeted lesions, we performed functional disconnection of the PL-pDMS pathway to assess its role in goal-directed learning. In the first experiment, we demonstrated that PL input to the pDMS is necessary for instrumental training-induced neuronal activity. Next, we disrupted ipsilateral, contralateral, or bilateral PL-pDMS connections and found that only bilateral PL-pDMS disconnection disrupted the acquisition of goal-directed actions, a finding we replicated in our final study using a pharmacological disconnection procedure.

Preconditioned cues have no value

Sensory preconditioning has been used to implicate midbrain dopamine in model-based learning, contradicting the view that dopamine transients reflect model-free value. However, it has been suggested that model-free value might accrue directly to the preconditioned cue through mediated learning. Here, building on previous work (Sadacca et al., 2016), we address this question by testing whether a preconditioned cue will support conditioned reinforcement in rats. We found that while both directly conditioned and second-order conditioned cues supported robust conditioned reinforcement, a preconditioned cue did not. These data show that the preconditioned cue in our procedure does not directly accrue model-free value and further suggest that the cue may not necessarily access value even indirectly in a model-based manner. If so, then phasic response of dopamine neurons to cues in this setting cannot be described as signaling errors in predicting value.

Lateral Hypothalamic GABAergic Neurons Encode Reward Predictions that Are Relayed to the Ventral Tegmental Area to Regulate Learning

Eating is a learned process. Our desires for specific foods arise through experience. Both electrical stimulation and optogenetic studies have shown that increased activity in the lateral hypothalamus (LH) promotes feeding. Current dogma is that these effects reflect a role for LH neurons in the control of the core motivation to feed, and their activity comes under control of forebrain regions to elicit learned food-motivated behaviors. However, these effects could also reflect the storage of associative information about the cues leading to food in LH itself. Here, we present data from several studies that are consistent with a role for LH in learning. In the first experiment, we use a novel GAD-Cre rat to show that optogenetic inhibition of LH γ-aminobutyric acid (GABA) neurons restricted to cue presentation disrupts the rats' ability to learn that a cue predicts food without affecting subsequent food consumption. In the second experiment, we show that this manipulation also disrupts the ability of a cue to promote food seeking after learning. Finally, we show that inhibition of the terminals of the LH GABA neurons in ventral-tegmental area (VTA) facilitates learning about reward-paired cues. These results suggest that the LH GABA neurons are critical for storing and later disseminating information about reward-predictive cues.

Algorithms for survival: a comparative perspective on emotions

The nature and neural implementation of emotions is the subject of vigorous debate. Here, we use Bayesian decision theory to address key complexities in this field and conceptualize emotions in terms of their relationship to survival-relevant behavioural choices. Decision theory indicates which behaviours are optimal in a given situation; however, the calculations required are radically intractable. We therefore conjecture that the brain uses a range of pre-programmed algorithms that provide approximate solutions. These solutions seem to produce specific behavioural manifestations of emotions and can also be associated with core affective dimensions. We identify principles according to which these algorithms are implemented in the brain and illustrate our approach by considering decision making in the face of proximal threat.

Neural correlates of the mother-to-infant social transmission of fear

Although clinical and basic studies show that parental trauma, fear, and anxiety may be transmitted to offspring, the neurobiology of this transmission is still not well understood. We recently demonstrated in an animal model that infant rats acquire threat responses to a distinct cue when a mother expresses fear to this cue in their presence. This ability to acquire maternal fear through social learning is present at birth and, as we previously reported, depends on the pup's amygdala. However, the remaining neural mechanisms underlying social fear learning (SFL) in infancy remain elusive. Here, by using [(14) C]2-deoxyglucose autoradiography, we show that the mother-to-infant transmission of fear in preweaning rats is associated with a significant increase of activity in the subregions of the lateral septum, nucleus accumbens, bed nucleus of stria terminalis, retrosplenial cortex, paraventricular nucleus of the thalamus, mediodorsal and intralaminar thalamic nuclei, medial and the lateral preoptic nuclei of the hypothalamus, and the lateral periaqueductal gray. In contrast to studies of adult SFL demonstrating the role of the anterior cingulate cortex and possibly the insular cortex or research of infant classical fear conditioning showing the role of the posterior piriform cortex, no changes of activation in these areas were observed. Our results indicate that the pup's exposure to maternal fear activates a number of areas involved in processing threat, stress, or pain. This pattern of activation suggests a unique set of neural mechanisms underlying SFL in the developing brain.

The Role of the Medial Prefrontal Cortex in the Conditioning and Extinction of Fear

Once acquired, a fearful memory can persist for a lifetime. Although learned fear can be extinguished, extinction memories are fragile. The resilience of fear memories to extinction may contribute to the maintenance of disorders of fear and anxiety, including post-traumatic stress disorder (PTSD). As such, considerable effort has been placed on understanding the neural circuitry underlying the acquisition, expression, and extinction of emotional memories in rodent models as well as in humans. A triad of brain regions, including the prefrontal cortex, hippocampus, and amygdala, form an essential brain circuit involved in fear conditioning and extinction. Within this circuit, the prefrontal cortex is thought to exert top-down control over subcortical structures to regulate appropriate behavioral responses. Importantly, a division of labor has been proposed in which the prelimbic (PL) and infralimbic (IL) subdivisions of the medial prefrontal cortex (mPFC) regulate the expression and suppression of fear in rodents, respectively. Here, we critically review the anatomical and physiological evidence that has led to this proposed dichotomy of function within mPFC. We propose that under some conditions, the PL and IL act in concert, exhibiting similar patterns of neural activity in response to aversive conditioned stimuli and during the expression or inhibition of conditioned fear. This may stem from common synaptic inputs, parallel downstream outputs, or cortico-cortical interactions. Despite this functional covariation, these mPFC subdivisions may still be coding for largely opposing behavioral outcomes, with PL biased towards fear expression and IL towards suppression.

Epigenetics and memory: causes, consequences and treatments for post-traumatic stress disorder and addiction

Understanding the interaction between fear and reward at the circuit and molecular levels has implications for basic scientific approaches to memory and for understanding the etiology of psychiatric disorders. Both stress and exposure to drugs of abuse induce epigenetic changes that result in persistent behavioral changes, some of which may contribute to the formation of a drug addiction or a stress-related psychiatric disorder. Converging evidence suggests that similar behavioral, neurobiological and molecular mechanisms control the extinction of learned fear and drug-seeking responses. This may, in part, account for the fact that individuals with post-traumatic stress disorder have a significantly elevated risk of developing a substance use disorder and have high rates of relapse to drugs of abuse, even after long periods of abstinence. At the behavioral level, a major challenge in treatments is that extinguished behavior is often not persistent, returning with changes in context, the passage of time or exposure to mild stressors. A common goal of treatments is therefore to weaken the ability of stressors to induce relapse. With the discovery of epigenetic mechanisms that create persistent molecular signals, recent work on extinction has focused on how modulating these epigenetic targets can create lasting extinction of fear or drug-seeking behavior. Here, we review recent evidence pointing to common behavioral, systems and epigenetic mechanisms in the regulation of fear and drug seeking. We suggest that targeting these mechanisms in combination with behavioral therapy may promote treatment and weaken stress-induced relapse.

The prelimbic cortex directs attention toward predictive cues during fear learning

The prelimbic cortex is argued to promote conditioned fear expression, at odds with appetitive research implicating this region in attentional processing. Consistent with an attentional account, we report that the effect of prelimbic lesions on fear expression depends on the degree of competition between contextual and discrete cues. Further, when competition from contextual cues is low, we found that PL inactivation resulted in animals expressing fear toward irrelevant discrete cues; an effect selective to inactivation during the learning phase and not during retrieval. These data demonstrate that the prelimbic cortex modulates attention toward cues to preferentially direct fear responding on the basis of their predictive value.