Beta-adrenergic receptors support attention to extinction learning that occurs in the absence, but not the presence, of a context change

Distinct catecholaminergic pathways projecting to hippocampal CA1 transmit contrasting signals during navigation in familiar and novel environments

Neuromodulatory inputs to the hippocampus play pivotal roles in modulating synaptic plasticity, shaping neuronal activity, and influencing learning and memory. Recently it has been shown that the main sources of catecholamines to the hippocampus, ventral tegmental area (VTA) and locus coeruleus (LC), may have overlapping release of neurotransmitters and effects on the hippocampus. Therefore, to dissect the impacts of both VTA and LC circuits on hippocampal function, a thorough examination of how these pathways might differentially operate during behavior and learning is necessary. We therefore utilized 2-photon microscopy to functionally image the activity of VTA and LC axons within the CA1 region of the dorsal hippocampus in head-fixed male mice navigating linear paths within virtual reality (VR) environments. We found that within familiar environments some VTA axons and the vast majority of LC axons showed a correlation with the animals' running speed. However, as mice approached previously learned rewarded locations, a large majority of VTA axons exhibited a gradual ramping-up of activity, peaking at the reward location. In contrast, LC axons displayed a pre-movement signal predictive of the animal's transition from immobility to movement. Interestingly, a marked divergence emerged following a switch from the familiar to novel VR environments. Many LC axons showed large increases in activity that remained elevated for over a minute, while the previously observed VTA axon ramping-to-reward dynamics disappeared during the same period. In conclusion, these findings highlight distinct roles of VTA and LC catecholaminergic inputs in the dorsal CA1 hippocampal region. These inputs encode unique information, with reward information in VTA inputs and novelty and kinematic information in LC inputs, likely contributing to differential modulation of hippocampal activity during behavior and learning.

Memory Impairing Effect of Propranolol on Consolidation and Reconsolidation for Various Learning Tasks

Newly acquired memory traces have been thought to become stable and resistant to interruption after they are stored in long-term memory. However, according to a recent research drugs such as beta-adrenergic receptor antagonists enable memories to be updated and rewritten when administered during consolidation and reconsolidation. Propranolol is a widely used beta-adrenergic receptor antagonist that disrupts the consolidation and reconsolidation processes of memory formation as it inhibits protein synthesis in the central nervous system. This review aims to discuss the memory impairing effect of the systemic and intracerebral administration of propranolol during the consolidation and reconsolidation processes associated with different learning tasks. In doing so, this review will help elucidate the effects of propranolol on different stages of memory formation. Since learning and maladaptive memories underpin some of the most common psychological disorders, such as phobias, post-traumatic stress disorder, addiction, drug-seeking behavior, and so on, a thorough understanding of propranolol's memory-impairing effect has significant clinical value and the potential to help people suffering from these disorders.

Genetic Depletion of BDNF Impairs Extinction Learning of a Spatial Appetitive Task in the Presence or Absence of the Acquisition Context

Brain derived neurotropic factor (BDNF) supports neuronal survival, growth, and differentiation and is involved in forms of hippocampus-dependent and independent learning, as well as hippocampus-dependent learning. Extinction learning comprises active inhibition of no-longer relevant learned information, in conjunction with a decreased response of a previously learned behavior. It is highly dependent on context, and evidence exists that it requires hippocampal activation. The participation of BDNF in memory processing is experience-dependent. For example, BDNF has been associated with synaptic plasticity needed for spatial learning, and it is involved in acquisition and extinction learning of fear conditioning. However, little is known about its role in spatial appetitive extinction learning. In this study, we evaluated to what extent BDNF contributes to spatial appetitive extinction learning in the presence (ABA) or absence (AAA) of exposure to the acquisition context. Daily training, of BDNF^+/--mice or their wildtype (WT) littermates, to reach acquisition criterion in a T-maze, resulted in a similar performance outcome. However, extinction learning was delayed in the AAA, and impaired in the ABA-paradigm compared to performance in WT littermates. Trial-by-trial learning analysis indicated differences in the integration of the context into extinction learning by BDNF^+/--mice compared to WT littermates. Taken together, these results support an important role for BDNF in processes that relate to information updating and retrieval that in turn are crucial for effective extinction learning.

Context-dependent extinction learning emerging from raw sensory inputs: a reinforcement learning approach

The context-dependence of extinction learning has been well studied and requires the hippocampus. However, the underlying neural mechanisms are still poorly understood. Using memory-driven reinforcement learning and deep neural networks, we developed a model that learns to navigate autonomously in biologically realistic virtual reality environments based on raw camera inputs alone. Neither is context represented explicitly in our model, nor is context change signaled. We find that memory-intact agents learn distinct context representations, and develop ABA renewal, whereas memory-impaired agents do not. These findings reproduce the behavior of control and hippocampal animals, respectively. We therefore propose that the role of the hippocampus in the context-dependence of extinction learning might stem from its function in episodic-like memory and not in context-representation per se. We conclude that context-dependence can emerge from raw visual inputs.

Functional Compartmentalization of the Contribution of Hippocampal Subfields to Context-Dependent Extinction Learning

During extinction learning (EL), an individual learns that a previously learned behavior no longer fulfills its original purpose, or is no longer relevant. Recent studies have contradicted earlier theories that EL comprises forgetting, or the inhibition of the previously learned behavior, and indicate that EL comprises new associative learning. This suggests that the hippocampus is involved in this process. Empirical evidence is lacking however. Here, we used fluorescence in situ hybridization of somatic immediate early gene (IEG) expression to scrutinize if the hippocampus processes EL. Rodents engaged in context-dependent EL and were also tested for renewal of (the original behavioral response to) a spatial appetitive task in a T-maze. Whereas distal and proximal CA1 subfields processed both EL and renewal, effects in the proximal CA1 were more robust consistent with a role of this subfield in processing context. The lower blade of the dentate gyrus (DG) and the proximal CA3 subfields were particularly involved in renewal. Responses in the distal and proximal CA3 subfields suggest that this hippocampal subregion may also contribute to the evaluation of the reward outcome. Taken together, our findings provide novel and direct evidence for the involvement of distinct hippocampal subfields in context-dependent EL and renewal.

Alpha1-Adrenergic Receptor Mediated Long-Term Depression at CA3-CA1 Synapses Can Be Induced via Accumulation of Endogenous Norepinephrine and Is Preserved Following Noradrenergic Denervation

Locus coeruleus (LC) provides the sole source of noradrenergic (NA) innervation to hippocampus, and it undergoes significant degeneration early in Alzheimer's disease (AD). Norepinephrine (NE) modulates synaptic transmission and plasticity at hippocampal synapses which likely contributes to hippocampus-dependent learning and memory. We previously reported that pharmacological activation of α1 adrenergic receptors (α1ARs) induces long-term depression (LTD) at CA3-CA1 synapses. Here, we investigated whether accumulation of endogenous NE via pharmacological blockade of norepinephrine transporters (NETs) and the NE degradative enzyme, monoamine oxidase (MAO), can induce α1AR LTD, as these inhibitors are used clinically. Further, we sought to determine how degeneration of hippocampal NA innervation, as occurs in AD, impacts α1AR function and α1AR LTD. Bath application of NET and MAO inhibitors in slices from control rats reliably induced α1AR LTD when β adrenergic receptors were inhibited. To induce degeneration of LC-NA innervation, rats were treated with the specific NA neurotoxin DSP-4 and recordings performed 1-3 weeks later when NA axon degeneration had stabilized. Even with 85% loss of hippocampal NA innervation, α1AR LTD was successfully induced using either the α1AR agonist phenylephrine or the combined NET and MAO inhibitors, and importantly, the LTD magnitude was not different from saline-treated control. These data suggest that despite significant decreases in NA input to hippocampus, the mechanisms necessary for the induction of α1AR LTD remain functional. Furthermore, we posit that α1AR activation could be a viable therapeutic target for pharmacological intervention in AD and other diseases involving malfunctions of NA neurotransmission.

β-Adrenergic Control of Hippocampal Function: Subserving the Choreography of Synaptic Information Storage and Memory

Noradrenaline (NA) is a key neuromodulator for the regulation of behavioral state and cognition. It supports learning by increasing arousal and vigilance, whereby new experiences are “earmarked” for encoding. Within the hippocampus, experience-dependent information storage occurs by means of synaptic plasticity. Furthermore, novel spatial, contextual, or associative learning drives changes in synaptic strength, reflected by the strengthening of long-term potentiation (LTP) or long-term depression (LTD). NA acting on β-adrenergic receptors (β-AR) is a key determinant as to whether new experiences result in persistent hippocampal synaptic plasticity. This can even dictate the direction of change of synaptic strength.

The different hippocampal subfields play different roles in encoding components of a spatial representation through LTP and LTD. Strikingly, the sensitivity of synaptic plasticity in these subfields to β-adrenergic control is very distinct (dentate gyrus > CA3 > CA1). Moreover, NA released from the locus coeruleus that acts on β-AR leads to hippocampal LTD and an enhancement of LTD-related memory processing. We propose that NA acting on hippocampal β-AR, that is graded according to the novelty or saliency of the experience, determines the content and persistency of synaptic information storage in the hippocampal subfields and therefore of spatial memories.

Involvement of Dopamine D1/D5 and D2 Receptors in Context-Dependent Extinction Learning and Memory Reinstatement

Dopamine contributes to the regulation of higher order information processing and executive control. It is important for memory consolidation processes, and for the adaptation of learned responses based on experience. In line with this, under aversive learning conditions, application of dopamine receptor antagonists prior to extinction result in enhanced memory reinstatement. Here, we investigated the contribution of the dopaminergic system to extinction and memory reinstatement (renewal) of an appetitive spatial learning task in rodents. Rats were trained for 3 days in a T-maze (context "A") to associate a goal arm with a food reward, despite low reward probability (acquisition phase). On day 4, extinction learning (unrewarded) occurred, that was reinforced by a context change ("B"). On day 5, re-exposure to the (unrewarded) "A" context took place (renewal of context "A", followed by extinction of context "A"). In control animals, significant extinction occurred on day 4, that was followed by an initial memory reinstatement (renewal) on day 5, that was, in turn, succeeded by extinction of renewal. Intracerebral treatment with a D1/D5-receptor antagonist prior to the extinction trials, elicited a potent enhancement of extinction in context "B". By contrast, a D1/D5-agonist impaired renewal in context "A". Extinction in the "A" context on day 5 was unaffected by the D1/D5-ligands. Treatment with a D2-receptor antagonist prior to extinction had no overall effect on extinction in context "B" or renewal in context "A", although extinction of the renewal effect was impaired on day 5, compared to controls. Taken together, these data suggest that dopamine acting on the D1/D5-receptor modulates both acquisition and consolidation of context-dependent extinction. By contrast, the D2-receptor may contribute to context-independent aspects of this kind of extinction learning.

The DA antagonist tiapride impairs context-related extinction learning in a novel context without affecting renewal

Renewal describes the recovery of an extinguished response if recall is tested in a context different from the extinction context. Behavioral studies demonstrated that attention to relevant context strengthens renewal. Neurotransmitters mediating attention and learning such as the dopaminergic (DA) system presumably modulate extinction learning and renewal. However, the role of DA for non-fear-based extinction learning and renewal in humans has not yet been investigated. This fMRI study investigated effects of DA-antagonism upon context-related extinction in a predictive learning task in which extinction occurred either in a novel (ABA) or an unchanged (AAA) context. The tiapride-treated group (TIA) showed significantly impaired ABA extinction learning and a significant within-group difference between ABA and AAA extinction, compared to placebo (PLAC). Groups did not differ in their level of ABA renewal. In ABA extinction, TIA showed reduced activation in dlPFC and OFC, hippocampus, and temporal regions. Across groups, activation in PFC and hippocampus correlated negatively with ABA extinction errors. Results suggest that in context-related extinction learning DA in PFC and hippocampus is involved in readjusting the cue-outcome relationship in the presence of a novel context. However, relating context to the appropriate association during recall does not appear to rely exclusively on DA signaling.