Reward expectation extinction restructures and degrades CA1 spatial maps through loss of a dopaminergic reward proximity signal

Distinct catecholaminergic pathways projecting to hippocampal CA1 transmit contrasting signals during navigation in familiar and novel environments

Neuromodulatory inputs to the hippocampus play pivotal roles in modulating synaptic plasticity, shaping neuronal activity, and influencing learning and memory. Recently, it has been shown that the main sources of catecholamines to the hippocampus, ventral tegmental area (VTA) and locus coeruleus (LC), may have overlapping release of neurotransmitters and effects on the hippocampus. Therefore, to dissect the impacts of both VTA and LC circuits on hippocampal function, a thorough examination of how these pathways might differentially operate during behavior and learning is necessary. We therefore utilized two-photon microscopy to functionally image the activity of VTA and LC axons within the CA1 region of the dorsal hippocampus in head-fixed male mice navigating linear paths within virtual reality (VR) environments. We found that within familiar environments some VTA axons and the vast majority of LC axons showed a correlation with the animals' running speed. However, as mice approached previously learned rewarded locations, a large majority of VTA axons exhibited a gradual ramping-up of activity, peaking at the reward location. In contrast, LC axons displayed a pre-movement signal predictive of the animal's transition from immobility to movement. Interestingly, a marked divergence emerged following a switch from the familiar to novel VR environments. Many LC axons showed large increases in activity that remained elevated for over a minute, while the previously observed VTA axon ramping-to-reward dynamics disappeared during the same period. In conclusion, these findings highlight distinct roles of VTA and LC catecholaminergic inputs in the dorsal CA1 hippocampal region. These inputs encode unique information, with reward information in VTA inputs and novelty and kinematic information in LC inputs, likely contributing to differential modulation of hippocampal activity during behavior and learning.

Distinct catecholaminergic pathways projecting to hippocampal CA1 transmit contrasting signals during navigation in familiar and novel environments

Neuromodulatory inputs to the hippocampus play pivotal roles in modulating synaptic plasticity, shaping neuronal activity, and influencing learning and memory. Recently it has been shown that the main sources of catecholamines to the hippocampus, ventral tegmental area (VTA) and locus coeruleus (LC), may have overlapping release of neurotransmitters and effects on the hippocampus. Therefore, to dissect the impacts of both VTA and LC circuits on hippocampal function, a thorough examination of how these pathways might differentially operate during behavior and learning is necessary. We therefore utilized 2-photon microscopy to functionally image the activity of VTA and LC axons within the CA1 region of the dorsal hippocampus in head-fixed male mice navigating linear paths within virtual reality (VR) environments. We found that within familiar environments some VTA axons and the vast majority of LC axons showed a correlation with the animals' running speed. However, as mice approached previously learned rewarded locations, a large majority of VTA axons exhibited a gradual ramping-up of activity, peaking at the reward location. In contrast, LC axons displayed a pre-movement signal predictive of the animal's transition from immobility to movement. Interestingly, a marked divergence emerged following a switch from the familiar to novel VR environments. Many LC axons showed large increases in activity that remained elevated for over a minute, while the previously observed VTA axon ramping-to-reward dynamics disappeared during the same period. In conclusion, these findings highlight distinct roles of VTA and LC catecholaminergic inputs in the dorsal CA1 hippocampal region. These inputs encode unique information, with reward information in VTA inputs and novelty and kinematic information in LC inputs, likely contributing to differential modulation of hippocampal activity during behavior and learning.

Transformation of spatial representations along hippocampal circuits

The hippocampus is thought to provide the brain with a cognitive map of the external world by processing various types of spatial information. To understand how essential spatial variables such as direction, position, and distance are transformed along its circuits to construct this global map, we perform single-photon widefield microendoscope calcium imaging in the dentate gyrus and CA3 of mice freely navigating along a narrow corridor. We find that spatial activity maps in the dentate gyrus, but not in CA3, are correlated after aligning them to the running directions, suggesting that they represent the distance traveled along the track in egocentric coordinates. Together with population activity decoding, our data suggest that while spatial representations in the dentate gyrus and CA3 are anchored in both egocentric and allocentric coordinates, egocentric distance coding is more prevalent in the dentate gyrus than in CA3, providing insights into the assembly of the cognitive map.

Remapping revisited: how the hippocampus represents different spaces

The representation of distinct spaces by hippocampal place cells has been linked to changes in their place fields (the locations in the environment where the place cells discharge strongly), a phenomenon that has been termed 'remapping'. Remapping has been assumed to be accompanied by the reorganization of subsecond cofiring relationships among the place cells, potentially maximizing hippocampal information coding capacity. However, several observations challenge this standard view. For example, place cells exhibit mixed selectivity, encode non-positional variables, can have multiple place fields and exhibit unreliable discharge in fixed environments. Furthermore, recent evidence suggests that, when measured at subsecond timescales, the moment-to-moment cofiring of a pair of cells in one environment is remarkably similar in another environment, despite remapping. Here, I propose that remapping is a misnomer for the changes in place fields across environments and suggest instead that internally organized manifold representations of hippocampal activity are actively registered to different environments to enable navigation, promote memory and organize knowledge.

A hippocampus-accumbens code guides goal-directed appetitive behavior

The dorsal hippocampus (dHPC) is a key brain region for the expression of spatial memories, such as navigating towards a learned reward location. The nucleus accumbens (NAc) is a prominent projection target of dHPC and implicated in value-based action selection. Yet, the contents of the dHPC→NAc information stream and their acute role in behavior remain largely unknown. Here, we found that optogenetic stimulation of the dHPC→NAc pathway while mice navigated towards a learned reward location was both necessary and sufficient for spatial memory-related appetitive behaviors. To understand the task-relevant coding properties of individual NAc-projecting hippocampal neurons (dHPC→NAc), we used in vivo dual-color two-photon imaging. In contrast to other dHPC neurons, the dHPC→NAc subpopulation contained more place cells, with enriched spatial tuning properties. This subpopulation also showed enhanced coding of non-spatial task-relevant behaviors such as deceleration and appetitive licking. A generalized linear model revealed enhanced conjunctive coding in dHPC→NAc neurons which improved the identification of the reward zone. We propose that dHPC routes specific reward-related spatial and behavioral state information to guide NAc action selection.

Task-anchored grid cell firing is selectively associated with successful path integration-dependent behaviour

Grid firing fields have been proposed as a neural substrate for spatial localisation in general or for path integration in particular. To distinguish these possibilities, we investigate firing of grid and non-grid cells in the mouse medial entorhinal cortex during a location memory task. We find that grid firing can either be anchored to the task environment, or can encode distance travelled independently of the task reference frame. Anchoring varied between and within sessions, while spatial firing of non-grid cells was either coherent with the grid population, or was stably anchored to the task environment. We took advantage of the variability in task-anchoring to evaluate whether and when encoding of location by grid cells might contribute to behaviour. We find that when reward location is indicated by a visual cue, performance is similar regardless of whether grid cells are task-anchored or not, arguing against a role for grid representations when location cues are available. By contrast, in the absence of the visual cue, performance was enhanced when grid cells were anchored to the task environment. Our results suggest that anchoring of grid cells to task reference frames selectively enhances performance when path integration is required.

Lateral entorhinal cortex subpopulations represent experiential epochs surrounding reward

During goal-directed navigation, 'what' information, describing the experiences occurring in periods surrounding a reward, can be combined with spatial 'where' information to guide behavior and form episodic memories. This integrative process likely occurs in the hippocampus, which receives spatial information from the medial entorhinal cortex; however, the source of the 'what' information is largely unknown. Here, we show that mouse lateral entorhinal cortex (LEC) represents key experiential epochs during reward-based navigation tasks. We discover separate populations of neurons that signal goal approach and goal departure and a third population signaling reward consumption. When reward location is moved, these populations immediately shift their respective representations of each experiential epoch relative to reward, while optogenetic inhibition of LEC disrupts learning the new reward location. Therefore, the LEC contains a stable code of experiential epochs surrounding and including reward consumption, providing reward-centric information to contextualize the spatial information carried by the medial entorhinal cortex.

Extracellular matrix abnormalities in the hippocampus of subjects with substance use disorder

Contextual triggers are significant factors contributing to relapse in substance use disorders (SUD). Emerging evidence points to a critical role of extracellular matrix (ECM) molecules as mediators of reward memories. Chondroitin sulfate proteoglycans (CSPGs) are a subset of ECM molecules that form perineuronal nets (PNN) around inhibitory neurons. PNNs restrict synaptic connections and help maintain synapses. Rodent models suggest that modulation of PNNs may strengthen contextual reward memories in SUD. However, there is currently a lack of information regarding PNNs in the hippocampus of people with SUD as well as how comorbidity with major depressive disorder (MDD) may affect PNNs. We used postmortem hippocampal tissues from cohorts of human and nonhuman primates with or without chronic alcohol use to test the hypothesis that PNNs are increased in subjects with SUD. We used histochemical labeling and quantitative microscopy to examine PNNs, and qRT-PCR to examine gene expression for ECM molecules, synaptic markers and related markers. We identified increased densities of PNNs and CSPG-labeled glial cells in SUD, coinciding with decreased expression of the ECM protease matrix metalloproteinase 9 (Mmp9), and increased expression for the excitatory synaptic marker vesicle associated membrane protein 2 (Vamp2). Similar increases in PNNs were observed in monkeys with chronic alcohol self-administration. Subjects with MDD displayed changes opposite to SUD, and subjects with SUD and comorbid MDD had minimal changes in any of the outcome measures examined. Our findings demonstrate that PNNs are increased in SUD, possibly contributing to stabilizing contextual reward memories as suggested by preclinical studies. Our results also point to a previously unsuspected role for CSPG expression in glial cells in SUD. Evidence for increased hippocampal PNNs in SUD suggests that targeting PNNs to weaken contextual reward memories is a promising therapeutic approach for SUD, however comorbidity with MDD is a significant consideration.

Hippocampal sequences span experience relative to rewards

Hippocampal place cells fire in sequences that span spatial environments and non-spatial modalities, suggesting that hippocampal activity can anchor to the most behaviorally salient aspects of experience. As reward is a highly salient event, we hypothesized that sequences of hippocampal activity can anchor to rewards. To test this, we performed two-photon imaging of hippocampal CA1 neurons as mice navigated virtual environments with changing hidden reward locations. When the reward moved, the firing fields of a subpopulation of cells moved to the same relative position with respect to reward, constructing a sequence of reward-relative cells that spanned the entire task structure. The density of these reward-relative sequences increased with task experience as additional neurons were recruited to the reward-relative population. Conversely, a largely separate subpopulation maintained a spatially-based place code. These findings thus reveal separate hippocampal ensembles can flexibly encode multiple behaviorally salient reference frames, reflecting the structure of the experience.

Extracellular Matrix Abnormalities in the Hippocampus of Subjects with Substance Use Disorder

Contextual triggers are significant factors contributing to relapse in substance use disorders (SUD). Emerging evidence points to a critical role of extracellular matrix (ECM) molecules as mediators of reward memories. Chondroitin sulfate proteoglycans (CSPGs) are a subset of ECM molecules that form perineuronal nets (PNN) around inhibitory neurons. PNNs restrict synaptic connections and help maintain synapses. Rodent models suggest that modulation of PNNs may strengthen contextual reward memories in SUD. However, there is currently a lack of information regarding PNNs in the hippocampus of people with SUD as well as how comorbidity with major depressive disorder (MDD) may affect PNNs. We used postmortem hippocampal tissues from cohorts of human and nonhuman primates with or without chronic alcohol use to test the hypothesis that PNNs are increased in subjects with SUD. We used histochemical labeling and quantitative microscopy to examine PNNs, and qRT-PCR to examine gene expression for ECM molecules, synaptic markers and related markers. We identified increased densities of PNNs and CSPG-labeled glial cells in SUD, coinciding with decreased expression of the ECM protease matrix metalloproteinase 9 (Mmp9), and increased expression for the excitatory synaptic marker vesicle associated membrane protein 2 (Vamp2). Similar increases in PNNs were observed in monkeys with chronic alcohol self-administration. Subjects with MDD displayed changes opposite to SUD, and subjects with SUD and comorbid MDD had minimal changes in any of the outcome measures examined. Our findings demonstrate that PNNs are increased in SUD, possibly contributing to stabilizing contextual reward memories as suggested by preclinical studies. Our results also point to a previously unsuspected role for CSPG expression in glial cells in SUD. Evidence for increased hippocampal PNNs in SUD suggests that targeting PNNs to weaken contextual reward memories is a promising therapeutic approach for SUD, however comorbidity with MDD is a significant consideration.

A bird's eye view of the hippocampus beyond space: Behavioral, neuroanatomical, and neuroendocrine perspectives

Although the hippocampus is one of the most-studied brain regions in mammals, research on the avian hippocampus has been more limited in scope. It is generally agreed that the hippocampus is an ancient feature of the amniote brain, and therefore homologous between the two lineages. Because birds and mammals are evolutionarily not very closely related, any shared anatomy is likely to be crucial for shared functions of their hippocampi. These functions, in turn, are likely to be essential if they have been conserved for over 300 million years. Therefore, research on the avian hippocampus can help us understand how this brain region evolved and how it has changed over evolutionary time. Further, there is a strong research foundation in birds on hippocampal-supported behaviors such as spatial navigation, food caching, and brood parasitism that scientists can build upon to better understand how hippocampal anatomy, network circuitry, endocrinology, and physiology can help control these behaviors. In this review, we summarize our current understanding of the avian hippocampus in spatial cognition as well as in regulating anxiety, approach-avoidance behavior, and stress responses. Although there are still some questions about the exact number of subdivisions in the avian hippocampus and how that might vary in different avian families, there is intriguing evidence that the avian hippocampus might have complementary functional profiles along the rostral-caudal axis similar to the dorsal-ventral axis of the rodent hippocampus, where the rostral/dorsal hippocampus is more involved in cognitive processes like spatial learning and the caudal/ventral hippocampus regulates emotional states, anxiety, and the stress response. Future research should focus on elucidating the cellular and molecular mechanisms - including endocrinological - in the avian hippocampus that underlie behaviors such as spatial navigation, spatial memory, and anxiety-related behaviors, and in so doing, resolve outstanding questions about avian hippocampal function and organization.

Imaging-based chemogenetics for dissecting neural circuits in nonhuman primates

Nonhuman primates, particularly macaque and marmoset monkeys, serve as invaluable models for studying complex brain functions and behavior. However, the lack of suitable genetic neuromodulation tools has constrained research at the network level. This review examines the application of a chemogenetic technology, specifically, designer receptors exclusively activated by designer drugs (DREADDs), to nonhuman primates. DREADDs offer a means of reversibly controlling neuronal activity within a specific cell type or neural pathway, effectively targeting multiple brain regions simultaneously. The combination of DREADDs with imaging techniques, such as positron emission tomography and magnetic resonance imaging, has significantly enhanced nonhuman primate research, facilitating the precise visualization and manipulation of specific brain circuits and enabling the detailed monitoring of changes in network activity, which can then be correlated with altered behavior. This review outlines these technological advances and considers their potential for enhancing our understanding of primate brain circuit function and developing novel therapeutic approaches for treating brain diseases.

Reward Expectation Reduces Representational Drift in the Hippocampus

Spatial memory in the hippocampus involves dynamic neural patterns that change over days, termed representational drift. While drift may aid memory updating, excessive drift could impede retrieval. Memory retrieval is influenced by reward expectation during encoding, so we hypothesized that diminished reward expectation would exacerbate representational drift. We found that high reward expectation limited drift, with CA1 representations on one day gradually re-emerging over successive trials the following day. Conversely, the absence of reward expectation resulted in increased drift, as the gradual re-emergence of the previous day's representation did not occur. At the single cell level, lowering reward expectation caused an immediate increase in the proportion of place-fields with low trial-to-trial reliability. These place fields were less likely to be reinstated the following day, underlying increased drift in this condition. In conclusion, heightened reward expectation improves memory encoding and retrieval by maintaining reliable place fields that are gradually reinstated across days, thereby minimizing representational drift.

The Precision of Place Fields Governs Their Fate across Epochs of Experience

Spatial memories are represented by hippocampal place cells during navigation. This spatial code is dynamic, undergoing changes across time, known as representational drift, and across changes in internal state, even while navigating the same spatial environment with consistent behavior. A dynamic code may provide the hippocampus a means to track distinct epochs of experience that occur at different times or during different internal states and update spatial memories. Changes to the spatial code include place fields (PFs) that remap to new locations and place fields that vanish, while others are stable. However, what determines place field fate across epochs remains unclear. We measured the lap-by-lap properties of place cells in mice during navigation for a block of trials in a rewarded virtual environment. We then determined the position of the place fields in another block of trials in the same spatial environment either separated by a day (a distinct temporal epoch) or during the same session but with reward removed to change reward expectation (a distinct internal state epoch). We found that place cells with remapped place fields across epochs tended to have lower spatial precision during navigation in the initial epoch. Place cells with stable or vanished place fields tended to have higher spatial precision. We conclude that place cells with less precise place fields have greater spatial flexibility, allowing them to respond to, and track, distinct epochs of experience in the same spatial environment, while place cells with precise place fields generally preserve spatial information when their fields reappear.

Hippocampal place code plasticity in CA1 requires postsynaptic membrane fusion

Rapid delivery of glutamate receptors to the postsynaptic membrane via vesicle fusion is a central component of synaptic plasticity. However, it is unknown how this process supports specific neural computations during behavior. To bridge this gap, we combined conditional genetic deletion of a component of the postsynaptic membrane fusion machinery, Syntaxin3 (Stx3), in hippocampal CA1 neurons of mice with population in vivo calcium imaging. This approach revealed that Stx3 is necessary for forming the neural dynamics that support novelty processing, spatial reward memory and offline memory consolidation. In contrast, CA1 Stx3 was dispensable for maintaining aspects of the neural code that exist presynaptic to CA1 such as representations of context and space. Thus, manipulating postsynaptic membrane fusion identified computations that specifically require synaptic restructuring via membrane trafficking in CA1 and distinguished them from neural representation that could be inherited from upstream brain regions or learned through other mechanisms.

Place conditioning in humans: opportunities for translational research

RATIONALE

Translational research, especially research that bridges studies with humans and nonhuman species, is critical to advancing our understanding of human disorders such as addiction. This advancement requires reliable and rigorous models to study the underlying constructs contributing to the maladaptive behavior.

OBJECTIVE

In this commentary, we address some of the challenges of conducting translational research by examining a single procedure, place conditioning. Place conditioning is commonly used with laboratory animals to study the conditioned rewarding effects of drugs, and recent studies indicate that a similar procedure can be used in humans.

RESULTS

We discuss the opportunities and challenges of making the procedure comparable across species, as well as discuss the benefits of more systematically applying the procedure to humans.

CONCLUSION

We argue that the capacity of humans to report verbally on their internal experiences (perceptions, affective states, likes and dislikes) add an important dimension to the understanding of the procedures used in laboratory animals.

A thalamic-hippocampal CA1 signal for contextual fear memory suppression, extinction, and discrimination

The adaptive regulation of fear memories is a crucial neural function that prevents inappropriate fear expression. Fear memories can be acquired through contextual fear conditioning (CFC) which relies on the hippocampus. The thalamic nucleus reuniens (NR) is necessary to extinguish contextual fear and innervates hippocampal CA1. However, the role of the NR-CA1 pathway in contextual fear is unknown. We developed a head-restrained virtual reality CFC paradigm, and demonstrate that mice can acquire and extinguish context-dependent fear responses. We found that inhibiting the NR-CA1 pathway following CFC lengthens the duration of fearful freezing epochs, increases  fear generalization, and delays fear extinction. Using in vivo imaging, we recorded NR-axons innervating CA1 and found that NR-axons become tuned to fearful freezing following CFC. We conclude that the NR-CA1 pathway actively suppresses fear by disrupting contextual fear memory retrieval in CA1 during fearful freezing behavior, a process that also reduces fear generalization and accelerates extinction.

BTSP, not STDP, Drives Shifts in Hippocampal Representations During Familiarization

Synaptic plasticity is widely thought to support memory storage in the brain, but the rules determining impactful synaptic changes in-vivo are not known. We considered the trial-by-trial shifting dynamics of hippocampal place fields (PFs) as an indicator of ongoing plasticity during memory formation. By implementing different plasticity rules in computational models of spiking place cells and comparing to experimentally measured PFs from mice navigating familiar and novel environments, we found that Behavioral-Timescale-Synaptic-Plasticity (BTSP), rather than Hebbian Spike-Timing-Dependent-Plasticity, is the principal mechanism governing PF shifting dynamics. BTSP-triggering events are rare, but more frequent during novel experiences. During exploration, their probability is dynamic: it decays after PF onset, but continually drives a population-level representational drift. Finally, our results show that BTSP occurs in CA3 but is less frequent and phenomenologically different than in CA1. Overall, our study provides a new framework to understand how synaptic plasticity shapes neuronal representations during learning.

Lateral entorhinal cortex subpopulations represent experiential epochs surrounding reward

During goal-directed navigation, "what" information, which describes the experiences occurring in periods surrounding a reward, can be combined with spatial "where" information to guide behavior and form episodic memories1,2. This integrative process is thought to occur in the hippocampus3, which receives spatial information from the medial entorhinal cortex (MEC)4; however, the source of the "what" information and how it is represented is largely unknown. Here, by establishing a novel imaging method, we show that the lateral entorhinal cortex (LEC) of mice represents key experiential epochs during a reward-based navigation task. We discover a population of neurons that signals goal approach and a separate population of neurons that signals goal departure. A third population of neurons signals reward consumption. When reward location is moved, these populations immediately shift their respective representations of each experiential epoch relative to reward, while optogenetic inhibition of LEC disrupts learning of the new reward location. Together, these results indicate the LEC provides a stable code of experiential epochs surrounding and including reward consumption, providing reward-centric information to contextualize the spatial information carried by the MEC. Such parallel representations are well-suited for generating episodic memories of rewarding experiences and guiding flexible and efficient goal-directed navigation5-7.

Mapping neuronal ensembles and pattern-completion neurons through graphical models

Neuronal ensembles are coordinated groups of neurons that serve as functional building blocks of neural circuits. Here, we present PatMap, a computational toolbox for identifying pattern-completion neurons, key trigger cells capable of reactivating entire neuronal ensembles. We describe a protocol for modeling neural circuits as probabilistic graphical models, linking behavior with specific neuronal ensembles, and identifying their pattern-completion neurons. By linking the cellular and circuit level, PatMap provides a springboard for targeted manipulation and control of neural circuits. For complete details on the use and execution of this protocol, please refer to Carrillo-Reid et al. (2021).1.

Direct Thalamic Inputs to Hippocampal CA1 Transmit a Signal That Suppresses Ongoing Contextual Fear Memory Retrieval

Memory retrieval of fearful experiences is essential for survival but can be maladaptive if not appropriately suppressed. Fear memories can be acquired through contextual fear conditioning (CFC) which relies on the hippocampus. The thalamic subregion Nucleus Reuniens (NR) is necessary for contextual fear extinction and strongly projects to hippocampal subregion CA1. However, the NR-CA1 pathway has not been investigated during behavior, leaving unknown its role in contextual fear memory retrieval. We implement a novel head-restrained virtual reality CFC paradigm and show that inactivation of the NR-CA1 pathway prolongs fearful freezing epochs, induces fear generalization, and delays extinction. We use in vivo sub-cellular imaging to specifically record NR-axons innervating CA1 before and after CFC. We find NR-axons become selectively tuned to freezing only after CFC, and this activity is well-predicted by an encoding model. We conclude that the NR-CA1 pathway actively suppresses fear responses by disrupting ongoing hippocampal-dependent contextual fear memory retrieval.

Direct Thalamic Inputs to Hippocampal CA1 Transmit a Signal That Suppresses Ongoing Contextual Fear Memory Retrieval

Memory retrieval of fearful experiences is essential for survival but can be maladaptive if not appropriately suppressed. Fear memories can be acquired through contextual fear conditioning (CFC) which relies on the hippocampus. The thalamic subregion Nucleus Reuniens (NR) is necessary for contextual fear extinction and strongly projects to hippocampal subregion CA1. However, the NR-CA1 pathway has not been investigated during behavior, leaving unknown its role in contextual fear memory retrieval. We implement a novel head-restrained virtual reality CFC paradigm and show that inactivation of the NR-CA1 pathway prolongs fearful freezing epochs, induces fear generalization, and delays extinction. We use in vivo sub-cellular imaging to specifically record NR-axons innervating CA1 before and after CFC. We find NR-axons become selectively tuned to freezing only after CFC, and this activity is well-predicted by an encoding model. We conclude that the NR-CA1 pathway actively suppresses fear responses by disrupting ongoing hippocampal-dependent contextual fear memory retrieval.