Shifting between response and place strategies in maze navigation: Effects of training, cue availability and functional inactivation of striatum or hippocampus in rats

Memory consolidation affects the interplay of place and response navigation

Navigation through space is based on memory representations of landmarks ('place') or movement sequences ('response'). Over time, memory representations transform through consolidation. However, it is unclear how the transformation affects place and response navigation in humans. In the present study, healthy adults navigated to target locations in a virtual maze. The preference for using place and response strategies and the ability to recall place and response memories were tested after a delay of one hour (n = 31), one day (n = 30), or two weeks (n = 32). The different delays captured early-phase synaptic changes, changes after one night of sleep, and long-delay changes due to the reorganization of navigation networks. Our results show that the relative contributions of place and response navigation changed as a function of time. After a short delay of up to one day, participants preferentially used a place strategy and exhibited a high degree of visual landmark exploration. After a longer delay of two weeks, place strategy use decreased significantly. Participants now equally relied on place and response strategy use and increasingly repeated previously taken paths. Further analyses indicate that response strategy use predominantly occurred as a compensatory strategy in the absence of sufficient place memory. Over time, place memory faded before response memory. We suggest that the observed shift from place to response navigation is context-dependent since detailed landmark information, which strongly relied on hippocampal function, decayed faster than sequence information, which required less detail and depended on extra-hippocampal areas. We conclude that changes in place and response navigation likely reflect the reorganization of navigation networks during systems consolidation.

Vestibular damage affects the precision and accuracy of navigation in a virtual visual environment

Vestibular information is available to the brain during navigation, as are the other self-generated (idiothetic) and external (allothetic) sensorimotor cues that contribute to central estimates of position and motion. Rodent studies provide strong evidence that vestibular information contributes to navigation but human studies have been less conclusive. Furthermore, sex-based differences have been described in human navigation studies performed with the head stationary, a situation where dynamic vestibular (and other idiothetic) information is absent, but sex differences in the utilization of vestibular information have not been described. Here, we studied men and women with severe bilateral vestibular damage as they navigated through a visually barren virtual reality environment and compared their performance to normal men and women. Two navigation protocols were employed, which either activated dynamic idiothetic cues ('dynamic task', navigate by turning, walking in place) or eliminated them ('static task', navigate with key presses, head stationary). For both protocols, we employed a standard 'triangle completion task' in which subjects moved to two visual targets in series and then were required to return to their perceived starting position without localizing visual information. The angular and linear 'accuracy' (derived from response error) and 'precision' (derived from response variability) were calculated. Comparing performance 'within tasks', navigation on the dynamic paradigm was worse in male vestibular-deficient patients than in normal men but vestibular-deficient and normal women were equivalent; on the static paradigm, vestibular-deficient men (but not women) performed better than normal subjects. Comparing performance 'between tasks', normal men performed better on the dynamic than the static paradigm while vestibular-deficient men and both normal and vestibular-deficient women were equivalent on both tasks. Statistical analysis demonstrated that for the angular precision metric, sex had a significant effect on the interaction between vestibular status and the test paradigm. These results provide evidence that humans use vestibular information when they navigate in a virtual visual environment and that men and women may utilize vestibular (and visual) information differently. On our navigation paradigm, men used vestibular information to improve navigation performance, and in the presence of severe vestibular damage, they utilized visual information more effectively. In contrast, we did not find evidence that women used vestibular information while navigating on our virtual task, nor did we find evidence that they improved their utilization of visual information in the presence of severe vestibular damage.

A map of spatial navigation for neuroscience

Spatial navigation has received much attention from neuroscientists, leading to the identification of key brain areas and the discovery of numerous spatially selective cells. Despite this progress, our understanding of how the pieces fit together to drive behavior is generally lacking. We argue that this is partly caused by insufficient communication between behavioral and neuroscientific researchers. This has led the latter to under-appreciate the relevance and complexity of spatial behavior, and to focus too narrowly on characterizing neural representations of space-disconnected from the computations these representations are meant to enable. We therefore propose a taxonomy of navigation processes in mammals that can serve as a common framework for structuring and facilitating interdisciplinary research in the field. Using the taxonomy as a guide, we review behavioral and neural studies of spatial navigation. In doing so, we validate the taxonomy and showcase its usefulness in identifying potential issues with common experimental approaches, designing experiments that adequately target particular behaviors, correctly interpreting neural activity, and pointing to new avenues of research.

Chronic alcohol consumption shifts learning strategies and synaptic plasticity from hippocampus to striatum-dependent pathways

Introduction

The hippocampus and striatum have dissociable roles in memory and are necessary for spatial and procedural/cued learning, respectively. Emotionally charged, stressful events promote the use of striatal- over hippocampus-dependent learning through the activation of the amygdala. An emerging hypothesis suggests that chronic consumption of addictive drugs similarly disrupt spatial/declarative memory while facilitating striatum-dependent associative learning. This cognitive imbalance could contribute to maintain addictive behaviors and increase the risk of relapse.

Methods

We first examined, in C57BL/6 J male mice, whether chronic alcohol consumption (CAC) and alcohol withdrawal (AW) might modulate the respective use of spatial vs. single cue-based learning strategies, using a competition protocol in the Barnes maze task. We then performed in vivo electrophysiological studies in freely moving mice to assess learning-induced synaptic plasticity in both the basolateral amygdala (BLA) to dorsal hippocampus (dCA1) and BLA to dorsolateral striatum (DLS) pathways.

Results

We found that both CAC and early AW promote the use of cue-dependent learning strategies, and potentiate plasticity in the BLA → DLS pathway while reducing the use of spatial memory and depressing BLA → dCA1 neurotransmission.

Discussion

These results support the view that CAC disrupt normal hippocampo-striatal interactions, and suggest that targeting this cognitive imbalance through spatial/declarative task training could be of great help to maintain protracted abstinence in alcoholic patients.

Early life adversity impaired dorsal striatal synaptic transmission and behavioral adaptability to appropriate action selection in a sex-dependent manner

Early life adversity (ELA) is a major health burden in the United States, with 62% of adults reporting at least one adverse childhood experience. These experiences during critical stages of brain development can perturb the development of neural circuits that mediate sensory cue processing and behavioral regulation. Recent studies have reported that ELA impaired the maturation of dendritic spines on neurons in the dorsolateral striatum (DLS) but not in the dorsomedial striatum (DMS). The DMS and DLS are part of two distinct corticostriatal circuits that have been extensively implicated in behavioral flexibility by regulating and integrating action selection with the reward value of those actions. To date, no studies have investigated the multifaceted effects of ELA on aspects of behavioral flexibility that require alternating between different action selection strategies or higher-order cognitive processes, and the underlying synaptic transmission in corticostriatal circuitries. To address this, we employed whole-cell patch-clamp electrophysiology to assess the effects of ELA on synaptic transmission in the DMS and DLS. We also investigated the effects of ELA on the ability to update action control in response to outcome devaluation in an instrumental learning paradigm and reversal of action-outcome contingency in a water T-maze paradigm. At the circuit level, ELA decreased corticostriatal glutamate transmission in male but not in female mice. Interestingly, in DMS, glutamate transmission is decreased in male ELA mice, but increased in female ELA mice. ELA impaired the ability to update action control in response to reward devaluation in a context that promotes goal-directedness in male mice and induced deficits in reversal learning. Overall, our findings demonstrate the sex- and region-dependent effects of ELA on behavioral flexibility and underlying corticostriatal glutamate transmission. By establishing a link between ELA and circuit mechanisms underlying behavioral flexibility, our findings will begin to identify novel molecular mechanisms that can represent strategies for treating behavioral inflexibility in individuals who experienced early life traumatic incidents.

Inhibition of the ventral midline thalamus does not alter encoding, short-term holding or retrieval of spatial information in rats performing a water-escape working memory task

Working memory (WM) is a function operating in three successive phases: encoding (sample trial), holding (delay), and retrieval (test trial) of information. Studies point to a possible implication of the thalamic reuniens nucleus (Re) in spatial WM (SWM). In which of the aforementioned 3 phases the Re has a function is largely unknown. Recently, in a delayed SWM water-escape task, we found that performance during the retrieval trial correlated positively with c-Fos expression in the Re nucleus, suggesting participation in retrieval. Here, we used the same task and muscimol (Musc) inhibition or DREADD(hM4Di)-mediated inhibition of the Re during information encoding, right thereafter (thereby affecting the holding phase), or during the retrieval trial. A 6-hour delay separated encoding from retrieval. Concerning SWM, Musc in the Re nucleus did not alter performance, be it during or after encoding, or during evaluation. CNO administered before encoding in DREADD-expressing rats was also ineffective, although CNO-induced inhibition disrupted set shifting performance, as found previously (Quet et al., Brain Struct Function 225, 2020), thereby validating DREADD efficiency. These findings are the first that do not support an implication of the Re nucleus in SWM. As most previous studies used T-maze alternation tasks, which carry high proactive interference risks, an important question to resolve now is whether these nuclei are required in (T-maze alternation) tasks using very short information-holding delays (seconds to minutes), and less so in other short-term spatial memory tasks with longer information holding intervals (hours) and therefore reduced interference risks.

Ventral midline thalamus activation is correlated with memory performance in a delayed spatial matching-to-sample task: A c-Fos imaging approach in the rat

The reuniens (Re) and rhomboid (Rh) nuclei of the ventral midline thalamus are bi-directionally connected with the hippocampus and the medial prefrontal cortex. They participate in a variety of cognitive functions, including information holding for seconds to minutes in working memory tasks. What about longer delays? To address this question, we used a spatial working memory task in which rats had to reach a platform submerged in water. The platform location was changed every 2-trial session and rats had to use allothetic cues to find it. Control rats received training in a typical response-memory task. We interposed a 6 h interval between instruction (locate platform) and evaluation (return to platform) trials in both tasks. After the last session, rats were killed for c-Fos imaging. A home-cage group was used as additional control of baseline levels of c-Fos expression. C-Fos expression was increased to comparable levels in the Re (not Rh) of both spatial memory and response-memory rats as compared to their home cage counterparts. However, in spatial memory rats, not in their response-memory controls, task performance was correlated with c-Fos expression in the Re: the higher this expression, the better the performance. Furthermore, we noticed an activation of hippocampal region CA1 and of the anteroventral nucleus of the rostral thalamus. This activation was specific to spatial memory. The data point to a possible performance-determinant participation of the Re nucleus in the delayed engagement of spatial information encoded in a temporary memory.

Ventral hippocampus lesions and allocentric spatial memory in the radial maze: Anterograde and retrograde deficits

Although the dorsal hippocampus (DHip) has been clearly implicated in spatial learning and memory, there is currently debate as to whether the ventral hippocampus (VHip) is also necessary in allocentric-based navigation tasks. To differentiate between these two subregions of the hippocampal dorsoventral axis, we examined the effect of neurotoxic lesions to the DHip and VHip in different learning situations, using a four-arm plus-shaped maze. In experiment 1 a spatial reference memory task was used, with results showing an acquisition deficit in DHip-lesioned rats but perfect learning in VHip-lesioned rats. However, in experiment 2 an acquisition deficit was found in VHip-lesioned rats using a doubly marked training protocol. In this case the position of the goal arm during training was marked simultaneously by the extramaze constellation of stimuli around the maze and an intramaze cue. The main results indicated that DHip and VHip groups presented significantly more allocentric errors in the probe test than the control rats. In experiments 3 and 4, animals with their brains still intact learned, respectively, a spatial reference memory task or a purely cue-guided navigation task, and DHip and VHip lesions were made 2-3 days after reaching learning criterion. Results indicated a profound retrograde deficit in both lesioned groups but only with regard to allocentric information. So, depending on the training protocol used, our results point to increased integration and cooperation throughout the hippocampal dorsoventral axis when allocentric learning and memory is involved. These data support the existence of a functional continuum from the dorsal to the ventral hippocampus.

Sleep Leads to Brain-Wide Neural Changes Independent of Allocentric and Egocentric Spatial Training in Humans and Rats

Sleep is important for memory consolidation and systems consolidation in particular, which is thought to occur during sleep. While there has been a significant amount of research regarding the effect of sleep on behavior and certain mechanisms during sleep, evidence that sleep leads to consolidation across the system has been lacking until now. We investigated the role of sleep in the consolidation of spatial memory in both rats and humans using a watermaze task involving allocentric- and egocentric-based training. Analysis of immediate early gene expression in rodents, combined with functional magnetic resonance imaging in humans, elucidated similar behavioral and neural effects in both species. Sleep had a beneficial effect on behavior in rats and a marginally significant effect in humans. Interestingly, sleep led to changes across multiple brain regions at the time of retrieval in both species and in both training conditions. In rats, sleep led to increased gene expression in the hippocampus, striatum, and prefrontal cortex. In the humans, sleep led to an activity increase in brain regions belonging to the executive control network and a decrease in activity in regions belonging to the default mode network. Thus, we provide cross-species evidence for system-level memory consolidation occurring during sleep.

Hippocampal place cells encode global location but not connectivity in a complex space

Flexible navigation relies on a cognitive map of space, thought to be implemented by hippocampal place cells: neurons that exhibit location-specific firing. In connected environments, optimal navigation requires keeping track of one's location and of the available connections between subspaces. We examined whether the dorsal CA1 place cells of rats encode environmental connectivity in four geometrically identical boxes arranged in a square. Rats moved between boxes by pushing saloon-type doors that could be locked in one or both directions. Although rats demonstrated knowledge of environmental connectivity, their place cells did not respond to connectivity changes, nor did they represent doorways differently from other locations. Place cells coded location in a global reference frame, with a different map for each box and minimal repetitive fields despite the repetitive geometry. These results suggest that CA1 place cells provide a spatial map that does not explicitly include connectivity.

Hippocampal volume and navigational ability: The map(ping) is not to scale

A critical question regards the neural basis of complex cognitive skill acquisition. One extensively studied skill is navigation, with evidence suggesting that humans vary widely in navigation abilities. Yet, data supporting the neural underpinning of these individual differences are mixed. Some evidence suggests robust structure-behavior relations between hippocampal volume and navigation ability, whereas other experiments show no such correlation. We focus on several possibilities for these discrepancies: 1) volumetric hippocampal changes are relevant only at the extreme ranges of navigational abilities; 2) hippocampal volume correlates across individuals but only for specific measures of navigation skill; 3) hippocampal volume itself does not correlate with navigation skill acquisition; connectivity patterns are more relevant. To explore this third possibility, we present a model emphasizing functional connectivity changes, particularly to extra-hippocampal structures. This class of models arises from the premise that navigation is dynamic and that good navigators flexibly solve spatial challenges. These models pave the way for research on other skills and provide more precise predictions for the neural basis of skill acquisition.

The histone H3 lysine 9 methyltransferase G9a/GLP complex activity is required for long-term consolidation of spatial memory in mice

The G9a/G9a-like protein (GLP) histone lysine dimethyltransferase complex and downstream histone H3 lysine 9 dimethylation (H3K9me2) repressive mark have recently emerged as key transcriptional regulators of gene expression programs necessary for long-term memory (LTM) formation in the dorsal hippocampus. However, the role for hippocampal G9a/GLP complex in mediating the consolidation of spatial LTM remains largely unknown. Using a water maze competition task in which both dorsal hippocampus-dependent spatial and striatum-dependent cue navigation strategies are effective to solve the maze, we found that pharmacological inhibition of G9a/GLP activity immediately after learning disrupts long-term consolidation of previously learned spatial information in male mice, hence producing cue bias on the competition test performed 24 h later. Importantly, the inhibition of hippocampal G9a/GLP did not disrupt short-term memory retention. Immunohistochemical analyses revealed increases in global levels of permissive histone H3K9 acetylation in the dorsal hippocampus and dorsal striatum at 1 h post-training, which persisted up to 24 h in the hippocampus. Conversely, H3K9me2 levels were either unchanged in the dorsal hippocampus or transiently decreased at 15 min post-training in the dorsal striatum. Finally, the inhibition of G9a/GLP activity further increased global levels of H3K9 acetylation while decreasing H3K9me2 in the hippocampus at 1 h post-training. However, both marks returned to vehicle control levels at 24 h. Together, these findings support the possibility that G9a/GLP in the dorsal hippocampus is required for the transcriptional switch from short-term to long-term spatial memory formation.

Place vs. Response Learning: History, Controversy, and Neurobiology

The present article provides a historical review of the place and response learning plus-maze tasks with a focus on the behavioral and neurobiological findings. The article begins by reviewing the conflict between Edward C. Tolman's cognitive view and Clark L. Hull's stimulus-response (S-R) view of learning and how the place and response learning plus-maze tasks were designed to resolve this debate. Cognitive learning theorists predicted that place learning would be acquired faster than response learning, indicating the dominance of cognitive learning, whereas S-R learning theorists predicted that response learning would be acquired faster, indicating the dominance of S-R learning. Here, the evidence is reviewed demonstrating that either place or response learning may be dominant in a given learning situation and that the relative dominance of place and response learning depends on various parametric factors (i.e., amount of training, visual aspects of the learning environment, emotional arousal, et cetera). Next, the neurobiology underlying place and response learning is reviewed, providing strong evidence for the existence of multiple memory systems in the mammalian brain. Research has indicated that place learning is principally mediated by the hippocampus, whereas response learning is mediated by the dorsolateral striatum. Other brain regions implicated in place and response learning are also discussed in this section, including the dorsomedial striatum, amygdala, and medial prefrontal cortex. An exhaustive review of the neurotransmitter systems underlying place and response learning is subsequently provided, indicating important roles for glutamate, dopamine, acetylcholine, cannabinoids, and estrogen. Closing remarks are made emphasizing the historical importance of the place and response learning tasks in resolving problems in learning theory, as well as for examining the behavioral and neurobiological mechanisms of multiple memory systems. How the place and response learning tasks may be employed in the future for examining extinction, neural circuits of memory, and human psychopathology is also briefly considered.

Striatal Transcriptome Reveals Differences Between Cognitively Impaired and Unimpaired Aged Male Rats

Cognitive processes require striatal activity. The underlying molecular mechanisms are widely unknown. For this reason the striatal transcriptome of young (YM), aged cognitively impaired (OMB), and unimpaired (OMG) male rats was analyzed. The global comparison of transcripts reveal a higher number of differences between OMG and YM as compared to OMB and YM. Hierarchical clustering detects differences in up- and down-regulated gene clusters in OMG and OMB when compared to YM. In OMG we found more single genes to be specifically regulated in this group than in OMB when compared to young. These genes were considered as cognition specific, whereas genes shared in OMG and OMB were considered as age specific. OMB specific up-regulated genes are related to negative control of cell differentiation and transcription (Hopx), to phagocytosis (Cd202) and cell adhesion (Pcdhb21), whereas down-regulated genes are related to associative learning, behavioral fear response and synaptic transmission (Gabra5). OMG specific up-regulated genes are in the context of maintenance of transcription and estrogen receptor signaling (Padi2, Anxa3), signal transduction [Rassf4, Dock8)], sterol regulation (Srebf1), and complement activity (C4a, C4b). Down-regulated genes are related to lipid oxidation reduction processes (Far2) and positive regulation of axon extension (Islr2). These relations were supported by pathway analysis, which reveals cholesterol metabolism processes in both aged group and cholesterol biosynthesis specifically in OMG; adipogenesis and focal adhesion in OMB. In OMG glucuronidation, estrogen metabolism, inflammatory responses and TGF beta signaling where detected as specific for this group. Signal transduction of the sphingosine-1-phospate-receptor (S1P) receptor was the main pathway difference in the comparison of OMB and OMG with downregulated genes in the first group. This difference could also be observed in the OMB vs. YM comparison but not in the OMG vs. YM analysis. Thus, an up-regulation of cognition related genes could be observed in OMG compared to OMB rats. The S1P pathway discriminated between OMB and OMG as well as between OMB and OMG. Since this pathway has been described as essential for cognitive processes in the striatum of mice, it may, among steroid hormone signaling, significantly contribute to the maintenance of cognitive processes in OMG.

Striatal and hippocampal contributions to flexible navigation in rats and humans

The hippocampus has been firmly established as playing a crucial role in flexible navigation. Recent evidence suggests that dorsal striatum may also play an important role in such goal-directed behaviour in both rodents and humans. Across recent studies, activity in the caudate nucleus has been linked to forward planning and adaptation to changes in the environment. In particular, several human neuroimaging studies have found the caudate nucleus tracks information traditionally associated with that by the hippocampus. In this brief review, we examine this evidence and argue the dorsal striatum encodes the transition structure of the environment during flexible, goal-directed behaviour. We highlight that future research should explore the following: (1) Investigate neural responses during spatial navigation via a biophysically plausible framework explained by reinforcement learning models and (2) Observe the interaction between cortical areas and both the dorsal striatum and hippocampus during flexible navigation.