Inactivation of the dorsal hippocampus does not affect learning during exploration of a novel environment

Epinephrine modulates memory of latent learning in an inhibitory avoidance task

The present study examined the memory modulatory effect of epinephrine on latent learning of an inhibitory avoidance task. Male Sprague-Dawley rats on the first day were subjected to one of three conditions (no, short or long) in pre-exposure to the task apparatus. One day or several days later, they received the typical inhibitory avoidance training with a 0.5 mA/0.5 s foot shock. Memory of the inhibitory avoidance response was tested one day after the foot-shock training. The long pre-exposure group showed better memory than the no or short pre-exposure group, and this latent memory could last for 6 days: Retention scores of the long pre-exposure group were significantly better than those of the no pre-exposure group if the shock training was given 3 or 6 days, but not 12 or 21 days, after the pre-exposure. Epinephrine injected after the pre-exposure training modulated the latent memory in a dose- and time-dependent manner: 0.01 mg/kg given shortly after the short pre-exposure enhanced the memory, but 0.5 mg/kg given shortly after the long pre-exposure impaired it. Epinephrine injected 4 h after the pre-exposure had no effect, neither did that given to rats pre-exposed to a different context. Epinephrine (0.01 mg/kg) also made the latent memory lasting longer as the rats treated with it showed significant avoidance behavior when they had the shock training at 12 or 21 days after the pre-exposure. These findings suggest that epinephrine could modulate memory formed in the latent learning.

A general model of hippocampal and dorsal striatal learning and decision making

Humans and other animals use multiple strategies for making decisions. Reinforcement-learning theory distinguishes between stimulus-response (model-free; MF) learning and deliberative (model-based; MB) planning. The spatial-navigation literature presents a parallel dichotomy between navigation strategies. In "response learning," associated with the dorsolateral striatum (DLS), decisions are anchored to an egocentric reference frame. In "place learning," associated with the hippocampus, decisions are anchored to an allocentric reference frame. Emerging evidence suggests that the contribution of hippocampus to place learning may also underlie its contribution to MB learning by representing relational structure in a cognitive map. Here, we introduce a computational model in which hippocampus subserves place and MB learning by learning a "successor representation" of relational structure between states; DLS implements model-free response learning by learning associations between actions and egocentric representations of landmarks; and action values from either system are weighted by the reliability of its predictions. We show that this model reproduces a range of seemingly disparate behavioral findings in spatial and nonspatial decision tasks and explains the effects of lesions to DLS and hippocampus on these tasks. Furthermore, modeling place cells as driven by boundaries explains the observation that, unlike navigation guided by landmarks, navigation guided by boundaries is robust to "blocking" by prior state-reward associations due to learned associations between place cells. Our model, originally shaped by detailed constraints in the spatial literature, successfully characterizes the hippocampal-striatal system as a general system for decision making via adaptive combination of stimulus-response learning and the use of a cognitive map.

Memory systems 2018 - Towards a new paradigm

The multiple memory systems theory (MMS) postulates that the brain stores information based on the independent and parallel activity of a number of modules, each with distinct properties, dynamics, and neural basis. Much of the evidence for this theory comes from dissociation studies indicating that damage to restricted brain areas cause selective types of memory deficits. MMS has been the prevalent paradigm in memory research for more than thirty years, even as it has been adjusted several times to accommodate new data. However, recent empirical results indicating that the memory systems are not always dissociable constitute a challenge to fundamental tenets of the current theory because they suggest that representations formed by individual memory systems can contribute to more than one type of memory-driven behavioral strategy. This problem can be addressed by applying a dynamic network perspective to memory architecture. According to this view, memory networks can reconfigure or transiently couple in response to environmental demands. Within this context, the neural network underlying a specific memory system can act as an independent unit or as an integrated component of a higher order meta-network. This dynamic network model proposes a way in which empirical evidence that challenges the idea of distinct memory systems can be incorporated within a modular memory architecture. The model also provides a framework to account for the complex interactions among memory systems demonstrated at the behavioral level. Advances in the study of dynamic networks can generate new ideas to experimentally manipulate and control memory in basic or clinical research.

Dorsal hippocampus contributes to model-based planning

Planning can be defined as action selection that leverages an internal model of the outcomes likely to follow each possible action. Its neural mechanisms remain poorly understood. Here we adapt recent advances from human research for rats, presenting for the first time an animal task that produces many trials of planned behavior per session, making multitrial rodent experimental tools available to study planning. We use part of this toolkit to address a perennially controversial issue in planning: the role of the dorsal hippocampus. Although prospective hippocampal representations have been proposed to support planning, intact planning in animals with damaged hippocampi has been repeatedly observed. Combining formal algorithmic behavioral analysis with muscimol inactivation, we provide causal evidence directly linking dorsal hippocampus with planning behavior. Our results and methods open the door to new and more detailed investigations of the neural mechanisms of planning in the hippocampus and throughout the brain.

Spatial cognition in mice and rats: similarities and differences in brain and behavior

The increasing use of mice models in cognitive tasks that were originally designed for rats raises crucial questions about cross-species comparison in the study of spatial cognition. The present review focuses on the major neuroethological differences existing between mice and rats, with particular attention given to the neurophysiological basis of space coding. While little difference is found in the basic properties of space representation in these two species, it appears that the stability of this representation changes more drastically over time in mice than in rats. We consider several hypotheses dealing with attentional, perceptual, and genetic aspects and offer some directions for future research that might help in deciphering hippocampal function in learning and memory processes. WIREs Cogn Sci 2016, 7:406-421. doi: 10.1002/wcs.1411 For further resources related to this article, please visit the WIREs website.

Parallel processing of information about location in the amygdala, entorhinal cortex and hippocampus

The conditioned cue preference paradigm was used to study how rats use extra-maze cues to discriminate between 2 adjacent arms on an 8-arm radial maze, a situation in which most of the same cues can be seen from both arms but only one arm contains food. Since the food-restricted rats eat while passively confined on the food-paired arm no responses are reinforced, so the discrimination is due to Pavlovian stimulus-reward (or outcome) learning. Consistent with other evidence that rats must move around in an environment to acquire a spatial map, we found that learning the adjacent arms CCP (ACCP) required a minimum amount of active exploration of the maze with no reinforcers present prior to passive pairing of the extra-maze cues with the food reinforcer, an instance of latent learning. Temporary inactivation of the hippocampus during the pre-exposure sessions had no effect on ACCP learning, confirming other evidence that the hippocampus is not involved in latent learning. A series of experiments indentified a circuit involving fimbria-fornix and dorsal entorhinal cortex as the neural basis of latent learning in this situation. In contrast, temporary inactivation of the entorhinal cortex or hippocampus during passive training or during testing blocked ACCP learning and expression, respectively, suggesting that these two structures co-operate in using spatial information to learn the location of food on the maze during passive pairing and to express this combined information during testing. In parallel with these processes we found that the amygdala processes information leading to an equal tendency to enter both adjacent arms (even though only one was paired with food) suggesting that the stimulus information available to this structure is not sufficiently precise to discriminate between the ambiguous cues visible from the adjacent arms. Expression of the ACCP in normal rats depends on hippocampus-based learning to avoid the unpaired arm which competes with the amygdala-based tendency to enter that arm. In contrast, there is cooperation between amygdala- and hippocampus-based tendencies to enter the food-paired arm. These independent forms of learning contribute to the rat's ability to discriminate among spatial locations using ambiguous extra-maze cues.

Mushroom body extrinsic neurons in the honeybee brain encode cues and contexts differently

Free-flying honeybees (Apis mellifera carnica) are known to learn the context to solve discrimination tasks. Here we apply classical conditioning of the proboscis extension response in restrained bees in combination with single-unit extracellular recordings from mushroom body (MB) extrinsic neurons elucidating the neural correlates of context-dependent olfactory discrimination. The contexts were light, colors, and temperatures, either alone or in combination. We found that bees learn context rules quickly and use them for better discrimination. They also solved a transwitching and a cue/context reversal task. Neurons extrinsic to the α lobe of the MB reduced the responses to the rewarded odor, whereas they increased their responses to the context. These results indicate that MB extrinsic neurons encode cues and contexts differently. Data are discussed with reference to MB function.

Profound retrograde but absence of anterograde amnesia for cued place learning in rats with hippocampal lesions

Previous studies in our lab have shown that slight modifications in the spatial reference memory procedure can overcome the deficit in spatial learning typically observed in rats with hippocampal damage. However, it is unknown if memory acquired under such training circumstances is spared after hippocampal lesions. With this aim a four-arm plus-shaped maze and a spatial reference memory paradigm were used, in which the goal arm was doubly marked: by an intramaze cue (a piece of sandpaper positioned on the floor of the arm) and by the extramaze constellation of stimuli around the maze. Experiment 1 replicated previous findings showing that hippocampally damaged rats can learn a place response just as well as the controls when the intramaze cue is present during the training, but they are unable to do so in the absence of the intramaze signal. When the learning procedure was doubly signaled, a transfer test performed 24h after the end of acquisition demonstrated that lesioned rats showed perfect memory for the goal arm when the intramaze cue was removed. Experiment 2 investigated the effect of hippocampal damage 1 day after the learning. Results showed that regardless of the training procedure employed (with or without the intramaze cue), hippocampal lesions produced a profound retrograde amnesia. Thus, although the absence of anterograde amnesia suggests that structures other that the hippocampus can take charge of the acquisition, the presence of retrograde amnesia indicates the critical role of the normal hippocampus in the long-term formation of allocentric information.

Latent learning of spatial information is impaired in middle-aged rats

The present study determined if the middle age related impairment that occurs with nonspatial latent learning also occurs in spatial latent learning. Thirty young (3-months-old) and 30 middle-aged (12-months-old) male Sprague-Dawley rats were given either pre-exposure to spatial cues surrounding a Barnes maze (SpatialPX), or pre-exposure to just the maze (MazePX). They were then given 10 training trials in which they had to find a hidden escape box while experiencing an aversive environment produced by bright lights and wind. Results showed that young rats given the SpatialPX condition demonstrated faster escape latencies and fewer errors than young rats given the MazePX condition. However, middle-aged rats given the SpatialPX condition did not show this improved performance. These findings indicate that the middle age learning deficit is not task specific, but rather is a general impairment in latent learning, possibly due to the early degeneration of the entorhinal cortex.

Parallel associative processing in the dorsal striatum: segregation of stimulus-response and cognitive control subregions

Although evidence suggests that the dorsal striatum contributes to multiple learning and memory functions, there nevertheless remains considerable disagreement on the specific associative roles of different neuroanatomical subregions. We review evidence indicating that the dorsolateral striatum (DLS) is a substrate for stimulus-response habit formation - incremental strengthening of simple S-R bonds - via input from sensorimotor neocortex while the dorsomedial striatum (DMS) contributes to behavioral flexibility - the cognitive control of behavior - via prefrontal and limbic circuits engaged in relational and spatial information processing. The parallel circuits through dorsal striatum interact with incentive/affective motivational processing in the ventral striatum and portions of the prefrontal cortex leading to overt responding under specific testing conditions. Converging evidence obtained through a detailed task analysis and neurobehavioral assessment is beginning to illuminate striatal subregional interactions and relations to the rest of the mammalian brain.

The entorhinal cortex, but not the dorsal hippocampus, is necessary for single-cue latent learning

Two experiments were conducted to examine the roles of the entorhinal cortex (EC), dorsal hippocampus (DH), and ventral hippocampus (VH) in a modified Latent Cue Preference (LCP) task. The modified LCP task utilized one visual cue in each compartment, compared to several multimodal cues used in a previous version. In the single-cue LCP task, water-replete rats drink water in one compartment of the LCP box on 1 day, and then have no water in a second compartment of the LCP box the following day (one training trial), for a total of three training trials. Rats are then water-deprived prior to a preference test, in which they are allowed to move freely between the two compartments with the water removed. Latent learning is demonstrated when water-deprived rats spend more time in the compartment that previously contained the water. Experiment 1 demonstrated that the single-cue LCP task results in the same irrelevant-incentive latent learning as the multicue LCP task. In addition, Experiment 1 replicated the finding that a compartment preference based on this latent learning requires a deprivation state during the preference test, while a compartment preference based on conditioning does not. Experiment 2 examined the effects of pretraining neurotoxin lesions of the EC, DH, and VH on this single-cue LCP task. Results showed that lesions of the EC and VH disrupted the irrelevant-incentive latent learning, while lesions of the DH did not. These results indicate that a latent learning task that involves one discrete compartment cue, rather than several compartmental cues, does not require the DH. Therefore, the EC appears to play a central role in single-cue latent learning in the LCP task.

Preserved learning about allocentric cues but impaired flexible memory expression in rats with hippocampal lesions

Several studies have shown that slight modifications in the standard reference spatial memory procedure normally used for allocentric learning in the Morris water maze and the radial maze, can overcome the classic deficit in allocentric navigation typically observed in rats with hippocampal damage. In these special paradigms, however, there is only intramaze manipulation of a salient stimulus. The present study was designed to investigate whether extramaze manipulations produce a similar outcome. With this aim a four-arm plus-shaped maze and a reference spatial memory paradigm were used, in which the goal arm was marked in two ways: by a prominent extramaze cue (intermittent light), which maintained a constant relation with the goal, and by the extramaze constellation of stimuli around the maze. Experiment 1 showed that, unlike the standard version of the task, using this special training procedure hippocampally-damaged rats could learn a place response as quickly as control animals; importantly, one day after reaching criterion, lesioned and control subjects performed the task perfectly during a transfer test in which the salient extramaze stimulus used during the acquisition was removed. However, although acquisition deficit was overcomed in these lesioned animals, a profound deficit in retention was detected 15 days later. Experiment 2 suggests that although under our special paradigm hippocampal rats can learn a place response, spatial memory only can be expressed when the requisites of behavioral flexibility are minimal. These findings suggest that, under certain circumstances, extrahippocampal structures are sufficient for building a coherent allocentric representation of space; however, flexible memory expression is dependent, fundamentally, on hippocampal functioning.

Temporary inactivation of the dorsal entorhinal cortex impairs acquisition and retrieval of spatial information

We tested the effects of temporary inactivation of the dorsal entorhinal cortex on spatial discrimination using a conditioned cue preference (CCP) paradigm. The three phases of the procedure were: pre-exposure: unreinforced exploration of the center platform and two adjacent arms of an eight-arm radial maze; training: rats were confined to the ends of the two arms on alternate days - one arm always contained food and the other never contained food; testing: unreinforced exploration of the center platform and the two arms. Rats that received bilateral infusions of saline into the dorsal entorhinal cortex before the training trials or before the test trial spent significantly more time in the arm that previously contained food than in the arm that never contained food, demonstrating that they had acquired and were able to express information that discriminated between the two adjacent maze arms. In contrast, rats that received bilateral, intra-entorhinal infusions of muscimol, a gamma-aminobutyric acid(a) (GABA(a)) agonist, before either training or testing spent equal amounts of time in the two arms, indicating that they failed to acquire and were unable to express this information. Interactions between the entorhinal cortex and hippocampus in the acquisition and expression of the information required for this discrimination are discussed.

A limited role for the hippocampus in the modulation of novel-object preference by contextual cues

Recent evidence suggests that rats require an intact hippocampus in order to recognize familiar objects when they encounter them again in a different context. The two experiments reported here further examined how changes in context affect rats' performance on the novel-object preference (NOP) test of object-recognition memory, and how those effects interact with the effects of HPC damage. Rats with HPC lesions and control rats received NOP testing in either the same context in which they had previously encountered sample objects, or in a different but equally familiar context. In Experiment 1, the two contexts had very few overlapping cues within or outside the apparatus; thus, the differences between them were global. Consistent with previous results, control rats showed a novel-object preference in both the unchanged and (globally) changed contexts, whereas rats with HPC lesions displayed a preference only in the unchanged context. In Experiment 2, the context shift included only local features proximal to the test objects. The main results were the reverse of Experiment 1--rats with HPC lesions displayed a novel-object preference in both the unchanged and (locally) changed contexts, whereas control rats displayed a preference only in the unchanged context. The findings are consistent with the view that HPC damage does not cause a general inability to recognize objects, nor an inability to encode or store a representation of the context in which the objects are encountered. They suggest instead that HPC damage impairs the ability to remember specific locations of familiar objects within a particular context.

Functional dissociation between fornix and hippocampus in spatial conditional learning

Do lesions of the fornix or the hippocampus impair the performance of spatial conditional associative learning tasks, and to what extent does damage to these brain structures result in comparable deficits in this type of spatial behavior? The available evidence is not clear. In the present study, rats with lesions of the fornix, hippocampus, and normal control animals were trained on two spatial-visual conditional learning tasks in which they had to form arbitrary associations between visual stimuli and the context in which these stimuli were embedded. In one condition, rats were required to choose stimulus X in place A and stimulus Y in place B, and there was no overlap in the contents of the two scenes. In the other condition, the animal approached the same scene from two different directions and had to select stimulus X when the scene was viewed from perspective A and to select stimulus Y when the scene was viewed from perspective B. Rats with fornix transection were able to learn both conditional tasks at a rate comparable to that of normal control animals, but rats with hippocampal damage were severely impaired under both conditions. The findings extend the range of tasks known to be sensitive to damage of the hippocampus. In addition, the results argue that the fornix is not necessary for the acquisition of certain spatial conditional learning tasks and that this brain structure cannot be used as an indicator of hippocampal dysfunction under all learning situations.

Cholinergic activity in the insular cortex is necessary for acquisition and consolidation of contextual memory

Experiences with a high emotional content (aversive) tend to be stored as long-term memories; however, there are also contextual recollections, which form a significant part of our memories. Different research has shown that the insular cortex (IC) plays an important role during aversive memory formation, yet its role during incidental/non-aversive learning like pre-exposure contextual memory formation has received little attention. The objective of this research was to establish the role of cholinergic activity in the IC through its muscarinic receptors during the formation of inhibitory avoidance (IA) memory, as well as during pre-exposure contextual memory, using a paradigm such as latent inhibition (LI). Rats with bilateral cannulae directed into the IC were trained in the LI paradigm of IA or IA task alone. The muscarinic antagonist receptor scopolamine was infused bilaterally into the IC 5 min before the pre-exposure into the dark chamber of the IA cage, one day before the conventional IA training or during the IA training day. During the IA test, the entrance latency into the dark chamber of the IA cage was measured as an index of contextual memory. The results showed that scopolamine infused before and after IA training disrupts inhibitory avoidance memory. Also, it showed that the pre-exposed saline-infused animals (LI) had a lower entrance latency compared to the group not pre-exposed (IA). However, the group that received scopolamine into the IC before, but not after, the pre-exposure to the dark chamber, presented a similar latency to the IA group, showing a blockade of the latent inhibition of the IA. These results suggest that cholinergic activity in the insular cortex is necessary during the acquisition and consolidation of avoidance memory, but appears necessary only during the acquisition of pre-exposure non-aversive contextual memory.

Roles of learning and motivation in preference behavior: Mediation by entorhinal cortex, dorsal and ventral hippocampus

In the latent cue preference (LCP) task, water-deprived rats alternately drink a salt solution in one distinctive compartment of a conditioned cue preference (CCP) apparatus and water in the other compartment over 8 days (training trials). They are then given a choice between the two compartments with no solutions present (preference test). Previous findings showed that this training procedure results in two parallel forms of learning: conditioning to water-paired cues (a water-CCP) and latent learning of an association between salt and salt-paired compartment cues (a salt-LCP). Experiment 1 examined these two types of learning in isolation. Results showed that expression of the salt-LCP required salt deprivation during testing, but expression of the water-CCP did not require a deprivation state during testing. Other results showed that salt-LCP learning itself involves two distinct components: (1) the latent association among neutral cues in the salt-paired compartment, and (2) motivational information about salt deprivation during testing. Previous findings also demonstrated roles for the dorsal hippocampus (DH), ventral hippocampus (VH), and entorhinal cortex (EC) in salt-LCP learning. Experiment 2 examined the involvement of these structures during acquisition or expression of salt-LCP learning. Rats with cannulas aimed at DH, VH, or EC were given infusions of muscimol, either before exposure to the salt-paired, but not the water-paired, compartment during training or before the preference test. Inactivation of the DH or EC impaired both acquisition and expression of the association between salt and salt-paired compartment cues, while inactivation of the VH disrupted the influence of motivational information about salt deprivation required to express the salt-LCP. These results suggest unique roles for the EC-DH circuit and VH in salt-LCP learning, as well as a functional dissociation between the DH and VH.

Unreinforced spatial (latent) learning is mediated by a circuit that includes dorsal entorhinal cortex and fimbria fornix

The relationship of the entorhinal cortex (EC) and fimbria-fornix (FF) in unreinforced spatial (latent) learning was studied using the conditioned-cue-preference task on an eight-arm radial maze. The maze was turned before every trial to eliminate the use of local cues. During three pre-exposure sessions, food-deprived rats explored the center platform and two adjacent arms of the maze. Since most of the same cues were visible from both arm locations, discriminating them required spatial learning. The rats were then alternately confined to the end of each arm over several days: one arm always contained food, the other was empty. Finally, the rats were allowed free access to both arms with no food present. Normal rats spent more time in their food-paired than in their unpaired arms showing that they learned to discriminate between the arm locations. Bilateral micro-injections of muscimol into the dorsal, but not into the ventral EC, given before the pre-exposure sessions only, impaired the discrimination. The discrimination was also impaired in rats with unilateral lesions of FF and contralateral injections of muscimol into the dorsal EC given before the pre-exposure sessions. Ipsilateral FF lesions and entorhinal inactivation had no effect. These results indicate that the acquisition of information during unreinforced exploration of a novel environment requires an intact circuit involving the dorsal EC and fimbria fornix. Together with previous reports, that this form of learning does not require a functional hippocampus, (Gaskin et al. (2005) Hippocampus 15:1085-1093) the findings also suggest that the acquisition of certain kinds of unreinforced information by this circuit is independent of the hippocampus.

Cooperation and competition between the dorsal hippocampus and lateral amygdala in spatial discrimination learning

The conditioned cue preference (CCP) was used to study how rats discriminate between adjacent arms on a radial maze. Chai and White (Behav Neurosci 2004, 118:770-784) showed that an intact dorsal hippocampus is required to learn this discrimination and that an amygdala-based conditioned approach response that produces an equal tendency to enter both arms is simultaneously acquired. In the present experiments, rats were preexposed to the maze with no food and trained by alternately confining them at the ends of two adjacent arms, one that contained food and one that did not. When given a choice between these arms with no food present, the rats spent more time on their food-paired arms, suggesting they had learned to discriminate their locations. Temporary inactivation of the dorsal hippocampus with muscimol during confinement on the food-paired arm had no effect on the discrimination, but inactivation while on the no-food arm impaired it. This pattern of effects was reversed in rats with amygdala lesions (inactivation on the food-paired arm impaired, but inactivation on the no-food arm had no effect on the discrimination), showing that hippocampus-based and amygdala-based learning interact to influence the behavior of normal rats in this situation. The dorsal hippocampus learns about locations that contain food and about locations that do not contain food. The amygdala-based tendency to enter the food-paired arm cooperates with hippocampus-based foraging for food on the food-paired, but the amygdala-based tendency to enter the no-food arm competes with hippocampus-based learning about the absence of food on that arm.

Dorsal hippocampus function in learning and expressing a spatial discrimination

Learning to discriminate between spatial locations defined by two adjacent arms of a radial maze in the conditioned cue preference paradigm requires two kinds of information: latent spatial learning when the rats explore the maze with no food available, and learning about food availability in two spatial locations when the rats are then confined in one arm with food and the other with no food. Previous research showed that a functional dorsal hippocampus is not required for latent learning. The present experiments show that it is required for learning about food availability, and during retrieval of both types of information.

A latent cue preference based on sodium depletion in rats

Three experiments show latent (or incidental) learning of salt-cue relationships using a conditioned cue-preference paradigm. Rats drank a salt solution while confined in one compartment and water in an adjacent, distinct compartment on alternate days. When given access to the two compartments with no solutions present, sodium-deprived rats preferred their salt-paired compartments; normal rats preferred their water-paired compartments. Reversing the deprivation states of the two groups reversed their preferences. These results show that rats can latently acquire associations between environmental cues and the taste of salt, and can use this information flexibly to guide behavior based upon internal cues produced by sodium deprivation.