Parallel processing across neural systems: Implications for a multiple memory system hypothesis

Hippocampal-prefrontal dynamics in spatial working memory: interactions and independent parallel processing

Memory processes may be independent, compete, operate in parallel, or interact. In accordance with this view, behavioral studies suggest that the hippocampus (HPC) and prefrontal cortex (PFC) may act as an integrated circuit during performance of tasks that require working memory over longer delays, whereas during short delays the HPC and PFC may operate in parallel or have completely dissociable functions. In the present investigation we tested rats in a spatial delayed non-match to sample working memory task using short and long time delays to evaluate the hypothesis that intermediate CA1 region of the HPC (iCA1) and medial PFC (mPFC) interact and operate in parallel under different temporal working memory constraints. In order to assess the functional role of these structures, we used an inactivation strategy in which each subject received bilateral chronic cannula implantation of the iCA1 and mPFC, allowing us to perform bilateral, contralateral, ipsilateral, and combined bilateral inactivation of structures and structure pairs within each subject. This novel approach allowed us to test for circuit-level systems interactions, as well as independent parallel processing, while we simultaneously parametrically manipulated the temporal dimension of the task. The current results suggest that, at longer delays, iCA1 and mPFC interact to coordinate retrospective and prospective memory processes in anticipation of obtaining a remote goal, whereas at short delays either structure may independently represent spatial information sufficient to successfully complete the task.

Parallel associative processing in the dorsal striatum: segregation of stimulus-response and cognitive control subregions

Although evidence suggests that the dorsal striatum contributes to multiple learning and memory functions, there nevertheless remains considerable disagreement on the specific associative roles of different neuroanatomical subregions. We review evidence indicating that the dorsolateral striatum (DLS) is a substrate for stimulus-response habit formation - incremental strengthening of simple S-R bonds - via input from sensorimotor neocortex while the dorsomedial striatum (DMS) contributes to behavioral flexibility - the cognitive control of behavior - via prefrontal and limbic circuits engaged in relational and spatial information processing. The parallel circuits through dorsal striatum interact with incentive/affective motivational processing in the ventral striatum and portions of the prefrontal cortex leading to overt responding under specific testing conditions. Converging evidence obtained through a detailed task analysis and neurobehavioral assessment is beginning to illuminate striatal subregional interactions and relations to the rest of the mammalian brain.

Independent neural coding of reward and movement by pedunculopontine tegmental nucleus neurons in freely navigating rats

Phasic firing of dopamine (DA) neurons in the ventral tegmental area (VTA) and substantia nigra (SN) is likely to be crucial for reward processing that guides learning. One of the key structures implicated in the regulation of this DA burst firing is the pedunculopontine tegmental nucleus (PPTg), which projects to both the VTA and SN. Different literatures suggest that the PPTg serves as a sensory-gating area for DA cells or it regulates voluntary movement. This study recorded PPTg single-unit activity as rats perform a spatial navigation task to examine the potential for both reward and movement contributions. PPTg cells showed significant changes in firing relative to reward acquisition, the velocity of movement across the maze and turning behaviors of the rats. Reward, but not movement, correlates were impacted by changes in context, and neither correlate type was affected by reward manipulations (e.g. changing the expected location of a reward). This suggests that the PPTg conjunctively codes both reward and behavioral information, and that the reward information is processed in a context-dependent manner. The distinct anatomical distribution of reward and movement cells emphasizes different models of synaptic control by PPTg of DA burst firing in the VTA and SN. Relevant to both VTA and SN learning systems, however, PPTg appears to serve as a sensory gating mechanism to facilitate reinforcement learning, while at the same time provides reinforcement-based guidance of ongoing goal-directed behaviors.

Ventral tegmental area disruption selectively affects CA1/CA2 but not CA3 place fields during a differential reward working memory task

Hippocampus (HPC) receives dopaminergic (DA) projections from the ventral tegmental area (VTA) and substantia nigra. These inputs appear to provide a modulatory signal that influences HPC dependent behaviors and place fields. We examined how efferent projections from VTA to HPC influence spatial working memory and place fields when the reward context changes. CA1 and CA3 process environmental context changes differently and VTA preferentially innervates CA1. Given these anatomical data and electrophysiological evidence that implicate DA in reward processing, we predicted that CA1 place fields would respond more strongly to both VTA disruption and changes in the reward context than CA3 place fields. Rats (N = 9) were implanted with infusion cannula targeting VTA and recording tetrodes aimed at HPC. Then they were tested on a differential reward, win-shift working memory task. One recording session consisted of 5 baseline and 5 manipulation trials during which place cells in CA1/CA2 (N = 167) and CA3 (N = 94) were recorded. Prior to manipulation trials rats were infused with either baclofen or saline and then subjected to control or reward conditions during which the learned locations of large and small reward quantities were reversed. VTA disruption resulted in an increase in errors, and in CA1/CA2 place field reorganization. There were no changes in any measures of CA3 place field stability during VTA disruption. Reward manipulations did not affect performance or place field stability in CA1/CA2 or CA3; however, changes in the reward locations "rescued" performance and place field stability in CA1/CA2 when VTA activity was compromised, perhaps by trigging compensatory mechanisms. These data support the hypothesis that VTA contributes to spatial working memory performance perhaps by maintaining place field stability selectively in CA1/CA2.

The brain-derived neurotrophic factor Val66Met polymorphism is associated with reduced functional magnetic resonance imaging activity in the hippocampus and increased use of caudate nucleus-dependent strategies in a human virtual navigation task

Multiple memory systems are involved in parallel processing of spatial information during navigation. A series of studies have distinguished between hippocampus-dependent 'spatial' navigation, which relies on knowledge of the relationship between landmarks in one's environment to build a cognitive map, and habit-based 'response' learning, which requires the memorization of a series of actions and is mediated by the caudate nucleus. Studies have demonstrated that people spontaneously use one of these two alternative navigational strategies with almost equal frequency to solve a given navigation task, and that strategy correlates with functional magnetic resonance imaging (fMRI) activity and grey matter density. Although there is evidence for experience modulating grey matter in the hippocampus, genetic contributions may also play an important role in the hippocampus and caudate nucleus. Recently, the Val66Met polymorphism of the brain-derived neurotrophic factor (BDNF) gene has emerged as a possible inhibitor of hippocampal function. We have investigated the role of the BDNF Val66Met polymorphism on virtual navigation behaviour and brain activation during an fMRI navigation task. Our results demonstrate a genetic contribution to spontaneous strategies, where 'Met' carriers use a response strategy more frequently than individuals homozygous for the 'Val' allele. Additionally, we found increased hippocampal activation in the Val group relative to the Met group during performance of a virtual navigation task. Our results support the idea that the BDNF gene with the Val66Met polymorphism is a novel candidate gene involved in determining spontaneous strategies during navigation behaviour.

The cholinergic system and neostriatal memory functions

The striatum is one of the major forebrain regions that strongly expresses muscarinic and nicotinic cholinergic receptors. This article reviews the current knowledge and our new findings about the striatal cholinoceptive organization and its role in a variety of cognitive functions. Pharmacological and genetic manipulations have indicated that the cholinergic and dopaminergic system in the striatum modulate each other's function. In addition to modulating the dopaminergic system, nicotinic cholinergic receptors facilitate GABA release, whereas muscarinic receptors attenuate GABA release. The striatal cholinergic system has also been implicated in various cognitive functions including procedural learning and intradimensional set shifting. Together, these data indicate that the cholinergic system in the striatum is involved in a diverse set of cognitive functions through interactions with other neurotransmitter systems including the dopaminergic and GABAergic systems.

Dissociations within human hippocampal subregions during encoding and retrieval of spatial information

Although the hippocampus is critical for the formation and retrieval of spatial memories, it is unclear how subregions are differentially involved in these processes. Previous high-resolution functional magnetic resonance imaging (fMRI) studies have shown that CA2, CA3, and dentate gyrus (CA23DG) regions support the encoding of novel associations, whereas the subicular cortices support the retrieval of these learned associations. Whether these subregions are used in humans during encoding and retrieval of spatial information has yet to be explored. Using high-resolution fMRI (1.6 mm × 1.6-mm in-plane), we found that activity within the right CA23DG increased during encoding compared to retrieval. Conversely, right subicular activity increased during retrieval compared to encoding of spatial associations. These results are consistent with the previous studies illustrating dissociations within human hippocampal subregions and further suggest that these regions are similarly involved during the encoding and retrieval of spatial information.

Pre-exposure to context affects learning strategy selection in mice

The multiple memory systems hypothesis proposes that different types of learning strategies are mediated by distinct neural systems in the brain. Male and female mice were tested on a water plus-maze task that could be solved by either a place or response strategy. One group of mice was pre-exposed to the same context as training and testing (PTC) and the other group was pre-exposed to a different context (PDC). Our results show that the PTC condition biased mice to place strategy use in males, but this bias was dependent on the presence of ovarian hormones in females.

The ventral basal ganglia, a selection mechanism at the crossroads of space, strategy, and reward

The basal ganglia are often conceptualised as three parallel domains that include all the constituent nuclei. The 'ventral domain' appears to be critical for learning flexible behaviours for exploration and foraging, as it is the recipient of converging inputs from amygdala, hippocampal formation and prefrontal cortex, putatively centres for stimulus evaluation, spatial navigation, and planning/contingency, respectively. However, compared to work on the dorsal domains, the rich potential for quantitative theories and models of the ventral domain remains largely untapped, and the purpose of this review is to provide the stimulus for this work. We systematically review the ventral domain's structures and internal organisation, and propose a functional architecture as the basis for computational models. Using a full schematic of the structure of inputs to the ventral striatum (nucleus accumbens core and shell), we argue for the existence of many identifiable processing channels on the basis of unique combinations of afferent inputs. We then identify the potential information represented in these channels by reconciling a broad range of studies from the hippocampal, amygdala and prefrontal cortex literatures with known properties of the ventral striatum from lesion, pharmacological, and electrophysiological studies. Dopamine's key role in learning is reviewed within the three current major computational frameworks; we also show that the shell-based basal ganglia sub-circuits are well placed to generate the phasic burst and dip responses of dopaminergic neurons. We detail dopamine's modulation of ventral basal ganglia's inputs by its actions on pre-synaptic terminals and post-synaptic membranes in the striatum, arguing that the complexity of these effects hint at computational roles for dopamine beyond current ideas. The ventral basal ganglia are revealed as a constellation of multiple functional systems for the learning and selection of flexible behaviours and of behavioural strategies, sharing the common operations of selection-by-disinhibition and of dopaminergic modulation.

Striatal versus hippocampal representations during win-stay maze performance

The striatum and hippocampus are widely held to be components of distinct memory systems that can guide competing behavioral strategies. However, some electrophysiological studies have suggested that neurons in both structures encode spatial information and may therefore make similar contributions to behavior. In rats well trained to perform a win-stay radial maze task, we recorded simultaneously from dorsal hippocampus and from multiple striatal subregions, including both lateral areas implicated in motor responses to cues and medial areas that work cooperatively with hippocampus in cognitive operations. In each brain region, movement through the maze was accompanied by the continuous sequential activation of sets of projection neurons. Hippocampal neurons overwhelmingly were active at a single spatial location (place cells). Striatal projection neurons were active at discrete points within the progression of every trial-especially during choices or following reward delivery-regardless of spatial position. Place-cell-type firing was not observed even for medial striatal cells entrained to the hippocampal theta rhythm. We also examined neural coding in earlier training sessions, when rats made use of spatial working memory to guide choices, and again found that striatal cells did not show place-cell-type firing. Prospective or retrospective encoding of trajectory was not observed in either hippocampus or striatum, at either training stage. Our results indicate that, at least in this task, dorsal hippocampus uses a spatial foundation for information processing that is not substantially modulated by spatial working memory demands. By contrast, striatal cells do not use such a spatial foundation, even in medial subregions that cooperate with hippocampus in the selection of spatial strategies. The progressive dominance of a striatum-dependent strategy does not appear to be accompanied by large changes in striatal or hippocampal single-cell representations, suggesting that the conflict between strategies may be resolved elsewhere.

Basal ganglia contributions to adaptive navigation

The striatum has long been considered to be selectively important for nondeclarative, procedural types of memory. This stands in contrast with spatial context processing that is typically attributed to hippocampus. Neurophysiological evidence from studies of the neural mechanisms of adaptive navigation reveals that distinct neural systems such as the striatum and hippocampus continuously process task relevant information regardless of the current cognitive strategy. For example, both striatal and hippocampal neural representations reflect spatial location, directional heading, reward, and egocentric movement features of a test situation in an experience-dependent way, and independent of task demands. Thus, continual parallel processing across memory systems may be the norm rather than the exception. It is suggested that neuromodulators, such as dopamine, may serve to differentially regulate learning-induced neural plasticity mechanisms within these memory systems such that the most successful form of neural processing exerts the strongest control over response selection functions. In this way, dopamine may serve to optimize behavioral choices in the face of changing environmental demands during navigation.

Learning processing in the basal ganglia: a mosaic of broken mirrors

In the present review we propose a model to explain the role of the basal ganglia in sensorimotor and cognitive functions based on a growing body of behavioural, anatomical, physiological, and neurochemical evidence accumulated over the last decades. This model proposes that the body and its surrounding environment are represented in the striatum in a fragmented and repeated way, like a mosaic consisting of the fragmented images of broken mirrors. Each fragment forms a functional unit representing articulated parts of the body with motion properties, objects of the environment which the subject can approach or manipulate, and locations the subject can move to. These units integrate the sensory properties and movements related to them. The repeated and widespread distribution of such units amplifies the combinatorial power of the associations among them. These associations depend on the phasic release of dopamine in the striatum triggered by the saliency of stimuli and will be reinforced by the rewarding consequences of the actions related to them. Dopamine permits synaptic plasticity in the corticostriatal synapses. The striatal units encoding the same stimulus/action send convergent projections to the internal segment of the globus pallidus (GPi) and to the substantia nigra pars reticulata (SNr) that stimulate or hold the action through a thalamus-frontal cortex pathway. According to this model, this is how the basal ganglia select actions based on environmental stimuli and store adaptive associations as nondeclarative memories such as motor skills, habits, and memories formed by Pavlovian and instrumental conditioning.

Animal model of posterior cingulate cortex hypometabolism implicated in amnestic MCI and AD

The posterior cingulate cortex (PCC) is the brain region displaying the earliest sign of energy hypometabolism in patients with amnestic mild cognitive impairment (MCI) who develop Alzheimer's disease (AD). In particular, the activity of the mitochondrial respiratory enzyme cytochrome oxidase (C.O.) is selectively inhibited within the PCC in AD. The present study is the first experimental analysis designed to model in animals the localized cortical C.O. inhibition found as the earliest metabolic sign of early-stage AD in human neuroimaging studies. Rats were used to model local inhibition of C.O. by direct injection of the C.O. inhibitor sodium azide into the PCC. Learning and memory were examined in a spatial holeboard task and brains were analyzed using quantitative histochemical, morphological and biochemical techniques. Behavioral results showed that sodium azide-treated rats were impaired in their memory of the baited pattern in probe trials as compared to their training scores before treatment, without non-specific behavioral differences. Brain analyses showed that C.O. inhibition was specific to the PCC, and sodium azide increased lipid peroxidation, gliosis and neuron loss, and lead to a network functional disconnection between the PCC and interconnected hippocampal regions. It was concluded that impaired memory by local C.O. inhibition in the PCC may serve to model in animals a metabolic lesion similar to that found in patients with amnestic MCI and early-stage AD. This model may be useful as an in vivo testing platform to investigate neuroprotective strategies to prevent or reduce the amnestic effects produced by posterior cingulate energy hypometabolism.

Use of cognitive strategies in rats: the role of estradiol and its interaction with dopamine

Accumulating evidence suggests a role for estrogen in the use of a particular cognitive strategy when solving a maze task. In order to confirm the role of estrogen in this phenomenon, ovariectomized (OVX) female rats receiving either high ( approximately 90 pg/ml) or low ( approximately 32 pg/ml) circulating levels of 17beta-estradiol benzoate (E2) performed a plus maze task for a reward. Consistent with previous research, OVX rats receiving low levels of E2 utilized a striatum-mediated response strategy while OVX rats administered high levels of E2 employed a hippocampus-mediated place strategy. Furthermore, following a systemic injection of a moderate dose of either a dopamine D1 (SKF 83566, 0.1 mg/kg IP) or D2 (raclopride, 0.5 mg/kg IP) receptor antagonist, low E2 rats were seen to use the opposite strategy and exercise a hippocampus-mediated place strategy in order to obtain the reward. At the same doses, high E2 rats did not change from using a place strategy. At a lower dose, these drugs shifted high E2 rats such that they showed an equal propensity for either strategy; this was not observed in low E2 rats. These results corroborate previous findings that E2 plays a significant role in the use of either a response or place strategy when solving a maze for a reward. In addition, the shift in strategy after dopamine receptor blockade implies the importance of central dopamine function in selecting a cognitive strategy to solve such tasks. It is suggested that estrogen alters cognitive strategy not only by improving hippocampal function, but also by altering dopamine-regulated striatal function.

Immediate early gene activation in hippocampus and dorsal striatum: Effects of explicit place and response training

Evidence from lesion, electrophysiological, and neuroimaging studies support the hypothesis that the hippocampus and dorsal striatum process afferent inputs in such a way that each structure regulates expression of different behaviors in learning and memory. The present study sought to determine whether rats explicitly trained to perform one of two different learning strategies, spatial or response, would display disparate immediate early gene activation in hippocampus and striatum. c-Fos and Zif268 immunoreactivity (IR) was measured in both hippocampus and striatum 30 or 90 min following criterial performance on a standard plus-maze task (place learners) or a modified T-maze task (response learners). Place and response learning differentially affected c-Fos-IR in striatum but not hippocampus. Specifically, explicit response learning induced greater c-Fos-IR activation in two subregions of the dorsal striatum. This increased c-Fos-IR was dependent upon the number of trials performed prior to reaching behavioral criterion and accuracy of performance during post-testing probe trials. Quantification of Zif268-IR in both hippocampus and striatum failed to distinguish between place and response learners. The changes in c-Fos-IR occurred 30 min, but not 90 min, post-testing. The synthesis of c-Fos early in testing could reflect the recruitment of key structures in learning. Consequently, animals that were able to learn the response task efficiently displayed greater amounts of c-Fos-IR in dorsal striatum.

Memory influences on hippocampal and striatal neural codes: effects of a shift between task rules

Interactions with neocortical memory systems may facilitate flexible information processing by hippocampus. We sought direct evidence for such memory influences by recording hippocampal neural responses to a change in cognitive strategy. Well-trained rats switched (within a single recording session) between the use of place and response strategies to solve a plus maze task. Maze and extramaze environments were constant throughout testing. Place fields demonstrated (in-field) firing rate and location-based reorganization [Leutgeb, S., Leutgeb, J. K., Barnes, C. A., Moser, E. I., McNaughton, B. L., & Moser, M. B. (2005). Independent codes for spatial and episodic memory in hippocampal neuronal ensembles. Science, 309, 619-623] after a task switch, suggesting that hippocampus encoded each phase of testing as a different context, or episode. The task switch also resulted in qualitative and quantitative changes to discharge that were correlated with an animal's velocity or acceleration of movement. Thus, the effects of a strategy switch extended beyond the spatial domain, and the movement correlates were not passive reflections of the current behavioral state. To determine whether hippocampal neural responses were unique, striatal place and movement-correlated neurons were simultaneously recorded with hippocampal neurons. Striatal place and movement cells exhibited a response profile that was similar, but not identical, to that observed for hippocampus after a strategy switch. Thus, retrieval of a different memory led both neural systems to represent a different context. However, hippocampus may play a special (though not exclusive) role in flexible spatial processing since correlated firing amongst cell pairs was highest when rats successfully switched between two spatial tasks. Correlated firing by striatal cell pairs increased following any strategy switch, supporting the view that striatum codes change in reinforcement contingencies.

Hippocampal place cells: parallel input streams, subregional processing, and implications for episodic memory

The hippocampus is thought to be involved in episodic memory in humans. Place cells of the rat hippocampus offer a potentially important model system to understand episodic memory. However, the difficulties in determining whether rats have episodic memory are profound. Progress can be made by considering the hippocampus as a computational device that presumably performs similar transformations on its inputs in both rats and in humans. Understanding the input/output transformations of rat place cells can thus inform research on the computational basis of human episodic memory. Two examples of different transformations in the CA3 and CA1 regions are presented. In one example, CA3 place fields are shown to maintain a greater degree of population coherence than CA1 place fields after a rearrangement of the salient landmarks in an environment, in agreement with computational models of CA3 as an autoassociative network. In the second example, CA3 place field appears to store information about the spatiotemporal sequences of place fields, starting with the first exposure to a cue-altered environment, whereas CA1 place fields store this information only on a temporary basis. Finally, recordings of hippocampal afferents from the lateral and medial entorhinal cortex (EC) suggest that these two regions convey fundamentally different representations to the hippocampus, with spatial information conveyed by the medial EC and nonspatial information conveyed by the lateral EC. The dentate gyrus and CA3 regions may create configural object+place (or item+context) representations that provide the spatiotemporal context of an episodic memory.

Estrogen modulates learning in female rats by acting directly at distinct memory systems

Physiologically high levels of circulating estradiol enhance the use of place learning and impair the use of response learning to find food on a land maze. These two types of learning are impaired by lesions of distinct neuronal structures, i.e. the hippocampus and striatum, respectively. Moreover, it has been shown in male rats that compromising hippocampal function can promote the use of response learning, while compromising striatal function can promote place learning. These findings suggest an ongoing competition between the hippocampus and striatum during cognition, such that intact functioning of one structure somehow obstructs the relative participation of the other. The goal of this study was to determine if estrogen's opposing effects on place and response learning in female rats are due to direct actions, either independent or interacting, at the hippocampus and striatum. We infused 0.5 microM 17beta-estradiol 3-sulfate sodium or vehicle bilaterally into the dorsal hippocampus or dorsolateral striatum of ovariectomized young adult female rats, 48, 24 and 2 h before training. Rats were tested on one of three appetitive tasks in a Y-maze: place learning, response learning, or response learning with reduced visual cues (cue-poor condition). Intrahippocampal estradiol infusions enhanced place learning, reversing a cannula-induced impairment, whereas intrastriatal infusions had no effects on place learning. Estradiol infusions into neither structure significantly affected response learning when extramaze cues were visible. However, in the response task, cue-poor condition, intrastriatal but not intrahippocampal infusions impaired learning. These data demonstrate that estrogen modulates place and response learning at the hippocampus and striatum respectively, most likely through independent actions at these two structures.

Spatial exploration induces ARC, a plasticity-related immediate-early gene, only in calcium/calmodulin-dependent protein kinase II-positive principal excitatory and inhibitory neurons of the rat forebrain

Active behavior, such as exploring a novel environment, induces the expression of the immediate-early gene Arc (activity-regulated cytoskeletal associated protein, or Arg 3.1) in many brain regions, including the hippocampus, neocortex, and striatum. Arc messenger ribonucleic acid and protein are localized in activated dendrites, and Arc protein is required for the maintenance of long-term potentiation and memory consolidation. Although previous evidence suggests that Arc is expressed in neurons, there is no direct demonstration that only neurons can express Arc. Furthermore, there is no characterization of the main neuronal types that express Arc. The data reported here show that behavior- or seizure-induced Arc expression in the hippocampus, primary somatosensory cortex, and dorsal striatum of rats colocalizes only with neuronal (NeuN-positive) and not with glial (GFAP-positive) cells. Furthermore, Arc was found exclusively in non-GABAergic alpha-CaMKII-positive hippocampal and neocortical neurons of rats that had explored a novel environment. Some GAD65/67-positive neurons in these regions were observed to express Arc, but only after a very strong stimulus (electroconvulsive seizure). In the dorsal striatum, spatial exploration induced Arc only in GABAergic and alpha-CaMKII-positive neurons. Combined, these results show that although a very strong stimulus (seizure) can induce Arc in a variety of neurons, behavior induces Arc in the CaMKII-positive principal neurons of the hippocampus, neocortex, and dorsal striatum. These results, coupled with recent in vitro findings of interactions between Arc and CaMKII, are consistent with the hypothesis that Arc and CaMKII act as plasticity partners to promote functional and/or structural synaptic modifications that accompany learning.

Small-scale spatial cognition in pigeons

Roberts and Van Veldhuizen's [Roberts, W.A., Van Veldhuizen, N., 1985. Spatial memory in pigeons on the radial maze. J. Exp. Psychol.: Anim. Behav. Proc. 11, 241-260] study on pigeons in the radial maze sparked research on landmark use by pigeons in lab-based tasks as well as variants of the radial-maze task. Pigeons perform well on open-field versions of the radial maze, with feeders scattered on the laboratory floor. Pigeons can also be trained to search precisely for buried food. The search can be based on multiple landmarks, but is sometimes controlled by just one or two landmarks, with the preferred landmarks varying across individuals. Findings are similar in landmark-based searching on a computer monitor and on a lab floor, despite many differences between the two kinds of tasks. A number of general learning principles are found in landmark-based searching, such as cue competition, generalization and peak shift, and selective attention. Pigeons also learn the geometry of the environment in which they are searching. Neurophysiological studies have implicated the hippocampal formation (HF) in avian spatial cognition, with the right hippocampus hypothesized to play a more important role in the spatial recognition of goal locations. Most recently, single-cell recording from the pigeon's hippocampal formation has revealed cells with different properties from the classic 'place' cells of rats, as well as differences in the two sides of the hippocampus.

Learning-related development of context-specific neuronal responses to places and events: the hippocampal role in context processing

Contextual information plays a key role in learning and memory. Learned information becomes associated with the context such that the context can cue the relevant memories and behaviors. An extensive literature involving experimental brain lesions has implicated the hippocampus in context processing. However, the neurophysiological mechanisms of context coding are not known. Although "context" has typically been defined in terms of the background cues, recent studies indicate that hippocampal neurons are sensitive to subtle changes in task demands, even in an unchanging environment. Thus, the context may also include non-environmental features of a learning situation. In the present study, hippocampal neuronal activity was recorded while rats learned to approach different reward locations in two contexts. Because all of the training took place in the same environment, the contexts were defined by the task demands rather than by environmental stimuli. Learning to differentiate two such contexts was associated with the development of highly context-specific neuronal firing patterns. These included different place fields in pyramidal neurons and different event (e.g., reward) responses in pyramidal and interneurons. The differential firing patterns did not develop in a control condition that did not involve a context manipulation. The context-specific firing patterns could modulate activity in extrahippocampal structures to prime context-appropriate behavioral responses and memories. These results provide direct support for a context processing role of the hippocampus and suggest that the hippocampus contributes contextual representations to episodic memories.

Acetylcholine release in the hippocampus and striatum during place and response training

These experiments examined the release of acetylcholine in the hippocampus and striatum when rats were trained, within single sessions, on place or response versions of food-rewarded mazes. Microdialysis samples of extra-cellular fluid were collected from the hippocampus and striatum at 5-min increments before, during, and after training. These samples were later analyzed for ACh content using HPLC methods. In Experiment 1, ACh release in both the hippocampus and striatum increased during training on both the place and response tasks. The magnitude of increase of training-related ACh release in the striatum was greater in rats trained on the response task than in rats trained on the place task, while the magnitude of ACh release in the hippocampus was comparable in the two tasks. Experiment 2 tested the possibility that the hippocampus was engaged and participated in learning the response task, as well as the place task, because of the availability of extra-maze cues. Rats were trained on a response version of a maze under either cue-rich or cue-poor conditions. The findings indicate that ACh release in the hippocampus increased similarly under both cue conditions, but declined during training on the cue-poor condition, when spatial processing by the hippocampus would not be suitable for solving the maze. In addition, high baseline levels of ACh release in the hippocampus predicted rapid learning in the cue-rich condition and slow learning in the cue-poor condition. These findings suggest that ACh release in the hippocampus augments response learning when extra-maze cues can be used to solve the maze but impairs response learning when extra-maze cues are not available for use in solving the maze.

Hippocampal place cells, context, and episodic memory

Although most observers agree that the hippocampus has a critical role in learning and memory, there remains considerable debate about the precise functional contribution of the hippocampus to these processes. Two of the most influential accounts hold that the primary function of the hippocampus is to generate cognitive maps and to mediate episodic memory processes. The well-documented spatial firing patterns (place fields) of hippocampal neurons in rodents, along with the spatial learning impairments observed with hippocampal damage support the cognitive mapping hypothesis. The amnesia for personally experienced events seen in humans with hippocampal damage and the data of animal models, which show severe memory deficits associated with hippocampal lesions, support the episodic memory account. Although an extensive literature supports each of these hypotheses, a specific contribution of place cells to episodic memory has not been clearly demonstrated. Recent data from our laboratory, together with previous findings, indicate that hippocampal place fields and neuronal responses to task-relevant stimuli are highly sensitive to the context, even when the contexts are defined by abstract task demands rather than the spatial geometry of the environment. On the basis of these findings, it is proposed that place fields reflect a more general context processing function of the hippocampus. Hippocampal context representations could serve to differentiate contexts and prime the relevant memories and behaviors. Since episodic memories, by definition, include information about the time and place where the episode occurred, contextual information is a necessary prerequisite for any episodic memory. Thus, place fields contribute importantly to episodic memory as part of the needed context representations. Additionally, recent findings indicate that hippocampal neurons differentiate contexts at progressively finer levels of detail, suggesting a hierarchical coding scheme which, if combined with temporal information, could provide a means of differentiating memory episodes.

Context-dependent modulation by D₁ receptors: Differential effects in hippocampus and striatum

Place-specific firing by hippocampal and striatal neurons was recorded simultaneously following injection of a D(1) receptor antagonist (SCH23390) and during spatial working memory task performance. SCH23390-induced changes in unit responses were observed during light and dark test conditions. Although hippocampal place field locations were altered by the contextual change, the reliability and specificity of place fields was disrupted only by combining D(1) antagonism and a change in context. Striatal place field locations were reorganized after either contextual change or D(1) antagonism, without altering place field reliability and specificity. Disrupted velocity encoding by place cells in both regions was induced by darkness, whereas greater stability in acceleration encoding followed removal of D(1) receptor activity. Dopamine may differentially regulate hippocampal context learning and striatum-based predictive codes.

Hippocampal and caudate metabolic activity associated with different navigational strategies

Hippocampal and striatal systems are widely related to spatial tasks. Depending on the strategies used, different memory systems can be activated. In this study, the authors used the cytochrome c-oxidase technique as a functional marker of the hippocampal and dorsal striatum activity related to training in several water maze tasks. Current results show a differential participation of the hippocampal and striatal systems in navigation. When spatial information is relevant, participation of the hippocampal system is more important, and when the task is similar to a response learning one, the striatal system is more active. According to computational models, CA3 seems to be more active when the associative demand is higher, whereas CA1 and dentate gyrus activity are higher when spatial information processing is required.

Differential effects of estrogen on hippocampal- and striatal-dependent learning

Estrogen's role in learning and memory may be to predispose animals to use specific cognitive strategies (Korol & Kolo, 2002). Specifically, estrogen may facilitate hippocampal-dependent learning, while at the same time attenuate striatal-dependent learning. As a stringent test of this hypothesis, place or response learning on an eight-arm radial maze was compared between ovariectomized (OVX) female Long-Evans rats and rats with chronic estrogen replacement (OVX+E; 5mg 17-beta estradiol 60-day release tablet). Reference and working memory errors were monitored separately for both place and response learning tasks. OVX+E rats learned the place task significantly faster than the response task, and faster than OVX rats. OVX rats required fewer days to reach criterion on the response task than OVX+E rats. Estrogen selectively enhanced reference memory performance, but only during place learning. The specific pattern of estrogen effects on learning suggests that future studies include verification of cognitive strategies used by animals.

A lateralized avian hippocampus: preferential role of the left hippocampal formation in homing pigeon sun compass-based spatial learning

The hippocampal formation (HF) plays a crucial role in amniote spatial cognition. There are also indications of functional lateralization in the contribution of the left and right HF in processes that enable birds to navigate space. The experiments described in this study were designed to examine left and right HF differences in a task of sun compass-based spatial learning in homing pigeons (Columba livia). Control, left (HFL) and right (HFR) HF lesioned pigeons were trained in an outdoor arena to locate a food reward using their sun compass in the presence or absence of alternative feature cues. Subsequent to training, the pigeons were subjected to test sessions to determine if they learned to represent the goal location with their sun compass and the relative importance of the sun compass vs. feature cues. Under all test conditions, the control pigeons demonstrated preferential use of the sun compass in locating the goal. By contrast, the HFL pigeons demonstrated no ability to locate the goal by the sun compass but an ability to use the feature cues. The behaviour of the HFR pigeons demonstrated that an intact left HF is sufficient to support sun compass-based learning, but in conflict situations and in contrast to controls, they often relied on feature cues. In conclusion, only the left HF is capable of supporting sun compass-based learning. However, preferential use of the sun compass for learning requires an intact right HF. The data support the hypothesis that the left and right HF make different but complementary contributions toward avian spatial cognition.

A study on the role of the dorsal striatum and the nucleus accumbens in allocentric and egocentric spatial memory consolidation

There is now accumulating evidence that the striatal complex in its two major components, the dorsal striatum and the nucleus accumbens, contributes to spatial memory. However, the possibility that different striatal subregions might modulate specific aspects of spatial navigation has not been completely elucidated. Therefore, in this study, two different learning procedures were used to determine whether the two striatal components could be distinguished on the basis of their involvement in spatial learning using different frames of reference: allocentric and egocentric. The task used involved the detection of a spatial change in the configuration of four objects placed in an arena, after the mice had had the opportunity to experience the objects in a constant position for three previous sessions. In the first part of the study we investigated whether changes in the place where the animals were introduced into the arena during habituation and testing could induce a preferential use of an egocentric or an allocentric frame of reference. In the second part of the study we performed focal injections of the N-methyl-d-aspartate (NMDA) receptors' antagonist, AP-5, within the two subregions immediately after training. The results indicate that using the two behavioral procedures, the animals rely on an egocentric and an allocentric spatial frame of reference. Furthermore, they demonstrate that AP-5 (37.5, 75, and 150 ng/side) injections into the dorsal striatum selectively impaired consolidation of spatial information in the egocentric but not in the allocentric procedure. Intra-accumbens AP-5 administration, instead, impaired animals trained using both procedures.

Glucose injections into the dorsal hippocampus or dorsolateral striatum of rats prior to T-maze training: modulation of learning rates and strategy selection

The present experiments examined the effects of injecting glucose into the dorsal hippocampus or dorsolateral striatum on learning rates and on strategy selection in rats trained on a T-maze that can be solved by using either a hippocampus-sensitive place or striatum-sensitive response strategy. Percentage strategy selection on a probe trial (P(crit)) administered after rats achieved criterion (nine of 10 correct choices) varied by group. All groups predominately exhibited a response strategy on a probe trial administered after overtraining, i.e., after 90 trials. In experiment 1, rats that received intrahippocampal glucose injections showed enhanced acquisition of the T-maze and showed increased use of response solutions at P(crit) compared with that of unimplanted and artificial cerebral spinal fluid (aCSF)-treated groups. These findings suggest that glucose enhanced hippocampal functions to accelerate the rate of learning and the early adoption of a response strategy. In experiment 2, rats that received intrastriatal glucose injections exhibited place solutions early in training and reached criterion more slowly than did aCSF controls, with learning rates comparable to those of unoperated and operated-uninjected controls. Relative to unoperated, operated-uninjected and glucose-injected rats, rats that received intrastriatal aCSF injections showed enhanced acquisition of the T-maze and increased use of response solutions at P(crit). The unexpected enhanced acquisition seen after striatal aCSF injections suggests at least two possible interpretations: (1) aCSF impaired striatal function, thereby releasing competition with the hippocampus and ceding control over learning to the hippocampus during early training trials; and (2) aCSF enhanced striatal functioning to facilitate striatal-sensitive learning. With either interpretation, the results indicate that intrastriatal glucose injections compensated for the aCSF-induced effect. Finally, enhanced acquisition regardless of treatment was accompanied by rapid adoption of a response solution for the T-maze.

Role of estrogen in balancing contributions from multiple memory systems

In addition to modulating memory per se, estrogen alters the learning strategy used to solve a task, thereby regulating the quality of information processed by the brain. This review discusses estrogen's actions on cognition within a memory systems framework, highlighting our work with a variety of paradigms showing that learning strategy is sensitive to estrogen even when learning rate is not. Specifically, high levels of gonadal steroids, in particular, elevations in estrogen, bias female rats toward using hippocampal-sensitive approaches while low levels of gonadal steroids promote the use of non-hippocampal sensitive strategies. In light of findings from a variety of approaches involving the hippocampus in allocentric and the striatum in egocentric response patterns, it is likely that estrogen alters the relative participation of these, and most undoubtedly other, neural systems during cognition. Changes in neuromodulators such as acetylcholine that regulate other processes such as inhibitory tone and excitability reflect one mechanism by which estrogen may orchestrate learning and memory.