Context-dependent modulation by D₁ receptors: Differential effects in hippocampus and striatum

Organizational effects of testosterone on learning strategy preference and muscarinic receptor binding in prepubertal rats

Prior to puberty, male rats, but not female rats, prefer a striatum-based stimulus-response learning strategy rather than a hippocampus-based place strategy on a water maze task that can be solved using either strategy. Neurochemically, learning strategy preference has been linked to the ratio of cholinergic muscarinic receptor binding in the hippocampus relative to the striatum, with lower ratios displayed by males compared to females and by stimulus-response learners compared to place learners. Sex differences in a variety of different behaviors are established by the organizational influence of testosterone on brain development. Therefore, the current study investigated the potential organizational effects of neonatal testosterone on learning strategy preference and the hippocampus:striatum ratio of muscarinic receptor binding in prepubertal male and female rats. Similar to vehicle-treated control males, prepubertal females treated with testosterone propionate on the first two days of life preferred a stimulus-response strategy on a dual-solution water maze task. Conversely, vehicle-treated prepubertal females were more likely to use a place strategy. Consistent with previous findings, the hippocampus:striatum ratio of muscarinic receptor binding was lower in rats preferring a stimulus-response strategy compared to those using a place strategy and lower in control males compared to control females. However, the hippocampus:striatum ratio was not reversed by neonatal testosterone treatment of females as predicted. The current study is the first to show that sex differences in how a navigational task is learned prior to puberty is impacted by the presence of testosterone during vulnerable periods in brain development.

Ongoing behavioral state information signaled in the lateral habenula guides choice flexibility in freely moving rats

The lateral habenula (LHb) plays a role in a wide variety of behaviors ranging from maternal care, to sleep, to various forms of cognition. One prominent theory with ample supporting evidence is that the LHb serves to relay basal ganglia and limbic signals about negative outcomes to midbrain monoaminergic systems. This makes it likely that the LHb is critically involved in behavioral flexibility as all of these systems have been shown to contribute when flexible behavior is required. Behavioral flexibility is commonly examined across species and is impaired in various neuropsychiatric conditions including autism, depression, addiction, and schizophrenia; conditions in which the LHb is thought to play a role. Therefore, a thorough examination of the role of the LHb in behavioral flexibility serves multiple functions including understanding possible connections with neuropsychiatric illnesses and additional insight into its role in cognition in general. Here, we assess the LHb’s role in behavioral flexibility through comparisons of the roles its afferent and efferent pathways are known to play. Additionally, we provide new evidence supporting the LHb contributions to behavioral flexibility through organization of specific goal directed actions under cognitively demanding conditions. Specifically, in the first experiment, a majority of neurons recorded from the LHb were found to correlate with velocity on a spatial navigation task and did not change significantly when reward outcomes were manipulated. Additionally, measurements of local field potential (LFP) in the theta band revealed significant changes in power relative to velocity and reward location. In a second set of experiments, inactivation of the LHb with the gamma-aminobutyric acid (GABA) agonists baclofen and muscimol led to an impairment in a spatial/response based repeated probabilistic reversal learning task. Control experiments revealed that this impairment was likely due to the demands of repeated switching behaviors as rats were unimpaired on initial discrimination acquisition or retention of probabilistic learning. Taken together, these novel findings compliment other work discussed supporting a role for the LHb in action selection when cognitive or emotional demands are increased. Finally, we discuss future mechanisms by which a superior understanding of the LHb can be obtained through additional examination of behavioral flexibility tasks.

A role for the lateral dorsal tegmentum in memory and decision neural circuitry

A role for the hippocampus in memory is clear, although the mechanism for its contribution remains a matter of debate. Converging evidence suggests that hippocampus evaluates the extent to which context-defining features of events occur as expected. The consequence of mismatches, or prediction error, signals from hippocampus is discussed in terms of its impact on neural circuitry that evaluates the significance of prediction errors: Ventral tegmental area (VTA) dopamine cells burst fire to rewards or cues that predict rewards (Schultz, Dayan, & Montague, 1997). Although the lateral dorsal tegmentum (LDTg) importantly controls dopamine cell burst firing (Lodge & Grace, 2006) the behavioral significance of the LDTg control is not known. Therefore, we evaluated LDTg functional activity as rats performed a spatial memory task that generates task-dependent reward codes in VTA (Jo, Lee, & Mizumori, 2013; Puryear, Kim, & Mizumori, 2010) and another VTA afferent, the pedunculopontine nucleus (PPTg, Norton, Jo, Clark, Taylor, & Mizumori, 2011). Reversible inactivation of the LDTg significantly impaired choice accuracy. LDTg neurons coded primarily egocentric information in the form of movement velocity, turning behaviors, and behaviors leading up to expected reward locations. A subset of the velocity-tuned LDTg cells also showed high frequency bursts shortly before or after reward encounters, after which they showed tonic elevated firing during consumption of small, but not large, rewards. Cells that fired before reward encounters showed stronger correlations with velocity as rats moved toward, rather than away from, rewarded sites. LDTg neural activity was more strongly regulated by egocentric behaviors than that observed for PPTg or VTA cells that were recorded by Puryear et al. and Norton et al. While PPTg activity was uniquely sensitive to ongoing sensory input, all three regions encoded reward magnitude (although in different ways), reward expectation, and reward encounters. Only VTA encoded reward prediction errors. LDTg may inform VTA about learned goal-directed movement that reflects the current motivational state, and this in turn may guide VTA determination of expected subjective goal values. When combined it is clear the LDTg and PPTg provide only a portion of the information that dopamine cells need to assess the value of prediction errors, a process that is essential to future adaptive decisions and switches of cognitive (i.e. memorial) strategies and behavioral responses.

Hippocampal place cell responses to distal and proximal cue manipulations in dopamine D2 receptor-knockout mice

The human hippocampus is critical for learning and memory. In rodents, hippocampal pyramidal neurons fire in a location-specific manner and form relational representations of environmental cues. The important roles of dopaminergic D1 receptors in learning and in hippocampal neural synaptic plasticity in novel environments have been previously shown. However, the roles of D2 receptors in hippocampal neural plasticity in response to novel and familiar spatial stimuli remain unclear. In order to clarify this issue, we recorded from hippocampal neurons in dopamine D2 receptor-knockout (D2R-KO) mice and their wild-type (WT) littermates during manipulations of distinct spatial cues in familiar and novel environments. Here, we report that D2R-KO mice showed substantial deficits in place-cell properties (number of place cells, intra-field firing rates, spatial tuning, and spatial coherence). Furthermore, although place cells in D2R-KO mice responded to manipulations of distal and proximal cues in both familiar and novel environments in a manner that was similar to place cells in WT mice, place fields were less stable in the D . The axes represent the differences between the peak and the valley of each waveform of EL2 and EL3.2R-KO mice in the familiar environment, but not in the novel environment. The present results suggested that D2 receptors in the hippocampus are important for place response stability. The place-cell properties of D2R-KO mice were similar to aged animals, suggesting that the alterations of place-cell properties in aged animals might be ascribed partly to alterations in the D2R in the HF of aged animals.

COMT rs4680 Met is not always the 'smart allele': Val allele is associated with better working memory and larger hippocampal volume in healthy Chinese

Catechol-O-methyltransferase (COMT) Val158Met (rs4680) polymorphism plays a crucial role in regulating brain dopamine level. Converging evidence from Caucasian samples showed that, compared with rs4680 Val allele, the Met allele was linked to lower COMT activity, which in turn was linked to better cognitive performance such as working memory (WM) and to a larger hippocampus (a brain region important for WM). However, some behavioral studies have shown that the function of rs4680 appears to vary across different ethnic groups, with Chinese subjects showing an opposite pattern as that for Caucasians (i.e. the Val allele is linked to better cognitive functions related to WM in Chinese). Using a sample of healthy Han Chinese college students (ages from 19 to 21 years), this study investigated the association of COMT Val158Met genotype with behavioral data on a two-back WM task (n = 443, 189M/254F) and T1 MRI data (n = 320, 134M/186F). Results showed that, compared to the Met allele, the Val allele was associated with larger hippocampal volume (the right hippocampus: β = -0.118, t = -2.367, P = 0.019, and the left hippocampus: β = -0.099, t = -1.949, P = 0.052) and better WM performance (β = -0.110, t = -2.315, P = 0.021). These results add to the growing literature on differentiated effects of COMT rs4680 polymorphism on WM across populations and offer a brain structural mechanism for such population-specific genetic effects.

Independent neural coding of reward and movement by pedunculopontine tegmental nucleus neurons in freely navigating rats

Phasic firing of dopamine (DA) neurons in the ventral tegmental area (VTA) and substantia nigra (SN) is likely to be crucial for reward processing that guides learning. One of the key structures implicated in the regulation of this DA burst firing is the pedunculopontine tegmental nucleus (PPTg), which projects to both the VTA and SN. Different literatures suggest that the PPTg serves as a sensory-gating area for DA cells or it regulates voluntary movement. This study recorded PPTg single-unit activity as rats perform a spatial navigation task to examine the potential for both reward and movement contributions. PPTg cells showed significant changes in firing relative to reward acquisition, the velocity of movement across the maze and turning behaviors of the rats. Reward, but not movement, correlates were impacted by changes in context, and neither correlate type was affected by reward manipulations (e.g. changing the expected location of a reward). This suggests that the PPTg conjunctively codes both reward and behavioral information, and that the reward information is processed in a context-dependent manner. The distinct anatomical distribution of reward and movement cells emphasizes different models of synaptic control by PPTg of DA burst firing in the VTA and SN. Relevant to both VTA and SN learning systems, however, PPTg appears to serve as a sensory gating mechanism to facilitate reinforcement learning, while at the same time provides reinforcement-based guidance of ongoing goal-directed behaviors.

Ventral tegmental area disruption selectively affects CA1/CA2 but not CA3 place fields during a differential reward working memory task

Hippocampus (HPC) receives dopaminergic (DA) projections from the ventral tegmental area (VTA) and substantia nigra. These inputs appear to provide a modulatory signal that influences HPC dependent behaviors and place fields. We examined how efferent projections from VTA to HPC influence spatial working memory and place fields when the reward context changes. CA1 and CA3 process environmental context changes differently and VTA preferentially innervates CA1. Given these anatomical data and electrophysiological evidence that implicate DA in reward processing, we predicted that CA1 place fields would respond more strongly to both VTA disruption and changes in the reward context than CA3 place fields. Rats (N = 9) were implanted with infusion cannula targeting VTA and recording tetrodes aimed at HPC. Then they were tested on a differential reward, win-shift working memory task. One recording session consisted of 5 baseline and 5 manipulation trials during which place cells in CA1/CA2 (N = 167) and CA3 (N = 94) were recorded. Prior to manipulation trials rats were infused with either baclofen or saline and then subjected to control or reward conditions during which the learned locations of large and small reward quantities were reversed. VTA disruption resulted in an increase in errors, and in CA1/CA2 place field reorganization. There were no changes in any measures of CA3 place field stability during VTA disruption. Reward manipulations did not affect performance or place field stability in CA1/CA2 or CA3; however, changes in the reward locations "rescued" performance and place field stability in CA1/CA2 when VTA activity was compromised, perhaps by trigging compensatory mechanisms. These data support the hypothesis that VTA contributes to spatial working memory performance perhaps by maintaining place field stability selectively in CA1/CA2.

Conjunctive encoding of movement and reward by ventral tegmental area neurons in the freely navigating rodent

As one of the two main sources of brain dopamine, the ventral tegmental area (VTA) is important for several complex functions, including motivation, reward prediction, and contextual learning. Although many studies have identified the potential neural substrate of VTA dopaminergic activity in reward prediction functions during Pavlovian and operant conditioning tasks, less is understood about the role of VTA neuronal activity in motivated behaviors and more naturalistic forms of context-dependent learning. Therefore, VTA neural activity was recorded as rats performed a spatial memory task under varying contextual conditions. In addition to reward- and reward predicting cue-related firing commonly observed during conditioning tasks, the activity of a large proportion of VTA neurons was also related to the velocity and/or acceleration of the animal's movement. It is important to note that movement-related activity was strongest when rats displayed more motivation to obtain reward. Furthermore, many cells displayed a dual code of movement- and reward-related activity. These two modes of firing, however, were differentially regulated by context information, suggesting that movement- and reward-related firing are two independently regulated modes of VTA neuronal activity and may serve separate functions.

Neuronal representation of conditioned taste in the basolateral amygdala of rats

Animals develop robust learning and long lasting taste aversion memory once they experience a new taste that is followed by visceral discomfort. A large body of literature has supported the hypothesis that basolateral amygdala (BLA) plays a critical role in the acquisition and extinction of such conditioned taste aversions (CTA). Despite the evidence that BLA is crucially engaged during CTA training, it is unclear how BLA neural activity represents the conditioned tastes. Here, we incorporated a modified behavioral paradigm suitable for single unit study, one which utilizes a sequence of pulsed saccharin and water infusion via intraoral cannulae. After conditioning, we investigated BLA unit activity while animals experience the conditioned taste (saccharin). Behavioral tests of taste reactivity confirmed that the utilized training procedure produced reliable acquisition and expression of the aversion throughout test sessions. When neural activity was compared between saccharin and water trials, half of the recorded BLA units (77/149) showed differential activity according to the types of solution. 76% of those cells (29/38) in the conditioned group showed suppressed activity, while only 44% of taste reactive cells (17/39) in controls showed suppressed activity during saccharin trials (relative to water trials). In addition, the overall excitability of BLA units was increased as shown by altered characteristics of burst activity after conditioning. The changes in BLA activity as a consequence of CTA were maintained throughout test sessions, consistent with the behavioral study. The current study suggests that the neuronal activity evoked by a sweet taste is altered as a consequence of CTA learning, and that the overall change might be related to the learning induced negative affect.

What is remembered? Role of attention on the encoding and retrieval of hippocampal representations

The hippocampus is critically involved in storing explicit memory such as memory for space. A defining feature of explicit memory storage is that it requires attention both for encoding and retrieval. Whereas, a great deal is now known about the mechanisms of storage, the mechanisms whereby attention modulates the encoding and retrieval of space and other hippocampus-dependent memory representations are not known. In this review we discuss recent studies, including our own, which show on the cellular level that attention is critical for the stabilization of spatial and reward-associated odour representations. Our findings support the view that in the hippocampus attention selects the reference frame for task-relevant information. This mechanism is in part mediated by dopamine acting through D1/D5 receptors and involves an increase in neuronal synchronization in the gamma band frequency. We propose that synchronous activity leads to enhancements in synaptic strength that mediate the stabilization of hippocampal representations.

Context dependent effects of ventral tegmental area inactivation on spatial working memory

Rats were tested on a hippocampus dependent win-shift working memory task in familiar or novel environments after receiving bilateral ventral tegmental area infusions of baclofen. Baclofen infusion disrupted working memory performance in both familiar and novel environments. In addition, baclofen infusion selectively disrupted short-term working memory in the novel environment. This experiment confirms selective ventral tegmental area support of accurate performance during a context dependent spatial navigation task.

Dopamine D1 receptor modulates hippocampal representation plasticity to spatial novelty

The human hippocampus is critical for learning and memory. In rodents, hippocampal pyramidal neurons fire in a location-specific manner, forming relational representations of environmental cues. The importance of glutamatergic systems in learning and in hippocampal neural synaptic plasticity has been shown. However, the role of dopaminergic systems in the response of hippocampal neural plasticity to novel and familiar spatial stimuli remains unclear. To clarify this important issue, we recorded hippocampal neurons from dopamine D(1) receptor knock-out (D1R-KO) mice and their wild-type (WT) littermates under the manipulation of distinct spatial cues in a familiar and a novel environment. Here we report that in WT mice, the majority of place cells quickly responded to the manipulations of distal and proximal cues in both familiar and novel environments. In contrast, the influence of distal cues on spatial firing in D1R-KO mice was abolished. In the D1R-KO mice, the influence of proximal cues was facilitated in a familiar environment, and in a novel environment most of the place cells were less likely to respond to changes of spatial cues. Our results demonstrate that hippocampal neurons in mice can rapidly and flexibly encode information about space from both distal and proximal cues to cipher a novel environment. This ability is necessary for many types of learning, and lacking D1R can radically alter this learning-related neural activity. We propose that D1R is crucially implicated in encoding spatial information in novel environments, and influences the plasticity of hippocampal representations, which is important in spatial learning and memory.

Basal ganglia contributions to adaptive navigation

The striatum has long been considered to be selectively important for nondeclarative, procedural types of memory. This stands in contrast with spatial context processing that is typically attributed to hippocampus. Neurophysiological evidence from studies of the neural mechanisms of adaptive navigation reveals that distinct neural systems such as the striatum and hippocampus continuously process task relevant information regardless of the current cognitive strategy. For example, both striatal and hippocampal neural representations reflect spatial location, directional heading, reward, and egocentric movement features of a test situation in an experience-dependent way, and independent of task demands. Thus, continual parallel processing across memory systems may be the norm rather than the exception. It is suggested that neuromodulators, such as dopamine, may serve to differentially regulate learning-induced neural plasticity mechanisms within these memory systems such that the most successful form of neural processing exerts the strongest control over response selection functions. In this way, dopamine may serve to optimize behavioral choices in the face of changing environmental demands during navigation.

Task-dependent encoding of space and events by striatal neurons is dependent on neural subtype

The dorsal striatum plays a critical role in procedural learning and memory. Current models of basal ganglia assume that striatal neurons and circuitry are critical for the execution of overlearned, habitual sequences of action. However, less is known about how the striatum encodes task information that guides the performance of actions in procedural tasks. To explore the striatal encoding of task information, we compared the behavioral correlates of striatal neurons tested in two tasks: a multiple T-maze task in which reward delivery was entirely predictable based on spatial cues (the Multiple-T task), and a task in which rats ran on a rectangular track, but food delivery depended on the distance traveled on the track and was not dependent solely on spatial location (the Take-5 task). Striatal cells recorded on these tasks were divisible into three cell types: phasic-firing neurons (PFNs), tonically firing neurons (TFNs), and high-firing neurons (HFNs) and similar proportions of each cell type were found in each task. However, the behavioral correlates of each cell type were differentially sensitive to the type of task rats were performing. PFNs were responsive to specific task-parameters on each task. TFNs showed reliable burst-and-pause responses following food delivery and other events that were consistent with tonically active neurons (TANs) on the Take-5 (non-spatial) task but not on the Multiple-T (spatial) task. HFNs showed spatial oscillations on the Multiple-T (spatial) task but not the Take-5 (non-spatial) task. Reconstruction of the rats' position on the maze was highly accurate when using striatal ensembles recorded on the Multiple-T (spatial) task, but not when using ensembles recorded on the Take-5 (non-spatial) task. In contrast, reconstruction of time following food delivery was successful in both tasks. The results indicated a strong task dependency of the quality of the spatial, but not the reward-related, striatal representations on these tasks. These results suggest that striatal spatial representations depend on the degree to which spatial task-parameters can be unambiguously associated with goals.

Exploring the role of context-dependent hippocampal activity in spatial alternation behavior

In a continuous T-maze spatial alternation task, CA1 place cells fire differentially on the stem of the maze as rats are performing left- and right-turn trials (Wood et al. (2000) Neuron 27:623-633). This context-dependent hippocampal activity provides a potential mechanism by which animals could solve the alternation task, as it provides a cue that could prime the appropriate goal choice. The aim of this study was to examine the relationship between context-dependent hippocampal activity and spatial alternation behavior. We report that rats with complete lesions of the hippocampus learn and perform the spatial alternation task as well as controls if there is no delay between trials, suggesting that the observed context-dependent hippocampal activity does not mediate alternation behavior in this task. However lesioned rats are significantly impaired when delays of 2 or 10 s are interposed. Recording experiments reveal that context-dependent hippocampal activity occurs in both the delay and no-delay versions of the task, but that in the delay version it occurs during the delay period, and not on the stem of the maze. These data are consistent with a role for context-dependent hippocampal activity in delayed spatial alternation, but suggest that, according to specific task demands and memory load, the activity may be generated by different mechanisms and/or in different brain structures.

Improvement of episodic contextual memory by S 18986 in middle-aged mice: comparison with donepezil

INTRODUCTION

This study compared the effects of S 18986, a positive allosteric modulator of alpha-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid (AMPA)-type glutamate receptors, to those of donepezil a cholinesterase inhibitor on memory impairments induced by ageing in a contextual serial discrimination (CSD) task in middle-aged mice.

MATERIALS AND METHODS

The CSD task involved the learning of two consecutive discriminations in a four-hole board, each performed on two different floors. This model has been developed to study simultaneously different forms of memory in mice (i.e., episodic-like vs semantic-like forms of memory). We showed that placebo-middle-aged mice (14-15 months old) and placebo-aged subjects (19-20 months old) exhibited a severe memory deficit for the first but not the second discrimination, which was due to an increase in interference, as compared with placebo-treated young mice (5 months old). Middle-aged mice were given (9 days) per os administration of either donepezil, S 18986, or placebo.

RESULTS AND DISCUSSION

Both 0.3 mg/kg donepezil and 0.1 mg/kg S 18986 reversed the deficit of middle-aged mice through a significant increase in contextually correct responses and in parallel a tendency to reduce interfering responses.

CONCLUSION

Overall, S 18986 emerges as having a beneficial impact on contextual memory processes in middle-aged mice.

Immediate early gene activation in hippocampus and dorsal striatum: Effects of explicit place and response training

Evidence from lesion, electrophysiological, and neuroimaging studies support the hypothesis that the hippocampus and dorsal striatum process afferent inputs in such a way that each structure regulates expression of different behaviors in learning and memory. The present study sought to determine whether rats explicitly trained to perform one of two different learning strategies, spatial or response, would display disparate immediate early gene activation in hippocampus and striatum. c-Fos and Zif268 immunoreactivity (IR) was measured in both hippocampus and striatum 30 or 90 min following criterial performance on a standard plus-maze task (place learners) or a modified T-maze task (response learners). Place and response learning differentially affected c-Fos-IR in striatum but not hippocampus. Specifically, explicit response learning induced greater c-Fos-IR activation in two subregions of the dorsal striatum. This increased c-Fos-IR was dependent upon the number of trials performed prior to reaching behavioral criterion and accuracy of performance during post-testing probe trials. Quantification of Zif268-IR in both hippocampus and striatum failed to distinguish between place and response learners. The changes in c-Fos-IR occurred 30 min, but not 90 min, post-testing. The synthesis of c-Fos early in testing could reflect the recruitment of key structures in learning. Consequently, animals that were able to learn the response task efficiently displayed greater amounts of c-Fos-IR in dorsal striatum.