Dorsal hippocampal lesions disrupt Pavlovian delay conditioning and conditioned-response timing

Knockout of NMDARs in CA1 and dentate gyrus fails to impair temporal control of conditioned behavior in mice

The hippocampus has been implicated in temporal learning. Plasticity within the hippocampus requires NMDA receptor-dependent glutamatergic neurotransmission. We tested the prediction that hippocampal NMDA receptors are required for learning about time by testing mice that lack postembryonal NMDARs in the CA1 and dentate gyrus (DG) hippocampal subfields on three different appetitive temporal learning procedures. The conditional knockout mice (Grin1ΔDCA1 ) showed normal sensitivity to cue duration, responding at a higher level to a short duration cue than compared to a long duration cue. Knockout mice also showed normal precision and accuracy of response timing in the peak procedure in which reinforcement occurred after 10 s delay within a 30 s cue presentation. Mice were tested on the matching of response rates to reinforcement rates on instrumental conditioning with two levers reinforced on a concurrent variable interval schedule. Pressing on one lever was reinforced at a higher rate than the other lever. Grin1ΔDGCA1 mice showed normal sensitivity to the relative reinforcement rates of the levers. In contrast to the lack of effect of hippocampal NMDAR deletion on measures of temporal sensitivity, Grin1ΔDGCA1 mice showed increased baseline measures of magazine activity and lever pressing. Furthermore, reversal learning was enhanced when the reward contingencies were switched in the lever pressing task, but this was true only for mice trained with a large difference between relative reinforcement rates between the levers. The results failed to demonstrate a role for NMDARs in excitatory CA1 and DG neurons in learning about temporal information.

Is the scalar property of interval timing preserved after hippocampus lesions?

Time perception is fundamental for decision-making, adaptation, and survival. In the peak-interval (PI) paradigm, one of the critical features of time perception is its scale invariance, i.e., the error in time estimation increases linearly with the to-be-timed interval. Brain lesions can profoundly alter time perception, but do they also change its scalar property? In particular, hippocampus (HPC) lesions affect the memory of the reinforced durations. Experiments found that ventral hippocampus (vHPC) lesions shift the perceived durations to longer values while dorsal hippocampus (dHPC) lesions produce opposite effects. Here we used our implementation of the Striatal Beat Frequency (SBFML) model with biophysically realistic Morris-Lecar (ML) model neurons and a topological map of HPC memory to predict analytically and verify numerically the effect of HPC lesions on scalar property. We found that scalar property still holds after both vHPC and dHPC lesions in our SBFML-HPC network simulation. Our numerical results show that PI durations are shifted in the correct direction and match the experimental results. In our simulations, the relative peak shift of the behavioral response curve is controlled by two factors: (1) the lesion size, and (2) the cellular-level memory variance of the temporal durations stored in the HPC. The coefficient of variance (CV) of the behavioral response curve remained constant over the tested durations of PI procedure, which suggests that scalar property is not affected by HPC lesions.

The differential role of the dorsal hippocampus in initiating and terminating timed responses: A lesion study using the switch-timing task

This study investigated the role of the dorsal hippocampus (dHPC) in the temporal entrainment of behavior, while addressing limitations of previous evidence from peak procedure experiments. Rats were first trained on a switch-timing task in which food was obtained from one of two concurrently available levers; one lever was effective after 8 s and the other after 16  s. After performance stabilized, rats underwent either bilateral NMDA lesions of the dHPC or sham lesions. After recovery, switch-timing training resumed. In a subsequent condition, the switch-timing task was modified such that food was available after either 8 or 32 s. Although dHPC lesions had subtle and complex effects on when rats stopped seeking for food at the 8-s lever (departures), it more systematically reduced the time when rats started seeking for food at the 16-s and 32-s lever (switches). No systematic effect of dHPC lesions were observed on the coefficient of quartile variation (normalized dispersion) of latencies to switch. Within the context of the pacemaker-accumulator framework of interval timing, these findings suggest that partially or wholly independent mechanisms control the initiation and termination of timed responses, and that the dHPC is primarily involved in encoding the time to start responding.

A Population-Based Model of the Temporal Memory in the Hippocampus

Spatial and temporal dimensions are fundamental for orientation, adaptation, and survival of organisms. Hippocampus has been identified as the main neuroanatomical structure involved both in space and time perception and their internal representation. Dorsal hippocampus lesions showed a leftward shift (toward shorter durations) in peak-interval procedures, whereas ventral lesions shifted the peak time toward longer durations. We previously explained hippocampus lesion experimental findings by assuming a topological map model of the hippocampus with shorter durations memorized ventrally and longer durations more dorsal. Here we suggested a possible connection between the abstract topological maps model of the hippocampus that stored reinforcement times in a spatially ordered memory register and the "time cells" of the hippocampus. In this new model, the time cells provide a uniformly distributed time basis that covers the entire to-be-learned temporal duration. We hypothesized that the topological map of the hippocampus stores the weights that reflect the contribution of each time cell to the average temporal field that determines the behavioral response. The temporal distance between the to-be-learned criterion time and the time of the peak activity of each time cell provides the error signal that determines the corresponding weight correction. Long-term potentiation/depression could enhance/weaken the weights associated to the time cells that peak closer/farther to the criterion time. A coincidence detector mechanism, possibly under the control of the dopaminergic system, could be involved in our suggested error minimization and learning algorithm.

Scalar timing in memory: A temporal map in the hippocampus

Many essential tasks, such as decision making, rate calculation and planning, require accurate timing in the second to minute range. This process, known as interval timing, involves many cortical areas such as the prefrontal cortex, the striatum, and the hippocampus. Although the neurobiological origin and the mechanisms of interval timing are largely unknown, we have developed increasingly accurate mathematical and computational models that can mimic some properties of time perception. The accepted paradigm of temporal durations storage is that the objective elapsed time from the short-term memory is transferred to the reference memory using a multiplicative "memory translation constant" K*. It is believed that K* has a Gaussian distribution due to trial-related variabilities. To understand K* genesis, we hypothesized that the storage of temporal memories follows a topological map in the hippocampus, with longer durations stored towards dorsal hippocampus and shorter durations stored toward ventral hippocampus. We found that selective removal of memory cells in this topological map model shifts the peak-response time in a manner consistent with the current experimental data on the effect of hippocampal lesions on time perception. This opens new avenues for experimental testing of our topological map hypothesis. We found numerically that the relative shift is determined both by the lesion size and its location and we suggested a theoretical estimate for the memory translation constant K*.

Ventral hippocampal neurons inhibit postprandial energy intake

Evidence suggests that the memory of a recently ingested meal limits subsequent intake. Given that ventral hippocampal (vHC) neurons are involved in memory and energy intake, the present experiment tested the hypothesis that vHC neurons contribute to the formation of a memory of a meal and inhibit energy intake during the postprandial period. We tested (1) whether pharmacological inactivation of vHC neurons during the period following a sucrose meal, when the memory of the meal would be undergoing consolidation, accelerates the onset of the next sucrose meal and increases intake and (2) whether sucrose intake increases vHC expression of the synaptic plasticity marker activity-regulated cytoskeletal-associated protein (Arc). Adult male Sprague-Dawley rats were trained to consume a 32% sucrose solution daily at the same time and location. On the experimental day, the rats were given intra-vHC infusions of the GABA_A receptor agonist muscimol or vehicle after they finished their first sucrose meal. Compared to vehicle infusions, postmeal intra-vHC muscimol infusions decreased the latency to the next sucrose meal, increased the amount of sucrose consumed during that meal, increased the total number of sucrose meals and the total amount of sucrose ingested. In addition, rats that consumed sucrose had higher levels of Arc expression in both vHC CA1 and CA3 subfields than cage control rats. Collectively, these findings are the first to show that vHC neurons inhibit energy intake during the postprandial period and support the hypothesis that vHC neurons form a memory of a meal and inhibit subsequent intake. © 2016 Wiley Periodicals, Inc.

Impaired Pavlovian predictive learning between temporally phasic but not static events in autism-model strain mice

Autism-spectrum disorder (ASD) is a multi-aspect developmental disorder characterised by various social and non-social behavioural abnormalities. Using BTBR T+ tf mouse strain (BTBR), a promising animal model displaying a number of behavioural and neural characteristics associated with ASD, we tested the hypothesis that at the core of various symptoms of ASD lies a fundamental deficit in predictive learning between events. In five experiments, we conducted a variety of Pavlovian conditioning tasks, some requiring the establishment of associations between temporally phasic events and others involving static events. BTBR mice were impaired in the acquisition of conditioned magazine approach responses with an appetitive unconditioned stimulus (US) (Experiment 1) and conditioned freezing with an electric shock US (Experiment 2). Both of these tasks had temporally phasic conditioned stimuli (CSs). Conversely, these mice showed normal acquisition of conditioned place preference (CPP), whether the US was a systemic injection of methamphetamine (Experiment 3A) or the presence of food (Experiment 3B). Experiment 4 showed normal acquisition of conditioned taste aversion (CTA) to a flavour-taste compound CS, although BTBR mice still exhibited an abnormal stimulus selection when learning for each element of the compound CS was assessed separately. Experiment 5 revealed a weaker latent inhibition of CTA in BTBR mice. The BTBR mouse's impaired predictive learning between phasic events and intact associations between static events are discussed in terms of dysfunctional contingency-based, but not contiguity-based learning, which may accompany abnormal selective attention to relevant cues. We propose that such dysfunctional contingency learning mechanisms may underlie the development of various social and non-social symptoms of ASD.

Cognitive control of meal onset and meal size: Role of dorsal hippocampal-dependent episodic memory

There is a large gap in our understanding of how top-down cognitive processes, such as memory, influence energy intake. Similarly, there is limited knowledge regarding how the brain controls the timing of meals and meal frequency. Understanding how cognition influences ingestive behavior and how the brain controls meal frequency will provide a more complete explanation of the neural mechanisms that regulate energy intake and may also increase our knowledge of the factors that contribute to diet-induced obesity. We hypothesize that dorsal hippocampal neurons, which are critical for memory of personal experiences (i.e., episodic memory), form a memory of a meal, inhibit meal onset during the period following a meal, and limit the amount ingested at the next meal. In support, we describe evidence from human research suggesting that episodic memory of a meal inhibits intake and review data from human and non-human animals showing that impaired hippocampal function is associated with increased intake. We then describe evidence from our laboratory showing that inactivation of dorsal hippocampal neurons decreases the interval between sucrose meals and increases intake at the next meal. We also describe our evidence suggesting that sweet orosensation is sufficient to induce synaptic plasticity in dorsal hippocampal neurons and raise the possibility that impaired dorsal hippocampal function and episodic memory deficits contribute to the development and/or maintenance of diet-induced obesity. Finally, we raise some critical questions that need to be addressed in future research.

Individual trial analysis evidences clock and non-clock based conditioned suppression behaviors in rats

We analyzed the temporal pattern of conditioned suppression of lever-pressing for food in rats conditioned with tone-shock pairings using either a 10 or 15s conditioned stimulus (CS)-unconditioned stimulus (US) interval with a CS duration that was three times the CS-US interval. The analysis of average suppression and of individual trials was performed during Probe CS-alone trials and when a short gap was inserted during the CS. The pattern of suppression followed the classical temporal rules: (1) scalar property, (2) a shift in peak suppression due to a gap, compatible with a Stop rule, (3) a three-state pattern of lever-pressing in individual trials, with abrupt start and stop of suppression. The peak of the average suppression curve, but not the middle time, was anticipatory to the programmed US time. The pattern of lever-pressing in individual trials unraveled two types of start of suppression behavior: a clock-based biphasic responding, with a burst of lever-pressing before suppression, and a non-clock based monophasic reduction of lever-pressing close to the CS onset. The non-clock based type of behavior may be responsible for the anticipatory peak time, and the biphasic pattern of lever-pressing may reflect the decision stage described in clock models.

Sleep and circadian rhythm disruption and recognition memory in schizophrenia

Schizophrenia patients often show irregularities in sleep and circadian rhythms and deficits in recognition memory. Similar phenotypes are seen in schizophrenia-relevant genetic mouse models, such as synaptosomal associated protein of 25 kDa (Snap-25) point mutant mice, vasoactive intestinal peptide receptor 2 (Vipr2) knockout mice, and neuregulin 1 (Nrg1)-deficient mice. Sleep and circadian abnormalities and impaired recognition memory may be causally related in both schizophrenia patients and schizophrenia-relevant mouse models, since sleep deprivation, abnormal photic input, and the manipulation of core clock genes (cryptochrome 1/2) can all disrupt object recognition memory in rodent models. The recognition deficits observed in patients and mouse models (both schizophrenia-related and -unrelated) are discussed here in terms of the dual-process theory of recognition, which postulates that there are two recognition mechanisms-recollection versus familiarity-that can be selectively impaired by brain lesions, neuropsychiatric conditions, and putatively, sleep and circadian rhythm disruption. However, based on this view, the findings from patient studies and studies using genetic mouse models (Nrg1 deficiency) seem to be inconsistent with each other. Schizophrenia patients are impaired at recollection (and to a lesser extent, familiarity judgments), but Nrg1-deficient mice are impaired at familiarity-based object recognition, raising concerns regarding the validity of using these genetically modified mice to model recognition phenotypes observed in patients. This issue can be resolved in future animal studies by examining performance in different variants of the spontaneous recognition task-the standard, perirhinal cortex-dependent, object recognition task versus the hippocampus-dependent object-place recognition task-in order to see which of the two recognition mechanisms is more disrupted.

Effects of prefrontal cortex and hippocampal NMDA NR1-subunit deletion on complex cognitive and social behaviors

Glutamate N-methyl-D-aspartate receptors (NMDARs) in the medial prefrontal cortex (mPFC) and hippocampus may play an integral role in complex cognitive and social deficits associated with a number of psychiatric illnesses including autism, mood disorders, and schizophrenia. We used localized infusions of adeno-associated virus Cre-recombinase in adult, targeted knock-in mice with loxP sites flanking exons 11-22 of the NR1 gene to investigate the effects of chronic NMDAR dysfunction in the mPFC and CA3 hippocampus on cognitive and social behavior. A 5-choice serial reaction time task (5-CSRTT) was used to monitor aspects of cognitive function that included attention and response inhibition. Social behavior was assessed using Crowley׳s sociability and preference for social novelty protocol. Chronic NMDAR dysfunction localized to the anterior cingulate/prelimbic mPFC or dorsal CA3 hippocampus differentially affected the response inhibition and social interaction. mPFC NR1-deletion increased perseverative responding in the 5-CSRTT and enhanced preference for social novelty, whereas CA3 NR1-deletion increased premature responding in the 5-CSRTT and decreased social approach behavior. These findings suggest that mPFC and CA3 NMDARs play selective roles in regulating compulsive and impulsive behavior, respectively. Furthermore, these findings are consistent with emerging evidence that these behaviors are mediated by distinct, albeit overlapping, neural circuits. Our data also suggest that NMDARs in these regions uniquely contribute to the expression of normal social behavior. In this case, mPFC and CA3 NMDARs appear to inhibit and facilitate aspects of social interaction, respectively. The latter dissociation raises the possibility that distinct circuits contribute to the expression of social intrusiveness and impoverished social interaction.

Remembering to eat: hippocampal regulation of meal onset

A wide variety of species, including vertebrate and invertebrates, consume food in bouts (i.e., meals). Decades of research suggest that different mechanisms regulate meal initiation (when to start eating) versus meal termination (how much to eat in a meal, also known as satiety). There is a very limited understanding of the mechanisms that regulate meal onset and the duration of the postprandial intermeal interval (ppIMI). In the present review, we examine issues involved in measuring meal onset and some of the limited available evidence regarding how it is regulated. Then, we describe our recent work indicating that dorsal hippocampal neurons inhibit meal onset during the ppIMI and describe the processes that may be involved in this. We also synthesize recent evidence, including evidence from our laboratory, suggesting that overeating impairs hippocampal functioning and that impaired hippocampal functioning, in turn, contributes to the development and/or maintenance of diet-induced obesity. Finally, we identify critical questions and challenges for future research investigating neural controls of meal onset.

Hippocampus, time, and memory--a retrospective analysis

In 1984, there was considerable evidence that the hippocampus was important for spatial learning and some evidence that it was also involved in duration discrimination. The article "Hippocampus, Time, and Memory" (Meck, Church, & Olton, 1984), however, was the first to isolate the effects of hippocampal damage on specific stages of temporal processing. In this review, to celebrate the 30th anniversary of Behavioral Neuroscience, we look back on factors that contributed to the long-lasting influence of this article. The major results were that a fimbria-fornix lesion (a) interferes with the ability to retain information in temporal working memory, and (b) distorts the content of temporal reference memory, but (c) did not decrease sensitivity to signal duration. This was the first lesion experiment in which the results were interpreted by a well-developed theory of behavior (scalar timing theory). It has led to extensive research on the role of the hippocampus in temporal processing by many investigators. The most important ones are the development of computational models with plausible neural mechanisms (such as the striatal beat-frequency model of interval timing), the use of multiple behavioral measures of timing, and empirical research on the neural mechanisms of timing and temporal memory using ensemble recording of neurons in prefrontal-striatal-hippocampal circuits.

Reevaluating the role of the hippocampus in delay eyeblink conditioning

The role of the hippocampus in delay eyeblink conditioning (DEC) remains controversial. Here, we investigated the involvement of the hippocampus in DEC with a soft tone as the conditioned stimulus (CS) by using electrolytic lesions or muscimol inactivation of guinea pig dorsal hippocampus. Interestingly, when a soft tone was used as a CS, electrolytic lesions of the hippocampus significantly retarded acquisition of the conditioned response (CR), and muscimol infusions into hippocampus distinctly inhibited the acquisition and expression of CR, but had no significant effect on consolidation of well-learned CR. In contrast, both electrolytic lesions and muscimol inactivation of hippocampus produced no significant deficits in the CR when a loud tone was used as the CS. These results demonstrate that the hippocampus is essential for the DEC when the delay task was rendered more difficult.

The hippocampus, time, and memory across scales

A wealth of experimental studies with animals have offered insights about how neural networks within the hippocampus support the temporal organization of memories. These studies have revealed the existence of "time cells" that encode moments in time, much as the well-known "place cells" map locations in space. Another line of work inspired by human behavioral studies suggests that episodic memories are mediated by a state of temporal context that changes gradually over long time scales, up to at least a few thousand seconds. In this view, the "mental time travel" hypothesized to support the experience of episodic memory corresponds to a "jump back in time" in which a previous state of temporal context is recovered. We suggest that these 2 sets of findings could be different facets of a representation of temporal history that maintains a record at the last few thousand seconds of experience. The ability to represent long time scales comes at the cost of discarding precise information about when a stimulus was experienced--this uncertainty becomes greater for events further in the past. We review recent computational work that describes a mechanism that could construct such a scale-invariant representation. Taken as a whole, this suggests the hippocampus plays its role in multiple aspects of cognition by representing events embedded in a general spatiotemporal context. The representation of internal time can be useful across nonhippocampal memory systems.