Temporal encoding of place sequences by hippocampal cell assemblies

Computational influence of adult neurogenesis on memory encoding

Adult neurogenesis in the hippocampus leads to the incorporation of thousands of new granule cells into the dentate gyrus every month, but its function remains unclear. Here, we present computational evidence that indicates that adult neurogenesis may make three separate but related contributions to memory formation. First, immature neurons introduce a degree of similarity to memories learned at the same time, a process we refer to as pattern integration. Second, the extended maturation and change in excitability of these neurons make this added similarity a time-dependent effect, supporting the possibility that temporal information is included in new hippocampal memories. Finally, our model suggests that the experience-dependent addition of neurons results in a dentate gyrus network well suited for encoding new memories in familiar contexts while treating novel contexts differently. Taken together, these results indicate that new granule cells may affect hippocampal function in several unique and previously unpredicted ways.

Grid cells: the position code, neural network models of activity, and the problem of learning

We review progress on the modeling and theoretical fronts in the quest to unravel the computational properties of the grid cell code and to explain the mechanisms underlying grid cell dynamics. The goals of the review are to outline a coherent framework for understanding the dynamics of grid cells and their representation of space; to critically present and draw contrasts between recurrent network models of grid cells based on continuous attractor dynamics and independent-neuron models based on temporal interference; and to suggest open questions for experiment and theory.

Behavior-dependent coordination of multiple theta dipoles in the hippocampus

Theta (4-10 Hz) oscillations in the hippocampus are thought to be important for plasticity, temporal coding, learning, and memory. The hippocampal system has been postulated to have two (or more) rhythmic sources of theta oscillations, but little is known about the behavior-dependent interplay of theta oscillations in different subregions and layers of the hippocampus. We tested rats in a hippocampus-dependent delayed spatial alternation task on a modified T-maze while simultaneously recording local field potentials from dendritic and somatic layers of the dentate gyrus, CA3, and CA1 regions using high-density, 96-site silicon probes. We found that while theta oscillations were generally coherent throughout the hippocampus, the power, coherence, and phase of theta oscillations fluctuated in a layer-specific manner, confirming the presence of multiple interdependent dipoles. Layer-dependent changes in the power and coherence of theta oscillations varied with aspects of both the memory and control (non-mnemonic) tasks, but only a small fraction of the variance could be explained by running speed or acceleration. Furthermore, the phase lag between theta oscillations in the CA3 and CA1 pyramidal layers was significantly smaller on the maze arm approaching the T-junction than on other arms of the alternation task or on comparable segments of control tasks. Overall, our findings reveal a consortium of layer-specific theta dipoles (current sinks and sources) generated by the rhythmic flow of ions into and out of hippocampal cells. Moreover, our data suggest that these different theta generators flexibly coordinate hippocampal regions and layers to support behavioral task performance.

Olfactory oscillations: the what, how and what for

Olfactory system oscillations play out with beautiful temporal and behavioral regularity on the oscilloscope and seem to scream 'meaning'. Always there is the fear that, although attractive, these symbols of dynamic regularity might be just seductive epiphenomena. There are now many studies that have isolated some of the neural mechanisms involved in these oscillations, and recent work argues that they are functional and even necessary at the physiological and cognitive levels. However, much remains to be done for a full understanding of their functions.

Activation of the Cholinergic System Endows Compositional Properties to Striatal Cell Assemblies

Striatal cell assemblies are thought to encode network states related to associative learning, procedural memory, and the sequential organization of behavior. Cholinergic neurotransmission modulates memory processes in the striatum and other brain structures. This work asks if the activity of striatal microcircuits observed in living nervous tissue, with attributes similar to cell assemblies, exhibit some of the properties proposed to be necessary to compose memory traces. Accordingly, we used whole cell and calcium-imaging techniques to investigate the cholinergic modulation of striatal neuron pools that have been reported to exhibit several properties expected from cell assemblies such as synchronous states of activity and the alternation of this activity among different neuron pools. We analyzed the cholinergic modulation of the activity of neuron pools with multidimensional reduction techniques and vectorization of network dynamics. It was found that the activation of the cholinergic system enables striatal cell assemblies with properties that have been posited for recurrent neural artificial networks with memory storage capabilities. Graph theory techniques applied to striatal network states revealed sequences of vectors with a recursive dynamics similar to closed reverberating cycles. The cycles exhibited a modular architecture and a hierarchical organization. It is then concluded that, under certain conditions, the cholinergic system enables the striatal microcircuit with the ability to compose complex sequences of activity. Neuronal recurrent networks with the characteristics encountered in the present experiments are proposed to allow repeated sequences of activity to become memories and repeated memories to compose learned motor procedures.

Hippocampal network dynamics constrain the time lag between pyramidal cells across modified environments

The hippocampus provides a spatial map of the environment. Changes in the environment alter the firing patterns of hippocampal neurons, but are presumably constrained by elements of the network dynamics. We compared the neural activity in CA1 and CA3 regions of the hippocampus in rats running for water reward on a linear track, before and after the track length was shortened. A fraction of cells lost their place fields and new sets of cells with fields emerged, indicating distinct representation of the two tracks. Cells active in both environments shifted their place fields in a location-dependent manner, most notably at the beginning and the end of the track. Furthermore, peak firing rates and place-field sizes decreased, whereas place-field overlap and coactivity increased. Power in the theta-frequency band of the local field potentials also decreased in both CA1 and CA3, along with the coherence between the two structures. In contrast, the theta-scale (0-150 ms) time lags between cell pairs, representing distances on the tracks, were conserved, and the activity of the inhibitory neuron population was maintained across environments. We interpret these observations as reflecting the freedoms and constraints of the hippocampal network dynamics. The freedoms permit the necessary flexibility for the network to distinctly represent unique patterns, whereas the dynamics constrain the speed at which activity propagates between the cell assemblies representing the patterns.

Cell groups reveal structure of stimulus space

An important task of the brain is to represent the outside world. It is unclear how the brain may do this, however, as it can only rely on neural responses and has no independent access to external stimuli in order to “decode” what those responses mean. We investigate what can be learned about a space of stimuli using only the action potentials (spikes) of cells with stereotyped—but unknown—receptive fields. Using hippocampal place cells as a model system, we show that one can (1) extract global features of the environment and (2) construct an accurate representation of space, up to an overall scale factor, that can be used to track the animal's position. Unlike previous approaches to reconstructing position from place cell activity, this information is derived without knowing place fields or any other functions relating neural responses to position. We find that simply knowing which groups of cells fire together reveals a surprising amount of structure in the underlying stimulus space; this may enable the brain to construct its own internal representations.

We construct our understanding of the world solely from neuronal activity generated in our brains. How do we do this? Many studies have investigated how neural activity is related to outside stimuli, and maps of these relationships (often called receptive fields) are routinely computed from data collected in neuroscience experiments. Yet how the brain can understand the meaning of this activity, without the dictionary provided by these maps, remains a mystery. We tackle this fundamental question in the context of hippocampal place cells—i.e., neurons in rodent hippocampus whose activity is strongly correlated to the animal's position in space. We find that the structure of stimulus space can be revealed by exploiting relationships between groups of cofiring neurons in response to different stimuli. We provide a ‘proof of principle’ by demonstrating constructively how the topology of space and the animal's position in an environment can be derived purely from the action potentials fired by hippocampal place cells. In this way, the brain may be able to build up structured representations of stimulus spaces that are then used to represent external stimuli.

Place cells, grid cells, and the brain's spatial representation system

More than three decades of research have demonstrated a role for hippocampal place cells in representation of the spatial environment in the brain. New studies have shown that place cells are part of a broader circuit for dynamic representation of self-location. A key component of this network is the entorhinal grid cells, which, by virtue of their tessellating firing fields, may provide the elements of a path integration-based neural map. Here we review how place cells and grid cells may form the basis for quantitative spatiotemporal representation of places, routes, and associated experiences during behavior and in memory. Because these cell types have some of the most conspicuous behavioral correlates among neurons in nonsensory cortical systems, and because their spatial firing structure reflects computations internally in the system, studies of entorhinal-hippocampal representations may offer considerable insight into general principles of cortical network dynamics.

Internally generated cell assembly sequences in the rat hippocampus

A long-standing conjecture in neuroscience is that aspects of cognition depend on the brain's ability to self-generate sequential neuronal activity. We found that reliably and continually changing cell assemblies in the rat hippocampus appeared not only during spatial navigation but also in the absence of changing environmental or body-derived inputs. During the delay period of a memory task, each moment in time was characterized by the activity of a particular assembly of neurons. Identical initial conditions triggered a similar assembly sequence, whereas different conditions gave rise to different sequences, thereby predicting behavioral choices, including errors. Such sequences were not formed in control (nonmemory) tasks. We hypothesize that neuronal representations, evolved for encoding distance in spatial navigation, also support episodic recall and the planning of action sequences.

A neural coding scheme formed by the combined function of gamma and theta oscillations

Brain oscillations are important in controlling the timing of neuronal firing. This process has been extensively analyzed in connection with gamma frequency oscillations and more recently with respect to theta frequency oscillations. Here we review evidence that theta and gamma oscillations work together to form a neural code. This coding scheme provides a way for multiple neural ensembles to represent an ordered sequence of items. In the hippocampus, this coding scheme is utilized during the phase precession, a phenomenon that can be interpreted as the recall of sequences of items (places) from long-term memory. The same coding scheme may be used in certain cortical regions to encode multi-item short-term memory. The possibility that abnormalities in theta/gamma could underlie symptoms of schizophrenia is discussed.

Different CA1 and CA3 representations of novel routes in a shortcut situation

Place cells are hippocampal neurons whose discharge is strongly related to a rat's location in its environment. The existence of place cells has led to the proposal that they are part of an integrated neural system dedicated to spatial navigation. To further understand the relationships between place cell firing and spatial problem solving, we examined the discharge of CA1 and CA3 place cells as rats were exposed to a shortcut in a runway maze. On specific sessions, a wall section of the maze was removed so as to open a shorter novel route within the otherwise familiar maze. We found that the discharge of both CA1 and CA3 cells was strongly affected in the vicinity of the shortcut region but was much less affected farther away. In addition, CA3 fields away from the shortcut were more altered than CA1 fields. Thus, place cell firing appears to reflect more than just the animal's spatial location and may provide additional information about possible motions, or routes, within the environment. This kinematic representation appears to be spatially more extended in CA3 than in CA1, suggesting interesting computational differences between the two subregions.

Reliability, synchrony and noise

The brain is noisy. Neurons receive tens of thousands of highly fluctuating inputs and generate spike trains that appear highly irregular. Much of this activity is spontaneous - uncoupled to overt stimuli or motor outputs - leading to questions about the functional impact of this noise. Although noise is most often thought of as disrupting patterned activity and interfering with the encoding of stimuli, recent theoretical and experimental work has shown that noise can play a constructive role - leading to increased reliability or regularity of neuronal firing in single neurons and across populations. These results raise fundamental questions about how noise can influence neural function and computation.

Intelligence and EEG phase reset: a two compartmental model of phase shift and lock

OBJECTIVES

The purpose of this study was to explore the relationship between EEG phase reset and performance on the Wechsler Intelligence test.

METHODS

The electroencephalogram (EEG) was recorded from 19 scalp locations from 378 subjects ranging in age from 5 years to 17.6 years. The Wechsler Intelligence test (WISC-R) was administered to the same subjects on the same day but not while the EEG was recorded. Complex demodulation was used to compute instantaneous EEG phase differences between pairs of electrodes and the 1st and 2nd derivatives were used to measure phase reset by phase shift duration and phase lock duration. The dependent variable was full scale I.Q. and the independent variables were phase shift duration (SD) and phase lock duration (LD) with age as a covariate.

RESULTS

Phase shift duration (40-90 ms) was positively related to intelligence (P<.00001) and the phase lock duration (100-800 ms) was negatively related to intelligence (P<.00001). Phase reset in short interelectrode distances (6 cm) was more highly correlated to I.Q. (P<.0001) than in long distances (>12 cm).

CONCLUSIONS

The duration of unstable phase dynamics and phase locking represent a bounded optimization process, for example, too long a duration of phase locking then less flexibility and too short of a phase shift then reduced neural resources. A two compartmental model of local field coupling and neuron synchrony to a preferred phase was developed to explain the findings.

Theta-mediated dynamics of spatial information in hippocampus

In rodent hippocampus, neuronal activity is organized by a 6-10 Hz theta oscillation. The spike timing of hippocampal pyramidal cells with respect to the theta rhythm correlates with an animal's position in space. This correlation has been suggested to indicate an explicit temporal code for position. Alternatively, it may be interpreted as a byproduct of theta-dependent dynamics of spatial information flow in hippocampus. Here we show that place cell activity on different phases of theta reflects positions shifted into the future or past along the animal's trajectory in a two-dimensional environment. The phases encoding future and past positions are consistent across recorded CA1 place cells, indicating a coherent representation at the network level. Consistent theta-dependent time offsets are not simply a consequence of phase-position correlation (phase precession), because they are no longer seen after data randomization that preserves the phase-position relationship. The scale of these time offsets, 100-300 ms, is similar to the latencies of hippocampal activity after sensory input and before motor output, suggesting that offset activity may maintain coherent brain activity in the face of information processing delays.

Firing rate dynamics in the hippocampus induced by trajectory learning

The hippocampus is essential for spatial navigation, which may involve sequential learning. However, how the hippocampus encodes new sequences in familiar environments is unknown. To study the impact of novel spatial sequences on the activity of hippocampal neurons, we monitored hippocampal ensembles while rats learned to switch from two familiar trajectories to a new one in a familiar environment. Here, we show that this novel spatial experience induces two types of changes in firing rates, but not locations of hippocampal place cells. First, place-cell firing rates on the two familiar trajectories start to change before the actual behavioral switch to the new trajectory. Second, repeated exposure on the new trajectory is associated with an increased dependence of place-cell firing rates on immediate past locations. The result suggests that sequence encoding in the hippocampus may involve integration of information about the recent past into current state.

Sequential neural changes during motor learning in schizophrenia

Positron emission tomography (PET) was used to investigate differences in neural plasticity associated with learning a unique motor task in patients with schizophrenia and healthy volunteers. Working with a robotic manipulandum, subjects learned reaching movements in a force field. Visual cues were provided to guide the reaching movements. PET rCBF measures were acquired while participants learned the motor skill over successive runs. The groups did not differ in behavioral performance but did differ in their rCBF activity patterns. Healthy volunteers displayed blood flow increases in primary motor cortex and supplementary motor area with motor learning. The patients with schizophrenia displayed an increase in the primary visual cortex with motor learning. Changes in these regions were positively correlated with changes in each group's motor accuracy, respectively. This is the first study to employ a unique arm-reaching motor learning test to assess neural plasticity during multiple phases of motor learning in patients with schizophrenia. The patients may have an inability to rapidly tune motor cortical neural populations to a preferred direction. The visual system, however, appears to be highly compensated in schizophrenia and the inability to rapidly modulate the motor cortex may be substantially corrected by the schizophrenic group's visuomotor adaptations.

Hippocampus-independent phase precession in entorhinal grid cells

Theta-phase precession in hippocampal place cells is one of the best-studied experimental models of temporal coding in the brain. Theta-phase precession is a change in spike timing in which the place cell fires at progressively earlier phases of the extracellular theta rhythm as the animal crosses the spatially restricted firing field of the neuron. Within individual theta cycles, this phase advance results in a compressed replication of the firing sequence of consecutively activated place cells along the animal's trajectory, at a timescale short enough to enable spike-time-dependent plasticity between neurons in different parts of the sequence. The neuronal circuitry required for phase precession has not yet been established. The fact that phase precession can be seen in hippocampal output stuctures such as the prefrontal cortex suggests either that efferent structures inherit the precession from the hippocampus or that it is generated locally in those structures. Here we show that phase precession is expressed independently of the hippocampus in spatially modulated grid cells in layer II of medial entorhinal cortex, one synapse upstream of the hippocampus. Phase precession is apparent in nearly all principal cells in layer II but only sparsely in layer III. The precession in layer II is not blocked by inactivation of the hippocampus, suggesting that the phase advance is generated in the grid cell network. The results point to possible mechanisms for grid formation and raise the possibility that hippocampal phase precession is inherited from entorhinal cortex.

Altered phase precession and compression of temporal sequences by place cells in epileptic rats

In the hippocampus, pyramidal cells encode information in two major ways: rate coding and temporal coding. Rate coding, in which information is coded through firing frequency, is exemplarily illustrated by place cells, characterized by their location-specific firing. In addition, the precise temporal organization of firing of multiple place cells provides information, in a compressed time window, about the temporal sequence of the locations visited by the animal. This encoding is accomplished through phase precession, a phenomenon whereby unit firing is linked to theta rhythm, one of the major hippocampal EEG oscillations. Although it is likely that this type of processing is critical for normal brain function, its involvement in pathologies associated with cognitive disorders is unknown. In this experiment, we determined whether the temporal organization of place cell firing is affected in an animal model of mesial temporal lobe epilepsy (MTLE), a disease accompanied with cognitive impairment. We investigated hippocampal coding and its relationship to theta rhythm in rats after status epilepticus (SE), a condition that leads to MTLE. We found a great proportion of SE place cells had aberrant phase/precession pattern and temporal organization of firing among pairs of neurons, which constitutes the compression of temporal sequences, was altered in SE rats. The same animals were also markedly impaired in the water maze task, a measure of spatial memory. We propose that the synaptic and cellular alterations observed in MTLE induce aberrant temporal coding in the hippocampus, contributing in turn to cognitive dysfunction.

Phase Precession Through Synaptic Facilitation

Phase precession is a relational code that is thought to be important for episodic-like memory, for instance, the learning of a sequence of places. In the hippocampus, places are encoded through bursting activity of so-called place cells. The spikes in such a burst exhibit a precession of their firing phases relative to field potential theta oscillations (4–12 Hz); the theta phase of action potentials in successive theta cycles progressively decreases toward earlier phases. The mechanisms underlying the generation of phase precession are, however, unknown. In this letter, we show through mathematical analysis and numerical simulations that synaptic facilitation in combination with membrane potential oscillations of a neuron gives rise to phase precession. This biologically plausible model reproduces experimentally observed features of phase precession, such as (1) the progressive decrease of spike phases, (2) the nonlinear and often also bimodal relation between spike phases and the animal's place, (3) the range of phase precession being smaller than one theta cycle, and (4) the dependence of phase jitter on the animal's location within the place field. The model suggests that the peculiar features of the hippocampal mossy fiber synapse, such as its large efficacy, long-lasting and strong facilitation, and its phase-locked activation, are essential for phase precession in the CA3 region of the hippocampus.

Theta phase-specific codes for two-dimensional position, trajectory and heading in the hippocampus

Temporal coding is a means of representing information by the time, as opposed to the rate, at which neurons fire. Evidence of temporal coding in the hippocampus comes from place cells, whose spike times relative to theta oscillations reflect a rat's position while running along stereotyped trajectories. This arises from the backwards shift in cell firing relative to local theta oscillations (phase precession). Here we demonstrate phase precession during place-field crossings in an open-field foraging task. This produced spike sequences in each theta cycle that disambiguate the rat's trajectory through two-dimensional space and can be used to predict movement direction. Furthermore, position and movement direction were maximally predicted from firing in the early and late portions of the theta cycle, respectively. This represents the first direct evidence of a combined representation of position, trajectory and heading in the hippocampus, organized on a fine temporal scale by theta oscillations.

New experiences enhance coordinated neural activity in the hippocampus

The acquisition of new memories for places and events requires synaptic plasticity in the hippocampus, and plasticity depends on temporal coordination among neurons. Spatial activity in the hippocampus is relatively disorganized during the initial exploration of a novel environment, however, and it is unclear how neural activity during the initial stages of learning drives synaptic plasticity. Here we show that pairs of CA1 cells that represent overlapping novel locations are initially more coactive and more precisely coordinated than are cells representing overlapping familiar locations. This increased coordination occurs specifically during brief, high-frequency events (HFEs) in the local field potential that are similar to ripples and is not associated with better coordination of place-specific neural activity outside of HFEs. As novel locations become more familiar, correlations between cell pairs decrease. Thus, hippocampal neural activity during learning has a unique structure that is well suited to induce synaptic plasticity and to allow for rapid storage of new memories.

Impaired spatial representation in CA1 after lesion of direct input from entorhinal cortex

Place-specific firing in the hippocampus is determined by path integration-based spatial representations in the grid-cell network of the medial entorhinal cortex. Output from this network is conveyed directly to CA1 of the hippocampus by projections from principal neurons in layer III, but also indirectly by axons from layer II to the dentate gyrus and CA3. The direct pathway is sufficient for spatial firing in CA1, but it is not known whether similar firing can also be supported by the input from CA3. To test this possibility, we made selective lesions in layer III of medial entorhinal cortex by local infusion of the neurotoxin gamma-acetylenic GABA. Firing fields in CA1 became larger and more dispersed after cell loss in layer III, whereas CA3 cells, which receive layer II input, still had sharp firing fields. Thus, the direct projection is necessary for precise spatial firing in the CA1 place cell population.

Gamma oscillatory firing reveals distinct populations of pyramidal cells in the CA1 region of the hippocampus

Hippocampal place cells that fire together within the same cycle of theta oscillations represent the sequence of positions (movement trajectory) that a rat traverses on a linear track. Furthermore, it has been suggested that the encoding of these and other types of temporal memory sequences is organized by gamma oscillations nested within theta oscillations. Here, we examined whether gamma-related firing of place cells permits such discrete temporal coding. We found that gamma-modulated CA1 pyramidal cells separated into two classes on the basis of gamma firing phases during waking theta periods. These groups also differed in terms of their spike waveforms, firing rates, and burst firing tendency. During gamma oscillations one group's firing became restricted to theta phases associated with the highest gamma power. Consequently, on the linear track, cells in this group often failed to fire early in theta-phase precession (as the rat entered the place field) if gamma oscillations were present. The second group fired throughout the theta cycle during gamma oscillations, and maintained gamma-modulated firing at different stages of theta-phase precession. Our results suggest that the two different pyramidal cell classes may support different types of population codes within a theta cycle: one in which spike sequences representing movement trajectories occur across subsequent gamma cycles nested within each theta cycle, and another in which firing in synchronized gamma discharges without temporal sequences encode a representation of location. We propose that gamma oscillations during theta-phase precession organize the mnemonic recall of population patterns representing places and movement paths.

A single application of MK801 causes symptoms of acute psychosis, deficits in spatial memory, and impairment of synaptic plasticity in rats

Schizophrenia is mostly a progressive psychiatric illness. Although cognitive changes in chronic schizophrenia have been investigated, little is known about the consequences of a single psychotic episode on memory mechanisms and formation. We investigated changes in hippocampal long-term potentiation (LTP) and spatial memory in a rat model of an acute psychotic episode. Application of NMDA receptor antagonists, such as MK801 (dizolcilpine) in rats, have been shown to give rise to an acute and short-lasting behavioral state, which mirrors many symptoms of schizophrenia. Furthermore, NMDA antagonist-intake in humans elicits symptoms of schizophrenia such as hallucinations, delusions, and affective blunting. We therefore treated animals with a single systemic injection of MK801 (5 mg/kg). Increased stereotypy, locomotion, and ataxia were evident immediately after MK801-treatment, with effects disappearing within 24 h. MK801-treatment caused a disruption of prepulse inhibition of the acoustic startle reflex, 1 day but not 7 or 28 days after treatment. These effects were consistent with the occurrence of an acute psychotic episode. LTP was profoundly impaired in freely moving rats 7 days after MK801 application. Four weeks after treatment, a slight recovery of LTP was seen, however marked deficits in long-term spatial memory were evident. These data suggest that treatment with MK801 to generate an acute psychotic episode in rats, gives rise to grave disturbances in synaptic plasticity and is associated with lasting impairments with the ability to form spatial memory.

Electrolytic lesions of dorsal CA3 impair episodic-like memory in rats

Episodic memory is the ability to recollect one's past experiences occurring in an unique spatial and temporal context. In non-human animals, it is expressed in the ability to combine "what", "where" and "when" factors to form an integrated memory system. During the search for its neural substrates, the hippocampus has attracted a lot of attentions. Yet, it is not yet possible to induce a pure episodic-like memory deficit in animal studies without being confounded by impairments in the spatial cognition. Here, we present a lesion study evidencing direct links between the hippocampus CA3 region and the episodic-like memory in rats. In a spontaneous object exploration task, lesioned rats showed no interaction between the temporal and spatial elements in their memory associated with the objects. In separate tests carried out subsequently, the same animals still expressed abilities to process spatial, temporal, and object recognition memory. In conclusions, our results support the idea that the hippocampus CA3 has a particular status in the neural mechanism of the episodic-like memory system. It is responsible for combining information from different modules of cognitive processes.

Gradual changes in hippocampal activity support remembering the order of events

The hippocampus is thought to contribute to episodic memory in part by binding stimuli to their spatiotemporal context. The present study examined how hippocampal neuronal populations encode spatial and temporal context as rats performed a task in which they were required to remember the order of trial-unique sequences of odors. The results suggest that a gradual change in the pattern of hippocampal activity served as a temporal context for odor-sampling events and was important for successful subsequent memory of the order of those odors.

Hippocampal theta sequences

The activity of individual hippocampal principal neurons is spatially localized such that each neuron is active only when the animal occupies an area of the environment known as the cell's place field. Additionally, the activity of hippocampal neurons exhibits a particular temporal relationship to the hippocampal EEG, such that spikes fired by the neuron occur at progressively earlier phases of the co-occurring theta rhythm in the EEG as the animal traverses the place field. This relationship is known as theta precession. A long-standing prediction following the observation of theta precession has been that among a collection of hippocampal neurons recorded simultaneously, the neurons will fire in sequences reflecting the behavioral order of the place fields. Here we examine this prediction. We show that clear, ordered sequences occur during theta, which we name theta sequences, in which a portion of the animal's spatial experience is played out in forwards order. We further investigate the relationship of theta sequences to phase precession by shuffling spike phases in such a way as to preserve the relationship between spike phase and position. This jitter significantly reduces the prevalence of theta sequences while leaving theta phase precession intact, suggesting that the presence of theta phase precession is not trivially predictive of theta sequences. Finally, we discuss the relationship between theta sequences and individual place fields, and the possible functional role of theta sequences in navigational learning.

Hippocampal and neocortical interactions during context discrimination: electrophysiological evidence from the rat

There is substantial evidence that hippocampus plays an important role in the processing of contextual information. Its specific role, however, remains unclear. One possibility is that single hippocampal neurons represent context information so that local circuits can construct representations of the current context, and the context that is expected based on past experience. Population codes derived from input by multiple local circuits may then engage match-mismatch algorithms that compare current and expected context information to determine the extent to which an expected context has changed. The results of such match-mismatch comparisons can be used to discriminate contexts. When context changes are detected, efferent messages may be passed on to connected neocortical areas so that informed "decisions" regarding future behavioral and cognitive strategies can be made. Here, a brief review describes evidence that a primary consequence of hippocampal processing is the discrimination of meaningful contexts. Then, the functional significance of neocortical circuits that likely receive hippocampal output messages are described in terms of their contribution to the control of ongoing behavioral and cognitive strategy, especially during active navigation. It is clear from this systems view that studies of spatial navigation continue to provide researchers with an excellent model of hippocampal-neocortical interactions during learning.

Toward an integrative perspective on hippocampal function: from the rapid encoding of experience to adaptive behavior

The mammalian hippocampus has been associated with learning and memory, as well as with many other behavioral processes. In this article, these different perspectives are brought together, and it is pointed out that integration of diverse functional domains may be a key feature enabling the hippocampus to support not only the encoding and retrieval of certain memory representations, but also their translation into adaptive behavior. The hippocampus appears to combine: (i) sensory afferents and synaptic mechanisms underlying certain types of rapid learning; and (ii) links to motivational, emotional, executive, and sensorimotor functions. Recent experiments are highlighted, indicating that the induction of hippocampal synaptic plasticity is required to encode rapidly aspects of experience, such as places, into memory representations; subsequent retrieval of these representations requires transmission through the previously modified hippocampal synapses, but no further plasticity. In contrast, slow incremental place learning may not absolutely require hippocampal contributions. The neocortical sensory inputs, especially visuo-spatial information, necessary for hippocampus-dependent rapid learning, are preferentially associated with the septal to intermediate hippocampus. In contrast, connectivity with the prefrontal cortex and subcortical sites, which link the hippocampus to motivational, emotional, executive, and sensorimotor functions, is primarily associated with the intermediate to temporal hippocampus. A model of functional differentiation and integration along the septo-temporal axis of the hippocampus is proposed, describing key hippocampal contributions to adaptive behavior based on information encoded during a single or a few past experiences.

Memory retrieval time and memory capacity of the CA3 network: role of gamma frequency oscillations

The existence of recurrent synaptic connections in CA3 led to the hypothesis that CA3 is an autoassociative network similar to the Hopfield networks studied by theorists. CA3 undergoes gamma frequency periodic inhibition that prevents a persistent attractor state. This argues against the analogy to Hopfield nets, in which an attractor state can be used for working memory. However, we show that such periodic inhibition allows one cycle of recurrent excitatory activity and that this is sufficient for memory retrieval (within milliseconds). Thus, gamma oscillations are compatible with a long-term autoassociative memory function for CA3. A second goal of our work was to evaluate previous methods for estimating the memory capacity (P) of CA3. We confirm the equation, P = c/a(2), where c is the probability that any two cells are recurrently connected and a is the fraction of cells representing a memory item. In applying this to CA3, we focus on CA3a, the subregion where recurrent connections are most numerous (c = 0.2) and approximate randomness. We estimate that a memory item is represented by approximately 225 of the 70,000 neurons in CA3a (a = 0.003) and that approximately 20,000 memory items can be stored. Our general conclusion is that the physiological and anatomical findings of CA3a are consistent with an autoassociative function. The nature of the information that is associated in CA3a is discussed. We also discuss how the autoassociative properties of CA3 and the heteroassociative properties of dentate synapses (linking sequential memories) form an integrated system for the storage and recall of item sequences. The recall process generates the phase precession in dentate, CA3, and entorhinal cortex.

Natural stimuli evoke dynamic sequences of states in sensory cortical ensembles

Although temporal coding is a frequent topic of neurophysiology research, trial-to-trial variability in temporal codes is typically dismissed as noise and thought to play no role in sensory function. Here, we show that much of this supposed "noise" faithfully reflects stimulus-related processes carried out in coherent neural networks. Cortical neurons responded to sensory stimuli by progressing through sequences of states, identifiable only in examinations of simultaneously recorded ensembles. The specific times at which ensembles transitioned from state to state varied from trial to trial, but the state sequences were reliable and stimulus-specific. Thus, the characterization of ensemble responses in terms of state sequences captured facets of sensory processing that are missing from, and obscured in, other analyses. This work provides evidence that sensory neurons act as parts of a systems-level dynamic process, the nature of which can best be appreciated through observation of distributed ensembles.

Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point

Neural ensembles were recorded from the CA3 region of rats running on T-based decision tasks. Examination of neural representations of space at fast time scales revealed a transient but repeatable phenomenon as rats made a decision: the location reconstructed from the neural ensemble swept forward, first down one path and then the other. Estimated representations were coherent and preferentially swept ahead of the animal rather than behind the animal, implying it represented future possibilities rather than recently traveled paths. Similar phenomena occurred at other important decisions (such as in recovery from an error). Local field potentials from these sites contained pronounced theta and gamma frequencies, but no sharp wave frequencies. Forward-shifted spatial representations were influenced by task demands and experience. These data suggest that the hippocampus does not represent space as a passive computation, but rather that hippocampal spatial processing is an active process likely regulated by cognitive mechanisms.

Estimating firing rates from calcium signals in locust projection neurons in vivo

Combining intracellular electrophysiology and multi-photon calcium imaging in vivo, we studied the relationship between calcium signals (sampled at 500-750 Hz) and spike output in principal neurons in the locust antennal lobe. Our goal was to determine whether the firing rate of individual neurons can be estimated in vivo with calcium imaging and, if so, to measure directly the accuracy and resolution of our estimates. Using the calcium indicator Oregon Green BAPTA-1, we describe a simple method to reconstruct firing rates from dendritic calcium signals with 80-90% accuracy and 50 ms temporal resolution.

Dopamine modulation of hippocampal-prefrontal cortical interaction drives memory-guided behavior

Information gleaned from learning and memory processes is essential in guiding behavior toward a specific goal. However, the neural mechanisms that determine how these processes are effectively utilized to guide goal-directed behavior are unknown. Here, we show that rats utilize retrospective and prospective memory and flexible switching between these 2 memory processes to guide behaviors to obtain rewards. We found that retrospective memory is mainly processed in the hippocampus (HPC) but that this retrospective information must be incorporated within the prefrontal cortex (PFC) to be used to switch to an anticipatory response strategy involving prospective memory. Furthermore, switching between memory processes is regulated by the mesocortical dopamine (DA) system. Thus, DA D1 and D2 receptor activation in the PFC differentially affects retrospective memory processing within the HPC via an indirect feedback pathway. In contrast, D1, but not D2, receptor activation is crucial for incorporation of HPC-based retrospective information into the PFC. However, once this takes place, D2 receptor activation is required for further processing of information to effect preparation of future actions. These results provide a unique perspective on the mechanism of memory-based goal-directed behavior.

Analyzing the activity of large populations of neurons: how tractable is the problem?

Understanding how the brain performs computations requires understanding neuronal firing patterns at successive levels of processing-a daunting and seemingly intractable task. Two recent studies have made dramatic progress on this problem by showing how its dimensionality can be reduced. Using the retina as a model system, they demonstrated that multineuronal firing patterns can be predicted by pairwise interactions.

Emergence of sequence sensitivity in a hippocampal CA3–CA1 model

Recent studies have shown that place cells in the hippocampal CA1 region fire in a sequence sensitive manner. In this study we tested if hippocampal CA3 and CA1 regions can give rise to the sequence sensitivity. We used a two-layer CA3-CA1 hippocampal model that consisted of Hodgkin-Huxley style neuron models. Sequential input signals that mimicked signals projected from the entorhinal cortex gradually modified the synaptic conductances between CA3 pyramidal cells through spike-timing-dependent plasticity (STDP) and produced propagations of neuronal activity in the radial direction from stimulated pyramidal cells. This sequence dependent spatio-temporal activity was picked up by specific CA1 pyramidal cells through modification of Schaffer collateral synapses with STDP. After learning, these CA1 pyramidal cells responded with the highest probability to the learned sequence, while responding with a lower probability to different sequences. These results demonstrate that sequence sensitivity of CA1 place cells would emerge through computation in the CA3 and CA1 regions.

Place-selective firing contributes to the reverse-order reactivation of CA1 pyramidal cells during sharp waves in open-field exploration

On the linear track, the recent firing sequences of CA1 place cells recur during sharp wave/ripple patterns (SWRs) in a reverse temporal order [Foster & Wilson (2006) Nature, 440, 680–683]. We have found similar reverse-order reactivation during SWRs in open-field exploration where the firing sequence of cells varied before each SWR. Both the onset times and the firing patterns of cells showed a tendency for reversed sequences during SWRs. These effects were observed for SWRs that occurred during exploration, but not for those during longer immobility periods. Additionally, reverse reactivation was stronger when it was preceded by higher speed (> 5 cm/s) run periods. The trend for reverse-order SWR reactivation was not significantly different in familiar and novel environments, even though SWR-associated firing rates of both pyramidal cells and interneurons were reduced in novel environments as compared with familiar. During exploration-associated SWRs (eSWR) place cells retain place-selective firing [O'Neill et al. (2006) Neuron, 49, 143–155]. Here, we have shown that each cell's firing onset was more delayed and firing probability more reduced during eSWRs the further the rat was from the middle of the cell's place field; that is, cells receiving less momentary place-related excitatory drive fired later during SWR events. However, even controlling for place field distance, the recent firing of cells was still significantly correlated with SWR reactivation sequences. We therefore propose that both place-related drive and the firing history of cells contribute to reverse reactivation during eSWRs.

Hippocampal place cell assemblies are speed-controlled oscillators

The phase of spikes of hippocampal pyramidal cells relative to the local field theta oscillation shifts forward ("phase precession") over a full theta cycle as the animal crosses the cell's receptive field ("place field"). The linear relationship between the phase of the spikes and the travel distance within the place field is independent of the animal's running speed. This invariance of the phase-distance relationship is likely to be important for coordinated activity of hippocampal cells and space coding, yet the mechanism responsible for it is not known. Here we show that at faster running speeds place cells are active for fewer theta cycles but oscillate at a higher frequency and emit more spikes per cycle. As a result, the phase shift of spikes from cycle to cycle (i.e., temporal precession slope) is faster, yet spatial-phase precession stays unchanged. Interneurons can also show transient-phase precession and contribute to the formation of coherently precessing assemblies. We hypothesize that the speed-correlated acceleration of place cell assembly oscillation is responsible for the phase-distance invariance of hippocampal place cells.

Human cortical circuits for central executive function emerge by theta phase synchronization

Dynamic networking of brain regions is suggested to be one of the key factors involved in various brain computations. Central executive function typically requires instantaneous coordination among the medial prefrontal regions and other distant regions, depending on the on-going task situation. In human scalp-recorded electroencephalography (EEG), the medial prefrontal area is estimated to be the current source of the theta rhythm, while there is no direct evidence that the theta rhythm is involved in the dynamic networking of central executive circuits. Here we hypothesize that the central executive circuit over the prefrontal and task-related cortices is dynamically linked by theta synchronization. By using simultaneous functional magnetic resonance imaging (fMRI) and EEG, we elucidated cortical circuits emerging with theta phase synchronization during free pacing repeated subtraction. Theta phase synchronization in the scalp EEG was found to emerge at two major clusters of electrode pairs, between the right frontal and left parietal sites and between the frontal and right parietal sites. The phase synchronization of two clusters is accompanied by fMRI responses in the cortical regions responsible for central executive function, working memory, visual imagery and cognitive action sequence. Here we report the first evidence that theta phase synchronization dynamically coordinates the central executive circuits, including the medial prefrontal cortex and relevant cortical regions.

Sleep enforces the temporal order in memory

Background

Temporal sequence represents the main principle underlying episodic memory. The storage of temporal sequence information is thought to involve hippocampus-dependent memory systems, preserving temporal structure possibly via chaining of sequence elements in heteroassociative networks. Converging evidence indicates that sleep enhances the consolidation of recently acquired representations in the hippocampus-dependent declarative memory system. Yet, it is unknown if this consolidation process comprises strengthening of the temporal sequence structure of the representation as well, or is restricted to sequence elements independent of their temporal order. To address this issue we tested the influence of sleep on the strength of forward and backward associations in word-triplets.

Methodology/Principal Findings

Subjects learned a list of 32 triplets of unrelated words, presented successively (A-B-C) in the center of a screen, and either slept normally or stayed awake in the subsequent night. After two days, retrieval was assessed for the triplets sequentially either in a forward direction (cueing with A and B and asking for B and C, respectively) or in a backward direction (cueing with C and B and asking for B and A, respectively). Memory was better for forward than backward associations (p<0.01). Sleep did not affect backward associations, but enhanced forward associations, specifically for the first (AB) transitions (p<0.01), which were generally more difficult to retrieve than the second transitions.

Conclusions/Significance

Our data demonstrate that consolidation during sleep strengthens the original temporal sequence structure in memory, presumably as a result of a replay of new representations during sleep in forward direction. Our finding suggests that the temporally directed replay of memory during sleep, apart from strengthening those traces, could be the key mechanism that explains how temporal order is integrated and maintained in the trace of an episodic memory.

A unified view of theta-phase coding in the entorhinal–hippocampal system

The discovery of theta-rhythm-dependent firing of rodent hippocampal neurons highlighted the functional significance of temporal encoding in hippocampal memory. However, earlier theoretical studies on this topic seem divergent and experimental implications are invariably complicated. To obtain a unified understanding of neural dynamics in the hippocampal memory, we here review recent developments in computational models and experimental discoveries on the 'theta-phase precession' of hippocampal place cells and entorhinal grid cells. We identify a theoretical hypothesis that is well supported by experimental facts; this model reveals a significant contribution of theta-phase coding to the on-line real-time operation of episodic events, through highly parallel representation of spatiotemporal information.

Learning-related coordination of striatal and hippocampal theta rhythms during acquisition of a procedural maze task

The striatum and hippocampus are conventionally viewed as complementary learning and memory systems, with the hippocampus specialized for fact-based episodic memory and the striatum for procedural learning and memory. Here we directly tested whether these two systems exhibit independent or coordinated activity patterns during procedural learning. We trained rats on a conditional T-maze task requiring navigational and cue-based associative learning. We recorded local field potential (LFP) activity with tetrodes chronically implanted in the caudoputamen and the CA1 field of the dorsal hippocampus during 6-25 days of training. We show that simultaneously recorded striatal and hippocampal theta rhythms are modulated differently as the rats learned to perform the T-maze task but nevertheless become highly coherent during the choice period of the maze runs in rats that successfully learned the task. Moreover, in the rats that acquired the task, the phase of the striatal-hippocampal theta coherence was modified toward a consistent antiphase relationship, and these changes occurred in proportion to the levels of learning achieved. We suggest that rhythmic oscillations, including theta-band activity, could influence not only neural processing in cortico-basal ganglia circuits but also dynamic interactions between basal ganglia-based and hippocampus-based forebrain circuits during the acquisition and performance of learned behaviors. Experience-dependent changes in coordination of oscillatory activity across brain structures thus may parallel the well known plasticity of spike activity that occurs as a function of experience.

Path planning in the hippocampo-prefrontal cortex pathway: an adaptive model based receding horizon planner

Four characteristic properties of human path planning strategy are course and fine planning, supervised planning, adaptation and robustness, and complexity reduction. These four characteristics are also observed in "model predictive controller" and its modified version, "receding horizon planner". We hypothesize that the human brain performs path planning tasks, literally like a receding horizon planner. The similarities between human brain and a receding horizon planner are: (1) hippocampus contains the course model and the parietal cortex is responsible for the fine model. (2) Replanning and trajectory tuning using the visual data in parietal cortex and prefrontal cortex is exploited in an adaptive restricted receding horizon. Prefrontal cortex plays the role of the supervisor. (3) Adjusting the sampling time of the planner is implemented based on changes in the complexity of the environment and tasks. This is in fact, the adaptation, which exists both in human behavior and in receding horizon planner. (4) The brain simplifies path-finding problems to reduce computational loads, exactly similar to what engineering controllers intend to do. The visual data is smoothed by clustering of obstacles, before performing any computational task. Finally, we have discussed the consequence of our hypothesis in Alzheimer disease as an optimal planning disorder. Based on some experimental data, Alzheimer patients have a reduced predictive horizon, making the system less robust and exposed to hazardous conditions in sophisticated environments. Patients with mild Alzheimer disease have little trouble with simple optimization problems; working memory of the prefrontal cortex is sufficient for this purpose. However, in complicated tasks, the brain needs huge extended memory. This memory is available through hippocampo-prefrontal pathway, which is to some extent disturbed in Alzheimer patients. We suggest that this fact may be a basis for future experimental diagnosis tests. We predict that Alzheimer patients should have problems with planning for far future; because they have a weak memory, insufficient for heavy optimization tasks, such as moving through moving obstacles in a dynamic environment. Alzheimer disease could be early detected by designing new tests in which the ability of patients to predict the future events is checked. These tests could be accompanied with a multi-step optimization problem. We believe that paying attention to this opinion may provide a good help in diagnosing Alzheimer disease in earlier stages. Surely, experimental studies are needed to validate our hypothesis.

Which computational mechanisms operate in the hippocampus during novelty detection?

A fundamental property of adaptive behavior is the ability to rapidly distinguish what is novel from what is familiar in our environment. Empirical evidence and computational work have provided biologically plausible models of the neural substrate and mechanisms underlying the coding of stimulus novelty in the perirhinal cortex. In this article, we highlight the importance of a different category of novelty, namely associative novelty, which has received relatively little attention, despite its clear ecological importance. While previous studies in both animals and humans have documented hippocampal responses in relation to associative novelty, a key issue concerning the computations underlying these novelty signals has not been previously addressed. We argue that this question has importance not only for our understanding of novelty processing, but also for advancing our knowledge of the fundamental computational operations performed by the hippocampus. We suggest a different approach to this problem, and discuss recent evidence supporting the hypothesis that the hippocampus operates as a comparator during the processing of associative novelty, generating mismatch/novelty signals when prior predictions are violated by sensory reality. We also draw on conceptual similarities between associative novelty and contextual novelty to suggest that empirical findings from these two seemingly distant research fields accord with the operation of a comparator mechanism during novelty detection more generally. We therefore conclude that a comparator mechanism may underlie the role of the hippocampus not only in detecting occurrences that are unexpected given specific associatively retrieved predictions, but also events that violate more abstract properties of the experimental context.

Hippocampal CA3 pyramidal cells selectively innervate aspiny interneurons

The specific connectivity among principal cells and interneurons determines the flow of activity in neuronal networks. To elucidate the connections between hippocampal principal cells and various classes of interneurons, CA3 pyramidal cells were intracellularly labelled with biocytin in anaesthetized rats and the three-dimensional distribution of their axon collaterals was reconstructed. The sections were double-stained for substance P receptor (SPR)- or metabotropic glutamate receptor 1alpha (mGluR-1alpha)-immunoreactivity to investigate interneuron targets of the CA3 pyramidal cells. SPR-containing interneurons represent a large portion of the GABAergic population, including spiny and aspiny classes. Axon terminals of CA3 pyramidal cells contacted SPR-positive interneuron dendrites in the hilus and in all hippocampal strata in both CA3 and CA1 regions (7.16% of all boutons). The majority of axons formed single contacts (87.5%), but multiple contacts (up to six) on single target neurons were also found. CA3 pyramidal cell axon collaterals innervated several types of morphologically different aspiny SPR-positive interneurons. In contrast, spiny SPR-interneurons or mGluR-1alpha-positive interneurons in the hilus, CA3 and CA1 regions were rarely contacted by the filled pyramidal cells. These findings indicate a strong target selection of CA3 pyramidal cells favouring the activation of aspiny classes of interneurons.