Cognitive map formation through sequence encoding by theta phase precession

Rat anterior cingulate neurons responsive to rule or strategy changes are modulated by the hippocampal theta rhythm and sharp-wave ripples

To better understand neural processing during adaptive learning of stimulus-response-reward contingencies, we recorded synchrony of neuronal activity in anterior cingulate cortex (ACC) and hippocampal rhythms in male rats acquiring and switching between spatial and visual discrimination tasks in a Y-maze. ACC population activity as well as single unit activity shifted shortly after task rule changes or just before the rats adopted different task strategies. Hippocampal theta oscillations (associated with memory encoding) modulated an elevated proportion of rule-change responsive neurons (70%), but other neurons that were correlated with strategy-change, strategy value and reward-rate were not. However, hippocampal sharp wave-ripples modulated significantly higher proportions of rule-change, strategy-change and reward-rate responsive cells during post-session sleep but not pre-session sleep. This suggests an underestimated mechanism for hippocampal mismatch and contextual signals to facilitate ACC to detect contingency changes for cognitive flexibility, a function that is attenuated after it is damaged.

Synaptic conditions for auto-associative memory storage and pattern completion in Jensen et al.'s model of hippocampal area CA3

Jensen et al. (Learn Memory 3(2-3):243-256, 1996b) proposed an auto-associative memory model using an integrated short-term memory (STM) and long-term memory (LTM) spiking neural network. Their model requires that distinct pyramidal cells encoding different STM patterns are fired in different high-frequency gamma subcycles within each low-frequency theta oscillation. Auto-associative LTM is formed by modifying the recurrent synaptic efficacy between pyramidal cells. In order to store auto-associative LTM correctly, the recurrent synaptic efficacy must be bounded. The synaptic efficacy must be upper bounded to prevent re-firing of pyramidal cells in subsequent gamma subcycles. If cells encoding one memory item were to re-fire synchronously with other cells encoding another item in subsequent gamma subcycle, LTM stored via modifiable recurrent synapses would be corrupted. The synaptic efficacy must also be lower bounded so that memory pattern completion can be performed correctly. This paper uses the original model by Jensen et al. as the basis to illustrate the following points. Firstly, the importance of coordinated long-term memory (LTM) synaptic modification. Secondly, the use of a generic mathematical formulation (spiking response model) that can theoretically extend the results to other spiking network utilizing threshold-fire spiking neuron model. Thirdly, the interaction of long-term and short-term memory networks that possibly explains the asymmetric distribution of spike density in theta cycle through the merger of STM patterns with interaction of LTM network.

A computational predictor of human episodic memory based on a theta phase precession network

In the rodent hippocampus, a phase precession phenomena of place cell firing with the local field potential (LFP) theta is called “theta phase precession” and is considered to contribute to memory formation with spike time dependent plasticity (STDP). On the other hand, in the primate hippocampus, the existence of theta phase precession is unclear. Our computational studies have demonstrated that theta phase precession dynamics could contribute to primate–hippocampal dependent memory formation, such as object–place association memory. In this paper, we evaluate human theta phase precession by using a theory–experiment combined analysis. Human memory recall of object–place associations was analyzed by an individual hippocampal network simulated by theta phase precession dynamics of human eye movement and EEG data during memory encoding. It was found that the computational recall of the resultant network is significantly correlated with human memory recall performance, while other computational predictors without theta phase precession are not significantly correlated with subsequent memory recall. Moreover the correlation is larger than the correlation between human recall and traditional experimental predictors. These results indicate that theta phase precession dynamics are necessary for the better prediction of human recall performance with eye movement and EEG data. In this analysis, theta phase precession dynamics appear useful for the extraction of memory-dependent components from the spatio–temporal pattern of eye movement and EEG data as an associative network. Theta phase precession may be a common neural dynamic between rodents and humans for the formation of environmental memories.

Biomimetic approach to tacit learning based on compound control

The remarkable capability of living organisms to adapt to unknown environments is due to learning mechanisms that are totally different from the current artificial machine-learning paradigm. Computational media composed of identical elements that have simple activity rules play a major role in biological control, such as the activities of neurons in brains and the molecular interactions in intracellular control. As a result of integrations of the individual activities of the computational media, new behavioral patterns emerge to adapt to changing environments. We previously implemented this feature of biological controls in a form of machine learning and succeeded to realize bipedal walking without the robot model or trajectory planning. Despite the success of bipedal walking, it was a puzzle as to why the individual activities of the computational media could achieve the global behavior. In this paper, we answer this question by taking a statistical approach that connects the individual activities of computational media to global network behaviors. We show that the individual activities can generate optimized behaviors from a particular global viewpoint, i.e., autonomous rhythm generation and learning of balanced postures, without using global performance indices.

Spatial-area selective retrieval of multiple object-place associations in a hierarchical cognitive map formed by theta phase coding

The human cognitive map is known to be hierarchically organized consisting of a set of perceptually clustered landmarks. Patient studies have demonstrated that these cognitive maps are maintained by the hippocampus, while the neural dynamics are still poorly understood. The authors have shown that the neural dynamic "theta phase precession" observed in the rodent hippocampus may be capable of forming hierarchical cognitive maps in humans. In the model, a visual input sequence consisting of object and scene features in the central and peripheral visual fields, respectively, results in the formation of a hierarchical cognitive map for object-place associations. Surprisingly, it is possible for such a complex memory structure to be formed in a few seconds. In this paper, we evaluate the memory retrieval of object-place associations in the hierarchical network formed by theta phase precession. The results show that multiple object-place associations can be retrieved with the initial cue of a scene input. Importantly, according to the wide-to-narrow unidirectional connections among scene units, the spatial area for object-place retrieval can be controlled by the spatial area of the initial cue input. These results indicate that the hierarchical cognitive maps have computational advantages on a spatial-area selective retrieval of multiple object-place associations. Theta phase precession dynamics is suggested as a fundamental neural mechanism of the human cognitive map.

Hippocampal network dynamics constrain the time lag between pyramidal cells across modified environments

The hippocampus provides a spatial map of the environment. Changes in the environment alter the firing patterns of hippocampal neurons, but are presumably constrained by elements of the network dynamics. We compared the neural activity in CA1 and CA3 regions of the hippocampus in rats running for water reward on a linear track, before and after the track length was shortened. A fraction of cells lost their place fields and new sets of cells with fields emerged, indicating distinct representation of the two tracks. Cells active in both environments shifted their place fields in a location-dependent manner, most notably at the beginning and the end of the track. Furthermore, peak firing rates and place-field sizes decreased, whereas place-field overlap and coactivity increased. Power in the theta-frequency band of the local field potentials also decreased in both CA1 and CA3, along with the coherence between the two structures. In contrast, the theta-scale (0-150 ms) time lags between cell pairs, representing distances on the tracks, were conserved, and the activity of the inhibitory neuron population was maintained across environments. We interpret these observations as reflecting the freedoms and constraints of the hippocampal network dynamics. The freedoms permit the necessary flexibility for the network to distinctly represent unique patterns, whereas the dynamics constrain the speed at which activity propagates between the cell assemblies representing the patterns.

A unified view of theta-phase coding in the entorhinal–hippocampal system

The discovery of theta-rhythm-dependent firing of rodent hippocampal neurons highlighted the functional significance of temporal encoding in hippocampal memory. However, earlier theoretical studies on this topic seem divergent and experimental implications are invariably complicated. To obtain a unified understanding of neural dynamics in the hippocampal memory, we here review recent developments in computational models and experimental discoveries on the 'theta-phase precession' of hippocampal place cells and entorhinal grid cells. We identify a theoretical hypothesis that is well supported by experimental facts; this model reveals a significant contribution of theta-phase coding to the on-line real-time operation of episodic events, through highly parallel representation of spatiotemporal information.

Neural dynamics of the cognitive map in the hippocampus

The rodent hippocampus has been thought to represent the spatial environment as a cognitive map. In the classical theory, the cognitive map has been explained as a consequence of the fact that different spatial regions are assigned to different cell populations in the framework of rate coding. Recently, the relation between place cell firing and local field oscillation theta in terms of theta phase precession was experimentally discovered and suggested as a temporal coding mechanism leading to memory formation of behavioral sequences accompanied with asymmetric Hebbian plasticity. The cognitive map theory is apparently outside of the sequence memory view. Therefore, theoretical analysis is necessary to consider the biological neural dynamics for the sequence encoding of the memory of behavioral sequences, providing the cognitive map formation. In this article, we summarize the theoretical neural dynamics of the real-time sequence encoding by theta phase precession, called theta phase coding, and review a series of theoretical models with the theta phase coding that we previously reported. With respect to memory encoding functions, instantaneous memory formation of one-time experience was first demonstrated, and then the ability of integration of memories of behavioral sequences into a network of the cognitive map was shown. In terms of memory retrieval functions, theta phase coding enables the hippocampus to represent the spatial location in the current behavioral context even with ambiguous sensory input when multiple sequences were coded. Finally, for utilization, retrieved temporal sequences in the hippocampus can be available for action selection, through the process of reverting theta rhythm-dependent activities to information in the behavioral time scale. This theoretical approach allows us to investigate how the behavioral sequences are encoded, updated, retrieved and used in the hippocampus, as the real-time interaction with the external environment. It may indeed be the bridge to the episodic memory function in human hippocampus.

Reactivation of behavioral activity during sharp waves: A computational model for two stage hippocampal dynamics

The rodent hippocampus is known to exhibit two very distinctive patterns of activity: theta with place selective cells firing during exploratory behavior and sharp waves (SPWs) associated with collective discharges in the CA3 during slow wave sleep (SWS), inactivity while awake and consummatory behavior. A great deal of evidence has demonstrated that the cells activated during SPWs events are representative of previous behavioral activity, which suggests an important functional role of off-line learning and consolidation for these SPWs events. Supporting this view, forward, and more recently, reverse replay of linear track behavioral sequences have been reported in rodent's hippocampal place cells during SPWs. We demonstrate here that these patterns of reactivation can be successfully reproduced by relying on a computational model of the hippocampus with theta phase precession and synaptic plasticity during theta rhythm. Two mechanisms are proposed to initiate SPWs events: random reactivation in the presence of rapid, irregular subthreshold inputs and place selective cell activations. In 2D navigation computational experiments, rather than observing the perfect replay of experienced pathways, new pathways "experienced during immobility" emerge. This suggests a neural mechanism for shortcut navigation.

Conserving total synaptic weight ensures one-trial sequence learning of place fields in the hippocampus

The hippocampus plays a critical role in the rapid acquisition of information from a novel experience. Recent theoretical studies on the rat hippocampus have shown the possibility of behavioral sequence learning in a single traversal experience by theta phase coding. Specifically, previous work using computer simulations demonstrated that the extent of overlap among individual events of sequence and rat running velocity should be quantitatively incorporated into the learning rule to ensure one-trial sequence learning. These extents of overlap- and running velocity-dependent properties in the learning rule are called the input-dependent regulation of the learning rule. However, the biological meaning of such learning properties remains poorly understood. In this study, we quantitatively derive these learning properties with mathematical analyses. We further find that the input-dependent regulation of the learning rule allows maintenance of total synaptic weight over a given neuron during one-trial learning. Our results predict that a homeostatic plasticity mechanism should exist for conserving total synaptic weight on a rapid timescale.

Online formation of a hierarchical cognitive map for object-place association by theta phase coding

Object-place associative memory, the storage of object and place conjunctions based on a one-time experience, is hippocampal-dependent in humans. Theta phase precession, a type of neural dynamics observed in the rat hippocampus, has recently been suggested to serve a role in instantaneous memory formation based on a one-time experience, while its functional role in associating distinct types of information (object and place information) is unclear. In this study, we hypothesize that theta phase encoding with theta phase precession contributes to the storage of object-place associations. To examine this hypothesis, we propose a neural network model of the corticohippocampal system, including central-peripheral visual pathways and theta phase coding in the hippocampus. Memory storage computer experiments demonstrate that the hippocampal network successfully stores the object-place associations of a one-time experience. Interestingly, it is also found that a random visual input sequence results in a robust formation of asymmetric connections between objects and scenes instantaneously after a single trial. Furthermore, it is found that scene-object connections and scene-scene connections form a hierarchical network representing the spatial alignment of scenes and objects in the environment. Our findings indicate that the theta phase coding, as observed in the rat hippocampus, can facilitate the online memory storage of complex environments in humans as a hierarchical cognitive map.