Integrating behavioral and physiological models of hippocampal function

Motivated exploratory behaviour in the rat: The role of hippocampus and the histaminergic neurotransmission

Exploration is one of most basic adaptive behavioural responses, giving the animal an important evolutionary advantage to survive in a changing environment. Inspection of novel environments might be come with motivated exploratory behaviour. In spite that this type of exploration in the rat is known for many years, little attention has been given to the intrinsic mechanisms or the brain structures that are involved in. In the present work the hippocampus, the neurotransmitter histamine, and the geometrical features of novel objects were examined in a model of conflictive and non-conflictive exploration in the rat which evaluates incentive-motivated exploration. Young adult intact rats were tested in a neutral non-conflictive behavioural activity detector (OVM), with (eOVM) or without (sOVM) novel objects. Three different objects were used: a box, a toy duck, and a tower. Results show that animals decrease its general motor activity (horizontal, ambulatory and non-ambulatory activity) in favor to exploration of the objects. Motivated exploration was not the same for all three objects. Rats explored significantly more the Tower and the Box objects than the Duck item. Behavioral patterns of hippocampus-implanted rats showed decreased scores in motor activity but maintained the difference in the relation of "without/with objects" exploration. When hippocampus-implanted rats were tested in a conflictive exploration device (the elevated asymmetric plus-maze), exploration of the No Wall arm, considered the most fear-inducing environment, was significantly more explored by the animal when the tower object was positioned at its end than when it was absent. Microinjection into the ventral hippocampus of histamine abolished this motivated exploratory response. Pre-treatment with pyrilamine, and not with ranitidine, was effective to block the inhibitory effect of histamine on the object motivated exploration. Results confirm that the hippocampus is involved on incentive motivated exploration, and suggest that histamine is part of an analyzing neuronal circuit of novelty incentivating behavioural responses in rats.

Context learning in the rodent hippocampus

We present a Bayesian statistical theory of context learning in the rodent hippocampus. While context is often defined in an experimental setting in relation to specific background cues or task demands, we advance a single, more general notion of context that suffices for a variety of learning phenomena. Specifically, a context is defined as a statistically stationary distribution of experiences, and context learning is defined as the problem of how to form contexts out of groups of experiences that cluster together in time. The challenge of context learning is solving the model selection problem: How many contexts make up the rodent's world? Solving this problem requires balancing two opposing goals: minimize the variability of the distribution of experiences within a context and minimize the likelihood of transitioning between contexts. The theory provides an understanding of why hippocampal place cell remapping sometimes develops gradually over many days of experience and why even consistent landmark differences may need to be relearned after other environmental changes. The theory provides an explanation for progressive performance improvements in serial reversal learning, based on a clear dissociation between the incremental process of context learning and the relatively abrupt context selection process. The impact of partial reinforcement on reversal learning is also addressed. Finally, the theory explains why alternating sequence learning does not consistently result in unique context-dependent sequence representations in hippocampus.

Network modeling of adult neurogenesis: shifting rates of neuronal turnover optimally gears network learning according to novelty gradient

Apoptotic and neurogenic events in the adult hippocampus are hypothesized to play a role in cognitive responses to new contexts. Corticosteroid-mediated stress responses and other neural processes invoked by substantially novel contextual changes may regulate these processes. Using elementary three-layer neural networks that learn by incremental synaptic plasticity, we explored whether the cognitive effects of differential regimens of neuronal turnover depend on the environmental context in terms of the degree of novelty in the new information to be learned. In "adult" networks that had achieved mature synaptic connectivity upon prior learning of the Roman alphabet, imposition of apoptosis/neurogenesis before learning increasingly novel information (alternate Roman < Russian < Hebrew) reveals optimality of informatic cost benefits when rates of turnover are geared in proportion to the degree of novelty. These findings predict that flexible control of rates of apoptosis-neurogenesis within plastic, mature neural systems optimizes learning attributes under varying degrees of contextual change, and that failures in this regulation may define a role for adult hippocampal neurogenesis in novelty- and stress-responsive psychiatric disorders.

Cortico-hippocampal interaction and adaptive stimulus representation: a neurocomputational theory of associative learning and memory

Computational models of the hippocampal region link psychological theories of associative learning with their underlying physiological and anatomical substrates. Our approach to theory development began with a broad description of the computations that depend on the hippocampal region in classical conditioning (Gluck and Myers, 1993 and Gluck and Myers, 2001). In this initial model, the hippocampal region was treated as an Information-processing system that transformed stimulus representations, compressing (making more similar) representations of inputs that co-occur or are otherwise redundant, while differentiating (or making less similar) representations of inputs that predict different future events. This model led to novel predictions for the behavioral consequences of hippocampal-region lesions in rodents and of brain damage in humans who have amnesia or are in the earliest stages of Alzheimer's disease. Many of these predictions have, since been confirmed by our lab and others. Functional brain imaging studies have provided further supporting evidence. In more recent computational modeling, we have shown how some aspects of this proposed information-processing function could emerge from known anatomical and physiological characteristics of the hippocampal region, including the entorhinal cortex and the septo-hippocampal cholinergic system. The modeling to date lays the groundwork for future directions that increase the depth of detail of the biological modeling, as well as the breadth of behavioral phenomena addressed. In particular, we are working now to reconcile these kinds of incremental associative learning models with other models of the hippocampal region that account for the rapid formation of declarative memories.

Hippocampal dampening during a relational memory task

The hippocampus (HPC) has an essential role in relational memory. One task used to test relational memory is the transverse patterning (TP) problem (A+ B-, B+ C-, and C+ A-), which is sensitive to HPC damage across species. Using functional magnetic resonance imaging in humans, the authors observed activation maps and time course data indicating that the HPC is involved in this task, but it is paradoxically less active during the hippocampal-dependent relational memory phase relative to both a hippocampal-independent control memory phase and to a fixation control phase. This suggests that traditional assumptions suggesting that brain regions critical for a task must produce an increased blood oxygen level-dependent response during performance of that task are probably inaccurate and alternative explanations should be entertained.

Simulated apoptosis/neurogenesis regulates learning and memory capabilities of adaptive neural networks

Characterization of neuronal death and neurogenesis in the adult brain of birds, humans, and other mammals raises the possibility that neuronal turnover represents a special form of neuroplasticity associated with stress responses, cognition, and the pathophysiology and treatment of psychiatric disorders. Multilayer neural network models capable of learning alphabetic character representations via incremental synaptic connection strength changes were used to assess additional learning and memory effects incurred by simulation of coordinated apoptotic and neurogenic events in the middle layer. Using a consistent incremental learning capability across all neurons and experimental conditions, increasing the number of middle layer neurons undergoing turnover increased network learning capacity for new information, and increased forgetting of old information. Simulations also showed that specific patterns of neural turnover based on individual neuronal connection characteristics, or the temporal-spatial pattern of neurons chosen for turnover during new learning impacts new learning performance. These simulations predict that apoptotic and neurogenic events could act together to produce specific learning and memory effects beyond those provided by ongoing mechanisms of connection plasticity in neuronal populations. Regulation of rates as well as patterns of neuronal turnover may serve an important function in tuning the informatic properties of plastic networks according to novel informational demands. Analogous regulation in the hippocampus may provide for adaptive cognitive and emotional responses to novel and stressful contexts, or operate suboptimally as a basis for psychiatric disorders. The implications of these elementary simulations for future biological and neural modeling research on apoptosis and neurogenesis are discussed.

Neuroengineering models of brain disease

The techniques of computational simulation have begun to be applied to modeling neurological disease and mental illness. Such neuroengineering models provide a conceptual bridge between molecular/cellular pathology and cognitive performance. We consider models of Alzheimer's disease, Parkinson's disease, and schizophrenia. Each of these diseases involves a disorder of neuromodulation coupled with underlying neuronal pathology. Parallels arising between these models suggests that a common set of computational mechanisms may account for functional loss across a spectrum of brain diseases. In particular, we focus on attractor-based network dynamics and how they arise from neural architectures, on mechanisms for linking sequences of attractor states and their role in cognition, and on the role of neuromodulation in controlling these processes. These studies suggest new approaches to understanding the forebrain circuits underlying cognition, and point toward a new tool for dissecting the pathophysiology of brain disease.

A model of hippocampal activity in trace conditioning: where's the trace?

The hippocampus is generally thought to play a modulating role in the timing of conditioned responses in classical trace conditioning. One hypothesis is that the hippocampus stores a memory trace of the conditioned stimulus (CS) during the stimulus-free period. Cellular recordings, however, do not show any obvious CS storage. This article examines this issue by using a biologically plausible model of the CA3 region of the hippocampus. Simulations of the model reproduce both behavioral and physiological experimental data. On the basis of neural codes that develop in the model, the authors hypothesize that the hippocampus functions as a time-indexed encoding device for the CS and not as a CS storage buffer. Specifically, the CS initiates a sequence of neural activity during the trace interval that only indirectly represents the CS. The model yields 2 predictions: Some cells will increase in activity only during the trace interval, and some unconditioned stimulus (US)-coding cells will shift in time and fire before US onset.

Memory for events and their spatial context: models and experiments

The computational role of the hippocampus in memory has been characterized as: (i) an index to disparate neocortical storage sites; (ii) a time-limited store supporting neocortical long-term memory; and (iii) a content-addressable associative memory. These ideas are reviewed and related to several general aspects of episodic memory, including the differences between episodic, recognition and semantic memory, and whether hippocampal lesions differentially affect recent or remote memories. Some outstanding questions remain, such as: what characterizes episodic retrieval as opposed to other forms of read-out from memory; what triggers the storage of an event memory; and what are the neural mechanisms involved? To address these questions a neural-level model of the medial temporal and parietal roles in retrieval of the spatial context of an event is presented. This model combines the idea that retrieval of the rich context of real-life events is a central characteristic of episodic memory, and the idea that medial temporal allocentric representations are used in long-term storage while parietal egocentric representations are used to imagine, manipulate and re-experience the products of retrieval. The model is consistent with the known neural representation of spatial information in the brain, and provides an explanation for the involvement of Papez's circuit in both the representation of heading direction and in the recollection of episodic information. Two experiments relating to the model are briefly described. A functional neuroimaging study of memory for the spatial context of life-like events in virtual reality provides support for the model's functional localization. A neuropsychological experiment suggests that the hippocampus does store an allocentric representation of spatial locations.

Parametric fMRI analysis of visual encoding in the human medial temporal lobe

A number of functional brain imaging studies indicate that the medial temporal lobe system is crucially involved in encoding new information into memory. However, most studies were based on differences in brain activity between encoding of familiar vs. novel stimuli. To further study the underlying cognitive processes, we applied a parametric design of encoding. Seven healthy subjects were instructed to encode complex color pictures into memory. Stimuli were presented in a parametric fashion at different rates, thus representing different loads of encoding. Functional magnetic resonance imaging (fMRI) was used to assess changes in brain activation. To determine the number of pictures successfully stored into memory, recognition scores were determined afterwards. During encoding, brain activation occurred in the medial temporal lobe, comparable to the results obtained by others. Increasing the encoding load resulted in an increase in the number of successfully stored items. This was reflected in a significant increase in brain activation in the left lingual gyrus, in the left and right parahippocampal gyrus, and in the right inferior frontal gyrus. This study shows that fMRI can detect changes in brain activation during variation of one aspect of higher cognitive tasks. Further, it strongly supports the notion that the human medial temporal lobe is involved in encoding novel visual information into memory.

Eyeblink classical conditioning: hippocampal formation is for neutral stimulus associations as cerebellum is for association-response

Extensive evidence has been amassed that the cerebellum, hippocampus, and associated circuitry are activated during classical conditioning of the nictitating membrane/eyeblink response. In this article, the authors argue that the cerebellum is essential to all eyeblink classical conditioning paradigms. In addition, the septohippocampal system plays a critical role when the classical conditioning paradigm requires the formation of associations in addition to the simple association between the conditioned and unconditioned stimuli. When only a simple conditioned stimulus--unconditioned stimulus association is needed, the septohippocampal system has a more limited, modulatory role. The neutral stimulus association versus simple association-response distinction is one of the ways in which declarative or relational memory can be separated from nondeclarative or nonrelational memory in classical conditioning paradigms.

Considerations arising from a complementary learning systems perspective on hippocampus and neocortex

We discuss a framework for the organization of learning systems in the mammalian brain, in which the hippocampus and related areas form a memory system complementary to learning mechanisms in neocortex and other areas. The hippocampal system stores new episodes and "replays" them to the neocortical system, interleaved with ongoing experience, allowing generalization as cortical memories form. The data to account for include: 1) neurophysiological findings concerning representations in hippocampal areas, 2) behavioral evidence demonstrating a spatial role for hippocampus, 3) and effects of surgical and pharmacological manipulations on neuronal firing in hippocampal regions in behaving animals. We hypothesize that the hippocampal memory system consists of three major modules: 1) an invertible encoder subsystem supported by the pathways between neocortex and entorhinal cortex, which provides a stable, compressed, invertible encoding in entorhinal cortex (EC) of cortical activity patterns, 2) a memory separation, storage, and retrieval subsystem, supported by pathways between EC, dentate gyrus and area CA3, including the CA3 recurrent collaterals, which facilitates encoding and storage in CA3 of individual EC patterns, and retrieval of those CA3 encodings, in a manner that minimizes interference, and 3) a memory decoding subsystem, supported by the Shaffer collaterals from area CA1 to area CA3 and the bi-directional pathways between EC and CA3, which provides the means by which a retrieved CA3 coding of an EC pattern can reinstate that pattern on EC. This model has shown that 1) there is a trade-off between the need for information-preserving, structure-extracting encoding of cortical traces and the need for effective storage and recall of arbitrary traces, 2) long-term depression of synaptic strength in the pathways subject to long-term potentiation is crucial in preserving information, 3) area CA1 must be able to exploit correlations in EC patterns in the direct perforant path synapses.

Encoding and retrieval of episodic memories: role of cholinergic and GABAergic modulation in the hippocampus

This research focuses on linking episodic memory function to the cellular physiology of hippocampal neurons, with a particular emphasis on modulatory effects at cholinergic and gamma-aminobutyric acid B receptors. Drugs which block acetylcholine receptors (e.g., scopolamine) have been shown to impair encoding of new information in humans, nonhuman primates, and rodents. Extensive data have been gathered about the cellular effects of acetylcholine in the hippocampus. In this research, models of individual hippocampal subregions have been utilized to understand the significance of particular features of modulation, and these hippocampal subregions have been combined in a network simulation which can replicate the selective encoding impairment produced by scopolamine in human subjects.