Hippocampal ripple-contingent training accelerates trace eyeblink conditioning and retards extinction in rabbits

Prefrontal neuronal ensembles link prior knowledge with novel actions during flexible action selection

We make decisions based on currently perceivable information or an internal model of the environment. The medial prefrontal cortex (mPFC) and its interaction with the hippocampus have been implicated in the latter, model-based decision-making; however, the underlying computational properties remain incompletely understood. We have examined mPFC spiking and hippocampal oscillatory activity while rats flexibly select new actions using a known associative structure of environmental cues and outcomes. During action selection, the mPFC reinstates representations of the associative structure. These awake reactivation events are accompanied by synchronous firings among neurons coding the associative structure and those coding actions. Moreover, their functional coupling is strengthened upon the reactivation events leading to adaptive actions. In contrast, only cue-coding neurons improve functional coupling during hippocampal sharp wave ripples. Thus, the lack of direct experience disconnects the mPFC from the hippocampus to independently form self-organized neuronal ensemble dynamics linking prior knowledge with novel actions.

CA3-CA1 long-term potentiation occurs regardless of respiration and cardiac cycle phases in urethane-anesthetized rats

Breathing and heartbeat synchronize to each other and to brain function and affect cognition in humans. However, it is not clear how cardiorespiratory rhythms modulate such basic processes as synaptic plasticity thought to underlie learning. Thus, we studied if respiration and cardiac cycle phases at burst stimulation onset affect hippocampal long-term potentiation (LTP) in the CA3-CA1 synapse in urethane-anesthetized adult male Sprague-Dawley rats. In a between-subjects design, we timed burst stimulation of the ventral hippocampal commissure (vHC) to systole or diastole either during expiration or inspiration and recorded responses throughout the hippocampus with a linear probe. As classical conditioning in humans seems to be most efficient at expiration-diastole, we also expected LTP to be most efficient if burst stimulation was targeted to expiration-diastole. However, LTP was induced equally in all four groups and respiration and cardiac cycle phase did not modulate CA1 responses to vHC stimulation overall. This could be perhaps because we bypassed all natural routes of external influences on the CA1 by directly stimulating the vHC. In the future, the effect of cardiorespiratory rhythms on synaptic plasticity could also be studied in awake state and in other parts of the hippocampal tri-synaptic loop.

Imagination as a fundamental function of the hippocampus

Imagination is a biological function that is vital to human experience and advanced cognition. Despite this importance, it remains unknown how imagination is realized in the brain. Substantial research focusing on the hippocampus, a brain structure traditionally linked to memory, indicates that firing patterns in spatially tuned neurons can represent previous and upcoming paths in space. This work has generally been interpreted under standard views that the hippocampus implements cognitive abilities primarily related to actual experience, whether in the past (e.g. recollection, consolidation), present (e.g. spatial mapping) or future (e.g. planning). However, relatively recent findings in rodents identify robust patterns of hippocampal firing corresponding to a variety of alternatives to actual experience, in many cases without overt reference to the past, present or future. Given these findings, and others on hippocampal contributions to human imagination, we suggest that a fundamental function of the hippocampus is to generate a wealth of hypothetical experiences and thoughts. Under this view, traditional accounts of hippocampal function in episodic memory and spatial navigation can be understood as particular applications of a more general system for imagination. This view also suggests that the hippocampus contributes to a wider range of cognitive abilities than previously thought. This article is part of the theme issue 'Thinking about possibilities: mechanisms, ontogeny, functions and phylogeny'.

-Cardiac cycle and respiration phase affect responses to the conditioned stimulus in young adults trained in trace eyeblink conditioning

Rhythms of breathing and heartbeat are linked to each other as well as to rhythms of the brain. Our recent studies suggest that presenting the conditioned stimulus during expiration or during the diastolic phase of the cardiac cycle facilitates neural processing of that stimulus and improves learning an eyeblink classical conditioning task. To date, it has not been examined whether utilizing information from both respiration and cardiac cycle phases simultaneously allows even more efficient modulation of learning. Here we studied whether the timing of the conditioned stimulus to different cardiorespiratory rhythm phase combinations affects learning trace eyeblink conditioning in healthy young adults. The results were consistent with previous reports: Timing the conditioned stimulus to diastole during expiration was more beneficial for learning than timing it to systole during inspiration. Cardiac cycle phase seemed to explain most of this variation in learning at the behavioral level. Brain evoked potentials (N1) elicited by the conditioned stimulus and recorded using electroencephalogram were larger when the conditioned stimulus was presented to diastole during expiration than when it was presented to systole during inspiration. Breathing phase explained the variation in the N1 amplitude. To conclude, our findings suggest that non-invasive monitoring of bodily rhythms combined with closed-loop control of stimulation can be used to promote learning in humans. The next step will be to test if performance can also be improved in humans with compromised cognitive ability, such as in older people with memory impairments.

Hippocampal Interneurons are Required for Trace Eyeblink Conditioning in Mice

While the hippocampus has been implicated in supporting the association among time-separated events, the underlying cellular mechanisms have not been fully clarified. Here, we combined in vivo multi-channel recording and optogenetics to investigate the activity of hippocampal interneurons in freely-moving mice performing a trace eyeblink conditioning (tEBC) task. We found that the hippocampal interneurons exhibited conditioned stimulus (CS)-evoked sustained activity, which predicted the performance of conditioned eyeblink responses (CRs) in the early acquisition of the tEBC. Consistent with this, greater proportions of hippocampal pyramidal cells showed CS-evoked decreased activity in the early acquisition of the tEBC. Moreover, optogenetic suppression of the sustained activity in hippocampal interneurons severely impaired acquisition of the tEBC. In contrast, suppression of the sustained activity of hippocampal interneurons had no effect on the performance of well-learned CRs. Our findings highlight the role of hippocampal interneurons in the tEBC, and point to a potential cellular mechanism subserving associative learning.

Dark control: The default mode network as a reinforcement learning agent

The default mode network (DMN) is believed to subserve the baseline mental activity in humans. Its higher energy consumption compared to other brain networks and its intimate coupling with conscious awareness are both pointing to an unknown overarching function. Many research streams speak in favor of an evolutionarily adaptive role in envisioning experience to anticipate the future. In the present work, we propose a process model that tries to explain how the DMN may implement continuous evaluation and prediction of the environment to guide behavior. The main purpose of DMN activity, we argue, may be described by Markov decision processes that optimize action policies via value estimates through vicarious trial and error. Our formal perspective on DMN function naturally accommodates as special cases previous interpretations based on (a) predictive coding, (b) semantic associations, and (c) a sentinel role. Moreover, this process model for the neural optimization of complex behavior in the DMN offers parsimonious explanations for recent experimental findings in animals and humans.

The hippocampal sharp wave-ripple in memory retrieval for immediate use and consolidation

Various cognitive functions have long been known to require the hippocampus. Recently, progress has been made in identifying the hippocampal neural activity patterns that implement these functions. One such pattern is the sharp wave-ripple (SWR), an event associated with highly synchronous neural firing in the hippocampus and modulation of neural activity in distributed brain regions. Hippocampal spiking during SWRs can represent past or potential future experience, and SWR-related interventions can alter subsequent memory performance. These findings and others suggest that SWRs support both memory consolidation and memory retrieval for processes such as decision-making. In addition, studies have identified distinct types of SWR based on representational content, behavioural state and physiological features. These various findings regarding SWRs suggest that different SWR types correspond to different cognitive functions, such as retrieval and consolidation. Here, we introduce another possibility - that a single SWR may support more than one cognitive function. Taking into account classic psychological theories and recent molecular results that suggest that retrieval and consolidation share mechanisms, we propose that the SWR mediates the retrieval of stored representations that can be utilized immediately by downstream circuits in decision-making, planning, recollection and/or imagination while simultaneously initiating memory consolidation processes.

Real-time classification of experience-related ensemble spiking patterns for closed-loop applications

Communication in neural circuits across the cortex is thought to be mediated by spontaneous temporally organized patterns of population activity lasting ~50 –200 ms. Closed-loop manipulations have the unique power to reveal direct and causal links between such patterns and their contribution to cognition. Current brain–computer interfaces, however, are not designed to interpret multi-neuronal spiking patterns at the millisecond timescale. To bridge this gap, we developed a system for classifying ensemble patterns in a closed-loop setting and demonstrated its application in the online identification of hippocampal neuronal replay sequences in the rat. Our system decodes multi-neuronal patterns at 10 ms resolution, identifies within 50 ms experience-related patterns with over 70% sensitivity and specificity, and classifies their content with 95% accuracy. This technology scales to high-count electrode arrays and will help to shed new light on the contribution of internally generated neural activity to coordinated neural assembly interactions and cognition.

Age Is Associated with Reduced Sharp-Wave Ripple Frequency and Altered Patterns of Neuronal Variability

Spatial and episodic memory performance declines with age, and the neural basis for this decline is not well understood. Sharp-wave ripples are brief (∼70 ms) high-frequency oscillatory events generated in the hippocampus and are associated with the consolidation of spatial memories. Given the connection between ripple oscillations and memory consolidation, we investigated whether the structure of ripple oscillations and ripple-triggered patterns of single-unit activity are altered in aged rats. Local field and single-unit activity surrounding sharp-wave ripple events were examined in the CA1 region of the hippocampus of old (n = 5) and young (n = 6) F344 rats during periods of rest preceding and following performance on a place-dependent eyeblink-conditioning task. Neural responses in aged rats differed from responses in young rats in several ways. First, compared with young rats, the rate of ripple occurrence (ripple density) is reduced in aged rats during postbehavior rest. Second, mean ripple frequency during prebehavior and postbehavior rest is lower in aged animals (aged: 132 Hz; young: 146 Hz). Third, single neurons in aged animals responded more consistently from ripple to ripple. Fourth, variability in interspike intervals was greater in aged rats. Finally, neurons were tuned to a narrower range of phases of the ripple oscillation relative to young animals. Together, these results suggest that the CA1 network in aged animals has a reduced "vocabulary" of available representational states.

SIGNIFICANCE STATEMENT

The hippocampus is a structure that is critical for the formation of episodic memories. Sharp-wave ripple events generated in the hippocampus have been implicated in memory consolidation processes critical to memory stabilization. We examine here whether these ripple oscillations are altered over the course of the life span, which could contribute to hippocampus-dependent memory deficits that occur during aging. This experiment used young and aged memory-impaired rats to examine age-related changes in ripple architecture, ripple-triggered spike variance, and spike-phase coherence. We found that there are, indeed, significant changes in characteristics of ripples in older animals that could impact consolidation processes and memory stabilization in the aged brain.

Spatial tuning and brain state account for dorsal hippocampal CA1 activity in a non-spatial learning task

The hippocampus is a brain area crucial for episodic memory in humans. In contrast, studies in rodents have highlighted its role in spatial learning, supported by the discovery of place cells. Efforts to reconcile these views have found neurons in the rodent hippocampus that respond to non-spatial events but have not unequivocally dissociated the spatial and non-spatial influences on these cells. To disentangle these influences, we trained freely moving rats in trace eyeblink conditioning, a hippocampally dependent task in which the animal learns to blink in response to a tone. We show that dorsal CA1 pyramidal neurons are all place cells, and do not respond to the tone when the animal is moving. When the animal is inactive, the apparent tone-evoked responses reflect an arousal-mediated resumption of place-specific firing. These results suggest that one of the main output stages of the hippocampus transmits only spatial information, even in this non-spatial task.

DOI:http://dx.doi.org/10.7554/eLife.14321.001

Hippocampal Non-Theta-Contingent Eyeblink Classical Conditioning: A Model System for Neurobiological Dysfunction

Typical information processing is thought to depend on the integrity of neurobiological oscillations that may underlie coordination and timing of cells and assemblies within and between structures. The 3-7 Hz bandwidth of hippocampal theta rhythm is associated with cognitive processes essential to learning and depends on the integrity of cholinergic, GABAergic, and glutamatergic forebrain systems. Since several significant psychiatric disorders appear to result from dysfunction of medial temporal lobe (MTL) neurochemical systems, preclinical studies on animal models may be an important step in defining and treating such syndromes. Many studies have shown that the amount of hippocampal theta in the rabbit strongly predicts the acquisition rate of classical eyeblink conditioning and that impairment of this system substantially slows the rate of learning and attainment of asymptotic performance. Our lab has developed a brain-computer interface that makes eyeblink training trials contingent upon the explicit presence or absence of hippocampal theta. The behavioral benefit of theta-contingent training has been demonstrated in both delay and trace forms of the paradigm with a two- to fourfold increase in learning speed over non-theta states. The non-theta behavioral impairment is accompanied by disruption of the amplitude and synchrony of hippocampal local field potentials, multiple-unit excitation, and single-unit response patterns dependent on theta state. Our findings indicate a significant electrophysiological and behavioral impact of the pretrial state of the hippocampus that suggests an important role for this MTL system in associative learning and a significant deleterious impact in the absence of theta. Here, we focus on the impairments in the non-theta state, integrate them into current models of psychiatric disorders, and suggest how improvement in our understanding of neurobiological oscillations is critical for theories and treatment of psychiatric pathology.

Hippocampal sharp wave-ripple: A cognitive biomarker for episodic memory and planning

Sharp wave ripples (SPW-Rs) represent the most synchronous population pattern in the mammalian brain. Their excitatory output affects a wide area of the cortex and several subcortical nuclei. SPW-Rs occur during "off-line" states of the brain, associated with consummatory behaviors and non-REM sleep, and are influenced by numerous neurotransmitters and neuromodulators. They arise from the excitatory recurrent system of the CA3 region and the SPW-induced excitation brings about a fast network oscillation (ripple) in CA1. The spike content of SPW-Rs is temporally and spatially coordinated by a consortium of interneurons to replay fragments of waking neuronal sequences in a compressed format. SPW-Rs assist in transferring this compressed hippocampal representation to distributed circuits to support memory consolidation; selective disruption of SPW-Rs interferes with memory. Recently acquired and pre-existing information are combined during SPW-R replay to influence decisions, plan actions and, potentially, allow for creative thoughts. In addition to the widely studied contribution to memory, SPW-Rs may also affect endocrine function via activation of hypothalamic circuits. Alteration of the physiological mechanisms supporting SPW-Rs leads to their pathological conversion, "p-ripples," which are a marker of epileptogenic tissue and can be observed in rodent models of schizophrenia and Alzheimer's Disease. Mechanisms for SPW-R genesis and function are discussed in this review.

Real time algorithms for sharp wave ripple detection

Neural activity during sharp wave ripples (SWR), short bursts of co-ordinated oscillatory activity in the CA1 region of the rodent hippocampus, is implicated in a variety of memory functions from consolidation to recall. Detection of these events in an algorithmic framework, has thus far relied on simple thresholding techniques with heuristically derived parameters. This study is an investigation into testing and improving the current methods for detection of SWR events in neural recordings. We propose and profile methods to reduce latency in ripple detection. Proposed algorithms are tested on simulated ripple data. The findings show that simple realtime algorithms can improve upon existing power thresholding methods and can detect ripple activity with latencies in the range of 10-20 ms.

Phase matters: responding to and learning about peripheral stimuli depends on hippocampal θ phase at stimulus onset

Hippocampal θ (3-12 Hz) oscillations are implicated in learning and memory, but their functional role remains unclear. We studied the effect of the phase of local θ oscillation on hippocampal responses to a neutral conditioned stimulus (CS) and subsequent learning of classical trace eyeblink conditioning in adult rabbits. High-amplitude, regular hippocampal θ-band responses (that predict good learning) were elicited by the CS when it was timed to commence at the fissure θ trough (Trough group). Regardless, learning in this group was not enhanced compared with a yoked control group, possibly due to a ceiling effect. However, when the CS was consistently presented to the peak of θ (Peak group), hippocampal θ-band responding was less organized and learning was retarded. In well-trained animals, the hippocampal θ phase at CS onset no longer affected performance of the learned response, suggesting a time-limited role for hippocampal processing in learning. To our knowledge, this is the first study to demonstrate that timing a peripheral stimulus to a specific phase of the hippocampal θ cycle produces robust effects on the synchronization of neural responses and affects learning at the behavioral level. Our results support the notion that the phase of spontaneous hippocampal θ oscillation is a means of regulating the processing of information in the brain to a behaviorally relevant degree.

Scaling brain size, keeping timing: evolutionary preservation of brain rhythms

Despite the several-thousand-fold increase of brain volume during the course of mammalian evolution, the hierarchy of brain oscillations remains remarkably preserved, allowing for multiple-time-scale communication within and across neuronal networks at approximately the same speed, irrespective of brain size. Deployment of large-diameter axons of long-range neurons could be a key factor in the preserved time management in growing brains. We discuss the consequences of such preserved network constellation in mental disease, drug discovery, and interventional therapies.

Phase-locked hippocampal theta-band responses are related to discriminative eyeblink conditioned responding

Hippocampal electrophysiological oscillatory activity is undoubtedly related to learning and memory. The relative power of spontaneously occurring hippocampal theta (∼4-8 Hz) oscillations predicts how fast and how well an animal will learn: more theta predicts faster acquisition of the conditioned response in eyeblink conditioning in both rats and rabbits. Here, our aim was to study how hippocampal theta-band responses to conditioned stimuli elicited during very-long delay discrimination eyeblink conditioning relate to the accompanying conditioned behavior. We trained adult male New Zealand White rabbits using 1500-ms auditory stimuli as conditioned stimuli and a 100-ms airpuff as an unconditioned stimulus. The reinforced conditioned stimulus overlapped and co-terminated with the unconditioned stimulus whereas the non-reinforced conditioned stimulus was always presented alone. Consistent with previous results, hippocampal theta-band responses to the conditioned stimuli diminished in amplitude across training. Interestingly, hippocampal theta-band responses were most consistently time-locked when a well-trained animal failed to suppress behavioral learned responses to the non-reinforced conditioned stimulus. We suggest that phase-locking of hippocampal theta-band oscillations in response to external stimuli reflects retrieval of the dominant memory trace (adaptive or not) along with initiating the most prominent action scheme related to that memory trace.

Disrupting neural activity related to awake-state sharp wave-ripple complexes prevents hippocampal learning

Oscillations in hippocampal local-field potentials (LFPs) reflect the crucial involvement of the hippocampus in memory trace formation: theta (4–8 Hz) oscillations and ripples (~200 Hz) occurring during sharp waves are thought to mediate encoding and consolidation, respectively. During sharp wave-ripple complexes (SPW-Rs), hippocampal cell firing closely follows the pattern that took place during the initial experience, most likely reflecting replay of that event. Disrupting hippocampal ripples using electrical stimulation either during training in awake animals or during sleep after training retards spatial learning. Here, adult rabbits were trained in trace eyeblink conditioning, a hippocampus-dependent associative learning task. A bright light was presented to the animals during the inter-trial interval (ITI), when awake, either during SPW-Rs or irrespective of their neural state. Learning was particularly poor when the light was presented following SPW-Rs. While the light did not disrupt the ripple itself, it elicited a theta-band oscillation, a state that does not usually coincide with SPW-Rs. Thus, it seems that consolidation depends on neuronal activity within and beyond the hippocampus taking place immediately after, but by no means limited to, hippocampal SPW-Rs.

Project DyAdd: classical eyeblink conditioning in adults with dyslexia and ADHD

In this study of the project DyAdd (Adult Dyslexia and Attention Deficit Disorder in Finland), classical eyeblink conditioning (EBC) was investigated in both delay and trace paradigms in adults (18-55 years) with dyslexia (n = 37), attention deficit-hyperactivity disorder (ADHD; n = 21), their comorbid combination (n = 8), and healthy controls (n = 35). In addition, the profiles of three participants with a rare autosomal dominant cerebellar disease were assessed (episodic ataxia type 2, EA-2). We found that participants with dyslexia were overall slower learners than controls in eyeblink conditioning. Further, they were the only group that had a reduced number of CRs in mediotemporal-dependent trace paradigm compared to the more cerebellum-dependent delay paradigm. Second, ADHD was found to be related to larger CR amplitude. Third, those with a comorbid condition learned faster and manifested CRs that were not well timed. Fourth, the cerebellar patients showed nearly no conditioning at all. Correlations between EBC and various neuropsychological domains (phonological processing, reading, spelling, arithmetic, executive functions, attention, and fine motor control) over all participants resulted in significant relations only for the delay paradigm: Increased amount of reading errors related with later peak latency and increased amount of self-corrections in fine motor control related with larger response magnitude. Within those who conditioned, relations emerged only for the trace paradigm: better spelling was related to larger response magnitude. These results do not lend support to the cerebellar hypothesis of dyslexia. On the contrary, dyslexia in its pure form seems to be related to a relative dysfunction of a larger hippocampal-cerebellar network. Further, larger responses in the ADHD group are suggested to result from their lowered responding threshold.

Learning to learn: theta oscillations predict new learning, which enhances related learning and neurogenesis

Animals in the natural world continuously encounter learning experiences of varying degrees of novelty. New neurons in the hippocampus are especially responsive to learning associations between novel events and more cells survive if a novel and challenging task is learned. One might wonder whether new neurons would be rescued from death upon each new learning experience or whether there is an internal control system that limits the number of cells that are retained as a function of learning. In this experiment, it was hypothesized that learning a task that was similar in content to one already learned previously would not increase cell survival. We further hypothesized that in situations in which the cells are rescued hippocampal theta oscillations (3–12 Hz) would be involved and perhaps necessary for increasing cell survival. Both hypotheses were disproved. Adult male Sprague-Dawley rats were trained on two similar hippocampus-dependent tasks, trace and very-long delay eyeblink conditioning, while recording hippocampal local-field potentials. Cells that were generated after training on the first task were labeled with bromodeoxyuridine and quantified after training on both tasks had ceased. Spontaneous theta activity predicted performance on the first task and the conditioned stimulus induced a theta-band response early in learning the first task. As expected, performance on the first task correlated with performance on the second task. However, theta activity did not increase during training on the second task, even though more cells were present in animals that had learned. Therefore, as long as learning occurs, relatively small changes in the environment are sufficient to increase the number of surviving neurons in the adult hippocampus and they can do so in the absence of an increase in theta activity. In conclusion, these data argue against an upper limit on the number of neurons that can be rescued from death by learning.

Reactivation, replay, and preplay: how it might all fit together

Sequential activation of neurons that occurs during “offline” states, such as sleep or awake rest, is correlated with neural sequences recorded during preceding exploration phases. This so-called reactivation, or replay, has been observed in a number of different brain regions such as the striatum, prefrontal cortex, primary visual cortex and, most prominently, the hippocampus. Reactivation largely co-occurs together with hippocampal sharp-waves/ripples, brief high-frequency bursts in the local field potential. Here, we first review the mounting evidence for the hypothesis that reactivation is the neural mechanism for memory consolidation during sleep. We then discuss recent results that suggest that offline sequential activity in the waking state might not be simple repetitions of previously experienced sequences. Some offline sequential activity occurs before animals are exposed to a novel environment for the first time, and some sequences activated offline correspond to trajectories never experienced by the animal. We propose a conceptual framework for the dynamics of offline sequential activity that can parsimoniously describe a broad spectrum of experimental results. These results point to a potentially broader role of offline sequential activity in cognitive functions such as maintenance of spatial representation, learning, or planning.

Relationships between hippocampal sharp waves, ripples, and fast gamma oscillation: influence of dentate and entorhinal cortical activity

Hippocampal sharp waves (SPWs) and associated fast ("ripple") oscillations (SPW-Rs) in the CA1 region are among the most synchronous physiological patterns in the mammalian brain. Using two-dimensional arrays of electrodes for recording local field potentials and unit discharges in freely moving rats, we studied the emergence of ripple oscillations (140-220 Hz) and compared their origin and cellular-synaptic mechanisms with fast gamma oscillations (90-140 Hz). We show that (1) hippocampal SPW-Rs and fast gamma oscillations are quantitatively distinct patterns but involve the same networks and share similar mechanisms; (2) both the frequency and magnitude of fast oscillations are positively correlated with the magnitude of SPWs; (3) during both ripples and fast gamma oscillations the frequency of network oscillation is higher in CA1 than in CA3; and (4) the emergence of CA3 population bursts, a prerequisite for SPW-Rs, is biased by activity patterns in the dentate gyrus and entorhinal cortex, with the highest probability of ripples associated with an "optimum" level of dentate gamma power. We hypothesize that each hippocampal subnetwork possesses distinct resonant properties, tuned by the magnitude of the excitatory drive.