Temporal patterns of inputs to cerebellum necessary and sufficient for trace eyelid conditioning

Hippocampal Interneurons are Required for Trace Eyeblink Conditioning in Mice

While the hippocampus has been implicated in supporting the association among time-separated events, the underlying cellular mechanisms have not been fully clarified. Here, we combined in vivo multi-channel recording and optogenetics to investigate the activity of hippocampal interneurons in freely-moving mice performing a trace eyeblink conditioning (tEBC) task. We found that the hippocampal interneurons exhibited conditioned stimulus (CS)-evoked sustained activity, which predicted the performance of conditioned eyeblink responses (CRs) in the early acquisition of the tEBC. Consistent with this, greater proportions of hippocampal pyramidal cells showed CS-evoked decreased activity in the early acquisition of the tEBC. Moreover, optogenetic suppression of the sustained activity in hippocampal interneurons severely impaired acquisition of the tEBC. In contrast, suppression of the sustained activity of hippocampal interneurons had no effect on the performance of well-learned CRs. Our findings highlight the role of hippocampal interneurons in the tEBC, and point to a potential cellular mechanism subserving associative learning.

Optogenetic inhibition of ventral hippocampal neurons alleviates associative motor learning dysfunction in a rodent model of schizophrenia

Schizophrenia (SZ) is a serious and incurable mental disorder characterized by clinical manifestations of positive and negative symptoms and cognitive dysfunction. High-frequency deep brain stimulation (DBS) of the ventral hippocampus (VHP) has been recently applied as a therapeutic approach for SZ in both experimental and clinical studies. However, little is known about the precise mechanism of VHP-DBS treatment for SZ and the role of hippocampal cell activation in the pathogenesis of SZ. With optogenetic technology in this study, we tried to inhibit neuronal activity in the VHP which has dense projections to the prefrontal cortex, before measuring long stumulus-induced delay eyeblink conditioning (long-dEBC) in a rodent model of SZ. Rats were administrated with phencyclidine (PCP, 3 mg/kg, 1/d, ip) for successive 7 days before optogenetic intervention. The current data show that PCP administration causes significant impairment in the acquisition and timing of long-dEBC; the inhibition of bilateral VHP neurons alleviates the decreased acquisition and impaired timing of longd-dEBC in PCP-administered rats. The results provide direct evidence at the cellular level that the inhibition of VHP neuronal cells may be a prominent effect of hippocampal DBS intervention, and increased activity in the hippocampal network play a pivotal role in SZ.

Optogenetic Inhibition of Medial Prefrontal Cortex-Pontine Nuclei Projections During the Stimulus-free Trace Interval Impairs Temporal Associative Motor Learning

The medial prefrontal cortex (mPFC) is closely involved in many higher-order cognitive functions, including learning to associate temporally discontiguous events (called temporal associative learning). However, direct evidence for the role of mPFC and the neural pathway underlying modulation of temporal associative motor learning is sparse. Here, we show that optogenetic inhibition of the mPFC or its axon terminals at the pontine nuclei (PN) during trace intervals or whole trial period significantly impaired the trace eyeblink conditioning (TEC), but had no significant effects on TEC during the conditioned stimulus or intertrial interval period. Our results suggest that activities associated with the mPFC-PN projection during trace intervals is crucial for trace associative motor learning. This finding is of great importance in understanding the mechanisms and the relevant neural pathways underlying mPFC modulation of temporal associative motor learning.

Response Dynamics in an Olivocerebellar Spiking Neural Network With Non-linear Neuron Properties

Sensorimotor signals are integrated and processed by the cerebellar circuit to predict accurate control of actions. In order to investigate how single neuron dynamics and geometrical modular connectivity affect cerebellar processing, we have built an olivocerebellar Spiking Neural Network (SNN) based on a novel simplification algorithm for single point models (Extended Generalized Leaky Integrate and Fire, EGLIF) capturing essential non-linear neuronal dynamics (e.g., pacemaking, bursting, adaptation, oscillation and resonance). EGLIF models specifically tuned for each neuron type were embedded into an olivocerebellar scaffold reproducing realistic spatial organization and physiological convergence and divergence ratios of connections. In order to emulate the circuit involved in an eye blink response to two associated stimuli, we modeled two adjacent olivocerebellar microcomplexes with a common mossy fiber input but different climbing fiber inputs (either on or off). EGLIF-SNN model simulations revealed the emergence of fundamental response properties in Purkinje cells (burst-pause) and deep nuclei cells (pause-burst) similar to those reported in vivo. The expression of these properties depended on the specific activation of climbing fibers in the microcomplexes and did not emerge with scaffold models using simplified point neurons. This result supports the importance of embedding SNNs with realistic neuronal dynamics and appropriate connectivity and anticipates the scale-up of EGLIF-SNN and the embedding of plasticity rules required to investigate cerebellar functioning at multiple scales.

Intracerebellar cannabinoid administration impairs delay but not trace eyeblink conditioning

Intracerebellar administration of cannabinoid agonists impairs cerebellum-dependent delay eyeblink conditioning (EBC) in rats. It is not known whether the cannabinoid-induced impairment in EBC is found with shorter interstimulus intervals (ISI), longer ISIs, or with trace EBC. Moreover, systemic administration of cannabinoid agonists does not impair trace EBC, suggesting that cannabinoid receptors within the cerebellum are not involved in trace EBC. To more precisely assess the effects of cannabinoids on cerebellar learning mechanisms the current study examined the effects of the cannabinoid agonist WIN55,212-2 (WIN) infusion into the area of the cerebellar cortex necessary for EBC (the eyeblink microzone) in rats during short delay (250 ms CS), long delay (750 ms CS), and trace (250 ms CS, 500 ms trace interval) EBC. WIN was infused into the eyeblink microzone 30 min before pretraining sessions and five EBC training sessions, followed by five EBC training sessions without infusions to assess recovery from drug effects and savings. WIN had no effect on spontaneous blinks or non-associative responses to the CS or US during the pretraining sessions. Short and long delay EBC were impaired by WIN but trace EBC was unaffected. The results indicate that trace EBC is mediated by mechanisms that are resistant to cannabinoid agonists.

Sensorimotor Coding of Vermal Granule Neurons in the Developing Mammalian Cerebellum

The vermal cerebellum is a hub of sensorimotor integration critical for postural control and locomotion, but the nature and developmental organization of afferent information to this region have remained poorly understood in vivo Here, we use in vivo two-photon calcium imaging of the vermal cerebellum in awake behaving male and female mice to record granule neuron responses to diverse sensorimotor cues targeting visual, auditory, somatosensory, and motor domains. Use of an activity-independent marker revealed that approximately half (54%) of vermal granule neurons were activated during these recordings. A multikernel linear model distinguished the relative influences of external stimuli and co-occurring movements on neural responses, indicating that, among the subset of activated granule neurons, locomotion (44%-56%) and facial air puffs (50%) were more commonly and reliably encoded than visual (31%-32%) and auditory (19%-28%) stimuli. Strikingly, we also uncover populations of granule neurons that respond differentially to voluntary and forced locomotion, whereas other granule neurons in the same region respond similarly to locomotion in both conditions. Finally, by combining two-photon calcium imaging with birth date labeling of granule neurons via in vivo electroporation, we find that early- and late-born granule neurons convey similarly diverse sensorimotor information to spatially distinct regions of the molecular layer. Collectively, our findings elucidate the nature and developmental organization of sensorimotor information in vermal granule neurons of the developing mammalian brain.SIGNIFICANCE STATEMENT Cerebellar granule neurons comprise over half the neurons in the brain, and their coding properties have been the subject of theoretical and experimental interest for over a half-century. In this study, we directly test long-held theories about encoding of sensorimotor stimuli in the cerebellum and compare the in vivo coding properties of early- and late-born granule neurons. Strikingly, we identify populations of granule neurons that differentially encode voluntary and forced locomotion and find that, although the birth order of granule neurons specifies the positioning of their parallel fiber axons, both early- and late-born granule neurons convey a functionally diverse sensorimotor code. These findings constitute important conceptual advances in understanding the principles underlying cerebellar circuit development and function.

How the cerebellum learns to build a sequence

Rabbits can learn the biological analogue of a simple recursive function by relying only on the neurons of the cerebellum.

Medial Auditory Thalamus Is Necessary for Expression of Auditory Trace Eyelid Conditioning

Transforming a brief sensory event into a persistent neural response represents a mechanism for linking temporally disparate stimuli together to support learning. The cerebellum requires this type of persistent input during trace conditioning to engage associative plasticity and acquire adaptively timed conditioned responses (CRs). An initial step toward identifying the sites and mechanisms generating and transmitting persistent signals to the cerebellum is to identify the input pathway. The medial auditory thalamic nuclei (MATN) are the necessary and sufficient source of auditory input to the cerebellum for delay conditioning in rodents and a possible input to forebrain sites generating persistent signals. Using pharmacological and computational approaches, we test (1) whether the necessity of MATN during auditory eyelid conditioning is conserved across species, (2) whether the MATN are necessary for the expression of trace eyelid CRs, and if so, (3)whether this relates to the generation of persistent signals. We find that contralateral inactivation of MATN with muscimol largely abolished trace and delay CRs in male rabbits. Residual CRs were decreased in amplitude, but CR timing was unaffected. Results from large-scale cerebellar simulations are consistent with previous experimental demonstrations that silencing only CS-duration inputs does not abolish trace CRs, and instead affects their timing. Together, these results suggest that the MATN are a necessary component of both the direct auditory stimulus pathway to the cerebellum and the pathway generating task-essential persistent signals.SIGNIFICANCE STATEMENT Persistent activity is required for working memory-dependent tasks, such as trace conditioning, and represents a mechanism by which sensory information can be used over time for learning and cognition. This neuronal response entails the transformation of a discrete sensory-evoked response into a signal that extends beyond the stimulus event. Understanding the generation and transmission of this stimulus transformation requires identifying the input sources necessary for task-essential persistent signals. We report that the medial auditory thalamic nuclei are required for the expression of auditory trace conditioning and suggest that these nuclei are a component of the pathway-generating persistent signals. Our study provides a foundation for testing circuit-level mechanisms underlying persistent activity in a cerebellar learning model with identified inputs and well defined behavioral outputs.

Cerebellar implementation of movement sequences through feedback

Most movements are not unitary, but are comprised of sequences. Although patients with cerebellar pathology display severe deficits in the execution and learning of sequences (Doyon et al., 1997; Shin and Ivry, 2003), most of our understanding of cerebellar mechanisms has come from analyses of single component movements. Eyelid conditioning is a cerebellar-mediated behavior that provides the ability to control and restrict inputs to the cerebellum through stimulation of mossy fibers. We utilized this advantage to test directly how the cerebellum can learn a sequence of inter-connected movement components in rabbits. We show that the feedback signals from one component are sufficient to serve as a cue for the next component in the sequence. In vivo recordings from Purkinje cells demonstrated that all components of the sequence were encoded similarly by cerebellar cortex. These results provide a simple yet general framework for how the cerebellum can use simple associate learning processes to chain together a sequence of appropriately timed responses.

Imagine a gymnastics competition in which participants take turns to cartwheel and somersault across the floor. The routines on display comprise sequences of precisely timed movements learned through practice. This is also true for many of the actions we perform every day, such as reaching for a cup of coffee. A region of the brain called the cerebellum helps us learn sequences of movements. But how does it do this?

To find out, Khilkevich et al. came up with a new version of an old experiment. Rabbits were first trained to blink their eye in response to a specific external cue. This type of learning, called associative learning, has been shown before in the cerebellum. But Khilkevich et al. wondered whether the cerebellum could also use internal feedback signals from the eyeblink as a cue to learn the next movement? If so, this might explain how the cerebellum can chain movements together in a sequence.

As predicted, Khilkevich et al. found that rabbits could learn to blink their eye in response to an initial signal, and then blink again in response to the first blink. Control experiments confirmed that the second eyeblink was coupled to the first, and not to the original cue. Moreover, on many trials the rabbits showed a third and even fourth eyeblink. This is because feedback signals from the first, second or third blink were the same. Thus, the feedback signals from the first blink triggered the second blink, feedback from the second triggered the third, and so forth. Rabbits could also learn to use a blink of the left eye as a cue for a blink of the right eye. Similar patterns of neuronal activity accompanied each blink, suggesting that the same mechanism generated them all.

The cerebellum can thus use feedback from one movement as a cue to learn the proper timing of the next movement in a sequence. A key question is whether this mechanism of sequence learning extends beyond movement. The cerebellum has extensive connections to the brain’s outer layer, the cortex, including many areas involved in cognition. Future experiments should test whether the cerebellum might help guide sequences of cortical activity during cognitive tasks.

Cerebellar Processing Common to Delay and Trace Eyelid Conditioning

Results from previous lesion studies have been interpreted as evidence that the cerebellar cortex plays different roles for delay and trace conditioning of eyelid responses. However, the cerebellar cortex is organized by parasagittal stripes of Purkinje cells (PCs) that converge onto common deep nucleus neurons and receive common or related climbing fiber inputs. Based on this organization, we hypothesized that cerebellar tasks involving the same response system, such as delay and trace eyelid conditioning, would engage the same PCs and that the relationships between PC activity and expression of behavioral responses would be similar for both tasks. To test these hypotheses, we used tetrode recordings from eyelid PCs in rabbits during expression of delay- and trace-conditioned eyelid responses. Previous recording studies during delay conditioning described a strong relationship between eyelid PC activity and the kinematics of conditioned eyelid responses. The present results replicate these findings for delay conditioning and show that the same relationship exists during trace eyelid conditioning. During transitions from delay to trace responding, the relationship between eyelid PCs and behavioral responses was relatively stable. We found that an inverse firing rate model tuned to predict PC activity during one training paradigm could then predict equally well the PC activity during the other training paradigm. These results provide strong evidence that cerebellar cortex processing is similar for delay and trace eyelid conditioning and that the parasagittal organization of the cerebellum, not the conditioning paradigm, dictate which neurons are engaged to produce adaptively timed conditioned responses.SIGNIFICANCE STATEMENT A variety of evidence from eyelid conditioning and other cerebellar-dependent behaviors indicates that the cerebellar cortex is necessary for learning and proper timing of cerebellar learned responses. Debates exist about whether trace eyelid conditioning data show that fundamentally different mechanisms operate in the cerebellum during tasks when input from the forebrain is necessary for learning. We show here that learning-related changes in a specific population of Purkinje cells control the timing and amplitude of cerebellar responses the same way regardless of the inputs necessary to learn the task. Our results indicate the parasagittal organization of the cerebellar cortex, not the complexity of inputs to the cerebellum, determines which neurons are engaged in the learning and execution of cerebellar-mediated responses.

A cerebellar mechanism for learning prior distributions of time intervals

Knowledge about the statistical regularities of the world is essential for cognitive and sensorimotor function. In the domain of timing, prior statistics are crucial for optimal prediction, adaptation and planning. Where and how the nervous system encodes temporal statistics is, however, not known. Based on physiological and anatomical evidence for cerebellar learning, we develop a computational model that demonstrates how the cerebellum could learn prior distributions of time intervals and support Bayesian temporal estimation. The model shows that salient features observed in human Bayesian time interval estimates can be readily captured by learning in the cerebellar cortex and circuit level computations in the cerebellar deep nuclei. We test human behavior in two cerebellar timing tasks and find prior-dependent biases in timing that are consistent with the predictions of the cerebellar model.

Human timing behavior is biased towards previously encountered intervals and is predicted by Bayesian models. Here, the authors develop a computational model based in properties of the cerebellum to show how we might encode time estimates based on prior experience.

Genetic silencing of olivocerebellar synapses causes dystonia-like behaviour in mice

Theories of cerebellar function place the inferior olive to cerebellum connection at the centre of motor behaviour. One possible implication of this is that disruption of olivocerebellar signalling could play a major role in initiating motor disease. To test this, we devised a mouse genetics approach to silence glutamatergic signalling only at olivocerebellar synapses. The resulting mice had a severe neurological condition that mimicked the early-onset twisting, stiff limbs and tremor that is observed in dystonia, a debilitating movement disease. By blocking olivocerebellar excitatory neurotransmission, we eliminated Purkinje cell complex spikes and induced aberrant cerebellar nuclear activity. Pharmacologically inhibiting the erratic output of the cerebellar nuclei in the mutant mice improved movement. Furthermore, deep brain stimulation directed to the interposed cerebellar nuclei reduced dystonia-like postures in these mice. Collectively, our data uncover a neural mechanism by which olivocerebellar dysfunction promotes motor disease phenotypes and identify the cerebellar nuclei as a therapeutic target for surgical intervention.

Dystonia is thought to be driven by impairments in cerebellar signalling. The authors use a mouse genetic approach to silence excitatory transmission in the inferior olive to cerebellum pathway, resulting in dystonia-like signs in the animals which can be alleviated using DBS stimulation of the pathway.

Cerebellar Roles in Self-Timing for Sub- and Supra-Second Intervals

Previous studies suggest that the cerebellum and basal ganglia are involved in sub-second and supra-second timing, respectively. To test this hypothesis at the cellular level, we examined the activity of single neurons in the cerebellar dentate nucleus in monkeys performing the oculomotor version of the self-timing task. Animals were trained to report the passage of time of 400, 600, 1200, or 2400 ms following a visual cue by making self-initiated memory-guided saccades. We found a sizeable preparatory neuronal activity before self-timed saccades across delay intervals, while the time course of activity correlated with the trial-by-trial variation of saccade latency in different ways depending on the length of the delay intervals. For the shorter delay intervals, the ramping up of neuronal firing rate started just after the visual cue and the rate of rise of neuronal activity correlated with saccade timing. In contrast, for the longest delay (2400 ms), the preparatory activity started late during the delay period, and its onset time correlated with self-timed saccade latency. Because electrical microstimulation applied to the recording sites during saccade preparation advanced self-timed but not reactive saccades, regardless of their directions, the signals in the cerebellum may have a causal role in self-timing. We suggest that the cerebellum may regulate timing in both sub-second and supra-second ranges, although its relative contribution might be greater for sub-second than for supra-second time intervals.SIGNIFICANCE STATEMENT How we decide the timing of self-initiated movement is a fundamental question. According to the prevailing hypothesis, the cerebellum plays a role in monitoring sub-second timing, whereas the basal ganglia are important for supra-second timing. To verify this, we explored neuronal signals in the monkey cerebellum while animals reported the passage of time in the range 400-2400 ms by making eye movements. Contrary to our expectations, we found that neurons in the cerebellar dentate nucleus exhibited a similar preparatory activity for both sub-second and supra-second intervals, and that electrical simulation advanced self-timed saccades in both conditions. We suggest that the cerebellum plays a causal role in the fine adjustment of self-timing in a larger time range than previously thought.

Links Between Single-Trial Changes and Learning Rate in Eyelid Conditioning

The discovery of single-trial learning effects, where the presence or absence (or the number) of climbing fiber inputs produces measureable changes in Purkinje cell response and in behavior, represents a major breakthrough in cerebellar learning. Among other things, these observations provide strong links between climbing fiber-mediated plasticity and cerebellar learning. They also demonstrate that cerebellar learning is stochastic, with each instantiation of a movement producing a small increment or decrement in gain. The sum of the small changes give rise to the macroscopic properties of cerebellar learning. We used a relatively large data set from another example of cerebellar-dependent learning, classical conditioning of eyelid responses, to attempt a behavioral replication and extension of single-trial learning effects. As a normal part of training, stimulus-alone trials provide instances where the climbing fiber response would be omitted, similar to non-climbing-fiber trials (gain down) during smooth pursuit training. The consequences of the stimulus-alone trial on the amplitude and timing of the conditioned response on the following paired trials were examined. We find that the amplitude of the conditioned response during the trial after a stimulus-alone trial (no climbing fiber input) was measurably smaller than the amplitude on the previous trials, and this single-trial effect on amplitude is larger for longer interstimulus intervals. The magnitude of the single-trial effect parallels the rate of extinction at different interstimulus intervals supporting the previously observed link between single-trial effects and learning.

Neural mechanisms of human temporal fear conditioning

Learning the temporal relationship between a warning cue (conditioned stimulus; CS) and aversive threat (unconditioned stimulus; UCS) is an important aspect of Pavlovian conditioning. Although prior functional magnetic resonance imaging (fMRI) research has identified brain regions that support Pavlovian conditioning, it remains unclear whether these regions support time-related processes important for this type of associative learning. Elucidating the neural substrates of temporal conditioning is important for a complete understanding of the Pavlovian conditioning process. Therefore, the present study used a temporal Pavlovian conditioning procedure to investigate brain activity that mediates the formation of temporal associations. During fMRI, twenty-three healthy volunteers completed a temporal conditioning procedure and a control task that does not support conditioning. Specifically, during the temporal conditioning procedure, the UCS was presented at fixed intervals (ITI: 20s) while in the control condition the UCS was presented at random intervals (Average ITI: 20s, ITI Range: 6-34s). We observed greater skin conductance responses and expectancy of the UCS during fixed (i.e., temporal conditioning) relative to random (i.e., control procedure) interval trials. These findings demonstrate fixed trials support temporal conditioning, while random trials do not. During fixed interval trials, greater conditioned fMRI signal responses were observed within dorsolateral prefrontal cortex, inferior parietal lobule, inferior and middle temporal cortex, hippocampus, and amygdala. The current findings suggest these brain regions constitute a neural circuit that encodes the temporal information necessary for Pavlovian fear conditioning.

Prefrontal Single-Neuron Responses after Changes in Task Contingencies during Trace Eyeblink Conditioning in Rabbits

A number of studies indicate that the medial prefrontal cortex (mPFC) plays a role in mediating the expression of behavioral responses during tasks that require flexible changes in behavior. During trace eyeblink conditioning, evidence suggests that the mPFC provides the cerebellum with a persistent input to bridge the temporal gap between conditioned and unconditioned stimuli. Therefore, the mPFC is in a position to directly mediate the expression of trace conditioned responses. However, it is unknown whether persistent neural responses are associated with the flexible expression of behavior when task contingencies are changed during trace eyeblink conditioning. To investigate this, single-unit activity was recorded in the mPFC of rabbits during extinction and reacquisition of trace eyeblink conditioning, and during training to a different conditional stimulus. Persistent responses remained unchanged after full extinction, and also did not change during reacquisition training. During training to a different tone, however, the generalization of persistent responses to the new stimulus was associated with an animal’s performance—when persistent responses generalized to the new tone, performance was high (>50% response rate). When persistent responses decreased to baseline rates, performance was poor (<50% response rate). The data suggest that persistent mPFC responses do not appear to mediate flexible changes in the expression of the original learning, but do appear to play a role in the generalization of that learning when the task is modified.

Contribution of Cerebellar Loops to Action Timing

Recent studies of sensorimotor processing have benefited from decision-making paradigms that emphasize the selection of appropriate movements. Selecting when to make those responses, or action timing, is important as well. Although the cerebellum is commonly viewed as a controller of movement dynamics, its role in action timing is also firmly supported. Several lines of research have now extended this idea. Anatomical findings have revealed connections between the cerebellum and broader timing circuits, neurophysiological results have suggested mechanisms for timing within its microcircuitry, and theoretical work has indicated how temporal signals are processed through it and decoded by its targets. These developments are inspiring renewed studies of the role of the cerebellar loops in action timing.

The impact of hippocampal lesions on trace-eyeblink conditioning and forebrain-cerebellar interactions

Behavioral Neuroscience published a pivotal paper by Moyer, Deyo, and Disterhoft (1990) 25 years ago that described the impaired acquisition of trace-eyeblink conditioning in rabbits with complete removal of the hippocampus. As part of the Behavioral Neuroscience celebration commemorating the 30th anniversary of the journal, we reflect upon the impact of that study on understanding the role of the hippocampus, forebrain, and forebrain-cerebellar interactions that mediate acquisition and retention of trace-conditioned responses, and of declarative memory more globally. We discuss the expansion of the conditioning paradigm to species other than the rabbit, the heterogeneity of responses among hippocampal neurons during trace conditioning, the responsivity of hippocampal neurons following consolidation of conditioning, the role of awareness in conditioning, how blink conditioning can be used as a translational tool by assaying potential therapeutics for cognitive enhancement, how trace and delay classical conditioning may be used to investigate neurological disorders including Alzheimer's disease and schizophrenia, and how the 2 paradigms may be used to understand the relationship between declarative (explicit) and nondeclarative (implicit) memory systems.

Trace Eyeblink Conditioning in Mice Is Dependent upon the Dorsal Medial Prefrontal Cortex, Cerebellum, and Amygdala: Behavioral Characterization and Functional Circuitry

Trace eyeblink conditioning is useful for studying the interaction of multiple brain areas in learning and memory. The goal of the current work was to determine whether trace eyeblink conditioning could be established in a mouse model in the absence of elicited startle responses and the brain circuitry that supports this learning. We show here that mice can acquire trace conditioned responses (tCRs) devoid of startle while head-restrained and permitted to freely run on a wheel. Most mice (75%) could learn with a trace interval of 250 ms. Because tCRs were not contaminated with startle-associated components, we were able to document the development and timing of tCRs in mice, as well as their long-term retention (at 7 and 14 d) and flexible expression (extinction and reacquisition). To identify the circuitry involved, we made restricted lesions of the medial prefrontal cortex (mPFC) and found that learning was prevented. Furthermore, inactivation of the cerebellum with muscimol completely abolished tCRs, demonstrating that learned responses were driven by the cerebellum. Finally, inactivation of the mPFC and amygdala in trained animals nearly abolished tCRs. Anatomical data from these critical regions showed that mPFC and amygdala both project to the rostral basilar pons and overlap with eyelid-associated pontocerebellar neurons. The data provide the first report of trace eyeblink conditioning in mice in which tCRs were driven by the cerebellum and required a localized region of mPFC for acquisition. The data further reveal a specific role for the amygdala as providing a conditioned stimulus-associated input to the cerebellum.

Optogenetic stimulation of mPFC pyramidal neurons as a conditioned stimulus supports associative learning in rats

It is generally accepted that the associative learning occurs when a behaviorally neutral conditioned stimulus (CS) is paired with an aversive unconditioned stimulus (US) in close temporal proximity. Eyeblink conditioning (EBC) is a simple form of associative learning for motor responses. Specific activation of a population of cells may be an effective and sufficient CS for establishing EBC. However, there has been no direct evidence to support this hypothesis. Here, we show in rats that optogenetic activation of the right caudal mPFC pyramidal neurons as a CS is sufficient to support the acquisition of delay eyeblink conditioning (DEC). Interestingly, the associative memory was not stably expressed during the initial period of daily conditioning session even after the CR acquisition reached the asymptotic level. Finally, the intensity and consistency of the CS were found to be crucial factors in regulating the retrieval of the associative memory. These results may be of importance in understanding the neural cellular mechanisms underlying associative learning and the mechanisms underlying retrieval process of memory.

Prefrontal control of cerebellum-dependent associative motor learning

Behavioral studies have demonstrated that both medial prefrontal cortex (mPFC) and cerebellum play critical roles in trace eyeblink conditioning. However, little is known regarding the mechanism by which the two brain regions interact. By use of electrical stimulation of the caudal mPFC as a conditioned stimulus, we show evidence that persistent outputs from the mPFC to cerebellum are necessary and sufficient for the acquisition and expression of a trace conditioned response (CR)-like response. Specifically, the persistent outputs of caudal mPFC are relayed to the cerebellum via the rostral part of lateral pontine nuclei. Moreover, interfering with persistent activity by blockade of the muscarinic Ach receptor in the caudal mPFC impairs the expression of learned trace CRs. These results suggest an important way for the caudal mPFC to interact with the cerebellum during associative motor learning.

Modification of persistent responses in medial prefrontal cortex during learning in trace eyeblink conditioning

Persistent spiking in response to a discrete stimulus is considered to reflect the active maintenance of a memory for that stimulus until a behavioral response is made. This response pattern has been reported in learning paradigms that impose a temporal gap between stimulus presentation and behavioral response, including trace eyeblink conditioning. However, it is unknown whether persistent responses are acquired as a function of learning or simply represent an already existing category of response type. This fundamental question was addressed by recording single-unit activity in the medial prefrontal cortex (mPFC) of rabbits during the initial learning phase of trace eyeblink conditioning. Persistent responses to the tone conditioned stimulus were observed in the mPFC during the very first training sessions. Further analysis revealed that most cells with persistent responses showed this pattern during the very first training trial, before animals had experienced paired training. However, persistent cells showed reliable decreases in response magnitude over the first training session, which were not observed on the second day of training or for sessions in which learning criterion was met. This modification of response magnitude was specific to persistent responses and was not observed for cells showing phasic tone-evoked responses. The data suggest that persistent responses to discrete stimuli do not require learning but that the ongoing robustness of such responses over the course of training is modified as a result of experience. Putative mechanisms for this modification are discussed, including changes in cellular or network properties, neuromodulatory tone, and/or the synaptic efficacy of tone-associated inputs.

Differential effects of the cannabinoid agonist WIN55,212-2 on delay and trace eyeblink conditioning

Central cannabinoid-1 receptors (CB1R) play a role in the acquisition of delay eyeblink conditioning (EBC) but not trace EBC in humans and animals. However, it is not clear why trace conditioning is immune to the effects of cannabinoid receptor compounds. The current study examined the effects of variants of delay and trace conditioning procedures to elucidate the factors that determine the effects of CB1R agonists on EBC. In Experiment 1, rats were administered the cannabinoid agonist WIN55,212-2 during delay, long-delay, or trace conditioning. Rats were impaired during delay and long-delay, but not trace conditioning; the impairment was greater for long-delay than delay conditioning. Trace conditioning was further examined in Experiment 2 by manipulating the trace interval and keeping constant the conditioned stimulus (conditional stimulus [CS]) duration. It was found that when the trace interval was 300 ms or less, WIN55,212-2 administration impaired the rate of learning. Experiment 3 tested whether the trace interval duration or the relative durations of the CS and trace interval were critical parameters influencing the effects of WIN55,212-2 on EBC. Rats were not impaired with a 100-ms CS, 200-ms trace paradigm but were impaired with a 1,000-ms CS, 500-ms trace paradigm, indicating that the duration of the trace interval does not matter, but the proportion of the interstimulus interval occupied by the CS relative to the trace period is critical. Taken together, the results indicate that cannabinoid agonists affect cerebellar learning when the CS is longer than the trace interval.

Awareness is essential for differential delay eyeblink conditioning with soft-tone but not loud-tone conditioned stimuli

The role of awareness in differential delay eyeblink conditioning (DEC) remains controversial. Here, we investigated the involvement of awareness in differential DEC with a soft or a loud tone as the conditioned stimulus (CS). In the experiment, 36 participants were trained in differential DEC with a soft tone (60 dB) or a loud tone (85 dB) as the CS, paired with a corneal air-puff as the unconditioned stimulus (US). After conditioning, awareness of the relationship between the CS and the US was assessed with a 17-item true/false questionnaire. Interestingly, during differential DEC with a soft-tone CS, a higher proportion of differential conditioned responses (CRs) was evident in participants who were aware than those who were unaware. In contrast, when a loud tone was used as the CS, the proportion of differential CRs of the aware participants did not differ significantly from those who were unaware over any of the blocks of 20 trials. In unaware participants, the percentage of differential CRs with a loud-tone CS was significantly higher than that with a soft-tone CS; however in participants classified as aware, the percentage of differential CRs with a loud-tone CS did not differ significantly from that with a soft-tone CS. The present findings suggest that awareness is critical for differential DEC when the delay task is rendered more difficult.

Human trace fear conditioning: right-lateralized cortical activity supports trace-interval processes

Pavlovian conditioning requires the convergence and simultaneous activation of neural circuitry that supports conditioned stimulus (CS) and unconditioned stimulus (US) processes. However, in trace conditioning, the CS and US are separated by a period of time called the trace interval, and thus do not overlap. Therefore, determining brain regions that support associative learning by maintaining a CS representation during the trace interval is an important issue for conditioning research. Prior functional magnetic resonance imaging (fMRI) research has identified brain regions that support trace-conditioning processes. However, relatively little is known about whether this activity is specific to the trace CS, the trace interval, or both periods of time. The present study was designed to disentangle the hemodynamic response produced by the trace CS from that associated with the trace interval, in order to identify learning-related activation during these distinct components of a trace-conditioning trial. Trace-conditioned activity was observed within dorsomedial prefrontal cortex (PFC), dorsolateral PFC, insula, inferior parietal lobule (IPL), and posterior cingulate (PCC). Each of these regions showed learning-related activity during the trace CS, while trace-interval activity was only observed within a subset of these areas (i.e., dorsomedial PFC, PCC, right dorsolateral PFC, right IPL, right superior/middle temporal gyrus, and bilateral insula). Trace-interval activity was greater in right than in left dorsolateral PFC, IPL, and superior/middle temporal gyrus. These findings indicate that components of the prefrontal, cingulate, insular, and parietal cortices support trace-interval processes, as well as suggesting that a right-lateralized fronto-parietal circuit may play a unique role in trace conditioning.

Persistent activity in prefrontal cortex during trace eyelid conditioning: dissociating responses that reflect cerebellar output from those that do not

Persistent neural activity, responses that outlast the stimuli that evoke them, plays an important role in neural computations and possibly in processes, such as working memory. Recent studies suggest that trace eyelid conditioning, which involves a temporal gap between the conditioned and unconditioned stimuli (the trace interval), requires persistent neural activity in a region of medial prefrontal cortex (mPFC). This persistent activity, which could be conveyed to cerebellum via a pathway through pons, may engage the cerebellum and allow for the expression of conditioned responses. Given the substantial reciprocity observed among many brain regions, it is essential to demonstrate that persistent responses in mPFC neurons are not simply a reflection of cerebellar feedback to the forebrain, leaving open the possibility that such responses could serve as input to the cerebellum. This concern is highlighted by studies showing that hippocampal learning-related activity is abolished by cerebellar inactivation. We inactivated the cerebellum while recording single-unit activity from the mPFC of rabbits trained with a forebrain-dependent trace eyelid conditioning procedure. We report that, whereas the responses of cells that show an onset of increased spike activity during the trace interval were abolished by cerebellar inactivation, persistent responses that begin during the conditioned stimulus and persisted into the trace interval were unaffected. Therefore, conditioned stimulus-evoked persistent responses remain the strongest candidate input pattern to support the cerebellar expression of learned responses.

Reevaluating the role of the hippocampus in delay eyeblink conditioning

The role of the hippocampus in delay eyeblink conditioning (DEC) remains controversial. Here, we investigated the involvement of the hippocampus in DEC with a soft tone as the conditioned stimulus (CS) by using electrolytic lesions or muscimol inactivation of guinea pig dorsal hippocampus. Interestingly, when a soft tone was used as a CS, electrolytic lesions of the hippocampus significantly retarded acquisition of the conditioned response (CR), and muscimol infusions into hippocampus distinctly inhibited the acquisition and expression of CR, but had no significant effect on consolidation of well-learned CR. In contrast, both electrolytic lesions and muscimol inactivation of hippocampus produced no significant deficits in the CR when a loud tone was used as the CS. These results demonstrate that the hippocampus is essential for the DEC when the delay task was rendered more difficult.

Visual cortical contributions to associative cerebellar learning

Eye-blink conditioning (EBC) is a form of associative learning that depends on the cerebellum. Previous reports suggested that sensory cortex is necessary for trace EBC but not for delay EBC. The trace and delay EBC procedures used in these studies differed by the presence or absence of a temporal gap between the end of the conditioned stimulus and the onset of the unconditioned stimulus (trace interval) and in the interval between the onset of the CS and the US (inter-stimulus interval, ISI). The current study examined the role of the visual cortex in delay, long-delay, and trace EBC, matching CS duration and inter-stimulus interval between groups. In Experiment 1, extensive removal of the visual cortex impaired acquisition of long-delay and trace EBC but had no effect on delay EBC. In Experiment 2, bilateral inactivation of the visual cortex impaired acquisition and retention of long-delay and trace EBC, but had no effect on delay EBC. In Experiment 3, unilateral inactivation of the visual cortex impaired long-delay EBC but had no effect on trace EBC. The results indicate that the visual cortex facilitates EBC with relatively long ISIs, regardless of whether there is a trace interval or not. Moreover, the ipsilateral projections from the visual cortex to the pontine nuclei are sufficient for modulating long-delay EBC, whereas trace EBC involves bilateral visual cortical interactions with forebrain systems including the hippocampus and prefrontal cortex.

Coupling of prefrontal gamma amplitude and theta phase is strengthened in trace eyeblink conditioning

Trace eyeblink conditioning requires animals to associate a neutral stimulus (CS) and an aversive periorbital shock (US) that occurred moment later. Acquisition in this conditioning depends on several forebrain regions including the hippocampus, medial prefrontal, and entorhinal cortices in addition to the cerebellum. Activities of single and population neurons in these regions show several patterns of change with the conditioning. For example, the power and synchronization of theta oscillations are correlated with the rate of acquisition. Yet, little is known about how neuronal oscillations at other frequency bands change with the conditioning. The present study examined changes in gamma oscillations, which are typically associated with spiking activity of individual cells. We found that after CS offset the power of gamma oscillations at 35-45 Hz fluctuated at about 7 Hz. This rhythmic fluctuation of gamma power was observed in all three regions and locked to local theta oscillations at 4-8 Hz. Furthermore, over the course of 10 days of acquisition sessions, the coupling of gamma power and theta phase became stronger in the medial prefrontal cortex while it did not change in the hippocampus or lateral entorhinal cortex. Neither theta nor gamma power in any of the regions significantly changed across sessions, rejecting a possibility that the observed increase in prefrontal theta-gamma coupling was secondary to an increase in theta or gamma power. The theta-gamma coupling between different regions did not significantly change across sessions. These results suggest that prefrontal gamma oscillations become more effectively coordinated with concurrent theta oscillations in trace eyeblink conditioning. This may result in a stronger impact of prefrontal neuronal firing responses to the CS on the processing in down-stream regions, such as the lateral entorhinal cortex and/or pontine nuclei.

Classical eyeblink conditioning using electrical stimulation of caudal mPFC as conditioned stimulus is dependent on cerebellar interpositus nucleus in guinea pigs

AIM

To determine whether electrical stimulation of caudal medial prefrontal cortex (mPFC) as conditioned stimulus (CS) paired with airpuff unconditioned stimulus (US) was sufficient for establishing eyeblink conditioning in guinea pigs, and whether it was dependent on cerebellar interpositus nucleus.

METHODS

Thirty adult guinea pigs were divided into 3 conditioned groups, and trained on the delay eyeblink conditioning, short-trace eyeblink conditioning, and long-trace eyeblink conditioning paradigms, respectively, in which electrical stimulation of the right caudal mPFC was used as CS and paired with corneal airpuff US. A pseudo conditioned group of another 10 adult guinea pigs was given unpaired caudal mPFC electrical stimulation and the US. Muscimol (1 μg in 1 μL saline) and saline (1 μL) were infused into the cerebellar interpositus nucleus of the animals through the infusion cannula on d 11 and 12, respectively.

RESULTS

The 3 eyeblink conditioning paradigms have been successfully established in guinea pigs. The animals acquired the delay and short-trace conditioned responses more rapidly than long-trace conditioned responses. Muscimol infusion into the cerebellar interpositus nucleus markedly impaired the expression of the 3 eyeblink conditioned responses.

CONCLUSION

Electrical stimulation of caudal mPFC is effective CS for establishing eyeblink conditioning in guinea pigs, and it is dependent on the cerebellar interpositus nucleus.

Reevaluating the role of the medial prefrontal cortex in delay eyeblink conditioning

It has been proposed that the medial prefrontal cortex (mPFC) is not necessary for delay eyeblink conditioning (DEC). Here, we investigated the involvement of the mPFC in DEC with a soft or loud tone as the conditioned stimulus (CS) by using electrolytic lesions or muscimol inactivation of guinea pig mPFC. Interestingly, when a soft tone was used as a CS, electrolytic lesions of the mPFC significantly retarded acquisition of the conditioned response (CR), and muscimol infusions into mPFC distinctly inhibited the acquisition and expression of CR, but had no significant effect on consolidation of well-learned CR. In contrast, both electrolytic lesions and muscimol inactivation of mPFC produced no significant deficits in the CR when a loud tone was used as the CS, or in the unconditioned response (UR) when a soft or loud tone was used as the CS. These results demonstrate that the mPFC is essential for the DEC with the soft tone CS but not for the DEC with the loud tone CS.

Changes of synaptic ultrastructure in the guinea pig interpositus nuclei associate with response magnitude and timing after trace eyeblink conditioning

Learning-induced changes of synaptic ultrastructure have long been proposed as a mechanism that may contribute to support memory formation. Although recent studies have demonstrated that the interpositus nuclei (IN) play critical role in acquisition and retention of trace conditioned eyeblink responses (CRs), there is now limited evidence associating trace eyeblink conditioning with changes of synaptic ultrastructure in the IN. Here, we investigated this issue using a transmission electron microscope. Adult guinea pigs were randomly allocated to either a trace-paired, delay-paired, unpaired or exposure-only condition. The IN tissue was taken for morphological analysis 1h after the completion of the tenth training session. Serial section analysis of synaptic ultrastructure revealed that trace eyeblink conditioning induced increases in the thickness of excitatory PSD. Classification of the synapses into shape subtypes indicated that the increased thickness of excitatory PSD was mainly attributable to increase in the concave- and convex-shaped synapses. On the contrary, trace eyeblink conditioning resulted in decreases in the thickness of inhibitory PSD. Specifically, these significant changes of PSD thickness were limited to occur in the animals with good behavioral performance. Further analysis of correlations between the trace CR performance and synaptic ultrastructural modifications showed that the thickness of excitatory PSD within the IN correlated with the peak amplitude of trace CRs, whereas the thickness of inhibitory PSD correlated with the onset latency. The present findings suggest that trace eyeblink conditioning induces structural plasticity in the IN, which may play a crucial role in acquiring and executing adaptive eyeblink movements.

Exploring prefrontal cortical memory mechanisms with eyeblink conditioning

Several studies in nonhuman primates have shown that neurons in the dorsolateral prefrontal cortex have activity that persists throughout the delay period in delayed matching to sample tasks, and age-related changes in the microcolumnar organization of the prefrontal cortex are significantly correlated with age-related declines in cognition. Activity that persists beyond the presentation of a stimulus could mediate working memory processes, and disruption of those processes could account for memory deficits that often accompany the aging process. These potential memory and aging mechanisms are being systematically examined with eyeblink conditioning paradigms in nonprimate mammalian animal models including the rabbit. The trace version of the conditioning paradigm is a particularly good system to explore declarative memory since humans do not acquire trace conditioning if they are unable to become cognitively aware of the association between a conditioning tone and an airpuff to the eye. This conditioning paradigm has been used to show that the hippocampus and cerebellum interact functionally since both conditioned responses and conditioned hippocampal pyramidal neuron activity are abolished following lesions of the cerebellar nuclei and since hippocampal lesions prevent or abolish trace conditioned blinks. However, because there are no direct connections between the hippocampal formation and the cerebellum, and because the hippocampus is not necessary for trace conditioning after a period of consolidation has elapsed, we and others have been examining the prefrontal cortex for its role in forebrain-dependent trace eyeblink conditioning. This review examines some of the literature which suggests that the prefrontal cortex serves to orchestrate a neuronal network that interacts with the cerebellum to mediate adaptively timed conditioned responses.

Persistent activity in a cortical-to-subcortical circuit: bridging the temporal gap in trace eyelid conditioning

We have addressed the source and nature of the persistent neural activity that bridges the stimulus-free gap between the conditioned stimulus (CS) and unconditioned stimulus (US) during trace eyelid conditioning. Previous work has demonstrated that this persistent activity is necessary for trace eyelid conditioning: CS-elicited activity in mossy fiber inputs to the cerebellum does not extend into the stimulus-free trace interval, which precludes the cerebellar learning that mediates conditioned response expression. In behaving rabbits we used in vivo recordings from a region of medial prefrontal cortex (mPFC) that is necessary for trace eyelid conditioning to test the hypothesis that neurons there generate activity that persists beyond CS offset. These recordings revealed two patterns of activity during the trace interval that would enable cerebellar learning. Activity in some cells began during the tone CS and persisted to overlap with the US, whereas in other cells, activity began during the stimulus-free trace interval. Injection of anterograde tracers into this same region of mPFC revealed dense labeling in the pontine nuclei, where recordings also revealed tone-evoked persistent activity during trace conditioning. These data suggest a corticopontine pathway that provides an input to the cerebellum during trace conditioning trials that bridges the temporal gap between the CS and US to engage cerebellar learning. As such, trace eyelid conditioning represents a well-characterized and experimentally tractable system that can facilitate mechanistic analyses of cortical persistent activity and how it is used by downstream brain structures to influence behavior.

Multiple sites of extinction for a single learned response

Most learned responses can be diminished by extinction, a process that can be engaged when a conditioned stimulus (CS) is presented but not reinforced. We present evidence that plasticity in at least two brain regions can mediate extinction of responses produced by trace eyelid conditioning, where the CS and the reinforcing stimulus are separated by a stimulus-free interval. We observed individual differences in the effects of blocking extinction mechanisms in the cerebellum, the structure that, along with several forebrain structures, mediates acquisition of trace eyelid responses; in some rabbits extinction was prevented, whereas in others it was largely unaffected. We also show that cerebellar mechanisms can mediate extinction when noncerebellar mechanisms are bypassed. Together, these observations indicate that trace eyelid responses can be extinguished via processes operating at more than one site, one in the cerebellum and one upstream in forebrain. The relative contributions of these sites may vary from animal to animal and situation to situation.

Differential acetylcholine release in the prefrontal cortex and hippocampus during pavlovian trace and delay conditioning

Pavlovian trace conditioning critically depends on the medial prefrontal cortex (mPFC) and hippocampus (HPC), whereas delay conditioning does not depend on these brain structures. Given that the cholinergic basal forebrain system modulates activity in both the mPFC and HPC, it was reasoned that the level of acetylcholine (ACh) release in these regions would show distinct profiles during testing in trace and delay conditioning paradigms. To test this assumption, microdialysis probes were implanted unilaterally into the mPFC and HPC of rats that were pre-trained in appetitive trace and delay conditioning paradigms using different conditional stimuli in the two tasks. On the day of microdialysis testing, dialysate samples were collected during a quiet baseline interval before trials were initiated, and again during performance in separate blocks of trace and delay conditioning trials in each animal. ACh levels were quantified using high-performance liquid chromatography and electrochemical detection techniques. Consistent with our hypothesis, results showed that ACh release in the mPFC was greater during trace conditioning than during delay conditioning. The level of ACh released during trace conditioning in the HPC was also greater than the levels observed during delay conditioning. While ACh efflux in both the mPFC and HPC selectively increased during trace conditioning, ACh levels in the mPFC during trace conditioning testing showed the greatest increases observed. These results demonstrate a dissociation in cholinergic activation of the mPFC and HPC during performance in trace but not delay appetitive conditioning, where this cholinergic activity may contribute to attentional mechanisms, adaptive response timing, or memory consolidation necessary for successful trace conditioning.

A subtraction mechanism of temporal coding in cerebellar cortex

The temporally specific learning displayed by the cerebellum facilitates mechanistic analysis of neural timing and temporal coding. We report evidence for a subtraction-like mechanism of temporal coding in cerebellar cortex in which activity in a subset of granule cells specifically codes the interval between the offset of two mossy fiber inputs. In a large-scale cerebellar simulation, cessation of one of two ongoing mossy fiber inputs produces a robust temporal code in the population of granule cells. This activity supports simulation learning in response to temporal patterns of stimuli, even when those same stimuli do not support learning when presented individually. Using stimulation of mossy fiber inputs to the cerebellum as training stimuli in rabbits, we confirmed these unusual predictions in a cerebellum-dependent form of learning. Analysis of the simulations reveals a specific working hypothesis for this temporal subtraction process that involves interactions between granule cells and the inhibitory Golgi cells. The results suggest how feedforward inhibition, such as that present in the cerebellar cortex, can contribute to temporal coding.

Projection-specific neuromodulation of medial prefrontal cortex neurons

Mnemonic persistent activity in the prefrontal cortex (PFC) constitutes the neural basis of working memory. To understand how neuromodulators contribute to the generation of persistent activity, it is necessary to identify the intrinsic properties of the layer V pyramidal neurons that transfer this information to downstream networks. Here we show that the somatic dynamic and integrative properties of layer V pyramidal neurons in the rat medial PFC depend on whether they project subcortically to the pons [corticopontine (CPn)] or to the contralateral cortex [commissural (COM)]. CPn neurons display low temporal summation and accelerate in firing frequency when depolarized, whereas COM neurons have high temporal summation and display spike frequency accommodation. In response to dynamic stimuli, COM neurons act as low-pass filters, whereas CPn neurons act as bandpass filters, resonating in the theta frequency range (3-6 Hz). The disparate subthreshold properties of COM and CPn neurons can be accounted for by differences in the hyperpolarization-activated cyclic nucleotide gated cation h-current. Interestingly, neuromodulators hypothesized to enhance mnemonic persistent activity affect COM and CPn neurons distinctly. Adrenergic modulation shifts the dynamic properties of CPn but not COM neurons and increases the excitability of CPn neurons significantly more than COM neurons. In response to cholinergic modulation, CPn neurons were much more likely to display activity-dependent intrinsic persistent firing than COM neurons. Together, these data suggest that the two categories of projection neurons may subserve separate functions in PFC and may be engaged differently during working memory processes.