Neural circuitry and plasticity mechanisms underlying delay eyeblink conditioning

Using optically pumped magnetometers to measure magnetoencephalographic signals in the human cerebellum

Key points

The application of conventional cryogenic magnetoencephalography (MEG) to the study of cerebellar functions is highly limited because typical cryogenic sensor arrays are far away from the cerebellum and naturalistic movement is not allowed in the recording.

A new generation of MEG using optically pumped magnetometers (OPMs) that can be worn on the head during movement has opened up an opportunity to image the cerebellar electrophysiological activity non‐invasively.

We use OPMs to record human cerebellar MEG signals elicited by air‐puff stimulation to the eye.

We demonstrate robust responses in the cerebellum.

OPMs pave the way for studying the neurophysiology of the human cerebellum.

Abstract

We test the feasibility of an optically pumped magnetometer‐based magnetoencephalographic (OP‐MEG) system for the measurement of human cerebellar activity. This is to our knowledge the first study investigating the human cerebellar electrophysiology using optically pumped magnetometers. As a proof of principle, we use an air‐puff stimulus to the eyeball in order to elicit cerebellar activity that is well characterized in non‐human models. In three subjects, we observe an evoked component at approx. 50 ms post‐stimulus, followed by a second component at approx. 85–115 ms post‐stimulus. Source inversion localizes both components in the cerebellum, while control experiments exclude potential sources elsewhere. We also assess the induced oscillations, with time‐frequency decompositions, and identify additional sources in the occipital lobe, a region expected to be active in our paradigm, and in the neck muscles. Neither of these contributes to the stimulus‐evoked responses at 50–115 ms. We conclude that OP‐MEG technology offers a promising way to advance the understanding of the information processing mechanisms in the human cerebellum.

The application of conventional cryogenic magnetoencephalography (MEG) to the study of cerebellar functions is highly limited because typical cryogenic sensor arrays are far away from the cerebellum and naturalistic movement is not allowed in the recording.

A new generation of MEG using optically pumped magnetometers (OPMs) that can be worn on the head during movement has opened up an opportunity to image the cerebellar electrophysiological activity non‐invasively.

We use OPMs to record human cerebellar MEG signals elicited by air‐puff stimulation to the eye.

We demonstrate robust responses in the cerebellum.

OPMs pave the way for studying the neurophysiology of the human cerebellum.

mGluR1 in cerebellar Purkinje cells is essential for the formation but not expression of associative eyeblink memory

Classical eyeblink conditioning is a representative associative motor learning that requires both the cerebellar cortex and the deep cerebellar nucleus (DCN). Metabotropic glutamate receptor subtype 1 (mGluR1) is richly expressed in Purkinje cells (PCs) of the cerebellar cortex. Global mGluR1 knock-out (KO) mice show a significantly lower percentage of conditioned response (CR%) than wild-type mice in eyeblink conditioning, and the impaired CR% is restored by the introduction of mGluR1 in PCs. However, the specific roles of mGluR1 in major memory processes, including formation, storage and expression have not yet been defined. We thus examined the role of mGluR1 in these processes of eyeblink conditioning, using mGluR1 conditional KO (cKO) mice harboring a selective and reversible expression of mGluR1 in PCs. We have found that eyeblink memory is not latently formed in the absence of mGluR1 in adult mouse PCs. However, once acquired, eyeblink memory is expressed even after the depletion of mGluR1 in PCs. We thus conclude that mGluR1 in PCs is indispensable for the formation of eyeblink memory, while it is not required for the expression of CR.

Reevaluating the ability of cerebellum in associative motor learning

It has been well established that the cerebellum and its associated circuitry constitute the essential neuronal system for both delay and trace classical eyeblink conditioning (DEC and TEC). However, whether the cerebellum is sufficient to independently modulate the DEC, and TEC with a shorter trace interval remained controversial. Here, we used direct optogenetic stimulation of mossy fibers in the middle cerebellar peduncle (MCP) as a conditioned stimulus (CS) replacement for the peripheral CS (eg, a tone CS or a light CS) paired with a periorbital shock unconditioned stimulus (US) to examine the ability of the cerebellum to learn the DEC and the TEC with various trace intervals. Moreover, neural inputs to the pontine nucleus (PN) were pharmacological blocked to limit the associative motor learning inside the cerebellum. We show that all rats quickly acquired the DEC, indicating that direct optogenetic stimulation of mossy fibers in the left MCP is a very effective and sufficient CS to establish DEC and to limit the motor learning process inside the cerebellum. However, only five out of seven rats acquired the TEC with a 150-ms trace interval, three out of nine rats acquired the TEC with a 350-ms trace interval, and none of the rats acquired the TEC with a 500-ms trace interval. Moreover, pharmacological blocking glutamatergic and GABAergic inputs to the PN from the extra-cerebellar and cerebellar regions has no significant effect on the DEC and TEC learning with the optogenetic CS. These results indicate that the cerebellum has the ability to independently support both the simple DEC, and the TEC with a trace interval of 150 or 350 ms, but not the TEC with a trace interval of 500 ms. The present results are of great importance in our understanding of the mechanisms and ability of the cerebellum in associative motor learning and memory.

Spontaneous recovery of conditioned eyeblink responses is associated with transiently decreased cerebellar theta activity in guinea pigs

Behavioral studies have demonstrated that extinguished conditioned eyeblink responses (CR) can spontaneously recover after extinction. However, the neural mechanisms underlying this process are still unclear. We have shown that spontaneous cerebellar theta activity was predictive of subsequent CR extinction. Here, we sought to further evaluate the association between spontaneous recovery and cerebellar theta activity in behaving guinea pigs. It was found that trace conditioning training significantly diminished the degree of spontaneous recovery during extinction sessions as compared to delay training. Moreover, by recording local field potential in the cerebellum of guinea pigs undergoing an eyeblink conditioning extinction task, we found that spontaneous recovery of delay-paradigm CRs was associated with transiently decreased CS-evoked theta activity in the cerebellum. These findings suggest that decreased CS-evoked cerebellar theta activity may contribute to the neural process that is important for the spontaneous recovery of extinguished motor memory. Future studies are needed to clarify the neural mechanism underlying changed cerebellar theta activity during altered behavioral contingencies.

Inactivation of the interpositus nucleus blocks the acquisition of conditioned responses and timing changes in conditioning-specific reflex modification of the rabbit eyeblink response

Conditioning-specific reflex modification (CRM) of the rabbit eyeblink response is an associative phenomenon characterized by increases in the frequency, size, and peak latency of the reflexive unconditioned eyeblink response (UR) when the periorbital shock unconditioned stimulus (US) is presented alone following conditioning, particularly to lower intensity USs that produced minimal responding prior to conditioning. Previous work has shown that CRM shares many commonalities with the conditioned eyeblink response (CR) including a similar response topography, suggesting the two may share similar neural substrates. The following study examined the hypothesis that the interpositus nucleus (IP) of the cerebellum, an essential part of the neural circuitry of eyeblink conditioning, is also required for the acquisition of CRM. Tests for CRM occurred following delay conditioning under muscimol inactivation of the IP and also after additional conditioning without IP inactivation. Results showed that IP inactivation blocked acquisition of CRs and the timing aspect of CRM but did not prevent increases in UR amplitude and area. Following the cessation of inactivation, CRs and CRM latency changes developed similarly to controls with intact IP functioning, but with some indication that CRs may have been facilitated in muscimol rabbits. In conclusion, CRM timing and CRs both likely require the development of plasticity in the IP, but other associative UR changes may involve non-cerebellar structures interacting with the eyeblink conditioning circuitry, a strong candidate being the amygdala, which is also likely involved in the facilitation of conditioning. Other candidates worth consideration include the cerebellar cortex, prefrontal and motor cortices.

Impact of parallel fiber to Purkinje cell long-term depression is unmasked in absence of inhibitory input

Pavlovian eyeblink conditioning has been used extensively to study the neural mechanisms underlying associative and motor learning. During this simple learning task, memory formation takes place at Purkinje cells in defined areas of the cerebellar cortex, which acquire a strong temporary suppression of their activity during conditioning. Yet, it is unknown which neuronal plasticity mechanisms mediate this suppression. Two potential mechanisms include long-term depression of parallel fiber to Purkinje cell synapses and feed-forward inhibition by molecular layer interneurons. We show, using a triple transgenic approach, that only concurrent disruption of both these suppression mechanisms can severely impair conditioning, highlighting that both processes can compensate for each other's deficits.

Classical Short-Delay Eyeblink Conditioning in One-Year-Old Children

Classical eyeblink conditioning (EBC) refers to the learned association between a conditioned stimulus (an auditory tone) and an unconditioned stimulus (a puff of air to the cornea). Eyeblink conditioning is often used experimentally to detect abnormalities in cerebellar-dependent learning and memory that underlies this type of associative learning. While experiments in adults and older children are relatively simple to administer using commercial equipment, eyeblink conditioning in infants is more challenging due to their poor compliance, which makes correct positioning of the equipment difficult. To achieve conditioning in one-year-old infants, a custom-made or an adapted commercial system can be used to deliver the air puff to the infant's cornea. The main challenge lies in successfully detecting and classifying the behavioral responses. We report that automated blink detection methods are unreliable in this population, and that conditioning experiments should be analyzed using frame-by-frame analysis of supplementary video camera recordings. This method can be applied to study developmental changes in eyeblink conditioning and to examine whether this paradigm can detect children with neurological disorders.

The negotiated equilibrium model of spinal cord function

The belief that the spinal cord is hardwired is no longer tenable. Like the rest of the CNS, the spinal cord changes during growth and ageing, when new motor behaviours are acquired, and in response to trauma and disease. This paper describes a new model of spinal cord function that reconciles its recently appreciated plasticity with its long-recognized reliability as the final common pathway for behaviour. According to this model, the substrate of each motor behaviour comprises brain and spinal plasticity: the plasticity in the brain induces and maintains the plasticity in the spinal cord. Each time a behaviour occurs, the spinal cord provides the brain with performance information that guides changes in the substrate of the behaviour. All the behaviours in the repertoire undergo this process concurrently; each repeatedly induces plasticity to preserve its key features despite the plasticity induced by other behaviours. The aggregate process is a negotiation among the behaviours: they negotiate the properties of the spinal neurons and synapses that they all use. The ongoing negotiation maintains the spinal cord in an equilibrium - a negotiated equilibrium - that serves all the behaviours. This new model of spinal cord function is supported by laboratory and clinical data, makes predictions borne out by experiment, and underlies a new approach to restoring function to people with neuromuscular disorders. Further studies are needed to test its generality, to determine whether it may apply to other CNS areas such as the cerebral cortex, and to develop its therapeutic implications.

Timing correlations between cerebellar interpositus neuronal firing and classically conditioned eyelid responses in wild-type and Lurcher mice

Classical eyeblink conditioning is an experimental model widely used for the study of the neuronal mechanisms underlying the acquisition of new motor and cognitive skills. There are two principal interpretations of the role of the cerebellum in the learning of eyelid conditioned responses (CRs). One considers that the cerebellum is the place where this learning is acquired and stored, while the second suggests that the cerebellum is mostly involved in the proper performance of acquired CRs, implying that there must be other brain areas involved in the learning process. We checked the timing of cerebellar interpositus nucleus (IPN) neurons’ firing rate with eyelid CRs in both wild-type (WT) and Lurcher (a model of cerebellar cortex degeneration) mice. We used delay and trace conditioning paradigms. WT mice presented a better execution for delay vs. trace conditioning and also for these two paradigms than did Lurcher mice. IPN neurons were activated during CRs following the activation of the orbicularis oculi muscle. Firing patterns of IPN neurons were altered in Lurcher mice. In conclusion, the cerebellum seems to be mostly related with the performance of conditioned responses, rather than with their acquisition.

Cannabinoid agonist administration within the cerebellar cortex impairs motor learning

Systemic administration of cannabinoid agonists impairs cerebellum-dependent motor learning. The cannabinoid-induced impairment of motor learning has been hypothesized to be due to disruption of Purkinje cell plasticity within the cerebellar cortex. In the current study, we tested this hypothesis in rats with localized microinfusions of cannabinoid agonists and antagonists into the cerebellar cortex during eyeblink conditioning, a type of cerebellum-dependent motor learning. Infusions of the cannabinoid agonists WIN55,212-2 or ACEA directly into the eyeblink conditioning microzone of the cerebellar cortex severely impaired acquisition of eyeblink conditioning, whereas the CB1R antagonist SR141716A did not produce a significant impairment. Infusions of WIN55,212-2 outside of the eyeblink conditioning microzone did not impair motor learning, establishing anatomical specificity for the agonist effects. The motor learning impairment caused by WIN55,212-2 and ACEA was rescued by SR141716A, indicating that the learning deficit was produced through CB1Rs. The current findings demonstrate that the effects of cannabinoid receptor agonists on motor learning are localized to CB1Rs within a discrete microzone of the cerebellar cortex.

Video-based data acquisition system for use in eye blink classical conditioning procedures in sheep

Pavlovian eye blink conditioning (EBC) has been extensively studied in humans and laboratory animals, providing one of the best-understood models of learning in neuroscience. EBC has been especially useful in translational studies of cerebellar and hippocampal function. We recently reported a novel extension of EBC procedures for use in sheep, and now describe new advances in a digital video-based system. The system delivers paired presentations of conditioned stimuli (CSs; a tone) and unconditioned stimuli (USs; an air puff to the eye), or CS-alone "unpaired" trials. This system tracks the linear distance between the eyelids to identify blinks occurring as either unconditioned (URs) or conditioned (CRs) responses, to a resolution of 5 ms. A separate software application (Eye Blink Reviewer) is used to review and autoscore the trial CRs and URs, on the basis of a set of predetermined rules, permitting an operator to confirm (or rescore, if needed) the autoscore results, thereby providing quality control for accuracy of scoring. Learning curves may then be quantified in terms of the frequencies of CRs over sessions, both on trials with paired CS-US presentations and on CS-alone trials. The latency to CR onset, latency to CR peak, and occurrence of URs are also obtained. As we demonstrated in two example cases, this video-based system provides efficient automated means to conduct EBC in sheep and can facilitate fully powered studies with multigroup designs that involve paired and unpaired training. This can help extend new studies in sheep, a species well suited for translational studies of neurodevelopmental disorders resulting from gestational exposure to drugs, toxins, or intrauterine distress.

Central amygdala lesions inhibit pontine nuclei acoustic reactivity and retard delay eyeblink conditioning acquisition in adult rats

In delay eyeblink conditioning (EBC) a neutral conditioned stimulus (CS; tone) is repeatedly paired with a mildly aversive unconditioned stimulus (US; periorbital electrical shock). Over training, subjects learn to produce an anticipatory eyeblink conditioned response (CR) during the CS, prior to US onset. While cerebellar synaptic plasticity is necessary for successful EBC, the amygdala is proposed to enhance eyeblink CR acquisition. In the current study, adult Long-Evans rats received bilateral sham or neurotoxic lesions of the central nucleus of the amygdala (CEA) followed by 1 or 4 EBC sessions. Fear-evoked freezing behavior, CS-mediated enhancement of the unconditioned response (UR), and eyeblink CR acquisition were all impaired in the CEA lesion rats relative to sham controls. There were also significantly fewer c-Fos immunoreactive cells in the pontine nuclei (PN)-major relays of acoustic information to the cerebellum-following the first and fourth EBC session in lesion rats. In sham rats, freezing behavior decreased from session 1 to 4, commensurate with nucleus-specific reductions in amygdala Fos+ cell counts. Results suggest delay EBC proceeds through three stages: in stage one the amygdala rapidly excites diffuse fear responses and PN acoustic reactivity, facilitating cerebellar synaptic plasticity and the development of eyeblink CRs in stage two, leading, in stage three, to a diminution or stabilization of conditioned fear responding.

Propranolol produces short-term facilitation of extinction in a rabbit model of post-traumatic stress disorder

Post-traumatic stress disorder (PTSD) is a learning-based anxiety disorder with significant public health challenges due to difficulties in treating the complex, multiple symptomology. We have developed an animal model of PTSD, based on Pavlovian eyeblink conditioning in rabbits, that addresses two key features: conditioned responses (CRs) to cues associated with an aversive event and a form of conditioned hyperarousal referred to as conditioning-specific reflex modification (CRM). We have found previously that unpaired extinction is ideal for reducing both CRs and CRM simultaneously and shows sensitivity to systemic serotonergic and glutamatergic manipulations. The following study aimed to extend our work to examine the role of the noradrenergic system, dysregulation of which is strongly implicated as part of the neurobiology of PTSD and which may also play a role in the balance shift from fear reconsolidation to extinction during treatment. The goal of the following two studies was to examine whether the β-adrenergic receptor antagonist propranolol combined with either a full or brief course of unpaired extinction treatment could enhance extinction of CRs and/or CRM. Results showed a within-session facilitation of propranolol on extinction of CRs, particularly during the first extinction session, and a short-term enhancement of extinction of CRM when extinction treatment was brief. However, neither benefit translated to long-term extinction retention for the majority of subjects. Findings suggest that propranolol may provide the most therapeutic benefit in situations of high arousal early in treatment, which may be more important for future patient compliance rather than long-term treatment outcomes.

No Medium-Term Spinocerebellar Input Plasticity in Deep Cerebellar Nuclear Neurons In Vivo?

The existence of input plasticity in the deep cerebellar nuclear (DCN) cells of the adult cerebellum could have profound implications for our understanding of cerebellar function. Whereas the existence of plastic changes in mossy fiber (mf) synaptic responses in DCN neurons has been demonstrated in juvenile slices, there has so far been no direct demonstration of this form of plasticity in the adult cerebellum in vivo. In the present paper, we recorded from neurons in the anterior interposed nucleus (AIN) and stimulated the spinocerebellar tracts (SCT) directly or via the skin to obtain mf activation and the inferior olive to activate climbing fibers (cfs) in the nonanesthetized, adult, decerebrated cat. We used three different types of protocols that theoretically could be expected to induce plasticity, each of which involved episodically intense afferent activation lasting for 10 min. These were conjunctive mf-cf activation, which effectively induces plasticity in cortical neurons; mf and cf activation in a pattern resembling the protocol for inducing classical conditioning; and conjunctive activation of two excitatory mf inputs. None of these protocols had any statistically significant effect on the evoked responses in the AIN neurons. We conclude that the input plasticity for excitatory mfs in the AIN cells of the adult cerebellum in vivo is likely to be less effective than that of parallel fiber synaptic inputs in cerebellar cortical cells, at least in the timespan of 1 h.

Modulation of 7 T fMRI Signal in the Cerebellar Cortex and Nuclei During Acquisition, Extinction, and Reacquisition of Conditioned Eyeblink Responses

Classical delay eyeblink conditioning is likely the most commonly used paradigm to study cerebellar learning. As yet, few studies have focused on extinction and savings of conditioned eyeblink responses (CRs). Saving effects, which are reflected in a reacquisition after extinction that is faster than the initial acquisition, suggest that learned associations are at least partly preserved during extinction. In this study, we tested the hypothesis that acquisition-related plasticity is nihilated during extinction in the cerebellar cortex, but retained in the cerebellar nuclei, allowing for faster reacquisition. Changes of 7 T functional magnetic resonance imaging (fMRI) signals were investigated in the cerebellar cortex and nuclei of young and healthy human subjects. Main effects of acquisition, extinction, and reacquisition against rest were calculated in conditioned stimulus-only trials. First-level β values were determined for a spherical region of interest (ROI) around the acquisition peak voxel in lobule VI, and dentate and interposed nuclei ipsilateral to the unconditioned stimulus. In the cerebellar cortex and nuclei, fMRI signals were significantly lower in extinction compared to acquisition and reacquisition, but not significantly different between acquisition and reacquisition. These findings are consistent with the theory of bidirectional learning in both the cerebellar cortex and nuclei. It cannot explain, however, why conditioned responses reappear almost immediately in reacquisition following extinction. Although the present data do not exclude that part of the initial memory remains in the cerebellum in extinction, future studies should also explore changes in extracerebellar regions as a potential substrate of saving effects. Hum Brain Mapp 38:3957-3974, 2017. © 2017 Wiley Periodicals, Inc.

Cerebellar granule cells acquire a widespread predictive feedback signal during motor learning

Cerebellar granule cells, which constitute half the brain's neurons, supply Purkinje cells with contextual information necessary for motor learning, but how they encode this information is unknown. Here we show, using two-photon microscopy to track neural activity over multiple days of cerebellum-dependent eyeblink conditioning in mice, that granule cell populations acquire a dense representation of the anticipatory eyelid movement. Initially, granule cells responded to neutral visual and somatosensory stimuli as well as periorbital airpuffs used for training. As learning progressed, two-thirds of monitored granule cells acquired a conditional response whose timing matched or preceded the learned eyelid movements. Granule cell activity covaried trial by trial to form a redundant code. Many granule cells were also active during movements of nearby body structures. Thus, a predictive signal about the upcoming movement is widely available at the input stage of the cerebellar cortex, as required by forward models of cerebellar control.

Are Purkinje Cell Pauses Drivers of Classically Conditioned Blink Responses?

Several lines of evidence show that classical or Pavlovian conditioning of blink responses depends on the cerebellum. Recordings from cerebellar Purkinje cells that control the eyelid and the conditioned blink show that during training with a conditioning protocol, a Purkinje cell develops a pause response to the conditional stimulus. This conditioned cellular response has many of the properties that characterise the overt blink. The present paper argues that the learned Purkinje cell pause response is the memory trace and main driver of the overt conditioned blink and that it explains many well-known behavioural phenomena.

The reference frame of the tilt aftereffect measured by differential Pavlovian conditioning

We used a differential Pavlovian conditioning paradigm to measure tilt aftereffect (TAE) strength. Gabor patches, rotated clockwise and anticlockwise, were used as conditioned stimuli (CSs), one of which (CS+) was followed by the unconditioned stimulus (UCS), whereas the other (CS−) appeared alone. The UCS was an air puff delivered to the left eye. In addition to the CS+ and CS−, the vertical test patch was also presented for the clockwise and anticlockwise adapters. The vertical patch was not followed by the UCS. After participants acquired differential conditioning, eyeblink conditioned responses (CRs) were observed for the vertical patch when it appeared to be tilted in the same direction as the CS+ owing to the TAE. The effect was observed not only when the adapter and test stimuli were presented in the same retinotopic position but also when they were presented in the same spatiotopic position, although spatiotopic TAE was weak—it occurred approximately half as often as the full effect. Furthermore, spatiotopic TAE decayed as the time after saccades increased, but did not decay as the time before saccades increased. These results suggest that the time before the performance of saccadic eye movements is needed to compute the spatiotopic representation.

Relational and procedural memory systems in the goldfish brain revealed by trace and delay eyeblink-like conditioning

The presence of multiple memory systems supported by different neural substrata has been demonstrated in animal and human studies. In mammals, two variants of eyeblink classical conditioning, differing only in the temporal relationships between the conditioned stimulus (CS) and the unconditioned stimulus (US), have been widely used to study the neural substrata of these different memory systems. Delay conditioning, in which both stimuli coincide in time, depends on a non-relational memory system supported by the cerebellum and associated brainstem circuits. In contrast, trace conditioning, in which a stimulus-free time gap separates the CS and the US, requires a declarative or relational memory system, thus depending on forebrain structures in addition to the cerebellum. The distinction between the explicit or relational and the implicit or procedural memory systems that support trace and delay classical conditioning has been extensively studied in mammals, but studies in other vertebrate groups are relatively scarce. In the present experiment we analyzed the differential involvement of the cerebellum and the telencephalon in delay and trace eyeblink-like classical conditioning in goldfish. The results show that whereas the cerebellum lesion prevented the eyeblink-like conditioning in both procedures, the telencephalon ablation impaired exclusively the acquisition of the trace conditioning. These data showing that comparable neural systems support delay and trace eyeblink conditioning in teleost fish and mammals suggest that these separate memory systems and their neural bases could be a shared ancestral brain feature of the vertebrate lineage.

Cannabinoid modulation of memory consolidation within the cerebellum

Cannabinoid receptors contribute to learning and synaptic plasticity mechanisms. The cerebellum contains a high density of cannabinoid receptors and manipulations of cannabinoid receptors affect synaptic plasticity within the cerebellar cortex. In vivo studies have found that cannabinoid agonists impair learning of cerebellum-dependent eyeblink conditioning in rodents and humans. However, the role of cannabinoid receptors or endocannabinoids in memory consolidation within the cerebellum has not been examined. In the current study, we examined the role of cannabinoid receptors and endocannabinoids during learning and consolidation of eyeblink conditioning in rats. Administration of the cannabinoid receptor agonist WIN55,212-2 or drugs that increase/decrease endocannabinoid levels directly into the cerebellar cortex before each training session resulted in marked learning impairments. When administered 1 h after each training session, during memory consolidation, the cannabinoid inverse agonist SR141716A or the endocannabinoid suppressor THL impaired memory. In contrast, increasing endocannabinoid levels with JZL-184 or infusion of WIN55,212-2 within the cerebellar cortex facilitated memory consolidation 1h post-training. Intracerebellar manipulations of cannabinoid receptors or endocannabinoid levels had no effect on memory consolidation when administered 3 or 6h after each training session. The results demonstrate that cannabinoids impair cerebellar learning, but facilitate memory consolidation mechanisms within the cerebellar cortex 1-3h after training.

Developmental Changes in Hippocampal CA1 Single Neuron Firing and Theta Activity during Associative Learning

Hippocampal development is thought to play a crucial role in the emergence of many forms of learning and memory, but ontogenetic changes in hippocampal activity during learning have not been examined thoroughly. We examined the ontogeny of hippocampal function by recording theta and single neuron activity from the dorsal hippocampal CA1 area while rat pups were trained in associative learning. Three different age groups [postnatal days (P)17-19, P21-23, and P24-26] were trained over six sessions using a tone conditioned stimulus (CS) and a periorbital stimulation unconditioned stimulus (US). Learning increased as a function of age, with the P21-23 and P24-26 groups learning faster than the P17-19 group. Age- and learning-related changes in both theta and single neuron activity were observed. CA1 pyramidal cells in the older age groups showed greater task-related activity than the P17-19 group during CS-US paired sessions. The proportion of trials with a significant theta (4-10 Hz) power change, the theta/delta ratio, and theta peak frequency also increased in an age-dependent manner. Finally, spike/theta phase-locking during the CS showed an age-related increase. The findings indicate substantial developmental changes in dorsal hippocampal function that may play a role in the ontogeny of learning and memory.

HPA Axis Interactions with Behavioral Systems

Perhaps the most salient behaviors that individuals engage in involve the avoidance of aversive experiences and the pursuit of pleasurable experiences. Engagement in these behaviors is regulated to a significant extent by an individual's hormonal milieu. For example, glucocorticoid hormones are produced by the hypothalamic-pituitary-adrenocortical (HPA) axis, and influence most aspects of behavior. In turn, many behaviors can influence HPA axis activity. These bidirectional interactions not only coordinate an individual's physiological and behavioral states to each other, but can also tune them to environmental conditions thereby optimizing survival. The present review details the influence of the HPA axis on many types of behavior, including appetitively-motivated behaviors (e.g., food intake and drug use), aversively-motivated behaviors (e.g., anxiety-related and depressive-like) and cognitive behaviors (e.g., learning and memory). Conversely, the manuscript also describes how engaging in various behaviors influences HPA axis activity. Our current understanding of the neuronal and/or hormonal mechanisms that underlie these interactions is also summarized. © 2016 American Physiological Society. Compr Physiol 6:1897-1934, 2016.

The inferior olive is essential for long-term maintenance of a simple motor skill

The inferior olive (IO) is essential for operant down-conditioning of the rat soleus H-reflex, a simple motor skill. To evaluate the role of the IO in long-term maintenance of this skill, the H-reflex was down-conditioned over 50 days, the IO was chemically ablated, and down-conditioning continued for up to 102 more days. H-reflex size just before IO ablation averaged 62(±2 SE)% of its initial value (P < 0.001 vs. initial). After IO ablation, H-reflex size rose to 75-80% over ∼10 days, remained there for ∼30 days, rose over 10 days to above its initial value, and averaged 140(±14)% for the final 10 days of study (P < 0.01 vs. initial). This two-stage loss of down-conditioning maintenance correlated with IO neuronal loss (r = 0.75, P < 0.01) and was similar to the loss of down-conditioning that follows ablation of the cerebellar output nuclei dentate and interpositus. In control (i.e., unconditioned) rats, IO ablation has no long-term effect on H-reflex size. These results indicate that the IO is essential for long-term maintenance of a down-conditioned H-reflex. With previous data, they support the hypothesis that IO and cortical inputs to cerebellum combine to produce cerebellar plasticity that produces sensorimotor cortex plasticity that produces spinal cord plasticity that produces the smaller H-reflex. H-reflex down-conditioning appears to depend on a hierarchy of plasticity that may be guided by the IO and begin in the cerebellum. Similar hierarchies may underlie other motor learning.

Active Inference and Learning in the Cerebellum

This letter offers a computational account of Pavlovian conditioning in the cerebellum based on active inference and predictive coding. Using eyeblink conditioning as a canonical paradigm, we formulate a minimal generative model that can account for spontaneous blinking, startle responses, and (delay or trace) conditioning. We then establish the face validity of the model using simulated responses to unconditioned and conditioned stimuli to reproduce the sorts of behavior that are observed empirically. The scheme's anatomical validity is then addressed by associating variables in the predictive coding scheme with nuclei and neuronal populations to match the (extrinsic and intrinsic) connectivity of the cerebellar (eyeblink conditioning) system. Finally, we try to establish predictive validity by reproducing selective failures of delay conditioning, trace conditioning, and extinction using (simulated and reversible) focal lesions. Although rather metaphorical, the ensuing scheme can account for a remarkable range of anatomical and neurophysiological aspects of cerebellar circuitry-and the specificity of lesion-deficit mappings that have been established experimentally. From a computational perspective, this work shows how conditioning or learning can be formulated in terms of minimizing variational free energy (or maximizing Bayesian model evidence) using exactly the same principles that underlie predictive coding in perception.

Amygdala Modulation of Cerebellar Learning

Previous studies showed that amygdala lesions or inactivation slow the acquisition rate of cerebellum-dependent eyeblink conditioning, a type of associative motor learning. The current study was designed to determine the behavioral nature of amygdala-cerebellum interactions, to identify the neural pathways underlying amygdala-cerebellum interactions, and to examine how the amygdala influences cerebellar learning mechanisms in rats. Pharmacological inactivation of the central amygdala (CeA) severely impaired acquisition and retention of eyeblink conditioning, indicating that the amygdala continues to interact with the cerebellum after conditioning is consolidated (Experiment 1). CeA inactivation also substantially reduced stimulus-evoked and learning-related neuronal activity in the cerebellar anterior interpositus nucleus during acquisition and retention of eyeblink conditioning (Experiment 2). A very small proportion of cerebellar neurons responded to the conditioned stimulus (CS) during CeA inactivation. Finally, retrograde and anterograde tracing experiments identified the basilar pontine nucleus at the confluence of outputs from CeA that may support amygdala modulation of CS input to the cerebellum (Experiment 3). Together, these results highlight a role for the CeA in the gating of CS-related input to the cerebellum during motor learning that is maintained even after the conditioned response is well learned.

SIGNIFICANCE STATEMENT

The current study is the first to demonstrate that the amygdala modulates sensory-evoked and learning-related neuronal activity within the cerebellum during acquisition and retention of associative learning. The findings suggest a model of amygdala-cerebellum interactions in which the amygdala gates conditioned stimulus inputs to the cerebellum through a direct projection from the medial central nucleus to the basilar pontine nucleus. Amygdala gating of sensory input to the cerebellum may be an attention-like mechanism that facilitates cerebellar learning. In contrast to previous theories of amygdala-cerebellum interactions, the sensory gating hypothesis posits that the gating mechanism continues to be necessary for retrieval of cerebellar memory after learning is well established.

Retention of eyeblink conditioning in periweanling and adult rats

Eyeblink conditioning is a well-established model for studying the developmental neurobiology of associative learning and memory, though nothing is known regarding developmental differences in retention between periweanling and adult rats. The present study examined retention of eyeblink conditioning in periweanling (postnatal day 24 at the start of training) and adult rats 1, 7, or 28 days after acquisition. Retention was assessed by (1) a conditional stimulus (CS)-alone test session followed by (2) CS-unconditional stimulus (US) reacquisition tests. Conditional response (CR) levels at acquisition were comparable in most respects between ages, and robust CR levels were present at the start of retention tests for both ages in the 1 day group, with CR percentages at block 1 of reacquisition higher in periweanlings relative to adults. At the 7 day retention test there was a trend toward significance for higher CR percentages at the CS-alone test in adults relative to periweanlings, though there were no age differences at reacquisition testing. When testing occurred 28 days after acquisition, however, periweanlings showed fewer CRs relative to adults during reacquisition despite low CR levels in both ages throughout the CS-alone test. Furthermore, periweanlings in the 28 day group required more trials at reacquisition than all other groups to exceed CR levels from their first acquisition session. These findings are consistent with rapid forgetting in the young commonly referred to as "infantile amnesia." The well-characterized eyeblink preparation may be useful for future studies investigating neural mechanisms responsible for rapid forgetting in developing animals.

Asymmetries in Cerebellar Plasticity and Motor Learning

Synaptic plasticity at the parallel fiber to Purkinje cell synapse has long been considered a cellular correlate for cerebellar motor learning. Functionally, long-term depression and long-term potentiation at these synapses seem to be the reverse of each other, with both pre- and post-synaptic expression occurring in both. However, different cerebellar motor learning paradigms have been shown to be asymmetric and not equally reversible. Here, we discuss the asymmetric reversibility shown in the vestibulo-ocular reflex and eyeblink conditioning and suggest that different cellular plasticity mechanisms might be recruited under different conditions leading to unequal reversibility.

Theta synchronization between medial prefrontal cortex and cerebellum is associated with adaptive performance of associative learning behavior

Associative learning is thought to require coordinated activities among distributed brain regions. For example, to direct behavior appropriately, the medial prefrontal cortex (mPFC) must encode and maintain sensory information and then interact with the cerebellum during trace eyeblink conditioning (TEBC), a commonly-used associative learning model. However, the mechanisms by which these two distant areas interact remain elusive. By simultaneously recording local field potential (LFP) signals from the mPFC and the cerebellum in guinea pigs undergoing TEBC, we found that theta-frequency (5.0-12.0 Hz) oscillations in the mPFC and the cerebellum became strongly synchronized following presentation of auditory conditioned stimulus. Intriguingly, the conditioned eyeblink response (CR) with adaptive timing occurred preferentially in the trials where mPFC-cerebellum theta coherence was stronger. Moreover, both the mPFC-cerebellum theta coherence and the adaptive CR performance were impaired after the disruption of endogenous orexins in the cerebellum. Finally, association of the mPFC -cerebellum theta coherence with adaptive CR performance was time-limited occurring in the early stage of associative learning. These findings suggest that the mPFC and the cerebellum may act together to contribute to the adaptive performance of associative learning behavior by means of theta synchronization.

Ablation of the inferior olive prevents H-reflex down-conditioning in rats

We evaluated the role of the inferior olive (IO) in acquisition of the spinal cord plasticity that underlies H-reflex down-conditioning, a simple motor skill. The IO was chemically ablated before a 50-day exposure to an operant conditioning protocol that rewarded a smaller soleus H-reflex. In normal rats, down-conditioning succeeds (i.e., H-reflex size decreases at least 20%) in 80% of animals. Down-conditioning failed in every IO-ablated rat (P< 0.001 vs. normal rats). IO ablation itself had no long-term effect on H-reflex size. These results indicate that the IO is essential for acquisition of a down-conditioned H-reflex. With previous data, they support the hypothesis that IO and cortical inputs to cerebellum enable the cerebellum to guide sensorimotor cortex plasticity that produces and maintains the spinal cord plasticity that underlies the down-conditioned H-reflex. They help to further define H-reflex conditioning as a model for understanding motor learning and as a new approach to enhancing functional recovery after trauma or disease.

New Insights into the Nature of Cerebellar-Dependent Eyeblink Conditioning Deficits in Schizophrenia: A Hierarchical Linear Modeling Approach

Evidence of cerebellar dysfunction in schizophrenia has mounted over the past several decades, emerging from neuroimaging, neuropathological, and behavioral studies. Consistent with these findings, cerebellar-dependent delay eyeblink conditioning (dEBC) deficits have been identified in schizophrenia. While repeated-measures analysis of variance is traditionally used to analyze dEBC data, hierarchical linear modeling (HLM) more reliably describes change over time by accounting for the dependence in repeated-measures data. This analysis approach is well suited to dEBC data analysis because it has less restrictive assumptions and allows unequal variances. The current study examined dEBC measured with electromyography in a single-cue tone paradigm in an age-matched sample of schizophrenia participants and healthy controls (N = 56 per group) using HLM. Subjects participated in 90 trials (10 blocks) of dEBC, during which a 400 ms tone co-terminated with a 50 ms air puff delivered to the left eye. Each block also contained 1 tone-alone trial. The resulting block averages of dEBC data were fitted to a three-parameter logistic model in HLM, revealing significant differences between schizophrenia and control groups on asymptote and inflection point, but not slope. These findings suggest that while the learning rate is not significantly different compared to controls, associative learning begins to level off later and a lower ultimate level of associative learning is achieved in schizophrenia. Given the large sample size in the present study, HLM may provide a more nuanced and definitive analysis of differences between schizophrenia and controls on dEBC.

Hippocampal Non-Theta-Contingent Eyeblink Classical Conditioning: A Model System for Neurobiological Dysfunction

Typical information processing is thought to depend on the integrity of neurobiological oscillations that may underlie coordination and timing of cells and assemblies within and between structures. The 3-7 Hz bandwidth of hippocampal theta rhythm is associated with cognitive processes essential to learning and depends on the integrity of cholinergic, GABAergic, and glutamatergic forebrain systems. Since several significant psychiatric disorders appear to result from dysfunction of medial temporal lobe (MTL) neurochemical systems, preclinical studies on animal models may be an important step in defining and treating such syndromes. Many studies have shown that the amount of hippocampal theta in the rabbit strongly predicts the acquisition rate of classical eyeblink conditioning and that impairment of this system substantially slows the rate of learning and attainment of asymptotic performance. Our lab has developed a brain-computer interface that makes eyeblink training trials contingent upon the explicit presence or absence of hippocampal theta. The behavioral benefit of theta-contingent training has been demonstrated in both delay and trace forms of the paradigm with a two- to fourfold increase in learning speed over non-theta states. The non-theta behavioral impairment is accompanied by disruption of the amplitude and synchrony of hippocampal local field potentials, multiple-unit excitation, and single-unit response patterns dependent on theta state. Our findings indicate a significant electrophysiological and behavioral impact of the pretrial state of the hippocampus that suggests an important role for this MTL system in associative learning and a significant deleterious impact in the absence of theta. Here, we focus on the impairments in the non-theta state, integrate them into current models of psychiatric disorders, and suggest how improvement in our understanding of neurobiological oscillations is critical for theories and treatment of psychiatric pathology.

Climbing fibers encode a temporal-difference prediction error during cerebellar learning in mice

Climbing fiber inputs to Purkinje cells are thought to play a teaching role by generating the instructive signals that drive cerebellar learning. To investigate how these instructive signals are encoded, we recorded the activity of individual climbing fibers during cerebellar-dependent eyeblink conditioning in mice. Our findings show that climbing fibers signal both the unexpected delivery and the unexpected omission of the periocular airpuff that serves as the instructive signal for eyeblink conditioning. In addition, we report the surprising discovery that climbing fibers activated by periocular airpuffs also respond to stimuli from other sensory modalities, if those stimuli are novel or if they predict that the periocular airpuff is about to be presented. This pattern of climbing fiber activity is strikingly similar to the responses of dopamine neurons during reinforcement learning, which have been shown to encode a particular type of instructive signal known as a temporal difference prediction error.

Effects of extinction treatments on the reduction of conditioned responding and conditioned hyperarousal in a rabbit model of posttraumatic stress disorder (PTSD)

We have previously characterized a model of posttraumatic stress disorder (PTSD), based on classical conditioning of the rabbit nictitating membrane response (NMR), that focuses on 2 key PTSD-like features: conditioned responses to trauma-associated cues and hyperarousal. In addition to the development of conditioned NMRs (CRs) to a tone conditioned stimulus (CS) associated with a periorbital shock unconditioned stimulus (US), we have observed that rabbits also exhibit a conditioning-specific reflex modification (CRM) of the NMR that manifests as an exaggerated and more complex reflexive NMR to presentations of the US by itself, particularly to intensities that elicited little response prior to conditioning. Previous work has demonstrated that unpaired presentations of the CS and US are successful at extinguishing CRs and CRM simultaneously, even when a significantly weakened version of the US is utilized. In the current study, additional extinction treatments were tested, including continued pairings of the CS with a weakened US and exposure to the training context alone, and these treatments were contrasted with the effects of unpaired extinction with a weakened US and remaining in home cages with no further treatment. Results showed that continued pairings only slightly decreased CRs and CRM, while context exposure had no effect on CRs and marginal effects on reducing CRM. Unpaired extinction was still the most effective treatment for reducing both. Findings are discussed in terms of applications to cognitive-behavioral therapies for treatment of PTSD, such as incorporating mild, innately stressful stimuli into virtual reality therapy.

The role of cerebellar circuitry alterations in the pathophysiology of autism spectrum disorders

The cerebellum has been repeatedly implicated in gene expression, rodent model and post-mortem studies of autism spectrum disorder (ASD). How cellular and molecular anomalies of the cerebellum relate to clinical manifestations of ASD remains unclear. Separate circuits of the cerebellum control different sensorimotor behaviors, such as maintaining balance, walking, making eye movements, reaching, and grasping. Each of these behaviors has been found to be impaired in ASD, suggesting that multiple distinct circuits of the cerebellum may be involved in the pathogenesis of patients' sensorimotor impairments. We will review evidence that the development of these circuits is disrupted in individuals with ASD and that their study may help elucidate the pathophysiology of sensorimotor deficits and core symptoms of the disorder. Preclinical studies of monogenetic conditions associated with ASD also have identified selective defects of the cerebellum and documented behavioral rescues when the cerebellum is targeted. Based on these findings, we propose that cerebellar circuits may prove to be promising targets for therapeutic development aimed at rescuing sensorimotor and other clinical symptoms of different forms of ASD.

Relating cerebellar purkinje cell activity to the timing and amplitude of conditioned eyelid responses

How Purkinje cell (PC) activity may be altered by learning is central to theories of the cerebellum. Pavlovian eyelid conditioning, because of how directly it engages the cerebellum, has helped reveal many aspects of cerebellar learning and the underlying mechanisms. Theories of cerebellar learning assert that climbing fiber inputs control plasticity at synapses onto PCs, and thus PCs control the expression of learned responses. We tested this assertion by recording 184 eyelid PCs and 240 non-eyelid PCs during the expression of conditioned eyelid responses (CRs) in well trained rabbits. By contrasting the responses of eyelid and non-eyelid PCs and by contrasting the responses of eyelid PCs under conditions that produce differently timed CRs, we test the hypothesis that learning-related changes in eyelid PCs contribute to the learning and adaptive timing of the CRs. We used a variety of analyses to test the quantitative relationships between eyelid PC responses and the kinematic properties of the eyelid CRs. We find that the timing of eyelid PC responses varies systematically with the timing of the behavioral CRs and that there are differences in the magnitude of eyelid PC responses between larger-CR, smaller-CR, and non-CR trials. However, eyelid PC activity does not encode any single kinematic property of the behavioral CRs at a fixed time lag, nor does it linearly encode CR amplitude. Even so, the results are consistent with the hypothesis that learning-dependent changes in PC activity contribute to the adaptively timed expression of conditioned eyelid responses.

Spinal circuits for motor learning

Studies of motor learning have largely focussed on the cerebellum, and have provided key concepts about neural circuits required. However, other parts of the nervous system are involved in learning, as demonstrated by the capacity to 'train' spinal circuits to produce locomotion following spinal cord injury. While somatosensory feedback is necessary for spinal motor learning, feed forward circuits within the spinal cord must also contribute. In fact, motoneurons themselves could act as comparators that integrate feed forward and feedback inputs, and thus contribute to motor learning. Application of cerebellar-derived principles to spinal circuitry leads to testable predictions of spinal organization required for motor learning.

Optogenetic stimulation of mPFC pyramidal neurons as a conditioned stimulus supports associative learning in rats

It is generally accepted that the associative learning occurs when a behaviorally neutral conditioned stimulus (CS) is paired with an aversive unconditioned stimulus (US) in close temporal proximity. Eyeblink conditioning (EBC) is a simple form of associative learning for motor responses. Specific activation of a population of cells may be an effective and sufficient CS for establishing EBC. However, there has been no direct evidence to support this hypothesis. Here, we show in rats that optogenetic activation of the right caudal mPFC pyramidal neurons as a CS is sufficient to support the acquisition of delay eyeblink conditioning (DEC). Interestingly, the associative memory was not stably expressed during the initial period of daily conditioning session even after the CR acquisition reached the asymptotic level. Finally, the intensity and consistency of the CS were found to be crucial factors in regulating the retrieval of the associative memory. These results may be of importance in understanding the neural cellular mechanisms underlying associative learning and the mechanisms underlying retrieval process of memory.

Medial auditory thalamus is necessary for acquisition and retention of eyeblink conditioning to cochlear nucleus stimulation

Associative learning tasks commonly involve an auditory stimulus, which must be projected through the auditory system to the sites of memory induction for learning to occur. The cochlear nucleus (CN) projection to the pontine nuclei has been posited as the necessary auditory pathway for cerebellar learning, including eyeblink conditioning. However, the medial auditory thalamic nuclei (MATN), consisting of the medial division of the medial geniculate, suprageniculate, and posterior interlaminar nucleus have also been implicated as a critical auditory relay to the pontine nuclei for cerebellum-dependent motor learning. The MATN also conveys auditory information to the amygdala necessary for avoidance and fear conditioning. The current study used CN stimulation to increase activity in the pontine nuclei, relative to a tone stimulus, and possibly provide sufficient input to the cerebellum for acquisition or retention of eyeblink conditioning during MATN inactivation. Primary and secondary effects of CN stimulation and MATN inactivation were examined using 2-deoxy-glucose autoradiography. Stimulation of CN increased activity in the pontine nuclei, however, this increase was not sufficient for cerebellar learning during MATN inactivation. Results of the current experiment provide additional evidence indicating the MATN may be the critical auditory relay for many associative learning tasks.

Modeling possible effects of atypical cerebellar processing on eyeblink conditioning in autism

Autism is unique among other disorders in that acquisition of conditioned eyeblink responses is enhanced in children, occurring in a fraction of the trials required for control participants. The timing of learned responses is, however, atypical. Two animal models of autism display a similar phenotype. Researchers have hypothesized that these differences in conditioning reflect cerebellar abnormalities. The present study used computer simulations of the cerebellar cortex, including inhibition by the molecular layer interneurons, to more closely examine whether atypical cerebellar processing can account for faster conditioning in individuals with autism. In particular, the effects of inhibitory levels on delay eyeblink conditioning were simulated, as were the effects of learning-related synaptic changes at either parallel fibers or ascending branch synapses from granule cells to Purkinje cells. Results from these simulations predict that whether molecular layer inhibition results in an enhancement or an impairment of acquisition, or changes in timing, may depend on (1) the sources of inhibition, (2) the levels of inhibition, and (3) the locations of learning-related changes (parallel vs. ascending branch synapses). Overall, the simulations predict that a disruption in the balance or an overall increase of inhibition within the cerebellar cortex may contribute to atypical eyeblink conditioning in children with autism and in animal models of autism.

Cerebellar cortex and cerebellar nuclei are concomitantly activated during eyeblink conditioning: a 7T fMRI study in humans

There are controversies whether learning of conditioned eyeblink responses primarily takes place within the cerebellar cortex, the interposed nuclei, or both. It has also been suggested that the cerebellar cortex may be important during early stages of learning, and that there is a shift to the cerebellar nuclei during later stages. As yet, human studies have provided little to resolve this question. In the present study, we established a setup that allows ultra-high-field 7T functional magnetic resonance imaging (fMRI) of the cerebellar cortex and interposed cerebellar nuclei simultaneously during delay eyeblink conditioning in humans. Event-related fMRI signals increased concomitantly in the cerebellar cortex and nuclei during early acquisition of conditioned eyeblink responses in 20 healthy human subjects. ANOVAs with repeated-measures showed significant effects of time across five blocks of 20 conditioning trials in the cortex and nuclei (p < 0.05, permutation corrected). Activations were most pronounced in, but not limited to, lobules VI and interposed nuclei. Increased activations were most prominent at the first time the maximum number of conditioned responses was achieved. Our data are consistent with a simultaneous and synergistic two-site model of learning during acquisition of classically conditioned eyeblinks. Because increased MRI signal reflects synaptic activity, concomitantly increased signals in the cerebellar nuclei and cortex are consistent with findings of learning related potentiation at the mossy fiber to nuclear cell synapse and mossy fiber to granule cell synapse. Activity related to the expression of conditioned responses, however, cannot be excluded.

Effects of inferior olive lesion on fear-conditioned bradycardia

The inferior olive (IO) sends excitatory inputs to the cerebellar cortex and cerebellar nuclei through the climbing fibers. In eyeblink conditioning, a model of motor learning, the inactivation of or a lesion in the IO impairs the acquisition or expression of conditioned eyeblink responses. Additionally, climbing fibers originating from the IO are believed to transmit the unconditioned stimulus to the cerebellum in eyeblink conditioning. Studies using fear-conditioned bradycardia showed that the cerebellum is associated with adaptive control of heart rate. However, the role of inputs from the IO to the cerebellum in fear-conditioned bradycardia has not yet been investigated. To examine this possible role, we tested fear-conditioned bradycardia in mice by selective disruption of the IO using 3-acetylpyridine. In a rotarod test, mice with an IO lesion were unable to remain on the rod. The number of neurons of IO nuclei in these mice was decreased to ∼40% compared with control mice. Mice with an IO lesion did not show changes in the mean heart rate or in heart rate responses to a conditioned stimulus, or in their responses to a painful stimulus in a tail-flick test. However, they did show impairment of the acquisition/expression of conditioned bradycardia and attenuation of heart rate responses to a pain stimulus used as an unconditioned stimulus. These results indicate that the IO inputs to the cerebellum play a key role in the acquisition/expression of conditioned bradycardia.

Ontogeny of septohippocampal modulation of delay eyeblink conditioning

The current study investigated the effects of disrupting the septohippocampal theta system on the developmental emergence of delay eyeblink conditioning. Theta oscillations are defined as electroencephalographic (EEG) waveforms with a frequency between 3-8 Hz. Hippocampal theta oscillations are generated by inputs from the entorhinal cortex and the medial septum. Theta activity has been shown to facilitate learning in a variety of paradigms, including delay eyeblink conditioning. Lesions of the medial septum disrupt theta activity and slow the rate at which delay eyeblink conditioning is learned (Berry & Thompson, [1979] Science 200:1298-1300). The role of the septohippocampal theta system in the ontogeny of eyeblink conditioning has not been examined. In the current study, infant rats received an electrolytic lesion of the medial septum on postnatal day (P) 12. Rats were later given eyeblink conditioning for 6 sessions with an auditory conditioned stimulus on P17-19, P21-23, or P24-26. Lesions impaired eyeblink conditioning on P21-23 and P24-26 but not on P17-19. The results suggest that the septohippocampal system comes online to facilitate acquisition of eyeblink conditioning between P19 and P21. Developmental changes in septohippocampal modulation of the cerebellum may play a significant role in the ontogeny of eyeblink conditioning.

Extinction, reacquisition, and rapid forgetting of eyeblink conditioning in developing rats

Eyeblink conditioning is a well-established model for studying the developmental neurobiology of associative learning and memory. However, age differences in extinction and subsequent reacquisition have yet to be studied using this model. The present study examined extinction and reacquisition of eyeblink conditioning in developing rats. In Experiment 1, post-natal day (P) 17 and 24 rats were trained to a criterion of 80% conditioned responses (CRs) using stimulation of the middle cerebellar peduncle (MCP) as a conditioned stimulus (CS). Stimulation CS-alone extinction training commenced 24 h later, followed by reacquisition training after the fourth extinction session. Contrary to expected results, rats trained starting on P17 showed significantly fewer CRs to stimulation CS-alone presentations relative to P24s, including fewer CRs as early as the first block of extinction session 1. Furthermore, the P17 group was slower to reacquire following extinction. Experiment 2 was run to determine the extent to which the low CR percentage observed in P17s early in extinction reflected rapid forgetting versus rapid extinction. Twenty-four hours after reaching criterion, subjects were trained in a session split into 50 stimulation CS-unconditioned stimulus paired trials followed immediately by 50 stimulation CS-alone trials. With this "immediate" extinction protocol, CR percentages during the first block of stimulation CS-alone presentations were equivalent to terminal acquisition levels at both ages but extinction was more rapid in the P17 group. These findings indicate that forgetting is observed in P17 relative to P24 rats 24 h following acquisition. The forgetting in P17 rats has important implications for the neurobiological mechanisms of memory in the developing cerebellum.

Localization and characterization of an essential associative memory trace in the mammalian brain

We argue here that we have succeeded in localizing an essential memory trace for a basic form of associative learning and memory - classical conditioning of discrete responses learned with an aversive stimulus - to the anterior interpositus nucleus of the cerebellum. We first identified the entire essential circuit, using eyelid conditioning as the model system, and used reversible inactivation, during training, of critical structures and activation of pathways to localize definitively the essential memory trace. This discovery and the associated studies have: 1) shown that the essential cerebellar circuit applies equally to all mammals studied, including humans; 2) shown that this cerebellar circuit holds for the learning of any discrete behavioral response elicited by an aversive US, not just eyelid closure; 3) identified the essential circuit and process for reinforcement for this form of learning; 4) shown that this form of learning and its essential cerebellar circuitry is phylogenetically very old; 5) solved the long-standing puzzle of where memory traces are formed in the brain when the CS is electrical stimulation of the cerebral cortex in conditioning; 6) shown that this cerebellar circuitry forms the essential neural substrate for the behavioral phenomenon of "blocking", and hence, 7) provides the first clear neural instantiation of the Rescorla-Wagner learning algorithm; 8) shown that the fundamental neural process underlying this form of learning is a strengthening of preexisting pathways, and 9) shown that the basic mechanism underlying this strengthening is the formation of new excitatory synapses. This article is part of a Special Issue entitled SI: Brain and Memory.

Neuromodulatory adaptive combination of correlation-based learning in cerebellum and reward-based learning in basal ganglia for goal-directed behavior control

Goal-directed decision making in biological systems is broadly based on associations between conditional and unconditional stimuli. This can be further classified as classical conditioning (correlation-based learning) and operant conditioning (reward-based learning). A number of computational and experimental studies have well established the role of the basal ganglia in reward-based learning, where as the cerebellum plays an important role in developing specific conditioned responses. Although viewed as distinct learning systems, recent animal experiments point toward their complementary role in behavioral learning, and also show the existence of substantial two-way communication between these two brain structures. Based on this notion of co-operative learning, in this paper we hypothesize that the basal ganglia and cerebellar learning systems work in parallel and interact with each other. We envision that such an interaction is influenced by reward modulated heterosynaptic plasticity (RMHP) rule at the thalamus, guiding the overall goal directed behavior. Using a recurrent neural network actor-critic model of the basal ganglia and a feed-forward correlation-based learning model of the cerebellum, we demonstrate that the RMHP rule can effectively balance the outcomes of the two learning systems. This is tested using simulated environments of increasing complexity with a four-wheeled robot in a foraging task in both static and dynamic configurations. Although modeled with a simplified level of biological abstraction, we clearly demonstrate that such a RMHP induced combinatorial learning mechanism, leads to stabler and faster learning of goal-directed behaviors, in comparison to the individual systems. Thus, in this paper we provide a computational model for adaptive combination of the basal ganglia and cerebellum learning systems by way of neuromodulated plasticity for goal-directed decision making in biological and bio-mimetic organisms.

Prefrontal neuronal circuits of contextual fear conditioning

Over the past years, numerous studies have provided a clear understanding of the neuronal circuits and mechanisms involved in the formation, expression and extinction phases of conditioned cued fear memories. Yet, despite a strong clinical interest, a detailed understanding of these memory phases for contextual fear memories is still missing. Besides the well-known role of the hippocampus in encoding contextual fear behavior, growing evidence indicates that specific regions of the medial prefrontal cortex differentially regulate contextual fear acquisition and storage in both animals and humans that ultimately leads to expression of contextual fear memories. In this review, we provide a detailed description of the recent literature on the role of distinct prefrontal subregions in contextual fear behavior and provide a working model of the neuronal circuits involved in the acquisition, expression and generalization of contextual fear memories.