Learning stimulus intervals--adaptive timing of conditioned purkinje cell responses

Mesoscale simulations predict the role of synergistic cerebellar plasticity during classical eyeblink conditioning

According to the motor learning theory by Albus and Ito, synaptic depression at the parallel fibre to Purkinje cells synapse (pf-PC) is the main substrate responsible for learning sensorimotor contingencies under climbing fibre control. However, recent experimental evidence challenges this relatively monopolistic view of cerebellar learning. Bidirectional plasticity appears crucial for learning, in which different microzones can undergo opposite changes of synaptic strength (e.g. downbound microzones-more likely depression, upbound microzones-more likely potentiation), and multiple forms of plasticity have been identified, distributed over different cerebellar circuit synapses. Here, we have simulated classical eyeblink conditioning (CEBC) using an advanced spiking cerebellar model embedding downbound and upbound modules that are subject to multiple plasticity rules. Simulations indicate that synaptic plasticity regulates the cascade of precise spiking patterns spreading throughout the cerebellar cortex and cerebellar nuclei. CEBC was supported by plasticity at the pf-PC synapses as well as at the synapses of the molecular layer interneurons (MLIs), but only the combined switch-off of both sites of plasticity compromised learning significantly. By differentially engaging climbing fibre information and related forms of synaptic plasticity, both microzones contributed to generate a well-timed conditioned response, but it was the downbound module that played the major role in this process. The outcomes of our simulations closely align with the behavioural and electrophysiological phenotypes of mutant mice suffering from cell-specific mutations that affect processing of their PC and/or MLI synapses. Our data highlight that a synergy of bidirectional plasticity rules distributed across the cerebellum can facilitate finetuning of adaptive associative behaviours at a high spatiotemporal resolution.

A computational passage-of-time model of the cerebellar Purkinje cell in eyeblink conditioning

The cerebellar Purkinje cell controlling eyeblinks can learn, remember, and reproduce the interstimulus interval in a classical conditioning paradigm. Given temporally separated inputs, the cerebellar Purkinje cell learns to pause its tonic inhibition of a motor pathway with high temporal precision so that an overt blink occurs at the right time. Most models place the passage-of-time representation in upstream network effects. Yet, bypassing the upstream network and directly stimulating the Purkinje cell's pre-synaptic fibers during conditioning still causes acquisition of a well-timed response. Additionally, while network models are sensitive to variance in the temporal structure of probe stimulation, in vivo findings suggest that the acquired Purkinje cell response is not. Such findings motivate alternative approaches to modeling neural function. Here, we present a proof-of-principle model of the passage-of-time which is internal to the Purkinje cell and is invariant to probe structure. The model is consistent with puzzling findings, accurately recapitulates Purkinje cell firing during classical conditioning and makes testable electrophysiological predictions.

A biochemical mechanism for time-encoding memory formation within individual synapses of Purkinje cells

Within the classical eye-blink conditioning, Purkinje cells within the cerebellum are known to suppress their tonic firing rates for a well defined time period in response to the conditional stimulus after training. The temporal profile of the drop in tonic firing rate, i.e., the onset and the duration, depend upon the time interval between the onsets of the conditional and unconditional training stimuli. Direct stimulation of parallel fibers and climbing fiber by electrodes was found to be sufficient to reproduce the same characteristic drop in the firing rate of the Purkinje cell. In addition, the specific metabotropic glutamate-based receptor type 7 (mGluR₇) was found responsible for the initiation of the response, suggesting an intrinsic mechanism within the Purkinje cell for the temporal learning. In an attempt to look for a mechanism for time-encoding memory formation within individual Purkinje cells, we propose a biochemical mechanism based on recent experimental findings. The proposed mechanism tries to answer key aspects of the “Coding problem” of Neuroscience by focusing on the Purkinje cell’s ability to encode time intervals through training. According to the proposed mechanism, the time memory is encoded within the dynamics of a set of proteins—mGluR₇, G-protein, G-protein coupled Inward Rectifier Potassium ion channel, Protein Kinase A, Protein Phosphatase 1 and other associated biomolecules—which self-organize themselves into a protein complex. The intrinsic dynamics of these protein complexes can differ and thus can encode different time durations. Based on their amount and their collective dynamics within individual synapses, the Purkinje cell is able to suppress its own tonic firing rate for a specific time interval. The time memory is encoded within the effective dynamics of the biochemical reactions and altering these dynamics means storing a different time memory. The proposed mechanism is verified by both a minimal and a more comprehensive mathematical model of the conditional response behavior of the Purkinje cell and corresponding dynamical simulations of the involved biomolecules, yielding testable experimental predictions.

Kir3 channel blockade in the cerebellar cortex suppresses performance of classically conditioned Purkinje cell responses

In the eyeblink conditioning paradigm, cerebellar Purkinje cells learn to respond to the conditional stimulus with an adaptively timed pause in its spontaneous firing. Evidence suggests that the pause is elicited by glutamate released from parallel fibers and acting on metabotropic receptors (mGluR7) which initiates a delayed-onset suppression of firing. We suggested that G protein activation of hyperpolarizing K_ir3 channels (or ‘GIRK’, G protein-coupled inwardly-rectifying K⁺ channels) could be part of such a mechanism. Application of the K_ir3 antagonist Tertiapin-LQ locally in the superficial layers of the cerebellar cortex in decerebrate ferrets suppressed normal performance of Purkinje cell pause responses to the conditional stimulus. Importantly, there was no detectable effect on spontaneous firing. These findings suggest that intact functioning of K_ir3 channels in the cerebellar cortex is required for normal conditioned Purkinje cell responses.

Locating the engram: Should we look for plastic synapses or information-storing molecules?

Karl Lashley began the search for the engram nearly seventy years ago. In the time since, much has been learned but divisions remain. In the contemporary neurobiology of learning and memory, two profoundly different conceptions contend: the associative/connectionist (A/C) conception and the computational/representational (C/R) conception. Both theories ground themselves in the belief that the mind is emergent from the properties and processes of a material brain. Where these theories differ is in their description of what the neurobiological substrate of memory is and where it resides in the brain. The A/C theory of memory emphasizes the need to distinguish memory cognition from the memory engram and postulates that memory cognition is an emergent property of patterned neural activity routed through engram circuits. In this model, learning re-organizes synapse association strengths to guide future neural activity. Importantly, the version of the A/C theory advocated for here contends that synaptic change is not symbolic and, despite normally being necessary, is not sufficient for memory cognition. Instead, synaptic change provides the capacity and a blueprint for reinstating symbolic patterns of neural activity. Unlike the A/C theory, which posits that memory emerges at the circuit level, the C/R conception suggests that memory manifests at the level of intracellular molecular structures. In C/R theory, these intracellular structures are information-conveying and have properties compatible with the view that brain computation utilizes a read/write memory, functionally similar to that in a computer. New research has energized both sides and highlighted the need for new discussion. Both theories, the key questions each theory has yet to resolve and several potential paths forward are presented here.

Internal Clocks, mGluR7 and Microtubules: A Primer for the Molecular Encoding of Target Durations in Cerebellar Purkinje Cells and Striatal Medium Spiny Neurons

The majority of studies in the field of timing and time perception have generally focused on sub- and supra-second time scales, specific behavioral processes, and/or discrete neuronal circuits. In an attempt to find common elements of interval timing from a broader perspective, we review the literature and highlight the need for cell and molecular studies that can delineate the neural mechanisms underlying temporal processing. Moreover, given the recent attention to the function of microtubule proteins and their potential contributions to learning and memory consolidation/re-consolidation, we propose that these proteins play key roles in coding temporal information in cerebellar Purkinje cells (PCs) and striatal medium spiny neurons (MSNs). The presence of microtubules at relevant neuronal sites, as well as their adaptability, dynamic structure, and longevity, makes them a suitable candidate for neural plasticity at both intra- and inter-cellular levels. As a consequence, microtubules appear capable of maintaining a temporal code or engram and thereby regulate the firing patterns of PCs and MSNs known to be involved in interval timing. This proposed mechanism would control the storage of temporal information triggered by postsynaptic activation of mGluR7. This, in turn, leads to alterations in microtubule dynamics through a "read-write" memory process involving alterations in microtubule dynamics and their hexagonal lattice structures involved in the molecular basis of temporal memory.

Intrinsic memory of temporal intervals in cerebellar Purkinje cells

The general consensus for learning and memory, including in the cerebellum, is that modification of synaptic strength via long-term potentiation (LTP) or long-term depression (LTD) are the primary mechanisms for the formation of memories. Recent findings suggest additional cellular mechanisms - referred to as 'intrinsic plasticity' - where a neuron's membrane excitability intrinsically changes. These mechanisms act like a dimmer and alter neuronal responsiveness by adjusting response amplitudes and spike thresholds. Here, I argue that classical conditioning of cerebellar Purkinje cell responses reveals yet another cell-intrinsic learning mechanism which significantly differs from both changes in synaptic strength and changes in membrane excitability. When the conditional (CS) and unconditional stimuli (US) are delivered directly to the Purkinje cell's immediate pre-synaptic afferents, the parallel fibres and the climbing fibre, the cell learns to respond to the CS with a pause in its spontaneous firing that reflects the interval between the two stimuli. The pause response has a delayed onset and adaptively timed maximum, offset and duration, determined by the previously experienced CS-US interval. The timing is not dependent on any network-generated time-varying input. This implies the existence of a timing mechanism and a memory substrate that encodes the duration of the CS-US interval inside the Purkinje cell. Such temporal interval learning is not simply a change that causes more or less firing in response to an input. Here, I review these findings in relation to the standard theory of synaptic strength changes and the network interactions believed to be necessary for generating time codes.

Real-time cerebellar neuroprosthetic system based on a spiking neural network model of motor learning

OBJECTIVE

Damage to the brain, as a result of various medical conditions, impacts the everyday life of patients and there is still no complete cure to neurological disorders. Neuroprostheses that can functionally replace the damaged neural circuit have recently emerged as a possible solution to these problems. Here we describe the development of a real-time cerebellar neuroprosthetic system to substitute neural function in cerebellar circuitry for learning delay eyeblink conditioning (DEC).

APPROACH

The system was empowered by a biologically realistic spiking neural network (SNN) model of the cerebellar neural circuit, which considers the neuronal population and anatomical connectivity of the network. The model simulated synaptic plasticity critical for learning DEC. This SNN model was carefully implemented on a field programmable gate array (FPGA) platform for real-time simulation. This hardware system was interfaced in in vivo experiments with anesthetized rats and it used neural spikes recorded online from the animal to learn and trigger conditioned eyeblink in the animal during training.

MAIN RESULTS

This rat-FPGA hybrid system was able to process neuronal spikes in real-time with an embedded cerebellum model of ~10 000 neurons and reproduce learning of DEC with different inter-stimulus intervals. Our results validated that the system performance is physiologically relevant at both the neural (firing pattern) and behavioral (eyeblink pattern) levels.

SIGNIFICANCE

This integrated system provides the sufficient computation power for mimicking the cerebellar circuit in real-time. The system interacts with the biological system naturally at the spike level and can be generalized for including other neural components (neuron types and plasticity) and neural functions for potential neuroprosthetic applications.

The Roles of the Olivocerebellar Pathway in Motor Learning and Motor Control. A Consensus Paper

For many decades, the predominant view in the cerebellar field has been that the olivocerebellar system's primary function is to induce plasticity in the cerebellar cortex, specifically, at the parallel fiber-Purkinje cell synapse. However, it has also long been proposed that the olivocerebellar system participates directly in motor control by helping to shape ongoing motor commands being issued by the cerebellum. Evidence consistent with both hypotheses exists; however, they are often investigated as mutually exclusive alternatives. In contrast, here, we take the perspective that the olivocerebellar system can contribute to both the motor learning and motor control functions of the cerebellum and might also play a role in development. We then consider the potential problems and benefits of it having multiple functions. Moreover, we discuss how its distinctive characteristics (e.g., low firing rates, synchronization, and variable complex spike waveforms) make it more or less suitable for one or the other of these functions, and why having multiple functions makes sense from an evolutionary perspective. We did not attempt to reach a consensus on the specific role(s) the olivocerebellar system plays in different types of movements, as that will ultimately be determined experimentally; however, collectively, the various contributions highlight the flexibility of the olivocerebellar system, and thereby suggest that it has the potential to act in both the motor learning and motor control functions of the cerebellum.

Learned response sequences in cerebellar Purkinje cells

Associative learning in the cerebellum has previously focused on single movements. In eyeblink conditioning, for instance, a subject learns to blink at the right time in response to a conditional stimulus (CS), such as a tone that is repeatedly followed by an unconditional corneal stimulus (US). During conditioning, the CS and US are transmitted by mossy/parallel fibers and climbing fibers to cerebellar Purkinje cells that acquire a precisely timed pause response that drives the overt blink response. The timing of this conditional Purkinje cell response is determined by the CS-US interval and is independent of temporal patterns in the input signal. In addition to single movements, the cerebellum is also believed to be important for learning complex motor programs that require multiple precisely timed muscle contractions, such as, for example, playing the piano. In the present work, we studied Purkinje cells in decerebrate ferrets that were conditioned using electrical stimulation of mossy fiber and climbing fiber afferents as CS and US, while alternating between short and long interstimulus intervals. We found that Purkinje cells can learn double pause responses, separated by an intermediate excitation, where each pause corresponds to one interstimulus interval. The results show that individual cells can not only learn to time a single response but that they also learn an accurately timed sequential response pattern.

Cerebellar learning modulates surface expression of a voltage-gated ion channel in cerebellar cortex

Numerous experiments using ex vivo electrophysiology suggest that mammalian learning and memory involves regulation of voltage-gated ion channels in terms of changes in function. Yet, little is known about learning-related regulation of voltage-gated ion channels in terms of changes in expression. In two experiments, we examined changes in cell surface expression of the voltage-gated potassium channel alpha-subunit Kv1.2 in a discrete region of cerebellar cortex after eyeblink conditioning (EBC), a well-studied form of cerebellar-dependent learning. Kv1.2 in cerebellar cortex is expressed almost entirely in basket cells, primarily in the axon terminal pinceaux (PCX) region, and Purkinje cells, primarily in dendrites. Cell surface expression of Kv1.2 was measured using both multiphoton microscopy, which allowed measurement confined to the PCX region, and biotinylation/western blot, which measured total cell surface expression. In the first experiment, rats underwent three sessions of EBC, explicitly unpaired stimulus exposure, or context-only exposure and the results revealed a decrease in Kv1.2 cell surface expression in the unpaired group as measured with microscopy but no change as measured with western blot. In the second experiment, the same three training groups underwent only one half of a session of training, and the results revealed an increase in Kv1.2 cell surface expression in the unpaired group as measured with western blot but no change as measured with microscopy. In addition, rats in the EBC group that did not express conditioned responses (CRs) exhibited the same increase in Kv1.2 cell surface expression as the unpaired group. The overall pattern of results suggests that cell surface expression of Kv1.2 is changed with exposure to EBC stimuli in the absence, or prior to the emergence, of CRs.

Are Purkinje Cell Pauses Drivers of Classically Conditioned Blink Responses?

Several lines of evidence show that classical or Pavlovian conditioning of blink responses depends on the cerebellum. Recordings from cerebellar Purkinje cells that control the eyelid and the conditioned blink show that during training with a conditioning protocol, a Purkinje cell develops a pause response to the conditional stimulus. This conditioned cellular response has many of the properties that characterise the overt blink. The present paper argues that the learned Purkinje cell pause response is the memory trace and main driver of the overt conditioned blink and that it explains many well-known behavioural phenomena.

A comparative approach to cerebellar function: insights from electrosensory systems

Despite its simple and highly-ordered circuitry the function of the cerebellum remains a topic of vigorous debate. This review explores connections between the cerebellum and sensory processing structures that closely resemble the cerebellum in terms of their evolution, development, patterns of gene expression, and circuitry. Recent studies of cerebellum-like structures involved in electrosensory processing in fish have provided insights into the functions of granule cells and unipolar brush cells-cell types shared with the cerebellum. We also discuss the possibility, supported by recent studies, that generating and subtracting predictions of the sensory consequences of motor commands may be core functions shared by both cerebellum-like structures and the cerebellum.

Neural Mechanisms for Predicting the Sensory Consequences of Behavior: Insights from Electrosensory Systems

Perception of the environment requires differentiating between external sensory inputs and those that are self-generated. Some of the clearest insights into the neural mechanisms underlying this process have come from studies of the electrosensory systems of fish. Neurons at the first stage of electrosensory processing generate negative images of the electrosensory consequences of the animal's own behavior. By canceling out the effects of predictable, self-generated inputs, negative images allow for the selective encoding of unpredictable, externally generated stimuli. Combined experimental and theoretical studies of electrosensory systems have led to detailed accounts of how negative images are formed at the level of synaptic plasticity rules, cells, and circuits. Here, I review these accounts and discuss their implications for understanding how predictions of the sensory consequences of behavior may be generated in other sensory structures and the cerebellum.

Time Perception Mechanisms at Central Nervous System

The five senses have specific ways to receive environmental information and lead to central nervous system. The perception of time is the sum of stimuli associated with cognitive processes and environmental changes. Thus, the perception of time requires a complex neural mechanism and may be changed by emotional state, level of attention, memory and diseases. Despite this knowledge, the neural mechanisms of time perception are not yet fully understood. The objective is to relate the mechanisms involved the neurofunctional aspects, theories, executive functions and pathologies that contribute the understanding of temporal perception. Articles form 1980 to 2015 were searched by using the key themes: neuroanatomy, neurophysiology, theories, time cells, memory, schizophrenia, depression, attention-deficit hyperactivity disorder and Parkinson’s disease combined with the term perception of time. We evaluated 158 articles within the inclusion criteria for the purpose of the study. We conclude that research about the holdings of the frontal cortex, parietal, basal ganglia, cerebellum and hippocampus have provided advances in the understanding of the regions related to the perception of time. In neurological and psychiatric disorders, the understanding of time depends on the severity of the diseases and the type of tasks.

Mechanisms for motor timing in the cerebellar cortex

In classical eyeblink conditioning a subject learns to blink to a previously neutral stimulus. This conditional response is timed to occur just before an air puff to the eye. The learning is known to depend on the cerebellar cortex where Purkinje cells respond with adaptively timed pauses in their spontaneous firing. The pauses in the inhibitory Purkinje cells cause disinhibition of the cerebellar nuclei, which elicit the overt blinks. The timing of a Purkinje cell response was previously thought to require a temporal code in the input signal but recent work suggests that the Purkinje cells can learn to time their responses through an intrinsic mechanism that is activated by metabotropic glutamate receptors (mGluR7).

Inactivation of Cerebellar Cortical Crus II Disrupts Temporal Processing of Absolute Timing but not Relative Timing in Voluntary Movements

Several recent studies have demonstrated that the cerebellum plays an important role in temporal processing at the scale of milliseconds. However, it is not clear whether intrinsic cerebellar function involves the temporal processing of discrete or continuous events. Temporal processing during discrete events functions by counting absolute time like a stopwatch, while during continuous events it measures events at intervals. During the temporal processing of continuous events, animals might respond to rhythmic timing of sequential responses rather than to the absolute durations of intervals. Here, we tested the contribution of the cerebellar cortex to temporal processing of absolute and relative timings in voluntary movements. We injected muscimol and baclofen to a part of the cerebellar cortex of rats. We then tested the accuracy of their absolute or relative timing prediction using two timing tasks requiring almost identical reaching movements. Inactivation of the cerebellar cortex disrupted accurate temporal prediction in the absolute timing task. The rats formed two groups based on the changes to their timing accuracy following one of two distinct patterns which can be described as longer or shorter declines in the accuracy of learned intervals. However, a part of the cerebellar cortical inactivation did not affect the rats' performance of relative timing tasks. We concluded that a part of the cerebellar cortex, Crus II, contributes to the accurate temporal prediction of absolute timing and that the entire cerebellar cortex may be unnecessary in cases in which accurately knowing the absolute duration of an interval is not required for temporal prediction.

Contribution of Cerebellar Loops to Action Timing

Recent studies of sensorimotor processing have benefited from decision-making paradigms that emphasize the selection of appropriate movements. Selecting when to make those responses, or action timing, is important as well. Although the cerebellum is commonly viewed as a controller of movement dynamics, its role in action timing is also firmly supported. Several lines of research have now extended this idea. Anatomical findings have revealed connections between the cerebellum and broader timing circuits, neurophysiological results have suggested mechanisms for timing within its microcircuitry, and theoretical work has indicated how temporal signals are processed through it and decoded by its targets. These developments are inspiring renewed studies of the role of the cerebellar loops in action timing.

Motor Learning and the Cerebellum

Although our ability to store semantic declarative information can nowadays be readily surpassed by that of simple personal computers, our ability to learn and express procedural memories still outperforms that of supercomputers controlling the most advanced robots. To a large extent, our procedural memories are formed in the cerebellum, which embodies more than two-thirds of all neurons in our brain. In this review, we will focus on the emerging view that different modules of the cerebellum use different encoding schemes to form and express their respective memories. More specifically, zebrin-positive zones in the cerebellum, such as those controlling adaptation of the vestibulo-ocular reflex, appear to predominantly form their memories by potentiation mechanisms and express their memories via rate coding, whereas zebrin-negative zones, such as those controlling eyeblink conditioning, appear to predominantly form their memories by suppression mechanisms and express their memories in part by temporal coding using rebound bursting. Together, the different types of modules offer a rich repertoire to acquire and control sensorimotor processes with specific challenges in the spatiotemporal domain.

Relating cerebellar purkinje cell activity to the timing and amplitude of conditioned eyelid responses

How Purkinje cell (PC) activity may be altered by learning is central to theories of the cerebellum. Pavlovian eyelid conditioning, because of how directly it engages the cerebellum, has helped reveal many aspects of cerebellar learning and the underlying mechanisms. Theories of cerebellar learning assert that climbing fiber inputs control plasticity at synapses onto PCs, and thus PCs control the expression of learned responses. We tested this assertion by recording 184 eyelid PCs and 240 non-eyelid PCs during the expression of conditioned eyelid responses (CRs) in well trained rabbits. By contrasting the responses of eyelid and non-eyelid PCs and by contrasting the responses of eyelid PCs under conditions that produce differently timed CRs, we test the hypothesis that learning-related changes in eyelid PCs contribute to the learning and adaptive timing of the CRs. We used a variety of analyses to test the quantitative relationships between eyelid PC responses and the kinematic properties of the eyelid CRs. We find that the timing of eyelid PC responses varies systematically with the timing of the behavioral CRs and that there are differences in the magnitude of eyelid PC responses between larger-CR, smaller-CR, and non-CR trials. However, eyelid PC activity does not encode any single kinematic property of the behavioral CRs at a fixed time lag, nor does it linearly encode CR amplitude. Even so, the results are consistent with the hypothesis that learning-dependent changes in PC activity contribute to the adaptively timed expression of conditioned eyelid responses.

Modeling possible effects of atypical cerebellar processing on eyeblink conditioning in autism

Autism is unique among other disorders in that acquisition of conditioned eyeblink responses is enhanced in children, occurring in a fraction of the trials required for control participants. The timing of learned responses is, however, atypical. Two animal models of autism display a similar phenotype. Researchers have hypothesized that these differences in conditioning reflect cerebellar abnormalities. The present study used computer simulations of the cerebellar cortex, including inhibition by the molecular layer interneurons, to more closely examine whether atypical cerebellar processing can account for faster conditioning in individuals with autism. In particular, the effects of inhibitory levels on delay eyeblink conditioning were simulated, as were the effects of learning-related synaptic changes at either parallel fibers or ascending branch synapses from granule cells to Purkinje cells. Results from these simulations predict that whether molecular layer inhibition results in an enhancement or an impairment of acquisition, or changes in timing, may depend on (1) the sources of inhibition, (2) the levels of inhibition, and (3) the locations of learning-related changes (parallel vs. ascending branch synapses). Overall, the simulations predict that a disruption in the balance or an overall increase of inhibition within the cerebellar cortex may contribute to atypical eyeblink conditioning in children with autism and in animal models of autism.

Theoretical considerations for understanding a Purkinje cell timing mechanism

In classical conditioning, cerebellar Purkinje cells learn an adaptively timed pause in spontaneous firing. This pause reaches its maximum near the end of the interstimulus interval. While it was thought that this timing was due to temporal patterns in the input signal and selective engagement of changes in synapse strength, we have shown Purkinje cells learn timed responses even when the conditional stimulus is delivered to its immediate afferents.¹ This shows that Purkinje cells have a cellular timing mechanism. The cellular models of intrinsic timing we are aware of are based on adapting the rise time of the concentration of a given ion. As an alternative, we here propose a selection mechanism in abstract terms for how a Purkinje cell could learn to respond at a particular time after an external trigger.

Time course of the rabbit's conditioned nictitating membrane movements during acquisition, extinction, and reacquisition

The present experiment tested whether or not the time course of a conditioned eyeblink response, particularly its duration, would expand and contract, as the magnitude of the conditioned response (CR) changed massively during acquisition, extinction, and reacquisition. The CR duration remained largely constant throughout the experiment, while CR onset and peak time occurred slightly later during extinction. The results suggest that computational models can account for these results by using two layers of plasticity conforming to the sequence of synapses in the cerebellar pathways that mediate eyeblink conditioning.

Cerebellar learning mechanisms

The mechanisms underlying cerebellar learning are reviewed with an emphasis on old arguments and new perspectives on eyeblink conditioning. Eyeblink conditioning has been used for decades a model system for elucidating cerebellar learning mechanisms. The standard model of the mechanisms underlying eyeblink conditioning is that there two synaptic plasticity processes within the cerebellum that are necessary for acquisition of the conditioned response: (1) long-term depression (LTD) at parallel fiber-Purkinje cell synapses and (2) long-term potentiation (LTP) at mossy fiber-interpositus nucleus synapses. Additional Purkinje cell plasticity mechanisms may also contribute to eyeblink conditioning including LTP, excitability, and entrainment of deep nucleus activity. Recent analyses of the sensory input pathways necessary for eyeblink conditioning indicate that the cerebellum regulates its inputs to facilitate learning and maintain plasticity. Cerebellar learning during eyeblink conditioning is therefore a dynamic interactive process which maximizes responding to significant stimuli and suppresses responding to irrelevant or redundant stimuli. This article is part of a Special Issue entitled SI: Brain and Memory.

Memory trace and timing mechanism localized to cerebellar Purkinje cells

The standard view of the mechanisms underlying learning is that they involve strengthening or weakening synaptic connections. Learned response timing is thought to combine such plasticity with temporally patterned inputs to the neuron. We show here that a cerebellar Purkinje cell in a ferret can learn to respond to a specific input with a temporal pattern of activity consisting of temporally specific increases and decreases in firing over hundreds of milliseconds without a temporally patterned input. Training Purkinje cells with direct stimulation of immediate afferents, the parallel fibers, and pharmacological blocking of interneurons shows that the timing mechanism is intrinsic to the cell itself. Purkinje cells can learn to respond not only with increased or decreased firing but also with an adaptively timed activity pattern.

Human premotor areas parse sequences into their spatial and temporal features

Skilled performance is characterized by precise and flexible control of movement sequences in space and time. Recent theories suggest that integrated spatio-temporal trajectories are generated by intrinsic dynamics of motor and premotor networks. This contrasts with behavioural advantages that emerge when a trained spatial or temporal feature of sequences is transferred to a new spatio-temporal combination arguing for independent neural representations of these sequence features. We used a new fMRI pattern classification approach to identify brain regions with independent vs integrated representations. A distinct regional dissociation within motor areas was revealed: whereas only the contralateral primary motor cortex exhibited unique patterns for each spatio-temporal sequence combination, bilateral premotor areas represented spatial and temporal features independently of each other. These findings advocate a unique function of higher motor areas for flexible recombination and efficient encoding of complex motor behaviours.

DOI:http://dx.doi.org/10.7554/eLife.03043.001

Once a pianist has learned to play a song, he or she can nearly effortlessly reproduce the sequence of finger movements needed to play the song with a particular rhythm. A skilled pianist can also improvise, pairing the same keystrokes with a different rhythm or playing the same rhythm with a slightly different sequence of keys. This ability to flexibly modify and recombine sequences of physical movements in space and time enables humans to exhibit great creativity in music, language, and many other tasks that require motor skills. However, the underlying brain mechanisms that allow this flexibility are only beginning to be explored.

Some scientists have theorized that networks of brain cells in the parts of the brain that control movement store a sequence in time and space as one inseparable unit. However, this theory doesn't explain why pianists and other skilled individuals can separate and recombine the physical movements and timing of a sequence in new ways. An alternate idea is that the brain captures the information necessary to execute a series of physical movements separately from the timing at which the movements are to be carried out. This would allow these features to be put together in new ways.

Kornysheva and Diedrichsen taught a group of volunteers a series of finger movements paired with particular rhythms. Half the volunteers performed the task using their left hand and the other half with their right hand. After training the volunteers performed better when producing sequences they had been trained on, even in trials where either the rhythm or the finger sequence was slightly changed.

The volunteers were also asked to perform the trained movements while their brain activity was monitored in a functional magnetic resonance imaging (fMRI) machine. Kornysheva and Diedrichsen looked for areas that showed similar patterns of increases and decreases in activity whenever a particular sequence was performed. This identified areas that showed unique patterns for each trained sequence combination of finger movements and rhythm, which could be distinguished from areas where the activity patterns for sequences remained similar across rhythms or across finger movements.

Kornysheva and Diedrichsen found that a region of the brain that controls movement encodes sequences on the opposite side of the brain from the moving hand. In this part of the brain, the movement and timing were encoded together as one unit. However, in premotor areas—which are known to help individuals to plan movements—the timing and the finger movements appeared to be encoded separately in overlapping patches on both sides of the brain. This automatic separation appears to be a fundamental function of the premotor cortex, enabling behavioural flexibility and the storage of complex sequences of movements in space and time.

DOI:http://dx.doi.org/10.7554/eLife.03043.002

Changes in complex spike activity during classical conditioning

The cerebellar cortex is necessary for adaptively timed conditioned responses (CRs) in eyeblink conditioning. During conditioning, Purkinje cells acquire pause responses or "Purkinje cell CRs" to the conditioned stimuli (CS), resulting in disinhibition of the cerebellar nuclei (CN), allowing them to activate motor nuclei that control eyeblinks. This disinhibition also causes inhibition of the inferior olive (IO), via the nucleo-olivary pathway (N-O). Activation of the IO, which relays the unconditional stimulus (US) to the cortex, elicits characteristic complex spikes in Purkinje cells. Although Purkinje cell activity, as well as stimulation of the CN, is known to influence IO activity, much remains to be learned about the way that learned changes in simple spike firing affects the IO. In the present study, we analyzed changes in simple and complex spike firing, in extracellular Purkinje cell records, from the C3 zone, in decerebrate ferrets undergoing training in a conditioning paradigm. In agreement with the N-O feedback hypothesis, acquisition resulted in a gradual decrease in complex spike activity during the conditioned stimulus, with a delay that is consistent with the long N-O latency. Also supporting the feedback hypothesis, training with a short interstimulus interval (ISI), which does not lead to acquisition of a Purkinje cell CR, did not cause a suppression of complex spike activity. In contrast, observations that extinction did not lead to a recovery in complex spike activity and the irregular patterns of simple and complex spike activity after the conditioned stimulus are less conclusive.

Sensory processing and corollary discharge effects in posterior caudal lobe Purkinje cells in a weakly electric mormyrid fish

Although it has been suggested that the cerebellum functions to predict the sensory consequences of motor commands, how such predictions are implemented in cerebellar circuitry remains largely unknown. A detailed and relatively complete account of predictive mechanisms has emerged from studies of cerebellum-like sensory structures in fish, suggesting that comparisons of the cerebellum and cerebellum-like structures may be useful. Here we characterize electrophysiological response properties of Purkinje cells in a region of the cerebellum proper of weakly electric mormyrid fish, the posterior caudal lobe (LCp), which receives the same mossy fiber inputs and projects to the same target structures as the electrosensory lobe (ELL), a well-studied cerebellum-like structure. We describe patterns of simple spike and climbing fiber activation in LCp Purkinje cells in response to motor corollary discharge, electrosensory, and proprioceptive inputs and provide evidence for two functionally distinct Purkinje cell subtypes within LCp. Protocols that induce rapid associative plasticity in ELL fail to induce plasticity in LCp, suggesting differences in the adaptive functions of the two structures. Similarities and differences between LCp and ELL are discussed in light of these results.

Bidirectional plasticity of Purkinje cells matches temporal features of learning

Many forms of learning require temporally ordered stimuli. In Pavlovian eyeblink conditioning, a conditioned stimulus (CS) must precede the unconditioned stimulus (US) by at least about 100 ms for learning to occur. Conditioned responses are learned and generated by the cerebellum. Recordings from the cerebellar cortex during conditioning have revealed CS-triggered pauses in the firing of Purkinje cells that likely drive the conditioned blinks. The predominant view of the learning mechanism in conditioning is that long-term depression (LTD) at parallel fiber (PF)-Purkinje cell synapses underlies the Purkinje cell pauses. This raises a serious conceptual challenge because LTD is most effectively induced at short CS-US intervals, which do not support acquisition of eyeblinks. To resolve this discrepancy, we recorded Purkinje cells during conditioning with short or long CS-US intervals. Decerebrated ferrets trained with CS-US intervals ≥150 ms reliably developed Purkinje cell pauses, but training with an interval of 50 ms unexpectedly induced increases in CS-evoked spiking. This bidirectional modulation of Purkinje cell activity offers a basis for the requirement of a minimum CS-US interval for conditioning, but we argue that it cannot be fully explained by LTD, even when previous in vitro studies of stimulus-timing-dependent LTD are taken into account.

The ontogeny of associative cerebellar learning

Ontogenetic changes in associative cerebellar learning have been examined extensively using eyeblink conditioning in infant humans and rats. The cerebellum is essential for eyeblink conditioning in adult and infant animals. The cerebellum receives input from the conditional stimulus (CS) through the pontine mossy fiber projection and unconditional stimulus (US) input through the inferior olive climbing fiber projection. Coactivation of the CS and US pathways induces synaptic plasticity in the cerebellum, which is necessary for the conditional response. Ontogenetic changes in eyeblink conditioning are driven by developmental changes in the projections of subcortical sensory nuclei to the pontine nuclei and in the inhibitory projection from the cerebellar deep nuclei to the inferior olive. Developmental changes in the CS and US pathways limit the induction of learning-related plasticity in the cerebellum and thereby limit acquisition of eyeblink conditioning.

Feedback control of learning by the cerebello-olivary pathway

The ability to anticipate future events and to modify erroneous anticipatory actions is crucial for the survival of any organism. Both theoretical and empirical lines of evidence implicate the cerebellum in this ability. It is often suggested that the cerebellum acquires "expectations" or "internal models." However, except in a metaphorical sense, the cerebellum, which consists of a set of interconnected nerve cells, cannot contain "internal models" or "have expectations." In this chapter, we try to untangle these metaphors by translating them back into neurophysiological cause and effect relationships. We approach this task from within the paradigm of classical conditioning, in which a subject, through repeated presentations of a conditional stimulus, followed by an unconditional stimulus, acquires a conditioned response. Importantly, the conditioned response is timed so that it anticipates the unconditioned response. Available neurophysiological evidence suggests that Purkinje cells, in the cerebellar cortex, generate the conditioned response. In addition, Purkinje cells provide negative feedback to the inferior olive, which is a relay for the unconditional stimulus, via the nucleo-olivary pathway. Purkinje cells can therefore regulate the intensity of the signal derived from the unconditional stimulus, which, in turn, decides subsequent plasticity. Hence, as learning progresses, the olivary signal will become weaker and weaker due to increasing negative feedback from Purkinje cells. Thus, in an important sense, learning-induced changes in Purkinje cell activity constitute an "expectation" or "anticipation" of a future event (the unconditional stimulus), and, consistent with theoretical models, future learning depends on the accuracy of this expectation.

Number of spikes in climbing fibers determines the direction of cerebellar learning

Cerebellar learning requires context information from mossy fibers and a teaching signal through the climbing fibers from the inferior olive. Although the inferior olive fires in bursts, virtually all studies have used a teaching signal consisting of a single pulse. Following a number of failed attempts to induce cerebellar learning in decerebrate ferrets with a nonburst signal, we tested the effect of varying the number of pulses in the climbing fiber teaching signal. The results show that training with a single pulse in a conditioning paradigm in vivo does not result in learning, but rather causes extinction of a previously learned response.

Similar circuits but different connectivity patterns between the cerebellum, basal ganglia, and supplementary motor area in early Parkinson's disease patients and controls during predictive motor timing

BACKGROUND AND PURPOSE

The cerebellum, basal ganglia (BG), and other cortical regions, such as supplementary motor area (SMA) have emerged as important structures dealing with various aspects of timing, yet the modulation of functional connectivity between them during motor timing tasks remains unexplored.

METHODS

We used dynamic causal modeling to investigate the differences in effective connectivity (EC) between these regions and its modulation by behavioral outcome during a motor timing prediction task in a group of 16 patients with early Parkinson's disease (PD) and 17 healthy controls. Behavioral events (hits and errors) constituted the driving input connected to the cerebellum, and the modulation in connectivity was assessed relative to the hit condition (successful interception of target).

RESULTS

The driving input elicited response in the target area, while modulatory input changed the specific connection strength. The neuroimaging data revealed similar structure of intrinsic connectivity in both groups with unidirectional connections from cerebellum to both sides of the BG, from BG to the SMA, and then from SMA to the cerebellum. However, the type of intrinsic connection was different between two groups. In the PD group, the connection between the SMA and cerebellum was inhibitory in comparison to the HC group, where the connection was activated. Furthermore, the modulation of connectivity by the performance in the task was different between the two groups, with decreased connectivity between the cerebellum and left BG and SMA and a more pronounced symmetry of these connections in controls. In the same time, there was an increased EC between the cerebellum and both sides of BG with more pronounced asymmetry (stronger connection with left BG) in patients. In addition, in the PD group the modulatory input strengthened inhibitory connectivity between the SMA and the cerebellum, while in the HC group the excitatory connection was slightly strengthened.

CONCLUSIONS

Our findings indicate that although early PD subjects and controls use similar functional circuits to maintain a successful outcome in predictive motor timing behavior, the type and strength of EC and its modulation by behavioral performance differ between these two groups. These functional differences might represent the first step of cortical reorganization aimed at maintaining a normal performance in the brain affected by early Parkinson's disease and may have implications for the neuro-rehabilitation field.

Interaction of temporal and ordinal representations in movement sequences

The production of movement sequences requires an accurate control of muscle activation in time. How does the nervous system encode the precise timing of these movements? One possibility is that the timing of movements (temporal sequence) is an emergent property of the dynamic state of the nervous system and therefore intimately linked to a representation of the sequence of muscle commands (ordinal sequence). Alternatively, timing may be represented independently of the motor effectors and would be transferable to a new ordinal sequence. Some studies have found that a learned temporal sequence cannot be transferred to a new ordinal sequence, thus arguing for an integrated representation. Others have observed temporal transfer across movement sequences and have advocated an independent representation of temporal information. Using a modified serial reaction time task, we tested alternative models of the representation of temporal structure and the interaction between the output of separate ordinal and temporal sequence representations. Temporal transfer depended on whether a novel ordinal sequence was fixed within each test block. Our results confirm the presence of an independent representation of temporal structure and advocate a nonlinear multiplicative neural interaction of temporal and ordinal signals in the production of movements.

Essential tremor, the cerebellum, and motor timing: towards integrating them into one complex entity

Essential tremor (ET) is the most common movement disorder in humans. It is characterized by a postural and kinetic tremor most commonly affecting the forearms and hands. Isolated head tremor has been found in 1-10% of patients, suggesting that ET may be a composite of several phenotypes. The exact pathophysiology of ET is still unknown. ET has been repeatedly shown as a disorder of mild cerebellar degeneration, particularly in postmortem studies. Clinical observations, electrophysiological, volumetric and functional imaging studies all reinforce the fact that the cerebellum is involved in the generation of ET. However, crucial debate exists as to whether ET is a neurodegenerative disease. Data suggesting that it is neurodegenerative include postmortem findings of pathological abnormalities in the brainstem and cerebellum, white matter changes on diffusion tensor imaging, and clinical studies demonstrating an association with cognitive and gait changes. There is also conflicting evidence against ET as a neurodegenerative disease: the improvement of gait abnormalities with ethanol administration, lack of gray matter volume loss on voxel-based morphometry, failure to confirm the prominent presence of Lewy bodies in the locus ceruleus, and other pathological findings. To clarify this issue, future research is needed to describe the mechanism of cellular changes in the ET brain and to understand the order in which they occur. The cerebellum has been shown to be involved in the timing of movement and sensation, acting as an internal timing system that provides the temporal representation of salient events spanning hundreds of milliseconds. It has been reported that cerebellar timing function is altered in patients with ET, showing an increased variability of rhythmic hand movements as well as diminished performance during predictive motor timing task. Based on current knowledge and observations, we argue that ET is essentially linked with cerebellar degeneration, or at least cerebellar dysfunction, together with disturbance of motor timing. We explain the context of our current understanding on this topic, highlighting possible clinical consequences for patients suffering from ET and future research directions.

Examining the effects of former cannabis use on cerebellum-dependent eyeblink conditioning in humans

RATIONALE

Previous work in humans has shown that chronic cannabis users exhibit disruptions in classical eyeblink conditioning (EBC), a form of associative learning that is known to be dependent on the cerebellum. Based upon previous work in animals, it was hypothesized that these learning deficits were related to cannabinoid receptor (CB1R) downregulation. However, it remains unclear whether there is a recovery of cerebellum-dependent learning after the cessation of cannabis use.

METHODS

Therefore, former cannabis users (n=10), current cannabis users (n=10), and cannabis-naïve controls (n=10), all free of DSM-IV Axis-I or -II disorders, were evaluated. A standard delay EBC procedure was utilized in which paired presentations of a conditioned stimulus (CS; e.g., tone) and a co-terminating unconditioned stimulus (US; e.g., ocular airpuff) were administered, thus eliciting a conditioned eyeblink response (CR). The primary dependent measures were percentage of CRs and CR latency across conditioning blocks.

RESULTS

Similar to prior studies, current cannabis users exhibited marked impairments in both the acquisition and timing of CRs compared to controls. Although former cannabis users showed intact CR acquisition compared to controls, they exhibited significantly impaired (shorter) CR latencies. In both cannabis groups, UR amplitude did not differ from controls, indicating normal US processing.

CONCLUSIONS

These data suggest that a recovery of function has occurred for the learning of the CS-US association, while the accurate timing of the CR shows lasting impairments. Taken together, these results suggest that heavy cannabis use can disrupt timing-related synaptic plasticity within the cerebellum, even after the cessation of cannabis use.

Learning to learn: theta oscillations predict new learning, which enhances related learning and neurogenesis

Animals in the natural world continuously encounter learning experiences of varying degrees of novelty. New neurons in the hippocampus are especially responsive to learning associations between novel events and more cells survive if a novel and challenging task is learned. One might wonder whether new neurons would be rescued from death upon each new learning experience or whether there is an internal control system that limits the number of cells that are retained as a function of learning. In this experiment, it was hypothesized that learning a task that was similar in content to one already learned previously would not increase cell survival. We further hypothesized that in situations in which the cells are rescued hippocampal theta oscillations (3–12 Hz) would be involved and perhaps necessary for increasing cell survival. Both hypotheses were disproved. Adult male Sprague-Dawley rats were trained on two similar hippocampus-dependent tasks, trace and very-long delay eyeblink conditioning, while recording hippocampal local-field potentials. Cells that were generated after training on the first task were labeled with bromodeoxyuridine and quantified after training on both tasks had ceased. Spontaneous theta activity predicted performance on the first task and the conditioned stimulus induced a theta-band response early in learning the first task. As expected, performance on the first task correlated with performance on the second task. However, theta activity did not increase during training on the second task, even though more cells were present in animals that had learned. Therefore, as long as learning occurs, relatively small changes in the environment are sufficient to increase the number of surviving neurons in the adult hippocampus and they can do so in the absence of an increase in theta activity. In conclusion, these data argue against an upper limit on the number of neurons that can be rescued from death by learning.

Retention and extinction of delay eyeblink conditioning are modulated by central cannabinoids

Rats administered the cannabinoid agonist WIN55,212-2 or the antagonist SR141716A exhibit marked deficits during acquisition of delay eyeblink conditioning, as noted by Steinmetz and Freeman in an earlier study. However, the effects of these drugs on retention and extinction of eyeblink conditioning have not been assessed. The present study examined the effects of WIN55,212-2 and SR141716A on retention and extinction of delay eyeblink conditioning in rats. Rats were given acquisition training for five daily sessions followed by one session of retention training with subcutaneous administration of 3 mg/kg of WIN55,212-2 or 5 mg/kg of SR141716A and an additional session with the vehicle. Two sessions of extinction training were then given with WIN55,212-2, SR141716A, or vehicle. Retention and extinction were impaired by WIN55,212-2, whereas SR141716A produced no deficits. The extinction deficit in rats given WIN55,212-2 was observed only during the first session, suggesting a specific impairment in short-term plasticity mechanisms. The current results and previous findings indicate that the cannabinoid system modulates cerebellar contributions to acquisition, retention, and extinction of eyeblink conditioning.

A trigeminal conditioned stimulus yields fast acquisition of cerebellum-dependent conditioned eyeblinks

Classical conditioning of the eyeblink response in the rabbit is a form of motor learning whereby the animal learns to respond to an initially irrelevant conditioned stimulus (CS). It is thought that acquired conditioned responses (CRs) are adaptive because they protect the eye in anticipation of potentially harmful events. This protective mechanism is surprisingly inefficient because the acquisition of CRs requires extensive training - a condition that is unlikely to occur in nature. We hypothesized that the rate of conditioning in rabbits could depend on CS modality and that stimulating mystacial vibrissae as the CS could produce CR acquisition faster than the traditional auditory or visual stimulation. We tested this hypothesis by conditioning naïve rabbits in the delay paradigm using a weak airpuff CS (vCS) directed to the ipsilateral mystacial vibrissae. We found that the trigeminal vCS yields significantly faster CR acquisition. We next examined if vCS-evoked CRs are dependent on the intermediate cerebellum in the same fashion as CRs evoked by the traditional auditory CS. We found that vibrissal CRs could be abolished by inactivating the cerebellar interposed nuclei (IN) with muscimol. In addition, injections of picrotoxin in the IN shortened the onset latency of vibrissal CRs. These findings suggest that the tone and vCS-evoked CRs share similar cerebellar dependency.

Time course of classically conditioned Purkinje cell response is determined by initial part of conditioned stimulus

Classical conditioning of a motor response such as eyeblink is associated with the development of a pause in cerebellar Purkinje cell firing that is an important driver of the overt response. This conditioned Purkinje cell response is adaptively timed and has a specific temporal profile that probably explains the time course of the overt behavior. It is generally assumed that the temporal properties of the conditioned Purkinje cell response are determined by the temporal pattern of the parallel fiber impulses generated by the conditioned stimulus at the time of the conditioned response. We show here in the decerebrate ferret preparation that a very brief conditioned stimulus, consisting of only one or two impulses in the mossy fibers, can be sufficient to elicit a full conditioned Purkinje cell response with normal time course. The finding suggests that parallel fiber input to the Purkinje cell influences the firing rate several hundred milliseconds later. It poses a serious challenge to the standard view of the role of parallel fiber impulses in response timing.