Role of plasticity at different sites across the time course of cerebellar motor learning

Purkinje cells in Crus I and II encode the visual stimulus and the impending choice as monkeys learn a reinforcement based visuomotor association task

Visuomotor association involves linking an arbitrary visual cue to a well-learned movement. Transient inactivation of Crus I/II impairs primates' ability to learn new associations and delays motor responses without affecting the kinematics of the movement. The simple spikes of Purkinje cells in the Crus regions signal cognitive errors as monkeys learn to associate specific fractal stimuli with movements of the left or right hand. Here we show that as learning progresses, the simple spike activity of individual neurons becomes more selective for stimulus-response associations, with selectivity developing closer to the appearance of visual stimuli. Initially, most neurons respond to both associations, irrespective of the identity of the stimulus and the associated movement, but as learning advances, more neurons distinguish between specific stimulus-hand associations. Using a linear decoder, it was found that in early learning stages, the visual stimulus can be decoded only when the choice can also be decoded. As learning improves, the visual stimulus is decoded earlier than the choice. A simple model can replicate the observed simple spike signals and the monkeys' behavior in both the early and late learning stages.

The olivary input to the cerebellum dissociates sensory events from movement plans

Neurons in the inferior olive are thought to anatomically organize the Purkinje cells (P-cells) of the cerebellum into computational modules, but what is computed by each module? Here, we designed a saccade task in marmosets that dissociated sensory events from motor events and then recorded the complex and simple spikes of hundreds of P-cells. We found that when a visual target was presented at a random location, the olive reported the direction of that sensory event to one group of P-cells, but not to a second group. However, just before movement onset, it reported the direction of the planned movement to both groups, even if that movement was not toward the target. At the end of the movement if the subject experienced an error but chose to withhold the corrective movement, only the first group received information about the sensory prediction error. We organized the P-cells based on the information content of their olivary input and found that in the group that received sensory information, the simple spikes were suppressed during fixation, then produced a burst before saccade onset in a direction consistent with assisting the movement. In the second group, the simple spikes were not suppressed during fixation but burst near saccade deceleration in a direction consistent with stopping the movement. Thus, the olive differentiated the P-cells based on whether they would receive sensory or motor information, and this defined their contributions to control of movements as well as holding still.

Normative tDCS over V5 and FEF reveals practice-induced modulation of extraretinal smooth pursuit mechanisms, but no specific stimulation effect

The neural networks subserving smooth pursuit eye movements (SPEM) provide an ideal model for investigating the interaction of sensory processing and motor control during ongoing movements. To better understand core plasticity aspects of sensorimotor processing for SPEM, normative sham, anodal or cathodal transcranial direct current stimulation (tDCS) was applied over visual area V5 and frontal eye fields (FEF) in sixty healthy participants. The identical within-subject paradigm was used to assess SPEM modulations by practice. While no specific tDCS effects were revealed, within- and between-session practice effects indicate plasticity of top-down extraretinal mechanisms that mainly affect SPEM in the absence of visual input and during SPEM initiation. To explore the potential of tDCS effects, individual electric field simulations were computed based on calibrated finite element head models and individual functional localization of V5 and FEF location (using functional MRI) and orientation (using combined EEG/MEG) was conducted. Simulations revealed only limited electric field target intensities induced by the applied normative tDCS montages but indicate the potential efficacy of personalized tDCS for the modulation of SPEM. In sum, results indicate the potential susceptibility of extraretinal SPEM control to targeted external neuromodulation (e.g., personalized tDCS) and intrinsic learning protocols.

Physiological Mechanisms That Impact Exercise Adaptations for Individuals With Down Syndrome

ABSTRACT

Post, EM, and Kraemer, WJ. Physiological mechanisms that impact exercise adaptations for individuals with Down syndrome. J Strength Cond Res 37(12): e646-e655, 2023-Down syndrome (DS) is the most common chromosomal disorder diagnosed in the United States since 2014. There is a wide range of intellectual severities, with the average IQ of individuals with DS at approximately 50 and adults without intellectual delay at approximately 70-130. Individuals with DS vary from mild to severe cognitive impairment, depending on the phenotypic penetration on the 21st chromosome, with the average cognitive capacity equivalent to a cognitive functioning of an 8- to 9-year-old child. To have successful health, all aspects of health must be considered (i.e., overall health, fitness, and social). Both aerobic training and resistance training (RT) are favored for a healthy lifestyle. Resistance training specifically can help improve motor function and overall activities of daily living. Although many motivational and environmental barriers for individuals with DS can make exercising difficult, there are many ways to overcome those barriers (both intrinsically and extrinsically). Individuals with DS should strive for 150 minutes of moderate-intensity or 75 minutes of vigorous-intensity aerobic exercise a week or a combination of both. The individual should also strive for 2 or more days a week of strengthening activities, such as RT, involving all muscle groups. These activities will help improve many aspects of life, leading to a better quality of life. Regular group exercise activity can help increase self-confidence and success socially in life. This review will focus on the underlying biological mechanisms related to DS, their influence on exercise, and the roles exercise plays in mediating positive health, physical fitness, and social lifestyle outcomes.

Diverse role of NMDA receptors for dendritic integration of neural dynamics

Neurons, represented as a tree structure of morphology, have various distinguished branches of dendrites. Different types of synaptic receptors distributed over dendrites are responsible for receiving inputs from other neurons. NMDA receptors (NMDARs) are expressed as excitatory units, and play a key physiological role in synaptic function. Although NMDARs are widely expressed in most types of neurons, they play a different role in the cerebellar Purkinje cells (PCs). Utilizing a computational PC model with detailed dendritic morphology, we explored the role of NMDARs at different parts of dendritic branches and regions. We found somatic responses can switch from silent, to simple spikes and complex spikes, depending on specific dendritic branches. Detailed examination of the dendrites regarding their diameters and distance to soma revealed diverse response patterns, yet explain two firing modes, simple and complex spike. Taken together, these results suggest that NMDARs play an important role in controlling excitability sensitivity while taking into account the factor of dendritic properties. Given the complexity of neural morphology varying in cell types, our work suggests that the functional role of NMDARs is not stereotyped but highly interwoven with local properties of neuronal structure.

Short duration event related cerebellar TDCS enhances visuomotor adaptation

BACKGROUND

Transcranial direct current stimulation (TDCS) is typically applied before or during a task, for periods ranging from 5 to 30 min.

HYPOTHESIS

We hypothesise that briefer stimulation epochs synchronous with individual task actions may be more effective.

METHODS

In two separate experiments, we applied brief bursts of event-related anodal stimulation (erTDCS) to the cerebellum during a visuomotor adaptation task.

RESULTS

The first study demonstrated that 1 s duration erTDCS time-locked to the participants' reaching actions enhanced adaptation significantly better than sham. A close replication in the second study demonstrated 0.5 s erTDCS synchronous with the reaching actions again resulted in better adaptation than standard TDCS, significantly better than sham. Stimulation either during the inter-trial intervals between movements or after movement, during assessment of visual feedback, had no significant effect. Because short duration stimulation with rapid onset and offset is more readily perceived by the participants, we additionally show that a non-electrical vibrotactile stimulation of the scalp, presented with the same timing as the erTDCS, had no significant effect.

CONCLUSIONS

We conclude that short duration, event related, anodal TDCS targeting the cerebellum enhances motor adaptation compared to the standard model. We discuss possible mechanisms of action and speculate on neural learning processes that may be involved.

An emergent temporal basis set robustly supports cerebellar time-series learning

The cerebellum is considered a "learning machine" essential for time interval estimation underlying motor coordination and other behaviors. Theoretical work has proposed that the cerebellum's input recipient structure, the granule cell layer (GCL), performs pattern separation of inputs that facilitates learning in Purkinje cells (P-cells). However, the relationship between input reformatting and learning has remained debated, with roles emphasized for pattern separation features from sparsification to decorrelation. We took a novel approach by training a minimalist model of the cerebellar cortex to learn complex time-series data from time-varying inputs, typical during movements. The model robustly produced temporal basis sets from these inputs, and the resultant GCL output supported better learning of temporally complex target functions than mossy fibers alone. Learning was optimized at intermediate threshold levels, supporting relatively dense granule cell activity, yet the key statistical features in GCL population activity that drove learning differed from those seen previously for classification tasks. These findings advance testable hypotheses for mechanisms of temporal basis set formation and predict that moderately dense population activity optimizes learning.NEW & NOTEWORTHY During movement, mossy fiber inputs to the cerebellum relay time-varying information with strong intrinsic relationships to ongoing movement. Are such mossy fibers signals sufficient to support Purkinje signals and learning? In a model, we show how the GCL greatly improves Purkinje learning of complex, temporally dynamic signals relative to mossy fibers alone. Learning-optimized GCL population activity was moderately dense, which retained intrinsic input variance while also performing pattern separation.

Memory decay and generalization following distinct motor learning mechanisms

Motor skill learning is considered to arise out of contributions from multiple learning mechanisms, including error-based learning (EBL), use-dependent learning (UDL), and reinforcement learning (RL). These learning mechanisms exhibit dissociable roles and engage different neural circuits during skill acquisition. However, it remains largely unknown how a newly formed motor memory acquired through each learning mechanism decays over time and whether distinct learning mechanisms produce different generalization patterns. Here, we used variants of reaching paradigms that dissociated these learning mechanisms to examine the time course of memory decay following each learning and the generalization patterns of each learning. We found that motor memories acquired through these learning mechanisms decayed as a function of time. Notably, 15 min, 6 h, and 24 h after acquisition, the memory of EBL decayed much greater than that of RL. The memory acquired through UDL faded away within a few minutes. Motor memories formed through EBL and RL for given movement directions generalized to untrained movement directions, with the generalization of EBL being greater than that of RL. In contrast, motor memory of UDL could not generalize to untrained movement directions. These results suggest that distinct learning mechanisms exhibit different patterns of memory decay and generalization.NEW & NOTEWORTHY Motor skill learning is likely to involve error-based learning, use-dependent plasticity, and operant reinforcement. Here, we showed that these dissociable learning mechanisms exhibited distinct patterns of memory decay and generalization. With a better understanding of the characteristics of these learning mechanisms, it becomes possible to regulate each learning process separately to improve neurological rehabilitation.

Cerebellar GABA Change during Visuomotor Adaptation Relates to Adaptation Performance and Cerebellar Network Connectivity: A Magnetic Resonance Spectroscopic Imaging Study

Motor adaptation is crucial for performing accurate movements in a changing environment and relies on the cerebellum. Although cerebellar involvement has been well characterized, the neurochemical changes in the cerebellum underpinning human motor adaptation remain unknown. We used a novel magnetic resonance spectroscopic imaging (MRSI) technique to measure changes in the inhibitory neurotransmitter GABA in the human cerebellum during visuomotor adaptation. Participants (n = 17, six female) used their right hand to adapt to a rotated cursor in the scanner, compared with a control task requiring no adaptation. We spatially resolved adaptation-driven GABA changes at the cerebellar nuclei and cerebellar cortex in the left and the right cerebellar hemisphere independently and found that simple right-hand movements increase GABA in the right cerebellar nuclei and decreases GABA in the left. When isolating adaptation-driven GABA changes, we found that GABA in the left cerebellar nuclei and the right cerebellar nuclei diverged, although GABA change from baseline at the right cerebellar nuclei was not different from zero at the group level. Early adaptation-driven GABA fluctuations in the right cerebellar nuclei correlated with adaptation performance. Participants showing greater GABA decrease adapted better, suggesting early GABA change is behaviorally relevant. Early GABA change also correlated with functional connectivity change in a cerebellar network. Participants showing greater decreases in GABA showed greater strength increases in cerebellar network connectivity. Results were specific to GABA, to adaptation, and to the cerebellar network. This study provides first evidence for plastic changes in cerebellar neurochemistry during motor adaptation. Characterizing these naturally occurring neurochemical changes may provide a basis for developing therapeutic interventions to facilitate human motor adaptation.SIGNIFICANCE STATEMENT Despite motor adaptation being fundamental to maintaining accurate movements, its neurochemical basis remains poorly understood, perhaps because measuring neurochemicals in the human cerebellum is technically challenging. Using a novel magnetic resonance spectroscopic imaging method, this study provides evidence for GABA changes in the left compared with the right cerebellar nuclei driven by both simple movement and motor adaptation. Although right cerebellar GABA changes were not significantly different from zero at the group level, the adaptation-driven GABA fluctuations in the right cerebellar nuclei correlated with adaptation performance and with functional connectivity change in a cerebellar network. These results show the first evidence for plastic changes in cerebellar neurochemistry during a cerebellar learning task. This provides the basis for developing therapeutic interventions that facilitate these naturally occurring changes to amplify cerebellar-dependent learning.

The Effects of Resistance Training on Physical Fitness and Neuromotor-Cognitive Functions in Adults With Down Syndrome

Adults with Down syndrome are an underserved population at high risk for a host of different pathologies from aging and lack of activity.

Localization of long-term synaptic plasticity defects in cerebellar circuits using optokinetic reflex learning profile

Objective.Functional maps of the central nervous system attribute the coordination and control of many body movements directly or indirectly to the cerebellum. Despite this general picture, there is little information on the function of cerebellar neural components at the circuit level. The presence of multiple synaptic junctions and the synergistic action of different types of plasticity make it virtually difficult to determine the distinct contribution of cerebellar neural processes to behavioral manifestations. In this study, investigating the effect of long-term synaptic changes on cerebellar motor learning, we intend to provide quantitative criteria for localizing defects in the major forms of synaptic plasticity in the cerebellum.Approach.To this end, we develop a firing rate model of the cerebellar circuits to simulate learning of optokinetic reflex (OKR), one of the most well-known cerebellar-dependent motor tasks. In the following, by comparing the simulated OKR learning profile for normal and pathosynaptic conditions, we extract the learning features affected by long-term plasticity disorders. Next, conducting simulation with different massed (continuous with no rest) and spaced (interleaved with rest periods) learning paradigms, we estimate the detrimental impact of plasticity defects at corticonuclear synapses on short- and long-term motor memory.Main results.Our computational approach predicts a correlation between location and grade of the defect with some learning factors such as the rate of formation and retention of motor memory, baseline performance, and even cerebellar motor reserve capacity. Further, spacing analysis reveal the dependence of learning paradigm efficiency on the spatiotemporal characteristic of defect in the network. Indeed, defects in cortical memory formation and nuclear memory consolidation mainly harm massed and spaced learning, respectively. This result is used to design a differential assay for identifying the faulty phases of cerebellar learning.Significance.The proposed computational framework can help develop neural-screening systems and prepare meso-scale functional maps of the cerebellar circuits.

Synchronous spiking of cerebellar Purkinje cells during control of movements

SignificanceThe information that one region of the brain transmits to another is usually viewed through the lens of firing rates. However, if the output neurons could vary the timing of their spikes, then, through synchronization, they would spotlight information that may be critical for control of behavior. Here we report that, in the cerebellum, Purkinje cell populations that share a preference for error convey, to the nucleus, when to decelerate the movement, by reducing their firing rates and temporally synchronizing the remaining spikes.

Adaptive control of movement deceleration during saccades

As you read this text, your eyes make saccades that guide your fovea from one word to the next. Accuracy of these movements require the brain to monitor and learn from visual errors. A current model suggests that learning is supported by two different adaptive processes, one fast (high error sensitivity, low retention), and the other slow (low error sensitivity, high retention). Here, we searched for signatures of these hypothesized processes and found that following experience of a visual error, there was an adaptive change in the motor commands of the subsequent saccade. Surprisingly, this adaptation was not uniformly expressed throughout the movement. Rather, after experience of a single error, the adaptive response in the subsequent trial was limited to the deceleration period. After repeated exposure to the same error, the acceleration period commands also adapted, and exhibited resistance to forgetting during set-breaks. In contrast, the deceleration period commands adapted more rapidly, but suffered from poor retention during these same breaks. State-space models suggested that acceleration and deceleration periods were supported by a shared adaptive state which re-aimed the saccade, as well as two separate processes which resembled a two-state model: one that learned slowly and contributed primarily via acceleration period commands, and another that learned rapidly but contributed primarily via deceleration period commands.

An implicit memory of errors limits human sensorimotor adaptation

During extended motor adaptation, learning appears to saturate despite persistence of residual errors. This adaptation limit is not fixed but varies with perturbation variance; when variance is high, residual errors become larger. These changes in total adaptation could relate to either implicit or explicit learning systems. Here, we found that when adaptation relied solely on the explicit system, residual errors disappeared and learning was unaltered by perturbation variability. In contrast, when learning depended entirely, or in part, on implicit learning, residual errors reappeared. Total implicit adaptation decreased in the high-variance environment due to changes in error sensitivity, not in forgetting. These observations suggest a model in which the implicit system becomes more sensitive to errors when they occur in a consistent direction. Thus, residual errors in motor adaptation are at least in part caused by an implicit learning system that modulates its error sensitivity in response to the consistency of past errors.

Autonomous Purkinje cell activation instructs bidirectional motor learning through evoked dendritic calcium signaling

The signals in cerebellar Purkinje cells sufficient to instruct motor learning have not been systematically determined. Therefore, we applied optogenetics in mice to autonomously excite Purkinje cells and measured the effect of this activity on plasticity induction and adaptive behavior. Ex vivo, excitation of channelrhodopsin-2-expressing Purkinje cells elicits dendritic Ca2+ transients with high-intensity stimuli initiating dendritic spiking that additionally contributes to the Ca2+ response. Channelrhodopsin-2-evoked Ca2+ transients potentiate co-active parallel fiber synapses; depression occurs when Ca2+ responses were enhanced by dendritic spiking. In vivo, optogenetic Purkinje cell activation drives an adaptive decrease in vestibulo-ocular reflex gain when vestibular stimuli are paired with relatively small-magnitude Purkinje cell Ca2+ responses. In contrast, pairing with large-magnitude Ca2+ responses increases vestibulo-ocular reflex gain. Optogenetically induced plasticity and motor adaptation are dependent on endocannabinoid signaling, indicating engagement of this pathway downstream of Purkinje cell Ca2+ elevation. Our results establish a causal relationship among Purkinje cell Ca2+ signal size, opposite-polarity plasticity induction, and bidirectional motor learning.

Bidirectional learning in upbound and downbound microzones of the cerebellum

Over the past several decades, theories about cerebellar learning have evolved. A relatively simple view that highlighted the contribution of one major form of heterosynaptic plasticity to cerebellar motor learning has given way to a plethora of perspectives that suggest that many different forms of synaptic and non-synaptic plasticity, acting at various sites, can control multiple types of learning behaviour. However, there still seem to be contradictions between the various hypotheses with regard to the mechanisms underlying cerebellar learning. The challenge is therefore to reconcile these different views and unite them into a single overall concept. Here I review our current understanding of the changes in the activity of cerebellar Purkinje cells in different 'microzones' during various forms of learning. I describe an emerging model that indicates that the activity of each microzone is bound to either increase or decrease during the initial stages of learning, depending on the directional and temporal demands of its downstream circuitry and the behaviour involved.

Population coding in the cerebellum: a machine learning perspective

The cere resembles a feedforward, three-layer network of neurons in which the "hidden layer" consists of Purkinje cells (P-cells) and the output layer consists of deep cerebellar nucleus (DCN) neurons. In this analogy, the output of each DCN neuron is a prediction that is compared with the actual observation, resulting in an error signal that originates in the inferior olive. Efficient learning requires that the error signal reach the DCN neurons, as well as the P-cells that project onto them. However, this basic rule of learning is violated in the cerebellum: the olivary projections to the DCN are weak, particularly in adulthood. Instead, an extraordinarily strong signal is sent from the olive to the P-cells, producing complex spikes. Curiously, P-cells are grouped into small populations that converge onto single DCN neurons. Why are the P-cells organized in this way, and what is the membership criterion of each population? Here, I apply elementary mathematics from machine learning and consider the fact that P-cells that form a population exhibit a special property: they can synchronize their complex spikes, which in turn suppress activity of DCN neuron they project to. Thus complex spikes cannot only act as a teaching signal for a P-cell, but through complex spike synchrony, a P-cell population may act as a surrogate teacher for the DCN neuron that produced the erroneous output. It appears that grouping of P-cells into small populations that share a preference for error satisfies a critical requirement of efficient learning: providing error information to the output layer neuron (DCN) that was responsible for the error, as well as the hidden layer neurons (P-cells) that contributed to it. This population coding may account for several remarkable features of behavior during learning, including multiple timescales, protection from erasure, and spontaneous recovery of memory.

Multiple Motor Learning Processes in Humans: Defining Their Neurophysiological Bases

Learning new motor behaviors or adjusting previously learned actions to account for dynamic changes in our environment requires the operation of multiple distinct motor learning processes, which rely on different neuronal substrates. For instance, humans are capable of acquiring new motor patterns via the formation of internal model representations of the movement dynamics and through positive reinforcement. In this review, we will discuss how changes in human physiological markers, assessed with noninvasive brain stimulation techniques from distinct brain regions, can be utilized to provide insights toward the distinct learning processes underlying motor learning. We will summarize the findings from several behavioral and neurophysiological studies that have made efforts to understand how distinct processes contribute to and interact when learning new motor behaviors. In particular, we will extensively review two types of behavioral processes described in human sensorimotor learning: (1) a recalibration process of a previously learned movement and (2) acquiring an entirely new motor control policy, such as learning to play an instrument. The selected studies will demonstrate in-detail how distinct physiological mechanisms contributions change depending on the time course of learning and the type of behaviors being learned.

Synergistic excitability plasticity in cerebellar functioning

The cerebellum, a universal processor for sensory acquisition and internal models, and its association with synaptic and nonsynaptic plasticity have been envisioned as the biological correlates of learning, perception, and even thought. Indeed, the cerebellum is no longer considered merely as the locus of motor coordination and its learning. Here, we introduce the mechanisms underlying the induction of multiple types of plasticity in cerebellar circuit and give an overview focusing on the plasticity of nonsynaptic intrinsic excitability. The discovery of long-term potentiation of synaptic responsiveness in hippocampal neurons led investigations into changes of their intrinsic excitability. This activity-dependent potentiation of neuronal excitability is distinct from that of synaptic efficacy. Systematic examination of excitability plasticity has indicated that the modulation of various types of Ca²⁺ - and voltage-dependent K⁺ channels underlies the phenomenon, which is also triggered by immune activity. Intrinsic plasticity is expressed specifically on dendrites and modifies the integrative processing and filtering effect. In Purkinje cells, modulation of the discordance of synaptic current on soma and dendrite suggested a novel type of cellular learning mechanism. This property enables a plausible synergy between synaptic efficacy and intrinsic excitability, by amplifying electrical conductivity and influencing the polarity of bidirectional synaptic plasticity. Furthermore, the induction of intrinsic plasticity in the cerebellum correlates with motor performance and cognitive processes, through functional connections from the cerebellar nuclei to neocortex and associated regions: for example, thalamus and midbrain. Taken together, recent advances in neuroscience have begun to shed light on the complex functioning of nonsynaptic excitability and the synergy.

Encoding of eye movements explains reward-related activity in cerebellar simple spikes

The cerebellum exhibits both motor and reward-related signals. However, it remains unclear whether reward is processed independently from the motor command or might reflect the motor consequences of the reward drive. To test how reward-related signals interact with sensorimotor processing in the cerebellum, we recorded Purkinje cell simple spike activity in the cerebellar floccular complex while monkeys were engaged in smooth pursuit eye movement tasks. The color of the target signaled the size of the reward the monkeys would receive at the end of the target motion. When the tracking task presented a single target, both pursuit and neural activity were only slightly modulated by the reward size. The reward modulations in single cells were rarely large enough to be detected. These modulations were only significant in the population analysis when we averaged across many neurons. In two-target tasks where the monkey learned to select based on the size of the reward outcome, both behavior and neural activity adapted rapidly. In both the single- and two-target tasks, the size of the reward-related modulation matched the size of the effect of reward on behavior. Thus, unlike cortical activity in eye movement structures, the reward-related signals could not be dissociated from the motor command. These results suggest that reward information is integrated with the eye movement command upstream of the Purkinje cells in the floccular complex. Thus reward-related modulations of the simple spikes are akin to modulations found in motor behavior and not to the central processing of the reward value.NEW & NOTEWORTHY Disentangling sensorimotor and reward signals is only possible if these signals do not completely overlap. We recorded activity in the floccular complex of the cerebellum while monkeys performed tasks designed to separate representations of reward from those of movement. Activity modulation by reward could be accounted for by the coding of eye movement parameters, suggesting that reward information is already integrated into motor commands upstream of the floccular complex.

Bidirectional short-term plasticity during single-trial learning of cerebellar-driven eyelid movements in mice

The brain is constantly monitoring its own performance, using error signals to trigger mechanisms of plasticity that help improve future behavior. Indeed, adaptive changes in behavior have been observed after a single error trial in many learning tasks, including cerebellum-dependent eyeblink conditioning. Here, we demonstrate that the plasticity underlying single-trial learning during eyeblink conditioning in mice is bidirectionally regulated by positive and negative prediction errors, has an ephemeral effect on behavior (decays in <1 min), and can be triggered in the absence of errors in performance. We suggest that these three properties of single-trial learning may be particularly useful for driving mechanisms of motor adaptation that can achieve optimal performance in the face of environmental disturbances with a fast timescale.

Computational Principles of Supervised Learning in the Cerebellum

Supervised learning plays a key role in the operation of many biological and artificial neural networks. Analysis of the computations underlying supervised learning is facilitated by the relatively simple and uniform architecture of the cerebellum, a brain area that supports numerous motor, sensory, and cognitive functions. We highlight recent discoveries indicating that the cerebellum implements supervised learning using the following organizational principles: ( a) extensive preprocessing of input representations (i.e., feature engineering), ( b) massively recurrent circuit architecture, ( c) linear input-output computations, ( d) sophisticated instructive signals that can be regulated and are predictive, ( e) adaptive mechanisms of plasticity with multiple timescales, and ( f) task-specific hardware specializations. The principles emerging from studies of the cerebellum have striking parallels with those in other brain areas and in artificial neural networks, as well as some notable differences, which can inform future research on supervised learning and inspire next-generation machine-based algorithms.

No effects of cerebellar transcranial direct current stimulation on force field and visuomotor reach adaptation in young and healthy subjects

Previous studies have shown that cerebellar transcranial direct current stimulation (tDCS) leads to faster adaptation of arm reaching movements to visuomotor rotation and force field perturbations in healthy subjects. The first aim of the present study was to confirm a stimulation-dependent effect on motor adaptation. Second, we investigated whether tDCS effects differ depending on onset, that is, before or at the beginning of the adaptation phase. A total of 120 healthy and right-handed subjects (60 women, mean age 23.2 ± SD 2.7 yr, range 18-31 yr) were tested. Subjects moved a cursor with a manipulandum to one of eight targets presented on a vertically orientated screen. Three baseline blocks were followed by one adaptation block and three washout blocks. Sixty subjects did a force field adaptation task (FF), and 60 subjects did a visuomotor adaptation task (VM). Equal numbers of subjects received anodal, cathodal, or sham cerebellar tDCS beginning either in the third baseline block or at the start of the adaptation block. In FF and VM, tDCS and the onset of tDCS did not show a significant effect on motor adaptation (all P values >0.05). We were unable to support previous findings of modulatory cerebellar tDCS effects in reaching adaptation tasks in healthy subjects. Prior to possible application in patients with cerebellar disease, future experiments are needed to determine which tDCS and task parameters lead to robust tDCS effects. NEW & NOTEWORTHY Transcranial direct current stimulation (tDCS) is a promising tool to improve motor learning. We investigated whether cerebellar tDCS improves motor learning in force field and visuomotor tasks in healthy subjects and what influence the onset of stimulation has. We did not find stimulation effects of tDCS or an effect of onset of stimulation. A reevaluation of cerebellar tDCS in healthy subjects and at the end of the clinical potential in cerebellar patients is demanded.

Multiple components in direction learning in smooth pursuit eye movements of monkeys

We analyzed behavioral features of smooth pursuit eye movements to characterize the course of acquisition and expression of multiple neural components of motor learning. Monkeys tracked a target that began to move in an initial "pursuit" direction and suddenly, but predictably, changed direction after a fixed interval of 250 ms. As the trial is repeated, monkeys learn to make eye movements that predict the change in target direction. Quantitative analysis of the learned response revealed evidence for multiple, dynamic, parallel processes at work during learning. 1) The overall learning followed at least two trial courses: a fast component grew and saturated rapidly over tens of trials, and a slow component grew steadily over up to 1,000 trials. 2) The temporal specificity of the learned response within each trial was crude during the first 100 trials but then improved gradually over the remaining trials. 3) External influences on the gain of pursuit initiation modulate the expression but probably not the acquisition of learning. The gain of pursuit initiation and the expression of the learned response decreased in parallel, both gradually through a 1,000-trial learning block and immediately between learning trials with different gains in the initiation of pursuit. We conclude that at least two distinct neural mechanisms drive the acquisition of pursuit learning over 100 to 1,000 trials (3 to 30 min). Both mechanisms generate underlying memory traces that are modulated in relation to the gain of pursuit initiation before expression in the final motor output. NEW & NOTEWORTHY We show that cerebellum-dependent direction learning in smooth pursuit eye movements grows in at least two components over 1,100 behavioral learning repetitions. One component grows over tens of trials and the other over hundreds. Within trials, learned temporal specificity gradually improves over hundreds of trials. The expression of each learning component on a given trial can be modified by external factors that do not affect the underlying memory trace.

The relationship between reinforcement and explicit control during visuomotor adaptation

The motor system’s ability to adapt to environmental changes is essential for maintaining accurate movements. Such adaptation recruits several distinct systems: cerebellar sensory-prediction error learning, success-based reinforcement, and explicit control. Although much work has focused on the relationship between cerebellar learning and explicit control, there is little research regarding how reinforcement and explicit control interact. To address this, participants first learnt a 20° visuomotor displacement. After reaching asymptotic performance, binary, hit-or-miss feedback (BF) was introduced either with or without visual feedback, the latter promoting reinforcement. Subsequently, retention was assessed using no-feedback trials, with half of the participants in each group being instructed to stop aiming off target. Although BF led to an increase in retention of the visuomotor displacement, instructing participants to stop re-aiming nullified this effect, suggesting explicit control is critical to BF-based reinforcement. In a second experiment, we prevented the expression or development of explicit control during BF performance, by either constraining participants to a short preparation time (expression) or by introducing the displacement gradually (development). Both manipulations strongly impaired BF performance, suggesting reinforcement requires both recruitment and expression of an explicit component. These results emphasise the pivotal role explicit control plays in reinforcement-based motor learning.

Encoding of error and learning to correct that error by the Purkinje cells of the cerebellum

The primary output cells of the cerebellar cortex, Purkinje cells, make kinematic predictions about ongoing movements via high-frequency simple spikes, but receive sensory error information about that movement via low-frequency complex spikes (CS). How is the vector space of sensory errors encoded by this low-frequency signal? Here we measured Purkinje cell activity in the oculomotor vermis of animals during saccades, then followed the chain of events from experience of visual error, generation of CS, modulation of simple spikes, and ultimately change in motor output. We found that while error direction affected the probability of CS, error magnitude altered its temporal distribution. Production of CS changed the simple spikes on the next trial, but regardless of the actual visual error, this change biased the movement only along a vector that was parallel to the Purkinje cell's preferred error. From these results, we inferred the anatomy of a sensory-to-motor adaptive controller that transformed visual error vectors into motor-corrections.

Estimating properties of the fast and slow adaptive processes during sensorimotor adaptation

Experience of a prediction error recruits multiple motor learning processes, some that learn strongly from error but have weak retention and some that learn weakly from error but exhibit strong retention. These processes are not generally observable but are inferred from their collective influence on behavior. Is there a robust way to uncover the hidden processes? A standard approach is to consider a state space model where the hidden states change following experience of error and then fit the model to the measured data by minimizing the squared error between measurement and model prediction. We found that this least-squares algorithm (LMSE) often yielded unrealistic predictions about the hidden states, possibly because of its neglect of the stochastic nature of error-based learning. We found that behavioral data during adaptation was better explained by a system in which both error-based learning and movement production were stochastic processes. To uncover the hidden states of learning, we developed a generalized expectation maximization (EM) algorithm. In simulation, we found that although LMSE tracked the measured data marginally better than EM, EM was far more accurate in unmasking the time courses and properties of the hidden states of learning. In a power analysis designed to measure the effect of an intervention on sensorimotor learning, EM significantly reduced the number of subjects that were required for effective hypothesis testing. In summary, we developed a new approach for analysis of data in sensorimotor experiments. The new algorithm improved the ability to uncover the multiple processes that contribute to learning from error. NEW & NOTEWORTHY Motor learning is supported by multiple adaptive processes, each with distinct error sensitivity and forgetting rates. We developed a generalized expectation maximization algorithm that uncovers these hidden processes in the context of modern sensorimotor learning experiments that include error-clamp trials and set breaks. The resulting toolbox may improve the ability to identify the properties of these hidden processes and reduce the number of subjects needed to test the effectiveness of interventions on sensorimotor learning.

The Roles of the Olivocerebellar Pathway in Motor Learning and Motor Control. A Consensus Paper

For many decades, the predominant view in the cerebellar field has been that the olivocerebellar system's primary function is to induce plasticity in the cerebellar cortex, specifically, at the parallel fiber-Purkinje cell synapse. However, it has also long been proposed that the olivocerebellar system participates directly in motor control by helping to shape ongoing motor commands being issued by the cerebellum. Evidence consistent with both hypotheses exists; however, they are often investigated as mutually exclusive alternatives. In contrast, here, we take the perspective that the olivocerebellar system can contribute to both the motor learning and motor control functions of the cerebellum and might also play a role in development. We then consider the potential problems and benefits of it having multiple functions. Moreover, we discuss how its distinctive characteristics (e.g., low firing rates, synchronization, and variable complex spike waveforms) make it more or less suitable for one or the other of these functions, and why having multiple functions makes sense from an evolutionary perspective. We did not attempt to reach a consensus on the specific role(s) the olivocerebellar system plays in different types of movements, as that will ultimately be determined experimentally; however, collectively, the various contributions highlight the flexibility of the olivocerebellar system, and thereby suggest that it has the potential to act in both the motor learning and motor control functions of the cerebellum.

Motor Learning Requires Purkinje Cell Synaptic Potentiation through Activation of AMPA-Receptor Subunit GluA3

Accumulating evidence indicates that cerebellar long-term potentiation (LTP) is necessary for procedural learning. However, little is known about its underlying molecular mechanisms. Whereas AMPA receptor (AMPAR) subunit rules for synaptic plasticity have been extensively studied in relation to declarative learning, it is unclear whether these rules apply to cerebellum-dependent motor learning. Here we show that LTP at the parallel-fiber-to-Purkinje-cell synapse and adaptation of the vestibulo-ocular reflex depend not on GluA1- but on GluA3-containing AMPARs. In contrast to the classic form of LTP implicated in declarative memory formation, this form of LTP does not require GluA1-AMPAR trafficking but rather requires changes in open-channel probability of GluA3-AMPARs mediated by cAMP signaling and activation of the protein directly activated by cAMP (Epac). We conclude that vestibulo-cerebellar motor learning is the first form of memory acquisition shown to depend on GluA3-dependent synaptic potentiation by increasing single-channel conductance.

•

Cerebellar learning depends on expression of GluA3, but not GluA1, in Purkinje cells

•

GluA3 is required to induce LTP, but not LTD, at PF-PC synapses

•

GluA3-dependent potentiation involves a cAMP-driven change in channel conductance

•

GluA3-mediated LTP and learning are induced via cAMP-mediated Epac activation

Modulation of Complex-Spike Duration and Probability during Cerebellar Motor Learning in Visually Guided Smooth-Pursuit Eye Movements of Monkeys

Activation of an inferior olivary neuron powerfully excites Purkinje cells via its climbing fiber input and triggers a characteristic high-frequency burst, known as the complex spike (CS). The theory of cerebellar learning postulates that the CS induces long-lasting depression of the strength of synapses from active parallel fibers onto Purkinje cells, and that synaptic depression leads to changes in behavior. Prior reports showed that a CS on one learning trial is linked to a properly timed depression of simple spikes on the subsequent trial, as well as a learned change in pursuit eye movement. Further, the duration of a CS is a graded instruction for single-trial plasticity and behavioral learning. We now show across multiple learning paradigms that both the probability and duration of CS responses are correlated with the magnitudes of neural and behavioral learning in awake behaving monkeys. When the direction of the instruction for learning repeatedly was in the same direction or alternated directions, the duration and probability of CS responses decreased over a learning block along with the magnitude of trial-over-trial neural learning. When the direction of the instruction was randomized, CS duration, CS probability, and neural and behavioral learning remained stable across time. In contrast to depression, potentiation of simple-spike firing rate for ON-direction learning instructions follows a longer time course and plays a larger role as depression wanes. Computational analysis provides a model that accounts fully for the detailed statistics of a complex set of data.

Adaptive Acceleration of Visually Evoked Smooth Eye Movements in Mice

The optokinetic response (OKR) consists of smooth eye movements following global motion of the visual surround, which suppress image slip on the retina for visual acuity. The effective performance of the OKR is limited to rather slow and low-frequency visual stimuli, although it can be adaptably improved by cerebellum-dependent mechanisms. To better understand circuit mechanisms constraining OKR performance, we monitored how distinct kinematic features of the OKR change over the course of OKR adaptation, and found that eye acceleration at stimulus onset primarily limited OKR performance but could be dramatically potentiated by visual experience. Eye acceleration in the temporal-to-nasal direction depended more on the ipsilateral floccular complex of the cerebellum than did that in the nasal-to-temporal direction. Gaze-holding following the OKR was also modified in parallel with eye-acceleration potentiation. Optogenetic manipulation revealed that synchronous excitation and inhibition of floccular complex Purkinje cells could effectively accelerate eye movements in the nasotemporal and temporonasal directions, respectively. These results collectively delineate multiple motor pathways subserving distinct aspects of the OKR in mice and constrain hypotheses regarding cellular mechanisms of the cerebellum-dependent tuning of movement acceleration.

SIGNIFICANCE STATEMENT

Although visually evoked smooth eye movements, known as the optokinetic response (OKR), have been studied in various species for decades, circuit mechanisms of oculomotor control and adaptation remain elusive. In the present study, we assessed kinematics of the mouse OKR through the course of adaptation training. Our analyses revealed that eye acceleration at visual-stimulus onset primarily limited working velocity and frequency range of the OKR, yet could be dramatically potentiated during OKR adaptation. Potentiation of eye acceleration exhibited different properties between the nasotemporal and temporonasal OKRs, indicating distinct visuomotor circuits underlying the two. Lesions and optogenetic manipulation of the cerebellum provide constraints on neural circuits mediating visually driven eye acceleration and its adaptation.

Distinct responses of Purkinje neurons and roles of simple spikes during associative motor learning in larval zebrafish

To study cerebellar activity during learning, we made whole-cell recordings from larval zebrafish Purkinje cells while monitoring fictive swimming during associative conditioning. Fish learned to swim in response to visual stimulation preceding tactile stimulation of the tail. Learning was abolished by cerebellar ablation. All Purkinje cells showed task-related activity. Based on how many complex spikes emerged during learned swimming, they were classified as multiple, single, or zero complex spike (MCS, SCS, ZCS) cells. With learning, MCS and ZCS cells developed increased climbing fiber (MCS) or parallel fiber (ZCS) input during visual stimulation; SCS cells fired complex spikes associated with learned swimming episodes. The categories correlated with location. Optogenetically suppressing simple spikes only during visual stimulation demonstrated that simple spikes are required for acquisition and early stages of expression of learned responses, but not their maintenance, consistent with a transient, instructive role for simple spikes during cerebellar learning in larval zebrafish.

Responses of Purkinje cells in the oculomotor vermis of monkeys during smooth pursuit eye movements and saccades: comparison with floccular complex

We recorded the responses of Purkinje cells in the oculomotor vermis during smooth pursuit and saccadic eye movements. Our goal was to characterize the responses in the vermis using approaches that would allow direct comparisons with responses of Purkinje cells in another cerebellar area for pursuit, the floccular complex. Simple-spike firing of vermis Purkinje cells is direction selective during both pursuit and saccades, but the preferred directions are sufficiently independent so that downstream circuits could decode signals to drive pursuit and saccades separately. Complex spikes also were direction selective during pursuit, and almost all Purkinje cells showed a peak in the probability of complex spikes during the initiation of pursuit in at least one direction. Unlike the floccular complex, the preferred directions for simple spikes and complex spikes were not opposite. The kinematics of smooth eye movement described the simple-spike responses of vermis Purkinje cells well. Sensitivities were similar to those in the floccular complex for eye position and considerably lower for eye velocity and acceleration. The kinematic relations were quite different for saccades vs. pursuit, supporting the idea that the contributions from the vermis to each kind of movement could contribute independently in downstream areas. Finally, neither the complex-spike nor the simple-spike responses of vermis Purkinje cells were appropriate to support direction learning in pursuit. Complex spikes were not triggered reliably by an instructive change in target direction; simple-spike responses showed very small amounts of learning. We conclude that the vermis plays a different role in pursuit eye movements compared with the floccular complex.NEW & NOTEWORTHY The midline oculomotor cerebellum plays a different role in smooth pursuit eye movements compared with the lateral, floccular complex and appears to be much less involved in direction learning in pursuit. The output from the oculomotor vermis during pursuit lies along a null-axis for saccades and vice versa. Thus the vermis can play independent roles in the two kinds of eye movement.

Movement Rate Is Encoded and Influenced by Widespread, Coherent Activity of Cerebellar Molecular Layer Interneurons

Inhibition from molecular layer interneurons (MLIs) is thought to play an important role in cerebellar function by sharpening the precision of Purkinje cell spike output. Yet the coding features of MLIs during behavior are poorly understood. To study MLI activity, we used in vivo Ca²⁺ imaging in head-fixed mice during the performance of a rhythmic motor behavior, licking during water consumption. MLIs were robustly active during lick-related movement across a lobule-specific region of the cerebellum showing high temporal correspondence within their population. Average MLI Ca²⁺ activity strongly correlated with movement rate but not to the intentional, or unexpected, adjustment of lick position or to sensory feedback that varied with task condition. Chemogenetic suppression of MLI output reduced lick rate and altered tongue movements, indicating that activity of these interneurons not only encodes temporal aspects of movement kinematics but also influences motor outcome pointing to an integral role in online control of rhythmic behavior.SIGNIFICANCE STATEMENT The cerebellum helps fine-tune coordinated motor actions via signaling from projection neurons called Purkinje cells. Molecular layer interneurons (MLIs) provide powerful inhibition onto Purkinje cells, but little is understood about how this inhibitory circuit is engaged during behavior or what type of information is transmitted through these neurons. Our work establishes that MLIs in the lateral cerebellum are broadly activated during movement with calcium activity corresponding to movement rate. We also show that suppression of MLI output slows and disorganizes the precise movement pattern. Therefore, MLIs are an important circuit element in the cerebellum allowing for accurate motor control.

Cerebellar-M1 Connectivity Changes Associated with Motor Learning Are Somatotopic Specific

One of the functions of the cerebellum in motor learning is to predict and account for systematic changes to the body or environment. This form of adaptive learning is mediated by plastic changes occurring within the cerebellar cortex. The strength of cerebellar-to-cerebral pathways for a given muscle may reflect aspects of cerebellum-dependent motor adaptation. These connections with motor cortex (M1) can be estimated as cerebellar inhibition (CBI): a conditioning pulse of transcranial magnetic stimulation delivered to the cerebellum before a test pulse over motor cortex. Previously, we have demonstrated that changes in CBI for a given muscle representation correlate with learning a motor adaptation task with the involved limb. However, the specificity of these effects is unknown. Here, we investigated whether CBI changes in humans are somatotopy specific and how they relate to motor adaptation. We found that learning a visuomotor rotation task with the right hand changed CBI, not only for the involved first dorsal interosseous of the right hand, but also for an uninvolved right leg muscle, the tibialis anterior, likely related to inter-effector transfer of learning. In two follow-up experiments, we investigated whether the preparation of a simple hand or leg movement would produce a somatotopy-specific modulation of CBI. We found that CBI changes only for the effector involved in the movement. These results indicate that learning-related changes in cerebellar-M1 connectivity reflect a somatotopy-specific interaction. Modulation of this pathway is also present in the context of interlimb transfer of learning.SIGNIFICANCE STATEMENT Connectivity between the cerebellum and motor cortex is a critical pathway for the integrity of everyday movements and understanding the somatotopic specificity of this pathway in the context of motor learning is critical to advancing the efficacy of neurorehabilitation. We found that adaptive learning with the hand affects cerebellar-motor cortex connectivity, not only for the trained hand, but also for an untrained leg muscle, an effect likely related to intereffector transfer of learning. Furthermore, we introduce a novel method to measure cerebellar-motor cortex connectivity during movement preparation. With this technique, we show that, outside the context of learning, modulation of cerebellar-motor cortex connectivity is somatotopically specific to the effector being moved.

Temporal dynamics of cerebellar and motor cortex physiological processes during motor skill learning

Learning motor tasks involves distinct physiological processes in the cerebellum (CB) and primary motor cortex (M1). Previous studies have shown that motor learning results in at least two important neurophysiological changes: modulation of cerebellar output mediated in-part by long-term depression of parallel fiber-Purkinje cell synapse and induction of long-term plasticity (LTP) in M1, leading to transient occlusion of additional LTP-like plasticity. However, little is known about the temporal dynamics of these two physiological mechanisms during motor skill learning. Here we use non-invasive brain stimulation to explore CB and M1 mechanisms during early and late motor skill learning in humans. We predicted that early skill acquisition would be proportional to cerebellar excitability (CBI) changes, whereas later stages of learning will result in M1 LTP-like plasticity modifications. We found that early, and not late into skill training, CBI changed. Whereas, occlusion of LTP-like plasticity over M1 occurred only during late, but not early training. These findings indicate a distinct temporal dissociation in the physiological role of the CB and M1 when learning a novel skill. Understanding the role and temporal dynamics of different brain regions during motor learning is critical to device optimal interventions to augment learning.

Oscillations, Timing, Plasticity, and Learning in the Cerebellum

The highly stereotyped, crystal-like architecture of the cerebellum has long served as a basis for hypotheses with regard to the function(s) that it subserves. Historically, most clinical observations and experimental work have focused on the involvement of the cerebellum in motor control, with particular emphasis on coordination and learning. Two main models have been suggested to account for cerebellar functioning. According to Llinás's theory, the cerebellum acts as a control machine that uses the rhythmic activity of the inferior olive to synchronize Purkinje cell populations for fine-tuning of coordination. In contrast, the Ito-Marr-Albus theory views the cerebellum as a motor learning machine that heuristically refines synaptic weights of the Purkinje cell based on error signals coming from the inferior olive. Here, we review the role of timing of neuronal events, oscillatory behavior, and synaptic and non-synaptic influences in functional plasticity that can be recorded in awake animals in various physiological and pathological models in a perspective that also includes non-motor aspects of cerebellar function. We discuss organizational levels from genes through intracellular signaling, synaptic network to system and behavior, as well as processes from signal production and processing to memory, delegation, and actual learning. We suggest an integrative concept for control and learning based on articulated oscillation templates.

Subthalamic, not striatal, activity correlates with basal ganglia downstream activity in normal and parkinsonian monkeys

The striatum and the subthalamic nucleus (STN) constitute the input stage of the basal ganglia (BG) network and together innervate BG downstream structures using GABA and glutamate, respectively. Comparison of the neuronal activity in BG input and downstream structures reveals that subthalamic, not striatal, activity fluctuations correlate with modulations in the increase/decrease discharge balance of BG downstream neurons during temporal discounting classical condition task. After induction of parkinsonism with 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine (MPTP), abnormal low beta (8-15 Hz) spiking and local field potential (LFP) oscillations resonate across the BG network. Nevertheless, LFP beta oscillations entrain spiking activity of STN, striatal cholinergic interneurons and BG downstream structures, but do not entrain spiking activity of striatal projection neurons. Our results highlight the pivotal role of STN divergent projections in BG physiology and pathophysiology and may explain why STN is such an effective site for invasive treatment of advanced Parkinson's disease and other BG-related disorders.

DOI:http://dx.doi.org/10.7554/eLife.16443.001

The symptoms of Parkinson’s disease include tremor and slow movement, as well as loss of balance, depression and problems with sleep and memory. The death of neurons in a region of the brain called the substantia nigra pars compacta is one of the major hallmarks of Parkinson’s disease. These neurons produce a chemical called dopamine, and their death reduces dopamine levels in another area of the brain called the striatum. This structure is one of five brain regions known collectively as the basal ganglia, which form a circuit that helps to control movement.

The most effective treatment currently available for advanced Parkinson’s disease entails lowering electrodes deep into the brain in order to shut down the activity of part of the basal ganglia. However, the target is not the striatum; instead it is a structure called the subthalamic nucleus. The striatum and the subthalamic nucleus are the two input regions of the basal ganglia: each sends signals to the other three structures downstream. So why does targeting the subthalamic nucleus, but not the striatum, reduce the symptoms of Parkinson’s disease?

To shed some light on this issue, Deffains et al. recorded the activity of neurons in the basal ganglia before and after injecting two monkeys with a drug called MPTP. Related to heroin, MPTP produces symptoms in animals that resemble those of Parkinson’s disease. Before the injections, spontaneous fluctuations in the activity of the subthalamic nucleus produced matching changes in the activity of the three downstream basal ganglia structures. Fluctuations in the activity of the striatum, by contrast, had no such effect. Moreover, injecting the monkeys with MPTP caused the basal ganglia to fire in an abnormal highly synchronized rhythm, similar to that seen in Parkinson’s disease. Crucially, the subthalamic nucleus contributed to this abnormal rhythm, whereas the striatum did not.

The results presented by Deffains et al. provide a concrete explanation for why inactivating the subthalamic nucleus, but not the striatum, reduces the symptoms of Parkinson’s disease. Further research is now needed to explore how the striatum controls the activity of downstream regions of the basal ganglia, both in healthy people and in those with Parkinson's disease.

DOI:http://dx.doi.org/10.7554/eLife.16443.002

Modeling eye-head gaze shifts in multiple contexts without motor planning

During gaze shifts, the eyes and head collaborate to rapidly capture a target (saccade) and fixate it. Accordingly, models of gaze shift control should embed both saccadic and fixation modes and a mechanism for switching between them. We demonstrate a model in which the eye and head platforms are driven by a shared gaze error signal. To limit the number of free parameters, we implement a model reduction approach in which steady-state cerebellar effects at each of their projection sites are lumped with the parameter of that site. The model topology is consistent with anatomy and neurophysiology, and can replicate eye-head responses observed in multiple experimental contexts: 1) observed gaze characteristics across species and subjects can emerge from this structure with minor parametric changes; 2) gaze can move to a goal while in the fixation mode; 3) ocular compensation for head perturbations during saccades could rely on vestibular-only cells in the vestibular nuclei with postulated projections to burst neurons; 4) two nonlinearities suffice, i.e., the experimentally-determined mapping of tectoreticular cells onto brain stem targets and the increased recruitment of the head for larger target eccentricities; 5) the effects of initial conditions on eye/head trajectories are due to neural circuit dynamics, not planning; and 6) "compensatory" ocular slow phases exist even after semicircular canal plugging, because of interconnections linking eye-head circuits. Our model structure also simulates classical vestibulo-ocular reflex and pursuit nystagmus, and provides novel neural circuit and behavioral predictions, notably that both eye-head coordination and segmental limb coordination are possible without trajectory planning.

Asymmetries in Cerebellar Plasticity and Motor Learning

Synaptic plasticity at the parallel fiber to Purkinje cell synapse has long been considered a cellular correlate for cerebellar motor learning. Functionally, long-term depression and long-term potentiation at these synapses seem to be the reverse of each other, with both pre- and post-synaptic expression occurring in both. However, different cerebellar motor learning paradigms have been shown to be asymmetric and not equally reversible. Here, we discuss the asymmetric reversibility shown in the vestibulo-ocular reflex and eyeblink conditioning and suggest that different cellular plasticity mechanisms might be recruited under different conditions leading to unequal reversibility.

Distributed Cerebellar Motor Learning: A Spike-Timing-Dependent Plasticity Model

Deep cerebellar nuclei neurons receive both inhibitory (GABAergic) synaptic currents from Purkinje cells (within the cerebellar cortex) and excitatory (glutamatergic) synaptic currents from mossy fibers. Those two deep cerebellar nucleus inputs are thought to be also adaptive, embedding interesting properties in the framework of accurate movements. We show that distributed spike-timing-dependent plasticity mechanisms (STDP) located at different cerebellar sites (parallel fibers to Purkinje cells, mossy fibers to deep cerebellar nucleus cells, and Purkinje cells to deep cerebellar nucleus cells) in close-loop simulations provide an explanation for the complex learning properties of the cerebellum in motor learning. Concretely, we propose a new mechanistic cerebellar spiking model. In this new model, deep cerebellar nuclei embed a dual functionality: deep cerebellar nuclei acting as a gain adaptation mechanism and as a facilitator for the slow memory consolidation at mossy fibers to deep cerebellar nucleus synapses. Equipping the cerebellum with excitatory (e-STDP) and inhibitory (i-STDP) mechanisms at deep cerebellar nuclei afferents allows the accommodation of synaptic memories that were formed at parallel fibers to Purkinje cells synapses and then transferred to mossy fibers to deep cerebellar nucleus synapses. These adaptive mechanisms also contribute to modulate the deep-cerebellar-nucleus-output firing rate (output gain modulation toward optimizing its working range).

Healthy and pathological cerebellar Spiking Neural Networks in Vestibulo-Ocular Reflex

Since the Marr-Albus model, computational neuroscientists have been developing a variety of models of the cerebellum, with different approaches and features. In this work, we developed and tested realistic artificial Spiking Neural Networks inspired to this brain region. We tested in computational simulations of the Vestibulo-Ocular Reflex protocol three different models: a network equipped with a single plasticity site, at the cortical level; a network equipped with a distributed plasticity, at both cortical and nuclear levels; a network with a pathological plasticity mechanism at the cortical level. We analyzed the learning performance of the three different models, highlighting the behavioral differences among them. We proved that the model with a distributed plasticity produces a faster and more accurate cerebellar response, especially during a second session of acquisition, compared with the single plasticity model. Furthermore, the pathological model shows an impaired learning capability in Vestibulo-Ocular Reflex acquisition, as found in neurophysiological studies. The effect of the different plasticity conditions, which change fast and slow dynamics, memory consolidation and, in general, learning capabilities of the cerebellar network, explains differences in the behavioral outcome.

Explicit and Implicit Processes Constitute the Fast and Slow Processes of Sensorimotor Learning

A popular model of human sensorimotor learning suggests that a fast process and a slow process work in parallel to produce the canonical learning curve (Smith et al., 2006). Recent evidence supports the subdivision of sensorimotor learning into explicit and implicit processes that simultaneously subserve task performance (Taylor et al., 2014). We set out to test whether these two accounts of learning processes are homologous. Using a recently developed method to assay explicit and implicit learning directly in a sensorimotor task, along with a computational modeling analysis, we show that the fast process closely resembles explicit learning and the slow process approximates implicit learning. In addition, we provide evidence for a subdivision of the slow/implicit process into distinct manifestations of motor memory. We conclude that the two-state model of motor learning is a close approximation of sensorimotor learning, but it is unable to describe adequately the various implicit learning operations that forge the learning curve. Our results suggest that a wider net be cast in the search for the putative psychological mechanisms and neural substrates underlying the multiplicity of processes involved in motor learning.

Motor Learning and the Cerebellum

Although our ability to store semantic declarative information can nowadays be readily surpassed by that of simple personal computers, our ability to learn and express procedural memories still outperforms that of supercomputers controlling the most advanced robots. To a large extent, our procedural memories are formed in the cerebellum, which embodies more than two-thirds of all neurons in our brain. In this review, we will focus on the emerging view that different modules of the cerebellum use different encoding schemes to form and express their respective memories. More specifically, zebrin-positive zones in the cerebellum, such as those controlling adaptation of the vestibulo-ocular reflex, appear to predominantly form their memories by potentiation mechanisms and express their memories via rate coding, whereas zebrin-negative zones, such as those controlling eyeblink conditioning, appear to predominantly form their memories by suppression mechanisms and express their memories in part by temporal coding using rebound bursting. Together, the different types of modules offer a rich repertoire to acquire and control sensorimotor processes with specific challenges in the spatiotemporal domain.

Persistent residual errors in motor adaptation tasks: reversion to baseline and exploratory escape

When movements are perturbed in adaptation tasks, humans and other animals show incomplete compensation, tolerating small but sustained residual errors that persist despite repeated trials. State-space models explain this residual asymptotic error as interplay between learning from error and reversion to baseline, a form of forgetting. Previous work using zero-error-clamp trials has shown that reversion to baseline is not obligatory and can be overcome by manipulating feedback. We posited that novel error-clamp trials, in which feedback is constrained but has nonzero error and variance, might serve as a contextual cue for recruitment of other learning mechanisms that would then close the residual error. When error clamps were nonzero and had zero variance, human subjects changed their learning policy, using exploration in response to the residual error, despite their willingness to sustain such an error during the training block. In contrast, when the distribution of feedback in clamp trials was naturalistic, with persistent mean error but also with variance, a state-space model accounted for behavior in clamps, even in the absence of task success. Therefore, when the distribution of errors matched those during training, state-space models captured behavior during both adaptation and error-clamp trials because error-based learning dominated; when the distribution of feedback was altered, other forms of learning were triggered that did not follow the state-space model dynamics exhibited during training. The residual error during adaptation appears attributable to an error-dependent learning process that has the property of reversion toward baseline and that can suppress other forms of learning.

Reward-dependent modulation of movement variability

Movement variability is often considered an unwanted byproduct of a noisy nervous system. However, variability can signal a form of implicit exploration, indicating that the nervous system is intentionally varying the motor commands in search of actions that yield the greatest success. Here, we investigated the role of the human basal ganglia in controlling reward-dependent motor variability as measured by trial-to-trial changes in performance during a reaching task. We designed an experiment in which the only performance feedback was success or failure and quantified how reach variability was modulated as a function of the probability of reward. In healthy controls, reach variability increased as the probability of reward decreased. Control of variability depended on the history of past rewards, with the largest trial-to-trial changes occurring immediately after an unrewarded trial. In contrast, in participants with Parkinson's disease, a known example of basal ganglia dysfunction, reward was a poor modulator of variability; that is, the patients showed an impaired ability to increase variability in response to decreases in the probability of reward. This was despite the fact that, after rewarded trials, reach variability in the patients was comparable to healthy controls. In summary, we found that movement variability is partially a form of exploration driven by the recent history of rewards. When the function of the human basal ganglia is compromised, the reward-dependent control of movement variability is impaired, particularly affecting the ability to increase variability after unsuccessful outcomes.

A matter of trial and error for motor learning

Climbing fiber inputs to cerebellar Purkinje cells are thought to carry error signals that can trigger motor learning across multiple time scales. A new study by Kimpo et al. finds that the potency of climbing fibers as instructive signals for adaptation of the vestibulo-ocular reflex depends on task conditions.

Purkinje-cell plasticity and cerebellar motor learning are graded by complex-spike duration

Behavioral learning is mediated by cellular plasticity such as changes in the strength of synapses at specific sites in neural circuits. The theory of cerebellar motor learning^1,2,3 relies on movement errors signaled by climbing-fiber inputs to cause long-term depression of synapses from parallel fibers to Purkinje cells^4,5. Yet, a recent review⁶ has called into question the widely-held view that the climbing fiber input is an “all-or-none” event. In anesthetized animals, there is wide variation in the duration of the complex-spike (CS) caused in Purkinje cells by a climbing fiber input⁷. Further, the duration of electrically-controlled bursts in climbing fibers grades the amount of plasticity in Purkinje cells^8,9. The duration of bursts depends on the “state” of the inferior olive and therefore could be correlated across climbing fibers^8,10. Here, we provide a potential functional context for these mechanisms during motor learning in behaving monkeys. The magnitudes of both plasticity and motor learning depend on the duration of the CS responses. Further, the duration of CS responses appears to be a meaningful signal that is correlated across the Purkinje cell population during motor learning. We suggest that during learning, longer bursts in climbing fibers lead to longer duration CS responses in Purkinje cells, more calcium entry into Purkinje cells, larger synaptic depression, and stronger learning. The same graded impact of instructive signals for plasticity and learning could occur throughout the nervous system.