Cerebellar climbing fibers encode expected reward size

Social and emotional learning in the cerebellum

The posterior cerebellum has a critical role in human social and emotional learning. Three systems and related neural networks support this cerebellar function: a biological action observation system as part of an extended sensorimotor integration network, a mentalizing system for understanding a person's mental and emotional state subserved by a mentalizing network, and a limbic network supporting core emotional (dis)pleasure and arousal processes. In this Review, I describe how these systems and networks support social and emotional learning via functional reciprocal connections initiating and terminating in the posterior cerebellum and cerebral neocortex. It is hypothesized that a major function of the posterior cerebellum is to identify and encode temporal sequences of events, which might help to fine-tune and automatize social and emotional learning. I discuss research using neuroimaging and non-invasive stimulation that provides converging evidence for this hypothesized function of cerebellar sequencing, but also other potential functional accounts of the posterior cerebellum's role in these social and emotional processes.

Reward-driven cerebellar climbing fiber activity influences both neural and behavioral learning

The cerebellum plays a key role in motor coordination and learning. In contrast with classical supervised learning models, recent work has revealed that CFs can signal reward-predictive information in some behaviors. This raises the question of whether CFs may also operate according to principles similar to those described by reinforcement learning models. To test how CFs operate during reward-guided behavior, and evaluate the role of reward-related CF activity in learning, we have measured CF responses in Purkinje cells of the lateral cerebellum during a Pavlovian task using 2-photon calcium imaging. Specifically, we have performed multi-stimulus experiments to determine whether CF activity meets the requirements of a reward prediction error (rPE) signal for transfer from an unexpected reward to a reward-predictive cue. We find that once CF activity is transferred to a conditioned stimulus, and there is no longer a response to reward, CFs cannot generate learned responses to a second conditioned stimulus that carries the same reward prediction. In addition, by expressing the inhibitory opsin GtACR2 in neurons of the inferior olive, and optically inhibiting these neurons across behavioral training at the time of unexpected reward, we find that the transfer of CF signals to the conditioned stimulus is impaired. Moreover, this optogenetic inhibition also impairs learning, resulting in a deficit in anticipatory lick timing. Together, these results indicate that CF signals can exhibit several characteristics in common with rPEs during reinforcement learning, and that the cerebellum can harness these learning signals to generate accurately timed motor behavior.

Cerebellar climbing fibers signal flexible, rapidly adapting reward predictions

Classical models of cerebellar computation posit that climbing fibers (CFs) operate according to supervised learning rules, correcting movements by signaling the occurrence of motor errors. However, recent findings suggest that in some behaviors, CF activity can exhibit features that resemble the instructional signals necessary for reinforcement learning, namely reward prediction errors (rPEs). Despite these initial observations, many key properties of reward-related CF responses remain unclear, thus limiting our understanding of how they operate to guide cerebellar learning. Here, we have measured the postsynaptic responses of CFs onto cerebellar Purkinje cells using two-photon calcium imaging to test how they respond to learned stimuli that either do or do not predict reward. We find that CFs can develop generalized responses to similar cues of the same modality, regardless of whether they are reward predictive. However, this generalization depends on temporal context, and does not extend across sensory modalities. Further, learned CF responses are flexible, and can be rapidly updated according to new reward contingencies. Together these results suggest that CFs can generate learned, reward-predictive responses that flexibly adapt to the current environment in a context-sensitive manner.

Converging and Diverging Cerebellar Pathways for Motor and Social Behaviors in Mice

Evidence from clinical and preclinical studies has shown that the cerebellum contributes to cognitive functions, including social behaviors. Now that the cerebellum's role in a wider range of behaviors has been confirmed, the question arises whether the cerebellum contributes to social behaviors via the same mechanisms with which it modulates movements. This review seeks to answer whether the cerebellum guides motor and social behaviors through identical pathways. It focuses on studies in which cerebellar cells, synapses, or genes are manipulated in a cell-type specific manner followed by testing of the effects on social and motor behaviors. These studies show that both anatomically restricted and cerebellar cortex-wide manipulations can lead to social impairments without abnormal motor control, and vice versa. These studies suggest that the cerebellum employs different cellular, synaptic, and molecular pathways for social and motor behaviors. Future studies warrant a focus on the diverging mechanisms by which the cerebellum contributes to a wide range of neural functions.

Consensus Paper: Cerebellum and Reward

Cerebellum is a key-structure for the modulation of motor, cognitive, social and affective functions, contributing to automatic behaviours through interactions with the cerebral cortex, basal ganglia and spinal cord. The predictive mechanisms used by the cerebellum cover not only sensorimotor functions but also reward-related tasks. Cerebellar circuits appear to encode temporal difference error and reward prediction error. From a chemical standpoint, cerebellar catecholamines modulate the rate of cerebellar-based cognitive learning, and mediate cerebellar contributions during complex behaviours. Reward processing and its associated emotions are tuned by the cerebellum which operates as a controller of adaptive homeostatic processes based on interoceptive and exteroceptive inputs. Lobules VI-VII/areas of the vermis are candidate regions for the cortico-subcortical signaling pathways associated with loss aversion and reward sensitivity, together with other nodes of the limbic circuitry. There is growing evidence that the cerebellum works as a hub of regional dysconnectivity across all mood states and that mental disorders involve the cerebellar circuitry, including mood and addiction disorders, and impaired eating behaviors where the cerebellum might be involved in longer time scales of prediction as compared to motor operations. Cerebellar patients exhibit aberrant social behaviour, showing aberrant impulsivity/compulsivity. The cerebellum is a master-piece of reward mechanisms, together with the striatum, ventral tegmental area (VTA) and prefrontal cortex (PFC). Critically, studies on reward processing reinforce our view that a fundamental role of the cerebellum is to construct internal models, perform predictions on the impact of future behaviour and compare what is predicted and what actually occurs.

High-dimensional encoding of movement by single neurons in basal ganglia output

The substantia nigra pars reticulata (SNpr), an output structure of the basal ganglia, is hypothesized to gate movement execution. Previous studies in the eye movement system focusing mostly on saccades have reported that SNpr neurons are tonically active and either pause or increase their firing during movements, consistent with the gating role. We recorded activity in the SNpr of two monkeys during smooth pursuit and saccadic eye movements. SNpr neurons exhibited highly diverse reaction patterns during pursuit, including frequent increases and decreases in firing rate, uncorrelated responses in different movement directions and in reward conditions that resulted in the high dimensional activity of single neurons. These diverse temporal patterns surpassed those in other oculomotor areas in the medial-temporal cortex, frontal cortex, basal ganglia, and cerebellum. These findings suggest that temporal properties of the responses enrich the coding capacity of the basal ganglia output beyond gating or permitting movement.

A cerebellar granule cell-climbing fiber computation to learn to track long time intervals

In classical cerebellar learning, Purkinje cells (PkCs) associate climbing fiber (CF) error signals with predictive granule cells (GrCs) that were active just prior (∼150 ms). The cerebellum also contributes to behaviors characterized by longer timescales. To investigate how GrC-CF-PkC circuits might learn seconds-long predictions, we imaged simultaneous GrC-CF activity over days of forelimb operant conditioning for delayed water reward. As mice learned reward timing, numerous GrCs developed anticipatory activity ramping at different rates until reward delivery, followed by widespread time-locked CF spiking. Relearning longer delays further lengthened GrC activations. We computed CF-dependent GrC→PkC plasticity rules, demonstrating that reward-evoked CF spikes sufficed to grade many GrC synapses by anticipatory timing. We predicted and confirmed that PkCs could thereby continuously ramp across seconds-long intervals from movement to reward. Learning thus leads to new GrC temporal bases linking predictors to remote CF reward signals-a strategy well suited for learning to track the long intervals common in cognitive domains.

The Role of the Cerebellum in Learning to Predict Reward: Evidence from Cerebellar Ataxia

Recent findings in animals have challenged the traditional view of the cerebellum solely as the site of motor control, suggesting that the cerebellum may also be important for learning to predict reward from trial-and-error feedback. Yet, evidence for the role of the cerebellum in reward learning in humans is lacking. Moreover, open questions remain about which specific aspects of reward learning the cerebellum may contribute to. Here we address this gap through an investigation of multiple forms of reward learning in individuals with cerebellum dysfunction, represented by cerebellar ataxia cases. Nineteen participants with cerebellar ataxia and 57 age- and sex-matched healthy controls completed two separate tasks that required learning about reward contingencies from trial-and-error. To probe the selectivity of reward learning processes, the tasks differed in their underlying structure: while one task measured incremental reward learning ability alone, the other allowed participants to use an alternative learning strategy based on episodic memory alongside incremental reward learning. We found that individuals with cerebellar ataxia were profoundly impaired at reward learning from trial-and-error feedback on both tasks, but retained the ability to learn to predict reward based on episodic memory. These findings provide evidence from humans for a specific and necessary role for the cerebellum in incremental learning of reward associations based on reinforcement. More broadly, the findings suggest that alongside its role in motor learning, the cerebellum likely operates in concert with the basal ganglia to support reinforcement learning from reward.

Reinforcement Motor Learning After Cerebellar Damage Is Related to State Estimation

Recent work showed that individuals with cerebellar degeneration could leverage intact reinforcement learning (RL) to alter their movement. However, there was marked inter-individual variability in learning, and the factors underlying it were unclear. Cerebellum-dependent sensory prediction may contribute to RL in motor contexts by enhancing body state estimates, which are necessary to solve the credit-assignment problem. The objective of this study was to test the relationship between the predictive component of state estimation and RL in individuals with cerebellar degeneration. Individuals with cerebellar degeneration and neurotypical control participants completed two tasks: an RL task that required them to alter the angle of reaching movements and a state estimation task that tested the somatosensory perception of active and passive movement. The state estimation task permitted the calculation of the active benefit shown by each participant, which is thought to reflect the cerebellum-dependent predictive component of state estimation. We found that the cerebellar and control groups showed similar magnitudes of learning with reinforcement and active benefit on average, but there was substantial variability across individuals. Using multiple regression, we assessed potential predictors of RL. Our analysis included active benefit, somatosensory acuity, clinical ataxia severity, movement variability, movement speed, and age. We found a significant relationship in which greater active benefit predicted better learning with reinforcement in the cerebellar, but not the control group. No other variables showed significant relationships with learning. Overall, our results support the hypothesis that the integrity of sensory prediction is a strong predictor of RL after cerebellar damage.

Purkinje cell dysfunction causes disrupted sleep in ataxic mice

Purkinje cell dysfunction disrupts movement and causes disorders such as ataxia. Recent evidence suggests that Purkinje cell dysfunction may also alter sleep regulation. Here, we used an ataxic mouse model generated by silencing Purkinje cell neurotransmission (L7Cre;Vgatfx/fx) to better understand how cerebellar dysfunction impacts sleep physiology. We focused our analysis on sleep architecture and electrocorticography (ECoG) patterns based on their relevance to extracting physiological measurements during sleep. We found that circadian activity was unaltered in the mutant mice, although their sleep parameters and ECoG patterns were modified. The L7Cre;Vgatfx/fx mutant mice had decreased wakefulness and rapid eye movement (REM) sleep, whereas non-REM sleep was increased. The mutants had an extended latency to REM sleep, which is also observed in human patients with ataxia. Spectral analysis of ECoG signals revealed alterations in the power distribution across different frequency bands defining sleep. Therefore, Purkinje cell dysfunction may influence wakefulness and equilibrium of distinct sleep stages in ataxia. Our findings posit a connection between cerebellar dysfunction and disrupted sleep and underscore the importance of examining cerebellar circuit function in sleep disorders.

The cerebellum and its connections to other brain structures involved in motor and non-motor functions: A comprehensive review

The cerebellum has a large network of neurons that communicate with several brain structures and participate in different functions. Recent studies have demonstrated that the cerebellum is not only associated with motor functions but also participates in several non-motor functions. It is suggested that the cerebellum can modulate behavior through many connections with different nervous system structures in motor, sensory, cognitive, autonomic, and emotional processes. Recently, a growing number of clinical and experimental studies support this theory and provide further evidence. In light of recent findings, a comprehensive review is needed to summarize the knowledge on the influence of the cerebellum on the processing of different functions. Therefore, the aim of this review was to describe the neuroanatomical aspects of the activation of the cerebellum and its connections with other structures of the central nervous system in different behaviors.

Inhibiting cholinergic signalling in the cerebellar interpositus nucleus impairs motor behaviour

The role of neuromodulators in the cerebellum is not well understood. In particular, the behavioural significance of the cholinergic system in the cerebellum is unknown. To investigate the importance of cerebellar cholinergic signalling in behaviour, we infused acetylcholine receptor antagonists, scopolamine and mecamylamine, bilaterally into the rat cerebellum (centred on interpositus nucleus) and observed the motor effects through a battery of behavioural tests. These tests included unrewarded behaviour during open field exploration and a horizontal ladder walking task and reward-based beam walking and pellet reaching tasks. Infusion of a mix of the antagonists did not impair motor learning in the horizontal ladder walking or the reaching task but reduced spontaneous movement during open field exploration, impaired coordination during beam walking and ladder walking, led to fewer reaches in the pellet reaching task, slowed goal-directed reaching behaviour and reduced reward pellet consumption in a free access to food task. Infusion of the muscarinic antagonist scopolamine on its own resulted in deficits in motor performance and a reduction in the number of reward pellets consumed in the free access to food task. By contrast, infusion of the nicotinic antagonist mecamylamine on its own had no significant effect on any task, except beam walking traversal time, which was reduced. Together, these data suggest that acetylcholine in the cerebellar interpositus nucleus is important for the execution and coordination of voluntary movements mainly via muscarinic receptor signalling, especially in relation to reward-related behaviour.

Re-examining the Mysterious Role of the Cerebellum in Pain

Pain is considered a multidimensional experience that embodies not merely sensation, but also emotion and perception. As is appropriate for this complexity, pain is represented and processed by an extensive matrix of cortical and subcortical structures. Of these structures, the cerebellum is gaining increasing attention. Although association between the cerebellum and both acute and chronic pain have been extensively detailed in electrophysiological and neuroimaging studies, a deep understanding of what functions are mediated by these associations is lacking. Nevertheless, the available evidence implies that lobules IV-VI and Crus I are especially pertinent to pain processing, and anatomical studies reveal that these regions connect with higher-order structures of sensorimotor, emotional, and cognitive function. Therefore, we speculate that the cerebellum exerts a modulatory role in pain via its communication with sites of sensorimotor, executive, reward, and limbic function. On this basis, in this review, we propose numerous ways in which the cerebellum might contribute to both acute and chronic pain, drawing particular attention to emotional and cognitive elements of pain. In addition, we emphasise the importance of advancing our knowledge about the relationship between the cerebellum and pain by discussing novel therapeutic opportunities that capitalize on this association.

The olivary input to the cerebellum dissociates sensory events from movement plans

Neurons in the inferior olive are thought to anatomically organize the Purkinje cells (P-cells) of the cerebellum into computational modules, but what is computed by each module? Here, we designed a saccade task in marmosets that dissociated sensory events from motor events and then recorded the complex and simple spikes of hundreds of P-cells. We found that when a visual target was presented at a random location, the olive reported the direction of that sensory event to one group of P-cells, but not to a second group. However, just before movement onset, it reported the direction of the planned movement to both groups, even if that movement was not toward the target. At the end of the movement if the subject experienced an error but chose to withhold the corrective movement, only the first group received information about the sensory prediction error. We organized the P-cells based on the information content of their olivary input and found that in the group that received sensory information, the simple spikes were suppressed during fixation, then produced a burst before saccade onset in a direction consistent with assisting the movement. In the second group, the simple spikes were not suppressed during fixation but burst near saccade deceleration in a direction consistent with stopping the movement. Thus, the olive differentiated the P-cells based on whether they would receive sensory or motor information, and this defined their contributions to control of movements as well as holding still.

A cerebro-cerebellar network for learning visuomotor associations

Consensus is rapidly building to support a role for the cerebellum beyond motor function, but its contributions to non-motor learning remain poorly understood. Here, we provide behavioral, anatomical and computational evidence to demonstrate a causal role for the primate posterior lateral cerebellum in learning new visuomotor associations. Reversible inactivation of the posterior lateral cerebellum of male monkeys impeded the learning of new visuomotor associations, but had no effect on movement parameters, or on well-practiced performance of the same task. Using retrograde transneuronal transport of rabies virus, we identified a distinct cerebro-cerebellar network linking Purkinje cells in the posterior lateral cerebellum with a region of the prefrontal cortex that is critical in learning visuomotor associations. Together, these results demonstrate a causal role for the primate posterior lateral cerebellum in non-motor, reinforcement learning.

The effect of reward on motor learning: different stage, different effect

Motor learning is a prominent and extensively studied subject in rehabilitation following various types of neurological disorders. Motor repair and rehabilitation often extend over months and years post-injury with a slow pace of recovery, particularly affecting the fine movements of the distal extremities. This extended period can diminish the motivation and persistence of patients, a facet that has historically been overlooked in motor learning until recent years. Reward, including monetary compensation, social praise, video gaming, music, and virtual reality, is currently garnering heightened attention for its potential to enhance motor motivation and improve function. Numerous studies have examined the effects and attempted to explore potential mechanisms in various motor paradigms, yet they have yielded inconsistent or even contradictory results and conclusions. A comprehensive review is necessary to summarize studies on the effects of rewards on motor learning and to deduce a central pattern from these existing studies. Therefore, in this review, we initially outline a framework of motor learning considering two major types, two major components, and three stages. Subsequently, we summarize the effects of rewards on different stages of motor learning within the mentioned framework and analyze the underlying mechanisms at the level of behavior or neural circuit. Reward accelerates learning speed and enhances the extent of learning during the acquisition and consolidation stages, possibly by regulating the balance between the direct and indirect pathways (activating more D1-MSN than D2-MSN) of the ventral striatum and by increasing motor dynamics and kinematics. However, the effect varies depending on several experimental conditions. During the retention stage, there is a consensus that reward enhances both short-term and long-term memory retention in both types of motor learning, attributed to the LTP learning mechanism mediated by the VTA-M1 dopaminergic projection. Reward is a promising enhancer to bolster waning confidence and motivation, thereby increasing the efficiency of motor learning and rehabilitation. Further exploration of the circuit and functional connections between reward and the motor loop may provide a novel target for neural modulation to promote motor behavior.

Organization of reward and movement signals in the basal ganglia and cerebellum

The basal ganglia and the cerebellum are major subcortical structures in the motor system. The basal ganglia have been cast as the reward center of the motor system, whereas the cerebellum is thought to be involved in adjusting sensorimotor parameters. Recent findings of reward signals in the cerebellum have challenged this dichotomous view. To compare the basal ganglia and the cerebellum directly, we recorded from oculomotor regions in both structures from the same monkeys. We partitioned the trial-by-trial variability of the neurons into reward and eye-movement signals to compare the coding across structures. Reward expectation and movement signals were the most pronounced in the output structure of the basal ganglia, intermediate in the cerebellum, and the smallest in the input structure of the basal ganglia. These findings suggest that reward and movement information is sharpened through the basal ganglia, resulting in a higher signal-to-noise ratio than in the cerebellum.

Cognitive, Emotional, and Other Non-motor Symptoms of Spinocerebellar Ataxias

PURPOSE OF REVIEW

Spinocerebellar ataxias (SCAs) are autosomal dominant degenerative syndromes that present with ataxia and brain stem abnormalities. This review describes the cognitive and behavioral symptoms of SCAs in the context of recent knowledge of the role of the cerebellum in higher intellectual function.

RECENT FINDINGS

Recent studies suggest that patients with spinocerebellar ataxia can display cognitive deficits even early in the disease. These have been given the term cerebellar cognitive affective syndrome (CCAS). CCAS can be tracked using newly developed rating scales. In addition, patients with spinocerebellar ataxia also display impulsive and compulsive behavior, depression, anxiety, fatigue, and sleep disturbances. This review stresses the importance of recognizing non-motor symptoms in SCAs. There is a pressing need for novel therapeutic interventions to address these symptoms given their deleterious impact on patients' quality of life.

The cerebellum directly modulates the substantia nigra dopaminergic activity

Evidence of direct reciprocal connections between the cerebellum and basal ganglia has challenged the long-held notion that these structures function independently. While anatomical studies have suggested the presence of cerebellar projections to the substantia nigra pars compacta (SNc), the nature and function of these connections (Cb-SNc) is unknown. Here we show, in mice, that Cb-SNc projections form monosynaptic glutamatergic synapses with dopaminergic and non-dopaminergic neurons in the SNc. Optogenetic activation of Cb-SNc axons in the SNc is associated with increased SNc activity, elevated striatal dopamine levels and increased locomotion. During behavior, Cb-SNc projections are bilaterally activated before ambulation and unilateral lever manipulation. Cb-SNc projections show prominent activation for water reward and higher activation for sweet water, suggesting that the pathway also encodes reward value. Thus, the cerebellum directly, rapidly and effectively modulates basal ganglia dopamine levels and conveys information related to movement initiation, vigor and reward processing.

Cognitive Decline and Mood Alterations in the Mouse Model of Spinocerebellar Ataxia Type 2

Spinocerebellar ataxia type 2 (SCA2) is a hereditary disorder, caused by an expansion of polyglutamine in the ataxin-2 protein. Although the mutant protein is expressed throughout all the cell and organ types, the cerebellum is primarily affected. The disease progression is mainly accompanied by a decline in motor functions. However, the disturbances in cognitive abilities and low mental state have also been reported in patients. Recent evidence suggests that the cerebellar functionality expands beyond the motor control. Thus, the cerebellum turned out to be involved into the language, verbal working, and spatial memory; executive functions such as working memory, planning, organizing, and strategy formation; and emotional processing. Here, we used the transgenic SCA2-58Q mice to evaluate their anxiety, cognitive functions, and mood alterations. The expression of the mutant ataxin-2 specifically in the cerebellar Purkinje cells (PCs) in SCA2-58Q mice allowed us to study the direct involvement of the cerebellum into the cognitive and affective control. We determined that SCA2-58Q mice exhibit anxiolytic behavior, decline in spatial memory, and a depressive-like state. Our results support the idea of cerebellar involvement in cognitive control and the handling of emotions.

Sensorimotor-linked reward modulates smooth pursuit eye movements in monkeys

Reward is essential for shaping behavior. Using sensory cues to imply forthcoming rewards, previous studies have demonstrated powerful effects of rewards on behavior. Nevertheless, the impact of reward on the sensorimotor transformation, particularly when reward is linked to behavior remains uncertain. In this study, we investigated how reward modulates smooth pursuit eye movements in monkeys. Three distinct associations between reward and eye movements were conducted in independent blocks. Results indicated that reward increased eye velocity during the steady-state pursuit, rather than during the initiation. The influence depended on the particular association between behavior and reward: a faster eye velocity was linked with reward. Neither rewarding slower eye movements nor randomizing rewards had a significant effect on behavior. The findings support the existence of distinct mechanisms involved in the initiation and steady-state phases of pursuit, and contribute to a deeper understanding of how reward interacts with these two periods of pursuit.

Cognitive-Affective Functions of the Cerebellum

The cerebellum, traditionally associated with motor coordination and balance, also plays a crucial role in various aspects of higher-order function and dysfunction. Emerging research has shed light on the cerebellum's broader contributions to cognitive, emotional, and reward processes. The cerebellum's influence on autonomic function further highlights its significance in regulating motivational and emotional states. Perturbations in cerebellar development and function have been implicated in various neurodevelopmental disorders, including autism spectrum disorder and attention deficit hyperactivity disorder. An increasing appreciation for neuropsychiatric symptoms that arise from cerebellar dysfunction underscores the importance of elucidating the circuit mechanisms that underlie complex interactions between the cerebellum and other brain regions for a comprehensive understanding of complex behavior. By briefly discussing new advances in mapping cerebellar function in affective, cognitive, autonomic, and social processing and reviewing the role of the cerebellum in neuropathology beyond the motor domain, this Mini-Symposium review aims to provide a broad perspective of cerebellar intersections with the limbic brain in health and disease.

Interaction between decision-making and motor learning when selecting reach targets in the presence of bias and noise

Motor errors can have both bias and noise components. Bias can be compensated for by adaptation and, in tasks in which the magnitude of noise varies across the environment, noise can be reduced by identifying and then acting in less noisy regions of the environment. Here we examine how these two processes interact when participants reach under a combination of an externally imposed visuomotor bias and noise. In a center-out reaching task, participants experienced noise (zero-mean random visuomotor rotations) that was target-direction dependent with a standard deviation that increased linearly from a least-noisy direction. They also experienced a constant bias, a visuomotor rotation that varied (across groups) from 0 to 40 degrees. Critically, on each trial, participants could select one of three targets to reach to, thereby allowing them to potentially select targets close to the least-noisy direction. The group who experienced no bias (0 degrees) quickly learned to select targets close to the least-noisy direction. However, groups who experienced a bias often failed to identify the least-noisy direction, even though they did partially adapt to the bias. When noise was introduced after participants experienced and adapted to a 40 degrees bias (without noise) in all directions, they exhibited an improved ability to find the least-noisy direction. We developed two models-one for reach adaptation and one for target selection-that could explain participants' adaptation and target-selection behavior. Our data and simulations indicate that there is a trade-off between adaptation and selection. Specifically, because bias learning is local, participants can improve performance, through adaptation, by always selecting targets that are closest to a chosen direction. However, this comes at the expense of improving performance, through selection, by reaching toward targets in different directions to find the least-noisy direction.

Internal models of self-motion: neural computations by the vestibular cerebellum

The vestibular cerebellum plays an essential role in maintaining our balance and ensuring perceptual stability during activities of daily living. Here I examine three key regions of the vestibular cerebellum: the floccular lobe, anterior vermis (lobules I-V), and nodulus and ventral uvula (lobules X-IX of the posterior vermis). These cerebellar regions encode vestibular information and combine it with extravestibular signals to create internal models of eye, head, and body movements, as well as their spatial orientation with respect to gravity. To account for changes in the external environment and/or biomechanics during self-motion, the neural mechanisms underlying these computations are continually updated to ensure accurate motor behavior. To date, studies on the vestibular cerebellum have predominately focused on passive vestibular stimulation, whereas in actuality most stimulation is the result of voluntary movement. Accordingly, I also consider recent research exploring these computations during active self-motion and emerging evidence establishing the cerebellum's role in building predictive models of self-generated movement.

Cerebellar Prediction and Feeding Behaviour

Given the importance of the cerebellum in controlling movements, it might be expected that its main role in eating would be the control of motor elements such as chewing and swallowing. Whilst such functions are clearly important, there is more to eating than these actions, and more to the cerebellum than motor control. This review will present evidence that the cerebellum contributes to homeostatic, motor, rewarding and affective aspects of food consumption.Prediction and feedback underlie many elements of eating, as food consumption is influenced by expectation. For example, circadian clocks cause hunger in anticipation of a meal, and food consumption causes feedback signals which induce satiety. Similarly, the sight and smell of food generate an expectation of what that food will taste like, and its actual taste will generate an internal reward value which will be compared to that expectation. Cerebellar learning is widely thought to involve feed-forward predictions to compare expected outcomes to sensory feedback. We therefore propose that the overarching role of the cerebellum in eating is to respond to prediction errors arising across the homeostatic, motor, cognitive, and affective domains.

Recent data on the cerebellum require new models and theories

The cerebellum has been a popular topic for theoretical studies because its structure was thought to be simple. Since David Marr and James Albus related its function to motor skill learning and proposed the Marr-Albus cerebellar learning model, this theory has guided and inspired cerebellar research. In this review, we summarize the theoretical progress that has been made within this framework of error-based supervised learning. We discuss the experimental progress that demonstrates more complicated molecular and cellular mechanisms in the cerebellum as well as new cell types and recurrent connections. We also cover its involvement in diverse non-motor functions and evidence of other forms of learning. Finally, we highlight the need to explain these new experimental findings into an integrated cerebellar model that can unify its diverse computational functions.

Cerebellar climbing fibers multiplex movement and reward signals during a voluntary movement task in mice

Cerebellar climbing fibers convey sensorimotor information and their errors, which are used for motor control and learning. Furthermore, they represent reward-related information. Despite such functional diversity of climbing fiber signals, it is still unclear whether each climbing fiber conveys the information of single or multiple modalities and how the climbing fibers conveying different information are distributed over the cerebellar cortex. Here we perform two-photon calcium imaging from cerebellar Purkinje cells in mice engaged in a voluntary forelimb lever-pull task and demonstrate that climbing fiber responses in 68% of Purkinje cells can be explained by the combination of multiple behavioral variables such as lever movement, licking, and reward delivery. Neighboring Purkinje cells exhibit similar climbing fiber response properties, form functional clusters, and share noise fluctuations of responses. Taken together, individual climbing fibers convey behavioral information on multiplex variables and are spatially organized into the functional modules of the cerebellar cortex.

Purkinje cell dysfunction causes disrupted sleep in ataxic mice

Purkinje cell dysfunction causes movement disorders such as ataxia, however, recent evidence suggests that Purkinje cell dysfunction may also alter sleep regulation. Here, we used an ataxia mouse model generated by silencing Purkinje cell neurotransmission ( L7 Cre ;Vgat fx/fx ) to better understand how cerebellar dysfunction impacts sleep physiology. We focused our analysis on sleep architecture and electrocorticography (ECoG) patterns based on their relevance to extracting physiological measurements during sleep. We found that circadian activity is unaltered in the mutant mice, although their sleep parameters and ECoG patterns are modified. The L7 Cre ;Vgat fx/fx mutant mice have decreased wakefulness and rapid eye movement (REM) sleep, while non-rapid eye movement (NREM) sleep is increased. The mutant mice have an extended latency to REM sleep, which is also observed in human ataxia patients. Spectral analysis of ECoG signals revealed alterations in the power distribution across different frequency bands defining sleep. Therefore, Purkinje cell dysfunction may influence wakefulness and equilibrium of distinct sleep stages in ataxia. Our findings posit a connection between cerebellar dysfunction and disrupted sleep and underscore the importance of examining cerebellar circuit function in sleep disorders.

Summary Statement

Utilizing a precise genetic mouse model of ataxia, we provide insights into the cerebellum's role in sleep regulation, highlighting its potential as a therapeutic target for motor disorders-related sleep disruptions.

Exploring the role of task success in implicit motor adaptation

We learn to improve our motor skills using different forms of feedback: sensory-prediction error, task success, and reward/punishment. While implicit motor adaptation is driven by sensory-prediction errors, recent work has shown that task success modulates this process. Task success is often confounded with reward, so we sought to determine if the effects of these two signals on adaptation can be dissociated. To address this question, we conducted five experiments that isolated implicit learning using error-clamp visuomotor reach adaptation paradigms. Task success was manipulated by changing the size and position of the target relative to the cursor providing visual feedback, and reward expectation was established using monetary cues and auditory feedback. We found that neither monetary cues nor auditory feedback affected implicit adaptation, suggesting that task success influences implicit adaptation via mechanisms distinct from conventional reward-related processes. Additionally, we found that changes in target size, which caused the target to either exclude or fully envelop the cursor, only affected implicit adaptation for a narrow range of error sizes, while jumping the target to overlap with the cursor more reliably and robustly affected implicit adaptation. Taken together, our data indicate that, while task success exerts a small effect on implicit adaptation, these effects are susceptible to methodological variations and unlikely to be mediated by reward.

The human cerebellum in reward anticipation and reward outcome processing: An activation likelihood estimation meta-analysis

The cerebellum generates internal prediction models and actively compares anticipated and actual outcomes in order to reach a desired end state. In this process, reward can serve as a reinforcer that shapes internal prediction models, enabling context-appropriate behavior. While the involvement of the cerebellum in reward processing has been established in animals, there is no detailed account of which cerebellar regions are involved in reward anticipation and reward outcome processing in humans. To this end, an activation likelihood estimation meta-analysis of functional neuroimaging studies was performed to investigate cerebellar functional activity patterns associated with reward anticipation and reward outcome processing in healthy adults. Results showed that reward anticipation (k=31) was associated with regional activity in the bilateral anterior lobe, bilateral lobule VI, left Crus I and the posterior vermis, while reward outcome (k=16) was associated with regional activity in the declive and left lobule VI. The findings of this meta-analysis show distinct involvement of the cerebellum in reward anticipation and reward outcome processing as part of a predictive coding routine.

Cerebellar contribution to the regulation of defensive states

Despite fine tuning voluntary movement as the most prominently studied function of the cerebellum, early human studies suggested cerebellar involvement emotion regulation. Since, the cerebellum has been associated with various mood and anxiety-related conditions. Research in animals provided evidence for cerebellar contributions to fear memory formation and extinction. Fear and anxiety can broadly be referred to as defensive states triggered by threat and characterized by multimodal adaptations such as behavioral and cardiac responses integrated into an intricately orchestrated defense reaction. This is mediated by an evolutionary conserved, highly interconnected network of defense-related structures with functional connections to the cerebellum. Projections from the deep cerebellar nucleus interpositus to the central amygdala interfere with retention of fear memory. Several studies uncovered tight functional connections between cerebellar deep nuclei and pyramis and the midbrain periaqueductal grey. Specifically, the fastigial nucleus sends direct projections to the ventrolateral PAG to mediate fear-evoked innate and learned freezing behavior. The cerebellum also regulates cardiovascular responses such as blood pressure and heart rate-effects dependent on connections with medullary cardiac regulatory structures. Because of the integrated, multimodal nature of defensive states, their adaptive regulation has to be highly dynamic to enable responding to a moving threatening stimulus. In this, predicting threat occurrence are crucial functions of calculating adequate responses. Based on its role in prediction error generation, its connectivity to limbic regions, and previous results on a role in fear learning, this review presents the cerebellum as a regulator of integrated cardio-behavioral defensive states.

Disrupted sleep in dystonia depends on cerebellar function but not motor symptoms in mice

Although dystonia is the third most common movement disorder, patients often also experience debilitating nonmotor defects including impaired sleep. The cerebellum is a central component of a "dystonia network" that plays various roles in sleep regulation. Importantly, the primary driver of sleep impairments in dystonia remains poorly understood. The cerebellum, along with other nodes in the motor circuit, could disrupt sleep. However, it is unclear how the cerebellum might alter sleep and mobility. To disentangle the impact of cerebellar dysfunction on motion and sleep, we generated two mouse genetic models of dystonia that have overlapping cerebellar circuit miswiring but show differing motor phenotype severity: Ptf1a ^Cre ;Vglut2 ^fx/fx and Pdx1 ^Cre ;Vglut2 ^fx/fx mice. In both models, excitatory climbing fiber to Purkinje cell neurotransmission is blocked, but only the Ptf1a ^Cre ;Vglut2 ^fx/fx mice have severe twisting. Using in vivo ECoG and EMG recordings we found that both mutants spend greater time awake and in NREM sleep at the expense of REM sleep. The increase in awake time is driven by longer awake bouts rather than an increase in bout number. We also found a longer latency to reach REM in both mutants, which is similar to what is reported in human dystonia. We uncovered independent but parallel roles for cerebellar circuit dysfunction and motor defects in promoting sleep quality versus posture impairments in dystonia.

Neuroanatomical predictors of real‐time fMRI ‐based anterior insula regulation. A supervised machine learning study

Increasing evidence showed that learned control of metabolic activity in selected brain regions can support emotion regulation. Notably, a number of studies demonstrated that neurofeedback-based regulation of fMRI activity in several emotion-related areas leads to modifications of emotional behavior along with changes of neural activity in local and distributed networks, in both healthy individuals and individuals with emotional disorders. However, the current understanding of the neural mechanisms underlying self-regulation of the emotional brain, as well as their relationship with other emotion regulation strategies, is still limited. In this study, we attempted to delineate neuroanatomical regions mediating real-time fMRI-based emotion regulation by exploring whole brain GM and WM features predictive of self-regulation of anterior insula (AI) activity, a neuromodulation procedure that can successfully support emotional brain regulation in healthy individuals and patients. To this aim, we employed a multivariate kernel ridge regression model to assess brain volumetric features, at regional and network level, predictive of real-time fMRI-based AI regulation. Our results showed that several GM regions including fronto-occipital and medial temporal areas and the basal ganglia as well as WM regions including the fronto-occipital fasciculus, tapetum and fornix significantly predicted learned AI regulation. Remarkably, we observed a substantial contribution of the cerebellum in relation to both the most effective regulation run and average neurofeedback performance. Overall, our findings highlighted specific neurostructural features contributing to individual differences of AI-guided emotion regulation. Notably, such neuroanatomical topography partially overlaps with the neurofunctional network associated with cognitive emotion regulation strategies, suggesting common neural mechanisms.

Cerebellar Contributions to the Basal Ganglia Influence Motor Coordination, Reward Processing, and Movement Vigor

Both the cerebellum and the basal ganglia are known for their roles in motor control and motivated behavior. These two systems have been classically considered as independent structures that coordinate their contributions to behavior via separate cortico-thalamic loops. However, recent evidence demonstrates the presence of a rich set of direct connections between these two regions. Although there is strong evidence for connections in both directions, for brevity we limit our discussion to the better-characterized connections from the cerebellum to the basal ganglia. We review two sets of such connections: disynaptic projections through the thalamus and direct monosynaptic projections to the midbrain dopaminergic nuclei, the VTA and the SNc. In each case, we review the evidence for these pathways from anatomic tracing and physiological recordings, and discuss their potential functional roles. We present evidence that the disynaptic pathway through the thalamus is involved in motor coordination, and that its dysfunction contributes to motor deficits, such as dystonia. We then discuss how cerebellar projections to the VTA and SNc influence dopamine release in the respective targets of these nuclei: the NAc and the dorsal striatum. We argue that the cerebellar projections to the VTA may play a role in reward-based learning and therefore contribute to addictive behavior, whereas the projection to the SNc may contribute to movement vigor. Finally, we speculate how these projections may explain many of the observations that indicate a role for the cerebellum in mental disorders, such as schizophrenia.

Human Variation in Error-Based and Reinforcement Motor Learning Is Associated With Entorhinal Volume

Error-based and reward-based processes are critical for motor learning and are thought to be mediated via distinct neural pathways. However, recent behavioral work in humans suggests that both learning processes can be bolstered by the use of cognitive strategies, which may mediate individual differences in motor learning ability. It has been speculated that medial temporal lobe regions, which have been shown to support motor sequence learning, also support the use of cognitive strategies in error-based and reinforcement motor learning. However, direct evidence in support of this idea remains sparse. Here we first show that better overall learning during error-based visuomotor adaptation is associated with better overall learning during the reward-based shaping of reaching movements. Given the cognitive contribution to learning in both of these tasks, these results support the notion that strategic processes, associated with better performance, drive intersubject variation in both error-based and reinforcement motor learning. Furthermore, we show that entorhinal cortex volume is larger in better learning individuals-characterized across both motor learning tasks-compared with their poorer learning counterparts. These results suggest that individual differences in learning performance during error and reinforcement learning are related to neuroanatomical differences in entorhinal cortex.

Cerebellar and cortico-striatal-midbrain contributions to reward-cognition processes and apathy within the psychosis continuum

Negative symptoms in the psychosis continuum are linked to impairments in reward processing and cognitive function. Processes at the interface of reward processing and cognition and their relation to negative symptoms remain little studied, despite evidence suggestive of integration in mechanisms and neural circuitry. Here, we investigated brain activation during reward-dependent modulation of working memory (WM) and their relationship to negative symptoms in subclinical and early stages of the psychosis continuum. We included 27 persons with high schizotypal personality traits and 23 patients with first episode psychosis as well as 27 healthy controls. Participants underwent functional magnetic resonance imaging while performing an established 2-back WM task with two reward levels (5 CHF vs. no reward), which allowed us to assess common reward-cognition regions through whole-brain conjunction analyses and to investigate relations with clinical scores of negative symptoms. As expected for behavior, reward facilitated performance while cognitive load diminished it. At the neural level, the conjunction of high reward and high cognitive load contrasts across the psychosis continuum showed increased hemodynamic activity in the thalamus and the cerebellar vermis. During high cognitive load, more severe apathy but not diminished expression in the psychosis continuum was associated with reduced activity in right lateral orbitofrontal cortex, midbrain, posterior vermal cerebellum, caudate and lateral parietal cortex. Our results suggest that hypoactivity in the cerebellar vermis and the cortical-striatal-midbrain-circuitry in the psychosis continuum relates to apathy possibly via impaired flexible cognitive resource allocation for effective goal pursuit.

Neural Processing Dysfunctions During Fear Learning but Not Reward-Related Processing Characterize Depressed Individuals With High Levels of Repetitive Negative Thinking

BACKGROUND

Repetitive negative thinking (RNT) is a symptom dimension of depression that is associated with a poorer prognosis in terms of higher recurrence, treatment resistance, residual symptoms, and disability. This investigation examined whether RNT is associated with aberrant reward processing and fear learning.

METHODS

Very high RNT (VH-RNT) (n = 60) and high RNT (H-RNT) (n = 60) propensity-matched individuals with depression (age, sex, race/ethnicity, income/employment, body mass index, depressive and anxiety symptom severity) participated in this study along with matched healthy comparison volunteers (n = 30). This propensity-matched sample was selected from the larger Tulsa 1000 study. Participants performed two functional magnetic resonance imaging tasks: the monetary incentive delay task probing reward processing and the fear conditioning task probing aversive learning and extinction.

RESULTS

Both VH-RNT and H-RNT groups showed lower neural activity than healthy comparison subjects in reward circuitry, including the inferior frontal gyrus (VH-RNT: β = -1.24, H-RNT: β = -1.28) and the cerebellum (VH-RNT: β = -0.93, H-RNT: β = -1.14). However, individuals with VH-RNT exhibited lower activation than those with H-RNT in central autonomic network components during fear conditioning (β = -0.84) and continued conditioned responses during early extinction in the postcentral cortex (β = 0.71).

CONCLUSIONS

VH-RNT showed aberrant processing in fear conditioning during both learning and extinction phases compared with H-RNT. These findings demonstrate that dysfunctions of negative valence associated with RNT may be domain specific, which should be taken into account for identifying potential specific targets of intervention.

Mixed Selectivity in the Cerebellar Purkinje-Cell Response during Visuomotor Association Learning

Although the cerebellum has been traditionally considered to be exclusively involved in motor control, recent anatomic and clinical studies show that it also has a role in reward-processing. However, the way in which the movement-related and the reward-related neural activity interact at the level of the cerebellar cortex and contribute toward learning is still unclear. Here, we studied the simple spike activity of Purkinje cells in the mid-lateral cerebellum when 2 male monkeys learned to associate a right or left-hand movement with one of two visual symbolic cues. These cells had distinctly different discharge patterns between an overtrained symbol-hand association and a novel symbol-hand association, responding in association with the movement of both hands, although the kinematics of the movement did not change between the two conditions. The activity change was not related to the pattern of the visual symbols, the movement kinematics, the monkeys' reaction times, or the novelty of the visual symbols. The simple spike activity changed throughout the learning process, but the concurrent complex spikes did not instruct that change. Although these neurons also have reward-related activity, the reward-related and movement-related signals were independent. We suggest that this mixed selectivity may facilitate the flexible learning of difficult reinforcement learning problems.SIGNIFICANCE STATEMENT The cerebellum receives both motor-related and reward-related information. However, it is unclear how these two signals interact at the level of cerebellar cortex and contribute to learning nonmotor skills. Here we show that in the mid-lateral cerebellum, the reward information is encoded independently from the motor information such that during reward-based learning, only the reward information carried by the Purkinje cells inform learning while the motor information remains unchanged with learning.

Reward signals in the cerebellum: origins, targets, and functional implications

The cerebellum has long been proposed to play a role in cognitive function, although this has remained controversial. This idea has received renewed support with the recent discovery that signals associated with reward can be observed in the cerebellar circuitry, particularly in goal-directed learning tasks involving an interplay between the cerebellar cortex, basal ganglia, and cerebral cortex. Remarkably, a wide range of reward contingencies-including reward expectation, delivery, size, and omission-can be encoded by specific circuit elements in a manner that reflects the microzonal organization of the cerebellar cortex. The facts that reward signals have been observed in both the mossy fiber and climbing fiber input pathways to the cerebellar cortex and that their convergence may trigger plasticity in Purkinje cells suggest that these interactions may be crucial for the role of the cerebellar cortex in learned behavior. These findings strengthen the emerging consensus that the cerebellum plays a pivotal role in shaping cognitive processing and suggest that the cerebellum may combine both supervised learning and reinforcement learning to optimize goal-directed action. We make specific predictions about how cerebellar circuits can work in concert with the basal ganglia to guide different stages of learning.

Purkinje cells translate subjective salience into readiness to act and choice performance

The brain selectively allocates attention from a continuous stream of sensory input. This process is typically attributed to computations in distinct regions of the forebrain and midbrain. Here, we explore whether cerebellar Purkinje cells encode information about the selection of sensory inputs and could thereby contribute to non-motor forms of learning. We show that complex spikes of individual Purkinje cells change the sensory modality they encode to reflect changes in the perceived salience of sensory input. Comparisons with mouse models deficient in cerebellar plasticity suggest that changes in complex spike activity instruct potentiation of Purkinje cells simple spike firing, which is required for efficient learning. Our findings suggest that during learning, climbing fibers do not directly guide motor output, but rather contribute to a general readiness to act via changes in simple spike activity, thereby bridging the sequence from non-motor to motor functions.

Mid-lateral cerebellar complex spikes encode multiple independent reward-related signals during reinforcement learning

Although the cerebellum has been implicated in simple reward-based learning recently, the role of complex spikes (CS) and simple spikes (SS), their interaction and their relationship to complex reinforcement learning and decision making is still unclear. Here we show that in a context where a non-human primate learned to make novel visuomotor associations, classifying CS responses based on their SS properties revealed distinct cell-type specific encoding of the probability of failure after the stimulus onset and the non-human primate's decision. In a different context, CS from the same cerebellar area also responded in a cell-type and learning independent manner to the stimulus that signaled the beginning of the trial. Both types of CS signals were independent of changes in any motor kinematics and were unlikely to instruct the concurrent SS activity through an error based mechanism, suggesting the presence of context dependent, flexible, multiple independent channels of neural encoding by CS and SS. This diversity in neural information encoding in the mid-lateral cerebellum, depending on the context and learning state, is well suited to promote exploration and acquisition of wide range of cognitive behaviors that entail flexible stimulus-action-reward relationships but not necessarily motor learning.

Cerebellar complex spikes multiplex complementary behavioral information

Purkinje cell (PC) discharge, the only output of cerebellar cortex, involves 2 types of action potentials, high-frequency simple spikes (SSs) and low-frequency complex spikes (CSs). While there is consensus that SSs convey information needed to optimize movement kinematics, the function of CSs, determined by the PC’s climbing fiber input, remains controversial. While initially thought to be specialized in reporting information on motor error for the subsequent amendment of behavior, CSs seem to contribute to other aspects of motor behavior as well. When faced with the bewildering diversity of findings and views unraveled by highly specific tasks, one may wonder if there is just one true function with all the other attributions wrong? Or is the diversity of findings a reflection of distinct pools of PCs, each processing specific streams of information conveyed by climbing fibers? With these questions in mind, we recorded CSs from the monkey oculomotor vermis deploying a repetitive saccade task that entailed sizable motor errors as well as small amplitude saccades, correcting them. We demonstrate that, in addition to carrying error-related information, CSs carry information on the metrics of both primary and small corrective saccades in a time-specific manner, with changes in CS firing probability coupled with changes in CS duration. Furthermore, we also found CS activity that seemed to predict the upcoming events. Hence PCs receive a multiplexed climbing fiber input that merges complementary streams of information on the behavior, separable by the recipient PC because they are staggered in time.

Purkinje cell (PC) discharge, the only output of cerebellar cortex, involves both high-frequency simple spikes and low-frequency complex spikes; the function of the latter, determined by a PC’s climbing fibre input, remains controversial. This study shows that PCs receive a multiplexed climbing fibre input that merges complementary streams of information relevant for behaviour.

Simple and complex spike responses of mouse cerebellar Purkinje neurons to regular trains and omissions of somatosensory stimuli

Cerebellar Purkinje neurons help compute absolute subsecond timing, but how their firing is affected during repetitive sensory stimulation with consistent subsecond intervals remains unaddressed. Here, we investigated how simple and complex spikes of Purkinje cells change during regular application of air puffs (3.3 Hz for ∼4 min) to the whisker pad of awake, head-fixed female mice. Complex spike responses fell into two categories: those in which firing rates increased (at ∼50 ms) and then fell [complex spike elevated (CxSE) cells] and those in which firing rates decreased (at ∼70 ms) and then rose [complex spike reduced (CxSR) cells]. Both groups had indistinguishable rates of basal complex (∼1.7 Hz) and simple (∼75 Hz) spikes and initially responded to puffs with a well-timed sensory response, consisting of a short-latency (∼15 ms), transient (4 ms) suppression of simple spikes. CxSE more than CxSR cells, however, also showed a longer-latency increase in simple spike rate, previously shown to reflect motor command signals. With repeated puffs, basal simple spike rates dropped greatly in CxSR but not CxSE cells; complex spike rates remained constant, but their temporal precision rose in CxSR cells and fell in CxSE cells. Also over time, transient simple spike suppression gradually disappeared in CxSE cells, suggesting habituation, but remained stable in CxSR cells, suggesting reliable transmission of sensory stimuli. During stimulus omissions, both categories of cells showed complex spike suppression with different latencies. The data indicate two modes by which Purkinje cells transmit regular repetitive stimuli, distinguishable by their climbing fiber signals.NEW & NOTEWORTHY Responses of cerebellar Purkinje cells in awake mice form two categories defined by complex spiking during regular trains of brief, somatosensory stimuli. Cells in which complex spike probability first increases or decreases show simple spike suppressions that habituate or persist, respectively. Stimulus omissions alter complex spiking. The results provide evidence for differential suppression of olivary cells during sensory stimulation and omissions and illustrate that climbing fiber innervation defines Purkinje cell responses to repetitive stimuli.

Population calcium responses of Purkinje cells in the oculomotor cerebellum driven by non-visual input

The climbing fiber input to the cerebellum conveys instructive signals that can induce synaptic plasticity and learning by triggering complex spikes accompanied by large calcium transients in Purkinje cells. In the cerebellar flocculus, which supports oculomotor learning, complex spikes are driven by image motion on the retina, which could indicate an oculomotor error. In the same neurons, complex spikes also can be driven by non-visual signals. It has been shown that the calcium transients accompanying each complex spike can vary in amplitude, even within a given cell, therefore, we compared the calcium responses associated with the visual and non-visual inputs to floccular Purkinje cells. The calcium indicator GCaMP6f was selectively expressed in Purkinje cells, and fiber photometry was used to record the calcium responses from a population of Purkinje cells in the flocculus of awake behaving mice. During visual (optokinetic) stimuli and pairing of vestibular and visual stimuli, the calcium level increased during contraversive retinal image motion. During performance of the vestibulo-ocular reflex in the dark, calcium increased during contraversive head rotation and the associated ipsiverse eye movements. The amplitude of this non-visual calcium response was comparable to that during conditions with retinal image motion present that induce oculomotor learning. Thus, population calcium responses of Purkinje cells in the cerebellar flocculus to visual and non-visual input are similar to what has been reported previously for complex spikes, suggesting that multimodal instructive signals control the synaptic plasticity supporting oculomotor learning.

A neural circuit state change underlying skilled movements

In motor neuroscience, state changes are hypothesized to time-lock neural assemblies coordinating complex movements, but evidence for this remains slender. We tested whether a discrete change from more autonomous to coherent spiking underlies skilled movement by imaging cerebellar Purkinje neuron complex spikes in mice making targeted forelimb-reaches. As mice learned the task, millimeter-scale spatiotemporally coherent spiking emerged ipsilateral to the reaching forelimb, and consistent neural synchronization became predictive of kinematic stereotypy. Before reach onset, spiking switched from more disordered to internally time-locked concerted spiking and silence. Optogenetic manipulations of cerebellar feedback to the inferior olive bi-directionally modulated neural synchronization and reaching direction. A simple model explained the reorganization of spiking during reaching as reflecting a discrete bifurcation in olivary network dynamics. These findings argue that to prepare learned movements, olivo-cerebellar circuits enter a self-regulated, synchronized state promoting motor coordination. State changes facilitating behavioral transitions may generalize across neural systems.

The relationship between birth timing, circuit wiring, and physiological response properties of cerebellar granule cells

Cerebellar granule cells (GrCs) are usually regarded as a uniform cell type that collectively expands the coding space of the cerebellum by integrating diverse combinations of mossy fiber inputs. Accordingly, stable molecularly or physiologically defined GrC subtypes within a single cerebellar region have not been reported. The only known cellular property that distinguishes otherwise homogeneous GrCs is the correspondence between GrC birth timing and the depth of the molecular layer to which their axons project. To determine the role birth timing plays in GrC wiring and function, we developed genetic strategies to access early- and late-born GrCs. We initiated retrograde monosynaptic rabies virus tracing from control (birth timing unrestricted), early-born, and late-born GrCs, revealing the different patterns of mossy fiber input to GrCs in vermis lobule 6 and simplex, as well as to early- and late-born GrCs of vermis lobule 6: sensory and motor nuclei provide more input to early-born GrCs, while basal pontine and cerebellar nuclei provide more input to late-born GrCs. In vivo multidepth two-photon Ca2+ imaging of axons of early- and late-born GrCs revealed representations of diverse task variables and stimuli by both populations, with modest differences in the proportions encoding movement, reward anticipation, and reward consumption. Our results suggest neither organized parallel processing nor completely random organization of mossy fiber→GrC circuitry but instead a moderate influence of birth timing on GrC wiring and encoding. Our imaging data also provide evidence that GrCs can represent generalized responses to aversive stimuli, in addition to recently described reward representations.

Basal ganglia and cerebellum contributions to vocal emotion processing as revealed by high-resolution fMRI

Until recently, brain networks underlying emotional voice prosody decoding and processing were focused on modulations in primary and secondary auditory, ventral frontal and prefrontal cortices, and the amygdala. Growing interest for a specific role of the basal ganglia and cerebellum was recently brought into the spotlight. In the present study, we aimed at characterizing the role of such subcortical brain regions in vocal emotion processing, at the level of both brain activation and functional and effective connectivity, using high resolution functional magnetic resonance imaging. Variance explained by low-level acoustic parameters (fundamental frequency, voice energy) was also modelled. Wholebrain data revealed expected contributions of the temporal and frontal cortices, basal ganglia and cerebellum to vocal emotion processing, while functional connectivity analyses highlighted correlations between basal ganglia and cerebellum, especially for angry voices. Seed-to-seed and seed-to-voxel effective connectivity revealed direct connections within the basal ganglia—especially between the putamen and external globus pallidus—and between the subthalamic nucleus and the cerebellum. Our results speak in favour of crucial contributions of the basal ganglia, especially the putamen, external globus pallidus and subthalamic nucleus, and several cerebellar lobules and nuclei for an efficient decoding of and response to vocal emotions.

Interpreting the role of the striatum during multiple phases of motor learning

The synaptic pathways in the striatum are central to basal ganglia functions including motor control, learning and organization, action selection, acquisition of motor skills, cognitive function, and emotion. Here, we review the role of the striatum and its connections in motor learning and performance. The development of new techniques to record neuronal activity and animal models of motor disorders using neurotoxin, pharmacological, and genetic manipulations are revealing pathways that underlie motor performance and motor learning, as well as how they are altered by pathophysiological mechanisms. We discuss approaches that can be used to analyze complex motor skills, particularly in rodents, and identify specific questions central to understanding how striatal circuits mediate motor learning.

Passive Motor Learning: Oculomotor Adaptation in the Absence of Behavioral Errors

Motor adaptation is commonly thought to be a trial-and-error process in which the accuracy of movement improves with repetition of behavior. We challenged this view by testing whether erroneous movements are necessary for motor adaptation. In the eye movement system, the association between movements and errors can be disentangled, since errors in the predicted stimulus trajectory can be perceived even without movements. We modified a smooth pursuit eye movement adaptation paradigm in which monkeys learn to make an eye movement that predicts an upcoming change in target direction. We trained the monkeys to fixate on a target while covertly, an additional target initially moved in one direction and then changed direction after 250 ms. The monkeys showed a learned response to infrequent probe trials in which they were instructed to follow the moving target. Additional experiments confirmed that probing learning or residual eye movements during fixation did not drive learning. These results show that motor adaptation can be elicited in the absence of movement and provide an animal model for studying the implementation of passive motor learning. Current models assume that the interaction between movement and error signals underlies adaptive motor learning. Our results point to other mechanisms that may drive learning in the absence of movement.

Medial prefrontal cortical control of reward- and aversion-based behavioral output: Bottom-up modulation

How does the brain guide our actions? This is a complex issue, where the medial prefrontal cortex (mPFC) plays a crucial role. The mPFC is essential for cognitive flexibility and decision making. These functions are related to reward- and aversion-based learning, which ultimately drive behavior. Though, cortical projections and modulatory systems that may regulate those processes in the mPFC are less understood. How does the mPFC regulate approach-avoidance behavior in the case of conflicting aversive and appetitive stimuli? This is likely dependent on the bottom-up neuromodulation of the mPFC projection neurons. In this review, we integrate behavioral-, pharmacological-, and viral-based circuit manipulation data showing the involvement of mPFC dopaminergic, noradrenergic, cholinergic, and serotoninergic inputs in reward and aversion processing. Given that an incorrect balance of reward and aversion value could be a key problem in mental diseases such as substance use disorders, we discuss outstanding questions for future research on the role of mPFC modulation in reward and aversion.