A role for dopamine-mediated learning in the pathophysiology and treatment of Parkinson's disease

Circuit-Specific Deep Brain Stimulation Provides Insights into Movement Control

Deep brain stimulation (DBS), a method in which electrical stimulation is delivered to specific areas of the brain, is an effective treatment for managing symptoms of a number of neurological and neuropsychiatric disorders. Clinical access to neural circuits during DBS provides an opportunity to study the functional link between neural circuits and behavior. This review discusses how the use of DBS in Parkinson's disease and dystonia has provided insights into the brain networks and physiological mechanisms that underlie motor control. In parallel, insights from basic science about how patterns of electrical stimulation impact plasticity and communication within neural circuits are transforming DBS from a therapy for treating symptoms to a therapy for treating circuits, with the goal of training the brain out of its diseased state.

Striatal Dopamine Contributions to Skilled Motor Learning

Coordinated multijoint limb and digit movements-"manual dexterity"-underlie both specialized skills (e.g., playing the piano) and more mundane tasks (e.g., tying shoelaces). Impairments in dexterous skill cause significant disability, as occurs with motor cortical injury, Parkinson's disease, and a range of other pathologies. Clinical observations, as well as basic investigations, suggest that corticostriatal circuits play a critical role in learning and performing dexterous skills. Furthermore, dopaminergic signaling in these regions is implicated in synaptic plasticity and motor learning. Nonetheless, the role of striatal dopamine signaling in skilled motor learning remains poorly understood. Here, we use fiber photometry paired with a genetically encoded dopamine sensor to investigate striatal dopamine release in both male and female mice as they learn and perform a skilled reaching task. Dopamine rapidly increases during a skilled reach and peaks near pellet consumption. In the dorsolateral striatum, dopamine dynamics are faster than in the dorsomedial and ventral striatum. Across training, as reaching performance improves, dopamine signaling shifts from pellet consumption to cues that predict pellet availability, particularly in medial and ventral areas of the striatum. Furthermore, performance prediction errors are present across the striatum, with reduced dopamine release after an unsuccessful reach. These findings show that dopamine dynamics during skilled motor behaviors change with learning and are differentially regulated across striatal subregions.

Ethological computational psychiatry: Challenges and opportunities

Studying the intricacies of individual subjects' moods and cognitive processing over extended periods of time presents a formidable challenge in medicine. While much of systems neuroscience appropriately focuses on the link between neural circuit functions and well-constrained behaviors over short timescales (e.g., trials, hours), many mental health conditions involve complex interactions of mood and cognition that are non-stationary across behavioral contexts and evolve over extended timescales. Here, we discuss opportunities, challenges, and possible future directions in computational psychiatry to quantify non-stationary continuously monitored behaviors. We suggest that this exploratory effort may contribute to a more precision-based approach to treating mental disorders and facilitate a more robust reverse translation across animal species. We conclude with ethical considerations for any field that aims to bridge artificial intelligence and patient monitoring.

Dopamine D2 Receptor Modulates Exercise Related Effect on Cortical Excitation/Inhibition and Motor Skill Acquisition

Exercise is known to benefit motor skill learning in health and neurological disease. Evidence from brain stimulation, genotyping, and Parkinson's disease studies converge to suggest that the dopamine D2 receptor, and shifts in the cortical excitation and inhibition (E:I) balance, are prime candidates for the drivers of exercise-enhanced motor learning. However, causal evidence using experimental pharmacological challenge is lacking. We hypothesized that the modulatory effect of the dopamine D2 receptor on exercise-induced changes in the E:I balance would determine the magnitude of motor skill acquisition. To test this, we measured exercise-induced changes in excitation and inhibition using paired-pulse transcranial magnetic stimulation (TMS) in 22 healthy female and male humans, and then had participants learn a novel motor skill-the sequential visual isometric pinch task (SVIPT). We examined the effect of D2 receptor blockade (800 mg sulpiride) on these measures within a randomized, double-blind, placebo-controlled design. Our key result was that motor skill acquisition was driven by an interaction between the D2 receptor and E:I balance. Specifically, poorer skill learning was related to an attenuated shift in the E:I balance in the sulpiride condition, whereas this interaction was not evident in placebo. Our results demonstrate that exercise-primed motor skill acquisition is causally influenced by D2 receptor activity on motor cortical circuits.

Dopamine across timescales and cell types: Relevance for phenotypes in Parkinson's disease progression

Dopamine neurons in the substantia nigra pars compacta (SNc) synthesize and release dopamine, a critical neurotransmitter for movement and learning. SNc dopamine neurons degenerate in Parkinson's Disease (PD), causing a host of motor and non-motor symptoms. Here, we review recent conceptual advances in our basic understanding of the dopamine system - including our rapidly advancing knowledge of dopamine neuron heterogeneity - with special attention to their importance for understanding PD. In PD patients, dopamine neuron degeneration progresses from lateral SNc to medial SNc, suggesting clinically relevant heterogeneity in dopamine neurons. With technical advances in dopamine system interrogation, we can understand the relevance of this heterogeneity for PD progression and harness it to develop new treatments.

Associating white matter microstructural integrity and improvements in reactive stepping in people with Parkinson's Disease

Reactive steps are rapid responses after balance challenges. People with Parkinson's Disease (PwPD) demonstrate impaired reactive stepping, increasing fall-risk. Although PwPD can improve steps through practice, the neural mechanisms contributing to improved reactive stepping are poorly understood. This study investigated white-matter correlates of responsiveness to reactive step training in PwPD. In an eighteen-week multiple-baseline study, participants (n = 22) underwent baseline assessments (B1 and B2 two-weeks apart), a two-week training protocol, and post-training assessments immediately (P1) and two-months (P2) post-training. Assessments involved three backward reactive step trials, measuring anterior-posterior margin of stability (AP MOS), step length, and step latency. Tract-Based Spatial Statistics correlated white-matter integrity (fractional anisotropy (FA) and radial diffusivity (RD)) with retained (P2-B2) and immediate improvements (P1-B2) in stepping. Significant and sustained improvements in step length and AP MOS were observed. Greater retention of step length improvement correlated with increased FA in the left anterior thalamic radiation (ATR), left posterior thalamic radiation (PTR), left superior longitudinal fasciculus (SLF), and right inferior longitudinal fasciculus (ILF). Step latency retention was associated with lower RD in the left posterior corona radiata and left PTR. Immediate improvements in AP MOS correlated with increased FA of the right ILF, right SLF, and right corticospinal tract. Immediate step length improvements were associated with increased FA in right and left ATR and right SLF. These findings highlight the importance of white-matter microstructural integrity in motor learning and retention processes in PD and could aid in identifying individuals with PD who would benefit most from balance rehabilitation.

Opposing Motor Memories in the Direct and Indirect Pathways of the Basal Ganglia

Loss of dopamine neurons causes motor deterioration in Parkinson's disease patients. We have previously reported that in addition to acute motor impairment, the impaired motor behavior is encoded into long-term memory in an experience-dependent and task-specific manner, a phenomenon we refer to as aberrant inhibitory motor learning. Although normal motor learning and aberrant inhibitory learning oppose each other and this is manifested in apparent motor performance, in the present study, we found that normal motor memory acquired prior to aberrant inhibitory learning remains preserved in the brain, suggesting the existence of independent storage. To investigate the neuronal circuits underlying these two opposing memories, we took advantage of the RNA-binding protein YTHDF1, an m 6 A RNA methylation reader involved in the regulation of protein synthesis and learning/memory. Conditional deletion of Ythdf1 in either D1 or D2 receptor-expressing neurons revealed that normal motor memory is stored in the D1 (direct) pathway of the basal ganglia, while inhibitory memory is stored in the D2 (indirect) pathway. Furthermore, fiber photometry recordings of GCaMP signals from striatal D1 (dSPN) and D2 (iSPN) receptor-expressing neurons support the preservation of normal memory in the direct pathway after aberrant inhibitory learning, with activities of dSPN predictive of motor performance. Finally, a computational model based on activities of motor cortical neurons, dSPN and iSPN neurons, and their interactions through the basal ganglia loops supports the above observations. These findings have important implications for novel approaches in treating Parkinson's disease by reactivating preserved normal memory, and in treating hyperkinetic movement disorders such as chorea or tics by erasing aberrant motor memories.

Striatal dopamine contributions to skilled motor learning

Coordinated multi-joint limb and digit movements - "manual dexterity" - underlie both specialized skills (e.g., playing the piano) and more mundane tasks (e.g., tying shoelaces). Impairments in dexterous skill cause significant disability, as occurs with motor cortical injury, Parkinson's Disease, and a range of other pathologies. Clinical observations, as well as basic investigations, suggest that cortico-striatal circuits play a critical role in learning and performing dexterous skills. Furthermore, dopaminergic signaling in these regions is implicated in synaptic plasticity and motor learning. Nonetheless, the role of striatal dopamine signaling in skilled motor learning remains poorly understood. Here, we use fiber photometry paired with a genetically encoded dopamine sensor to investigate striatal dopamine release as mice learn and perform a skilled reaching task. Dopamine rapidly increases during a skilled reach and peaks near pellet consumption. In dorsolateral striatum, dopamine dynamics are faster than in dorsomedial and ventral striatum. Across training, as reaching performance improves, dopamine signaling shifts from pellet consumption to cues that predict pellet availability, particularly in medial and ventral areas of striatum. Furthermore, performance prediction errors are present across the striatum, with reduced dopamine release after an unsuccessful reach. These findings show that dopamine dynamics during skilled motor behaviors change with learning and are differentially regulated across striatal subregions.

Adaptive control of synaptic plasticity integrates micro- and macroscopic network function

Synaptic plasticity configures interactions between neurons and is therefore likely to be a primary driver of behavioral learning and development. How this microscopic-macroscopic interaction occurs is poorly understood, as researchers frequently examine models within particular ranges of abstraction and scale. Computational neuroscience and machine learning models offer theoretically powerful analyses of plasticity in neural networks, but results are often siloed and only coarsely linked to biology. In this review, we examine connections between these areas, asking how network computations change as a function of diverse features of plasticity and vice versa. We review how plasticity can be controlled at synapses by calcium dynamics and neuromodulatory signals, the manifestation of these changes in networks, and their impacts in specialized circuits. We conclude that metaplasticity-defined broadly as the adaptive control of plasticity-forges connections across scales by governing what groups of synapses can and can't learn about, when, and to what ends. The metaplasticity we discuss acts by co-opting Hebbian mechanisms, shifting network properties, and routing activity within and across brain systems. Asking how these operations can go awry should also be useful for understanding pathology, which we address in the context of autism, schizophrenia and Parkinson's disease.

R1441C and G2019S LRRK2 knockin mice have distinct striatal molecular, physiological, and behavioral alterations

LRRK2 mutations are closely associated with Parkinson's disease (PD). Convergent evidence suggests that LRRK2 regulates striatal function. Here, by using knock-in mouse lines expressing the two most common LRRK2 pathogenic mutations-G2019S and R1441C-we investigated how LRRK2 mutations altered striatal physiology. While we found that both R1441C and G2019S mice displayed reduced nigrostriatal dopamine release, hypoexcitability in indirect-pathway striatal projection neurons, and alterations associated with an impaired striatal-dependent motor learning were observed only in the R1441C mice. We also showed that increased synaptic PKA activities in the R1441C and not G2019S mice underlie the specific alterations in motor learning deficits in the R1441C mice. In summary, our data argue that LRRK2 mutations' impact on the striatum cannot be simply generalized. Instead, alterations in electrochemical, electrophysiological, molecular, and behavioral levels were distinct between LRRK2 mutations. Our findings offer mechanistic insights for devising and optimizing treatment strategies for PD patients.

The Arousal-motor Hypothesis of Dopamine Function: Evidence that Dopamine Facilitates Reward Seeking in Part by Maintaining Arousal

Dopamine facilitates approach to reward via its actions on dopamine receptors in the nucleus accumbens. For example, blocking either D1 or D2 dopamine receptors in the accumbens reduces the proportion of reward-predictive cues to which rats respond with cued approach. Recent evidence indicates that accumbens dopamine also promotes wakefulness and arousal, but the relationship between dopamine's roles in arousal and reward seeking remains unexplored. Here, we show that the ability of systemic or intra-accumbens injections of the D1 antagonist SCH23390 to reduce cued approach to reward depends on the animal's state of arousal. Handling the animal, a manipulation known to increase arousal, was sufficient to reverse the behavioral effects of the antagonist. In addition, SCH23390 reduced spontaneous locomotion and increased time spent in sleep postures, both consistent with reduced arousal, but also increased time spent immobile in postures inconsistent with sleep. In contrast, the ability of the D2 antagonist haloperidol to reduce cued approach was not reversible by handling. Haloperidol reduced spontaneous locomotion but did not increase sleep postures, instead increasing immobility in non-sleep postures. We place these results in the context of the extensive literature on dopamine's contributions to behavior, and propose the arousal-motor hypothesis. This novel synthesis, which proposes that two main functions of dopamine are to promote arousal and facilitate motor behavior, accounts both for our findings and many previous behavioral observations that have led to disparate and conflicting conclusions.

Regulation of Cdc42 signaling by the dopamine D2 receptor in a mouse model of Parkinson's disease

Substantial spine loss in striatal medium spiny neurons (MSNs) and abnormal behaviors are common features of Parkinson's disease (PD). The caudate putamen (CPu) mainly contains MSNs expressing dopamine D1 receptor (dMSNs) and dopamine D2 receptor (iMSNs) exerting critical effects on motor and cognition behavior. However, the molecular mechanisms contributing to spine loss and abnormal behaviors in dMSNs and iMSNs under parkinsonian state remain unknown. In the present study, we revealed that Cell division control protein 42 (Cdc42) signaling was significantly decreased in the caudate putamen (CPu) in parkinsonian mice. In addition, overexpression of constitutively active Cdc42 in the CPu reversed spine abnormalities and improved the behavior deficits in parkinsonian mice. Utilizing conditional dopamine D1 receptor (D1R) or D2 receptor (D2R) knockout mice, we found that such a decrease under parkinsonian state was further reduced by conditional knockout of the D2R but not D1R. Moreover, the thin spine loss in iMSNs and deficits in motor coordination and cognition induced by conditional knockout of D2R were reversed by overexpression of constitutively active Cdc42 in the CPu. Additionally, conditional knockout of Cdc42 from D2R‐positive neurons in the CPu was sufficient to induce spine and behavior deficits similar to those observed in parkinsonian mice. Overall, our results indicate that impaired Cdc42 signaling regulated by D2R plays an important role in spine loss and behavioral deficits in PD.

Computational Psychiatry Needs Time and Context

Why has computational psychiatry yet to influence routine clinical practice? One reason may be that it has neglected context and temporal dynamics in the models of certain mental health problems. We develop three heuristics for estimating whether time and context are important to a mental health problem: Is it characterized by a core neurobiological mechanism? Does it follow a straightforward natural trajectory? And is intentional mental content peripheral to the problem? For many problems the answers are no, suggesting that modeling time and context is critical. We review computational psychiatry advances toward this end, including modeling state variation, using domain-specific stimuli, and interpreting differences in context. We discuss complementary network and complex systems approaches. Novel methods and unification with adjacent fields may inspire a new generation of computational psychiatry.

Mechanisms of Antiparkinsonian Anticholinergic Therapy Revisited

Before the advent of L-DOPA, the gold standard symptomatic therapy for Parkinson's disease (PD), anticholinergic drugs (muscarinic receptor antagonists) were the preferred antiparkinsonian therapy, but their unwanted side effects associated with impaired extrastriatal cholinergic function limited their clinical utility. Since most patients treated with L-DOPA also develop unwanted side effects such as L-DOPA-induced dyskinesia (LID), better therapies are needed. Recent studies in animal models demonstrate that optogenetic and chemogenetic manipulation of striatal cholinergic interneurons (SCIN), the main source of striatal acetylcholine, modulate parkinsonism and LID, suggesting that restoring SCIN function might serve as a therapeutic option that avoids extrastriatal anticholinergics' side effects. However, it is still unclear how the altered SCIN activity in PD and LID affects the striatal circuit, whereas the mechanisms of action of anticholinergic drugs are still not fully understood. Recent animal model studies showing that SCINs undergo profound changes in their tonic discharge pattern after chronic L-DOPA administration call for a reexamination of classical views of how SCINs contribute to PD symptoms and LID. Here, we review the recent advances on the circuit implications of aberrant striatal cholinergic signaling in PD and LID in an effort to provide a comprehensive framework to understand the effects of anticholinergic drugs and with the aim of shedding light into future perspectives of cholinergic circuit-based therapies.

Function and Regulation of ALDH1A1-Positive Nigrostriatal Dopaminergic Neurons in Motor Control and Parkinson's Disease

Dopamine is an important chemical messenger in the brain, which modulates movement, reward, motivation, and memory. Different populations of neurons can produce and release dopamine in the brain and regulate different behaviors. Here we focus our discussion on a small but distinct group of dopamine-producing neurons, which display the most profound loss in the ventral substantia nigra pas compacta of patients with Parkinson's disease. This group of dopaminergic neurons can be readily identified by a selective expression of aldehyde dehydrogenase 1A1 (ALDH1A1) and accounts for 70% of total nigrostriatal dopaminergic neurons in both human and mouse brains. Recently, we presented the first whole-brain circuit map of these ALDH1A1-positive dopaminergic neurons and reveal an essential physiological function of these neurons in regulating the vigor of movement during the acquisition of motor skills. In this review, we first summarize previous findings of ALDH1A1-positive nigrostriatal dopaminergic neurons and their connectivity and functionality, and then provide perspectives on how the activity of ALDH1A1-positive nigrostriatal dopaminergic neurons is regulated through integrating diverse presynaptic inputs and its implications for potential Parkinson's disease treatment.

Rational inattention and tonic dopamine

Slow-timescale (tonic) changes in dopamine (DA) contribute to a wide variety of processes in reinforcement learning, interval timing, and other domains. Furthermore, changes in tonic DA exert distinct effects depending on when they occur (e.g., during learning vs. performance) and what task the subject is performing (e.g., operant vs. classical conditioning). Two influential theories of tonic DA-the average reward theory and the Bayesian theory in which DA controls precision-have each been successful at explaining a subset of empirical findings. But how the same DA signal performs two seemingly distinct functions without creating crosstalk is not well understood. Here we reconcile the two theories under the unifying framework of 'rational inattention,' which (1) conceptually links average reward and precision, (2) outlines how DA manipulations affect this relationship, and in so doing, (3) captures new empirical phenomena. In brief, rational inattention asserts that agents can increase their precision in a task (and thus improve their performance) by paying a cognitive cost. Crucially, whether this cost is worth paying depends on average reward availability, reported by DA. The monotonic relationship between average reward and precision means that the DA signal contains the information necessary to retrieve the precision. When this information is needed after the task is performed, as presumed by Bayesian inference, acute manipulations of DA will bias behavior in predictable ways. We show how this framework reconciles a remarkably large collection of experimental findings. In reinforcement learning, the rational inattention framework predicts that learning from positive and negative feedback should be enhanced in high and low DA states, respectively, and that DA should tip the exploration-exploitation balance toward exploitation. In interval timing, this framework predicts that DA should increase the speed of the internal clock and decrease the extent of interference by other temporal stimuli during temporal reproduction (the central tendency effect). Finally, rational inattention makes the new predictions that these effects should be critically dependent on the controllability of rewards, that post-reward delays in intertemporal choice tasks should be underestimated, and that average reward manipulations should affect the speed of the clock-thus capturing empirical findings that are unexplained by either theory alone. Our results suggest that a common computational repertoire may underlie the seemingly heterogeneous roles of DA.

Acute exercise following skill practice promotes motor memory consolidation in Parkinson's disease

Acute cardiovascular exercise has shown to promote neuroplastic processes supporting the consolidation of newly acquired motor skills in healthy adults. First results suggest that this concept may be transferred to populations with motor and cognitive dysfunctions. In this context, Parkinson's disease (PD) is highly relevant since patients demonstrate deficits in motor learning. Hence, in the present study we sought to explore the effect of a single post-practice exercise bout on motor memory consolidation in PD. For this purpose, 17 patients with PD (Hoehn and Yahr: 1 - 2.5, age: 60.1 ± 7.9 y) practiced a whole-body skill followed by either (i) a moderate-intense bout of cycling, or (ii) seated rest for a total of 30 min. The motor skill required the participants to balance on a tiltable platform (stabilometer) for 30 s. During skill practice, participants performed 15 trials followed by a retention test 1 day and 7 days later. We calculated time in balance (platform within ± 5° from horizontal) for each trial and within- and between-group differences in memory consolidation (i.e. offline learning = skill change from last acquisition block to retention tests) were analyzed. Groups revealed similar improvements during skill practice (F_4,60 = 0.316, p = 0.866), but showed differences in offline learning, which were only evident after 7 days (F_1,14 = 5.602, p = 0.033). Our results suggest that a single post-practice exercise bout is effective in enhancing long-term motor memory consolidation in a population with motor learning impairments. This may point at unique promoting effects of exercise on dopamine neurotransmission involved in memory formation. Future studies should investigate the potential role of exercise-induced effects on the dopaminergic system.

Precisely timed dopamine signals establish distinct kinematic representations of skilled movements

Brain dopamine is critical for normal motor control, as evidenced by its importance in Parkinson Disease and related disorders. Current hypotheses are that dopamine influences motor control by 'invigorating' movements and regulating motor learning. Most evidence for these aspects of dopamine function comes from simple tasks (e.g. lever pressing). Therefore, the influence of dopamine on motor skills requiring multi-joint coordination is unknown. To determine the effects of precisely timed dopamine manipulations on the performance of a complex, finely coordinated dexterous skill, we optogenetically stimulated or inhibited midbrain dopamine neurons as rats performed a skilled reaching task. We found that reach kinematics and coordination between gross and fine movements progressively changed with repeated manipulations. However, once established, rats transitioned abruptly between aberrant and baseline reach kinematics in a dopamine-dependent manner. These results suggest that precisely timed dopamine signals have immediate and long-term influences on motor skill performance, distinct from simply 'invigorating' movement.

AUTS2 Governs Cerebellar Development, Purkinje Cell Maturation, Motor Function and Social Communication

Autism susceptibility candidate 2 (AUTS2), a risk gene for autism spectrum disorders (ASDs), is implicated in telencephalon development. Because AUTS2 is also expressed in the cerebellum where defects have been linked to ASDs, we investigated AUTS2 functions in the cerebellum. AUTS2 is specifically localized in Purkinje cells (PCs) and Golgi cells during postnatal development. Auts2 conditional knockout (cKO) mice exhibited smaller and deformed cerebella containing immature-shaped PCs with reduced expression of Cacna1a. Auts2 cKO and knock-down experiments implicated AUTS2 participation in elimination and translocation of climbing fiber synapses and restriction of parallel fiber synapse numbers. Auts2 cKO mice exhibited behavioral impairments in motor learning and vocal communications. Because Cacna1a is known to regulate synapse development in PCs, it suggests that AUTS2 is required for PC maturation to elicit normal development of PC synapses and thus the impairment of AUTS2 may cause cerebellar dysfunction related to psychiatric illnesses such as ASDs.

•

Loss of Auts2 leads to the reduction of cerebellar size

•

AUTS2 promotes the dendritic maturation of Purkinje cells

•

AUTS2 participates in PF and CF synapse development of Purkinje cells

•

Auts2 cKO mice exhibit the impaired motor learning and vocal communications

Role of Genes and Treatments for Parkinson’s Disease

Parkinson’s Disease (PD) is a complex neurodegenerative disorder that mainly results due to the loss of dopaminergic neurons in the substantia nigra of the midbrain. It is well known that dopamine is synthesized in substantia nigra and is transported to the striatumvianigrostriatal tract. Besides the sporadic forms of PD, there are also familial cases of PD and number of genes (both autosomal dominant as well as recessive) are responsible for PD. There is no permanent cure for PD and to date, L-dopa therapy is considered to be the best option besides having dopamine agonists. In the present review, we have described the genes responsible for PD, the role of dopamine, and treatment strategies adopted for controlling the progression of PD in humans.

A non-linear deterministic model of action selection in the basal ganglia to simulate motor fluctuations in Parkinson's disease

Motor fluctuations and dyskinesias are severe complications of Parkinson's disease (PD), especially evident at its advanced stage, under long-term levodopa therapy. Despite their strong clinical prevalence, the neural origin of these motor symptoms is still a subject of intense debate. In this work, a non-linear deterministic neurocomputational model of the basal ganglia (BG), inspired by biology, is used to provide more insights into possible neural mechanisms at the basis of motor complications in PD. In particular, the model is used to simulate the finger tapping task. The model describes the main neural pathways involved in the BG to select actions [the direct or Go, the indirect or NoGo, and the hyperdirect pathways via the action of the sub-thalamic nucleus (STN)]. A sensitivity analysis is performed on some crucial model parameters (the dopamine level, the strength of the STN mechanism, and the strength of competition among different actions in the motor cortex) at different levels of synapses, reflecting major or minor motor training. Depending on model parameters, results show that the model can reproduce a variety of clinically relevant motor patterns, including normokinesia, bradykinesia, several attempts before movement, freezing, repetition, and also irregular fluctuations. Motor symptoms are, especially, evident at low or high dopamine levels, with excessive strength of the STN and with weak competition among alternative actions. Moreover, these symptoms worsen if the synapses are subject to insufficient learning. The model may help improve the comprehension of motor complications in PD and, ultimately, may contribute to the treatment design.

Impaired context-sensitive adjustment of behaviour in Parkinson's disease patients tested on and off medication: An fMRI study

The brain's sensitivity to and accentuation of unpredicted over predicted sensory signals plays a fundamental role in learning. According to recent theoretical models of the predictive coding framework, dopamine is responsible for balancing the interplay between bottom-up input and top-down predictions by controlling the precision of surprise signals that guide learning. Using functional MRI, we investigated whether patients with Parkinson's disease (PD) show impaired learning from prediction errors requiring either adaptation or stabilisation of current predictions. Moreover, we were interested in whether deficits in learning over a specific time scale would be accompanied by altered surprise responses in dopamine-related brain structures. To this end, twenty-one PD patients tested on and off dopaminergic medication and twenty-one healthy controls performed a digit prediction paradigm. During the task, violations of sequence-based predictions either signalled the need to update or to stabilise the current prediction and, thus, to react to them or ignore them, respectively. To investigate contextual adaptation to prediction errors, the probability (or its inverse, surprise) of the violations fluctuated across the experiment. When the probability of prediction errors over a specific time scale increased, healthy controls but not PD patients off medication became more flexible, i.e., error rates at violations requiring a motor response decreased in controls but increased in patients. On the neural level, this learning deficit in patients was accompanied by reduced signalling in the substantia nigra and the caudate nucleus. In contrast, differences between the groups regarding the probabilistic modulation of behaviour and neural responses were much less pronounced at prediction errors requiring only stabilisation but no adaptation. Interestingly, dopaminergic medication could neither improve learning from prediction errors nor restore the physiological, neurotypical pattern. Our findings point to a pivotal role of dysfunctions of the substantia nigra and caudate nucleus in deficits in learning from flexibility-demanding prediction errors in PD. Moreover, the data witness poor effects of dopaminergic medication on learning in PD.

An integrative framework for perceptual disturbances in psychosis

Perceptual disturbances in psychosis, such as auditory verbal hallucinations, are associated with increased baseline activity in the associative auditory cortex and increased dopamine transmission in the associative striatum. Perceptual disturbances are also associated with perceptual biases that suggest increased reliance on prior expectations. We review theoretical models of perceptual inference and key supporting physiological evidence, as well as the anatomy of associative cortico-striatal loops that may be relevant to auditory perceptual inference. Integrating recent findings, we outline a working framework that bridges neurobiology and the phenomenology of perceptual disturbances via theoretical models of perceptual inference.

Mathematical modeling and parameter estimation of levodopa motor response in patients with parkinson disease

Parkinson disease (PD) is characterized by a clear beneficial motor response to levodopa (LD) treatment. However, with disease progression and longer LD exposure, drug-related motor fluctuations usually occur. Recognition of the individual relationship between LD concentration and its effect may be difficult, due to the complexity and variability of the mechanisms involved. This work proposes an innovative procedure for the automatic estimation of LD pharmacokinetics and pharmacodynamics parameters, by a biologically-inspired mathematical model. An original issue, compared with previous similar studies, is that the model comprises not only a compartmental description of LD pharmacokinetics in plasma and its effect on the striatal neurons, but also a neurocomputational model of basal ganglia action selection. Parameter estimation was achieved on 26 patients (13 with stable and 13 with fluctuating LD response) to mimic plasma LD concentration and alternate finger tapping frequency along four hours after LD administration, automatically minimizing a cost function of the difference between simulated and clinical data points. Results show that individual data can be satisfactorily simulated in all patients and that significant differences exist in the estimated parameters between the two groups. Specifically, the drug removal rate from the effect compartment, and the Hill coefficient of the concentration-effect relationship were significantly higher in the fluctuating than in the stable group. The model, with individualized parameters, may be used to reach a deeper comprehension of the PD mechanisms, mimic the effect of medication, and, based on the predicted neural responses, plan the correct management and design innovative therapeutic procedures.

Striatopallidal neurons control avoidance behavior in exploratory tasks

The dorsal striatum has been linked to decision-making under conflict, but the mechanism by which striatal neurons contribute to approach-avoidance conflicts remains unclear. We hypothesized that striatopallidal dopamine D2 receptor (D2R)-expressing neurons promote avoidance, and tested this hypothesis in two exploratory approach-avoidance conflict paradigms in mice: the elevated zero maze and open field. Genetic elimination of D2Rs on striatopallidal neurons (iMSNs), but not other neural populations, increased avoidance of the open areas in both tasks, in a manner that was dissociable from global changes in movement. Population calcium activity of dorsomedial iMSNs was disrupted in mice lacking D2Rs on iMSNs, suggesting that disrupted output of iMSNs contributes to heightened avoidance behavior. Consistently, artificial disruption of iMSN output with optogenetic stimulation heightened avoidance of open areas of these tasks, while inhibition of iMSN output reduced avoidance. We conclude that dorsomedial striatal iMSNs control approach-avoidance conflicts in exploratory tasks, and highlight this neural population as a potential target for reducing avoidance in anxiety disorders.

Cocaine conditioned place preference: unexpected suppression of preference due to testing combined with strong conditioning

Conditioned place preference (CPP) is widely used for evaluating the rewarding effects of drugs. Like other memories, CPP is proposed to undergo reconsolidation during which it is unstable and sensitive to pharmacological inhibition. Previous studies have shown that cocaine CPP can be apparently erased by extracellular signal-regulated kinase (ERK) pathway inhibition during cocaine reconditioning (re-exposure to the drug-paired environment in the presence of the drug). Here, we show that blockade of D1 receptors during reconditioning prevented ERK activation and induced a loss of CPP. However, we also unexpectedly observed a CPP disappearance in mice that underwent testing and reconditioning with cocaine alone, specifically in strong conditioning conditions. The loss was due to the intermediate test. CPP was not recovered with reconditioning or priming in the short term, but it spontaneously reappeared after a month. When we challenged the D1 antagonist-mediated erasure, we observed that both a high dose of cocaine and a first CPP test were required for this effect. Our results also suggest a balance between D1-dependent ERK pathway activation and an A2a-dependent mechanism in D2 striatal neurons in controlling CPP expression. Our data reveal that, paradoxically, a simple CPP test can induce a complete (but transient) loss of place preference following strong but not weak cocaine conditioning. This study emphasizes the complex nature of CPP memory and the importance of multiple parameters that must be taken into consideration when investigating reconsolidation.

Dual Dopaminergic Regulation of Corticostriatal Plasticity by Cholinergic Interneurons and Indirect Pathway Medium Spiny Neurons

Endocannabinoid (eCB)-mediated long-term depression (LTD) requires dopamine (DA) D2 receptors (D2Rs) for eCB mobilization. The cellular locus of the D2Rs involved in LTD induction remains highly debated. We directly examined the role in LTD induction of D2Rs expressed by striatal cholinergic interneurons (Chls) and indirect pathway medium spiny neurons (iMSNs) using neuron-specific targeted deletion of D2Rs. Deletion of Chl-D2Rs (Chl-Drd2KO) impaired LTD induction in both subtypes of MSNs. LTD induction was restored in the Chl-Drd2KO mice by an M1-selective muscarinic acetylcholine receptor antagonist. In contrast, after the deletion of iMSN-D2Rs (iMSN-Drd2KO), LTD induction was intact in MSNs. Separate interrogation of direct pathway and iMSNs revealed a deficit in LTD induction only at synapses onto iMSNs that lack D2Rs. LTD induction in iMSNs was restored by D2R agonist application. Our findings suggest that Chl D2Rs strongly modulate LTD induction in MSNs, with iMSN-D2Rs having a weaker, iMSN-specific, modulatory effect.

Mettl14 Is Essential for Epitranscriptomic Regulation of Striatal Function and Learning

N⁶-methyladenosine (m⁶A) regulates mRNA metabolism and translation, serving as an important source of post-transcriptional regulation. To date, the functional consequences of m⁶A deficiency within the adult brain have not been determined. To achieve m⁶A deficiency, we deleted Mettl14, an essential component of the m⁶A methyltransferase complex, in two related yet discrete mouse neuronal populations: striatonigral and striatopallidal. Mettl14 deletion reduced striatal m⁶A levels without altering cell numbers or morphology. Transcriptome-wide profiling of m⁶A-modified mRNAs in Mettl14-deleted striatum revealed downregulation of similar striatal mRNAs encoding neuron- and synapse-specific proteins in both neuronal types, but striatonigral and striatopallidal identity genes were uniquely downregulated in each respective manipulation. Upregulated mRNA species encoded non-neuron-specific proteins. These changes increased neuronal excitability, reduced spike frequency adaptation, and profoundly impaired striatal-mediated behaviors. Using viral-mediated, neuron-specific striatal Mettl14 deletion in adult mice, we further confirmed the significance of m⁶A in maintaining normal striatal function in the adult mouse.

What does dopamine mean?

Dopamine is a critical modulator of both learning and motivation. This presents a problem: how can target cells know whether increased dopamine is a signal to learn or to move? It is often presumed that motivation involves slow ('tonic') dopamine changes, while fast ('phasic') dopamine fluctuations convey reward prediction errors for learning. Yet recent studies have shown that dopamine conveys motivational value and promotes movement even on subsecond timescales. Here I describe an alternative account of how dopamine regulates ongoing behavior. Dopamine release related to motivation is rapidly and locally sculpted by receptors on dopamine terminals, independently from dopamine cell firing. Target neurons abruptly switch between learning and performance modes, with striatal cholinergic interneurons providing one candidate switch mechanism. The behavioral impact of dopamine varies by subregion, but in each case dopamine provides a dynamic estimate of whether it is worth expending a limited internal resource, such as energy, attention, or time.

Limitations of the rat medial forebrain lesion model to study prefrontal cortex mediated cognitive tasks in Parkinson's disease

Parkinson's Disease (PD) is a progressive movement disorder characterized by the loss of dopaminergic neurons in the midbrain. Besides motor impairment, PD patients exhibit non-motor symptoms that negatively impact their quality of life and often manifest prior to motor deficits. One such symptom is mild cognitive impairment (PD-MCI), which is comprised of deficits in executive function such as working memory, attention, cognitive flexibility, and spatial memory. The 6-hydroxydopamine (6-OHDA) induced unilateral medial forebrain bundle (MFB) lesion animal model successfully recapitulates PD motor impairment but is also used to assess non-motor deficits. The present study utilizes a unilateral 6-OHDA induced MFB lesion rodent model to investigate prefrontal cortex (PFC)-mediated cognitive processes that are impaired in PD patients. In a test of attentional set shifting, PD rodents demonstrated deficits in simple discrimination, but not in rule reversal or extradimensional shifts. PD rodents also exhibited deficits in a temporal order memory task but had no deficits in novel/spatial object recognition or object-in-place tasks. These results reveal limitations of the 6-OHDA induced unilateral MFB lesion model to completely recapitulate PD-MCI symptoms suggesting a need for better lesion models to study PD-MCI.

To Do or Not to Do: Dopamine, Affordability and the Economics of Opportunity

Five years ago, we introduced the thrift hypothesis of dopamine (DA), suggesting that the primary role of DA in adaptive behavior is regulating behavioral energy expenditure to match the prevailing economic conditions of the environment. Here we elaborate that hypothesis with several new ideas. First, we introduce the concept of affordability, suggesting that costs must necessarily be evaluated with respect to the availability of resources to the organism, which computes a value not only for the potential reward opportunity, but also the value of resources expended. Placing both costs and benefits within the context of the larger economy in which the animal is functioning requires consideration of the different timescales against which to compute resource availability, or average reward rate. Appropriate windows of computation for tracking resources requires corresponding neural substrates that operate on these different timescales. In discussing temporal patterns of DA signaling, we focus on a neglected form of DA plasticity and adaptation, changes in the physical substrate of the DA system itself, such as up- and down-regulation of receptors or release probability. We argue that changes in the DA substrate itself fundamentally alter its computational function, which we propose mediates adaptations to longer temporal horizons and economic conditions. In developing our hypothesis, we focus on DA D2 receptors (D2R), arguing that D2R implements a form of “cost control” in response to the environmental economy, serving as the “brain’s comptroller”. We propose that the balance between the direct and indirect pathway, regulated by relative expression of D1 and D2 DA receptors, implements affordability. Finally, as we review data, we discuss limitations in current approaches that impede fully investigating the proposed hypothesis and highlight alternative, more semi-naturalistic strategies more conducive to neuroeconomic investigations on the role of DA in adaptive behavior.

Regulation of Striatal Neuron Activity by Cyclic Nucleotide Signaling and Phosphodiesterase Inhibition: Implications for the Treatment of Parkinson's Disease

Cyclic nucleotide phosphodiesterase (PDE) enzymes catalyze the hydrolysis and inactivation of cyclic nucleotides (cAMP/cGMP) in the brain. Several classes of PDE enzymes with distinct tissue distributions, cyclic nucleotide selectivity, and regulatory factors are highly expressed in brain regions subserving cognitive and motor processes known to be disrupted in neurodegenerative diseases such as Parkinson's disease (PD). Furthermore, small-molecule inhibitors of several different PDE family members alter cyclic nucleotide levels and favorably enhance motor performance and cognition in animal disease models. This chapter will explore the roles and therapeutic potential of non-selective and selective PDE inhibitors on neural processing in fronto-striatal circuits in normal animals and models of DOPA-induced dyskinesias (LIDs) associated with PD. The impact of selective PDE inhibitors and augmentation of cAMP and cGMP signaling on the membrane excitability of striatal medium-sized spiny projection neurons (MSNs) will be discussed. The effects of cyclic nucleotide signaling and PDE inhibitors on synaptic plasticity of striatonigral and striatopallidal MSNs will be also be reviewed. New data on the efficacy of PDE10A inhibitors for reversing behavioral and electrophysiological correlates of L-DOPA-induced dyskinesias in a rat model of PD will also be presented. Together, these data will highlight the potential of novel PDE inhibitors for treatment of movement disorders such as PD which are associated with abnormal corticostriatal transmission.

Interrelations between cognitive dysfunction and motor symptoms of Parkinson's disease: behavioral and neural studies

Parkinson's disease (PD) is characterized by a range of motor symptoms. Besides the cardinal symptoms (tremor, bradykinesia/akinesia, and rigidity), PD patients also show other motor deficits, including gait disturbance, speech deficits, and impaired handwriting. However, along with these key motor symptoms, PD patients also experience cognitive deficits in attention, executive function, working memory, and learning. Recent evidence suggests that these motor and cognitive deficits of PD are not completely dissociable, as aspects of cognitive dysfunction can impact motor performance in PD. In this article, we provide a review of behavioral and neural studies on the associations between motor symptoms and cognitive deficits in PD, specifically akinesia/bradykinesia, tremor, gait, handwriting, precision grip, and speech production. This review paves the way for providing a framework for understanding how treatment of cognitive dysfunction, for example cognitive rehabilitation programs, may in turn influence the motor symptoms of PD.

Down-regulation of dorsal striatal αCaMKII causes striatum-related cognitive and synaptic disorders

Alpha calcium/calmodulin dependent protein kinase II (αCaMKII) is a serine/threonine protein kinase which is expressed abundantly in dorsal striatum and is highly involved in the corticostriatal synaptic plasticity. Nevertheless, it currently remains unclear whether and how αCaMKII plays a in the striatum-related neural disorders. To address the above issue, lentivirus-mediated short hairpin RNA (shRNA) was used to silence the expression of αCaMKII gene in the dorsal striatum of mice. As a consequence of down-regulation of dorsal striatal αCaMKII expression, we observed defective motor skill learning in accelerating rotarod and response learning in water cross maze. Furthermore, impaired corticostriatal basal transmission and long-term potentiation (LTP), which correlated with the deficits in dorsal striatum-related cognition, were also detected in the αCaMKII-shRNA mice. Consistent with the above results, αCaMKII-shRNA mice exhibited a remarkable decline in GluA1-Ser831 and GluA1-Ser845 phosphorylation levels of α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid receptor (AMPAR), and a decline in the expression levels of N-methyl-d-aspartic acid receptor (NMDAR) subunits NR1, NR2A and NR2B. Taken together, αCaMKII down-regulation caused dorsal striatum-related cognitive disorders by inhibiting corticostriatal synaptic plasticity, which resulted from dysfunction of AMPARs and NMDARs. Our findings demonstrate for the first time an important role of αCaMKII in striatum-related neural disorders and provide further evidence for the proposition that corticostriatal LTP underlies aspects of dorsal striatum-related cognition.

Chronic Nicotine Mitigates Aberrant Inhibitory Motor Learning Induced by Motor Experience under Dopamine Deficiency

Although dopamine receptor antagonism has long been associated with impairments in motor performance, more recent studies have shown that dopamine D2 receptor (D2R) antagonism, paired with a motor task, not only impairs motor performance concomitant with the pharmacodynamics of the drug, but also impairs future motor performance once antagonism has been relieved. We have termed this phenomenon "aberrant motor learning" and have suggested that it may contribute to motor symptoms in movement disorders such as Parkinson's disease (PD). Here, we show that chronic nicotine (cNIC), but not acute nicotine, treatment mitigates the acquisition of D2R-antagonist-induced aberrant motor learning in mice. Although cNIC mitigates D2R-mediated aberrant motor learning, cNIC has no effect on D1R-mediated motor learning. β2-containing nicotinic receptors in dopamine neurons likely mediate the protective effect of cNIC against aberrant motor learning, because selective deletion of β2 nicotinic subunits in dopamine neurons reduced D2R-mediated aberrant motor learning. Finally, both cNIC treatment and β2 subunit deletion blunted postsynaptic responses to D2R antagonism. These results suggest that a chronic decrease in function or a downregulation of β2-containing nicotinic receptors protects the striatal network against aberrant plasticity and aberrant motor learning induced by motor experience under dopamine deficiency.

SIGNIFICANCE STATEMENT

Increasingly, aberrant plasticity and aberrant learning are recognized as contributing to the development and progression of movement disorders. Here, we show that chronic nicotine (cNIC) treatment or specific deletion of β2 nicotinic receptor subunits in dopamine neurons mitigates aberrant motor learning induced by dopamine D2 receptor (D2R) blockade in mice. Moreover, both manipulations also reduced striatal dopamine release and blunt postsynaptic responses to D2R antagonists. These results suggest that chronic downregulation of function and/or receptor expression of β2-containing nicotinic receptors alters presynaptic and postsynaptic striatal signaling to protect against aberrant motor learning. Moreover, these results suggest that cNIC treatment may alleviate motor symptoms and/or delay the deterioration of motor function in movement disorders by blocking aberrant motor learning.

Catecholaminergic challenge uncovers distinct Pavlovian and instrumental mechanisms of motivated (in)action

Catecholamines modulate the impact of motivational cues on action. Such motivational biases have been proposed to reflect cue-based, 'Pavlovian' effects. Here, we assess whether motivational biases may also arise from asymmetrical instrumental learning of active and passive responses following reward and punishment outcomes. We present a novel paradigm, allowing us to disentangle the impact of reward and punishment on instrumental learning from Pavlovian response biasing. Computational analyses showed that motivational biases reflect both Pavlovian and instrumental effects: reward and punishment cues promoted generalized (in)action in a Pavlovian manner, whereas outcomes enhanced instrumental (un)learning of chosen actions. These cue- and outcome-based biases were altered independently by the catecholamine enhancer melthylphenidate. Methylphenidate's effect varied across individuals with a putative proxy of baseline dopamine synthesis capacity, working memory span. Our study uncovers two distinct mechanisms by which motivation impacts behaviour, and helps refine current models of catecholaminergic modulation of motivated action.

Cognitive states influence dopamine-driven aberrant learning in Parkinson's disease

Individual differences in dopaminergic tone underlie tendencies to learn from reward versus punishment. These effects are well documented in Parkinson's patients, who vacillate between low and high tonic dopaminergic states as a function of medication. Yet very few studies have investigated the influence of higher-level cognitive states known to affect downstream dopaminergic learning in Parkinson's patients. A dopamine-dependent cognitive influence over learning would provide a candidate mechanism for declining cognitive integrity and motivation in Parkinson's patients. In this report we tested the influence of two high-level cognitive states (cost of conflict and value of volition) that have recently been shown to cause predictable learning biases in healthy young adults as a function of dopamine receptor subtype and dopaminergic challenge. It was hypothesized that Parkinson's patients OFF medication would have an enhanced cost of conflict and a decreased value of volition, and that these effects would be remediated or reversed ON medication. Participants included N = 28 Parkinson's disease patients who were each tested ON and OFF dopaminergic medication and 28 age- and sex-matched controls. The expected cost of conflict effect was observed in Parkinson's patients OFF versus ON medication, but only in those that were more recently diagnosed (<5 years). We found an unexpected effect in the value of volition task: medication compromised the ability to learn from difficult a-volitional (instructed) choices. This novel finding was also enhanced in recently diagnosed patients. The difference in learning biases ON versus OFF medication between these two tasks was strongly correlated, bolstering the idea that they tapped into a common underlying imbalance in dopaminergic tone that is particularly variable in earlier stage Parkinsonism. The finding that these decision biases are specific to earlier but not later stage disease may offer a chance for future studies to quantify phenotypic expressions of idiosyncratic disease progression.

Dopamine Selectively Modulates the Outcome of Learning Unnatural Action-Valence Associations

Learning the contingencies between stimulus, action, and outcomes is disrupted in disorders associated with altered dopamine (DA) function in the BG, such as Parkinson disease (PD). Although the role of DA in learning to act has been extensively investigated in PD, the role of DA in "learning to withhold" (or inhibit) action to influence outcomes is not as well understood. The current study investigated the role of DA in learning to act or to withhold action to receive rewarding, or avoid punishing outcomes, in patients with PD tested "off" and "on" dopaminergic medication (n = 19) versus healthy controls (n = 30). Participants performed a reward-based learning task that orthogonalized action and outcome valence (action-reward, inaction-reward, action-punishment, inaction-punishment). We tested whether DA would bias learning toward action, toward reward, or to particular action-outcome interactions. All participants demonstrated inherent learning biases preferring action with reward and inaction to avoid punishment, and this was unaffected by medication. Instead, DA produced a complex modulation of learning less natural action-outcome associations. "Off" DA medication, patients demonstrated impairments in learning to withhold action to gain reward, suggesting a difficulty to overcome a bias toward associating inaction with punishment avoidance. On DA medication, these patterns changed, and patients showed a reduced ability to learn to act to avoid punishment, indicating a bias toward action and reward. The current findings suggest that DA in PD has a complex influence on the formation of action-outcome associations, particularly those involving less natural linkages between action and outcome valence.

An Integrative Perspective on the Role of Dopamine in Schizophrenia

We propose that schizophrenia involves a combination of decreased phasic dopamine responses for relevant stimuli and increased spontaneous phasic dopamine release. Using insights from computational reinforcement-learning models and basic-science studies of the dopamine system, we show that each of these two disturbances contributes to a specific symptom domain and explains a large set of experimental findings associated with that domain. Reduced phasic responses for relevant stimuli help to explain negative symptoms and provide a unified explanation for the following experimental findings in schizophrenia, most of which have been shown to correlate with negative symptoms: reduced learning from rewards; blunted activation of the ventral striatum, midbrain, and other limbic regions for rewards and positive prediction errors; blunted activation of the ventral striatum during reward anticipation; blunted autonomic responding for relevant stimuli; blunted neural activation for aversive outcomes and aversive prediction errors; reduced willingness to expend effort for rewards; and psychomotor slowing. Increased spontaneous phasic dopamine release helps to explain positive symptoms and provides a unified explanation for the following experimental findings in schizophrenia, most of which have been shown to correlate with positive symptoms: aberrant learning for neutral cues (assessed with behavioral and autonomic responses), and aberrant, increased activation of the ventral striatum, midbrain, and other limbic regions for neutral cues, neutral outcomes, and neutral prediction errors. Taken together, then, these two disturbances explain many findings in schizophrenia. We review evidence supporting their co-occurrence and consider their differential implications for the treatment of positive and negative symptoms.

Engaging cognitive circuits to promote motor recovery in degenerative disorders. exercise as a learning modality

Exercise and physical activity are fundamental components of a lifestyle essential in maintaining a healthy brain. This is primarily due to the fact that the adult brain maintains a high degree of plasticity and activity is essential for homeostasis throughout life. Plasticity is not lost even in the context of a neurodegenerative disorder, but could be maladaptive thus promoting disease onset and progression. A major breakthrough in treating brain disorders such as Parkinson's disease is to drive neuroplasticity in a direction to improve motor and cognitive dysfunction. The purpose of this short review is to present the evidence from our laboratories that supports neuroplasticity as a potential therapeutic target in treating brain disorders. We consider that the enhancement of motor recovery in both animal models of dopamine depletion and in patients with Parkinson's disease is optimized when cognitive circuits are engaged; in other words, the brain is engaged in a learning modality. Therefore, we propose that to be effective in treating Parkinson's disease, physical therapy must employ both skill-based exercise (to drive specific circuits) and aerobic exercise (to drive the expression of molecules required to strengthen synaptic connections) components to select those neuronal circuits, such as the corticostriatal pathway, necessary to restore proper motor and cognitive behaviors. In the wide spectrum of different forms of exercise, learning as the fundamental modality likely links interventions used to treat patients with Parkinson's disease and may be necessary to drive beneficial neuroplasticity resulting in symptomatic improvement and possible disease modification.

DYT1 dystonia increases risk taking in humans

It has been difficult to link synaptic modification to overt behavioral changes. Rodent models of DYT1 dystonia, a motor disorder caused by a single gene mutation, demonstrate increased long-term potentiation and decreased long-term depression in corticostriatal synapses. Computationally, such asymmetric learning predicts risk taking in probabilistic tasks. Here we demonstrate abnormal risk taking in DYT1 dystonia patients, which is correlated with disease severity, thereby supporting striatal plasticity in shaping choice behavior in humans.

DOI:http://dx.doi.org/10.7554/eLife.14155.001

We learn to choose better options and avoid worse ones through trial and error, but exactly how this happens is still unclear. One idea is that we learn 'values' for options: whenever we choose an option and get more reward than originally expected (for example, if an unappetizing-looking food turns out to be very tasty), the value of that option increases. Likewise, if we get less reward than expected, the chosen option’s value decreases.

This learning process is hypothesized to work via the strengthening and weakening of connections between neurons in two parts of the brain: the cortex and the striatum. In this model, the activity of the neurons in the cortex represents the options, and the value of these options is represented by the activity of neurons in the striatum. Strengthening the connections is thought to increase the value of the stimulus, but this theory has been difficult to test.

In humans, a single genetic mutation causes a movement disorder called DYT1 dystonia, in which muscles contract involuntarily. In rodents, the same mutation causes the connections between the neurons in the cortex and the striatum to become too strong. If the theory about value learning is true, this strengthening should affect the decisions of patients that have DYT1 dystonia.

Arkadir et al. got healthy people and people with DYT1 dystonia to play a game where they had to choose between a 'sure' option and a 'risky' option. Picking the sure option guaranteed the player would receive a small amount of money, whereas the risky option gave either double this amount or nothing. The theory predicts that the double rewards should cause the patients to learn abnormally high values, which would lure them into making risky choices. Indeed, Arkadir et al. found that players with DYT1 dystonia were more likely to choose the risky option, with the people who had more severe symptoms of dystonia having a greater tendency towards taking risks.

Arkadir et al. showed that these results correspond with a model that suggests that people with DYT1 dystonia learn excessively from unexpected wins but show weakened learning after losses, causing them to over-estimate the value of risky choices. This imbalance mirrors the previous results that showed an inappropriate strengthening of the connections between neurons in rodents, and so suggests that similar changes occur in the brains of humans. Thus it appears that the changes in the strength of the connections between neurons translate into changes in behavior.

This pattern of results might also mean that the movement problems seen in people with DYT1 dystonia may be because they over-learn movements that previously led to a desired outcome and cannot sufficiently suppress movements that are no longer useful. Testing this idea will require further experiments.

DOI:http://dx.doi.org/10.7554/eLife.14155.002

The Effects of Exercise on Dopamine Neurotransmission in Parkinson's Disease: Targeting Neuroplasticity to Modulate Basal Ganglia Circuitry

Animal studies have been instrumental in providing evidence for exercise-induced neuroplasticity of corticostriatal circuits that are profoundly affected in Parkinson’s disease. Exercise has been implicated in modulating dopamine and glutamate neurotransmission, altering synaptogenesis, and increasing cerebral blood flow. In addition, recent evidence supports that the type of exercise may have regional effects on brain circuitry, with skilled exercise differentially affecting frontal-striatal related circuits to a greater degree than pure aerobic exercise. Neuroplasticity in models of dopamine depletion will be reviewed with a focus on the influence of exercise on the dorsal lateral striatum and prefrontal related circuitry underlying motor and cognitive impairment in PD. Although clearly more research is needed to address major gaps in our knowledge, we hypothesize that the potential effects of exercise on inducing neuroplasticity in a circuit specific manner may occur through synergistic mechanisms that include the coupling of an increasing neuronal metabolic demand and increased blood flow. Elucidation of these mechanisms may provide important new targets for facilitating brain repair and modifying the course of disease in PD.

The anatomy of choice: dopamine and decision-making

This paper considers goal-directed decision-making in terms of embodied or active inference. We associate bounded rationality with approximate Bayesian inference that optimizes a free energy bound on model evidence. Several constructs such as expected utility, exploration or novelty bonuses, softmax choice rules and optimism bias emerge as natural consequences of free energy minimization. Previous accounts of active inference have focused on predictive coding. In this paper, we consider variational Bayes as a scheme that the brain might use for approximate Bayesian inference. This scheme provides formal constraints on the computational anatomy of inference and action, which appear to be remarkably consistent with neuroanatomy. Active inference contextualizes optimal decision theory within embodied inference, where goals become prior beliefs. For example, expected utility theory emerges as a special case of free energy minimization, where the sensitivity or inverse temperature (associated with softmax functions and quantal response equilibria) has a unique and Bayes-optimal solution. Crucially, this sensitivity corresponds to the precision of beliefs about behaviour. The changes in precision during variational updates are remarkably reminiscent of empirical dopaminergic responses—and they may provide a new perspective on the role of dopamine in assimilating reward prediction errors to optimize decision-making.

Striatal D1 and D2 signaling differentially predict learning from positive and negative outcomes

The extent to which we learn from positive and negative outcomes of decisions is modulated by the neurotransmitter dopamine. Dopamine neurons burst fire in response to unexpected rewards and pause following negative outcomes. This dual signaling mechanism is hypothesized to drive both approach and avoidance behavior. Here we test a prediction deriving from a computational reinforcement learning model, in which approach is mediated via activation of the direct cortico-striatal pathway due to striatal D1 receptor stimulation, while avoidance occurs via disinhibition of indirect pathway striatal neurons secondary to a reduction of D2 receptor stimulation. Using positron emission tomography with two separate radioligands, we demonstrate that individual differences in human approach and avoidance learning are predicted by variability in striatal D1 and D2 receptor binding, respectively. Moreover, transient dopamine precursor depletion improved learning from negative outcomes. These findings support a bidirectional modulatory role for striatal dopamine in reward and avoidance learning via segregated D1 and D2 cortico-striatal pathways.

Cerebrospinal fluid synaptic proteins as useful biomarkers in tyrosine hydroxylase deficiency

Tyrosine hydroxylase (TH) deficiency is an inborn error of dopamine biosynthesis and a cause of early parkinsonism. Two clinical phenotypes have been described. Type "B": early onset severe encephalopathy; type "A": later onset, less severe and better response to L-dopa. We aimed to study the expression of several key dopaminergic and gabaergic synaptic proteins in the cerebrospinal fluid (CSF) of a series of patients with TH deficiency and their possible relation with the clinical phenotype and response to L-DOPA. Dopamine transporter (DAT), D2-receptor and vesicular monoamine transporter (VMAT2) were measured in the CSF of 10 subjects with TH deficiency by Western blot analysis. In 3 patients, data of pre- and post-treatment with L-DOPA were available, and in one of them, GABA vesicular transporter was determined. Results were compared to an age-matched control population. The concentration of D2-receptors in CSF was significantly higher in patients with TH deficiency than in controls. Similarly, DAT and vesicular monoamine transporter type 2 were up-regulated. Studies performed before L-DOPA, and on L-DOPA therapy showed a paradoxical response with D2 receptor expression increase as L-Dopa doses and homovanillic concentration gradually raised in a B phenotype patient. The opposite results were found in two patients with A phenotype. However, this is a very small sample, and further studies are needed to conclude robust differences between phenotypes. Synaptic proteins are detectable in the CSF and their quantification can be useful for understanding the pathophysiology of neurotransmitter defects and potentially to adjust and personalize treatments in the future.