Effects of levodopa on stimulus-response learning versus response selection in healthy young adults

Dopamine Increases Accuracy and Lengthens Deliberation Time in Explicit Motor Skill Learning

Although animal research implicates a central role for dopamine in motor skill learning, a direct causal link has yet to be established in neurotypical humans. Here, we tested if a pharmacological manipulation of dopamine alters motor learning, using a paradigm which engaged explicit, goal-directed strategies. Participants (27 females; 11 males; aged 18-29 years) first consumed either 100 mg of levodopa (n = 19), a dopamine precursor that increases dopamine availability, or placebo (n = 19). Then, during training, participants learnt the explicit strategy of aiming away from presented targets by instructed angles of varying sizes. Targets jumped mid-movement by the instructed aiming angle. Task success was thus contingent upon aiming accuracy and not speed. The effect of the dopamine manipulations on skill learning was assessed during training and after an overnight follow-up. Increasing dopamine availability at training improved aiming accuracy and lengthened reaction times, particularly for larger, more difficult aiming angles, both at training and, importantly, at follow-up, despite prominent session-by-session performance improvements in both accuracy and speed. Exogenous dopamine thus seems to result in a learnt, persistent propensity to better adhere to task goals. Results support the proposal that dopamine is important in engagement of instrumental motivation to optimize adherence to task goals, particularly when learning to execute goal-directed strategies in motor skill learning.

NMDA receptor-related mechanisms of dopaminergic modulation of tDCS-induced neuroplasticity

Dopamine is a key neuromodulator of neuroplasticity and an important neuronal substrate of learning, and memory formation, which critically involves glutamatergic N-methyl-D-aspartate (NMDA) receptors. Dopamine modulates NMDA receptor activity via dopamine D1 and D2 receptor subtypes. It is hypothesized that dopamine focuses on long-term potentiation (LTP)-like plasticity, i.e. reduces diffuse widespread but enhances locally restricted plasticity via a D2 receptor-dependent NMDA receptor activity reduction. Here, we explored NMDA receptor-dependent mechanisms underlying dopaminergic modulation of LTP-like plasticity induced by transcranial direct current stimulation (tDCS). Eleven healthy, right-handed volunteers received anodal tDCS (1 mA, 13 min) over the left motor cortex combined with dopaminergic agents (the D2 receptor agonist bromocriptine, levodopa for general dopamine enhancement, or placebo) and the partial NMDA receptor agonist D-cycloserine (dosages of 50, 100, and 200 mg, or placebo). Cortical excitability was monitored by transcranial magnetic stimulation-induced motor-evoked potentials. We found that LTP-like plasticity was abolished or converted into LTD-like plasticity via dopaminergic activation, but reestablished under medium-dose D-cycloserine. These results suggest that diffuse LTP-like plasticity is counteracted upon via D2 receptor-dependent reduction of NMDA receptor activity.

Impaired Formation and Expression of Goal-Directed and Habitual Control in Parkinson's Disease

Selective depletion of dopaminergic neurotransmission in the caudal sensorimotor striatum, a subdivision implicated in habitual control, is a major pathological feature in Parkinson’s disease (PD). Here, we evaluated the effects of PD on the formation of goal-directed and habitual control during learning, and for the first time investigated the conflict between these two strategies in the expression of acquired learning. Twenty PD patients and 20 healthy individuals participated in a set of tasks designed to assess relative goal-directed versus habitual behavioral control. In the instrumental training phase, participants first learned by trial and error to respond to different pictured stimuli in order to gain rewarding outcomes. Three associations were trained, with standard and congruent associations mediated predominantly by goal-directed action, and incongruent association regulated predominantly by habitual control. In a subsequent “slips-of-action” test, participants were assessed to determine whether they can flexibly adjust their behavior to changes in the desirability of the outcomes. A baseline test was then administered to rule out the possibility of general inhibitory deficit, and a questionnaire was finally adopted to test the explicit knowledge of the relationships between stimuli, responses, and outcomes. Our results showed that during the instrumental training phase, PD patients had impaired learning not only of the standard and congruent associations (mediated by goal-directed system), but also the incongruent association (mediated by habitual control system). In the slips-of-action test, PD patients responded less for valuable outcomes and more often to stimuli that were associated with devalued outcomes, with poor performance predicted by symptom severity. No significant difference was found between PD and healthy subjects for the baseline test and questionnaire performance. These results collectively demonstrate that the formation of both goal-directed and habitual control are impaired in PD patients. Furthermore, PD patients are more prone to slips of action, suggesting PD patients exhibit an impairment in engaging the goal-directed system with a relatively excessive reliance on habitual control in the expression of acquired learning.

Null effects of levodopa on reward- and error-based motor adaptation, savings, and anterograde interference

Dopamine signaling is thought to mediate reward-based learning. We tested for a role of dopamine in motor adaptation by administering the dopamine precursor levodopa to healthy participants in two experiments involving reaching movements. Levodopa has been shown to impair reward-based learning in cognitive tasks. Thus, we hypothesized that levodopa would selectively impair aspects of motor adaptation that depend on the reinforcement of rewarding actions. In the first experiment, participants performed two separate tasks in which adaptation was driven either by visual error-based feedback of the hand position or binary reward feedback. We used EEG to measure event-related potentials evoked by task feedback. We hypothesized that levodopa would specifically diminish adaptation and the neural responses to feedback in the reward learning task. However, levodopa did not affect motor adaptation in either task nor did it diminish event-related potentials elicited by reward outcomes. In the second experiment, participants learned to compensate for mechanical force field perturbations applied to the hand during reaching. Previous exposure to a particular force field can result in savings during subsequent adaptation to the same force field or interference during adaptation to an opposite force field. We hypothesized that levodopa would diminish savings and anterograde interference, as previous work suggests that these phenomena result from a reinforcement learning process. However, we found no reliable effects of levodopa. These results suggest that reward-based motor adaptation, savings, and interference may not depend on the same dopaminergic mechanisms that have been shown to be disrupted by levodopa during various cognitive tasks.NEW & NOTEWORTHY Motor adaptation relies on multiple processes including reinforcement of successful actions. Cognitive reinforcement learning is impaired by levodopa-induced disruption of dopamine function. We administered levodopa to healthy adults who participated in multiple motor adaptation tasks. We found no effects of levodopa on any component of motor adaptation. This suggests that motor adaptation may not depend on the same dopaminergic mechanisms as cognitive forms or reinforcement learning that have been shown to be impaired by levodopa.

Neurophysiological correlates of dual tasking in people with Parkinson's disease and freezing of gait

Freezing of gait in people with Parkinson's disease (PwP) is associated with executive dysfunction and motor preparation deficits. We have recently shown that electrophysiological markers of motor preparation, rather than decision-making, differentiate PwP with freezing of gait (FOG +) and without (FOG -) while sitting. To examine the effect of locomotion on these results, we measured behavioural and electrophysiological responses in PwP with and without FOG during a target response time task while sitting (single-task) and stepping-in-place (dual-task). Behavioural and electroencephalographic data were acquired from 18 PwP (eight FOG +) and seven young controls performing the task while sitting and stepping-in-place. FOG + had slower response times while stepping compared with sitting. However, response times were significantly faster while stepping compared with sitting for controls. Electrophysiological responses showed no difference in decision-making potentials (centroparietal positivity) between groups or conditions but there were differences in neurophysiological markers of response inhibition (N2) and motor preparation (lateralized readiness potential, LRP) in FOG + while performing a dual-task. This suggests that the addition of a second complex motor task (stepping-in-place) impacts automatic allocation of resources in FOG +, resulting in delayed response times. The impact of locomotion on the generation of the N2 and LRP potentials, particularly in freezers, indirectly implies that these functions compete with locomotion for resources. In the setting of multiple complex tasks or cognitive impairment, severe motor dysfunction may result, leading to freezing of gait.

Accelerated habitual learning resulting from L-dopa exposure in rats is prevented by N-acetylcysteine

Instrumental actions are initially goal-directed and driven by their associated outcome. However, with repeated experience habitual actions develop which are automated and efficient, as they are instead driven by antecedent stimuli. Dopamine is thought to facilitate the transition from goal-directed to habitual actions. This idea has been largely derived from evidence that psychostimulants accelerate the development of habitual actions. In the current study, we examined the impact of L-dopa (levodopa or L-dihydroxyphenylalanine), which also potentiates dopamine activity, on habitual learning. L-dopa was systemically administered prior to training rats to press a lever for a food outcome. When tested, L-dopa exposed animals were insensitive to changes in the value of the food outcome, and hence demonstrated accelerated habitual behavioral control compared to control animals that remained goal directed. We also showed that when N-acetylcysteine (NAC), an antioxidant and regulator of glutamate activity, was co-administered with L-dopa, it prevented the transition to habitual behavior; an effect demonstrated previously for cocaine. Therefore, this study establishes similarities between L-dopa and psychostimulants in both the development and prevention of habitual actions, and supports the notion that excess dopamine potentiates habitual learning. This finding extends the limited existing knowledge of the impact of L-dopa on learning and behavior, and has implications for neurological disorders where L-dopa is the primary treatment.

Decreased transfer of value to action in Tourette syndrome

OBJECTIVE

Tourette syndrome is a neurodevelopmental disorder putatively associated with a hyperdopaminergic state. Therefore, it seems plausible that excessive dopamine transmission in Tourette syndrome alters the ability to learn based on rewards and punishments. We tested whether Tourette syndrome patients exhibited altered reinforcement learning and corresponding feedback-related EEG deflections.

METHODS

We used a reinforcement learning task providing factual and counterfactual feedback in a sample of 15 Tourette syndrome patients and matched healthy controls whilst recording EEG. The paradigm presented various reward probabilities to enforce adaptive adjustments. We employed a computational model to derive estimates of the prediction error, which we used for single-trial regression analysis of the EEG data.

RESULTS

We found that Tourette syndrome patients showed increased choice stochasticity compared to controls. The feedback-related negativity represented an axiomatic prediction error for factual feedback and did not differ between groups. We observed attenuated P3a modulation specifically for factual feedback in Tourette syndrome patients, representing impaired coding of attention allocation.

CONCLUSION

Our findings indicate that cortical prediction error coding is unaffected by Tourette syndrome. Nonetheless, the transfer of learned values into choice formation is degraded, in line with a hyperdopaminergic state.

The effect of aging, Parkinson's disease, and exogenous dopamine on the neural response associated with auditory regularity processing

Processing regular patterns in auditory scenes is important for navigating complex environments. Electroencephalography studies find enhancement of sustained brain activity, correlating with the emergence of a regular pattern in sounds. How aging, aging-related diseases such as Parkinson's disease (PD), and treatment of PD with dopaminergic therapy affect this fundamental function remain unknown. We addressed this knowledge gap. Healthy younger and older adults and patients with PD listened to sounds that contained or were devoid of regular patterns. Healthy older adults and patients with PD were tested twice-off and on dopaminergic medication, in counterbalanced order. Regularity-evoked, sustained electroencephalography activity was reduced in older, compared with younger adults. Patients with PD and older controls evidenced comparable attenuation of the sustained response. Dopaminergic therapy further weakened the sustained response in both older controls and patients with PD. These findings suggest that fundamental regularity processing is impacted by aging but not specifically by PD. The finding that dopaminergic therapy attenuates rather than improves the sustained response coheres with the dopamine overdose response and is in line with previous findings that regularity processing implicates brain regions receiving dopamine from the ventral tegmental area that is relatively spared in PD and normal aging.

Levodopa does not affect expression of reinforcement learning in older adults

Dopamine has been implicated in learning from rewards and punishment, and in the expression of this learning. However, many studies do not fully separate retrieval and decision mechanisms from learning and consolidation. Here, we investigated the effects of levodopa (dopamine precursor) on choice performance (isolated from learning or consolidation). We gave 31 healthy older adults 150 mg of levodopa or placebo (double-blinded, randomised) 1 hour before testing them on stimuli they had learned the value of the previous day. We found that levodopa did not affect the overall accuracy of choices, nor the relative expression of positively or negatively reinforced values. This contradicts several studies and suggests that overall dopamine levels may not play a role in the choice performance for values learned through reinforcement learning in older adults.

Independent effects of age and levodopa on reversal learning in healthy volunteers

The dopamine overdose hypothesis has provided an important theoretical framework for understanding cognition in Parkinson's disease. It posits that effects of dopaminergic therapy on cognition in Parkinson's disease depend on baseline dopamine levels in brain regions that support different functions. Although functions performed by more severely dopamine-depleted brain regions improve with medication, those associated with less dopamine deficient areas are actually worsened. It is presumed that medication-related worsening of cognition owes to dopamine overdose. We investigated whether age-related changes in baseline dopamine levels would modulate effects of dopaminergic therapy on reward learning in healthy volunteers. In a double-blind, crossover design, healthy younger and older adults completed a probabilistic reversal learning task after treatment with 100/25 mg of levodopa/carbidopa versus placebo. Older adults learned more poorly than younger adults at baseline, being more likely to shift responses after misleading punishment. Levodopa worsened stimulus-reward learning relative to placebo to the same extent in both groups, irrespective of differences in baseline performance and expected dopamine levels. When order effects were eliminated, levodopa induced response shifts after reward more often than placebo. Our results reveal independent deleterious effects of age group and exogenous dopamine on reward learning, suggesting a more complex scenario than predicted by the dopamine overdose hypothesis.

Dopaminergic Therapy Increases Go Timeouts in the Go/No-Go Task in Patients with Parkinson's Disease

Parkinson's disease (PD) is characterized by resting tremor, rigidity and bradykinesia. Dopaminergic medications such as L-dopa treat these motor symptoms, but can have complex effects on cognition. Impulse control is an essential cognitive function. Impulsivity is multifaceted in nature. Motor impulsivity involves the inability to withhold pre-potent, automatic, erroneous responses. In contrast, cognitive impulsivity refers to improper risk-reward assessment guiding behavior. Informed by our previous research, we anticipated that dopaminergic therapy would decrease motor impulsivity though it is well known to enhance cognitive impulsivity. We employed the Go/No-go paradigm to assess motor impulsivity in PD. Patients with PD were tested using a Go/No-go task on and off their normal dopaminergic medication. Participants completed cognitive, mood, and physiological measures. PD patients on medication had a significantly higher proportion of Go trial Timeouts (i.e., trials in which Go responses were not completed prior to a deadline of 750 ms) compared to off medication (p = 0.01). No significant ON-OFF differences were found for Go trial or No-go trial response times (RTs), or for number of No-go errors. We interpret that dopaminergic therapy induces a more conservative response set, reflected in Go trial Timeouts in PD patients. In this way, dopaminergic therapy decreased motor impulsivity in PD patients. This is in contrast to the widely recognized effects of dopaminergic therapy on cognitive impulsivity leading in some patients to impulse control disorders. Understanding the nuanced effects of dopaminergic treatment in PD on cognitive functions such as impulse control will clarify therapeutic decisions.