Independent effects of age and levodopa on reversal learning in healthy volunteers

Assessing the influence of dopamine and mindfulness on the formation of routines in visual search

Given experience in cluttered but stable visual environments, our eye-movements form stereotyped routines that sample task-relevant locations, while not mixing-up routines between similar task-settings. Both dopamine signaling and mindfulness have been posited as factors that influence the formation of such routines, yet quantification of their impact remains to be tested in healthy humans. Over two sessions, participants searched through grids of doors to find hidden targets, using a gaze-contingent display. Within each session, door scenes appeared in either one of two colors, with each color signaling a differing set of likely target locations. We derived measures for how well target locations were learned (target-accuracy), how routine were sets of eye-movements (stereotypy), and the extent of interference between the two scenes (setting-accuracy). Participants completed two sessions, where they were administered either levodopa (dopamine precursor) or placebo (vitamin C), under double-blind counterbalanced conditions. Dopamine and trait mindfulness (assessed by questionnaire) interacted to influence both target-accuracy and stereotypy. Increasing dopamine improved accuracy and reduced stereotypy for high mindfulness scorers, but induced the opposite pattern for low mindfulness scorers. Dopamine also disrupted setting-accuracy invariant to mindfulness. Our findings show that mindfulness modulates the impact of dopamine on the target-accuracy and stereotypy of eye-movement routines, whereas increasing dopamine promotes interference between task-settings, regardless of mindfulness. These findings provide a link between non-human and human models regarding the influence of dopamine on the formation of task-relevant eye-movement routines and provide novel insights into behavior-trait factors that modulate the use of experience when building adaptive repertoires.

L-DOPA and oxytocin influence the neural correlates of performance monitoring for self and others

RATIONALE

The ability to monitor the consequences of our actions for others is imperative for flexible and adaptive behavior, and allows us to act in a (pro)social manner. Yet, little is known about the neurochemical mechanisms underlying alterations in (pro)social performance monitoring.

OBJECTIVE

The aim of this functional magnetic resonance imaging (fMRI) study was to improve our understanding of the role of dopamine and oxytocin and their potential overlap in the neural mechanisms underlying performance monitoring for own versus others' outcomes.

METHOD

Using a double-blind placebo-controlled cross-over design, 30 healthy male volunteers were administered oxytocin (24 international units), the dopamine precursor L-DOPA (100 mg + 25 mg carbidopa), or placebo in three sessions. Participants performed a computerized cannon shooting game in two recipient conditions where mistakes resulted in negative monetary consequences for (1) oneself or (2) an anonymous other participant.

RESULTS

Results indicated reduced error-correct differentiation in the ventral striatum after L-DOPA compared to placebo, independent of recipient. Hence, pharmacological manipulation of dopamine via L-DOPA modulated performance-monitoring activity in a brain region associated with reward prediction and processing in a domain-general manner. In contrast, oxytocin modulated the BOLD response in a recipient-specific manner, such that it specifically enhanced activity for errors that affected the other in the pregenual anterior cingulate cortex (pgACC), a region previously implicated in the processing of social rewards and prediction errors. Behaviorally, we also found reduced target sizes-indicative of better performance-after oxytocin, regardless of recipient. Moreover, after oxytocin lower target sizes specifically predicted higher pgACC activity when performing for others.

CONCLUSIONS

These different behavioral and neural patterns after oxytocin compared to L-DOPA administration highlight a divergent role of each neurochemical in modulating the neural mechanisms underlying social performance monitoring.

l-DOPA and oxytocin influence the neurocomputational mechanisms of self-benefitting and prosocial reinforcement learning

Humans learn through reinforcement, particularly when outcomes are unexpected. Recent research suggests similar mechanisms drive how we learn to benefit other people, that is, how we learn to be prosocial. Yet the neurochemical mechanisms underlying such prosocial computations remain poorly understood. Here, we investigated whether pharmacological manipulation of oxytocin and dopamine influence the neurocomputational mechanisms underlying self-benefitting and prosocial reinforcement learning. Using a double-blind placebo-controlled cross-over design, we administered intranasal oxytocin (24 IU), dopamine precursor l-DOPA (100 mg + 25 mg carbidopa), or placebo over three sessions. Participants performed a probabilistic reinforcement learning task with potential rewards for themselves, another participant, or no one, during functional magnetic resonance imaging. Computational models of reinforcement learning were used to calculate prediction errors (PEs) and learning rates. Participants behavior was best explained by a model with different learning rates for each recipient, but these were unaffected by either drug. On the neural level, however, both drugs blunted PE signaling in the ventral striatum and led to negative signaling of PEs in the anterior mid-cingulate cortex, dorsolateral prefrontal cortex, inferior parietal gyrus, and precentral gyrus, compared to placebo, and regardless of recipient. Oxytocin (versus placebo) administration was additionally associated with opposing tracking of self-benefitting versus prosocial PEs in dorsal anterior cingulate cortex, insula and superior temporal gyrus. These findings suggest that both l-DOPA and oxytocin induce a context-independent shift from positive towards negative tracking of PEs during learning. Moreover, oxytocin may have opposing effects on PE signaling when learning to benefit oneself versus another.

Development of cross-species translational paradigms for psychiatric research in the Research Domain Criteria era

The past 30 years of IBNS has included research attempting to treat the cognitive and behavioral deficits observed in people with psychiatric conditions. Early work utilized drugs identified from tests thought to be cognition-relevant, however the high failure rate crossing the translational-species barrier led to focus on developing valid cross-species translational tests. The face, predictive, and neurobiological validities used to assess animal models of psychiatry can be used to validate these tests. Clinical sensitivity is another important aspect however, for if the clinical population targeted for treatment does not exhibit task deficits, then why develop treatments? This review covers some work validating cross-species translational tests and suggests future directions. Also covered is the contribution IBNS made to fostering such research and my role in IBNS, making it more available to all including fostering mentor/mentee programs plus spearheading diversity and inclusivity initiatives. All science needs support and IBNS has supported research recreating the behavioral abnormalities that define psychiatric conditions with the aim to improve the lives of people with such conditions.

Exploring the effects of dopamine on sensorimotor inhibition and mobility in older adults

Dopaminergic activity decreases in older adults (OAs) with normal aging and is further reduced in Parkinson's disease (PD), affecting cortical motor and sensorimotor pathways. Levodopa is the prevailing therapy to counter dopamine loss in PD, though not all PD motor signs improve with levodopa. The purpose of this preliminary study was to explore the effects of levodopa on sensorimotor inhibition, gait and quiet standing in OAs and to investigate the relationships between sensorimotor inhibition and both gait and standing balance both OFF- and ON-levodopa. Fifteen OA males completed a gait, balance and sensorimotor assessments before and 1 h after they were given a 100 mg dose of levodopa. Short-latency afferent inhibition quantified sensorimotor inhibition. Wearable sensors characterized gait (two-minute walk) and standing balance (1-min stance). No sensorimotor inhibition, gait, or standing balance measures changed from OFF- to ON-levodopa. When OFF-levodopa, worse inhibition significantly related to increased double stance (r = 0.62; p = 0.01), increased jerkiness of sway (r = 0.57; p = 0.03) and sway area (r = 0.58; p = 0.02). While ON-levodopa, worse inhibition related to increased arm swing range of motion (r = 0.63; p = 0.01) and jerkiness of sway (r = 0.53; p = 0.04). The relationship between SAI and arm swing excursion significantly changed from OFF- to ON-levodopa (z = - 3.05; p = 0.002; 95% confidence interval = - 0.95, - 0.21). Sensorimotor inhibition relationships to both gait and balance may be affected by dopamine in OAs. Cortical restructuring due to the loss of dopamine may be responsible for the heterogeneity of levodopa effect in people with PD and OAs.

Anxiety predicts impulsive-compulsive behaviours in Parkinson's disease: Clinical relevance and theoretical implications

Patients with Parkinson's disease (PD) often present symptoms of anxiety, depression and apathy. These negative affect manifestations have been recently associated with the presence of impulsive compulsive behaviours (ICBs). However, their relation with the use of dopamine replacement therapy (DRT), a renewed risk factor for ICBs, is still not fully understood. Elucidating the role of these different ICBs predictors in PD could inform both prevention/intervention recommendations as well as theoretical models. In the present study, we have analysed data collected in 417 PD patients, 50 patients with Parkinsonian symptoms but with scan without evidence of dopaminergic deficit (SWEDD), and 185 healthy controls (HC). We examined each patient's clinical profile over a two-year time window, investigating the role of both negative affect and DRT on ICBs. Results confirmed the presence of higher levels of anxiety in both the clinical groups, and of higher level of ICBs in SWEDD patients, respect to both PD and HC. Mixed model analyses revealed a statistically significant association between anxiety and ICBs in the SWEDD patients who did not take any DRT. Findings suggest the independence between anxiety and DRT in ICBs development, and provide new evidence for the motivational opponency theoretical framework.

Age at Parkinson's disease onset modulates the effect of levodopa on response inhibition: Support for the dopamine overdose hypothesis from the antisaccade task

The antisaccade task is an established eye-tracking paradigm to explore response inhibition. While many studies showed that antisaccade performance is impaired in Parkinson's disease (PD), the effect of dopaminergic medication is still an area of debate. According to the dopamine overdose hypothesis, intrinsic basal dopamine levels in ventral parts of the striatum determine whether levodopa intake has beneficial or detrimental effects on dopamine-dependent cognitive tasks. The objective of this study was therefore to explore the effect of several disease-related factors on changes in antisaccade performance after levodopa intake in PD. Thirty-five individuals with PD (and 30 healthy controls) performed antisaccades in OFF and ON medication state. Multiple linear regressions were calculated to predict the change in antisaccade latency, directive errors and express saccade rate based on age at PD onset, disease duration, levodopa-equivalent daily dose, motor symptom severity and executive functions. Levodopa intake did not alter antisaccade performance on a group level. However, the effect of levodopa was differentially modulated by age at PD onset and motor symptom severity. Earlier disease onset and milder motor symptoms in OFF medication state were associated with reduced response inhibition capacity after levodopa intake measured as increased express saccade and error rates. Our results indicate that levodopa may have opposing effects on oculomotor response inhibition dependent on the age at PD onset and motor disease severity. Assuming less dopaminergic loss in ventral parts of the striatum in early compared to late onset PD, these findings support the dopamine overdose hypothesis.

Neural regions associated with gain-loss frequency and average reward in older and younger adults

Research on the biological basis of reinforcement-learning has focused on how brain regions track expected value based on average reward. However, recent work suggests that humans are more attuned to reward frequency. Furthermore, older adults are less likely to use expected values to guide choice than younger adults. This raises the question of whether brain regions assumed to be sensitive to average reward, like the medial and lateral PFC, also track reward frequency, and whether there are age-based differences. Older (60-81 years) and younger (18-30 years) adults performed the Soochow Gambling task, which separates reward frequency from average reward, while undergoing fMRI. Overall, participants preferred options that provided negative net payoffs, but frequent gains. Older adults improved less over time, were more reactive to recent negative outcomes, and showed greater frequency-related activation in several regions, including DLPFC. We also found broader recruitment of prefrontal and parietal regions associated with frequency value and reward prediction errors in older adults, which may indicate compensation. The results suggest greater reliance on average reward for younger adults than older adults.

Decision making in Parkinson's disease: An analysis of the studies using the Iowa Gambling Task

In Parkinson's disease (PD) impairments in decision making can occur, in particular because of the tendency toward risky and rewarding options. The Iowa Gambling Task has been widely used to investigate decision processes involving these options. The task assesses the ability to manage risk and to learn from feedback. The present paper aims at critically examining those studies in which this task has been administered to PD patients, in order to understand possible anomalies in patients' decision processes and which variables are responsible for that. A meta‐analysis has been conducted as well. Features of the task, sociodemographic and clinical aspects (including daily drugs intake), cognitive conditions and emotional disorders of the patients have been taken into account. Neural correlates of decision‐making competences were considered. It emerged that PD patients show a trend of preference toward risky choices, probably due to an impairment in anticipating the unrewarding consequences or to an insensitiveness to punishment. The possible role played by dopamine medications in decision making under uncertain conditions, affecting basal ganglia and structures involved in the limbic loop, was discussed. Attention has been focused on some aspects that need to be investigated in further research, in order to delve into this issue and promote patients' quality of life.

Null effects of levodopa on reward- and error-based motor adaptation, savings, and anterograde interference

Dopamine signaling is thought to mediate reward-based learning. We tested for a role of dopamine in motor adaptation by administering the dopamine precursor levodopa to healthy participants in two experiments involving reaching movements. Levodopa has been shown to impair reward-based learning in cognitive tasks. Thus, we hypothesized that levodopa would selectively impair aspects of motor adaptation that depend on the reinforcement of rewarding actions. In the first experiment, participants performed two separate tasks in which adaptation was driven either by visual error-based feedback of the hand position or binary reward feedback. We used EEG to measure event-related potentials evoked by task feedback. We hypothesized that levodopa would specifically diminish adaptation and the neural responses to feedback in the reward learning task. However, levodopa did not affect motor adaptation in either task nor did it diminish event-related potentials elicited by reward outcomes. In the second experiment, participants learned to compensate for mechanical force field perturbations applied to the hand during reaching. Previous exposure to a particular force field can result in savings during subsequent adaptation to the same force field or interference during adaptation to an opposite force field. We hypothesized that levodopa would diminish savings and anterograde interference, as previous work suggests that these phenomena result from a reinforcement learning process. However, we found no reliable effects of levodopa. These results suggest that reward-based motor adaptation, savings, and interference may not depend on the same dopaminergic mechanisms that have been shown to be disrupted by levodopa during various cognitive tasks.NEW & NOTEWORTHY Motor adaptation relies on multiple processes including reinforcement of successful actions. Cognitive reinforcement learning is impaired by levodopa-induced disruption of dopamine function. We administered levodopa to healthy adults who participated in multiple motor adaptation tasks. We found no effects of levodopa on any component of motor adaptation. This suggests that motor adaptation may not depend on the same dopaminergic mechanisms as cognitive forms or reinforcement learning that have been shown to be impaired by levodopa.

Dopaminergic therapy and prefrontal activation during walking in individuals with Parkinson's disease: does the levodopa overdose hypothesis extend to gait?

The "levodopa-overdose hypothesis" posits that dopaminergic replacement therapy (1) increases performance on tasks that depend on the nigrostriatal-pathway (e.g., motor-control circuits), yet (2) decreases performance on tasks that depend upon the mesocorticolimbic-pathway (e.g., prefrontal cortex, PFC). Previous work in Parkinson's disease (PD) investigated this model while focusing on cognitive function. Here, we evaluated whether this model applies to gait in patients with PD and freezing of gait (FOG). Forty participants were examined in both the OFF anti-Parkinsonian medication state (hypo-dopaminergic) and ON state (hyper-dopaminergic) while walking with and without the concurrent performance of a serial subtraction task. Wireless functional near-infrared spectroscopy measured PFC activation during walking. Consistent with the "overdose-hypothesis", performance on the subtraction task decreased (p = 0.027) after dopamine intake. Moreover, the effect of walking condition on PFC activation depended on the dopaminergic state (i.e., interaction effect p = 0.001). Gait significantly improved after levodopa administration (p < 0.001). Nonetheless, PFC activation was higher (p = 0.013) in this state than in the OFF state during usual-walking. This increase in PFC activation in the ON state suggests that dopamine treatment interfered with PFC functioning. Otherwise, PFC activation, putatively a reflection of cognitive compensation, should have decreased. Moreover, in contrast to the OFF state, in the ON state, PFC activation failed to increase (p = 0.313) during dual-tasking, perhaps due to a "ceiling effect". These findings extend the "levodopa-overdose hypothesis" and suggest that it also applies to gait in PD patients. While dopaminergic therapy improves certain aspects of motor performance, optimal treatment should consider the "double-edged sword" of levodopa.

Effects of daily L-dopa administration on learning and brain structure in older adults undergoing cognitive training: a randomised clinical trial

Cognitive aging creates major individual and societal burden, motivating search for treatment and preventive care strategies. Behavioural interventions can improve cognitive performance in older age, but effects are small. Basic research has implicated dopaminergic signalling in plasticity. We investigated whether supplementation with the dopamine-precursor L-dopa improves effects of cognitive training on performance. Sixty-three participants for this randomised, parallel-group, double-blind, placebo-controlled trial were recruited via newspaper advertisements. Inclusion criteria were: age of 65–75 years, Mini-Mental State Examination score >25, absence of serious medical conditions. Eligible subjects were randomly allocated to either receive 100/25 mg L-dopa/benserazide (n = 32) or placebo (n = 31) prior to each of twenty cognitive training sessions administered during a four-week period. Participants and staff were blinded to group assignment. Primary outcomes were latent variables of spatial and verbal fluid intelligence. Compared to the placebo group, subjects receiving L-dopa improved less in spatial intelligence (−0.267 SDs; 95%CI [−0.498, −0.036]; p = 0.024). Change in verbal intelligence did not significantly differ between the groups (−0.081 SDs, 95%CI [−0.242, 0.080]; p = 0.323). Subjects receiving L-dopa also progressed slower through the training and the groups displayed differential volumetric changes in the midbrain. No statistically significant differences were found for the secondary cognitive outcomes. Adverse events occurred for 10 (31%) and 7 (23%) participants in the active and control groups, correspondingly. The results speak against early pharmacological interventions in older healthy adults to improve broader cognitive functions by targeting the dopaminergic system and provide no support for learning-enhancing properties of L-dopa supplements in the healthy elderly. The findings warrant closer investigation about the cognitive effects of early dopamine-replacement therapy in neurological disorders. This trial was preregistered at the European Clinical Trial Registry, EudraCT#2016-000891-54 (2016-10-05).

The effect of aging, Parkinson's disease, and exogenous dopamine on the neural response associated with auditory regularity processing

Processing regular patterns in auditory scenes is important for navigating complex environments. Electroencephalography studies find enhancement of sustained brain activity, correlating with the emergence of a regular pattern in sounds. How aging, aging-related diseases such as Parkinson's disease (PD), and treatment of PD with dopaminergic therapy affect this fundamental function remain unknown. We addressed this knowledge gap. Healthy younger and older adults and patients with PD listened to sounds that contained or were devoid of regular patterns. Healthy older adults and patients with PD were tested twice-off and on dopaminergic medication, in counterbalanced order. Regularity-evoked, sustained electroencephalography activity was reduced in older, compared with younger adults. Patients with PD and older controls evidenced comparable attenuation of the sustained response. Dopaminergic therapy further weakened the sustained response in both older controls and patients with PD. These findings suggest that fundamental regularity processing is impacted by aging but not specifically by PD. The finding that dopaminergic therapy attenuates rather than improves the sustained response coheres with the dopamine overdose response and is in line with previous findings that regularity processing implicates brain regions receiving dopamine from the ventral tegmental area that is relatively spared in PD and normal aging.

Dorsal striatum does not mediate feedback-based, stimulus-response learning: An event-related fMRI study in patients with Parkinson's disease tested on and off dopaminergic therapy

Learning associations between stimuli and responses is essential to everyday life. Dorsal striatum (DS) has long been implicated in stimulus-response learning, though recent results challenge this contention. We have proposed that discrepant findings arise because stimulus-response learning methodology generally confounds learning and response selection processes. In 19 patients with Parkinson's disease (PD) and 18 age-matched controls, we found that dopaminergic therapy decreased the efficiency of stimulus-response learning, with corresponding attenuation of ventral striatum (VS) activation. In contrast, exogenous dopamine improved response selection accuracy related to enhanced DS BOLD signal. Contrasts between PD patients and controls fully support these within-subject patterns. These double dissociations in terms of behaviour and neural activity related to VS and DS in PD and in response to dopaminergic therapy, strongly refute the view that DS mediates stimulus-response learning through feedback. Our findings integrate with a growing literature favouring a role for DS in decision making rather than learning, and unite two literature that have been evolving independently.