Striatal dopamine dissociates methylphenidate effects on value-based versus surprise-based reversal learning

Methamphetamine-induced adaptation of learning rate dynamics depend on baseline performance

The ability to calibrate learning according to new information is a fundamental component of an organism's ability to adapt to changing conditions. Yet, the exact neural mechanisms guiding dynamic learning rate adjustments remain unclear. Catecholamines appear to play a critical role in adjusting the degree to which we use new information over time, but individuals vary widely in the manner in which they adjust to changes. Here, we studied the effects of a low dose of methamphetamine (MA), and individual differences in these effects, on probabilistic reversal learning dynamics in a within-subject, double-blind, randomized design. Participants first completed a reversal learning task during a drug-free baseline session to provide a measure of baseline performance. Then they completed the task during two sessions, one with MA (20 mg oral) and one with placebo (PL). First, we showed that, relative to PL, MA modulates the ability to dynamically adjust learning from prediction errors. Second, this effect was more pronounced in participants who performed poorly at baseline. These results present novel evidence for the involvement of catecholaminergic transmission on learning flexibility and highlights that baseline performance modulates the effect of the drug.

Dopamine and acetylcholine have distinct roles in delay- and effort-based decision-making in humans

In everyday life, we encounter situations that require tradeoffs between potential rewards and associated costs, such as time and (physical) effort. The literature indicates a prominent role for dopamine in discounting of both delay and effort, with mixed findings for delay discounting in humans. Moreover, the reciprocal antagonistic interaction between dopaminergic and cholinergic transmission in the striatum suggests a potential opponent role of acetylcholine in these processes. We found opposing effects of dopamine D2 (haloperidol) and acetylcholine M1 receptor (biperiden) antagonism on specific components of effort-based decision-making in healthy humans: haloperidol decreased, whereas biperiden increased the willingness to exert physical effort. In contrast, delay discounting was reduced under haloperidol, but not affected by biperiden. Together, our data suggest that dopamine, acting at D2 receptors, modulates both effort and delay discounting, while acetylcholine, acting at M1 receptors, appears to exert a more specific influence on effort discounting only.

L-DOPA and oxytocin influence the neural correlates of performance monitoring for self and others

RATIONALE

The ability to monitor the consequences of our actions for others is imperative for flexible and adaptive behavior, and allows us to act in a (pro)social manner. Yet, little is known about the neurochemical mechanisms underlying alterations in (pro)social performance monitoring.

OBJECTIVE

The aim of this functional magnetic resonance imaging (fMRI) study was to improve our understanding of the role of dopamine and oxytocin and their potential overlap in the neural mechanisms underlying performance monitoring for own versus others' outcomes.

METHOD

Using a double-blind placebo-controlled cross-over design, 30 healthy male volunteers were administered oxytocin (24 international units), the dopamine precursor L-DOPA (100 mg + 25 mg carbidopa), or placebo in three sessions. Participants performed a computerized cannon shooting game in two recipient conditions where mistakes resulted in negative monetary consequences for (1) oneself or (2) an anonymous other participant.

RESULTS

Results indicated reduced error-correct differentiation in the ventral striatum after L-DOPA compared to placebo, independent of recipient. Hence, pharmacological manipulation of dopamine via L-DOPA modulated performance-monitoring activity in a brain region associated with reward prediction and processing in a domain-general manner. In contrast, oxytocin modulated the BOLD response in a recipient-specific manner, such that it specifically enhanced activity for errors that affected the other in the pregenual anterior cingulate cortex (pgACC), a region previously implicated in the processing of social rewards and prediction errors. Behaviorally, we also found reduced target sizes-indicative of better performance-after oxytocin, regardless of recipient. Moreover, after oxytocin lower target sizes specifically predicted higher pgACC activity when performing for others.

CONCLUSIONS

These different behavioral and neural patterns after oxytocin compared to L-DOPA administration highlight a divergent role of each neurochemical in modulating the neural mechanisms underlying social performance monitoring.

From Tripping and Falling to Ruminating and Worrying: A Meta-Control Account of Repetitive Negative Thinking

Repetitive negative thinking (RNT) is a transdiagnostic construct that encompasses rumination and worry, yet what precisely is shared between rumination and worry is unclear. To clarify this, we develop a meta-control account of RNT. Meta-control refers to the reinforcement and control of mental behavior via similar computations as reinforce and control motor behavior. We propose rumination and worry are coarse terms for failure in meta-control, just as tripping and falling are coarse terms for failure in motor control. We delineate four meta-control stages and risk factors increasing the chance of failure at each, including open-ended thoughts (stage 1), individual differences influencing subgoal execution (stage 2) and switching (stage 3), and challenges inherent to learning adaptive mental behavior (stage 4). Distinguishing these stages therefore elucidates diverse processes that lead to the same behavior of excessive RNT. Our account also subsumes prominent clinical accounts of RNT into a computational cognitive neuroscience framework.

Striatal dopamine integrates cost, benefit, and motivation

Striatal dopamine (DA) release has long been linked to reward processing, but it remains controversial whether DA release reflects costs or benefits and how these signals vary with motivation. Here, we measure DA release in the nucleus accumbens (NAc) and dorsolateral striatum (DLS) while independently varying costs and benefits and apply behavioral economic principles to determine a mouse's level of motivation. We reveal that DA release in both structures incorporates both reward magnitude and sunk cost. Surprisingly, motivation was inversely correlated with reward-evoked DA release. Furthermore, optogenetically evoked DA release was also heavily dependent on sunk cost. Our results reconcile previous disparate findings by demonstrating that striatal DA release simultaneously encodes cost, benefit, and motivation but in distinct manners over different timescales. Future work will be necessary to determine whether the reduction in phasic DA release in highly motivated animals is due to changes in tonic DA levels.

Dopamine release in human associative striatum during reversal learning

The dopaminergic system is firmly implicated in reversal learning but human measurements of dopamine release as a correlate of reversal learning success are lacking. Dopamine release and hemodynamic brain activity in response to unexpected changes in action-outcome probabilities are here explored using simultaneous dynamic [11C]Raclopride PET-fMRI and computational modelling of behavior. When participants encounter reversed reward probabilities during a card guessing game, dopamine release is observed in associative striatum. Individual differences in absolute reward prediction error and sensitivity to errors are associated with peak dopamine receptor occupancy. The fMRI response to perseverance errors at the onset of a reversal spatially overlap with the site of dopamine release. Trial-by-trial fMRI correlates of absolute prediction errors show a response in striatum and association cortices, closely overlapping with the location of dopamine release, and separable from a valence signal in ventral striatum. The results converge to implicate striatal dopamine release in associative striatum as a central component of reversal learning, possibly signifying the need for increased cognitive control when new stimuli-responses should be learned.

Methylphenidate undermines or enhances divergent creativity depending on baseline dopamine synthesis capacity

Catecholamine-enhancing psychostimulants, such as methylphenidate have long been argued to undermine creative thinking. However, prior evidence for this is weak or contradictory, stemming from studies with small sample sizes that do not consider the well-established large variability in psychostimulant effects across different individuals and task demands. We aimed to definitively establish the link between psychostimulants and creative thinking by measuring effects of methylphenidate in 90 healthy participants on distinct creative tasks that measure convergent and divergent thinking, as a function of individuals' baseline dopamine synthesis capacity, indexed with 18F-FDOPA PET imaging. In a double-blind, within-subject design, participants were administered methylphenidate, placebo or selective D2 receptor antagonist sulpiride. The results showed that striatal dopamine synthesis capacity and/or methylphenidate administration did not affect divergent and convergent thinking. However, exploratory analysis demonstrated a baseline dopamine-dependent effect of methylphenidate on a measure of response divergence, a creativity measure that measures response variability. Response divergence was reduced by methylphenidate in participants with low dopamine synthesis capacity but enhanced in those with high dopamine synthesis capacity. No evidence of any effect of sulpiride was found. These results show that methylphenidate can undermine certain forms of divergent creativity but only in individuals with low baseline dopamine levels.

Human Brain Project Partnering Projects Meeting: Status Quo and Outlook

As the European Flagship Human Brain Project (HBP) ends in September 2023, a meeting dedicated to the Partnering Projects (PPs), a collective of independent research groups that partnered with the HBP, was held on September 4-7, 2022. The purpose of this meeting was to allow these groups to present their results, reflect on their collaboration with the HBP and discuss future interactions with the European Research Infrastructure (RI) EBRAINS that has emerged from the HBP. In this report, we share the tour-de-force that the Partnering Projects that were present in the meeting have made in furthering knowledge concerning various aspects of Brain Research with the HBP. We describe briefly major achievements of the HBP Partnering Projects in terms of a systems-level understanding of the functional architecture of the brain and its possible emulation in artificial systems. We then recapitulate open discussions with EBRAINS representatives about the evolution of EBRAINS as a sustainable Research Infrastructure for the Partnering Projects after the HBP, and also for the wider scientific community.