Using pharmacological manipulations to study the role of dopamine in human reward functioning: A review of studies in healthy adults

Transcranial direct current stimulation enhances effort maintenance in ADHD

BACKGROUND

Youth with attention-deficit/hyperactivity disorder (ADHD) exhibit increased effort aversion, likely due to deficits in anticipatory dopamine firing. Previous research has shown that transcranial direct current stimulation (tDCS) targeting the right prefrontal cortex can enhance activity in dopaminergic meso-striatal regions. However, the extent to which this specific tDCS configuration effectively modulates effort behavior in anticipation of rewards in ADHD remains uncertain.

HYPOTHESIS

We expected an increase of effort maintenance and invigoration during and following our tDCS set-up compared to sham in subjects with ADHD.

METHODS

Twenty-four children and adolescents with ADHD (mean age: 11.6 years; 95 % CI [10.7, 12.4]) received 2 mA and sham tDCS for 20 min each. The anode was positioned over the ventromedial prefrontal cortex (PFC), while the cathode was placed over the right dorsolateral PFC, generating an electrical field with maximal strength in the right PFC. During and after the tDCS sessions, participants performed a button-pressing task aimed at earning delayed monetary rewards. Primary outcomes were effort maintenance (frequency of button presses) and invigoration (slopes of button presses), measuring motor task performance.

RESULTS

We observed a significant increase in effort maintenance both during (b = 2.66; p < 0.001) and after tDCS (b = 2.04; p= .007) compared to sham. No significant difference was found for invigoration during stimulation, while after bonferroni correction (p = 0.025) a non-significant decrease was found after tDCS compared to sham (b = -5.18; p = 0.041).

CONCLUSION

tDCS targeting the ventromedial PFC (anodal) and right dorsolateral PFC (cathodal) increases effort maintenance in children and adolescents with ADHD.

Behavioral therapies targeting reward mechanisms in substance use disorders

Behavioral therapies are considered best practices in the treatment of substance use disorders (SUD) and used as first-line approaches for SUDs without FDA-approved pharmacotherapies. Decades of research on the neuroscience of drug reward and addiction have informed the development of current leading behavioral therapies that, while differing in focus and technique, have in common the overarching goal of shifting reward responding away from drug and toward natural non-drug rewards. This review begins by describing key neurobiological processes of reward in addiction, followed by a description of how various behavioral therapies address specific reward processes. Based on this review, a conceptual 'map' is crafted to pinpoint gaps and areas of overlap, serving as a guide for selecting and integrating behavioral therapies.

A meta-analysis of electrophysiological biomarkers of reward and error monitoring in substance misuse

Substance use disorders are characterized by marked changes in reward and error processing. The primary objective of this meta-analysis was to estimate effect sizes for the reward positivity (RewP) and error-related negativity (ERN), two event-related potential indicators of outcome monitoring, in substance users compared to controls. The secondary objective was to test for moderation by demographic, substance type, and EEG experiment parameters. Final PubMed searches were performed in August 2023. Inclusion criteria were substance use disorder/dependence or validated self-report of substance misuse, RewP/ERN means available, healthy control comparison group, non-acute drug study, peer-reviewed journal, English language, and human participants. Selection bias was tested through modified Egger's regression and exploratory 3-parameter selection model tests. The RewP results (19 studies, 1641 participants) did not support an overall effect (Hedges' g = 0.07, 95% CI [-0.44, 0.58], p = .777) and nor effect of any moderators. The ERN results (20 studies, 1022 participants) indicated no significant overall effect (g = 0.41, 95%CI [-0.05, 0.88]). Subgroup analyses indicated that cocaine users had a blunted ERN compared to controls (g = 1.12, 95%CI [0.77, 1.47]). There was limited evidence for publication/small study bias. Although the results indicate a potential dissociation between substance types, this meta-analysis revealed the need for additional research on the RewP/ERN in substance using populations and for better designed experiments that adequately address research questions.

L-DOPA and oxytocin influence the neural correlates of performance monitoring for self and others

RATIONALE

The ability to monitor the consequences of our actions for others is imperative for flexible and adaptive behavior, and allows us to act in a (pro)social manner. Yet, little is known about the neurochemical mechanisms underlying alterations in (pro)social performance monitoring.

OBJECTIVE

The aim of this functional magnetic resonance imaging (fMRI) study was to improve our understanding of the role of dopamine and oxytocin and their potential overlap in the neural mechanisms underlying performance monitoring for own versus others' outcomes.

METHOD

Using a double-blind placebo-controlled cross-over design, 30 healthy male volunteers were administered oxytocin (24 international units), the dopamine precursor L-DOPA (100 mg + 25 mg carbidopa), or placebo in three sessions. Participants performed a computerized cannon shooting game in two recipient conditions where mistakes resulted in negative monetary consequences for (1) oneself or (2) an anonymous other participant.

RESULTS

Results indicated reduced error-correct differentiation in the ventral striatum after L-DOPA compared to placebo, independent of recipient. Hence, pharmacological manipulation of dopamine via L-DOPA modulated performance-monitoring activity in a brain region associated with reward prediction and processing in a domain-general manner. In contrast, oxytocin modulated the BOLD response in a recipient-specific manner, such that it specifically enhanced activity for errors that affected the other in the pregenual anterior cingulate cortex (pgACC), a region previously implicated in the processing of social rewards and prediction errors. Behaviorally, we also found reduced target sizes-indicative of better performance-after oxytocin, regardless of recipient. Moreover, after oxytocin lower target sizes specifically predicted higher pgACC activity when performing for others.

CONCLUSIONS

These different behavioral and neural patterns after oxytocin compared to L-DOPA administration highlight a divergent role of each neurochemical in modulating the neural mechanisms underlying social performance monitoring.

Effects of dopamine and opioid receptor antagonism on the neural processing of social and nonsocial rewards

Rewards are a broad category of stimuli inducing approach behavior to aid survival. Extensive evidence from animal research has shown that wanting (the motivation to pursue a reward) and liking (the pleasure associated with its consumption) are mostly regulated by dopaminergic and opioidergic activity in dedicated brain areas. However, less is known about the neuroanatomy of dopaminergic and opioidergic regulation of reward processing in humans, especially when considering different types of rewards (i.e., social and nonsocial). To fill this gap of knowledge, we combined dopaminergic and opioidergic antagonism (via amisulpride and naltrexone administration) with functional neuroimaging to investigate the neurochemical and neuroanatomical bases of wanting and liking of matched nonsocial (food) and social (interpersonal touch) rewards, using a randomized, between-subject, placebo-controlled, double-blind design. While no drug effect was observed at the behavioral level, brain activity was modulated by the administered compounds. In particular, opioid antagonism, compared to placebo, reduced activity in the medial orbitofrontal cortex during consumption of the most valued social and nonsocial rewards. Dopamine antagonism, however, had no clear effects on brain activity in response to reward anticipation. These findings provide insights into the neurobiology of human reward processing and suggest a similar opioidergic regulation of the neural responses to social and nonsocial reward consumption.

Methamphetamine alters nucleus accumbens neural activation to monetary loss in healthy young adults

RATIONALE

Stimulant drugs like methamphetamine (MA) activate brain reward circuitry, which is linked to the development of problematic drug use. It is not clear how drugs like MA alter neural response to a non-drug reward.

OBJECTIVES

We examined how acute MA impacts neural response to receipt of a monetary reward relative to a loss in healthy adults. We hypothesized that MA (vs. placebo) would increase mesolimbic neural activation to reward, relative to loss.

METHODS

In a within-subject, randomized, cross-over, double-blind, placebo-controlled design, 41 healthy adults completed the Doors monetary reward task during fMRI after ingestion of placebo or 20 mg MA. We examined drug effects on neural response to reward receipt (Win vs. Loss) using a priori anatomical striatal regions of interest (nucleus accumbens (NAcc), caudate, putamen).

RESULTS

MA decreased NAcc BOLD activation to reward vs loss compared to placebo (p=.007) without altering caudate or putamen BOLD activation. Similar effects for reward vs. loss were obtained using whole brain analysis. Additional exploratory ROI analysis comparing reward and loss activation relative to a neutral "fixation" period indicated that MA increased NAcc BOLD activation during loss trials, without decreasing activation during win trials.

CONCLUSIONS

This preliminary evidence suggests that MA increases NAcc neural response to the receipt of monetary loss. Additional studies are needed to replicate our findings and clarify the mechanisms contributing to altered mesolimbic neural response to reward and loss receipt during stimulant intoxication.

l-DOPA and oxytocin influence the neurocomputational mechanisms of self-benefitting and prosocial reinforcement learning

Humans learn through reinforcement, particularly when outcomes are unexpected. Recent research suggests similar mechanisms drive how we learn to benefit other people, that is, how we learn to be prosocial. Yet the neurochemical mechanisms underlying such prosocial computations remain poorly understood. Here, we investigated whether pharmacological manipulation of oxytocin and dopamine influence the neurocomputational mechanisms underlying self-benefitting and prosocial reinforcement learning. Using a double-blind placebo-controlled cross-over design, we administered intranasal oxytocin (24 IU), dopamine precursor l-DOPA (100 mg + 25 mg carbidopa), or placebo over three sessions. Participants performed a probabilistic reinforcement learning task with potential rewards for themselves, another participant, or no one, during functional magnetic resonance imaging. Computational models of reinforcement learning were used to calculate prediction errors (PEs) and learning rates. Participants behavior was best explained by a model with different learning rates for each recipient, but these were unaffected by either drug. On the neural level, however, both drugs blunted PE signaling in the ventral striatum and led to negative signaling of PEs in the anterior mid-cingulate cortex, dorsolateral prefrontal cortex, inferior parietal gyrus, and precentral gyrus, compared to placebo, and regardless of recipient. Oxytocin (versus placebo) administration was additionally associated with opposing tracking of self-benefitting versus prosocial PEs in dorsal anterior cingulate cortex, insula and superior temporal gyrus. These findings suggest that both l-DOPA and oxytocin induce a context-independent shift from positive towards negative tracking of PEs during learning. Moreover, oxytocin may have opposing effects on PE signaling when learning to benefit oneself versus another.

A process model account of the role of dopamine in intertemporal choice

Theoretical accounts disagree on the role of dopamine in intertemporal choice and assume that dopamine either promotes delay of gratification by increasing the preference for larger rewards or that dopamine reduces patience by enhancing the sensitivity to waiting costs. Here, we reconcile these conflicting accounts by providing empirical support for a novel process model according to which dopamine contributes to two dissociable components of the decision process, evidence accumulation and starting bias. We re-analyzed a previously published data set where intertemporal decisions were made either under the D2 antagonist amisulpride or under placebo by fitting a hierarchical drift diffusion model that distinguishes between dopaminergic effects on the speed of evidence accumulation and the starting point of the accumulation process. Blocking dopaminergic neurotransmission not only strengthened the sensitivity to whether a reward is perceived as worth the delay costs during evidence accumulation (drift rate) but also attenuated the impact of waiting costs on the starting point of the evidence accumulation process (bias). In contrast, re-analyzing data from a D1 agonist study provided no evidence for a causal involvement of D1R activation in intertemporal choices. Taken together, our findings support a novel, process-based account of the role of dopamine for cost-benefit decision making, highlight the potential benefits of process-informed analyses, and advance our understanding of dopaminergic contributions to decision making.

Prefrontal transcranial magnetic stimulation boosts response vigour during reinforcement learning in healthy adults

A 10-Hz repetitive transcranial magnetic stimulation to the left dorsal lateral prefrontal cortex has been shown to increase dopaminergic activity in the dorsal striatum, a region strongly implicated in reinforcement learning. However, the behavioural influence of this effect remains largely unknown. We tested the causal effects of 10-Hz stimulation on behavioural and computational characteristics of reinforcement learning. A total of 40 healthy individuals were randomized into active and sham (placebo) stimulation groups. Each participant underwent one stimulation session (1500 pulses) in which stimulation was applied over the left dorsal lateral prefrontal cortex using a robotic arm. Participants then completed a reinforcement learning task sensitive to striatal dopamine functioning. Participants' choices were modelled using a reinforcement learning model (Q-learning) that calculates separate learning rates associated with positive and negative reward prediction errors. Subjects receiving active stimulation exhibited increased reward rate (number of correct responses per second of task activity) compared with those in sham. Computationally, although no group differences were observed, the active group displayed a higher learning rate for correct trials (αG) compared with incorrect trials (αL). Finally, when tested with novel pairs of stimuli, the active group displayed extremely fast reaction times, and a trend towards a higher reward rate. This study provided specific behavioural and computational accounts of altered striatal-mediated behaviour, particularly response vigour, induced by a proposed increase of dopamine activity by 10-Hz stimulation to the left dorsal lateral prefrontal cortex. Together, these findings bolster the use of repetitive transcranial magnetic stimulation to target neurocognitive disturbances attributed to the dysregulation of dopaminergic-striatal circuits.

Reward, motivation and brain imaging in human healthy participants - A narrative review

Over the past 20 years there has been an increasing number of brain imaging studies on the mechanisms underlying reward motivation in humans. This narrative review describes studies on the neural mechanisms associated with reward motivation and their relationships with cognitive function in healthy human participants. The brain's meso-limbic dopamine reward circuitry in humans is known to control reward-motivated behavior in humans. The medial and lateral Pre-Frontal Cortex (PFC) integrate motivation and cognitive control during decision-making and the dorsolateral PFC (dlPFC) integrates and transmits signals of reward to the mesolimbic and meso-cortical dopamine circuits and initiates motivated behavior. The thalamus and insula influence incentive processing in humans and the motor system plays a role in response to action control. There are reciprocal relationships between reward motivation, learning, memory, imagery, working memory, and attention. The most common method of assessing reward motivation is the monetary incentive delay task (DMRT) and there are several meta-analyses of this paradigm. Genetics modulates motivation reward, and dopamine provides the basis for the interaction between motivational and cognitive control. There is some evidence that male adolescents take more risky decisions than female adolescents and that the lateralization of reward-related DA release in the ventral striatum is confined to men. These studies have implications for our understanding of natural reward and psychiatric conditions like addiction, depression and ADHD. Furthermore, the association between reward and memory can help develop treatment techniques for drug addiction that interfere with consolidation of memory. Finally, there is a lack of research on reward motivation, genetics and sex differences and this can improve our understanding of the relationships between reward, motivation and the brain.

Motor response vigour and visual fixation patterns reflect subjective valuation during intertemporal choice

Value-based decision-making is of central interest in cognitive neuroscience and psychology, as well as in the context of neuropsychiatric disorders characterised by decision-making impairments. Studies examining (neuro-)computational mechanisms underlying choice behaviour typically focus on participants’ decisions. However, there is increasing evidence that option valuation might also be reflected in motor response vigour and eye movements, implicit measures of subjective utility. To examine motor response vigour and visual fixation correlates of option valuation in intertemporal choice, we set up a task where the participants selected an option by pressing a grip force transducer, simultaneously tracking fixation shifts between options. As outlined in our preregistration (https://osf.io/k6jct), we used hierarchical Bayesian parameter estimation to model the choices assuming hyperbolic discounting, compared variants of the softmax and drift diffusion model, and assessed the relationship between response vigour and the estimated model parameters. The behavioural data were best explained by a drift diffusion model specifying a non-linear scaling of the drift rate by the subjective value differences. Replicating previous findings, we found a magnitude effect for temporal discounting, such that higher rewards were discounted less. This magnitude effect was further reflected in motor response vigour, such that stronger forces were exerted in the high vs. the low magnitude condition. Bayesian hierarchical linear regression further revealed higher grip forces, faster response times and a lower number of fixation shifts for trials with higher subjective value differences. An exploratory analysis revealed that subjective value sums across options showed an even more pronounced association with trial-wise grip force amplitudes. Our data suggest that subjective utility or implicit valuation is reflected in motor response vigour and visual fixation patterns during intertemporal choice. Taking into account response vigour might thus provide deeper insight into decision-making, reward valuation and maladaptive changes in these processes, e.g. in the context of neuropsychiatric disorders.

How to Tackle Mental Fatigue: A Systematic Review of Potential Countermeasures and Their Underlying Mechanisms

INTRODUCTION

Mental fatigue (MF) is a psychobiological state that impairs cognitive as well as physical performance in different settings. Recently, numerous studies have sought ways to counteract these negative effects of MF. An overview of the explored countermeasures for MF is, however, lacking.

OBJECTIVES

The objective of this review is to provide an overview of the different MF countermeasures currently explored in literature. Countermeasures were classified by the timing of application (before, during or after the moment of MF) and type of intervention (behavioural, physiological and psychological).

METHODS

The databases of PubMed (MEDLINE), Web of Science and PsycINFO were searched until March 7, 2022. Studies were eligible when MF was induced using a task with a duration of at least 30 min, when they assessed MF markers in at least two out of the three areas wherein MF markers have been defined (i.e., behavioural, subjective and/or [neuro]physiological) and used a placebo or control group for the countermeasure.

RESULTS

A total of 33 studies investigated one or more countermeasures against MF. Of these, eight studies assessed a behavioural countermeasure, 22 a physiological one, one a psychological countermeasure and two a combination of a behavioural and psychological countermeasure. The general finding was that a vast majority of the countermeasures induced a positive effect on behavioural (e.g., task or sport performance) and/or subjective MF markers (e.g., visual analogue scale for MF or alertness). No definitive conclusion could be drawn regarding the effect of the employed countermeasures on (neuro)physiological markers of MF as only 19 of the included studies investigated these measures, and within these a large heterogeneity in the evaluated (neuro)physiological markers was present.

DISCUSSION

Within the physiological countermeasures it seems that the use of odours during a MF task or caffeine before the MF task are the most promising interventions in combating MF. Promising behavioural (e.g., listening to music) and psychological (e.g., extrinsic motivation) countermeasures of MF have also been reported. The most assumed mechanism through which these countermeasures operate is the dopaminergic system. However, this mechanism remains speculative as (neuro)physiological markers of MF have been scarcely evaluated to date.

CONCLUSION

The present systematic review reveals that a wide range of countermeasures have been found to successfully counteract MF on a subjective, (neuro)physiological and/or behavioural level. Of these, caffeine, odours, music and extrinsic motivation are the most evidenced for countering MF. To provide in-detail practical guidelines for the real-life application of MF countermeasures, more research must be performed into the underlying mechanisms and into the optimal dosage and time of application/intake.

A Predictive Coding Framework for Understanding Major Depression

Predictive coding models of brain processing propose that top-down cortical signals promote efficient neural signaling by carrying predictions about incoming sensory information. These "priors" serve to constrain bottom-up signal propagation where prediction errors are carried via feedforward mechanisms. Depression, traditionally viewed as a disorder characterized by negative cognitive biases, is associated with disrupted reward prediction error encoding and signaling. Accumulating evidence also suggests that depression is characterized by impaired local and long-range prediction signaling across multiple sensory domains. This review highlights the electrophysiological and neuroimaging evidence for disrupted predictive processing in depression. The discussion is framed around the manner in which disrupted generative predictions about the sensorium could lead to depressive symptomatology, including anhedonia and negative bias. In particular, the review focuses on studies of sensory deviance detection and reward processing, highlighting research evidence for both disrupted generative predictions and prediction error signaling in depression. The role of the monoaminergic and glutamatergic systems in predictive coding processes is also discussed. This review provides a novel framework for understanding depression using predictive coding principles and establishes a foundational roadmap for potential future research.

Towards a Unifying Account of Dopamine’s Role in Cost-Benefit Decision Making

Dopamine is thought to play a crucial role in cost-benefit decision making, but so far there is no consensus on the precise role of dopamine in decision making. Here, we review the literature on dopaminergic manipulations of cost-benefit decision making in humans and evaluate how well different theoretical accounts explain the existing body of evidence. Reduced D₂ stimulation tends to increase the willingness to bear delay and risk costs (i.e., wait for later rewards, take riskier options), while increased D₁ and D₂ receptor stimulation increases willingness to bear effort costs. We argue that the empirical findings can best be explained by combining the strengths of two theoretical accounts: in cost-benefit decision making, dopamine may play a dual role both in promoting the pursuit of psychologically close options (e.g., sooner and safer rewards) and in computing which costs are acceptable for a reward at stake. Moreover, we identify several limiting factors in the study designs of previous investigations that prevented a fuller understanding of dopamine's role in value-based choice. Together, the proposed theoretical framework and the methodological suggestions for future studies may bring us closer to a unifying account of dopamine in healthy and impaired cost-benefit decision making.

Pharmacogenetics of Addiction Therapy

Drug addiction is a serious relapsing disease that has high costs to society and to the individual addicts. Treatment of these addictions is still in its nascency, with only a few examples of successful therapies. Therapeutic response depends upon genetic, biological, social, and environmental components. A role for genetic makeup in the response to treatment has been shown for several addiction pharmacotherapies with response to treatment based on individual genetic makeup. In this chapter, we will discuss the role of genetics in pharmacotherapies, specifically for cocaine, alcohol, and opioid dependences. The continued elucidation of the role of genetics should aid in the development of new treatments and increase the efficacy of existing treatments.

Neural Circuitry of Salience and Reward Processing in Psychosis

The processing of salient and rewarding stimuli is integral to engaging our attention, stimulating anticipation for future events, and driving goal-directed behaviors. Widespread impairments in these processes are observed in psychosis, which may be associated with worse functional outcomes or mechanistically linked to the development of symptoms. Here, we summarize the current knowledge of behavioral and functional neuroimaging in salience, prediction error, and reward. Although each is a specific process, they are situated in multiple feedback and feedforward systems integral to decision making and cognition more generally. We argue that the origin of salience and reward processing dysfunctions may be centered in the subcortex during the earliest stages of psychosis, with cortical abnormalities being initially more spared but becoming more prominent in established psychotic illness/schizophrenia. The neural circuits underpinning salience and reward processing may provide targets for delaying or preventing progressive behavioral and neurobiological decline.