Dissociable systems for gain- and loss-related value predictions and errors of prediction in the human brain

Studying the effects of dietary body weight-adjusted acute tryptophan depletion on punishment-related behavioral inhibition

Background

Alterations in serotonergic (5-HT) neurotransmission are thought to play a decisive role in affective disorders and impulse control.

Objective

This study aims to reproduce and extend previous findings on the effects of acute tryptophan depletion (ATD) and subsequently diminished central 5-HT synthesis in a reinforced categorization task using a refined body weight–adjusted depletion protocol.

Design

Twenty-four young healthy adults (12 females, mean age [SD]=25.3 [2.1] years) were subjected to a double-blind within-subject crossover design. Each subject was administered both an ATD challenge and a balanced amino acid load (BAL) in two separate sessions in randomized order. Punishment-related behavioral inhibition was assessed using a forced choice go/no-go task that incorporated a variable payoff schedule.

Results

Administration of ATD resulted in significant reductions in TRP measured in peripheral blood samples, indicating reductions of TRP influx across the blood–brain barrier and related brain 5-HT synthesis. Overall accuracy and response time performance were improved after ATD administration. The ability to adjust behavioral responses to aversive outcome magnitudes and behavioral adjustments following error contingent punishment remained intact after decreased brain 5-HT synthesis. A previously observed dissociation effect of ATD on punishment-induced inhibition was not observed.

Conclusions

Our results suggest that neurodietary challenges with ATD Moja–De have no detrimental effects on task performance and punishment-related inhibition in healthy adults.

Effects of prospective thinking on intertemporal choice: The role of familiarity

Imagining future events while performing an intertemporal choice task can attenuate the devaluation of future rewards. Here, we investigated whether this effect and its neural basis depend on the degree of personal prior experience associated with the simulated future scenarios. Functional magnetic resonance imaging was combined with a modified intertemporal choice task in which the delayed options were either purely monetary, or linked with a social event. Subject-specific events differed regarding familiarity, that is, meeting a close, familiar person or a celebrity in a café. In line with recent hypotheses on episodic construction, the simulation of future familiar and unfamiliar events equally attenuated delay discounting behavior in comparison with the control condition and both were imagined with similar richness. Imaging data, however, indicate that these results rely on differential neural activation patterns. The hippocampus was particularly involved in the simulation of unfamiliar future scenarios, probably reflecting enhanced construction processes when personal experience with similar past events is lacking. Consequently, functional coupling of the hippocampus with neural valuation signals in the anterior cingulate cortex predicted the subjective value only of rewards offered in the unfamiliar context. In contrast, valuation of rewards in a familiar context was predicted by activation in key nodes of emotional and autobiographical memory retrieval and dynamically modulated by frontal-striatal connectivity. The present data emphasize that the mechanisms underlying neural valuation of prospective rewards largely depend on the pre-experience with the context in which they are offered.

Reward Anticipation Is Differentially Modulated by Varenicline and Nicotine in Smokers

Recidivism rates for cigarette smokers following treatment often exceed 80%. Varenicline is the most efficacious pharmacotherapy currently available with cessation rates of 25-35% following a year of treatment. Although the in vivo binding properties are well known, varenicline's neurobiological mechanisms of action are still poorly understood. Varenicline acts as a nicotinic receptor partial agonist or antagonist depending on the presence or absence of nicotine and has been implicated in the reduction of reward signaling more broadly. The current study probed anticipatory reward processing using a revised monetary incentive delay task during fMRI in cohorts of smokers and non-smokers who completed a two-drug, placebo-controlled, double-blind crossover study. All participants underwent ~17 days of order-balanced varenicline and placebo pill administration and were scanned under each condition wearing a transdermal nicotine or placebo patch. Consistent with nicotine's ability to enhance the rewarding properties of nondrug stimuli, acute nicotine administration enhanced activation in response to reward-predicting monetary cues in both smokers and non-smokers. In contrast, varenicline reduced gain magnitude processing, but did so only in smokers. These results suggest that varenicline's downregulation of anticipatory reward processing in smokers, in addition to its previously demonstrated reduction in the negative affect associated with withdrawal, independently and additively alter distinct brain circuits. These effects likely contribute to varenicline's efficacy as a pharmacotherapy for smoking cessation.

Dissociable effects of basolateral amygdala lesions on decision making biases in rats when loss or gain is emphasized

Individuals switch from risk seeking to risk aversion when mathematically identical options are described in terms of loss versus gains, as exemplified in the reflection and framing effects. Determining the neurobiology underlying such cognitive biases could inform our understanding of decision making in health and disease. Although reports vary, data using human subjects have implicated the amygdala in such biases. Animal models enable more detailed investigation of neurobiological mechanisms. We therefore tested whether basolateral amygdala (BLA) lesions would affect risk preference for gains or losses in rats. Choices in both paradigms were always between options of equal expected value-a guaranteed outcome, or the 50:50 chance of double or nothing. In the loss-chasing task, most rats exhibited strong risk seeking preferences, gambling at the risk of incurring double the penalty, regardless of the size of the guaranteed loss. In the betting task, the majority of animals were equivocal in their choice, irrespective of bet size; however, a wager-sensitive subgroup progressively shifted away from the uncertain option as the bet size increased, which is reminiscent of risk aversion. BLA lesions increased preference for the smaller guaranteed loss in the loss-chasing task, without affecting choice on the betting task, which is indicative of reduced risk seeking for losses, but intact risk aversion for gains. These data support the hypothesis that the amygdala plays a more prominent role in choice biases related to losses. Given the importance of the amygdala in representing negative affect, the aversive emotional reaction to loss, rather than aberrant estimations of probability or loss magnitude, may underlie risk seeking for losses.

Increased neural responses to reward in adolescents and young adults with attention-deficit/hyperactivity disorder and their unaffected siblings

OBJECTIVE

Attention-deficit/hyperactivity disorder (ADHD) is a heritable neuropsychiatric disorder associated with abnormal reward processing. Limited and inconsistent data exist about the neural mechanisms underlying this abnormality. Furthermore, it is not known whether reward processing is abnormal in unaffected siblings of participants with ADHD.

METHOD

We used event-related functional magnetic resonance imaging (fMRI) to investigate brain responses during reward anticipation and receipt with an adapted monetary incentive delay task in a large sample of adolescents and young adults with ADHD (n = 150), their unaffected siblings (n = 92), and control participants (n = 108), all of the same age.

RESULTS

Participants with ADHD showed, relative to control participants, increased responses in the anterior cingulate, anterior frontal cortex, and cerebellum during reward anticipation, and in the orbitofrontal, occipital cortex and ventral striatum. Responses of unaffected siblings were increased in these regions as well, except for the cerebellum during anticipation and ventral striatum during receipt.

CONCLUSION

ADHD in adolescents and young adults is associated with enhanced neural responses in frontostriatal circuitry to anticipation and receipt of reward. The findings support models emphasizing aberrant reward processing in ADHD, and suggest that processing of reward is subject to familial influences. Future studies using standard monetary incentive delay task parameters are needed to replicate our findings.

Event-related EEG responses to anticipation and delivery of monetary and social reward

Monetary and a social incentive delay tasks were used to characterize reward anticipation and delivery with electroencephalography. During reward anticipation, N1, P2 and P3 components were modulated by both prospective reward value and incentive type (monetary or social), suggesting distinctive allocation of attentional and motivational resources depending not only on whether rewards or non-rewards were cued, but also on the monetary and social nature of the prospective outcomes. In the delivery phase, P2, FRN and P3 components were also modulated by levels of reward value and incentive type, illustrating how distinctive affective and cognitive processes were attached to the different outcomes. Our findings imply that neural processing of both reward anticipation and delivery can be specific to incentive type, which might have implications for basic as well as translational research. These results are discussed in the light of previous electrophysiological and neuroimaging work using similar tasks.

Decision making in the ageing brain: changes in affective and motivational circuits

As the global population ages, older decision makers will be required to take greater responsibility for their own physical, psychological and financial well-being. With this in mind, researchers have begun to examine the effects of ageing on decision making and associated neural circuits. A new 'affect-integration-motivation' (AIM) framework may help to clarify how affective and motivational circuits support decision making. Recent research has shed light on whether and how ageing influences these circuits, providing an interdisciplinary account of how ageing can alter decision making.

Striatal and midbrain connectivity with the hippocampus selectively boosts memory for contextual novelty

The role of contextual expectation in processing familiar and novel stimuli was investigated in a series of experiments combining eye tracking, functional magnetic resonance imaging, and behavioral methods. An experimental paradigm emphasizing either familiarity or novelty detection at retrieval was used. The detection of unexpected familiar and novel stimuli, which were characterized by lower probability, engaged activity in midbrain and striatal structures. Specifically, detecting unexpected novel stimuli, relative to expected novel stimuli, produced greater activity in the substantia nigra/ventral tegmental area (SN/VTA), whereas the detection of unexpected familiar, relative to expected, familiar stimuli, elicited activity in the striatum/globus pallidus (GP). An effective connectivity analysis showed greater functional coupling between these two seed areas (GP and SN/VTA) and the hippocampus, for unexpected than for expected stimuli. Within this network of midbrain/striatal-hippocampal interactions two pathways are apparent; the direct SN-hippocampal pathway sensitive to unexpected novelty and the perirhinal-GP-hippocampal pathway sensitive to unexpected familiarity. In addition, increased eye fixations and pupil dilations also accompanied the detection of unexpected relative to expected familiar and novel stimuli, reflecting autonomic activity triggered by the functioning of these two pathways. Finally, subsequent memory for unexpected, relative to expected, familiar, and novel stimuli was characterized by enhanced recollection, but not familiarity, accuracy. Taken together, these findings suggest that a hippocampal-midbrain network, characterized by two distinct pathways, mediates encoding facilitation and most critically, that this facilitation is driven by contextual novelty, rather than by the absolute novelty of a stimulus. This contextually sensitive neural mechanism appears to elicit increased exploratory behavior, leading subsequently to greater recollection of the unexpected stimulus.

Neural mechanisms of negative reinforcement in children and adolescents with autism spectrum disorders

Background

Previous research has found accumulating evidence for atypical reward processing in autism spectrum disorders (ASD), particularly in the context of social rewards. Yet, this line of research has focused largely on positive social reinforcement, while little is known about the processing of negative reinforcement in individuals with ASD.

Methods

The present study examined neural responses to social negative reinforcement (a face displaying negative affect) and non-social negative reinforcement (monetary loss) in children with ASD relative to typically developing children, using functional magnetic resonance imaging (fMRI).

Results

We found that children with ASD demonstrated hypoactivation of the right caudate nucleus while anticipating non-social negative reinforcement and hypoactivation of a network of frontostriatal regions (including the nucleus accumbens, caudate nucleus, and putamen) while anticipating social negative reinforcement. In addition, activation of the right caudate nucleus during non-social negative reinforcement was associated with individual differences in social motivation.

Conclusions

These results suggest that atypical responding to negative reinforcement in children with ASD may contribute to social motivational deficits in this population.

Human oscillatory activity in near-miss events

Near-miss events are situations in which an action yields a negative result but is very close to being successful. They are known to influence behavior, especially in gambling scenarios. Previous neuroimaging studies have described an 'anomalous' activity of brain reward areas following these events. The goal of the present research was to study electrophysiological correlates of near-misses in the expectation and outcome phases. Electroencephalography was recorded while participants were playing a simplified version of a slot machine. Four possible outcomes (gain, near-miss, loss and no-information) were presented in a pseudorandom order to ensure fixed proportions. Results from the time-frequency analysis for the theta (4-8 Hz), alpha (9-13 Hz), low beta (15-22 Hz) and beta-gamma (25-35 Hz) frequency-bands presented larger power increases for wins and near-misses compared with losses. In the anticipation phase, power changes were lower than in the resolution phase. The current results are in agreement with previous studies showing that near-miss events recruit brain areas of the reward network. Likewise, the oscillatory activity in near-misses is very similar to the one elicited in the gain condition. In addition, present findings suggest that oscillatory activity in the expectation phase does not play a crucial role in near-miss events.

Distinct midbrain and habenula pathways are involved in processing aversive events in humans

Emerging evidence implicates the midbrain dopamine system and its interactions with the lateral habenula in processing aversive information and learning to avoid negative outcomes. We examined neural responses to unexpected, aversive events using methods specialized for imaging the midbrain and habenula in humans. Robust activation to aversive relative to neutral events was observed in the habenula and two regions within the ventral midbrain: one located within the ventral tegmental area (VTA) and the other in the substantia nigra (SN). Aversive processing increased functional connectivity between the VTA and the habenula, putamen, and medial prefrontal cortex, whereas the SN exhibited a different pattern of functional connectivity. Our findings provide evidence for a network comprising the VTA and SN, the habenula, and mesocorticolimbic structures that supports processing aversive events in humans.

The ecology of human fear: survival optimization and the nervous system

We propose a Survival Optimization System (SOS) to account for the strategies that humans and other animals use to defend against recurring and novel threats. The SOS attempts to merge ecological models that define a repertoire of contextually relevant threat induced survival behaviors with contemporary approaches to human affective science. We first propose that the goal of the nervous system is to reduce surprise and optimize actions by (i) predicting the sensory landscape by simulating possible encounters with threat and selecting the appropriate pre-encounter action and (ii) prevention strategies in which the organism manufactures safe environments. When a potential threat is encountered the (iii) threat orienting system is engaged to determine whether the organism ignores the stimulus or switches into a process of (iv) threat assessment, where the organism monitors the stimulus, weighs the threat value, predicts the actions of the threat, searches for safety, and guides behavioral actions crucial to directed escape. When under imminent attack, (v) defensive systems evoke fast reflexive indirect escape behaviors (i.e., fight or flight). This cascade of responses to threat of increasing magnitude are underwritten by an interconnected neural architecture that extends from cortical and hippocampal circuits, to attention, action and threat systems including the amygdala, striatum, and hard-wired defensive systems in the midbrain. The SOS also includes a modulatory feature consisting of cognitive appraisal systems that flexibly guide perception, risk and action. Moreover, personal and vicarious threat encounters fine-tune avoidance behaviors via model-based learning, with higher organisms bridging data to reduce face-to-face encounters with predators. Our model attempts to unify the divergent field of human affective science, proposing a highly integrated nervous system that has evolved to increase the organism's chances of survival.

Neuroticism and extraversion are associated with amygdala resting-state functional connectivity

The personality traits neuroticism and extraversion are differentially related to socioemotional functioning and susceptibility to affective disorders. However, the neurobiology underlying this differential relationship is still poorly understood. This discrepancy could perhaps best be studied by adopting a brain connectivity approach. Whereas the amygdala has repeatedly been linked to neuroticism and extraversion, no study has yet focused on the intrinsic functional architecture of amygdala-centered networks in relation to both traits. To this end, seed-based correlation analysis was employed to reveal amygdala resting-state functional connectivity (RSFC) and its associations with neuroticism and extraversion in 50 healthy participants. Higher neuroticism scores were associated with increased amygdala RSFC with the precuneus, and decreased amygdala RSFC with the temporal poles, insula, and superior temporal gyrus (p < .05, cluster corrected). Conversely, higher extraversion scores were associated with increased amygdala RSFC with the putamen, temporal pole, insula, and several regions of the occipital cortex (p < .05, cluster corrected). The shifts in amygdala RSFC associated with neuroticism may relate to the less-adaptive perception and processing of self-relevant and socioemotional information that is frequently seen in neurotic individuals, whereas the amygdala RSFC pattern associated with extraversion may relate to the heightened reward sensitivity and enhanced socioemotional functioning in extraverts. We hypothesize that the variability in amygdala RSFC observed in the present study could potentially link neuroticism and extraversion to the neurobiology underlying increased susceptibility or resilience to affective disorders.

Dissociating pathomechanisms of depression with fMRI: bottom-up or top-down dysfunctions of the reward system

Depression is a debilitating psychiatric disorder characterized among other aspects by the inability to properly experience or respond to reward. However, it remains unclear whether patients with depression present impaired reward system due to abnormal modulatory mechanisms. We investigated the activation of the nucleus accumbens (NAcc), a crucial region involved in reward processing, with functional magnetic resonance imaging using the desire-reason-dilemma paradigm. This task allows tracking the activity of the NAcc during the acceptance or the rejection of previously conditioned reward stimuli. Patients were assigned into subgroups of lower (LA) or higher (HA) NAcc activation according to beta weights. LA patients presented significant hypoactivation in the ventral tegmental area in addition to bilateral ventral striatum, confirming impairments in the bottom-up input to the NAcc. Conversely, HA patients presented significant hyperactivation in prefrontal areas such as the rostral anterior cingulate cortex and the anterior ventral prefrontal cortex in addition to bilateral ventral striatum, suggesting disturbances in the top-down regulation of the NAcc. Demographic and clinical differences explaining the abnormal co-activations of midbrain and prefrontal regions were not identified. Therefore, we provide evidence for dysfunctional bottom-up processing in one potential neurobiological subtype of depression (LA) and dysfunctional top-down modulation in another subtype (HA). We suggest that the midbrain and prefrontal regions are more specific pathophysiological substrates for each depression subtype. Above all, our results encourage the segregation of patients by similar dysfunctional mechanisms of the dopaminergic system, which would finally contribute to disentangle more specific pathogeneses and guide the development of more personalized targets for future therapies.

Dynamic routing of task-relevant signals for decision making in dorsolateral prefrontal cortex

Neurons in the dorsolateral prefrontal cortex (DLPFC) encode a diverse array of sensory and mnemonic signals, but little is known about how this information is dynamically routed during decision making. We analyzed the neuronal activity in the DLPFC of monkeys performing a probabilistic reversal task where information about the probability and magnitude of reward was provided by the target color and numerical cues, respectively. The location of the target of a given color was randomized across trials and therefore was not relevant for subsequent choices. DLPFC neurons encoded signals related to both task-relevant and irrelevant features, but only task-relevant mnemonic signals were encoded congruently with choice signals. Furthermore, only the task-relevant signals related to previous events were more robustly encoded following rewarded outcomes. Thus, multiple types of neural signals are flexibly routed in the DLPFC so as to favor actions that maximize reward.

The effects of incentive framing on performance decrements for large monetary outcomes: behavioral and neural mechanisms

There is a nuanced interplay between the provision of monetary incentives and behavioral performance. Individuals' performance typically increases with increasing incentives only up to a point, after which larger incentives may result in decreases in performance, a phenomenon known as "choking." We investigated the influence of incentive framing on choking effects in humans: in one condition, participants performed a skilled motor task to obtain potential monetary gains; in another, participants performed the same task to avoid losing a monetary amount. In both the gain and loss frame, the degree of participants' behavioral loss aversion was correlated with their susceptibility to choking effects. However, the effects were markedly different in the gain and loss frames: individuals with higher loss aversion were susceptible to choking for large prospective gains and not susceptible to choking for large prospective losses, whereas individuals with low loss aversion choked for large prospective losses but not for large prospective gains. Activity in the ventral striatum was predictive of performance decrements in both the gain and loss frames. Moreover, a mediation analysis revealed that behavioral loss aversion hindered performance via the influence of ventral striatal activity on motor performance. Our findings indicate that the framing of an incentive has a profound effect on an individual's susceptibility to choking effects, which is contingent on their loss aversion. Furthermore, we demonstrate that the ventral striatum serves as an interface between incentive-driven motivation and instrumental action, regardless of whether incentives are framed in terms of potential losses or gains.

Altered neural reward and loss processing and prediction error signalling in depression

Dysfunctional processing of reward and punishment may play an important role in depression. However, functional magnetic resonance imaging (fMRI) studies have shown heterogeneous results for reward processing in fronto-striatal regions. We examined neural responsivity associated with the processing of reward and loss during anticipation and receipt of incentives and related prediction error (PE) signalling in depressed individuals. Thirty medication-free depressed persons and 28 healthy controls performed an fMRI reward paradigm. Regions of interest analyses focused on neural responses during anticipation and receipt of gains and losses and related PE-signals. Additionally, we assessed the relationship between neural responsivity during gain/loss processing and hedonic capacity. When compared with healthy controls, depressed individuals showed reduced fronto-striatal activity during anticipation of gains and losses. The groups did not significantly differ in response to reward and loss outcomes. In depressed individuals, activity increases in the orbitofrontal cortex and nucleus accumbens during reward anticipation were associated with hedonic capacity. Depressed individuals showed an absence of reward-related PEs but encoded loss-related PEs in the ventral striatum. Depression seems to be linked to blunted responsivity in fronto-striatal regions associated with limited motivational responses for rewards and losses. Alterations in PE encoding might mirror blunted reward- and enhanced loss-related associative learning in depression.

Jumping to conclusions in schizophrenia

Schizophrenia is a mental disorder associated with a variety of symptoms, including hallucinations, delusions, social withdrawal, and cognitive dysfunction. Impairments on decision-making tasks are routinely reported: evidence points to a particular deficit in learning from and revising behavior following feedback. In addition, patients tend to make hasty decisions when probabilistic judgments are required. This is known as "jumping to conclusions" (JTC) and has typically been demonstrated by presenting participants with colored beads drawn from one of two "urns" until they claim to be sure which urn the beads are being drawn from (the proportions of colors vary in each urn). Patients tend to make early decisions on this task, and there is evidence to suggest that a hasty decision-making style might be linked to delusion formation and thus be of clinical relevance. Various accounts have been proposed regarding what underlies this behavior. In this review, we briefly introduce the disorder and the decision-making deficits associated with it. We then explore the evidence for each account of JTC in the context of a wider decision-making deficit and then go on to summarize work exploring JTC in healthy controls using pharmacological manipulations and functional imaging. Finally, we assess whether JTC might have a role in therapy.

Value and probability coding in a feedback-based learning task utilizing food rewards

For the consequences of our actions to guide behavior, the brain must represent different types of outcome-related information. For example, an outcome can be construed as negative because an expected reward was not delivered or because an outcome of low value was delivered. Thus behavioral consequences can differ in terms of the information they provide about outcome probability and value. We investigated the role of the striatum in processing probability-based and value-based negative feedback by training participants to associate cues with food rewards and then employing a selective satiety procedure to devalue one food outcome. Using functional magnetic resonance imaging, we examined brain activity related to receipt of expected rewards, receipt of devalued outcomes, omission of expected rewards, omission of devalued outcomes, and expected omissions of an outcome. Nucleus accumbens activation was greater for rewarding outcomes than devalued outcomes, but activity in this region did not correlate with the probability of reward receipt. Activation of the right caudate and putamen, however, was largest in response to rewarding outcomes relative to expected omissions of reward. The dorsal striatum (caudate and putamen) at the time of feedback also showed a parametric increase correlating with the trialwise probability of reward receipt. Our results suggest that the ventral striatum is sensitive to the motivational relevance, or subjective value, of the outcome, while the dorsal striatum codes for a more complex signal that incorporates reward probability. Value and probability information may be integrated in the dorsal striatum, to facilitate action planning and allocation of effort.

Early effects of reward anticipation are modulated by dopaminergic stimulation

The abilities to predict future rewards and assess the value of reward delivery are crucial aspects of adaptive behavior. While the mesolimbic system, including dopaminergic midbrain, ventral striatum and prefrontal cortex have long been associated with reward processing, recent studies also indicate a prominent role of early visual brain regions. However, the precise underlying neural mechanisms still remain unclear. To address this issue, we presented participants with visual cues predicting rewards of high and low magnitudes and probability (2×2 factorial design), while neural activity was scanned using magnetoencephalography. Importantly, one group of participants received 150 mg of the dopamine precursor levodopa prior to the experiment, while another group received a placebo. For the placebo group, neural signals of reward probability (but not magnitude) emerged at ∼100 ms after cue presentation at occipital sensors in the event-related magnetic fields. Importantly, these probability signals were absent in the levodopa group indicating a close link. Moreover, levodopa administration reduced oscillatory power in the high (20–30 Hz) and low (13–20 Hz) beta band during both reward anticipation and delivery. Taken together, our findings indicate that visual brain regions are involved in coding prospective reward probability but not magnitude and that these effects are modulated by dopamine.

Representation of aversive prediction errors in the human periaqueductal gray

Pain is a primary driver of learning and motivated action. It is also a target of learning, as nociceptive brain responses are shaped by learning processes. We combined an instrumental pain avoidance task with an axiomatic approach to assessing fMRI signals related to prediction errors (PEs), which drive reinforcement-based learning. We found that pain PEs were encoded in the periaqueductal gray (PAG), a structure important for pain control and learning in animal models. Axiomatic tests combined with dynamic causal modeling suggested that ventromedial prefrontal cortex, supported by putamen, provides an expected value-related input to the PAG, which then conveys PE signals to prefrontal regions important for behavioral regulation, including orbitofrontal, anterior mid-cingulate and dorsomedial prefrontal cortices. Thus, pain-related learning involves distinct neural circuitry, with implications for behavior and pain dynamics.

The role of serotonin in reward, punishment and behavioural inhibition in humans: insights from studies with acute tryptophan depletion

Deakin and Graeff proposed that forebrain 5-hydroxytryptamine (5-HT) projections are activated by aversive events and mediate anticipatory coping responses including avoidance learning and suppression of the fight-flight escape/panic response. Other theories proposed 5-HT mediates aspects of behavioural inhibition or reward. Most of the evidence comes from rodent studies. We review 36 experimental studies in humans in which the technique of acute tryptophan depletion (ATD) was used to explicitly address the role of 5-HT in response inhibition, punishment and reward. ATD did not cause disinhibition of responding in the absence of rewards or punishments (9 studies). A major role for 5-HT in reward processing is unlikely but further tests are warranted by some ATD findings. Remarkably, ATD lessened the ability of punishments (losing points or notional money) to restrain behaviour without affecting reward processing in 7 studies. Two of these studies strongly indicate that ATD blocks 5-HT mediated aversively conditioned Pavlovian inhibition and this can explain a number of the behavioural effects of ATD.

Perceived control influences neural responses to setbacks and promotes persistence

How do people cope with setbacks and persist with their goals? We examine how perceiving control over setbacks alters neural processing in ways that increase persistence through adversity. For example, a student might retake a class if initial failure was due to controllable factors (e.g., studying) but give up if failure was uncontrollable (e.g., unfair exam questions). Participants persisted more when they perceived control over setbacks, and when they experienced increased negative affect to setbacks. Consistent with previous observations involving negative outcomes, ventral striatum and ventromedial prefrontal (VMPFC) activity was decreased in response to setbacks. Critically, these structures represented distinct neural mechanisms for persistence through adversity. Ventral striatum signal change to controllable setbacks correlated with greater persistence, whereas VMPFC signal change to uncontrollable setbacks mediated the relationship between increased negative affect and persistence. Taken together, the findings highlight how people process setbacks and adapt their behavior for future goal pursuit.

Enhanced striatal responses during expectancy coding in alcohol dependence

BACKGROUND

Individuals with alcohol dependence are known to make disadvantageous decisions, possibly caused by alterations in either reward or punishment sensitivity, which lead to persistent alcohol use despite its adverse consequences. Previous studies in alcohol dependence have mainly focused on reward anticipation processing and results from these studies are mixed. To clarify the nature of the motivational deficit that underlies disadvantageous choice in alcohol dependence, the current study sought to characterize the neural representation of expected value in individuals with alcohol dependence, separating expectancy-related processing of gains and losses, as a function of outcome magnitude and outcome probability.

METHOD

Functional MRI was used to examine brain responses during the expectation of gains and losses in patients with alcohol dependence (n=19) and healthy controls (n=19). The task manipulated outcome magnitude (€1 and €5) and outcome probability (30% and 70%).

RESULTS

Compared to healthy controls, patients with alcohol dependence were more responsive to the expectancy of large wins, in the caudate and putamen. This effect was driven by a higher caudate activity in the contrast comparing €5 vs. €1 trials in patients with alcohol dependence. There were no group differences in the responses to the expectancy for loss. The patient group reported lower expectancies of winning in the trial-by-trial ratings.

CONCLUSIONS

Patients with alcohol dependence showed caudate hyperactivity when expecting wins. The result contrasts with past work using the monetary incentive delay task, showing caudate hypoactivity; the passive nature of our task contrasts with an active response requirement in the MIDT studies.

Modafinil augments brain activation associated with reward anticipation in the nucleus accumbens

RATIONALE

The nucleus accumbens (NAc) works as a key brain structure of the reward system, in which reward-related neural activity is well correlated with dopamine release from mesolimbic dopaminergic neurons.

OBJECTIVES

Since modafinil can modulate dopaminergic transmission through re-uptake inhibition of dopamine, we investigated whether modafinil affects the reward-related brain activity in the NAc in healthy subjects.

METHODS

Twenty healthy participants underwent two series of functional magnetic resonance imaging while performing monetary incentive delay task in which they were cued to anticipate and respond to a rapidly presented target to gain or avoid losing varying amounts of money, under modafinil or placebo condition. Blood oxygenation-level dependent (BOLD) activation signals during gain and loss anticipations were analyzed in the NAc as an a priori region of interest as well as the whole brain.

RESULTS

Modafinil significantly changed subjective feelings toward positive ones. The activation of BOLD signals was observed during gain anticipation under the placebo and modafinil conditions in the left and bilateral NAc, respectively. The modafinil condition showed significantly higher BOLD signal change at the highest gain (+¥500) cue compared to the placebo condition.

CONCLUSIONS

The present study showed that modafinil affects reward processing in the NAc in healthy subjects through enhancing more positive anticipation, and it may provide a basis for the use of this drug for treating anhedonia observed in psychiatric disorders.

Decision-making and trait impulsivity in bipolar disorder are associated with reduced prefrontal regulation of striatal reward valuation

Bipolar disorder is characterized by impaired decision-making captured in impulsivity and risk-taking. We sought to determine whether this is driven by a failure to effectively weight the lower-order goal of obtaining a strongly desired reward in relation to higher-order goals, and how this relates to trait impulsivity and risk-taking. We hypothesized that in bipolar disorder the weighting of valuation signals converging on ventromedial prefrontal cortex are more heavily weighted towards ventral striatum inputs (lower-order), with less weighting of dorsolateral prefrontal cortex inputs (higher-order). Twenty euthymic patients with bipolar disorder not in receipt of antipsychotic medication and 20 case-matched controls performed a roulette task during functional magnetic resonance imaging. Activity in response to high-probability ('safe') and low-probability ('risky') prospects was measured during both anticipation, and outcome. In control subjects, anticipatory and outcome-locked activity in dorsolateral prefrontal cortex was greater for safe than risky reward prospects. The bipolar disorder group showed the opposite pattern with preferential response to risky rewards. This group also showed increased anticipatory and outcome-locked activity in ventral striatum in response to rewards. In control subjects, however, ventromedial prefrontal activation was positively associated with both ventral striatum and dorsolateral prefrontal activity; patients evidenced a strong positive association with ventral striatum, but a negative association with dorsolateral prefrontal cortex. Response to high-probability rewards in dorsolateral prefrontal cortex was inversely associated with trait impulsivity and risk-taking in the bipolar disorder group. Our findings suggest that clinically impulsive and risky decision-making are related to subjective valuation that is biased towards lower-order preference, with diminished integration of higher-order goals. The findings extend a functional neuroanatomical account of disorders characterized by clinically impulsive decision-making, and provide targets for evaluating interventions that foster self-control.

The role of dopamine in risk taking: a specific look at Parkinson's disease and gambling

An influential model suggests that dopamine signals the difference between predicted and experienced reward. In this way, dopamine can act as a learning signal that can shape behaviors to maximize rewards and avoid punishments. Dopamine is also thought to invigorate reward seeking behavior. Loss of dopamine signaling is the major abnormality in Parkinson’s disease. Dopamine agonists have been implicated in the occurrence of impulse control disorders in Parkinson’s disease patients, the most common being pathological gambling, compulsive sexual behavior, and compulsive buying. Recently, a number of functional imaging studies investigating impulse control disorders in Parkinson’s disease have been published. Here we review this literature, and attempt to place it within a decision-making framework in which potential gains and losses are evaluated to arrive at optimum choices. We also provide a hypothetical but still incomplete model on the effect of dopamine agonist treatment on these value and risk assessments. Two of the main brain structures thought to be involved in computing aspects of reward and loss are the ventral striatum (VStr) and the insula, both dopamine projection sites. Both structures are consistently implicated in functional brain imaging studies of pathological gambling in Parkinson’s disease.

Impact of personal economic environment and personality factors on individual financial decision making

This study on healthy young male students aimed to enlighten the associations between an individual’s financial decision making and surrogate makers for environmental factors covering long-term financial socialization, the current financial security/responsibility, and the personal affinity to financial affairs as represented by parental income, funding situation, and field of study. A group of 150 male young healthy students underwent two versions of the Holt and Laury (2002) lottery paradigm (matrix and random sequential version). Their financial decision was mainly driven by the factor “source of funding”: students with strict performance control (grants, scholarships) had much higher rates of relative risk aversion (RRA) than subjects with support from family (ΔRRA = 0.22; p = 0.018). Personality scores only modestly affected the outcome. In an ANOVA, however, also the intelligence quotient significantly and relevantly contributed to the explanation of variance; the effects of parental income and the personality factors “agreeableness” and “openness” showed moderate to modest – but significant – effects. These findings suggest that environmental factors more than personality factors affect risk aversion.

A genetic polymorphism of the endogenous opioid dynorphin modulates monetary reward anticipation in the corticostriatal loop

The dynorphin/κ-opioid receptor (KOP-R) system has been shown to play a role in different types of behavior regulation, including reward-related behavior and drug craving. It has been shown that alleles with 3 or 4 repeats (HH genotype) of the variable nucleotide tandem repeat (68-bp VNTR) functional polymorphism of the prodynorphin (PDYN) gene are associated with higher levels of dynorphin peptides than alleles with 1 or 2 repeats (LL genotype). We used fMRI on N = 71 prescreened healthy participants to investigate the effect of this polymorphism on cerebral activation in the limbic-corticostriatal loop during reward anticipation. Individuals with the HH genotype showed higher activation than those with the LL genotype in the medial orbitofrontal cortex (mOFC) when anticipating a possible monetary reward. In addition, the HH genotype showed stronger functional coupling (as assessed by effective connectivity analyses) of mOFC with VMPFC, subgenual anterior cingulate cortex, and ventral striatum during reward anticipation. This hints at a larger sensitivity for upcoming rewards in individuals with the HH genotype, resulting in a higher motivation to attain these rewards. These findings provide first evidence in humans that the PDYN polymorphism modulates neural processes associated with the anticipation of rewards, which ultimately may help to explain differences between genotypes with respect to addiction and drug abuse.

Neural representation of expected value in the adolescent brain

Previous work shows that the adolescent reward system is hyperactive, but this finding may be confounded by differences in how teens value money. To address this, we examined the neural ontogeny of objective value representation. Adolescent and adult participants performed a monetary gambling task in which they chose to accept or reject gambles of varying expected value. Increasing expected value had a stronger influence over gambling choices in adolescents relative to adults, an effect that was paralleled by greater activation in the ventral striatum in adolescents. This unique adolescent ventral striatum response remained even after matching groups on acceptance behavior. These behavioral and neural data suggest that the value of available options has a greater influence in adolescent versus adult choices, even when objective value and subjective choice are held constant. This research provides further evidence that hyperactivation of reward circuitry in adolescence may be a normative ontogenetic shift that is due to greater valuation in the adolescent brain.

Relationship between oscillatory neuronal activity during reward processing and trait impulsivity and sensation seeking

Background

The processing of reward and punishment stimuli in humans appears to involve brain oscillatory activity of several frequencies, probably each with a distinct function. The exact nature of associations of these electrophysiological measures with impulsive or risk-seeking personality traits is not completely clear. Thus, the aim of the present study was to investigate event-related oscillatory activity during reward processing across a wide spectrum of frequencies, and its associations with impulsivity and sensation seeking in healthy subjects.

Methods

During recording of a 32-channel EEG 22 healthy volunteers were characterized with the Barratt Impulsiveness and the Sensation Seeking Scale and performed a computerized two-choice gambling task comprising different feedback options with positive vs. negative valence (gain or loss) and high or low magnitude (5 vs. 25 points).

Results

We observed greater increases of amplitudes of the feedback-related negativity and of activity in the theta, alpha and low-beta frequency range following loss feedback and, in contrast, greater increase of activity in the high-beta frequency range following gain feedback. Significant magnitude effects were observed for theta and delta oscillations, indicating greater amplitudes upon feedback concerning large stakes. The theta amplitude changes during loss were negatively correlated with motor impulsivity scores, whereas alpha and low-beta increase upon loss and high-beta increase upon gain were positively correlated with various dimensions of sensation seeking.

Conclusions

The findings suggest that the processing of feedback information involves several distinct processes, which are subserved by oscillations of different frequencies and are associated with different personality traits.

Common neural mechanisms underlying reversal learning by reward and punishment

Impairments in flexible goal-directed decisions, often examined by reversal learning, are associated with behavioral abnormalities characterized by impulsiveness and disinhibition. Although the lateral orbital frontal cortex (OFC) has been consistently implicated in reversal learning, it is still unclear whether this region is involved in negative feedback processing, behavioral control, or both, and whether reward and punishment might have different effects on lateral OFC involvement. Using a relatively large sample (N = 47), and a categorical learning task with either monetary reward or moderate electric shock as feedback, we found overlapping activations in the right lateral OFC (and adjacent insula) for reward and punishment reversal learning when comparing correct reversal trials with correct acquisition trials, whereas we found overlapping activations in the right dorsolateral prefrontal cortex (DLPFC) when negative feedback signaled contingency change. The right lateral OFC and DLPFC also showed greater sensitivity to punishment than did their left homologues, indicating an asymmetry in how punishment is processed. We propose that the right lateral OFC and anterior insula are important for transforming affective feedback to behavioral adjustment, whereas the right DLPFC is involved in higher level attention control. These results provide insight into the neural mechanisms of reversal learning and behavioral flexibility, which can be leveraged to understand risky behaviors among vulnerable populations.

Attentional modulation of reward processing in the human brain

Although neural signals of reward anticipation have been studied extensively, the functional relationship between reward and attention has remained unclear: Neural signals implicated in reward processing could either reflect attentional biases towards motivationally salient stimuli, or proceed independently of attentional processes. Here, we sought to disentangle reward and attention-related neural processes by independently modulating reward value and attentional task demands in a functional magnetic resonance imaging study in healthy human participants. During presentation of a visual reward cue that indicated whether monetary reward could be obtained in a subsequent reaction time task, participants either attended to the reward cue or performed an unrelated attention-demanding task at two different levels of difficulty. In ventral striatum and ventral tegmental area, neural responses were modulated by reward anticipation irrespective of attentional demands, thus indicating attention-independent processing of reward cues. By contrast, additive effects of reward and attention were observed in visual cortex. Critically, reward-related activations in right anterior insula strongly depended on attention to the reward cue. Dynamic causal modelling revealed that the attentional modulation of reward processing in insular cortex was mediated by enhanced effective connectivity from ventral striatum to anterior insula. Our results provide evidence for distinct functional roles of the brain regions involved in the processing of reward-indicating information: While subcortical structures signal the motivational salience of reward cues even when attention is fully engaged elsewhere, reward-related responses in anterior insula depend on available attentional resources, likely reflecting the conscious evaluation of sensory information with respect to motivational value.

Dissociable patterns of abnormal frontal cortical activation during anticipation of an uncertain reward or loss in bipolar versus major depression

OBJECTIVES

Recent research has found abnormalities in reward-related neural activation in bipolar disorder (BD), during both manic and euthymic phases. However, reward-related neural activation in currently depressed individuals with BD and that in currently depressed individuals with major depressive disorder (MDD) have yet to be directly compared. Here, we studied these groups, examining the neural activation elicited during a guessing task in fronto-striatal regions identified by previous studies.

METHODS

We evaluated neural activation during a reward task using fMRI in two groups of depressed individuals, one with bipolar I disorder (BD-I) (n = 23) and one with MDD (n = 40), with similar levels of illness severity, and a group of healthy individuals (n = 37).

RESULTS

Reward expectancy-related activation in the anterior cingulate cortex was observed in the healthy individuals, but was significantly reduced in depressed patients (BD-I and MDD together). Anticipation-related activation was increased in the left ventrolateral prefrontal cortex in the BD-I depressed group compared with the other two groups. There were no significant differences in prediction error-related activation in the ventral striatum across the three groups.

CONCLUSIONS

The findings extend previous research which has identified dysfunction within the ventrolateral prefrontal cortex in BD, and show that abnormally elevated activity in this region during anticipation of either reward or loss may distinguish depressed individuals with BD-I from those with MDD. Altered activation of the anterior cingulate cortex during reward expectancy characterizes both types of depression. These findings have important implications for identifying both common and distinct properties of the neural circuitry underlying BD-I and MDD.

The functional and structural neural basis of individual differences in loss aversion

Decision making under risk entails the anticipation of prospective outcomes, typically leading to the greater sensitivity to losses than gains known as loss aversion. Previous studies on the neural bases of choice-outcome anticipation and loss aversion provided inconsistent results, showing either bidirectional mesolimbic responses of activation for gains and deactivation for losses, or a specific amygdala involvement in processing losses. Here we focused on loss aversion with the aim to address interindividual differences in the neural bases of choice-outcome anticipation. Fifty-six healthy human participants accepted or rejected 104 mixed gambles offering equal (50%) chances of gaining or losing different amounts of money while their brain activity was measured with functional magnetic resonance imaging (fMRI). We report both bidirectional and gain/loss-specific responses while evaluating risky gambles, with amygdala and posterior insula specifically tracking the magnitude of potential losses. At the individual level, loss aversion was reflected both in limbic fMRI responses and in gray matter volume in a structural amygdala-thalamus-striatum network, in which the volume of the "output" centromedial amygdala nuclei mediating avoidance behavior was negatively correlated with monetary performance. We conclude that outcome anticipation and ensuing loss aversion involve multiple neural systems, showing functional and structural individual variability directly related to the actual financial outcomes of choices. By supporting the simultaneous involvement of both appetitive and aversive processing in economic decision making, these results contribute to the interpretation of existing inconsistencies on the neural bases of anticipating choice outcomes.

Resting-state EEG theta activity and risk learning: sensitivity to reward or punishment?

Increased theta (4-7 Hz)-beta (13-30 Hz) power ratio in resting state electroencephalography (EEG) has been associated with risky disadvantageous decision making and with impaired reinforcement learning. However, the specific contributions of theta and beta power in risky decision making remain unclear. The first aim of the present study was to replicate the earlier found relationship and examine the specific contributions of theta and beta power in risky decision making using the Iowa Gambling Task. The second aim of the study was to examine whether the relation were associated with differences in reward or punishment sensitivity. We replicated the earlier found relationship by showing a positive association between theta/beta ratio and risky decision making. This correlation was mainly driven by theta oscillations. Furthermore, theta power correlated with reward motivated learning, but not with punishment learning. The present results replicate and extend earlier findings by providing novel insights into the relation between thetabeta ratios and risky decision making. Specifically, findings show that resting-state theta activity is correlated with reinforcement learning, and that this association may be explained by differences in reward sensitivity.

Attention-dependent modulation of cortical taste circuits revealed by Granger causality with signal-dependent noise

We show, for the first time, that in cortical areas, for example the insular, orbitofrontal, and lateral prefrontal cortex, there is signal-dependent noise in the fMRI blood-oxygen level dependent (BOLD) time series, with the variance of the noise increasing approximately linearly with the square of the signal. Classical Granger causal models are based on autoregressive models with time invariant covariance structure, and thus do not take this signal-dependent noise into account. To address this limitation, here we describe a Granger causal model with signal-dependent noise, and a novel, likelihood ratio test for causal inferences. We apply this approach to the data from an fMRI study to investigate the source of the top-down attentional control of taste intensity and taste pleasantness processing. The Granger causality with signal-dependent noise analysis reveals effects not identified by classical Granger causal analysis. In particular, there is a top-down effect from the posterior lateral prefrontal cortex to the insular taste cortex during attention to intensity but not to pleasantness, and there is a top-down effect from the anterior and posterior lateral prefrontal cortex to the orbitofrontal cortex during attention to pleasantness but not to intensity. In addition, there is stronger forward effective connectivity from the insular taste cortex to the orbitofrontal cortex during attention to pleasantness than during attention to intensity. These findings indicate the importance of explicitly modeling signal-dependent noise in functional neuroimaging, and reveal some of the processes involved in a biased activation theory of selective attention.

We show that in cortical areas such as the insular, orbitofrontal, and lateral prefrontal cortex, the variation of the blood-oxygen level dependent (BOLD) time series across trials measured with functional magnetic resonance imaging (fMRI) increases with the magnitude of the signal. We describe a new method of measuring causal effects with Granger causality that takes into account this signal-dependent noise. We show in a functional neuroimaging investigation with the new method that there is a causal influence from the anterior lateral prefrontal cortex that during attention to the pleasantness of taste stimuli increases the response of the orbitofrontal cortex to the taste; and there is a causal influence from the posterior lateral prefrontal cortex to the insular taste cortex during attention to the intensity of taste stimuli. This shows how part of the circuitry involved in the effects of selective attention on the pleasantness and intensity of stimuli operates in the brain.

Toward a common theory for learning from reward, affect, and motivation: the SIMON framework

While the effects of reward, affect, and motivation on learning have each developed into their own fields of research, they largely have been investigated in isolation. As all three of these constructs are highly related, and use similar experimental procedures, an important advance in research would be to consider the interplay between these constructs. Here we first define each of the three constructs, and then discuss how they may influence each other within a common framework. Finally, we delineate several sources of evidence supporting the framework. By considering the constructs of reward, affect, and motivation within a single framework, we can develop a better understanding of the processes involved in learning and how they interplay, and work toward a comprehensive theory that encompasses reward, affect, and motivation.

Reduced striatal responses to reward prediction errors in older compared with younger adults

We examined whether older adults differ from younger adults in how they learn from rewarding and aversive outcomes. Human participants were asked to either learn to choose actions that lead to monetary reward or learn to avoid actions that lead to monetary losses. To examine age differences in the neurophysiological mechanisms of learning, we applied a combination of computational modeling and fMRI. Behavioral results showed age-related impairments in learning from reward but not in learning from monetary losses. Consistent with these results, we observed age-related reductions in BOLD activity during learning from reward in the ventromedial PFC. Furthermore, the model-based fMRI analysis revealed a reduced responsivity of the ventral striatum to reward prediction errors during learning in older than younger adults. This age-related reduction in striatal sensitivity to reward prediction errors may result from a decline in phasic dopaminergic learning signals in the elderly.

Mechanisms of reward circuit dysfunction in psychiatric illness: prefrontal-striatal interactions

The brain's "reward circuit" has been widely implicated in the pathophysiology of mental illness. Although there has been significant progress in identifying the functional characteristics of individual nodes within the circuit and linking dysfunction of these brain areas to various forms of psychopathology, there remains a substantial gap in understanding how the nodes of the circuit interact with one another, and how the growing neurobiological knowledge may be applied to improve psychiatric patient care. In this article, we summarize what is currently known about the functions and interactions of two key nodes of this circuit-the ventral striatum and the ventromedial prefrontal/orbital frontal cortex-in relation to mental illness.

Playing it safe but losing anyway--serotonergic signaling of negative outcomes in dorsomedial prefrontal cortex in the context of risk-aversion

Risk avoidance is an important determinant of human behavior. The neurotransmitter serotonin has been implicated in processing negative outcomes caused by risky decisions. However, it is unclear whether serotonin provides a neurobiological link between making a risk aversive decision and the response to a negative outcome. Using pharmacological fMRI, we manipulated the availability of serotonin in healthy volunteers while performing a gambling task. The same group of participants was studied in three fMRI sessions: (i) during intravenous administration of the SSRI citalopram to increase the serotonergic tone, (ii) after acute tryptophan depletion (ATD) to reduce central serotonin levels, or (iii) without interventions. ATD and citalopram had opposite effects on outcome related activity in dorsomedial prefrontal cortex (dmPFC) and amygdala. Relative to the control condition, ATD increased and citalopram decreased the neural response to negative outcomes in dmPFC. Conversely, ATD decreased and citalopram increased the neural response to negative outcomes in left amygdala. Critically, these pharmacological effects were restricted to negative outcomes that were caused by low-risk decisions and led to a high missed reward. ATD and citalopram did not alter the neural response to positive outcomes in dmPFC, but relative to ATD, citalopram produced a bilateral increase in the amygdala response to large wins caused by high-risk choices. The results show a selective involvement of the serotonergic system in neocortical processing of negative outcomes resulting from risk-averse decisions, thereby linking risk aversion and processing of negative outcomes in goal-directed behaviors.

Neurophysiological differences in reward processing in anhedonics

Anhedonia is characterized by a reduced capacity to experience pleasure in response to rewarding stimuli and has been considered a possible candidate endophenotype in depression and schizophrenia. However, it is still not well understood whether these reward deficits are confined to anticipatory and/or to consummatory experiences of pleasure. In the present study, we recorded electrophysiological responses (event-related brain potentials [ERPs] and oscillatory activity) to monetary gains and losses in extreme groups of anhedonic and nonanhedonic participants. The anhedonic participants showed reduced motivation to incur risky decisions, especially after monetary rewards. These sequential behavioral effects were correlated with an increased sensitivity to punishment, which psychometrically characterized the anhedonic group. In contrast, both electrophysiological measures associated with the impacts of monetary losses and gains--the feedback-related negativity (FRN) and the beta-gamma oscillatory component--clearly revealed preserved consummatory responses in anhedonic participants. However, anhedonics showed a drastic increase in frontal medial theta power after receiving the maximum monetary gain. This increase in theta oscillatory activity could be associated with an increase in conflict and cognitive control for unexpected large positive rewards, thus indexing the violation of default negative expectations built up across the task in anhedonic participants. Thus, the present results showed that participants with elevated scores on Chapman's Physical Anhedonia Scale were more sensitive to possible punishments, showed deficits in the correct integration of response outcomes in their actions, and evidenced deficits in sustaining positive expectations of future rewards. This overall pattern suggests an effect of anhedonia in the motivational aspects of approach behavior rather than in consummatory processes.

Motivational salience and genetic variability of dopamine D2 receptor expression interact in the modulation of interference processing

Dopamine has been implicated in the fine-tuning of complex cognitive and motor function and also in the anticipation of future rewards. This dual function of dopamine suggests that dopamine might be involved in the generation of active motivated behavior. The DRD2 TaqIA polymorphism of the dopamine D2 receptor gene (rs1800497) has previously been suggested to affect striatal function with carriers of the less common A1 allele exhibiting reduced striatal D2 receptor density and increased risk for addiction. Here we aimed to investigate the influences of DRD2 TaqIA genotype on the modulation of interference processing by reward and punishment. Forty-six young, healthy volunteers participated in a behavioral experiment, and 32 underwent functional magnetic resonance imaging (fMRI). Participants performed a flanker task with a motivation manipulation (monetary reward, monetary loss, neither, or both). Reaction times (RTs) were shorter in motivated flanker trials, irrespective of congruency. In the fMRI experiment motivation was associated with reduced prefrontal activation during incongruent vs. congruent flanker trials, possibly reflecting increased processing efficiency. DRD2 TaqIA genotype did not affect overall RTs, but interacted with motivation on the congruency-related RT differences, with A1 carriers showing smaller interference effects to reward alone and A2 homozygotes exhibiting a specific interference reduction during combined reward (REW) and punishment trials (PUN). In fMRI, anterior cingulate activity showed a similar pattern of genotype-related modulation. Additionally, A1 carriers showed increased anterior insula activation relative to A2 homozygotes. Our results point to a role for genetic variations of the dopaminergic system in individual differences of cognition-motivation interaction.