Ventral striatal and medial prefrontal BOLD activation is correlated with reward-related electrocortical activity: A combined ERP and fMRI study

Executive control- and reward-related neural processes associated with the opportunity to engage in voluntary dishonest moral decision making

Research has begun to examine the neurocognitive processes underlying voluntary moral decision making, which involves engaging in honest or dishonest behavior in a setting in which the individual is free to make his or her own moral decisions. Employing event-related potentials, we measured executive control-related and reward-related neural processes during an incentivized coin-guessing task in which participants had the opportunity to voluntarily engage in dishonest behavior, by overreporting their wins to maximize earnings. We report four primary findings: First, the opportunity to deceive recruited executive control processes involving conflict monitoring and conflict resolution, as evidenced by a higher N2 and a smaller P3. Second, processing the outcome of the coin flips engaged reward-related processes, as evidenced by a larger medial feedback negativity (MFN) for incorrect (loss) than for correct (win) guesses, reflecting a reward prediction error signal. Third, elevated executive control-related neural activity reflecting conflict resolution (i.e., an attenuated executive control P3) predicted a greater likelihood of engaging in overall deceptive behavior. Finally, whereas elevated reward-related neural activity (the reward P3) was associated with a greater likelihood of engaging in overall deceptive behavior, an elevated reward prediction error signal (MFN difference score) predicted increased trial-by-trial moral behavioral adjustment (i.e., a greater likelihood to overreport wins following a previous honest loss than following a previous honest win trial). Collectively, these findings suggest that both executive control- and reward-related neural processes are implicated in moral decision making.

Using fMRI to study reward processing in humans: past, present, and future

Functional magnetic resonance imaging (fMRI) is a noninvasive tool used to probe cognitive and affective processes. Although fMRI provides indirect measures of neural activity, the advent of fMRI has allowed for1) the corroboration of significant animal findings in the human brain, and2) the expansion of models to include more common human attributes that inform behavior. In this review, we briefly consider the neural basis of the blood oxygenation level dependent signal to set up a discussion of how fMRI studies have applied it in examining cognitive models in humans and the promise of using fMRI to advance such models. Specifically, we illustrate the contribution that fMRI has made to the study of reward processing, focusing on the role of the striatum in encoding reward-related learning signals that drive anticipatory and consummatory behaviors. For instance, we discuss how fMRI can be used to link neural signals (e.g., striatal responses to rewards) to individual differences in behavior and traits. While this functional segregation approach has been constructive to our understanding of reward-related functions, many fMRI studies have also benefitted from a functional integration approach that takes into account how interconnected regions (e.g., corticostriatal circuits) contribute to reward processing. We contend that future work using fMRI will profit from using a multimodal approach, such as combining fMRI with noninvasive brain stimulation tools (e.g., transcranial electrical stimulation), that can identify causal mechanisms underlying reward processing. Consequently, advancements in implementing fMRI will promise new translational opportunities to inform our understanding of psychopathologies.

Blunted neural responses to reward in remitted major depression: A high-density event-related potential study

BACKGROUND

Major depressive disorder (MDD) is a highly recurrent condition, and improving our understanding of the abnormalities that persist in remitted MDD (rMDD) may provide insight into mechanisms that contribute to relapse. MDD has been characterized by reward learning deficits linked to dysfunction in frontostriatal regions. Although initial behavioral evidence of reward learning deficits in rMDD has recently emerged, it is unclear whether these reflect impairments in neural reward processing that persist into remission.

METHODS

We examined behavioral reward learning and 128-channel event-related potentials (ERP) during a well-validated probabilistic reward task in 26 rMDD individuals and 34 never-depressed controls. Temporo-spatial principal components analysis (PCA) was used to separate overlapping ERP components, and group differences in neural activity in a priori regions were examined using low-resolution electromagnetic tomography (LORETA).

RESULTS

Individuals with rMDD displayed reduced behavioral reward learning, as well as blunted ERP amplitude to reward feedback. Importantly, the reduction in ERP amplitude occurred at a PCA factor that peaked during the time at which phasic reward feedback-related signaling - hypothesized to originate in the striatum and project to the anterior cingulate cortex (ACC) - are thought to modulate scalp-recorded activity. Consistent with this, LORETA analyses revealed reduced activity in the ACC in the rMDD group, and this blunting correlated with poorer reward learning.

CONCLUSION

These findings suggest that the reward learning impairment observed in acute MDD persists into full remission and that these impairments may be attributable to abnormalities in the neural processes that support reward feedback monitoring, particularly within the ACC.

Left medial orbitofrontal cortex volume correlates with skydive-elicited euphoric experience

The medial orbitofrontal cortex has been linked to the experience of positive affect. Greater medial orbitofrontal cortex volume is associated with greater expression of positive affect and reduced medial orbital frontal cortex volume is associated with blunted positive affect. However, little is known about the experience of euphoria, or extreme joy, and how this state may relate to variability in medial orbitofrontal cortex structure. To test the hypothesis that variability in euphoric experience correlates with the volume of the medial orbitofrontal cortex, we measured individuals' (N = 31) level of self-reported euphoria in response to a highly anticipated first time skydive and measured orbitofrontal cortical volumes with structural magnetic resonance imaging. Skydiving elicited a large increase in self-reported euphoria. Participants' euphoric experience was predicted by the volume of their left medial orbitofrontal cortex such that, the greater the volume, the greater the euphoria. Further analyses indicated that the left medial orbitofrontal cortex and amygdalo-hippocampal complex independently explain variability in euphoric experience and that medial orbitofrontal cortex volume, in conjunction with other structures within the mOFC-centered corticolimbic circuit, can be used to predict individuals' euphoric experience.

Neural Basis of Intrinsic Motivation: Evidence from Event-Related Potentials

Human intrinsic motivation is of great importance in human behavior. However, although researchers have focused on this topic for decades, its neural basis was still unclear. The current study employed event-related potentials to investigate the neural disparity between an interesting stop-watch (SW) task and a boring watch-stop task (WS) to understand the neural mechanisms of intrinsic motivation. Our data showed that, in the cue priming stage, the cue of the SW task elicited smaller N2 amplitude than that of the WS task. Furthermore, in the outcome feedback stage, the outcome of the SW task induced smaller FRN amplitude and larger P300 amplitude than that of the WS task. These results suggested that human intrinsic motivation did exist and that it can be detected at the neural level. Furthermore, intrinsic motivation could be quantitatively indexed by the amplitude of ERP components, such as N2, FRN, and P300, in the cue priming stage or feedback stage. Quantitative measurements would also be convenient for intrinsic motivation to be added as a candidate social factor in the construction of a machine learning model.

Convergence of EEG and fMRI measures of reward anticipation

Deficits in reward anticipation are putative mechanisms for multiple psychopathologies. Research indicates that these deficits are characterized by reduced left (relative to right) frontal electroencephalogram (EEG) activity and blood oxygenation level-dependent (BOLD) signal abnormalities in mesolimbic and prefrontal neural regions during reward anticipation. Although it is often assumed that these two measures capture similar mechanisms, no study to our knowledge has directly examined the convergence between frontal EEG alpha asymmetry and functional magnetic resonance imaging (fMRI) during reward anticipation in the same sample. Therefore, the aim of the current study was to investigate if and where in the brain frontal EEG alpha asymmetry and fMRI measures were correlated in a sample of 40 adults. All participants completed two analogous reward anticipation tasks--once during EEG data collection and the other during fMRI data collection. Results indicated that the two measures do converge and that during reward anticipation, increased relative left frontal activity is associated with increased left anterior cingulate cortex (ACC)/medial prefrontal cortex (mPFC) and left orbitofrontal cortex (OFC) activation. This suggests that the two measures may similarly capture PFC functioning, which is noteworthy given the role of these regions in reward processing and the pathophysiology of disorders such as depression and schizophrenia.

Neural reactivity to rewards and losses in offspring of mothers and fathers with histories of depressive and anxiety disorders

Depression appears to be characterized by reduced neural reactivity to receipt of reward. Despite evidence of shared etiologies and high rates of comorbidity between depression and anxiety, this abnormality may be relatively specific to depression. However, it is unclear whether children at risk for depression also exhibit abnormal reward responding, and if so, whether risk for anxiety moderates this association. The feedback negativity (FN) is an event-related potential component sensitive to receipt of rewards versus losses that is reduced in depression. Using a large community sample (N = 407) of 9-year-old children who had never experienced a depressive episode, we examined whether histories of depression and anxiety in their parents were associated with the FN following monetary rewards and losses. Results indicated that maternal history of depression was associated with a blunted FN in offspring, but only when there was no maternal history of anxiety. In addition, greater severity of maternal depression was associated with greater blunting of the FN in children. No effects of paternal psychopathology were observed. Results suggest that blunted reactivity to rewards versus losses may be a vulnerability marker that is specific to pure depression, but is not evident when there is also familial risk for anxiety. In addition, these findings suggest that abnormal reward responding is evident as early as middle childhood, several years prior to the sharp increase in the prevalence of depression and rapid changes in neural reward circuitry in adolescence.

Individual differences in the habitual use of cognitive reappraisal predict the reward-related processing

Recent studies have shown that instructed cognitive reappraisal can regulate the neural processing of reward. However, it is still unclear whether the habitual use of cognitive reappraisal in everyday life is related to brain activity involved in reward processing. In the present study, participants' neural responses to reward were measured using electroencephalography (EEG) recorded during a gambling task and their tendency to use cognitive reappraisal was assessed using the Emotion Regulation Questionnaire (ERQ). Event-related potential (ERP) results indicated that losses on the gambling task elicited greater negative reward-related feedback negativity (FN) than gains. The differential FN between losses and gains was significantly correlated with cognitive reappraisal scores across participants such that individuals with a higher tendency to use cognitive reappraisal showed stronger reward processing (i.e., amplified FN difference between losses and gains). This correlation remained significant after controlling for expressive suppression scores. However, expressive suppression per se was not correlated with FN differences. Taken together, these results suggest that the habitual use of cognitive reappraisal is associated with increased neural processing of reward.

Negative childhood experiences alter a prefrontal-insular-motor cortical network in healthy adults: A preliminary multimodal rsfMRI-fMRI-MRS-dMRI study

Research in humans and animals has shown that negative childhood experiences (NCE) can have long-term effects on the structure and function of the brain. Alterations have been noted in grey and white matter, in the brain's resting state, on the glutamatergic system, and on neural and behavioural responses to aversive stimuli. These effects can be linked to psychiatric disorder such as depression and anxiety disorders that are influenced by excessive exposure to early life stressors. The aim of the current study was to investigate the effect of NCEs on these systems. Resting state functional MRI (rsfMRI), aversion task fMRI, glutamate magnetic resonance spectroscopy (MRS), and diffusion magnetic resonance imaging (dMRI) were combined with the Childhood Trauma Questionnaire (CTQ) in healthy subjects to examine the impact of NCEs on the brain. Low CTQ scores, a measure of NCEs, were related to higher resting state glutamate levels and higher resting state entropy in the medial prefrontal cortex (mPFC). CTQ scores, mPFC glutamate and entropy, correlated with neural BOLD responses to the anticipation of aversive stimuli in regions throughout the aversion-related network, with strong correlations between all measures in the motor cortex and left insula. Structural connectivity strength, measured using mean fractional anisotropy, between the mPFC and left insula correlated to aversion-related signal changes in the motor cortex. These findings highlight the impact of NCEs on multiple inter-related brain systems. In particular, they highlight the role of a prefrontal-insular-motor cortical network in the processing and responsivity to aversive stimuli and its potential adaptability by NCEs.

Blunted neural response to rewards as a vulnerability factor for depression: Results from a family study

Depressive disorders are associated with significant economic and public health burdens as well as increased morbidity. Yet, perhaps due to the heterogeneous nature of the disease, prevention and intervention efforts are only moderately efficacious. A better understanding of core mechanisms of depressive disorders might aid in the development of more targeted intervention, and perhaps help identify individuals at risk. One mechanism that may be particularly important to depressive phenotypes is reward insensitivity. Examination of neurobiological correlates of reward-processing, which should relate more directly to the neuropathology of depression, may be helpful in identifying liability for the disorder. To that end, we used a family study design to examine whether a neural response to rewards is a familial risk factor for depression in a sample of probands with a wide range of internalizing psychopathology, as well as their biological siblings. Event-related potentials were recorded during a simple forced-choice gambling paradigm, in which participants could either win or lose small amounts of money. Lower levels of positive affect in probands predicted a reduced neural response to rewards in siblings, even over and above the sibling's own level of positive and negative affect. Additionally, the neural response to rewards was familial (i.e., correlated among siblings). Combined, these analyses suggest that a blunted neural response to rewards may be useful in identifying individuals vulnerable to depressive illnesses.

Anterior cingulate activity to monetary loss and basal ganglia activity to monetary gain uniquely contribute to the feedback negativity

OBJECTIVE

The feedback negativity (FN) is an event-related potential that differentiates unfavorable versus favorable outcomes. Although thought to reflect error-related activity within the anterior cingulate cortex, recent work indicates the FN may also reflect reward-related activity that has been linked to the basal ganglia. To date, it remains unclear how to reconcile these conflicting perspectives.

METHODS

We decomposed the FN by applying time-frequency analysis to isolate activity unique to monetary losses and gains. The FN was recorded from 84 individuals during a laboratory gambling task.

RESULTS

Two signals contributed to the FN elicited by unpredictable outcomes: theta activity (4-7Hz) was increased following monetary loss, and delta activity (<3Hz) was increased following monetary gain. Predictable outcomes elicited delta but not theta activity. Source analysis revealed distinct generators, with loss-related theta localized to the anterior cingulate cortex and gain-related delta to a possible source in the striatum. Symptoms of depression, anxiety, and stress reactivity were specifically associated with blunted gain-related delta.

CONCLUSIONS

The FN may be a composite of loss- and gain-related neural activity, reflecting distinct facets of reward processing.

SIGNIFICANCE

Gain-related delta activity may provide unique information about reward dysfunction in major depression and other internalizing psychopathology.

Neural reactivity to monetary rewards and losses differentiates social from generalized anxiety in children

BACKGROUND

The relationship between reward sensitivity and pediatric anxiety is poorly understood. Evidence suggests that alterations in reward processing are more characteristic of depressive than anxiety disorders. However, some studies have reported that anxiety disorders are also associated with perturbations in reward processing. Heterogeneity in the forms of anxiety studied may account for the differences between studies. We used the feedback-negativity, an event-related potential sensitive to monetary gains versus losses (ΔFN), to examine whether different forms of youth anxiety symptoms were uniquely associated with reward sensitivity as indexed by neural reactivity to the receipt of positive and negative monetary outcomes.

METHOD

Participants were 390, eight- to ten-year-old children (175 females) from a large community sample. The ΔFN was measured during a monetary reward task. Self-reports of child anxiety and depression symptoms and temperamental positive emotionality (PE) were obtained.

RESULTS

Multiple regression analysis revealed that social anxiety and generalized anxiety symptoms were unique predictors of reward sensitivity after accounting for concurrent depressive symptoms and PE. While social anxiety was associated with a greater ΔFN, generalized anxiety was associated with a reduced ΔFN.

CONCLUSIONS

Different symptom dimensions of child anxiety are differentially related to alterations in reward sensitivity. This may, in part, explain inconsistent findings in the literature regarding reward processing in anxiety.

Impaired neural response to negative prediction errors in cocaine addiction

Learning can be guided by unexpected success or failure, signaled via dopaminergic positive reward prediction error (+RPE) and negative reward-prediction error (-RPE) signals, respectively. Despite conflicting empirical evidence, RPE signaling is thought to be impaired in drug addiction. To resolve this outstanding question, we studied as a measure of RPE the feedback negativity (FN) that is sensitive to both reward and the violation of expectation. We examined FN in 25 healthy controls; 25 individuals with cocaine-use disorder (CUD) who tested positive for cocaine on the study day (CUD+), indicating cocaine use within the past 72 h; and in 25 individuals with CUD who tested negative for cocaine (CUD-). EEG was acquired while the participants performed a gambling task predicting whether they would win or lose money on each trial given three known win probabilities (25, 50, or 75%). FN was scored for the period in each trial when the actual outcome (win or loss) was revealed. A significant interaction between prediction, outcome, and group revealed that controls showed increased FN to unpredicted compared with predicted wins (i.e., intact +RPE) and decreased FN to unpredicted compared with predicted losses (i.e., intact -RPE). However, neither CUD subgroup showed FN modulation to loss (i.e., impaired -RPE), and unlike CUD+ individuals, CUD- individuals also did not show FN modulation to win (i.e., impaired +RPE). Thus, using FN, the current study directly documents -RPE deficits in CUD individuals. The mechanisms underlying -RPE signaling impairments in addiction may contribute to the disadvantageous nature of excessive drug use, which can persist despite repeated unfavorable life experiences (e.g., frequent incarcerations).

Apathy in Parkinson's disease: clinical features, neural substrates, diagnosis, and treatment

Normal maintenance of human motivation depends on the integrity of subcortical structures that link the prefrontal cortex with the limbic system. Structural and functional disruption of different networks within these circuits alters the maintenance of spontaneous mental activity and the capacity of affected individuals to associate emotions with complex stimuli. The clinical manifestations of these changes include a continuum of abnormalities in goal-oriented behaviours known as apathy. Apathy is highly prevalent in Parkinson's disease (and across many neurodegenerative disorders) and can severely affect the quality of life of both patients and caregivers. Differentiation of apathy from depression, and discrimination of its cognitive, emotional, and auto-activation components could guide an individualised approach to the treatment of symptoms. The opportunity to manipulate dopaminergic treatment in Parkinson's disease allows researchers to study a continuous range of motivational states, from apathy to impulse control disorders. Parkinson's disease can thus be viewed as a model that provides insight into the neural substrates of apathy.

Blunted neural responses to monetary risk in high sensation seekers

The sensation-seeking trait is a valid predictor of various risk-taking behaviors. However, the neural underpinnings of risk processing in sensation seeking are yet unclear. The present event-related potential (ERP) study examined electrophysiological correlates associated with different stages of risky reward processing in sensation seeking. Twenty-one high sensation seekers (HSS) and 22 low sensation seekers (LSS) performed a simple two-choice gambling task. Behaviorally, whereas LSS exhibited a risk-averse pattern, HSS showed a risk-neutral pattern. During the anticipation stage, an increased stimulus-preceding negativity was elicited by high-risk compared to low-risk choices in LSS but not in HSS. During the outcome-appraisal stage, the feedback-related negativity, when calculated as the difference between losses and gains, was enhanced in response to the high-risk versus low-risk outcomes, which appeared for LSS but not for HSS. Further, HSS as compared to LSS exhibited a diminished P300 to both gains and losses. These findings suggest that risk-taking behavior in sensation seeking is expressed as blunted neural responses to risk in the anticipation stage and in the outcome-appraisal stage, which represents a candidate target for drug prevention.

Impaired reward processing by anterior cingulate cortex in children with attention deficit hyperactivity disorder

Decades of research have examined the neurocognitive mechanisms of cognitive control, but the motivational factors underlying task selection and performance remain to be elucidated. We recently proposed that anterior cingulate cortex (ACC) utilizes reward prediction error signals carried by the midbrain dopamine system to learn the value of tasks according to the principles of hierarchical reinforcement learning. According to this position, disruption of the ACC-dopamine interface can disrupt the selection and execution of extended, task-related behaviors. To investigate this issue, we recorded the event-related brain potential (ERP) from children with attention deficit hyperactivity disorder (ADHD), which is strongly associated with ACC-dopamine dysfunction, and from typically developing children while they navigated a simple "virtual T-maze" to find rewards. Depending on the condition, the feedback stimuli on each trial indicated that the children earned or failed to earn either money or points. We found that the reward positivity, an ERP component proposed to index the impact of dopamine-related reward signals on ACC, was significantly larger with money feedback than with points feedback for the children with ADHD, but not for the typically developing children. These results suggest that disruption of the ACC-dopamine interface may underlie the impairments in motivational control observed in childhood ADHD.

Mechanisms Underlying Motivational Deficits in Psychopathology: Similarities and Differences in Depression and Schizophrenia

Motivational and hedonic impairments are core aspects of a variety of types of psychopathology. These impairments cut across diagnostic categories and may be critical to understanding major aspects of the functional impairments accompanying psychopathology. Given the centrality of motivational and hedonic systems to psychopathology, the Research Domain Criteria (RDoC) initiative includes a "positive valence" systems domain that outlines a number of constructs that may be key to understanding the nature and mechanisms of motivational and hedonic impairments in psychopathology. These component constructs include initial responsiveness to reward, reward anticipation or expectancy, incentive or reinforcement learning, effort valuation, and action selection. Here, we review behavioral and neuroimaging studies providing evidence for impairments in these constructs in individuals with psychosis versus in individuals with depressive pathology. There are important differences in the nature of reward-related and hedonic deficits associated with psychosis versus depression that have major implications for our understanding of etiology and treatment development. In particular, the literature strongly suggests the presence of impairments in in-the-moment hedonics or "liking" in individuals with depressive pathology, particularly among those who experience anhedonia. Such deficits may propagate forward and contribute to impairments in other constructs that are dependent on hedonic responses, such as anticipation, learning, effort, and action selection. Such hedonic impairments could reflect alterations in dopamine and/or opioid signaling in the striatum related to depression or specifically to anhedonia in depressed populations. In contrast, the literature points to relatively intact in-the-moment hedonic processing in psychosis, but provides much evidence for impairments in other components involved in translating reward to action selection. Particularly, individuals with schizophrenia exhibit altered reward prediction and associated striatal and prefrontal activation, impaired reward learning, and impaired reward-modulated action selection.

Neural reactivity to monetary rewards and losses in childhood: longitudinal and concurrent associations with observed and self-reported positive emotionality

Reward reactivity and positive emotion are key components of a theoretical, early-emerging approach motivational system, yet few studies have examined associations between positive emotion and neural reactivity to reward across development. In this multi-method prospective study, we examined the association of laboratory observations of positive emotionality (PE) at age 3 and self-reported positive affect (PA) at age 9 with an event-related potential component sensitive to the relative response to winning vs. losing money, the feedback negativity (ΔFN), at age 9 (N=381). Males had a larger ΔFN than females, and both greater observed PE at age 3 and self-reported PA at age 9 significantly, but modestly, predicted an enhanced ΔFN at age 9. Negative emotionality and behavioral inhibition did not predict ΔFN. Results contribute to understanding the neural correlates of PE and suggest that the FN and PE may be related to the same biobehavioral approach system.

Ability to maintain internal arousal and motivation modulates brain responses to emotions

Persistence (PS) is defined as the ability to generate and maintain arousal and motivation internally in the absence of immediate external reward. Low PS individuals tend to become discouraged when expectations are not rapidly fulfilled. The goal of this study was to investigate whether individual differences in PS influence the recruitment of brain regions involved in emotional processing and regulation. In a functional MRI study, 35 subjects judged the emotional intensity of displayed pictures. When processing negative pictures, low PS (vs. high PS) subjects showed higher amygdala and right orbito-frontal cortex (OFC) activity but lower left OFC activity. This dissociation in OFC activity suggests greater prefrontal cortical asymmetry for approach/avoidance motivation, suggesting an avoidance response to aversive stimuli in low PS. For positive or neutral stimuli, low PS subjects showed lower activity in the amygdala, striatum, and hippocampus. These results suggest that low PS may involve an imbalance in processing distinct emotional inputs, with greater reactivity to aversive information in regions involved in avoidance behaviour (amygdala, OFC) and dampened response to positive and neutral stimuli across circuits subserving motivated behaviour (striatum, hippocampus, amygdala). Low PS affective style was associated with depression vulnerability. These findings in non-depressed subjects point to a neural mechanism whereby some individuals are more likely to show systematic negative emotional biases, as frequently observed in depression. The assessment of these individual differences, including those that may cause vulnerability to depressive disorders, would therefore constitute a promising approach to risk assessment for depression.

Reward dysfunction in major depression: multimodal neuroimaging evidence for refining the melancholic phenotype

Reward dysfunction is thought to play a core role in the pathophysiology of major depressive disorder (MDD). Event-related potential (ERP) and functional magnetic resonance imaging (fMRI) studies have identified reward processing deficits in MDD, but these methods have yet to be applied together in a single MDD sample. We utilized multimodal neuroimaging evidence to examine reward dysfunction in MDD. Further, we explored how neurobiological reward dysfunction would map onto subtypes of MDD. The feedback negativity (FN), an ERP index of reward evaluation, was recorded in 34 unmedicated depressed individuals and 42 never-depressed controls during a laboratory gambling task. Ventral striatal (VS) activation to reward was recorded in a separate fMRI session, using an identical task, among a subgroup of 24 depressed individuals and a comparison group of 18 non-depressed controls. FN amplitude was blunted in MDD. This effect was driven by a MDD subgroup characterized by impaired mood reactivity to positive events, a core feature of melancholic MDD. A similar pattern was observed for VS activation, which was also blunted among the MDD subgroup with impaired mood reactivity. Neither FN amplitude nor VS activation was related to the full, DSM-defined melancholic or atypical MDD subtypes. Across the MDD sample, FN amplitude and VS activation were correlated, indicating convergence across methods. These results indicate that not all MDD is characterized by reward dysfunction, and that there is meaningful heterogeneity in reward processing within MDD. The current study offers neurobiological evidence that impaired mood reactivity is a key phenotypic distinction for subtyping MDD, and further suggests that the existing melancholic phenotype may require further refinement.

Electrocortical reactivity to social feedback in youth: a pilot study of the Island Getaway task

Peer relationships become a major concern in adolescence, yet event-related potential (ERP) measures of reactivity to social feedback in adolescence are limited. In this pilot study, we tested a novel task to elicit reactivity to social feedback in youth. Participants (10-15 years old; 57.9% male; N=19) played a game that involved exchanging personal information with peers, voting to remove players from the game, and receiving rejection and acceptance feedback from peers. Results indicated that participants modified their voting behavior in response to peer feedback, and rejection feedback was associated with a negativity in the ERP wave compared to acceptance (i.e., the feedback negativity, FN). The FN predicted behavioral patterns, such that participants who showed greater neural reactivity to social feedback were less likely to reject co-players. Preliminary analyses suggest that the task may be a useful measure of individual differences: adolescents higher in social anxiety symptoms were less likely to reject peers and showed an enhanced FN to rejection vs. acceptance feedback, and higher depressive symptoms predicted an increased FN to rejection specifically. Results suggest that the FN elicited by social feedback may be a useful, economical neural measure of social processing across development and in clinical research.

Feedback-related negativity observed in rodent anterior cingulate cortex

The feedback-related negativity (FRN) refers to a difference in the human event-related potential (ERP) elicited by feedback indicating success versus failure: the difference appears negative when subtracting the success ERP from the failure ERP (Miltner et al., 1997). Although source localization techniques (e.g., BESA) suggest that the FRN is produced in the ACC, the inverse problem (that any given scalp distribution can be produced by an infinite number of possible dipole configurations) limits the certainty of this conclusion. The inverse problem can be circumvented by directly recording from the ACC in animal models. Although a non-human primate homologue of the FRN has been observed in the macaque monkey (e.g. Emeric et al., 2008), a homologue of the FRN has yet to be identified in rodents. We recorded local field potentials (LFPs) directly from the ACC in 6 rodents in a task based on the FRN paradigm. The animals were trained to poke their nose into a lighted port and received a feedback smell indicating whether or not a reward pellet would drop 1.5s later. We observed a FRN-like effect time-locked to the feedback scent whereby the LFP to feedback predicting no-reward was significantly more negative than the LFP to feedback predicting reward. This deflection began on average 130ms before behavioral changes in response to the feedback. Thus, we provide the first evidence of the existence of a rodent homologue of the FRN.

The dark side of monetary incentive: how does extrinsic reward crowd out intrinsic motivation

It was widely believed that incentives could effectively enhance the motivation of both students and employees. However, psychologists reported that extrinsic reward actually could undermine individuals' intrinsic motivation to a given interesting task, which challenged viewpoints from traditional incentive theories. Numerous studies have been carried out to test and explain the undermining effect; however, the neural basis of this effect is still elusive. Here, we carried out an electrophysiological study with a simple but interesting stopwatch task to explore to what extent the performance-based monetary reward undermines individuals' intrinsic motivation toward the task. The electrophysiological data showed that the differentiated feedback-related negativity amplitude toward intrinsic success failure divergence was prominently reduced once the extrinsic reward was imposed beforehand. However, such a difference was not observed in the control group, in which no extrinsic reward was provided throughout the experiment. Furthermore, such a pattern was not observed for P300 amplitude. Therefore, the current results indicate that extrinsic reward demotivates the intrinsic response of individuals toward success-failure outcome, which was reflected in the corresponding reduced motivational-related differentiated feedback-related negativity, but not in amplitude of P300.

Early Parenting Moderates the Association between Parental Depression and Neural Reactivity to Rewards and Losses in Offspring

Children of parents with depression exhibit neural abnormalities in reward processing. Examining contributions of parenting could provide insight into the development of these abnormalities and to the etiology of depression. We evaluated whether early parenting moderates the effects of parental depression on a neural measure of reward and loss processing in mid-late childhood. Parenting was assessed when children were preschoolers. At age nine, children completed an event-related potential assessment and the feedback negativity (FN) was measured following rewards and losses (N=344). Maternal authoritative parenting moderated the effect of maternal depression; among offspring of mothers with histories of depression, low authoritative parenting predicted a blunted FN. Observed maternal positive parenting interacted with paternal depression in a comparable manner, indicating that maternal parenting may buffer the effects of paternal depression. Early parenting may be important in shaping the neural systems involved in reward processing among children at high risk for depression.

Risk assessment and reward processing in problem gambling investigated by event-related potentials and fMRI-constrained source analysis

BACKGROUND

The temporo-spatial dynamics of risk assessment and reward processing in problem gamblers with a focus on an ecologically valid design has not been examined previously.

METHODS

We investigated risk assessment and reward processing in 12 healthy male occasional gamblers (OG) and in 12 male problem gamblers (PG) with a combined EEG and fMRI approach to identify group-differences in successively activated brain regions during two stages within a quasi-realistic blackjack game.

RESULTS

Both groups did not differ in reaction times but event-related potentials in PG and OG produced significantly different amplitudes in middle and late time-windows during high-risk vs. low-risk decisions. Applying an fMRI-constrained regional source model during risk assessment resulted in larger source moments in PG in the high-risk vs. low-risk comparison in thalamic, orbitofrontal and superior frontal activations within the 600-800 ms time window. During reward processing, PG showed a trend to enhanced negativity in an early time window (100-150 ms) potentially related to higher rostral anterior cingulate activity and a trend to centro-parietal group-differences in a later time window (390-440 ms) accompanied by increased superior-frontal (i.e., premotor-related) source moments in PG vs. OG.

CONCLUSIONS

We suggest that problem gambling is characterized by stronger cue-related craving during risk assessment. Reward processing is associated with early affective modulation followed by increased action preparation for ongoing gambling in PG.

Decision-making and trait impulsivity in bipolar disorder are associated with reduced prefrontal regulation of striatal reward valuation

Bipolar disorder is characterized by impaired decision-making captured in impulsivity and risk-taking. We sought to determine whether this is driven by a failure to effectively weight the lower-order goal of obtaining a strongly desired reward in relation to higher-order goals, and how this relates to trait impulsivity and risk-taking. We hypothesized that in bipolar disorder the weighting of valuation signals converging on ventromedial prefrontal cortex are more heavily weighted towards ventral striatum inputs (lower-order), with less weighting of dorsolateral prefrontal cortex inputs (higher-order). Twenty euthymic patients with bipolar disorder not in receipt of antipsychotic medication and 20 case-matched controls performed a roulette task during functional magnetic resonance imaging. Activity in response to high-probability ('safe') and low-probability ('risky') prospects was measured during both anticipation, and outcome. In control subjects, anticipatory and outcome-locked activity in dorsolateral prefrontal cortex was greater for safe than risky reward prospects. The bipolar disorder group showed the opposite pattern with preferential response to risky rewards. This group also showed increased anticipatory and outcome-locked activity in ventral striatum in response to rewards. In control subjects, however, ventromedial prefrontal activation was positively associated with both ventral striatum and dorsolateral prefrontal activity; patients evidenced a strong positive association with ventral striatum, but a negative association with dorsolateral prefrontal cortex. Response to high-probability rewards in dorsolateral prefrontal cortex was inversely associated with trait impulsivity and risk-taking in the bipolar disorder group. Our findings suggest that clinically impulsive and risky decision-making are related to subjective valuation that is biased towards lower-order preference, with diminished integration of higher-order goals. The findings extend a functional neuroanatomical account of disorders characterized by clinically impulsive decision-making, and provide targets for evaluating interventions that foster self-control.

Anticipation of high arousal aversive and positive movie clips engages common and distinct neural substrates

The neural correlates of anxious anticipation have been primarily studied with aversive and neutral stimuli. In this study, we examined the effect of valence on anticipation by using high arousal aversive and positive stimuli and a condition of uncertainty (i.e. either positive or aversive). The task consisted of predetermined cues warning participants of upcoming aversive, positive, 'uncertain' (either aversive or positive) and neutral movie clips. Anticipation of all affective clips engaged common regions including the anterior insula, dorsal anterior cingulate cortex, thalamus, caudate, inferior parietal and prefrontal cortex that are associated with emotional experience, sustained attention and appraisal. In contrast, the nucleus accumbens and medial prefrontal cortex, regions implicated in reward processing, were selectively engaged during anticipation of positive clips (depicting sexually explicit content) and the mid-insula, which has been linked to processing aversive stimuli, was selectively engaged during anticipation of aversive clips (depicting graphic medical procedures); these three areas were also activated during anticipation of 'uncertain' clips reflecting a broad preparatory response for both aversive and positive stimuli. These results suggest that a common circuitry is recruited in anticipation of affective clips regardless of valence, with additional areas preferentially engaged depending on whether expected stimuli are negative or positive.

A single-trial estimation of the feedback-related negativity and its relation to BOLD responses in a time-estimation task

An event-related potential (ERP) component reliably associated with feedback processing and well studied in humans is the feedback-related negativity (FRN), which is assumed to indicate activation of midcingulate cortex (MCC) neurons. However, recent approaches have conceptualized this frontocentral ERP component as reflecting at least partially a reward positivity associated with activation in reward-related brain regions, in line with fMRI studies investigating feedback processing in the context of reward evaluation. To discover convergence of electrophysiological and BOLD responses elicited by performance feedback, we concurrently recorded EEG and fMRI during a time-estimation task. The ERP showed relatively more negative amplitudes to negative than to positive feedback. Conventional analyses of fMRI data revealed activation of a number of areas, including ventral striatum, anterior cingulate cortex, and medial prefrontal cortex to positive versus negative feedback. Most importantly, when using single-trial amplitudes of electrophysiological feedback signals to estimate hemodynamic responses, we found feedback-related BOLD-responses in ventral striatum, midcingulate, and midfrontal cortices to positive but not to negative feedback associated with feedback signals in the time range of the FRN. Specifically, activation in these areas increased as amplitudes became more positive. These findings suggest that, in the time-estimation task, a positivity elicited by reward is associated with brain activation in several reward-related brain regions and is driving differential ERP responses in the time range of the FRN.

Genetic variations in the human cannabinoid receptor gene are associated with happiness

Happiness has been viewed as a temporary emotional state (e.g., pleasure) and a relatively stable state of being happy (subjective happiness level). As previous studies demonstrated that individuals with high subjective happiness level rated their current affective states more positively when they experience positive events, these two aspects of happiness are interrelated. According to a recent neuroimaging study, the cytosine to thymine single-nucleotide polymorphism of the human cannabinoid receptor 1 gene is associated with sensitivity to positive emotional stimuli. Thus, we hypothesized that our genetic traits, such as the human cannabinoid receptor 1 genotypes, are closely related to the two aspects of happiness. In Experiment 1, 198 healthy volunteers were used to compare the subjective happiness level between cytosine allele carriers and thymine-thymine carriers of the human cannabinoid receptor 1 gene. In Experiment 2, we used positron emission tomography with 20 healthy participants to compare the brain responses to positive emotional stimuli of cytosine allele carriers to that of thymine-thymine carriers. Compared to thymine-thymine carriers, cytosine allele carriers have a higher subjective happiness level. Regression analysis indicated that the cytosine allele is significantly associated with subjective happiness level. The positive mood after watching a positive film was significantly higher for the cytosine allele carriers compared to the thymine-thymine carriers. Positive emotion-related brain region such as the medial prefrontal cortex was significantly activated when the cytosine allele carriers watched the positive film compared to the thymine-thymine carriers. Thus, the human cannabinoid receptor 1 genotypes are closely related to two aspects of happiness. Compared to thymine-thymine carriers, the cytosine allele carriers of the human cannabinoid receptor 1 gene, who are sensitive to positive emotional stimuli, exhibited greater magnitude positive emotions when they experienced positive events and had a higher subjective happiness level.

Neural evidence for description dependent reward processing in the framing effect

Human decision making can be influenced by emotionally valenced contexts, known as the framing effect. We used event-related brain potentials to investigate how framing influences the encoding of reward. We found that the feedback related negativity (FRN), which indexes the “worse than expected” negative prediction error in the anterior cingulate cortex (ACC), was more negative for the negative frame than for the positive frame in the win domain. Consistent with previous findings that the FRN is not sensitive to “better than expected” positive prediction error, the FRN did not differentiate the positive and negative frame in the loss domain. Our results provide neural evidence that the description invariance principle which states that reward representation and decision making are not influenced by how options are presented is violated in the framing effect.

Neurophysiology of performance monitoring and adaptive behavior

Successful goal-directed behavior requires not only correct action selection, planning, and execution but also the ability to flexibly adapt behavior when performance problems occur or the environment changes. A prerequisite for determining the necessity, type, and magnitude of adjustments is to continuously monitor the course and outcome of one's actions. Feedback-control loops correcting deviations from intended states constitute a basic functional principle of adaptation at all levels of the nervous system. Here, we review the neurophysiology of evaluating action course and outcome with respect to their valence, i.e., reward and punishment, and initiating short- and long-term adaptations, learning, and decisions. Based on studies in humans and other mammals, we outline the physiological principles of performance monitoring and subsequent cognitive, motivational, autonomic, and behavioral adaptation and link them to the underlying neuroanatomy, neurochemistry, psychological theories, and computational models. We provide an overview of invasive and noninvasive systemic measures, such as electrophysiological, neuroimaging, and lesion data. We describe how a wide network of brain areas encompassing frontal cortices, basal ganglia, thalamus, and monoaminergic brain stem nuclei detects and evaluates deviations of actual from predicted states indicating changed action costs or outcomes. This information is used to learn and update stimulus and action values, guide action selection, and recruit adaptive mechanisms that compensate errors and optimize goal achievement.