Anterior cingulate activity to monetary loss and basal ganglia activity to monetary gain uniquely contribute to the feedback negativity

College students with depression symptom are more sensitive to task difficulty in reinforcement learning

BACKGROUND

Depression is usually characterized by impairments in reward function, and shows altered motivation to reward in reinforcement learning. This study further explored whether task difficulty affects reinforcement learning in college students with and without depression symptom.

METHODS

The depression symptom group (20) and the no depression symptom group (26) completed a probabilistic reward learning task with low, medium, and high difficulty levels, in which task the response bias to reward and the discriminability of reward were analyzed. Additionally, electrophysiological responses to reward and loss feedback were recorded and analyzed while they performed a simple gambling task.

RESULTS

The depression symptom group showed more response bias to reward than the no depression symptom group when the task was easy and then exhibited more quickly decrease in response bias to reward as task difficulty increased. The no depression symptom group showed a decrease in response bias only in the high-difficulty condition. Further regression analyses showed that, the Feedback-related negativity (FRN) and theta oscillation could predict response bias change in the low-difficulty condition, the FRN and oscillations of theta and delta could predict response bias change in the medium and high-difficulty conditions.

LIMITATIONS

The electrophysiological responses to loss and reward were not recorded in the same task as the reinforcement learning behaviors.

CONCLUSIONS

College students with depression symptom are more sensitive to task difficulty during reinforcement learning. The FRN, and oscillations of theta and delta could predict reward leaning behavior.

Acute stress-induced reductions in neural response to reward are related to acute stress-related increases in cortisol

Stressors and blunted reward processing are implicated in depression. The current study simultaneously examined the impact of an acute stressor on cortisol and reward processing, measured using the reward positivity (RewP) in 66 participants. Participants completed a reward task during a stressor and a control condition, counterbalanced, and separated by 1 week, while saliva samples were collected before, immediately following, and 25 min after the reward task. Participants reported that the stressor condition was more stressful than the control condition. Cortisol levels did not differ before the reward task; however, cortisol levels were higher both immediately and 25 min after the task. The RewP was blunted during the stressor compared to the control condition, and participants with a larger stress-induced increase in cortisol had greater reductions in their RewP. The current study provides evidence that stress-induced changes in HPA-axis functioning relate to reductions in neural correlates of reward processing.

The neural correlates of reinforcement sensitivity theory: A systematic review of the frontal asymmetry and spectral power literature

The original Reinforcement Sensitivity Theory (oRST) proposes two systems of approach (BAS) and avoidance (BIS) motivation to underpin personality and behavior. The revised-RST (rRST) model separates avoidance motivation into passive (BIS; anxiety) and active (FFFS; fear) systems. Prior research has attempted to map RST onto lateralized frontal asymmetry to provide a neurophysiological marker of RST. The main aim is to examine the relationships of the o/rRST scales with trait (baseline) and state (manipulated through experimental paradigms) frontal asymmetry. A systematic review was conducted, resulting in 158 studies designated to neuroimaging research. In total, 54 studies were included in this review using either frontal asymmetry or spectral power. The results were split into three main categories: resting frontal alpha asymmetry (N = 23), emotional induction and state-related frontal alpha asymmetry (N = 20), and spectral analysis (N = 16). Findings indicated that BAS was associated with enhanced left frontal asymmetry at baseline and during state-related paradigms. Findings for BIS were more inconsistent, especially at rest, suggesting that BIS, in particular, may require active engagement with the environment. Only 9 of the 54 papers included used the revised RST model, highlighting the need for more rRST research.

Reduced approach disposition in familial risk for depression: Evidence from time-frequency alpha asymmetries

Despite the promising role of alpha and delta power in reflecting reduced approach disposition in depression, to date, it is unclear whether these measures can be employed to identify at-risk individuals. Hence, the present study investigated affective disposition in 32 unaffected individuals with a family history of depression (23 F) and 30 individuals without a family history of depression (21 F) through a data-driven analysis of alpha and delta time-frequency power during the viewing of pleasant, neutral, and unpleasant pictures. Different patterns of posterior alpha asymmetry emerged within each group. Particularly, controls showed greater right posterior alpha desynchronization ~ 600 ms following emotional relative to neutral pictures presentation. Conversely, the group with a family history of depression showed greater posterior left alpha desynchronization only to unpleasant relative to neutral images in a later time window (> 900 ms). Hence, depression vulnerability seems to be characterized by a blunted reactivity to pleasant and delayed reactivity to unpleasant stimuli with a distinct posterior distribution relative to the controls. Finally, the two groups showed a comparable pattern of greater delta power to emotional relative to neutral cues. Overall, initial support was provided for the employment of time-frequency alpha power changes during affective processing in identifying blunted approach disposition in unaffected at-risk individuals.

Reward-Related Brain Activity Mediates the Relationship Between Decision-Making Deficits and Pediatric Depression Symptom Severity

BACKGROUND

The mechanisms that link neural and behavioral indices of reduced reward sensitivity in depression, particularly in children, remain unclear. Reward positivity (RewP), a neural index of reward processing, has been consistently associated with depression. Separately, recent studies using the drift-diffusion model on behavioral data have delineated computational indices of reward sensitivity. Therefore, in the current study, we examined whether RewP is a neural mediator of drift-diffusion model-based indices of reward processing in predicting pediatric depression across varying levels of symptom severity.

METHODS

A community sample of 166 girls, ages 8 to 14 years, completed 2 tasks. The first was a reward guessing task from which RewP was computed using electroencephalography; the second was a probabilistic reward-based decision-making task. On this second task, drift-diffusion model analysis was applied to behavioral data to quantify the efficiency of accumulating reward-related evidence (drift rate) and potential baseline bias (starting point) toward the differently rewarded choices. Depression severity was measured using the self-report Children's Depression Inventory.

RESULTS

RewP was correlated with drift rate, but not starting point bias, toward the more rewarded choice. Furthermore, RewP completely mediated the association between a slower drift rate toward the more rewarded option and higher depression symptom severity.

CONCLUSIONS

Our findings suggest that reduced neural sensitivity to reward feedback may be a neural mechanism that underlies behavioral insensitivity to reward in children and adolescents with higher depression symptom severity, offering novel insights into the relationship between neural and computational indices of reward processing in this context.

Attenuated neural activity in processing decision-making feedback in uncertain conditions in patients with mild cognitive impairment

The present study aimed to explore the potential neural correlates during feedback evaluation during decision-making under risk and ambiguity in MCI. Nineteen individuals with MCI and twenty age-matched HCs were enrolled. Decision-making performance under risk and ambiguity was examined with the modified game of dice task (GDT) and an Iowa gambling task (IGT). Using task-related EEG data, reward positivity (RewP) and feedback P3 (fb-P3) were used to characterize participants' motivation and allocation of cognitive resources. Also, response time and event-related oscillation (ERO) were used to evaluate information processing speed, and the potent of post-feedback information integration and behavioral modulation. MCI patients had lower RewP (p = 0.022) and fb-P3 (p = 0.045) amplitudes in the GDT than HCs. Moreover, the amount and valence of feedback modulated the RewP (p = 0.008; p = 0.017) and fb-P3 (p < 0.001; p < 0.001). In the IGT, in addition to the significantly reduced fb-P3 observed in MCI patients (p = 0.010), the amount and valence of feedback modulated the RewP (p = 0.002; p = 0.020). Furthermore, MCI patients took longer to make decisions (t = 2.15, p = 0.041). The ERO analysis revealed that delta power was reduced in MCI (GDT: p = 0.045; p = 0.011). The findings suggest that, during feedback evaluation when making risky and ambiguous decisions, motivation, allocation of cognitive resources, information processing and neuronal excitability were attenuated in MCI. It implies that neural activity related to decision making was compromised in MCI.

A meta-analysis of electrophysiological biomarkers of reward and error monitoring in substance misuse

Substance use disorders are characterized by marked changes in reward and error processing. The primary objective of this meta-analysis was to estimate effect sizes for the reward positivity (RewP) and error-related negativity (ERN), two event-related potential indicators of outcome monitoring, in substance users compared to controls. The secondary objective was to test for moderation by demographic, substance type, and EEG experiment parameters. Final PubMed searches were performed in August 2023. Inclusion criteria were substance use disorder/dependence or validated self-report of substance misuse, RewP/ERN means available, healthy control comparison group, non-acute drug study, peer-reviewed journal, English language, and human participants. Selection bias was tested through modified Egger's regression and exploratory 3-parameter selection model tests. The RewP results (19 studies, 1641 participants) did not support an overall effect (Hedges' g = 0.07, 95% CI [-0.44, 0.58], p = .777) and nor effect of any moderators. The ERN results (20 studies, 1022 participants) indicated no significant overall effect (g = 0.41, 95%CI [-0.05, 0.88]). Subgroup analyses indicated that cocaine users had a blunted ERN compared to controls (g = 1.12, 95%CI [0.77, 1.47]). There was limited evidence for publication/small study bias. Although the results indicate a potential dissociation between substance types, this meta-analysis revealed the need for additional research on the RewP/ERN in substance using populations and for better designed experiments that adequately address research questions.

How and when social evaluative feedback is processed in the brain: A systematic review on ERP studies

Social evaluative feedback informs the receiver of the other's views, which may contain judgments of personality-related traits and/or the level of likability. Such kinds of social evaluative feedback are of particular importance to humans. Event-related potentials (ERPs) can directly measure where in the processing stream feedback valence, expectancy, or contextual relevance modulate information processing. This review provides an overview and systematization of studies and early, mid-latency, and late ERP effects. Early effects were inconsistently reported for all factors. Feedback valence effects are more consistently reported for specific mid-latency ERPs (Reward Positivity, RewP, and Early Posterior Negativity, EPN) and late positivities (P3 and Late Positive Potential, LPP). Unexpected feedback consistently increased the Feedback Related Negativity (FRN) and, less consistently, decreased P3 amplitudes. Contextual relevance of the sender (e.g., human vs computer sender) or self-relatedness increased mid-latency to late ERPs. Interactions between valence and other factors were less often found, arising during mid-latency stages, where most consistent interactions showed larger EPN and P3 amplitude differences for valent feedback in a more relevant context. The ERP findings highlight that social evaluative feedback is consistently differentiated during mid-latency processing stages. The review discusses the relevance of findings, possible shortcomings of different experimental designs, and open questions. Furthermore, we suggest concrete venues for future research.

Feedback negativity and feedback-related P3 in individuals at risk for depression: Comparing surface potentials and current source densities

Blunted responses to reward feedback have been linked to major depressive disorder (MDD) and depression risk. Using a monetary incentive delay task (win, loss, break-even), we investigated the impact of family risk for depression and lifetime history of MDD and anxiety disorder with 72-channel electroencephalograms (EEG) recorded from 29 high-risk and 32 low-risk individuals (15-58 years, 30 male). Linked-mastoid surface potentials (ERPs) and their corresponding reference-free current source densities (CSDs) were quantified by temporal principal components analysis (PCA). Each PCA solution revealed a midfrontal feedback negativity (FN; peak around 310 ms) and a posterior feedback-P3 (fb-P3; 380 ms) as two distinct reward processing stages. Unbiased permutation tests and multilevel modeling of component scores revealed greater FN to loss than win and neutral for all stratification groups, confirming FN sensitivity to valence. Likewise, all groups had greater fb-P3 to win and loss than neutral, confirming that fb-P3 indexes motivational salience and allocation of attention. By contrast, group effects were subtle, dependent on data transformation (ERP, CSD), and did not confirm reduced FN or fb-P3 for at-risk individuals. Instead, CSD-based fb-P3 was overall reduced in individuals with than without MDD history, whereas ERP-based fb-P3 was greater for high-risk individuals than for low-risk individuals for monetary, but not neutral outcomes. While the present findings do not support blunted reward processing in depression and depression risk, our side-by-side comparison underscores how the EEG reference choice affects the characterization of subtle group differences, strongly advocating the use of reference-free techniques.

Comparing monetary gain and loss in the monetary incentive delay task: EEG evidence

What is more effective to guide behavior: The desire to gain or the fear to lose? Electroencephalography (EEG) studies have yielded inconsistent answers. In a systematic exploration of the valence and magnitude parameters in monetary gain and loss processing, we used time-domain and time-frequency-domain analyses to uncover the underlying neural processes. A group of 24 participants performed a monetary incentive delay (MID) task in which cue-induced anticipation of a high or low magnitude of gain or loss was manipulated trial-wise. Behaviorally, the anticipation of both gain and loss expedited responses, with gain anticipation producing greater facilitation than loss anticipation. Analyses of cue-locked P2 and P3 components revealed the significant valence main effect and valence × magnitude interaction: amplitude differences between high and low incentive magnitudes were larger with gain vs. loss cues. However, the contingent negative variation component was sensitive to incentive magnitude but did not vary with incentive valence. In the feedback phase, the RewP component exhibited reversed patterns for gain and loss trials. Time-frequency analyses revealed a large increase in delta/theta-ERS oscillatory activity in high- vs. low-magnitude conditions and a large decrease of alpha-ERD oscillatory activity in gain vs. loss conditions in the anticipation stage. In the consumption stage, delta/theta-ERS turned out stronger for negative than positive feedback, especially in the gain condition. Overall, our study provides new evidence for the neural oscillatory features of monetary gain and loss processing in the MID task, suggesting that participants invested more attention under gain and high-magnitude conditions vs. loss and low-magnitude conditions.

Declarative Learning Mechanisms Support Declarative but Not Probabilistic Feedback-Based Learning in Children with Developmental Language Disorder (DLD)

Declarative and probabilistic feedback-based learning was evaluated in 8-12-year-old school-age children with developmental language disorder (DLD; n = 14) and age-matched children with typical development (TD; n = 15). Children performed a visual two-choice word-learning task and a visual probabilistic classification task while their electroencephalogram (EEG) was recorded non-invasively from the scalp. Behavioral measures of accuracy and response to feedback, and electrophysiological responses to feedback were collected and compared between the two groups. While behavioral data indicated poorer performance by children with DLD in both learning paradigms, and similar response patterns to positive and negative feedback, electrophysiological data highlighted processing patterns in the DLD group that differed by task. More specifically, in this group, feedback processing in the context of declarative learning, which is known to be dominated by the medial temporal lobe (MTL), was associated with enhanced N170, an event-related brain potential (ERP) associated with MTL activation. The N170 amplitude was found to be correlated with declarative task performance in the DLD group. During probabilistic learning, known to be governed by the striatal-based learning system, the feedback-related negativity (FRN) ERP, which is the product of the cortico-striatal circuit dominated feedback processing. Within the context of probabilistic learning, enhanced N170 was associated with poor learning in the TD group, suggesting that MTL activation during probabilistic learning disrupts learning. These results are interpreted within the context of a proposed feedback parity hypothesis suggesting that in children with DLD, the system that dominates learning (i.e., MTL during declarative learning and the striatum during probabilistic learning) dominates and supports feedback processing.

Unraveling the influence of trial-based motivational changes on performance monitoring stages in a flanker task

Performance monitoring (PM) is a vital component of adaptive behavior and known to be influenced by motivation. We examined effects of potential gain (PG) and loss avoidance (LA) on neural correlates of PM at different processing stages, using a task with trial-based changes in these motivational contexts. Findings suggest more attention is allocated to the PG context, with higher amplitudes for respective correlates of stimulus and feedback processing. The PG context favored rapid responses, while the LA context emphasized accurate responses. Lower response thresholds in the PG context after correct responses derived from a drift-diffusion model also indicate a more approach-oriented response style in the PG context. This cognitive shift is mirrored in neural correlates: negative feedback in the PG context elicited a higher feedback-related negativity (FRN) and higher theta power, whereas positive feedback in the LA context elicited higher P3a and P3b amplitudes, as well as higher theta power. There was no effect of motivational context on response-locked brain activity. Given the similar frequency of negative feedback in both contexts, the elevated FRN and theta power in PG trials cannot be attributed to variations in reward prediction error. The observed variations in the FRN indicate that the effect of outcome valence is modulated by motivational salience.

Working memory training for reward processing in university students with subsyndromal depression: The influence of baseline severity of depression

Previous studies have tentatively suggested that working memory training (WMT) has the potential to improve reward processing, but it is not known how long this improvement lasts, whether there is a lag effect, or whether it is reflected in neurophysiological indicators. In this study, 40 university students with subsyndromal depression were randomly assigned to a training group or a control group and completed a 20-day working memory training task and a simple memory task, respectively. All participants completed the Temporal Experience of Pleasure Scale (TEPS) and a doors task with electroencephalogram (EEG) signals recorded simultaneously on a pre- and post-test and a 3-month follow-up. The reward-related positivity (RewP) amplitude, theta power, and their differences between conditions (i.e., ΔRewP and Δtheta power, respectively) in the doors task were the primary outcomes, and the score on TEPS was the secondary outcome. The results indicated no group-related effects were demonstrated in primary and secondary outcomes at post-test and 3-month follow-up. Furthermore, the differences in the pre- and post-test in Δtheta power were moderated by the baseline severity of depression. This was primarily driven by the fact that the change values in the control group increased with the severity of depression, while the change values in the training group had high homogeneity. Our findings did not provide support for the effect of WMT on reward processing across the whole sample, but without intervention, there would be high heterogeneity in the change in the cognitive control ability to loss feedback, which is detrimental to individuals with high depression severity.

Mothers exhibit higher neural activity in gaining rewards for their children than for themselves

Are people willing to exert greater effort to obtain rewards for their children than they are for themselves? Although previous studies have demonstrated that social distance influences neural responses to altruistic reward processing, the distinction between winning rewards for oneself and winning them for one's child is unclear. In the present study, a group of 31 mothers performed a monetary incentive delay task in which cue-induced reward anticipations of winning a reward for themselves, their children and donation to a charity program were manipulated trial-wise, followed by performance-contingent feedback. Behaviorally, the anticipation of winning a reward for their children accelerated participants' responses. Importantly, the electroencephalogram results revealed that across the reward anticipation and consumption phases, the child condition elicited comparable or higher brain responses of participants than the self condition did. The source localization results showed that participants' reward anticipations for their children were associated with more activation in the social brain regions, compared to winning a reward for themselves or a charity donation. Overall, these findings advance our understanding of the neural mechanisms of altruistic reward processing and suggest that the priority of winning a reward for one's child may transcend the limits of the self-advantage effect in reward processing.

Freedom of choice boosts midfrontal theta power during affective feedback processing of goal-directed actions

Sense of agency, the feeling of being in control of one's actions and their effects, is particularly relevant during goal-directed actions. During feedback learning, action effects provide information about the best course of action to reinforce positive and prevent negative outcomes. However, it is unclear whether agency experience selectively affects the processing of negative or positive feedback during the performance of goal-directed actions. As an important marker of feedback processing, we examined agency-related changes in midfrontal oscillatory activity in response to performance feedback using electroencephalography. Thirty-three participants completed a reinforcement learning task during which they received positive (monetary gain) or negative (monetary loss) feedback following item choices made either by themselves (free-choice) or by the computer (forced-choice). Independent of choice context, midfrontal theta activity was more enhanced for negative than positive feedback. In addition, free, compared to forced choices increased midfrontal theta power for both gain and loss feedback. These results indicate that freedom of choice in a motivationally salient learning task leads to a general enhancement in the processing of affective action outcomes. Our findings contribute to an understanding of the neuronal mechanisms underlying agency-related changes during action regulation and indicate midfrontal theta activity as a neurophysiological marker important for the monitoring of affective action outcomes, irrespective of feedback valence.

Effects of the COVID-19 Pandemic on Neural Responses to Reward: A Quasi-experiment

BACKGROUND

The COVID-19 pandemic has been a prolonged period of stress due to social isolation, illness, death, and other major life disruptions. Neural reward sensitivity, essential for healthy functioning, may become reduced under major naturalistic stressors, though few studies have examined this. The present study sought to test whether neural responses to rewards were significantly blunted by the stress of the pandemic.

METHODS

We compared 2 groups of young adult participants, who completed a monetary reward task while an electroencephalogram was recorded, at 2 time points, 1 to 3 years apart. Our measure of reward sensitivity was the reward positivity (RewP), a neural marker enhanced to gain relative to loss feedback. The magnitude of the RewP is sensitive to stress exposure and can prospectively predict depression. The pre-pandemic group (n = 41) completed both time points before the pandemic, while the pandemic group (n = 39) completed the baseline visit before the pandemic and the follow-up visit during its second year.

RESULTS

The pandemic group reported having experienced significant stressors over the course of the pandemic. We did not observe a significant decrease in the RewP from baseline to follow-up in the pre-pandemic group. In contrast, in the pandemic group, the RewP was significantly blunted at the follow-up visit to the extent that it no longer distinguished gain from loss feedback.

CONCLUSIONS

These results suggest that prolonged naturalistic stressors can result in adaptations in neural responses to rewards. Our findings also highlight a possible mechanism linking stress to the development of depression.

The contribution of theta and delta to feedback processing in children with developmental language disorder

PURPOSE

The study aimed at evaluating feedback processing at the electrophysiological level and its relation to learning in children with developmental language disorder (DLD) to further advance our understanding of the underlying neural mechanisms of feedback-based learning in children with this disorder.

METHOD

A feedback-based probabilistic learning task required children to classify novel cartoon animals into two categories that differ on five binary features, the probabilistic combination of which determined classification. The learning outcomes' variance in relation to time- and time-frequency measures of feedback processing were examined and compared between 20 children with developmental language disorder and 25 age-matched children with typical language development.

RESULTS

Children with developmental language disorder (DLD) performed poorer on the task when compared with their age-matched peers with typical language development (TD). The electrophysiological data in the time domain indicated no differences in the processing of positive and negative feedback among children with DLD. However, the time-frequency analysis revealed a strong theta activity in response to negative feedback in this group, suggesting an initial distinction between positive and negative feedback that was not captured by the ERP data. In the TD group, delta activity played a major role in shaping the FRN and P3a and was found to predict test performance. Delta did not contribute to the FRN and P3a in the DLD group. Additionally, theta and delta activities were not associated with the learning outcomes of children with DLD.

CONCLUSION

Theta activity, which is associated with the initial processing of feedback at the level of the anterior cingulate cortex, was detected in children with developmental language disorder (DLD) but was not associated with their learning outcomes. Delta activity, which is assumed to be generated by the striatum and to be linked to elaborate processing of outcomes and adjustment of future actions, contributed to processing and learning outcomes of children with typical language development but not of children with DLD. The results provide evidence for atypical striatum-based feedback processing in children with DLD.

Neural response to social but not monetary reward predicts increases in depressive symptoms during the COVID-19 pandemic

The prevalence of depressive symptoms has increased during the COVID-19 pandemic, especially among those with greater pandemic-related stress exposure; however, not all individuals exposed to pandemic stress will develop depression. Determining which individuals are vulnerable to depressive symptoms as a result of this stress could lead to an improved understanding of the etiology of depression. This study sought to determine whether neural sensitivity to monetary and/or social reward prospectively predicts depressive symptoms during periods of high stress. 121 participants attended pre-pandemic laboratory visits where they completed monetary and social reward tasks while electroencephalogram was recorded. Subsequently, from March to August 2020, we sent eight questionnaires probing depressive symptoms and exposure to pandemic-related stressors. Using repeated-measures multilevel models, we evaluated whether neural response to social or monetary reward predicted increases in depressive symptoms across the early course of the pandemic. Furthermore, we examined whether neural response to social or monetary reward moderated the association between pandemic-related episodic stressors and depressive symptoms. Pandemic-related stress exposure was strongly associated with depressive symptoms. Additionally, we found that blunted neural response to social but not monetary reward predicted increased depressive symptoms during the pandemic. However, neither neural response to social nor monetary reward moderated the association between episodic stress exposure and depressive symptoms. Our findings indicate that neural response to social reward may be a useful predictor of depressive symptomatology under times of chronic stress, particularly stress with a social dimension.

Electrophysiological signatures of reward learning in the rodent touchscreen-based Probabilistic Reward Task

Blunted reward learning and reward-related activation within the corticostriatal-midbrain circuitry have been implicated in the pathophysiology of anhedonia and depression. Unfortunately, the search for more efficacious interventions for anhedonic behaviors has been hampered by the use of vastly different preclinical and clinical assays. In a first step in addressing this gap, in the current study, we used event-related potentials and spectral analyses in conjunction with a touchscreen version of the rodent Probabilistic Reward Task (PRT) to identify the electrophysiological signatures of reward learning in rats. We trained 11 rats (5 females and 6 males) on the rodent touchscreen-based PRT and subsequently implanted them with deep electrodes in the anterior cingulate cortex (ACC) and nucleus accumbens (NAc) for local field potentials recordings during the PRT. Behaviorally, the expected responsivity-to-reward profile was observed. At the electrophysiological level, we identified a negative amplitude deflection 250-500 ms after feedback in the ACC and NAc electrodes, as well as power increase in feedback-locked delta (1-5 Hz) and alpha/beta (9-17 Hz) bands in both electrodes for rewarded trials. Using a reverse-translational approach, we identified electrophysiological signatures of reward learning in rats similar to those described in humans. These findings and approaches might provide a useful translational platform to efficiently evaluate novel therapeutics targeting anhedonia.

Reduced positive affect alters reward learning via reduced information encoding in the Reward Positivity

Reward Positivity (RewP) is a feedback-locked event-related potential component that is specifically elicited by rewarding feedback and scales with positive reward prediction error, a hallmark of reinforcement learning models. The RewP is also diminished in depression, suggesting that it may be a novel marker of anhedonia. Here, we examined if a sad mood induction offered an opportunity to causally induce a mood-related alteration of the RewP and reward-related learning. In Experiment 1 (N = 50 total), participants were randomly assigned to previously established sad or neutral mood induction procedures before a probabilistic selection task. This manipulation failed to induce changes in affect, suggesting that standard methods are inadequate. In Experiment 2 (N = 50 total), participants were randomly assigned to newly developed happy versus sad mood manipulations, which successfully induced large changes in affect. While the RewP was unaffected by mood induction, positive mood moderated the relationship between prediction error encoding in the RewP and reward learning, such that low positive mood and low prediction error encoding resulted in poorer reward learning. These findings provide a mechanistic example of how reduced positive affect moderates reward learning via poorer information encoding in the RewP.

Rethinking the risk for depression using the RDoC: A psychophysiological perspective

Considering that the classical categorical approach to mental disorders does not allow a clear identification of at-risk conditions, the dimensional approach provided by the Research Domain Criteria (RDoC) is useful in the exploration of vulnerability to psychopathology. In the RDoC era, psychophysiological models have an important role in the reconceptualization of mental disorders. Indeed, progress in the study of depression vulnerability has increasingly been informed by psychophysiological models. By adopting an RDoC lens, this narrative review focuses on how psychophysiological models can be used to advance our knowledge of the pathophysiological mechanisms underlying depression vulnerability. Findings from psychophysiological research that explored multiple RDoC domains in populations at-risk for depression are reviewed and discussed. Future directions for the application of psychophysiological research in reaching a more complete understanding of depression vulnerability and, ultimately, improving clinical utility, are presented.

Electrophysiological measures of conflict and reward processing are associated with decisions to engage in physical effort

Anterior cingulate cortex (ACC), a key brain region involved in cognitive control and decision making, is suggested to mediate effort- and value-based decision making, but the specific role of ACC in this process remains debated. Here we used frontal midline theta (FMT) and the reward positivity (RewP) to examine ACC function in a value-based decision making task requiring physical effort. We investigated whether (1) FMT power is sensitive to the difficulty of the decision or to selecting effortful actions, and (2) RewP is sensitive to the subjective value of reward outcomes as a function of effort investment. On each trial, participants chose to execute a low-effort or a high-effort behavior (that required squeezing a hand-dynamometer) to obtain smaller or larger rewards, respectively, while their brainwaves were recorded. We replicated prior findings that tonic FMT increased over the course of the hour-long task, which suggests increased application of control in the face of growing fatigue. RewP amplitude also increased following execution of high-effort compared to low-effort behavior, consistent with increased valuation of reward outcomes by ACC. Although neither phasic nor tonic FMT were associated with decision difficulty or effort selection per se, an exploratory analysis revealed that the interaction of phasic FMT and expected value of choice predicted effort choice. This interaction suggests that phasic FMT increases specifically under situations of decision difficulty when participants ultimately select a high-effort choice. These results point to a unique role for ACC in motivating and persisting at effortful behavior when decision conflict is high.

The gray matter morphology associated with the electrophysiological response to errors in individuals with high trait anxiety

Enhanced error monitoring has been associated with higher levels of anxiety. This has been consistently demonstrated in its most reliable electrophysiological index, the error-related negativity (ERN), such that increased ERN is related with elevated anxiety symptomology. However, it is still unclear whether the structural properties of the brain are associated with individual differences in ERN amplitude. Moreover, the relationship between ERN and anxiety has recently been suggested to be moderated by sex, but the degree to which sex moderates the association between brain structure and ERN amplitude is unknown. The present study investigated the association between gray matter volume (GMV) and ERN amplitude in individuals with high trait anxiety (N = 98) as well as the role of sex in moderating this association. The ERN was elicited from a flanker task, whereas structural MRI images were obtained from whole brain structural T1-weighted MRI scans. The results of voxel-based morphometry analyses showed that the relationship between ERN difference scores and GMV was moderated by sex in the dorsal anterior cingulate cortex (dACC). This sex difference was derived from a negative correlation between ERN difference scores and dACC GMV in females and a positive correlation in males. Our findings are in accordance with the critical role of the dACC serving as a neural substrate of error monitoring. It also provides further evidence for sex-specific associations with brain structures related to error monitoring.

Reward-based decision-making in mesial temporal lobe epilepsy patients with unilateral hippocampal sclerosis pre- and post-surgery

BACKGROUND

Correct functioning of the reward processing system is critical for optimizing decision-making as well as preventing the development of addictions and/or neuropsychiatric symptoms such as depression, apathy, and anhedonia. Consequently, patients with mesial temporal lobe epilepsy due to unilateral hippocampal sclerosis (mTLE-UHS) represent an excellent opportunity to study the brain networks involved in this system.

OBJECTIVE

The aim of the current study was to evaluate decision-making and the electrophysiological correlates of feedback processing in a sample of mTLE-UHS patients, compared to healthy controls. In addition, we assessed the impact of mesial temporal lobe surgical resection on these processes, as well as general, neuropsychological functioning.

METHOD

17 mTLE-UHS patients and 17 matched healthy controls completed: [1] a computerized version of the Game of Dice Task, [2] a Standard Iowa Gambling Task, and [3] a modified ERP version of a probabilistic gambling task coupled with multichannel electroencephalography. Neuropsychological scores were also obtained both pre- and post-surgery.

RESULTS

Behavioral analyses showed a pattern of increased risk for the mTLE-UHS group in decision-making under ambiguity compared to the control group. A decrease in the amplitude of the Feedback Related Negativity (FRN), a weaker effect of valence on delta power, and a general reduction of delta and theta power in the mTLE-UHS group, as compared to the control group, were also found. The beta-gamma activity associated with the delivery of positive reward was similar in both groups. Behavioral performance and electrophysiological measures did not worsen post-surgery.

CONCLUSIONS

Patients with mTLE-UHS showed impairments in decision-making under ambiguity, particularly when they had to make decisions based on the outcomes of their choices, but not in decision-making under risk. No group differences were observed in decision-making when feedbacks were random. These results might be explained by the abnormal feedback processing seen in the EEG activity of patients with mTLE-UHS, and by concomitant impairments in working memory, and memory. These impairments may be linked to the disruption of mesial temporal lobe networks. Finally, feedback processing and decision-making under ambiguity were already affected in mTLE-UHS patients pre-surgery and did not show evidence of clear worsening post-surgery.

Pathways to depression: Dynamic associations between neural responses to appetitive cues in the environment, stress, and the development of illness

This review focuses on research my colleagues and I have conducted on etiological pathways to depression. Much of this work has focused on the measurement of neural responses to appetitive cues, using two event-related brain potential (ERP) components, the Late Positive Potential (LPP) and the Reward Positivity (RewP). Reductions in each of these components have been associated with current symptoms of depression, and in some cases have been shown to differentiate anxious from depressive phenotypes. In this review, I will describe three broad and related approaches we have taken in our research to address a series of interdependent issuess. The first attempts to understand different sources of variation in the LPP and RewP, and how these sources interact with one another. The second tries to identify whether variation in the processes measured by these ERP components might reflect a latent vulnerability to depression and its symptoms, that is evident prior to illness onset. And the third examines the possibility that the processes reflected in the LPP and RewP might play a mechanistic role in the development of depression.

Expectations of immediate and delayed reward differentially affect cognitive task performance

The current study used a modified Monetary Incentive Delay task to examine the neural mechanisms underlying anticipating and receiving an immediate or delayed reward and examined the influence of pursuing these rewards on cognitive task performance. A pre-cue indicating the potential of gaining a monetary reward (immediate-, delayed-, vs. no-reward) was followed by a target stimulus requiring a fast and accurate response. Then, response-contingent feedback was presented indicating whether or not the participant would receive the corresponding reward. Linear mixed-effect models revealed the fastest behavioural responses and the strongest neural activity, as reflected in event-related-potentials and event-related-spectral-perturbation responses, for immediate reward, followed by delayed reward, with the slowest behavioural responses and the weakest neural activities observed in the no-reward condition. Expectations related to the cue-P3 component and the cue-delta activities predicted behavioural performance, especially in the immediate reward condition. Moreover, exploratory analyses revealed that depression moderated the relationship between target-locked neural activity and behavioural performance in the delayed reward condition, with lower neural activity being related to worse behavioural performance amongst participants scoring high on depression. These results indicate that differential value representations formed through delay discounting directly affect neural responses in reward processing and directly influence the effort invested in the current task, which is reflected by behavioural responses and is in agreement with the expected value of control theory.

Feedback Processing During Probabilistic Learning in Children With Developmental Language Disorder: An Event-Related Potential Study

PURPOSE

The purpose of this study was to examine feedback processing within the context of probabilistic learning in children with and without developmental language disorder (DLD).

METHOD

The probabilistic category learning task required 28 children ages 8-13 years old to classify novel cartoon animals that differed in five binary features into one of two categories. Performance feedback guided incremental learning of the stimuli classifications. Feedback processing was compared between children with DLD and age-matched children with typical development (TD) by measuring the magnitude of feedback-related event-related potentials. Additionally, the likelihood of each group to repeat a classification of a stimulus following positive feedback ("stay" behavior) and change a classification following negative feedback ("switch" behavior) served as a measure of the consequence of feedback processing.

RESULTS

Children with DLD achieved lower classification accuracy on all learning outcomes compared to their peers with TD. Children with DLD were less likely than those with TD to demonstrate "stay" behavior or to repeat a correct response following positive feedback. "Switch" behavior or changing an incorrect response following negative feedback was found to be at chance level in both groups. Electrophysiological data indicated that children with DLD had a smaller feedback-related negativity effect (i.e., smaller differential processing of positive and negative feedback) when compared to children with TD. Although no differences were found between the two groups in the amplitude of the P3a, strong positive correlations were found between "stay/switch" behavior and the P3a for children in the TD group only.

CONCLUSIONS

Children with DLD do not appear to benefit from incremental corrective feedback to the same extent as their peers with TD. Processing differences are captured in the initial stages of feedback evaluation and in translating information carried by the feedback to inform future actions.

The influence of reward anticipation on conflict control in children and adolescents: Evidences from hierarchical drift-diffusion model and event-related potentials

Reward is deemed a performance reinforcer. The current study investigated how social and monetary reward anticipation affected cognitive control in 39 children, 40 adolescents, and 40 adults. We found that cognitive control performance improved with age in a Simon task, and the reaction time (RT) was modulated by the reward magnitude. The conflict monitoring process (target N2 amplitudes) of adolescents and the attentional control processes (target P3 amplitudes) of adolescents and adults could be adjusted by reward magnitude, suggesting that adolescents were more sensitive to rewards compared to children. Reward magnitudes influenced the neural process of attentional control with larger P3 in congruent trails than that in incongruent trials only in low reward condition. The result of hierarchical drift-diffusion model indicated that children had slower drift rates, higher decision threshold, and longer non-decision time than adolescents and adults. Adolescents had faster drift rates in monetary task than in social task under the high reward condition, and they had faster drift rates under high reward condition than no reward condition only in the monetary task. The correlation analysis further showed that adults' non-decision time and decision threshold correlated with conflict monitoring process (N2 responses) and attentional control process on conflicts (P3 responses). Adolescents' drift rates associated with neural process of attentional control. The current study reveals that reward magnitude and reward type can modulate cognitive control process, especially in adolescents.

EEG time-frequency analysis reveals blunted tendency to approach and increased processing of unpleasant stimuli in dysphoria

To date, affective and cognitive processing of emotional information in individuals with depressive symptoms have been examined through peripheral psychophysiological measures, event-related potentials, and time–frequency analysis of oscillatory activity. However, electrocortical correlates of emotional and cognitive processing of affective content in depression have not been fully understood. Time–frequency analysis of electroencephalographic activity allows disentangling the brain's parallel processing of information. The present study employed a time–frequency approach to simultaneously examine affective disposition and cognitive processing during the viewing of emotional stimuli in dysphoria. Time–frequency event-related changes were examined during the viewing of pleasant, neutral and unpleasant pictures in 24 individuals with dysphoria and 24 controls. Affective disposition was indexed by delta and alpha power, while theta power was employed as a correlate of cognitive elaboration of the stimuli. Cluster-based statistics revealed a centro-parietal reduction in delta power for pleasant stimuli in individuals with dysphoria relative to controls. Also, dysphoria was characterized by an early fronto-central increase in theta power for unpleasant stimuli relative to neutral and pleasant ones. Comparatively, controls were characterized by a late fronto-central and occipital reduction in theta power for unpleasant stimuli relative to neutral and pleasant. The present study granted novel insights on the interrelated facets of affective elaboration in dysphoria, mainly characterized by a hypoactivation of the approach-related motivational system and a sustained facilitated cognitive processing of unpleasant stimuli.

Disentangling performance-monitoring signals encoded in feedback-related EEG dynamics

The feedback-related negativity (FRN) is a well-established electrophysiological correlate of feedback-processing. However, there is still an ongoing debate whether the FRN is driven by negative or positive reward prediction errors (RPE), valence of feedback, or mere surprise. Our study disentangles independent contributions of valence, surprise, and RPE on the feedback-related neuronal signal including the FRN and P3 components using the statistical power of a sample of N = 992 healthy individuals. The participants performed a modified time-estimation task, while EEG from 64 scalp electrodes was recorded. Our results show that valence coding is present during the FRN with larger amplitudes for negative feedback. The FRN is further modulated by surprise in a valence-dependent way being more positive-going for surprising positive outcomes. The P3 was strongly driven by both global and local surprise, with larger amplitudes for unexpected feedback and local deviants. Behavioral adaptations after feedback and FRN just show small associations. Results support the theory of the FRN as a representation of a signed RPE. Additionally, our data indicates that surprising positive feedback enhances the EEG response in the time window of the P3. These results corroborate previous findings linking the P3 to the evaluation of PEs in decision making and learning tasks.

Cognitive Effort Exertion Enhances Electrophysiological Responses to Rewarding Outcomes

Recent work has highlighted neural mechanisms underlying cognitive effort-related discounting of anticipated rewards. However, findings on whether effort exertion alters the subjective value of obtained rewards are inconsistent. Here, we provide a more nuanced account of how cognitive effort affects subsequent reward processing in a novel task designed to assess effort-induced modulations of the Reward Positivity, an event-related potential indexing reward-related neural activity. We found that neural responses to both gains and losses were significantly elevated in trials requiring more versus less cognitive effort. Moreover, time-frequency analysis revealed that these effects were mirrored in gain-related delta, but not in loss-related theta band activity, suggesting that people ascribed more value to high-effort outcomes. In addition, we also explored whether individual differences in behavioral effort discounting rates and reward sensitivity in the absence of effort may affect the relationship between effort exertion and subsequent reward processing. Together, our findings provide evidence that cognitive effort exertion can increase the subjective value of subsequent outcomes and that this effect may primarily rely on modulations of delta band activity.

A biomarker of maternal vicarious reward processing and its association with parenting behavior

Parenting styles play a critical role in child well-being, yet the neural bases of parenting behaviors remain nebulous. Understanding the neural processes associated with parenting styles can both clarify etiological mechanisms underlying parenting behaviors and point us toward new targets for intervention. A novel electrocortical biomarker called the observational reward positivity (oRewP) that occurs in response to observing another receive a reward has been linked to self-reported authoritarian parenting behavior. The current study sought to replicate associations between the oRewP and self-reported and observationally-coded parenting in a sample of mothers selected to be at elevated risk for problematic parenting. Self-reported authoritarian parenting was associated with observationally-coded problematic discipline, while no other self-reported parenting scales were associated with observationally-coded scores. We replicated the previously reported association between a blunted oRewP and increased self-reported authoritarian parenting. We additionally found that an attenuated oRewP was associated with greater permissive parenting, and that only the relationship with permissive parenting was conserved after adjusting for other parenting styles and other relevant covariates. We did not find significant associations between the oRewP and observationally-coded parenting. The current findings suggest that the neural process indexed by the oRewP are relevant to parenting behavior. Further research is needed to better understand the discrepancy between self-reported and observed parenting.

Win, lose, or draw: Examining salience, reward memory, and depression with the reward positivity

The reward positivity (RewP) is a putative biomarker of depression. Careful control of stimulus properties and manipulation of both stimulus valence and salience could facilitate interpretation of the RewP. RewP interpretation could further be improved by investigating functional outcomes of a blunted RewP in depression, such as reduced memory for rewarding outcomes. This study sought to advance RewP interpretation first by advancing task design through use of neutral (i.e., draw) control trials and counterbalanced feedback stimuli. Second, we examined the RewP's association with memory and the impact of depression. Undergraduates completed self-report measures of depression and anhedonia prior to a modified doors task in which words were displayed in colored fonts that indicated win, loss, or draw feedback. Memory of the feedback associated with each word (i.e., source memory) was tested. Results showed that RewP response to wins was more positive than to losses, which was more positive than to draws. The RewP was not associated with depression or anhedonia. The low depression group showed a source memory advantage for win words, but the high depression group did not. Source memory showed small relations to the RewP, but these did not survive Bonferroni correction. Results suggest the RewP is sensitive to salience and highlight challenges in detecting an association between the RewP and depression in modified doors tasks. Findings indicate that depression is related to dysfunctional source memory for reward but not loss and that future research should probe the possible associations between the RewP and memory in depression.

Task Learnability Modulates Surprise but Not Valence Processing for Reinforcement Learning in Probabilistic Choice Tasks

The goal of temporal difference (TD) reinforcement learning is to maximize outcomes and improve future decision-making. It does so by utilizing a prediction error (PE), which quantifies the difference between the expected and the obtained outcome. In gambling tasks, however, decision-making cannot be improved because of the lack of learnability. On the basis of the idea that TD utilizes two independent bits of information from the PE (valence and surprise), we asked which of these aspects is affected when a task is not learnable. We contrasted behavioral data and ERPs in a learning variant and a gambling variant of a simple two-armed bandit task, in which outcome sequences were matched across tasks. Participants were explicitly informed that feedback could be used to improve performance in the learning task but not in the gambling task, and we predicted a corresponding modulation of the aspects of the PE. We used a model-based analysis of ERP data to extract the neural footprints of the valence and surprise information in the two tasks. Our results revealed that task learnability modulates reinforcement learning via the suppression of surprise processing but leaves the processing of valence unaffected. On the basis of our model and the data, we propose that task learnability can selectively suppress TD learning as well as alter behavioral adaptation based on a flexible cost-benefit arbitration.

Reward mechanism of depressive episodes in bipolar disorder: Enhanced theta power in feedback-related negativity

INTRODUCTION

This study aimed to explore the reward-related neural mechanism in patients with depressive mood in bipolar disorder (BD) using event-related potentials. It remains unknown whether or not different neurobiological markers underlying depression symptoms in BD depression and major depression disorder (MDD).

METHODS

24 patients with BD depression and 20 healthy controls were included. Participants underwent evaluation with the Temporal Experience of Pleasure Scale (TEPS), followed by the classical gambling paradigm, while undergoing 64-channel electroencephalography. The waveform of feedback-related negativity (FRN) was extracted from the 250-350 ms time-window after participants received feedback regarding loss or gain. Event-related potential datasets were obtained using time-frequency analysis.

RESULTS

(1) The TEPS scores of the patients were significantly lower than those of the controls [t₍₄₂₎ = 5.16, p < 0.01]. (2) The event of loss elicited a deeper FRN in patients than that in controls [t₍₄₂₎ = 2.19, p < 0.05], while no difference was observed in the event of gains (t₍₄₂₎ = 1.12, p > 0.05). (3) Theta power rooted in FRN in patients was significantly higher in loss than in gain [F_(1,42) = 30.32, p < 0.01]. (4) Analysis of Variance (ANOVA) illustrated the interaction effect of theta power in gain/loss between two groups [F_(1,42) = 3.59, p = 0.06].

LIMITATION

Our study did not analyze the effect of different drugs which might affect our results.

CONCLUSION

The enhanced reflection of negative feedback was consistent with the negative bias, impulse control impairment, and emotional dysregulation observed in the bipolar disorder spectrum. We suggested that the extreme theta power generated from the anterior cingulate gyrus (ACC) might be the main component of abnormal FRN.

Electrophysiological underpinnings of reward processing: Are we exploiting the full potential of EEG?

Understanding how the brain processes reward is an important and complex endeavor, which has involved the use of a range of complementary neuroimaging tools, including electroencephalography (EEG). EEG has been praised for its high temporal resolution but, because the signal recorded at the scalp is a mixture of brain activities, it is often considered to have poor spatial resolution. Besides, EEG data analysis has most often relied on event-related potentials (ERPs) which cancel out non-phase locked oscillatory activity, thus limiting the functional discriminative power of EEG attainable through spectral analyses. Because these three dimensions -temporal, spatial and spectral- have been unequally leveraged in reward studies, we argue that the full potential of EEG has not been exploited. To back up our claim, we first performed a systematic survey of EEG studies assessing reward processing. Specifically, we report on the nature of the cognitive processes investigated (i.e., reward anticipation or reward outcome processing) and the methods used to collect and process the EEG data (i.e., event-related potential, time-frequency or source analyses). A total of 359 studies involving healthy subjects and the delivery of monetary rewards were surveyed. We show that reward anticipation has been overlooked (88% of studies investigated reward outcome processing, while only 24% investigated reward anticipation), and that time-frequency and source analyses (respectively reported by 19% and 12% of the studies) have not been widely adopted by the field yet, with ERPs still being the dominant methodology (92% of the studies). We argue that this focus on feedback-related ERPs provides a biased perspective on reward processing, by ignoring reward anticipation processes as well as a large part of the information contained in the EEG signal. Finally, we illustrate with selected examples how addressing these issues could benefit the field, relying on approaches combining time-frequency analyses, blind source separation and source localization.

Sequential gains and losses during gambling feedback: Differential effects in time-frequency delta and theta measures

One critical aspect of reward-feedback is the impact of local outcome history-how past experiences with choices and outcomes influences current behavior and neural activity. Yet, prior event-related potential work in this area has been contentious. This study contributes to this field by using time-frequency measures to better isolate constituent processes. Specifically, we identify how theta and delta are differentially sensitive to local outcome history. Participants completed a binary monetary choice task while we collected EEG data. Unbeknownst to them, trial outcomes were manipulated into pre-determined sequences, ranging from one to eight gains or losses in a row. Analyses were arranged by sequence establishment (first 2 trials of a sequence) and continuation (prolonged sequences of 3-8 trials). During the establishment of a sequence, delta activity to gains and losses were virtually identical on the first (change) trial, demonstrating marked divergence only on the second trial. This difference grew throughout the continuation period, as delta activity was sustained with accruing gains but declined with multiple losses. Theta activity, conversely, demonstrated a maximal loss-gain difference on the change trial but was insensitive to the establishment of a new sequence. Differential theta activity between outcomes decreased as sequences continued, with theta activity increasing over accruing gains and remaining stable over losses. Results indicate that delta-gain and theta-loss signals are relatively stable across sequential outcomes. Furthermore, theta is most sensitive to loss-gain differences on the initial change trial, while delta is more sensitive to gain-loss differences with the continuation of a sequence.

Single-trial modeling separates multiple overlapping prediction errors during reward processing in human EEG

Learning signals during reinforcement learning and cognitive control rely on valenced reward prediction errors (RPEs) and non-valenced salience prediction errors (PEs) driven by surprise magnitude. A core debate in reward learning focuses on whether valenced and non-valenced PEs can be isolated in the human electroencephalogram (EEG). We combine behavioral modeling and single-trial EEG regression to disentangle sequential PEs in an interval timing task dissociating outcome valence, magnitude, and probability. Multiple regression across temporal, spatial, and frequency dimensions characterized a spatio-tempo-spectral cascade from early valenced RPE value to non-valenced RPE magnitude, followed by outcome probability indexed by a late frontal positivity. Separating negative and positive outcomes revealed the valenced RPE value effect is an artifact of overlap between two non-valenced RPE magnitude responses: frontal theta feedback-related negativity on losses and posterior delta reward positivity on wins. These results reconcile longstanding debates on the sequence of components representing reward and salience PEs in the human EEG.

Electrophysiological investigation of reward anticipation and outcome evaluation during slot machine play

Slot machines are a popular form of gambling, offering a tractable way to experimentally model reward processes. This study used a 3-reel slot paradigm to assess psychologically distinct phases of reward processing, reflecting anticipation, and early- and late-stage outcome processing. EEG measures of winning, nearly missing (a losing outcome revealed at the final, third reel), and "totally" missing (a losing outcome revealed earlier, at the second reel) were collected from healthy adults (n=54). Condition effects were evaluated in: i) event-related potential (ERP) components reflecting anticipatory attention (stimulus preceding negativity, SPN) and outcome processing (reward positivity, RewP and late-positive potential, LPP) and ii) total power and phase synchrony of theta and delta band oscillations. Behaviorally, trial initiation was fastest after a near miss outcome and slowest after a winning outcome. As expected, a significant SPN was observed for possible wins (AA) vs. total misses (AB), consistent with reward anticipation. Larger win (AAA) vs. near miss (AAB) amplitudes were observed for the RewP; LPP amplitudes were largest for wins (AAA), intermediate for near misses (AAB), and smallest for total misses (ABC), reflecting significant early (RewP) and late-stage (LPP) outcome processing effects. There was an effect of reel position on the RewP, with larger amplitude in the final reel (AAA-AAB) relative to the 2nd-reel locked difference waves (AA-AB). Across all outcomes, near misses elicited the largest and most phase-synchronized theta responses, while wins elicited larger and more phase-synchronized delta responses than total misses, with delta band measures not distinguishing between near misses and wins. . Phase locking measures contrasting win vs. near miss delta and theta synchronization, within time windows corresponding to ERP measurements, covaried with RewP, but not SPN or LPP, amplitude. Lastly, EEG measures showed differential relationships with age and self-reported consummatory pleasure. In the context of slot machine play, where reward anticipation and attainment place minimal demands on effort and skill, ERP and time-frequency methods capture distinct neurophysiological signatures of reward anticipation and outcome processing.

The Relationship Between Depression Symptoms and Adolescent Neural Response During Reward Anticipation and Outcome Depends on Developmental Timing: Evidence From a Longitudinal Study

BACKGROUND

Blunted neural reward responsiveness (RR) is observed in youth depression. However, it is unclear whether symptoms of depression experienced early in development relate to adolescent RR beyond current symptoms and, further, whether such relationships with RR differ during two key components of reward processing: anticipation and outcome.

METHODS

Within a prospective longitudinal study oversampled for early depression, children and caregivers completed semiannual diagnostic assessments beginning in preschool. In later adolescence, mean age = 16.49 years (SD = 0.94), youths' (N = 100) neurophysiological responses to cues signaling likely win and loss and these outcomes were assessed. Longitudinally assessed dimensional depression and externalizing symptoms (often comorbid with depression as well as associated with RR) experienced at different developmental periods (preschool [age 3-5.11 years], school age [6-9.11 years], early adolescence [10-14.11 years], current) were used as simultaneous predictors of event-related potentials indexing anticipatory cue processing (cue-P3) and outcome processing (reward positivity/feedback negativity and feedback-P3).

RESULTS

Blunted motivated attention to cues signaling likely win (cue-P3) was specifically predicted by early-adolescent depression symptoms. Blunted initial response to win (reward positivity) and loss (feedback negativity) outcomes was specifically predicted by preschool depression symptoms. Blunted motivational salience of win and loss outcomes (feedback-P3) was predicted by cumulative depression, not specific to any developmental stage.

CONCLUSIONS

Although blunted anticipation and outcome RR is a common finding in depression, specific deficits related to motivated attention to cues and initial outcome processing may map onto the developmental course of these symptoms.

Self-awareness buffers the consequences of negative feedback: Evidence from an ERP study

Previous studies have found that self-awareness can help people to recruit more cognitive resources, while people with more cognitive resources can better buffer the detrimental effects of negative events. However, it is not clear whether self-awareness can directly buffer the consequences of negative feedback (i.e., reducing neural sensitivity to negative feedback). To explore this issue, we used a scrambled sentence task (SST) to manipulate participants' self-awareness (self vs. other) and investigated whether outcome evaluations in a gambling task are modulated by the self-awareness priming. Event-related brain potentials (ERPs) were recorded while 27 normal adults performed a gambling task. The ERP analysis focused on the feedback-related negativity (FRN), reward positivity (RewP) and P300 component. We found that the self-awareness priming resulted in a smaller FRN response to the losses compared with the other-awareness priming. There was no significant difference in the RewP response to wins between the self-awareness condition and the other-awareness condition. We also found that the self-awareness condition evoked larger P300 amplitude than the other-awareness condition. The present findings suggest that self-awareness can help people to cope with negative feedback in the early semiautomatic outcome evaluation stage (i.e., reducing neural sensitivity to negative feedback) and enhance top-down evaluation to both positive and negative feedback in the late and deliberate stage, providing direct evidence of the adaptive function of self-awareness on outcome experience.

Cannabis users demonstrate enhanced neural reactivity to reward: An event-related potential and time-frequency EEG study

INTRODUCTION

Disruptions in neural measures of reward responsiveness are implicated in risk for and the development of Substance Use Disorders (SUDs) in general, but it is not clear if this is also true for Cannabis Use Disorder (CUD). To date, no studies have examined neural reward responsiveness in cannabis users using EEG.

METHODS

Cannabis users (CU; n = 67) and non-users (n = 60) were drawn from larger studies of individuals with and without internalizing and externalizing psychopathology. Groups were matched on current and lifetime psychopathology. Participants completed a validated monetary reward task during electroencephalogram (EEG). One-way between subject analysis of covariance (ANCOVA) models examined group differences in four EEG indicators of reward responsiveness - the reward positivity (RewP) and feedback negativity (FN) event-related potentials and two time-frequency measures (reward-related delta and loss-related theta).

RESULTS

CU demonstrated an enhanced RewP to the attainment of monetary reward compared to non-users (p = .004), even after controlling for relevant covariates. Secondary analyses found that occasional CU, but not current CUD or remitted CUD, showed enhanced RewP compared to non-users. There were no significant differences in FN, reward-related delta, or loss-related theta time-frequency measures between groups.

CONCLUSIONS

To our knowledge, this is the first study to show preliminary evidence that CU have an enhanced RewP to reward and the extent of disruption may be related to CUD status. Our findings suggest that greater neural reward responsiveness may only be seen among occasional CU, not necessarily among CU with current or remitted CUD.

Emotion context insensitivity in depression: Toward an integrated and contextualized approach

Major depressive disorder (MDD) is characterized by pervasive mood disturbance as well as deficits in emotional processing, reactivity, and regulation. There is accumulating evidence that MDD is characterized by emotional patterns consistent with environmental disengagement, as reflected in attenuated positive and negative emotional reactivity, consistent with Emotion Context Insensitivity (ECI) theory. However, MDD individuals vary considerably in the extent to which they exhibit specific alterations in patterns of emotional responding. Emotions are complex, multicomponent processes that invoke responses across multiple functional domains and levels of analysis, including subjective experience, behavior, autonomic regulation, cognition, and neural processing. In this article, I review the current state of the literature on emotional responding and MDD from the lens of ECI. I focus on the importance of assessing emotional indices from multiple levels of analysis across development and contexts. I also discuss methodological and measurement issues that may contribute to inconsistent findings. In particular, I emphasize how psychophysiological measures can help elucidate emotional processes that underlie the pathophysiology of MDD as part of an integrated and contextualized approach.

Neural processing of iterated prisoner's dilemma outcomes indicates next-round choice and speed to reciprocate cooperation

The iterated prisoner's dilemma (iPD) game is a well-established model for testing how people cooperate, and the neural processes that unfold after its distinct outcomes have been partly described. Recent theoretical models suggest evolution favors intuitive cooperation, which raises questions on the behavioral but also neural timelines involved. We studied the outcome/feedback stage of iPD rounds with electroencephalography (EEG) methods. Results showed that neural signals associated with this stage also relate to future choice, in an outcome-dependent manner: (i) after zero-gain "sucker's payoffs" (unreciprocated cooperation), a participant's decision thereafter relates to changes to the feedback-related negativity (FRN); (ii) after one-sided non-cooperation (participant wins at co-player's expense), by the P3; (iii) after mutual cooperation, by late frontal delta-band modulations. Critically, faster reciprocation behavior towards a co-player's choice to cooperate was predicted, on a single-trial basis, by players' P3 and frontal delta modulations at the immediately preceding trial. Delta-band signaling is discussed in relation to homeostatic regulation processing in the literature. The findings relate the early outcome/feedback stage to subsequent decisional processes in the iPD, providing a first neural account of the brief timelines implied in heuristic modes of cooperation.

The ERP, frequency, and time-frequency correlates of feedback processing: Insights from a large sample study

Human learning, at least in part, appears to be dependent on the evaluation of how outcomes of our actions align with our expectations. Over the past 23 years, electroencephalography (EEG) has been used to probe the neural signatures of feedback processing. Seminal work demonstrated a difference in the human event-related potential (ERP) dependent on whether people were processing correct or incorrect feedback. Since then, these feedback evoked ERPs have been associated with reinforcement learning and conflict monitoring, tied to subsequent behavioral adaptations, and shown to be sensitive to a wide range of factors (e.g., Parkinson's disease). Recently, research has turned to frequency decomposition techniques to examine how changes in the EEG power spectra are related to underlying learning mechanisms. Although the literature on the neural correlates of feedback processing is vast, there are still methodological discrepancies and differences in results across studies. Here, we provide reference results and an investigation of methodological considerations for the ERP (reward positivity) and frequency (delta and theta power) correlates of feedback evaluation with a large sample size. Specifically, participants (n = 500) performed a two-armed bandit task while we recorded EEG. Our findings provide key information about the data characteristics and relationships that exist between the neural signatures of feedback evaluation. Additionally, we conclude with selected methodological recommendations for standardization of future research. All data and scripts are freely provided to facilitate open science.

Cingulate oscillatory activity reflects the quality of memory representations in visuospatial working memory

The human brain has the high likelihood for committing errors when confronted by a day-to-day situation that demands to process more than four integrated items in working memory, for example driving a car to a new destination in high traffic. However, neural mechanisms underlying the response outcome in working memory is still unclear. High temporal resolution and improved spatial resolution of dense array electroencephalogram (EEG) make it an ideal tool to investigate the dynamics of brain networks. In the present study, the brain activity of twenty healthy male volunteers was investigated during correct and error trials of visuospatial working memory task using dense array EEG. Independent brain components were identified using independent component analysis (ICA). Event-related spectral perturbations (ERSP) were computed for each independent component using Morlet wavelet transform for the frequency range of 3-70 Hz. ERSP of independent component clusters identified using K-means algorithm were statistically compared between correct and error trials. Delta and theta power increased in the component cluster located at cingulate gyrus before the error response of visuospatial working memory task. The current study findings suggest that cingulate oscillatory activity might reflect the quality of memory representation and intensity of target uncertainty during the visuospatial search.

Neural response to rewards predicts risk-taking in late but not early adolescent females

Risk-taking peaks in adolescence and reflects, in part, hyperactivity of the brain's reward system. However, it has not been established whether the association between reward-related brain activity and risk-taking varies across adolescence. The present study investigated how neural reward sensitivity is associated with laboratory risk-taking in a sample of female adolescents as a function of age. Sixty-three female adolescents ages 10-19 completed the Balloon Analogue Risk Task, a laboratory measure of risk-taking behavior, as well as a forced choice monetary gambling task while an electroencephalogram (EEG) was recorded. This gambling task elicits the reward positivity (RewP), a frontocentral event-related potential component that is sensitive to feedback signaling reward. We observed a negative quadratic association between age and risk-taking, such that those in early and late adolescence had lower relative risk-taking compared to mid-adolescence, with risk-taking peaking at around 15 years of age. In predicting risk-taking, we observed an interaction between age and RewP, such that reward-related brain activity was not associated with risk-taking in early adolescence but was associated with a greater propensity for risk in later adolescence. These findings suggest that for females, neural response to rewards is an important factor in predicting risk-taking only in later adolescence.

EEG correlates of physical effort and reward processing during reinforcement learning

Effort-based decision making is often modeled using subjective value, a function of reward discounted by effort. We asked whether EEG event-related potential (ERP) correlates of reward processing are also modulated by physical effort. Human participants performed a task in which they were required to accurately produce target levels of muscle activation to receive rewards. Quadriceps muscle activation was recorded with electromyography (EMG) during isometric knee extension. On a given trial, the target muscle activation required either low or high effort. The effort was determined probabilistically according to a binary choice, such that the responses were associated with 20% and 80% probability of high effort. This contingency could only be learned through experience, and it reversed periodically. Binary reinforcement feedback depended on accurately producing the target muscle activity. Participants adaptively avoided effort by switching responses more frequently after choices that resulted in hard effort. Feedback after participants' choices that revealed the resulting effort requirement did not elicit modulation of the feedback-related negativity/reward positivity (FRN/RP). However, the neural response to reinforcement outcome after effort production was increased by preceding physical effort. Source decomposition revealed separable early and late positive deflections contributing to the ERP. The main effect of reward outcome, characteristic of the FRN/RP, loaded onto the earlier component, whereas the reward × effort interaction was observed only in the later positivity, which resembled the P300. Thus, retrospective effort modulates reward processing. This may explain paradoxical behavioral findings whereby rewards requiring more effort to obtain can become more powerful reinforcers.NEW & NOTEWORTHY Choices probabilistically determined the physical effort requirements for a subsequent task, and reward depended on task performance. Feedback revealing whether choices resulted in easy or hard effort did not elicit reinforcement learning signals. However, the neural responses to reinforcement were modulated by preceding effort. Thus, effort itself was not treated as loss or punishment, but it affected the responses to subsequent reinforcement outcomes. This may explain how effort can enhance the motivational effect of reward.