Event-related brain potentials and the study of reward processing: Methodological considerations

Aberrant social reward dynamics in individuals with melancholic major depressive disorder: An ERP study

BACKGROUND

Compared to monetary rewards, depressive symptoms are specifically associated with abnormal social reward processing. In addition, individuals with melancholic depression may exhibit more significant reward-related impairments. However, there is still limited understanding of the specific alterations in social reward processing in individuals with melancholic depression.

METHODS

Forty patients with melancholic major depressive disorder (MDD), forty patients with non-melancholic MDD, and fifty healthy controls participated in the social incentive delay (SID) tasks with event-related potential (ERP) recording. We measured one anticipatory ERP(cue-N2) and two consummatory ERPs (FRN, fb-P3). Furthermore, we examined correlation between FRN and consummatory anhedonia.

RESULTS

Melancholic MDD patients showed less anticipation of social rewards (cue-N2). Concurrently, melancholic individuals demonstrated diminished reception of social rewards, as evidenced by reduced amplitudes of FRN. Notably, the group x condition interaction effect on FRN was significant (F (2, 127) = 4.15, p = 0.018, η2ρ = 0.061). Melancholic MDD patients had similar neural responses to both gain and neutral feedback (blunted reward positivity), whereas non-melancholic MDD patients (t (39) = 3.09, p = 0.004) and healthy participants (t (49) = 5.25, p < 0.001) had smaller FRN amplitudes when receiving gain feedback relative to neutral feedback. In addition, there was a significant correlation between FRN and consummatory anhedonia in MDD patients.

CONCLUSIONS

Our findings indicated that individuals with melancholic MDD exhibit attenuated neural responses to both anticipated and consumed social rewards. This suggests that aberrant processing of social rewards could serve as a potential biomarker for melancholic MDD.

Beyond peaks and troughs: Multiplexed performance monitoring signals in the EEG

With the discovery of event-related potentials elicited by errors more than 30 years ago, a new avenue of research on performance monitoring, cognitive control, and decision making emerged. Since then, the field has developed and expanded fulminantly. After a brief overview on the EEG correlates of performance monitoring, this article reviews recent advancements based on single-trial analyses using independent component analysis, multiple regression, and multivariate pattern classification. Given the close interconnection between performance monitoring and reinforcement learning, computational modeling and model-based EEG analyses have made a particularly strong impact. The reviewed findings demonstrate that error- and feedback-related EEG dynamics represent variables reflecting how performance-monitoring signals are weighted and transformed into an adaptation signal that guides future decisions and actions. The model-based single-trial analysis approach goes far beyond conventional peak-and-trough analyses of event-related potentials and enables testing mechanistic theories of performance monitoring, cognitive control, and decision making.

Electrical brain activations in preadolescents during a probabilistic reward-learning task reflect cognitive processes and behavioral strategy

Both adults and children learn through feedback which environmental events and choices are associated with higher probability of reward, an ability thought to be supported by the development of fronto-striatal reward circuits. Recent developmental studies have applied computational models of reward learning to investigate such learning in children. However, tasks and measures effective for assaying the cascade of reward-learning neural processes in children have been limited. Using a child-version of a probabilistic reward-learning task while recording event-related-potential (ERP) measures of electrical brain activity, this study examined key processes of reward learning in preadolescents (8-12 years old; n=30), namely: (1) reward-feedback sensitivity, as measured by the early-latency, reward-related, frontal ERP positivity, (2) rapid attentional shifting of processing toward favored visual stimuli, as measured by the N2pc component, and (3) longer-latency attention-related responses to reward feedback as a function of behavioral strategies (i.e., Win-Stay-Lose-Shift), as measured by the central-parietal P300. Consistent with our prior work in adults, the behavioral findings indicate preadolescents can learn stimulus-reward outcome associations, but at varying levels of performance. Neurally, poor preadolescent learners (those with slower learning rates) showed greater reward-related positivity amplitudes relative to good learners, suggesting greater reward-feedback sensitivity. We also found attention shifting towards to-be-chosen stimuli, as evidenced by the N2pc, but not to more highly rewarded stimuli as we have observed in adults. Lastly, we found the behavioral learning strategy (i.e., Win-Stay-Lose-Shift) reflected by the feedback-elicited parietal P300. These findings provide novel insights into the key neural processes underlying reinforcement learning in preadolescents.

Does effort increase or decrease reward valuation? Considerations from cognitive dissonance theory

The present research tested the effect of manipulated perceived control (over obtaining the outcomes) and effort on reward valuation using the event-related potential known as the Reward Positivity (RewP). This test was conducted in an attempt to integrate two research literatures with opposite findings: Effort justification occurs when high effort leads to high reward valuation, whereas effort discounting occurs when high effort leads to low reward valuation. Based on an examination of past methods used in these literatures, we predicted that perceived control and effort would interactively influence RewP. Consistent with the effort justification literature (cognitive dissonance theory), when individuals have high perceived control, high effort should lead to more reward valuation than low effort should. Consistent with the effort discounting literature, when individuals have low perceived control, low effort should lead to more reward valuation than high effort should. Results supported these interactive and integrative predictions.

A meta-analysis of electrophysiological biomarkers of reward and error monitoring in substance misuse

Substance use disorders are characterized by marked changes in reward and error processing. The primary objective of this meta-analysis was to estimate effect sizes for the reward positivity (RewP) and error-related negativity (ERN), two event-related potential indicators of outcome monitoring, in substance users compared to controls. The secondary objective was to test for moderation by demographic, substance type, and EEG experiment parameters. Final PubMed searches were performed in August 2023. Inclusion criteria were substance use disorder/dependence or validated self-report of substance misuse, RewP/ERN means available, healthy control comparison group, non-acute drug study, peer-reviewed journal, English language, and human participants. Selection bias was tested through modified Egger's regression and exploratory 3-parameter selection model tests. The RewP results (19 studies, 1641 participants) did not support an overall effect (Hedges' g = 0.07, 95% CI [-0.44, 0.58], p = .777) and nor effect of any moderators. The ERN results (20 studies, 1022 participants) indicated no significant overall effect (g = 0.41, 95%CI [-0.05, 0.88]). Subgroup analyses indicated that cocaine users had a blunted ERN compared to controls (g = 1.12, 95%CI [0.77, 1.47]). There was limited evidence for publication/small study bias. Although the results indicate a potential dissociation between substance types, this meta-analysis revealed the need for additional research on the RewP/ERN in substance using populations and for better designed experiments that adequately address research questions.

Prediction-error-dependent processing of immediate and delayed positive feedback

Learning often involves trial-and-error, i.e. repeating behaviours that lead to desired outcomes, and adjusting behaviour when outcomes do not meet our expectations and thus lead to prediction errors (PEs). PEs have been shown to be reflected in the reward positivity (RewP), an event-related potential (ERP) component between 200 and 350 ms after performance feedback which is linked to striatal processing and assessed via electroencephalography (EEG). Here we show that this is also true for delayed feedback processing, for which a critical role of the hippocampus has been suggested. We found a general reduction of the RewP for delayed feedback, but the PE was similarly reflected in the RewP and the later P300 for immediate and delayed positive feedback, while no effect was found for negative feedback. Our results suggest that, despite processing differences between immediate and delayed feedback, positive PEs drive feedback processing and learning irrespective of delay.

Machine learning reveals differential effects of depression and anxiety on reward and punishment processing

Recent studies suggest that depression and anxiety are associated with unique aspects of EEG responses to reward and punishment, respectively; also, abnormal responses to punishment in depressed individuals are related to anxiety, the symptoms of which are comorbid with depression. In a non-clinical sample, we aimed to investigate the relationships between reward processing and anxiety, between punishment processing and anxiety, between reward processing and depression, and between punishment processing and depression. Towards this aim, we separated feedback-related brain activity into delta and theta bands to isolate activity that indexes functionally distinct processes. Based on the delta/theta frequency and feedback valence, we then used machine learning (ML) to classify individuals with high severity of depressive symptoms and individuals with high severity of anxiety symptoms versus controls. The significant difference between the depression and control groups was driven mainly by delta activity; there were no differences between reward- and punishment-theta activities. The high severity of anxiety symptoms was marginally more strongly associated with the punishment- than the reward-theta feedback processing. The findings provide new insights into the differences in the impacts of anxiety and depression on reward and punishment processing; our study shows the utility of ML in testing brain-behavior hypotheses and emphasizes the joint effect of theta-RewP/FRN and delta frequency on feedback-related brain activity.

The impact of electrode selection for ocular correction on the reward positivity and late positive potential components in adolescents

Electroencephalography (EEG) data processing to derive event-related potentials (ERPs) follows a standard set of procedures to maximize signal-to-noise ratio. This often includes ocular correction, which corrects for artifacts introduced by eye movements, typically measured by electrooculogram (EOG) using facial electrodes near the eyes. Yet, attaching electrodes to the face may be uncomfortable for some populations, best to avoid in some situations, and contribute to data loss. Eye movements can also be measured using electrodes in a standard 10-20 EEG cap. An examination of the impact of electrode selection on ERPs is needed to inform best practices. The present study examined data quality when using different electrodes to measure eye movements for ocular correction (i.e., facial electrodes, cap electrodes, and no ocular correction) for two well-established and widely studied ERP components (i.e., reward positivity, RewP; and late positive potential, LPP) elicited in adolescents (N = 34). Results revealed comparable split-half reliability and standardized measurement error (SME) between facial and cap electrode approaches, with lower SME for the RewP with facial or cap electrodes compared to no ocular correction. Few significant differences in mean amplitude of ERPs were observed, but the LPP to positive images differed when using facial compared to cap electrodes. Findings provide preliminary evidence of the ability to collect high-quality ERP data without facial electrodes. However, when using cap electrodes for EOG measurement and ocular correction, it is recommended to use consistent procedures across the sample or statistically examine the impact of ocular correction procedures on results.

Neurocognitive reward processes measured via event-related potentials are associated with binge-eating disorder diagnosis and ecologically-assessed behavior

Altered reward processing has been implicated in the onset and maintenance of binge-eating disorder (BED). However, it is unclear which precise neurocognitive reward processes may contribute to BED. In the present study, 40 individuals with BED and 40 age-, sex-, and BMI-matched controls completed a reward (incentive delay) task while their neural activity was recorded using electroencephalography (EEG). Individuals with BED also completed a 10-day ecological momentary assessment (EMA) protocol assessing binge-eating behavior in the natural environment. Event-related potential (ERP) analysis of the EEG indicated that individuals with BED had stronger anticipatory (CNV) and outcome-related (RewP) neural reward activity to food and monetary rewards, compared to controls. However, within the BED group, greater frequency of binge eating during the EMA protocol was associated with stronger anticipatory (CNV) but weaker outcome-related (RewP) neural reward activity. These associations within the BED group were unique to food, and not monetary, rewards. Although preliminary, these results suggest that both anticipatory ("wanting") and outcome ("liking") reward processes may be generally amplified in BED. However, they also suggest that among individuals with BED, disorder severity may be associated with increased anticipatory reward processes ("wanting"), but relatively decreased reward-outcome processing ("liking"), of food rewards specifically.

Feedback negativity and feedback-related P3 in individuals at risk for depression: Comparing surface potentials and current source densities

Blunted responses to reward feedback have been linked to major depressive disorder (MDD) and depression risk. Using a monetary incentive delay task (win, loss, break-even), we investigated the impact of family risk for depression and lifetime history of MDD and anxiety disorder with 72-channel electroencephalograms (EEG) recorded from 29 high-risk and 32 low-risk individuals (15-58 years, 30 male). Linked-mastoid surface potentials (ERPs) and their corresponding reference-free current source densities (CSDs) were quantified by temporal principal components analysis (PCA). Each PCA solution revealed a midfrontal feedback negativity (FN; peak around 310 ms) and a posterior feedback-P3 (fb-P3; 380 ms) as two distinct reward processing stages. Unbiased permutation tests and multilevel modeling of component scores revealed greater FN to loss than win and neutral for all stratification groups, confirming FN sensitivity to valence. Likewise, all groups had greater fb-P3 to win and loss than neutral, confirming that fb-P3 indexes motivational salience and allocation of attention. By contrast, group effects were subtle, dependent on data transformation (ERP, CSD), and did not confirm reduced FN or fb-P3 for at-risk individuals. Instead, CSD-based fb-P3 was overall reduced in individuals with than without MDD history, whereas ERP-based fb-P3 was greater for high-risk individuals than for low-risk individuals for monetary, but not neutral outcomes. While the present findings do not support blunted reward processing in depression and depression risk, our side-by-side comparison underscores how the EEG reference choice affects the characterization of subtle group differences, strongly advocating the use of reference-free techniques.

Distinct processing of the state prediction error signals in frontal and parietal correlates in learning the environment model

Goal-directed reinforcement learning constructs a model of how the states in the environment are connected and prospectively evaluates action values by simulating experience. State prediction error (SPE) is theorized as a crucial signal for learning the environment model. However, the underlying neural mechanisms remain unclear. Here, using electroencephalogram, we verified in a two-stage Markov task two neural correlates of SPEs: an early negative correlate transferring from frontal to central electrodes and a late positive correlate over parietal regions. Furthermore, by investigating the effects of explicit knowledge about the environment model and rewards in the environment, we found that, for the parietal correlate, rewards enhanced the representation efficiency (beta values of regression coefficient) of SPEs, whereas explicit knowledge elicited a larger SPE representation (event-related potential activity) for rare transitions. However, for the frontal and central correlates, rewards increased activities in a content-independent way and explicit knowledge enhanced activities only for common transitions. Our results suggest that the parietal correlate of SPEs is responsible for the explicit learning of state transition structure, whereas the frontal and central correlates may be involved in cognitive control. Our study provides novel evidence for distinct roles of the frontal and the parietal cortices in processing SPEs.

The neural correlates of continuous feedback processing

Feedback processing is commonly studied by analyzing the brain's response to discrete rather than continuous events. Such studies have led to the hypothesis that rapid phasic midbrain dopaminergic activity tracks reward prediction errors (RPEs), the effects of which are measurable at the scalp via electroencephalography (EEG). Although studies using continuous feedback are sparse, recent animal work suggests that moment-to-moment changes in reward are tracked by slowly ramping midbrain dopaminergic activity. Some have argued that these ramping signals index state values rather than RPEs. Our goal here was to develop an EEG measure of continuous feedback processing in humans, then test whether its behavior could be accounted for by the RPE hypothesis. Participants completed a stimulus-response learning task in which a continuous reward cue gradually increased or decreased over time. A regression-based unmixing approach revealed EEG activity with a topography and time course consistent with the stimulus-preceding negativity (SPN), a scalp potential previously linked to reward anticipation and tonic dopamine release. Importantly, this reward-related activity depended on outcome expectancy: as predicted by the RPE hypothesis, activity for expected reward cues was reduced compared to unexpected reward cues. These results demonstrate the possibility of using human scalp-recorded potentials to track continuous feedback processing, and test candidate hypotheses of this activity.

Comparing monetary gain and loss in the monetary incentive delay task: EEG evidence

What is more effective to guide behavior: The desire to gain or the fear to lose? Electroencephalography (EEG) studies have yielded inconsistent answers. In a systematic exploration of the valence and magnitude parameters in monetary gain and loss processing, we used time-domain and time-frequency-domain analyses to uncover the underlying neural processes. A group of 24 participants performed a monetary incentive delay (MID) task in which cue-induced anticipation of a high or low magnitude of gain or loss was manipulated trial-wise. Behaviorally, the anticipation of both gain and loss expedited responses, with gain anticipation producing greater facilitation than loss anticipation. Analyses of cue-locked P2 and P3 components revealed the significant valence main effect and valence × magnitude interaction: amplitude differences between high and low incentive magnitudes were larger with gain vs. loss cues. However, the contingent negative variation component was sensitive to incentive magnitude but did not vary with incentive valence. In the feedback phase, the RewP component exhibited reversed patterns for gain and loss trials. Time-frequency analyses revealed a large increase in delta/theta-ERS oscillatory activity in high- vs. low-magnitude conditions and a large decrease of alpha-ERD oscillatory activity in gain vs. loss conditions in the anticipation stage. In the consumption stage, delta/theta-ERS turned out stronger for negative than positive feedback, especially in the gain condition. Overall, our study provides new evidence for the neural oscillatory features of monetary gain and loss processing in the MID task, suggesting that participants invested more attention under gain and high-magnitude conditions vs. loss and low-magnitude conditions.

Feedback processing in cognitive and motor tasks: A meta-analysis on the feedback-related negativity

For motor learning, the processing of behavioral outcomes is of high significance. The feedback-related negativity (FRN) is an event-related potential, which is often described as a correlate of the reward prediction error in reinforcement learning. The number of studies examining the FRN in motor tasks is increasing. This meta-analysis summarizes the component in the motor domain and compares it to the cognitive domain. Therefore, a data set of a previous meta-analysis in the cognitive domain that comprised 47 studies  was reanalyzed and compared to additional 25 studies of the motor domain. Further, a moderator analysis for the studies in the motor domain was conducted. The FRN amplitude was higher in the motor domain than in the cognitive domain. This might be related to a higher task complexity and a higher feedback ambiguity of motor tasks. The FRN latency was shorter in the motor domain than in the cognitive domain. Given that sensory information can be used as an external feedback predictor prior to the presentation of the final feedback, reward processing in the motor domain may have been faster and reduced the FRN latency. The moderator variable analysis revealed that the feedback modality influenced the FRN latency, with shorter FRN latencies after bimodal than after visual feedback. Processing of outcome feedback seems to share basic principles in both domains; however, differences exist and should be considered in FRN studies. Future research is motivated to scrutinize the effects of bimodal feedback and other moderators within the motor domain.

Neurophysiological and Psychometric Outcomes in Minimal Consciousness State after Advanced Audio-Video Emotional Stimulation: A Retrospective Study

In the last ten years, technological innovations have led to the development of new, advanced sensory stimulation (SS) tools, such as PC-based rehabilitative programs or virtual reality training. These are meant to stimulate residual cognitive abilities and, at the same time, assess cognition and awareness, also in patients with a minimally conscious state (MCS). Our purpose was to evaluate the clinical and neurophysiological effects of multi-sensory and emotional stimulation provided by Neurowave in patients with MCS, as compared to a conventional SS treatment. The psychological status of their caregivers was also monitored. In this retrospective study, we have included forty-two MCS patients and their caregivers. Each MCS subject was included in either the control group (CG), receiving a conventional SS, or the experimental group (EG), who was submitted to the experimental training with the Neurowave. They were assessed before (T0) and after the training (T1) through a specific clinical battery, including both motor and cognitive outcomes. Moreover, in the EG, we also monitored the brain electrophysiological activity (EEG and P300). In both study groups (EG and CG), the psychological caregiver's aspects, including anxiety levels, were measured using the Zung Self-Rating Anxiety Scale (SAS). The intra-group analysis (T0-T1) of the EG showed statistical significances in all patients' outcome measures, while in the CG, we found statistical significances in consciousness and awareness outcomes. The inter-group analysis between the EG and the CG showed no statistical differences, except for global communication skills. In conclusion, the multi-sensory stimulation approach through Neurowave was found to be an innovative rehabilitation treatment, also allowing the registration of brain activity during treatment.

Mothers exhibit higher neural activity in gaining rewards for their children than for themselves

Are people willing to exert greater effort to obtain rewards for their children than they are for themselves? Although previous studies have demonstrated that social distance influences neural responses to altruistic reward processing, the distinction between winning rewards for oneself and winning them for one's child is unclear. In the present study, a group of 31 mothers performed a monetary incentive delay task in which cue-induced reward anticipations of winning a reward for themselves, their children and donation to a charity program were manipulated trial-wise, followed by performance-contingent feedback. Behaviorally, the anticipation of winning a reward for their children accelerated participants' responses. Importantly, the electroencephalogram results revealed that across the reward anticipation and consumption phases, the child condition elicited comparable or higher brain responses of participants than the self condition did. The source localization results showed that participants' reward anticipations for their children were associated with more activation in the social brain regions, compared to winning a reward for themselves or a charity donation. Overall, these findings advance our understanding of the neural mechanisms of altruistic reward processing and suggest that the priority of winning a reward for one's child may transcend the limits of the self-advantage effect in reward processing.

Effort and Appetitive Responding in Depression: Examining Deficits in Motivational and Consummatory Stages of Reward Processing Using the Effort-Doors Task

Background

Reward sensitivity is a dimensional construct central to understanding the nature of depression. Psychophysiological research on this construct has primarily focused on the reward positivity, an event-related potential (ERP) that indexes consummatory reward sensitivity. This study extended prior research by focusing on ERPs that index the motivational component of reward.

Methods

A novel effort-for-reward task was used to elicit motivational and consummatory ERPs. Groups consisting of 34 participants with depression and 32 participants without depression were compared across a range of reward-related ERPs.

Results

Participants with depression exhibited reduced responsivity to effort completion cues following high effort expenditure, reduced anticipation of rewards after low effort expenditure (i.e., the stimulus preceding negativity), and reduced reward positivity following high effort expenditure. ERPs occurring prior to reward receipt accounted for unique variance in depression status and differentiated between subgroups of depressed individuals.

Conclusions

Findings support the utility of leveraging multiple ERPs that index separate reward processing deficits to better characterize depression and depressive subtypes.

Relationship between reward-related brain activity and opportunities to sit

The present study tested whether energy-minimizing behaviors evoke reward-related brain activity that promotes the repetition of these behaviors via reinforcement learning processes. Fifty-eight healthy young adults in a standing position performed a task where they could earn a reward either by sitting down or squatting while undergoing electroencephalographic (EEG) recording. Reward-prediction errors were quantified as the amplitude of the EEG-derived reward positivity. Results showed that reward positivity was larger on reward versus no reward trials, confirming the validity of our paradigm to measure evoked reward-related brain activity. However, results showed no evidence that sitting (versus standing and squatting) trials led to larger reward positivity. Moreover, we found no evidence suggesting that this effect was moderated by typical physical activity, physical activity on the day of the study, or energy expenditure during the experiment. However, at the behavioral level, results showed that the probability of choosing the stimulus more likely to lead to sitting than standing increased as the number of trials increased. In addition, results revealed that the probability of changing the selected stimulus was higher when the previous trial was a stand trial relative to a sit trial. In sum, neural results showed no evidence supporting the theory that opportunities to minimize energy expenditure are rewarding. However, behavioral findings suggested participants tend to choose the less effortful behavioral alternative and were therefore consistent with the theory of effort minimization (TEMPA).

Neural correlates of evaluations of non-binary social feedback: An EEG study

PURPOSE

In complex and diverse social circumstances, decision making is affected by social feedback. Although previous studies have examined the electrophysiological correlates of social feedback with a binary valence, those related to non-binary feedback, or the magnitude of social feedback, remain unclear. This study investigated the electrophysiological correlates of non-binary social feedback and subsequent action selection processing.

METHODS

Participants were asked to complete a Gabor patch direction judgment task in which they were required to make judgments before and after receiving social feedback. They were informed that the feedback stimuli represented the degree to which other participants made the same choice.

RESULTS & CONCLUSION

The results revealed that feedback that was highly concordant with the participant's judgments elicited greater P300 activity, which was associated with the fulfillment of expectations regarding social reward. Moreover, moderately concordant feedback induced stronger theta band power, which may indicate monitoring of subjective conflict. Temporal changes in theta power during feedback phase may also relate to adjustments in prediction error. Additionally, when an initial judgment was maintained following social feedback, we observed a stronger increase in beta power, indicating an association with post-social-feedback action processing.

A comparison of reward processing during Becker-DeGroot-Marschak and Vickrey auctions: An ERP study

Vickrey auctions (VA) and Becker-DeGroot-Marschak auctions (BDM) are strategically equivalent demand-revealing mechanisms, differentiated only by a human opponent in the VA, and a random-number-generator opponent in the BDM. Game parameters are such that players are incentivized to reveal their private subjective values (SV) and behavior should be identical in both tasks. However, this has been repeatedly shown not to be the case. In this study, the neural correlates of outcome feedback processing during VA and BDM were directly compared using electroencephalography. Twenty-eight healthy participants bid for household products which were then divided into high- and low-SV categories. The VA included a human opponent deception to induce a social environment, while in reality a random-number-generator was used in both tasks. A P3 component peaking at 336 ms over midline parietal sites showed more positive amplitudes for high bid values, and for win outcomes in the VA but not the BDM. Both auctions also elicited a Reward Positivity potential, maximal at 275 ms along the central midline electrodes, that was not modulated by auction task or SV. Further, an exploratory N170 potential in the right occipitotemporal electrodes and a vertex positive potential component were stronger in the VA relative to the BDM. Results point to an enhanced cortical response to bid outcomes during VA task in a potential component associated with emotional control, and to the occurrence of face-sensitive potentials in VA but not in BDM auction. These findings suggest modulation of bid outcome processing by the social-competitive aspect of auction tasks. Directly comparing two prominent auction paradigms affords the opportunity to isolate the impact of social environment on competitive, risky decision-making. Findings suggest that feedback processing as early as 176 ms is facilitated by the presence of a human competitor, and later processing is modulated by social context and subjective value.

Neural dissociation between reward and salience prediction errors through the lens of optimistic bias

The question of how the brain represents reward prediction errors is central to reinforcement learning and adaptive, goal-directed behavior. Previous studies have revealed prediction error representations in multiple electrophysiological signatures, but it remains elusive whether these electrophysiological correlates underlying prediction errors are sensitive to valence (in a signed form) or to salience (in an unsigned form). One possible reason concerns the loose correspondence between objective probability and subjective prediction resulting from the optimistic bias, that is, the tendency to overestimate the likelihood of encountering positive future events. In the present electroencephalography (EEG) study, we approached this question by directly measuring participants' idiosyncratic, trial-to-trial prediction errors elicited by subjective and objective probabilities across two experiments. We adopted monetary gain and loss feedback in Experiment 1 and positive and negative feedback as communicated by the same zero-value feedback in Experiment 2. We provided electrophysiological evidence in time and time-frequency domains supporting both reward and salience prediction error signals. Moreover, we showed that these electrophysiological signatures were highly flexible and sensitive to an optimistic bias and various forms of salience. Our findings shed new light on multiple presentations of prediction error in the human brain, which differ in format and functional role.

Prepared to stop: how sense of agency in a preceding trial modulates inhibitory control in the current trial

Feeling in control of actions and events can enhance motivation for further actions. How this sense of agency (SoA) in fact influences flexible motor control remains poorly understood. Here, we investigated the effect of SoA on subsequent response inhibition in a modified go/no-go task with EEG recordings. We manipulated participants' SoA by varying the presence, predictability, and emotional valence of a visual outcome for a given motor action. When participants unexpectedly did not receive any visible outcome following their action on trial n - 1, they exhibited slower responses and lower hit rates to the go signal but higher rates of successful inhibition to the no-go signal on trial n, regardless of the emotional valence of the expected action outcome. Furthermore, enhanced inhibitory tendencies were accompanied by reduced N2 and P3 amplitudes, midfrontal theta power, and theta synchronization between midfrontal and medial to parietal areas, indicating that less top-down control is required for successful response inhibition on trial n after experiencing low SoA on trial n - 1. These findings suggest that feeling less in control in a preceding trial makes it easier to implement inhibitory control in the current trial, thereby providing new insights into the role of SoA in goal-directed behavior.

Stabilizing expectations when shifting from analytical to intuitive reasoning: The role of prediction errors in reasoning

As humans, we rely on intuitive reasoning for most of our decisions. However, when there is a novel or atypical decision to be made, we must rely on a slower and more deliberative thought process-analytical reasoning. As we gain experience with these novel or atypical decisions, our reasoning shifts from analytical to intuitive, which parallels a reduction in the need for cognitive control. Here, we sought to confirm this claim by employing electroencephalographic (EEG) measures of cognitive control as participants performed a simple perceptual decision-making task. Specifically, we had participants categorize "blobs" into families based on their visual attributes so we could examine how their reasoning changed with learning. In a key manipulation, halfway through the experiment we introduced novel blob families to categorize, thus temporarily increasing the need for analytical reasoning (i.e., cognitive control). Congruent with past research, we focused our EEG analyses on frontal theta activity as it has been linked to cognitive control and analytical thinking. As hypothesized, we found a transition from analytical to intuitive decision-making systems with learning as indexed by a decrease in frontal theta power. Further, when the novel blobs were introduced at the midpoint of the experiment, we found that decisions about these stimuli recruited analytical reasoning as indicated by increased theta power in comparison to decisions about well-practiced stimuli. We propose our findings to reflect prediction errors to decision demands-a monitoring process that determines whether our expectations of demands are met. Shifting from analytical to intuitive reasoning thus reflects the stabilization of our expectations of decision demands, which can be violated with unexpected demands when encountering novel stimuli.

Electrophysiological signatures of reward learning in the rodent touchscreen-based Probabilistic Reward Task

Blunted reward learning and reward-related activation within the corticostriatal-midbrain circuitry have been implicated in the pathophysiology of anhedonia and depression. Unfortunately, the search for more efficacious interventions for anhedonic behaviors has been hampered by the use of vastly different preclinical and clinical assays. In a first step in addressing this gap, in the current study, we used event-related potentials and spectral analyses in conjunction with a touchscreen version of the rodent Probabilistic Reward Task (PRT) to identify the electrophysiological signatures of reward learning in rats. We trained 11 rats (5 females and 6 males) on the rodent touchscreen-based PRT and subsequently implanted them with deep electrodes in the anterior cingulate cortex (ACC) and nucleus accumbens (NAc) for local field potentials recordings during the PRT. Behaviorally, the expected responsivity-to-reward profile was observed. At the electrophysiological level, we identified a negative amplitude deflection 250-500 ms after feedback in the ACC and NAc electrodes, as well as power increase in feedback-locked delta (1-5 Hz) and alpha/beta (9-17 Hz) bands in both electrodes for rewarded trials. Using a reverse-translational approach, we identified electrophysiological signatures of reward learning in rats similar to those described in humans. These findings and approaches might provide a useful translational platform to efficiently evaluate novel therapeutics targeting anhedonia.

Electrophysiological measures of conflict and reward processing are associated with decisions to engage in physical effort

Anterior cingulate cortex (ACC), a key brain region involved in cognitive control and decision making, is suggested to mediate effort- and value-based decision making, but the specific role of ACC in this process remains debated. Here we used frontal midline theta (FMT) and the reward positivity (RewP) to examine ACC function in a value-based decision making task requiring physical effort. We investigated whether (1) FMT power is sensitive to the difficulty of the decision or to selecting effortful actions, and (2) RewP is sensitive to the subjective value of reward outcomes as a function of effort investment. On each trial, participants chose to execute a low-effort or a high-effort behavior (that required squeezing a hand-dynamometer) to obtain smaller or larger rewards, respectively, while their brainwaves were recorded. We replicated prior findings that tonic FMT increased over the course of the hour-long task, which suggests increased application of control in the face of growing fatigue. RewP amplitude also increased following execution of high-effort compared to low-effort behavior, consistent with increased valuation of reward outcomes by ACC. Although neither phasic nor tonic FMT were associated with decision difficulty or effort selection per se, an exploratory analysis revealed that the interaction of phasic FMT and expected value of choice predicted effort choice. This interaction suggests that phasic FMT increases specifically under situations of decision difficulty when participants ultimately select a high-effort choice. These results point to a unique role for ACC in motivating and persisting at effortful behavior when decision conflict is high.

Expending effort may share neural responses with reward and evokes high subjective satisfaction

Throughout our daily lives, the levels of effort we invest in various tasks are influenced by reward processing. The subjective expectation after expending effort is a primary factor affecting reward processing. However, recent studies indicate that individual differences in reward anticipation influence this subjective valuation. To better understand the relationship between effort expenditure and the subjective valuation of rewards, in this study, we perform an experiment in which we manipulate effort, control reward expectation implicitly, and measure the subjective valuation of rewards using event-related potentials (ERPs) and physical effort through behavioral measures (number of keystrokes). In the reward-task paradigm, 30 subjects performed effort and control trials, with the reward probability comparable across the effort and control conditions. We also examined the ERPs associated with the valuation of subjective rewards, including reward positivity (RewP) and set reward expectation controlled as the baseline. The results showed that the ERP amplitudes, the number of keystrokes, and explicit satisfaction ratings were all significantly greater in the effort condition than in the control condition. The participants maintained high levels of effort throughout the sessions associated with the experiment. The results of this study suggest that when reward expectations are controlled, effort expenditure evokes neural responses similar to reward feedback being given, which is linked with increased subjective satisfaction.

Dissociable feedback valence effects on frontal midline theta during reward gain versus threat avoidance learning

While frontal midline theta (FMθ) has been associated with threat processing, with cognitive control in the context of anxiety, and with reinforcement learning, most reinforcement learning studies on FMθ have used reward rather than threat-related stimuli as reinforcer. Accordingly, the role of FMθ in threat-related reinforcement learning is largely unknown. Here, n = 23 human participants underwent one reward-, and one punishment-, based reversal learning task, which differed only with regard to the kind of reinforcers that feedback was tied to (i.e., monetary gain vs. loud noise burst, respectively). In addition to single-trial EEG, we assessed single-trial feedback expectations based on both a reinforcement learning computational model and trial-by-trial subjective feedback expectation ratings. While participants' performance and feedback expectations were comparable between the reward and punishment tasks, FMθ was more reliably amplified to negative vs. positive feedback in the reward vs. punishment task. Regressions with feedback valence, computationally derived, and self-reported expectations as predictors and FMθ as criterion further revealed that trial-by-trial variations in FMθ specifically relate to reward-related feedback-valence and not to threat-related feedback or to violated expectations/prediction errors. These findings suggest that FMθ as measured in reinforcement learning tasks may be less sensitive to the processing of events with direct relevance for fear and anxiety.

Bid outcome processing in Vickrey auctions: An ERP study

Online retailers often sell products using a socially competitive second-price sealed-bid auction known as a Vickrey auction (VA), an incentivized demand-revealing mechanism used to elicit players' subjective values. The VA presents a situation of risky decision-making, which typically implements value processing and a loss aversion mechanism. Neural outcome processing of VA bids are not known; this study explores this for the first time using EEG. Twenty-eight healthy participants bid on household items against an anonymous, computerized opponent. Bid outcome event-related potentials were predicted to differentiate between three conditions: outbid (no-win), large margin win (bargain), and small margin win (snatch). Individual loss aversion values were evaluated in a separate behavioral experiment offering gains or losses of variable amounts but equal chances against an assured gain. Processing outcomes of VA bids were associated with a feedback-related negativity (FRN) potential with a spatial maximum at the vertex (251-271 ms), where bargain win trials resulted in greater FRN amplitudes than snatch win trials. Additionally, a P300 potential was sensitive to win versus no-win outcomes and to retail price. Individual loss aversion level did not correlate with the strength of FRN or P300. Results show that outcome processing in a VA is associated with FRN that differentiates between relatively advantageous and less advantageous gains, and a P300 that distinguishes between the more and less expensive auction items. Our findings pave the way to an objective exploration of economic decision-making and purchasing behavior involving a widely popular auction.

Greater Cumulative Lifetime Stressor Exposure Predicts Blunted Reward Positivity in Adolescent Girls Followed for 2 Years

BACKGROUND

Although research has found that life stress is associated with reward-related brain activity, few studies have examined how cumulative stressors occurring over the entire lifetime affect reward processing during adolescence.

METHODS

To address this issue, we investigated how lifetime stressor exposure related to reward processing, indexed by the reward positivity, in 240 adolescent girls between ages 8 and 14 years (mean age = 12.4). Participants were followed for 2 years. They completed a reward task at baseline and follow-up and the Stress and Adversity Inventory at follow-up.

RESULTS

As hypothesized, greater lifetime stressor exposure was related to a blunted reward positivity at the follow-up session while controlling for baseline age, baseline reward positivity, and time between assessments. Furthermore, this association was evident for acute but not chronic lifetime stressors.

CONCLUSIONS

These data suggest that the development of adaptive reward processing may be adversely affected by experiencing major life stressors. The results may thus have implications for understanding how stressors increase risk for psychopathology, such as major depressive disorder.

Relationship between reward-related evoked potentials and real-world motivation in older people living with human immunodeficiency virus

Apathy, a clinical disorder characterized by low motivation, is prevalent in people living with Human Immunodeficiency Virus (HIV). It affects mental and physical health-related quality-of-life, medication adherence, and is associated with cognitive decline. However, the causes of apathy and the underlying brain mechanisms in HIV are unknown. Brain responses to reward may be relevant to understanding apathy and might serve as biomarkers for diagnosis or treatment response. Electroencephalogram (EEG) responses to gain and loss feedback in simple guessing tasks have been related to apathy in neurodegenerative conditions and healthy individuals. The primary aim of this study is to contribute evidence regarding the relationship between two EEG correlates of reward processing, the Reward Positivity, and the Feedback-P300, and real-world motivated behavior indicated by self-reported hours engaged in goal-directed leisure activities per week, in older individuals with well-controlled HIV infection. High-density EEG was collected from 75 participants while they performed a guessing task with gain or loss feedback. We found that a later component of reward processing, the Feedback-P300, was related to real-world engagement, while the earlier Reward Positivity was not. The Feedback-P300 measured with EEG holds promise as a biomarker for motivated behavior in older people living with HIV. These findings lay the groundwork for a better understanding of the neurobiology of apathy in this condition.

Social exclusion modulates neural dynamics of monetary and social reward processing in young adult females

Evidence suggests that social exclusion increases one's sensitivity to monetary and social rewards. However, whether and how social exclusion modulates the neural dynamics of reward processing remains unknown. The current study aimed to address this gap by systematically investigating the differential influences of social exclusion on various stages of monetary and social reward processing. Forty-five female participants were recruited, and the Cyberball game was used to manipulate social exclusion. To disentangle the anticipatory and consummatory stages of monetary and social reward processing, we recorded event-related potentials during two incentive delay tasks, one with a monetary reward and one with a social reward. The results showed that during the anticipatory stage, a larger contingent negative variation was observed for the exclusion group than for the inclusion group, regardless of reward type. During the consummatory stage, although the reward-related positivity was larger in the exclusion group than in the inclusion group, this difference was only observed for the social, and not monetary, reward feedback. These findings advance our understanding of the relationship between social exclusion and reward processing and suggest that while social exclusion might exert comparable enhancement effect for monetary and social reward processing during the anticipatory stage, it exerts a specific enhancement effect for social reward processing during the consummatory stage.

The reward positivity shows increased amplitude and decreased latency with increasing age in early childhood

The reward positivity (RewP) is a widely studied measure of neural response to rewards, yet little is known about normative developmental characteristics of the RewP during early childhood. The present study utilized a pooled community sample of 309 4- to 6-year-old children who participated in the Doors guessing game to examine the latency and amplitude of the RewP. Peak detection of the gain-loss difference waveform was conducted for electrodes Fz, Cz, Pz, Oz and the mean activity in a 100 ms window centered around this peak was analyzed. There was a significant decrease in RewP latency (RewP was earlier) and increase in RewP amplitude (RewP magnitude was larger) with advancing age in this cross-sectional analysis. Further, these were independent effects, as both RewP latency and RewP amplitude were uniquely associated with children's age. Moreover, our results indicate that the RewP latency in 4- to 6-year-olds falls outside the 250-350 ms window typically used to quantify the RewP (RewP latency in our sample = 381 ms; SD = 60.15). The internal consistency for latency (.64) and amplitude (.27) of the RewP were characterized by moderate to low reliability, consistent with previous work on the reliability of difference scores. Overall, results demonstrate RewP differences in both timing and amplitude across age in early childhood, and suggest that both amplitude and latency of the RewP might function as individual difference measures of reward processing. These findings are discussed in the context of methodological considerations and the development of reward processing across early childhood.

Electrophysiological Correlates of Romantic Love: A Review of EEG and ERP Studies with Beloved-Related Stimuli

Science is starting to unravel the neural basis of romantic love. The goal of this literature review was to identify and interpret the electrophysiological correlates of romantic love. Electroencephalography (EEG) and event-related potential (ERP) studies with a design that elicits romantic love feelings were included. The methods of previous EEG studies are too heterogeneous to draw conclusions. Multiple ERP studies, however, have shown that beloved stimuli elicit an enhanced late positive potential (LPP/P3/P300), which is not due to familiarity, positive valence, or objective beauty. This effect occurs in Western and Eastern cultures and for pictorial and verbal information, and results from bottom-up rather than top-down factors. Studies have also shown that beloved stimuli elicit an early posterior negativity (EPN), which also does not seem to be due to familiarity or positive valence. Data on earlier ERP components (P1, N1, P2, N170/VPP, N2) is scarce and mixed. Of course, the enhanced LPP and EPN are not specific to romantic love. Instead, they suggest that the beloved captures early attention, within 200–300 ms after stimulus onset that is relatively resource-independent, and subsequently receives sustained motivated attention. Future research would benefit from employing cognitive tasks and testing participants who are in love regardless of relationship status.

Pain feedback interferes with reward positivity production

The reinforcement learning (RL) theory of the reward positivity (RewP) proposes that RewP indexes a reward prediction error (RPE) signal processed in the anterior cingulate cortex (ACC). According to this theory, RewP is an event-related potential (ERP) that is more positive-going for feedback stimuli that predict better-than-expected outcomes (positive feedback) than for feedback stimuli that predict worse-than-expected outcomes (negative feedback). Despite strong evidence for this hypothesis, findings have been equivocal for tasks involving painful outcomes. We hypothesized that the RewP is modulated by high-level task goals such that outcomes that are congruent with the goals elicit positive RPEs even if their immediate consequences are negative. Accordingly, changes in high-level task goals should modulate RewP amplitude for tasks that involve seeking pain compared to tasks that involve avoiding pain. We recorded the electroencephalogram from participants who were instructed to navigate a virtual T-Maze to find reward-predictive feedback in a reward condition and pain-predictive feedback in a pain condition. We expected more positive-going ERPs to reward feedback in the reward condition and more positive-going ERPs to pain feedback in the pain condition. Despite behavioral results indicating that participants complied with task instructions, contrary to our predictions, we did not find a RewP to pain feedback. We suggest that pain feedback interfered with the effect of high-level task goals on RewP amplitude, which is indicative of conflict at different levels of task hierarchy.

Safety on demand: Post-hypnotic suggestions of safety reduce neural signals of reward sensitivity with long-term beneficial effects

Increased reward sensitivity has been proposed as an important transdiagnostic feature for a series of disorders, including addictive behaviors. Earlier studies suggest that a positive affective state characterized by the feeling of safety could reduce an individual's reward sensitivity. A promising technique to establish a feeling of safety on demand is to utilize post-hypnotic suggestions. We hypothesized that the feeling of safety elicited by post-hypnotic suggestions reduces neural signals of reward sensitivity. To test our predictions, we hypnotized 24 highly suggestible participants, suggested them to feel safe and coupled this feeling of safety to a post-hypnotic trigger that reactivates the feeling of safety outside the hypnotic state. Participants then played a risk game both in a safety condition using the post-hypnotic safety trigger and in a control condition using a neutral trigger. Simultaneously, we recorded their EEG. Participants reported significantly higher ratings of safety in the safety condition compared to the control condition. Even several weeks after the main experimental session, the post-hypnotic safety trigger still elicited a significantly stronger feeling of safety compared to the control condition. Moreover, the Reward Positivity (RewP) was significantly reduced in the safety condition. As the RewP amplitude has been proposed as a psychophysiological marker for reward sensitivity, we conclude that the suggestion of safety by post-hypnotic suggestions turns participants into a quiescence motivational state that makes them less reward sensitive. Therefore, we discuss implications of the post-hypnotic safety trigger for the treatment of disorders associated with increased reward sensitivity such as addictive behaviors.

Distinct Neural Signatures of Outcome Monitoring After Selection and Execution Errors

Losing a point in tennis could result from poor shot selection or faulty stroke execution. To explore how the brain responds to these different types of errors, we examined feedback-locked EEG activity while participants completed a modified version of a standard three-armed bandit probabilistic reward task. Our task framed unrewarded outcomes as the result of either errors of selection or errors of execution. We examined whether amplitude of a medial frontal negativity (the feedback-related negativity [FRN]) was sensitive to the different forms of error attribution. Consistent with previous reports, selection errors elicited a large FRN relative to rewards, and amplitude of this signal correlated with behavioral adjustment after these errors. A different pattern was observed in response to execution errors. These outcomes produced a larger FRN, a frontocentral attenuation in activity preceding this component, and a subsequent enhanced error positivity in parietal sites. Notably, the only correlations with behavioral adjustment were with the early frontocentral attenuation and amplitude of the parietal signal; FRN differences between execution errors and rewarded trials did not correlate with subsequent changes in behavior. Our findings highlight distinct neural correlates of selection and execution error processing, providing insight into how the brain responds to the different classes of error that determine future action.

Task Learnability Modulates Surprise but Not Valence Processing for Reinforcement Learning in Probabilistic Choice Tasks

The goal of temporal difference (TD) reinforcement learning is to maximize outcomes and improve future decision-making. It does so by utilizing a prediction error (PE), which quantifies the difference between the expected and the obtained outcome. In gambling tasks, however, decision-making cannot be improved because of the lack of learnability. On the basis of the idea that TD utilizes two independent bits of information from the PE (valence and surprise), we asked which of these aspects is affected when a task is not learnable. We contrasted behavioral data and ERPs in a learning variant and a gambling variant of a simple two-armed bandit task, in which outcome sequences were matched across tasks. Participants were explicitly informed that feedback could be used to improve performance in the learning task but not in the gambling task, and we predicted a corresponding modulation of the aspects of the PE. We used a model-based analysis of ERP data to extract the neural footprints of the valence and surprise information in the two tasks. Our results revealed that task learnability modulates reinforcement learning via the suppression of surprise processing but leaves the processing of valence unaffected. On the basis of our model and the data, we propose that task learnability can selectively suppress TD learning as well as alter behavioral adaptation based on a flexible cost-benefit arbitration.

The Interplay Between Affective Processing and Sense of Agency During Action Regulation: A Review

Sense of agency is the feeling of being in control of one's actions and their perceivable effects. Most previous research identified cognitive or sensory determinants of agency experience. However, it has been proposed that sense of agency is also bound to the processing of affective information. For example, during goal-directed actions or instrumental learning we often rely on positive feedback (e.g., rewards) or negative feedback (e.g., error messages) to determine our level of control over the current task. Nevertheless, we still lack a scientific model which adequately explains the relation between affective processing and sense of agency. In this article, we review current empirical findings on how affective information modulates agency experience, and, conversely, how sense of agency changes the processing of affective action outcomes. Furthermore, we discuss in how far agency-related changes in affective processing might influence the ability to enact cognitive control and action regulation during goal-directed behavior. A preliminary model is presented for describing the interplay between sense of agency, affective processing, and action regulation. We propose that affective processing could play a role in mediating the influence between subjective sense of agency and the objective ability to regulate one's behavior. Thus, determining the interrelation between affective processing and sense of agency will help us to understand the potential mechanistic basis of agency experience, as well as its functional significance for goal-directed behavior.

The choice levels modulate outcome processing during outcome independent of behavior selection: Evidence from event-related potentials

Having a choice is a basic demand to influence human behavior. However, how various choice levels modulate outcome processing when the outcome is independent of the choices remains unclear. In this event-related potential (ERP) study, thirty-seven participants were instructed to perform a one-person choice task in which they were required to choose one card from 1 (no-choice level), 2 (medium-choice level), and 8 cards (high-choice level) to win a reward, with a 50% chance. Behavioral results indicated that pleasure and perceived control rating scores were linearly promoted with increased choice levels. ERP results revealed that having choices (medium- and high-choice level) elicited greater original-RewP and PCA-RewP amplitudes than having no choice (no-choice level), suggesting the amplification of the reward prediction error by quickly detecting whether there is a choice or not. Moreover, ERP results revealed that the original-P300 amplitudes were linearly enhanced with increased choice levels, suggesting the increased attentional allocation based on the motivational and emotional significance, due to advanced processing of the value of choice levels. Therefore, these results suggest that choice levels can modulate outcome processing, even when the outcome is independent of the choices, and provide further evidence to support the intrinsic value of having choices.

Working memory load reduces the processing of outcome evaluation involving others but not oneself: Event-related potential evidence

Previous event-related potential (ERP) studies have suggested that self-related and non-self-related outcomes are processed simultaneously. However, the studies investigated situations in which individuals had sufficient attentional/cognitive resources to process both of the outcomes. It is unknown whether self-related and non-self-unrelated outcomes could still be processed simultaneously when resources are limited. To address this issue, 32 female participants in the present study were asked to perform a working memory task. To manipulate the amount of available attentional/cognitive resources, participants were asked to memorize a letter in the low load condition and five letters in the high load condition. During letter consolidation, participants were informed that they and another player each performed a gambling task and were subsequently presented with both of the outcomes. ERP results showed that others' monetary loss elicited larger P200 and late positive potential amplitudes than others' monetary gain under a low working memory load, whereas a high load reduced these effects. However, working memory load did not influence the effect of self-outcome on ERP responses. Therefore, the findings suggest that the amount of available attentional/cognitive resources alters the evaluation of non-self-related but not self-related outcomes.

Examining Neural Activity Related to Pitch Stimuli and Feedback at the Plate: Cognitive and Performance Implications

This study investigated the relationships among neural activity related to pitch stimuli and task feedback, self-regulatory control, and task-performance measures in expert and novice baseball players. The participants had their event-related brain potentials recorded while they completed a computerized task assessing whether thrown pitches were balls or strikes and received feedback on the accuracy of their responses following each pitch. The results indicated that college players exhibited significantly larger medial frontal negativities to pitch stimuli, as well as smaller reward positivities and larger frontocentral positivities in response to negative feedback, compared with novices. Furthermore, significant relationships were present between college players' neural activity related to both pitches and feedback and their task performance and self-regulatory behavior. These relationships were not present for novices. These findings suggest that players efficiently associate the information received in their feedback to their self-regulatory processing of the task and, ultimately, their task performance.

Finger tapping to different styles of music and changes in cortical oscillations

Music has been a therapeutic strategy proposed to improve impaired movement performance, but there remains a lack of understanding of how music impacts motor cortical activity. Thus, the purpose of this study is to use a time-frequency analysis (i.e., wavelet) of electroencephalographic (EEG) data to determine differences in motor and auditory cortical activity when moving to music at two different rates. Twenty healthy young adults tapped their index finger while electroencephalography was collected. There were three conditions (tapping in time with a tone and with two contrasting music styles), and each condition was repeated at two different rates (70 and 140 beats per minute). A time-frequency Morlet wavelet analysis was completed for electrodes of interest over the sensorimotor areas (FC3, FC4, FCz, C3, C4, Cz) and the primary auditory areas (T7, T8). Cluster-based permutation testing was applied to the electrodes of interest for all conditions. Results showed few differences between cortical oscillations when moving to music versus a tone. However, the two music conditions elicited a variety of distinct responses, particularly at the slower movement rate. These results suggest that music style and movement rate should be considered when designing therapeutic applications that include music to target motor performance.

I, robot: depression plays different roles in human-human and human-robot interactions

Socially engaging robots have been increasingly applied to alleviate depressive symptoms and to improve the quality of social life among different populations. Seeing that depression negatively influences social reward processing in everyday interaction, we investigate this influence during simulated interactions with humans or robots. In this study, 35 participants with mild depression and 35 controls (all from nonclinical populations) finished the social incentive delay task with event-related potential recording, in which they received performance feedback from other persons or from a robot. Compared to the controls, the mild depressive symptom (MDS) group represented abnormalities of social reward processing in the human feedback condition: first, the MDS group showed a lower hit rate and a smaller contingent-negative variation (correlated with each other) during reward anticipation; second, depression level modulated both the early phase (indexed by the feedback-related negativity (FRN)) and the late phase (indexed by the P3) of reward consumption. In contrast, the effect of depression was evident only on FRN amplitude in the robot feedback condition. We suggest that compared to human-human interaction, the rewarding properties of human-robot interaction are less likely to be affected by depression. These findings have implications for the utilization of robot-assisted intervention in clinical practice.

Effects of a school readiness intervention on electrophysiological indices of external response monitoring in children in foster care

This study examined the impact of a school readiness intervention on external response monitoring in children in foster care. Behavioral and event-related potential (ERP) data were collected during a flanker task from children who received the Kids In Transition to School (KITS) Program (n = 26) and children who received services as usual (n = 19) before and after the intervention. While there were no significant group differences on the behavioral data, the ERP data for the two groups of children significantly differed. Specifically, in contrast to the children who received services as usual, the children who received the KITS Program displayed greater amplitude differences between positive and negative performance feedback over time for the N1, which reflects early attention processes, and feedback-related negativity, which reflects evaluation processes. In addition, although the two groups did not differ on amplitude differences between positive and negative performance feedback for these ERP components before the intervention, the children who received the KITS Program displayed greater amplitude differences than the children who received services as usual after the intervention. These results suggest that the KITS Program had an effect on responsivity to external performance feedback, which may be beneficial during the transition into kindergarten.

Champ versus Chump: Viewing an Opponent’s Face Engages Attention but Not Reward Systems

When we play competitive games, the opponents that we face act as predictors of the outcome of the game. For instance, if you are an average chess player and you face a Grandmaster, you anticipate a loss. Framed in a reinforcement learning perspective, our opponents can be thought of as predictors of rewards and punishments. The present study investigates whether facing an opponent would be processed as a reward or punishment depending on the level of difficulty the opponent poses. Participants played Rock, Paper, Scissors against three computer opponents while electroencephalographic (EEG) data was recorded. In a key manipulation, one opponent (HARD) was programmed to win most often, another (EASY) was made to lose most often, and the third (AVERAGE) had equiprobable outcomes of wins, losses, and ties. Through practice, participants learned to anticipate the relative challenge of a game based on the opponent they were facing that round. An analysis of our EEG data revealed that winning outcomes elicited a reward positivity relative to losing outcomes. Interestingly, our analysis of the predictive cues (i.e., the opponents’ faces) demonstrated that attentional engagement (P3a) was contextually sensitive to anticipated game difficulty. As such, our results for the predictive cue are contrary to what one might expect for a reinforcement model associated with predicted reward, but rather demonstrate that the neural response to the predictive cue was encoding the level of engagement with the opponent as opposed to value relative to the anticipated outcome.

Single-trial modeling separates multiple overlapping prediction errors during reward processing in human EEG

Learning signals during reinforcement learning and cognitive control rely on valenced reward prediction errors (RPEs) and non-valenced salience prediction errors (PEs) driven by surprise magnitude. A core debate in reward learning focuses on whether valenced and non-valenced PEs can be isolated in the human electroencephalogram (EEG). We combine behavioral modeling and single-trial EEG regression to disentangle sequential PEs in an interval timing task dissociating outcome valence, magnitude, and probability. Multiple regression across temporal, spatial, and frequency dimensions characterized a spatio-tempo-spectral cascade from early valenced RPE value to non-valenced RPE magnitude, followed by outcome probability indexed by a late frontal positivity. Separating negative and positive outcomes revealed the valenced RPE value effect is an artifact of overlap between two non-valenced RPE magnitude responses: frontal theta feedback-related negativity on losses and posterior delta reward positivity on wins. These results reconcile longstanding debates on the sequence of components representing reward and salience PEs in the human EEG.

Dissociating the effect of reward uncertainty and timing uncertainty on neural indices of reward prediction errors: A reward positivity (RewP) event-related potential (ERP) study

Accurate reward predictions include forecasting both what a reward will be and when a reward will occur. We tested how variations in the certainty of reward outcome and certainty in timing of feedback presentation modulate neural indices of reward prediction errors using the reward positivity (RewP) component of the scalp-recorded brain event-related potential (ERP). In a within-subjects design, seventy-three healthy individuals completed two versions of a cued doors task; one cued the probability of a reward outcome while the other cued the probability of a delay before feedback. Replicating previous results, RewP amplitude was larger for uncertain feedback compared to certain feedback. Additionally, RewP amplitude was differentially associated with uncertainty of presence/absence of reward, but not uncertainty of feedback timing. Findings suggest a dissociation in that RewP amplitude is modulated by reward prediction certainty but is less affected by certainty surrounding timing of feedback.

Relevance of Predictive and Postdictive Error Information in the Course of Motor Learning

The prediction of the sensory consequences of physical movements is a fundamental feature of the human brain. This function is attributed to a forward model, which generates predictions based on sensory and efferent information. The neural processes underlying such predictions have been studied using the error-related negativity (ERN) as a fronto-central event-related potential in electroencephalogram (EEG) tracings. In this experiment, 16 participants practiced a novel motor task for 4000 trials over ten sessions. Neural correlates of error processing were recorded in sessions one, five, and ten. Along with significant improvements in task performance, the ERN amplitude increased over the sessions. Simultaneously, the feedback-related negativity (FRN), a neural marker corresponding to the processing of movement-outcome feedback, attenuated with learning. The findings suggest that early in learning, the motor control system relies more on information from external feedback about terminal outcome. With increasing task performance, the forward model is able to generate more accurate outcome predictions, which, as a result, increasingly contributes to error processing. The data also suggests a complementary relationship between the ERN and the FRN over motor learning.