Willing to wait: Elevated reward-processing EEG activity associated with a greater preference for larger-but-delayed rewards

Cortico-striatal beta oscillations as a reward-related signal

The value associated with reward is sensitive to external factors, such as the time between the choice and reward delivery as classically manipulated in temporal discounting tasks. Subjective preference for two reward options is dependent on objective variables of reward magnitude and reward delay. Single neuron correlates of reward value have been observed in regions, including ventral striatum, orbital, and medial prefrontal cortex. Brain imaging studies show cortico-striatal-limbic network activity related to subjective preferences. To explore how oscillatory dynamics represent reward processing across brain regions, we measured local field potentials of rats performing a temporal discounting task. Our goal was to use a data-driven approach to identify an electrophysiological marker that correlates with reward preference. We found that reward-locked oscillations at beta frequencies signaled the magnitude of reward and decayed with longer temporal delays. Electrodes in orbitofrontal/medial prefrontal cortex, anterior insula, ventral striatum, and amygdala individually increased power and were functionally connected at beta frequencies during reward outcome. Beta power during reward outcome correlated with subjective value as defined by a computational model fit to the discounting behavior. These data suggest that cortico-striatal beta oscillations are a reward signal correlated, which may represent subjective value and hold potential to serve as a biomarker and potential therapeutic target.

Risk-Taking Is Associated with Decreased Subjective Value Signals and Increased Prediction Error Signals in the Hot Columbia Card Task

It remains a pressing concern to understand how neural computations relate to risky decisions. However, most observations of brain-behavior relationships in the risk-taking domain lack a rigorous computational basis or fail to emulate of the dynamic, sequential nature of real-life risky decision-making. Recent advances emphasize the role of neural prediction error (PE) signals. We modeled, according to prospect theory, the choices of n = 43 human participants (33 females, 10 males) performing an EEG version of the hot Columbia Card Task, featuring rounds of sequential decisions between stopping (safe option) and continuing with increasing odds of a high loss (risky option). Single-trial regression EEG analyses yielded a subjective value signal at centroparietal (300-700 ms) and frontocentral (>800 ms) electrodes and in the delta band, as well as PE signals tied to the feedback-related negativity, P3a, and P3b, and in the theta band. Higher risk preference (total number of risky choices) was linked to attenuated subjective value signals but increased PE signals. Higher P3-like activity associated with the most positive PE in each round predicted stopping in the present round but not risk-taking in the subsequent round. Our findings indicate that decreased representation of decision values and increased sensitivity to winning despite low odds (positive PE) facilitate risky choices at the subject level. Strong neural responses when gains are least expected (the most positive PE on each round) adaptively contribute to safer choices at the trial-by-trial level but do not affect risky choice at the round-by-round level.

Transcranial Direct Current Stimulation Decreases P3 Amplitude and Inherent Delta Activity during a Waiting Impulsivity Paradigm: Crossover Study

The inability to wait for a target before initiating an action (i.e., waiting impulsivity) is one of the main features of addictive behaviors. Current interventions for addiction, such as transcranial Direct Current Stimulation (tDCS), have been suggested to improve this inability. Nonetheless, the effects of tDCS on waiting impulsivity and underlying electrophysiological (EEG) markers are still not clear. Therefore, this study aimed to evaluate the effects of neuromodulation over the right inferior frontal gyrus (rIFG) on the behavior and EEG markers of reward anticipation (i.e., cue and target-P3 and underlying delta/theta power) during a premature responding task. For that, forty healthy subjects participated in two experimental sessions, where they received active and sham tDCS over the rIFG combined with EEG recording during the task. To evaluate transfer effects, participants also performed two control tasks to assess delay discounting and motor inhibition. The active tDCS decreased the cue-P3 and target-P3 amplitudes, as well as delta power during target-P3. While no tDCS effects were found for motor inhibition, active tDCS increased the discounting of future rewards when compared to sham. These findings suggest a tDCS-induced modulation of the P3 component and underlying oscillatory activity during waiting impulsivity and the discounting of future rewards.

Modulating preferences during intertemporal choices through exogenous midfrontal transcranial alternating current stimulation: A registered report

Decision conflicts may arise when the costs and benefits of choices are evaluated as a function of outcomes predicted along a temporal dimension. Electrophysiology studies suggest that during performance monitoring a typical oscillatory activity in the theta rhythm, named midfrontal theta, may index conflict processing and resolution. In the present within-subject, sham controlled, cross-over preregistered study, we delivered online midfrontal transcranial Alternating Current Stimulation (tACS) to modulate electrocortical activity during intertemporal decisions. Participants were invited to select choice preference between economic offers at three different intermixed levels of conflict (i.e., low, medium, high) while receiving either theta -, gamma-, or sham tACS in separate blocks and sessions. At the end of each stimulation block, a Letter-Flanker task was also administered to measure behavioural aftereffects. We hypothesized that theta-tACS would have acted on the performance monitoring system inducing behavioural changes (i.e., faster decisions and more impulsive choices) in high conflicting trials, rather than gamma- and sham-tACS. Results very partially confirmed our predictions. Unexpectedly, both theta- and gamma-driven neuromodulation speeded-up decisions compared to sham. However, exploratory analyses revealed that such an effect was stronger in the high-conflict decisions during theta-tACS. These findings were independent from the influence of the sensations induced by the electrical stimulation. Moreover, further analyses highlighted a significant association during theta-tACS between the selection of immediate offers in high-conflict trials and attentional impulsiveness, suggesting that individual factors may account for the tACS effects during intertemporal decisions. Finally, we did not capture long-lasting behavioural changes following tACS in the Flanker task. Our findings may inform scholars to improve experimental designs and boost the knowledge toward a more effective application of tACS.

Reduced Reward Processing in Schizophrenia: A Comprehensive EEG Event-Related Oscillation Study

It is well known that abnormal reward processing is a characteristic feature of various psychopathologies including schizophrenia (SZ). Reduced reward anticipation has been suggested as a core symptom of SZ. The present study aims to evaluate the event-related oscillations (EROs) delta, theta, alpha, beta, and gamma in patients with SZ during the Monetary Incentive Delay (MID) task, which elicits the neural activity of reward processing. Twenty-one patients with SZ and twenty-two demographically matched healthy controls were included in the study. EROs were compared between groups and correlation analyses were conducted to determine a possible relationship between clinical scores and ERO values. Compared with healthy controls, the SZ group had reduced (1) delta and theta amplitudes in the reward condition (2) total beta and non-incentive cue-related beta amplitudes, and (3) incentive cue-related frontal gamma amplitudes. These reductions can be interpreted as impaired dopaminergic neurotransmission and disrupted cognitive functioning in the reward processing of SZ. In contrast, SZ patients showed higher incentive cue-related theta and occipital gamma amplitudes compared to controls. These increments may reflect negative symptoms in SZ. Moreover, theta amplitudes showed a negative correlation with Calgary Depression Scale for Schizophrenia scores and a positive correlation with attentional impulsivity. This is the first study showing the impairments of SZ patients in EROs from delta to gamma frequency bands compared with healthy controls during reward anticipation. Being the first comprehensive study, our results can be interpreted as providing evidence for disrupted brain dynamics in the reward processing of SZ studied by EROs. It may become possible to help patients' wellness by improving our understanding of reward processing in schizophrenia and developing innovative rehabilitation treatments based on these findings.

Comparing monetary gain and loss in the monetary incentive delay task: EEG evidence

What is more effective to guide behavior: The desire to gain or the fear to lose? Electroencephalography (EEG) studies have yielded inconsistent answers. In a systematic exploration of the valence and magnitude parameters in monetary gain and loss processing, we used time-domain and time-frequency-domain analyses to uncover the underlying neural processes. A group of 24 participants performed a monetary incentive delay (MID) task in which cue-induced anticipation of a high or low magnitude of gain or loss was manipulated trial-wise. Behaviorally, the anticipation of both gain and loss expedited responses, with gain anticipation producing greater facilitation than loss anticipation. Analyses of cue-locked P2 and P3 components revealed the significant valence main effect and valence × magnitude interaction: amplitude differences between high and low incentive magnitudes were larger with gain vs. loss cues. However, the contingent negative variation component was sensitive to incentive magnitude but did not vary with incentive valence. In the feedback phase, the RewP component exhibited reversed patterns for gain and loss trials. Time-frequency analyses revealed a large increase in delta/theta-ERS oscillatory activity in high- vs. low-magnitude conditions and a large decrease of alpha-ERD oscillatory activity in gain vs. loss conditions in the anticipation stage. In the consumption stage, delta/theta-ERS turned out stronger for negative than positive feedback, especially in the gain condition. Overall, our study provides new evidence for the neural oscillatory features of monetary gain and loss processing in the MID task, suggesting that participants invested more attention under gain and high-magnitude conditions vs. loss and low-magnitude conditions.

Allostatic-interoceptive anticipation of social rejection

Anticipating social stress evokes strong reactions in the organism, including interoceptive modulations. However, evidence for this claim comes from behavioral studies, often with inconsistent results, and relates almost solely to the reactive and recovery phase of social stress exposure. Here, we adopted an allostatic-interoceptive predictive coding framework to study interoceptive and exteroceptive anticipatory brain responses using a social rejection task. We analyzed the heart-evoked potential (HEP) and task-related oscillatory activity of 58 adolescents via scalp EEG, and 385 human intracranial recordings of three patients with intractable epilepsy. We found that anticipatory interoceptive signals increased in the face of unexpected social outcomes, reflected in larger negative HEP modulations. Such signals emerged from key brain allostatic-interoceptive network hubs, as shown by intracranial recordings. Exteroceptive signals were characterized by early activity between 1-15 Hz across conditions, and modulated by the probabilistic anticipation of reward-related outcomes, observed over distributed brain regions. Our findings suggest that the anticipation of a social outcome is characterized by allostatic-interoceptive modulations that prepare the organism for possible rejection. These results inform our understanding of interoceptive processing and constrain neurobiological models of social stress.

The modulation of pain in reward processing is reflected by increased P300 and delta oscillation

Pain elicits the desire for a reward to alleviate the unpleasant sensation. This may be a consequence of facilitated neural activities in the reward circuit. However, the temporal modulation of pain on reward processing remains unclear. We addressed this issue by recording electroencephalogram when participants received win or loss feedback in a simple gambling task. Pain treatment was conducted on 33 participants with topical capsaicin cream and on 33 participants with hand cream as a control. Results showed that pain generally increased the P300 amplitude for both types of feedback but did not affect feedback-related negativity (FRN). A significant interaction effect of treatment (painful, non-painful) and outcome (win, loss) was observed on delta oscillation as pain only enhanced the power of win feedback. In addition, the FRN and theta oscillation responded more to loss feedback, but this effect was unaffected by pain. These findings indicate that pain may enhance secondary value representation and evaluation processes of rewards, but does not influence primary distinction of reward or reward expectation. The temporal unfolding of how pain affects reward-related neural activities highlights the prominent impact of pain on high-level cognitive processes associated with reward.

Brain mechanisms of automated conflict avoidance simulator supervision

Supervision of automated systems is an ubiquitous aspect of most of our everyday life activities which is even more necessary in high risk industries (aeronautics, power plants, etc.). Performance monitoring related to our own error making has been widely studied. Here we propose to assess the neurofunctional correlates of system error detection. We used an aviation-based conflict avoidance simulator with a 40% error-rate and recorded the electroencephalographic activity of participants while they were supervising it. Neural dynamics related to the supervision of system's correct and erroneous responses were assessed in the time and time-frequency domains to address the dynamics of the error detection process in this environment. Two levels of perceptual difficulty were introduced to assess their effect on system's error detection-related evoked activity. Using a robust cluster-based permutation test, we observed a lower widespread evoked activity in the time domain for errors compared to correct responses detection, as well as a higher theta-band activity in the time-frequency domain dissociating the detection of erroneous from that of correct system responses. We also showed a significant effect of difficulty on time-domain evoked activity, and of the phase of the experiment on spectral activity: a decrease in early theta and alpha at the end of the experiment, as well as interaction effects in theta and alpha frequency bands. These results improve our understanding of the brain dynamics of performance monitoring activity in closer-to-real-life settings and are a promising avenue for the detection of error-related components in ecological and dynamic tasks.

Reward-based decision-making in mesial temporal lobe epilepsy patients with unilateral hippocampal sclerosis pre- and post-surgery

BACKGROUND

Correct functioning of the reward processing system is critical for optimizing decision-making as well as preventing the development of addictions and/or neuropsychiatric symptoms such as depression, apathy, and anhedonia. Consequently, patients with mesial temporal lobe epilepsy due to unilateral hippocampal sclerosis (mTLE-UHS) represent an excellent opportunity to study the brain networks involved in this system.

OBJECTIVE

The aim of the current study was to evaluate decision-making and the electrophysiological correlates of feedback processing in a sample of mTLE-UHS patients, compared to healthy controls. In addition, we assessed the impact of mesial temporal lobe surgical resection on these processes, as well as general, neuropsychological functioning.

METHOD

17 mTLE-UHS patients and 17 matched healthy controls completed: [1] a computerized version of the Game of Dice Task, [2] a Standard Iowa Gambling Task, and [3] a modified ERP version of a probabilistic gambling task coupled with multichannel electroencephalography. Neuropsychological scores were also obtained both pre- and post-surgery.

RESULTS

Behavioral analyses showed a pattern of increased risk for the mTLE-UHS group in decision-making under ambiguity compared to the control group. A decrease in the amplitude of the Feedback Related Negativity (FRN), a weaker effect of valence on delta power, and a general reduction of delta and theta power in the mTLE-UHS group, as compared to the control group, were also found. The beta-gamma activity associated with the delivery of positive reward was similar in both groups. Behavioral performance and electrophysiological measures did not worsen post-surgery.

CONCLUSIONS

Patients with mTLE-UHS showed impairments in decision-making under ambiguity, particularly when they had to make decisions based on the outcomes of their choices, but not in decision-making under risk. No group differences were observed in decision-making when feedbacks were random. These results might be explained by the abnormal feedback processing seen in the EEG activity of patients with mTLE-UHS, and by concomitant impairments in working memory, and memory. These impairments may be linked to the disruption of mesial temporal lobe networks. Finally, feedback processing and decision-making under ambiguity were already affected in mTLE-UHS patients pre-surgery and did not show evidence of clear worsening post-surgery.

Expectations of immediate and delayed reward differentially affect cognitive task performance

The current study used a modified Monetary Incentive Delay task to examine the neural mechanisms underlying anticipating and receiving an immediate or delayed reward and examined the influence of pursuing these rewards on cognitive task performance. A pre-cue indicating the potential of gaining a monetary reward (immediate-, delayed-, vs. no-reward) was followed by a target stimulus requiring a fast and accurate response. Then, response-contingent feedback was presented indicating whether or not the participant would receive the corresponding reward. Linear mixed-effect models revealed the fastest behavioural responses and the strongest neural activity, as reflected in event-related-potentials and event-related-spectral-perturbation responses, for immediate reward, followed by delayed reward, with the slowest behavioural responses and the weakest neural activities observed in the no-reward condition. Expectations related to the cue-P3 component and the cue-delta activities predicted behavioural performance, especially in the immediate reward condition. Moreover, exploratory analyses revealed that depression moderated the relationship between target-locked neural activity and behavioural performance in the delayed reward condition, with lower neural activity being related to worse behavioural performance amongst participants scoring high on depression. These results indicate that differential value representations formed through delay discounting directly affect neural responses in reward processing and directly influence the effort invested in the current task, which is reflected by behavioural responses and is in agreement with the expected value of control theory.

The cognitive dynamics of small-sooner over large-later preferences during temporal discounting task through event-related oscillations (EROs)

Event-related oscillations (ERO) may provide a useful tool for the identification of cognitive processes during economic decisions. In the present study, we investigate peak-to-peak amplitude of task event-related oscillations of healthy subjects during delay discounting task. The study included forty-seven consecutive volunteers with mean 22 age- and matched education and socioeconomic condition. We used two temporal discounting (TD) tasks: the first was used to find individual indifference points for a set of delays and in the second, we recorded EEG as the participants made now vs delay decisions for the indifferent options. The EEG activity were recorded from 24 electrodes placed on the head surface according to the international 10-20 system. EEG activity for each choice (now and future) was averaged separately. The ERO responses were calculated for delta, theta, alpha and beta bands by the peak-to-peak measures. After Bonferroni correction, we found a significant effect of the decision process on the left frontal theta, left centroparietal delta, and frontoparietal beta oscillations. These were significantly greater during future decisions compared to now condition. These results indicate that a widespread frontoparietal network is implicated during delay discounting.

Electrophysiological underpinnings of reward processing: Are we exploiting the full potential of EEG?

Understanding how the brain processes reward is an important and complex endeavor, which has involved the use of a range of complementary neuroimaging tools, including electroencephalography (EEG). EEG has been praised for its high temporal resolution but, because the signal recorded at the scalp is a mixture of brain activities, it is often considered to have poor spatial resolution. Besides, EEG data analysis has most often relied on event-related potentials (ERPs) which cancel out non-phase locked oscillatory activity, thus limiting the functional discriminative power of EEG attainable through spectral analyses. Because these three dimensions -temporal, spatial and spectral- have been unequally leveraged in reward studies, we argue that the full potential of EEG has not been exploited. To back up our claim, we first performed a systematic survey of EEG studies assessing reward processing. Specifically, we report on the nature of the cognitive processes investigated (i.e., reward anticipation or reward outcome processing) and the methods used to collect and process the EEG data (i.e., event-related potential, time-frequency or source analyses). A total of 359 studies involving healthy subjects and the delivery of monetary rewards were surveyed. We show that reward anticipation has been overlooked (88% of studies investigated reward outcome processing, while only 24% investigated reward anticipation), and that time-frequency and source analyses (respectively reported by 19% and 12% of the studies) have not been widely adopted by the field yet, with ERPs still being the dominant methodology (92% of the studies). We argue that this focus on feedback-related ERPs provides a biased perspective on reward processing, by ignoring reward anticipation processes as well as a large part of the information contained in the EEG signal. Finally, we illustrate with selected examples how addressing these issues could benefit the field, relying on approaches combining time-frequency analyses, blind source separation and source localization.

Neurophysiological correlates of purchase decision-making

Economic decisions are characterized by their uncertainty and the lack of explicit feedback that indicates the correctness of decisions at the time they are made. Nevertheless, very little is known about the neural mechanisms involved in this process. Our study sought to identify the neurophysiological correlates of purchase decision-making in situations where the optimal purchase time is not known. EEG was recorded in 24 healthy subjects while they were performing a new experimental paradigm that simulates real economic decisions. At the time of price presentation, we found an increase in the P3 Event-Related Potential and induced theta and alpha oscillatory activity when participants chose to buy compared to when they decided to wait for a better price. These results reflect the engagement of attention and executive function in purchase decision-making and might help in the understanding of brain mechanisms underlying economic decisions in uncertain scenarios.

Cortical Patterns of Pleasurable Musical Chills Revealed by High-Density EEG

Music has the capacity to elicit strong positive feelings in humans by activating the brain's reward system. Because group emotional dynamics is a central concern of social neurosciences, the study of emotion in natural/ecological conditions is gaining interest. This study aimed to show that high-density EEG (HD-EEG) is able to reveal patterns of cerebral activities previously identified by fMRI or PET scans when the subject experiences pleasurable musical chills. We used HD-EEG to record participants (11 female, 7 male) while listening to their favorite pleasurable chill-inducing musical excerpts; they reported their subjective emotional state from low pleasure up to chills. HD-EEG results showed an increase of theta activity in the prefrontal cortex when arousal and emotional ratings increased, which are associated with orbitofrontal cortex activation localized using source localization algorithms. In addition, we identified two specific patterns of chills: a decreased theta activity in the right central region, which could reflect supplementary motor area activation during chills and may be related to rhythmic anticipation processing, and a decreased theta activity in the right temporal region, which may be related to musical appreciation and could reflect the right superior temporal gyrus activity. The alpha frontal/prefrontal asymmetry did not reflect the felt emotional pleasure, but the increased frontal beta to alpha ratio (measure of arousal) corresponded to increased emotional ratings. These results suggest that EEG may be a reliable method and a promising tool for the investigation of group musical pleasure through musical reward processing.

Cingulate oscillatory activity reflects the quality of memory representations in visuospatial working memory

The human brain has the high likelihood for committing errors when confronted by a day-to-day situation that demands to process more than four integrated items in working memory, for example driving a car to a new destination in high traffic. However, neural mechanisms underlying the response outcome in working memory is still unclear. High temporal resolution and improved spatial resolution of dense array electroencephalogram (EEG) make it an ideal tool to investigate the dynamics of brain networks. In the present study, the brain activity of twenty healthy male volunteers was investigated during correct and error trials of visuospatial working memory task using dense array EEG. Independent brain components were identified using independent component analysis (ICA). Event-related spectral perturbations (ERSP) were computed for each independent component using Morlet wavelet transform for the frequency range of 3-70 Hz. ERSP of independent component clusters identified using K-means algorithm were statistically compared between correct and error trials. Delta and theta power increased in the component cluster located at cingulate gyrus before the error response of visuospatial working memory task. The current study findings suggest that cingulate oscillatory activity might reflect the quality of memory representation and intensity of target uncertainty during the visuospatial search.

Emotional content impacts how executive function ability relates to willingness to wait and to work for reward

Research has demonstrated that better value-based decision making (e.g., waiting or working for rewards) relates to greater executive function (EF) ability. However, EF is not a static ability, but is influenced by the emotional content of the task. As such, EF ability in emotional contexts may have unique associations with value-based decision making, in which costs and benefits are explicit. Participants (N = 229) completed an EF task (with both negative and neutral task conditions) and two value-based decision-making tasks. Willingness to wait and to work were evaluated in separate path models relating the waiting and working conditions to the EF conditions. Willingness to wait and willingness to work showed distinct relationships with EF ability: Greater EF ability on a negative, but not on a neutral, EF task was related to a willingness to wait for a reward, whereas greater EF ability across both EF tasks was related to a greater willingness to work for a reward. EF ability on a negative EF task showed an inverted-U relationship to willingness to wait for reward, and was most related to willingness to wait at a 6-month delay. Greater EF, regardless of whether the task was negative or neutral, was related to a greater willingness to work when reward was uncertain (50%) or was likely (88%), but not when reward was unlikely (12%). This study suggests that the emotional content of value-based decisions impacts the relationship between EF ability and willingness to wait or to work for reward.

Measuring facets of reward sensitivity, inhibition, and impulse control in individuals with problematic Internet use

INTRODUCTION

Problematic Internet Use (PIU) is the inability to control the amount of time spent on the Internet. Research indicates that abnormalities in reward sensitivity, sensitivity to punishment, and impulse control drive addictive behaviors such as substance abuse and gambling disorders, but it is unclear whether this is also the case in PIU.

METHODS

Behavioral tasks and scales were completed by 62 participants (32 PIU individuals and 30 no-PIU individuals) to assess reward sensitivity, sensitivity to punishment, as well as inhibitory function and impulse control. Measures administered included Go/No-Go, delay discounting, Behavioral Inhibition/Activation (BIS/BAS) scales and the Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ).

RESULTS

The PIU group endorsed greater reward sensitivity and punishment sensitivity as indexed by the SPSRQ. However, there were no group differences with regards to delay discounting, performance in the Go/No-Go task, or endorsement in the BIS/BAS scales.

DISCUSSION

The present study found increased reward sensitivity and sensitivity to punishment in PIU individuals, though impulse control was not observably affected. Future experimental studies are needed to inform our conceptualization of the etiology of addictive behavior as it pertains to PIU. Further investigation will aid in informing prevention and intervention efforts.

Internal cost of spontaneous deception revealed by ERPs and EEG spectral perturbations

Abundant literature has studied the behavioral and neural correlates of deception, but little research has focused on the internal cost of spontaneous deception. In the present study, the event-related potential and event-related spectral perturbations techniques were used to measure the internal cost of spontaneous deception by having participants perform a sender–receiver task in which they decided whether to send deceptive messages to increase their payoff from the task. Several important main findings emerged from this study. We observed a reward positivity (RewP) after senders sent the message, suggesting an integration of reward with associated cost after response in our task. Furthermore, spontaneous deception decreased the amplitude of the RewP and power in the delta and beta bands, whereas it increased the amplitude of power in the theta band, indicating that deception carried an internal cost that devalued individuals’ rewards.

Single-trial EEG dissociates motivation and conflict processes during decision-making under risk

In making decisions under risk (i.e., choosing whether to gamble when the outcome probabilities are known), two aspects of decision are of particular concern. The first, if gambling, is how large are potential gains compared to losses? The subjectively larger, the more rewarding to gamble. Thus, this aspect of decision-making, quantified through expected utility (EU), is motivation-related. The second concern is how easy is it to reach the decision? When subjective desirability between gambling and not-gambling is clearly different from each other (regardless of the direction), it is easier to decide. This aspect, quantified through utility distance (UD), is conflict-related. It is unclear how the brain simultaneously processes these two aspects of decision-making. Forty-five participants decided whether to gamble during electroencephalogram (EEG) recording. To compute trial-by-trial variability in EU and UD, we fit participants' choices to models inspired by Expected-Utility and Prospect theories using hierarchical-Bayesian modeling. To examine unique influences of EU and UD, we conducted model-based single-trial EEG analyses with EU and UD as simultaneous regressors. While both EU and UD were positively associated with P3-like activity and delta-band power, the contribution of EU was around 200 ms earlier. Thus, during decision-making under risk, people may allocate their attention to motivation-related aspects before conflict-related aspects. Next, following learning the options and before reporting their decision, higher EU was associated with stronger alpha and beta suppression, while higher UD was associated with a stronger contingent-negativity-variation-like activity. This suggests distinct roles of EU and UD on anticipation-related processes. Overall, we identified time and frequency characteristics of EEG signals that differentially traced motivation-related and conflict-related information during decision-making under risk.

Altered Oscillatory Responses to Feedback in Borderline Personality Disorder are Linked to Symptom Severity

Several studies using electroencephalography (EEG) demonstrate that the processing of feedback in patients suffering from borderline personality disorder (BPD) is altered in comparison to healthy controls. Differences occur in the theta (ca. 5 Hz) and high-beta frequency-ranges (ca. 20 Hz) of oscillations in response to negative and positive feedback, respectively. However, alpha (ca. 10 Hz) and low-beta (ca. 15 Hz) oscillations have also been shown to be involved in feedback processing. We hypothesized that additional alterations might occur in these frequency ranges in BPD. Eighteen patients with BPD and twenty-two healthy controls performed a gambling task while 64-channel-EEG was recorded. Induced oscillatory responses to positive (i.e. gain) and negative (i.e. loss) feedback in the alpha and low-beta frequency range were investigated. No significant differences were found in the alpha frequency range. Regarding the low-beta frequency range a significant Group (i.e. BPD vs. healthy controls) × Valence (i.e. gain vs. loss) interaction in the time frame between 600 and 700 milliseconds after feedback was found. This effect showed a significant correlation with symptom severity (assessed with the BSL-23). The results indicate that feedback processing in BPD could be more heavily altered than previously expected, with more severe symptomatology being linked to stronger alterations in oscillatory responses to feedback in the low-beta range.

Reappraisal and suppression emotion-regulation tendencies differentially predict reward-responsivity and psychological well-being

Individuals who suppress their emotions experience less positive emotions, worse relationships, and a reduced quality of life whereas those who tend to reappraise show an opposite pattern. Despite this divergent pattern, few have asked how the use of these emotion-regulation strategies relates to reward responsivity. We predicted that elevated suppression would be associated with blunted reward responsivity, whereas reappraisal would be associated with elevated reward responsivity. To test this hypothesis, participants completed a measure of individual differences in emotion-regulation strategies, measures of self-reported reward responsivity, and then a reward time-estimation task (Kotani et al., 2003) while electroencephalography (EEG) was recorded. Results revealed that individual differences in cognitive reappraisal were unrelated to self-report measures of reward responsivity, whereas suppression was associated with blunted reward responsivity. At the neural level, reappraisal was associated with greater attention to the rewarding cues, as indexed by the P300 event-related potential (ERP) component, whereas suppression was related to blunted reward anticipation, as indexed by the stimulus-preceding negativity (SPN) ERP component. Suppression prospectively predicted worse psychological well-being 2.5 years later and blunted neural reward anticipation partially explained this association. Taken together with past research, these results suggest reappraisal tendencies may lead to better outcomes due, in part, to enhanced reward responsivity, whereas the negative consequences of suppression may be associated with blunted reward responsivity.

Power of Feedback-Induced Beta Oscillations Reflect Omission of Rewards: Evidence From an EEG Gambling Study

The functional role of high beta oscillations (20–35 Hz) during feedback processing has been suggested to reflect unexpected gains. Using a novel gambling task that separates gains and losses across blocks and directly compares reception of monetary rewards to a ‘no-reward/punishment’ condition with equal probability we aimed to further investigate the role of beta oscillations. When contrasting different feedback conditions across rewards, we found that a late low beta component (12–20 Hz) had increased in power during the omission of rewards relative to the reception of rewards, while no differences were observed during the loss domain. These findings may indicate that late low beta oscillations in the context of feedback processing may respond to omission of gains relative to other potential outcomes. We speculate that late low beta oscillations may operate as a learning mechanism that signals the brain to make future adequate decisions. Overall, our study provides new insights for the role of late low beta oscillations in reward processing.

Making mistakes in public: Being observed magnifies physiological responses to errors

As social beings, humans often find themselves in situations in which they are required to act against the backdrop of public observation. In these situations, the presence of observers may influence how we evaluate feedback and learn from it. The neural basis of such observer-induced behavioral changes is not well understood at present. In the current study, we used event-related potentials (ERPs) and event-related spectral perturbations (ERSPs) combined with a gambling task to examine how the presence of others modulates the neural representations of errors and losses. In the alone condition, participants finished the gambling task alone while in the observed condition, they were observed by two others. Results revealed that the observer effect particularly altered the feedback-related negativity (FRN) and the late positive potential (LPP). The difference in FRN amplitude between error and correct feedback was enlarged when participants were being observed. The LPP also showed a marginally enhanced amplitude difference between error and correct feedback in the observed condition. We also found that theta power was enhanced in the observed condition. Taken together, our findings suggest that neural representations of errors were influenced by the presence of others.

Monetary Incentives Modulate Feedback-related Brain Activity

Previous research has shown that feedback evaluation is sensitive to monetary incentive. We investigated whether this sensitivity is driven by motivational salience (the difference between both rewarding and punishing events versus neutral events) or by motivational valence (the difference between rewarding and punishing events). Fifty-seven participants performed a monetary incentive delay task under a gain context, a loss context, and a neutral context with their electroencephalogram recorded. During the time domain, the feedback-related negativity (FRN) showed a motivational salience effect whereas the P3 displayed a reward valence effect. During the time-frequency domain, we observed a motivational salience effect for phase-locked theta power regardless of performance feedback, but a reward valence effect for non-phase-locked theta power in response to unsuccessful feedback. Moreover, we found a reward valence effect for phase-locked delta. These findings thus suggest that the affective modulation on feedback evaluation can be driven either by motivational valence or by motivational salience, which depends on the temporal dynamics (the FRN vs. the P3), the frequency dynamics (theta vs. delta power), as well as the phase dynamics (evoked vs. induced power).

Laboratory-induced learned helplessness attenuates approach motivation as indexed by posterior versus frontal theta activity

Research suggests that midline posterior versus frontal electroencephalographic (EEG) theta activity (PFTA) may reflect a novel neurophysiological index of approach motivation. Elevated PFTA has been associated with approach-related tendencies both at rest and during laboratory tasks designed to enhance approach motivation. PFTA is sensitive to changes in dopamine signaling within the fronto-striatal neural circuit, which is centrally involved in approach motivation, reward processing, and goal-directed behavior. To date, however, no studies have examined PFTA during a laboratory task designed to reduce approach motivation or goal-directed behavior. Considerable animal and human research supports the hypothesis put forth by the learned helplessness theory that exposure to uncontrollable aversive stimuli decreases approach motivation by inducing a state of perceived uncontrollability. Accordingly, the present study examined the effect of perceived uncontrollability (i.e., learned helplessness) on PFTA. EEG data were collected from 74 participants (mean age = 19.21 years; 40 females) exposed to either Controllable (n = 26) or Uncontrollable (n = 25) aversive noise bursts, or a No-Noise Condition (n = 23). In line with prediction, individuals exposed to uncontrollable aversive noise bursts displayed a significant decrease in PFTA, reflecting reduced approach motivation, relative to both individuals exposed to controllable noise bursts or the No-Noise Condition. There was no relationship between perceived uncontrollability and frontal EEG alpha asymmetry, another commonly used neurophysiological index of approach motivation. Results have implications for understanding the neurophysiology of approach motivation and establishing PFTA as a neurophysiological index of approach-related tendencies.

Elevated outcome-anticipation and outcome-evaluation ERPs associated with a greater preference for larger-but-delayed rewards

Although waiting for a reward reduces or discounts its value, some people have a stronger tendency to wait for larger rewards and forgo smaller-but-immediate rewards. This ability to delay gratification is captured by individual differences in so-called intertemporal choices in which individuals are asked to choose between larger-but-delayed versus smaller-but-immediate rewards. The current study used event-related potentials (ERPs) to examine whether enhancement in two neurocognitive processes, outcome anticipation and outcome evaluation, modulate individual variability in intertemporal responses. After completing a behavioral intertemporal choice task, 34 participants performed an ERP gambling task. From this ERP task, we separately examined individual differences in outcome anticipation (stimulus-preceding negativity; SPN), early outcome valuation (feedback-related negativity; FRN), and late outcome evaluation (P3). We observed that both elevated outcome-anticipation (SPN) and late outcome-evaluation (P3) neural processes predicted a stronger preference toward larger-but-delayed rewards. No relationship was observed between intertemporal responses and early outcome evaluation (FRN), indicating that the relationship between outcome evaluation and intertemporal responses was specific to the late outcome-evaluation processing stream. Moreover, multiple regression analyses indicated that the SPN and P3 independently modulate individual differences in intertemporal responses, suggesting separate mechanisms underlie the relationship between these two neurocognitive processes and intertemporal responses. Accordingly, we identify two potential neurocognitive modulators of individual variability in intertemporal responses. We discuss the mechanisms underlying these modulators in terms of anticipation-related processing (SPN) and a saliency bias toward gain (compared to loss) outcomes (P3).

Oscillatory rhythm of reward: anticipation and processing of rewards in children with and without autism

Background

Autism spectrum disorder (ASD) is a complex neurodevelopmental condition, and multiple theories have emerged concerning core social deficits. While the social motivation hypothesis proposes that deficits in the social reward system cause individuals with ASD to engage less in social interaction, the overly intense world hypothesis (sensory over-responsivity) proposes that individuals with ASD find stimuli to be too intense and may have hypersensitivity to social interaction, leading them to avoid these interactions.

Methods

EEG was recorded during reward anticipation and reward processing. Reward anticipation was measured using alpha asymmetry, and post-feedback theta was utilized to measure reward processing. Additionally, we calculated post-feedback alpha suppression to measure attention and salience. Participants were 6- to 8-year-olds with (N = 20) and without (N = 23) ASD.

Results

Children with ASD showed more left-dominant alpha suppression when anticipating rewards accompanied by nonsocial stimuli compared to social stimuli. During reward processing, children with ASD had less theta activity than typically developing (TD) children. Alpha activity after feedback showed the opposite pattern: children with ASD had greater alpha suppression than TD children. Significant correlations were observed between behavioral measures of autism severity and EEG activity in both the reward anticipation and reward processing time periods.

Conclusions

The findings provide evidence that children with ASD have greater approach motivation prior to nonsocial (compared to social) stimuli. Results after feedback suggest that children with ASD evidence less robust activity thought to reflect evaluation and processing of rewards (e.g., theta) compared to TD children. However, children with ASD evidence greater alpha suppression after feedback compared to TD children. We hypothesize that post-feedback alpha suppression reflects general cognitive engagement-which suggests that children with ASD may experience feedback as overly intense. Taken together, these results suggest that aspects of both the social motivation hypothesis and the overly intense world hypothesis may be occurring simultaneously.

Slow and Fast Responses: Two Mechanisms of Trial Outcome Processing Revealed by EEG Oscillations

Cognitive control includes maintenance of task-specific processes related to attention, and non-specific regulation of motor threshold. Depending upon the nature of the behavioral tasks, these mechanisms may predispose to different kinds of errors, with either increased or decreased response time (RT) of erroneous responses relative to correct responses. Specifically, slow responses are related to attentional lapses and decision uncertainty, these conditions tending to delay RTs of both erroneous and correct responses. Here we studied if RT may be a valid approximation distinguishing trials with high and low levels of sustained attention and decision uncertainty. We analyzed response-related and feedback-related modulations in theta, alpha and beta band activity in the auditory version of the two-choice condensation task, which is highly demanding for sustained attention while involves no inhibition of prepotent responses. Depending upon response speed and accuracy, trials were divided into slow correct, slow erroneous, fast correct and fast erroneous. We found that error-related frontal midline theta (FMT) was present only on fast erroneous trials. The feedback-related FMT was equally strong on slow erroneous and fast erroneous trials. Late post-response posterior alpha suppression was stronger on erroneous slow trials. Feedback-related frontal beta was present only on slow correct trials. The data obtained cumulatively suggests that RT allows distinguishing the two types of trials, with fast trials related to higher levels of attention and low uncertainty, and slow trials related to lower levels of attention and higher uncertainty.

To Know or Not to Know? Theta and Delta Reflect Complementary Information about an Advanced Cue before Feedback in Decision-Making

To investigate brain activity during the reinforcement learning process in social contexts is a topic of increasing research interest. Previous studies have mainly focused on using electroencephalograms (EEGs) for feedback evaluation in reinforcement learning tasks by measuring event-related potentials. Few studies have investigated the time–frequency (TF) profiles of a cue that manifested whether a following feedback is available or not after decision-making. Moreover, it remains unclear whether the TF profiles of the cue interact with different agents to whom the feedback related. In this study we used the TF approach to test EEG oscillations of the cue stimuli in three agents (‘Self’, ‘Other’, and ‘Computer’) conditions separately. The results showed that the increased central-posterior delta power was elicited by the feedback unavailable cues more so than with the feedback available cue within 200–350 ms after the onset of the cue, but only in the self-condition. Moreover, a frontal-central theta oscillation had enhanced power when following the feedback unavailable cue as opposed to the feedback available cue across three agencies. These findings demonstrated that the cue for knowing an outcome produced reward prediction error-like signals, which were mirrored by the delta and theta oscillations during decision-making. More importantly, the present study demonstrated that the theta and delta oscillations reflected separable components of the advanced cue processing before the feedback in decision-making.