The better, the bigger: The effect of graded positive performance feedback on the reward positivity

The affective response to positive performance feedback is associated with motor learning

Motor skill learning and performance are improved when successful actions are paired with extrinsic rewards, such as money. Positive feedback indicating successful task performance is thought to induce intrinsic reward associated with goal attainment, evidenced by increases in positive affect that correlate with neural reward signaling. However, it is not clear whether the subjective, internal reward processes elicited by positive feedback promote motor learning and performance.Here, we tested the hypothesis that intrinsic reward elicited by positive feedback promotes motor learning and performance. Participants practiced a visuomotor interception task using a joystick, and received feedback during practice indicating success or failure depending on their accuracy. During practice, the accuracy demands were adapted to control and vary the frequency of positive feedback across randomly ordered blocks of practice at either 50%, 70%, or 90%. Performance was measured for each condition as the average accuracy during practice. Learning was estimated by measuring the accuracy pre and post practice in the absence of feedback. We queried participants periodically on their enjoyment of the task to index affective responses to performance feedback.The intrinsic reward elicited by positive feedback, operationalized by the increase in enjoyment immediately following positive versus negative feedback, was positively correlated with learning from pre to post practice. However, increasing the overall amount of positive feedback by lower accuracy demands did not improve performance. These results suggest that experiencing intrinsic reward due to positive feedback benefits motor learning only when it is contingent on good performance.

Reward-Related Brain Activity Mediates the Relationship Between Decision-Making Deficits and Pediatric Depression Symptom Severity

BACKGROUND

The mechanisms that link neural and behavioral indices of reduced reward sensitivity in depression, particularly in children, remain unclear. Reward positivity (RewP), a neural index of reward processing, has been consistently associated with depression. Separately, recent studies using the drift-diffusion model on behavioral data have delineated computational indices of reward sensitivity. Therefore, in the current study, we examined whether RewP is a neural mediator of drift-diffusion model-based indices of reward processing in predicting pediatric depression across varying levels of symptom severity.

METHODS

A community sample of 166 girls, ages 8 to 14 years, completed 2 tasks. The first was a reward guessing task from which RewP was computed using electroencephalography; the second was a probabilistic reward-based decision-making task. On this second task, drift-diffusion model analysis was applied to behavioral data to quantify the efficiency of accumulating reward-related evidence (drift rate) and potential baseline bias (starting point) toward the differently rewarded choices. Depression severity was measured using the self-report Children's Depression Inventory.

RESULTS

RewP was correlated with drift rate, but not starting point bias, toward the more rewarded choice. Furthermore, RewP completely mediated the association between a slower drift rate toward the more rewarded option and higher depression symptom severity.

CONCLUSIONS

Our findings suggest that reduced neural sensitivity to reward feedback may be a neural mechanism that underlies behavioral insensitivity to reward in children and adolescents with higher depression symptom severity, offering novel insights into the relationship between neural and computational indices of reward processing in this context.

Feedback processing in cognitive and motor tasks: A meta-analysis on the feedback-related negativity

For motor learning, the processing of behavioral outcomes is of high significance. The feedback-related negativity (FRN) is an event-related potential, which is often described as a correlate of the reward prediction error in reinforcement learning. The number of studies examining the FRN in motor tasks is increasing. This meta-analysis summarizes the component in the motor domain and compares it to the cognitive domain. Therefore, a data set of a previous meta-analysis in the cognitive domain that comprised 47 studies  was reanalyzed and compared to additional 25 studies of the motor domain. Further, a moderator analysis for the studies in the motor domain was conducted. The FRN amplitude was higher in the motor domain than in the cognitive domain. This might be related to a higher task complexity and a higher feedback ambiguity of motor tasks. The FRN latency was shorter in the motor domain than in the cognitive domain. Given that sensory information can be used as an external feedback predictor prior to the presentation of the final feedback, reward processing in the motor domain may have been faster and reduced the FRN latency. The moderator variable analysis revealed that the feedback modality influenced the FRN latency, with shorter FRN latencies after bimodal than after visual feedback. Processing of outcome feedback seems to share basic principles in both domains; however, differences exist and should be considered in FRN studies. Future research is motivated to scrutinize the effects of bimodal feedback and other moderators within the motor domain.

Distinct influence of inter- versus intra-trial feedback on the brain response to subsequent feedback: Evidence from event-related potentials

Substantial evidence indicates that feedback processing not only varies with the valence of feedback, but is also highly dependent on contextual factors. Even so, the influence of prior outcome history on current outcome evaluation is far from clear. To investigate this issue, we conducted two event-related potential (ERP) experiments using a modified gambling task whereby each trial was associated with two consequences. In experiment 1, two instances of feedback indicated participant performance on two dimensions of a single decision, within a trial. In experiment 2, participants made two decisions in each trial, and then received two instances of feedback. We examined the feedback-related negativity (FRN) as an index of feedback processing. When both instances of feedback were relevant to the same trial (intra-trial), the FRN to the second was affected by the valence of the immediately previous feedback: The FRN was amplified to losses following wins. This was observed in both experiment 1 and experiment 2. When two instances of feedback were relevant to two different trials (inter-trial), the effect of immediately previous feedback on the FRN was inconsistent. In experiment 1 there was no effect of feedback from the previous trial on the FRN. However, in Experiment 2 there was an effect of inter-trial feedback on the FRN that was opposite to the effect of intra-trial feedback: The FRN was amplified when losses followed losses. Taken together, the findings suggest that the neural systems involved in reward processing dynamically and continuously integrate preceding feedback for the evaluation of present feedback.

Reduced positive affect alters reward learning via reduced information encoding in the Reward Positivity

Reward Positivity (RewP) is a feedback-locked event-related potential component that is specifically elicited by rewarding feedback and scales with positive reward prediction error, a hallmark of reinforcement learning models. The RewP is also diminished in depression, suggesting that it may be a novel marker of anhedonia. Here, we examined if a sad mood induction offered an opportunity to causally induce a mood-related alteration of the RewP and reward-related learning. In Experiment 1 (N = 50 total), participants were randomly assigned to previously established sad or neutral mood induction procedures before a probabilistic selection task. This manipulation failed to induce changes in affect, suggesting that standard methods are inadequate. In Experiment 2 (N = 50 total), participants were randomly assigned to newly developed happy versus sad mood manipulations, which successfully induced large changes in affect. While the RewP was unaffected by mood induction, positive mood moderated the relationship between prediction error encoding in the RewP and reward learning, such that low positive mood and low prediction error encoding resulted in poorer reward learning. These findings provide a mechanistic example of how reduced positive affect moderates reward learning via poorer information encoding in the RewP.

Cognitive [Computational] Neuroscience Test Reliability and Clinical Applications for Serious Mental Illness (CNTRaCS) Consortium: Progress and Future Directions

The development of treatments for impaired cognition in schizophrenia has been characterized as the most important challenge facing psychiatry at the beginning of the twenty-first century. The Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia (CNTRICS) project was designed to build on the potential benefits of using tasks and tools from cognitive neuroscience to better understanding and treat cognitive impairments in psychosis. These benefits include: (1) the use of fine-grained tasks that measure discrete cognitive processes; (2) the ability to design tasks that distinguish between specific cognitive domain deficits and poor performance due to generalized deficits resulting from sedation, low motivation, poor test taking skills, etc.; and (3) the ability to link cognitive deficits to specific neural systems, using animal models, neuropsychology, and functional imaging. CNTRICS convened a series of meetings to identify paradigms from cognitive neuroscience that maximize these benefits and identified the steps need for translation into use in clinical populations. The Cognitive Neuroscience Test Reliability and Clinical Applications for Schizophrenia (CNTRaCS) Consortium was developed to help carry out these steps. CNTRaCS consists of investigators at five different sites across the country with diverse expertise relevant to a wide range of the cognitive systems identified as critical as part of CNTRICs. This work reports on the progress and current directions in the evaluation and optimization carried out by CNTRaCS of the tasks identified as part of the original CNTRICs process, as well as subsequent extensions into the Positive Valence systems domain of Research Domain Criteria (RDoC). We also describe the current focus of CNTRaCS, which involves taking a computational psychiatry approach to measuring cognitive and motivational function across the spectrum of psychosis. Specifically, the current iteration of CNTRaCS is using computational modeling to isolate parameters reflecting potentially more specific cognitive and visual processes that may provide greater interpretability in understanding shared and distinct impairments across psychiatric disorders.

An extended challenge-based framework for practice design in sports coaching

The challenge-point framework as a model for thinking about motor learning was first proposed in 2004. Although it has been well-cited, surprisingly this framework has not made its way into much of the applied sport science literature. One of the reasons for this omission is that the original framework had not been encapsulated into a paper accessible for sports practitioners. The framework had mostly a theoretical focus, providing a mechanistic summary of motor learning research. Our aims in this paper were to explain and elaborate on the challenge point framework to present an applied framework guiding practice design. We connect the framework to other theories that involve predictive coding, where information is attended when it disconfirms current predictions, providing a strong signal for learning. We also consider how two new dimensions (learners' motivation and practice specificity) need to be considered when designing practice settings. By moving around the different dimensions of functional difficulty, motivation, and specificity, coaches can optimize practice to achieve different learning goals. Specifically, we present three general "types" of practice: practice to learn, to transfer to competition, and to maintain current skills. Practical examples are given to illustrate how this framework can inform coach practice.

Advances in modeling learning and decision-making in neuroscience

An organism's survival depends on its ability to learn about its environment and to make adaptive decisions in the service of achieving the best possible outcomes in that environment. To study the neural circuits that support these functions, researchers have increasingly relied on models that formalize the computations required to carry them out. Here, we review the recent history of computational modeling of learning and decision-making, and how these models have been used to advance understanding of prefrontal cortex function. We discuss how such models have advanced from their origins in basic algorithms of updating and action selection to increasingly account for complexities in the cognitive processes required for learning and decision-making, and the representations over which they operate. We further discuss how a deeper understanding of the real-world complexities in these computations has shed light on the fundamental constraints on optimal behavior, and on the complex interactions between corticostriatal pathways to determine such behavior. The continuing and rapid development of these models holds great promise for understanding the mechanisms by which animals adapt to their environments, and what leads to maladaptive forms of learning and decision-making within clinical populations.

Win, lose, or draw: Examining salience, reward memory, and depression with the reward positivity

The reward positivity (RewP) is a putative biomarker of depression. Careful control of stimulus properties and manipulation of both stimulus valence and salience could facilitate interpretation of the RewP. RewP interpretation could further be improved by investigating functional outcomes of a blunted RewP in depression, such as reduced memory for rewarding outcomes. This study sought to advance RewP interpretation first by advancing task design through use of neutral (i.e., draw) control trials and counterbalanced feedback stimuli. Second, we examined the RewP's association with memory and the impact of depression. Undergraduates completed self-report measures of depression and anhedonia prior to a modified doors task in which words were displayed in colored fonts that indicated win, loss, or draw feedback. Memory of the feedback associated with each word (i.e., source memory) was tested. Results showed that RewP response to wins was more positive than to losses, which was more positive than to draws. The RewP was not associated with depression or anhedonia. The low depression group showed a source memory advantage for win words, but the high depression group did not. Source memory showed small relations to the RewP, but these did not survive Bonferroni correction. Results suggest the RewP is sensitive to salience and highlight challenges in detecting an association between the RewP and depression in modified doors tasks. Findings indicate that depression is related to dysfunctional source memory for reward but not loss and that future research should probe the possible associations between the RewP and memory in depression.

Do food images as action outcomes evoke a reward positivity?

Favourable compared to unfavourable action outcomes typically evoke a positive-going amplitude shift at frontomedial electrodes in the scalp-recorded electroencephalogram. Since prior studies on this Reward Positivity (RewP) have heavily relied on monetary outcomes, it is still debated whether the RewP is also elicited by other kinds of reward. We addressed this issue by focussing on food as another major category of daily reward. Twenty-eight healthy participants completed a decision task, in which they received images of personally liked, neutral or disliked food as outcome stimuli. Importantly, single trial outcomes were of relevance for a prolonged task goal (i.e., obtaining the liked foods and avoiding the disliked foods). The observed amplitude pattern did not correspond to the typical RewP effect observed for monetary outcomes. In particular, disliked foods evoked a similar positive-going amplitude shift as liked foods when compared to neutral foods. Exploratory analyses indicated that this pattern may result from a spatiotemporal overlap between a potential RewP response and other, emotion-related ERP components (i.e., the Early Posterior Negativity and the Late Positive Potential). We discuss our findings with regard to theoretical and methodological implications for the usage of the RewP in the study of reward processing.

Differences in Reward Sensitivity between High and Low Problematic Smartphone Use Adolescents: An ERP Study

Background: Problematic smartphone use is highly prevalent in adolescent populations compared to other age groups (e.g., adults and young children). Previous studies suggested that higher levels of reward sensitivity were associated with problematic smartphone use. Therefore, the current study investigated the neural processing of monetary and social reward and punishment feedbacks between high and low problematic smartphone use adolescents. Methods: 46 adolescents participated in the current study and they were categorized into two groups based on their level of problematic smartphone use: those who obtained low scores on the measure of problematic smartphone use were categorized as Low Problematic Smartphone Use (LPSU), and those who obtained high scores on the measure of problematic smartphone use were categorized as High Problematic Smartphone Use (HPSU). Electrocortical activities were recorded during the processing of monetary and social reward and punishment feedback. Results: (1) LPSUs evoked larger P3 in the social punishment condition than in the monetary punishment condition. HPSUs evoked larger P3 in the social reward condition than in the monetary condition. (2) The feedback-related negativity (FRN) amplitudes in the reward condition were significantly larger than those in the punishment condition. (3) HPSUs induced larger reward positivity in social feedback conditions than in monetary feedback conditions, while there were no significant differences between the two types of conditions in the LPSUs. Discussion: The results provide neural underpinning evidence that high sensitivity to social rewards may be related to problematic smartphone use in adolescence.

Valence-dependent Neural Correlates of Augmented Feedback Processing in Extensive Motor Sequence Learning - Part I: Practice-related Changes of Feedback Processing

Several event-related potentials (ERPs) are associated with the processing of valence-dependent augmented feedback during the practice of motor tasks. In this study, 38 students learned a sequential arm-movement-task with 192 trials in each of five practice sessions (960 practice trials in total), to examine practice-related changes in neural feedback processing. Electroencephalogram (EEG) was recorded in the first and last practice session. An adaptive bandwidth for movement accuracy led to equal amounts of positive and negative feedback. A frontal located negative deflection in the time window of the feedback-related negativity (FRN) was more negative for negative feedback and might reflect reward prediction errors in reinforcement learning. This negativity increased after extensive practice, which might indicate that smaller errors are harder to identify in the later phase. The late fronto-central positivity (LFCP) was more positive for negative feedback and is assumed to be associated with supervised learning and behavioral adaptations based on feedback with higher complexity. No practice-related changes of the LFCP were observed, which suggests that complex feedback is processed independent from the practice phase. The P300 displayed a more positive activation for positive feedback, which might be interpreted as the higher significance of positive feedback for the updating of internal models in this setting. A valence-independent increase of the P300 amplitude after practice might reflect an improved ability to update the internal representation based on feedback information. These results demonstrate that valence-dependent neural feedback processing changes with extensive practice of a novel motor task. Dissociating changes in latencies of different components support the assumption that they are related to distinct mechanisms of feedback-dependent learning.

Response-based outcome predictions and confidence regulate feedback processing and learning

Influential theories emphasize the importance of predictions in learning: we learn from feedback to the extent that it is surprising, and thus conveys new information. Here, we explore the hypothesis that surprise depends not only on comparing current events to past experience, but also on online evaluation of performance via internal monitoring. Specifically, we propose that people leverage insights from response-based performance monitoring - outcome predictions and confidence - to control learning from feedback. In line with predictions from a Bayesian inference model, we find that people who are better at calibrating their confidence to the precision of their outcome predictions learn more quickly. Further in line with our proposal, EEG signatures of feedback processing are sensitive to the accuracy of, and confidence in, post-response outcome predictions. Taken together, our results suggest that online predictions and confidence serve to calibrate neural error signals to improve the efficiency of learning.

The reward positivity reflects the integrated value of temporally threefold-layered decision outcomes

In reinforcement learning, adaptive behavior depends on the ability to predict future outcomes based on previous decisions. The Reward Positivity (RewP) is thought to encode reward prediction errors in the anterior midcingulate cortex (aMCC) whenever these predictions are violated. Although the RewP has been extensively studied in the context of simple binary (win vs. loss) reward processing, recent studies suggest that the RewP scales complex feedback in a fine graded fashion. The aim of this study was to replicate and extend previous findings that the RewP reflects the integrated sum of instantaneous and delayed consequences of a singular outcome by increasing the feedback information content by a third temporal dimension. We used a complex reinforcement-learning task where each option was associated with an immediate, intermediate and delayed monetary outcome and analyzed the RewP in the time domain as well as fronto-medial theta power in the time-frequency domain. To test if the RewP sensitivity to the three outcome dimensions reflect stable trait-like individual differences in reward processing, a retesting session took place 3 months later. The results confirm that the RewP reflects the integrated value of complex temporally extended consequences in a stable manner, albeit there was no relation to behavioral choice. Our findings indicate that the medial frontal cortex receives fine graded information about complex action outcomes that, however, may not necessarily translate to cognitive or behavioral control processes.

Expectations of reward and efficacy guide cognitive control allocation

The amount of mental effort we invest in a task is influenced by the reward we can expect if we perform that task well. However, some of the rewards that have the greatest potential for driving these efforts are partly determined by factors beyond one's control. In such cases, effort has more limited efficacy for obtaining rewards. According to the Expected Value of Control theory, people integrate information about the expected reward and efficacy of task performance to determine the expected value of control, and then adjust their control allocation (i.e., mental effort) accordingly. Here we test this theory's key behavioral and neural predictions. We show that participants invest more cognitive control when this control is more rewarding and more efficacious, and that these incentive components separately modulate EEG signatures of incentive evaluation and proactive control allocation. Our findings support the prediction that people combine expectations of reward and efficacy to determine how much effort to invest.

Comparing the motivational value of rewards and losses in an EEG-pupillometry study

We found earlier that performance-contingent rewards lead to faster performance than equivalent losses [Carsten, Hoofs, Boehler, & Krebs, 2019. Motivation Science, 5(3). http://dx.doi.org/10.1037/mot0000117]. Here, we further tested the hypothesis that motivation to gain rewards is higher than to avoid losses, even when incentive values are matched. As implicit markers of motivation, we assessed electroencephalography (EEG) focusing on the P3 after target and feedback onset, and the Feedback-Related Negativity (FRN), as well as simultaneously recorded pupil size. Comparing only reward and loss prospect trials in Experiment 1, we found no consistent differences in behavior and electrophysiological markers of motivation, although pupil data suggested higher arousal after feedback in potential-loss trials. Including additional no-incentive trials in Experiment 2, we found consistent evidence that motivation to gain rewards was higher than to avoid losses: In line with behavior, the target-P3 was most pronounced for reward-related stimuli, followed by loss and no-incentive ones. This same ranking was found in the P3 and the FRN after positive outcomes (i.e., reward, avoided loss, and correct feedback in no-incentive trials). Negative outcomes featured a different pattern in line with the pupil response, which suggests that losses are emotionally salient events, without invigorating behavior proportionally. In sum, these findings suggest that the motivation to gain rewards is more pronounced than motivation to avoid equivalent losses, at least in tasks promoting transient increases in attention triggered by incentive prospect. These motivational differences may arise as avoided losses are not profitable in the long term, in contrast to gained rewards.

Aiming at ecological validity-Midfrontal theta oscillations in a toy gun shooting task

Laboratory electroencephalography (EEG) studies have already provided important insights into the neuronal mechanisms of performance monitoring. However, to our knowledge no study so far has examined neuronal correlates of performance monitoring using an ecologically valid task outside a typical laboratory setting. Therefore, we examined midfrontal theta and the feedback-related negativity (FRN) using mobile EEG in a physical shooting task within an ecologically valid environment with highly dynamical visual feedback. Participants shot a target using a toy gun while moving and looking around freely. Shots that missed the target evoked stronger midfrontal theta activity than hits and this response was rather phase-unlocked. There was no difference between misses and hits in the FRN. The results raise the question whether the absence of certain ERP components like the FRN could be due to methodological reasons or to the fact that partially different neuronal processes may be activated in the laboratory as compared to more ecologically valid tasks. Overall, our results indicate that crucial neurocognitive processes of performance monitoring can be assessed in highly dynamic and ecologically valid settings by mobile EEG.

Modification of food preferences by posthypnotic suggestions: An event-related brain potential study

The preference for high-over low-calorie food and difficulties in inhibiting the desire for high-calorie food are important factors involved in unhealthy food choices. Here, we explored posthypnotic suggestions (PHS), aiming to increase the desire for vegetables and fruits, as a possible new tool to induce a preference for low-calorie food. Following the termination of hypnosis, PHS was activated and deactivated in counterbalanced order, while event-related brain-potentials were recorded. Two tasks were administered, a food-face classification measuring implicit food preferences, where stimuli were categorized as showing food items or faces, and a Go-NoGo task measuring inhibition, where food items were selected as being appropriate for making a salad or not. In the food-face classification task without PHS, the early visual P1 component, a marker of stimulus reward-associations, was larger in response to high-than low-calorie food pictures; PHS eliminated this difference. PHS also yielded faster RTs and larger amplitudes of a late positive component in low-versus high-calorie items. Hence, PHS appeared to neutralize the positive perceptual bias toward high-calorie food items and enhance the effective processing of low-calorie items by increasing motivated attention. In the Go-NoGo task, PHS decreased the NoGo-N2; PHS increased the early Go- and NoGo-P3, possibly by turning low- and high-calorie items more pleasant and unpleasant, respectively, requiring more proactive control to inhibit task-irrelevant food-related emotions. Further, in the Go condition, PHS quickened the rejection of salad-inappropriate high-calorie items and increased the amplitude of late-P3, indicating facilitated classification of high-calorie items and increased response monitoring. Together, PHS effectively increased the preference for low-calorie food and the inhibition of impulses toward high-calorie food; therefore, PHS may be a promising tool for supporting healthy and sustainable food choices.

Neurophysiological evidence for evaluative feedback processing depending on goal relevance

Feedback signaling the success or failure of actions is readily exploited to implement goal-directed behavior. Two event-related brain potentials (ERPs) have been identified as reliable markers of evaluative feedback processing: the Feedback-Related Negativity (FRN) and the P3. Recent ERP studies have shown a substantial reduction of these components when the feedback's goal relevance (in terms of goal informativeness) was decreased. However, it remains unclear whether this lowering of evaluative feedback processing at the FRN and P3 levels (i) reflects a common regulation process operating across them or (ii) indirectly and mostly depends on valence processing. To address these questions, 44 participants performed a time estimation task wherein the perceived goal relevance of the feedback following each decision was manipulated via instructions in different blocks. We recorded 64-channel EEG and collected subjective ratings of feedback valence and relevance, separately for goal-relevant and irrelevant conditions. ERP results showed a substantial reduction of the FRN and P3 components for irrelevant than relevant feedback, despite the balanced task relevance between them. Moreover, a Principal Component Analysis (PCA) showed that these two successive ERP effects had dissociable spatiotemporal properties. Crucially, a multivariate multiple regression analysis revealed that goal relevance per se, but not valence, was the unique significant predictor of the amplitude reduction of the FRN and P3 when the feedback was goal irrelevant. Our results suggest that although these ERP components exhibit non-overlapping spatiotemporal properties and performance monitoring effects, they can both be modulated by a common, valence-unspecific process related to goal relevance.

Does practicing a skill with the expectation of teaching alter motor preparatory cortical dynamics?

Recent evidence suggests practicing a motor skill with the expectation of teaching it enhances learning by increasing information processing during motor preparation. However, the specific motor preparatory processes remain unknown. The present study sought to address this shortcoming by employing EEG to assess participants' motor preparatory processes while they completed a golf putting pretest, and then practiced putting with the expectation of (a) teaching another participant how to putt the next day (teach group, n = 30), or (b) being tested on their putting the next day (test group, n = 30). Participants' EEG during the 3-s prior to and 1-s after initiating putter movement was analyzed. All participants completed posttests 1 day after the practice session. The teach group exhibited better posttest performance (superior learning) relative to the test group, but no group differences in motor preparatory processing (EEG) emerged. However, participants in both groups exhibited linear decreases in both theta power at frontal midline and upper-alpha power over motor areas during putt initiation. These results suggest a decrease in working memory and action monitoring (frontal midline theta), and an increase in motor programming (motor upper-alpha) during putt initiation. Further, participants in both groups exhibited increased frontal midline theta from pretest to practice, but decreases in both upper motor-alpha and upper-alpha coherence between left/right temporal and motor planning regions. These results suggest participants utilized working memory and action monitoring to a greater extent during practice relative to pretest, while refining their motor programming and verbal-analytic/visuospatial involvement in motor programming.

Rewarding images do not invoke the reward positivity: They inflate it

Increasing evidence suggests that the reward positivity conforms to an axiomatic reward prediction error - that is, it closely follows the rule-like encoding of surprising reinforcers. However, a major limitation in these EEG studies is the over-reliance on a single class of secondary rewards like points or money, constraining dimensionality and limiting generalizability. In the current suite of studies we address this limitation by leveraging different classes of rewards outcomes, specifically emotionally pleasant pictures. Over a series of three experiments, participants were able to choose idiosyncratically preferred pictures as rewards. During the first two experiments, participants were rewarded with either high or low points or high or low preferred pictures. The reward positivity was modulated by points, but not by pictures (regardless of preference), which instead evoked enhanced N2 amplitudes. In a third study that paired high/low points and preferred/non-preferred pictures, the point-induced reward positivity was inflated by the presence of a preferred picture. In line with past research stating the reward positivity is primarily sensitive to positive reward prediction error, this report finds that it is also influenced by a liking dimension, which possibly acts as an affective state to frame the motivational aspect of extrinsic rewards.

Group-Level EEG-Processing Pipeline for Flexible Single Trial-Based Analyses Including Linear Mixed Models

Here we present an application of an EEG processing pipeline customizing EEGLAB and FieldTrip functions, specifically optimized to flexibly analyze EEG data based on single trial information. The key component of our approach is to create a comprehensive 3-D EEG data structure including all trials and all participants maintaining the original order of recording. This allows straightforward access to subsets of the data based on any information available in a behavioral data structure matched with the EEG data (experimental conditions, but also performance indicators, such accuracy or RTs of single trials). In the present study we exploit this structure to compute linear mixed models (LMMs, using lmer in R) including random intercepts and slopes for items. This information can easily be read out from the matched behavioral data, whereas it might not be accessible in traditional ERP approaches without substantial effort. We further provide easily adaptable scripts for performing cluster-based permutation tests (as implemented in FieldTrip), as a more robust alternative to traditional omnibus ANOVAs. Our approach is particularly advantageous for data with parametric within-subject covariates (e.g., performance) and/or multiple complex stimuli (such as words, faces or objects) that vary in features affecting cognitive processes and ERPs (such as word frequency, salience or familiarity), which are sometimes hard to control experimentally or might themselves constitute variables of interest. The present dataset was recorded from 40 participants who performed a visual search task on previously unfamiliar objects, presented either visually intact or blurred. MATLAB as well as R scripts are provided that can be adapted to different datasets.

The Feedback-related Negativity Reflects the Combination of Instantaneous and Long-term Values of Decision Outcomes

Hundreds of ERP studies have reported a midfrontal negative-going amplitude shift following negative compared with positive action outcomes. This feedback-related negativity (FRN) effect is typically thought to reflect an early and binary mechanism of action evaluation in the posterior midcingulate cortex. However, in prior research on the FRN effect, the instantaneous value and the long-term value of action outcomes have been perfectly confounded. That is, instantaneously positive outcomes were generally consistent with task goals, whereas instantaneously negative outcomes were inconsistent with task goals. In this study, we disentangled these two outcome aspects in two experiments. Our results reveal an interaction of instantaneous and long-term outcome values. More precisely, our findings strongly suggest that the FRN effect is mainly driven by a reward positivity, which is evoked only by outcomes that possess an instantaneously positive value and also help the organism to reach its long-term goals. These findings add to a recent literature according to which the posterior midcingulate cortex acts as a hierarchical reinforcement learning system and suggest that this system integrates instant and long-term action-outcome values. This, in turn, might be crucial for learning optimal behavioral strategies in a given setting.

Motivational Hierarchy in the Chinese Brain: Primacy of the Individual Self, Relational Self, or Collective Self?

According to the three-tier hierarchy of motivational potency in the self system, the self can be divided into individual self, relational self, and collective self, and individual self is at the top of the motivational hierarchy in Western culture. However, the motivational primacy of the individual self is challenged in Chinese culture, which raises the question about whether the three-tier hierarchy of motivational potency in the self system can be differentiated in the collectivist brain. The present study recorded the event-related potentials (ERPs) to evaluate brain responses when participants gambled for individual self, for a close friend (relational self), or for the class (collective self). The ERP results showed that when outcome feedback was positive, gambling for individual self evoked a larger reward positivity compared with gambling for a friend or for the class, while there is no difference between the latter two conditions. In contrast, when outcome feedback was negative, no significant effect was found between conditions. The present findings provide direct electrophysiological evidence that individual self is at the top of the three-tier hierarchy of the motivational system in the collectivist brain, which supports the classical pancultural view that individual self has motivational primacy.