It's all about timing: An electrophysiological examination of feedback-based learning with immediate and delayed feedback

The effect of feedback timing on category learning and feedback processing in younger and older adults

Introduction

Corrective feedback can be received immediately after an action or with a temporal delay. Neuroimaging studies suggest that immediate and delayed feedback are processed by the striatum and medial temporal lobes (MTL), respectively. Age-related changes in the striatum and MTL may influence the efficiency of feedback-based learning in older adults. The current study leverages event-related potentials (ERPs) to evaluate age-related differences in immediate and delayed feedback processing and consequences for learning. The feedback-related negativity (FRN) captures activity in the frontostriatal circuit while the N170 is hypothesized to reflect MTL activation.

Methods

18 younger (Myears  = 24.4) and 20 older (Myears  = 65.5) adults completed learning tasks with immediate and delayed feedback. For each group, learning outcomes and ERP magnitudes were evaluated across timing conditions.

Results

Younger adults learned better than older adults in the immediate timing condition. This performance difference was associated with a typical FRN signature in younger but not older adults. For older adults, impaired processing of immediate feedback in the striatum may have negatively impacted learning. Conversely, learning was comparable across groups when feedback was delayed. For both groups, delayed feedback was associated with a larger magnitude N170 relative to immediate feedback, suggesting greater MTL activation.

Discussion and conclusion

Delaying feedback may increase MTL involvement and, for older adults, improve category learning. Age-related neural changes may differentially affect MTL- and striatal-dependent learning. Future research can evaluate the locus of age-related learning differences and how feedback can be manipulated to optimize learning across the lifespan.

Prediction-error-dependent processing of immediate and delayed positive feedback

Learning often involves trial-and-error, i.e. repeating behaviours that lead to desired outcomes, and adjusting behaviour when outcomes do not meet our expectations and thus lead to prediction errors (PEs). PEs have been shown to be reflected in the reward positivity (RewP), an event-related potential (ERP) component between 200 and 350 ms after performance feedback which is linked to striatal processing and assessed via electroencephalography (EEG). Here we show that this is also true for delayed feedback processing, for which a critical role of the hippocampus has been suggested. We found a general reduction of the RewP for delayed feedback, but the PE was similarly reflected in the RewP and the later P300 for immediate and delayed positive feedback, while no effect was found for negative feedback. Our results suggest that, despite processing differences between immediate and delayed feedback, positive PEs drive feedback processing and learning irrespective of delay.

Feedback processing in cognitive and motor tasks: A meta-analysis on the feedback-related negativity

For motor learning, the processing of behavioral outcomes is of high significance. The feedback-related negativity (FRN) is an event-related potential, which is often described as a correlate of the reward prediction error in reinforcement learning. The number of studies examining the FRN in motor tasks is increasing. This meta-analysis summarizes the component in the motor domain and compares it to the cognitive domain. Therefore, a data set of a previous meta-analysis in the cognitive domain that comprised 47 studies  was reanalyzed and compared to additional 25 studies of the motor domain. Further, a moderator analysis for the studies in the motor domain was conducted. The FRN amplitude was higher in the motor domain than in the cognitive domain. This might be related to a higher task complexity and a higher feedback ambiguity of motor tasks. The FRN latency was shorter in the motor domain than in the cognitive domain. Given that sensory information can be used as an external feedback predictor prior to the presentation of the final feedback, reward processing in the motor domain may have been faster and reduced the FRN latency. The moderator variable analysis revealed that the feedback modality influenced the FRN latency, with shorter FRN latencies after bimodal than after visual feedback. Processing of outcome feedback seems to share basic principles in both domains; however, differences exist and should be considered in FRN studies. Future research is motivated to scrutinize the effects of bimodal feedback and other moderators within the motor domain.

Declarative Learning Mechanisms Support Declarative but Not Probabilistic Feedback-Based Learning in Children with Developmental Language Disorder (DLD)

Declarative and probabilistic feedback-based learning was evaluated in 8-12-year-old school-age children with developmental language disorder (DLD; n = 14) and age-matched children with typical development (TD; n = 15). Children performed a visual two-choice word-learning task and a visual probabilistic classification task while their electroencephalogram (EEG) was recorded non-invasively from the scalp. Behavioral measures of accuracy and response to feedback, and electrophysiological responses to feedback were collected and compared between the two groups. While behavioral data indicated poorer performance by children with DLD in both learning paradigms, and similar response patterns to positive and negative feedback, electrophysiological data highlighted processing patterns in the DLD group that differed by task. More specifically, in this group, feedback processing in the context of declarative learning, which is known to be dominated by the medial temporal lobe (MTL), was associated with enhanced N170, an event-related brain potential (ERP) associated with MTL activation. The N170 amplitude was found to be correlated with declarative task performance in the DLD group. During probabilistic learning, known to be governed by the striatal-based learning system, the feedback-related negativity (FRN) ERP, which is the product of the cortico-striatal circuit dominated feedback processing. Within the context of probabilistic learning, enhanced N170 was associated with poor learning in the TD group, suggesting that MTL activation during probabilistic learning disrupts learning. These results are interpreted within the context of a proposed feedback parity hypothesis suggesting that in children with DLD, the system that dominates learning (i.e., MTL during declarative learning and the striatum during probabilistic learning) dominates and supports feedback processing.

The detection of self-group conflicts in exercise behaviors differs with social network centrality: ERP evidence

BACKGROUND

The influence of social norms on exercise behaviors has been explored in studies over the years. However, little is known about whether an individual's role (central or peripheral) in his or her social network, which is associated with social skills, could shift his or her susceptibility to normative effects on exercise behaviors. To that end, event-related potentials (ERPs) were recorded to examine the underlying cognitive mechanism of the effects of network centrality on normative social influence.

METHODS

We manipulated network centrality by assigning participants to exercise support groups, with group members who were their nominated friends (high centrality) or nonnominated classmates (low centrality). Participants were asked to evaluate their willingness to engage in various exercises, after viewing discrepant group ratings (peer influence) or not viewing (no-influence).

RESULTS

Peer influence evoked a larger negative-going feedback-related negativity (FRN) wave, which was linked to automatic social conflict detection, and a larger positive-going P3 wave, which was linked to subsequent conformity behavioral changes. However, effects on the FRN, not the P3, were observed only in the high-centrality group.

CONCLUSION

Our results highlight the important roles of network centrality in encoding self-group exercise attitude discrepancy rather than in decision-making regarding exercise attitude adjustments. Interventions aimed at promoting exercise behaviors should be considered in a broader social environmental framework.

Learning new words via feedback-Association between feedback-locked ERPs and recall performance-An exploratory study

Feedback learning is thought to involve the dopamine system and its projection sites in the basal ganglia and anterior cingulate cortex (ACC), regions associated with procedural learning. Under certain conditions, such as when feedback is delayed, feedback-locked activation is pronounced in the medial temporal lobe (MTL), which is associated with declarative learning. In event-related potential research, the feedback-related negativity (FRN) has been linked to immediate feedback processing, while the N170, possibly reflecting MTL activity, has been related to delayed feedback processing. In the current study, we performed an exploratory investigation on the relation between N170 and FRN amplitude and memory performance in a test for declarative memory (free recall), also exploring the role of feedback delay. To this end, we adapted a paradigm in which participants learned associations between non-objects and non-words with either immediate or delayed feedback, and added a subsequent free recall test. We indeed found that N170, but not FRN amplitudes, depended on later free recall performance, with smaller amplitudes for later remembered non-words. In an additional analysis with memory performance as dependent variable, the N170, but not the FRN amplitude predicted free recall, modulated by feedback timing and valence. This finding shows that the N170 reflects an important process during feedback processing, possibly related to expectations and their violation, but is distinct from the process reflected by the FRN.

With or without Feedback?-How the Presence of Feedback Affects Processing in Children with Developmental Language Disorder

Language acquisition depends on the ability to process and learn probabilistic information, often through the integration of performance feedback. Children with developmental language disorder (DLD) have demonstrated weaknesses in both probabilistic learning and feedback processing, but the individual effects of each skill are poorly understood in this population. This study examined school-aged children with DLD (n = 29) and age- and gender-matched children with typical development (TD; n = 44) on a visual probabilistic classification learning task presented with and without feedback. In the feedback-based version of the task, children received performance feedback on a trial-by-trial basis during the training phase of the task. In the feedback-free version, children responded after seeing the correct choice marked with a green border and were not presented with feedback. Children with TD achieved higher accuracy than children with DLD following feedback-based training, while the two groups achieved similar levels of accuracy following feedback-free training. Analyses of event-related potentials (ERPs) provided insight into stimulus encoding processes. The feedback-free task was dominated by a frontal slow wave (FSW) and a late parietal component (LPC) which were not different between the two groups. The feedback-based task was dominated by a parietal slow wave (PSW) and an LPC, both of which were found to be larger in the TD than in the DLD group. In combination, results suggest that engagement with feedback boosts learning in children with TD, but not in children with DLD. When the need to process feedback is eliminated, children with DLD demonstrate behavioral and neurophysiological responses similar to their peers with TD.

Distinct influence of inter- versus intra-trial feedback on the brain response to subsequent feedback: Evidence from event-related potentials

Substantial evidence indicates that feedback processing not only varies with the valence of feedback, but is also highly dependent on contextual factors. Even so, the influence of prior outcome history on current outcome evaluation is far from clear. To investigate this issue, we conducted two event-related potential (ERP) experiments using a modified gambling task whereby each trial was associated with two consequences. In experiment 1, two instances of feedback indicated participant performance on two dimensions of a single decision, within a trial. In experiment 2, participants made two decisions in each trial, and then received two instances of feedback. We examined the feedback-related negativity (FRN) as an index of feedback processing. When both instances of feedback were relevant to the same trial (intra-trial), the FRN to the second was affected by the valence of the immediately previous feedback: The FRN was amplified to losses following wins. This was observed in both experiment 1 and experiment 2. When two instances of feedback were relevant to two different trials (inter-trial), the effect of immediately previous feedback on the FRN was inconsistent. In experiment 1 there was no effect of feedback from the previous trial on the FRN. However, in Experiment 2 there was an effect of inter-trial feedback on the FRN that was opposite to the effect of intra-trial feedback: The FRN was amplified when losses followed losses. Taken together, the findings suggest that the neural systems involved in reward processing dynamically and continuously integrate preceding feedback for the evaluation of present feedback.

The contribution of theta and delta to feedback processing in children with developmental language disorder

PURPOSE

The study aimed at evaluating feedback processing at the electrophysiological level and its relation to learning in children with developmental language disorder (DLD) to further advance our understanding of the underlying neural mechanisms of feedback-based learning in children with this disorder.

METHOD

A feedback-based probabilistic learning task required children to classify novel cartoon animals into two categories that differ on five binary features, the probabilistic combination of which determined classification. The learning outcomes' variance in relation to time- and time-frequency measures of feedback processing were examined and compared between 20 children with developmental language disorder and 25 age-matched children with typical language development.

RESULTS

Children with developmental language disorder (DLD) performed poorer on the task when compared with their age-matched peers with typical language development (TD). The electrophysiological data in the time domain indicated no differences in the processing of positive and negative feedback among children with DLD. However, the time-frequency analysis revealed a strong theta activity in response to negative feedback in this group, suggesting an initial distinction between positive and negative feedback that was not captured by the ERP data. In the TD group, delta activity played a major role in shaping the FRN and P3a and was found to predict test performance. Delta did not contribute to the FRN and P3a in the DLD group. Additionally, theta and delta activities were not associated with the learning outcomes of children with DLD.

CONCLUSION

Theta activity, which is associated with the initial processing of feedback at the level of the anterior cingulate cortex, was detected in children with developmental language disorder (DLD) but was not associated with their learning outcomes. Delta activity, which is assumed to be generated by the striatum and to be linked to elaborate processing of outcomes and adjustment of future actions, contributed to processing and learning outcomes of children with typical language development but not of children with DLD. The results provide evidence for atypical striatum-based feedback processing in children with DLD.

Task parameters influence operant response variability in mice

RATIONALE

During operant conditioning, animals associate actions with outcomes. However, patterns and rates of operant responding change over learning, which makes it difficult to distinguish changes in learning from general changes in performance or movement. Thus, understanding how task parameters influence movement execution is essential.

OBJECTIVES

To understand how specific operant task parameters influenced the repetition of future operant responses, we investigated the ability of operant conditioning schedules and contingencies to promote reproducible bouts of five lever presses in mice.

METHODS

Mice were trained on one of the four operant tasks to test three distinct hypotheses: (1) whether a cue presented concurrently with sucrose delivery influenced the pattern of lever pressing; (2) whether requiring animals to collect earned sucrose promoted the organization of responses into bouts; and (3) whether only reinforcing bouts where interresponse time (IRT) variances were below a target promoted reproducible patterns of operant behavior.

RESULTS

(1) Signaling reinforcer delivery with a cue increased learning rates but resulted in mice pressing the lever in fast succession until the cue turned on, rather than executing discrete bouts. (2) Requiring mice to collect the reinforcer between bouts had little effect on behavior. (3) A training strategy that directly reinforced bouts with low variance IRTs was not more effective than a traditional fixed ratio schedule at promoting reproducible action execution.

CONCLUSIONS

Together, our findings provide insights into the parameters of behavioral training that promote reproducible actions and that should be carefully selected when designing operant conditioning experiments.

Dissociable feedback valence effects on frontal midline theta during reward gain versus threat avoidance learning

While frontal midline theta (FMθ) has been associated with threat processing, with cognitive control in the context of anxiety, and with reinforcement learning, most reinforcement learning studies on FMθ have used reward rather than threat-related stimuli as reinforcer. Accordingly, the role of FMθ in threat-related reinforcement learning is largely unknown. Here, n = 23 human participants underwent one reward-, and one punishment-, based reversal learning task, which differed only with regard to the kind of reinforcers that feedback was tied to (i.e., monetary gain vs. loud noise burst, respectively). In addition to single-trial EEG, we assessed single-trial feedback expectations based on both a reinforcement learning computational model and trial-by-trial subjective feedback expectation ratings. While participants' performance and feedback expectations were comparable between the reward and punishment tasks, FMθ was more reliably amplified to negative vs. positive feedback in the reward vs. punishment task. Regressions with feedback valence, computationally derived, and self-reported expectations as predictors and FMθ as criterion further revealed that trial-by-trial variations in FMθ specifically relate to reward-related feedback-valence and not to threat-related feedback or to violated expectations/prediction errors. These findings suggest that FMθ as measured in reinforcement learning tasks may be less sensitive to the processing of events with direct relevance for fear and anxiety.

Feedback Processing During Probabilistic Learning in Children With Developmental Language Disorder: An Event-Related Potential Study

PURPOSE

The purpose of this study was to examine feedback processing within the context of probabilistic learning in children with and without developmental language disorder (DLD).

METHOD

The probabilistic category learning task required 28 children ages 8-13 years old to classify novel cartoon animals that differed in five binary features into one of two categories. Performance feedback guided incremental learning of the stimuli classifications. Feedback processing was compared between children with DLD and age-matched children with typical development (TD) by measuring the magnitude of feedback-related event-related potentials. Additionally, the likelihood of each group to repeat a classification of a stimulus following positive feedback ("stay" behavior) and change a classification following negative feedback ("switch" behavior) served as a measure of the consequence of feedback processing.

RESULTS

Children with DLD achieved lower classification accuracy on all learning outcomes compared to their peers with TD. Children with DLD were less likely than those with TD to demonstrate "stay" behavior or to repeat a correct response following positive feedback. "Switch" behavior or changing an incorrect response following negative feedback was found to be at chance level in both groups. Electrophysiological data indicated that children with DLD had a smaller feedback-related negativity effect (i.e., smaller differential processing of positive and negative feedback) when compared to children with TD. Although no differences were found between the two groups in the amplitude of the P3a, strong positive correlations were found between "stay/switch" behavior and the P3a for children in the TD group only.

CONCLUSIONS

Children with DLD do not appear to benefit from incremental corrective feedback to the same extent as their peers with TD. Processing differences are captured in the initial stages of feedback evaluation and in translating information carried by the feedback to inform future actions.

Shared Attention Amplifies the Neural Processing of Emotional Faces

Sharing an experience, without communicating, affects people's subjective perception of the experience, often by intensifying it. We investigated the neural mechanisms underlying shared attention by implementing an EEG study where participants attended to and rated the intensity of emotional faces, simultaneously or independently. Participants performed the task in three experimental conditions: (a) alone; (b) simultaneously next to each other in pairs, without receiving feedback of the other's responses (shared without feedback); and (c) simultaneously while receiving the feedback (shared with feedback). We focused on two face-sensitive ERP components: The amplitude of the N170 was greater in the "shared with feedback" condition compared to the alone condition, reflecting a top-down effect of shared attention on the structural encoding of faces, whereas the EPN was greater in both shared context conditions compared to the alone condition, reflecting an enhanced attention allocation in the processing of emotional content of faces, modulated by the social context. Taken together, these results suggest that shared attention amplifies the neural processing of faces, regardless of the valence of facial expressions.

Strategy Development and Feedback Processing During Complex Category Learning

In this study, 38 young adults participated in a probabilistic A/B prototype category learning task under observational and feedback-based conditions. The study compared learning success (testing accuracy) and strategy use (multi-cue vs. single feature vs. random pattern) between training conditions. The feedback-related negativity (FRN) and P3a event related potentials were measured to explore the relationships between feedback processing and strategy use under a probabilistic paradigm. A greater number of participants were found to utilize an optimal, multi-cue strategy following feedback-based training than observational training, adding to the body of research suggesting that feedback can influence learning approach. There was a significant interaction between training phase and strategy on FRN amplitude. Specifically, participants who used a strategy in which category membership was determined by a single feature (single feature strategy) exhibited a significant decrease in FRN amplitude from early training to late training, perhaps due to reduced utilization of feedback or reduced prediction error. There were no significant main or interaction effects between valence, training phase, or strategy on P3a amplitude. Findings are consistent with prior research suggesting that learners vary in their approach to learning and that training method influences learning. Findings also suggest that measures of feedback processing during probabilistic category learning may reflect changes in feedback utilization and may further illuminate differences among individual learners.

Delaying feedback compensates for impaired reinforcement learning in developmental dyslexia

A theoretical framework suggests that developmental dyslexia is characterized by abnormalities in brain structures underlying the procedural learning and memory systems while the declarative learning and memory systems are presumed to remain intact or even enhanced (Procedural Deficit Hypothesis). This notion has been supported by a substantial body of research, which focused on each system independently. However, less attention has been paid to interactions between these memory systems which may provide insights as to learning situations and conditions in which learning in dyslexia can be improved. The current study was undertaken to examine these important but unresolved issues. To this end, probabilistic reinforcement learning and episodic memory tasks were examined in participants with dyslexia and neurotypicals simultaneously within a single task. Feedback timing presentation was manipulated, building on prior research indicating that delaying feedback timing shifts striatal-based probabilistic learning, to become more hippocampal-dependent. It was hypothesized that if the procedural learning and memory systems are impaired in dyslexia, performance will be impaired under conditions that encourage procedural memory engagement (immediate feedback trials) but not under conditions that promote declarative memory processing (long delayed feedback trials). It was also predicted that the ability to incidentally acquire episodic information would be preserved in dyslexia. The results supported these predictions. Participants with dyslexia were impaired in probabilistic learning of cue-outcome associations compared to neurotypicals in an immediate feedback condition, but not when feedback on choices was presented after a long delay. Furthermore, participants with dyslexia demonstrated similar performance to neurotypicals in a task requiring incidental episodic memory formation. These findings attest to a dissociation between procedural-based and declarative-based learning in developmental dyslexia within a single task, a finding that adds discriminative validity to the Procedural Deficit Hypothesis. Just as important, the present findings suggest that training conditions designed to shift the load from midbrain/striatal systems to declarative memory mechanisms have the potential to compensate for impaired learning in developmental dyslexia.

Acting in Temporal Contexts: On the Behavioral and Neurophysiological Consequences of Feedback Delays

Feedback on success or failure is critical to increase rewards through behavioral adaptation or learning of dependencies from trial and error. Learning from reward feedback is thereby treated as embedded in a reinforcement learning framework. Due to temporal discounting of reward, learning in this framework is suspected to be vulnerable to feedback delay. Together, investigations of reinforcement learning in learned decision making tasks show that performance and learning impairments due to feedback delay vary as a function of task type. Performance in tasks that require implicit processing is affected by the delayed availability of feedback compared to tasks that can be accomplished with explicit processing. At the same time, the feedback related negativity, an event related potential component in the electroencephalogram that is associated with feedback processing, is affected by feedback delay similarly independent of task type. With the idea of fully implicit or explicit processing as opposite endpoints of a continuum of reciprocal shares of the implicit and explicit processing systems with feedback delay as the determinant of where on this continuum processing can be located, a common explanatory approach of both, behavioral and electrophysiological findings, is suggested.

Learning to deal with delayed outcomes: EEG oscillatory and slow potentials during the prefeedback interval

It is well established that the stimulus-preceding negativity (SPN) decreases in amplitude as a task is mastered, a phenomenon generally attributed to the reduction in anticipatory attention as feedback becomes less needed. Typically, the experiments supporting this assumption have used relatively short delays (<3 s). However, we found in a previous study that this decline in amplitude, although present during the 2.5-s prefeedback delay of a patterned key-pressing task, was absent with an 8-s delay. We reexamined this finding using a 6-s delay and found that the SPN diminished at frontal sites as participants learned a sequence of four keypress durations, but that this modulation was limited to the early half of the delay (maximum at 2 s). Decline of lateralized sensorimotor theta activity across trials was also limited to early portions of the delay. These findings suggest that processes other than anticipatory attention to feedback may be more relevant for explaining SPN diminution. Such processes could include adjustment and maintenance of action-outcome expectancies (e.g., forward models) during the prefeedback interval.

Dissociating the effect of reward uncertainty and timing uncertainty on neural indices of reward prediction errors: A reward positivity (RewP) event-related potential (ERP) study

Accurate reward predictions include forecasting both what a reward will be and when a reward will occur. We tested how variations in the certainty of reward outcome and certainty in timing of feedback presentation modulate neural indices of reward prediction errors using the reward positivity (RewP) component of the scalp-recorded brain event-related potential (ERP). In a within-subjects design, seventy-three healthy individuals completed two versions of a cued doors task; one cued the probability of a reward outcome while the other cued the probability of a delay before feedback. Replicating previous results, RewP amplitude was larger for uncertain feedback compared to certain feedback. Additionally, RewP amplitude was differentially associated with uncertainty of presence/absence of reward, but not uncertainty of feedback timing. Findings suggest a dissociation in that RewP amplitude is modulated by reward prediction certainty but is less affected by certainty surrounding timing of feedback.

Learning With and Without Feedback in Children With Developmental Language Disorder

Purpose Intervention provided to school-age children with developmental language disorder often relies on the provision of performance feedback, yet it is unclear whether children with this disorder benefit from feedback-based learning. The study evaluates the effect of performance feedback on learning in children with developmental language disorder. Method Thirteen 8- to 12-year-old children with developmental language disorder and 14 age- and gender-matched children with typical language development completed two learning tasks whose objective was to pair nonword novel names with novel objects. The two tasks differed in the presence of performance feedback to guide learning. Learning outcomes on immediate and follow-up tests were compared between the feedback-based and feedback-free tasks. Additionally, an electrophysiological marker of feedback processing was compared between children with and without developmental language disorder. Results Children with developmental language disorder demonstrated poorer learning outcomes on both tasks when compared with their peers, but both groups achieved better accuracy on the feedback-free task when compared with the feedback-based task. Within the feedback-based task, children were more likely to repeat a correct response than to change it after positive feedback but were as likely to repeat an error as they were to correct it after receiving negative feedback. While children with typical language elicited a feedback-related negativity with greater amplitude to negative feedback, this event-related potential had no amplitude differences between positive and negative feedback in children with developmental language disorder. Conclusions Findings indicate that 8- to 12-year-old children benefit more from a feedback-free learning environment and that negative feedback is not as effective as positive feedback in facilitating learning in children. The behavioral and electrophysiological data provide evidence that feedback processing is impaired in children with developmental language disorders. Future research should evaluate feedback-based learning in children with this disorder using other learning paradigms.

Valence-dependent Neural Correlates of Augmented Feedback Processing in Extensive Motor Sequence Learning - Part I: Practice-related Changes of Feedback Processing

Several event-related potentials (ERPs) are associated with the processing of valence-dependent augmented feedback during the practice of motor tasks. In this study, 38 students learned a sequential arm-movement-task with 192 trials in each of five practice sessions (960 practice trials in total), to examine practice-related changes in neural feedback processing. Electroencephalogram (EEG) was recorded in the first and last practice session. An adaptive bandwidth for movement accuracy led to equal amounts of positive and negative feedback. A frontal located negative deflection in the time window of the feedback-related negativity (FRN) was more negative for negative feedback and might reflect reward prediction errors in reinforcement learning. This negativity increased after extensive practice, which might indicate that smaller errors are harder to identify in the later phase. The late fronto-central positivity (LFCP) was more positive for negative feedback and is assumed to be associated with supervised learning and behavioral adaptations based on feedback with higher complexity. No practice-related changes of the LFCP were observed, which suggests that complex feedback is processed independent from the practice phase. The P300 displayed a more positive activation for positive feedback, which might be interpreted as the higher significance of positive feedback for the updating of internal models in this setting. A valence-independent increase of the P300 amplitude after practice might reflect an improved ability to update the internal representation based on feedback information. These results demonstrate that valence-dependent neural feedback processing changes with extensive practice of a novel motor task. Dissociating changes in latencies of different components support the assumption that they are related to distinct mechanisms of feedback-dependent learning.

Electrophysiological Examination of Feedback-Based Learning in 8-11-Year-Old Children

The study aimed at evaluating the extent to which the feedback related negativity (FRN), an ERP component associated with feedback processing, is related to learning in school-age children. Eighty typically developing children between the ages of 8 and 11 years completed a declarative learning task while their EEG was recorded. The study evaluated the predictive value of the FRN on learning retention as measured by accuracy on a follow-up test a day after the session. The FRN elicited by positive feedback was found to be predictive of learning retention in children. The relationship between the FRN and learning was moderated by age. The P3a was also found to be associated with learning, such that larger P3a to negative feedback was associated with better learning retention in children.

Does Acute Stress Impact Declarative and Procedural Learning?

It is well established that acute stress can influence memory function, yet its influence may differ across memory systems. Whereas stress sometimes exerts a negative influence on declarative learning, it does not necessarily harm learning in general, as demonstrated in the case of procedural learning. Probabilistic category learning is mediated by the striatum, but delaying feedback by a few seconds shifts learning to become more hippocampal-dependent. Here, we examined the influence of acute stress on this type of learning, under different conditions that favor either procedural-based (immediate feedback) vs. declarative-based (delayed feedback) learning. Sixty-two participants randomly assigned to either stress or non-stress groups, performed a probabilistic category learning task, in which they were instructed to learn associations between cues and outcomes under different feedback conditions (immediate feedback, short-delayed feedback, and long-delayed feedback). Acute stress was induced by the Maastricht Acute Stress Test (MAST), and stress levels were gauged by Galvanic Skin Response (GSR) measures and a self-reported questionnaire. Results showed that although the MAST was effective in inducing stress, this did not harm learning in either of the feedback conditions. These findings suggest that not all hippocampal-based learning types are negatively influenced by stress.

The Influence of Pitch-by-Pitch Feedback on Neural Activity and Pitch Perception in Baseball

This study was designed to examine the influence of performance feedback on task performance and neural activity in expert and novice baseball players. Participants completed a video task to determine whether thrown pitches were balls or strikes while their neural activity was recorded. After each pitch, participants were given feedback on the accuracy of their choice. Results indicated that college players exhibited larger frontocentral positivity amplitudes compared with novices, regardless of feedback type. Furthermore, results showed that the feedback-related negativity was related to response accuracy following incorrect feedback for college players, with larger feedback-related negativity amplitude associated with greater response accuracy. This relationship is independent of any relations between overall task accuracy and either feedback-related negativity amplitude or response accuracy following incorrect feedback. These results indicate that the nature of neural activity during pitch feedback for college baseball players can inform and influence participants' subsequent pitch-location performance.

Effects of feedback delay on learning from positive and negative feedback in patients with Parkinson's disease off medication

Phasic dopamine (DA) signals conveyed from the substantia nigra to the striatum and the prefrontal cortex crucially affect learning from feedback, with DA bursts facilitating learning from positive feedback and DA dips facilitating learning from negative feedback. Consequently, diminished nigro-striatal dopamine levels as in unmedicated patients suffering from Parkinson's Disease (PD) have been shown to lead to a negative learning bias. Recent studies suggested a diminished striatal contribution to feedback processing when the outcome of an action is temporally delayed. This study investigated whether the bias towards negative feedback learning induced by a lack of DA in PD patients OFF medication is modulated by feedback delay. To this end, PD patients OFF medication and healthy controls completed a probabilistic selection task, in which feedback was given immediately (after 800 ms) or delayed (after 6800 ms). PD patients were impaired in immediate but not delayed feedback learning. However, differences in the preference for positive/negative learning between patients and controls were seen for both learning from immediate and delayed feedback, with evidence of stronger negative learning in patients than controls. A Bayesian analysis of the data supports the conclusion that feedback timing did not affect the learning bias in the patients. These results hint at reduced, but still relevant nigro-striatal contribution to feedback learning, when feedback is delayed.

Slow Is Also Fast: Feedback Delay Affects Anxiety and Outcome Evaluation

Performance-related feedback plays an important role in improving human being’s adaptive behavior. Using event-related potentials (ERPs), previous studies have associated a particular component, i.e., reward positivity (RewP), with outcome evaluation processing and found that this component was affected by waiting time before outcome evaluation. Prior research has also suggested that anxious individuals are more prone to detecting threats and susceptible to negative emotions, and show different patterns of brain activity in outcome evaluation. It is quite common that a decision-maker cannot receive feedback immediately; however, few studies have focused on the processing of delayed feedback, especially in subjects who exhibit trait anxiety. In this study, we recruited two groups of subjects with different trait anxiety levels and recorded ERPs when they conducted a time-estimation task with short (0.6–1 s) or long delayed (4–5 s) feedback. The ERP results during the cue phase showed that long waiting cues elicited more negative-going feedback-related negativity (FRN)-like component than short waiting cues in the high trait anxiety (HTA) group. More importantly, the two groups showed different patterns of ERP in the feedback condition. In the low trait anxiety (LTA) group, more positive-going RewP was found in the short-delayed than in the long-delayed condition. In contrast, no difference was found in the HTA group. This pattern may reflect the hyperactivity of the reward systems of HTA individuals in uncertain environments (e.g., the long-delay condition) compared with LTA individuals. Our results provide a direction for future research on the neural mechanisms of reinforcement learning and anxiety.