Differential modulations of reward expectation on implicit facial emotion processing: ERP evidence

The effect of reward expectation on working memory of emotional faces under different levels of cognitive load: an ERP study

Using event-related potentials (ERPs), this study examined the impact of reward expectations on working memory of emotional faces under different levels of cognitive load in a task combining the N-back paradigm and the reward expectation paradigm. The experiment involved presenting high- or low-reward cues followed by an N-back task for emotional faces with different loads. The accuracy results showed that under a high task load, both reward and emotion effects were significantly observed. However, these effects disappeared under a low task load. Analysis of the ERP data revealed that the early P2 and VPP components exhibited greater responses to fearful faces than to neutral faces. In the later stages, the P3 and LPP components showed greater reactions to high rewards than to low rewards. Additionally, the P2 component was found to be modulated by task load in relation to rewards, the EPN component demonstrated task load modulation with respect to emotions, and the N170 component showed an interaction effect between rewards and emotions. These findings imply that load regulates the reward effect and the emotional superiority effect in the process of working memory for emotional faces. In the cognitive processing of working memory, motivation and emotion jointly influence processing. Emotional factors have a greater impact in the early stage of processing, while motivation factors have a greater impact in the late stage of processing.

Comparing monetary gain and loss in the monetary incentive delay task: EEG evidence

What is more effective to guide behavior: The desire to gain or the fear to lose? Electroencephalography (EEG) studies have yielded inconsistent answers. In a systematic exploration of the valence and magnitude parameters in monetary gain and loss processing, we used time-domain and time-frequency-domain analyses to uncover the underlying neural processes. A group of 24 participants performed a monetary incentive delay (MID) task in which cue-induced anticipation of a high or low magnitude of gain or loss was manipulated trial-wise. Behaviorally, the anticipation of both gain and loss expedited responses, with gain anticipation producing greater facilitation than loss anticipation. Analyses of cue-locked P2 and P3 components revealed the significant valence main effect and valence × magnitude interaction: amplitude differences between high and low incentive magnitudes were larger with gain vs. loss cues. However, the contingent negative variation component was sensitive to incentive magnitude but did not vary with incentive valence. In the feedback phase, the RewP component exhibited reversed patterns for gain and loss trials. Time-frequency analyses revealed a large increase in delta/theta-ERS oscillatory activity in high- vs. low-magnitude conditions and a large decrease of alpha-ERD oscillatory activity in gain vs. loss conditions in the anticipation stage. In the consumption stage, delta/theta-ERS turned out stronger for negative than positive feedback, especially in the gain condition. Overall, our study provides new evidence for the neural oscillatory features of monetary gain and loss processing in the MID task, suggesting that participants invested more attention under gain and high-magnitude conditions vs. loss and low-magnitude conditions.

Reward advantage over punishment for incentivizing visual working memory

The prospects of gaining reward and avoiding punishment widely influence human behavior. Despite of numerous attempts to investigate the influence of motivational signals on working memory (WM), whether the valence and the magnitude of motivational signals interactively influence WM performance remains unclear. To investigate this, the present study used a free-recall working memory task with EEG recording to compare the effect of incentive valence (reward or punishment), as well as the magnitude of incentives on visual WM. Behavioral results revealed that the presence of incentive signals improved WM precision when compared with no-incentive condition, and compared with punishing cues, rewarding cues led to greater facilitation in WM precision, as well as confidence ratings afterward. Moreover, event related potential (ERP) results suggested that compared with punishment, reward led to an earlier latency of late positive component (LPC), a larger amplitude of contingent negative variation (CNV) during the expectation period, and a larger P300 amplitude during the sample and delay periods. Furthermore, reward advantage over punishment in behavioral and neural results were correlated, such that individuals with larger CNV difference between reward and punishment conditions also report greater distinction in confidence ratings between the two conditions. In sum, our results demonstrate what and how rewarding cues cause more beneficial effects than punishing cues when incentivizing visual WM.

Reward History Modulates the Processing of Task-Irrelevant Emotional Faces in a Demanding Task

The aim of the current study was to examine how reward-associated emotional facial distractors could capture attentional resources in a demanding visual task using event-related potentials (ERPs). In the learning phase, a high- or low-reward probability was paired with angry, happy, or neutral faces. Then, in the test phase, participants performed a face-irrelevant task with no reward at stake, in which they needed to discriminate the length of two lines presented in the center of the screen while faces that were taken from the learning phase were used as distractors presented in the periphery. The behavioral results revealed no effect of distractor emotional valence since the emotional information was task-irrelevant. The ERP results in the test phase revealed a significant main effect of distractor emotional valence for the parieto-occipital P200 (170-230 ms); the mean amplitudes in both the angry- and happy-face conditions were more positive than the neutral-face condition. Moreover, we found that the high-reward association enhanced both the N170 (140-180 ms) and EPN (260-330 ms) relative to the low-reward association condition. Finally, the N2pc (270-320 ms) also exhibited enhanced neural activity in the high-reward condition compared to the low-reward condition. The absence of emotional effects indicated that task-irrelevant emotional facial stimuli did not impact behavioral or neural responses in this highly demanding task. However, reward-associated information was processed when attention was directed elsewhere, suggesting that the processing of reward-associated information worked more in an automatic way, irrespective of the top-down task demand.

Testing stimulus exposure time as the critical factor of increased EPN and LPP amplitudes for fearful faces during perceptual distraction tasks

Fearful facial expressions are prioritized across different information processing stages, as evident in early, intermediate, and late components of event-related brain potentials (ERPs). Recent studies showed that, in contrast to early N170 modulations, mid-latency (Early Posterior Negativity, EPN) and late (Late Positive Potential, LPP) emotional modulations depend on the attended perceptual feature. Nevertheless, several studies reported significant differences between emotional and neutral faces for the EPN or LPP components during distraction tasks. One cause for these conflicting findings might be that when faces are presented sufficiently long, participants attend to task-irrelevant features of the faces. In this registered report, we tested whether the presentation duration of faces is the critical factor for differences between reported emotional modulations during perceptual distraction tasks. To this end, 48 participants were required to discriminate the orientation of lines overlaid onto fearful or neutral faces, while face presentation varied (100 msec, 300 msec, 1,000 msec, 2,000 msec). While participants did not need to pay attention to the faces, we observed main effects of emotion for the EPN and LPP, but no interaction between emotion and presentation duration. Of note, unregistered exploratory tests per presentation duration showed no significant EPN and LPP emotion differences during short durations (100 and 300 msec) but significant differences with longer durations. While the presentation duration seems not to be a critical factor for EPN and LPP emotion effects, future studies are needed to investigate the role of threshold effects and the applied analytic designs to explain conflicting findings in the literature.

Expectations of immediate and delayed reward differentially affect cognitive task performance

The current study used a modified Monetary Incentive Delay task to examine the neural mechanisms underlying anticipating and receiving an immediate or delayed reward and examined the influence of pursuing these rewards on cognitive task performance. A pre-cue indicating the potential of gaining a monetary reward (immediate-, delayed-, vs. no-reward) was followed by a target stimulus requiring a fast and accurate response. Then, response-contingent feedback was presented indicating whether or not the participant would receive the corresponding reward. Linear mixed-effect models revealed the fastest behavioural responses and the strongest neural activity, as reflected in event-related-potentials and event-related-spectral-perturbation responses, for immediate reward, followed by delayed reward, with the slowest behavioural responses and the weakest neural activities observed in the no-reward condition. Expectations related to the cue-P3 component and the cue-delta activities predicted behavioural performance, especially in the immediate reward condition. Moreover, exploratory analyses revealed that depression moderated the relationship between target-locked neural activity and behavioural performance in the delayed reward condition, with lower neural activity being related to worse behavioural performance amongst participants scoring high on depression. These results indicate that differential value representations formed through delay discounting directly affect neural responses in reward processing and directly influence the effort invested in the current task, which is reflected by behavioural responses and is in agreement with the expected value of control theory.

Spatiotemporal Dynamics of Covert Versus Overt Processing of Happy, Fearful and Sad Facial Expressions

Behavioral and electrophysiological correlates of the influence of task demands on the processing of happy, sad, and fearful expressions were investigated in a within-subjects study that compared a perceptual distraction condition with task-irrelevant faces (e.g., covert emotion task) to an emotion task-relevant categorization condition (e.g., overt emotion task). A state-of-the-art non-parametric mass univariate analysis method was used to address the limitations of previous studies. Behaviorally, participants responded faster to overtly categorized happy faces and were slower and less accurate to categorize sad and fearful faces; there were no behavioral differences in the covert task. Event-related potential (ERP) responses to the emotional expressions included the N170 (140-180 ms), which was enhanced by emotion irrespective of task, with happy and sad expressions eliciting greater amplitudes than neutral expressions. EPN (200-400 ms) amplitude was modulated by task, with greater voltages in the overt condition, and by emotion, however, there was no interaction of emotion and task. ERP activity was modulated by emotion as a function of task only at a late processing stage, which included the LPP (500-800 ms), with fearful and sad faces showing greater amplitude enhancements than happy faces. This study reveals that affective content does not necessarily require attention in the early stages of face processing, supporting recent evidence that the core and extended parts of the face processing system act in parallel, rather than serially. The role of voluntary attention starts at an intermediate stage, and fully modulates the response to emotional content in the final stage of processing.

Reward expectation modulates N2pc for target selection: Electrophysiological evidence

In an electrophysiological experiment, we investigated the effect of reward expectation on the localized attentional interference effect using a cue-target paradigm, while event-related potentials (ERPs) were recorded. A cue indicating the reward condition of each trial (incentive vs. non-incentive) was followed by the presentation of a search array containing two target items. Participants were asked to decide whether the two shape singletons (two triangles, two rectangles, or one triangle and one rectangle) among a set of circles were the same shape. Moreover, we manipulated the distance between the two targets to be adjacent to each other (Separation 1) or further apart (Separation 3 and Separation 5). Behavioral results revealed a larger reward facilitation effect for the larger target separation conditions. The N2pc component locked to the target display exhibited an interaction between reward expectation and the distance between the two targets. For non-incentive trials, the N2pc amplitude increased as the separation between the two targets increased; however, for incentive trials, the N2pc showed comparable amplitudes in the different target separation conditions. These results indicate that reward expectation regulated attentional focus to better resolve the competition between representation and selection of the two targets for acquiring possible reward outcomes.

The interactive effects of reward expectation and emotional interference on cognitive conflict control: An ERP study

The effects of reward expectation and task-irrelevant emotional content on performance and event-related potential (ERP) recordings in a cognitive conflict control task were investigated using the face-word Stroop paradigm. A precue indicating additional monetary rewards for fast and accurate responses during the upcoming trial (incentive condition; relative to a cue indicating no additional reward, i.e., nonincentive condition) was followed by the presentation of target Chinese words (male vs. female) superimposed on background emotional faces (happy vs. fearful). The face's gender was congruent or incongruent with the target Chinese words. ERP results revealed that incentive cues elicited larger P1, P3, and CNV responses compared to nonincentive cues. There was a significant three-way interaction of reward expectation, emotional content, and congruency during the target processing stage such that emotionality and congruency interacted to affect the N170 and N2 component responses during the nonincentive condition but not during the incentive condition. These results indicate that reward-induced motivation reduces the interference effect of task-irrelevant emotional information, leading to better conflict resolution.

Attentional conditions differentially affect early, intermediate and late neural responses to fearful and neutral faces

The processing of fearful facial expressions is prioritized by the human brain. This priority is maintained across various information processing stages as evident in early, intermediate and late components of event-related potentials (ERPs). However, emotional modulations are inconsistently reported for these different processing stages. In this pre-registered study, we investigated how feature-based attention differentially affects ERPs to fearful and neutral faces in 40 participants. The tasks required the participants to discriminate either the orientation of lines overlaid onto the face, the sex of the face or the face's emotional expression, increasing attention to emotion-related features. We found main effects of emotion for the N170, early posterior negativity (EPN) and late positive potential (LPP). While N170 emotional modulations were task-independent, interactions of emotion and task were observed for the EPN and LPP. While EPN emotion effects were found in the sex and emotion tasks, the LPP emotion effect was mainly driven by the emotion task. This study shows that early responses to fearful faces are task-independent (N170) and likely based on low-level and configural information while during later processing stages, attention to the face (EPN) or-more specifically-to the face's emotional expression (LPP) is crucial for reliable amplified processing of emotional faces.