Differential effects of sustained and transient effort triggered by reward - A combined EEG and pupillometry study

Compensating for the Mobile Menace With Extra Effort: a Pupillometry Investigation of the Mere Presence Effect of Smartphones

Previous research suggests that the mere presence of a smartphone can detrimentally affect performance. However, other studies failed to observe such detrimental effects. A limitation of existing studies is that no indexes of (potentially compensating) effort were included. Further, time-on-task effects have been unexplored. Here, we address these limitations by investigating the mere-presence effect of a smartphone on performance in two continuous-performance experiments (Experiment 1 using an n-back and a number judgement task at two difficulty levels, and Experiment 2 using a pure, challenging n-back task), measuring pupil size to assess invested effort, and taking into account time-on-task effects. Finally, contrary to previous studies that predominantly used between-subject designs, we utilized within-subject designs in both experiments. Contrary to expectations, Experiment 1 largely yielded no significant effects of smartphone presence on performance. Nonetheless, the presence of a smartphone triggered larger tonic pupil size in the more difficult task, and a more rapid decrease over time. Experiment 2 similarly failed to demonstrate smartphone effects on performance, but replicated the finding of larger tonic pupil size in the presence of a smartphone. In addition, tonic pupil size showed a slower decrease over time when a smartphone was present. In Experiment 2, we could furthermore look at phasic pupil size, which decreased over time in the absence of a phone but not in its presence. These findings suggest a complex relationship between smartphone presence, effort, and time-on-task, which does not necessarily express itself behaviorally, highlighting in particular the need to also explore potential contributions of (compensatory) effort.

Linking tonic and phasic pupil responses to P300 amplitude in an emotional face-word Stroop task

The locus coeruleus-norepinephrine (LC-NE) system, which regulates arousal levels, is important for cognitive control, including emotional conflict resolution. Additionally, the LC-NE system is implicated in P300 generation. If the P300 is mediated by the LC-NE system, and considering the established correlations between LC activity and pupil dilation, P300 amplitude should correlate with task-evoked (phasic) pupil dilation on a trial-by-trial basis. However, prior studies, predominantly utilizing oddball-type paradigms, have not demonstrated correlations between concurrently recorded task-evoked pupil dilation and P300 responses. Using a recently developed emotional face-word Stroop task that links pupil dilation to the LC-NE system, here, we examined both intra- and inter-individual correlations between task-evoked pupil dilation and P300 amplitude. We found that lower accuracy, slower reaction times, and larger task-evoked pupil dilation were obtained in the incongruent compared to the congruent condition. Furthermore, we observed intra-individual correlations between task-evoked pupil dilation and P300 amplitude, with larger pupil dilation correlating with a greater P300 amplitude. In contrast, pupil dilation did not exhibit consistent correlations with N450 and N170 amplitudes. Baseline (tonic) pupil size also showed correlations with P300 and N170 amplitudes, with smaller pupil size corresponding to larger amplitude. Moreover, inter-individual differences in task-evoked pupil dilation between the congruent and incongruent conditions correlated with differences in reaction time and P300 amplitude, though these effects only approached significance. To summarize, our study provides evidence for a connection between task-evoked pupil dilation and P300 amplitude at the single-trial level, suggesting the involvement of the LC-NE system in P300 generation.

Preexposure to one social threat alters responses to another social threat: Behavioral and electrophysiological evidence

A recent Cyberball study has indicated that the experience of loss of control can affect how people process subsequent social exclusion. This "preexposure effect" supports the idea of a common cognitive system involved in the processing of different types of social threats. To test the validity of this assumption in the current study, we reversed the sequence of the preexposure setup. We measured the effects of social exclusion on the subsequent processing of loss of control utilizing event-related brain potentials (ERPs) and self-reports. In the control group (CG, n = 26), the transition to loss of control elicited significant increases in both the P3 amplitude and the self-reported negative mood. Replicating the results of the previous preexposure study, these effects were significantly reduced by the preexposure to an independent social threat (here: social exclusion). In contrast to previous findings, these effects were not modulated by the discontinuation (EG1disc, n = 25) or continuation (EG2cont, n = 24) of the preexposure threat. Given that the P3 effect is related to the violation of subjective expectations, these results support the notion that preexposure to a specific social threat has widespread effects on the individuals' expectancy of upcoming social participation and control.

Unraveling the influence of trial-based motivational changes on performance monitoring stages in a flanker task

Performance monitoring (PM) is a vital component of adaptive behavior and known to be influenced by motivation. We examined effects of potential gain (PG) and loss avoidance (LA) on neural correlates of PM at different processing stages, using a task with trial-based changes in these motivational contexts. Findings suggest more attention is allocated to the PG context, with higher amplitudes for respective correlates of stimulus and feedback processing. The PG context favored rapid responses, while the LA context emphasized accurate responses. Lower response thresholds in the PG context after correct responses derived from a drift-diffusion model also indicate a more approach-oriented response style in the PG context. This cognitive shift is mirrored in neural correlates: negative feedback in the PG context elicited a higher feedback-related negativity (FRN) and higher theta power, whereas positive feedback in the LA context elicited higher P3a and P3b amplitudes, as well as higher theta power. There was no effect of motivational context on response-locked brain activity. Given the similar frequency of negative feedback in both contexts, the elevated FRN and theta power in PG trials cannot be attributed to variations in reward prediction error. The observed variations in the FRN indicate that the effect of outcome valence is modulated by motivational salience.

Contributions of transient and sustained reward to memory formation

Reward benefits to memory formation have been robustly linked to dopaminergic activity. Despite the established characterization of dopaminergic mechanisms as operating at multiple timescales, potentially supporting distinct functional outcomes, the temporal dynamics by which reward might modulate memory encoding are just beginning to be investigated. In the present study, we leveraged a mixed block/event experimental design to disentangle transient and sustained reward influences on task engagement and subsequent recognition memory in an adapted monetary-incentive-encoding (MIE) paradigm. Across three behavioral experiments, transient and sustained reward modulation of item and context memory was probed, at both 24-h and ~ 15-min retention intervals, to investigate the importance of overnight consolidation. In general, we observed that transient reward was associated with enhanced item memory encoding, while sustained reward modulated response speed but did not appear to benefit subsequent recognition accuracy. Notably, reward effects on item memory performance and response speed were somewhat inconsistent across the three experiments, with suggestions that RT speeding might also be related to time on task, and we did not observe reward modulation of context memory performance or amplification of reward benefits to memory by overnight consolidation. Taken together, the observed pattern of behavior is consistent with potentially distinct roles for transient and sustained reward in memory encoding and cognitive performance and suggests that further investigation of the temporal dynamics of dopaminergic contributions to memory formation will advance the understanding of motivated memory.

Adult Age Differences in the Temporal Dynamics of Motivated Attention

Reward-based motivation modulates attention and cognitive control across the life span, but little is known about age differences in the temporal dynamics of motivated attention. The current study examined the effects of financial incentives on visual attention using ERPs. Participants (26 younger, aged 18-33 years; 24 older, aged 65-95 years) completed an incentivized flanker task in which trial-level incentive cues signaled the availability of performance-contingent reward, and subsequent alerting cues signaled the onset of the flanker target. ERP components of interest included cue-related components (incentive-cue P2 and contingent negative variation, and alerting-cue N1) as well as target-related components (target N1 and P3). Transient effects of incentives were assessed by comparing ERP amplitudes across incentive and non-incentive trials from mixed-incentive blocks. Sustained effects of incentives were assessed by comparing ERP amplitudes across non-incentive trials from mixed-incentive blocks and non-incentive trials from pure non-incentive blocks. Younger adults showed transient effects of incentives on all components, whereas older adults showed these effects for incentive-cue P2 and alerting-cue N1 only. Both age groups showed sustained effects of incentives on cue-locked ERPs, but only younger adults showed sustained effects on target-locked ERPs. RT patterns mirrored the ERP findings, in that younger adults showed greater incentive-based modulation than older adults, but at a greater cost to accuracy. Overall, these findings reveal widespread age differences in the dynamics of incentive-motivated attention and cognitive control, particularly at longer timescales.

Effort Mobilization and Lapses of Sustained Attention

The current study examined whether effort mobilization would enhance sustained attention and reduce lapses of attention. Participants performed a sustained attention task and were randomly assigned to either an effort condition where they were instructed to "Try Hard" on a subset of trials or were assigned to a control condition with no "Try Hard" instructions. Pupillary responses were continuously recorded, and periodically during the task participants were presented with thought probes to determine whether they were on or off task. The results suggested within the effort condition there were no behavioral differences between Try Hard and "Standard" trials. Preparatory pupil responses were increased in Try Hard trials, but there were no differences for phasic pupillary responses to stimulus onset. In contrast, examining differences between the effort and control conditions suggested that participants who received the Try Hard instructions demonstrated faster overall performance, a reduction in very long reaction times, and reported fewer off-task thoughts compared with participants in the control condition. Participants in the effort condition also demonstrated a larger ramp-up in pupillary responses during the preparatory interval and a larger phasic response to stimulus onset compared with participants in the control condition. These results are consistent with attention allocation models suggesting that participants in the effort condition mobilized more attentional effort than participants in the control condition, resulting in enhanced sustained attention and a reduction in lapses of attention. These results also are consistent with recent theories, which suggest that the locus coeruleus norepinephrine system is associated with effort mobilization.

Investigating anticipatory processes during sequentially changing reward prospect: An ERP study

Performance-contingent reward prospect modulates the stability-flexibility balance in voluntary task switching. High reward prospect typically increases stability, indicated by a low voluntary switch rate (VSR). But this effect depends on the immediate reward history: Only when a high reward repeats (reward remains high), stability is increased. In contrast, when reward increases (high reward following low reward) cognitive flexibility is promoted, indicated by a relatively high VSR. To investigate the underlying mechanisms of changing reward expectations during voluntary task choice, we conducted two experiments and measured reward cue-locked event-related potentials (P2, P3b, CNV). The experiments yielded consistent findings: The P2 was stronger in response to high vs. low reward reflecting an early attentional boost by high reward anticipation. The P3b was highest in increase, intermediate in remain-high, and lowest in low reward trials suggesting responsiveness to working memory updating and motivational arousal. Finally, the CNV increased over time and was sensitive to both reward magnitude and sequence with the lowest amplitude in reward remain-low trials suggesting that preparatory control only increases when worth the effort. Taken together, early attentional processes (P2) were boosted by mere reward magnitude, while later processes (P3b, CNV) were sensitive to both reward magnitude and its sequence.

Selective reinforcement of conflict processing in the Stroop task

Motivation signals have been shown to influence the engagement of cognitive control processes. However, most studies focus on the invigorating effect of reward prospect, rather than the reinforcing effect of reward feedback. The present study aimed to test whether people strategically adapt conflict processing when confronted with condition-specific congruency-reward contingencies in a manual Stroop task. Results show that the size of the Stroop effect can be affected by selectively rewarding responses following incongruent versus congruent trials. However, our findings also suggest important boundary conditions. Our first two experiments only show a modulation of the Stroop effect in the first half of the experimental blocks, possibly due to our adaptive threshold procedure demotivating adaptive behavior over time. The third experiment showed an overall modulation of the Stroop effect, but did not find evidence for a similar modulation on test items, leaving open whether this effect generalizes to the congruency conditions, or is stimulus-specific. More generally, our results are consistent with computational models of cognitive control and support contemporary learning perspectives on cognitive control. The findings also offer new guidelines and directions for future investigations on the selective reinforcement of cognitive control processes.

Comparing the motivational value of rewards and losses in an EEG-pupillometry study

We found earlier that performance-contingent rewards lead to faster performance than equivalent losses [Carsten, Hoofs, Boehler, & Krebs, 2019. Motivation Science, 5(3). http://dx.doi.org/10.1037/mot0000117]. Here, we further tested the hypothesis that motivation to gain rewards is higher than to avoid losses, even when incentive values are matched. As implicit markers of motivation, we assessed electroencephalography (EEG) focusing on the P3 after target and feedback onset, and the Feedback-Related Negativity (FRN), as well as simultaneously recorded pupil size. Comparing only reward and loss prospect trials in Experiment 1, we found no consistent differences in behavior and electrophysiological markers of motivation, although pupil data suggested higher arousal after feedback in potential-loss trials. Including additional no-incentive trials in Experiment 2, we found consistent evidence that motivation to gain rewards was higher than to avoid losses: In line with behavior, the target-P3 was most pronounced for reward-related stimuli, followed by loss and no-incentive ones. This same ranking was found in the P3 and the FRN after positive outcomes (i.e., reward, avoided loss, and correct feedback in no-incentive trials). Negative outcomes featured a different pattern in line with the pupil response, which suggests that losses are emotionally salient events, without invigorating behavior proportionally. In sum, these findings suggest that the motivation to gain rewards is more pronounced than motivation to avoid equivalent losses, at least in tasks promoting transient increases in attention triggered by incentive prospect. These motivational differences may arise as avoided losses are not profitable in the long term, in contrast to gained rewards.

Performance feedback promotes proactive but not reactive adaptation of conflict-control

Cognitive control refers to the use of internal goals to guide how we process stimuli, and control can be applied proactively (in anticipation of a stimulus) or reactively (once that stimulus has been presented). The application of control can be guided by memory; for instance, people typically learn to adjust their level of attentional selectivity to changing task statistics, such as different frequencies of hard and easy trials in the Stroop task. This type of control-learning is highly adaptive, but its boundary conditions are currently not well understood. In the present study, we assessed how the presence of performance feedback shapes control-learning in the context of item-specific (reactive control, Experiments 1a and 1b) and list-wide (proactive control, Experiments 2a and 2b) proportion of congruency manipulations in a Stroop protocol. We found that performance feedback did not alter the modulation of the Stroop effect by item-specific cueing, but did enhance the modulation of the Stroop effect by a list-wide context. Performance feedback thus selectively promoted proactive, but not reactive, adaptation of cognitive control. These results have important implications for experimental designs, potential psychiatric treatment, and theoretical accounts of the mechanisms underlying control-learning. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Losing Money and Motivation: Effects of Loss Incentives on Motivation and Metacognition in Younger and Older Adults

Incentives are usually expected to increase motivation and cognitive control and to thereby improve performance. A small but growing number of studies have begun to investigate whether the effects of incentive on cognitive performance differ for younger vs. older adults. Most have used attention and cognitive control paradigms, trial-wise implementation of incentive condition, and gain incentives (reward), with only a very few investigating the effects of loss incentives. The present study takes a complementary approach: We tested younger and older adults in a working memory paradigm with loss incentives implemented session-wide (between subjects). We also included self-report measures to ask how loss incentive affected participants’ perceptions of the mental demand of the task, as well as their perceived effort, frustration, motivation, distraction, and metacognitive judgments of how well they had performed. This allowed us to test the disparate predictions of different theoretical views: the intuitive hypothesis that incentive should increase motivation and performance, the motivational shift proposal that older adults are especially motivated to avoid losses (Freund and Ebner, 2005), a heuristic “positivity effect” perspective that older adults ignore losses (Brassen et al., 2012; Williams et al., 2017), and a more nuanced view that suggests that when negative information is unavoidable and increases perceived costs, older adults may instead disengage from the situation (Charles, 2010; Hess, 2014). The results seemed most consistent with the more nuanced view of the positivity effect. While neither group showed incentive-related performance differences, both younger and older adults reported greater perceived demand and frustration under loss incentive, especially in the most challenging conditions. Loss incentive increased the accuracy of immediate metacognitive judgments, but reduced the accuracy of later, more global judgments of competency for older adults. Self-report measures suggested that the loss incentive manipulation was distracting to young adults and demotivating for older adults. The results suggest a need for caution in generalizing from existing studies to everyday life, and that additional studies parameterizing critical aspects of task design and incentive manipulation are needed to fully understand how incentives affect cognition and motivation in younger and older adults.

Are all behavioral reward benefits created equally? An EEG-fMRI study

Reward consistently boosts performance in cognitive tasks. Although many different reward manipulations exist, systematic comparisons are lacking. Reward effects on cognitive control are usually studied using monetary incentive delay (MID; cue-related reward information) or stimulus-reward association (SRA; target-related reward information) tasks. While for MID tasks, evidence clearly implicates reward-triggered global increases in proactive control, it is unclear how reward effects arise in SRA tasks, and in how far such mechanisms overlap during task preparation and target processing. Here, we address these questions with simultaneous EEG-fMRI using a Stroop task with four different block types. In addition to MID and SRA blocks, we used an SRA-task modification with reward-irrelevant cues (C-SRA) and regular reward-neutral Stroop-task blocks. Behaviorally, we observed superior performance for all reward conditions compared to Neutral, and more pronounced reward effects in the SRA and C-SRA blocks, compared to MID blocks. The fMRI data showed similar reward effects in value-related areas for events that signaled reward availability (MID cues and (C-)SRA targets), and comparable reward modulations in cognitive-control regions for all targets regardless of block type. This result pattern was echoed by the EEG data, showing clear markers of valuation and cognitive control, which only differed during task preparation, whereas reward-related modulations during target processing were again comparable across block types. Yet, considering only cue-related fMRI data, C-SRA cues triggered preparatory control processes beyond reward-unrelated MID cues, without simultaneous modulations in typical reward areas, implicating enhanced task preparation that is not directly driven by a concurrent neural reward-anticipation response.

How sequential changes in reward expectation modulate cognitive control: Pupillometry as a tool to monitor dynamic changes in reward expectation

Much evidence suggests that positive affect associated with performance-contingent reward modulates cognitive flexibility and stability. For example, in voluntary task switching, it has been shown that unchanged high reward promotes cognitive stability whereas increases or decreases in reward prospect as well as unchanged low reward promote cognitive flexibility (higher voluntary switch rate, VSR). Pupil diameter has been shown to respond to reward prospect, to task switching manipulations, and more generally to effort in cognitive control tasks and thus appears to be the ideal tool to learn more about the processes underlying these reward-modulated decisions. Therefore, we measured pupillary activity in two voluntary task switching experiments with randomly changing reward magnitudes. Behaviorally, VSR was again lowest when reward remained high as compared to all other reward sequences. Baseline pupil diameter was generally higher following switch trials as compared to repetition trials. Furthermore, the pupil responded dynamically to the reward manipulation: Phasic cue- and target-locked pupil dilation was larger in the reward phase as compared to the non-reward baseline block. Most importantly, phasic pupil dilation in the target interval was highest when reward prospect increased and lowest when reward prospect decreased, suggesting that motivational arousal fluctuates in sync with changes in reward expectation. These results are discussed with respect to current theories on cognitive control as a form of affect regulation.

Eye pupil signals information gain

In conditions of constant illumination, the eye pupil diameter indexes the modulation of arousal state and responds to a large breadth of cognitive processes, including mental effort, attention, surprise, decision processes, decision biases, value beliefs, uncertainty, volatility, exploitation/exploration trade-off, or learning rate. Here, I propose an information theoretic framework that has the potential to explain the ensemble of these findings as reflecting pupillary response to information processing. In short, updates of the brain’s internal model, quantified formally as the Kullback–Leibler (KL) divergence between prior and posterior beliefs, would be the common denominator to all these instances of pupillary dilation to cognition. I show that stimulus presentation leads to pupillary response that is proportional to the amount of information the stimulus carries about itself and to the quantity of information it provides about other task variables. In the context of decision making, pupil dilation in relation to uncertainty is explained by the wandering of the evidence accumulation process, leading to large summed KL divergences. Finally, pupillary response to mental effort and variations in tonic pupil size are also formalized in terms of information theory. On the basis of this framework, I compare pupillary data from past studies to simple information-theoretic simulations of task designs and show good correspondance with data across studies. The present framework has the potential to unify the large set of results reported on pupillary dilation to cognition and to provide a theory to guide future research.

"A" for Effort: Rewarding Effortful Retrieval Attempts Improves Learning From General Knowledge Errors in Women

Previous research has shown that the prospect of attaining a reward can promote task-engagement, up-regulate attention toward reward-relevant information, and facilitate enhanced encoding of new information into declarative memory. However, past research on reward-based enhancement of declarative memory has focused primarily on paradigms in which rewards are contingent upon accurate responses. Yet, findings from test-enhanced learning show that making errors can also be useful for learning if those errors represent effortful retrieval attempts and are followed by corrective feedback. Here, we used a challenging general knowledge task to examine the effects of explicitly rewarding retrieval effort, defined as a semantically plausible answer to a question (referenced to a semantic knowledge database www.mangelslab.org/bknorms), regardless of response accuracy. In particular, we asked whether intermittent rewards following effortful incorrect responses facilitated learning from corrective feedback as measured by incidental learning outcomes on a 24-48 h delayed retest. Given that effort-contingent extrinsic rewards represent the intersection between an internal locus of control and competency, we compared participants in this "Effort" group to three other groups in a between-subjects design: a Luck group that framed rewards as related to participant-chosen lottery numbers (reward with internal control, not competence-based), a random Award group that framed rewards as computer generated (no control, not competence-based), and a Control group with no reward, but matched on all other task features. Both men and women in the Effort group showed increased self-reports of concentration and positive feelings following the receipt of rewards, as well as subjective effort on the retest, compared to the Control group. However, only women additionally exhibited performance benefits of effort framing on error correction. These benefits were found for both rewarded and non-rewarded trials, but only for correction of low confidence errors, suggesting that effort-contingent rewards produced task-level changes in motivation to learn less familiar information in women, rather than trial-level influences in encoding or consolidation. The Luck and Award groups did not demonstrate significant motivational or behavioral benefits for either gender. These results suggest that both reward context and gender are important factors contributing to the effectiveness of rewards as tools to enhance learning from errors.

Motivation alters implicit temporal attention through sustained and transient mechanisms: A behavioral and pupillometric study

Temporal expectations aid performance by allowing the optimization of attentional readiness at moment of highest target probability. Reward enhances cognitive performance through its action on preparatory and reactive attentional processes. To elucidate how motivation interacts with mechanisms of implicit temporal attention, we studied healthy young adult participants (N = 73) performing a sustained attention task with simultaneous pupillometric recording, under different reward conditions (baseline: 0 c; reward: 10 c/fast response). Target timing was temporally unpredictable (variable foreperiod: 2-10 s, uniformly distributed), in which case implicitly formed timing expectations. Trials were binned according to current foreperiod (FP_n ; short: 2-6 s; long: 6-10 s) and preceding foreperiod (FP_n-1 ; short: 2-6 s; long: 6-10 s). Overall, performance data showed the expected temporal attention effects, with slower responses after shorter FP_n s, particularly when they followed longer FP_n-1 s. Moreover, these temporal effects were significantly reduced in the reward condition. While performance improved in all trial types, the largest benefit appeared in trials that were normally most disadvantaged by invalid temporal expectation. Furthermore, reward motivation was accompanied by an increase in sustained (prestimulus) and transient (poststimulus response) pupil diameter. The latter effect was particularly evident following short FP_n s. The current findings suggest that reward motivation can improve overall attentional performance and reduce implicit temporal bias, both through preparatory and reactive attentional mechanisms.