Preserved calibration of persistence based on delay-timing distribution during sleep deprivation

Statistical information about reward timing is insufficient for promoting optimal persistence decisions

When deciding how long to keep waiting for delayed rewards that will arrive at an uncertain time, different distributions of possible reward times dictate different optimal strategies for maximizing reward. When reward timing distributions are heavy-tailed (e.g., waiting on hold) there is a point at which waiting is no longer advantageous because the opportunity cost of waiting is too high. Alternatively, when reward timing distributions have more predictable timing (e.g., uniform), it is advantageous to wait as long as necessary for the reward. Although people learn to approximate optimal strategies, little is known about how this learning occurs. One possibility is that people learn a general cognitive representation of the probability distribution that governs reward timing and then infer a strategy from that model of the environment. Another possibility is that they learn an action policy in a way that depends more narrowly on direct task experience, such that general knowledge of the reward timing distribution is insufficient for expressing the optimal strategy. Here, in a series of studies in which participants decided how long to persist for delayed rewards before quitting, we provided participants with information about the reward timing distribution in several ways. Whether the information was provided through counterfactual feedback (Study 1), previous exposure (Studies 2a and 2b), or description (Studies 3a and 3b), it did not obviate the need for direct, feedback-driven learning in a decision context. Therefore, learning when to quit waiting for delayed rewards might depend on task-specific experience, not solely on probabilistic reasoning.

Pupillometric evidence for a temporal expectations-based account of persistence under temporal uncertainty

People often quit waiting for delayed rewards when the exact timing of those rewards is uncertain. This behavior often has been attributed to self-control failure. Another possibility is that quitting is the result of a rational decision-making process in the face of uncertainty, based on the decision-maker's expectations about the possible arrival times of the awaited reward. There are forms of temporal expectations (e.g., heavy-tailed) under which the expected time remaining until a reward arrives actually increases as time elapses. In those cases, the rational strategy is to quit waiting when the expected reward is no longer worth the expected time remaining. To arbitrate between the "limited self-control" and "temporal expectations" accounts of persistence, we measured pupil diameter during a persistence task, as a physiological marker of surprise (phasic responses) and effort (pre-decision diameter). Phasic pupil responses were elevated in response to reward receipt. Critically, the extent to which pupils dilated following rewards depended on the delay: people showed larger pupillary surprise responses the more delayed the reward was. This result suggests that people expect the reward less the longer they wait for it-a form of temporal expectations under which limiting persistence is rational. Moreover, predecision pupil diameter before quit events was not associated with how long the participant had been waiting, but rather, depended on how atypical the quit decision was compared with the participant's usual behavior. These data provide physiological evidence for a temporal expectations account of persistence under temporal uncertainty.

Sleep and self-control: A systematic review and meta-analysis

Controlling impulses and overcoming temptations (i.e., self-control) are key aspects of living a productive life. There is a growing yet disperse literature indicating that sleep is an important predictor of self-control. The goal of this meta-analysis is to empirically integrate the findings from multiple literatures, and investigate whether sleep quality, and sleep duration predict self-control. To provide a thorough understanding of the proposed relationships, this meta-analysis also investigated potential differences between the level of analysis (between-individual vs. within-individual), research design (experiment vs. correlation; and cross-sectional vs. time-lagged), and types of measure (subjective vs. objective for sleep and self-control). A systematic review was conducted through ABI/Inform (including PsycInfo), ERIC, ProQuest Dissertation & Theses, PubMed, and Psychology Database using keywords related to self-control and sleep. Sixty-one independent studies met the inclusion criteria. The results, in general, suggest that sleep quality (between-individual 0.26, CI 0.21; 0.31; and within-individual 0.35, CI 0.24; 0.45), and sleep duration (between-individual 0.14, CI 0.07; 0.21; and within-individual 0.20, CI 0.09; 0.31) are all related to self-control. Given the impact of self-control on how individuals live productive lives, a future research agenda should include a deeper investigation in the causal process (potentially via prefrontal cortex activity) linking sleep and self-control, and an examination of the moderators (individual and contextual variables) that could impact the relationship between sleep and self-control.

Dissociable influences of implicit temporal expectation on attentional performance and mind wandering

Mind wandering at critical moments during a cognitive task degrades performance. At other moments, mind wandering could serve to conserve task-relevant resources, allowing a brief mental respite. Recent research has shown that, if target timing is predictable, mind wandering episodes coincide with moments of low target likelihood. Conversely, mind wandering can be avoided at moments when targets are expected. In the current study, we tested whether mind wandering can be guided by implicit temporal expectations when target timing is less predictable. In two experiments (Experiment 1: N = 37, Experiment 2: N = 61), participants performed a sustained attention task in which target events were preceded by a variable pre-target interval (foreperiod). As time passes over the foreperiod duration, implicit target expectation increases, given that it has not yet appeared. In Experiment 1, all foreperiod durations were equally probable (uniform distribution: 2-10 s). This resulted in faster responses when targets were preceded by long compared to short foreperiods (foreperiod-effect). In contrast, mind wandering, assessed by thought probes inserted following short or long foreperiods, did not follow this pattern. In Experiment 2, alterations in the foreperiod distribution (left or right-skewed) resulted in changes in the behavioral foreperiod-effect, but mind wandering was unaffected. Our findings indicate that implicit timing strongly affects behavioral response to target events, but has no bearing on the mind wandering. Contrastingly, mind wandering did correlate with performance deterioration due to fatigue (time-on-task), suggesting that the thought probe method was sufficiently sensitive to behaviorally relevant changes in mental state.

Motivation alters implicit temporal attention through sustained and transient mechanisms: A behavioral and pupillometric study

Temporal expectations aid performance by allowing the optimization of attentional readiness at moment of highest target probability. Reward enhances cognitive performance through its action on preparatory and reactive attentional processes. To elucidate how motivation interacts with mechanisms of implicit temporal attention, we studied healthy young adult participants (N = 73) performing a sustained attention task with simultaneous pupillometric recording, under different reward conditions (baseline: 0 c; reward: 10 c/fast response). Target timing was temporally unpredictable (variable foreperiod: 2-10 s, uniformly distributed), in which case implicitly formed timing expectations. Trials were binned according to current foreperiod (FP_n ; short: 2-6 s; long: 6-10 s) and preceding foreperiod (FP_n-1 ; short: 2-6 s; long: 6-10 s). Overall, performance data showed the expected temporal attention effects, with slower responses after shorter FP_n s, particularly when they followed longer FP_n-1 s. Moreover, these temporal effects were significantly reduced in the reward condition. While performance improved in all trial types, the largest benefit appeared in trials that were normally most disadvantaged by invalid temporal expectation. Furthermore, reward motivation was accompanied by an increase in sustained (prestimulus) and transient (poststimulus response) pupil diameter. The latter effect was particularly evident following short FP_n s. The current findings suggest that reward motivation can improve overall attentional performance and reduce implicit temporal bias, both through preparatory and reactive attentional mechanisms.

The effects of acute stress on the calibration of persistence

People frequently fail to wait for delayed rewards after choosing them. These preference reversals are sometimes thought to reflect self-control failure. Other times, however, continuing to wait for a delayed reward may be counterproductive (e.g., when reward timing uncertainty is high). Research has demonstrated that people can calibrate how long to wait for rewards in a given environment. Thus, the role of self-control might be to integrate information about the environment to flexibly adapt behavior, not merely to promote waiting. Here we tested effects of acute stress, which has been shown to tax control processes, on persistence, and the calibration of persistence, in young adult human participants. Half the participants (n = 60) performed a task in which persistence was optimal, and the other half (n = 60) performed a task in which it was optimal to quit waiting for reward soon after each trial began. Each participant completed the task either after cold pressor stress or no stress. Stress did not influence persistence or optimal calibration of persistence. Nevertheless, an exploratory analysis revealed an "inverted-U" relationship between cortisol increase and performance in the stress groups, suggesting that choosing the adaptive waiting policy may be facilitated with some stress and impaired with severe stress.