Rational temporal predictions can underlie apparent failures to delay gratification

What do highly motivated people know? Balancing goals, prioritizing actions

Highly motivated individuals are healthier, more academically and professionally successful, and have stronger relationships. What sets these individuals apart? We propose that highly motivated individuals know when to balance versus prioritize goals. Specifically, they seek harmony between their multiple goals: they see these goals as advancing or complementing each other (e.g., balancing work and family, finding foods that are both tasty and healthy). They also seek to prioritize pursuing a subset of these goals within a given time and place. They make consistent action choices that highlight more important goals (e.g., prioritize studying over social media while in class). The intuition to balance goals and prioritize actions is acquired through social learning and can be enhanced through mindfulness. In turn, it enables self-regulatory success.

Willingness to wait outperforms delay discounting in predicting drinking severity

Alcohol misuse ranks among the leading causes of preventable death worldwide. Therefore, discovering measures that can predict hazardous drinking is critical. The delay discounting paradigm-which assesses relative preference for immediate rewards over larger, later rewards-has frequently been used as a proxy for impulsive choice, but it does not capture how long someone is willing to wait for delayed rewards when the arrival time is uncertain. In contrast, a newer willingness-to-wait task measures how long someone is willing to wait for a delayed reward of uncertain timing before giving up. We hypothesized that performance in this willingness-to-wait task would be associated with drinking severity and that this task may even outperform delay discounting as a predictor of drinking severity. We pooled data from multiple studies of mostly college-aged adult participants. Drinking severity was assessed with the Alcohol Use Disorders Identification Test. Willingness to wait under temporal uncertainty, but not delay discounting, was associated with severity of alcohol problems among participants who drank (n = 212). Individuals engaging in hazardous drinking were less willing to wait for rewards when delays were unknown than were individuals with low-risk drinking habits. Thus, willingness to wait under temporal uncertainty may be an important predictor of problematic drinking.

Active and passive waiting in impulsive choice: Effects of fixed-interval and fixed-time delays

Behavioral interventions to improve self-control, preference for a larger-later (LL) reward over a smaller-sooner (SS) reward, involve experience with delayed rewards. Whether they involve timing processes remains controversial. In rats, there have been inconsistent results on whether timing processes may be involved in intervention-induced improvements in self-control. Interventions that improved self-control with corresponding timing improvements used fixed-interval (FI) delays, whereas interventions that failed to find corresponding timing improvements used fixed-time (FT) delays. The FI schedule includes a response contingency (active waiting), whereas the FT schedule delivers reward automatically (passive waiting). The present study compared the effects of FI and FT schedules in interventions and impulsive choice tasks to evaluate effects on self-control and timing behavior. The impulsive choice task evaluated preference for an SS option (one pellet after 10-, 15-, 20-, 25-, and 30-s delays) versus an LL option (two pellets after a 30-s delay). The intervention task included forced-choice SS (one pellet after 10 s) and LL (two pellets after 30 s) sessions under FI or FT schedules. FI schedules produced greater sensitivity to SS delay in the impulsive choice task. Both FI and FT interventions increased LL choices. Following choice testing, temporal bisection and peak interval tasks revealed better timing precision for rats with an FI delay experience. Overall, the FI choice contingency was associated with improved temporal attention and timing precision.

Mechanisms of impulsive choice: Experiments to explore and models to map the empirical terrain

Impulsive choice is preference for a smaller-sooner (SS) outcome over a larger-later (LL) outcome when LL choices result in greater reinforcement maximization. Delay discounting is a model of impulsive choice that describes the decaying value of a reinforcer over time, with impulsive choice evident when the empirical choice-delay function is steep. Steep discounting is correlated with multiple diseases and disorders. Thus, understanding the processes underlying impulsive choice is a popular topic for investigation. Experimental research has explored the conditions that moderate impulsive choice, and quantitative models of impulsive choice have been developed that elegantly represent the underlying processes. This review spotlights experimental research in impulsive choice covering human and nonhuman animals across the domains of learning, motivation, and cognition. Contemporary models of delay discounting designed to explain the underlying mechanisms of impulsive choice are discussed. These models focus on potential candidate mechanisms, which include perception, delay and/or reinforcer sensitivity, reinforcement maximization, motivation, and cognitive systems. Although the models collectively explain multiple mechanistic phenomena, there are several cognitive processes, such as attention and working memory, that are overlooked. Future research and model development should focus on bridging the gap between quantitative models and empirical phenomena.

Lesions to different regions of frontal cortex have dissociable effects on voluntary persistence

Deciding how long to keep waiting for uncertain future rewards is a complex problem. Previous research has shown that choosing to stop waiting results from an evaluative process that weighs the subjective value of the awaited reward against the opportunity cost of waiting. In functional neuroimaging data, activity in ventromedial prefrontal cortex (vmPFC) tracks the dynamics of this evaluation, while activation in the dorsomedial prefrontal cortex (dmPFC) and anterior insula (AI) ramps up before a decision to quit is made. Here, we provide causal evidence of the necessity of these brain regions for successful performance in a willingness-to-wait task. 28 participants with frontal lobe lesions were tested on their ability to adaptively calibrate how long they waited for monetary rewards. We grouped the participants based on the location of their lesions, which were primarily in ventromedial, dorsomedial, or lateral parts of their prefrontal cortex (vmPFC, dmPFC, and lPFC, respectively), or in the anterior insula. We compared the performance of each subset of lesion participants to behavior in a control group without lesions (n=18). Finally, we fit a newly developed computational model to the data to glean a more mechanistic understanding of how lesions affect the cognitive processes underlying choice. We found that participants with lesions to the vmPFC waited less overall, while participants with lesions to the dmPFC and anterior insula were specifically impaired at calibrating their level of persistence to the environment. These behavioral effects were accounted for by systematic differences in parameter estimates from a computational model of task performance: while the vmPFC group showed reduced initial willingness to wait, lesions to the dmPFC/anterior insula were associated with slower learning from negative feedback. These findings corroborate the notion that failures of persistence can be driven by sophisticated cost-benefit analyses rather than lapses in self-control. They also support the functional specialization of different parts of the prefrontal cortex in service of voluntary persistence.

If They Won't Know, I Won't Wait: Anticipated Social Consequences Drive Children's Performance on Self-Control Tasks

This research evaluated the hypothesis that the act of offering an incentive produces anticipated social benefits that are distinct from the benefits associated with the incentive itself. Across three preregistered studies, 3- to 5-year-old children in China (total N = 210) were given an opportunity to wait for an additional sticker (Studies 1 and 3) or an edible treat (Study 2). Rewards were dispensed via a timer-controlled box that allowed the experimenter's apparent ability to learn how long children waited to be manipulated experimentally. Children waited only about half as long when they believed the experimenter would not find out how long they waited. When children were offered three prizes for waiting, anticipated social benefits still drove behavior at least as much as the reward. The findings demonstrate that children as young as 3 years are sensitive to anticipated social rewards when responding to offers of incentives.

Statistical information about reward timing is insufficient for promoting optimal persistence decisions

When deciding how long to keep waiting for delayed rewards that will arrive at an uncertain time, different distributions of possible reward times dictate different optimal strategies for maximizing reward. When reward timing distributions are heavy-tailed (e.g., waiting on hold) there is a point at which waiting is no longer advantageous because the opportunity cost of waiting is too high. Alternatively, when reward timing distributions have more predictable timing (e.g., uniform), it is advantageous to wait as long as necessary for the reward. Although people learn to approximate optimal strategies, little is known about how this learning occurs. One possibility is that people learn a general cognitive representation of the probability distribution that governs reward timing and then infer a strategy from that model of the environment. Another possibility is that they learn an action policy in a way that depends more narrowly on direct task experience, such that general knowledge of the reward timing distribution is insufficient for expressing the optimal strategy. Here, in a series of studies in which participants decided how long to persist for delayed rewards before quitting, we provided participants with information about the reward timing distribution in several ways. Whether the information was provided through counterfactual feedback (Study 1), previous exposure (Studies 2a and 2b), or description (Studies 3a and 3b), it did not obviate the need for direct, feedback-driven learning in a decision context. Therefore, learning when to quit waiting for delayed rewards might depend on task-specific experience, not solely on probabilistic reasoning.

Prediction From Minimal Experience: How People Predict the Duration of an Ongoing Epidemic

People are known for good predictions in domains they have rich experience with, such as everyday statistics and intuitive physics. But how well can they predict for problems they lack experience with, such as the duration of an ongoing epidemic caused by a new virus? Amid the first wave of COVID-19 in China, we conducted an online diary study, asking each of over 400 participants to predict the remaining duration of the epidemic, once per day for 14 days. Participants' predictions reflected a reasonable use of publicly available information but were meanwhile biased, subject to the influence of negative affect and future time perspectives. Computational modeling revealed that participants neither relied on prior distributions of epidemic durations as in inferring everyday statistics, nor on mechanistic simulations of epidemic dynamics as in computing intuitive physics. Instead, with minimal experience, participants' predictions were best explained by similarity-based generalization of the temporal pattern of epidemic statistics. In two control experiments, we further confirmed that such cognitive algorithm is not specific to the epidemic scenario and that minimal and rich experience do lead to different prediction behaviors for the same observations. We conclude that people generalize patterns in recent history to predict the future under minimal experience.

Pupillometric evidence for a temporal expectations-based account of persistence under temporal uncertainty

People often quit waiting for delayed rewards when the exact timing of those rewards is uncertain. This behavior often has been attributed to self-control failure. Another possibility is that quitting is the result of a rational decision-making process in the face of uncertainty, based on the decision-maker's expectations about the possible arrival times of the awaited reward. There are forms of temporal expectations (e.g., heavy-tailed) under which the expected time remaining until a reward arrives actually increases as time elapses. In those cases, the rational strategy is to quit waiting when the expected reward is no longer worth the expected time remaining. To arbitrate between the "limited self-control" and "temporal expectations" accounts of persistence, we measured pupil diameter during a persistence task, as a physiological marker of surprise (phasic responses) and effort (pre-decision diameter). Phasic pupil responses were elevated in response to reward receipt. Critically, the extent to which pupils dilated following rewards depended on the delay: people showed larger pupillary surprise responses the more delayed the reward was. This result suggests that people expect the reward less the longer they wait for it-a form of temporal expectations under which limiting persistence is rational. Moreover, predecision pupil diameter before quit events was not associated with how long the participant had been waiting, but rather, depended on how atypical the quit decision was compared with the participant's usual behavior. These data provide physiological evidence for a temporal expectations account of persistence under temporal uncertainty.

Cross-national harmonization of neurocognitive assessment across five sites in a global study

OBJECTIVE

Cross-national work on neurocognitive testing has been characterized by inconsistent findings, suggesting the need for improved harmonization. Here, we describe a prospective harmonization approach in an ongoing global collaborative study.

METHOD

Visuospatial N-Back, Tower of London (ToL), Stop Signal task (SST), Risk Aversion (RA), and Intertemporal Choice (ITC) tasks were administered to 221 individuals from Brazil, India, the Netherlands, South Africa, and the USA. Prospective harmonization methods were employed to ensure procedural similarity of task implementation and processing of derived task measures across sites. Generalized linear models tested for between-site differences controlling for sex, age, education, and socioeconomic status (SES). Associations with these covariates were also examined and tested for differences by site with site-by-covariate interactions.

RESULTS

The Netherlands site performed more accurately on N-Back and ToL than the other sites, except for the USA site on the N-Back. The Netherlands and the USA sites performed faster than the other three sites during the go events in the SST. Finally, the Netherlands site also exhibited a higher tolerance for delay discounting than other sites on the ITC, and the India site showed more risk aversion than other sites on the RA task. However, effect size differences across sites on the five tasks were generally small (i.e., partial eta-squared < 0.05) after dropping the Netherlands (on ToL, N-Back, ITC, and SST tasks) and India (on the RA task). Across tasks, regardless of site, the N-Back (sex, age, education, and SES), ToL (sex, age, and SES), SST (age), and ITC (SES) showed associations with covariates.

CONCLUSIONS

Four out of the five sites showed only small between-site differences for each task. Nevertheless, despite our extensive prospective harmonization steps, task score performance deviated from the other sites in the Netherlands site (on four tasks) and the India site (on one task). Because the procedural methods were standardized across sites, and our analyses were adjusted for covariates, the differences found in cognitive performance may indicate selection sampling bias due to unmeasured confounders. Future studies should follow similar cross-site prospective harmonization procedures when assessing neurocognition and consider measuring other possible confounding variables for additional statistical control. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

What children do while they wait: The role of self-control strategies in delaying gratification

Self-control plays an essential role in children's emotional and behavioral adjustment. A central behavioral indicator of self-control is the ability to delay gratification. Few studies have focused on understanding the heterogeneity of self-control behaviors that underlie children's ability to delay gratification. Therefore, we examined the role of spontaneous self-control behaviors (fidgeting, vocalizations, and anticipation/attentional focus toward a reward) in relation to 5-year old children's delay ability using Mischel's delay task (N = 144; M_age = 5.4 years, SD = 0.29). Latent mixture modeling was used to derive three distinct classes of self-control behaviors observed during the delay task: (1) Passive (low fidgeting, low vocalizations, but moderate anticipation), (2) Active (moderate fidgeting, moderate vocalizations, but high anticipation), and (3) Disruptive (high fidgeting, high vocalizations, and high anticipation). Children in the Passive class were more likely to delay the full task time compared with children in the Active class (odds ratio = 1.50, 95 % confidence interval = 1.28-1.81). There were no other differences in delay ability by self-control class. Children whose level of fidgeting and vocalizations matched their level of anticipation (i.e., Passive and Disruptive regulators) were able to delay more successfully than children who were mostly driven by anticipation (Active regulators). Some variation in children's delay ability and use of self-control strategies was explained by sociodemographic differences, specifically maternal age. Findings suggest probing processes underlying children's self-control to identify potential targets for intervention.

Environmental uncertainty and the advantage of impulsive choice strategies

Choice impulsivity is characterized by the choice of immediate, smaller reward options over future, larger reward options, and is often thought to be associated with negative life outcomes. However, some environments make future rewards more uncertain, and in these environments impulsive choices can be beneficial. Here we examined the conditions under which impulsive vs. non-impulsive decision strategies would be advantageous. We used Markov Decision Processes (MDPs) to model three common decision-making tasks: Temporal Discounting, Information Sampling, and an Explore-Exploit task. We manipulated environmental variables to create circumstances where future outcomes were relatively uncertain. We then manipulated the discount factor of an MDP agent, which affects the value of immediate versus future rewards, to model impulsive and non-impulsive behavior. This allowed us to examine the performance of impulsive and non-impulsive agents in more or less predictable environments. In Temporal Discounting, we manipulated the transition probability to delayed rewards and found that the agent with the lower discount factor (i.e. the impulsive agent) collected more average reward than the agent with a higher discount factor (the non-impulsive agent) by selecting immediate reward options when the probability of receiving the future reward was low. In the Information Sampling task, we manipulated the amount of information obtained with each sample. When sampling led to small information gains, the impulsive MDP agent collected more average reward than the non-impulsive agent. Third, in the Explore-Exploit task, we manipulated the substitution rate for novel options. When the substitution rate was high, the impulsive agent again performed better than the non-impulsive agent, as it explored the novel options less and instead exploited options with known reward values. The results of these analyses show that impulsivity can be advantageous in environments that are unexpectedly uncertain.

Temporal expectations in delay of gratification

We examined how temporal expectations influence preference reversals in a delay of gratification task for rats based on a hypothesis of Rachlin (2000), who suggested that preference for a larger-later reward may shift in favor of a smaller-immediate reward as a result of changes in when that larger reward is expected. To explore Rachlin's hypothesis, we preexposed two groups of rats to the delays associated with a larger-later reinforcer from a delay of gratification task. One group experienced the delays as a function of their choices in an intertemporal choice task and the other group experienced delays yoked from the first group (independent of their behavior) in an exposure training procedure. In addition, we included a third group of rats that were not exposed to delays during preexposure training as a comparison to the other two groups. Overall, the two groups of rats that experienced delays during preexposure training tended to make fewer defection responses than the comparison group during the delay of gratification task. Consistent with Rachlin's hypothesis, our results suggest that temporal learning may influence preference reversals in a delay of gratification task, providing a number of future directions for research in this area.

Intertemporal choice reflects value comparison rather than self-control: insights from confidence judgements

Intertemporal decision-making has long been assumed to measure self-control, with prominent theories treating choices of smaller, sooner rewards as failed attempts to override immediate temptation. If this view is correct, people should be more confident in their intertemporal decisions when they 'successfully' delay gratification than when they do not. In two pre-registered experiments with built-in replication, adult participants (n = 117) made monetary intertemporal choices and rated their confidence in having made the right decisions. Contrary to assumptions of the self-control account, confidence was not higher when participants chose delayed rewards. Rather, participants were more confident in their decisions when possible rewards were further apart in time-discounted subjective value, closer to the present, and larger in magnitude. Demonstrating metacognitive insight, participants were more confident in decisions that better aligned with their separate valuation of possible rewards. Decisions made with less confidence were more prone to changes-of-mind and more susceptible to a patience-enhancing manipulation. Together, our results establish that confidence in intertemporal choice tracks uncertainty in estimating and comparing the value of possible rewards-just as it does in decisions unrelated to self-control. Our findings challenge self-control views and instead cast intertemporal choice as a form of value-based decision-making about future possibilities. This article is part of the theme issue 'Thinking about possibilities: mechanisms, ontogeny, functions and phylogeny'.

More than meets the eye: Examining physiological and behavioral regulation during delay of gratification task

Children continually encounter situations where they must regulate impulsive responses to achieve a goal, requiring both self‐control (SC) and delay of gratification. We examined concurrent behavioral SC strategies (fidgeting, vocalizations, anticipation) and physiological regulation (heart rate [HR], respiratory sinus arrhythmia [RSA]) in 126 children (M (SD) = 5.4 (0.29) years) during a standard delay of gratification task. Latent variable models derived latent SC classes and examined the moderating role of HR/RSA on SC and delay ability. Three classes of SC were identified: passive: low fidgeting and vocalizations, moderate anticipation; active: moderate fidgeting, low vocalizations, and high anticipation; and disruptive: moderate fidgeting, high vocalizations, and high anticipation. Children in the active class had the lowest odds of delaying full task time, compared to children in the passive (OR = 0.67, z = −5.25, p < .001) and disruptive classes (OR = 0.76, z = −2.03, p = .04). RSA changes during the task moderated the relationship between SC class and delay ability for children in the active class (aOR = 0.92, z = −3.1, p < .01). Within the group who struggled to delay gratification (active class), a subset exhibiting appropriate autonomic regulation was able to delay. The findings suggest probing congruency of observed behavioral and unobserved physiological regulation.

Testing delay of gratification in rats using a within-session increasing-delay task

In delay discounting, preference reversals refer to shifts in preference from a larger-later reward to a smaller-sooner reward. Steep hyperbolic discounting predicts a preference reversal when a smaller-sooner and larger-later reward both become temporally proximal; prior research is consistent with this prediction. Hyperbolic discounting does not predict a preference reversal, however, after an individual chooses a larger-later reward over a smaller-immediate reward; prior research is inconsistent with this prediction. We sought to replicate and extend these findings using a delay of gratification task in rats. The task included a defection response which allowed rats to reverse their preference after choosing a larger-later sucrose reinforcer to instead obtain a smaller-immediate sucrose reinforcer. In Experiment 1, we found that rats would defect on their choice of the larger-later reinforcer, systematically replicating prior research. We also found that experience on the delay of gratification task led to decreases in defection responses. In Experiment 2, we found that prior experience on an intertemporal choice task, with no opportunity to defect, also led to few defection responses on the delay of gratification task. We discuss our findings in the context of whether inhibitory control or temporal learning could be involved in delay of gratification.

Executive Functions in Social Context: Implications for Conceptualizing, Measuring, and Supporting Developmental Trajectories

Success in life is linked to executive functions, a collection of cognitive processes that support goal-directed behaviors. Executive functions is an umbrella term related to cognitive control, self-control, and more. Variations in executive functioning predict concurrent success in schooling, relationships, and behavior, as well as important life outcomes years later. Such findings may suggest that certain individuals are destined for good executive functioning and success. However, environmental influences on executive function and development have long been recognized. Recent research in this tradition demonstrates the power of social contextual influences on children's engagement of executive functions. Such findings suggest new interpretations of why individuals differ in executive functioning and associated life outcomes, including across cultures and socioeconomic statuses. These findings raise fundamental questions about how best to conceptualize, measure, and support executive functioning across diverse contexts. Future research addressing real-world dynamics and computational mechanisms will elucidate how executive functioning emerges in the world.

Quantifying the subjective cost of self-control in humans

Since Odysseus committed to resisting the Sirens, mechanisms to limit self-control failure have been a central feature of human behavior. Psychologists have long argued that the use of self-control is an effortful process and, more recently, that its failure arises when the cognitive costs of self-control outweigh its perceived benefits. In a similar way, economists have argued that sophisticated choosers can adopt "precommitment strategies" that tie the hands of their future selves in order to reduce these costs. Yet, we still lack an empirical tool to quantify and demonstrate the cost of self-control. Here, we develop and validate an economic decision-making task to quantify the subjective cost of self-control by determining the monetary cost a person is willing to incur in order to eliminate the need for self-control. We find that humans will pay to avoid having to exert self-control in a way that scales with increasing levels of temptation and that these costs appear to be modulated both by motivational incentives and stress exposure. Our psychophysical approach allows us to index moment-to-moment self-control costs at the within-subject level, validating important theoretical work across multiple disciplines and opening avenues of self-control research in healthy and clinical populations.

When the Going Gets Tough, How Do We Perceive the Future?

People struggle to stay motivated to work toward difficult goals. Sometimes the feeling of difficulty signals that the goal is important and worth pursuing; other times, it signals that the goal is impossible and should be abandoned. In this article, we argue that how difficulty is experienced depends on how we perceive and experience the timing of difficult events. We synthesize research from across the social and behavioral sciences and propose a new, integrated model to explain how components of time perception interact with interpretations of experienced difficulty to influence motivation and goal-directed behavior. Although these constructs have been studied separately in previous research, we suggest that these factors are inseparable and that an integrated model will help us to better understand motivation and predict behavior. We conclude with new empirical questions to guide future research and by discussing the implications of this research for both theory and intervention practice.

Weighting on waiting: Willpower and attribute weighting models of decision making

Willpower is often conceptualized as incorporating effortful and momentary suppression of immediate but ultimately inferior rewards. Yet, growing evidence instead supports a process of attribute weighting, whereby normatively optimal choices arise from separable evaluation of different attributes (e.g., time and money). Strategic allocation of attention settles conflicts between competing choice-relevant attributes, which could be expanded to include self-referential predictions ("resolve").

Inference and preference in intertemporal choice

When choosing between immediate and future rewards, how do people deal with uncertainty about the value of the future outcome or the delay until its occurrence? Skylark et al. (2020) suggested that people employ a delay-reward heuristic: the inferred value of an ambiguous future reward is a function of the stated delay, and vice-versa. The present paper investigates the role of this heuristic in choice behaviour. In Studies 1a–2b, participants inferred the value of an ambiguous future reward or delay before the true value was revealed and a choice made. Preference for the future option was predicted by the discrepancy between the estimated and true values: the more pleasantly surprising the delayed option, the greater the willingness to choose it. Studies 3a–3c examined the association between inference and preference when the ambiguous values remained unknown. As predicted by the use of a delay-reward heuristic, inferred delays and rewards were positively related to stated rewards and delays, respectively. More importantly, choices were associated with inferred rewards and, in some circumstances, delays. Critically, estimates and choices were both order-dependent: when estimates preceded choices, estimates were more optimistic (people inferred smaller delays and larger rewards) and were subsequently more likely to choose the delayed option than when choices were made before estimates. These order effects argue against a simple model in which people deal with ambiguity by first estimating the unknown value and then using their estimate as the basis for decision. Rather, it seems that inferences are partly constructed from choices, and the role of inference in choice depends on whether an explicit estimate is made prior to choosing. Finally, we also find that inferences about ambiguous delays depend on whether the estimate has to be made in “days” or in a self-selected temporal unit, and replicate previous findings that older participants make more pessimistic inferences than younger ones. We discuss the implications and possible mechanisms for these findings.

Hypnotic suggestions of safety reduce neuronal signals of delay discounting

Waiting for delayed rewards is important to reach long-term goals, yet most people prefer immediate rewards. This tendency is called delay discounting. Evidence shows that people are more willing to wait for delayed rewards when they believe that the delayed reward is certain. We hypothesized that feeling safe makes delayed outcomes subjectively more certain, which should in turn reduce neuronal signals of delay discounting. We hypnotized 24 highly suggestible participants and gave them a suggestion to feel safe. We then used EEG to measure their brain responses to immediate and delayed rewards while they played a delayed gratification game. As compared to a control condition without hypnosis, participants that were suggested to feel safe under hypnosis reported feeling significantly safer. Further, their reward-related brain activity differentiated less between immediate and delayed rewards. We conclude that feeling safe makes delayed outcomes subjectively more certain and therefore reduces neuronal signals of delay discounting.

From affective to cognitive processing: Functional organization of the medial frontal cortex

The medial wall of the primate frontal lobe encompasses multiple anatomical subregions. Based on distinct neurophysiological correlates and effects of lesions, individual areas are thought to play unique roles in behavior. Further, evidence suggests that dysfunction localized to specific subregions is commonly found in different neuropsychiatric disorders. The neurobiological underpinnings of these disorders, however, remain far from clear. Here, to better understand the functions of medial frontal cortex (MFC) and its role in psychiatric disease, we focus on its functional organization. We describe the emerging pattern in which more dorsal regions subserve temporally extended cognitive functions and more ventral regions predominantly subserve affective functions. We focus on two specific domains, decision-making and social cognition, that require integration across emotion and cognition. In each case, we discuss the current understanding of the functions believed to depend on subregions of MFC as a stepping-stone to speculate on how they might work in unison. We conclude with an overview of how symptoms of certain psychiatric disorders relate to our understanding of MFC functional organization and how further discovery could fuel advances in circuit-based therapies.

Trade-Offs in Choice

To explain trade-offs in choice, researchers have proposed myriad phenomena and decision rules, each paired with separate theories and idiosyncratic vocabularies. Yet most choice problems are ultimately resolved with one of just two types of solutions: mixed or extreme. For example, people adopt mixed solutions for resolving trade-offs when they allow exercising to license indulgence afterward (balancing between goals), read different literary genres (variety seeking), and order medium-sized coffees (the compromise effect). By contrast, when people adopt extreme solutions for resolving these exact same trade-offs, they exhibit highlighting, consistency seeking, and compromise avoidance, respectively. Our review of the choice literature first illustrates how many seemingly unrelated phenomena actually share the same underlying psychology. We then identify variables that promote one solution versus the other. These variables, in turn, systematically influence which of opposite choice effects arise (e.g., highlighting versus balancing). Finally, we demonstrate how several mistakes people purport to make can potentially instead be reinterpreted as mixed solutions for resolving trade-offs. We conclude with guidance for distinguishing mistakes from mixed solutions.

Delay of Gratification as Reputation Management

Although delay-of-gratification tasks have long been used as measures of self-control, recent evidence suggests that performance on these tasks is also driven by rational decision processes. The present research examined whether the effects of rational decision processes extend beyond costs and benefits embedded in the task itself to include anticipated consequences for the child's reputation. Across two studies, 3- and 4-year-olds from China (N = 273) were assigned to a standard delay-of-gratification condition or to a reputation condition in which they were told that their teacher or a peer would find out how long they had waited. Children waited longer in the reputation conditions and longer in the teacher condition than in the peer condition. This is the first evidence that children's performance on a delay-of-gratification task is sensitive to reputational concerns and to the identity of potential evaluators of their behavior.

Measuring Time Preferences

We review research that measures time preferences-i.e., preferences over intertemporal tradeoffs. We distinguish between studies using financial flows, which we call "money earlier or later" (MEL) decisions and studies that use time-dated consumption/effort. Under different structural models, we show how to translate what MEL experiments directly measure (required rates of return for financial flows) into a discount function over utils. We summarize empirical regularities found in MEL studies and the predictive power of those studies. We explain why MEL choices are driven in part by some factors that are distinct from underlying time preferences.

Your Brain Is Not an Onion With a Tiny Reptile Inside

A widespread misconception in much of psychology is that (a) as vertebrate animals evolved, “newer” brain structures were added over existing “older” brain structures, and (b) these newer, more complex structures endowed animals with newer and more complex psychological functions, behavioral flexibility, and language. This belief, although widely shared in introductory psychology textbooks, has long been discredited among neurobiologists and stands in contrast to the clear and unanimous agreement on these issues among those studying nervous-system evolution. We bring psychologists up to date on this issue by describing the more accurate model of neural evolution, and we provide examples of how this inaccurate view may have impeded progress in psychology. We urge psychologists to abandon this mistaken view of human brains.

Sustained Visual Priming Effects Can Emerge from Attentional Oscillation and Temporal Expectation

Priming refers to the influence that a previously encountered object exerts on future responses to similar objects. For many years, visual priming has been known as a facilitation and sometimes an inhibition effect that lasts for an extended period of time. It contrasts with the recent finding of an oscillated priming effect where facilitation and inhibition alternate over time periodically. Here we developed a computational model of visual priming that combines rhythmic sampling of the environment (attentional oscillation) with active preparation for future events (temporal expectation). Counterintuitively, it shows that both the sustained and oscillated priming effects can emerge from an interaction between attentional oscillation and temporal expectation. The interaction also leads to novel predictions, such as the change of visual priming effects with temporal expectation and attentional oscillation. Reanalysis of two published datasets and the results of two new experiments of visual priming tasks with male and female human participants provide support for the model's relevance to human behavior. More generally, our model offers a new perspective that may unify the increasing findings of behavioral and neural oscillations with the classic findings in visual perception and attention.

SIGNIFICANCE STATEMENT There is increasing behavioral and neural evidence that visual attention is a periodic process that sequentially samples different alternatives in the theta frequency range. It contrasts with the classic findings of sustained facilitatory or inhibitory attention effects. How can an oscillatory perceptual process give rise to sustained attention effects? Here we make this connection by proposing a computational model for a “fruit fly” visual priming task and showing both the sustained and oscillated priming effects can have the same origin: an interaction between rhythmic sampling of the environment and active preparation for future events. One unique contribution of our model is to predict how temporal contexts affects priming. It also opens up the possibility of reinterpreting other attention-related classic phenomena.

Deliberating trade-offs with the future

Many fundamental choices in life are intertemporal: they involve trade-offs between sooner and later outcomes. In recent years there has been a surge of interest into how people make intertemporal decisions, given that such decisions are ubiquitous in everyday life and central in domains from substance use to climate change action. While it is clear that people make decisions according to rules, intuitions and habits, they also commonly deliberate over their options, thinking through potential outcomes and reflecting on their own preferences. In this Perspective, we bring to bear recent research into the higher-order capacities that underpin deliberation-particularly those that enable people to think about the future (prospection) and their own thinking (metacognition)-to shed light on intertemporal decision-making. We show how a greater appreciation for these mechanisms of deliberation promises to advance our understanding of intertemporal decision-making and unify a wide range of otherwise disparate choice phenomena.

Same Data Set, Different Conclusions: Preschool Delay of Gratification Predicts Later Behavioral Outcomes in a Preregistered Study

One simple marshmallow test in preschool children predicts an array of important life outcomes, according to multiple studies spanning several decades. However, a recent conceptual replication casts doubt on these famous findings. We conducted an independent, preregistered secondary analysis to test whether previously observed longitudinal associations between preschool delay of gratification and adolescent outcomes would be conceptually replicated. Associations were significant for three of the five outcomes we tested using the analytic approach employed in the original studies of the marshmallow test. Relationships between delay of gratification and problem behavior held in bivariate, multivariate, and multilevel models; in contrast, no significant relationships between delay and problem behavior were found in the other recent replication, even though both studies used the same data set. These relationships were better explained by social support than by self-control, suggesting that the marshmallow test is predictive because it reflects aspects of a child's early environment that are important over the long term. This novel interpretation of the classic findings points to new directions for intervention.

Intrinsic prefrontal organization underlies associations between achievement motivation and delay discounting

Achievement motivation is a core component of human decision making. However, neural mechanisms that link achievement motivation and intertemporal choice have not yet been elucidated. Here, we examined neural pathways underlying the relationship between achievement motivation and intertemporal choice using a delay discounting task and resting-state functional magnetic resonance imaging on 86 healthy subjects. Behaviorally, delay discounting rate was positively correlated with achievement motivation. Functional coupling of the dorsolateral prefrontal cortex (dlPFC) with the medial prefrontal cortex (mPFC), medial orbitofrontal cortex and ventral striatum was positively correlated with achievement motivation. Notably, the mediation analysis showed that the impact of achievement motivation on delay discounting was mediated by intrinsic connectivity between the dlPFC and mPFC. Our findings suggest that intrinsic organization within the prefrontal cortex plays a key role in linking achievement motivation and intertemporal choice.

Children Delay Gratification for Cooperative Ends

To cooperate effectively, both in small-scale interactions and large-scale collective-action problems, people frequently have to delay gratification (i.e., resist short-term temptations in favor of joint long-term goals). Although delay-of-gratification skills are commonly considered critical in children's social-cognitive development, they have rarely been studied in the context of cooperative decision-making. In the current study, we therefore presented pairs of children (N = 207 individuals) with a modified version of the famous marshmallow test, in which children's outcomes were interdependently linked such that the children were rewarded only if both members of the pair delayed gratification. Children from two highly diverse cultures (Germany and Kenya) performed substantially better than they did on a standard version of the test, suggesting that children are more willing to delay gratification for cooperative than for individual goals. The results indicate that from early in life, human children are psychologically equipped to respond to social interdependencies in ways that facilitate cooperative success.

Altruistic self-regulation in young children

We investigated whether children would be willing to sustain delaying their own gratification in order to benefit someone else. We used a modified version of the classic "marshmallow task," in which children must sustain delaying gratification in the presence of the immediate reward for an unspecified amount of time in order to receive a larger reward later. Children were assigned to one of three conditions. In the Self condition, children were given a food item and were told that if they waited to eat it, they would receive a second food item. In the Prosocial condition, children also were given a food item but were told that if they waited to eat their food item, another child would get a food item. In the Nonsocial Control condition, children were given a food item but were told that waiting to eat it would not benefit anyone. We found that children waited significantly longer in both the Self and Prosocial conditions than in the Nonsocial Control condition, and children's wait durations in the Self and Prosocial conditions were not significantly different. Our results suggest that children are willing to engage in effortful self-regulation in order to benefit another child.

Uncovering the 'state': Tracing the hidden state representations that structure learning and decision-making

We review the abstract concept of a 'state' - an internal representation posited by reinforcement learning theories to be used by an agent, whether animal, human or artificial, to summarize the features of the external and internal environment that are relevant for future behavior on a particular task. Armed with this summary representation, an agent can make decisions and perform actions to interact effectively with the world. Here, we review recent findings from the neurobiological and behavioral literature to ask: 'what is a state?' with respect to the internal representations that organize learning and decision making across a range of tasks. We find that state representations include information beyond a straightforward summary of the immediate cues in the environment, providing timing or contextual information from the recent or more distant past, which allows these additional factors to influence decision making and other goal-directed behaviors in complex and perhaps unexpected ways.

The Motivational Aspect of Children's Delayed Gratification: Values and Decision Making in Middle Childhood

Delayed gratification is the ability to postpone an immediate gain in favor of greater and later reward. Although delayed gratification has been studied extensively, little is known about the motivation behind children's decisions. Since values are cognitive representations of individuals' motivations, which serve to guide behavior, we studied the relationship between children's values and delayed gratification. Two main distinct motivations overlapping with values may underlie this decision: conservation - the desire to reduce uncertainty and preserve the status quo, and self-enhancement - the desire to maximize resources and profit for the self. Accordingly, we hypothesized that conservation values would relate to children's preference to hold on to what is given as soon as possible, and that self-enhancement values would relate to children's preference for delaying gratification. Seven-year old children (N = 205) ranked their values with the Picture-Based Values Survey (Döring et al., 2010) as part of the Longitudinal Israeli Study of Twins (LIST) (Avinun and Knafo, 2013). The children also played a decision-making animation game that included delayed gratification decisions. In support of our hypotheses, greater delayed gratification related negatively to conservation values, specifically to security and tradition, and related positively to self-enhancement values, especially power and achievement. This is one of the first demonstrations that children's values relate meaningfully to their behaviors.

What the Future Holds and When: A Description-Experience Gap in Intertemporal Choice

Uncertainty about the waiting time before obtaining an outcome is integral to intertemporal choice. Here, we showed that people express different time preferences depending on how they learn about this temporal uncertainty. In two studies, people chose between pairs of options: one with a single, sure delay and the other involving multiple, probabilistic delays (a lottery). The probability of each delay occurring either was explicitly described (timing risk) or could be learned through experiential sampling (timing uncertainty; the delay itself was not experienced). When the shorter delay was rare, people preferred the lottery more often when it was described than when it was experienced. When the longer delay was rare, this pattern was reversed. Modeling analyses suggested that underexperiencing rare delays and different patterns of probability weighting contribute to this description-experience gap. Our results challenge traditional models of intertemporal choice with temporal uncertainty as well as the generality of inverse-S-shaped probability weighting in such choice.

Cognitive and behavioral training interventions to promote self-control

This review article discusses various cognitive and behavioral interventions that have been developed with the goal of promoting self-controlled responding. Self-control can exert a significant impact on human health and impulsive behaviors are associated with a wide range of diseases and disorders, leading to the suggestion that impulsivity is a trans-disease process. The self-control interventions include effort exposure, reward discrimination, reward bundling, interval schedules of reinforcement, impulse control training, and mindfulness training. Most of the interventions have been consistently shown to increase self-control, except for mindfulness training. Some of the successful interventions are long-lasting, whereas others may be transient. Most interventions are domain-specific, targeting specific cognitive and behavioral processes that relate to self-control rather than targeting overall self-control. For example, effort exposure appears to primarily increase effort tolerance, which in turn can improve self-control. Similarly, interval schedules primarily target interval timing, which promotes self-controlled responses. A diagram outlining a proposed set of intervention effects on self-control is introduced to motivate further research in this area. The diagram suggests that the individual target processes of the interventions may potentially summate to produce general self-control, or perhaps even produce synergistic effects. In addition, it is suggested that developing a self-control profile may be advantageous for aligning specific interventions to mitigate specific deficits. Overall, the results indicate that interventions are a promising avenue for promoting self-control and may help to contribute to changing health outcomes associated with a wide variety of diseases and disorders. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

On the Neural and Mechanistic Bases of Self-Control

Intertemporal choice requires a dynamic interaction between valuation and deliberation processes. While evidence identifying candidate brain areas for each of these processes is well established, the precise mechanistic role carried out by each brain region is still debated. In this article, we present a computational model that clarifies the unique contribution of frontoparietal cortex regions to intertemporal decision making. The model we develop samples reward and delay information stochastically on a moment-by-moment basis. As preference for the choice alternatives evolves, dynamic inhibitory processes are executed by way of asymmetric lateral inhibition. We find that it is these lateral inhibition processes that best explain the contribution of frontoparietal regions to intertemporal decision making exhibited in our data.

Life is uncertain, eat dessert first: Uncertainty causes controlled and unemotional eaters to consume more sweets

Sometimes even dieters with the best self-control overindulge. Uncertain situations may undermine the self-control of even well-controlled eaters. This study was designed to test the hypothesis that uncertainty increases unhealthy snacking. Participants were either told that they would be giving a speech, that they would be listening to a speech, or that they would find out later whether they were to give a speech or not. Among participants who typically reported good control over their eating or scored low on emotional eating, participants who were uncertain about whether they would be giving a speech ate more candy than participants who expected to not have to give a speech and even those who expected to have to give a speech. Participants who reported poor control over their eating or scored high on emotional eating did not eat significantly more when uncertain. These findings suggest that, for people who are typically able to control their eating, uncertainty increases snacking more than certainty of a negative outcome.