The role of simulation in intertemporal choices

The effect of episodic foresight on intertemporal decision-making: the role of future self-continuity and perceived control

To investigate the mechanism of episodic foresight of different valences on intertemporal decision-making, this study examined the mediating role of future self-continuity in the influence of episodic foresight on intertemporal decision-making and the moderating role of perceived control in two experiments. The results found that (1) future self-continuity mediated the effect of episodic foresight on individuals' intertemporal decision-making; and (2) perceived control moderated the indirect effect of episodic foresight on intertemporal decision-making through future self-continuity. Under low perceived control, individuals with positive episodic foresight had stronger future self-continuity and preferred future options, while individuals with negative episodic foresight had lower future self-continuity. In contrast, under high perceived control, individuals with different episodic foresight potencies did not show significant differences in their future self-continuity levels, but all showed higher levels and tended to choose the delayed option when faced with an intertemporal choice. From the perspective of the self-cognition, this study provided new insights into the relationship between episodic foresight and intertemporal decision-making and the psychological mechanisms of intertemporal decision-making.

The effects of cueing episodic future thinking on delay discounting in children, adolescents, and adults

Discounting the value of delayed rewards such that even a relatively small, immediately available reward is preferred to a larger delayed reward is a commonly observed human trait. Children are particularly steep discounters of delayed rewards as evidenced by delay of gratification studies. In recent years, however, a growing literature indicates that cueing individuals to imagine personal future events attenuates their discounting of delayed rewards. The present studies extend this literature by examining whether cueing future thinking promotes patient choices in children and adolescents. In Experiment 1 we found that cueing future thinking had no effect on 8-11-year-olds' (n = 177) delay discounting of either real or hypothetical rewards. In Experiment 2 we found that cueing adolescents (12-14-year-olds, n = 126) and adults (n = 122) to think about personal future events decreased their discounting of delayed rewards relative to three other conditions: a no cue control, an episodic memory condition and a novel 'future other' condition in which individuals imagine future events that might happen to a significant other person in their life. Cueing adults and adolescents to think about personal future events did not however affect how connected they felt to their future selves or their subjective sense of how close future time points felt to them - two constructs that have previously been shown to be related to delay discounting.

The right temporoparietal junction enables delay of gratification by allowing decision makers to focus on future events

Studies of neural processes underlying delay of gratification usually focus on prefrontal networks related to curbing affective impulses. Here, we provide evidence for an alternative mechanism that facilitates delaying gratification by mental orientation towards the future. Combining continuous theta-burst stimulation (cTBS) with functional neuroimaging, we tested how the right temporoparietal junction (rTPJ) facilitates processing of future events and thereby promotes delay of gratification. Participants performed an intertemporal decision task and a mental time-travel task in the MRI scanner before and after receiving cTBS over the rTPJ or the vertex (control site). rTPJ cTBS led to both stronger temporal discounting for longer delays and reduced processing of future relative to past events in the mental time-travel task. This finding suggests that the rTPJ contributes to the ability to delay gratification by facilitating mental representation of outcomes in the future. On the neural level, rTPJ cTBS led to a reduction in the extent to which connectivity of rTPJ with striatum reflected the value of delayed rewards, indicating a role of rTPJ–striatum connectivity in constructing neural representations of future rewards. Together, our findings provide evidence that the rTPJ is an integral part of a brain network that promotes delay of gratification by facilitating mental orientation to future rewards.

Studies of neural processes underlying delay of gratification usually focus on prefrontal networks related to curbing affective impulses. This study reveals that the right temporo-parietal junction improves patience by shifting attention to future outcomes, strengthening the representations of future reward values in the brain.

Cuing both positive and negative episodic foresight reduces delay discounting but does not affect risk-taking

Humans frequently create mental models of the future, allowing outcomes to be inferred in advance of their occurrence. Recent evidence suggests that imagining positive future events reduces delay discounting (the devaluation of reward with time until its receipt), while imagining negative future events may increase it. Here, using a sample of 297 participants, we experimentally assess the effects of cued episodic simulation of positive and negative future scenarios on decision-making in the context of both delay discounting (monetary choice questionnaire) and risk-taking (balloon-analogue risk task). Participants discounted the future less when cued to imagine positive and negative future scenarios than they did when cued to engage in control neutral imagery. There were no effects of experimental condition on risk-taking. Thus, although these results replicate previous findings suggesting episodic future simulation can reduce delay discounting, they indicate that this effect is not dependent on the valence of the thoughts, and does not generalise to all other forms of “impulsive” decision-making. We discuss various interpretations of these results, and suggest avenues for further research on the role of prospection in decision-making.

Does Intraindividual Variability of Personality States Improve Perspective Taking? An Ecological Approach Integrating Personality and Social Cognition

Research integrating cognitive abilities and personality has focused on the role of personality traits. We propose a theory on the role of intraindividual variability of personality states (hereafter state variability) on perspective taking, in particular, the ability to infer other peoples' mental states. First, we review the relevant research on personality psychology and social cognition. Second, we propose two complementary routes by which state variability relates to anchoring and adjustment in perspective taking. The first route, termed ego-dispersion, suggests that an increased state variability decreases egocentric bias, which reduces anchoring. The second route, termed perspective-pooling, suggests that an increased state variability facilitates efficient adjustment. We also discuss how our theory can be investigated empirically. The theory is rooted in an ecological interpretation of personality and social cognition, and flags new ways for integrating these fields of research.

Neural congruence between intertemporal and interpersonal self-control: Evidence from delay and social discounting

Behavioral studies using delay and social discounting as indices of self-control and altruism, respectively, have revealed functional similarities between farsighted and social decisions. However, neural evidence for this functional link is lacking. Twenty-five young adults completed a delay and social discounting task during fMRI scanning. A spatiotemporal partial least squares analysis revealed that both forms of discounting were well characterized by a pattern of brain activity in areas comprising frontoparietal control, default, and mesolimbic reward networks. Both forms of discounting appear to draw on common neurocognitive mechanisms, regardless of whether choices involve intertemporal or interpersonal outcomes. We also observed neural profiles differentiating between high and low discounters. High discounters were well characterized by increased medial temporal lobe and limbic activity. In contrast, low discount rates were associated with activity in the medial prefrontal cortex and right temporoparietal junction. This pattern may reflect biological mechanisms underlying behavioral heterogeneity in discount rates.

Thinking about others and the future: Neural correlates of perspective taking relate to preferences for delayed rewards

We infer the thoughts and feelings of others by taking their perspectives. Similar processes could be used to understand how we will be affected by future events, by allowing us to take the perspective of our future self. In this paper, we test this idea using a previously presented framework for guiding predictions. The framework proposes that a shared neural mechanism is involved in controlling egocentric bias, both while shifting our perspective away from self and towards others, and while shifting our perspective from immediate to future perspectives. To test this framework, 36 adults performed an intertemporal choice task. They were then scanned using 3T functional magnetic resonance imaging while completing a false-belief “localizer” task, which requires egocentric bias control. A positive correlation was observed between the right temporoparietal junction (rTPJ) response during the false-belief task, and preferences for delayed rewards in intertemporal choices. A subset of participants performed the intertemporal choice task again in the scanner, which revealed that the response of the same rTPJ cluster, individually localized during the false-belief task, was higher during delayed over immediate reward choices. In addition, functional connectivity between the rTPJ and ventromedial prefrontal cortex was found to differ between immediate and delayed choices. The current results indicate an overlap in processes of egocentric bias control and those that determine preferences in intertemporal choices, offering a social cognitive explanation for why rewards are devalued with delay in temporal discounting.

Human pursuance of equality hinges on mental processes of projecting oneself into the perspectives of others and into future situations

In the pursuance of equality, behavioural scientists disagree about distinct motivators, that is, consideration of others and prospective calculation for oneself. However, accumulating data suggest that these motivators may share a common process in the brain whereby perspectives and events that did not arise in the immediate environment are conceived. To examine this, we devised a game imitating a real decision-making situation regarding redistribution among income classes in a welfare state. The neural correlates of redistributive decisions were examined under contrasting conditions, with and without uncertainty, which affects support for equality in society. The dorsal anterior cingulate cortex (dACC) and the caudate nucleus were activated by equality decisions with uncertainty but by selfless decisions without uncertainty. Activation was also correlated with subjective values. Activation in both the dACC and the caudate nucleus was associated with the attitude to prefer accordance with others, whereas activation in the caudate nucleus reflected that the expected reward involved the prospective calculation of relative income. The neural correlates suggest that consideration of others and prospective calculation for oneself may underlie the support for equality. Projecting oneself into the perspective of others and into prospective future situations may underpin the pursuance of equality.

Dissociable Contributions of Imagination and Willpower to the Malleability of Human Patience

The ability to exercise patience is important for human functioning. Although it is known that patience can be promoted by using top-down control, or willpower, to override impatient impulses, patience is also malleable-in particular, susceptible to framing effects-in ways that are difficult to explain using willpower alone. So far, the mechanisms underlying framing effects on patience have been elusive. We investigated the role of imagination in these effects. In a behavioral experiment (Experiment 1), a classic framing manipulation (sequence framing) increased self-reported and independently coded imagination during intertemporal choice. In an investigation of neural responses during decision making (Experiment 2), sequence framing increased the extent to which patience was related to activation in brain regions associated with imagination, relative to activation in regions associated with willpower, and increased functional connectivity of brain regions associated with imagination, but not willpower, relative to regions associated with valuation. Our results suggest that sequence framing can increase the role of imagination in decision making without increasing the exertion of willpower.

Simulating future value in intertemporal choice

The laboratory study of how humans and other animals trade-off value and time has a long and storied history, and is the subject of a vast literature. However, despite a long history of study, there is no agreed upon mechanistic explanation of how intertemporal choice preferences arise. Several theorists have recently proposed model-based reinforcement learning as a candidate framework. This framework describes a suite of algorithms by which a model of the environment, in the form of a state transition function and reward function, can be converted on-line into a decision. The state transition function allows the model-based system to make decisions based on projected future states, while the reward function assigns value to each state, together capturing the necessary components for successful intertemporal choice. Empirical work has also pointed to a possible relationship between increased prospection and reduced discounting. In the current paper, we look for direct evidence of a relationship between temporal discounting and model-based control in a large new data set (n = 168). However, testing the relationship under several different modeling formulations revealed no indication that the two quantities are related.

Prospection and the Present Moment: The Role of Episodic Foresight in Intertemporal Choices between Immediate and Delayed Rewards

Humans are capable of imagining future rewards and the contexts in which they may be obtained. Functionally, intertemporal choices between smaller but immediate and larger but delayed rewards may be made without such episodic foresight. However, we propose that explicit simulations of this sort enable more flexible and adaptive intertemporal decision-making. Emotions triggered through the simulation of future situations can motivate people to forego immediate pleasures in the pursuit of long-term rewards. However, we stress that the most adaptive option need not always be a larger later reward. When the future is anticipated to be uncertain, for instance, it may make sense for preferences to shift toward more immediate rewards, instead. Imagining potential future scenarios and assessment of their likelihood and affective consequences allows humans to determine when it is more adaptive to delay gratification in pursuit of a larger later reward, and when the better strategy is to indulge in a present temptation. We discuss clinical studies that highlight when and how the effect of episodic foresight on intertemporal decision-making can be altered, and consider the relevance of this perspective to understanding the nature of self-control.