Time, self, and intertemporal choice

Revealing human sensitivity to a latent temporal structure of changes

Precisely timed behavior and accurate time perception plays a critical role in our everyday lives, as our wellbeing and even survival can depend on well-timed decisions. Although the temporal structure of the world around us is essential for human decision making, we know surprisingly little about how representation of temporal structure of our everyday environment impacts decision making. How does the representation of temporal structure affect our ability to generate well-timed decisions? Here we address this question by using a well-established dynamic probabilistic learning task. Using computational modeling, we found that human subjects' beliefs about temporal structure are reflected in their choices to either exploit their current knowledge or to explore novel options. The model-based analysis illustrates a large within-group and within-subject heterogeneity. To explain these results, we propose a normative model for how temporal structure is used in decision making, based on the semi-Markov formalism in the active inference framework. We discuss potential key applications of the presented approach to the fields of cognitive phenotyping and computational psychiatry.

A Model Guided Approach to Evoke Homogeneous Behavior During Temporal Reward and Loss Discounting

Background

The tendency to devaluate future options as a function of time, known as delay discounting, is associated with various factors such as psychiatric illness and personality. Under identical experimental conditions, individuals may therefore strongly differ in the degree to which they discount future options. In delay discounting tasks, this inter-individual variability inevitably results in an unequal number of discounted trials per subject, generating difficulties in linking delay discounting to psychophysiological and neural correlates. Many studies have therefore focused on assessing delay discounting adaptively. Here, we extend these approaches by developing an adaptive paradigm which aims at inducing more comparable and homogeneous discounting frequencies across participants on a dimensional scale.

Method

The proposed approach probabilistically links a (common) discounting function to behavior to obtain a probabilistic model, and then exploits the model to obtain a formal condition which defines how to construe experimental trials so as to induce any desired discounting probability. We first infer subject-level models on behavior on a non-adaptive delay discounting task and then use these models to generate adaptive trials designed to evoke graded relative discounting frequencies of 0.3, 0.5, and 0.7 in each participant. We further compare and evaluate common models in the field through out-of-sample prediction error estimates, to iteratively improve the trial-generating model and paradigm.

Results

The developed paradigm successfully increases discounting behavior during both reward and loss discounting. Moreover, it evokes graded relative choice frequencies in line with model-based expectations (i.e., 0.3, 0.5, and 0.7) suggesting that we can successfully homogenize behavior. Our model comparison analyses indicate that hyperboloid models are superior in predicting unseen discounting behavior to more conventional hyperbolic and exponential models. We report out-of-sample error estimates as well as commonalities and differences between reward and loss discounting, demonstrating for instance lower discounting rates, as well as differences in delay perception in loss discounting.

Conclusion

The present work proposes a model-based framework to evoke graded responses linked to cognitive function at a single subject level. Such a framework may be used in the future to measure cognitive functions on a dimensional rather than dichotomous scale.

Quantifying the contribution of individual variation in timing to delay-discounting

Delay-discounting studies in neuroscience, psychology, and economics have been mostly focused on concepts of self-control, reward evaluation, and discounting. Another important relationship to consider is the link between intertemporal choice and time perception. We presented 50 college students with timing tasks on the range of seconds to minutes and intertemporal-choice tasks on both the time-scale of seconds and of days. We hypothesized that individual differences in time perception would influence decisions about short experienced delays but not long delays. While we found some evidence that individual differences in internal clock speed account for some unexplained variance between choices across time-horizons, overall our findings suggest a nominal contribution of the altered sense of time in intertemporal choice.

Sex differences in time perception during smoking abstinence

INTRODUCTION

Nicotine withdrawal leads to impulsive decision-making, which reflects a preference for smaller, immediate rewards and often prompts a relapse to smoking. The mechanism by which nicotine withdrawal leads to impulsive decision-making is not well known. An essential dimension of decision-making is time perception. Impulsive decisions reflect intolerance of temporal delays and the perception that time is passing more slowly. Sex may be an important factor in impulsive decision-making and time perception, but no studies have investigated whether sex moderates the effects of nicotine withdrawal on impulsive decision-making and time perception.

METHODS

Thirty-three (12 female) adult smokers completed 2 laboratory sessions: following 24-hr abstinence and once smoking-as-usual (order counterbalanced, abstinence biochemically verified). Participants completed 2 time perception tasks, a decision-making task, and self-report measures of craving, withdrawal, and mood.

RESULTS

During time reproduction, males overestimated time during abstinence compared to smoking, whereas there was no session effect for females. On the time discrimination task, smokers were less accurate during abstinence, and this effect tended to be stronger among females. In general, males had higher discounting rates compared with females, but there was no effect of abstinence.

CONCLUSIONS

The current data suggest that the effect of abstinence on time perception may be stronger in males and that males generally exhibit steeper delay discounting rates. Time perception may be an important mechanism in smoking abstinence. Our future work will investigate the role of time perception in smoking relapse and whether this is moderated by sex.

Myopic decisions under negative emotions correlate with altered time perception

Previous studies have obtained inconsistent findings about emotional influence on inter-temporal choice (IC). In the present study, we first examined the effect of temporary emotional priming induced by affective pictures in a trial-to-trial paradigm on IC. The results showed that negative priming resulted in much higher percentages of trials during which smaller-but-sooner reward (SS%) were chosen compared with positive and neutral priming. Next, we attempted to explore the possible mechanisms underlying such emotional effects. When participants performed a time reproduction task, mean reaction times in negative priming condition were significantly shorter than those in the other two emotional contexts, which indicated that negative emotional priming led to overestimation of time. Moreover, such overestimation was negatively correlated with performance in the IC task. In contrast, temporary changes of emotional contexts did not alter performances in a Go/NoGo task (including commission errors and omission errors). In sum, our present findings suggested that myopic decisions under negative emotions were associated with altered time perception but not response inhibition.

Mechanisms of Individual Differences in Impulsive and Risky Choice in Rats

Individual differences in impulsive and risky choice are key risk factors for a variety of maladaptive behaviors such as drug abuse, gambling, and obesity. In our rat model, ordered individual differences are stable across choice parameters, months of testing, and span a broad spectrum, suggesting that rats, like humans, exhibit trait-level impulsive and risky choice behaviors. In addition, impulsive and risky choices are highly correlated, suggesting a degree of correlation between these two traits. An examination of the underlying cognitive mechanisms has suggested an important role for timing processes in impulsive choice. In addition, in an examination of genetic factors in impulsive choice, the Lewis rat strain emerged as a possible animal model for studying disordered impulsive choice, with this strain demonstrating deficient delay processing. Early rearing environment also affected impulsive behaviors, with rearing in an enriched environment promoting adaptable and more self-controlled choices. The combined results with impulsive choice suggest an important role for timing and reward sensitivity in moderating impulsive behaviors. Relative reward valuation also affects risky choice, with manipulation of objective reward value (relative to an alternative reference point) resulting in loss chasing behaviors that predicted overall risky choice behaviors. The combined results are discussed in relation to domain-specific versus domain-general subjective reward valuation processes and the potential neural substrates of impulsive and risky choice.