Brain activity in valuation regions while thinking about the future predicts individual discount rates

Multivariate analysis of multimodal brain structure predicts individual differences in risk and intertemporal preference

Large changes to brain structure (e.g., from damage or disease) can explain alterations in behavior. It is therefore plausible that smaller structural differences in healthy samples can be used to better understand and predict individual differences in behavior. Despite the brain's multivariate and distributed structure-to-function mapping, most studies have used univariate analyses of individual structural brain measures. Here we used a multivariate approach in a multimodal data set composed of volumetric, surface-based, diffusion-based, and functional resting-state MRI measures to predict reliable individual differences in risk and intertemporal preferences. We show that combining twelve brain structure measures led to better predictions across tasks than using any individual measure, and by examining model coefficients, we visualize the relative contribution of different brain measures from different brain regions. Using a multivariate approach to brain structure-to-function mapping that combines across many brain structure properties, along with reliably measured behavior phenotypes, may increase out-of-sample prediction accuracies and insight into neural underpinnings. Furthermore, this methodological approach may be useful to improve predictions and neural insight across basic, translational, and clinical research fields.

Neurobiological foundations and clinical relevance of effort-based decision-making

Applying effort-based decision-making tasks provides insights into specific variables influencing choice behaviors. The current review summarizes the structural and functional neuroanatomy of effort-based decision-making. Across 39 examined studies, the review highlights the ventromedial prefrontal cortex in forming reward-based predictions, the ventral striatum encoding expected subjective values driven by reward size, the dorsal anterior cingulate cortex for monitoring choices to maximize rewards, and specific motor areas preparing for effort expenditure. Neuromodulation techniques, along with shifting environmental and internal states, are promising novel treatment interventions for altering neural alterations underlying decision-making. Our review further articulates the translational promise of this construct into the development, maintenance and treatment of psychiatric conditions, particularly those characterized by reward-, effort- and valuation-related deficits.

The date/delay effect in intertemporal choice: A combined fMRI and eye-tracking study

Temporal discounting, the tendency to devalue future rewards as a function of delay until receipt, is influenced by time framing. Specifically, discount rates are shallower when the time at which the reward is received is presented as a date (date condition; e.g., June 8, 2023) rather than in delay units (delay condition; e.g., 30 days), which is commonly referred to as the date/delay effect. However, the cognitive and neural mechanisms of this effect are not well understood. Here, we examined the date/delay effect by analysing combined fMRI and eye-tracking data of N = 31 participants completing a temporal discounting task in both a delay and a date condition. The results confirmed the date/delay effect and revealed that the date condition led to higher fixation durations on time attributes and to higher activity in precuneus/PCC and angular gyrus, that is, areas previously associated with episodic thinking. Additionally, participants made more comparative eye movements in the date compared to the delay condition. A lower date/delay effect was associated with higher prefrontal activity in the date > delay contrast, suggesting that higher control or arithmetic operations may reduce the date/delay effect. Our findings are in line with hypotheses positing that the date condition is associated with differential time estimation and the use of more comparative as opposed to integrative choice strategies. Specifically, higher activity in memory-related brain areas suggests that the date condition leads to higher perceived proximity of delayed rewards, while higher frontal activity (middle/superior frontal gyrus, posterior medial frontal cortex, cingulate) in participants with a lower date/delay effect suggests that the effect is particularly pronounced in participants avoiding complex arithmetic operations in the date condition.

Critical tests of fuzzy trace theory in brain and behavior: uncertainty across time, probability, and development

Uncertainty permeates decisions from the trivial to the profound. Integrating brain and behavioral evidence, we discuss how probabilistic (varied outcomes) and temporal (delayed outcomes) uncertainty differ across age and individuals; how critical tests adjudicate between theories of uncertainty (prospect theory and fuzzy-trace theory); and how these mechanisms might be represented in the brain. The same categorical gist representations of gains and losses account for choices and eye-tracking data in both value-allocation (add money to gambles) and risky-choice tasks, disconfirming prospect theory and confirming predictions of fuzzy-trace theory. The analysis is extended to delay discounting and disambiguated choices, explaining hidden-zero effects that similarly turn on categorical distinctions between some gain and no gain, certain gain and uncertain gain, gain and loss, and now and later. Bold activation implicates dorsolateral prefrontal and posterior parietal cortices in gist strategies that are not just one tool in a grab-bag of cognitive options but rather are general strategies that systematically predict behaviors across many different tasks involving probabilistic and temporal uncertainty. High valuation (e.g., ventral striatum; ventromedial prefrontal cortex) and low executive control (e.g., lateral prefrontal cortex) contribute to risky and impatient choices, especially in youth. However, valuation in ventral striatum supports reward-maximizing and gist strategies in adulthood. Indeed, processing becomes less "rational" in the sense of maximizing gains and more noncompensatory (eye movements indicate fewer tradeoffs) as development progresses from adolescence to adulthood, as predicted. Implications for theoretically predicted "public-health paradoxes" are discussed, including gist versus verbatim thinking in drug experimentation and addiction.

Altered delay discounting in neurodegeneration: insight into the underlying mechanisms and perspectives for clinical applications

Steeper delay discounting (i.e., the extent to which future rewards are perceived as less valuable than immediate ones) has been proposed as a transdiagnostic process across different health conditions, in particular psychiatric disorders. Impulsive decision-making is a hallmark of different neurodegenerative conditions but little is known about delay discounting in the domain of neurodegenerative conditions. We reviewed studies on delay discounting in patients with Parkinson's disease (PD) and in patients with dementia (Alzheimer's disease / AD or frontotemporal dementia / FTD). We proposed that delay discounting could be an early marker of the neurodegenerative process. We developed the idea that altered delay discounting is associated with overlapping but distinct neurocognitive mechanisms across neurodegenerative diseases: dopaminergic-related disorders of reward processing in PD, memory/projection deficits due to medial temporal atrophy in AD, modified reward processing due to orbitofrontal atrophy in FTD. Neurodegeneration could provide a framework to decipher the neuropsychological mechanisms of value-based decision-making. Further, delay discounting could become a marker of interest in clinical practice, in particular for differential diagnosis.

An fMRI-Based Brain Marker of Individual Differences in Delay Discounting

Individual differences in delay discounting-how much we discount future compared to immediate rewards-are associated with general life outcomes, psychopathology, and obesity. Here, we use machine learning on fMRI activity during an intertemporal choice task to develop a functional brain marker of these individual differences in human adults. Training and cross-validating the marker in one dataset (Study 1, N = 110 male adults) resulted in a significant prediction-outcome correlation (r = 0.49), generalized to predict individual differences in a completely independent dataset (Study 2: N = 145 male and female adults, r = 0.45), and predicted discounting several weeks later. Out-of-sample responses of the functional brain marker, but not discounting behavior itself, differed significantly between overweight and lean individuals in both studies, and predicted fasting-state blood levels of insulin, c-peptide, and leptin in Study 1. Significant predictive weights of the marker were found in cingulate, insula, and frontoparietal areas, among others, suggesting an interplay among regions associated with valuation, conflict processing, and cognitive control. This new functional brain marker is a step toward a generalizable brain model of individual differences in delay discounting. Future studies can evaluate it as a potential transdiagnostic marker of altered decision-making in different clinical and developmental populations.SIGNIFICANCE STATEMENT People differ substantially in how much they prefer smaller sooner rewards or larger later rewards such as spending money now versus saving it for retirement. These individual differences are generally stable over time and have been related to differences in mental and bodily health. What is their neurobiological basis? We applied machine learning to brain-imaging data to identify a novel brain activity pattern that accurately predicts how much people prefer sooner versus later rewards, and which can be used as a new brain-based measure of intertemporal decision-making in future studies. The resulting functional brain marker also predicts overweight and metabolism-related blood markers, providing new insight into the possible links between metabolism and the cognitive and brain processes involved in intertemporal decision-making.

Intertemporal choice reflects value comparison rather than self-control: insights from confidence judgements

Intertemporal decision-making has long been assumed to measure self-control, with prominent theories treating choices of smaller, sooner rewards as failed attempts to override immediate temptation. If this view is correct, people should be more confident in their intertemporal decisions when they 'successfully' delay gratification than when they do not. In two pre-registered experiments with built-in replication, adult participants (n = 117) made monetary intertemporal choices and rated their confidence in having made the right decisions. Contrary to assumptions of the self-control account, confidence was not higher when participants chose delayed rewards. Rather, participants were more confident in their decisions when possible rewards were further apart in time-discounted subjective value, closer to the present, and larger in magnitude. Demonstrating metacognitive insight, participants were more confident in decisions that better aligned with their separate valuation of possible rewards. Decisions made with less confidence were more prone to changes-of-mind and more susceptible to a patience-enhancing manipulation. Together, our results establish that confidence in intertemporal choice tracks uncertainty in estimating and comparing the value of possible rewards-just as it does in decisions unrelated to self-control. Our findings challenge self-control views and instead cast intertemporal choice as a form of value-based decision-making about future possibilities. This article is part of the theme issue 'Thinking about possibilities: mechanisms, ontogeny, functions and phylogeny'.

Metacognitive deficits are associated with lower sensitivity to preference reversals in nicotine dependence

Deficits in impulse control belong to the core profile of nicotine dependence. Smokers might thus benefit from voluntarily self-restricting their access to the immediate temptation of nicotine products (precommitment) in order to avoid impulse control failures. However, little is known about how smokers' willingness to engage in voluntary self-restrictions is determined by metacognitive insight into their general preferences for immediate over delayed rewards. Here, with a series of monetary intertemporal choice tasks, we provide empirical evidence for reduced metacognitive accuracy in smokers relative to non-smokers and show that smokers overestimate the subjective value of delayed rewards relative to their revealed preferences. In line with the metacognitive deficits, smokers were also less sensitive to the risk of preference reversals when deciding whether or not to restrict their access to short-term financial rewards. Taken together, the current findings suggest that deficits not only in impulse control but also in metacognition may hamper smokers' resistance to immediate rewards and capacity to pursue long-term goals.

A neural signature of the vividness of prospective thought is modulated by temporal proximity during intertemporal decision making

Why do people discount future rewards? Multiple theories in psychology argue that one reason is that future events are imagined less vividly than immediate events, thereby diminishing their perceived value. Here we provide neuroscientific evidence for this proposal. First, we construct a neural signature of the vividness of prospective thought, using an fMRI dataset where the vividness of imagined future events is orthogonal to their valence by design. Then, we apply this neural signature in two additional fMRI datasets, each using a different delay-discounting task, to show that neural measures of vividness decline as rewards are delayed farther into the future.

Individual Differences in Intertemporal Choice

Intertemporal choice involves deciding between smaller, sooner and larger, later rewards. People tend to prefer smaller rewards that are available earlier to larger rewards available later, a phenomenon referred to as temporal or delay discounting. Despite its ubiquity in human and non-human animals, temporal discounting is subject to considerable individual differences. Here, we provide a critical narrative review of this literature and make suggestions for future work. We conclude that temporal discounting is associated with key socio-economic and health-related variables. Regarding personality, large-scale studies have found steeper temporal discounting to be associated with higher levels of self-reported impulsivity and extraversion; however, effect sizes are small. Temporal discounting correlates negatively with future-oriented cognitive styles and inhibitory control, again with small effect sizes. There are consistent associations between steeper temporal discounting and lower intelligence, with effect sizes exceeding those of personality or cognitive variables, although socio-demographic moderator variables may play a role. Neuroimaging evidence of brain structural and functional correlates is not yet consistent, neither with regard to areas nor directions of effects. Finally, following early candidate gene studies, recent Genome Wide Association Study (GWAS) approaches have revealed the molecular genetic architecture of temporal discounting to be more complex than initially thought. Overall, the study of individual differences in temporal discounting is a maturing field that has produced some replicable findings. Effect sizes are small-to-medium, necessitating future hypothesis-driven work that prioritizes large samples with adequate power calculations. More research is also needed regarding the neural origins of individual differences in temporal discounting as well as the mediating neural mechanisms of associations of temporal discounting with personality and cognitive variables.

Frontotemporal Regulation of Subjective Value to Suppress Impulsivity in Intertemporal Choices

Impulsive decisions arise from preferring smaller but sooner rewards compared with larger but later rewards. How neural activity and attention to choice alternatives contribute to reward decisions during temporal discounting is not clear. Here we probed (1) attention to and (2) neural representation of delay and reward information in humans (both sexes) engaged in choices. We studied behavioral and frequency-specific dynamics supporting impulsive decisions on a fine-grained temporal scale using eye tracking and MEG recordings. In one condition, participants had to decide for themselves but pretended to decide for their best friend in a second prosocial condition, which required perspective taking. Hence, conditions varied in the value for themselves versus that pretending to choose for another person. Stronger impulsivity was reliably found across three independent groups for prosocial decisions. Eye tracking revealed a systematic shift of attention from the delay to the reward information and differences in eye tracking between conditions predicted differences in discounting. High-frequency activity (175-250 Hz) distributed over right frontotemporal sensors correlated with delay and reward information in consecutive temporal intervals for high value decisions for oneself but not the friend. Collectively, the results imply that the high-frequency activity recorded over frontotemporal MEG sensors plays a critical role in choice option integration.SIGNIFICANCE STATEMENT Humans face decisions between sooner smaller rewards and larger later rewards daily. An objective benefit of losing weight over a longer time might be devalued in face of ice cream because they prefer currently available options because of insufficiently considering long-term alternatives. The degree of contribution of neural representation and attention to choice alternatives is not clear. We investigated correlates of such decisions in participants deciding for themselves or pretending to choose for a friend. Behaviorally participants discounted less in self-choices compared with the prosocial condition. Eye movement and MEG recordings revealed how participants represent choice options most evident for options with high subjective value. These results advance our understanding of neural mechanisms underlying decision-making in humans.

Associations Between Delay Discounting and Connectivity of the Valuation-control System in Healthy Young Adults

The process of valuation assists in determining if an object or course of action is rewarding. Delay discounting is the observed decay of a rewards' subjective value over time. Encoding the subjective value of rewards across a spectrum has been attributed to brain regions belonging to the valuation and executive control systems. The valuation system (VS) encodes reward value over short and long delays, influencing reinforcement learning and reward representation. The executive control system (ECS) becomes more active as choice difficulty increases, integrating contextual and mnemonic information with salience signals in the modulation of decision-making. Here, we aimed to identify resting-state functional connectivity-based patterns of the VS and ECS correlated with value-setting and delay discounting (outside-scanner paradigm) in a large (n = 992) cohort of healthy young adults from the Human Connectome Project (HCP). Results suggest the VS may be involved in value-setting of small, immediate rewards while the ECS may be involved in value-setting and delay discounting for large and small rewards over a range of delays. We observed magnitude sensitive connections involving the posterior cingulate cortex, time-sensitive connections with the ventromedial and lateral prefrontal cortex while connections involving the posterior parietal cortex appeared both magnitude- and time-sensitive. The ventromedial prefrontal cortex and posterior parietal cortex could act as "comparator" regions, weighing the value of small rewards against large rewards across various delay duration to aid in decision-making.

Dissociable fronto-striatal functional networks predict choice impulsivity

Fronto-striatal structural connectivity is associated with choice impulsivity. Yet, to date, whether distinct fronto-striatal functional coupling associates with impulsive choices are largely unknown. Using seed-based resting-state functional MRI (rsfMRI) combined with multivariate pattern analysis (MVPA), the present study aimed to explore the predictions of dissociable frontal-striatal functional connectivity on choice impulsivity in a relatively large sample (N = 429). Adaptive delay-discounting task was utilized to assess choice impulsivity and the striatum was further divided into three subregions including the nucleus accumbens (NAcc), caudate, and putamen. Results revealed that both the functional coupling between the NAcc and the limbic/dorsolateral prefrontal cortex, and between the caudate and the dorsal prefrontal cortex, including the dorsomedial prefrontal cortex (DMPFC), successfully predicted the delay-discounting rate. However, such pattern was not observed in the putamen-prefrontal functional connectivity. These findings suggest fronto-striatal-dependent neural mechanisms of choice impulsivity and further provide a better understanding of the contributions of striatum subregions and their functional connectivities with different areas of prefrontal cortex upon inter-temporal choice.

Deliberating trade-offs with the future

Many fundamental choices in life are intertemporal: they involve trade-offs between sooner and later outcomes. In recent years there has been a surge of interest into how people make intertemporal decisions, given that such decisions are ubiquitous in everyday life and central in domains from substance use to climate change action. While it is clear that people make decisions according to rules, intuitions and habits, they also commonly deliberate over their options, thinking through potential outcomes and reflecting on their own preferences. In this Perspective, we bring to bear recent research into the higher-order capacities that underpin deliberation-particularly those that enable people to think about the future (prospection) and their own thinking (metacognition)-to shed light on intertemporal decision-making. We show how a greater appreciation for these mechanisms of deliberation promises to advance our understanding of intertemporal decision-making and unify a wide range of otherwise disparate choice phenomena.

Imagining Events Alternative to the Present Can Attenuate Delay Discounting

Previous studies have shown that delay discounting (DD), the tendency to prefer smaller-immediate to larger-delayed rewards, decreases following vivid imagination of future events. Here, we test the hypothesis that imagining complex events alternative to direct (perceptual) experience, whether located in the future, the past, or even the present, would reduce DD. Participants (N = 250) imagined future events (Future condition), remembered past events (Past condition), imagined present events (Present-imagine condition), or reported on the current events (Present-attend condition), and then made a series of intertemporal choices about money and food. Compared to attending to the present, imagining the future reduced DD, but this only held for individuals who claimed vivid pre-experiencing of future events. Importantly, a similar attenuation of DD was found in the Past and Present-imagine conditions, suggesting that a shift in perspective from the perceptual present towards mentally constructed experience can downplay the appraisal of immediate rewards in favor of larger-delayed rewards, regardless of the location of the imagined experience in subjective time.

Dissociable functional activities of cortical theta and beta oscillations in the lateral prefrontal cortex during intertemporal choice

The lateral prefrontal cortex (LPFC) plays an important role in the neural networks involved in intertemporal choice. However, little is known about how the neural oscillation of LPFC functions during intertemporal choice, owing to the technical limitations of functional magnetic resonance imaging and event-related brain potential recordings. Electrocorticography (ECoG) is a novel neuroimaging technique that has high spatial and temporal resolution. In this study, we used ECoG and projected the ECoG data onto individual brain spaces to investigate human intracranial cortex activity and how neural oscillations of the LPFC impact intertemporal choice. We found that neural activity of theta oscillation was significantly higher during impulsive decisions, while beta oscillation activity was significantly higher during non-impulsive ones. Our findings suggest a functional dissociation between cortical theta and beta oscillations during decision-making processes involved in intertemporal choice, and that decision outcomes may be determined by LPFC modulation, which involves neural oscillations at different frequencies.

The effect of state self-control on the intertemporal decisions made by individuals with high and low trait self-control

The present study aimed to explore how state self-control influences the intertemporal decisions made by individuals with high and low trait self-control. State self-control, represented by the degree of depletion, was manipulated by conducting Stroop tasks with different levels of difficulty, and the intertemporal decision task was used as a self-control task. Compared with participants with high trait self-control, the preferences of participants with low trait self-control for immediate rewards were more vulnerable to the difficulty of depletion tasks. Throughout the experimental stages, the heart rate variability (HRV) of participants with high trait self-control was significantly higher than that of participants with low trait self-control, indicating that individuals with high trait self-control may have stronger and more stable self-control abilities.

Diminished Cortical Thickness Is Associated with Impulsive Choice in Adolescence

Adolescence is characterized by both maturation of brain structure and increased risk of negative outcomes from behaviors associated with impulsive decision-making. One important index of impulsive choice is delay discounting (DD), which measures the tendency to prefer smaller rewards available soon over larger rewards delivered after a delay. However, it remains largely unknown how individual differences in structural brain development may be associated with impulsive choice during adolescence. Leveraging a unique large sample of 427 human youths (208 males and 219 females) imaged as part of the Philadelphia Neurodevelopmental Cohort, we examined associations between delay discounting and cortical thickness within structural covariance networks. These structural networks were derived using non-negative matrix factorization, an advanced multivariate technique for dimensionality reduction, and analyzed using generalized additive models with penalized splines to capture both linear and nonlinear developmental effects. We found that impulsive choice, as measured by greater discounting, was most strongly associated with diminished cortical thickness in structural brain networks that encompassed the ventromedial prefrontal cortex, orbitofrontal cortex, temporal pole, and temporoparietal junction. Furthermore, structural brain networks predicted DD above and beyond cognitive performance. Together, these results suggest that reduced cortical thickness in regions known to be involved in value-based decision-making is a marker of impulsive choice during the critical period of adolescence.SIGNIFICANCE STATEMENT Risky behaviors during adolescence, such as initiation of substance use or reckless driving, are a major source of morbidity and mortality. In this study, we present evidence from a large sample of youths that diminished cortical thickness in specific structural brain networks is associated with impulsive choice. Notably, the strongest association between impulsive choice and brain structure was seen in regions implicated in value-based decision-making; namely, the ventromedial prefrontal and orbitofrontal cortices. Moving forward, such neuroanatomical markers of impulsivity may aid in the development of personalized interventions targeted to reduce risk of negative outcomes resulting from impulsivity during adolescence.

The effect of future time perspective on delay discounting is mediated by the gray matter volume of vmPFC

Although several previous studies have shown that individuals' attitude towards time could affect their intertemporal preference, little is known about the neural basis of the relation between time perspective (TP) and delay discounting. In the present study, we quantified the gray matter (GM) cortical volume using voxel-based morphometry (VBM) methods to investigate the effect of TP on delay discounting (DD) across two independent samples. For group 1 (102 healthy college students; 46 male; 20.40 ± 1.87 years), behavioral results showed that only Future TP was a significant predictor of DD, and higher scores on Future TP were related to lower discounting rates. Whole-brain analysis revealed that steeper discounting correlated with greater GM volume in the ventromedial prefrontal cortex (vmPFC) and ventral part of posterior cingulate cortex (vPCC). Also, GM volume of a cluster in the vmPFC was correlated with Future TP. Interestingly, there was an overlapping region in vmPFC that was correlated with both DD and Future TP. Region-of-interest analysis further indicated that the overlapping region of vmPFC played a partially mediating role in the relation between Future TP and DD in the other independent dataset (Group 2, 36 healthy college students; 14 male; 20.18±1.80 years). Taken together, our results provide a new perspective from neural basis for explaining the relation between DD and future TP.

Dissociable Contributions of Imagination and Willpower to the Malleability of Human Patience

The ability to exercise patience is important for human functioning. Although it is known that patience can be promoted by using top-down control, or willpower, to override impatient impulses, patience is also malleable-in particular, susceptible to framing effects-in ways that are difficult to explain using willpower alone. So far, the mechanisms underlying framing effects on patience have been elusive. We investigated the role of imagination in these effects. In a behavioral experiment (Experiment 1), a classic framing manipulation (sequence framing) increased self-reported and independently coded imagination during intertemporal choice. In an investigation of neural responses during decision making (Experiment 2), sequence framing increased the extent to which patience was related to activation in brain regions associated with imagination, relative to activation in regions associated with willpower, and increased functional connectivity of brain regions associated with imagination, but not willpower, relative to regions associated with valuation. Our results suggest that sequence framing can increase the role of imagination in decision making without increasing the exertion of willpower.

Can you change my preferences? Effect of social influence on intertemporal choice behavior

The present study presents a novel social observation paradigm to examine whether temporal discounting (TD) can be modulated in a specific direction. In particular, after estimating a baseline discount rate, we exposed subjects to a pattern of choice that was opposite to their baseline preferences, i.e., subjects preferring immediate over delayed rewards were exposed to a farsighted pattern of behavior and vice-versa. The results showed a significant decrease of the discount rate in the discounter group and an increase in the farsighted group. The effect was mainly guided by a modification of the subjective values at short time delays and was stronger in subjects with extreme, compared to mild, baseline preferences. Importantly, the magnitude and direction of the effect predicted the baseline preferences. These findings have potentially very relevant implications for the prevention and treatment of clinical conditions, such as addition-related disorders, characterized by severe impairments of decision-making mechanisms.

The Vivid Present: Visualization Abilities Are Associated with Steep Discounting of Future Rewards

Humans and other animals discount the value of future rewards, a phenomenon known as delay discounting. Individuals vary widely in the extent to which they discount future rewards, and these tendencies have been associated with important life outcomes. Recent studies have demonstrated that imagining the future reduces subsequent discounting behavior, but no research to date has examined whether a similar principle applies at the trait level, and whether training visualization changes discounting. The current study examined if individual differences in visualization abilities are linked to individual differences in discounting and whether practicing visualization can change discounting behaviors in a lasting way. Participants (n = 48) completed the Vividness of Visual Imagery Questionnaire (VVIQ) and delay discounting task and then underwent a 4-week intervention consisting of visualization training (intervention) or relaxation training (control). Contrary to our hypotheses, participants who reported greater visualization abilities (lower scores) on the VVIQ were higher discounters. To further examine this relationship, an additional 106 participants completed the VVIQ and delay discounting task. In the total sample (n = 154), there was a significant negative correlation between VVIQ scores and discount rates, showing that individuals who are better visualizers are also higher discounters. Consistent with this relationship but again to our surprise, visualization training tended, albeit weakly, to increase discount rates, and those whose VVIQ decreased the most were those whose discount rates increased the most. These results suggest a novel association between visualization abilities and delay discounting.

The neural basis of impulsive discounting in pathological gamblers

Pathological gambling is thought to result from a shift of balance between two competing neurobiological mechanisms: on the one hand the reward system involved in the regulation of the urge to get rewards and on the other hand the top-down control system. Fifteen pathological gamblers (PG) and fifteen healthy controls (HC) were studied in an event-related functional magnetic resonance imaging experiment where participants had to choose either a smaller, but immediately available monetary reward (SIR) or a larger delayed reward (LDR). We examined contrasts between LDR and SIR decisions. Additionally, we contrasted choices near the individual indifference point (indifferent decisions) and clear SIR or LDR choices (sure decisions). Behavioral data confirmed former results of steeper discount rates in PG. Contrasting choices of LDR vs. SIR showed widespread bilateral activations in PG, including postcentral gyrus, thalamus, superior/medial frontal gyrus and cingulate gyrus, whereas HC demonstrated only focal left-sided pre/postcentral activity. Forgoing an immediate reward thus recruits a widespread brain network including typical control areas. Indifferent vs. sure decisions were associated with widespread activation in PG, including the bilateral fronto-parietal cortex, insula, anterior cingulate gyrus, and striatum, whereas in HC, only bilateral frontal cortex and insula were activated. The reverse contrast demonstrated more activity for sure decisions in the cingulate gyrus, insula, and medial frontal gyrus in HC, whereas PG showed inferior parietal and superior temporal activity. The present study demonstrates that pathological gambling is associated with a shift in the interplay between a prefrontal-parietal control network and a brain network involved in immediate reward consumption.

Enhanced Neural Responses to Imagined Primary Rewards Predict Reduced Monetary Temporal Discounting

The pervasive tendency to discount the value of future rewards varies considerably across individuals and has important implications for health and well-being. Here, we used fMRI with human participants to examine whether an individual's neural representation of an imagined primary reward predicts the degree to which the value of delayed monetary payments is discounted. Because future rewards can never be experienced at the time of choice, imagining or simulating the benefits of a future reward may play a critical role in decisions between alternatives with either immediate or delayed benefits. We found that enhanced ventromedial prefrontal cortex response during imagined primary reward receipt was correlated with reduced discounting in a separate monetary intertemporal choice task. Furthermore, activity in enhanced ventromedial prefrontal cortex during reward imagination predicted temporal discounting behavior both between- and within-individual decision makers with 62% and 73% mean balanced accuracy, respectively. These results suggest that the quality of reward imagination may impact the degree to which future outcomes are discounted. Significance statement: We report a novel test of the hypothesis that an important factor influencing the discount rate for future rewards is the quality with which they are imagined or estimated in the present. Previous work has shown that temporal discounting is linked to individual characteristics ranging from general intelligence to the propensity for addiction. We demonstrate that individual differences in a neurobiological measure of primary reward imagination are significantly correlated with discounting rates for future monetary payments. Moreover, our neurobiological measure of imagination can be used to accurately predict choice behavior both between and within individuals. These results suggest that improving reward imagination may be a useful therapeutic target for individuals whose high discount rates promote detrimental behaviors.

Incidental rewarding cues influence economic decisions in people with obesity

Recent research suggests that obesity is linked to prominent alterations in learning and decision-making. This general difference may also underlie the preference for immediately consumable, highly palatable but unhealthy and high-calorie foods. Such poor food-related inter-temporal decision-making can explain weight gain; however, it is not yet clear whether this deficit can be generalized to other domains of inter-temporal decision-making, for example financial decisions. Further, little is known about the stability of decision-making behavior in obesity, especially in the presence of rewarding cues. To answer these questions, obese and lean participants (n = 52) completed two sessions of a novel priming paradigm including a computerized monetary delay discounting task. In the first session, general differences between groups in financial delay discounting were measured. In the second session, we tested the general stability of discount rates. Additionally, participants were primed by affective visual cues of different contextual categories before making financial decisions. We found that the obese group showed stronger discounting of future monetary rewards than the lean group, but groups did not differ in their general stability between sessions nor in their sensitivity toward changes in reward magnitude. In the obese group, a fast decrease of subjective value over time was directly related to a higher tendency for opportunistic eating. Obese in contrast to lean people were primed by the affective cues, showing a sex-specific pattern of priming direction. Our findings demonstrate that environments rich of cues, aiming at inducing unhealthy consumer decisions, can be highly detrimental for obese people. It also underscores that obesity is not merely a medical condition but has a strong cognitive component, meaning that current dietary and medical treatment strategies may fall too short.

The Malleability of Intertemporal Choice

Intertemporal choices are ubiquitous: people often have to choose between outcomes realized at different times. Although it is generally believed that people have stable tendencies toward being impulsive or patient, an emerging body of evidence indicates that intertemporal choice is malleable and can be profoundly influenced by context. How the choice is framed, or the state of the decision-maker at the time of choice, can induce a shift in preference. Framing effects are underpinned by allocation of attention to choice attributes, reference dependence, and time construal. Incidental affective states and prospection also influence intertemporal choice. We advocate that intertemporal choice models account for these context effects, and encourage the use of this knowledge to nudge people toward making more advantageous choices.

Sex differences in time perception during smoking abstinence

INTRODUCTION

Nicotine withdrawal leads to impulsive decision-making, which reflects a preference for smaller, immediate rewards and often prompts a relapse to smoking. The mechanism by which nicotine withdrawal leads to impulsive decision-making is not well known. An essential dimension of decision-making is time perception. Impulsive decisions reflect intolerance of temporal delays and the perception that time is passing more slowly. Sex may be an important factor in impulsive decision-making and time perception, but no studies have investigated whether sex moderates the effects of nicotine withdrawal on impulsive decision-making and time perception.

METHODS

Thirty-three (12 female) adult smokers completed 2 laboratory sessions: following 24-hr abstinence and once smoking-as-usual (order counterbalanced, abstinence biochemically verified). Participants completed 2 time perception tasks, a decision-making task, and self-report measures of craving, withdrawal, and mood.

RESULTS

During time reproduction, males overestimated time during abstinence compared to smoking, whereas there was no session effect for females. On the time discrimination task, smokers were less accurate during abstinence, and this effect tended to be stronger among females. In general, males had higher discounting rates compared with females, but there was no effect of abstinence.

CONCLUSIONS

The current data suggest that the effect of abstinence on time perception may be stronger in males and that males generally exhibit steeper delay discounting rates. Time perception may be an important mechanism in smoking abstinence. Our future work will investigate the role of time perception in smoking relapse and whether this is moderated by sex.

Adult neurogenesis in humans- common and unique traits in mammals

New neurons generated in the adult brain have been shown in rodents to mediate specific functions, including neural plasticity. This Essay discusses recent work on human adult neurogenesis, examining how it compares to that in other mammals.

New neurons are continuously generated in specific regions in the adult brain. Studies in rodents have demonstrated that adult-born neurons have specific functional features and mediate neural plasticity. Data on the extent and dynamics of adult neurogenesis in adult humans are starting to emerge, and there are clear similarities and differences compared to other mammals. Why do these differences arise? And what do they mean?

Mechanisms of Individual Differences in Impulsive and Risky Choice in Rats

Individual differences in impulsive and risky choice are key risk factors for a variety of maladaptive behaviors such as drug abuse, gambling, and obesity. In our rat model, ordered individual differences are stable across choice parameters, months of testing, and span a broad spectrum, suggesting that rats, like humans, exhibit trait-level impulsive and risky choice behaviors. In addition, impulsive and risky choices are highly correlated, suggesting a degree of correlation between these two traits. An examination of the underlying cognitive mechanisms has suggested an important role for timing processes in impulsive choice. In addition, in an examination of genetic factors in impulsive choice, the Lewis rat strain emerged as a possible animal model for studying disordered impulsive choice, with this strain demonstrating deficient delay processing. Early rearing environment also affected impulsive behaviors, with rearing in an enriched environment promoting adaptable and more self-controlled choices. The combined results with impulsive choice suggest an important role for timing and reward sensitivity in moderating impulsive behaviors. Relative reward valuation also affects risky choice, with manipulation of objective reward value (relative to an alternative reference point) resulting in loss chasing behaviors that predicted overall risky choice behaviors. The combined results are discussed in relation to domain-specific versus domain-general subjective reward valuation processes and the potential neural substrates of impulsive and risky choice.

Distributed value representation in the medial prefrontal cortex during intertemporal choices

The ability to resist current temptations in favor of long-term benefits is a critical human capacity. Despite the extensive studies on the neural mechanisms of intertemporal choices, how the subjective value of immediate and delayed rewards is represented and compared in the brain remains to be elucidated. The present fMRI study addressed this question by simultaneously and independently manipulating the magnitude of immediate and delayed rewards in an intertemporal decision task, combined with univariate analysis and multiple voxel pattern analysis. We found that activities in the posterior portion of the dorsal medial prefrontal cortex (DmPFC) were modulated by the value of immediate options, whereas activities in the adjacent anterior DmPFC were modulated by the subjective value of delayed options. Brain signal change in the ventral mPFC was positively correlated with the "relative value" (the absolute difference of subjective value between two intertemporal alternatives). In contrast, the dorsal anterior cingulate cortex activity was negatively correlated with the relative value. These results suggest that immediate and delayed rewards are separately represented in the dorsal mPFC and compared in the ventral mPFC to guide decisions. The functional dissociation of posterior and anterior DmPFC in representing immediate and delayed reward is consistent with the general structural and functional architecture of the prefrontal cortex and may provide a neural basis for human's unique capacity to delayed gratification.

What are the essential cognitive requirements for prospection (thinking about the future)?

Placing the future center stage as a way of understanding cognition is gaining attention in psychology. The general modern label for this is "prospection" which refers to the process of representing and thinking about possible future states of the world. Several theorists have claimed that episodic and prospective memory, as well as hypothetical thinking (mental simulation) and conditional reasoning are necessary cognitive faculties that enable prospection. Given the limitations in current empirical efforts connecting these faculties to prospection, the aim of this mini review is to argue that the findings show that they are sufficient, but not necessary for prospection. As a result, the short concluding section gives an outline of an alternative conceptualization of prospection. The proposal is that the critical characteristics of prospection are the discovery of, and maintenance of goals via causal learning.

Mechanisms of impulsive choice: I. Individual differences in interval timing and reward processing

Impulsive choice behavior incorporates the psychological mechanisms involved in the processing of the anticipated magnitude and delay until reward. The goal of the present experiment was to determine whether individual differences in such processes related to individual differences in impulsive choice behavior. Two groups of rats (Delay Group and Magnitude Group) were initially exposed to an impulsive choice task with choices between smaller-sooner (SS) and larger-later (LL) rewards. The Delay Group was subsequently exposed to a temporal discrimination task followed by a progressive interval task, whereas the Magnitude Group was exposed to a reward magnitude sensitivity task followed by a progressive ratio task. Intertask correlations revealed that the rats in the Delay Group that made more self-controlled (LL) choices also displayed lower standard deviations in the temporal bisection task and greater delay tolerance in the progressive interval task. Impulsive choice behavior in the Magnitude Group did not display any substantial correlations with the reward magnitude sensitivity and progressive ratio tasks. The results indicate the importance of core timing processes in impulsive choice behavior, and encourage further research examining the effects of changes in core timing processes on impulsive choice.

What are the essential cognitive requirements for prospection (thinking about the future)?

Placing the future center stage as a way of understanding cognition is gaining attention in psychology. The general modern label for this is “prospection” which refers to the process of representing and thinking about possible future states of the world. Several theorists have claimed that episodic and prospective memory, as well as hypothetical thinking (mental simulation) and conditional reasoning are necessary cognitive faculties that enable prospection. Given the limitations in current empirical efforts connecting these faculties to prospection, the aim of this mini review is to argue that the findings show that they are sufficient, but not necessary for prospection. As a result, the short concluding section gives an outline of an alternative conceptualization of prospection. The proposal is that the critical characteristics of prospection are the discovery of, and maintenance of goals via causal learning.