Temporal discounting in choice between delayed rewards: the role of age and income

Monetary incentives to reinforce engagement and achievement in a job-skills training program for homeless, unemployed adults

The current study examined whether monetary incentives could increase engagement and achievement in a job-skills training program for unemployed, homeless, alcohol-dependent adults. Participants (n=124) were randomized to a no-reinforcement group (n=39), during which access to the training program was provided but no incentives were given; a training reinforcement group (n=42), during which incentives were contingent on attendance and performance; or an abstinence and training reinforcement group (n=43), during which incentives were contingent on attendance and performance, but access was granted only if participants demonstrated abstinence from alcohol. abstinence and training reinforcement and training reinforcement participants advanced further in training and attended more hours than no-reinforcement participants. Monetary incentives were effective in promoting engagement and achievement in a job-skills training program for individuals who often do not take advantage of training programs.

What is the subjective cost of cognitive effort? Load, trait, and aging effects revealed by economic preference

It has long been assumed that people treat cognitive effort as costly, but also that such effort costs may vary greatly across individuals. Individual differences in subjective effort could present a major and pervasive confound in behavioral and neuroscience assessments, by conflating cognitive ability with cognitive motivation. Self-report cognitive effort scales have been developed, but objective measures are lacking. In this study, we use the behavioral economic approach of revealed preferences to quantify subjective effort. Specifically, we adapted a well-established discounting paradigm to measure the extent to which cognitive effort causes participants to discount monetary rewards. The resulting metrics are sensitive to both within-individual factors, including objective load and reward amount, and between-individual factors, including age and trait cognitive engagement. We further validate cognitive effort discounting by benchmarking it against well-established measures of delay discounting. The results highlight the promise and utility of behavioral economic tools for assessing trait and state influences on cognitive motivation.

An fMRI investigation of delay discounting in patients with schizophrenia

Schizophrenia (SZ) is associated with a reduced ability to set meaningful goals to reach desired outcomes. The delay-discounting (DD) task, in which one chooses between sooner smaller and later larger rewards, has proven useful in revealing executive function and reward deficits in various clinical groups. We used fMRI in patients with SZ and healthy controls (HC) to compare brain activation during performance of a DD task. Prior to the neuroimaging session, we obtained each participant's rate of DD, k, on a DD task and used it to select a version of the DD task for each participant's fMRI session. Because of the importance of comparing fMRI results from groups matched on performance, we used a criterion value of R (2) > 0.60 for response consistency on the DD task to analyze fMRI activation to DD task versus control trials from consistent SZ (n = 14) and consistent HC (n = 14). We also compared activation between the groups on contrasts related to trial difficulty. Finally, we contrasted the inconsistent SZ (n = 9) with the consistent HC and consistent SZ; these results should be interpreted with caution because of inconsistent SZ's aberrant performance on the task. Compared with consistent HC, consistent SZ showed reduced activation to DD task versus control trials in executive function and reward areas. In contrast, consistent SZ showed more activation in the precuneus and posterior cingulate, regions of the default mode network (DMN) that are typically deactivated during tasks, and in the insula, a region linked to emotional processing. Furthermore, consistent SZ had abnormal activation of lateral and medial frontal regions in relation to trial difficulty. These results point to disruption of several neural networks during decision making, including the executive, reward, default mode, and emotional networks, and suggest processes that are impaired during decision making in schizophrenia.

Temporal Discounting Is Associated with an Increased Risk of Mortality among Community-Based Older Persons without Dementia

Background

Temporal discounting is an important determinant of many health and financial outcomes, but we are not aware of studies that have examined the association of temporal discounting with mortality.

Methods

Participants were 406 older persons without dementia from the Rush Memory and Aging Project, a longitudinal cohort study of aging. Temporal discounting was measured using standard preference elicitation questions. Individual discount rates were estimated using a well-established hyperbolic function and used to predict the risk of mortality during up to 5 years of follow-up.

Results

The mean estimate of discounting was 0.45 (SD = 0.33, range: 0.08–0.90), with higher scores indicating a greater propensity to prefer smaller immediate rewards over larger but delayed ones. During up to 5 years of follow-up (mean = 3.6 years), 62 (15% of 406) persons died. In a proportional hazards model adjusted for age, sex, and education, temporal discounting was associated with an increased risk of mortality (HR = 1.103, 95% CI 1.024, 1.190, p = 0.010). Thus, a person with the highest discount rate (score = 0.90) was about twice more likely to die over the study period compared to a person with the lowest discount rate (score = 0.08). Further, the association of discounting with mortality persisted after adjustment for the level of global cognitive function, the burden of vascular risk factors and diseases, and an indicator of psychological well being (i.e., purpose in life).

Conclusion

Temporal discounting is associated with an increased risk of mortality in old age after accounting for global cognitive function and indicators of physical and mental health.

Effects of mindful eating training on delay and probability discounting for food and money in obese and healthy-weight individuals

Obese individuals tend to behave more impulsively than healthy weight individuals across a variety of measures, but it is unclear whether this pattern can be altered. The present study examined the effects of a mindful eating behavioral strategy on impulsive and risky choice patterns for hypothetical food and money. In Experiment 1, 304 participants completed computerized delay and probability discounting tasks for food-related and monetary outcomes. High percent body fat (PBF) predicted more impulsive choice for food, but not small-value money, replicating previous work. In Experiment 2, 102 randomly selected participants from Experiment 1 were assigned to participate in a 50-min workshop on mindful eating or to watch an educational video. They then completed the discounting tasks again. Participants who completed the mindful eating session showed more self-controlled and less risk-averse discounting patterns for food compared to baseline; those in the control condition discounted similarly to baseline rates. There were no changes in discounting for money for either group, suggesting stimulus specificity for food for the mindful eating condition.

Fuzzy trace theory and medical decisions by minors: differences in reasoning between adolescents and adults

Standard models of adolescent risk taking posit that the cognitive abilities of adolescents and adults are equivalent, and that increases in risk taking that occur during adolescence are the result of socio emotional differences in impulsivity, sensation seeking, and lack of self-control. Fuzzy-trace theory incorporates these socio emotional differences. However, it predicts that there are also cognitive differences between adolescents and adults, specifically that there are developmental increases in gist-based intuition that reflects understanding. Gist understanding, as opposed to verbatim-based analysis, generally has been hypothesized to have a protective effect on risk taking in adolescence. Gist understanding is also an essential element of informed consent regarding risks in medical decision- making. Evidence thus supports the argument that adolescents' status as mature minors should be treated as an exception rather than a presumption, because accuracy in verbatim analysis is not mature gist understanding. Use of the exception should be accompanied by medical experts' input on the bottom-line gist of risks involved in treatment.

Hungry pigeons make suboptimal choices, less hungry pigeons do not

Hungry animals will often choose suboptimally by being attracted to reliable signals for food that occur infrequently (they gamble) over less reliable signals for food that occur more often. That is, pigeons prefer an option that 50 % of the time provides them with a reliable signal for the appearance of food but 50 % of the time provides them with a reliable signal for the absence of food (overall 50 % reinforcement) over an alternative that always provides them with a signal for the appearance of food 75 % of the time (overall 75 % reinforcement). The pigeons appear to choose impulsively for the possibility of obtaining the reliable signal for reinforcement. There is evidence that greater hunger is associated with greater impulsivity. We tested the hypothesis that if the pigeons were less hungry, they would be less impulsive and, thus, would choose more optimally (i.e., on the basis of the overall probability of reinforcement). We found that hungry pigeons choose the 50 % reinforcement alternative suboptimally but less hungry pigeons prefer the more optimal 75 % reinforcement. Paradoxically, pigeons that needed the food more received less of it. These findings have implications for how level of motivation may also affect human suboptimal choice (e.g., purchase of lottery tickets and playing slot machines).

Changing delay discounting in the light of the competing neurobehavioral decision systems theory: a review

Excessively devaluing delayed reinforcers co-occurs with a wide variety of clinical conditions such as drug dependence, obesity, and excessive gambling. If excessive delay discounting is a trans-disease process that underlies the choice behavior leading to these and other negative health conditions, efforts to change an individual's discount rate are arguably important. Although discount rate is often regarded as a relatively stable trait, descriptions of interventions and environmental manipulations that successfully alter discount rate have begun to appear in the literature. In this review, we compare published examples of procedures that change discount rate and classify them into categories of procedures, including therapeutic interventions, direct manipulation of the executive decision-making system, framing effects, physiological state effects, and acute drug effects. These changes in discount rate are interpreted from the perspective of the competing neurobehavioral decision systems theory, which describes a combination of neurological and behavioral processes that account for delay discounting. We also suggest future directions that researchers could take to identify the mechanistic processes that allow for changes in discount rate and to test whether the competing neurobehavioral decision systems view of delay discounting is correct.

Assessing latent effects of prenatal cocaine exposure on growth and risk of cardiometabolic disease in late adolescence: design and methods

Prenatal cocaine exposure has been linked to neurocognitive and developmental outcomes throughout childhood. The cardiovascular toxicity of cocaine is also markedly increased in pregnancy, but it is unknown whether this toxicity affects anthropometric growth and the development of cardiometabolic disease risk factors in the offspring across the lifespan. During the early 1990s, the Miami Prenatal Cocaine Study enrolled a cohort of 476 African American children (253 cocaine-exposed, 223 non-cocaine-exposed) and their biological mothers at delivery in a prospective, longitudinal study. The MPCS has collected 12 prior waves of multidomain data on over 400 infants and their mothers/alternate caregivers through mid-adolescence and is now embarking on an additional wave of data collection at ages 18-19 years. We describe here the analytical methods for examining the relationship between prenatal cocaine exposure, anthropometric growth, and cardiometabolic disease risk factors in late adolescence in this minority, urban cohort. Findings from this investigation should inform both the fields of substance use and cardiovascular research about subsequent risks of cocaine ingestion during pregnancy in offspring.

Normal aging alters learning and attention-related teaching signals in basolateral amygdala

Normal aging has been associated with an increased propensity to wait for rewards. When this is tested experimentally, rewards are typically offered at increasing delays. In this setting, persistent responding for delayed rewards in aged rats could reflect either changes in the evaluation of delayed rewards or diminished learning, perhaps due to the loss of subcortical teaching signals induced by changes in reward; the loss or diminution of such teaching signals would result in slower learning with progressive delay of reward, which would appear as persistent responding. Such teaching signals have commonly been reported in phasic firing of midbrain dopamine neurons; however, similar signals have also been found in reward-responsive neurons in the basolateral amygdala (ABL). Unlike dopaminergic teaching signals, those in ABL seem to reflect surprise, increasing when reward is either better or worse than expected. Accordingly, activity is correlated with attentional responses and with the speed of learning after surprising increases or decreases in reward. Here we examined whether these attention-related teaching signals might be altered in normal aging. Young (3-6 months) and aged (22-26 months) male Long-Evans rats were trained on a discounting task used previously to demonstrate these signals. As expected, aged rats were less sensitive to delays, and this change was associated with a loss of attentional changes in orienting behavior and neural activity. These results indicate that normal aging alters teaching signals in the ABL. Changes in these teaching signals may contribute to a host of age-related cognitive changes.

Desvalorização de ganhos e perdas monetárias em fumantes, fumantes em tratamento e não fumantes

Fumantes tendem a escolher recompensas imediatas de menor valor e desvalorizar as atrasadas de maior valor em modelos de desvalorização pelo atraso (DA). Entretanto, pouco se sabe sobre a escolha temporal de consequências apetitivas e aversivas de fumantes que decidem parar de fumar. Por isso, investigou-se a DA em uma tarefa com perdas e ganhos de valores monetários hipotéticos em fumantes (n = 20), fumantes em tratamento (n = 20) e não fumantes (n = 20), que também responderam o questionário de tolerância de Fagerström e o ASSIST. A DA foi maior para fumantes do que para não fumantes para ganhos (mas não perdas). Fumantes em tratamento não diferiram dos outros grupos, apresentando uma DA intermediária. Estes podem ser um subgrupo de fumantes menos impulsivos ou a decisão de parar de fumar reduziu a DA. A DA pode ser uma preditora do sucesso da cessação do tabagismo.

Incentives to promote family planning

OBJECTIVE

Over the past 60 years, population control has become an increasingly urgent issue worldwide as a growing population strains already limited resources. The use of financial incentives to promote family planning is an innovative approach that has potential to make a contribution to efforts to better manage population growth. This report reviews eight studies that examined the effect of incentives on family planning.

METHOD

Published studies that tested the impact of incentives to promote some aspect of family planning and included an appropriate control or comparison condition were reviewed.

RESULTS

Incentives have been used to promote attendance at contraceptive education sessions, adoption and continuation of contraceptive methods, sterilization, and to limit family size. All but one of the eight studies reviewed reported positive outcomes, but weaknesses in study design and execution limit the strength of the conclusions that can be drawn.

CONCLUSION

Review of this literature suggests that family planning behaviors, like other behaviors, are sensitive to incentives. Given the tremendous need for efficacious interventions in global efforts to manage population growth, further research on this topic using more rigorous experimental methods is warranted.

Altruism in time: social temporal discounting differentiates smokers from problem drinkers

RATIONALE

Recent studies on reinforcer valuation in social situations have informed research on mental illness. Social temporal discounting may be a way to examine effects of social context on the devaluation of delayed reinforcers. In prior research with non-drug-using groups, we demonstrated that individuals discount delayed rewards less rapidly (i.e., value the future more) for a group of which they are a member than they do for themselves alone.

OBJECTIVES

The current study examined how cigarette smoking and level of alcohol use relate to rates of delay and social temporal discounting.

METHODS

In this study, we used crowd-sourcing technology to contact a large number of individuals (N = 796). Some of these individuals were hazardous-to-harmful drinkers (n = 269), whereas others were non-problem drinkers (n = 523); some were smokers (n = 182), whereas others were nonsmokers (n = 614). Delay discounting questionnaires for individual rewards (me now, me later) and for group rewards (we now, we later; me now, we later) were used to measure individuals' discounting rates across various social contexts.

RESULTS

Our analyses found that smokers discounted delayed rewards more rapidly than controls under all conditions. However, hazardous-to-harmful drinkers discounted delayed rewards significantly more rapidly than the non-problem drinkers under the individual condition, but not under the social conditions.

CONCLUSIONS

This finding suggests that the use of different abused drugs may be associated with excessive discounting in the individual condition and has selective effects when discounting for a group in the social conditions.

Using crowdsourcing to examine relations between delay and probability discounting

Although the extensive lines of research on delay and/or probability discounting have greatly expanded our understanding of human decision-making processes, the relation between these two phenomena remains unclear. For example, some studies have reported robust associations between delay and probability discounting, whereas others have failed to demonstrate a consistent relation between the two. The current study sought to clarify this relation by examining the relation between delay and probability discounting in a large sample of internet users (n=904) using the Amazon Mechanical Turk (AMT) crowdsourcing service. Because AMT is a novel data collection platform, the findings were validated through the replication of a number of previously established relations (e.g., relations between delay discounting and cigarette smoking status). A small but highly significant positive correlation between delay and probability discounting rates was obtained, and principal component analysis suggested that two (rather than one) components were preferable to account for the variance in both delay and probability discounting. Taken together, these findings suggest that delay and probability discounting may be related, but are not manifestations of a single construct (e.g., impulsivity).

Association of cognition with temporal discounting in community based older persons

BACKGROUND

The objective of this study was to test the hypothesis that cognitive function is negatively associated with temporal discounting in old age.

METHODS

Participants were 388 community-dwelling older persons without dementia from the Rush Memory and Aging Project, an ongoing longitudinal epidemiologic study of aging in the Chicago metropolitan area. Temporal discounting was measured using standard questions in which participants were asked to choose between an immediate, smaller payment and a delayed, larger one. Cognition was measured using a detailed battery including 19 tests. The association between cognition and temporal discounting was examined via mixed models adjusted for age, sex, education, income, and the number of chronic medical conditions.

RESULTS

Descriptive data revealed a consistent pattern whereby older persons with lower cognitive function were more likely to discount greater but delayed rewards compared to those with higher cognitive function. Further, in a mixed effect model adjusted for age, sex, education, income, and chronic medical conditions, global cognitive function was negatively associated with temporal discounting (estimate = -0.45, SE = 0.18, p = 0.015), such that a person with lower cognition exhibited greater discounting. Finally, in subsequent models examining domain specific associations, perceptual speed and visuospatial abilities were associated with temporal discounting, but episodic memory, semantic memory and working memory were not.

CONCLUSION

Among older persons without dementia, a lower level of cognitive function is associated with greater temporal discounting. These findings have implications regarding the ability of older persons to make decisions that involve delayed rewards but maximize well-being.

Temporal discounting of monetary rewards in children and adolescents with ADHD and autism spectrum disorders

It has been difficult to differentiate attention-deficit/hyperactivity disorder (ADHD) and autism spectrum disorder (ASD) in terms of some aspects of their cognitive profile. While both show deficits in executive functions, it has been suggested that they may differ in their response to monetary reward. For instance, children with ADHD prefer small immediate over large delayed rewards more than typically developing controls. One explanation for this is that they discount the value of rewards to a higher degree as they are moved into the future. The current study investigated whether children with ADHD can be differentiated from those with ASD in terms of reward discounting. Thirty-nine children (8-16 y) with ADHD, 34 children with ASD and 46 typically developing controls performed a hypothetical monetary temporal discounting task. Participants were instructed to make repeated choices between small variable rewards (0, 5, 10, 20, 30€) delivered immediately and large rewards delivered after a variable delay. Children with ADHD but not ASD discounted future rewards at a higher rate than typically developing controls. These data confirm steeper discounting of future rewards in ADHD and add to a small but growing literature showing that the psychological profile of ADHD can be distinguished from that of ASD in terms of disrupted motivational processes.

An efficient operant choice procedure for assessing delay discounting in humans: initial validation in cocaine-dependent and control individuals

Delay discounting is the decline in a consequence's control of behavior as a function of its delay, and may be a fundamental behavioral process in drug dependence. Human delay-discounting studies have usually relied on choices between hypothetical rewards. Some human tasks have assessed delay discounting using operant procedures with consequences provided during the task, as in nonhuman animal studies. However, these tasks have limitations such as long duration, potentially indeterminate data, or confounding the effect of delay with probability. A study in 20 cocaine-dependent volunteers and 20 demographically matched non-cocaine-dependent volunteers was designed to investigate a novel operant delay-discounting task providing monetary reinforcement by coin delivery throughout the task (Quick Discounting Operant Task; QDOT). Participants completed a hypothetical delay-discounting procedure, a potentially real reward delay-discounting procedure, and an existing operant delay-discounting task: the Experiential Discounting Task (EDT). The QDOT resulted in complete data for all participants, showed systematic effects of delay that were well described by a hyperbolic function, had a maximum duration of 17 min, and resulted in relatively little variability in session earnings. QDOT performance was significantly, positively correlated with performance on the EDT but not the other tasks. The QDOT resulted in an effect size between the groups that was similar to most other delay-discounting tasks examined, and showed that the cocaine-dependent participants delay discounted significantly more than the control participants. The QDOT is an efficient operant human delay-discounting task that may be useful in a variety of experimental settings.

Age differences in default and reward networks during processing of personally relevant information

We recently found activity in default mode and reward-related regions during self-relevant tasks in young adults. Here we examine the effect of aging on engagement of the default network (DN) and reward network (RN) during these tasks. Previous studies have shown reduced engagement of the DN and reward areas in older adults, but the influence of age on these circuits during self-relevant tasks has not been examined. The tasks involved judging personality traits about one's self or a well known other person. There were no age differences in reaction time on the tasks but older adults had more positive Self and Other judgments, whereas younger adults had more negative judgments. Both groups had increased DN and RN activity during the self-relevant tasks, relative to non-self tasks, but this increase was reduced in older compared to young adults. Functional connectivity of both networks during the tasks was weaker in the older relative to younger adults. Intrinsic functional connectivity, measured at rest, also was weaker in the older adults in the DN, but not in the RN. These results suggest that, in younger adults, the processing of personally relevant information involves robust activation of and functional connectivity within these two networks, in line with current models that emphasize strong links between the self and reward. The finding that older adults had more positive judgments, but weaker engagement and less consistent functional connectivity in these networks, suggests potential brain mechanisms for the "positivity bias" with aging.

Negative reinforcement learning is affected in substance dependence

BACKGROUND

Negative reinforcement results in behavior to escape or avoid an aversive outcome. Withdrawal symptoms are purported to be negative reinforcers in perpetuating substance dependence, but little is known about negative reinforcement learning in this population. The purpose of this study was to examine reinforcement learning in substance dependent individuals (SDI), with an emphasis on assessing negative reinforcement learning. We modified the Iowa Gambling Task to separately assess positive and negative reinforcement. We hypothesized that SDI would show differences in negative reinforcement learning compared to controls and we investigated whether learning differed as a function of the relative magnitude or frequency of the reinforcer.

METHODS

Thirty subjects dependent on psychostimulants were compared with 28 community controls on a decision making task that manipulated outcome frequencies and magnitudes and required an action to avoid a negative outcome.

RESULTS

SDI did not learn to avoid negative outcomes to the same degree as controls. This difference was driven by the magnitude, not the frequency, of negative feedback. In contrast, approach behaviors in response to positive reinforcement were similar in both groups.

CONCLUSIONS

Our findings are consistent with a specific deficit in negative reinforcement learning in SDI. SDI were relatively insensitive to the magnitude, not frequency, of loss. If this generalizes to drug-related stimuli, it suggests that repeated episodes of withdrawal may drive relapse more than the severity of a single episode.

Reduced sensitivity to immediate reward during decision-making in older than younger adults

We examined whether older adults differ from younger adults in the degree to which they favor immediate over delayed rewards during decision-making. To examine the neural correlates of age-related differences in delay discounting we acquired functional MR images while participants made decisions between smaller but sooner and larger but later monetary rewards. The behavioral results show age-related reductions in delay discounting. Less impulsive decision-making in older adults was associated with lower ventral striatal activations to immediate reward. Furthermore, older adults showed an overall higher percentage of delayed choices and reduced activity in the dorsal striatum than younger adults. This points to a reduced reward sensitivity of the dorsal striatum in older adults. Taken together, our findings indicate that less impulsive decision-making in older adults is due to a reduced sensitivity of striatal areas to reward. These age-related changes in reward sensitivity may result from transformations in dopaminergic neuromodulation with age.

Pathological gambling: a systematic review of biochemical, neuroimaging, and neuropsychological findings

Pathological gambling is an emerging psychiatric disorder that has recently gained much attention because of its increasing prevalence and devastating personal, familial, and social consequences. Although its pathophysiology is largely unknown, the shared similarities with both addiction and obsessive-compulsive spectrum disorders have suggested the possibility of common psychobiological substrates. As with many other psychiatric disorders, it is believed that pathological gambling may result from the interplay between individual vulnerability and environmental factors. The aim of this article is to offer a comprehensive review of the main neurobiological aspects of pathological gambling, with particular attention to neuropsychological and related findings. A deeper understanding of the biological correlates of pathological gambling is required in order to develop effective treatment strategies.

Excessive discounting of delayed reinforcers as a trans-disease process contributing to addiction and other disease-related vulnerabilities: emerging evidence

Delay discounting describes the devaluation of a reinforcer as a function of the delay until its receipt. Although all people discount delayed reinforcers, one consistent finding is that substance-dependent individuals tend to discount delayed reinforcers more rapidly than do healthy controls. Moreover, these higher-than-normal discounting rates have been observed in individuals with other behavioral maladies such as pathological gambling, poor health behavior, and overeating. This suggests that high rates of delay discounting may be a trans-disease process (i.e., a process that occurs across a range of disorders, making findings from one disorder relevant to other disorders). In this paper, we argue that delay discounting is a trans-disease process, undergirded by an imbalance between two competing neurobehavioral decision systems. Implications for our understanding of, and treatment for, this trans-disease process are discussed.

Polymorphic variation in the dopamine D4 receptor predicts delay discounting as a function of childhood socioeconomic status: evidence for differential susceptibility

Inconsistent or null findings among studies associating behaviors on the externalizing spectrum--addictions, impulsivity, risk-taking, novelty-seeking traits--with presence of the 7-repeat allele of a common length polymorphism in the gene encoding the dopamine D4 receptor (DRD4) may stem from individuals' variable exposures to prominent environmental moderators (gene × environment interaction). Here, we report that relative preference for immediate, smaller rewards over larger rewards delayed in time (delay discounting), a behavioral endophenotype of impulsive decision-making, varied by interaction of DRD4 genotype with childhood socioeconomic status (SES) among 546 mid-life community volunteers. Independent of age, sex, adulthood SES and IQ, participants who were both raised in families of distinctly low SES (low parental education and occupational grade) and carried the DRD4 7-repeat allele discounted future rewards more steeply than like-reared counterparts of alternate DRD4 genotype. In the absence of childhood socioeconomic disadvantage, however, participants carrying the 7-repeat allele discounted future rewards less steeply. This bidirectional association of DRD4 genotype with temporal discounting, conditioned by participants' early life circumstances, accords with a recently proposed developmental model of gene × environment interaction ('differential susceptibility') that posits genetically modulated sensitivity to both adverse and salubrious environmental influences.

Differences in Risk Aversion between Young and Older Adults

Research on decision-making strategies among younger and older adults suggests that older adults may be more risk averse than younger people in the case of potential losses. These results mostly come from experimental studies involving gambling paradigms. Since these paradigms involve substantial demands on memory and learning, differences in risk aversion or other features of decision-making attributed to age may in fact reflect age-related declines in cognitive abilities. In the current study, older and younger adults completed a simpler, paired lottery choice task used in the experimental economics literature to elicit risk aversion. A similar approach was used to elicit participants' discount rates. The older adult group was more risk averse than younger adults (p < .05) and also had a higher discount rate (15.6-21.0% vs. 10.3-15.5%, p < .01), indicating lower expected utility from future income. Risk aversion and implied discount rates were weakly correlated. It may be valuable to investigate developmental changes in neural correlates of decision-making across the lifespan.

Relations among delay discounting, addictions, and money mismanagement: implications and future directions

BACKGROUND

Delay discounting is a reduction in the subjective value of a delayed outcome. Elevated delay discounting is a type of impulsivity that is associated with harmful behaviors, including substance abuse and financial mismanagement.

METHODS

Elevated delay discounting as related to addiction and financial mismanagement was reviewed from psychological, neurobiological, and behavioral economic perspectives.

RESULTS

Addiction and financial mismanagement frequently co-occur, and elevated delay discounting may be a common mechanism contributing to both of these problematic behaviors.

CONCLUSIONS

Future research on the relationships between delay discounting, substance abuse, and financial mismanagement can provide important insights for developing improved prevention and treatment strategies.

Age, time, and decision making: from processing speed to global time horizons

Time and time perceptions are integral to decision making because any meaningful choice is embedded in a temporal context and requires the evaluation of future preferences and outcomes. The present review examines the influence of chronological age on time perceptions and horizons and discusses implications for decision making across the life span. Time influences and interacts with decision making in multiple ways. Specifically, this review examines the following topic areas: (1) processing speed and decision time, (2) internal clocks and time estimation, (3) mental representations of future time and intertemporal choice, and (4) global time horizons. For each aspect, patterns of age differences and implications for decision strategies and quality are discussed. The conclusion proposes frameworks to integrate different lines of research and identifies promising avenues for future inquiry.

Relative Reinforcing Value of Energy-dense Snack Foods: In Overweight and Obese Adults

Purpose: Obese people find energy-dense food more reinforcing than do their non-obese peers, and reinforcement influences food intake. We examined how the degree of adiposity, measured by body mass index (BMI), is associated with the relative reinforcing value of energy-dense snack foods versus fruits and vegetables in overweight and obese people.

Methods: Ninety-two overweight or obese students in introductory psychology courses completed questionnaires on age, sex, BMI, hunger, smoking status, dietary restraint, and hedonic (liking) ratings for energy-dense snack foods and fruits and vegetables. The questionnaire also was used to evaluate the relative reinforcing value of these snack foods in comparison with fruits and vegetables.

Results: The BMI predicted the relative reinforcing value of energy-dense snack food. This positive relationship remained significant after we controlled for age, sex, dietary restraint, hunger, smoking status, and snack food hedonics.

Conclusions: The greater the degree of overweight and obesity, the greater the motivation to obtain energy-dense snack foods. Because the rewarding value of food is a strong determinant of energy intake, a useful approach to preventing and treating obesity may be introducing pharmacological or behavioural nutrition intervention to reduce the rewarding value of energydense snack foods, or increasing the rewarding value of fruits and vegetables.

The behavioral economics and neuroeconomics of reinforcer pathologies: implications for etiology and treatment of addiction

The current paper presents a novel approach to understanding and treating addiction. Drawing from work in behavioral economics and developments in the new field of neuroeconomics, we describe addiction as pathological patterns of responding resulting from the persistently high valuation of a reinforcer and/or an excessive preference for the immediate consumption of that reinforcer. We further suggest that, as indicated by the competing neurobehavioral decision systems theory, these patterns of pathological choice and consumption result from an imbalance between two distinct neurobehavioral systems. Specifically, pathological patterns of responding result from hyperactivity in the evolutionarily older impulsive system (which values immediate and low-cost reinforcers) and/or hypoactivity in the more recently evolved executive system (which is involved in the valuation of delayed reinforcers). This approach is then used to explain five phenomena that we believe any adequate theory of addiction must address.

Risk, reward, and economic decision making in aging

OBJECTIVES

Older adults' decision quality is considered to be worse than that of younger adults. This age-related difference is often attributed to reductions in risk tolerance. Little is known about the circumstances that affect older adults' decisions and whether risk attitudes directly influence economic decisions. We measure the influence of risk attitudes on age-related differences in decision making in both nonsocial and social contexts.

METHODS

Risk attitudes and economic decision making were measured in 30 healthy older adults and 29 healthy younger adults.

RESULTS

Older adults report being less impulsive, sensation seeking and risk tolerant than younger adults. Age did not affect a measure of nonsocial economic decision making. Older adults were more likely to reject unfair divisions of money during an economic social-bargaining game and more likely to make equitable divisions of money during social-giving game. These age-related differences were determined in part by individuals' self-reported risk taking.

DISCUSSION

We conclude that age-related differences in decision making are domain specific and that some social economic decision making is influenced by risk attitudes. Older adults are more risk avoidant, but this does not alter their willingness to wait for reward in a nonsocial context. Perceiving more risk is associated with an unwillingness to accept an unfair offer in social economic contexts and ultimately leads to poorer outcomes for older adults.

Delay discounting: trait variable?

Delay discounting refers to the tendency for outcomes that are remote in time to have less value than more immediate outcomes. Steep discounting of delayed outcomes is associated with a variety of social maladies. The degree of sensitivity to delayed outcomes may be a stable and pervasive individual characteristic. In analyses of archival data, the present study found positive correlations between the degree of delay discounting for one outcome (as measured by the Area Under the Curve), and the degree of discounting for other outcomes. Along with additional evidence reviewed, these data suggest that delay discounting may be considered a personality trait. Recent research in epigenetics, neuroscience, and behavior suggests delay discounting may prove to be a beneficial target for therapeutic attempts to produce global reductions in impulsivity related to delay discounting.

Hypothetical intertemporal choice and real economic behavior: delay discounting predicts voucher redemptions during contingency-management procedures

Delay discounting rates are predictive of drug use status, the likelihood of becoming abstinent, and a variety of health behaviors. Rates of delay discounting may also be related to other relevant behaviors associated with addiction, such as the frequency at which individuals redeem contingency management voucher earnings. This study examined the discounting rates of 152 participants in a buprenorphine treatment program for opioid abuse. Participants received up to 12 weeks of buprenorphine treatment combined with contingency management. Participant's drug use was measured via urine specimens submitted three times a week. Successive negative urine specimens were reinforced with increasing amounts of money. After each negative urine specimen, a participant could either redeem his or her earnings or accumulate it in an account. Analysis of the frequency of redemptions showed that participants with higher rates of delay discounting at study intake redeemed their earnings significantly more often than participants with lower rates of discounting. Age and income also predicted redemption rates. We suggest that delay discounting rates can be used to predict redemption behaviors in a contingency management treatment program and that these findings are consistent with the recent theory of the competing neurobehavioral decision systems.

Can adolescents learn self-control? Delay of gratification in the development of control over risk taking

Recent findings from developmental neuroscience suggest that the adolescent brain is too immature to exert control over impulsive drives, such as sensation seeking, that increase during adolescence. Using a discounting of delayed reward paradigm, this research examines the ability to delay gratification as a potential source of control over risk-taking tendencies that increase during adolescence. In addition, it explores the role of experience resulting from risk taking as well as future time perspective as contributors to the development of this ability. In a nationally representative sample (n = 900) of young people aged 14-22, a structural equation analysis shows that risk taking as assessed by use of three popular drugs (tobacco, marijuana, and alcohol) is inversely related to the ability to delay gratification. The relation is robust across gender, age, and different levels of sensation seeking. In addition, high sensation seekers exhibit dramatic age-related increase in delay of gratification, lending support to the hypothesis that engaging in risky behavior provides experience that leads to greater patience for long-term rewards. The findings support the conclusion that a complete understanding of the development of self-control must consider individual differences not easily explained by universal trends in brain maturation.

Studying the relation between temporal reward discounting tasks used in populations with ADHD: a factor analysis

BACKGROUND

This study aimed at investigating the relationship between tasks that have been used in attention deficit hyperactivity disorder (ADHD) to measure choices between smaller immediate and larger delayed rewards: real and hypothetical temporal discounting tasks, and single-choice paradigms.

METHODS

Participants were 55 undergraduate psychology students. Tasks included a real and hypothetical version of a temporal discounting (TD) task with choices between a large reward (10 cents) after delays up to 60 seconds, and smaller immediate rewards (2-8 cents); two versions of a hypothetical temporal discounting task with choices between a large reward ($100) after delays up to 120 months, and smaller immediate rewards ($1-$95); a Choice Delay Task with choices between one point now and two points after 30 seconds (one point is worth five cents).

RESULTS

Correlation analyses showed that the real and the hypothetical TD tasks with 10 cents were very strongly associated. However, the hypothetical TD tasks with $100 did not correlate with either the real or the hypothetical TD task with 10 cents. Principal component analysis extracted two components: one for small amounts and short delays, and a second one for large rewards and long delays.

CONCLUSIONS

Temporal reward discounting is not a uniform construct. Functional brain imaging research could shed more light on unique brain activation patterns associated with different forms of temporal reward discounting.

Heritability of delay discounting in adolescence: a longitudinal twin study

Delay discounting (DD) refers to the preference for smaller immediate rewards over larger but delayed rewards, and is considered to be a distinct component of a broader "impulsivity" construct. Although greater propensity for discounting the value of delayed gratification has been associated with a range of problem behaviors and substance abuse, particularly in adolescents, the origins of individual differences in DD remain unclear. We examined genetic and environmental influences on a real-life behavioral measure of DD using a longitudinal twin design. Adolescent participants were asked to choose between a smaller ($7) reward available immediately and a larger ($10) reward to be received in 7 days. Biometrical genetic analysis using linear structural equation modeling showed significant heritability of DD at ages 12 and 14 (30 and 51%, respectively) and suggested that the same genetic factors influenced the trait at both ages. DD was significantly associated with symptoms of conduct disorder, attention deficit hyperactivity disorder, substance use, and with higher novelty seeking and poor self-regulation. This study provides the first evidence for heritability of DD in humans and suggests that DD can be a promising endophenotype for genetic studies of addiction and externalizing disorders.

Temporal reward discounting in attention-deficit/hyperactivity disorder: the contribution of symptom domains, reward magnitude, and session length

BACKGROUND

Theoretical models have hypothesized that one core problem in attention-deficit/hyperactivity disorder (ADHD) is abnormal reward processing. Temporal reward discounting (decreases in subjective reward value due to prereward delay) is of interest because of its relation with a key symptom of ADHD-impulsivity. This study investigated 1) whether steep temporal reward discounting (TD) is associated with ADHD-combined type (ADHD-C)/symptoms of hyperactivity-impulsivity specifically; 2) the role of reward magnitude in TD in ADHD-C/participants with symptoms of hyperactivity-impulsivity; and 3) whether steep TD in ADHD-C/participants with symptoms of hyperactivity-impulsivity is affected by session length.

METHODS

Three TD tasks were administered to children and adolescents (aged 6-17) with ADHD-C (n = 25), ADHD-inattentive type (ADHD-I; n = 20), and matched typically developing participants (n = 37). Reward magnitude and session length were varied.

RESULTS

Steep TD was observed in participants with ADHD-C but not in those with ADHD-I, independent of reward magnitude and session length. Dimensional analyses revealed that steep TD was associated with hyperactivity-impulsivity (transcending the arbitrary cutoff for ADHD subtypes), especially when reward magnitude at the trial level was small.

CONCLUSIONS

These findings suggest that steep TD in ADHD is best thought of as a correlate of the symptom dimension of hyperactivity/impulsivity. Additionally, steep TD in ADHD is the result of a trade-off between delay and reward magnitude, with all factors contributing to choice preferences. These findings may help refine the delay aversion theory of ADHD, and provide evidence for the notion that unique reward processing is one mechanism associated with symptoms of hyperactivity-impulsivity.

The quick delay questionnaire: a measure of delay aversion and discounting in adults

Individuals with ADHD often display an altered response to delay. To date, assessment of this has typically involved neuropsychological testing-however, such tests are designed specifically for children and may not be suitable for adults. They are also relatively time-consuming and expensive. In the current paper, we describe the initial validation of a short questionnaire to assess delay-related behaviour in adults. The Quick Delay Questionnaire (QDQ) is a 10-item scale. The questionnaire was administered to 575 participants from the normal population (ranging in age from 18 to 77 years). Forty of the original sample were selected at random and tested 1 week later. Data on ADHD, anxiety and depression were also collected. There were two five-item scales-(1) delay aversion; and (2) delay discounting. These had internal consistency and had good reliability. Subscales were differentially associated with ADHD, anxiety and depression. The QDQ is a potentially valuable way of assessing response to delay in adults. Further work is required to validate the scale against direct observation and neuropsychological assessment in clinically ascertained samples.

Effects of methylphenidate on discounting of delayed rewards in attention deficit/hyperactivity disorder

Impulsivity is a central component of attention deficit/hyperactivity disorder (ADHD). Delay discounting, or a preference for smaller, immediate rewards over larger, delayed rewards, is considered an important aspect of impulsivity, and delay-related impulsivity has been emphasized in etiological models of ADHD. In this study, we examined whether stimulant medication, an effective treatment for ADHD, reduced discounting of delayed experiential and hypothetical rewards among 49 children (ages 9-12 years) with ADHD. After a practice day, participants completed a 3-day double-blind placebo-controlled acute medication assessment. Active doses were long-acting methylphenidate (Concerta), with the nearest equivalents of 0.3 and 0.6 mg/kg TID immediate-release methylphenidate. On each testing day, participants completed experiential (real-world money in real time) and hypothetical discounting tasks. Relative to placebo, methylphenidate reduced discounting of delayed experiential rewards but not hypothetical rewards. Broadly consistent with etiological models that emphasize delay-related impulsivity among children with ADHD, these findings provide initial evidence that stimulant medication reduces delay discounting among those with the disorder. The results also draw attention to task parameters that may influence the sensitivity of various delay discounting measures to medication effects.

One-year temporal stability of delay-discount rates

The temporal stability of delay-discount rates for monetary rewards was assessed using a monetary choice questionnaire (Kirby & Marakovic, 1996). Of 100 undergraduate participants who completed the questionnaire at the initial session, 81 returned 5 weeks later and 46 returned 57 weeks later for subsequent sessions. The 5-week test-retest stability of discount rates was .77 (95% confidence interval = .67-.85), the 1-year stability was .71 (.50-.84), and the 57-week stability was .63 (.41-.77). Thus, at least when similar testing situations are reinstated, discount rates as individual differences have 1-year stabilities in the range that is typically obtained for personality traits. Discount rates index an attribute of the person that is relatively stable over time but that is moderated by aspects of the situation, such as reward type and deprivational state.

Within-subject differences in degree of delay discounting as a function of order of presentation of hypothetical cash rewards

Procedural variants in estimating delay discounting (DD) have been shown to yield significant differences in estimated degree of DD as well as variations in individual patterns of choice. For example, a recent study found significantly different degrees of DD between groups assessed using either an ascending or descending order of presentation of the immediately available rewards. The purpose of this study was to test for within-subject effects of order of presentation of the immediate rewards in a DD task. In a single session, college students (N=29) were asked to complete two DD tasks, one with the immediate rewards presented in ascending order and one in descending order. Consistent with previous results, significantly larger mean area under the discounting curve (AUC) was observed when the descending sequence was used compared to the ascending order of presentation; and the correlation between both measurements was moderate. These results suggest that some DD assessment tasks may be sensitive to contextual variables such as order and range of the reward and delay values.

Time preference and its relationship with age, health, and survival probability

Although theories from economics and evolutionary biology predict that one's age, health, and survival probability should be associated with one's subjective discount rate (SDR), few studies have empirically tested for these links. Our study analyzes in detail how the SDR is related to age, health, and survival probability, by surveying a sample of individuals in townships around Durban, South Africa. In contrast to previous studies, we find that age is not significantly related to the SDR, but both physical health and survival expectations have a U-shaped relationship with the SDR. Individuals in very poor health have high discount rates, and those in very good health also have high discount rates. Similarly, those with expected survival probability on the extremes have high discount rates. Therefore, health and survival probability, and not age, seem to be predictors of one's SDR in an area of the world with high morbidity and mortality.

Effects of dietary restraint and body mass index on the relative reinforcing value of snack food

The present study examined the independent and interactive association between dietary restraint, body mass index (BMI) and the relative reinforcing value of food. Four hundred and three introductory psychology students completed questionnaires assessing age, gender, BMI, hunger, smoking status, nicotine dependence, dietary restraint, hedonic ratings for snack food and fruits and vegetables and the relative reinforcing value of snack food and fruits and vegetables. In the overall sample, results indicated a dietary restraint x BMI interaction after controlling for age, hunger, nicotine dependence, and hedonics. However, when regression models were separated by gender, the BMI x restraint interaction emerged only for females and not for males. Findings suggest that BMI moderates the relationship between dietary restraint and snack food reinforcement in females only, such that restraint and snack food reinforcement are inversely correlated in females with lower BMI, but restraint is positively correlated with snack food reinforcement in females with higher BMI. Theoretical and clinical implications of these findings are discussed.