Genomic basis of delayed reward discounting

Adolescent ADHD and electrophysiological reward responsiveness: A machine learning approach to evaluate classification accuracy and prognosis

We evaluated event-related potential (ERP) indices of reinforcement sensitivity as ADHD biomarkers by examining, in N=306 adolescents (M_age=15.78, SD=1.08), the extent to which ERP amplitude and latency variables measuring reward anticipation and response (1) differentiate, in age- and sex-matched subsamples, (i) youth with vs. without ADHD, (ii) youth at-risk for vs. not at-risk for ADHD, and, in the with ADHD subsample, (iii) youth with the inattentive vs. the hyperactive/impulsive (H/I) and combined presentations. We further examined the extent to which ERP variables (2) predict, in the ADHD subsample, substance use (i) concurrently and (ii) prospectively at 18-month follow-up. Linear support vector machine analyses indicated ERPs weakly differentiate youth with/without (65%) - and at-risk for/not at-risk for (63%) - ADHD but better differentiate ADHD presentations (78%). Regression analyses showed in adolescents with ADHD, ERPs explain a considerable proportion of variance (50%) in concurrent alcohol use and, controlling for concurrent marijuana and tobacco use, explain a considerable proportion of variance (87 and 87%) in, and predict later marijuana and tobacco use. Findings are consistent with the dual-pathway model of ADHD. Results also highlight limitations of a dichotomous, syndromic classification and indicate differences in neural reinforcement sensitivity are a promising ADHD prognostic biomarker.

The sooner the better: clinical and neural correlates of impulsive choice in Tourette disorder

Reward sensitivity has been suggested as one of the central pathophysiological mechanisms in Tourette disorder. However, the subjective valuation of a reward by introduction of delay has received little attention in Tourette disorder, even though it has been suggested as a trans-diagnostic feature of numerous neuropsychiatric disorders. We aimed to assess delay discounting in Tourette disorder and to identify its brain functional correlates. We evaluated delayed discounting and its brain functional correlates in a large group of 54 Tourette disorder patients and 31 healthy controls using a data-driven approach. We identified a subgroup of 29 patients with steeper reward discounting, characterised by a higher burden of impulse-control disorders and a higher level of general impulsivity compared to patients with normal behavioural performance or to controls. Reward discounting was underpinned by resting-state activity of a network comprising the orbito-frontal, cingulate, pre-supplementary motor area, temporal and insular cortices, as well as ventral striatum and hippocampus. Within this network, (i) lower connectivity of pre-supplementary motor area with ventral striatum predicted a higher impulsivity and a steeper reward discounting and (ii) a greater connectivity of pre-supplementary motor area with anterior insular cortex predicted steeper reward discounting and more severe tics. Overall, our results highlight the heterogeneity of the delayed reward processing in Tourette disorder, with steeper reward discounting being a marker of burden in impulsivity and impulse control disorders, and the pre-supplementary motor area being a hub region for the delay discounting, impulsivity and tic severity.

Individual Differences in Intertemporal Choice

Intertemporal choice involves deciding between smaller, sooner and larger, later rewards. People tend to prefer smaller rewards that are available earlier to larger rewards available later, a phenomenon referred to as temporal or delay discounting. Despite its ubiquity in human and non-human animals, temporal discounting is subject to considerable individual differences. Here, we provide a critical narrative review of this literature and make suggestions for future work. We conclude that temporal discounting is associated with key socio-economic and health-related variables. Regarding personality, large-scale studies have found steeper temporal discounting to be associated with higher levels of self-reported impulsivity and extraversion; however, effect sizes are small. Temporal discounting correlates negatively with future-oriented cognitive styles and inhibitory control, again with small effect sizes. There are consistent associations between steeper temporal discounting and lower intelligence, with effect sizes exceeding those of personality or cognitive variables, although socio-demographic moderator variables may play a role. Neuroimaging evidence of brain structural and functional correlates is not yet consistent, neither with regard to areas nor directions of effects. Finally, following early candidate gene studies, recent Genome Wide Association Study (GWAS) approaches have revealed the molecular genetic architecture of temporal discounting to be more complex than initially thought. Overall, the study of individual differences in temporal discounting is a maturing field that has produced some replicable findings. Effect sizes are small-to-medium, necessitating future hypothesis-driven work that prioritizes large samples with adequate power calculations. More research is also needed regarding the neural origins of individual differences in temporal discounting as well as the mediating neural mechanisms of associations of temporal discounting with personality and cognitive variables.

Associations Between Delay Discounting and Connectivity of the Valuation-control System in Healthy Young Adults

The process of valuation assists in determining if an object or course of action is rewarding. Delay discounting is the observed decay of a rewards' subjective value over time. Encoding the subjective value of rewards across a spectrum has been attributed to brain regions belonging to the valuation and executive control systems. The valuation system (VS) encodes reward value over short and long delays, influencing reinforcement learning and reward representation. The executive control system (ECS) becomes more active as choice difficulty increases, integrating contextual and mnemonic information with salience signals in the modulation of decision-making. Here, we aimed to identify resting-state functional connectivity-based patterns of the VS and ECS correlated with value-setting and delay discounting (outside-scanner paradigm) in a large (n = 992) cohort of healthy young adults from the Human Connectome Project (HCP). Results suggest the VS may be involved in value-setting of small, immediate rewards while the ECS may be involved in value-setting and delay discounting for large and small rewards over a range of delays. We observed magnitude sensitive connections involving the posterior cingulate cortex, time-sensitive connections with the ventromedial and lateral prefrontal cortex while connections involving the posterior parietal cortex appeared both magnitude- and time-sensitive. The ventromedial prefrontal cortex and posterior parietal cortex could act as "comparator" regions, weighing the value of small rewards against large rewards across various delay duration to aid in decision-making.

Steep Discounting of Future Rewards as an Impulsivity Phenotype: A Concise Review

This chapter provides an overview over the behavioral economic index of impulsivity known as delay discounting. Specifically, delay discounting refers to an individual's preference for smaller immediate rewards over a larger delayed rewards. The more precipitously an individual discounts future rewards, the more impulsive they are considered to be. First, the chapter reviews the nature of delay discounting as a psychological process and juxtaposes it with nominally similar processes, including other facets of impulsivity. Second, the chapter reviews the links between delay discounting and numerous health behaviors, including addiction, attention deficit/hyperactivity disorder, and obesity. Third, the determinants of individual variation in delay discounting are discussed, including both genetic and environmental contributions. Finally, the chapter evaluates delay discounting as a potentially modifiable risk factor and the status of clinical interventions designed to reduce delay discounting to address deficits in self-control in a variety of maladaptive behaviors.

Delay discounting of different outcomes: Review and theory

Steep delay discounting is characterized by a preference for small immediate outcomes relative to larger delayed outcomes and is predictive of drug abuse, risky sexual behaviors, and other maladaptive behaviors. Nancy M. Petry was a pioneer in delay discounting research who demonstrated that people discount delayed monetary gains less steeply than they discount substances with abuse liability. Subsequent research found steep discounting for not only drugs, but other nonmonetary outcomes such as food, sex, and health. In this systematic review, we evaluate the hypotheses proposed to explain differences in discounting as a function of the type of outcome and explore the trait- and state-like nature of delay discounting. We found overwhelming evidence for the state-like quality of delay discounting: Consistent with Petry and others' work, nonmonetary outcomes are discounted more steeply than monetary outcomes. We propose two hypotheses that together may account for this effect: Decreasing Future Preference and Decreasing Future Worth. We also found clear evidence that delay discounting has trait-like qualities: People who steeply discount monetary outcomes steeply discount nonmonetary outcomes as well. The implication is that changing delay discounting for one outcome could change discounting for other outcomes.

Human Brain Imaging Links Dopaminergic Systems to Impulsivity

Molecular and functional imaging techniques have been used and combined with pharmacological probes to evaluate the role of dopamine in impulsivity. Overall, strong evidence links striatal dopaminergic function with impulsivity, measured by self-reports and laboratory tests of cognitive control and reward-based decision-making. The combination of molecular imaging using positron emission tomography (PET) with functional magnetic resonance imaging (fMRI) specifically implicates striatal D2-type dopamine receptors (i.e., D2 and D3) and corticostriatal connectivity in cognitive control. Low levels of striatal and midbrain D2-type receptor availability correlate with self-reported impulsivity, whereas striatal D2-type receptor availability shows positive correlation with motor response inhibition and cognitive flexibility. Impulsive choice on reward-based decision-making tasks also is related to deficits in striatal D2-type dopamine receptor availability, and there is evidence for an inverted U-shaped function in this relationship, reflecting an optimum of striatal dopaminergic activity. Findings from studies of clinical populations that present striatal dopamine D2-type receptor deficits as well as healthy control research participants identify D2-type receptors as therapeutic targets to improve cognitive control.