The neural basis of delay discounting: A review and preliminary model

Pre-supplementary motor area strengthens reward sensitivity in intertemporal choice

Previous investigations on the causal neural mechanisms underlying intertemporal decision making focused on the dorsolateral prefrontal cortex as neural substrate of cognitive control. However, little is known, about the causal contributions of further parts of the frontoparietal control network to delaying gratification, including the pre-supplementary motor area (pre-SMA) and posterior parietal cortex (PPC). Conflicting previous evidence related pre-SMA and PPC either to evidence accumulation processes, choice biases, or response caution. To disentangle between these alternatives, we combined drift diffusion models of decision making with online transcranial magnetic stimulation (TMS) over pre-SMA and PPC during an intertemporal decision task. While we observed no robust effects of PPC TMS, perturbation of pre-SMA activity reduced preferences for larger over smaller rewards. A drift diffusion model of decision making suggests that pre-SMA increases the weight assigned to reward magnitudes during the evidence accumulation process without affecting choice biases or response caution. Taken together, the current findings reveal the computational role of the pre-SMA in value-based decision making, showing that pre-SMA promotes choices of larger, costly rewards by strengthening the sensitivity to reward magnitudes.

The role of impulsivity and binge eating in outpatients with overweight or obesity: an EEG temporal discounting study

BACKGROUND

Binge eating (BE) is associated with a range of cognitive control deficits related to impulsivity, including lower response inhibition, preference for immediate gratification, and maladaptive decision-making. The aim was to investigate whether impulsivity and BE may interact with the decision process and underlying brain activity in outpatients with overweight or obesity who are starting a treatment to achieve weight loss.

METHODS

A sample of 26 treatment-seeking outpatients with overweight or obesity was evaluated for impulsivity, BE, and temporal discounting rates. Impulsivity was measured with the Barratt Impulsiveness Scale (BIS-11), according to which two groups were composed: high BIS and low BIS; BE was assessed with the eating disorders module of the Structured Clinical Interview for DSM5-Research Version, according to which two groups were composed: with (BE group) or without BE (NBE group). Changes in subjective value of rewards were measured with the Temporal Discounting Task (TDt) where participants had to choice between sooner but smaller vs. later but larger monetary rewards. These choices were made in two differently delayed conditions ("Now" and "Not-now"). Brain rhythms were recorded through high-density electroencephalogram (hd-EEG) during the TDt.

RESULTS

Patients with BE reported more impulsive tendencies and perceived sooner rewards as more gratifying when both options were delayed (Not-now condition, p = 0.02). The reward choice in the TDt was accompanied by a general EEG alpha band desynchronization in parietal areas observed without differences between experimental conditions and patients groups. No effects were observed within the Now condition or in the other EEG bands.

CONCLUSIONS

The tendency to favor immediate rewards may constitute an obstacle to adhering to treatment plans and achieving weight loss goals for outpatients with overweight or obesity. Clinicians are therefore encouraged to include psychological factors, such as impulsivity and dysfunctional eating behaviors, when designing weight loss programs. By addressing these psychological aspects, clinicians can better support patients in overcoming barriers to adherence and achieving sustainable weight loss.

TRIAL REGISTRATION

This study was approved by the Ethics Committee of the Department of Psychological, Health, and Territorial Sciences of the University G. d'Annunzio of Chieti-Pescara (Prot. n. 254 of 03/14/2017).

Differential phase-amplitude coupling in nucleus accumbens and orbitofrontal cortex reflects decision-making during a delay discounting task

BACKGROUND

The impulsive choice is characterized by the preference for a small immediate reward over a bigger delayed one. The mechanisms underlying impulsive choices are linked to the activity in the Nucleus Accumbens (NAc), the orbitofrontal cortex (OFC), and the dorsolateral striatum (DLS). While the study of functional connectivity between brain areas has been key to understanding a variety of cognitive processes, it remains unclear whether functional connectivity differentiates impulsive-control decisions.

METHODS

To study the functional connectivity both between and within NAc, OFC, and DLS during a delay discounting task, we concurrently recorded local field potential in NAc, OFC, and DLS in rats. We then quantified the degree of phase-amplitude coupling (PAC), coherence, and Granger Causality between oscillatory activities in animals exhibiting either a high (HI) or low (LI) tendency for impulsive choices.

RESULTS

Our results showed a differential pattern of PAC during decision-making in OFC and NAc, but not in DLS. While theta-gamma PAC in OFC was associated with self-control decisions, a higher delta-gamma PAC in both OFC and NAc biased decisions toward impulsive choices in both HI and LI groups. Furthermore, during the reward event, Granger Causality analysis indicated a stronger NAc➔OFC gamma contribution in the HI group, while the LI group showed a higher OFC➔NAc gamma contribution.

CONCLUSIONS

The overactivity in NAc during reward in the HI group suggests that exacerbated contribution of NAcCore can lead to an overvaluation of reward that biases the behavior toward the impulsive choice.

Methylphenidate, but not citalopram, decreases impulsive choice in rats performing a temporal discounting task

Introduction

Drugs targeting monoamine systems remain the most common treatment for disorders with impulse control impairments. There is a body of literature suggesting that drugs affecting serotonin reuptake and dopamine reuptake can modulate distinct aspects of impulsivity - though such tests are often performed using distinct behavioral tasks prohibiting easy comparisons.

Methods

Here, we directly compare pharmacologic agents that affect dopamine (methylphenidate) vs serotonin (citalopram) manipulations on choice impulsivity in a temporal discounting task where rats could choose between a small, immediate reward or a large reward delayed at either 2 or 10s. In control conditions, rats preferred the large reward at a small (2s) delay and discounted the large reward at a long (10s) delay.

Results

Methylphenidate, a dopamine transport inhibitor that blocks reuptake of dopamine, dose-dependently increased large reward preference in the long delay (10s) block. Citalopram, a selective serotonin reuptake inhibitor, had no effect on temporal discounting behavior. Impulsive behavior on the temporal discounting task was at least partially mediated by the nucleus accumbens shell. Bilateral lesions to the nucleus accumbens shell reduced choice impulsivity during the long delay (10s) block. Following lesions, methylphenidate did not impact impulsivity.

Discussion

Our results suggest that striatal dopaminergic systems modulate choice impulsivity via actions within the nucleus accumbens shell, whereas serotonin systems may regulate different aspects of behavioral inhibition/impulsivity.

A critical review of hot executive functioning in youth attention-deficit/hyperactivity disorder: Methodological limitations, conceptual considerations, and future directions

Hot executive functioning (EF) - EF under emotionally or motivationally salient conditions - is a putative etiology of attention-deficit/hyperactivity disorder (ADHD), disruptive behavior problems (DBPs), and their related impairments. Despite two decades of research, the present study is the first review of the construct in youth ADHD, with a particular focus on the role of task design, age, and DBPs, as well as relevant conceptual and methodological considerations. While certain hot EF tasks have been investigated extensively (e.g., choice impulsivity), substantial inconsistency in measurement of the broader construct remains, severely limiting conclusions. Future research should a) consider the extent to which various hot EF tasks relate to one another, a higher order factor, and other related constructs; b) further investigate task design, particularly the elicitation of emotion or motivation and its anticipated effect on EF; and c) incorporate multiple levels of analysis to validate similarities and differences among tasks with regard to the affective experiences and cognitive demands they elicit. With improved measurement and conceptual clarity, hot EF has potential to advance the literature on etiological pathways to ADHD, DBPs and associated impairments and, more broadly, may represent a useful tool for understanding the influence of emotion and motivation on cognition.

Choice impulsivity after repeated social stress is associated with increased perineuronal nets in the medial prefrontal cortex

Repeated stress can predispose to substance abuse. However, behavioral and neurobiological adaptations that link stress to substance abuse remain unclear. This study investigates whether intermittent social defeat (ISD), a stress protocol that promotes drug-seeking behavior, alters intertemporal decision-making and cortical inhibitory function in the medial prefrontal cortex (mPFC). Male long evans rats were trained in a delay discounting task (DDT) where rats make a choice between a fast (1 s) small reward (1 sugar pellet) and a large reward (3 sugar pellets) that comes with a time delay (10 s or 20 s). A decreased preference for delayed rewards was used as an index of choice impulsivity. Rats were exposed to ISD and tested in the DDT 24 h after each stress episode, and one- and two-weeks after the last stress episode. Immunohistochemistry was performed in rat's brains to evaluate perineuronal nets (PNNs) and parvalbumin GABA interneurons (PV) labeling as markers of inhibitory function in mPFC. ISD significantly decreased the preference for delayed large rewards in low impulsive, but not high impulsive, animals. ISD also increased the density of PNNs in the mPFC. These results suggest that increased choice impulsivity and cortical inhibition predispose animals to seek out rewards after stress.

The date/delay effect in intertemporal choice: A combined fMRI and eye-tracking study

Temporal discounting, the tendency to devalue future rewards as a function of delay until receipt, is influenced by time framing. Specifically, discount rates are shallower when the time at which the reward is received is presented as a date (date condition; e.g., June 8, 2023) rather than in delay units (delay condition; e.g., 30 days), which is commonly referred to as the date/delay effect. However, the cognitive and neural mechanisms of this effect are not well understood. Here, we examined the date/delay effect by analysing combined fMRI and eye-tracking data of N = 31 participants completing a temporal discounting task in both a delay and a date condition. The results confirmed the date/delay effect and revealed that the date condition led to higher fixation durations on time attributes and to higher activity in precuneus/PCC and angular gyrus, that is, areas previously associated with episodic thinking. Additionally, participants made more comparative eye movements in the date compared to the delay condition. A lower date/delay effect was associated with higher prefrontal activity in the date > delay contrast, suggesting that higher control or arithmetic operations may reduce the date/delay effect. Our findings are in line with hypotheses positing that the date condition is associated with differential time estimation and the use of more comparative as opposed to integrative choice strategies. Specifically, higher activity in memory-related brain areas suggests that the date condition leads to higher perceived proximity of delayed rewards, while higher frontal activity (middle/superior frontal gyrus, posterior medial frontal cortex, cingulate) in participants with a lower date/delay effect suggests that the effect is particularly pronounced in participants avoiding complex arithmetic operations in the date condition.

Not all discounts are created equal: Regional activity and brain networks in temporal and effort discounting

Reward outcomes associated with costs like time delay and effort investment are generally discounted in decision-making. Standard economic models predict rewards associated with different types of costs are devalued in a similar manner. However, our review of rodent lesion studies indicated partial dissociations between brain regions supporting temporal- and effort-based decision-making. Another debate is whether options involving low and high costs are processed in different brain substrates (dual-system) or in the same regions (single-system). This research addressed these issues using coordinate-based, connectivity-based, and activation network-based meta-analyses to identify overlapping and separable neural systems supporting temporal (39 studies) and effort (20 studies) discounting. Coordinate-based activation likelihood estimation and resting-state connectivity analyses showed immediate-small reward and delayed-large reward choices engaged distinct regions with unique connectivity profiles, but their activation network mapping was found to engage the default mode network. For effort discounting, salience and sensorimotor networks supported low-effort choices, while the frontoparietal network supported high-effort choices. There was little overlap between the temporal and effort networks. Our findings underscore the importance of differentiating different types of costs in decision-making and understanding discounting at both regional and network levels.

Assessing the utility of a novel cortical marker of delay discounting (C-DD) in two independent samples of early adolescents: Links with externalizing pathology

Delay discounting is a well-established risk factor for risky behaviors and the development of externalizing spectrum disorders. Building upon recent work that developed a novel cortical marker of delay discounting (C-DD) in adult samples, the objective of this study was to test whether the C-DD relates to delay discounting and subsequently externalizing pathology in adolescent samples. The current study used two samples: 9992 early adolescents participating in the ABCD study (Mage = 9.93 years old, 48.7% female), and 56 early adolescents recruited from the community (Mage = 12.27 years old, 55.4% female). Cortical thickness was estimated using the FreeSurfer standard pipeline, and the cortical marker of delay discounting (C-DD) was calculated based on procedures outlined by the initial validation study. All data are cross-sectional in nature. As expected, C-DD was positively related to delay discounting in the ABCD sample, even after accounting for age, biological sex, collection site and data quality indicators. Moreover, results showed that C-DD was discriminately associated with externalizing, but not internalizing, symptoms in both samples of young adolescents. Findings replicate those found in adult samples, suggestive that C-DD may be a useful neuroanatomical marker of youth delay discounting. Replication of findings in other samples will be needed to determine whether C-DD has translational relevance to understanding externalizing psychopathology in adolescent samples.

Transcranial direct current stimulation (tDCS) over the orbitofrontal cortex reduces delay discounting

Delay discounting (DD) is a quantifiable psychological phenomenon that regulates decision-making. Nevertheless, the neural substrates of DD and its relationship with other cognitive domains are not well understood. The orbitofrontal cortex (OFC) is a potential candidate for supporting the expression of DD, but due to its wide involvement in several psychological functions and neural networks, its central role remains elusive. In this study, healthy subjects underwent transcranial direct current stimulation (tDCS) while performing an intertemporal choice task for the quantification of DD and a working memory task. To selectively engage the OFC, two electrode configurations have been tested, namely, anodal Fp1-cathodal Fp2 and cathodal Fp1-anodal Fp2. Our results show that stimulation of the OFC reduces DD, independently from electrode configuration. In addition, no relationship was found between DD measures and either working memory performance or baseline impulsivity assessed through established tests. Our work will direct future investigations aimed at unveiling the specific neural mechanisms underlying the involvement of the OFC in DD, and at testing the efficacy of OFC tDCS in reducing DD in psychological conditions where this phenomenon has been strongly implicated, such as addiction and eating disorders.

The neurophysiological Behavioral Perspective Model of consumer choice and its contribution to the intentional behaviorist research programme

Cognitive explanations raise epistemological problems not faced by accounts confined to observable variables. Many explanatory components of cognitive models are unobservable: beliefs, attitudes, and intentions, for instance, must be made empirically available to the researcher in the form of measures of observable behavior from which the latent variables are inferred. The explanatory variables are abstract and theoretical and rely, if they are to enter investigations and explanations, on reasoned agreement on how they can be captured by proxy variables derived from what people say and how they behave. Psychometrics must be founded upon a firm, intersubjective agreement among researchers and users of research on the relationship of behavioral measures to the intentional constructs to which they point and the latent variables they seek to operationalize. Only if these considerations are adequately addressed can we arrive at consistent interpretations of the data. This problem provides the substance of the intentional behaviorist research programme which seeks to provide a rationale for the cognitive explanation. Within this programme, two versions of the Behavioral Perspective Model (BPM), an extensional portrayal of socioeconomic behavior and a corresponding intentional approach, address the task of identifying where intentional explanation becomes necessary and the form it should take. This study explores a third version, based on neurophysiological substrates of consumer choice as a contributor to this task. The nature of "value" is closely related to the rationale for a neurophysiological model of consumer choice. The variables involved are operationally specified and measured with high intersubjective agreement. The intentional model (BPM-I), depicting consumer action in terms of mental processes such as perception, deliberation, and choice, extends the purview of the BPM to new situations and areas of explanation.

Age differences in the neural basis of decision-making under uncertainty

Humans globally are reaping the benefits of longer lives. Yet, longer life spans also require engaging with consequential but often uncertain decisions well into old age. Previous research has yielded mixed findings with regards to life span differences in how individuals make decisions under uncertainty. One factor contributing to the heterogeneity of findings is the diversity of paradigms that cover different aspects of uncertainty and tap into different cognitive and affective mechanisms. In this study, 175 participants (53.14% females, mean age = 44.9 years, SD = 19.0, age range = 16 to 81) completed functional neuroimaging versions of two prominent paradigms in this area, the Balloon Analogue Risk Task and the Delay Discounting Task. Guided by neurobiological accounts of age-related changes in decision-making under uncertainty, we examined age effects on neural activation differences in decision-relevant brain structures, and compared these across multiple contrasts for the two paradigms using specification curve analysis. In line with theoretical predictions, we find age differences in nucleus accumbens, anterior insula, and medial prefrontal cortex, but the results vary across paradigm and contrasts. Our results are in line with existing theories of age differences in decision making and their neural substrates, yet also suggest the need for a broader research agenda that considers how both individual and task characteristics determine the way humans deal with uncertainty.

Critical tests of fuzzy trace theory in brain and behavior: uncertainty across time, probability, and development

Uncertainty permeates decisions from the trivial to the profound. Integrating brain and behavioral evidence, we discuss how probabilistic (varied outcomes) and temporal (delayed outcomes) uncertainty differ across age and individuals; how critical tests adjudicate between theories of uncertainty (prospect theory and fuzzy-trace theory); and how these mechanisms might be represented in the brain. The same categorical gist representations of gains and losses account for choices and eye-tracking data in both value-allocation (add money to gambles) and risky-choice tasks, disconfirming prospect theory and confirming predictions of fuzzy-trace theory. The analysis is extended to delay discounting and disambiguated choices, explaining hidden-zero effects that similarly turn on categorical distinctions between some gain and no gain, certain gain and uncertain gain, gain and loss, and now and later. Bold activation implicates dorsolateral prefrontal and posterior parietal cortices in gist strategies that are not just one tool in a grab-bag of cognitive options but rather are general strategies that systematically predict behaviors across many different tasks involving probabilistic and temporal uncertainty. High valuation (e.g., ventral striatum; ventromedial prefrontal cortex) and low executive control (e.g., lateral prefrontal cortex) contribute to risky and impatient choices, especially in youth. However, valuation in ventral striatum supports reward-maximizing and gist strategies in adulthood. Indeed, processing becomes less "rational" in the sense of maximizing gains and more noncompensatory (eye movements indicate fewer tradeoffs) as development progresses from adolescence to adulthood, as predicted. Implications for theoretically predicted "public-health paradoxes" are discussed, including gist versus verbatim thinking in drug experimentation and addiction.

Value-based decision-making network functional connectivity correlates with substance use and delay discounting behaviour among young adults

Substance use disorders are characterized by reduced control over the quantity and frequency of psychoactive substance use and impairments in social and occupational functioning. They are associated with poor treatment compliance and high rates of relapse. Identification of neural susceptibility biomarkers that index risk for developing a substance use disorder can facilitate earlier identification and treatment. Here, we aimed to identify the neurobiological correlates of substance use frequency and severity amongst a sample of 1,200 (652 females) participants aged 22-37 years from the Human Connectome Project. Substance use behaviour across eight classes (alcohol, tobacco, marijuana, sedatives, hallucinogens, cocaine, stimulants, opiates) was measured using the Semi-Structured Assessment for the Genetics of Alcoholism. We explored the latent organization of substance use behaviour using a combination of exploratory structural equation modelling, latent class analysis, and factor mixture modelling to reveal a unidimensional continuum of substance use behaviour. Participants could be rank ordered along a unitary severity spectrum encompassing frequency of use of all eight substance classes, with factor score estimates generated to represent each participant's substance use severity. Factor score estimates and delay discounting scores were compared with functional connectivity in 650 participants with imaging data using the Network-based Statistic. This neuroimaging cohort excludes participants aged 31 and over. We identified brain regions and connections correlated with impulsive decision-making and poly-substance use, with the medial orbitofrontal, lateral prefrontal and posterior parietal cortices emerging as key hubs. Functional connectivity of these networks could serve as susceptibility biomarkers for substance use disorders, informing earlier identification and treatment.

Temporal discounting for self and friends in adolescence: A fMRI study

Adolescence is characterized by impulsivity but also by increased importance of friendships. This study took the novel perspective of testing temporal discounting in a fMRI task where choices could affect outcomes for 96 adolescents (aged 10-20-years) themselves and their best friend. Decisions either benefitted themselves (i.e., the Self Immediate - Self Delay' condition) or their friend (i.e., 'Friend Immediate - Friend Delay' condition); or juxtaposed rewards for themselves and their friends (i.e., the 'Self Immediate - Friend Delay' or 'Friend Immediate - Self Delay' conditions). We observed that younger adolescents were more impulsive; and all participants were more impulsive when this was associated with an immediate benefit for friends. Individual differences analyses revealed increased activity in the subgenual anterior cingulate cortex extending in the ventral striatum for immediate relative to delayed reward choices for self. Temporal choices were associated with activity in the prefrontal cortex, parietal cortex, insula, and ventral striatum, but only activity in the right inferior parietal lobe was associated with age. Finally, temporal delay choices for friends relative to self were associated with increased activity in the temporo-parietal junction and precuneus. Overall, this study shows a unique role of the social context in adolescents' temporal decision making.

Altered delay discounting in neurodegeneration: insight into the underlying mechanisms and perspectives for clinical applications

Steeper delay discounting (i.e., the extent to which future rewards are perceived as less valuable than immediate ones) has been proposed as a transdiagnostic process across different health conditions, in particular psychiatric disorders. Impulsive decision-making is a hallmark of different neurodegenerative conditions but little is known about delay discounting in the domain of neurodegenerative conditions. We reviewed studies on delay discounting in patients with Parkinson's disease (PD) and in patients with dementia (Alzheimer's disease / AD or frontotemporal dementia / FTD). We proposed that delay discounting could be an early marker of the neurodegenerative process. We developed the idea that altered delay discounting is associated with overlapping but distinct neurocognitive mechanisms across neurodegenerative diseases: dopaminergic-related disorders of reward processing in PD, memory/projection deficits due to medial temporal atrophy in AD, modified reward processing due to orbitofrontal atrophy in FTD. Neurodegeneration could provide a framework to decipher the neuropsychological mechanisms of value-based decision-making. Further, delay discounting could become a marker of interest in clinical practice, in particular for differential diagnosis.

Neural Correlates of Delay Discounting in the Light of Brain Imaging and Non-Invasive Brain Stimulation: What We Know and What Is Missed

In decision making, the subjective value of a reward declines with the delay to its receipt, describing a hyperbolic function. Although this phenomenon, referred to as delay discounting (DD), has been extensively characterized and reported in many animal species, still, little is known about the neuronal processes that support it. Here, after drawing a comprehensive portrait, we consider the latest neuroimaging and lesion studies, the outcomes of which often appear contradictory among comparable experimental settings. In the second part of the manuscript, we focus on a more recent and effective route of investigation: non-invasive brain stimulation (NIBS). We provide a comprehensive review of the available studies that applied transcranial magnetic stimulation (TMS) and transcranial direct current stimulation (tDCS) to affect subjects’ performance in DD tasks. The aim of our survey is not only to highlight the superiority of NIBS in investigating DD, but also to suggest targets for future experimental studies, since the regions considered in these studies represent only a fraction of the possible ones. In particular, we argue that, based on the available neurophysiological evidence from lesion and brain imaging studies, a very promising and underrepresented region for future neuromodulation studies investigating DD is the orbitofrontal cortex.

The brain stimulation of DLPFC regulates choice preference in intertemporal choice self-other differences

Intertemporal choice requires to make decision by evaluating the value of two options consisting of different times and benefits. The dorsolateral prefrontal cortex (DLPFC) is a key brain region for modulating intertemporal choice. The aim of this study is to investigate the effect of non-invasive brain stimulation over DLPFC on intertemporal choice behavior for self and others. We used transcranial direct current stimulation (tDCS) and continuous theta burst stimulation (cTBS) to stimulate bilateral DLPFC in two experiments respectively. After stimulation, subjects made a choice between a Smaller-Sooner (SS) reward and a Larger-Later (LL) reward in intertemporal choice task. The results showed that cTBS stimulation on the left DLPFC reduced the choice preference for SS reward when individuals made choices for themselves. The cTBS stimulation caused preference difference between choosing for self and parents. But tDCS stimulation had no effect on regulating choice preference. In addition, subjects preferred SS reward for self than strangers. Time-types and monetary difference of rewards affected the choice preference. The presence of immediate time increased the choice preference of SS reward. As the monetary difference increased, the choice proportion of SS reward decreased. Our study demonstrates that brain stimulation on the left DLPFC can regulate choice preference behavior in intertemporal choice.

Excessive response to provocation rather than disinhibition mediates irritable behaviour in Huntington's disease

Background

Irritable and impulsive behaviour are common in Huntington's disease (HD: an autosomal dominant disorder causing degeneration in cortico-striatal networks). However, the cognitive mechanisms underlying these symptoms remain unclear, and previous research has not determined if common mechanisms underpin both symptoms. Here we used established and novel tasks to probe different aspects of irritable and impulsive behaviour to determine the neural mechanisms involved.

Methods

We recruited a cohort of 53 gene positive HD participants and 26 controls from non-affected family members and local volunteers. We used established questionnaire measures of irritability in HD (Snaith Irritability Scale, Problem Behaviours Assessment) and impulsivity [Urgency, Premeditation Perseverance, Sensation-seeking, Positive urgency scale (UPPSP), Barratt Impulsivity Scale], in addition to cognitive tasks of provocation, motor inhibition, delay discounting and decision making under uncertainty. We used generalised linear models to determine differences between cases and controls, and associations with irritability in the HD group.

Results

We found differences between cases and controls on the negative urgency subscale of the UPPSP, which was associated with irritability in HD. The frustrative non-reward provocation task also showed differences between cases and controls, in addition to predicting irritability in HD. The stop signal reaction time task showed case-control differences but was not associated with irritability in HD. None of the other measures showed group differences or predicted irritability in HD after correcting for confounding variables.

Discussion

Irritability in HD is mediated by excessive response to provocation, rather than a failure of motor inhibition.

Achieving and sustaining behavior change for older adults: A Research Centers Collaborative Network workshop report

Modifying unhealthy behaviors and/or environments may improve or maintain an older adult's health. However, achieving and sustaining behavior change is challenging and depends upon clinical, social, psychological, and political domains. In an effort to highlight the multidisciplinary nature of behavior change, the NIA Research Centers Collaborative Network (RCCN) held a two-day workshop, Achieving and sustaining behavior change for older adults. The workshop was informed by the socioecological model and designed to initiate dialogue around individual, community, and systems-level determinants of behavior change. This paper summarizes key topics presented during the workshop, discusses opportunities for future research, education, and training, and recommends how each of the six NIA research centers may pursue work in behavior change for older adults.

Interindividual differences in intergenerational sustainable behavior are associated with cortical thickness of the dorsomedial and dorsolateral prefrontal cortex

Intergenerational sustainability requires people of the present generation to make sacrifices today to benefit others of future generations (e.g. mitigating climate change, reducing public debt). Individuals vary greatly in their intergenerational sustainability, and the cognitive and neural sources of these interindividual differences are not yet well understood. We here combined neuroscientific and behavioral methods by assessing interindividual differences in cortical thickness and by using a common-pool resource paradigm with intergenerational contingencies. This enabled us to look for objective, stable, and trait-like neural markers of interindividual differences in consequential intergenerational behavior. We found that individuals behaving sustainably (vs. unsustainably) were marked by greater cortical thickness of the dorsomedial and dorsolateral prefrontal cortex. Given that these brain areas are involved in perspective-taking and self-control and supported by mediation analyses, we speculate that greater cortical thickness of these brain areas better enable individuals to take the perspective of future generations and to resist temptations to maximize personal benefits that incur costs for future generations. By meeting recent calls for the contribution of neuroscience to sustainability research, it is our hope that the present study advances the transdisciplinary understanding of interindividual differences in intergenerational sustainability.

Contrasting effects of DOI and lisuride on impulsive decision-making in delay discounting task

RATIONALE

The 5-HT2A receptor is the major target of classic hallucinogens. Both DOI (2,5-dimethoxy-4-iodoamphetamine) and lisuride act at 5-HT2A receptors, and lisuride shares comparable affinity with DOI and acts as a partial agonist at 5-HT2A receptors. However, not like DOI, lisuride lacks hallucinogenic properties. Impulsive decision-making refers to the preference for an immediate small reinforcer (SR) over a delayed large reinforcer (LR).

OBJECTIVES

The current study aims to compare the effects of DOI and lisuride on impulsive decision-making and further to investigate the possible receptor mechanisms responsible for the actions of the two drugs.

METHODS

Impulsive decision-making was evaluated in male Sprague-Dawley rats by the percentage of choice for the LR in delay discounting task (DDT). Delay to the LR changed in an ascending order (0, 4, 8, 16, and 32 s) across one session.

RESULTS

DOI (0.5 and 1.0 mg/kg) increased impulsive decision-making, and the effects of DOI (1.0 mg/kg) were blocked by the 5-HT2A receptor antagonist ketanserin (1.0 mg/kg) rather than the 5-HT2C receptor antagonist SB-242084 (1.0 mg/kg). Contrarily, lisuride (0.1, 0.3, and 0.5 mg/kg) decreased impulsive decision-making. The effects of lisuride (0.3 mg/kg) were not antagonized by ketanserin (1.0 mg/kg), selective 5-HT1A antagonist WAY-100635 (1.0 mg/kg), or selective dopamine D4 receptor antagonist L-745870 (1.0 mg/kg) but were attenuated by the selective dopamine D2/D3 receptor antagonist tiapride (40 mg/kg).

CONCLUSIONS

DOI and lisuride have contrasting effects on impulsive decision-making via distinct receptors. DOI-induced increase of impulsivity is mediated by the 5-HT2A receptor, while lisuride-induced inhibition of impulsivity is regulated by the dopamine D2/D3 receptor.

Internally Triggered Experiences of Hedonic Valence in Nonhuman Animals: Cognitive and Welfare Considerations

Do any nonhuman animals have hedonically valenced experiences not directly caused by stimuli in their current environment? Do they, like us humans, experience anticipated or previously experienced pains and pleasures as respectively painful and pleasurable? We review evidence from comparative neuroscience about hippocampus-dependent simulation in relation to this question. Hippocampal sharp-wave ripples and theta oscillations have been found to instantiate previous and anticipated experiences. These hippocampal activations coordinate with neural reward and fear centers as well as sensory and cortical areas in ways that are associated with conscious episodic mental imagery in humans. Moreover, such hippocampal “re- and preplay” has been found to contribute to instrumental decision making, the learning of value representations, and the delay of rewards in rats. The functional and structural features of hippocampal simulation are highly conserved across mammals. This evidence makes it reasonable to assume that internally triggered experiences of hedonic valence (IHVs) are pervasive across (at least) all mammals. This conclusion has important welfare implications. Most prominently, IHVs act as a kind of “welfare multiplier” through which the welfare impacts of any given experience of pain or pleasure are increased through each future retrieval. However, IHVs also have practical implications for welfare assessment and cause prioritization.

Lateral Orbitofrontal Cortex and Basolateral Amygdala Regulate Sensitivity to Delayed Punishment during Decision-making

In real-world decision-making scenarios, negative consequences do not always occur immediately after a choice. This delay between action and outcome drives the underestimation, or "delay discounting", of punishment. While the neural substrates underlying sensitivity to immediate punishment have been well-studied, there has been minimal investigation of delayed consequences. Here, we assessed the role of lateral orbitofrontal cortex (LOFC) and basolateral amygdala (BLA), two regions implicated in cost/benefit decision-making, in sensitivity to delayed vs immediate punishment. The delayed punishment decision-making task (DPDT) was used to measure delay discounting of punishment in rodents. During DPDT, rats choose between a small, single pellet reward and a large, three pellet reward accompanied by a mild foot shock. As the task progresses, the shock is preceded by a delay that systematically increases or decreases throughout the session. We observed that rats avoid choices associated with immediate punishment, then shift preference toward these options when punishment is delayed. LOFC inactivation did not influence choice of rewards with immediate punishment, but decreased choice of delayed punishment. We also observed that BLA inactivation reduced choice of delayed punishment for ascending but not descending delays. Inactivation of either brain region produced comparable effects on decision-making in males and females, but there were sex differences observed in omissions and latency to make a choice. In summary, both LOFC and BLA contribute to the delay discounting of punishment and may serve as promising therapeutic targets to improve sensitivity to delayed punishment during decision-making.Significance StatementNegative consequences occurring after a delay are often underestimated, which can lead to maladaptive decision-making. While sensitivity to immediate punishment during reward-seeking has been well-studied, the neural substrates underlying sensitivity to delayed punishment remain unclear. Here, we used the Delayed Punishment Decision-making Task to determine that lateral orbitofrontal cortex and basolateral amygdala both regulate the discounting of delayed punishment, suggesting that these regions may be potential targets to improve decision-making in psychopathology.

Delay discounting and alcohol consumption correlate with dorsal anterior insula activation during choice in nontreatment-seeking heavy drinkers

BACKGROUND

The anterior insular cortex (AIC), a prominent salience network node, integrates interoceptive information and emotional states into decision making. While AIC activation during delay discounting (DD) in alcohol use disorder (AUD) has been previously reported, the associations between AIC activation, impulsive choice, alcohol consumption, and connectivity remain unknown. We therefore tested AIC brain responses during DD in heavy drinkers and their association with DD performance, alcohol drinking, and task-based connectivity.

METHODS

Twenty-nine heavy drinkers (12 females; mean (SD) age=31.5 ± 6.1 years; mean (SD)=40.8 ± 23.4 drinks/week) completed a DD task during functional MRI. Regions activated during DD decision making were tested for correlation with DD behavior and alcohol drinking. Psychophysiological interaction (PPI) models assessed the task-dependent functional connectivity (FC) of activation during choice.

RESULTS

Delay discounting choice activated bilateral anterior insular cortex, anterior cingulate cortex, and left precentral gyrus. Right dorsal (d) AIC activation during choice negatively correlated withdiscounting of delayed rewards and alcohol consumption. PPI analysis revealed FC of the right dAIC to both the anterior and posterior cingulate cortices-key nodes in the midline default mode network.

CONCLUSIONS

Greater dAIC involvement in intertemporal choice may confer more adaptive behavior (lower impulsivity and alcohol consumption). Moreover, salience network processes governing discounting may require midline default mode (precuneus/posterior cingulate cortex) recruitment. These findings supporta key adaptive role for right dAIC in decision making involving future rewards and risky drinking.

Simulating the best and worst of times: the powers and perils of emotional simulation

We are remarkably capable of simulating events that we have never experienced. These simulated events often paint an emotional picture to behold, such as the best and worst possible outcomes that we might face. This review synthesises dispersed literature exploring the role of emotion in simulation. Drawing from work that suggests that simulations can influence our preferences, decision-making, and prosociality, we argue for a critical role of emotion in informing the consequences of simulation. We further unpack burgeoning evidence suggesting that the effects of emotional simulation transcend the laboratory. We propose avenues by which emotional simulation may be harnessed for both personal and collective good in applied contexts. We conclude by offering important future directions.

Delay of gratification dissociates cognitive control and valuation brain regions in healthy young adults

Delay of gratification (DofG) refers to an inter-temporal choice phenomenon that is of great interest in many domains, including animal learning, cognitive development, economic decision-making, and executive control. Yet experimental tools for investigating DofG in human adults are almost non-existent, and as a consequence, very little is known regarding the brain basis of core DofG behaviors. Here, we utilize a novel DofG paradigm, adapted for use in neuroimaging contexts, to examine event-related changes in neural activity as healthy young adult participants made repeated choices to continue waiting for a delayed reward, rather than take an immediately available one of lesser value. On DofG trials, choose-to-wait events were associated with increased activation in fronto-parietal and cingulo-opercular regions associated with cognitive control. Activity in the right lateral prefrontal cortex (PFC) was also associated with individual variability in task performance and strategy. Fronto-parietal activity was clearly dissociable from that observed in ventromedial PFC, as this latter region exhibited a ramping-up pattern of activity during the waiting period prior to reward delivery. Ventromedial PFC ramping activity dynamics were further selective to DofG trials associated with increased future reward rate, consistent with the involvement of this region in subjective reward valuation that incorporates higher-order task structure. These results provide important initial validation of this experimental paradigm as a useful tool for investigating and isolating unique DofG neural mechanisms, which can now be utilized to study a wide-variety of populations and task factors.

Neurobehavioral maturation of motor response inhibition in adolescence - A narrative review

Immature motor response inhibition in adolescence is considered contributory to adolescent risk-taking and externalizing behaviors. We review studies reporting age-related variations in motor response inhibition and MRI measurements from typically-developing adolescents. Reviewed studies measured response inhibition using one of three tasks-the Stop Signal Task, Go/No-Go, and Antisaccade Task. Task reliability appears to be particularly strong for the SST. Across tasks and study designs, results indicate that inhibitory control improves markedly through early adolescence. The trajectory of change in later adolescence and into young adulthood (i.e., linear or plateauing) varies depending on the task design. Neuroimaging studies identify adult-like response inhibition networks that are involved in behavioral development. The pros and cons of each task are discussed, including recommendations to guide future studies. Ongoing studies in large longitudinal datasets offer opportunities for further exploration of the shape of change in response inhibition, related neural regions, and associations with other affective and cognitive processes to identify potential impacts of motor response inhibition immaturities or individual differences on adolescent risk-taking behaviors.

The Resting-State Neural Network of Delay Discounting

Delay discounting is a common phenomenon in daily life, which refers to the subjective value of a future reward decreasing as a function of time. Previous studies have identified several cortical regions involved in delay discounting, but the neural network constructed by the cortical regions of delay discounting is less clear. In this study, we employed resting-state functional magnetic resonance imaging (RS-fMRI) to measure the spontaneous neural activity in a large sample of healthy young adults and used the Monetary Choice Questionnaire to directly measure participants’ level of delay discounting. To identify the neural network of delay discounting at rest, we used an individual difference approach to explore brain regions whose spontaneous activities were related to delay discounting across the whole brain. Then, these brain regions served as seeds to identify the neural network of delay discounting. We found that the fractional amplitude of low-frequency fluctuations (fALFF) of the left insula were positively correlated to delay discounting. More importantly, its connectivity to the anterior cingulate cortex was read out for participants’ behavioral performance in the task of delay discounting. In short, our study provides empirical evidence that insula-anterior cingulate cortex connectivity may serve as a part of the neural network for delay discounting.

Unifying Evidence on Delay Discounting: Open Task, Analysis Tutorial, and Normative Data from an Italian Sample

Despite the widespread use of the delay discounting task in clinical and non-clinical contexts, several task versions are available in the literature, making it hard to compare results across studies. Moreover, normative data are not available to evaluate individual performances. The present study aims to propose a unified version of the delay discounting task based on monetary rewards and it provides normative values built on an Italian sample of 357 healthy participants. The most used parameters in the literature to assess the delay discount rate were compared to find the most valid index to discriminate between normative data and a clinical population who typically present impulsivity issues, i.e., patients with a lesion to the medial orbitofrontal cortex (mOFC). In line with our hypothesis, mOFC patients showed higher delay discounting scores than the normative sample and the normative group. Based on this evidence, we propose that the task and indexes here provided can be used to identify extremely high (above the 90th percentile for hyperbolic k or below the 10th percentile for AUC) or low (below the 10th percentile for hyperbolic k or above the 90th percentile for AUC) delay discounting performances. The complete dataset, the R code used to perform all analyses, a free and modifiable version of the delay discounting task, as well as the R code that can be used to extract all indexes from such tasks and compare subjective performances with the normative data here presented are available as online materials.

Deprivation Has Inconsistent Effects on Delay Discounting: A Review

Delay discounting, the tendency for outcomes to be devalued as they are more temporally remote, has implications as a target for behavioral interventions. Because of these implications, it is important to understand how different states individuals may face, such as deprivation, influence the degree of delay discounting. Both dual systems models and state-trait views of delay discounting assume that deprivation may result in steeper delay discounting. Despite early inconsistencies and mixed results, researchers have sometimes asserted that deprivation increases delay discounting, with few qualifications. The aim of this review was to determine what empirical effect, if any, deprivation has on delay discounting. We considered many kinds of deprivation, such as deprivation from sleep, drugs, and food in humans and non-human animals. For 23 studies, we analyzed the effect of deprivation on delay discounting by computing effect sizes for the difference between delay discounting in a control, or baseline, condition and delay discounting in a deprived state. We discuss these 23 studies and other relevant studies found in our search in a narrative review. Overall, we found mixed effects of deprivation on delay discounting. The effect may depend on what type of deprivation participants faced. Effect sizes for deprivation types ranged from small for sleep deprivation (Hedge's gs between −0.21 and 0.07) to large for opiate deprivation (Hedge's gs between 0.42 and 1.72). We discuss possible reasons why the effect of deprivation on delay discounting may depend on deprivation type, including the use of imagined manipulations and deprivation intensity. The inconsistency in results across studies, even when comparing within the same type of deprivation, indicates that more experiments are needed to reach a consensus on the effects of deprivation on delay discounting. A basic understanding of how states affect delay discounting may inform translational efforts.

Brain responses during delay discounting in youth at high-risk for substance use disorders

Offspring of parents with substance use disorders (SUD) discount future rewards at a steeper rate on the monetary delay discounting task (DD) than typically developing youth. However, brain activation during DD has yet to be studied in drug naïve youth with a family history (FH) of SUD. Here, we investigate brain activation differences in high-risk youth during DD. We recruited substance naïve youth, aged 11-12, into three groups to compare brain activation during DD: (1) High-risk youth (n = 35) with a FH of SUD and externalizing psychiatric disorders, (2) psychiatric controls (n = 25) who had no FH of SUD, but with equivalent externalizing psychiatric disorders as high-risk youth, and (3) a healthy control group (n = 24) with no FH of SUD and minimal psychopathology. A whole-brain voxel wise analysis of the [Delay > Baseline], [Immediate > Baseline], and [Control > Baseline] contrasts identified functional regions of interest, from which extracted parameter estimates were tested for significant group differences. Relative to control youth, high-risk youth showed stronger activation in the left posterior insula and thalamus when making delayed choices, and stronger activation of the parahippocampal gyrus when making both delayed and control choices (ps < 0.05). Activation in the left posterior insula negatively correlated with both subscales of the Emotion Regulation Checklist, and positively correlated with the Stroop interference effect (ps < 0.05). Our findings suggest possible heritable SUD risk neural markers that distinguish drug naïve high-risk youth from psychiatric and healthy controls.

Global Cerebral Ischemia in Male Long Evans Rats Impairs Dopaminergic/ΔFosB Signalling in the Mesocorticolimbic Pathway Without Altering Delay Discounting Rates

Global cerebral ischemia (GCI) in rats has been shown to promote exploration of anxiogenic zones of the Elevated-Plus Maze (EPM) and Open Field Test (OFT). This study investigated changes in impulsive choice and/or defensive responses as possible contributors of heightened anxiogenic exploration observed after ischemia. Impulsivity was assessed using delay discounting (DD) paradigms, while the Predator Odour Test (PO) served to assess changes in defensive responses towards a naturally aversive stimulus. Male Long Evans rats underwent 9 days of autoshaping training and 24 days of DD training prior to GCI or sham surgery (n = 9/group). Post-surgery, rats completed the OFT, EPM, and PO, followed by 6 days of DD sessions. Blood droplets served to evaluate corticosterone secretion associated with PO exposure. With impulsivity being regulated through mesocorticolimbic monoaminergic pathways, we also characterised post-ischemic changes in the expression of dopamine D₂ receptors (DRD₂), dopamine transporters (DAT), and 1FosB in the basolateral amygdala (BLA), nucleus accumbens core (NAcC) and shell (NAcS), and ventromedial prefrontal cortex (vmPFC) using immunohistofluorescence. Our findings revealed no impact of GCI on delay discounting rates, while PO approach behaviours were minimally affected. Nonetheless, GCI significantly reduced DRD₂ and ΔFosB-ir in the NAcS and NAcC, respectively, while DAT-ir was diminished in both NAc subregions. Collectively, our findings refine the understanding of cognitive-behavioural and biochemical responses following stroke or cardiac arrest. They support significant alterations to the dopaminergic mesocorticolimbic pathway after ischemia, which are not associated with altered impulsive choice in a DD task but may influence locomotor exploration of the OFT and EPM.

Alcohol use and interoception - A narrative review

Interoception, defined as the ability to perceive and interpret body signals, may play an important role in alcohol use disorder (AUD). Earlier studies suggested an association between interoception impairment and known risk factors for AUD (e.g., alexithymia, emotion dysregulation, impulsivity, pain). Neurobiological studies show that the neurotoxicity of alcohol affects various elements of the interoceptive system (especially the insula) at structural and functional levels, with differential short/long term impacts. Conversely, primary interoceptive impairments may promote alcohol consumption and foster the evolution towards addiction. Despite convincing evidence demonstrating that interoception impairment may be an important contributor to the development and course of AUD, only a few studies directly evaluated interoceptive abilities in AUD. The research shows that interoceptive accuracy, the objective component of interoception, is lower in AUD individuals, and is correlated with craving and emotion dysregulation. Interoceptive sensibility is in turn higher in AUD individuals compared to healthy controls. Moreover, there is evidence that therapy focused on improving the ability to sense signals from the body in addiction treatment is effective. However, important methodological limitations in interoceptive measures persist, and it is therefore necessary to further investigate the associations between interoception and AUD.

Reduced sensitivity to delayed time and delayed reward of the post-operative insular glioma patients in delay discounting

Previous studies have shown that the insula is closely related to addiction, and the structure's role in delay discounting can be measured by a specific task, but the specific role of the insula has been less studied. In this study, we first conducted a lesion study in which we recruited healthy controls (n = 30) and patients with unilateral insula injury (n = 16) to complete a behavioral delay discounting task. Then we conducted a functional magnetic resonance imaging (fMRI) study, and a separate group healthy volunteers (n = 51) completed a delay discounting task during the fMRI scan. The lesion study showed a significant difference between the two groups in the delay discounting task, which revealed that insula injury was associated with impaired decision making. The fMRI study revealed choice-sensitive insula activation that was modulated by delayed time and delayed reward, indicating an important role of the insula in delay discounting. Overall, our results provide evidence for a role of the insular lobe in delay discounting and suggests that this structure may be considered an important factor in the future treatment and diagnosis of addiction disorders.

Neurocomputational mechanisms engaged in moral choices and moral learning

The neural circuitry involved in moral decisions has been studied since the early days of cognitive neuroscience, mainly using moral dilemma. However, the neurocomputational mechanisms describing how the human brain makes moral decisions and learns in various moral contexts are only starting to be established. Here we review recent results from an emerging field using model-based fMRI, which describes moral choices at a mechanistic level. These findings unify the field of moral decision making, extend a conceptual framework previously developed for value-based decision making and characterize how moral processes are computed in the brain. Moral dilemma can be modeled as value-based decisions that weigh self-interests against moral costs/harm to others and different types of prediction errors can be distinguished in different aspects of moral learning. These key computational signals help to describe moral choices and moral learning at an algorithmic level and to reveal how these cognitive operations are implemented in the brain. This researches provide a foundation to account for the neurocomputational mechanisms underlying moral decision making.

The sooner the better: clinical and neural correlates of impulsive choice in Tourette disorder

Reward sensitivity has been suggested as one of the central pathophysiological mechanisms in Tourette disorder. However, the subjective valuation of a reward by introduction of delay has received little attention in Tourette disorder, even though it has been suggested as a trans-diagnostic feature of numerous neuropsychiatric disorders. We aimed to assess delay discounting in Tourette disorder and to identify its brain functional correlates. We evaluated delayed discounting and its brain functional correlates in a large group of 54 Tourette disorder patients and 31 healthy controls using a data-driven approach. We identified a subgroup of 29 patients with steeper reward discounting, characterised by a higher burden of impulse-control disorders and a higher level of general impulsivity compared to patients with normal behavioural performance or to controls. Reward discounting was underpinned by resting-state activity of a network comprising the orbito-frontal, cingulate, pre-supplementary motor area, temporal and insular cortices, as well as ventral striatum and hippocampus. Within this network, (i) lower connectivity of pre-supplementary motor area with ventral striatum predicted a higher impulsivity and a steeper reward discounting and (ii) a greater connectivity of pre-supplementary motor area with anterior insular cortex predicted steeper reward discounting and more severe tics. Overall, our results highlight the heterogeneity of the delayed reward processing in Tourette disorder, with steeper reward discounting being a marker of burden in impulsivity and impulse control disorders, and the pre-supplementary motor area being a hub region for the delay discounting, impulsivity and tic severity.

Music-induced emotions influence intertemporal decision making

People tend to choose smaller, immediate rewards over larger, delayed rewards. This phenomenon is thought to be associated with emotional engagement. However, few studies have demonstrated the real-time impact of incidental emotions on intertemporal choices. This research investigated the effects of music-induced incidental emotions on intertemporal choices, during which happy or sad music was played simultaneously. We found that music-induced happiness made participants prefer smaller-but-sooner rewards (SS), whereas music-induced sadness made participants prefer larger-but-later rewards (LL). Time perception partially mediated this effect: the greater the perceived temporal difference, the more likely they were to prefer SS. Tempo and mode were then manipulated to disentangle the effects of arousal and mood on intertemporal choices. Only tempo-induced arousal, but not mode-induced mood, affected intertemporal choices. These results suggest the role of arousal in intertemporal decision making and provide evidence in support of equate-to-differentiate theory with regard to the non-compensatory mechanism in intertemporal choices.

Functional Abnormality of the Executive Control Network in Individuals With Obesity During Delay Discounting

Individuals with obesity (OB) prefer immediate rewards of food intake over the delayed reward of healthy well-being achieved through diet management and physical activity, compared with normal-weight controls (NW). This may reflect heightened impulsivity, an important factor contributing to the development and maintenance of obesity. However, the neural mechanisms underlying the greater impulsivity in OB remain unclear. Therefore, the current study employed functional magnetic resonance imaging with a delay discounting (DD) task to examine the association between impulsive choice and altered neural mechanisms in OB. During decision-making in the DD task, OB compared with NW had greater activation in the dorsolateral prefrontal cortex (DLPFC) and posterior parietal cortex, which was associated with greater discounting rate and weaker cognitive control as measured with the Three-Factor Eating Questionnaire (TFEQ). In addition, the association between DLPFC activation and cognitive control (TFEQ) was mediated by discounting rate. Psychophysiological interaction analysis showed decreased connectivity of DLPFC-inferior parietal cortex (within executive control network [ECN]) and angular gyrus-caudate (ECN-reward) in OB relative to NW. These findings reveal that the aberrant function and connectivity in core regions of ECN and striatal brain reward regions underpin the greater impulsivity in OB and contribute to abnormal eating behaviors.

Brain multimodal co-alterations related to delay discounting: a multimodal MRI fusion analysis in persons with and without cocaine use disorder

BACKGROUND

Delay discounting has been proposed as a behavioral marker of substance use disorders. Innovative analytic approaches that integrate information from multiple neuroimaging modalities can provide new insights into the complex effects of drug use on the brain. This study implemented a supervised multimodal fusion approach to reveal neural networks associated with delay discounting that distinguish persons with and without cocaine use disorder (CUD).

METHODS

Adults with (n = 35) and without (n = 37) CUD completed a magnetic resonance imaging (MRI) scan to acquire high-resolution anatomical, resting-state functional, and diffusion-weighted images. Pre-computed features from each data modality included whole-brain voxel-wise maps for gray matter volume, fractional anisotropy, and regional homogeneity, respectively. With delay discounting as the reference, multimodal canonical component analysis plus joint independent component analysis was used to identify co-alterations in brain structure and function.

RESULTS

The sample was 58% male and 78% African-American. As expected, participants with CUD had higher delay discounting compared to those without CUD. One joint component was identified that correlated with delay discounting across all modalities, involving regions in the thalamus, dorsal striatum, frontopolar cortex, occipital lobe, and corpus callosum. The components were negatively correlated with delay discounting, such that weaker loadings were associated with higher discounting. The component loadings were lower in persons with CUD, meaning the component was expressed less strongly.

CONCLUSIONS

Our findings reveal structural and functional co-alterations linked to delay discounting, particularly in brain regions involved in reward salience, executive control, and visual attention and connecting white matter tracts. Importantly, these multimodal networks were weaker in persons with CUD, indicating less cognitive control that may contribute to impulsive behaviors.

Neural and computational mechanisms of momentary fatigue and persistence in effort-based choice

From a gym workout, to deciding whether to persevere at work, many activities require us to persist in deciding that rewards are ‘worth the effort’ even as we become fatigued. However, studies examining effort-based decisions typically assume that the willingness to work is static. Here, we use computational modelling on two effort-based tasks, one behavioural and one during fMRI. We show that two hidden states of fatigue fluctuate on a moment-to-moment basis on different timescales but both reduce the willingness to exert effort for reward. The value of one state increases after effort but is ‘recoverable’ by rests, whereas a second ‘unrecoverable’ state gradually increases with work. The BOLD response in separate medial and lateral frontal sub-regions covaried with these states when making effort-based decisions, while a distinct fronto-striatal system integrated fatigue with value. These results provide a computational framework for understanding the brain mechanisms of persistence and momentary fatigue.

The willingness to exert effort into demanding tasks often declines over time through fatigue. Here the authors provide a computational account of the moment-to-moment dynamics of fatigue and its impact on effort-based choices, and reveal the neural mechanisms that underlie such computations.

Reward/Punishment-Based Decision Making in Rodents

Deficits in decision making are at the heart of many psychiatric diseases, such as substance abuse disorders and attention deficit hyperactivity disorder. Consequently, rodent models of decision making are germane to understanding the neural mechanisms underlying adaptive choice behavior and how such mechanisms can become compromised in pathological conditions. A critical factor that must be integrated with reward value to ensure optimal decision making is the occurrence of consequences, which can differ based on probability (risk of punishment) and temporal contiguity (delayed punishment). This article will focus on two models of decision making that involve explicit punishment, both of which recapitulate different aspects of consequences during human decision making. We will discuss each behavioral protocol, the parameters to consider when designing an experiment, and finally how such animal models can be utilized in studies of psychiatric disease. © 2020 Wiley Periodicals LLC. Basic Protocol 1: Behavioral training Support Protocol: Equipment testing Alternate Protocol: Reward discrimination Basic Protocol 2: Risky decision-making task (RDT) Basic Protocol 3: Delayed punishment decision-making task (DPDT).

Translating Interventional Neuroscience to Suicide: It's About Time

Despite significant advances in psychiatric and psychological treatment over the last 30 years, suicide deaths have increased. Unfortunately, neuroscience insights have yielded few translational interventions that specifically target suicidal thoughts and behaviors. In our view, this is attributable to two factors. The first factor is our limited integration of neurocircuitry models with contemporary suicide theory. The second challenge is inherent to the variable nature of suicide risk over time. Few interventional neuroscience studies evaluate how temporal fluctuations in risk affect treatment, despite evidence that temporality is a key component distinguishing suicide phenotypes. To wit, individual variability in risk trajectories may provide different treatment targets to engage as a patient moves between suicidal ideation and attempt. Here, we first review contemporary ideation-to-action theories of suicide from a neurobiological perspective, focusing on valence and executive function circuits and the key role of state-induced (e.g., within stressful contexts) functional modulation on longitudinal risk trajectories. We then describe neural correlates of suicide reduction following various interventions, ranging from circuit specific (i.e., transcranial magnetic stimulation) to broader pharmacological (i.e., ketamine, lithium) to psychological (i.e., brief cognitive therapy). We then introduce novel strategies for tracking risk in naturalistic settings and real time using ecological momentary interventions. We provide a critical integration of the literature focusing on the intersection between targets and temporality, and we conclude by proposing novel research designs integrating real-time and biologically based interventions to generate novel strategies for future suicide reduction research.

Explaining socioeconomic disparities in health behaviours: A review of biopsychological pathways involving stress and inflammation

The purpose of this article was to explore how individuals' position in a socioeconomic hierarchy is related to health behaviours that are related to socioeconomic disparities in health. We identified research which shows that: (a) low socioeconomic status (SES) is associated with living in harsh environments, (b) harsh environments are related to increased levels of stress and inflammation, (c) stress and inflammation impact neural systems involved in self-control by sensitising the impulsive system and desensitising the reflective system, (d) the effects are inflated valuations of small immediate rewards and deflated valuations of larger delayed rewards, (e) these effects are observed as increased delay discounting, and (f) delay discounting is positively associated with practicing more unhealthy behaviours. The results are discussed within an adaptive evolutionary framework which lays out how the stress response system, and its interaction with the immune system and brain systems for decision-making and behaviours, provides the biopsychological mechanisms and regulatory shifts that make widespread conditional adaptability possible. Consequences for policy work, interventions, and future research are discussed.

Individual Differences in Intertemporal Choice

Intertemporal choice involves deciding between smaller, sooner and larger, later rewards. People tend to prefer smaller rewards that are available earlier to larger rewards available later, a phenomenon referred to as temporal or delay discounting. Despite its ubiquity in human and non-human animals, temporal discounting is subject to considerable individual differences. Here, we provide a critical narrative review of this literature and make suggestions for future work. We conclude that temporal discounting is associated with key socio-economic and health-related variables. Regarding personality, large-scale studies have found steeper temporal discounting to be associated with higher levels of self-reported impulsivity and extraversion; however, effect sizes are small. Temporal discounting correlates negatively with future-oriented cognitive styles and inhibitory control, again with small effect sizes. There are consistent associations between steeper temporal discounting and lower intelligence, with effect sizes exceeding those of personality or cognitive variables, although socio-demographic moderator variables may play a role. Neuroimaging evidence of brain structural and functional correlates is not yet consistent, neither with regard to areas nor directions of effects. Finally, following early candidate gene studies, recent Genome Wide Association Study (GWAS) approaches have revealed the molecular genetic architecture of temporal discounting to be more complex than initially thought. Overall, the study of individual differences in temporal discounting is a maturing field that has produced some replicable findings. Effect sizes are small-to-medium, necessitating future hypothesis-driven work that prioritizes large samples with adequate power calculations. More research is also needed regarding the neural origins of individual differences in temporal discounting as well as the mediating neural mechanisms of associations of temporal discounting with personality and cognitive variables.

Delay discounting and neurocognitive correlates among inner city adolescents with and without family history of substance use disorder

Adolescents with a family history (FH+) of substance use disorder (SUD) are at a greater risk for SUD, suggested to be partly due to the transmission of behavioral impulsivity. We used a delay discounting task to compare impulsivity in decision-making and its associated brain functioning among FH+ and FH - minority adolescents. Participants chose between Smaller Sooner (SS) and Larger Later (LL) rewards. The SS was available immediately (Now trials) or in the future (Not-Now trials), allowing for greater differentiation between impulsive decisions. The FH+ group showed greater impatience by responding SS more frequently than the FH - group, only on the Now trials, and even when the relative reward differences (RRD) increased. Surprisingly, there were no differences in brain activity between the groups. Combined, the groups showed greater reward activity during the Now vs. Not-Now trials in medial prefrontal/anterior cingulate, posterior cingulate, precuneus, and inferior frontal gyrus (i.e., an immediacy effect). As the RRD increased activation in the reward network decreased, including the striatum, possibly reflecting easy decision-making. These results indicate that risk for SUD, seen behaviorally among FH+ adolescents, may not yet be associated with discernable brain changes, suggesting that early intervention has the potential to reduce this risk.

Inference and preference in intertemporal choice

When choosing between immediate and future rewards, how do people deal with uncertainty about the value of the future outcome or the delay until its occurrence? Skylark et al. (2020) suggested that people employ a delay-reward heuristic: the inferred value of an ambiguous future reward is a function of the stated delay, and vice-versa. The present paper investigates the role of this heuristic in choice behaviour. In Studies 1a–2b, participants inferred the value of an ambiguous future reward or delay before the true value was revealed and a choice made. Preference for the future option was predicted by the discrepancy between the estimated and true values: the more pleasantly surprising the delayed option, the greater the willingness to choose it. Studies 3a–3c examined the association between inference and preference when the ambiguous values remained unknown. As predicted by the use of a delay-reward heuristic, inferred delays and rewards were positively related to stated rewards and delays, respectively. More importantly, choices were associated with inferred rewards and, in some circumstances, delays. Critically, estimates and choices were both order-dependent: when estimates preceded choices, estimates were more optimistic (people inferred smaller delays and larger rewards) and were subsequently more likely to choose the delayed option than when choices were made before estimates. These order effects argue against a simple model in which people deal with ambiguity by first estimating the unknown value and then using their estimate as the basis for decision. Rather, it seems that inferences are partly constructed from choices, and the role of inference in choice depends on whether an explicit estimate is made prior to choosing. Finally, we also find that inferences about ambiguous delays depend on whether the estimate has to be made in “days” or in a self-selected temporal unit, and replicate previous findings that older participants make more pessimistic inferences than younger ones. We discuss the implications and possible mechanisms for these findings.

Temporal discounting and smoking cessation: choice consistency predicts nicotine abstinence in treatment-seeking smokers

INTRODUCTION

Smokers discount delayed rewards steeper than non-smokers or ex-smokers, possibly due to neuropharmacological effects of tobacco on brain circuitry, or lower abstinence rates in smokers with steep discounting. To delineate both theories from each other, we tested if temporal discounting, choice inconsistency, and related brain activity in treatment-seeking smokers (1) are higher compared to non-smokers, (2) decrease after smoking cessation, and (3) predict relapse.

METHODS

At T1, 44 dependent smokers, 29 non-smokers, and 30 occasional smokers underwent fMRI while performing an intertemporal choice task. Smokers were measured before and 21 days after cessation if abstinent from nicotine. In total, 27 smokers, 28 non-smokers, and 29 occasional smokers were scanned again at T2. Discounting rate k and inconsistency var(k) were estimated with Bayesian analysis.

RESULTS

First, k and var(k) in smokers in treatment were not higher than in non-smokers or occasional smokers. Second, neither k nor var(k) changed after smoking cessation. Third, k did not predict relapse, but high var(k) was associated with relapse during treatment and over 6 months. Brain activity in valuation and decision networks did not significantly differ between groups and conditions.

CONCLUSION

Our data from treatment-seeking smokers do not support the pharmacological hypothesis of pronounced reversible changes in discounting behavior and brain activity, possibly due to limited power. Behavioral data rather suggest that differences between current and ex-smokers might be due to selection. The association of choice consistency and treatment outcome possibly links consistent intertemporal decisions to remaining abstinent.

Linking perception of bodily states and cognitive control: the role of interoception in impulsive behaviour

Interoception and impulsivity are two multi-dimensional constructs and although the role of interoception in impulsiveness has been previously reported, it is not clear whether their different facets are related to each other. In the present study, we aimed at bridging this gap by investigating the relationships between interoception and impulsivity in the light of their multi-dimensional nature. To this aim, we conducted a cross-task comparison and assessed in the same sample of healthy participants, interoceptive accuracy, by the heartbeat perception task, interoceptive sensibility, by a self-reported measure, "hot" impulsivity, by a behavioural task of risk taking, and "cool" impulsivity, by a go/no-go task. Also, we assessed trait impulsivity by a self-report measure. We found that interoceptive sensibility contributed to "hot" impulsivity, while interoceptive accuracy was related to non-planning trait impulsivity. These findings underscore the need to investigate at a finer grain the relationships between these two complex, multi-dimensional constructs.