Temporal discounting of rewards in patients with bipolar disorder and schizophrenia

Developmental deviation in delay discounting as a transdiagnostic indicator of risk for child psychopathology

BACKGROUND

The tendency to prefer smaller, immediate rewards over larger, delayed rewards is known as delay discounting (DD). Developmental deviations in DD may be key in characterizing psychiatric and neurodevelopmental disorders. Recent work empirically supported DD as a transdiagnostic process in various psychiatric disorders. Yet, there is a lack of research relating developmental changes in DD from mid-childhood to adolescence to psychiatric and neurodevelopmental disorders. Additionally, examining the interplay between socioeconomic status/total household income (THI) and psychiatric symptoms is vital for a more comprehensive understanding of pediatric pathology and its complex relationship with DD.

METHODS

The current study addresses this gap in a robust psychiatric sample of 1843 children and adolescents aged 5-18 (M = 10.6, SD = 3.17; 1,219 males, 624 females). General additive models (GAMs) characterized the shape of age-related changes in monetary and food reward discounting for nine psychiatric disorders compared with neurotypical youth (NT; n = 123). Over 40% of our sample possessed a minimum of at least three psychiatric or neurodevelopmental disorders. We used bootstrap-enhanced Louvain community detection to map DD-related comorbidity patterns. We derived five subtypes based on diagnostic categories present in our sample. DD patterns were then compared across each of the subtypes. Further, we evaluated the effect of cognitive ability, emotional and behavioral problems, and THI in relation to DD across development.

RESULTS

Higher discounting was found in six of the nine disorders we examined relative to NT. DD was consistently elevated across development for most disorders, except for depressive disorders, with age-specific DD differences compared with NTs. Community detection analyses revealed that one comorbidity subtype consisting primarily of Attention-Deficit/Hyperactivity Disorder (ADHD) Combined Presentation and anxiety disorders displayed the highest overall emotional/behavioral problems and greater DD for the food reward. An additional subtype composed mainly of ADHD, predominantly Inattentive Presentation, learning, and developmental disorders, showed the greatest DD for food and monetary rewards compared with the other subtypes. This subtype had deficits in reasoning ability, evidenced by low cognitive and academic achievement performance. For this ADHD-I and developmental disorders subtype, THI was related to DD across the age span such that participants with high THI showed no differences in DD compared with NTs. In contrast, participants with low THI showed significantly worse DD trajectories than all others. Our results also support prior work showing that DD follows nonlinear developmental patterns.

CONCLUSIONS

We demonstrate preliminary evidence for DD as a transdiagnostic marker of psychiatric and neurodevelopmental disorders in children and adolescents. Comorbidity subtypes illuminate DD heterogeneity, facilitating the identification of high-risk individuals. Importantly, our findings revealed a marked link between DD and intellectual reasoning, with children from lower-income households exhibiting lower reasoning skills and heightened DD. These observations underscore the potential consequences of compromised self-regulation in economically disadvantaged individuals with these disorders, emphasizing the need for tailored interventions and further research to support improved outcomes.

Reinforcement learning profiles and negative symptoms across chronic and clinical high-risk phases of psychotic illness

Negative symptoms are prominent in individuals with schizophrenia (SZ) and youth at clinical high-risk for psychosis (CHR). In SZ, negative symptoms are linked to reinforcement learning (RL) dysfunction; however, previous research suggests implicit RL remains intact. It is unknown whether implicit RL is preserved in the CHR phase where negative symptom mechanisms are unclear, knowledge of which may assist in developing early identification and prevention methods. Participants from two studies completed an implicit RL task: Study 1 included 53 SZ individuals and 54 healthy controls (HC); Study 2 included 26 CHR youth and 23 HCs. Bias trajectories reflecting implicit RL were compared between groups and correlations with negative symptoms were examined. Cluster analysis investigated RL profiles across the combined samples. Implicit RL was comparable between HC and their corresponding SZ and CHR groups. However, cluster analysis was able to parse performance heterogeneity across diagnostic boundaries into two distinct RL profiles: a Positive/Early Learning cluster (65% of participants) with positive bias scores increasing from the first to second task block, and a Negative/Late Learning cluster (35% of participants) with negative bias scores increasing from the second to third block. Clusters did not differ in the proportion of CHR vs. SZ cases; however, the Negative/Late Learning cluster had more severe negative symptoms. Although implicit RL is intact in CHR similar to SZ, distinct implicit RL phenotypic profiles with elevated negative symptoms were identified trans-phasically, suggesting distinct reward-processing mechanisms can contribute to negative symptoms independent of phases of illness.

Short-active gestational photoperiod reduces effortful choice behavior in mice, partial normalization by d-amphetamine

RATIONALE

Seasonal birth patterns consistently implicate winter gestation as a risk factor for several psychiatric conditions. We recently demonstrated that short-active (SA; 19:5 light:dark)-i.e., "winter-like"-photoperiod exposure across gestation and early life (E0-P28) induces psychiatrically relevant behavioral abnormalities in adult mice, including reduced immobility in the forced swim test (FST) and effortful amotivation. It is unknown, however, whether these effects were driven primarily by prenatal or postnatal mechanisms, and whether perinatal SA photoperiod would similarly reduce effort expenditure in a task relevant to everyday decision-making.

OBJECTIVES AND METHODS

We first tested male and female mice exposed to either gestational (E0-P0) or postnatal (E0-P28) SA photoperiod in the FST to determine whether the previously observed alteration was driven primarily by prenatal versus postnatal photoperiod. We then assessed whether SA gestational photoperiod reduces effortful choice behavior in the cross-species effort-based decision-making task (EBDMT) and whether any such deficit could be remediated by d-amphetamine (0.1 and 0.3 mg/kg, i.p.).

RESULTS

Mice exposed to prenatal, but not postnatal, SA photoperiod exhibited reduced FST immobility relative to controls and also demonstrated condition-dependently reduced preference for high-effort/high-reward versus low-effort/low-reward contingencies in the EBDMT. This effortful choice deficit was normalized by 0.1 mg/kg amphetamine.

CONCLUSIONS

These data: (1) suggest a greater contribution of gestational versus postnatal light conditions to the behavioral effects of perinatal SA photoperiod; and (2) implicate altered dopamine signaling in the behavioral phenotype of the SA-born mouse and possibly in the etiology of winter gestation-associated cases of psychiatric disease.

Different topological patterns in structural covariance networks between high and low delay discounters

Introduction

People prefer immediate over future rewards because they discount the latter's value (a phenomenon termed "delay discounting," used as an index of impulsivity). However, little is known about how the preferences are implemented in brain in terms of the coordinated pattern of large-scale structural brain networks.

Methods

To examine this question, we classified high discounting group (HDG) and low discounting group (LDG) in young adults by assessing their propensity for intertemporal choice. We compared global and regional topological properties in gray matter volume-based structural covariance networks between two groups using graph theoretical analysis.

Results

HDG had less clustering coefficient and characteristic path length over the wide sparsity range than LDG, indicating low network segregation and high integration. In addition, the degree of small-worldness was more significant in HDG. Locally, HDG showed less betweenness centrality (BC) in the parahippocampal gyrus and amygdala than LDG.

Discussion

These findings suggest the involvement of structural covariance network topology on impulsive choice, measured by delay discounting, and extend our understanding of how impulsive choice is associated with brain morphological features.

Reward and Immune Systems in Emotion (RISE) prospective longitudinal study: Protocol overview of an integrative reward-inflammation model of first onset of major depression in adolescence

Background

Depression is associated with a reduced sensitivity to rewards and low reward-related brain function in cortico-striatal circuitry. A separate literature documents elevated peripheral inflammation in depression. Recently, integrated reward-inflammation models of depression have been proposed. These models draw on work indicating that peripheral inflammatory proteins access the brain, where they lower reward responsiveness. This blunted reward responsiveness is proposed to initiate unhealthy behaviors (substance use, poor diet), as well as sleep disruption and stress generation, which further heighten inflammation. Over time, dysregulation in reward responsiveness and immune signaling may synergize in a positive feedback loop, whereby dysregulation in each system exacerbates dysregulation in the other. Project RISE (Reward and Immune Systems in Emotion) provides a first systematic test of reward-immune dysregulation as a synergistic and dynamic vulnerability for first onset of major depressive disorder and increases in depressive symptoms during adolescence.

Methods

This NIMH-funded R01 study is a 3-year prospective, longitudinal investigation of approximately 300 community adolescents from the broader Philadelphia area, United States of America. Eligible participants must be 13-16 years old, fluent in English, and without a prior major depressive disorder. They are being selected along the entire dimension of self-reported reward responsiveness, with oversampling at the low tail of the dimension in order to increase the likelihood of major depression onsets. At Time 1 (T1), T3, and T5, each a year apart, participants complete blood draws to quantify biomarkers of low-grade inflammation, self-report and behavioral measures of reward responsiveness, and fMRI scans of reward neural activity and functional connectivity. At T1-T5 (with T2 and T4 six months between the yearly sessions), participants also complete diagnostic interviews and measures of depressive symptoms, reward-relevant life events, and behaviors that increase inflammation. Adversity history is assessed at T1 only.

Discussion

This study is an innovative integration of research on multi-organ systems involved in reward and inflammatory signaling in understanding first onset of major depression in adolescence. It has the potential to facilitate novel neuroimmune and behavioral interventions to treat, and ideally prevent, depression.

Why now and not later? An exploration into the neurocognitive correlates of delay discounting in bipolar disorder

Increased delay discounting is evident in bipolar disorder, though there is minimal research on the factors that impact delay discounting in this population. We evaluated neurocognitive correlates of delay discounting among relatively euthymic participants with bipolar disorder (N = 76) with (n = 31) and without (n = 45) past-year substance use disorders. There were no significant differences in the mean delay discounting value between the bipolar disorder group and the comorbid bipolar disorder and past-year substance use disorders group (p = .082, Cohen's d = 0.41). Using multiple regression, we evaluated the most important predictors of the delay discounting value. Impairments in executive functioning (per number of categories completed on the Wisconsin Card Sorting Test) and visuospatial construction (per the Rey-Osterrieth Complex Figure Test Copy Raw Score), as well as decreased years of education (all ps < .05), offered the best neurocognitive characterization of increased delay discounting in this sample.

Neural dynamics underlying self-control in the primate subthalamic nucleus

The subthalamic nucleus (STN) is hypothesized to play a central role in neural processes that regulate self-control. Still uncertain, however, is how that brain structure participates in the dynamically evolving estimation of value that underlies the ability to delay gratification and wait patiently for a gain. To address that gap in knowledge, we studied the spiking activity of neurons in the STN of monkeys during a task in which animals were required to remain motionless for varying periods of time in order to obtain food reward. At the single-neuron and population levels, we found a cost-benefit integration between the desirability of the expected reward and the imposed delay to reward delivery, with STN signals that dynamically combined both attributes of the reward to form a single integrated estimate of value. This neural encoding of subjective value evolved dynamically across the waiting period that intervened after instruction cue. Moreover, this encoding was distributed inhomogeneously along the antero-posterior axis of the STN such that the most dorso-posterior-placed neurons represented the temporal discounted value most strongly. These findings highlight the selective involvement of the dorso-posterior STN in the representation of temporally discounted rewards. The combination of rewards and time delays into an integrated representation is essential for self-control, the promotion of goal pursuit, and the willingness to bear the costs of time delays.

Altered delay discounting in neurodegeneration: insight into the underlying mechanisms and perspectives for clinical applications

Steeper delay discounting (i.e., the extent to which future rewards are perceived as less valuable than immediate ones) has been proposed as a transdiagnostic process across different health conditions, in particular psychiatric disorders. Impulsive decision-making is a hallmark of different neurodegenerative conditions but little is known about delay discounting in the domain of neurodegenerative conditions. We reviewed studies on delay discounting in patients with Parkinson's disease (PD) and in patients with dementia (Alzheimer's disease / AD or frontotemporal dementia / FTD). We proposed that delay discounting could be an early marker of the neurodegenerative process. We developed the idea that altered delay discounting is associated with overlapping but distinct neurocognitive mechanisms across neurodegenerative diseases: dopaminergic-related disorders of reward processing in PD, memory/projection deficits due to medial temporal atrophy in AD, modified reward processing due to orbitofrontal atrophy in FTD. Neurodegeneration could provide a framework to decipher the neuropsychological mechanisms of value-based decision-making. Further, delay discounting could become a marker of interest in clinical practice, in particular for differential diagnosis.

Investigating associations of delay discounting with brain structure, working memory, and episodic memory

INTRODUCTION

Delay discounting (DD), the preference for smaller and sooner rewards over larger and later ones, is an important behavioural phenomenon for daily functioning of increasing interest within psychopathology. The neurobiological mechanisms behind DD are not well understood and the literature on structural correlates of DD shows inconsistencies.

METHODS

Here we leveraged a large openly available dataset (n = 1196) to investigate associations with memory performance and gray and white matter correlates of DD using linked independent component analysis.

RESULTS

Greater DD was related to smaller anterior temporal gray matter volume. Associations of DD with total cortical volume, subcortical volumes, markers of white matter microscopic organization, working memory, and episodic memory scores were not significant after controlling for education and income.

CONCLUSION

Effects of size comparable to the one we identified would be unlikely to be replicated with sample sizes common in many previous studies in this domain, which may explain the incongruities in the literature. The paucity and small size of the effects detected in our data underscore the importance of using large samples together with methods that accommodate their statistical structure and appropriate control for confounders, as well as the need to devise paradigms with improved task parameter reliability in studies relating brain structure and cognitive abilities with DD.

The effect of social exclusion on intertemporal choice in suicide attempters: A preliminary experimental study

BACKGROUND

Suicide-related theories and a growing body of evidence suggest that suicidal patients may have a tendency toward "short-sightedness"-the preference for immediate gratification when making intertemporal choice-and that social exclusion may exacerbate this tendency in suicidal patients. The present study examined the intertemporal choice performance of suicide attempters under conditions of social exclusion in a sample of affective disorder patients.

METHODS

A total of 64 affective disorder patients (22 non-suicidal patients, 24 single-suicide attempters and 18 multiple-suicide attempters) completed an intertemporal choice task in an exclusion or a non-exclusion condition. Social exclusion was manipulated using the Cyberball paradigm.

RESULTS

Non-suicidal patients and single-suicide attempters both exhibited an exaggerated preference for immediate rewards in the exclusion condition compared with the non-exclusion condition; in contrast, the multiple-suicide attempters appeared relatively indifferent to the social exclusion, exhibiting virtually identical preferences for immediate rewards in both the exclusion and non-exclusion conditions. In addition, the multiple-suicide attempters exhibited an exaggerated preference for immediate rewards compared with non-suicidal patients and single-suicide attempters in the non-exclusion condition, while the three groups did not differ in the exclusion condition.

CONCLUSIONS

Affective disorder patients with a single or no suicide attempts are more short-sighted after being excluded, while those with multiple suicide attempts appeared consistent short-sightedness in both exclusion and non-exclusion conditions. The study provides preliminary evidence of the role of disadvantageous intertemporal choice in the suicidal process. Future research replicate and extend these findings could have implications for suicide prevention and intervention.

Computational reinforcement learning, reward (and punishment), and dopamine in psychiatric disorders

In the DSM-5, psychiatric diagnoses are made based on self-reported symptoms and clinician-identified signs. Though helpful in choosing potential interventions based on the available regimens, this conceptualization of psychiatric diseases can limit basic science investigation into their underlying causes. The reward prediction error (RPE) hypothesis of dopamine neuron function posits that phasic dopamine signals encode the difference between the rewards a person expects and experiences. The computational framework from which this hypothesis was derived, temporal difference reinforcement learning (TDRL), is largely focused on reward processing rather than punishment learning. Many psychiatric disorders are characterized by aberrant behaviors, expectations, reward processing, and hypothesized dopaminergic signaling, but also characterized by suffering and the inability to change one's behavior despite negative consequences. In this review, we provide an overview of the RPE theory of phasic dopamine neuron activity and review the gains that have been made through the use of computational reinforcement learning theory as a framework for understanding changes in reward processing. The relative dearth of explicit accounts of punishment learning in computational reinforcement learning theory and its application in neuroscience is highlighted as a significant gap in current computational psychiatric research. Four disorders comprise the main focus of this review: two disorders of traditionally hypothesized hyperdopaminergic function, addiction and schizophrenia, followed by two disorders of traditionally hypothesized hypodopaminergic function, depression and post-traumatic stress disorder (PTSD). Insights gained from a reward processing based reinforcement learning framework about underlying dopaminergic mechanisms and the role of punishment learning (when available) are explored in each disorder. Concluding remarks focus on the future directions required to characterize neuropsychiatric disorders with a hypothesized cause of underlying dopaminergic transmission.

Decision value signals in the ventromedial prefrontal cortex and motivational and hedonic symptoms across mood and psychotic disorders

Deficits in motivation and pleasure are common across many psychiatric disorders, and manifest as symptoms of amotivation and anhedonia, which are prominent features of both mood and psychotic disorders. Here we provide evidence for an association between neural value signals and symptoms of amotivation and anhedonia across adults with major depression, bipolar disorder, schizophrenia, or no psychiatric diagnosis. We found that value signals in the ventromedial prefrontal cortex (vmPFC) during intertemporal decision-making were dampened in individuals with greater motivational and hedonic deficits, after accounting for primary diagnosis. This relationship remained significant while controlling for diagnosis-specific symptoms of mood and psychosis, such as depression as well as positive and negative symptoms. Our results demonstrate that dysfunction in the vmPFC during value-based decision-making is specifically linked to motivational and hedonic impairments. These findings provide a quantitative neural target for the potential development of novel treatments for amotivation and anhedonia.

Impaired risk avoidance in bipolar disorder and substance use disorders

Comorbid substance use disorders are highly prevalent in bipolar disorder, and research suggests that individuals with the comorbid presentation typically have worse outcomes than individuals with bipolar disorder without this comorbidity. However, psychosocial treatments for the comorbid presentation have not demonstrated effectiveness for both mood and substance use symptom domains, suggesting novel treatments are needed. An alternative path to treatment development is to identify mechanisms that underlie comorbid bipolar disorder and substance use disorders that can subsequently be targeted in treatment. We evaluated neurocognitive markers for impairments in risk avoidance (the tendency to engage in a persistent pattern of problematic behaviors despite negative outcomes resulting from such behaviors) as potential mechanistic variables underlying negative illness outcomes in the comorbid population. Participants with bipolar disorder (n = 45) or comorbid bipolar disorder and substance use disorders (n = 31) in a relatively euthymic mood state completed clinical risk behavior assessments, task-based risk avoidance assessments, and neurocognitive assessments. Results indicated a lack of notable between-group differences in the clinical risk composite score, task-based risk avoidance assessments, and neurocognitive assessments, with the exception of self-reported executive dysfunction which was elevated among the comorbid sample. Collapsing across group, we found that increased discounting of delayed rewards, older age, and an earlier age of (hypo)mania onset predicted an increased clinical risk composite score. These findings underscore the potential importance of delay discounting as a novel mechanistic target for reducing clinical risk behaviors among individuals with bipolar disorder both with and without comorbid substance use disorders.

No group differences in Traditional Economics Measures of loss aversion and framing effects in bipolar I disorder

Bipolar disorder (BD) is associated with impaired decision making, yet few studies have adopted paradigms from behavioral economics to decompose which, if any, aspects of decision making may be impacted. This may be particularly relevant for decision-making processes relevant to known difficulties with emotive dysfunction and corresponding reward dysregulation in BD. Participants with bipolar I disorder (BD; n = 44) and non-psychiatric healthy controls (CTL; n = 28) completed three well-validated behavioral economics decision making tasks via a remote-based survey, including loss aversion and framing effects, that examined sensitivity to probabilities and potential gains and losses in monetary and non-monetary domains. Consistent with past work, we found evidence of moderate loss aversion and framing effects across all participants. No group differences were found in any of the measures of loss aversion or framing effects. We report no group differences between bipolar and non-psychiatric groups with respect to loss aversion and framing effects using a remote-based survey approach. These results provide a framework future studies to explore similar tasks in clinical populations and suggest the context and degree to which decision making is altered in BD may be rooted in a more complex cognitive mechanism that warrants future research.

Neurobehavioral and neurodevelopmental profiles of a heuristic genetic model of differential schizophrenia- and addiction-relevant features: The RHA vs. RLA rats

The Roman High- (RHA) and Low-(RLA) avoidance rat lines/strains were generated through bidirectional selective breeding for rapid (RHA) vs. extremely poor (RLA) two-way active avoidance acquisition. Compared with RLAs and other rat strains/stocks, RHAs are characterized by increased impulsivity, deficits in social behavior, novelty-induced hyper-locomotion, impaired attentional/cognitive abilities, vulnerability to psychostimulant sensitization and drug addiction. RHA rats also exhibit decreased function of the prefrontal cortex (PFC) and hippocampus, increased functional activity of the mesolimbic dopamine system and a dramatic deficit of central metabotropic glutamate-2 (mGlu2) receptors (due to a stop codon mutation at cysteine 407 in Grm2 -cys407*-), along with increased density of 5-HT2A receptors in the PFC, alterations of several synaptic markers and increased density of pyramidal "thin" (immature) dendrític spines in the PFC. These characteristics suggest an immature brain of RHA rats, and are reminiscent of schizophrenia features like hypofrontality and disruption of the excitation/inhibition cortical balance. RHA rats represent a promising heuristic model of neurodevelopmental schizophrenia-relevant features and comorbidity with drug addiction vulnerability.

Delay discounting in youth at clinical high-risk for psychosis and adults with schizophrenia

BACKGROUND

Schizophrenia (SZ) is typically preceded by a prodromal (i.e. pre-illness) period characterized by attenuated positive symptoms and declining functional outcome. Negative symptoms are prominent among individuals at clinical high-risk (CHR) for psychosis (i.e. those with prodromal syndromes) and highly predictive of conversion to illness. Mechanisms underlying negative symptoms in the CHR population are unclear. Two studies were conducted to evaluate whether abnormalities in a reward processing mechanism thought to be core to negative symptoms in SZ, value representation, also exist in CHR individuals and whether they are associated with negative symptoms transphasically.

METHODS

Study 1 included 33 individuals in the chronic phase of illness who have been diagnosed with schizophrenia or schizoaffective disorder (SZ) and 40 healthy controls (CN). Study 2 included 37 CHR participants and 45 CN. In both studies, participants completed the delay discounting (DD) task as a measure of value representation and the Brief Negative Symptom Scale was rated to measure negative symptoms.

RESULTS

Results indicated that patients with SZ had steeper discounting rates than CN, indicating impairments in value representation. However, CHR participants were unimpaired on the DD task. In both studies, steeper discounting was associated with greater severity of negative symptoms.

CONCLUSIONS

These findings suggest that deficits in value representation are associated with negative symptoms transphasically.

Altered risky decision making in patients with early non-affective psychosis

Abnormal risky decision making may represent an important factor contributing to functional impairment in psychotic disorders. Previous research revealed impaired decision making under risk in patients with chronic schizophrenia. However, risky decision making is under-studied in the early course of illness. We examined risky decision making in 33 patients with early non-affective psychosis and 32 demographically matched controls, using two well-validated experimental paradigms, balloon analogue risk task (BART) and Risky-Gains task (RGT), which modeled and assessed actual risk-taking behaviors in deliberative and time-pressured decision-making situations, respectively. Our results showed that patients exhibited suboptimal decision making on the BART and were more risk averse than controls by having fewer average balloon pumps in non-burst trials, lower explosion rate and lower total points gained. On the RGT, patients also behaved more conservatively than controls, with lower overall rate in choosing the risky option. Intriguingly, patients performed comparably to controls in adjusting risk-taking pattern following punished trials, suggesting relatively preserved sensitivity to punishment in early psychosis. Risk-taking measures showed no significant correlations with any symptom dimensions, impulsivity traits, cognitive functions or antipsychotic treatment after correcting for multiple comparisons. This study is the first to investigate risk-taking propensity in early psychosis based on BART/RGT performance, and consistently indicate that patients with early psychosis displayed altered risky decision making with increased risk aversion relative to healthy participants. Further investigation is warranted to clarify the longitudinal course of aberrant risky decision making and its relationship with functional outcome in early psychosis.

Impulsivity and Medical Care Utilization in Veterans Treated for Substance Use Disorder

Impulsivity has been defined by acting rashly during positive mood states (positive urgency; PU) or negative mood states (negative urgency; NU) and by excessive de-valuation of deferred rewards. These behaviors reflect a "live in the now" mentality that is not only characteristic of many individuals with severe substance use disorder (SUD) but also impedes medical treatment compliance and could result in repeated hospitalizations or other poor health outcomes. Purpose/objectives: We sought preliminary evidence that impulsivity may relate to adverse health outcomes in the veteran population. Impulsivity measured in 90 veterans receiving inpatient or outpatient SUD care at a Veterans Affairs Medical Center was related to histories of inpatient/residential care costs, based on VA Health Economics Resource Center data. Results: We found that positive urgency, lack of persistence and lack of premeditation, but not sensation-seeking or preference for immediate or risky rewards, were significantly higher in veterans with a history of one or more admissions for VA-based inpatient or residential health care that either included (n = 30) or did not include (n = 29) an admission for SUD care. Among veterans with a history of inpatient/residential care for SUD, NU and PU, but not decision-making behavior, correlated with SUD care-related costs. Conclusions/Importance: In veterans receiving SUD care, questionnaire-assessed trait impulsivity (but not decision-making) related to greater care utilization within the VA system. This suggests that veterans with high impulsivity are at greater risk for adverse health outcomes, such that expansion of cognitive interventions to reduce impulsivity may improve their health.

Steep Discounting of Future Rewards as an Impulsivity Phenotype: A Concise Review

This chapter provides an overview over the behavioral economic index of impulsivity known as delay discounting. Specifically, delay discounting refers to an individual's preference for smaller immediate rewards over a larger delayed rewards. The more precipitously an individual discounts future rewards, the more impulsive they are considered to be. First, the chapter reviews the nature of delay discounting as a psychological process and juxtaposes it with nominally similar processes, including other facets of impulsivity. Second, the chapter reviews the links between delay discounting and numerous health behaviors, including addiction, attention deficit/hyperactivity disorder, and obesity. Third, the determinants of individual variation in delay discounting are discussed, including both genetic and environmental contributions. Finally, the chapter evaluates delay discounting as a potentially modifiable risk factor and the status of clinical interventions designed to reduce delay discounting to address deficits in self-control in a variety of maladaptive behaviors.

Mobile enhancement of motivation in schizophrenia: A pilot randomized controlled trial of a personalized text message intervention for motivation deficits

OBJECTIVE

Motivation deficits remain an unmet treatment need in schizophrenia. Recent research has identified mechanisms underlying motivation deficits (i.e., impaired effort-cost computations, reduced future reward-value representation maintenance) that may be effective treatment targets to improve motivation. This study tested the feasibility and preliminary effectiveness of Mobile Enhancement of Motivation in Schizophrenia (MEMS), an intervention that leverages mobile technology to target these mechanisms with text messages.

METHOD

Fifty-six participants with a schizophrenia-spectrum disorder were randomized to MEMS (n = 27) or a control condition (n = 29). All participants set recovery goals to complete over 8 weeks. Participants in the MEMS group additionally received personalized, interactive text messages on their personal cellphones each weekday.

RESULTS

Retention and engagement in MEMS were high: 92.6% completed 8 weeks of MEMS, with an 86.1% text message response rate, and 100% reported being satisfied with the text messages. Compared to participants in the control condition, the participants in the MEMS condition had significantly greater improvements in interviewer-rated motivation and anticipatory pleasure and attained significantly more recovery-oriented goals at 8 weeks. There were no significant group differences in purported mechanisms (performance-based effort-cost computations and future reward-value representations) or in self-reported motivation, quality of life, or functioning.

CONCLUSION

Results demonstrate that MEMS is feasible as a brief, low-intensity mobile intervention that could effectively improve some aspects of motivation (i.e., initiation and maintenance of goal-directed behaviors) and recovery goal attainment for those with schizophrenia-spectrum disorders. More work is needed with larger samples and to understand the mechanisms of change in MEMS. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Impulsivity, decision-making and risk-taking behaviour in bipolar disorder: a systematic review and meta-analysis

Despite the robust body of work on cognitive aspects of bipolar disorder (BD), a clear profile of associated impairments in impulsivity, decision-making and risk-taking from studies that use behavioural measures has yet to be established. A systematic review, across four electronic databases (PsycINFO, MEDLINE/PubMed, ScienceDirect and Scopus), of literature published between January 1999 and December 2018 was carried out in accordance with the PRISMA statement. The protocol was registered on PROSPERO (CRD42018114684). A fixed-effect and random-effects meta-analysis using the Hedges' g (ES) estimate was performed. The analysis revealed significant impairment in BD individuals with medium effect sizes in various aspects of impulsivity - response inhibition (ES = 0.49; p < 0.0001), delay of gratification (ES = 0.54; p < 0.0001) and inattention (ES = 0.49; p < 0.0001) - and in decision-making (ES = 0.61, p = 0.0002), but no significant impairment in risk-taking behaviour (ES = 0.41; p = 0.0598). Furthermore, we found significant heterogeneity between studies for decision-making and risk-taking behaviour but not for impulsivity. Impaired risk-taking behaviour was significant in a subgroup of BD-I and euthymic individuals (ES = 0.92; p < 0.0001) with no significant heterogeneity. A stratification analysis revealed comparable results in euthymic and non-euthymic individuals for impulsivity. Our findings suggest that behaviour impulsivity is elevated in all phases of BD, representing a core and clinically relevant feature that persists beyond mood symptoms. More studies about decision-making and risk-taking are necessary to establish if they are impaired in BD and to analyze the role of mood state.

Rapid, precise, and reliable measurement of delay discounting using a Bayesian learning algorithm

Machine learning has the potential to facilitate the development of computational methods that improve the measurement of cognitive and mental functioning. In three populations (college students, patients with a substance use disorder, and Amazon Mechanical Turk workers), we evaluated one such method, Bayesian adaptive design optimization (ADO), in the area of delay discounting by comparing its test-retest reliability, precision, and efficiency with that of a conventional staircase method. In all three populations tested, the results showed that ADO led to 0.95 or higher test-retest reliability of the discounting rate within 10-20 trials (under 1-2 min of testing), captured approximately 10% more variance in test-retest reliability, was 3-5 times more precise, and was 3-8 times more efficient than the staircase method. The ADO methodology provides efficient and precise protocols for measuring individual differences in delay discounting.

Amygdala Structural Connectivity Is Associated With Impulsive Choice and Difficulty Quitting Smoking

Introduction: The amygdala is known to play a role in mediating emotion and possibly addiction. We used probabilistic tractography (PT) to evaluate whether structural connectivity of the amygdala to the brain reward network is associated with impulsive choice and tobacco smoking.

Methods: Diffusion and structural MRI scans were obtained from 197 healthy subjects (45 with a history of tobacco smoking) randomly sampled from the Human Connectome database. PT was performed to assess amygdala connectivity with several brain regions. Seed masks were generated, and statistical maps of amygdala connectivity were derived. Connectivity results were correlated with a subject performance both on a delayed discounting task and whether they met specified criteria for difficulty quitting smoking.

Results: Amygdala connectivity was spatially segregated, with the strongest connectivity to the hippocampus, orbitofrontal cortex (OFC), and brainstem. Connectivity with the hippocampus was associated with preference for larger delayed rewards, whereas connectivity with the OFC, rostral anterior cingulate cortex (rACC), and insula were associated with preference for smaller immediate rewards. Greater nicotine dependence with difficulty quitting was associated with less hippocampal and greater brainstem connectivity. Scores on the Fagerstrom Test for Nicotine Dependence (FTND) correlated with rACC connectivity.

Discussion: These findings highlight the importance of the amygdala-hippocampal-ACC network in the valuation of future rewards and substance dependence. These results will help to identify potential targets for neuromodulatory therapies for addiction and related disorders.

Impulsive decision making, brain cortical thickness and familial schizophrenia risk

BACKGROUND

Schizophrenia (SZ) patients and their biological relatives are more impulsive than controls. Although greater impulsivity in SZ has been associated with dysfunction in prefrontal neural circuits implicated in reward processing, little is known regarding brain structural correlates of heightened impulsivity in unaffected adolescent relatives of SZ patients.

METHODS

Impulsive decision-making was assessed using the delay discounting task in 174 adolescents: 36 first-degree relatives (FDR) and 50 second-degree relatives (SDR) of SZ patients, and 88 healthy controls with no SZ family history (NSFH). We contrasted MRI brain gray matter cortical thickness-discounting constant (k) relationships between these 3 comparison groups using well-validated statistical approaches.

RESULTS

FDR had a distinct pattern in cortical thickness-k associations when compared to NSFH and SDR. Preference for immediate rewards (i.e. greater impulsivity) among FDR correlated with less cortical thickness within diffuse brain regions, including dorsolateral prefrontal (cognitive control network and motor/premotor cortex) and lateral temporal (auditory and visual association cortex) brain areas.

CONCLUSIONS

Adolescent impulsive decision-making may serve as an informative phenotype of underlying brain circuitry dysfunction associated with SZ risk. Future research focusing on impulsivity in SZ will likely help advance understanding how dysfunctional interactions between cognitive and reward neural circuits contribute to the neurobiological basis of SZ.

The Neurobiology of Impulsive Decision-Making and Reinforcement Learning in Nonhuman Animals

Impulsive decisions are those that favor immediate over delayed rewards, involve the acceptance of undue risk or uncertainty, or fail to adapt to environmental changes. Pathological levels of impulsive decision-making have been observed in individuals with mental illness, but there may be substantial heterogeneity in the processes that drive impulsive choices. Understanding this behavioral heterogeneity may be critical for understanding associated diverseness in the neural mechanisms that give rise to impulsivity. The application of reinforcement learning algorithms in the deconstruction of impulsive decision-making phenotypes can help bridge the gap between biology and behavior and provide insights into the biobehavioral heterogeneity of impulsive choice. This chapter will review the literature on the neurobiological mechanisms of impulsive decision-making in nonhuman animals; specifically, the role of the amine neuromodulatory systems (dopamine, serotonin, norepinephrine, and acetylcholine) in impulsive decision-making and reinforcement learning processes is discussed. Ultimately, the integration of reinforcement learning algorithms with sophisticated behavioral and neuroscience techniques may be critical for advancing the understanding of the neurochemical basis of impulsive decision-making.

Improved functioning following computerized working memory training (COGMED®) in euthymic patients with bipolar disorder and cognitive complaints: An exploratory study

BACKGROUND

Patients with bipolar disorder (BD) frequently have cognitive deficits even when euthymic. These deficits are considered one of the main drivers of functional disability in BD. This study investigated whether computerized working memory training using the COGMED® program in patients with BD can improve global functioning, therapeutic compliance, and subjective quality of life.

METHODS

For this naturalistic prospective study, 40 patients with BD and cognitive complaints were recruited. Sociodemographic, clinical, neurocognitive and functional data were collected before starting the remediation intervention (baseline). At home, patients used the web-based working memory training program COGMED® that included a battery of interactive games (daily sessions, five days per week for five weeks), supported by weekly phone-based feedback. The clinical, neurocognitive and functional assessment was repeated four weeks after the intervention end and compared with the baseline data.

RESULTS

Thirty-two patients completed the study. Compared with baseline, general functioning was improved after the working memory training program, as indicated by a mean reduction of 6.78 (SD 4.65) points in the Functioning Assessment Short Test (p<0.001). This result remained significant after controlling for depressive symptomatology improvement. Similarly, the scores of neuropsychological tests for cognitive complaints, as well as verbal and visuospatial working memory components were significantly different before and after the intervention (p<0.05). Conversely, the subjective quality of life and therapeutic compliance did not change.

LIMITATIONS

The naturalistic open-label, non-controlled design of this study precludes the conclusion regarding causality.

CONCLUSIONS

In patients with BD, global functioning is improved by computerized working memory remediation.

Delay discounting abnormalities are seen in first-episode schizophrenia but not in bipolar disorder

Delay discounting (DD) is the phenomenon of individuals discounting future rewards as a function of time. It has been studied extensively in chronic schizophrenia (SZ) and the results of these studies have been variable. Comorbidity in chronic samples could be one reason for the mixed findings and studies in first-episode (FE) samples are surprisingly lacking. Bipolar disorder (BP) which shares some genetic and symptom features with SZ could serve as an interesting comparison group for DD but has been underexplored. Here we present the first study that combines FE SZ, FE BP with psychotic features, as well as healthy controls and study DD with two versions of the task. We found that SZ showed steeper discounting than HC and BP on the well-validated Kirby DD task. SZ showed no difference than HC on a separate DD task with smaller rewards presented with decimal places and shorter delays. As a preliminary finding, DD was found to be positively related to positive symptoms in FE SZ, while no relationship was found between negative symptoms and DD. In addition, we found comparable DD in BP compared to HC. Ultimately, our data may help elucidate the psychopathology in SZ and BP during intertemporal decision making.

Delay Discounting as a Transdiagnostic Process in Psychiatric Disorders: A Meta-analysis

IMPORTANCE

Delay discounting is a behavioral economic index of impulsive preferences for smaller-immediate or larger-delayed rewards that is argued to be a transdiagnostic process across health conditions. Studies suggest some psychiatric disorders are associated with differences in discounting compared with controls, but null findings have also been reported.

OBJECTIVE

To conduct a meta-analysis of the published literature on delay discounting in people with psychiatric disorders.

DATA SOURCES

PubMed, MEDLINE, PsycInfo, Embase, and Web of Science databases were searched through December 10, 2018. The psychiatric keywords used were based on DSM-IV or DSM-5 diagnostic categories. Collected data were analyzed from December 10, 2018, through June 1, 2019.

STUDY SELECTION

Following a preregistered Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) protocol, 2 independent raters reviewed titles, abstracts, and full-text articles. English-language articles comparing monetary delay discounting between participants with psychiatric disorders and controls were included.

DATA EXTRACTION AND SYNTHESIS

Hedges g effect sizes were computed and random-effects models were used for all analyses. Heterogeneity statistics, one-study-removed analyses, and publication bias indices were also examined.

MAIN OUTCOMES AND MEASURES

Categorical comparisons of delay discounting between a psychiatric group and a control group.

RESULTS

The sample included 57 effect sizes from 43 studies across 8 diagnostic categories. Significantly steeper discounting for individuals with a psychiatric disorder compared with controls was observed for major depressive disorder (Hedges g = 0.37; P = .002; k = 7), schizophrenia (Hedges g = 0.46; P = .004; k = 12), borderline personality disorder (Hedges g = 0.60; P < .001; k = 8), bipolar disorder (Hedges g = 0.68; P < .001; k = 4), bulimia nervosa (Hedges g = 0.41; P = .001; k = 4), and binge-eating disorder (Hedges g = 0.34; P = .001; k = 7). In contrast, anorexia nervosa exhibited statistically significantly shallower discounting (Hedges g = -0.30; P < .001; k = 10). Modest evidence of publication bias was indicated by a statistically significant Egger test for schizophrenia and at the aggregate level across studies.

CONCLUSIONS AND RELEVANCE

Results of this study appear to provide empirical support for delay discounting as a transdiagnostic process across most of the psychiatric disorders examined; the literature search also revealed limited studies in some disorders, notably posttraumatic stress disorder, which is a priority area for research.

Objective cognitive functioning in self-reported habitual short sleepers not reporting daytime dysfunction: examination of impulsivity via delay discounting

Study Objectives

(1) Examine performance on an objective measure of reward-related cognitive impulsivity (delay discounting) among self-reported habitual short sleepers and medium (i.e. recommended 7-9 hours) length sleepers either reporting or not reporting daytime dysfunction; (2) Inform the debate regarding what type and duration of short sleep (e.g. 21 to 24 hours of total sleep deprivation, self-reported habitual short sleep duration) meaningfully influences cognitive impulsivity; (3) Compare the predictive utility of sleep duration and perceived dysfunction to other factors previously shown to influence cognitive impulsivity via delay discounting performance (age, income, education, and fluid intelligence).

Methods

We analyzed data from 1190 adults from the Human Connectome Project database. Participants were grouped on whether they reported habitual short (≤6 hours) vs. medium length (7-9 hours) sleep duration and whether they perceived daytime dysfunction using the Pittsburgh Sleep Quality Index.

Results

All short sleepers exhibited increased delay discounting compared to all medium length sleepers, regardless of perceived dysfunction. Of the variables examined, self-reported sleep duration was the strongest predictor of delay discounting behavior between groups and across all 1190 participants.

Conclusions

Individuals who report habitual short sleep are likely to exhibit increased reward-related cognitive impulsivity regardless of perceived sleep-related daytime impairment. Therefore, there is a reason to suspect that these individuals exhibit more daytime dysfunction, in the form of reward-related cognitive impulsivity, than they may assume. Current findings suggest that assessment of sleep duration over the prior month has meaningful predictive utility for human reward-related impulsivity.

Linking Delay Discounting and Substance Use Disorders: Genotypes and Phenotypes

Research supports the idea that "delay discounting," also known as temporal discounting, intertemporal choice, or impulsive choice, is a transdisease process with a strong connection to substance use disorders (SUDs) and other psychopathologies, like attention deficit hyperactivity disorder and depression. This article briefly reviews the evidence used to conclude that delay discounting is heritable and should be considered to be an endophenotype, as well as evidence of its behavioral and genetic associations with SUDs. It also discusses the limitations that should be considered when evaluating the strength of these associations. Finally, this article briefly describes research examining relationships among delay discounting and SUD-associated intermediate phenotypes to better understand the conceptual relationships underlying the links between SUDs and delay discounting, and identifies research gaps that should be addressed.

Delay discounting and reward sensitivity in a 2 × 2 study of bipolar disorder and alcohol dependence

BACKGROUND AND AIMS

Separate studies have shown increased delay discounting in people with bipolar disorder (BD) and people with alcohol dependence (AD) relative to people without mental health problems. Delay discounting was compared in people with no mental health problems, AD, BD and AD plus BD. Associations of delay discounting with self-reported impulsivity and reward sensitivity were also assessed.

DESIGN

The study was a two-by-two factorial comparative observational design.

SETTING

Data were collected at baseline diagnostic visits as part of a neuroimaging study at a medical university in South Carolina, USA.

PARTICIPANTS

Twenty-two BD + AD, 33 BD, 28 AD and 27 people without mental health problems participated.

MEASUREMENTS

Diagnostic and clinician-rated symptom measures, self-report questionnaires and a computerized delay discounting task were administered. Two-by-two general linear univariate models were tested to examine between-group differences on discounting rates, and bivariate correlations and hierarchical regression analyses were performed to examine associations between discounting rates and self-reported reward sensitivity and impulsivity.

FINDINGS

There was a significant main effect of AD (P = 0.006, η2  = 0.068). The main effect of BD and the BD × AD interaction terms were non-significant (P ≥ 0.293, η2  ≤ 0.010). Reward sensitivity and impulsivity were not significantly associated with discounting rates after adjustment for the other (P ≥ 0.089).

CONCLUSIONS

People with alcohol dependence appear to have higher delay discounting, while previously found associations between bipolar disorder and delay discounting may be secondary to alcohol use disorder.

A Genetic Model of Impulsivity, Vulnerability to Drug Abuse and Schizophrenia-Relevant Symptoms With Translational Potential: The Roman High- vs. Low-Avoidance Rats

The bidirectional selective breeding of Roman high- (RHA) and low-avoidance (RLA) rats for respectively rapid vs. poor acquisition of active avoidant behavior has generated two lines/strains that differ markedly in terms of emotional reactivity, with RHA rats being less fearful than their RLA counterparts. Many other behavioral traits have been segregated along the selection procedure; thus, compared with their RLA counterparts, RHA rats behave as proactive copers in the face of aversive conditions, display a robust sensation/novelty seeking (SNS) profile, and show high impulsivity and an innate preference for natural and drug rewards. Impulsivity is a multifaceted behavioral trait and is generally defined as a tendency to express actions that are poorly conceived, premature, highly risky or inappropriate to the situation, that frequently lead to unpleasant consequences. High levels of impulsivity are associated with several neuropsychiatric conditions including attention-deficit hyperactivity disorder, obsessive-compulsive disorder, schizophrenia, and drug addiction. Herein, we review the behavioral and neurochemical differences between RHA and RLA rats and survey evidence that RHA rats represent a valid genetic model, with face, construct, and predictive validity, to investigate the neural underpinnings of behavioral disinhibition, novelty seeking, impulsivity, vulnerability to drug addiction as well as deficits in attentional processes, cognitive impairments and other schizophrenia-relevant traits.

Emotional content impacts how executive function ability relates to willingness to wait and to work for reward

Research has demonstrated that better value-based decision making (e.g., waiting or working for rewards) relates to greater executive function (EF) ability. However, EF is not a static ability, but is influenced by the emotional content of the task. As such, EF ability in emotional contexts may have unique associations with value-based decision making, in which costs and benefits are explicit. Participants (N = 229) completed an EF task (with both negative and neutral task conditions) and two value-based decision-making tasks. Willingness to wait and to work were evaluated in separate path models relating the waiting and working conditions to the EF conditions. Willingness to wait and willingness to work showed distinct relationships with EF ability: Greater EF ability on a negative, but not on a neutral, EF task was related to a willingness to wait for a reward, whereas greater EF ability across both EF tasks was related to a greater willingness to work for a reward. EF ability on a negative EF task showed an inverted-U relationship to willingness to wait for reward, and was most related to willingness to wait at a 6-month delay. Greater EF, regardless of whether the task was negative or neutral, was related to a greater willingness to work when reward was uncertain (50%) or was likely (88%), but not when reward was unlikely (12%). This study suggests that the emotional content of value-based decisions impacts the relationship between EF ability and willingness to wait or to work for reward.

Measuring facets of reward sensitivity, inhibition, and impulse control in individuals with problematic Internet use

INTRODUCTION

Problematic Internet Use (PIU) is the inability to control the amount of time spent on the Internet. Research indicates that abnormalities in reward sensitivity, sensitivity to punishment, and impulse control drive addictive behaviors such as substance abuse and gambling disorders, but it is unclear whether this is also the case in PIU.

METHODS

Behavioral tasks and scales were completed by 62 participants (32 PIU individuals and 30 no-PIU individuals) to assess reward sensitivity, sensitivity to punishment, as well as inhibitory function and impulse control. Measures administered included Go/No-Go, delay discounting, Behavioral Inhibition/Activation (BIS/BAS) scales and the Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ).

RESULTS

The PIU group endorsed greater reward sensitivity and punishment sensitivity as indexed by the SPSRQ. However, there were no group differences with regards to delay discounting, performance in the Go/No-Go task, or endorsement in the BIS/BAS scales.

DISCUSSION

The present study found increased reward sensitivity and sensitivity to punishment in PIU individuals, though impulse control was not observably affected. Future experimental studies are needed to inform our conceptualization of the etiology of addictive behavior as it pertains to PIU. Further investigation will aid in informing prevention and intervention efforts.

Computational psychiatry of impulsivity and risk: how risk and time preferences interact in health and disease

Choice impulsivity is an important subcomponent of the broader construct of impulsivity and is a key feature of many psychiatric disorders. Choice impulsivity is typically quantified as temporal discounting, a well-documented phenomenon in which a reward's subjective value diminishes as the delay to its delivery is increased. However, an individual's proclivity to-or more commonly aversion to- risk can influence nearly all of the standard experimental tools available for measuring temporal discounting. Despite this interaction, risk preference is a behaviourally and neurobiologically distinct construct that relates to the economic notion of utility or subjective value. In this opinion piece, we discuss the mathematical relationship between risk preferences and time preferences, their neural implementation, and propose ways that research in psychiatry could, and perhaps should, aim to account for this relationship experimentally to better understand choice impulsivity and its clinical implications. This article is part of the theme issue 'Risk taking and impulsive behaviour: fundamental discoveries, theoretical perspectives and clinical implications'.

Temporal and Effort cost Decision-making in Healthy Individuals with Subclinical Psychotic Symptoms

The value people attribute to rewards is influenced both by the time and the effort required to obtain them. Impairments in these computations are described in patients with schizophrenia and appear associated with negative symptom severity. This study investigated whether deficits in temporal and effort cost computations can be observed in individuals with subclinical psychotic symptoms (PS) to determine if this dysfunction is already present in a potentially pre-psychotic period. Sixty participants, divided into three groups based on the severity of PS (high, medium and low), performed two temporal discounting tasks with food and money and a concurrent schedule task, in which the effort to obtain food increased over time. We observed that in high PS participants the discounting rate appeared linear and flatter than that exhibited by participants with medium and low PS, especially with food. In the concurrent task, compared to those with low PS, participants with high PS exerted tendentially less effort to obtain snacks only when the required effort was high. Participants exerting less effort in the higher effort condition were those with higher negative symptoms. These results suggest that aberrant temporal and effort cost computations might be present in individuals with subclinical PS and therefore could represent a vulnerability marker for psychosis.

Temporal Self, Psychopathology, and Adaptive Functioning Deficits: An Examination of Acute Psychiatric Patients

Individuals with psychiatric illness have difficulty remembering specific events from their personal past and imagining their future. We examined psychotic psychiatric inpatients' sense of self-continuity over time, predicting that low levels of temporal continuity would predict increased psychopathology and lower functionality. Inpatients (n = 60) were compared with healthy controls (n = 60) on a validated measure of self-continuity, psychiatric symptoms, insight, and adaptive functioning capacity. Results revealed that patients had significant difficulty perceiving their past, present, and future selves as unified over time compared with controls. Within the inpatient group, deficits in present to future self-continuity was associated with patients' severity of positive, negative, and mood symptoms, degree of insight, and adaptive capacity. It may be the case that temporal self-unity provides a context for deriving reinforcement from daily life experiences in the moment and in anticipating the future as well as a worthwhile goal for treatment exploration.

Individual Differences in Dopamine Are Associated with Reward Discounting in Clinical Groups But Not in Healthy Adults

Some people are more willing to make immediate, risky, or costly reward-focused choices than others, which has been hypothesized to be associated with individual differences in dopamine (DA) function. In two studies using PET imaging, one empirical (Study 1: N = 144 males and females across 3 samples) and one meta-analytic (Study 2: N = 307 across 12 samples), we sought to characterize associations between individual differences in DA and time, probability, and physical effort discounting in human adults. Study 1 demonstrated that individual differences in DA D2-like receptors were not associated with time or probability discounting of monetary rewards in healthy humans, and associations with physical effort discounting were inconsistent across adults of different ages. Meta-analytic results for temporal discounting corroborated our empirical finding for minimal effect of DA measures on discounting in healthy individuals but suggested that associations between individual differences in DA and reward discounting depend on clinical features. Addictions were characterized by negative correlations between DA and discounting, but other clinical conditions, such as Parkinson's disease, obesity, and attention-deficit/hyperactivity disorder, were characterized by positive correlations between DA and discounting. Together, the results suggest that trait differences in discounting in healthy adults do not appear to be strongly associated with individual differences in D2-like receptors. The difference in meta-analytic correlation effects between healthy controls and individuals with psychopathology suggests that individual difference findings related to DA and reward discounting in clinical samples may not be reliably generalized to healthy controls, and vice versa.

SIGNIFICANCE STATEMENT Decisions to forgo large rewards for smaller ones due to increasing time delays, uncertainty, or physical effort have been linked to differences in dopamine (DA) function, which is disrupted in some forms of psychopathology. It remains unclear whether alterations in DA function associated with psychopathology also extend to explaining associations between DA function and decision making in healthy individuals. We show that individual differences in DA D2 receptor availability are not consistently related to monetary discounting of time, probability, or physical effort in healthy individuals across a broad age range. By contrast, we suggest that psychopathology accounts for observed inconsistencies in the relationship between measures of DA function and reward discounting behavior.

Striatal dopamine D2 receptors regulate effort but not value-based decision making and alter the dopaminergic encoding of cost

Deficits in goal-directed motivation represent a debilitating symptom for many patients with schizophrenia. Impairments in motivation can arise from deficits in processing information about effort and or value, disrupting effective cost-benefit decision making. We have previously shown that upregulated dopamine D2 receptor expression within the striatum (D2R-OE mice) decreases goal-directed motivation. Here, we determine the behavioral and neurochemical mechanisms behind this deficit. Female D2R-OE mice were tested in several behavioral paradigms including recently developed tasks that independently assess the impact of Value or Effort manipulations on cost-benefit decision making. In vivo microdialysis was used to measure extracellular dopamine in the striatum during behavior. In a value-based choice task, D2R-OE mice show normal sensitivity to changes in reward value and used reward value to guide their actions. In an effort-based choice task, D2R-OE mice evaluate the cost of increasing the number of responses greater relative to the effort cost of longer duration responses compared to controls. This shift away from choosing to repeatedly execute a response is accompanied by a dampening of extracellular dopamine in the striatum during goal-directed behavior. In the ventral striatum, extracellular dopamine level negatively correlates with response cost in controls, but this relationship is lost in D2R-OE mice. These results show that D2R signaling in the striatum, as observed in some patients with schizophrenia, alters the relationship between effort expenditure and extracellular dopamine. This dysregulation produces motivation deficits that are specific to effort but not value-based decision making, paralleling the effort-based motivational deficits observed in schizophrenia.

Dissociable functional activities of cortical theta and beta oscillations in the lateral prefrontal cortex during intertemporal choice

The lateral prefrontal cortex (LPFC) plays an important role in the neural networks involved in intertemporal choice. However, little is known about how the neural oscillation of LPFC functions during intertemporal choice, owing to the technical limitations of functional magnetic resonance imaging and event-related brain potential recordings. Electrocorticography (ECoG) is a novel neuroimaging technique that has high spatial and temporal resolution. In this study, we used ECoG and projected the ECoG data onto individual brain spaces to investigate human intracranial cortex activity and how neural oscillations of the LPFC impact intertemporal choice. We found that neural activity of theta oscillation was significantly higher during impulsive decisions, while beta oscillation activity was significantly higher during non-impulsive ones. Our findings suggest a functional dissociation between cortical theta and beta oscillations during decision-making processes involved in intertemporal choice, and that decision outcomes may be determined by LPFC modulation, which involves neural oscillations at different frequencies.

Impairment in delay discounting in schizophrenia and schizoaffective disorder but not primary mood disorders

A measure of planning and impulse control, the delay-discounting (DD) task estimates the extent to which an individual decreases the perceived value of a reward as the reward is delayed. We examined cross-disorder performance between healthy controls (n = 88), individuals with bipolar disorder (n = 23), major depressive disorder (n = 43), and primary psychotic disorders (schizophrenia and schizoaffective disorder; n = 51) on the DD task (using a $10 delayed larger reward), as well as the interaction of DD scores with other symptom domains (cognition, psychosis, and affect). We found that individuals with schizophrenia and schizoaffective disorder display significantly greater rates of discounting compared to healthy controls, while individuals with a primary mood disorder do not differ from healthy controls after adjustment for IQ. Further, impairment in working memory is associated with higher discounting rates among individuals with schizophrenia and schizoaffective disorder, but cognitive dysfunction alone does not account for the extent of impairment in DD. Taken together, these results suggest an impaired ability to plan for the future and make adaptive decisions that are specific to individuals with psychotic disorders, and likely related to adverse functional outcomes. More generally, this work demonstrates the presence of variation in impulsivity across major psychiatric illnesses, supporting the use of a trans-diagnostic perspective.

Patients with schizophrenia find it harder to delay gratification compared with patients diagnosed with other psychiatric disorders. Hannah Brown and colleagues in Roy Perlis’ lab at the Center for Quantitative Health at Massachusetts General Hospital, Boston, compared the performance of patients with bipolar disorder, major depressive disorder, schizophrenia, and healthy controls on a task that measures impulsivity. The delay discounting (DD) task assesses individuals’ ability to put off immediate pleasures for greater enjoyments later and is indicative of decision-making and planning behaviors. They found that certain aspects of cognitive dysfunction were associated with an increased preference for immediate rewards and that, even after adjusting for IQ, patients with schizophrenia showed significantly greater discounting rates compared with the other study participants. This variation in a specific measure of impulsivity suggests that the DD task could be used to better define aspects of impulsive behaviors across psychiatric disorders.

Increased delayed reward during intertemporal decision-making in schizophrenic patients and their unaffected siblings

Intertemporal choices are decisions with consequences in multiple time periods and constitute a significant part of social cognition. The shared neuropathological characteristics of patients with schizophrenia and their siblings might express intermediate phenotypes in behavior that could be used to further characterize the illness. Schizophrenic patients, unaffected siblings, and healthy controls underwent a computerized version of the "Intertemporal Choice Task". All participants could choose between sooner-smaller (SS) and later-larger (LL) options in now-trials and in not-now-trials. Subjects also underwent a battery of cognitive neuropsychological assessment. Our results indicated that schizophrenic patients and unaffected siblings both had a tendency to choose LL options in now-trials or not-now-trials compared to healthy controls. Schizophrenic patients had significantly lower scores in several cognitive tasks, including MoCA, attention, executive functions, and information processing when compared with the other two groups. Moreover, within the schizophrenic patient group, significant correlations were found between intertemporal decision-making performance and executive function. The present study showed that both schizophrenic patients and unaffected siblings preferred to choose larger-delayed rewards during intertemporal decision-making, which may result from frontal-striatal and frontal-parietal network dysfunction. Their intertemporal decision-making performance was associated with executive function performance.

Overlapping and disease specific trait, response, and reflection impulsivity in adolescents with first-episode schizophrenia spectrum disorders or attention-deficit/hyperactivity disorder

BACKGROUND

Schizophrenia and attention-deficit/hyperactivity disorder (ADHD) are developmental disorders with shared clinical characteristics such as cognitive impairments and impulsivity. Impulsivity is a core feature of ADHD and an important factor in aggression, violence, and substance use in schizophrenia. Based on the hypothesis that schizophrenia and ADHD represent a continuum of neurodevelopmental impairments, the aim was to identify overlapping and disease specific forms of impulsivity.

METHODS

Adolescents between 12 and 17 years of age were assessed with the Schedule for Affective Disorders and Schizophrenia for School-aged Children - Present and Lifetime Version. Subjects with early-onset, first-episode schizophrenia spectrum disorders (EOS) (N = 29) or ADHD (N = 29) and healthy controls (N = 45) were compared on two performance measures (Information Sampling Task, Stop Signal Task) and a subjective personality trait measure of impulsivity (Barratt Impulsiveness Scale, Version 11 (BIS-11)).

RESULTS

Significantly increased reflection impulsivity was observed in ADHD but not in the EOS group. No significant response inhibition deficits (stop signal reaction time) were found in the two clinical groups. The ADHD and the EOS group showed significantly increased motor, attentional, and non-planning subtraits of impulsivity.

CONCLUSIONS

Impaired pre-decisional information gathering appeared to be specific for ADHD while the information gathering was not significantly reduced in subjects with EOS. Neither the ADHD nor EOS group showed impaired response inhibition but shared increased personality subtraits of attentional, non-planning, and motor impulsivity although the latter was significantly more pronounced in ADHD. These increased subtraits of impulsivity may reflect diagnostic non-specific neurodevelopmental impairments in ADHD and EOS in adolescence.

Dissecting drug effects in preclinical models of impulsive choice: emphasis on glutamatergic compounds

RATIONALE

Impulsive choice is often measured with delay discounting paradigms. Because there are multiple discounting procedures, as well as different statistical analyses that can be applied to data generated from these paradigms, there are some inconsistencies in the literature regarding drug effects on impulsive choice.

OBJECTIVES

The goal of the current paper is to review the methodological and analytic approaches used to measure discounting and to discuss how these differences can account for differential drug effects observed across studies.

RESULTS

Because some procedures/analyses use a single data point as the dependent variable, changes in this value following pharmacological treatment may be interpreted as alterations in sensitivity to delayed reinforcement, but when other procedures/analyses are used, no changes in behavior are observed. Even when multiple data points are included, some studies show that the statistical analysis (e.g., ANOVA on raw proportion of responses vs. using hyperbolic/exponential functions) can lead to different interpretations. Finally, procedural differences (e.g., delay presentation order, signaling the delay to reinforcement, etc.) in the same discounting paradigm can alter how drugs affect sensitivity to delayed reinforcement.

CONCLUSIONS

Future studies should utilize paradigms that allow one to observe alterations in responding at each delay (e.g., concurrent-chains schedules). Concerning statistical analyses, using parameter estimates derived from nonlinear functions or incorporating the generalized matching law can allow one to determine if drugs affect sensitivity to delayed reinforcement or impair discrimination of the large and small magnitude reinforcers. Using these approaches can help further our understanding of the neurochemical underpinnings of delay discounting.

Elevated outcome-anticipation and outcome-evaluation ERPs associated with a greater preference for larger-but-delayed rewards

Although waiting for a reward reduces or discounts its value, some people have a stronger tendency to wait for larger rewards and forgo smaller-but-immediate rewards. This ability to delay gratification is captured by individual differences in so-called intertemporal choices in which individuals are asked to choose between larger-but-delayed versus smaller-but-immediate rewards. The current study used event-related potentials (ERPs) to examine whether enhancement in two neurocognitive processes, outcome anticipation and outcome evaluation, modulate individual variability in intertemporal responses. After completing a behavioral intertemporal choice task, 34 participants performed an ERP gambling task. From this ERP task, we separately examined individual differences in outcome anticipation (stimulus-preceding negativity; SPN), early outcome valuation (feedback-related negativity; FRN), and late outcome evaluation (P3). We observed that both elevated outcome-anticipation (SPN) and late outcome-evaluation (P3) neural processes predicted a stronger preference toward larger-but-delayed rewards. No relationship was observed between intertemporal responses and early outcome evaluation (FRN), indicating that the relationship between outcome evaluation and intertemporal responses was specific to the late outcome-evaluation processing stream. Moreover, multiple regression analyses indicated that the SPN and P3 independently modulate individual differences in intertemporal responses, suggesting separate mechanisms underlie the relationship between these two neurocognitive processes and intertemporal responses. Accordingly, we identify two potential neurocognitive modulators of individual variability in intertemporal responses. We discuss the mechanisms underlying these modulators in terms of anticipation-related processing (SPN) and a saliency bias toward gain (compared to loss) outcomes (P3).

Impulsivity in unaffected adolescent biological relatives of schizophrenia patients

OBJECTIVE

Although schizophrenia is not a prototypic impulse-control disorder, patients report more impulsive behaviors, have higher rates of substance use, and show dysfunction in brain circuits that underlie impulsivity. We investigate impulsivity in unaffected biological relatives of schizophrenia patients to further understand the relationships between schizophrenia risk and impulse control during adolescence.

METHOD

Group differences in impulsivity (UPPS-P Impulsive Behavior Scale and delay discounting) were tested in 210 adolescents contrasting 39 first- and 53 second-degree biological relatives of schizophrenia patients, and 118 subjects with no schizophrenia family history (NSFH).

RESULTS

Compared to NSFH adolescents and to second-degree relatives, first-degree relatives of schizophrenia patients had increased impulsivity-related behaviors (higher UPPS-P Perseverance, Positive Urgency and Premeditation subscale scores) and greater preference for immediate rewards (smaller AUC and larger discounting constant). Second-degree relatives did not differ significantly from NSFH adolescents on self-report impulsive behaviors or on measures of impulsive decision-making. These group differences remained even after careful consideration of potential confounding factors.

CONCLUSION

Impulsivity is associated with schizophrenia risk, and its severity increases with greater familial relatedness to the schizophrenia proband. Additional studies are needed to understand the role impulsivity may play in mediating schizophrenia susceptibility during adolescence.

Increased reward-oriented impulsivity in older bipolar patients: A preliminary study

OBJECTIVE

Impulsivity is a well-established trait of bipolar disorder (BD) that persists across mood phases. It is, however, still unknown whether, in BD, impulsivity remains stable or varies in intensity over the lifespan. This cross-sectional study compared impulsive behavior in older euthymic BD patients and healthy individuals using a range of self-rating and behavioral measures of impulsivity.

METHODS

28 BD patients (56.07 ± 4.08 years, 16 women) and 15 healthy controls (HC; 55.1 ± 3.95 years, 6 women) were administered the Barratt Impulsivity Scale (BIS) and selected tasks of the Cambridge Neuropsychological Test Automated Batter (CANTAB) reflecting impulsivity. Multivariate analysis of variance controlled for age compared impulsivity measures across BD and HC.

RESULTS

BD patients displayed poor decision making, risk taking, and increased delay aversion. Other measures of impulsivity such as response inhibition, sustained cognitive control, and BIS scores were, overall, comparable between BD and HC.

CONCLUSIONS

These preliminary findings suggest that, in BD, aspects of impulsivity related to reward-based decision making persist into late adulthood. Large scale, longitudinal studies are needed to evaluate the relationship of age to impulsivity over time, and explore the link between impulsivity and illness progression in elderly individuals with BD.

Sex differences in animal models of decision making

The ability to weigh the costs and benefits of various options to make an adaptive decision is critical to an organism's survival and wellbeing. Many psychiatric diseases are characterized by maladaptive decision making, indicating a need for better understanding of the mechanisms underlying this process and the ways in which it is altered under pathological conditions. Great strides have been made in uncovering these mechanisms, but the majority of what is known comes from studies conducted solely in male subjects. In recent years, decision-making research has begun to include female subjects to determine whether sex differences exist and to identify the mechanisms that contribute to such differences. This Mini-Review begins by describing studies that have examined sex differences in animal (largely rodent) models of decision making. Possible explanations, both theoretical and biological, for such differences in decision making are then considered. The Mini-Review concludes with a discussion of the implications of sex differences in decision making for understanding psychiatric conditions. © 2016 Wiley Periodicals, Inc.