1
|
Montemitro C, Ossola P, Ross TJ, Huys QJM, Fedota JR, Salmeron BJ, di Giannantonio M, Stein EA. Longitudinal changes in reinforcement learning during smoking cessation: a computational analysis using a probabilistic reward task. Sci Rep 2024; 14:32171. [PMID: 39741189 PMCID: PMC11688494 DOI: 10.1038/s41598-024-84091-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2024] [Accepted: 12/19/2024] [Indexed: 01/02/2025] Open
Abstract
Despite progress in smoking reduction in the past several decades, cigarette smoking remains a significant public health concern world-wide, with many smokers attempting but ultimately failing to maintain abstinence. However, little is known about how decision-making evolves in quitting smokers. Based on preregistered hypotheses and analysis plan ( https://osf.io/yq5th ), we examined the evolution of reinforcement learning (RL), a key component of decision-making, in smokers during acute and extended nicotine abstinence. In a longitudinal, within-subject design, we used a probabilistic reward task (PRT) to assess RL in twenty smokers who successfully refrained from smoking for at least 30 days. We evaluated changes in reward-based decision-making using signal-detection analysis and five RL models across three sessions during 30 days of nicotine abstinence. Contrary to our preregistered hypothesis, punishment sensitivity emerged as the only parameter that changed during smoking cessation. While it is plausible that some changes in task performance could be attributed to task repetition effects, we observed a clear impact of the Nicotine Withdrawal Syndrome (NWS) on RL, and a dynamic relationship between craving and reward and punishment sensitivity over time, suggesting a significant recalibration of cognitive processes during abstinence. In this context, the heightened sensitivity to negative outcomes observed at the last session (30 days after quitting) compared to the previous sessions, may be interpreted as a cognitive adaptation aimed at fostering long-term abstinence. While further studies are needed to clarify the mechanisms underlying punishment sensitivity during nicotine abstinence, these results highlight the need for personalized treatment approaches tailored to individual needs.
Collapse
Affiliation(s)
- Chiara Montemitro
- Neuroimaging Research Branch, National Institute on Drug Abuse-Intramural Research Program, National Institutes of Health, Baltimore, MD, USA.
- Department of Neuroscience, Imaging and Clinical Sciences, "G. d'Annunzio" University, Chieti, Italy.
- Center for Social and Affective Neuroscience, Linköping University, Linköping, Sweden.
| | - Paolo Ossola
- Department of Medicine and Surgery, University of Parma, Parma, Italy
- Department of Mental Health, AUSL Parma, Parma, Italy
| | - Thomas J Ross
- Neuroimaging Research Branch, National Institute on Drug Abuse-Intramural Research Program, National Institutes of Health, Baltimore, MD, USA.
| | - Quentin J M Huys
- Applied Computational Psychiatry Laboratory, Mental Health Neuroscience Department, Division of Psychiatry and Max Planck Centre for Computational Psychiatry and Ageing Research, Queen Square Institute of Neurology, University College London, London, UK
| | - John R Fedota
- Neuroimaging Research Branch, National Institute on Drug Abuse-Intramural Research Program, National Institutes of Health, Baltimore, MD, USA
- Behavioral and Cognitive Neuroscience Branch, Division of Neuroscience and Behavior, National Institute on Drug Abuse, National Institutes of Health, Bethesda, MD, USA
| | - Betty Jo Salmeron
- Neuroimaging Research Branch, National Institute on Drug Abuse-Intramural Research Program, National Institutes of Health, Baltimore, MD, USA
| | - Massimo di Giannantonio
- Department of Neuroscience, Imaging and Clinical Sciences, "G. d'Annunzio" University, Chieti, Italy
| | - Elliot A Stein
- Neuroimaging Research Branch, National Institute on Drug Abuse-Intramural Research Program, National Institutes of Health, Baltimore, MD, USA
| |
Collapse
|
2
|
Gunn MP, Rose GM, Whitton AE, Pizzagalli DA, Gilbert DG. Smoking Progression and Nicotine-Enhanced Reward Sensitivity Predicted by Resting-State Functional Connectivity in Salience and Executive Control Networks. Nicotine Tob Res 2024; 26:1305-1312. [PMID: 38624067 PMCID: PMC11417123 DOI: 10.1093/ntr/ntae084] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Revised: 03/14/2024] [Accepted: 04/08/2024] [Indexed: 04/17/2024]
Abstract
INTRODUCTION The neural underpinnings underlying individual differences in nicotine-enhanced reward sensitivity (NERS) and smoking progression are poorly understood. Thus, we investigated whether brain resting-state functional connectivity (rsFC.) during smoking abstinence predicts NERS and smoking progression in young light smokers. We hypothesized that high rsFC between brain areas with high densities of nicotinic receptors (insula, anterior cingulate cortex [ACC], hippocampus, thalamus) and areas involved in reward-seeking (nucleus accumbens [NAcc], prefrontal cortex [PFC]) would predict NERS and smoking progression. AIMS AND METHODS Young light smokers (N = 64, age 18-24, M = 1.89 cigarettes/day) participated in the study. These individuals smoked between 5 and 35 cigarettes per week and lifetime use never exceeded 35 cigarettes per week. Their rsFC was assessed using functional magnetic resonance imaging after 14 hours of nicotine deprivation. Subjects also completed a probabilistic reward task after smoking a placebo on 1 day and a regular cigarette on another day. RESULTS The probabilistic-reward-task assessed greater NERS was associated with greater rsFC between the right anterior PFC and right NAcc, but with reduced rsFC between the ACC and left inferior prefrontal gyrus and the insula and ACC. Decreased rsFC within the salience network (ACC and insula) predicted increased smoking progression across 18 months and greater NERS. CONCLUSIONS These findings provide the first evidence that differences in rsFCs in young light smokers are associated with nicotine-enhanced reward sensitivity and smoking progression. CLINICAL TRIAL REGISTRATION NCT02129387 (preregistered hypothesis: www.clinicaltrials.gov). IMPLICATIONS Weaker rsFC within the salience network predicted greater NERS and smoking progression. These findings suggest that salience network rsFC and drug-enhanced reward sensitivity may be useful tools and potential endophenotypes for reward sensitivity and drug-dependence research.
Collapse
Affiliation(s)
- Matthew P Gunn
- Department of Psychology, Southern Illinois University, Carbondale, IL, USA
| | - Gregory M Rose
- Department of Anatomy, Southern Illinois University School of Medicine, Carbondale, IL, USA
| | - Alexis E Whitton
- Division of Medical Science, McLean Hospital & Harvard Medical School, Boston, MA, USA
- Black Dog Institute, University of New South Wales, Sydney, NSW, Australia
| | - Diego A Pizzagalli
- Division of Medical Science, McLean Hospital & Harvard Medical School, Boston, MA, USA
| | - David G Gilbert
- Department of Psychology, Southern Illinois University, Carbondale, IL, USA
| |
Collapse
|
3
|
Gollan JK, Liverant G, Jao NC, Lord KA, Whitton AE, Hogarth L, Fox E, Bauer AM, Quinn MH, Pizzagalli DA, Leone FT, Papandonatos GD, Schnoll RA, Hitsman B. Depression Severity Moderates Reward Learning Among Smokers With Current or Past Major Depressive Disorder in a Smoking Cessation Randomized Clinical Trial. Nicotine Tob Res 2024; 26:639-644. [PMID: 37943674 PMCID: PMC11033567 DOI: 10.1093/ntr/ntad221] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2023] [Revised: 10/11/2023] [Accepted: 10/25/2023] [Indexed: 11/12/2023]
Abstract
INTRODUCTION Behavioral and pharmacological smoking cessation treatments are hypothesized to increase patients' reward learning to reduce craving. Identifying changes in reward learning processes that support effective tobacco-dependence interventions among smokers who experience depression may guide patients toward efficient treatment strategies. The objective was to investigate the extent to which adult daily cigarette smokers with current or past major depressive disorder (MDD) learned to seek reward during 12 weeks of treatment combining behavioral activation and varenicline. We hypothesized that a decline in reward learning would be attenuated (least to most) in the following order: (1) behavioral activation integrated with ST (BASC) + varenicline, (2) BASC + placebo, (3) standard behavioral cessation treatment (ST) + varenicline, (4) ST + placebo. METHODS We ran a phase IV, placebo-controlled, randomized clinical trial with 300 participants receiving 12 weeks of one of four conditions across two urban medical centers. Depressive symptoms were measured using the Beck Depression Inventory-II (BDI). Reward learning was ascertained at weeks 1, 7, and 14 using the Probabilistic Reward Task (PRT), a laboratory task that uses an asymmetric reinforcement schedule to assess (a) learning to seek reward (response bias), (b) differentiate between stimuli, and (c) time to react to cues. RESULTS There was a significant interaction of BDI group × PRT response bias. Response bias declined from weeks 7 to 14 among participants with high baseline depression symptoms. The other two BDI groups showed no change in response bias. CONCLUSIONS Controlling for baseline depression, participants showed a decrease in response bias from weeks 1 to 14, and from weeks 7 to 14. Treatment condition and abstinence status were unassociated with change in reward learning. IMPLICATIONS Smokers who report greater depression severity show a decline in reward learning despite their participation in smoking cessation treatments, suggesting that depressed populations pose unique challenges with standard smoking cessation approaches. TRIAL REGISTRATION ClinicalTrials.gov Identifier: NCT02378714.
Collapse
Affiliation(s)
- Jacqueline K Gollan
- Department of Psychiatry and Behavioral Sciences, Northwestern University, Chicago, IL, USA
| | | | - Nancy C Jao
- Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | - Kayla A Lord
- Institute of Living, Hartford Hospital, Hartford, CT, USA
| | - Alexis E Whitton
- Black Dog Institute, The University of New South Wales, Sydney, New South Wales, Australia
| | - Lee Hogarth
- Department of Psychology, University of Exeter, Exeter, UK
| | - Erica Fox
- Department of Preventive Medicine, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Anna-Marika Bauer
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Mackenzie Hosie Quinn
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | | | - Frank T Leone
- Pulmonary, Allergy & Critical Care Division, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | | | - Robert A Schnoll
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
- Center for Statistical Sciences, Brown University, Providence, RI, USA
| | - Brian Hitsman
- Department of Psychiatry and Behavioral Sciences, Northwestern University, Chicago, IL, USA
- Department of Preventive Medicine, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| |
Collapse
|
4
|
Abstract
Prior findings indicate that trait anhedonia enhances the likelihood of becoming a tobacco smoker, and preliminary evidence suggests that smoking abstinence leads to anhedonic states in some individuals and situations, and nicotine administration reduces anhedonic states. Nevertheless, many vital questions exist concerning relationships between anhedonia and nicotine dependence, including situational and individual difference factors that may moderate the strength of these associations. This chapter provides a critical review of the literature assessing relationships of anhedonia to nicotine dependence and the effects of acute nicotine through the lenses of the Research Domain Criteria's (RDoC) Positive Valence Systems (NIMH, RDoC changes to the matrix (CMAT) workgroup update: proposed positive valence domain revisions. A report by the national advisory mental health council workgroup on changes to the research domain criteria matrix, 2018) and the Situation x Trait Affective Response (STAR) model of nicotine's effects and nicotine dependence (Gilbert, Smoking individual differences, psychopathology, and emotion. Taylor and Francis, Washington, DC, 1995; Gilbert, Hum Psychopharmacol Clin Exp 12:S89-S102, 1997). The effects of nicotine and nicotine withdrawal on subjective, behavioral, and brain indices vary across the three RDoC Positive Valences Systems (Reward Responsiveness, Reward Learning, and Reward Valuation) in a manner that supports the research and potential clinical utility of using RDoC criteria and the STAR model to guide research and clinical innovation. We provide a revision of the STAR model that incorporates the three RDoC Positive Valence Systems with evidence that nicotine's effects on hedonic and affective processes vary as a function of the dominance/salience of (1) situational hedonic and affective cues and task/active coping cues, and (2) state executive functioning level/capacity and state reward sensitivity such that these effects of nicotine are maximal during states of suboptimal cognitive functioning and reward sensitivity, combined with low situational stimulus salience and low task-related cues/demands.
Collapse
Affiliation(s)
- David G Gilbert
- School of Psychological and Social Sciences, Southern Illinois University-Carbondale, Carbondale, IL, USA.
| | - Bryant M Stone
- School of Psychological and Social Sciences, Southern Illinois University-Carbondale, Carbondale, IL, USA
| |
Collapse
|
5
|
Smoking as a Common Modulator of Sensory Gating and Reward Learning in Individuals with Psychotic Disorders. Brain Sci 2021; 11:brainsci11121581. [PMID: 34942883 PMCID: PMC8699526 DOI: 10.3390/brainsci11121581] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2021] [Revised: 11/23/2021] [Accepted: 11/26/2021] [Indexed: 02/07/2023] Open
Abstract
Motivational and perceptual disturbances co-occur in psychosis and have been linked to aberrations in reward learning and sensory gating, respectively. Although traditionally studied independently, when viewed through a predictive coding framework, these processes can both be linked to dysfunction in striatal dopaminergic prediction error signaling. This study examined whether reward learning and sensory gating are correlated in individuals with psychotic disorders, and whether nicotine—a psychostimulant that amplifies phasic striatal dopamine firing—is a common modulator of these two processes. We recruited 183 patients with psychotic disorders (79 schizophrenia, 104 psychotic bipolar disorder) and 129 controls and assessed reward learning (behavioral probabilistic reward task), sensory gating (P50 event-related potential), and smoking history. Reward learning and sensory gating were correlated across the sample. Smoking influenced reward learning and sensory gating in both patient groups; however, the effects were in opposite directions. Specifically, smoking was associated with improved performance in individuals with schizophrenia but impaired performance in individuals with psychotic bipolar disorder. These findings suggest that reward learning and sensory gating are linked and modulated by smoking. However, disorder-specific associations with smoking suggest that nicotine may expose pathophysiological differences in the architecture and function of prediction error circuitry in these overlapping yet distinct psychotic disorders.
Collapse
|