1
|
Nicolaou S, Pascual JC, Soler J, Ortega G, Marco-Pallarés J, Vega D. Mapping punishment avoidance learning deficits in non-suicidal self-injury in young adults with and without borderline personality disorder: An fMRI study. J Affect Disord 2025; 370:489-498. [PMID: 39542117 DOI: 10.1016/j.jad.2024.11.026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/23/2024] [Revised: 11/04/2024] [Accepted: 11/06/2024] [Indexed: 11/17/2024]
Abstract
INTRODUCTION Non-suicidal self-injury (NSSI) is a growing public health concern among young adults in both clinical and non-clinical settings. Despite evidence linking NSSI to alterations in learning from reward and punishment, this area remains understudied, especially in non-clinical populations without borderline personality disorder (BPD). METHODS We employed a modified version of the Probabilistic Stimulus Selection (PSS) task in two groups of young adults with recurrent NSSI, with (NSSI+BPD) and without BPD (NSSI), and an additional group of healthy controls (HC). While undergoing functional magnetic resonance imaging (fMRI), participants were asked to choose between pairs of stimuli with different reward probabilities. In the training phase, they received probabilistic feedback and learned to identify the most rewarding option within fixed pairs. In the test phase, these learned stimuli were recombined into novel pairs, where participants' accuracy in selecting the most rewarding and avoiding the most punishing options reflected their ability to learn from reward and punishment, respectively. RESULTS Compared to HC, participants in the NSSI and NSSI+BPD groups were less accurate at avoiding the most punishing options than at choosing the most rewarding options, and showed reduced activity in the nucleus accumbens (NAcc) during punishment avoidance relative to reward selection. LIMITATIONS The modest sample size, descriptive rather than modeling approach, and absence of ecological momentary assessments may limit the results. CONCLUSION Findings suggest that reduced activation of the NAcc when avoiding loss may underlie difficulties in learning to avoid punishment in young adults with NSSI, regardless of the presence of BPD.
Collapse
Affiliation(s)
- Stella Nicolaou
- Department of Cognition, Development and Educational Psychology, Institute of Neurosciences, University of Barcelona, Barcelona, Spain; Cognition and Brain Plasticity Unit, Bellvitge Biomedical Research Institute (IDIBELL), L'Hospitalet de Llobregat, Barcelona, Spain; Department of Psychiatry and Mental Health, Consorci Sanitari de l'Anoia & Fundació Sanitària d'Igualada, Hospital Universitari d'Igualada, Barcelona, Spain
| | - Juan Carlos Pascual
- Centro de Investigación Biomédica en Red de Salud Mental. CIBERSAM, Madrid, Spain; Department of Psychiatry, Hospital de la Santa Creu i Sant Pau, Institut d'Investigació Biomèdica-Sant Pau (IIB-Sant Pau), Barcelona, Spain; Department of Psychiatry and Forensic Medicine, Institute of Neurosciences, Universitat Autònoma de Barcelona, Barcelona, Spain
| | - Joaquim Soler
- Centro de Investigación Biomédica en Red de Salud Mental. CIBERSAM, Madrid, Spain; Department of Psychiatry, Hospital de la Santa Creu i Sant Pau, Institut d'Investigació Biomèdica-Sant Pau (IIB-Sant Pau), Barcelona, Spain; Department of Psychiatry and Forensic Medicine, Institute of Neurosciences, Universitat Autònoma de Barcelona, Barcelona, Spain
| | - Gregori Ortega
- Imaging Diagnostic Department, Consorci Sanitari de l'Anoia & Fundació Sanitària d'Igualada, Hospital Universitari d'Igualada, Barcelona, Spain
| | - Josep Marco-Pallarés
- Department of Cognition, Development and Educational Psychology, Institute of Neurosciences, University of Barcelona, Barcelona, Spain; Cognition and Brain Plasticity Unit, Bellvitge Biomedical Research Institute (IDIBELL), L'Hospitalet de Llobregat, Barcelona, Spain
| | - Daniel Vega
- Department of Psychiatry and Mental Health, Consorci Sanitari de l'Anoia & Fundació Sanitària d'Igualada, Hospital Universitari d'Igualada, Barcelona, Spain; Department of Psychiatry and Forensic Medicine, Institute of Neurosciences, Universitat Autònoma de Barcelona, Barcelona, Spain.
| |
Collapse
|
2
|
Iigaya K, Larsen T, Fong T, O'Doherty JP. Computational and Neural Evidence for Altered Fast and Slow Learning from Losses in Problem Gambling. J Neurosci 2025; 45:e0080242024. [PMID: 39557579 DOI: 10.1523/jneurosci.0080-24.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2024] [Revised: 09/27/2024] [Accepted: 10/29/2024] [Indexed: 11/20/2024] Open
Abstract
Learning occurs across multiple timescales, with fast learning crucial for adapting to sudden environmental changes, and slow learning beneficial for extracting robust knowledge from multiple events. Here, we asked if miscalibrated fast vs slow learning can lead to maladaptive decision-making in individuals with problem gambling. We recruited participants with problem gambling (PG; N = 20; 9 female and 11 male) and a recreational gambling control group without any symptoms associated with PG (N = 20; 10 female and 10 male) from the community in Los Angeles, CA. Participants performed a decision-making task involving reward-learning and loss-avoidance while being scanned with fMRI. Using computational model fitting, we found that individuals in the PG group showed evidence for an excessive dependence on slow timescales and a reduced reliance on fast timescales during learning. fMRI data implicated the putamen, an area associated with habit, and medial prefrontal cortex (PFC) in slow loss-value encoding, with significantly more robust encoding in medial PFC in the PG group compared to controls. The PG group also exhibited stronger loss prediction error encoding in the insular cortex. These findings suggest that individuals with PG have an impaired ability to adjust their predictions following losses, manifested by a stronger influence of slow value learning. This impairment could contribute to the behavioral inflexibility of problem gamblers, particularly the persistence in gambling behavior typically observed in those individuals after incurring loss outcomes.
Collapse
Affiliation(s)
- Kiyohito Iigaya
- Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, California 91125
- Department of Psychiatry, Columbia University Irving Medical Center, New York, New York 10032
- Center for Theoretical Neuroscience and Zuckerman Institute, Columbia University, New York, New York 10027
- New York State Psychiatric Institute, New York, New York 10032
| | - Tobias Larsen
- Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, California 91125
| | - Timothy Fong
- Semel Institute for Neuroscience and Human Behavior, UCLA, Los Angeles, California 90024
| | - John P O'Doherty
- Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, California 91125
| |
Collapse
|
3
|
Hatzithomas L. Play-mirth theory: a cognitive appraisal theory of humor. Front Psychol 2024; 15:1473742. [PMID: 39712539 PMCID: PMC11659645 DOI: 10.3389/fpsyg.2024.1473742] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2024] [Accepted: 11/19/2024] [Indexed: 12/24/2024] Open
Abstract
This work aims to introduce a general theory of humor elicitation and appreciation, the play-mirth theory, which is based on the cognitive appraisal perspective. Two experiments test the theory's central hypothesis: that is, to experience humor, one must interpret (a) a stimulus as a playful turn and (b) the turn as consistent with their motives. In the first experiment, 104 undergraduate students rated the appraisal determinants of successful and failed humor experiences that they recalled. In the second experiment, appraisals of playful turn (i.e., present or absent), situational state (i.e., motive-inconsistent/motive-consistent), and motivational state (punishment/reward) were manipulated. Overall, 150 undergraduate students were exposed to the manipulated stimuli and answered a structured questionnaire. The findings provide the first experimental evidence that two appraisals (i.e., playful turn and motive-consistency) do elicit humor. Play-mirth hypothesis sufficiently differentiates humorous from nonhumorous experiences as well as mirth from other positive emotions such as joy, and relief.
Collapse
Affiliation(s)
- Leonidas Hatzithomas
- Department of Business Administration, University of Macedonia, Thessaloniki, Greece
| |
Collapse
|
4
|
Fisher CTL, Urcelay GP. Safety signals reinforce instrumental avoidance in humans. Learn Mem 2024; 31:a053914. [PMID: 39260876 PMCID: PMC11407691 DOI: 10.1101/lm.053914.123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2023] [Accepted: 07/24/2024] [Indexed: 09/13/2024]
Abstract
Safety signals reinforce instrumental avoidance behavior in nonhuman animals. However, there are no conclusive demonstrations of this phenomenon in humans. Using human participants in an avoidance task, Experiments 1-3 and 5 were conducted online to assess the reinforcing properties of safety signals, and Experiment 4 was conducted in the laboratory. Participants were trained with CSs+ and CSs-, and they could avoid an aversive outcome during presentations of the CSs+ by pressing their space bar at a specific time. If successful, the aversive outcome was not presented but instead a safety signal was. Participants were then tested-whilst on extinction-with two new ambiguous test CSs. If participants made an avoidance response, one of the test CSs produced the trained safety signal and the other was a control. In Experiments 1 and 4, the control was followed by no signal. In Experiment 2, the control was followed by a signal that differed in one dimension (color) with the trained safety signal, and in Experiment 3, the control differed in two dimensions (shape and color) from the trained safety signal. Experiment 5 tested the reinforcing properties of the safety signal using a choice procedure and a new response during test. We observed that participants made more avoidance responses to the ambiguous test CSs when followed by the trained signal in Experiments 1, 3, 4, and 5 (but not in Experiment 2). Overall, these results suggest that trained safety signals can reinforce avoidance behavior in humans.
Collapse
Affiliation(s)
- Courteney T L Fisher
- School of Psychology, University of Nottingham, Nottingham NG7 2RD, United Kingdom
| | - Gonzalo P Urcelay
- School of Psychology, University of Nottingham, Nottingham NG7 2RD, United Kingdom
| |
Collapse
|
5
|
Combrisson E, Basanisi R, Gueguen MCM, Rheims S, Kahane P, Bastin J, Brovelli A. Neural interactions in the human frontal cortex dissociate reward and punishment learning. eLife 2024; 12:RP92938. [PMID: 38941238 PMCID: PMC11213568 DOI: 10.7554/elife.92938] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/30/2024] Open
Abstract
How human prefrontal and insular regions interact while maximizing rewards and minimizing punishments is unknown. Capitalizing on human intracranial recordings, we demonstrate that the functional specificity toward reward or punishment learning is better disentangled by interactions compared to local representations. Prefrontal and insular cortices display non-selective neural populations to rewards and punishments. Non-selective responses, however, give rise to context-specific interareal interactions. We identify a reward subsystem with redundant interactions between the orbitofrontal and ventromedial prefrontal cortices, with a driving role of the latter. In addition, we find a punishment subsystem with redundant interactions between the insular and dorsolateral cortices, with a driving role of the insula. Finally, switching between reward and punishment learning is mediated by synergistic interactions between the two subsystems. These results provide a unifying explanation of distributed cortical representations and interactions supporting reward and punishment learning.
Collapse
Affiliation(s)
- Etienne Combrisson
- Institut de Neurosciences de la Timone, Aix Marseille UniversitéMarseilleFrance
| | - Ruggero Basanisi
- Institut de Neurosciences de la Timone, Aix Marseille UniversitéMarseilleFrance
| | - Maelle CM Gueguen
- Univ. Grenoble Alpes, Inserm, U1216, Grenoble Institut NeurosciencesGrenobleFrance
| | - Sylvain Rheims
- Department of Functional Neurology and Epileptology, Hospices Civils de Lyon and University of LyonLyonFrance
| | - Philippe Kahane
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut NeurosciencesGrenobleFrance
| | - Julien Bastin
- Univ. Grenoble Alpes, Inserm, U1216, Grenoble Institut NeurosciencesGrenobleFrance
| | - Andrea Brovelli
- Institut de Neurosciences de la Timone, Aix Marseille UniversitéMarseilleFrance
| |
Collapse
|
6
|
Liu H, Liu J, Sun S, Dai W, Nie B, Xu B, Dong Z, Yu S. Medication overuse headache associated with decreased dopamine transporter availability in the medial but not in the lateral orbitofrontal cortex: a 11CFT PET/MR study. Int J Neurosci 2024; 134:543-550. [PMID: 36120989 DOI: 10.1080/00207454.2022.2126773] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2022] [Revised: 08/25/2022] [Accepted: 08/26/2022] [Indexed: 10/14/2022]
Abstract
BACKGROUNDS Dysfunction of the mesocorticolimbic dopamine system in medication overuse headache (MOH) is unknown. This study aimed to determine dopamine transporter (DAT) availability, which is sensitive to dopamine levels, in the mesocorticolimbic dopamine system in MOH patients. METHODS This case-control study investigated eligible MOH patients admitted to the International Headache Centre in the neurological department of Chinese PLA General Hospital between July 2018 and August 2019. All subjects underwent an integrated positron emission tomography (PET)/magnetic resonance (MR) brain scans with 11CFT, a radioligand that binds to DAT. Standardised uptake value ratio (SUVr) images were compared voxelwise between MOH patients and healthy controls (HCs). SUVr values from significantly changed regions were extracted, and partial correlation analyses with clinical measures were conducted. RESULTS We examined 17 MOH patients and 16 HCs. MOH patients had lower SUVr levels in the medial rather than lateral orbitofrontal cortex (OFC) than HCs (T = -5.0317, PGRF < 0.01), which showed no correlation with clinical features. CONCLUSIONS MOH is characterised by decreased DAT availability in the medial OFC, which might reflect compensatory downregulation due to low dopamine signalling within the mesocorticolimbic dopamine system and provide a new perspective to understand the pathogenesis of MOH.
Collapse
Affiliation(s)
- Huanxian Liu
- Department of Neurology, Chinese PLA General Hospital, Beijing, China
- Medical School of Chinese PLA, Beijing, China
| | - Jiajin Liu
- Department of Nuclear Medicine, First Medical Center, Chinese PLA General Hospital, Beijing, China
| | - Shuping Sun
- Department of Neurology, Chinese PLA General Hospital, Beijing, China
- Medical School of Chinese PLA, Beijing, China
| | - Wei Dai
- Department of Neurology, Chinese PLA General Hospital, Beijing, China
- Medical School of Chinese PLA, Beijing, China
| | - Binbin Nie
- Beijing Engineering Research Center of Radiographic Techniques and Equipment, Institute of High Energy Physics, Chinese Academy of Sciences, Beijing, China
| | - Baixuan Xu
- Department of Nuclear Medicine, First Medical Center, Chinese PLA General Hospital, Beijing, China
| | - Zhao Dong
- Department of Neurology, Chinese PLA General Hospital, Beijing, China
- International Headache Center, Chinese PLA General Hospital, Beijing, China
| | - Shengyuan Yu
- Department of Neurology, Chinese PLA General Hospital, Beijing, China
- International Headache Center, Chinese PLA General Hospital, Beijing, China
| |
Collapse
|
7
|
Carvalheiro J, Philiastides MG. Distinct spatiotemporal brainstem pathways of outcome valence during reward- and punishment-based learning. Cell Rep 2023; 42:113589. [PMID: 38100353 DOI: 10.1016/j.celrep.2023.113589] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Revised: 10/05/2023] [Accepted: 11/30/2023] [Indexed: 12/17/2023] Open
Abstract
Learning to seek rewards and avoid punishments, based on positive and negative choice outcomes, is essential for human survival. Yet, the neural underpinnings of outcome valence in the human brainstem and the extent to which they differ in reward and punishment learning contexts remain largely elusive. Here, using simultaneously acquired electroencephalography and functional magnetic resonance imaging data, we show that during reward learning the substantia nigra (SN)/ventral tegmental area (VTA) and locus coeruleus are initially activated following negative outcomes, while the VTA subsequently re-engages exhibiting greater responses for positive than negative outcomes, consistent with an early arousal/avoidance response and a later value-updating process, respectively. During punishment learning, we show that distinct raphe nucleus and SN subregions are activated only by negative outcomes with a sustained post-outcome activity across time, supporting the involvement of these brainstem subregions in avoidance behavior. Finally, we demonstrate that the coupling of these brainstem structures with other subcortical and cortical areas helps to shape participants' serial choice behavior in each context.
Collapse
Affiliation(s)
- Joana Carvalheiro
- School of Psychology and Neuroscience, University of Glasgow, Glasgow G12 8QB, UK; Centre for Cognitive Neuroimaging, University of Glasgow, Glasgow G12 8QB, UK.
| | - Marios G Philiastides
- School of Psychology and Neuroscience, University of Glasgow, Glasgow G12 8QB, UK; Centre for Cognitive Neuroimaging, University of Glasgow, Glasgow G12 8QB, UK.
| |
Collapse
|
8
|
Dong Y, Li Y, Xiang X, Xiao ZC, Hu J, Li Y, Li H, Hu H. Stress relief as a natural resilience mechanism against depression-like behaviors. Neuron 2023; 111:3789-3801.e6. [PMID: 37776853 DOI: 10.1016/j.neuron.2023.09.004] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Revised: 08/07/2023] [Accepted: 09/06/2023] [Indexed: 10/02/2023]
Abstract
Relief, the appetitive state after the termination of aversive stimuli, is evolutionarily conserved. Understanding the behavioral role of this well-conserved phenomenon and its underlying neurobiological mechanisms are open and important questions. Here, we discover that the magnitude of relief from physical stress strongly correlates with individual resilience to depression-like behaviors in chronic stressed mice. Notably, blocking stress relief causes vulnerability to depression-like behaviors, whereas natural rewards supplied shortly after stress promotes resilience. Stress relief is mediated by reward-related mesolimbic dopamine neurons, which show minute-long, persistent activation after stress termination. Circuitry-wise, activation or inhibition of circuits downstream of the ventral tegmental area during the transient relief period bi-directionally regulates depression resilience. These results reveal an evolutionary function of stress relief in depression resilience and identify the neural substrate mediating this effect. Importantly, our data suggest a behavioral strategy of augmenting positive valence of stress relief with natural rewards to prevent depression.
Collapse
Affiliation(s)
- Yiyan Dong
- Department of Psychiatry and International Institutes of Medicine, The Fourth Affiliated Hospital, Zhejiang University School of Medicine, Yiwu 322000, China; Liangzhu Laboratory, MOE Frontier Science Center for Brain Science and Brain-Machine Integration, State Key Laboratory of Brain-Machine Intelligence, New Cornerstone Science Laboratory, Zhejiang University, Hangzhou 311121, China
| | - Yifei Li
- Liangzhu Laboratory, MOE Frontier Science Center for Brain Science and Brain-Machine Integration, State Key Laboratory of Brain-Machine Intelligence, New Cornerstone Science Laboratory, Zhejiang University, Hangzhou 311121, China
| | - Xinkuan Xiang
- Liangzhu Laboratory, MOE Frontier Science Center for Brain Science and Brain-Machine Integration, State Key Laboratory of Brain-Machine Intelligence, New Cornerstone Science Laboratory, Zhejiang University, Hangzhou 311121, China
| | - Zhuo-Cheng Xiao
- Courant Institute of Mathematical Sciences, New York University, New York, NY 10003, USA
| | - Ji Hu
- School of Life Science and Technology, ShanghaiTech University, Shanghai 201210, China
| | - Yulong Li
- State Key Laboratory of Membrane Biology, Peking University School of Life Sciences, Beijing 100871, China
| | - Haohong Li
- Liangzhu Laboratory, MOE Frontier Science Center for Brain Science and Brain-Machine Integration, State Key Laboratory of Brain-Machine Intelligence, New Cornerstone Science Laboratory, Zhejiang University, Hangzhou 311121, China
| | - Hailan Hu
- Department of Psychiatry and International Institutes of Medicine, The Fourth Affiliated Hospital, Zhejiang University School of Medicine, Yiwu 322000, China; Liangzhu Laboratory, MOE Frontier Science Center for Brain Science and Brain-Machine Integration, State Key Laboratory of Brain-Machine Intelligence, New Cornerstone Science Laboratory, Zhejiang University, Hangzhou 311121, China.
| |
Collapse
|
9
|
Sands LP, Jiang A, Liebenow B, DiMarco E, Laxton AW, Tatter SB, Montague PR, Kishida KT. Subsecond fluctuations in extracellular dopamine encode reward and punishment prediction errors in humans. SCIENCE ADVANCES 2023; 9:eadi4927. [PMID: 38039368 PMCID: PMC10691773 DOI: 10.1126/sciadv.adi4927] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Accepted: 11/03/2023] [Indexed: 12/03/2023]
Abstract
In the mammalian brain, midbrain dopamine neuron activity is hypothesized to encode reward prediction errors that promote learning and guide behavior by causing rapid changes in dopamine levels in target brain regions. This hypothesis (and alternatives regarding dopamine's role in punishment-learning) has limited direct evidence in humans. We report intracranial, subsecond measurements of dopamine release in human striatum measured, while volunteers (i.e., patients undergoing deep brain stimulation surgery) performed a probabilistic reward and punishment learning choice task designed to test whether dopamine release encodes only reward prediction errors or whether dopamine release may also encode adaptive punishment learning signals. Results demonstrate that extracellular dopamine levels can encode both reward and punishment prediction errors within distinct time intervals via independent valence-specific pathways in the human brain.
Collapse
Affiliation(s)
- L. Paul Sands
- Neuroscience Graduate Program, Wake Forest School of Medicine, Winston-Salem, NC 27101, USA
- Department of Physiology and Pharmacology, Wake Forest School of Medicine, Winston-Salem, NC 27101, USA
| | - Angela Jiang
- Department of Physiology and Pharmacology, Wake Forest School of Medicine, Winston-Salem, NC 27101, USA
| | - Brittany Liebenow
- Neuroscience Graduate Program, Wake Forest School of Medicine, Winston-Salem, NC 27101, USA
- Department of Physiology and Pharmacology, Wake Forest School of Medicine, Winston-Salem, NC 27101, USA
| | - Emily DiMarco
- Neuroscience Graduate Program, Wake Forest School of Medicine, Winston-Salem, NC 27101, USA
- Department of Physiology and Pharmacology, Wake Forest School of Medicine, Winston-Salem, NC 27101, USA
| | - Adrian W. Laxton
- Department of Neurosurgery, Wake Forest School of Medicine, Winston-Salem, NC 27101, USA
| | - Stephen B. Tatter
- Department of Neurosurgery, Wake Forest School of Medicine, Winston-Salem, NC 27101, USA
| | - P. Read Montague
- Wellcome Centre for Human Neuroimaging, University College London, WC1N 3BG London, UK
- Fralin Biomedical Research Institute, Virginia Tech, Roanoke, VA 24016, USA
- Department of Physics, Virginia Tech, Blacksburg, VA 24061, USA
| | - Kenneth T. Kishida
- Neuroscience Graduate Program, Wake Forest School of Medicine, Winston-Salem, NC 27101, USA
- Department of Physiology and Pharmacology, Wake Forest School of Medicine, Winston-Salem, NC 27101, USA
- Department of Neurosurgery, Wake Forest School of Medicine, Winston-Salem, NC 27101, USA
| |
Collapse
|
10
|
Seymour B, Crook RJ, Chen ZS. Post-injury pain and behaviour: a control theory perspective. Nat Rev Neurosci 2023; 24:378-392. [PMID: 37165018 PMCID: PMC10465160 DOI: 10.1038/s41583-023-00699-5] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/28/2023] [Indexed: 05/12/2023]
Abstract
Injuries of various types occur commonly in the lives of humans and other animals and lead to a pattern of persistent pain and recuperative behaviour that allows safe and effective recovery. In this Perspective, we propose a control-theoretic framework to explain the adaptive processes in the brain that drive physiological post-injury behaviour. We set out an evolutionary and ethological view on how animals respond to injury, illustrating how the behavioural state associated with persistent pain and recuperation may be just as important as phasic pain in ensuring survival. Adopting a normative approach, we suggest that the brain implements a continuous optimal inference of the current state of injury from diverse sensory and physiological signals. This drives the various effector control mechanisms of behavioural homeostasis, which span the modulation of ongoing motivation and perception to drive rest and hyper-protective behaviours. However, an inherent problem with this is that these protective behaviours may partially obscure information about whether injury has resolved. Such information restriction may seed a tendency to aberrantly or persistently infer injury, and may thus promote the transition to pathological chronic pain states.
Collapse
Affiliation(s)
- Ben Seymour
- Institute for Biomedical Engineering, University of Oxford, Oxford, UK.
- Wellcome Centre for Integrative Neuroimaging, John Radcliffe Hospital, Headington, Oxford, UK.
| | - Robyn J Crook
- Department of Biology, San Francisco State University, San Francisco, CA, USA.
| | - Zhe Sage Chen
- Departments of Psychiatry, Neuroscience and Physiology, Neuroscience Institute, New York University Grossman School of Medicine, New York, NY, USA.
- Department of Biomedical Engineering, New York University Tandon School of Engineering, Brooklyn, NY, USA.
- Interdisciplinary Pain Research Program, NYU Langone Health, New York, NY, USA.
| |
Collapse
|
11
|
Sands LP, Jiang A, Jones RE, Trattner JD, Kishida KT. Valence-partitioned learning signals drive choice behavior and phenomenal subjective experience in humans. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.03.17.533213. [PMID: 36993384 PMCID: PMC10055186 DOI: 10.1101/2023.03.17.533213] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
How the human brain generates conscious phenomenal experience is a fundamental problem. In particular, it is unknown how variable and dynamic changes in subjective affect are driven by interactions with objective phenomena. We hypothesize a neurocomputational mechanism that generates valence-specific learning signals associated with 'what it is like' to be rewarded or punished. Our hypothesized model maintains a partition between appetitive and aversive information while generating independent and parallel reward and punishment learning signals. This valence-partitioned reinforcement learning (VPRL) model and its associated learning signals are shown to predict dynamic changes in 1) human choice behavior, 2) phenomenal subjective experience, and 3) BOLD-imaging responses that implicate a network of regions that process appetitive and aversive information that converge on the ventral striatum and ventromedial prefrontal cortex during moments of introspection. Our results demonstrate the utility of valence-partitioned reinforcement learning as a neurocomputational basis for investigating mechanisms that may drive conscious experience.
Collapse
Affiliation(s)
- L. Paul Sands
- Dept. of Physiology and Pharmacology, Wake Forest School of Medicine, Winston-Salem NC, 27101, US
- Neuroscience Graduate Program, Wake Forest School of Medicine, Winston-Salem NC, 27101, US
| | - Angela Jiang
- Dept. of Physiology and Pharmacology, Wake Forest School of Medicine, Winston-Salem NC, 27101, US
| | - Rachel E. Jones
- Dept. of Physiology and Pharmacology, Wake Forest School of Medicine, Winston-Salem NC, 27101, US
- Neuroscience Graduate Program, Wake Forest School of Medicine, Winston-Salem NC, 27101, US
| | - Jonathan D. Trattner
- Dept. of Physiology and Pharmacology, Wake Forest School of Medicine, Winston-Salem NC, 27101, US
- Neuroscience Graduate Program, Wake Forest School of Medicine, Winston-Salem NC, 27101, US
| | - Kenneth T. Kishida
- Dept. of Physiology and Pharmacology, Wake Forest School of Medicine, Winston-Salem NC, 27101, US
- Neuroscience Graduate Program, Wake Forest School of Medicine, Winston-Salem NC, 27101, US
- Dept. of Neurosurgery, Wake Forest School of Medicine, Winston-Salem NC, 27101, US
| |
Collapse
|
12
|
Abstract
Pain is driven by sensation and emotion, and in turn, it motivates decisions and actions. To fully appreciate the multidimensional nature of pain, we formulate the study of pain within a closed-loop framework of sensory-motor prediction. In this closed-loop cycle, prediction plays an important role, as the interaction between prediction and actual sensory experience shapes pain perception and subsequently, action. In this Perspective, we describe the roles of two prominent computational theories-Bayesian inference and reinforcement learning-in modeling adaptive pain behaviors. We show that prediction serves as a common theme between these two theories, and that each of these theories can explain unique aspects of the pain perception-action cycle. We discuss how these computational theories and models can improve our mechanistic understandings of pain-centered processes such as anticipation, attention, placebo hypoalgesia, and pain chronification.
Collapse
Affiliation(s)
- Zhe Sage Chen
- Department of Psychiatry, New York University Grossman School of Medicine, New York, NY 10016, USA
- Department of Neuroscience and Physiology, New York University Grossman School of Medicine, New York, NY 10016, USA
- Neuroscience Institute, NYU Grossman School of Medicine, New York, NY 10016, USA
- Interdisciplinary Pain Research Program, NYU Langone Health, New York, NY 10016, USA
| | - Jing Wang
- Department of Neuroscience and Physiology, New York University Grossman School of Medicine, New York, NY 10016, USA
- Neuroscience Institute, NYU Grossman School of Medicine, New York, NY 10016, USA
- Interdisciplinary Pain Research Program, NYU Langone Health, New York, NY 10016, USA
- Department of Anesthesiology, Perioperative Care and Pain Medicine, New York University Grossman School of Medicine, New York, NY 10016, USA
| |
Collapse
|
13
|
Chan YC, Wang CY, Chou TL. Money or funny: Effective connectivity during service recovery with a DCM-PEB approach. Biol Psychol 2023; 176:108464. [PMID: 36435295 DOI: 10.1016/j.biopsycho.2022.108464] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2022] [Revised: 11/16/2022] [Accepted: 11/20/2022] [Indexed: 11/24/2022]
Abstract
While monetary compensation is considered the most effective service recovery strategy, relief theory claims that humor may also be useful in service recovery situations. This study investigated the effects of humor in service recovery using dynamic causal modeling and parametric empirical Bayes analysis to identify effective connectivity (EC) patterns in the dopaminergic reward system across four conditions representing different service recovery strategies: monetary compensation and humor (MH), monetary compensation and an apology (MA), non-monetary compensation using humor (H), and non-monetary compensation using an apology (CON, the control condition). The findings support the importance of the nucleus accumbens (NAc) in the monetary compensation (MH and MA) conditions and the amygdala in the non-monetary compensation (H and CON) conditions. Monetary compensation (MH and MA) resulted in right substantia nigra (rSN) to NAc EC, suggesting the processing of recovery satisfaction associated with perceived outcome fairness. Conversely, non-monetary compensation strategies (H and CON) resulted in left substantia nigra (lSN) to amygdala EC, suggesting the processing of satisfaction related to perceived interactional fairness. The use of humor for service recovery resulted in VTA-to-lSN-to-amygdala EC during humor appreciation, while the use of apologies (CON and MA) resulted in lSN-to-amygdala and lSN-to-VTA connectivity. Surprisingly, processing satisfaction in the MH condition did not activate the amygdala during humor appreciation. Coping humor could be norm-violating for service recovery, and its effectiveness depends on multiple factors. The results suggest that monetary compensation, humorous responses, and apologies play key roles in neurological responses to service recovery strategies.
Collapse
Affiliation(s)
- Yu-Chen Chan
- Department of Educational Psychology and Counseling, National Tsing Hua University, Hsinchu, Taiwan.
| | - Chen-Ya Wang
- Institute of Service Science, National Tsing Hua University, Hsinchu, Taiwan
| | - Tai-Li Chou
- Department of Psychology, National Taiwan University, Taipei, Taiwan
| |
Collapse
|
14
|
Neta M, Kim MJ. Surprise as an Emotion: A Response to Ortony. PERSPECTIVES ON PSYCHOLOGICAL SCIENCE 2022:17456916221132789. [PMID: 36356055 PMCID: PMC10169535 DOI: 10.1177/17456916221132789] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
We write in response to an article published in this journal by Andrew Ortony titled “Are All ‘Basic Emotions’ Emotions? A Problem for the (Basic) Emotions Construct.” The author claimed that “for all its elevated status as a basic emotion, surprise fails to satisfy the minimal requirements that [he] proposed for something to be an emotion, and if it is not an emotion, it cannot possibly be a basic emotion.” Although we acknowledge the concerns brought forth by Ortony, we respectfully disagree with his conclusion about surprise. To make a case against the assertion that surprise is valence-free, we summarize an extensive body of work showing that surprise is indeed valenced—in a specific manner (i.e., ambiguously valenced)—and that it meets all of Ortony’s criteria for an emotion. In other words, rather than being described as neither positive nor negative, this emotion is either positive or negative. We consider the data with respect to surprise as a basic emotion, and we dispute the definitions of basic emotions as “widely divergent.” Future work is needed to continue defining an emotion, and a basic emotion, but we believe this is a worthy effort toward shaping a still evolving field.
Collapse
Affiliation(s)
- Maital Neta
- Department of Psychology, University of Nebraska–Lincoln
- Center for Brain, Biology and Behavior, University of Nebraska–Lincoln
| | - M. Justin Kim
- Department of Psychology, Sungkyunkwan University
- Center for Neuroscience Imaging Research, Institute for Basic Science, Suwon, South Korea
| |
Collapse
|
15
|
Liebenow B, Jones R, DiMarco E, Trattner JD, Humphries J, Sands LP, Spry KP, Johnson CK, Farkas EB, Jiang A, Kishida KT. Computational reinforcement learning, reward (and punishment), and dopamine in psychiatric disorders. Front Psychiatry 2022; 13:886297. [PMID: 36339844 PMCID: PMC9630918 DOI: 10.3389/fpsyt.2022.886297] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Accepted: 09/23/2022] [Indexed: 11/13/2022] Open
Abstract
In the DSM-5, psychiatric diagnoses are made based on self-reported symptoms and clinician-identified signs. Though helpful in choosing potential interventions based on the available regimens, this conceptualization of psychiatric diseases can limit basic science investigation into their underlying causes. The reward prediction error (RPE) hypothesis of dopamine neuron function posits that phasic dopamine signals encode the difference between the rewards a person expects and experiences. The computational framework from which this hypothesis was derived, temporal difference reinforcement learning (TDRL), is largely focused on reward processing rather than punishment learning. Many psychiatric disorders are characterized by aberrant behaviors, expectations, reward processing, and hypothesized dopaminergic signaling, but also characterized by suffering and the inability to change one's behavior despite negative consequences. In this review, we provide an overview of the RPE theory of phasic dopamine neuron activity and review the gains that have been made through the use of computational reinforcement learning theory as a framework for understanding changes in reward processing. The relative dearth of explicit accounts of punishment learning in computational reinforcement learning theory and its application in neuroscience is highlighted as a significant gap in current computational psychiatric research. Four disorders comprise the main focus of this review: two disorders of traditionally hypothesized hyperdopaminergic function, addiction and schizophrenia, followed by two disorders of traditionally hypothesized hypodopaminergic function, depression and post-traumatic stress disorder (PTSD). Insights gained from a reward processing based reinforcement learning framework about underlying dopaminergic mechanisms and the role of punishment learning (when available) are explored in each disorder. Concluding remarks focus on the future directions required to characterize neuropsychiatric disorders with a hypothesized cause of underlying dopaminergic transmission.
Collapse
Affiliation(s)
- Brittany Liebenow
- Neuroscience Graduate Program, Wake Forest University School of Medicine, Winston-Salem, NC, United States
- Department of Physiology and Pharmacology, Wake Forest University School of Medicine, Winston-Salem, NC, United States
| | - Rachel Jones
- Neuroscience Graduate Program, Wake Forest University School of Medicine, Winston-Salem, NC, United States
- Department of Physiology and Pharmacology, Wake Forest University School of Medicine, Winston-Salem, NC, United States
| | - Emily DiMarco
- Neuroscience Graduate Program, Wake Forest University School of Medicine, Winston-Salem, NC, United States
- Department of Physiology and Pharmacology, Wake Forest University School of Medicine, Winston-Salem, NC, United States
| | - Jonathan D. Trattner
- Neuroscience Graduate Program, Wake Forest University School of Medicine, Winston-Salem, NC, United States
- Department of Physiology and Pharmacology, Wake Forest University School of Medicine, Winston-Salem, NC, United States
| | - Joseph Humphries
- Neuroscience Graduate Program, Wake Forest University School of Medicine, Winston-Salem, NC, United States
- Department of Physiology and Pharmacology, Wake Forest University School of Medicine, Winston-Salem, NC, United States
| | - L. Paul Sands
- Neuroscience Graduate Program, Wake Forest University School of Medicine, Winston-Salem, NC, United States
- Department of Physiology and Pharmacology, Wake Forest University School of Medicine, Winston-Salem, NC, United States
| | - Kasey P. Spry
- Neuroscience Graduate Program, Wake Forest University School of Medicine, Winston-Salem, NC, United States
- Department of Physiology and Pharmacology, Wake Forest University School of Medicine, Winston-Salem, NC, United States
| | - Christina K. Johnson
- Department of Physiology and Pharmacology, Wake Forest University School of Medicine, Winston-Salem, NC, United States
| | - Evelyn B. Farkas
- Georgia State University Undergraduate Neuroscience Institute, Atlanta, GA, United States
| | - Angela Jiang
- Department of Physiology and Pharmacology, Wake Forest University School of Medicine, Winston-Salem, NC, United States
| | - Kenneth T. Kishida
- Neuroscience Graduate Program, Wake Forest University School of Medicine, Winston-Salem, NC, United States
- Department of Physiology and Pharmacology, Wake Forest University School of Medicine, Winston-Salem, NC, United States
- Department of Neurosurgery, Wake Forest University School of Medicine, Winston-Salem, NC, United States
- Department of Biomedical Engineering, Wake Forest University School of Medicine, Winston-Salem, NC, United States
| |
Collapse
|
16
|
Ojala KE, Tzovara A, Poser BA, Lutti A, Bach DR. Asymmetric representation of aversive prediction errors in Pavlovian threat conditioning. Neuroimage 2022; 263:119579. [PMID: 35995374 DOI: 10.1016/j.neuroimage.2022.119579] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2022] [Revised: 08/16/2022] [Accepted: 08/17/2022] [Indexed: 11/24/2022] Open
Abstract
Survival in biological environments requires learning associations between predictive sensory cues and threatening outcomes. Such aversive learning may be implemented through reinforcement learning algorithms that are driven by the signed difference between expected and encountered outcomes, termed prediction errors (PEs). While PE-based learning is well established for reward learning, the role of putative PE signals in aversive learning is less clear. Here, we used functional magnetic resonance imaging in humans (21 healthy men and women) to investigate the neural representation of PEs during maintenance of learned aversive associations. Four visual cues, each with a different probability (0, 33, 66, 100%) of being followed by an aversive outcome (electric shock), were repeatedly presented to participants. We found that neural activity at omission (US-) but not occurrence of the aversive outcome (US+) encoded PEs in the medial prefrontal cortex. More expected omission of aversive outcome was associated with lower neural activity. No neural signals fulfilled axiomatic criteria, which specify necessary and sufficient components of PE signals, for signed PE representation in a whole-brain search or in a-priori regions of interest. Our results might suggest that, different from reward learning, aversive learning does not involve signed PE signals that are represented within the same brain region for all conditions.
Collapse
Affiliation(s)
- Karita E Ojala
- Computational Psychiatry Research, Department of Psychiatry, Psychotherapy and Psychosomatics, Psychiatric Hospital, University of Zurich, Lenggstrasse 31, Zurich 8032, Switzerland; Neuroscience Centre Zurich, University of Zurich, Winterthurerstrasse 190, Zürich 8057, Switzerland.
| | - Athina Tzovara
- Computational Psychiatry Research, Department of Psychiatry, Psychotherapy and Psychosomatics, Psychiatric Hospital, University of Zurich, Lenggstrasse 31, Zurich 8032, Switzerland; Neuroscience Centre Zurich, University of Zurich, Winterthurerstrasse 190, Zürich 8057, Switzerland; Institute of Computer Science, University of Bern, Neubrückstrasse 10, Bern 3012, Switzerland
| | - Benedikt A Poser
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Oxfordlaan 55 EV 6299, Maastricht, the Netherlands
| | - Antoine Lutti
- Laboratory for Research in Neuroimaging, Department of Clinical Neuroscience, Lausanne University Hospital and University of Lausanne, Chemin de Mont-Paisible 16, Lausanne 1011, Switzerland
| | - Dominik R Bach
- Computational Psychiatry Research, Department of Psychiatry, Psychotherapy and Psychosomatics, Psychiatric Hospital, University of Zurich, Lenggstrasse 31, Zurich 8032, Switzerland; Neuroscience Centre Zurich, University of Zurich, Winterthurerstrasse 190, Zürich 8057, Switzerland; Wellcome Centre for Human Neuroimaging and Max-Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, 10-12 Russell Square, London WC1B 5EH, United Kingdom.
| |
Collapse
|
17
|
Jepma M, Roy M, Ramlakhan K, van Velzen M, Dahan A. Different brain systems support learning from received and avoided pain during human pain-avoidance learning. eLife 2022; 11:74149. [PMID: 35731646 PMCID: PMC9217130 DOI: 10.7554/elife.74149] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Accepted: 06/07/2022] [Indexed: 12/14/2022] Open
Abstract
Both unexpected pain and unexpected pain absence can drive avoidance learning, but whether they do so via shared or separate neural and neurochemical systems is largely unknown. To address this issue, we combined an instrumental pain-avoidance learning task with computational modeling, functional magnetic resonance imaging (fMRI), and pharmacological manipulations of the dopaminergic (100 mg levodopa) and opioidergic (50 mg naltrexone) systems (N = 83). Computational modeling provided evidence that untreated participants learned more from received than avoided pain. Our dopamine and opioid manipulations negated this learning asymmetry by selectively increasing learning rates for avoided pain. Furthermore, our fMRI analyses revealed that pain prediction errors were encoded in subcortical and limbic brain regions, whereas no-pain prediction errors were encoded in frontal and parietal cortical regions. However, we found no effects of our pharmacological manipulations on the neural encoding of prediction errors. Together, our results suggest that human pain-avoidance learning is supported by separate threat- and safety-learning systems, and that dopamine and endogenous opioids specifically regulate learning from successfully avoided pain.
Collapse
Affiliation(s)
- Marieke Jepma
- Department of Psychology, University of Amsterdam, Amsterdam, Netherlands.,Department of Psychology, Leiden University, Leiden, Netherlands.,Leiden Institute for Brain and Cognition, Leiden, Netherlands
| | - Mathieu Roy
- Department of Psychology, McGill University, Montreal, Canada.,Alan Edwards Centre for Research on Pain, McGill University, Montreal, Canada
| | - Kiran Ramlakhan
- Department of Psychology, Leiden University, Leiden, Netherlands.,Department of Research and Statistics, Municipality of Amsterdam, Amsterdam, Netherlands
| | - Monique van Velzen
- Department of Anesthesiology, Leiden University Medical Center, Leiden, Netherlands
| | - Albert Dahan
- Department of Anesthesiology, Leiden University Medical Center, Leiden, Netherlands
| |
Collapse
|
18
|
Martinez-Saito M, Gorina E. Learning under social versus nonsocial uncertainty: A meta-analytic approach. Hum Brain Mapp 2022; 43:4185-4206. [PMID: 35620870 PMCID: PMC9374892 DOI: 10.1002/hbm.25948] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2021] [Revised: 04/08/2022] [Accepted: 05/04/2022] [Indexed: 01/10/2023] Open
Abstract
Much of the uncertainty that clouds our understanding of the world springs from the covert values and intentions held by other people. Thus, it is plausible that specialized mechanisms that compute learning signals under uncertainty of exclusively social origin operate in the brain. To test this hypothesis, we scoured academic databases for neuroimaging studies involving learning under uncertainty, and performed a meta‐analysis of brain activation maps that compared learning in the face of social versus nonsocial uncertainty. Although most of the brain activations associated with learning error signals were shared between social and nonsocial conditions, we found some evidence for functional segregation of error signals of exclusively social origin during learning in limited regions of ventrolateral prefrontal cortex and insula. This suggests that most behavioral adaptations to navigate social environments are reused from frontal and subcortical areas processing generic value representation and learning, but that a specialized circuitry might have evolved in prefrontal regions to deal with social context representation and strategic action.
Collapse
Affiliation(s)
| | - Elena Gorina
- Department of Cognitive and Brain Sciences, Hebrew University of Jerusalem, Jerusalem, Israel
| |
Collapse
|
19
|
Lin C, Zhuo S, Peng W. Ongoing pain facilitates emotional decision-making behaviors. BRAIN SCIENCE ADVANCES 2022. [DOI: 10.26599/bsa.2022.9050005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022] Open
Abstract
Emotion toward anticipated and actual outcomes acts as a vital signal on emotional decision-making, and the Iowa Gambling Task (IGT) can mimic this decision-making process. Pain can impair emotional decision-making behaviors because it captures attention and distracts from the task at hand. Alternatively, pain may facilitate emotional decision-making behaviors by prompting alertness and mobilizing cognitive resources to maximize rewards. The present study investigated the influence of ongoing pain on emotional decision-making behaviors using the IGT. Our study recruited two groups of participants and applied capsaicin (pain group) or control cream (control group) to their forearms. We then compared performances and selections between the pain and control groups. The results revealed that participants successfully learned the required adaptive selection strategy as the task progressed. The study observed a tendency toward optimal choices for both groups under the condition of frequent–small losses. However, we observed a disadvantageous preference for the control group, but not the pain group, when faced with choices with infrequent but large losses. The study implies that a distressing pain experience motivates individuals to adjust goal-directed behaviors to maximize their rewards in a task. Thus, the finding suggests that ongoing pain facilitates emotional decision-making behaviors.
Collapse
Affiliation(s)
- Chennan Lin
- School of Psychology, Shenzhen University, Shenzhen 518060, Guangdong, China
| | - Shiwei Zhuo
- School of Psychology, Shenzhen University, Shenzhen 518060, Guangdong, China
| | - Weiwei Peng
- School of Psychology, Shenzhen University, Shenzhen 518060, Guangdong, China
| |
Collapse
|
20
|
Tonic pain alters functional connectivity of the descending pain modulatory network involving amygdala, periaqueductal gray, parabrachial nucleus and anterior cingulate cortex. Neuroimage 2022; 256:119278. [PMID: 35523367 PMCID: PMC9250649 DOI: 10.1016/j.neuroimage.2022.119278] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2021] [Revised: 04/07/2022] [Accepted: 05/02/2022] [Indexed: 11/21/2022] Open
Abstract
INTRODUCTION Resting state functional connectivity (FC) is widely used to assess functional brain alterations in patients with chronic pain. However, reports of FC accompanying tonic pain in pain-free persons are rare. A network we term the Descending Pain Modulatory Network (DPMN) is implicated in healthy and pathologic pain modulation. Here, we evaluate the effect of tonic pain on FC of specific nodes of this network: anterior cingulate cortex (ACC), amygdala (AMYG), periaqueductal gray (PAG), and parabrachial nuclei (PBN). METHODS In 50 pain-free participants (30F), we induced tonic pain using a capsaicin-heat pain model. functional MRI measured resting BOLD signal during pain-free rest with a 32°C thermode and then tonic pain where participants experienced a previously warm temperature combined with capsaicin. We evaluated FC from ACC, AMYG, PAG, and PBN with correlation of self-report pain intensity during both states. We hypothesized tonic pain would diminish FC dyads within the DPMN. RESULTS Of all hypothesized FC dyads, only PAG and subgenual ACC was weakly altered during pain (F=3.34; p=0.074; pain-free>pain d=0.25). After pain induction sACC-PAG FC became positively correlated with pain intensity (R=0.38; t=2.81; p=0.007). Right PBN-PAG FC during pain-free rest positively correlated with subsequently experienced pain (R=0.44; t=3.43; p=0.001). During pain, this connection's FC was diminished (paired t=-3.17; p=0.0026). In whole-brain analyses, during pain-free rest, FC between left AMYG and right superior parietal lobule and caudate nucleus were positively correlated with subsequent pain. During pain, FC between left AMYG and right inferior temporal gyrus negatively correlated with pain. Subsequent pain positively correlated with right AMYG FC with right claustrum; right primary visual cortex and right temporo-occipitoparietal junction Conclusion: We demonstrate sACC-PAG tonic pain FC positively correlates with experienced pain and resting right PBN-PAG FC correlates with subsequent pain and is diminished during tonic pain. Finally, we reveal PAG- and right AMYG-anchored networks which correlate with subsequently experienced pain intensity. Our findings suggest specific connectivity patterns within the DPMN at rest are associated with subsequently experienced pain and modulated by tonic pain. These nodes and their functional modulation may reveal new therapeutic targets for neuromodulation or biomarkers to guide interventions.
Collapse
|
21
|
Manhapra A. Complex Persistent Opioid Dependence-an Opioid-induced Chronic Pain Syndrome. Curr Treat Options Oncol 2022; 23:921-935. [PMID: 35435616 DOI: 10.1007/s11864-022-00985-x] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/31/2022] [Indexed: 11/03/2022]
Abstract
OPINION STATEMENT Long-term opioid therapy (LTOT) for chronic cancer and non-cancer pain is commonly ineffective in providing its stated goal of improving function through good control of pain. Opioid tapering (slow dose reduction and/or discontinuation), the logical solution, also appears to be ineffective among many patients on LTOT as it often leads to even worse pain control and function, leaving the patients and providers managing LTOT in a clinical conundrum with little treatment choices. Complex persistent opioid dependence (CPOD) was recently offered as a heuristic to explain this clinical conundrum exemplified by the ineffectiveness of both LTOT and opioid tapering. This manuscript provides a detailed description of the neurobehavioral underpinnings of CPOD, explaining how long-term opioid use can lead to more pain even while experiencing relief with each opioid dose. CPOD is characterized by the allostatic opponent mechanisms of neuroadaptations related to the progression of opioid dependence and tolerance involving nociceptive/anti-nociceptive brain systems causing opioid-induced hyperalgesia and reward/anti-reward systems causing hyperkatefia or suffering that induces pain experience through the cognitive/emotional component of pain mechanisms. "Opioid Induced Chronic Pain syndrome" (OICP) is offered as an alternate clinical diagnostic term instead of CPOD that has several limitations as a diagnosis term including poor patient acceptance due to stigma towards addiction and clinical confounding with opioid use disorder, a related but separate clinical entity. OICP with LTOT is conceptualized as a recoverable iatrogenic problem that can be managed by pain providers. Broad guidance on management of OICP is also provided.
Collapse
Affiliation(s)
- Ajay Manhapra
- Pain Medicine, Hampton VA Medical Center, 100 Emancipation Drive, Hampton, VA, 23667, USA. .,New England Mental Illness Research Education and Clinical Center (MIRECC), West Haven, CT, USA. .,Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA. .,Departments of Physical Medicine and Rehabilitation and Psychiatry, Eastern Virginia Medical School, Norfolk, VA, USA.
| |
Collapse
|
22
|
van der Schaaf ME, Schmidt K, Kaur J, Gamer M, Wiech K, Forkmann K, Bingel U. Acquisition learning is stronger for aversive than appetitive events. Commun Biol 2022; 5:302. [PMID: 35379893 PMCID: PMC8979974 DOI: 10.1038/s42003-022-03234-x] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2021] [Accepted: 03/04/2022] [Indexed: 11/25/2022] Open
Abstract
Appetitive and aversive learning are both key building blocks of adaptive behavior, yet knowledge regarding their differences is sparse. Using a capsaicin heat pain model in 36 healthy participants, this study directly compared the acquisition and extinction of conditioned stimuli (CS) predicting pain exacerbation and relief. Valence ratings show stronger acquisition during aversive compared to appetitive learning, but no differences in extinction. Skin conductance responses and contingency ratings confirmed these results. Findings were unrelated to individual differences in pain sensitivity or psychological factors. Our results support the notion of an evolutionarily hardwired preponderance to acquire aversive rather than appetitive cues as is protective for acute aversive states such as pain but may contribute to the development and maintenance of clinical conditions such as chronic pain, depression or anxiety disorders. In this study, acquisition and extinction of conditioned stimuli are compared in a capsaicin heat pain paradigm in healthy human participants. The results demonstrate a preponderance to acquire aversive rather than appetitive cues, which could initially have a protective function but eventually contribute to the maintenance of chronic pain.
Collapse
Affiliation(s)
- Marieke E van der Schaaf
- Radboud University Medical Centre, Department of Psychiatry, 6525 GA, Nijmegen, The Netherlands.,Radboud University, Donders Institute for Brain Behaviour and Cognition, Centre for Cognitive Neuroimaging, Nijmegen, The Netherlands
| | - Katharina Schmidt
- Department of Neurology, Center for Translational Neuro- and Behavioural Sciences, University Medicine Essen, Essen, Germany.
| | - Jaspreet Kaur
- Department of Neurology, Center for Translational Neuro- and Behavioural Sciences, University Medicine Essen, Essen, Germany
| | - Matthias Gamer
- Department of Psychology, University of Würzburg, Würzburg, Germany
| | - Katja Wiech
- Wellcome Centre for Integrative Neuroimaging (WIN), Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, OX3 9DU, United Kingdom
| | - Katarina Forkmann
- Department of Neurology, Center for Translational Neuro- and Behavioural Sciences, University Medicine Essen, Essen, Germany
| | - Ulrike Bingel
- Department of Neurology, Center for Translational Neuro- and Behavioural Sciences, University Medicine Essen, Essen, Germany
| |
Collapse
|
23
|
Kuhn M, Gerlicher AMV, Lonsdorf TB. Navigating the manyverse of skin conductance response quantification approaches - A direct comparison of trough-to-peak, baseline correction, and model-based approaches in Ledalab and PsPM. Psychophysiology 2022; 59:e14058. [PMID: 35365863 DOI: 10.1111/psyp.14058] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2021] [Revised: 02/21/2022] [Accepted: 03/08/2022] [Indexed: 12/27/2022]
Abstract
Raw data are typically required to be processed to be ready for statistical analyses, and processing pipelines are often characterized by substantial heterogeneity. Here, we applied seven different approaches (trough-to-peak scoring by two different raters, script-based baseline correction, Ledalab as well as four different models implemented in the software PsPM) to two fear conditioning data sets. Selection of the approaches included was guided by a systematic literature search by using fear conditioning research as a case example. Our approach can be viewed as a set of robustness analyses (i.e., same data subjected to different processing pipelines) aiming to investigate if and to what extent these different quantification approaches yield comparable results given the same data. To our knowledge, no formal framework for the evaluation of robustness analyses exists to date, but we may borrow some criteria from a framework suggested for the evaluation of "replicability" in general. Our results from seven different SCR quantification approaches applied to two data sets with different paradigms suggest that there may be no single approach that consistently yields larger effect sizes and could be universally considered "best." Yet, at least some of the approaches employed show consistent effect sizes within each data set indicating comparability. Finally, we highlight substantial heterogeneity also within most quantification approaches and discuss implications and potential remedies.
Collapse
Affiliation(s)
- Manuel Kuhn
- Institute for Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.,Department of Psychiatry, Harvard Medical School, and Center for Depression, Anxiety and Stress Research, McLean Hospital, Belmont, Massachusetts, USA
| | - Anna M V Gerlicher
- Department of Clinical Psychology, University of Amsterdam, Amsterdam, The Netherlands.,Department of Experimental Psychology, Utrecht University, Utrecht, The Netherlands
| | - Tina B Lonsdorf
- Institute for Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| |
Collapse
|
24
|
Izadi M, Franklin S, Bellafiore M, Franklin DW. Motor Learning in Response to Different Experimental Pain Models Among Healthy Individuals: A Systematic Review. Front Hum Neurosci 2022; 16:863741. [PMID: 35399361 PMCID: PMC8987932 DOI: 10.3389/fnhum.2022.863741] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2022] [Accepted: 02/28/2022] [Indexed: 12/30/2022] Open
Abstract
Learning new movement patterns is a normal part of daily life, but of critical importance in both sport and rehabilitation. A major question is how different sensory signals are integrated together to give rise to motor adaptation and learning. More specifically, there is growing evidence that pain can give rise to alterations in the learning process. Despite a number of studies investigating the role of pain on the learning process, there is still no systematic review to summarize and critically assess investigations regarding this topic in the literature. Here in this systematic review, we summarize and critically evaluate studies that examined the influence of experimental pain on motor learning. Seventeen studies that exclusively assessed the effect of experimental pain models on motor learning among healthy human individuals were included for this systematic review, carried out based on the preferred reporting items for systematic reviews and meta-analyses (PRISMA) statement. The results of the review revealed there is no consensus regarding the effect of pain on the skill learning acquisition and retention. However, several studies demonstrated that participants who experienced pain continued to express a changed motor strategy to perform a motor task even 1 week after training under the pain condition. The results highlight a need for further studies in this area of research, and specifically to investigate whether pain has different effects on motor learning depending on the type of motor task.
Collapse
Affiliation(s)
- Mohammad Izadi
- Sport and Exercise Research Unit, Department of Psychology, Educational Sciences and Human Movement, University of Palermo, Palermo, Italy
| | - Sae Franklin
- Institute for Cognitive Systems, Department of Electrical and Computer Engineering, Technical University of Munich, Munich, Germany
| | - Marianna Bellafiore
- Sport and Exercise Research Unit, Department of Psychology, Educational Sciences and Human Movement, University of Palermo, Palermo, Italy
| | - David W. Franklin
- Neuromuscular Diagnostics, Department of Sport and Health Sciences, Technical University of Munich, Munich, Germany
- Munich School of Robotics and Machine Intelligence, Technical University of Munich, Munich, Germany
- Munich Data Science Institute, Technical University of Munich, Munich, Germany
| |
Collapse
|
25
|
Björkstrand J, Pine DS, Frick A. Evaluating an internet-delivered fear conditioning and extinction protocol using response times and affective ratings. Sci Rep 2022; 12:4014. [PMID: 35256733 PMCID: PMC8901755 DOI: 10.1038/s41598-022-07999-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2021] [Accepted: 02/23/2022] [Indexed: 12/27/2022] Open
Abstract
Pavlovian fear conditioning is widely used to study mechanisms of fear learning, but high-throughput studies are hampered by the labor-intensive nature of examining participants in the lab. To circumvent this bottle-neck, fear conditioning tasks have been developed for remote delivery. Previous studies have examined remotely delivered fear conditioning protocols using expectancy and affective ratings. Here we replicate and extend these findings using an internet-delivered version of the Screaming Lady paradigm, evaluating the effects on negative affective ratings and response time to an auditory probe during stimulus presentation. In a sample of 80 adults, we observed clear evidence of both fear acquisition and extinction using affective ratings. Response times were faster when probed early, but not later, during presentation of stimuli paired with an aversive scream. The response time findings are at odds with previous lab-based studies showing slower as opposed to faster responses to threat-predicting cues. The findings underscore the feasibility of employing remotely delivered fear conditioning paradigms with affective ratings as outcome. Findings further highlight the need for research examining optimal parameters for concurrent response time measures or alternate non-verbal indicators of conditioned responses in Pavlovian conditioning protocols.
Collapse
Affiliation(s)
| | - Daniel S Pine
- National Institute of Mental Health (NIMH), Bethesda, MD, USA
| | - Andreas Frick
- The Beijer Laboratory, Department of Neuroscience, Psychiatry, Uppsala University, Uppsala, Sweden
| |
Collapse
|
26
|
Lonsdorf T, Gerlicher A, Klingelhöfer-Jens M, Krypotos AM. Multiverse analyses in fear conditioning research. Behav Res Ther 2022; 153:104072. [DOI: 10.1016/j.brat.2022.104072] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2021] [Revised: 02/04/2022] [Accepted: 03/07/2022] [Indexed: 01/01/2023]
|
27
|
Sirucek L, Price RC, Gandhi W, Hoeppli ME, Fahey E, Qu A, Becker S, Schweinhardt P. Endogenous opioids contribute to the feeling of pain relief in humans. Pain 2021; 162:2821-2831. [PMID: 34793405 PMCID: PMC8600541 DOI: 10.1097/j.pain.0000000000002285] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2020] [Revised: 02/02/2021] [Accepted: 02/05/2021] [Indexed: 11/25/2022]
Abstract
Endogenous opioids mediate the pleasurable responses to positively reinforcing stimuli such as palatable food. Yet, the reduction or omission of a negative experience can also be rewarding (negative reinforcement). As such, pain relief leads to negative reinforcement and evokes a pleasant feeling in humans. Although it has been shown that the feeling of pleasure associated with positive reinforcement is at least partly mediated through endogenous opioids, it is currently unknown whether similar neurochemical mechanisms are involved in the pleasant feeling evoked by pain relief. In this study, 27 healthy participants completed 2 identical experimental sessions, 1 with placebo and 1 with naltrexone, an endogenous opioid antagonist. Pain relief was induced by superficial cooling after heat stimulation of capsaicin-sensitized skin. Participants rated the relief and pleasantness in response to the cooling. Endogenous opioid blockade by naltrexone decreased relief and pleasantness ratings compared with placebo (P = 0.0027). This study provides evidence that endogenous opioids play a role in mediating the pleasant feeling of pain relief in humans. Clinically, the rewarding nature of pain relief and its underlying mechanisms require consideration because of their potential reinforcing effects on behaviors that might be beneficial short-term but maladaptive long-term.
Collapse
Affiliation(s)
- Laura Sirucek
- Department of Chiropractic Medicine, Integrative Spinal Research, Balgrist University Hospital, University of Zurich (UZH), Zurich, Switzerland
- University of Zurich (UZH), Zurich, Switzerland
- Neuroscience Center Zurich (ZNZ), University of Zurich (UZH), Zurich, Switzerland
| | - Rebecca Christine Price
- Faculty of Medicine, McGill University, Montreal, QC, Canada
- Alan Edwards Centre for Research on Pain, McGill University, Montreal, QC, Canada
| | - Wiebke Gandhi
- Alan Edwards Centre for Research on Pain, McGill University, Montreal, QC, Canada
- Faculty of Dentistry, McGill University, Montreal, QC, Canada
- School of Psychology and Clinical Language Science, Centre of Integrative Neuroscience and Neurodynamics, University of Reading, Reading, United Kingdom
| | - Marie-Eve Hoeppli
- Faculty of Medicine, McGill University, Montreal, QC, Canada
- Alan Edwards Centre for Research on Pain, McGill University, Montreal, QC, Canada
- Department of Behavioral Medicine and Clinical Psychology, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, United States
| | - Emma Fahey
- Alan Edwards Centre for Research on Pain, McGill University, Montreal, QC, Canada
| | - Annie Qu
- Alan Edwards Centre for Research on Pain, McGill University, Montreal, QC, Canada
| | - Susanne Becker
- Department of Chiropractic Medicine, Integrative Spinal Research, Balgrist University Hospital, University of Zurich (UZH), Zurich, Switzerland
- University of Zurich (UZH), Zurich, Switzerland
- Neuroscience Center Zurich (ZNZ), University of Zurich (UZH), Zurich, Switzerland
- Alan Edwards Centre for Research on Pain, McGill University, Montreal, QC, Canada
- Department of Cognitive and Clinical Neuroscience, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Petra Schweinhardt
- Department of Chiropractic Medicine, Integrative Spinal Research, Balgrist University Hospital, University of Zurich (UZH), Zurich, Switzerland
- University of Zurich (UZH), Zurich, Switzerland
- Neuroscience Center Zurich (ZNZ), University of Zurich (UZH), Zurich, Switzerland
- Faculty of Medicine, McGill University, Montreal, QC, Canada
- Alan Edwards Centre for Research on Pain, McGill University, Montreal, QC, Canada
- Faculty of Dentistry, McGill University, Montreal, QC, Canada
| |
Collapse
|
28
|
Modeling incentive salience in Pavlovian learning more parsimoniously using a multiple attribute model. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2021; 22:244-257. [PMID: 34676496 DOI: 10.3758/s13415-021-00953-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 09/02/2021] [Indexed: 11/08/2022]
Abstract
We present a multi-attribute incentive salience (MAIS) model as a computational account of incentive salience in model-based Pavlovian learning. A model of incentive salience as a joint function of reward value and physiological state has been previously proposed by Zhang et al. (2009). In that model, the function takes additive or multiplicative forms depending on whether a preference shifts from positive to negative or vice versa. We demonstrate that arbitrarily varying this function is unnecessary to explain observed data. A multiplicative function is sufficient if one takes into account empirical data suggesting the incentive salience function for an incentive is comprised of multiple physiological signals. We compare our model to the previously proposed model on two datasets. We find the MAIS model predicts the outcomes equally well, fits empirical data describing multiple sensory representations of a single stimulus, better approximates the dual-structure appetitive-aversive nature of the reward system, is compatible with existing knowledge about incentive salience in Pavlovian learning, and better describes revaluation in Pavlovian learning. This model addresses a call (Dayan & Berridge, 2014) for algorithmic and computational models of model-based Pavlovian learning that consistently and fully explain empirical observations. Because a multi-attribute model is relevant even for simple Pavlovian associations, it should be useful in a wide variety of decision-making contexts, including agent modeling and addiction research.
Collapse
|
29
|
Story GW, Chowdhury R, Kurth-Nelson Z, Crockett M, Vlaev I, Darzi A, Dolan RJ. Dreading the pain of others? Altruistic responses to others' pain underestimate dread. J Exp Anal Behav 2021; 116:359-378. [PMID: 34643955 DOI: 10.1002/jeab.721] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2020] [Revised: 09/03/2021] [Accepted: 09/22/2021] [Indexed: 11/08/2022]
Abstract
A dislike of waiting for pain, aptly termed 'dread', is so great that people will increase pain to avoid delaying it. However, despite many accounts of altruistic responses to pain in others, no previous studies have tested whether people take delay into account when attempting to ameliorate others' pain. We examined the impact of delay in 2 experiments where participants (total N = 130) specified the intensity and delay of pain either for themselves or another person. Participants were willing to increase the experimental pain of another participant to avoid delaying it, indicative of dread, though did so to a lesser extent than was the case for their own pain. We observed a similar attenuation in dread when participants chose the timing of a hypothetical painful medical treatment for a close friend or relative, but no such attenuation when participants chose for a more distant acquaintance. A model in which altruism is biased to privilege pain intensity over the dread of pain parsimoniously accounts for these findings. We refer to this underestimation of others' dread as a 'Dread Empathy Gap'.
Collapse
Affiliation(s)
- Giles W Story
- Max Planck UCL Centre for Computational Psychiatry and Ageing, London, UK.,Centre for Health Policy, Institute of Global Health Innovation, Imperial College London, UK.,Wellcome Centre for Human Neuroimaging, London, UK
| | | | - Zeb Kurth-Nelson
- Max Planck UCL Centre for Computational Psychiatry and Ageing, London, UK.,DeepMind, London, UK
| | | | - Ivo Vlaev
- Warwick Business School, The University of Warwick, Coventry, UK
| | - Ara Darzi
- Centre for Health Policy, Institute of Global Health Innovation, Imperial College London, UK
| | - Raymond J Dolan
- Max Planck UCL Centre for Computational Psychiatry and Ageing, London, UK
| |
Collapse
|
30
|
Tanaka S, Taylor JE, Sakagami M. The effect of effort on reward prediction error signals in midbrain dopamine neurons. Curr Opin Behav Sci 2021. [DOI: 10.1016/j.cobeha.2021.07.004] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
|
31
|
The dynamics of pain reappraisal: the joint contribution of cognitive change and mental load. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2021; 20:276-293. [PMID: 31950439 PMCID: PMC7105446 DOI: 10.3758/s13415-020-00768-7] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
This study was designed to investigate the neural mechanism of cognitive modulation of pain via a reappraisal strategy with high temporal resolution. The EEG signal was recorded from 29 participants who were instructed to down-regulate, up-regulate, or maintain their pain experience. The L2 minimum norm source reconstruction method was used to localize areas in which a significant effect of the instruction was present. Down-regulating pain by reappraisal exerted a robust effect on pain processing from as early as ~100 ms that diminished the activity of limbic brain regions: the anterior cingulate cortex, right orbitofrontal cortex, left anterior temporal region, and left insula. However, compared with the no-regulation condition, the neural activity was similarly attenuated in the up- and down-regulation conditions. We suggest that this effect could be ascribed to the cognitive load that was associated with the execution of a cognitively demanding reappraisal task that could have produced a general attenuation of pain-related areas regardless of the aim of the reappraisal task (i.e., up- or down-regulation attempts). These findings indicate that reappraisal effects reflect the joint influence of both reappraisal-specific (cognitive change) and unspecific (cognitive demand) factors, thus pointing to the importance of cautiously selected control conditions that allow the modulating impact of both processes to be distinguished.
Collapse
|
32
|
Anatomical dissociation of intracerebral signals for reward and punishment prediction errors in humans. Nat Commun 2021; 12:3344. [PMID: 34099678 PMCID: PMC8184756 DOI: 10.1038/s41467-021-23704-w] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2020] [Accepted: 05/06/2021] [Indexed: 11/17/2022] Open
Abstract
Whether maximizing rewards and minimizing punishments rely on distinct brain systems remains debated, given inconsistent results coming from human neuroimaging and animal electrophysiology studies. Bridging the gap across techniques, we recorded intracerebral activity from twenty participants while they performed an instrumental learning task. We found that both reward and punishment prediction errors (PE), estimated from computational modeling of choice behavior, correlate positively with broadband gamma activity (BGA) in several brain regions. In all cases, BGA scaled positively with the outcome (reward or punishment versus nothing) and negatively with the expectation (predictability of reward or punishment). However, reward PE were better signaled in some regions (such as the ventromedial prefrontal and lateral orbitofrontal cortex), and punishment PE in other regions (such as the anterior insula and dorsolateral prefrontal cortex). These regions might therefore belong to brain systems that differentially contribute to the repetition of rewarded choices and the avoidance of punished choices. Whether maximizing rewards and minimizing punishments rely on distinct brain learning systems remains debated. Here, using intracerebral recordings in humans, the authors provide evidence for brain regions differentially engaged in signaling reward and punishment prediction errors that prescribe repetition versus avoidance of past choices.
Collapse
|
33
|
Abstract
ABSTRACT Efficacy of treatment is heavily dependent on experience and expectations. Moreover, humans can generalize from one experience to a perceptually similar but novel situation. We investigated whether and how this applies to pain relief, using ecologically valid tonic pain stimuli treated by surreptitiously lowering the applied temperature. Using different face cues, participants experienced better treatment from one physician than another. Participants were then tested on 6 additional face cues perceptually lying between both faces. Our data from 2 independent samples (N = 18 and N = 39) show a treatment experience effect, ie, for physically identical treatments, the initially superior physician was reported to deliver stronger pain relief. More importantly, the other faces on the perceptual continuum showed a graded effect of pain relief, indicating placebo generalization. Introducing a paradigm feasible to induce placebo pain relief, we show that the generic learning principle of generalization can explain carryover effects between learned and novel treatment situations.
Collapse
|
34
|
Kashanian A, Tsolaki E, Pouratian N, Bari AA. Deep Brain Stimulation of the Subgenual Cingulate Cortex for the Treatment of Chronic Low Back Pain. Neuromodulation 2021; 25:202-210. [PMID: 33872423 DOI: 10.1111/ner.13388] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2020] [Revised: 02/12/2021] [Accepted: 02/24/2021] [Indexed: 12/31/2022]
Abstract
OBJECTIVES Despite converging basic scientific and clinical evidence of the link between chronic pain and depression, existing therapies do not often take advantage of this overlap. Here, we provide a critical review of the literature that highlights the intersection in brain networks between chronic low back pain (CLBP) and depression and discuss findings from previous deep brain stimulation (DBS) studies for pain. Based on a multidimensional model of pain processing and the connectivity of the subgenual cingulate cortex (SCC) with areas that are implicated in both CLBP and depression, we propose a novel approach to the treatment of CLBP using DBS of the SCC. MATERIALS AND METHODS A narrative review with literature assessment. RESULTS CLBP is associated with a shift away from somatosensory representation toward brain regions that mediate emotional processes. There is a high degree of overlap between these regions and those involved in depression, including the anterior cingulate cortex, medial prefrontal cortex, nucleus accumbens, and amygdala. Whereas targets sites from previous DBS trials for pain were not anatomically positioned to engage these areas and their associated networks, the SCC is structurally connected to all of these regions and as well as others involved in mediating sensory, cognitive, and affective processing in CLBP. CONCLUSIONS CLBP and depression share a common underlying brain network interconnected by the SCC. Current data and novel technology provide an optimal opportunity to develop clinically effective trials of SCC DBS for CLBP.
Collapse
Affiliation(s)
- Alon Kashanian
- Department of Neurosurgery, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA
| | - Evangelia Tsolaki
- Department of Neurosurgery, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA
| | - Nader Pouratian
- Department of Neurosurgery, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA
| | - Ausaf A Bari
- Department of Neurosurgery, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA
| |
Collapse
|
35
|
Iordanova MD, Yau JOY, McDannald MA, Corbit LH. Neural substrates of appetitive and aversive prediction error. Neurosci Biobehav Rev 2021; 123:337-351. [PMID: 33453307 PMCID: PMC7933120 DOI: 10.1016/j.neubiorev.2020.10.029] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2020] [Revised: 08/24/2020] [Accepted: 10/13/2020] [Indexed: 12/14/2022]
Abstract
Prediction error, defined by the discrepancy between real and expected outcomes, lies at the core of associative learning. Behavioural investigations have provided evidence that prediction error up- and down-regulates associative relationships, and allocates attention to stimuli to enable learning. These behavioural advances have recently been followed by investigations into the neurobiological substrates of prediction error. In the present paper, we review neuroscience data obtained using causal and recording neural methods from a variety of key behavioural designs. We explore the neurobiology of both appetitive (reward) and aversive (fear) prediction error with a focus on the mesolimbic dopamine system, the amygdala, ventrolateral periaqueductal gray, hippocampus, cortex and locus coeruleus noradrenaline. New questions and avenues for research are considered.
Collapse
Affiliation(s)
- Mihaela D Iordanova
- Department of Psychology/Centre for Studies in Behavioral Neurobiology, Concordia University, 7141 Sherbrooke St, Montreal, QC, H4B 1R6, Canada.
| | - Joanna Oi-Yue Yau
- School of Psychology, The University of New South Wales, UNSW Sydney, NSW, 2052, Australia.
| | - Michael A McDannald
- Department of Psychology & Neuroscience, Boston College, 140 Commonwealth Avenue, 514 McGuinn Hall, Chestnut Hill, MA, 02467, USA.
| | - Laura H Corbit
- Departments of Psychology and Cell and Systems Biology, University of Toronto, 100 St. George Street, Toronto, ON, M5S 3G3, Canada.
| |
Collapse
|
36
|
Livermore JJA, Klaassen FH, Bramson B, Hulsman AM, Meijer SW, Held L, Klumpers F, de Voogd LD, Roelofs K. Approach-Avoidance Decisions Under Threat: The Role of Autonomic Psychophysiological States. Front Neurosci 2021; 15:621517. [PMID: 33867915 PMCID: PMC8044748 DOI: 10.3389/fnins.2021.621517] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2020] [Accepted: 03/10/2021] [Indexed: 12/25/2022] Open
Abstract
Acutely challenging or threatening situations frequently require approach-avoidance decisions. Acute threat triggers fast autonomic changes that prepare the body to freeze, fight or flee. However, such autonomic changes may also influence subsequent instrumental approach-avoidance decisions. Since defensive bodily states are often not considered in value-based decision-making models, it remains unclear how they influence the decision-making process. Here, we aim to bridge this gap by discussing the existing literature on the potential role of threat-induced bodily states on decision making and provide a new neurocomputational framework explaining how these effects can facilitate or bias approach-avoid decisions under threat. Theoretical accounts have stated that threat-induced parasympathetic activity is involved in information gathering and decision making. Parasympathetic dominance over sympathetic activity is particularly seen during threat-anticipatory freezing, an evolutionarily conserved response to threat demonstrated across species and characterized by immobility and bradycardia. Although this state of freezing has been linked to altered information processing and action preparation, a full theoretical treatment of the interactions with value-based decision making has not yet been achieved. Our neural framework, which we term the Threat State/Value Integration (TSI) Model, will illustrate how threat-induced bodily states may impact valuation of competing incentives at three stages of the decision-making process, namely at threat evaluation, integration of rewards and threats, and action initiation. Additionally, because altered parasympathetic activity and decision biases have been shown in anxious populations, we will end with discussing how biases in this system can lead to characteristic patterns of avoidance seen in anxiety-related disorders, motivating future pre-clinical and clinical research.
Collapse
Affiliation(s)
- James J. A. Livermore
- Donders Institute for Brain Cognition and Behaviour, Radboud University, Nijmegen, Netherlands
- Behavioural Science Institute, Radboud University, Nijmegen, Netherlands
| | - Felix H. Klaassen
- Donders Institute for Brain Cognition and Behaviour, Radboud University, Nijmegen, Netherlands
- Behavioural Science Institute, Radboud University, Nijmegen, Netherlands
| | - Bob Bramson
- Donders Institute for Brain Cognition and Behaviour, Radboud University, Nijmegen, Netherlands
- Behavioural Science Institute, Radboud University, Nijmegen, Netherlands
| | - Anneloes M. Hulsman
- Donders Institute for Brain Cognition and Behaviour, Radboud University, Nijmegen, Netherlands
- Behavioural Science Institute, Radboud University, Nijmegen, Netherlands
| | - Sjoerd W. Meijer
- Donders Institute for Brain Cognition and Behaviour, Radboud University, Nijmegen, Netherlands
- Behavioural Science Institute, Radboud University, Nijmegen, Netherlands
| | - Leslie Held
- Donders Institute for Brain Cognition and Behaviour, Radboud University, Nijmegen, Netherlands
- Behavioural Science Institute, Radboud University, Nijmegen, Netherlands
| | - Floris Klumpers
- Donders Institute for Brain Cognition and Behaviour, Radboud University, Nijmegen, Netherlands
- Behavioural Science Institute, Radboud University, Nijmegen, Netherlands
| | - Lycia D. de Voogd
- Donders Institute for Brain Cognition and Behaviour, Radboud University, Nijmegen, Netherlands
- Behavioural Science Institute, Radboud University, Nijmegen, Netherlands
| | - Karin Roelofs
- Donders Institute for Brain Cognition and Behaviour, Radboud University, Nijmegen, Netherlands
- Behavioural Science Institute, Radboud University, Nijmegen, Netherlands
| |
Collapse
|
37
|
Abstract
Olfactory learning and conditioning in the fruit fly is typically modelled by correlation-based associative synaptic plasticity. It was shown that the conditioning of an odor-evoked response by a shock depends on the connections from Kenyon cells (KC) to mushroom body output neurons (MBONs). Although on the behavioral level conditioning is recognized to be predictive, it remains unclear how MBONs form predictions of aversive or appetitive values (valences) of odors on the circuit level. We present behavioral experiments that are not well explained by associative plasticity between conditioned and unconditioned stimuli, and we suggest two alternative models for how predictions can be formed. In error-driven predictive plasticity, dopaminergic neurons (DANs) represent the error between the predictive odor value and the shock strength. In target-driven predictive plasticity, the DANs represent the target for the predictive MBON activity. Predictive plasticity in KC-to-MBON synapses can also explain trace-conditioning, the valence-dependent sign switch in plasticity, and the observed novelty-familiarity representation. The model offers a framework to dissect MBON circuits and interpret DAN activity during olfactory learning.
Collapse
|
38
|
Fear extinction learning and anandamide: an fMRI study in healthy humans. Transl Psychiatry 2021; 11:161. [PMID: 33723207 PMCID: PMC7961038 DOI: 10.1038/s41398-020-01177-7] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/02/2020] [Revised: 12/04/2020] [Accepted: 12/10/2020] [Indexed: 11/23/2022] Open
Abstract
Anxiety- and trauma-related disorders are severe illnesses with high prevalence. Current treatment options leave room for improvement and the endocannabinoid system (ECS) has become a key target in psychopharmacological research. Rodent models suggest an anxiolytic effect of endocannabinoids and demonstrated that the ECS is involved in the modulation of fear learning and aversive memory consolidation. So far, one prominent target was inhibition of fatty acid amino hydrolase (FAAH), the degrading enzyme of the endocannabinoid anandamide (AEA). Research in humans remains scarce, but genetic studies have found that the single-nucleotide polymorphism (SNP) FAAH C385A (rs324420) is associated with lower catabolic performance of FAAH and increased levels of AEA. Translational research on the ECS in fear learning processes is rare, yet crucial to understand the mechanisms involved. To address this lack of research, we designed a fear conditioning, extinction learning paradigm with 51 healthy, male humans who underwent functional magnetic resonance imaging (fMRI) before analysing baseline and task-related changes of AEA, as well as the FAAH polymorphism (rs324420). The results indicate higher AEA levels in AC-heterozygotes than in CC-individuals (SNP rs324420), but no difference between the groups during extinction learning. However, neural activation of the anterior cingulate cortex and anterior insular cortex during extinction learning correlated positively with AEA baseline levels, and task-related changes in AEA were found particularly during fear extinction, with a modulatory effect on neural activation related to extinction learning. Results indicate a putative role for AEA in fear extinction learning. Pre-treatment with AEA-enhancing drugs could promote extinction learning during psychotherapeutic interventions.
Collapse
|
39
|
|
40
|
A ventral striatal prediction error signal in human fear extinction learning. Neuroimage 2021; 229:117709. [PMID: 33460800 DOI: 10.1016/j.neuroimage.2020.117709] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2020] [Revised: 11/30/2020] [Accepted: 12/19/2020] [Indexed: 12/21/2022] Open
Abstract
Animal studies have shown that the prediction error (PE) signal that drives fear extinction learning is encoded by phasic activity of midbrain dopamine (DA) neurons. Thus, the extinction PE resembles the appetitive PE that drives reward learning. In humans, fear extinction learning is less well understood. Using computational neuroimaging, a previous study from our group reported hemodynamic activity in the left ventral putamen, a subregion of the ventral striatum (VS), to correlate with a PE function derived from a formal associative learning model. The activity was modulated by genetic variation in a DA-related gene. To conceptually replicate and extend this finding, we here asked whether an extinction PE (EPE) signal in the left ventral putamen can also be observed when genotype information is not taken into account. Using an optimized experimental design for model estimation, we again observed EPE-related activity in the same striatal region, indicating that activation of this region is a feature of human extinction learning. We further observed significant EPE signals across wider parts of the VS as well as in frontal cortical areas. These results may suggest that the prediction errors during extinction learning are available to larger parts of the brain, as has also been observed in human neuroimaging studies of reward PE signaling. Conclusive evidence that the human EPE signal is of DAergic nature is still outstanding.
Collapse
|
41
|
Lee JJ, Kim HJ, Čeko M, Park BY, Lee SA, Park H, Roy M, Kim SG, Wager TD, Woo CW. A neuroimaging biomarker for sustained experimental and clinical pain. Nat Med 2021; 27:174-182. [PMID: 33398159 DOI: 10.1038/s41591-020-1142-7] [Citation(s) in RCA: 88] [Impact Index Per Article: 22.0] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2020] [Accepted: 10/19/2020] [Indexed: 12/22/2022]
Abstract
Sustained pain is a major characteristic of clinical pain disorders, but it is difficult to assess in isolation from co-occurring cognitive and emotional features in patients. In this study, we developed a functional magnetic resonance imaging signature based on whole-brain functional connectivity that tracks experimentally induced tonic pain intensity and tested its sensitivity, specificity and generalizability to clinical pain across six studies (total n = 334). The signature displayed high sensitivity and specificity to tonic pain across three independent studies of orofacial tonic pain and aversive taste. It also predicted clinical pain severity and classified patients versus controls in two independent studies of clinical low back pain. Tonic and clinical pain showed similar network-level representations, particularly in somatomotor, frontoparietal and dorsal attention networks. These patterns were distinct from representations of experimental phasic pain. This study identified a brain biomarker for sustained pain with high potential for clinical translation.
Collapse
Affiliation(s)
- Jae-Joong Lee
- Center for Neuroscience Imaging Research, Institute for Basic Science, Suwon, South Korea.,Department of Biomedical Engineering, Sungkyunkwan University, Suwon, South Korea
| | - Hong Ji Kim
- Center for Neuroscience Imaging Research, Institute for Basic Science, Suwon, South Korea.,Department of Biomedical Engineering, Sungkyunkwan University, Suwon, South Korea
| | - Marta Čeko
- Institute of Cognitive Science, University of Colorado, Boulder CO, USA.,Department of Psychology and Neuroscience, University of Colorado, Boulder CO, USA
| | - Bo-Yong Park
- Center for Neuroscience Imaging Research, Institute for Basic Science, Suwon, South Korea.,McConnell Brain Imaging Centre, Montreal Neurological institute and Hospital, McGill University, Montreal, QC, Canada
| | - Soo Ahn Lee
- Center for Neuroscience Imaging Research, Institute for Basic Science, Suwon, South Korea.,Department of Biomedical Engineering, Sungkyunkwan University, Suwon, South Korea
| | - Hyunjin Park
- Center for Neuroscience Imaging Research, Institute for Basic Science, Suwon, South Korea.,School of Electronic and Electrical Engineering, Sungkyunkwan University, Suwon, South Korea
| | - Mathieu Roy
- Department of Psychology, McGill University, Montreal, QC, Canada.,Alan Edwards Centre for Research on Pain, McGill University, Montreal, QC, Canada
| | - Seong-Gi Kim
- Center for Neuroscience Imaging Research, Institute for Basic Science, Suwon, South Korea.,Department of Biomedical Engineering, Sungkyunkwan University, Suwon, South Korea
| | - Tor D Wager
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover NH, USA.
| | - Choong-Wan Woo
- Center for Neuroscience Imaging Research, Institute for Basic Science, Suwon, South Korea. .,Department of Biomedical Engineering, Sungkyunkwan University, Suwon, South Korea. .,Biomedical Institute for Convergence at SKKU, Sungkyunkwan University, Suwon, South Korea. .,Department of Intelligent Precision Healthcare Convergence, Sungkyunkwan University, Suwon, Korea.
| |
Collapse
|
42
|
Seymour B, Mancini F. Hierarchical models of pain: Inference, information-seeking, and adaptive control. Neuroimage 2020; 222:117212. [PMID: 32739554 DOI: 10.1016/j.neuroimage.2020.117212] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2020] [Revised: 07/21/2020] [Accepted: 07/25/2020] [Indexed: 11/26/2022] Open
Abstract
Computational models of pain consider how the brain processes nociceptive information and allow mapping neural circuits and networks to cognition and behaviour. To date, they have generally have assumed two largely independent processes: perceptual inference, typically modelled as an approximate Bayesian process, and action control, typically modelled as a reinforcement learning process. However, inference and control are intertwined in complex ways, challenging the clarity of this distinction. Here, we consider how they may comprise a parallel hierarchical architecture that combines inference, information-seeking, and adaptive value-based control. This sheds light on the complex neural architecture of the pain system, and takes us closer to understanding from where pain 'arises' in the brain.
Collapse
Affiliation(s)
- Ben Seymour
- Computational and Biological Learning Lab, Department of Engineering, University of Cambridge, United Kingdom; Center for Information and Neural Networks, National Institute of Information and Communications Technology, Osaka, Japan.
| | - Flavia Mancini
- Computational and Biological Learning Lab, Department of Engineering, University of Cambridge, United Kingdom.
| |
Collapse
|
43
|
Luo J, Tan JM, Nithianantharajah J. A molecular insight into the dissociable regulation of associative learning and motivation by the synaptic protein neuroligin-1. BMC Biol 2020; 18:118. [PMID: 32921313 PMCID: PMC7646379 DOI: 10.1186/s12915-020-00848-7] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2020] [Accepted: 08/14/2020] [Indexed: 02/06/2023] Open
Abstract
Background In a changing environment, a challenge for the brain is to flexibly guide adaptive behavior towards survival. Complex behavior and the underlying neural computations emerge from the structural components of the brain across many levels: circuits, cells, and ultimately the signaling complex of proteins at synapses. In line with this logic, dynamic modification of synaptic strength or synaptic plasticity is widely considered the cellular level implementation for adaptive behavior such as learning and memory. Predominantly expressed at excitatory synapses, the postsynaptic cell-adhesion molecule neuroligin-1 (Nlgn1) forms trans-synaptic complexes with presynaptic neurexins. Extensive evidence supports that Nlgn1 is essential for NMDA receptor transmission and long-term potentiation (LTP), both of which are putative synaptic mechanisms underlying learning and memory. Here, employing a comprehensive battery of touchscreen-based cognitive assays, we asked whether impaired NMDA receptor transmission and LTP in mice lacking Nlgn1 does in fact disrupt decision-making. To this end, we addressed two key decision problems: (i) the ability to learn and exploit the associative structure of the environment and (ii) balancing the trade-off between potential rewards and costs, or positive and negative utilities of available actions. Results We found that the capacity to acquire complex associative structures and adjust learned associations was intact. However, loss of Nlgn1 alters motivation leading to a reduced willingness to overcome effort cost for reward and an increased willingness to exert effort to escape an aversive situation. We suggest Nlgn1 may be important for balancing the weighting on positive and negative utilities in reward-cost trade-off. Conclusions Our findings update canonical views of this key synaptic molecule in behavior and suggest Nlgn1 may be essential for regulating distinct cognitive processes underlying action selection. Our data demonstrate that learning and motivational computations can be dissociated within the same animal model, from a detailed behavioral dissection. Further, these results highlight the complexities in mapping synaptic mechanisms to their behavioral consequences, and the future challenge to elucidate how complex behavior emerges through different levels of neural hardware.
Collapse
Affiliation(s)
- Jiaqi Luo
- Florey Institute of Neuroscience and Mental Health, Florey Department of Neuroscience, Melbourne Brain Centre, University of Melbourne, 30 Royal Parade, Parkville, Victoria, 3052, Australia
| | - Jessica M Tan
- Florey Institute of Neuroscience and Mental Health, Florey Department of Neuroscience, Melbourne Brain Centre, University of Melbourne, 30 Royal Parade, Parkville, Victoria, 3052, Australia
| | - Jess Nithianantharajah
- Florey Institute of Neuroscience and Mental Health, Florey Department of Neuroscience, Melbourne Brain Centre, University of Melbourne, 30 Royal Parade, Parkville, Victoria, 3052, Australia.
| |
Collapse
|
44
|
Expected value and sensitivity to punishment modulate insular cortex activity during risky decision making. Sci Rep 2020; 10:11920. [PMID: 32681146 PMCID: PMC7367818 DOI: 10.1038/s41598-020-68644-5] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2019] [Accepted: 06/29/2020] [Indexed: 11/08/2022] Open
Abstract
The exact contribution of the insula to risky decision making remains unclear, as are the specific outcome parameters and inter-individual characteristics that modulate insular activity prior to a risky choice. This fMRI study examines the contributions of outcome valence, magnitude, probability, and expected value (EV) to insular activity during risky decision making, and explores the influence of sensitivity to reward and to punishment, and anxiety, to insular activity. Participants (N = 31) performed a gambling task requiring choice between two roulettes with different outcome magnitude, probability and EV, under gain and loss conditions separately, and filled questionnaires assessing sensitivity to punishment/reward, and state/trait anxiety. Parametric analyses were conducted to examine the modulation of brain activity during decision making in relation to each task parameter. Correlations were examined between insular activity and psychometric questionnaires. EV of the selected roulette was associated with right posterior insula activation during decision making. Higher sensitivity to punishment was associated with lower bilateral insular activation. These findings suggest that the right posterior insula is involved in tracking the EV of a risky option during decision making. The involvement of the insula when making risky decisions also appears to be influenced by inter-individual differences in sensitivity to punishment.
Collapse
|
45
|
Measuring learning in human classical threat conditioning: Translational, cognitive and methodological considerations. Neurosci Biobehav Rev 2020; 114:96-112. [DOI: 10.1016/j.neubiorev.2020.04.019] [Citation(s) in RCA: 36] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2019] [Revised: 04/15/2020] [Accepted: 04/18/2020] [Indexed: 02/06/2023]
|
46
|
Lau CI, Liu MN, Chen WH, Walsh V, Wang SJ. Clinical and biobehavioral perspectives: Is medication overuse headache a behavior of dependence? PROGRESS IN BRAIN RESEARCH 2020; 255:371-402. [PMID: 33008514 DOI: 10.1016/bs.pbr.2020.05.019] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/01/2020] [Revised: 04/28/2020] [Accepted: 05/01/2020] [Indexed: 02/08/2023]
Abstract
Medication overuse headache (MOH), previously known as analgesic abuse headache or medication misuse headaches, is a common form of chronic headache disorder that has a detrimental impact on health and society. Although it has been widely accepted that overusing abortive medications is paradoxically the cause of MOH and drug discontinuation is the treatment of choice, ongoing debates exist as to whether drug consumption per se is the cause or consequence of headache chronification. Certain features in MOH such as their compulsive drug-seeking behavior, withdrawal headaches and high relapse rates share similarities with drug dependence, suggesting that there might be common underlying biological and psychobehavioral mechanisms. In this regard, this article will discuss the updated evidence and current debates on the possible biobehavioral overlap between MOH and drug dependence. To begin with, we will discuss whether MOH has characteristics of substance dependence based on standard psychiatry diagnostic criteria and other widely used dependence scales. Recent epidemiological studies underscoring common psychiatric comorbidities between the two disorders will also be presented. Although both demonstrate seemingly distinct personality traits, recent studies revealed similar decision-making impairment from a cognitive perspective, indicating the presence of a maladaptive reward system in both disorders. In addition, emerging imaging studies also support this notion by showing reversible morphological and functional brain changes related to the mesocorticolimbic reward circuitry in MOH, with a strong resemblance to those in addiction. Finally, an increased familial risk for drug dependence and genetic association with dopaminergic and drug dependence molecular pathways in MOH also support a possible link between MOH and addiction. Understanding the role of dependence in MOH will have a great impact on disease management as this will provide the missing piece of the puzzle in current therapeutic strategies.
Collapse
Affiliation(s)
- Chi Ieong Lau
- Dementia Center, Department of Neurology, Shin Kong Wu Ho-Su Memorial Hospital, Taipei, Taiwan; Applied Cognitive Neuroscience Group, Institute of Cognitive Neuroscience, University College London, London, United Kingdom; Institute of Biophotonics, National Yang-Ming University, Taipei, Taiwan; College of Medicine, Fu-Jen Catholic University, New Taipei City, Taiwan; University Hospital, Taipa, Macau
| | - Mu-N Liu
- Institute of Brain Science, National Yang-Ming University, Taipei, Taiwan; Department of Psychiatry, Taipei Veterans General Hospital, Taipei, Taiwan; Department of Neurology, Memory and Aging Centre, University of California, San Francisco, CA, United States
| | - Wei-Hung Chen
- Department of Neurology, Shin Kong Wu Ho-Su Memorial Hospital, Taipei, Taiwan; College of Medicine, Taipei Medical University, Taipei, Taiwan
| | - Vincent Walsh
- Applied Cognitive Neuroscience Group, Institute of Cognitive Neuroscience, University College London, London, United Kingdom
| | - Shuu-Jiun Wang
- Department of Neurology, Neurological Institute, Taipei Veterans General Hospital, Taipei, Taiwan; Brain Research Center and School of Medicine, National Yang-Ming University, Taipei, Taiwan.
| |
Collapse
|
47
|
Bitar N, Dugré JR, Marchand S, Potvin S. Medial Orbitofrontal De-Activation During Tonic Cold Pain Stimulation: A fMRI Study Examining the Opponent-Process Theory. J Pain Res 2020; 13:1335-1347. [PMID: 32606900 PMCID: PMC7292263 DOI: 10.2147/jpr.s248056] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2020] [Accepted: 05/22/2020] [Indexed: 01/21/2023] Open
Abstract
BACKGROUND While the concomitant administration of painful and rewarding stimuli tends to reduce the perception of one another, recent evidence shows that pleasant pain relief is experience after the interruption of noxious stimuli. On neurobiological grounds, these opponent processes should translate into decreased activity in brain reward regions during nociceptive stimulation and increased activity in these regions after its interruption. While growing evidence supports the latter assumption, evidence is lacking in humans in support of the former. METHODS Twenty-six healthy individuals underwent a functional magnetic resonance imaging (fMRI) session during which they were administered a cold pain stimulation, using a novel paradigm which consisted in a cold gel applied on the right foot of participants. RESULTS After the interruption of noxious stimulation, participants experienced significant levels of pleasant pain relief. During cold pain stimulation, brain activations were observed in key regions of the pain matrix (eg, thalamus, primary somatosensory cortex and insula). Conversely, the medial orbitofrontal cortex was found to be de-activated. Medial orbitofrontal de-activations were negatively correlated with subclinical pain symptoms. DISCUSSION Our results show that a key brain reward region (eg, medial orbitofrontal cortex) is de-activated during cold pain stimulation, a result which is consistent with one of the central assumptions of the opponent-process theory. On methodological grounds, our results show that the cold gel applied to the foot can be used to trigger activations in the pain matrix, and that the interruption of the cold pressor test elicits significant levels of pleasant pain relief. fMRI studies on pain-reward interactions in chronic pain patients are warranted.
Collapse
Affiliation(s)
- Nathalie Bitar
- Research Center of the Institute of Mental Health of Montreal, Montreal, Canada
- Department of Psychiatry, Faculty of Medicine, University of Montreal, Montreal, Canada
| | - Jules R Dugré
- Research Center of the Institute of Mental Health of Montreal, Montreal, Canada
- Department of Psychiatry, Faculty of Medicine, University of Montreal, Montreal, Canada
| | - Serge Marchand
- Genome Quebec, Montreal, Canada
- Department of Surgery, Faculty of Medicine, University of Sherbrooke, Sherbrooke, Canada
| | - Stéphane Potvin
- Research Center of the Institute of Mental Health of Montreal, Montreal, Canada
- Department of Psychiatry, Faculty of Medicine, University of Montreal, Montreal, Canada
| |
Collapse
|
48
|
Perceptual Decision Parameters and Their Relation to Self-Reported Pain: A Drift Diffusion Account. THE JOURNAL OF PAIN 2020; 21:324-333. [DOI: 10.1016/j.jpain.2019.06.009] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/15/2019] [Revised: 06/06/2019] [Accepted: 06/13/2019] [Indexed: 01/08/2023]
|
49
|
Vlemincx E, Luminet O. Sighs can become learned behaviors via operant learning. Biol Psychol 2020; 151:107850. [DOI: 10.1016/j.biopsycho.2020.107850] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2019] [Revised: 01/20/2020] [Accepted: 01/20/2020] [Indexed: 10/25/2022]
|
50
|
Pittig A, Wong AH, Glück VM, Boschet JM. Avoidance and its bi-directional relationship with conditioned fear: Mechanisms, moderators, and clinical implications. Behav Res Ther 2020; 126:103550. [DOI: 10.1016/j.brat.2020.103550] [Citation(s) in RCA: 49] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2019] [Revised: 12/16/2019] [Accepted: 01/07/2020] [Indexed: 02/08/2023]
|