1
|
De Ridder D, Adhia D, Vanneste S. The brain's duck test in phantom percepts: Multisensory congruence in neuropathic pain and tinnitus. Brain Res 2024; 1844:149137. [PMID: 39103069 DOI: 10.1016/j.brainres.2024.149137] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2024] [Revised: 06/26/2024] [Accepted: 08/01/2024] [Indexed: 08/07/2024]
Abstract
Chronic neuropathic pain and chronic tinnitus have been likened to phantom percepts, in which a complete or partial sensory deafferentation results in a filling in of the missing information derived from memory. 150 participants, 50 with tinnitus, 50 with chronic pain and 50 healthy controls underwent a resting state EEG. Source localized current density is recorded from all the sensory cortices (olfactory, gustatory, somatosensory, auditory, vestibular, visual) as well as the parahippocampal area. Functional connectivity by means of lagged phase synchronization is also computed between these regions of interest. Pain and tinnitus are associated with gamma band activity, reflecting prediction errors, in all sensory cortices except the olfactory and gustatory cortex. Functional connectivity identifies theta frequency connectivity between each of the sensory cortices except the chemical senses to the parahippocampus, but not between the individual sensory cortices. When one sensory domain is deprived, the other senses may provide the parahippocampal 'contextual' area with the most likely sound or somatosensory sensation to fill in the gap, applying an abductive 'duck test' approach, i.e., based on stored multisensory congruence. This novel concept paves the way to develop novel treatments for pain and tinnitus, using multisensory (i.e. visual, vestibular, somatosensory, auditory) modulation with or without associated parahippocampal targeting.
Collapse
Affiliation(s)
- Dirk De Ridder
- Unit of Neurosurgery, Department of Surgical Sciences, Dunedin School of Medicine, University of Otago, Dunedin, New Zealand
| | - Divya Adhia
- Unit of Neurosurgery, Department of Surgical Sciences, Dunedin School of Medicine, University of Otago, Dunedin, New Zealand
| | - Sven Vanneste
- School of Psychology, Trinity College Dublin, Dublin, Ireland; Global Brain Health Institute & Institute of Neuroscience, Trinity College Dublin, Dublin, Ireland. https://www.lab-clint.org
| |
Collapse
|
2
|
Yan M, Tian Y, Hai M, Zhang B, Chen A. Working memory components modulation of attentional disengagement from evaluative distractor. Psych J 2024; 13:717-725. [PMID: 38530871 PMCID: PMC11444721 DOI: 10.1002/pchj.748] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2023] [Accepted: 02/20/2024] [Indexed: 03/28/2024]
Abstract
It is important for people to disengage attention from a distraction, which can help them complete the task at hand as quickly as possible. Recent studies have shown that people's attention stays longer on reward-distractors than on loss-distractors, and a delay in attentional disengagement is noted when reward-distractors are present. However, few studies have examined whether attentional disengagement from an evaluative distractor relies upon working memory (WM) components. In the present study, we used an attentional disengagement paradigm in which reward- or loss-distractors were presented at a central location and the target was presented at a peripheral location, in combination with different WM tasks. The results from Experiment 1 showed that participants were slower to disengage their attention from a central reward-distractor than a loss-distractor regardless of cognitive load when the phonological loop component of WM was involved. The results from Experiment 2 revealed that people had difficulty in shifting their attention away from a reward-distractor in comparison to a loss-distractor when spatial WM was low, whereas no such difference was observed when spatial WM was high. We conclude that WM components differently modulate attentional disengagement from evaluative distractors. That is, the processing of evaluative (reward and loss) distractors may rely on the same cognitive resources as the spatial WM component, but not the phonological loop component.
Collapse
Affiliation(s)
- Minmin Yan
- Key Laboratory of Cognition and Personality of Ministry of Education, Faculty of PsychologySouthwest UniversityChongqingChina
| | - Yanying Tian
- School of PsychologyShaanxi Normal UniversityXi'anChina
| | - Min Hai
- School of PsychologyShaanxi Normal UniversityXi'anChina
| | - Bohua Zhang
- Key Laboratory of Cognition and Personality of Ministry of Education, Faculty of PsychologySouthwest UniversityChongqingChina
| | - Antao Chen
- School of Psychology, Research Center for Exercise and Brain ScienceShanghai University of SportShanghaiChina
| |
Collapse
|
3
|
Cecchi R, Collomb-Clerc A, Rachidi I, Minotti L, Kahane P, Pessiglione M, Bastin J. Direct stimulation of anterior insula and ventromedial prefrontal cortex disrupts economic choices. Nat Commun 2024; 15:7508. [PMID: 39209840 PMCID: PMC11362155 DOI: 10.1038/s41467-024-51822-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2023] [Accepted: 08/16/2024] [Indexed: 09/04/2024] Open
Abstract
Neural activity within the ventromedial prefrontal cortex (vmPFC) and anterior insula (aIns) is often associated with economic choices and confidence. However, it remains unclear whether these brain regions are causally related to these processes. To address this issue, we leveraged intracranial electrical stimulation (iES) data obtained from patients with epilepsy performing an economic choice task. Our results reveal opposite effects of stimulation on decision-making depending on its location along a dorso-ventral axis within each region. Specifically, stimulation of the ventral subregion within aIns reduces risk-taking by increasing participants' sensitivity to potential losses, whereas stimulation of the dorsal subregion of aIns and the ventral portion of the vmPFC increases risk-taking by reducing participants' sensitivity to losses. Moreover, stimulation of the aIns consistently decreases participants' confidence, regardless of its location within the aIns. These findings suggest the existence of functionally dissociated neural subregions and circuits causally involved in accepting or avoiding challenges.
Collapse
Affiliation(s)
- Romane Cecchi
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut Neurosciences, 38000, Grenoble, France.
- Laboratoire de Neurosciences Cognitives et Computationnelles, Institut National de la Santé et de la Recherche Médicale, Paris, France.
- Département d'Études Cognitives, École Normale Supérieure, Université Paris Sciences et Lettres, Paris, France.
| | - Antoine Collomb-Clerc
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut Neurosciences, 38000, Grenoble, France
- NeuroX Institute and Brain Mind Institute, School of Life Sciences, Swiss Federal Institute of Technology (EPFL), Lausanne, Switzerland
| | - Inès Rachidi
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut Neurosciences, 38000, Grenoble, France
- Neurology Department, University Hospital of Grenoble, Grenoble, France
| | - Lorella Minotti
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut Neurosciences, 38000, Grenoble, France
- Neurology Department, University Hospital of Grenoble, Grenoble, France
| | - Philippe Kahane
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut Neurosciences, 38000, Grenoble, France
- Neurology Department, University Hospital of Grenoble, Grenoble, France
| | - Mathias Pessiglione
- Motivation, Brain and Behavior (MBB) team, Paris Brain Institute, Pitié-Salpêtrière Hospital, Paris, France
- Université de Paris, Paris, France
| | - Julien Bastin
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut Neurosciences, 38000, Grenoble, France.
| |
Collapse
|
4
|
Kausel L, Figueroa-Vargas A, Zamorano F, Stecher X, Aspé-Sánchez M, Carvajal-Paredes P, Márquez-Rodríguez V, Martínez-Molina MP, Román C, Soto-Fernández P, Valdebenito-Oyarzo G, Manterola C, Uribe-San-Martín R, Silva C, Henríquez-Ch R, Aboitiz F, Polania R, Guevara P, Muñoz-Venturelli P, Soto-Icaza P, Billeke P. Patients recovering from COVID-19 who presented with anosmia during their acute episode have behavioral, functional, and structural brain alterations. Sci Rep 2024; 14:19049. [PMID: 39152190 PMCID: PMC11329703 DOI: 10.1038/s41598-024-69772-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2024] [Accepted: 08/08/2024] [Indexed: 08/19/2024] Open
Abstract
Patients recovering from COVID-19 commonly exhibit cognitive and brain alterations, yet the specific neuropathological mechanisms and risk factors underlying these alterations remain elusive. Given the significant global incidence of COVID-19, identifying factors that can distinguish individuals at risk of developing brain alterations is crucial for prioritizing follow-up care. Here, we report findings from a sample of patients consisting of 73 adults with a mild to moderate SARS-CoV-2 infection without signs of respiratory failure and 27 with infections attributed to other agents and no history of COVID-19. The participants underwent cognitive screening, a decision-making task, and MRI evaluations. We assessed for the presence of anosmia and the requirement for hospitalization. Groups did not differ in age or cognitive performance. Patients who presented with anosmia exhibited more impulsive alternative changes after a shift in probabilities (r = - 0.26, p = 0.001), while patients who required hospitalization showed more perseverative choices (r = 0.25, p = 0.003). Anosmia correlated with brain measures, including decreased functional activity during the decision-making task, thinning of cortical thickness in parietal regions, and loss of white matter integrity. Hence, anosmia could be a factor to be considered when identifying at-risk populations for follow-up.
Collapse
Affiliation(s)
- Leonie Kausel
- Laboratorio de Neurociencia Social y Neuromodulación (neuroCICS), Centro de Investigación en Complejidad Social (CICS), Facultad de Gobierno, Universidad del Desarrollo, Santiago, Chile
- Centro de Estudios en Neurociencia Humana y Neuropsicología (CENHN), Facultad de Psicología, Universidad Diego Portales, Santiago, Chile
| | - Alejandra Figueroa-Vargas
- Laboratorio de Neurociencia Social y Neuromodulación (neuroCICS), Centro de Investigación en Complejidad Social (CICS), Facultad de Gobierno, Universidad del Desarrollo, Santiago, Chile
- Laboratorio LaNCE, Centro Interdisciplinario de Neurociencia, Facultad de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile
| | - Francisco Zamorano
- Unidad de Imágenes Cuantitativas Avanzadas, Departamento de Imágenes, Clínica Alemana de Santiago, Facultad de Medicina CAS-UDD, Universidad del Desarrollo, Santiago, Chile
- Facultad de Ciencias Para El Cuidado de La Salud, Universidad San Sebastián, Santiago, Chile
| | - Ximena Stecher
- Unidad de Imágenes Cuantitativas Avanzadas, Departamento de Imágenes, Clínica Alemana de Santiago, Facultad de Medicina CAS-UDD, Universidad del Desarrollo, Santiago, Chile
- Departamento de Imágenes, Clínica Alemana de Santiago, Clínica Alemana de Santiago, Facultad de Medicina CAS-UDD, Universidad del Desarrollo, Santiago, Chile
| | - Mauricio Aspé-Sánchez
- Laboratorio de Neurogenética, Centro Interdisciplinario de Neurociencias de Valparaíso (CINV), Universidad de Valparaíso, Valparaiso, Chile
| | - Patricio Carvajal-Paredes
- Laboratorio de Neurociencia Social y Neuromodulación (neuroCICS), Centro de Investigación en Complejidad Social (CICS), Facultad de Gobierno, Universidad del Desarrollo, Santiago, Chile
| | - Victor Márquez-Rodríguez
- Laboratorio de Neurociencia Social y Neuromodulación (neuroCICS), Centro de Investigación en Complejidad Social (CICS), Facultad de Gobierno, Universidad del Desarrollo, Santiago, Chile
| | - María Paz Martínez-Molina
- Laboratorio de Neurociencia Social y Neuromodulación (neuroCICS), Centro de Investigación en Complejidad Social (CICS), Facultad de Gobierno, Universidad del Desarrollo, Santiago, Chile
| | - Claudio Román
- Centro de I&D en Ingeniería en Salud, Universidad de Valparaíso, Valparaíso, Chile
| | - Patricio Soto-Fernández
- Laboratorio de Neurociencia Social y Neuromodulación (neuroCICS), Centro de Investigación en Complejidad Social (CICS), Facultad de Gobierno, Universidad del Desarrollo, Santiago, Chile
- Laboratorio de Neurogenética, Centro Interdisciplinario de Neurociencias de Valparaíso (CINV), Universidad de Valparaíso, Valparaiso, Chile
- Departamento de Evaluación de Tecnologías Sanitarias y Salud Basada en Evidencia, División de Planificación Sanitaria, Subsecretaría de Salud Pública, Ministerio de Salud, Santiago, Chile
| | - Gabriela Valdebenito-Oyarzo
- Laboratorio de Neurociencia Social y Neuromodulación (neuroCICS), Centro de Investigación en Complejidad Social (CICS), Facultad de Gobierno, Universidad del Desarrollo, Santiago, Chile
| | - Carla Manterola
- Departamento de Pediatría, Clínica Alemana de Santiago, Universidad del Desarrollo, Santiago, Chile
| | - Reinaldo Uribe-San-Martín
- Departamento de Neurología, Facultad de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile
- Servicio de Neurología, Hospital Dr. Sótero del Río, Santiago, Chile
| | - Claudio Silva
- Unidad de Imágenes Cuantitativas Avanzadas, Departamento de Imágenes, Clínica Alemana de Santiago, Facultad de Medicina CAS-UDD, Universidad del Desarrollo, Santiago, Chile
- Departamento de Imágenes, Clínica Alemana de Santiago, Clínica Alemana de Santiago, Facultad de Medicina CAS-UDD, Universidad del Desarrollo, Santiago, Chile
| | - Rodrigo Henríquez-Ch
- Laboratorio LaNCE, Centro Interdisciplinario de Neurociencia, Facultad de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile
- Departamento de Neurología, Facultad de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile
| | - Francisco Aboitiz
- Laboratorio LaNCE, Centro Interdisciplinario de Neurociencia, Facultad de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile
- Departamento de Psiquiatría, Facultad de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile
| | - Rafael Polania
- Decision Neuroscience Lab, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
| | - Pamela Guevara
- Facultad de Ingeniería, Universidad de Concepción, Santiago, Chile
| | - Paula Muñoz-Venturelli
- Centro de Estudios Clínicos, Facultad de Medicina Clínica Alemana, Universidad del Desarrollo, Santiago, Chile
| | - Patricia Soto-Icaza
- Laboratorio de Neurociencia Social y Neuromodulación (neuroCICS), Centro de Investigación en Complejidad Social (CICS), Facultad de Gobierno, Universidad del Desarrollo, Santiago, Chile.
| | - Pablo Billeke
- Laboratorio de Neurociencia Social y Neuromodulación (neuroCICS), Centro de Investigación en Complejidad Social (CICS), Facultad de Gobierno, Universidad del Desarrollo, Santiago, Chile.
| |
Collapse
|
5
|
Hoy CW, de Hemptinne C, Wang SS, Harmer CJ, Apps MAJ, Husain M, Starr PA, Little S. Beta and theta oscillations track effort and previous reward in the human basal ganglia and prefrontal cortex during decision making. Proc Natl Acad Sci U S A 2024; 121:e2322869121. [PMID: 39047043 PMCID: PMC11295073 DOI: 10.1073/pnas.2322869121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2023] [Accepted: 06/18/2024] [Indexed: 07/27/2024] Open
Abstract
Choosing whether to exert effort to obtain rewards is fundamental to human motivated behavior. However, the neural dynamics underlying the evaluation of reward and effort in humans is poorly understood. Here, we report an exploratory investigation into this with chronic intracranial recordings from the prefrontal cortex (PFC) and basal ganglia (BG; subthalamic nuclei and globus pallidus) in people with Parkinson's disease performing a decision-making task with offers that varied in levels of reward and physical effort required. This revealed dissociable neural signatures of reward and effort, with BG beta (12 to 20 Hz) oscillations tracking effort on a single-trial basis and PFC theta (4 to 7 Hz) signaling previous trial reward, with no effects of net subjective value. Stimulation of PFC increased overall acceptance of offers and sensitivity to reward while decreasing the impact of effort on choices. This work uncovers oscillatory mechanisms that guide fundamental decisions to exert effort for reward across BG and PFC, supports a causal role of PFC for such choices, and seeds hypotheses for future studies.
Collapse
Affiliation(s)
- Colin W. Hoy
- Department of Neurology, University of California, San Francisco, CA94143
| | - Coralie de Hemptinne
- Norman Fixel Institute for Neurological Diseases, University of Florida, Gainesville, FL32608
- Department of Neurology, University of Florida, Gainesville, FL32608
| | - Sarah S. Wang
- Department of Neurology, University of California, San Francisco, CA94143
| | - Catherine J. Harmer
- Department of Psychiatry, University of Oxford, OxfordOX3 7JX, United Kingdom
| | - Matthew A. J. Apps
- Department of Experimental Psychology, University of Oxford, OxfordOX2 6GG, United Kingdom
- Institute for Mental Health, School of Psychology, University of Birmingham, Birmingham UKB15 2TT, United Kingdom
- Centre for Human Brain Health, School of Psychology, University of Birmingham, BirminghamB15 2TT, United Kingdom
| | - Masud Husain
- Department of Experimental Psychology, University of Oxford, OxfordOX2 6GG, United Kingdom
- Nuffield Department of Clinical Neurosciences, University of Oxford, OxfordOX3 9DU, United Kingdom
| | - Philip A. Starr
- Department of Neurological Surgery, University of California, San Francisco, CA94143, United Kingdom
| | - Simon Little
- Department of Neurology, University of California, San Francisco, CA94143
| |
Collapse
|
6
|
Combrisson E, Basanisi R, Gueguen MCM, Rheims S, Kahane P, Bastin J, Brovelli A. Neural interactions in the human frontal cortex dissociate reward and punishment learning. eLife 2024; 12:RP92938. [PMID: 38941238 PMCID: PMC11213568 DOI: 10.7554/elife.92938] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/30/2024] Open
Abstract
How human prefrontal and insular regions interact while maximizing rewards and minimizing punishments is unknown. Capitalizing on human intracranial recordings, we demonstrate that the functional specificity toward reward or punishment learning is better disentangled by interactions compared to local representations. Prefrontal and insular cortices display non-selective neural populations to rewards and punishments. Non-selective responses, however, give rise to context-specific interareal interactions. We identify a reward subsystem with redundant interactions between the orbitofrontal and ventromedial prefrontal cortices, with a driving role of the latter. In addition, we find a punishment subsystem with redundant interactions between the insular and dorsolateral cortices, with a driving role of the insula. Finally, switching between reward and punishment learning is mediated by synergistic interactions between the two subsystems. These results provide a unifying explanation of distributed cortical representations and interactions supporting reward and punishment learning.
Collapse
Affiliation(s)
- Etienne Combrisson
- Institut de Neurosciences de la Timone, Aix Marseille UniversitéMarseilleFrance
| | - Ruggero Basanisi
- Institut de Neurosciences de la Timone, Aix Marseille UniversitéMarseilleFrance
| | - Maelle CM Gueguen
- Univ. Grenoble Alpes, Inserm, U1216, Grenoble Institut NeurosciencesGrenobleFrance
| | - Sylvain Rheims
- Department of Functional Neurology and Epileptology, Hospices Civils de Lyon and University of LyonLyonFrance
| | - Philippe Kahane
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut NeurosciencesGrenobleFrance
| | - Julien Bastin
- Univ. Grenoble Alpes, Inserm, U1216, Grenoble Institut NeurosciencesGrenobleFrance
| | - Andrea Brovelli
- Institut de Neurosciences de la Timone, Aix Marseille UniversitéMarseilleFrance
| |
Collapse
|
7
|
Lin R, Meng X, Chen F, Li X, Jensen O, Theeuwes J, Wang B. Neural evidence for attentional capture by salient distractors. Nat Hum Behav 2024; 8:932-944. [PMID: 38538771 DOI: 10.1038/s41562-024-01852-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Accepted: 02/21/2024] [Indexed: 04/17/2024]
Abstract
Salient objects often capture our attention, serving as distractors and hindering our current goals. It remains unclear when and how salient distractors interact with our goals, and our knowledge on the neural mechanisms responsible for attentional capture is limited to a few brain regions recorded from non-human primates. Here we conducted a multivariate analysis on human intracranial signals covering most brain regions and successfully dissociated distractor-specific representations from target-arousal signals in the high-frequency (60-100 Hz) activity. We found that salient distractors were processed rapidly around 220 ms, while target-tuning attention was attenuated simultaneously, supporting initial capture by distractors. Notably, neuronal activity specific to the distractor representation was strongest in the superior and middle temporal gyrus, amygdala and anterior cingulate cortex, while there were smaller contributions from the parietal and frontal cortices. These results provide neural evidence for attentional capture by salient distractors engaging a much larger network than previously appreciated.
Collapse
Affiliation(s)
- Rongqi Lin
- Key Laboratory of Brain, Cognition and Education Sciences, South China Normal University, Ministry of Education, Guangzhou, China
- Institute for Brain Research and Rehabilitation, South China Normal University, Guangzhou, China
- Center for Studies of Psychological Application, South China Normal University, Guangzhou, China
- Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, China
- Department of Psychology, Zhejiang Normal University, Jinhua, China
- Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
| | - Xianghong Meng
- Department of Neurosurgery, Shenzhen University General Hospital, Shenzhen, China
| | - Fuyong Chen
- Department of Neurosurgery, University of Hongkong Shenzhen Hospital, Shenzhen, China
| | - Xinyu Li
- Department of Psychology, Zhejiang Normal University, Jinhua, China
| | - Ole Jensen
- Centre for Human Brain Health, School of Psychology, University of Birmingham, Birmingham, UK
| | - Jan Theeuwes
- Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
| | - Benchi Wang
- Key Laboratory of Brain, Cognition and Education Sciences, South China Normal University, Ministry of Education, Guangzhou, China.
- Institute for Brain Research and Rehabilitation, South China Normal University, Guangzhou, China.
- Center for Studies of Psychological Application, South China Normal University, Guangzhou, China.
- Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, China.
| |
Collapse
|
8
|
Cowan RL, Davis T, Kundu B, Rahimpour S, Rolston JD, Smith EH. More widespread and rigid neuronal representation of reward expectation underlies impulsive choices. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.04.11.588637. [PMID: 38645037 PMCID: PMC11030340 DOI: 10.1101/2024.04.11.588637] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/23/2024]
Abstract
Impulsive choices prioritize smaller, more immediate rewards over larger, delayed, or potentially uncertain rewards. Impulsive choices are a critical aspect of substance use disorders and maladaptive decision-making across the lifespan. Here, we sought to understand the neuronal underpinnings of expected reward and risk estimation on a trial-by-trial basis during impulsive choices. To do so, we acquired electrical recordings from the human brain while participants carried out a risky decision-making task designed to measure choice impulsivity. Behaviorally, we found a reward-accuracy tradeoff, whereby more impulsive choosers were more accurate at the task, opting for a more immediate reward while compromising overall task performance. We then examined how neuronal populations across frontal, temporal, and limbic brain regions parametrically encoded reinforcement learning model variables, namely reward and risk expectation and surprise, across trials. We found more widespread representations of reward value expectation and prediction error in more impulsive choosers, whereas less impulsive choosers preferentially represented risk expectation. A regional analysis of reward and risk encoding highlighted the anterior cingulate cortex for value expectation, the anterior insula for risk expectation and surprise, and distinct regional encoding between impulsivity groups. Beyond describing trial-by-trial population neuronal representations of reward and risk variables, these results suggest impaired inhibitory control and model-free learning underpinnings of impulsive choice. These findings shed light on neural processes underlying reinforced learning and decision-making in uncertain environments and how these processes may function in psychiatric disorders.
Collapse
Affiliation(s)
- Rhiannon L Cowan
- Department of Neurosurgery, University of Utah, Salt Lake City, UT 84132, USA
| | - Tyler Davis
- Department of Neurosurgery, University of Utah, Salt Lake City, UT 84132, USA
| | - Bornali Kundu
- Department of Neurosurgery, University of Missouri, Columbia, MO 65212, USA
| | - Shervin Rahimpour
- Department of Neurosurgery, University of Utah, Salt Lake City, UT 84132, USA
| | - John D Rolston
- Department of Neurosurgery, Brigham & Women's Hospital, Harvard Medical School, Boston, MA 02115, USA
| | - Elliot H Smith
- Department of Neurosurgery, University of Utah, Salt Lake City, UT 84132, USA
| |
Collapse
|
9
|
Man V, Cockburn J, Flouty O, Gander PE, Sawada M, Kovach CK, Kawasaki H, Oya H, Howard Iii MA, O'Doherty JP. Temporally organized representations of reward and risk in the human brain. Nat Commun 2024; 15:2162. [PMID: 38461343 PMCID: PMC10924934 DOI: 10.1038/s41467-024-46094-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2023] [Accepted: 02/13/2024] [Indexed: 03/11/2024] Open
Abstract
The value and uncertainty associated with choice alternatives constitute critical features relevant for decisions. However, the manner in which reward and risk representations are temporally organized in the brain remains elusive. Here we leverage the spatiotemporal precision of intracranial electroencephalography, along with a simple card game designed to elicit the unfolding computation of a set of reward and risk variables, to uncover this temporal organization. Reward outcome representations across wide-spread regions follow a sequential order along the anteroposterior axis of the brain. In contrast, expected value can be decoded from multiple regions at the same time, and error signals in both reward and risk domains reflect a mixture of sequential and parallel encoding. We further highlight the role of the anterior insula in generalizing between reward prediction error and risk prediction error codes. Together our results emphasize the importance of neural dynamics for understanding value-based decisions under uncertainty.
Collapse
Affiliation(s)
- Vincent Man
- Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, 91125, USA.
| | - Jeffrey Cockburn
- Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, 91125, USA
| | - Oliver Flouty
- Department of Neurosurgery and Brain Repair, University of South Florida, Tampa, FL, 33606, USA
| | - Phillip E Gander
- Department of Neurosurgery, University of Iowa Hospitals and Clinics, Iowa City, IA, 52242, USA
- Department of Radiology, University of Iowa Hospitals and Clinics, Iowa City, IA, 52242, USA
- Iowa Neuroscience Institute, University of Iowa Carver College of Medicine, Iowa City, IA, 52242, USA
| | - Masahiro Sawada
- Department of Neurosurgery, University of Iowa Hospitals and Clinics, Iowa City, IA, 52242, USA
| | - Christopher K Kovach
- Department of Neurosurgery, University of Iowa Hospitals and Clinics, Iowa City, IA, 52242, USA
- Department of Neurosurgery, University of Nebraska Medical Center, Omaha, NE, 68198, USA
| | - Hiroto Kawasaki
- Department of Neurosurgery, University of Iowa Hospitals and Clinics, Iowa City, IA, 52242, USA
| | - Hiroyuki Oya
- Department of Neurosurgery, University of Iowa Hospitals and Clinics, Iowa City, IA, 52242, USA
- Iowa Neuroscience Institute, University of Iowa Carver College of Medicine, Iowa City, IA, 52242, USA
| | - Matthew A Howard Iii
- Department of Neurosurgery, University of Iowa Hospitals and Clinics, Iowa City, IA, 52242, USA
- Iowa Neuroscience Institute, University of Iowa Carver College of Medicine, Iowa City, IA, 52242, USA
| | - John P O'Doherty
- Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, 91125, USA
- Computation and Neural Systems, California Institute of Technology, Pasadena, CA, 91125, USA
| |
Collapse
|
10
|
Roth AM, Lokesh R, Tang J, Buggeln JH, Smith C, Calalo JA, Sullivan SR, Ngo T, Germain LS, Carter MJ, Cashaback JGA. Punishment Leads to Greater Sensorimotor Learning But Less Movement Variability Compared to Reward. Neuroscience 2024; 540:12-26. [PMID: 38220127 PMCID: PMC10922623 DOI: 10.1016/j.neuroscience.2024.01.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 01/05/2024] [Accepted: 01/09/2024] [Indexed: 01/16/2024]
Abstract
When a musician practices a new song, hitting a correct note sounds pleasant while striking an incorrect note sounds unpleasant. Such reward and punishment feedback has been shown to differentially influence the ability to learn a new motor skill. Recent work has suggested that punishment leads to greater movement variability, which causes greater exploration and faster learning. To further test this idea, we collected 102 participants over two experiments. Unlike previous work, in Experiment 1 we found that punishment did not lead to faster learning compared to reward (n = 68), but did lead to a greater extent of learning. Surprisingly, we also found evidence to suggest that punishment led to less movement variability, which was related to the extent of learning. We then designed a second experiment that did not involve adaptation, allowing us to further isolate the influence of punishment feedback on movement variability. In Experiment 2, we again found that punishment led to significantly less movement variability compared to reward (n = 34). Collectively our results suggest that punishment feedback leads to less movement variability. Future work should investigate whether punishment feedback leads to a greater knowledge of movement variability and or increases the sensitivity of updating motor actions.
Collapse
Affiliation(s)
- Adam M Roth
- Department of Mechanical Engineering, University of Delaware, United States
| | - Rakshith Lokesh
- Department of Biomedical Engineering, University of Delaware, United States
| | - Jiaqiao Tang
- Department of Kinesiology, McMaster University, Canada
| | - John H Buggeln
- Department of Biomedical Engineering, University of Delaware, United States
| | - Carly Smith
- Department of Biomedical Engineering, University of Delaware, United States
| | - Jan A Calalo
- Department of Mechanical Engineering, University of Delaware, United States
| | - Seth R Sullivan
- Department of Biomedical Engineering, University of Delaware, United States
| | - Truc Ngo
- Department of Biomedical Engineering, University of Delaware, United States
| | | | | | - Joshua G A Cashaback
- Department of Mechanical Engineering, University of Delaware, United States; Department of Biomedical Engineering, University of Delaware, United States; Kinesiology and Applied Physiology, University of Delaware, United States; Interdisciplinary Neuroscience Graduate Program, University of Delaware, United States; Biomechanics and Movement Science Program, University of Delaware, United States; Department of Kinesiology, McMaster University, Canada.
| |
Collapse
|
11
|
Colas JT, O’Doherty JP, Grafton ST. Active reinforcement learning versus action bias and hysteresis: control with a mixture of experts and nonexperts. PLoS Comput Biol 2024; 20:e1011950. [PMID: 38552190 PMCID: PMC10980507 DOI: 10.1371/journal.pcbi.1011950] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2023] [Accepted: 02/26/2024] [Indexed: 04/01/2024] Open
Abstract
Active reinforcement learning enables dynamic prediction and control, where one should not only maximize rewards but also minimize costs such as of inference, decisions, actions, and time. For an embodied agent such as a human, decisions are also shaped by physical aspects of actions. Beyond the effects of reward outcomes on learning processes, to what extent can modeling of behavior in a reinforcement-learning task be complicated by other sources of variance in sequential action choices? What of the effects of action bias (for actions per se) and action hysteresis determined by the history of actions chosen previously? The present study addressed these questions with incremental assembly of models for the sequential choice data from a task with hierarchical structure for additional complexity in learning. With systematic comparison and falsification of computational models, human choices were tested for signatures of parallel modules representing not only an enhanced form of generalized reinforcement learning but also action bias and hysteresis. We found evidence for substantial differences in bias and hysteresis across participants-even comparable in magnitude to the individual differences in learning. Individuals who did not learn well revealed the greatest biases, but those who did learn accurately were also significantly biased. The direction of hysteresis varied among individuals as repetition or, more commonly, alternation biases persisting from multiple previous actions. Considering that these actions were button presses with trivial motor demands, the idiosyncratic forces biasing sequences of action choices were robust enough to suggest ubiquity across individuals and across tasks requiring various actions. In light of how bias and hysteresis function as a heuristic for efficient control that adapts to uncertainty or low motivation by minimizing the cost of effort, these phenomena broaden the consilient theory of a mixture of experts to encompass a mixture of expert and nonexpert controllers of behavior.
Collapse
Affiliation(s)
- Jaron T. Colas
- Department of Psychological and Brain Sciences, University of California, Santa Barbara, California, United States of America
- Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, California, United States of America
- Computation and Neural Systems Program, California Institute of Technology, Pasadena, California, United States of America
| | - John P. O’Doherty
- Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, California, United States of America
- Computation and Neural Systems Program, California Institute of Technology, Pasadena, California, United States of America
| | - Scott T. Grafton
- Department of Psychological and Brain Sciences, University of California, Santa Barbara, California, United States of America
| |
Collapse
|
12
|
Valdebenito-Oyarzo G, Martínez-Molina MP, Soto-Icaza P, Zamorano F, Figueroa-Vargas A, Larraín-Valenzuela J, Stecher X, Salinas C, Bastin J, Valero-Cabré A, Polania R, Billeke P. The parietal cortex has a causal role in ambiguity computations in humans. PLoS Biol 2024; 22:e3002452. [PMID: 38198502 PMCID: PMC10824459 DOI: 10.1371/journal.pbio.3002452] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2023] [Revised: 01/23/2024] [Accepted: 11/28/2023] [Indexed: 01/12/2024] Open
Abstract
Humans often face the challenge of making decisions between ambiguous options. The level of ambiguity in decision-making has been linked to activity in the parietal cortex, but its exact computational role remains elusive. To test the hypothesis that the parietal cortex plays a causal role in computing ambiguous probabilities, we conducted consecutive fMRI and TMS-EEG studies. We found that participants assigned unknown probabilities to objective probabilities, elevating the uncertainty of their decisions. Parietal cortex activity correlated with the objective degree of ambiguity and with a process that underestimates the uncertainty during decision-making. Conversely, the midcingulate cortex (MCC) encodes prediction errors and increases its connectivity with the parietal cortex during outcome processing. Disruption of the parietal activity increased the uncertainty evaluation of the options, decreasing cingulate cortex oscillations during outcome evaluation and lateral frontal oscillations related to value ambiguous probability. These results provide evidence for a causal role of the parietal cortex in computing uncertainty during ambiguous decisions made by humans.
Collapse
Affiliation(s)
- Gabriela Valdebenito-Oyarzo
- Laboratorio de Neurociencia Social y Neuromodulación, Centro de Investigación en Complejidad Social, (neuroCICS), Facultad de Gobierno, Universidad del Desarrollo, Santiago, Chile
| | - María Paz Martínez-Molina
- Laboratorio de Neurociencia Social y Neuromodulación, Centro de Investigación en Complejidad Social, (neuroCICS), Facultad de Gobierno, Universidad del Desarrollo, Santiago, Chile
| | - Patricia Soto-Icaza
- Laboratorio de Neurociencia Social y Neuromodulación, Centro de Investigación en Complejidad Social, (neuroCICS), Facultad de Gobierno, Universidad del Desarrollo, Santiago, Chile
| | - Francisco Zamorano
- Unidad de Neuroimágenes Cuantitativas avanzadas (UNICA), Departamento de Imágenes, Clínica Alemana de Santiago, Santiago, Chile
- Facultad de Ciencias para el Cuidado de la Salud, Campus Los Leones, Universidad San Sebastián, Santiago, Chile
| | - Alejandra Figueroa-Vargas
- Laboratorio de Neurociencia Social y Neuromodulación, Centro de Investigación en Complejidad Social, (neuroCICS), Facultad de Gobierno, Universidad del Desarrollo, Santiago, Chile
| | - Josefina Larraín-Valenzuela
- Laboratorio de Neurociencia Social y Neuromodulación, Centro de Investigación en Complejidad Social, (neuroCICS), Facultad de Gobierno, Universidad del Desarrollo, Santiago, Chile
| | - Ximena Stecher
- Unidad de Neuroimágenes Cuantitativas avanzadas (UNICA), Departamento de Imágenes, Clínica Alemana de Santiago, Santiago, Chile
| | - César Salinas
- Unidad de Neuroimágenes Cuantitativas avanzadas (UNICA), Departamento de Imágenes, Clínica Alemana de Santiago, Santiago, Chile
| | - Julien Bastin
- Univ. Grenoble Alpes, Inserm, U1216, Grenoble Institut Neurosciences, Grenoble, France
| | - Antoni Valero-Cabré
- Causal Dynamics, Plasticity and Rehabilitation Group, FRONTLAB team, Institut du Cerveau et de la Moelle Epinière (ICM), CNRS UMR 7225, INSERM U 1127 and Sorbonne Université, Paris, France
- Cognitive Neuroscience and Information Technology Research Program, Open University of Catalonia (UOC), Barcelona, Spain
- Laboratory for Cerebral Dynamics Plasticity and Rehabilitation, Boston University, School of Medicine, Boston, Massachusetts, United States of America
| | - Rafael Polania
- Decision Neuroscience Lab, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
| | - Pablo Billeke
- Laboratorio de Neurociencia Social y Neuromodulación, Centro de Investigación en Complejidad Social, (neuroCICS), Facultad de Gobierno, Universidad del Desarrollo, Santiago, Chile
| |
Collapse
|
13
|
Bieth T, Ovando‐Tellez M, Lopez‐Persem A, Garcin B, Hugueville L, Lehongre K, Levy R, George N, Volle E. Time course of EEG power during creative problem-solving with insight or remote thinking. Hum Brain Mapp 2024; 45:e26547. [PMID: 38060194 PMCID: PMC10789201 DOI: 10.1002/hbm.26547] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2023] [Revised: 10/18/2023] [Accepted: 11/15/2023] [Indexed: 12/08/2023] Open
Abstract
Problem-solving often requires creativity and is critical in everyday life. However, the neurocognitive mechanisms underlying creative problem-solving remain poorly understood. Two mechanisms have been highlighted: the formation of new connections among problem elements and insight solving, characterized by sudden realization of a solution. In this study, we investigated EEG activity during a modified version of the remote associates test, a classical insight problem task that requires finding a word connecting three unrelated words. This allowed us to explore the brain correlates associated with the semantic remoteness of connections (by varying the remoteness of the solution word across trials) and with insight solving (identified as a Eurêka moment reported by the participants). Semantic remoteness was associated with power increase in the alpha band (8-12 Hz) in a left parieto-temporal cluster, the beta band (13-30 Hz) in a right fronto-temporal cluster in the early phase of the task, and the theta band (3-7 Hz) in a bilateral frontal cluster just prior to participants' responses. Insight solving was associated with power increase preceding participants' responses in the alpha and gamma (31-60 Hz) bands in a left temporal cluster and the theta band in a frontal cluster. Source reconstructions revealed the brain regions associated with these clusters. Overall, our findings shed new light on some of the mechanisms involved in creative problem-solving.
Collapse
Affiliation(s)
- Théophile Bieth
- Sorbonne Université, Institut du Cerveau—Paris Brain Institute—ICM, Inserm, CNRS, APHP, Hôpital de la Pitié SalpêtrièreParisFrance
- Sorbonne Université, Institut du Cerveau—Paris Brain Institute—ICM, Inserm, CNRS, AP‐HP, Hôpital de la Pitié Salpêtrière, DMU NeuroscienceParisFrance
| | - Marcela Ovando‐Tellez
- Sorbonne Université, Institut du Cerveau—Paris Brain Institute—ICM, Inserm, CNRS, APHP, Hôpital de la Pitié SalpêtrièreParisFrance
| | - Alizée Lopez‐Persem
- Sorbonne Université, Institut du Cerveau—Paris Brain Institute—ICM, Inserm, CNRS, APHP, Hôpital de la Pitié SalpêtrièreParisFrance
| | - Béatrice Garcin
- Sorbonne Université, Institut du Cerveau—Paris Brain Institute—ICM, Inserm, CNRS, APHP, Hôpital de la Pitié SalpêtrièreParisFrance
- Department of NeurologyAvicenne Hospital, AP‐HPBobignyFrance
| | - Laurent Hugueville
- Sorbonne Université, Institut du Cerveau—Paris Brain Institute—ICM, Inserm, CNRS, APHP, Hôpital de la Pitié SalpêtrièreParisFrance
- Institut du Cerveau—ICM, Inserm U1127, CNRS UMR7225, Sorbonne Université, Centre MEG‐EEG, CENIRParisFrance
| | - Katia Lehongre
- Sorbonne Université, Institut du Cerveau—Paris Brain Institute—ICM, Inserm, CNRS, APHP, Hôpital de la Pitié SalpêtrièreParisFrance
| | - Richard Levy
- Sorbonne Université, Institut du Cerveau—Paris Brain Institute—ICM, Inserm, CNRS, APHP, Hôpital de la Pitié SalpêtrièreParisFrance
- Sorbonne Université, Institut du Cerveau—Paris Brain Institute—ICM, Inserm, CNRS, AP‐HP, Hôpital de la Pitié Salpêtrière, DMU NeuroscienceParisFrance
| | - Nathalie George
- Sorbonne Université, Institut du Cerveau—Paris Brain Institute—ICM, Inserm, CNRS, APHP, Hôpital de la Pitié SalpêtrièreParisFrance
- Institut du Cerveau—ICM, Inserm U1127, CNRS UMR7225, Sorbonne Université, Centre MEG‐EEG, CENIRParisFrance
| | - Emmanuelle Volle
- Sorbonne Université, Institut du Cerveau—Paris Brain Institute—ICM, Inserm, CNRS, APHP, Hôpital de la Pitié SalpêtrièreParisFrance
| |
Collapse
|
14
|
Hoy CW, Quiroga-Martinez DR, Sandoval E, King-Stephens D, Laxer KD, Weber P, Lin JJ, Knight RT. Asymmetric coding of reward prediction errors in human insula and dorsomedial prefrontal cortex. Nat Commun 2023; 14:8520. [PMID: 38129440 PMCID: PMC10739882 DOI: 10.1038/s41467-023-44248-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2022] [Accepted: 12/05/2023] [Indexed: 12/23/2023] Open
Abstract
The signed value and unsigned salience of reward prediction errors (RPEs) are critical to understanding reinforcement learning (RL) and cognitive control. Dorsomedial prefrontal cortex (dMPFC) and insula (INS) are key regions for integrating reward and surprise information, but conflicting evidence for both signed and unsigned activity has led to multiple proposals for the nature of RPE representations in these brain areas. Recently developed RL models allow neurons to respond differently to positive and negative RPEs. Here, we use intracranially recorded high frequency activity (HFA) to test whether this flexible asymmetric coding strategy captures RPE coding diversity in human INS and dMPFC. At the region level, we found a bias towards positive RPEs in both areas which paralleled behavioral adaptation. At the local level, we found spatially interleaved neural populations responding to unsigned RPE salience and valence-specific positive and negative RPEs. Furthermore, directional connectivity estimates revealed a leading role of INS in communicating positive and unsigned RPEs to dMPFC. These findings support asymmetric coding across distinct but intermingled neural populations as a core principle of RPE processing and inform theories of the role of dMPFC and INS in RL and cognitive control.
Collapse
Affiliation(s)
- Colin W Hoy
- Department of Neurology, University of California, San Francisco, San Francisco, CA, USA.
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, USA.
| | - David R Quiroga-Martinez
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, USA
- Center for Music in the Brain, Aarhus University & The Royal Academy of Music, Aarhus, Denmark
| | - Eduardo Sandoval
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, USA
| | - David King-Stephens
- Department of Neurology and Neurosurgery, California Pacific Medical Center, San Francisco, CA, USA
- Department of Neurology, Yale School of Medicine, New Haven, CT, USA
| | - Kenneth D Laxer
- Department of Neurology and Neurosurgery, California Pacific Medical Center, San Francisco, CA, USA
| | - Peter Weber
- Department of Neurology and Neurosurgery, California Pacific Medical Center, San Francisco, CA, USA
| | - Jack J Lin
- Department of Neurology, University of California, Davis, Davis, CA, USA
- Center for Mind and Brain, University of California, Davis, Davis, CA, USA
| | - Robert T Knight
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, USA
- Department of Psychology, University of California, Berkeley, Berkeley, CA, USA
| |
Collapse
|
15
|
Hoy CW, de Hemptinne C, Wang SS, Harmer CJ, Apps MAJ, Husain M, Starr PA, Little S. Beta and theta oscillations track effort and previous reward in human basal ganglia and prefrontal cortex during decision making. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.12.05.570285. [PMID: 38106063 PMCID: PMC10723308 DOI: 10.1101/2023.12.05.570285] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/19/2023]
Abstract
Choosing whether to exert effort to obtain rewards is fundamental to human motivated behavior. However, the neural dynamics underlying the evaluation of reward and effort in humans is poorly understood. Here, we investigate this with chronic intracranial recordings from prefrontal cortex (PFC) and basal ganglia (BG; subthalamic nuclei and globus pallidus) in people with Parkinson's disease performing a decision-making task with offers that varied in levels of reward and physical effort required. This revealed dissociable neural signatures of reward and effort, with BG beta (12-20 Hz) oscillations tracking subjective effort on a single trial basis and PFC theta (4-7 Hz) signaling previous trial reward. Stimulation of PFC increased overall acceptance of offers in addition to increasing the impact of reward on choices. This work uncovers oscillatory mechanisms that guide fundamental decisions to exert effort for reward across BG and PFC, as well as supporting a causal role of PFC for such choices.
Collapse
Affiliation(s)
- Colin W. Hoy
- Department of Neurology, University of California, San Francisco, San Francisco, CA, USA
| | - Coralie de Hemptinne
- Norman Fixel Institute for Neurological Diseases, University of Florida, Gainesville, FL, USA
- Department of Neurology, University of Florida, Gainesville, FL, USA
| | - Sarah S. Wang
- Department of Neurology, University of California, San Francisco, San Francisco, CA, USA
| | | | - Mathew A. J. Apps
- Department of Experimental Psychology, University of Oxford, Oxford, UK
- Institute for Mental Health, School of Psychology, University of Birmingham, Birmingham, UK
| | - Masud Husain
- Department of Experimental Psychology, University of Oxford, Oxford, UK
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK
| | - Philip A. Starr
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA, USA
| | - Simon Little
- Department of Neurology, University of California, San Francisco, San Francisco, CA, USA
| |
Collapse
|
16
|
Pouchon A, Vinckier F, Dondé C, Gueguen MC, Polosan M, Bastin J. Reward and punishment learning deficits among bipolar disorder subtypes. J Affect Disord 2023; 340:694-702. [PMID: 37591352 DOI: 10.1016/j.jad.2023.08.075] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/24/2023] [Revised: 07/24/2023] [Accepted: 08/14/2023] [Indexed: 08/19/2023]
Abstract
BACKGROUND Reward sensitivity is an essential dimension related to mood fluctuations in bipolar disorder (BD), but there is currently a debate around hypersensitivity or hyposensitivity hypotheses to reward in BD during remission, probably related to a heterogeneous population within the BD spectrum and a lack of reward bias evaluation. Here, we examine reward maximization vs. punishment avoidance learning within the BD spectrum during remission. METHODS Patients with BD-I (n = 45), BD-II (n = 34) and matched (n = 30) healthy controls (HC) were included. They performed an instrumental learning task designed to dissociate reward-based from punishment-based reinforcement learning. Computational modeling was used to identify the mechanisms underlying reinforcement learning performances. RESULTS Behavioral results showed a significant reward learning deficit across BD subtypes compared to HC, captured at the computational level by a lower sensitivity to rewards compared to punishments in both BD subtypes. Computational modeling also revealed a higher choice randomness in BD-II compared to BD-I that reflected a tendency of BD-I to perform better during punishment avoidance learning than BD-II. LIMITATIONS Our patients were not naive to antipsychotic treatment and were not euthymic (but in syndromic remission) according to the International Society for Bipolar Disorder definition. CONCLUSIONS Our results are consistent with the reward hyposensitivity theory in BD. Computational modeling suggests distinct underlying mechanisms that produce similar observable behaviors, making it a useful tool for distinguishing how symptoms interact in BD versus other disorders. In the long run, a better understanding of these processes could contribute to better prevention and management of BD.
Collapse
Affiliation(s)
- Arnaud Pouchon
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut Neurosciences, 38000 Grenoble, France; Department of Psychiatry, CHU Grenoble Alpes, 38000 Grenoble, France.
| | - Fabien Vinckier
- Motivation, Brain & Behavior (MBB) lab, Institut du Cerveau (ICM), Hôpital Pitié-Salpêtrière, F-75013 Paris, France; Université Paris Cité, F-75006 Paris, France; Department of Psychiatry, Service Hospitalo-Universitaire, GHU Paris Psychiatrie & Neurosciences, F-75014 Paris, France
| | - Clément Dondé
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut Neurosciences, 38000 Grenoble, France; Department of Psychiatry, CHU Grenoble Alpes, 38000 Grenoble, France; Department of Psychiatry, CH Alpes-Isère, 38000 Saint-Egrève, France
| | - Maëlle Cm Gueguen
- Department of Psychiatry, University Behavioral Health Care & the Brain Health Institute, Rutgers University-New Brunswick, Piscataway, USA; Laureate Institute for Brain Research, Tulsa, OK 74136 USA
| | - Mircea Polosan
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut Neurosciences, 38000 Grenoble, France; Department of Psychiatry, CHU Grenoble Alpes, 38000 Grenoble, France
| | - Julien Bastin
- Univ. Grenoble Alpes, Inserm, U1216, Grenoble Institut Neurosciences, 38000 Grenoble, France.
| |
Collapse
|
17
|
Collomb-Clerc A, Gueguen MCM, Minotti L, Kahane P, Navarro V, Bartolomei F, Carron R, Regis J, Chabardès S, Palminteri S, Bastin J. Human thalamic low-frequency oscillations correlate with expected value and outcomes during reinforcement learning. Nat Commun 2023; 14:6534. [PMID: 37848435 PMCID: PMC10582006 DOI: 10.1038/s41467-023-42380-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2022] [Accepted: 10/09/2023] [Indexed: 10/19/2023] Open
Abstract
Reinforcement-based adaptive decision-making is believed to recruit fronto-striatal circuits. A critical node of the fronto-striatal circuit is the thalamus. However, direct evidence of its involvement in human reinforcement learning is lacking. We address this gap by analyzing intra-thalamic electrophysiological recordings from eight participants while they performed a reinforcement learning task. We found that in both the anterior thalamus (ATN) and dorsomedial thalamus (DMTN), low frequency oscillations (LFO, 4-12 Hz) correlated positively with expected value estimated from computational modeling during reward-based learning (after outcome delivery) or punishment-based learning (during the choice process). Furthermore, LFO recorded from ATN/DMTN were also negatively correlated with outcomes so that both components of reward prediction errors were signaled in the human thalamus. The observed differences in the prediction signals between rewarding and punishing conditions shed light on the neural mechanisms underlying action inhibition in punishment avoidance learning. Our results provide insight into the role of thalamus in reinforcement-based decision-making in humans.
Collapse
Affiliation(s)
- Antoine Collomb-Clerc
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut Neurosciences, 38000, Grenoble, France
| | - Maëlle C M Gueguen
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut Neurosciences, 38000, Grenoble, France
- Department of Psychiatry, Brain Health Institute and University Behavioral Health Care, Rutgers University-New Brunswick, Piscataway, NJ, USA
| | - Lorella Minotti
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut Neurosciences, 38000, Grenoble, France
- Neurology Department, University Hospital of Grenoble, Grenoble, France
| | - Philippe Kahane
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut Neurosciences, 38000, Grenoble, France
- Neurology Department, University Hospital of Grenoble, Grenoble, France
| | - Vincent Navarro
- Sorbonne Université, Paris Brain Institute - Institut du Cerveau, ICM, INSERM, CNRS, AP-HP, Pitié-Salpêtrière Hospital, Paris, France
| | - Fabrice Bartolomei
- Timone University Hospital, Sleep Unit, Epileptology and Cerebral Rhythmology, University Hospital of Marseille, Marseille, France
- Aix Marseille University, Inserm, Institut de Neurosciences des Systèmes, Marseille, France
| | - Romain Carron
- Aix Marseille University, Inserm, Institut de Neurosciences des Systèmes, Marseille, France
- Timone University Hospital, Department of functional and stereotactic neurosurgery, University Hospital of Marseille, Marseille, France
| | - Jean Regis
- Neurosurgery Department, University Hospital of Marseille, Marseille, France
| | - Stephan Chabardès
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut Neurosciences, 38000, Grenoble, France
- Neurosurgery Department, University Hospital of Grenoble, Grenoble, France
| | - Stefano Palminteri
- Laboratoire de Neurosciences Cognitives Computationnelles, Département d'Etudes Cognitives, ENS, PSL, INSERM, Paris, France
| | - Julien Bastin
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut Neurosciences, 38000, Grenoble, France.
| |
Collapse
|
18
|
Marciano D, Staveland BR, Lin JJ, Saez I, Hsu M, Knight RT. Electrophysiological signatures of inequity-dependent reward encoding in the human OFC. Cell Rep 2023; 42:112865. [PMID: 37494185 DOI: 10.1016/j.celrep.2023.112865] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2022] [Revised: 06/12/2023] [Accepted: 07/10/2023] [Indexed: 07/28/2023] Open
Abstract
Social decision making requires the integration of reward valuation and social cognition systems, both dependent on the orbitofrontal cortex (OFC). How these two OFC functions interact is largely unknown. We recorded intracranial activity from the OFC of ten patients making choices in a social context where reward inequity with a social counterpart varied and could be either advantageous or disadvantageous. We find that OFC high-frequency activity (HFA; 70-150 Hz) encodes self-reward, consistent with previous reports. We also observe encoding of the social counterpart's reward, as well as the type of inequity being experienced. Additionally, we find evidence of inequity-dependent reward encoding: depending on the type of inequity, electrodes rapidly and reversibly switch between different reward-encoding profiles. These results provide direct evidence for encoding of self- and other rewards in the human OFC and highlight the dynamic nature of encoding in the OFC as a function of social context.
Collapse
Affiliation(s)
- Deborah Marciano
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA; Haas School of Business, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Brooke R Staveland
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Jack J Lin
- Department of Neurology, University of California, Davis, Davis, CA 95616, USA; Center for Mind and Brain, University of California, Davis, Davis, CA 95616, USA
| | - Ignacio Saez
- Departments of Neuroscience, Neurosurgery and Neurology, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA.
| | - Ming Hsu
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA; Haas School of Business, University of California, Berkeley, Berkeley, CA 94720, USA.
| | - Robert T Knight
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA; Department of Psychology, University of California, Berkeley, Berkeley, CA 94720, USA.
| |
Collapse
|
19
|
Kim H, Hur JK, Kwon M, Kim S, Zoh Y, Ahn WY. Causal role of the dorsolateral prefrontal cortex in modulating the balance between Pavlovian and instrumental systems in the punishment domain. PLoS One 2023; 18:e0286632. [PMID: 37267307 PMCID: PMC10237433 DOI: 10.1371/journal.pone.0286632] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2022] [Accepted: 05/19/2023] [Indexed: 06/04/2023] Open
Abstract
Previous literature suggests that a balance between Pavlovian and instrumental decision-making systems is critical for optimal decision-making. Pavlovian bias (i.e., approach toward reward-predictive stimuli and avoid punishment-predictive stimuli) often contrasts with the instrumental response. Although recent neuroimaging studies have identified brain regions that may be related to Pavlovian bias, including the dorsolateral prefrontal cortex (dlPFC), it is unclear whether a causal relationship exists. Therefore, we investigated whether upregulation of the dlPFC using transcranial current direct stimulation (tDCS) would reduce Pavlovian bias. In this double-blind study, participants were assigned to the anodal or the sham group; they received stimulation over the right dlPFC for 3 successive days. On the last day, participants performed a reinforcement learning task known as the orthogonalized go/no-go task; this was used to assess each participant's degree of Pavlovian bias in reward and punishment domains. We used computational modeling and hierarchical Bayesian analysis to estimate model parameters reflecting latent cognitive processes, including Pavlovian bias, go bias, and choice randomness. Several computational models were compared; the model with separate Pavlovian bias parameters for reward and punishment domains demonstrated the best model fit. When using a behavioral index of Pavlovian bias, the anodal group showed significantly lower Pavlovian bias in the punishment domain, but not in the reward domain, compared with the sham group. In addition, computational modeling showed that Pavlovian bias parameter in the punishment domain was lower in the anodal group than in the sham group, which is consistent with the behavioral findings. The anodal group also showed a lower go bias and choice randomness, compared with the sham group. These findings suggest that anodal tDCS may lead to behavioral suppression or change in Pavlovian bias in the punishment domain, which will help to improve comprehension of the causal neural mechanism.
Collapse
Affiliation(s)
- Hyeonjin Kim
- Department of Psychology, Seoul National University, Seoul, Korea
| | - Jihyun K. Hur
- Department of Psychology, Yale University, New Haven, Connecticut, United States of America
| | - Mina Kwon
- Department of Psychology, Seoul National University, Seoul, Korea
| | - Soyeon Kim
- Department of Psychology, Seoul National University, Seoul, Korea
| | - Yoonseo Zoh
- Department of Psychology, Princeton University, Princeton, New Jersey, United States of America
| | - Woo-Young Ahn
- Department of Psychology, Seoul National University, Seoul, Korea
- Department of Brain and Cognitive Sciences, Seoul National University, Seoul, Korea
| |
Collapse
|
20
|
Man V, Cockburn J, Flouty O, Gander PE, Sawada M, Kovach CK, Kawasaki H, Oya H, Howard MA, O'Doherty JP. Temporally organized representations of reward and risk in the human brain. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.05.09.539916. [PMID: 37214975 PMCID: PMC10197553 DOI: 10.1101/2023.05.09.539916] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
The value and uncertainty associated with choice alternatives constitute critical features along which decisions are made. While the neural substrates supporting reward and risk processing have been investigated, the temporal organization by which these computations are encoded remains elusive. Here we leverage the high spatiotemporal precision of intracranial electroencephalography (iEEG) to uncover how representations of decision-related computations unfold in time. We present evidence of locally distributed representations of reward and risk variables that are temporally organized across multiple regions of interest. Reward outcome representations across wide-spread regions follow a temporally cascading order along the anteroposterior axis of the brain. In contrast, expected value can be decoded from multiple regions at the same time, and error signals in both reward and risk domains reflect a mixture of sequential and parallel encoding. We highlight the role of the anterior insula in generalizing between reward prediction error (RePE) and risk prediction error (RiPE), within which the encoding of RePE in the distributed iEEG signal predicts RiPE. Together our results emphasize the utility of uncovering temporal dynamics in the human brain for understanding how computational processes critical for value-based decisions under uncertainty unfold.
Collapse
|
21
|
De Ridder D, Friston K, Sedley W, Vanneste S. A parahippocampal-sensory Bayesian vicious circle generates pain or tinnitus: a source-localized EEG study. Brain Commun 2023; 5:fcad132. [PMID: 37223127 PMCID: PMC10202557 DOI: 10.1093/braincomms/fcad132] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2022] [Revised: 02/14/2023] [Accepted: 04/19/2023] [Indexed: 05/25/2023] Open
Abstract
Pain and tinnitus share common pathophysiological mechanisms, clinical features, and treatment approaches. A source-localized resting-state EEG study was conducted in 150 participants: 50 healthy controls, 50 pain, and 50 tinnitus patients. Resting-state activity as well as functional and effective connectivity was computed in source space. Pain and tinnitus were characterized by increased theta activity in the pregenual anterior cingulate cortex, extending to the lateral prefrontal cortex and medial anterior temporal lobe. Gamma-band activity was increased in both auditory and somatosensory cortex, irrespective of the pathology, and extended to the dorsal anterior cingulate cortex and parahippocampus. Functional and effective connectivity were largely similar in pain and tinnitus, except for a parahippocampal-sensory loop that distinguished pain from tinnitus. In tinnitus, the effective connectivity between parahippocampus and auditory cortex is bidirectional, whereas the effective connectivity between parahippocampus and somatosensory cortex is unidirectional. In pain, the parahippocampal-somatosensory cortex is bidirectional, but parahippocampal auditory cortex unidirectional. These modality-specific loops exhibited theta-gamma nesting. Applying a Bayesian brain model of brain functioning, these findings suggest that the phenomenological difference between auditory and somatosensory phantom percepts result from a vicious circle of belief updating in the context of missing sensory information. This finding may further our understanding of multisensory integration and speaks to a universal treatment for pain and tinnitus-by selectively disrupting parahippocampal-somatosensory and parahippocampal-auditory theta-gamma activity and connectivity.
Collapse
Affiliation(s)
- Dirk De Ridder
- Unit of Neurosurgery, Department of Surgical Sciences, Dunedin School of Medicine, University of Otago, Dunedin 9016, New Zealand
| | - Karl Friston
- Wellcome Trust Centre for Neuroimaging, University College London, London WC1N 3AR, UK
| | - William Sedley
- Translational and Clinical Research Institute, Newcastle University, Newcastle upon Tyne NE1 7RU, UK
| | - Sven Vanneste
- Correspondence to: Sven Vanneste Lab for Clinical & Integrative Neuroscience Global Brain Health Institute and Institute of Neuroscience Trinity College Dublin, College Green 2, Dublin D02 PN40, Ireland E-mail:
| |
Collapse
|
22
|
Saez I, Gu X. Invasive Computational Psychiatry. Biol Psychiatry 2023; 93:661-670. [PMID: 36641365 PMCID: PMC10038930 DOI: 10.1016/j.biopsych.2022.09.032] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/05/2022] [Revised: 08/25/2022] [Accepted: 09/27/2022] [Indexed: 01/16/2023]
Abstract
Computational psychiatry, a relatively new yet prolific field that aims to understand psychiatric disorders with formal theories about the brain, has seen tremendous growth in the past decade. Despite initial excitement, actual progress made by computational psychiatry seems stagnant. Meanwhile, understanding of the human brain has benefited tremendously from recent progress in intracranial neuroscience. Specifically, invasive techniques such as stereotactic electroencephalography, electrocorticography, and deep brain stimulation have provided a unique opportunity to precisely measure and causally modulate neurophysiological activity in the living human brain. In this review, we summarize progress and drawbacks in both computational psychiatry and invasive electrophysiology and propose that their combination presents a highly promising new direction-invasive computational psychiatry. The value of this approach is at least twofold. First, it advances our mechanistic understanding of the neural computations of mental states by providing a spatiotemporally precise depiction of neural activity that is traditionally unattainable using noninvasive techniques with human subjects. Second, it offers a direct and immediate way to modulate brain states through stimulation of algorithmically defined neural regions and circuits (i.e., algorithmic targeting), thus providing both causal and therapeutic insights. We then present depression as a use case where the combination of computational and invasive approaches has already shown initial success. We conclude by outlining future directions as a road map for this exciting new field as well as presenting cautions about issues such as ethical concerns and generalizability of findings.
Collapse
Affiliation(s)
- Ignacio Saez
- Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, New York; Department of Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, New York; Department of Neurology, Icahn School of Medicine at Mount Sinai, New York, New York; Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, New York.
| | - Xiaosi Gu
- Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, New York; Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, New York.
| |
Collapse
|
23
|
Chen Y, Wang G, Zhang W, Han Y, Zhang L, Xu H, Meng S, Lu L, Xue Y, Shi J. An orbitofrontal cortex-anterior insular cortex circuit gates compulsive cocaine use. SCIENCE ADVANCES 2022; 8:eabq5745. [PMID: 36563158 PMCID: PMC9788779 DOI: 10.1126/sciadv.abq5745] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/17/2022] [Accepted: 11/23/2022] [Indexed: 06/01/2023]
Abstract
Compulsive drug use, a cardinal symptom of drug addiction, is characterized by persistent substance use despite adverse consequences. However, little is known about the neural circuit mechanisms behind this behavior. Using a footshock-punished cocaine self-administration procedure, we found individual variability of rats in the process of drug addiction, and rats with compulsive cocaine use presented increased neural activity of the anterior insular cortex (aIC) compared with noncompulsive rats. Chemogenetic manipulating activity of aIC neurons, especially aIC glutamatergic neurons, bidirectionally regulated compulsive cocaine intake. Furthermore, the aIC received inputs from the orbitofrontal cortex (OFC), and the OFC-aIC circuit was enhanced in rats with compulsive cocaine use. Suppression of the OFC-aIC circuit switched rats from punishment resistance to sensitivity, while potentiation of this circuit increased compulsive cocaine use. In conclusion, our results found that aIC glutamatergic neurons and the OFC-aIC circuit gated the shift from controlled to compulsive cocaine use, which could serve as potential therapeutic targets for drug addiction.
Collapse
Affiliation(s)
- Yang Chen
- National Institute on Drug Dependence and Beijing Key Laboratory of Drug Dependence, Peking University, Beijing 100191, China
- Department of Pharmacology, School of Basic Medical Sciences, Peking University Health Science Center, Beijing 100191, China
| | - Guibin Wang
- Institute of Materia Medica, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing 100050, China
| | - Wen Zhang
- National Institute on Drug Dependence and Beijing Key Laboratory of Drug Dependence, Peking University, Beijing 100191, China
| | - Ying Han
- National Institute on Drug Dependence and Beijing Key Laboratory of Drug Dependence, Peking University, Beijing 100191, China
| | - Libo Zhang
- National Institute on Drug Dependence and Beijing Key Laboratory of Drug Dependence, Peking University, Beijing 100191, China
- Peking University Shenzhen Hospital, Shenzhen 518036, China
| | - Hubo Xu
- National Institute on Drug Dependence and Beijing Key Laboratory of Drug Dependence, Peking University, Beijing 100191, China
| | - Shiqiu Meng
- National Institute on Drug Dependence and Beijing Key Laboratory of Drug Dependence, Peking University, Beijing 100191, China
| | - Lin Lu
- National Institute on Drug Dependence and Beijing Key Laboratory of Drug Dependence, Peking University, Beijing 100191, China
- Peking University Sixth Hospital, Peking University Institute of Mental Health, NHC Key Laboratory of Mental Health (Peking University), National Clinical Research Center for Mental Disorders (Peking University Sixth Hospital), Beijing 100191, China
| | - Yanxue Xue
- National Institute on Drug Dependence and Beijing Key Laboratory of Drug Dependence, Peking University, Beijing 100191, China
- The Key Laboratory for Neuroscience of the Ministry of Education and Health, Peking University, Beijing 100191, China
- Chinese Institute for Brain Research, Beijing 102206, China
| | - Jie Shi
- National Institute on Drug Dependence and Beijing Key Laboratory of Drug Dependence, Peking University, Beijing 100191, China
- Peking University Shenzhen Hospital, Shenzhen 518036, China
- The Key Laboratory for Neuroscience of the Ministry of Education and Health, Peking University, Beijing 100191, China
- Chinese Institute for Brain Research, Beijing 102206, China
- The State Key Laboratory of Natural and Biomimetic Drugs, Peking University, Beijing 100191, China
| |
Collapse
|
24
|
Zhang JL, Zhou N, Song KR, Zou BW, Xu LX, Fu Y, Geng XM, Wang ZL, Li X, Potenza MN, Nan Y, Zhang JT. Neural activations to loss anticipation mediates the association between difficulties in emotion regulation and screen media activities among early adolescent youth: A moderating role for depression. Dev Cogn Neurosci 2022; 58:101186. [PMID: 36516611 PMCID: PMC9764194 DOI: 10.1016/j.dcn.2022.101186] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2022] [Revised: 12/05/2022] [Accepted: 12/06/2022] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND Screen media activities (SMAs; e.g., watching videos, playing videogames) have become increasingly prevalent among youth as ways to alleviate or escape from negative emotional states. However, neural mechanisms underlying these processes in youth are incompletely understood. METHOD Seventy-nine youth aged 11-15 years completed a monetary incentive delay task during fMRI scanning. Neural correlates of reward/loss processing and their associations with SMAs were explored. Next, brain activations during reward/loss processing in regions implicated in the processing of emotions were examined as potential mediating factors between difficulties in emotion regulation (DER) and engagement in SMAs. Finally, a moderated mediation model tested the effects of depressive symptoms in such relationships. RESULT The emotional components associated with SMAs in reward/loss processing included activations in the left anterior insula (AI) and right dorsolateral prefrontal cortex (DLPFC) during anticipation of working to avoid losses. Activations in both the AI and DLPFC mediated the relationship between DER and SMAs. Moreover, depressive symptoms moderated the relationship between AI activation in response to loss anticipation and SMAs. CONCLUSION The current findings suggest that DER link to SMAs through loss-related brain activations implicated in the processing of emotions and motivational avoidance, particularly in youth with greater levels of depressive symptoms. The findings suggest the importance of enhancing emotion-regulation tendencies/abilities in youth and, in particular, their regulatory responses to negative emotional situations in order to guide moderate engagement in SMAs.
Collapse
Affiliation(s)
- Jia-Lin Zhang
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Nan Zhou
- Faculty of Education, University of Macau, Macau, China
| | - Kun-Ru Song
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Bo-Wen Zou
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Lin-Xuan Xu
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Yu Fu
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Xiao-Min Geng
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Zi-Liang Wang
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Xin Li
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Marc N Potenza
- Department of Psychiatry and Child Study Center, Yale University School of Medicine, New Haven, CT, USA; Connecticut Council on Problem Gambling, Wethersfield, CT, USA; Connecticut Mental Health Center, New Haven, CT, USA; Department of Neuroscience and Wu Tsai Institute, Yale University, New Haven, CT, USA
| | - Yun Nan
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China.
| | - Jin-Tao Zhang
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China.
| |
Collapse
|
25
|
Cecchi R, Vinckier F, Hammer J, Marusic P, Nica A, Rheims S, Trebuchon A, Barbeau EJ, Denuelle M, Maillard L, Minotti L, Kahane P, Pessiglione M, Bastin J. Intracerebral mechanisms explaining the impact of incidental feedback on mood state and risky choice. eLife 2022; 11:72440. [PMID: 35822700 PMCID: PMC9348847 DOI: 10.7554/elife.72440] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2021] [Accepted: 07/12/2022] [Indexed: 11/13/2022] Open
Abstract
Identifying factors whose fluctuations are associated with choice inconsistency is a major issue for rational decision theory. Here, we investigated the neuro-computational mechanisms through which mood fluctuations may bias human choice behavior. Intracerebral EEG data were collected in a large group of subjects (n=30) while they were performing interleaved quiz and choice tasks that were designed to examine how a series of unrelated feedbacks affect decisions between safe and risky options. Neural baseline activity preceding choice onset was confronted first to mood level, estimated by a computational model integrating the feedbacks received in the quiz task, and then to the weighting of option attributes, in a computational model predicting risk attitude in the choice task. Results showed that (1) elevated broadband gamma activity (BGA) in the ventromedial prefrontal cortex (vmPFC) and dorsal anterior insula (daIns) was respectively signaling periods of high and low mood, (2) increased vmPFC and daIns BGA respectively promoted and tempered risk taking by overweighting gain vs. loss prospects. Thus, incidental feedbacks induce brain states that correspond to different moods and bias the evaluation of risky options. More generally, these findings might explain why people experiencing positive (or negative) outcome in some part of their life tend to expect success (or failure) in any other.
Collapse
Affiliation(s)
| | | | - Jiri Hammer
- University Hospital in Motol, Prague, Czech Republic
| | - Petr Marusic
- University Hospital in Motol, Prague, Czech Republic
| | - Anca Nica
- Centre Hospitalier Universitaire de Rennes, Rennes, France
| | | | | | - Emmanuel J Barbeau
- Brain and Cognition Research Centre (CerCo), CNRS, University of Toulouse Paul Sabatier, Toulouse, France
| | - Marie Denuelle
- Centre Hospitalier Universitaire de Toulouse, Toulouse, France
| | | | - Lorella Minotti
- Centre Hospitalier Universitaire de Grenoble, Grenoble, France
| | - Philippe Kahane
- Centre Hospitalier Universitaire de Grenoble, Grenoble, France
| | | | | |
Collapse
|
26
|
Combrisson E, Allegra M, Basanisi R, Ince RAA, Giordano B, Bastin J, Brovelli A. Group-level inference of information-based measures for the analyses of cognitive brain networks from neurophysiological data. Neuroimage 2022; 258:119347. [PMID: 35660460 DOI: 10.1016/j.neuroimage.2022.119347] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2021] [Revised: 05/24/2022] [Accepted: 05/30/2022] [Indexed: 12/30/2022] Open
Abstract
The reproducibility crisis in neuroimaging and in particular in the case of underpowered studies has introduced doubts on our ability to reproduce, replicate and generalize findings. As a response, we have seen the emergence of suggested guidelines and principles for neuroscientists known as Good Scientific Practice for conducting more reliable research. Still, every study remains almost unique in its combination of analytical and statistical approaches. While it is understandable considering the diversity of designs and brain data recording, it also represents a striking point against reproducibility. Here, we propose a non-parametric permutation-based statistical framework, primarily designed for neurophysiological data, in order to perform group-level inferences on non-negative measures of information encompassing metrics from information-theory, machine-learning or measures of distances. The framework supports both fixed- and random-effect models to adapt to inter-individuals and inter-sessions variability. Using numerical simulations, we compared the accuracy in ground-truth retrieving of both group models, such as test- and cluster-wise corrections for multiple comparisons. We then reproduced and extended existing results using both spatially uniform MEG and non-uniform intracranial neurophysiological data. We showed how the framework can be used to extract stereotypical task- and behavior-related effects across the population covering scales from the local level of brain regions, inter-areal functional connectivity to measures summarizing network properties. We also present an open-source Python toolbox called Frites1 that includes the proposed statistical pipeline using information-theoretic metrics such as single-trial functional connectivity estimations for the extraction of cognitive brain networks. Taken together, we believe that this framework deserves careful attention as its robustness and flexibility could be the starting point toward the uniformization of statistical approaches.
Collapse
Affiliation(s)
- Etienne Combrisson
- Institut de Neurosciences de la Timone, Aix Marseille Université, UMR 7289 CNRS, 13005, Marseille, France.
| | - Michele Allegra
- Institut de Neurosciences de la Timone, Aix Marseille Université, UMR 7289 CNRS, 13005, Marseille, France; Dipartimento di Fisica e Astronomia "Galileo Galilei", Università di Padova, via Marzolo 8, 35131 Padova, Italy; Padua Neuroscience Center, Università di Padova, via Orus 2, 35131 Padova, Italy
| | - Ruggero Basanisi
- Institut de Neurosciences de la Timone, Aix Marseille Université, UMR 7289 CNRS, 13005, Marseille, France
| | - Robin A A Ince
- School of Psychology and Neuroscience, University of Glasgow, Glasgow, UK
| | - Bruno Giordano
- Institut de Neurosciences de la Timone, Aix Marseille Université, UMR 7289 CNRS, 13005, Marseille, France
| | - Julien Bastin
- Univ. Grenoble Alpes, Inserm, U1216, Grenoble Institut Neurosciences, 38000 Grenoble, France
| | - Andrea Brovelli
- Institut de Neurosciences de la Timone, Aix Marseille Université, UMR 7289 CNRS, 13005, Marseille, France.
| |
Collapse
|
27
|
Palminteri S, Lebreton M. The computational roots of positivity and confirmation biases in reinforcement learning. Trends Cogn Sci 2022; 26:607-621. [PMID: 35662490 DOI: 10.1016/j.tics.2022.04.005] [Citation(s) in RCA: 24] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2021] [Revised: 04/13/2022] [Accepted: 04/18/2022] [Indexed: 12/16/2022]
Abstract
Humans do not integrate new information objectively: outcomes carrying a positive affective value and evidence confirming one's own prior belief are overweighed. Until recently, theoretical and empirical accounts of the positivity and confirmation biases assumed them to be specific to 'high-level' belief updates. We present evidence against this account. Learning rates in reinforcement learning (RL) tasks, estimated across different contexts and species, generally present the same characteristic asymmetry, suggesting that belief and value updating processes share key computational principles and distortions. This bias generates over-optimistic expectations about the probability of making the right choices and, consequently, generates over-optimistic reward expectations. We discuss the normative and neurobiological roots of these RL biases and their position within the greater picture of behavioral decision-making theories.
Collapse
Affiliation(s)
- Stefano Palminteri
- Laboratoire de Neurosciences Cognitives et Computationnelles, Institut National de la Santé et Recherche Médicale, Paris, France; Département d'Études Cognitives, Ecole Normale Supérieure, Paris, France; Université de Recherche Paris Sciences et Lettres, Paris, France.
| | - Maël Lebreton
- Paris School of Economics, Paris, France; LabNIC, Department of Fundamental Neurosciences, University of Geneva, Geneva, Switzerland; Swiss Center for Affective Science, Geneva, Switzerland.
| |
Collapse
|
28
|
Horing B, Büchel C. The human insula processes both modality-independent and pain-selective learning signals. PLoS Biol 2022; 20:e3001540. [PMID: 35522696 PMCID: PMC9116652 DOI: 10.1371/journal.pbio.3001540] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2021] [Revised: 05/18/2022] [Accepted: 04/15/2022] [Indexed: 12/02/2022] Open
Abstract
Prediction errors (PEs) are generated when there are differences between an expected and an actual event or sensory input. The insula is a key brain region involved in pain processing, and studies have shown that the insula encodes the magnitude of an unexpected outcome (unsigned PEs). In addition to signaling this general magnitude information, PEs can give specific information on the direction of this deviation-i.e., whether an event is better or worse than expected. It is unclear whether the unsigned PE responses in the insula are selective for pain or reflective of a more general processing of aversive events irrespective of modality. It is also unknown whether the insula can process signed PEs at all. Understanding these specific mechanisms has implications for understanding how pain is processed in the brain in both health and in chronic pain conditions. In this study, 47 participants learned associations between 2 conditioned stimuli (CS) with 4 unconditioned stimuli (US; painful heat or loud sound, of one low and one high intensity each) while undergoing functional magnetic resonance imaging (fMRI) and skin conductance response (SCR) measurements. We demonstrate that activation in the anterior insula correlated with unsigned intensity PEs, irrespective of modality, indicating an unspecific aversive surprise signal. Conversely, signed intensity PE signals were modality specific, with signed PEs following pain but not sound located in the dorsal posterior insula, an area implicated in pain intensity processing. Previous studies have identified abnormal insula function and abnormal learning as potential causes of pain chronification. Our findings link these results and suggest that a misrepresentation of learning relevant PEs in the insular cortex may serve as an underlying factor in chronic pain.
Collapse
Affiliation(s)
- Björn Horing
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Christian Büchel
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| |
Collapse
|