1
|
Xiao J, Adkinson JA, Myers J, Allawala AB, Mathura RK, Pirtle V, Najera R, Provenza NR, Bartoli E, Watrous AJ, Oswalt D, Gadot R, Anand A, Shofty B, Mathew SJ, Goodman WK, Pouratian N, Pitkow X, Bijanki KR, Hayden B, Sheth SA. Beta activity in human anterior cingulate cortex mediates reward biases. Nat Commun 2024; 15:5528. [PMID: 39009561 PMCID: PMC11250824 DOI: 10.1038/s41467-024-49600-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Accepted: 06/07/2024] [Indexed: 07/17/2024] Open
Abstract
The rewards that we get from our choices and actions can have a major influence on our future behavior. Understanding how reward biasing of behavior is implemented in the brain is important for many reasons, including the fact that diminution in reward biasing is a hallmark of clinical depression. We hypothesized that reward biasing is mediated by the anterior cingulate cortex (ACC), a cortical hub region associated with the integration of reward and executive control and with the etiology of depression. To test this hypothesis, we recorded neural activity during a biased judgment task in patients undergoing intracranial monitoring for either epilepsy or major depressive disorder. We found that beta (12-30 Hz) oscillations in the ACC predicted both associated reward and the size of the choice bias, and also tracked reward receipt, thereby predicting bias on future trials. We found reduced magnitude of bias in depressed patients, in whom the beta-specific effects were correspondingly reduced. Our findings suggest that ACC beta oscillations may orchestrate the learning of reward information to guide adaptive choice, and, more broadly, suggest a potential biomarker for anhedonia and point to future development of interventions to enhance reward impact for therapeutic benefit.
Collapse
Affiliation(s)
- Jiayang Xiao
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, 77030, USA
- Department of Neuroscience, Baylor College of Medicine, Houston, TX, 77030, USA
| | - Joshua A Adkinson
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, 77030, USA
| | - John Myers
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, 77030, USA
| | | | - Raissa K Mathura
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, 77030, USA
| | - Victoria Pirtle
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, 77030, USA
| | - Ricardo Najera
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, 77030, USA
| | - Nicole R Provenza
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, 77030, USA
| | - Eleonora Bartoli
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, 77030, USA
| | - Andrew J Watrous
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, 77030, USA
| | - Denise Oswalt
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, 77030, USA
| | - Ron Gadot
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, 77030, USA
| | - Adrish Anand
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, 77030, USA
| | - Ben Shofty
- Department of Neurosurgery, University of Utah, Salt Lake City, UT, 84112, USA
| | - Sanjay J Mathew
- Department of Psychiatry and Behavioral Sciences, Baylor College of Medicine, Houston, TX, 77030, USA
| | - Wayne K Goodman
- Department of Psychiatry and Behavioral Sciences, Baylor College of Medicine, Houston, TX, 77030, USA
| | - Nader Pouratian
- Department of Neurological Surgery, UT Southwestern Medical Center, Dallas, TX, 75390, USA
| | - Xaq Pitkow
- Department of Neuroscience, Baylor College of Medicine, Houston, TX, 77030, USA
- Department of Electrical and Computer Engineering, Rice University, Houston, TX, 77005, USA
- Center for Neuroscience and Artificial Intelligence, Baylor College of Medicine, Houston, TX, 77030, USA
| | - Kelly R Bijanki
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, 77030, USA
| | - Benjamin Hayden
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, 77030, USA
| | - Sameer A Sheth
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, 77030, USA.
- Department of Neuroscience, Baylor College of Medicine, Houston, TX, 77030, USA.
- Department of Psychiatry and Behavioral Sciences, Baylor College of Medicine, Houston, TX, 77030, USA.
- Department of Electrical and Computer Engineering, Rice University, Houston, TX, 77005, USA.
| |
Collapse
|
2
|
Kim S, Sakaki M, Murayama K. Metacognition of curiosity: People underestimate the seductive lure of non-instrumental information. Psychon Bull Rev 2024; 31:1-12. [PMID: 37932580 PMCID: PMC11192831 DOI: 10.3758/s13423-023-02404-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/06/2023] [Indexed: 11/08/2023]
Abstract
Curiosity - the desire to seek information - is fundamental for learning and performance. Studies on curiosity have shown that people are intrinsically motivated to seek information even if it does not bring an immediate tangible benefit (i.e., non-instrumental information), but little is known as to whether people have the metacognitive capability to accurately monitor their motivation for seeking information. We examined whether people can accurately predict their own non-instrumental information-seeking behavior. Across six experiments (Experiments 1A-1E and 2, total N = 579), participants predicted that they would engage in information-seeking behavior less frequently than they actually did, suggesting that people tend to underestimate the motivational lure of curiosity. Overall, there was no consistent statistical evidence that this underestimation was altered by contextual factors (e.g., the cost to seek information). These results were consistent with the theoretical account that it is difficult for people to make sense of the internally rewarding value of information in advance.
Collapse
Affiliation(s)
- Sunae Kim
- Department of Psychology, Health, & Professional Development, Faculty of Health and Life Sciences, Oxford Brookes University, Gipsy Lane, Oxford, OX3 0BP, UK.
| | - Michiko Sakaki
- Hector Research Institute of Education Sciences and Psychology, University of Tübingen, Tübingen, Germany
- Research Institute, Kochi University of Technology, Kochi, Japan
- School of Psychology and Clinical Language Sciences, University of Reading, Reading, UK
| | - Kou Murayama
- Hector Research Institute of Education Sciences and Psychology, University of Tübingen, Tübingen, Germany
- Research Institute, Kochi University of Technology, Kochi, Japan
- School of Psychology and Clinical Language Sciences, University of Reading, Reading, UK
| |
Collapse
|
3
|
Jiang L, Wang G, Zhang S, Ye J, He R, Chen B, Si Y, Yao D, Yu J, Wan F, Xu P, Yu L, Li F. Feedback-related brain activity in individual decision: evidence from a gambling EEG study. Cereb Cortex 2024; 34:bhad430. [PMID: 37950878 DOI: 10.1093/cercor/bhad430] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2023] [Revised: 10/16/2023] [Accepted: 10/18/2023] [Indexed: 11/13/2023] Open
Abstract
In this study, based on scalp electroencephalogram (EEG), we conducted cortical source localization and functional network analyses to investigate the underlying mechanism explaining the decision processes when individuals anticipate maximizing gambling benefits, particularly in situations where the decision outcomes are inconsistent with the profit goals. The findings shed light on the feedback monitoring process, wherein incongruity between outcomes and gambling goals triggers a more pronounced medial frontal negativity and activates the frontal lobe. Moreover, long-range theta connectivity is implicated in processing surprise and uncertainty caused by inconsistent feedback conditions, while middle-range delta coupling reflects a more intricate evaluation of feedback outcomes, which subsequently modifies individual decision-making for optimizing future rewards. Collectively, these findings deepen our comprehension of decision-making under circumstances where the profit goals are compromised by decision outcomes and provide electrophysiological evidence supporting adaptive adjustments in individual decision strategies to achieve maximum benefit.
Collapse
Affiliation(s)
- Lin Jiang
- MOE Key Lab for Neuroinformation, The Clinical Hospital of Chengdu Brain Science Institute, University of Electronic Science and Technology of China, Chengdu 610054, China
- School of Life Science and Technology, Center for Information in BioMedicine, University of Electronic Science and Technology of China, Chengdu 611731, China
| | - Guangying Wang
- MOE Key Lab for Neuroinformation, The Clinical Hospital of Chengdu Brain Science Institute, University of Electronic Science and Technology of China, Chengdu 610054, China
- School of Life Science and Technology, Center for Information in BioMedicine, University of Electronic Science and Technology of China, Chengdu 611731, China
| | - Silai Zhang
- MOE Key Lab for Neuroinformation, The Clinical Hospital of Chengdu Brain Science Institute, University of Electronic Science and Technology of China, Chengdu 610054, China
- School of Life Science and Technology, Center for Information in BioMedicine, University of Electronic Science and Technology of China, Chengdu 611731, China
| | - Jiayu Ye
- MOE Key Lab for Neuroinformation, The Clinical Hospital of Chengdu Brain Science Institute, University of Electronic Science and Technology of China, Chengdu 610054, China
- School of Life Science and Technology, Center for Information in BioMedicine, University of Electronic Science and Technology of China, Chengdu 611731, China
| | - Runyang He
- MOE Key Lab for Neuroinformation, The Clinical Hospital of Chengdu Brain Science Institute, University of Electronic Science and Technology of China, Chengdu 610054, China
- School of Life Science and Technology, Center for Information in BioMedicine, University of Electronic Science and Technology of China, Chengdu 611731, China
| | - Baodan Chen
- MOE Key Lab for Neuroinformation, The Clinical Hospital of Chengdu Brain Science Institute, University of Electronic Science and Technology of China, Chengdu 610054, China
- School of Life Science and Technology, Center for Information in BioMedicine, University of Electronic Science and Technology of China, Chengdu 611731, China
| | - Yajing Si
- School of Psychology, Xinxiang Medical University, Xinxiang 453003, China
| | - Dezhong Yao
- MOE Key Lab for Neuroinformation, The Clinical Hospital of Chengdu Brain Science Institute, University of Electronic Science and Technology of China, Chengdu 610054, China
- School of Life Science and Technology, Center for Information in BioMedicine, University of Electronic Science and Technology of China, Chengdu 611731, China
- Research Unit of NeuroInformation, Chinese Academy of Medical Sciences, Chengdu 2019RU035, China
- School of Electrical Engineering, Zhengzhou University, Zhengzhou 450001, China
| | - Jing Yu
- Faculty of Psychology, Southwest University, Chongqing 400715, China
| | - Feng Wan
- Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Macau 999078, China
| | - Peng Xu
- MOE Key Lab for Neuroinformation, The Clinical Hospital of Chengdu Brain Science Institute, University of Electronic Science and Technology of China, Chengdu 610054, China
- School of Life Science and Technology, Center for Information in BioMedicine, University of Electronic Science and Technology of China, Chengdu 611731, China
- Research Unit of NeuroInformation, Chinese Academy of Medical Sciences, Chengdu 2019RU035, China
- Radiation Oncology Key Laboratory of Sichuan Province, Chengdu 610042, China
- Rehabilitation Center, Qilu Hospital of Shandong University, Jinan 250012, China
| | - Liang Yu
- Department of Neurology, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu 610072, China
- Chinese Academy of Sciences, Sichuan Translational Medicine Research Hospital, Chengdu 610072, China
| | - Fali Li
- MOE Key Lab for Neuroinformation, The Clinical Hospital of Chengdu Brain Science Institute, University of Electronic Science and Technology of China, Chengdu 610054, China
- School of Life Science and Technology, Center for Information in BioMedicine, University of Electronic Science and Technology of China, Chengdu 611731, China
- Research Unit of NeuroInformation, Chinese Academy of Medical Sciences, Chengdu 2019RU035, China
- Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Macau 999078, China
| |
Collapse
|
4
|
Proskurin M, Manakov M, Karpova A. ACC neural ensemble dynamics are structured by strategy prevalence. eLife 2023; 12:e84897. [PMID: 37991007 DOI: 10.7554/elife.84897] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2022] [Accepted: 11/20/2023] [Indexed: 11/23/2023] Open
Abstract
Medial frontal cortical areas are thought to play a critical role in the brain's ability to flexibly deploy strategies that are effective in complex settings, yet the underlying circuit computations remain unclear. Here, by examining neural ensemble activity in male rats that sample different strategies in a self-guided search for latent task structure, we observe robust tracking during strategy execution of a summary statistic for that strategy in recent behavioral history by the anterior cingulate cortex (ACC), especially by an area homologous to primate area 32D. Using the simplest summary statistic - strategy prevalence in the last 20 choices - we find that its encoding in the ACC during strategy execution is wide-scale, independent of reward delivery, and persists through a substantial ensemble reorganization that accompanies changes in global context. We further demonstrate that the tracking of reward by the ACC ensemble is also strategy-specific, but that reward prevalence is insufficient to explain the observed activity modulation during strategy execution. Our findings argue that ACC ensemble dynamics is structured by a summary statistic of recent behavioral choices, raising the possibility that ACC plays a role in estimating - through statistical learning - which actions promote the occurrence of events in the environment.
Collapse
Affiliation(s)
- Mikhail Proskurin
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
- Department of Neuroscience, Johns Hopkins University Medical School, Baltimore, United States
| | - Maxim Manakov
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
- Department of Neuroscience, Johns Hopkins University Medical School, Baltimore, United States
| | - Alla Karpova
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| |
Collapse
|
5
|
Wang X, Zhang Y, Huang J, Wang Y, Niu Y, Lui SSY, Hui L, Chan RCK. Revisiting reward impairments in schizophrenia spectrum disorders: a systematic review and meta-analysis for neuroimaging findings. Psychol Med 2023; 53:7189-7202. [PMID: 36994747 DOI: 10.1017/s0033291723000703] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/31/2023]
Abstract
BACKGROUND Abnormal reward functioning is central to anhedonia and amotivation symptoms of schizophrenia (SCZ). Reward processing encompasses a series of psychological components. This systematic review and meta-analysis examined the brain dysfunction related to reward processing of individuals with SCZ spectrum disorders and risks, covering multiple reward components. METHODS After a systematic literature search, 37 neuroimaging studies were identified and divided into four groups based on their target psychology components (i.e. reward anticipation, reward consumption, reward learning, effort computation). Whole-brain Seed-based d Mapping (SDM) meta-analyses were conducted for all included studies and each component. RESULTS The meta-analysis for all reward-related studies revealed reduced functional activation across the SCZ spectrum in the striatum, orbital frontal cortex, cingulate cortex, and cerebellar areas. Meanwhile, distinct abnormal patterns were found for reward anticipation (decreased activation of the cingulate cortex and striatum), reward consumption (decreased activation of cerebellum IV/V areas, insula and inferior frontal gyri), and reward learning processing (decreased activation of the striatum, thalamus, cerebellar Crus I, cingulate cortex, orbitofrontal cortex, and parietal and occipital areas). Lastly, our qualitative review suggested that decreased activation of the ventral striatum and anterior cingulate cortex was also involved in effort computation. CONCLUSIONS These results provide deep insights on the component-based neuro-psychopathological mechanisms for anhedonia and amotivation symptoms of the SCZ spectrum.
Collapse
Affiliation(s)
- Xuan Wang
- Neuropsychology and Applied Cognitive Neuroscience Laboratory, CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Yinghao Zhang
- Division of Psychology and Language Sciences, University College London, London, UK
| | - Jia Huang
- Neuropsychology and Applied Cognitive Neuroscience Laboratory, CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Yi Wang
- Neuropsychology and Applied Cognitive Neuroscience Laboratory, CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Yanzhe Niu
- Department of Psychology, University of California, San Diego, La Jolla, USA
| | - Simon S Y Lui
- Department of Psychiatry, School of Clinical Medicine, The University of Hong Kong, Hong Kong Special Administrative Region, China
| | - Li Hui
- Research Center of Biological Psychiatry, Suzhou Guangji Hospital, Medical College of Soochow University, Suzhou, Jiangsu, China
| | - Raymond C K Chan
- Neuropsychology and Applied Cognitive Neuroscience Laboratory, CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
6
|
Ben-Artzi I, Kessler Y, Nicenboim B, Shahar N. Computational mechanisms underlying latent value updating of unchosen actions. SCIENCE ADVANCES 2023; 9:eadi2704. [PMID: 37862419 PMCID: PMC10588947 DOI: 10.1126/sciadv.adi2704] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/16/2023] [Accepted: 09/20/2023] [Indexed: 10/22/2023]
Abstract
Current studies suggest that individuals estimate the value of their choices based on observed feedback. Here, we ask whether individuals also update the value of their unchosen actions, even when the associated feedback remains unknown. One hundred seventy-eight individuals completed a multi-armed bandit task, making choices to gain rewards. We found robust evidence suggesting latent value updating of unchosen actions based on the chosen action's outcome. Computational modeling results suggested that this effect is mainly explained by a value updating mechanism whereby individuals integrate the outcome history for choosing an option with that of rejecting the alternative. Properties of the deliberation (i.e., duration/difficulty) did not moderate the latent value updating of unchosen actions, suggesting that memory traces generated during deliberation might take a smaller role in this specific phenomenon than previously thought. We discuss the mechanisms facilitating credit assignment to unchosen actions and their implications for human decision-making.
Collapse
Affiliation(s)
- Ido Ben-Artzi
- School of Psychological Sciences, Tel Aviv University, Tel Aviv, Israel
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel
- Minducate Science of Learning Research and Innovation Center of the Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel
| | - Yoav Kessler
- Department of Psychology and School of Brain Sciences and Cognition, Ben Gurion University of the Negev, Be'er Sheva, Israel
| | - Bruno Nicenboim
- Department of Cognitive Science and Artificial Intelligence, Tilburg University, Tilburg, Netherlands
| | - Nitzan Shahar
- School of Psychological Sciences, Tel Aviv University, Tel Aviv, Israel
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel
| |
Collapse
|
7
|
Yun M, Nejime M, Kawai T, Kunimatsu J, Yamada H, Kim HR, Matsumoto M. Distinct roles of the orbitofrontal cortex, ventral striatum, and dopamine neurons in counterfactual thinking of decision outcomes. SCIENCE ADVANCES 2023; 9:eadh2831. [PMID: 37556536 PMCID: PMC10411892 DOI: 10.1126/sciadv.adh2831] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/22/2023] [Accepted: 07/07/2023] [Indexed: 08/11/2023]
Abstract
Individuals often assess past decisions by comparing what was gained with what would have been gained had they acted differently. Thoughts of past alternatives that counter what actually happened are called "counterfactuals." Recent theories emphasize the role of the prefrontal cortex in processing counterfactual outcomes in decision-making, although how subcortical regions contribute to this process remains to be elucidated. Here we report a clear distinction among the roles of the orbitofrontal cortex, ventral striatum and midbrain dopamine neurons in processing counterfactual outcomes in monkeys. Our findings suggest that actually gained and counterfactual outcome signals are both processed in the cortico-subcortical network constituted by these regions but in distinct manners and integrated only in the orbitofrontal cortex in a way to compare these outcomes. This study extends the prefrontal theory of counterfactual thinking and provides key insights regarding how the prefrontal cortex cooperates with subcortical regions to make decisions using counterfactual information.
Collapse
Affiliation(s)
- Mengxi Yun
- Division of Biomedical Science, Institute of Medicine, University of Tsukuba, Tsukuba, Ibaraki 305-8575, Japan
- Graduate School of Comprehensive Human Science, University of Tsukuba, Tsukuba, Ibaraki 305-8575, Japan
- Department of Molecular and Cellular Biology, Center for Brain Science, Harvard University, Cambridge, MA, USA
- Transborder Medical Research Center, University of Tsukuba, Tsukuba, Ibaraki 305-8577, Japan
| | - Masafumi Nejime
- Division of Biomedical Science, Institute of Medicine, University of Tsukuba, Tsukuba, Ibaraki 305-8575, Japan
| | - Takashi Kawai
- Division of Biomedical Science, Institute of Medicine, University of Tsukuba, Tsukuba, Ibaraki 305-8575, Japan
| | - Jun Kunimatsu
- Division of Biomedical Science, Institute of Medicine, University of Tsukuba, Tsukuba, Ibaraki 305-8575, Japan
- Transborder Medical Research Center, University of Tsukuba, Tsukuba, Ibaraki 305-8577, Japan
| | - Hiroshi Yamada
- Division of Biomedical Science, Institute of Medicine, University of Tsukuba, Tsukuba, Ibaraki 305-8575, Japan
- Transborder Medical Research Center, University of Tsukuba, Tsukuba, Ibaraki 305-8577, Japan
| | - HyungGoo R. Kim
- Department of Molecular and Cellular Biology, Center for Brain Science, Harvard University, Cambridge, MA, USA
- Department of Biomedical Engineering, Sungkyunkwan University, Suwon 16419, Republic of Korea
- Center for Neuroscience Imaging Research, Institute for Basic Science, Suwon 16419, Republic of Korea
| | - Masayuki Matsumoto
- Division of Biomedical Science, Institute of Medicine, University of Tsukuba, Tsukuba, Ibaraki 305-8575, Japan
- Transborder Medical Research Center, University of Tsukuba, Tsukuba, Ibaraki 305-8577, Japan
| |
Collapse
|
8
|
Li X, Guo J, Chen X, Yu R, Chen W, Zheng A, Yu Y, Zhou D, Dai L, Kuang L. Predicting Responses to Electroconvulsive Therapy in Adolescents with Treatment-Refractory Depression Based on Resting-State fMRI. J Clin Med 2023; 12:jcm12103556. [PMID: 37240663 DOI: 10.3390/jcm12103556] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2022] [Revised: 03/09/2023] [Accepted: 03/22/2023] [Indexed: 05/28/2023] Open
Abstract
OBJECTS The efficacy of electroconvulsive therapy (ECT) in the treatment of adolescents with treatment-refractory depression is still unsatisfactory, and the individual differences are large. It is not clear which factors are related to the treatment effect. Resting-state fMRI may be a good tool to predict the clinical efficacy of this treatment, and it is helpful to identify the most suitable population for this treatment. METHODS Forty treatment-refractory depression adolescents were treated by ECT and evaluated using HAMD and BSSI scores before and after treatment, and were then divided into a treatment response group and a non-treatment group according to the reduction rate of the HAMD scale. We extracted the ALFF, fALFF, ReHo, and functional connectivity of patients as predicted features after a two-sample t-test and LASSO to establish and evaluate a prediction model of ECT in adolescents with treatment-refractory depression. RESULTS Twenty-seven patients achieved a clinical response; symptoms of depression and suicidal ideation were significantly improved after treatment with ECT, which was reflected in a significant decrease in the scores of HAMD and BSSI (p < 0.001). The efficacy was predicted by ALFF, fALFF, ReHo, and whole-brain-based functional connectivity. We found that models built on a subset of features of ALFF in the left insula, fALFF in the left superior parietal gyrus, right superior parietal gyrus, and right angular, and functional connectivity between the left superior frontal gyrus, dorsolateral-right paracentral lobule, right middle frontal gyrus, orbital part-left cuneus, right olfactory cortex-left hippocampus, left insula-left thalamus, and left anterior cingulate gyrus-right hippocampus to have the best predictive performance (AUC > 0.8). CONCLUSIONS The local brain function in the insula, superior parietal gyrus, and angular gyrus as well as characteristic changes in the functional connectivity of cortical-limbic circuits may serve as potential markers for efficacy judgment of ECT and help to provide optimized individual treatment strategies for adolescents with depression and suicidal ideation in the early stages of treatment.
Collapse
Affiliation(s)
- Xiao Li
- Department of Psychiatry, The First Affiliated Hospital of Chongqing Medical University, Chongqing 400016, China
| | - Jiamei Guo
- Department of Psychiatry, The First Affiliated Hospital of Chongqing Medical University, Chongqing 400016, China
| | - Xiaolu Chen
- The First Branch, The First Affiliated Hospital of Chongqing Medical University, Chongqing 400015, China
| | - Renqiang Yu
- Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing 400016, China
| | - Wanjun Chen
- Department of Psychiatry, The First Affiliated Hospital of Chongqing Medical University, Chongqing 400016, China
| | - Anhai Zheng
- Department of Psychiatry, The First Affiliated Hospital of Chongqing Medical University, Chongqing 400016, China
| | - Yanjie Yu
- Department of Psychiatry, The First Affiliated Hospital of Chongqing Medical University, Chongqing 400016, China
| | - Dongdong Zhou
- Mental Health Center, University-Town Hospital of Chongqing Medical University, Chongqing 401331, China
| | - Linqi Dai
- Department of Psychiatry, The First Affiliated Hospital of Chongqing Medical University, Chongqing 400016, China
| | - Li Kuang
- Department of Psychiatry, The First Affiliated Hospital of Chongqing Medical University, Chongqing 400016, China
| |
Collapse
|
9
|
Smoulder AL, Marino PJ, Oby ER, Snyder SE, Miyata H, Pavlovsky NP, Bishop WE, Yu BM, Chase SM, Batista AP. A neural basis of choking under pressure. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.04.16.537007. [PMID: 37090659 PMCID: PMC10120738 DOI: 10.1101/2023.04.16.537007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/25/2023]
Abstract
Incentives tend to drive improvements in performance. But when incentives get too high, we can "choke under pressure" and underperform when it matters most. What neural processes might lead to choking under pressure? We studied Rhesus monkeys performing a challenging reaching task in which they underperform when an unusually large "jackpot" reward is at stake. We observed a collapse in neural information about upcoming movements for jackpot rewards: in the motor cortex, neural planning signals became less distinguishable for different reach directions when a jackpot reward was made available. We conclude that neural signals of reward and motor planning interact in the motor cortex in a manner that can explain why we choke under pressure. One-Sentence Summary In response to exceptionally large reward cues, animals can "choke under pressure", and this corresponds to a collapse in the neural information about upcoming movements.
Collapse
|
10
|
Jahn CI, Grohn J, Cuell S, Emberton A, Bouret S, Walton ME, Kolling N, Sallet J. Neural responses in macaque prefrontal cortex are linked to strategic exploration. PLoS Biol 2023; 21:e3001985. [PMID: 36716348 PMCID: PMC9910800 DOI: 10.1371/journal.pbio.3001985] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2022] [Revised: 02/09/2023] [Accepted: 01/03/2023] [Indexed: 02/01/2023] Open
Abstract
Humans have been shown to strategically explore. They can identify situations in which gathering information about distant and uncertain options is beneficial for the future. Because primates rely on scarce resources when they forage, they are also thought to strategically explore, but whether they use the same strategies as humans and the neural bases of strategic exploration in monkeys are largely unknown. We designed a sequential choice task to investigate whether monkeys mobilize strategic exploration based on whether information can improve subsequent choice, but also to ask the novel question about whether monkeys adjust their exploratory choices based on the contingency between choice and information, by sometimes providing the counterfactual feedback about the unchosen option. We show that monkeys decreased their reliance on expected value when exploration could be beneficial, but this was not mediated by changes in the effect of uncertainty on choices. We found strategic exploratory signals in anterior and mid-cingulate cortex (ACC/MCC) and dorsolateral prefrontal cortex (dlPFC). This network was most active when a low value option was chosen, which suggests a role in counteracting expected value signals, when exploration away from value should to be considered. Such strategic exploration was abolished when the counterfactual feedback was available. Learning from counterfactual outcome was associated with the recruitment of a different circuit centered on the medial orbitofrontal cortex (OFC), where we showed that monkeys represent chosen and unchosen reward prediction errors. Overall, our study shows how ACC/MCC-dlPFC and OFC circuits together could support exploitation of available information to the fullest and drive behavior towards finding more information through exploration when it is beneficial.
Collapse
Affiliation(s)
- Caroline I. Jahn
- Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
- Motivation, Brain and Behavior Team, Institut du Cerveau et de la Moelle Epinière, Paris, France
- Sorbonne Paris Cité universités, Université Paris Descartes, Frontières du Vivant, Paris, France
- * E-mail: (CIJ); (JG); (NK); (JS)
| | - Jan Grohn
- Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
- * E-mail: (CIJ); (JG); (NK); (JS)
| | - Steven Cuell
- Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
| | - Andrew Emberton
- Biomedical Science Services, University of Oxford, Oxford, United Kingdom
| | - Sebastien Bouret
- Motivation, Brain and Behavior Team, Institut du Cerveau et de la Moelle Epinière, Paris, France
| | - Mark E. Walton
- Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
| | - Nils Kolling
- Wellcome Centre for Integrative Neuroimaging, OBHA, University of Oxford, Headington, United Kingdom
- Univ Lyon, Université Lyon 1, Inserm, Stem Cell and Brain Research Institute U1208, Bron, France
- * E-mail: (CIJ); (JG); (NK); (JS)
| | - Jérôme Sallet
- Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
- Univ Lyon, Université Lyon 1, Inserm, Stem Cell and Brain Research Institute U1208, Bron, France
- * E-mail: (CIJ); (JG); (NK); (JS)
| |
Collapse
|
11
|
Fitzgibbon L, Murayama K. Counterfactual curiosity: motivated thinking about what might have been. Philos Trans R Soc Lond B Biol Sci 2022; 377:20210340. [PMID: 36314158 PMCID: PMC9620751 DOI: 10.1098/rstb.2021.0340] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022] Open
Abstract
Counterfactual information, information about what might have been, forms the content of counterfactual thoughts and emotions like regret and relief. Recent research suggests that human adults and children, as well as rhesus monkeys, demonstrate ‘counterfactual curiosity’: they are motivated to seek out counterfactual information after making decisions. Based on contemporary theories of curiosity and information seeking and a broad range of empirical literature, we suggest multiple heterogeneous psychological processes that contribute to people's motivation for counterfactual information. This includes processes that are identified in the curiosity literature more generally—the potential use of counterfactual information for adaptive decision making (its long-term instrumental value) and the drive to reduce uncertainty. Additionally, we suggest that counterfactual information may be particularly alluring because of its role in causal reasoning; its relationship with prediction and decision making; and its potential to fulfil emotion regulation and self-serving goals. Some future directions have been suggested, including investigating the role of individual differences in counterfactual curiosity on learning and wellbeing. This article is part of the theme issue ‘Thinking about possibilities: mechanisms, ontogeny, functions and phylogeny’.
Collapse
Affiliation(s)
- Lily Fitzgibbon
- Division of Psychology, University of Stirling, Stirling, UK
| | - Kou Murayama
- Hector Research Institute of Education Sciences and Psychology, University of Tübingen, Tübingen, Germany
- School of Psychology and Clinical Language Sciences, University of Reading, Reading, UK
- Research Institute, Kochi University of Technology, Kochi, Japan
| |
Collapse
|
12
|
Durand-de Cuttoli R, Martínez-Rivera FJ, Li L, Minier-Toribio A, Holt LM, Cathomas F, Yasmin F, Elhassa SO, Shaikh JF, Ahmed S, Russo SJ, Nestler EJ, Sweis BM. Distinct forms of regret linked to resilience versus susceptibility to stress are regulated by region-specific CREB function in mice. SCIENCE ADVANCES 2022; 8:eadd5579. [PMID: 36260683 PMCID: PMC9581472 DOI: 10.1126/sciadv.add5579] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/10/2022] [Revised: 06/23/2022] [Accepted: 08/30/2022] [Indexed: 05/31/2023]
Abstract
Regret describes recognizing alternative actions could have led to better outcomes. It remains unclear whether regret derives from generalized mistake appraisal or instead comprises dissociable, action-specific processes. Using a neuroeconomic task, we found that mice were sensitive to fundamentally distinct types of regret following exposure to chronic social defeat stress or manipulations of CREB, a transcription factor implicated in stress action. Bias to make compensatory decisions after rejecting high-value offers (regret type I) was unique to stress-susceptible mice. Bias following the converse operation, accepting low-value offers (regret type II), was enhanced in stress-resilient mice and absent in stress-susceptible mice. CREB function in either the prefrontal cortex or nucleus accumbens was required to suppress regret type I but bidirectionally regulated regret type II. We provide insight into how maladaptive stress response traits relate to distinct forms of counterfactual thinking, which could steer therapy for mood disorders, such as depression, toward circuit-specific computations through a careful description of decision narrative.
Collapse
Affiliation(s)
- Romain Durand-de Cuttoli
- Nash Family Department of Neuroscience, Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
| | - Freddyson J. Martínez-Rivera
- Nash Family Department of Neuroscience, Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
| | - Long Li
- Nash Family Department of Neuroscience, Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
| | - Angélica Minier-Toribio
- Nash Family Department of Neuroscience, Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
| | - Leanne M. Holt
- Nash Family Department of Neuroscience, Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
| | - Flurin Cathomas
- Nash Family Department of Neuroscience, Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
| | - Farzana Yasmin
- Nash Family Department of Neuroscience, Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
| | - Salma O. Elhassa
- Nash Family Department of Neuroscience, Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
| | - Jasmine F. Shaikh
- Nash Family Department of Neuroscience, Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
| | - Sanjana Ahmed
- Nash Family Department of Neuroscience, Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
| | - Scott J. Russo
- Nash Family Department of Neuroscience, Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
| | - Eric J. Nestler
- Nash Family Department of Neuroscience, Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
- Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
| | - Brian M. Sweis
- Nash Family Department of Neuroscience, Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
- Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
| |
Collapse
|
13
|
Banaie Boroujeni K, Sigona MK, Treuting RL, Manuel TJ, Caskey CF, Womelsdorf T. Anterior cingulate cortex causally supports flexible learning under motivationally challenging and cognitively demanding conditions. PLoS Biol 2022; 20:e3001785. [PMID: 36067198 PMCID: PMC9481162 DOI: 10.1371/journal.pbio.3001785] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2022] [Revised: 09/16/2022] [Accepted: 08/09/2022] [Indexed: 12/02/2022] Open
Abstract
Anterior cingulate cortex (ACC) and striatum (STR) contain neurons encoding not only the expected values of actions, but also the value of stimulus features irrespective of actions. Values about stimulus features in ACC or STR might contribute to adaptive behavior by guiding fixational information sampling and biasing choices toward relevant objects, but they might also have indirect motivational functions by enabling subjects to estimate the value of putting effort into choosing objects. Here, we tested these possibilities by modulating neuronal activity in ACC and STR of nonhuman primates using transcranial ultrasound stimulation while subjects learned the relevance of objects in situations with varying motivational and cognitive demands. Motivational demand was indexed by varying gains and losses during learning, while cognitive demand was varied by increasing the uncertainty about which object features could be relevant during learning. We found that ultrasound stimulation of the ACC, but not the STR, reduced learning efficiency and prolonged information sampling when the task required averting losses and motivational demands were high. Reduced learning efficiency was particularly evident at higher cognitive demands and when subjects experienced loss of already attained tokens. These results suggest that the ACC supports flexible learning of feature values when loss experiences impose a motivational challenge and when uncertainty about the relevance of objects is high. Taken together, these findings provide causal evidence that the ACC facilitates resource allocation and improves visual information sampling during adaptive behavior.
Collapse
Affiliation(s)
- Kianoush Banaie Boroujeni
- Department of Psychology, Vanderbilt University, Nashville, Tennessee, United States of America
- * E-mail: (KBB); (TW)
| | - Michelle K. Sigona
- Vanderbilt University Institute of Imaging Science, Nashville, Tennessee, United States of America
- Department of Biomedical Engineering, Vanderbilt University, Nashville, Tennessee, United States of America
| | - Robert Louie Treuting
- Department of Biomedical Engineering, Vanderbilt University, Nashville, Tennessee, United States of America
| | - Thomas J. Manuel
- Vanderbilt University Institute of Imaging Science, Nashville, Tennessee, United States of America
- Department of Biomedical Engineering, Vanderbilt University, Nashville, Tennessee, United States of America
| | - Charles F. Caskey
- Vanderbilt University Institute of Imaging Science, Nashville, Tennessee, United States of America
- Department of Biomedical Engineering, Vanderbilt University, Nashville, Tennessee, United States of America
- Vanderbilt University Medical Center Department of Radiology and Radiological Sciences, Nashville, Tennessee, United States of America
| | - Thilo Womelsdorf
- Department of Psychology, Vanderbilt University, Nashville, Tennessee, United States of America
- Department of Biomedical Engineering, Vanderbilt University, Nashville, Tennessee, United States of America
- * E-mail: (KBB); (TW)
| |
Collapse
|
14
|
Matisz C, Gruber A. Neuroinflammatory remodeling of the anterior cingulate cortex as a key driver of mood disorders in gastrointestinal disease and disorders. Neurosci Biobehav Rev 2022; 133:104497. [DOI: 10.1016/j.neubiorev.2021.12.020] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2020] [Revised: 11/10/2021] [Accepted: 12/09/2021] [Indexed: 02/08/2023]
|
15
|
Rudebeck PH, Izquierdo A. Foraging with the frontal cortex: A cross-species evaluation of reward-guided behavior. Neuropsychopharmacology 2022; 47:134-146. [PMID: 34408279 PMCID: PMC8617092 DOI: 10.1038/s41386-021-01140-0] [Citation(s) in RCA: 24] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/05/2021] [Revised: 07/30/2021] [Accepted: 07/30/2021] [Indexed: 02/07/2023]
Abstract
Efficient foraging is essential to survival and depends on frontal cortex in mammals. Because of its role in psychiatric disorders, frontal cortex and its contributions to reward procurement have been studied extensively in both rodents and non-human primates. How frontal cortex of these animal models compares is a source of intense debate. Here we argue that translating findings from rodents to non-human primates requires an appreciation of both the niche in which each animal forages as well as the similarities in frontal cortex anatomy and function. Consequently, we highlight similarities and differences in behavior and anatomy, before focusing on points of convergence in how parts of frontal cortex contribute to distinct aspects of foraging in rats and macaques, more specifically. In doing so, our aim is to emphasize where translation of frontal cortex function between species is clearer, where there is divergence, and where future work should focus. We finish by highlighting aspects of foraging for which have received less attention but we believe are critical to uncovering how frontal cortex promotes survival in each species.
Collapse
Affiliation(s)
| | - Alicia Izquierdo
- Department of Psychology, UCLA, Los Angeles, CA, USA.
- The Brain Research Institute, UCLA, Los Angeles, CA, USA.
- Integrative Center for Learning and Memory, UCLA, Los Angeles, CA, USA.
- Integrative Center for Addictions, UCLA, Los Angeles, CA, USA.
| |
Collapse
|
16
|
Kaanders P, Nili H, O'Reilly JX, Hunt L. Medial Frontal Cortex Activity Predicts Information Sampling in Economic Choice. J Neurosci 2021; 41:8403-8413. [PMID: 34413207 PMCID: PMC8496191 DOI: 10.1523/jneurosci.0392-21.2021] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2021] [Revised: 06/17/2021] [Accepted: 08/07/2021] [Indexed: 01/05/2023] Open
Abstract
Decision-making not only requires agents to decide what to choose but also how much information to sample before committing to a choice. Previously established frameworks for economic choice argue for a deliberative process of evidence accumulation across time. These tacitly acknowledge a role of information sampling in that decisions are only made once sufficient evidence is acquired, yet few experiments have explicitly placed information sampling under the participant's control. Here, we use fMRI to investigate the neural basis of information sampling in economic choice by allowing participants (n = 30, sex not recorded) to actively sample information in a multistep decision task. We show that medial frontal cortex (MFC) activity is predictive of further information sampling before choice. Choice difficulty (inverse value difference, keeping sensory difficulty constant) was also encoded in MFC, but this effect was explained away by the inclusion of information sampling as a coregressor in the general linear model. A distributed network of regions across the prefrontal cortex encoded key features of the sampled information at the time it was presented. We propose that MFC is an important controller of the extent to which information is gathered before committing to an economic choice. This role may explain why MFC activity has been associated with evidence accumulation in previous studies in which information sampling was an implicit rather than explicit feature of the decision.SIGNIFICANCE STATEMENT The decisions we make are determined by the information we have sampled before committing to a choice. Accumulator frameworks of decision-making tacitly acknowledge the need to sample further information during the evidence accumulation process until a decision boundary is reached. However, relatively few studies explicitly place this decision to sample further information under the participant's control. In this fMRI study, we find that MFC activity is related to information sampling decisions in a multistep economic choice task. This suggests that an important role of evidence representations within MFC may be to guide adaptive sequential decisions to sample further information before committing to a final decision.
Collapse
Affiliation(s)
- Paula Kaanders
- Wellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford OX3 9DU, England
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, England
| | - Hamed Nili
- Wellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford OX3 9DU, England
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX3 9DU, England
| | - Jill X O'Reilly
- Wellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford OX3 9DU, England
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, England
| | - Laurence Hunt
- Wellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford OX3 9DU, England
- Department of Psychiatry, University of Oxford, Oxford OX3 7JX, England
| |
Collapse
|
17
|
Maisson DJN, Cash-Padgett TV, Wang MZ, Hayden BY, Heilbronner SR, Zimmermann J. Choice-relevant information transformation along a ventrodorsal axis in the medial prefrontal cortex. Nat Commun 2021; 12:4830. [PMID: 34376663 PMCID: PMC8355277 DOI: 10.1038/s41467-021-25219-w] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2020] [Accepted: 07/27/2021] [Indexed: 11/17/2022] Open
Abstract
Choice-relevant brain regions in prefrontal cortex may progressively transform information about options into choices. Here, we examine responses of neurons in four regions of the medial prefrontal cortex as macaques performed two-option risky choices. All four regions encode economic variables in similar proportions and show similar putative signatures of key choice-related computations. We provide evidence to support a gradient of function that proceeds from areas 14 to 25 to 32 to 24. Specifically, we show that decodability of twelve distinct task variables increases along that path, consistent with the idea that regions that are higher in the anatomical hierarchy make choice-relevant variables more separable. We also show progressively longer intrinsic timescales in the same series. Together these results highlight the importance of the medial wall in choice, endorse a specific gradient-based organization, and argue against a modular functional neuroanatomy of choice.
Collapse
Affiliation(s)
- David J-N Maisson
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA.
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA.
- Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA.
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, USA.
| | - Tyler V Cash-Padgett
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
- Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, USA
| | - Maya Z Wang
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
- Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, USA
| | - Benjamin Y Hayden
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
- Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, USA
| | - Sarah R Heilbronner
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
- Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, USA
| | - Jan Zimmermann
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
- Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, USA
| |
Collapse
|
18
|
Biderman N, Shohamy D. Memory and decision making interact to shape the value of unchosen options. Nat Commun 2021; 12:4648. [PMID: 34330909 PMCID: PMC8324852 DOI: 10.1038/s41467-021-24907-x] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2021] [Accepted: 07/08/2021] [Indexed: 02/07/2023] Open
Abstract
The goal of deliberation is to separate between options so that we can commit to one and leave the other behind. However, deliberation can, paradoxically, also form an association in memory between the chosen and unchosen options. Here, we consider this possibility and examine its consequences for how outcomes affect not only the value of the options we chose, but also, by association, the value of options we did not choose. In five experiments (total n = 612), including a preregistered experiment (n = 235), we found that the value assigned to unchosen options is inversely related to their chosen counterparts. Moreover, this inverse relationship was associated with participants' memory of the pairs they chose between. Our findings suggest that deciding between options does not end the competition between them. Deliberation binds choice options together in memory such that the learned value of one can affect the inferred value of the other.
Collapse
Affiliation(s)
- Natalie Biderman
- Department of Psychology and Mortimer B. Zuckerman Mind, Brain, Behavior Institute, Columbia University, New York, NY, USA.
| | - Daphna Shohamy
- Department of Psychology and Mortimer B. Zuckerman Mind, Brain, Behavior Institute, Columbia University, New York, NY, USA.
- The Kavli Institute for Brain Science, Columbia University, New York, NY, USA.
| |
Collapse
|
19
|
Duan LY, Horst NK, Cranmore SAW, Horiguchi N, Cardinal RN, Roberts AC, Robbins TW. Controlling one's world: Identification of sub-regions of primate PFC underlying goal-directed behavior. Neuron 2021; 109:2485-2498.e5. [PMID: 34171290 PMCID: PMC8346232 DOI: 10.1016/j.neuron.2021.06.003] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2020] [Revised: 04/13/2021] [Accepted: 06/02/2021] [Indexed: 12/30/2022]
Abstract
Impaired detection of causal relationships between actions and their outcomes can lead to maladaptive behavior. However, causal roles of specific prefrontal cortex (PFC) sub-regions and the caudate nucleus in mediating such relationships in primates are unclear. We inactivated and overactivated five PFC sub-regions, reversibly and pharmacologically: areas 24 (perigenual anterior cingulate cortex), 32 (medial PFC), 11 (anterior orbitofrontal cortex, OFC), 14 (rostral ventromedial PFC/medial OFC), and 14-25 (caudal ventromedial PFC) and the anteromedial caudate to examine their role in expressing learned action-outcome contingencies using a contingency degradation paradigm in marmoset monkeys. Area 24 or caudate inactivation impaired the response to contingency change, while area 11 inactivation enhanced it, and inactivation of areas 14, 32, or 14-25 had no effect. Overactivation of areas 11 and 24 impaired this response. These findings demonstrate the distinct roles of PFC sub-regions in goal-directed behavior and illuminate the candidate neurobehavioral substrates of psychiatric disorders, including obsessive-compulsive disorder. Monkey pgACC-24 is necessary for detecting causal control of actions over outcomes Its projection target in the caudate nucleus is also implicated Three other subregions of the ventromedial prefrontal cortex are not necessary Anterior OFC-11 may mediate Pavlovian influences on goal-directed behavior
Collapse
Affiliation(s)
- Lisa Y Duan
- Department of Psychology, University of Cambridge, Downing Street, Cambridge CB2 3EB, UK; Behavioural and Clinical Neuroscience Institute, Downing Street, University of Cambridge, Cambridge CB2 3EB, UK.
| | - Nicole K Horst
- Department of Psychology, University of Cambridge, Downing Street, Cambridge CB2 3EB, UK; Behavioural and Clinical Neuroscience Institute, Downing Street, University of Cambridge, Cambridge CB2 3EB, UK
| | - Stacey A W Cranmore
- Department of Psychology, University of Cambridge, Downing Street, Cambridge CB2 3EB, UK; Behavioural and Clinical Neuroscience Institute, Downing Street, University of Cambridge, Cambridge CB2 3EB, UK
| | - Naotaka Horiguchi
- Department of Psychology, University of Cambridge, Downing Street, Cambridge CB2 3EB, UK; Behavioural and Clinical Neuroscience Institute, Downing Street, University of Cambridge, Cambridge CB2 3EB, UK
| | - Rudolf N Cardinal
- Department of Psychiatry, University of Cambridge, Herchel Smith Building for Brain & Mind Sciences, Forvie Site, Robinson Way, Cambridge CB2 0SZ, UK; Behavioural and Clinical Neuroscience Institute, Downing Street, University of Cambridge, Cambridge CB2 3EB, UK; Cambridgeshire and Peterborough NHS Foundation Trust, Liaison Psychiatry Service, Box 190, Cambridge Biomedical Campus, Cambridge CB2 0QQ, UK
| | - Angela C Roberts
- Department of Physiology, Development and Neuroscience, University of Cambridge, Downing Street, Cambridge CB2 3DY, UK; Behavioural and Clinical Neuroscience Institute, Downing Street, University of Cambridge, Cambridge CB2 3EB, UK
| | - Trevor W Robbins
- Department of Psychology, University of Cambridge, Downing Street, Cambridge CB2 3EB, UK; Behavioural and Clinical Neuroscience Institute, Downing Street, University of Cambridge, Cambridge CB2 3EB, UK
| |
Collapse
|
20
|
Yaple ZA, Tolomeo S, Yu R. Abnormal prediction error processing in schizophrenia and depression. Hum Brain Mapp 2021; 42:3547-3560. [PMID: 33955106 PMCID: PMC8249895 DOI: 10.1002/hbm.25453] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2020] [Revised: 04/01/2021] [Accepted: 04/11/2021] [Indexed: 11/19/2022] Open
Abstract
To make adaptive decisions under uncertainty, individuals need to actively monitor the discrepancy between expected outcomes and actual outcomes, known as prediction errors. Reward‐based learning deficits have been shown in both depression and schizophrenia patients. For this study, we compiled studies that investigated prediction error processing in depression and schizophrenia patients and performed a series of meta‐analyses. In both groups, positive t‐maps of prediction error tend to yield striatum activity across studies. The analysis of negative t‐maps of prediction error revealed two large clusters within the right superior and inferior frontal lobes in schizophrenia and the medial prefrontal cortex and bilateral insula in depression. The concordant posterior cingulate activity was observed in both patient groups, more prominent in the depression group and absent in the healthy control group. These findings suggest a possible role in dopamine‐rich areas associated with the encoding of prediction errors in depression and schizophrenia.
Collapse
Affiliation(s)
| | - Serenella Tolomeo
- Department of Psychology, National University of Singapore, Singapore
| | - Rongjun Yu
- Department of Management, Hong Kong Baptist University, Hong Kong, China.,Department of Sport, Physical Education and Health, Hong Kong Baptist University, Hong Kong, China.,Department of Physics, Hong Kong Baptist University, Hong Kong, China
| |
Collapse
|
21
|
Tervo DGR, Kuleshova E, Manakov M, Proskurin M, Karlsson M, Lustig A, Behnam R, Karpova AY. The anterior cingulate cortex directs exploration of alternative strategies. Neuron 2021; 109:1876-1887.e6. [PMID: 33852896 DOI: 10.1016/j.neuron.2021.03.028] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2020] [Revised: 12/31/2020] [Accepted: 03/22/2021] [Indexed: 12/26/2022]
Abstract
The ability to adjust one's behavioral strategy in complex environments is at the core of cognition. Doing so efficiently requires monitoring the reliability of the ongoing strategy and, when appropriate, switching away from it to evaluate alternatives. Studies in humans and non-human primates have uncovered signals in the anterior cingulate cortex (ACC) that reflect the pressure to switch away from the ongoing strategy, whereas other ACC signals relate to the pursuit of alternatives. However, whether these signals underlie computations that actually underpin strategy switching or merely reflect tracking of related variables remains unclear. Here we provide causal evidence that the rodent ACC actively arbitrates between persisting with the ongoing behavioral strategy and temporarily switching away to re-evaluate alternatives. Furthermore, by individually perturbing distinct output pathways, we establish that the two associated computations-determining whether to switch strategy and committing to the pursuit of a specific alternative-are segregated in the ACC microcircuitry.
Collapse
Affiliation(s)
| | - Elena Kuleshova
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA; Institute of Higher Nervous Activity and Neurophysiology of the Russian Academy of Sciences, Moscow, Russia
| | - Maxim Manakov
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA; Department of Neuroscience, Johns Hopkins University Medical School, Baltimore, MD, USA
| | - Mikhail Proskurin
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA; Department of Neuroscience, Johns Hopkins University Medical School, Baltimore, MD, USA
| | - Mattias Karlsson
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA; SpikeGadgets, San Francisco, CA, USA
| | - Andy Lustig
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Reza Behnam
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Alla Y Karpova
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA.
| |
Collapse
|
22
|
Abstract
Curiosity is a desire for information that is not motivated by strategic concerns. Latent learning is not driven by standard reinforcement processes. We propose that curiosity serves the purpose of motivating latent learning. While latent learning is often treated as a passive or incidental process, it normally reflects a strong evolved pressure to actively seek large amounts of information. That information in turn allows curious decision makers to represent the structure of their environment, that is, to form cognitive maps. These cognitive maps then drive adaptive flexible behavior. Based on recent data, we propose that orbitofrontal cortex (OFC) and dorsal anterior cingulate cortex (dACC) play complementary roles in curiosity-driven learning. Specifically, we propose that (1) OFC tracks intrinsic value of information and incorporates new information into a cognitive map; and (2) dACC tracks the environmental demands and information availability to then use the cognitive map from OFC to guide behavior.
Collapse
Affiliation(s)
- Maya Zhe Wang
- Department of Neuroscience, Center for Magnetic Resonance Research, and Center for Neuroengineering University of Minnesota, Minneapolis MN 55455
| | - Benjamin Y Hayden
- Department of Neuroscience, Center for Magnetic Resonance Research, and Center for Neuroengineering University of Minnesota, Minneapolis MN 55455
| |
Collapse
|
23
|
Purcell JR, Jahn A, Fine JM, Brown JW. Neural correlates of visual attention during risky decision evidence integration. Neuroimage 2021; 234:117979. [PMID: 33771695 PMCID: PMC8159858 DOI: 10.1016/j.neuroimage.2021.117979] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2020] [Revised: 03/08/2021] [Accepted: 03/13/2021] [Indexed: 12/20/2022] Open
Abstract
Value-based decision-making is presumed to involve a dynamic integration process that supports assessing the potential outcomes of different choice options. Decision frameworks assume the value of a decision rests on both the desirability and risk surrounding an outcome. Previous work has highlighted neural representations of risk in the human brain, and their relation to decision choice. Key neural regions including the insula and anterior cingulate cortex (ACC) have been implicated in encoding the effects of risk on decision outcomes, including approach and avoidance. Yet, it remains unknown whether these regions are involved in the dynamic integration processes that precede and drive choice, and their relationship with ongoing attention. Here, we used concurrent fMRI and eye-tracking to discern neural activation related to visual attention preceding choice between sure-thing (i.e. safe) and risky gamble options. We found activation in both dorsal ACC (dACC) and posterior insula (PI) scaled in opposite directions with the difference in attention to risky rewards relative to risky losses. PI activation also differentiated foveations on both risky options (rewards and losses) relative to a sure-thing option. These findings point to ACC involvement in ongoing evaluation of risky but higher value options. The role of PI in risky outcomes points to a more general evaluative role in the decision-making that compares both safe and risky outcomes, irrespective of potential for gains or losses.
Collapse
Affiliation(s)
- John R Purcell
- Department of Psychological & Brain Sciences, Indiana University, 1101 E. 10th St., Bloomington, IN 47405, USA; Program in Neuroscience, Indiana University, 1101 E. 10th St., Bloomington, IN 47405, USA.
| | - Andrew Jahn
- Department of Psychology, University of Michigan, East Hall, 530 Church St, #1265 Ann Arbor, MI 48109, USA.
| | - Justin M Fine
- Department of Psychological & Brain Sciences, Indiana University, 1101 E. 10th St., Bloomington, IN 47405, USA.
| | - Joshua W Brown
- Department of Psychological & Brain Sciences, Indiana University, 1101 E. 10th St., Bloomington, IN 47405, USA; Program in Neuroscience, Indiana University, 1101 E. 10th St., Bloomington, IN 47405, USA.
| |
Collapse
|
24
|
Procyk E, Fontanier V, Sarazin M, Delord B, Goussi C, Wilson CRE. The midcingulate cortex and temporal integration. INTERNATIONAL REVIEW OF NEUROBIOLOGY 2021; 158:395-419. [PMID: 33785153 DOI: 10.1016/bs.irn.2020.12.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
Abstract
The ability to integrate information across time at multiple timescales is a vital element of adaptive behavior, because it provides the capacity to link events separated in time, extract useful information from previous events and actions, and to construct plans for behavior over time. Here we make the argument that this information integration capacity is a central function of the midcingulate cortex (MCC), by reviewing the anatomical, intrinsic network, neurophysiological, and behavioral properties of MCC. The MCC is the region of the medial wall situated dorsal to the corpus callosum and sometimes referred to as dACC. It is positioned within the densely connected core network of the primate brain, with a rich diversity of cognitive, somatomotor and autonomic connections. Furthermore, the MCC shows strong local network inhibition which appears to control the metastability of the region-an established feature of many cortical networks in which the neural dynamics move through a series of quasi-stationary states. We propose that the strong local inhibition in MCC leads to particularly long dynamic state durations, and so less frequent transitions. Apparently as a result of these anatomical features and synaptic and ionic determinants, the MCC cells display the longest neuronal timescales among a range of recorded cortical areas. We conclude that the anatomical position, intrinsic properties, and local network interactions of MCC make it a uniquely positioned cortical area to perform the integration of diverse information over time that is necessary for behavioral adaptation.
Collapse
Affiliation(s)
- Emmanuel Procyk
- Univ Lyon, Université Claude Bernard Lyon 1, Inserm, Stem Cell and Brain Research Institute U1208, Bron, France.
| | - Vincent Fontanier
- Univ Lyon, Université Claude Bernard Lyon 1, Inserm, Stem Cell and Brain Research Institute U1208, Bron, France
| | - Matthieu Sarazin
- Institute of Intelligent Systems and Robotics (ISIR), Sorbonne Université, Centre National de la Recherche Scientifique, UMR 7222, Paris, France
| | - Bruno Delord
- Institute of Intelligent Systems and Robotics (ISIR), Sorbonne Université, Centre National de la Recherche Scientifique, UMR 7222, Paris, France
| | - Clément Goussi
- Univ Lyon, Université Claude Bernard Lyon 1, Inserm, Stem Cell and Brain Research Institute U1208, Bron, France
| | - Charles R E Wilson
- Univ Lyon, Université Claude Bernard Lyon 1, Inserm, Stem Cell and Brain Research Institute U1208, Bron, France.
| |
Collapse
|
25
|
Oscillations as a window into neuronal mechanisms underlying dorsal anterior cingulate cortex function. INTERNATIONAL REVIEW OF NEUROBIOLOGY 2020; 158:311-335. [PMID: 33785150 DOI: 10.1016/bs.irn.2020.11.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
Abstract
The function of dorsal Anterior Cingulate Cortex (dACC) remains poorly understood. While many methods, spanning bottom-up and top-down approaches, have been deployed, the view they offer is often conflicting. Integrating bottom-up and top-down approaches requires an intermediary with sufficient explanatory power, theoretical development, and empirical support. Oscillations in the local field potential (LFP) provide such a link. LFP oscillations arise from empirically well-characterized neuronal circuit motifs. Synchronizing the firing of individual units has appealing properties to bind disparate brain regions and propagate information, including gating, routing, and coding. Moreover, the LFP, rather than single unit activity, more closely relates to macro-scale recordings, such as the electroencephalogram and functional magnetic resonance imaging. Thus, LFP oscillations are a critical link that allow for the inference of neuronal micro-circuitry underlying macroscopic brain recordings.
Collapse
|
26
|
Watzek J, Brosnan SF. Capuchin and rhesus monkeys show sunk cost effects in a psychomotor task. Sci Rep 2020; 10:20396. [PMID: 33230238 PMCID: PMC7683735 DOI: 10.1038/s41598-020-77301-w] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2020] [Accepted: 11/03/2020] [Indexed: 11/10/2022] Open
Abstract
Human decision-making is often swayed by irrecoverable investments even though it should only be based on future-and not past-costs and benefits. Although this sunk cost effect is widely documented and can lead to devastating losses, the underlying psychological mechanisms are unclear. To tease apart possible explanations through a comparative approach, we assessed capuchin and rhesus monkeys' susceptibility to sunk costs in a psychomotor task. Monkeys needed to track a moving target with a joystick-controlled cursor for variable durations. They could stop at any time, ending the trial without reward. To minimize the work required for a reward, monkeys should have always persisted for at least 1 s, but should have abandoned the trial if that did not yield a reward. Capuchin monkeys and especially rhesus macaques persisted to trial completion even when it was suboptimal, and were more likely to complete the trial the longer they had already tracked the target. These effects were less pronounced, although still present, when the change in expected tracking duration was signalled visually. These results show that sunk cost effects can arise in the absence of human-unique factors and may emerge, in part, because persisting can resolve uncertainty.
Collapse
Affiliation(s)
- Julia Watzek
- Department of Psychology, Language Research Center, Georgia State University, Atlanta, GA, USA.
| | - Sarah F Brosnan
- Department of Psychology, Language Research Center, Georgia State University, Atlanta, GA, USA
- Department of Philosophy, Neuroscience Institute, Center for Behavioral Neuroscience, Georgia State University, Atlanta, GA, USA
| |
Collapse
|
27
|
Schneider KN, Sciarillo XA, Nudelman JL, Cheer JF, Roesch MR. Anterior Cingulate Cortex Signals Attention in a Social Paradigm that Manipulates Reward and Shock. Curr Biol 2020; 30:3724-3735.e2. [PMID: 32763169 PMCID: PMC7541607 DOI: 10.1016/j.cub.2020.07.039] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2020] [Revised: 06/04/2020] [Accepted: 07/10/2020] [Indexed: 01/09/2023]
Abstract
The ability to recognize emotions in others and adapt one's behavior accordingly is critical for functioning in any social context. This ability is impaired in several psychiatric disorders, such as autism and psychopathy. Recent work has identified the anterior cingulate cortex (ACC) among other brain regions involved in this process. Neural recording studies have shown that neurons in ACC are modulated by reward or shock when delivered to a conspecific and when experienced first-hand. Because previous studies do not vary reward and shock within the same experiment, it has been unclear whether the observed activity reflects how much attention is being paid to outcomes delivered to a conspecific or the valence associated with those stimuli. To address this issue, we recorded from ACC as rats performed a Pavlovian task that predicted whether reward, shock, or nothing would be delivered to the rat being recorded from or a conspecific located in the opposite chamber. Consistent with previous reports, we found that the firing of ACC neurons was modulated by aversive stimuli delivered to the recording rat and their conspecific. Activity of some of these neurons genuinely reflected outcome identity (i.e., reward or shock); however, the population of neurons as a whole responded similarly for both reward and shock, as well as for cues that predicted their occurrence (i.e., reward > neutral and shock > neutral; attention). These results suggest that ACC can process information about outcomes (i.e., identity and recipient) in the service of promoting attention in some social contexts.
Collapse
Affiliation(s)
- Kevin N Schneider
- Department of Psychology, University of Maryland, College Park, MD 20742, USA; Program in Neuroscience and Cognitive Science, University of Maryland, College Park, MD 20742, USA.
| | - Xavier A Sciarillo
- Department of Psychology, University of Maryland, College Park, MD 20742, USA
| | - Jacob L Nudelman
- Department of Psychology, University of Maryland, College Park, MD 20742, USA
| | - Joseph F Cheer
- Department of Anatomy and Neurobiology, University of Maryland School of Medicine, Baltimore, MD 21201, USA; Department of Psychiatry, University of Maryland School of Medicine, Baltimore, MD 21201, USA; Program in Neuroscience, University of Maryland School of Medicine, Baltimore, MD 21201, USA
| | - Matthew R Roesch
- Department of Psychology, University of Maryland, College Park, MD 20742, USA; Program in Neuroscience and Cognitive Science, University of Maryland, College Park, MD 20742, USA.
| |
Collapse
|
28
|
What Are Memories For? The Hippocampus Bridges Past Experience with Future Decisions. Trends Cogn Sci 2020; 24:542-556. [DOI: 10.1016/j.tics.2020.04.004] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2020] [Revised: 04/24/2020] [Accepted: 04/26/2020] [Indexed: 01/07/2023]
|
29
|
Chemogenetic Modulation and Single-Photon Calcium Imaging in Anterior Cingulate Cortex Reveal a Mechanism for Effort-Based Decisions. J Neurosci 2020; 40:5628-5643. [PMID: 32527984 PMCID: PMC7363467 DOI: 10.1523/jneurosci.2548-19.2020] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2019] [Revised: 05/23/2020] [Accepted: 05/24/2020] [Indexed: 11/25/2022] Open
Abstract
The ACC is implicated in effort exertion and choices based on effort cost, but it is still unclear how it mediates this cost-benefit evaluation. Here, male rats were trained to exert effort for a high-value reward (sucrose pellets) in a progressive ratio lever-pressing task. Trained rats were then tested in two conditions: a no-choice condition where lever-pressing for sucrose was the only available food option, and a choice condition where a low-value reward (lab chow) was freely available as an alternative to pressing for sucrose. Disruption of ACC, via either chemogenetic inhibition or excitation, reduced lever-pressing in the choice, but not in the no-choice, condition. We next looked for value coding cells in ACC during effortful behavior and reward consumption phases during choice and no-choice conditions. For this, we used in vivo miniaturized fluorescence microscopy to reliably track responses of the same cells and compare how ACC neurons respond during the same effortful behavior where there was a choice versus when there was no-choice. We found that lever-press and sucrose-evoked responses were significantly weaker during choice compared with no-choice sessions, which may have rendered them more susceptible to chemogenetic disruption. Together, findings from our interference experiments and neural recordings suggest that a mechanism by which ACC mediates effortful decisions is in the discrimination of the utility of available options. ACC regulates these choices by providing a stable population code for the relative value of different options. SIGNIFICANCE STATEMENT The ACC is implicated in effort-based decision-making. Here, we used chemogenetics and in vivo calcium imaging to explore its mechanism. Rats were trained to lever press for a high-value reward and tested in two conditions: a no-choice condition where lever-pressing for the high-value reward was the only option, and a choice condition where a low-value reward was also available. Inhibition or excitation of ACC reduced effort toward the high-value option, but only in the choice condition. Neural responses in ACC were weaker in the choice compared with the no-choice condition. A mechanism by which ACC regulates effortful decisions is in providing a stable population code for the discrimination of the utility of available options.
Collapse
|
30
|
Sallet J, Noonan MP, Thomas A, O’Reilly JX, Anderson J, Papageorgiou GK, Neubert FX, Ahmed B, Smith J, Bell AH, Buckley MJ, Roumazeilles L, Cuell S, Walton ME, Krug K, Mars RB, Rushworth MFS. Behavioral flexibility is associated with changes in structure and function distributed across a frontal cortical network in macaques. PLoS Biol 2020; 18:e3000605. [PMID: 32453728 PMCID: PMC7274449 DOI: 10.1371/journal.pbio.3000605] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2019] [Revised: 06/05/2020] [Accepted: 04/30/2020] [Indexed: 01/08/2023] Open
Abstract
One of the most influential accounts of central orbitofrontal cortex-that it mediates behavioral flexibility-has been challenged by the finding that discrimination reversal in macaques, the classic test of behavioral flexibility, is unaffected when lesions are made by excitotoxin injection rather than aspiration. This suggests that the critical brain circuit mediating behavioral flexibility in reversal tasks lies beyond the central orbitofrontal cortex. To determine its identity, a group of nine macaques were taught discrimination reversal learning tasks, and its impact on gray matter was measured. Magnetic resonance imaging scans were taken before and after learning and compared with scans from two control groups, each comprising 10 animals. One control group learned discrimination tasks that were similar but lacked any reversal component, and the other control group engaged in no learning. Gray matter changes were prominent in posterior orbitofrontal cortex/anterior insula but were also found in three other frontal cortical regions: lateral orbitofrontal cortex (orbital part of area 12 [12o]), cingulate cortex, and lateral prefrontal cortex. In a second analysis, neural activity in posterior orbitofrontal cortex/anterior insula was measured at rest, and its pattern of coupling with the other frontal cortical regions was assessed. Activity coupling increased significantly in the reversal learning group in comparison with controls. In a final set of experiments, we used similar structural imaging procedures and analyses to demonstrate that aspiration lesion of central orbitofrontal cortex, of the type known to affect discrimination learning, affected structure and activity in the same frontal cortical circuit. The results identify a distributed frontal cortical circuit associated with behavioral flexibility.
Collapse
Affiliation(s)
- Jérôme Sallet
- Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
- Univ Lyon, Université Lyon 1, Inserm, Stem Cell and Brain Research Institute U1208, Bron, France
| | - MaryAnn P. Noonan
- Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
| | - Adam Thomas
- Wellcome Centre for Integrative Neuroimaging, Centre for Functional MRI of the Brain (FMRIB), Nuffield Department of Clinical Neurosciences, University of Oxford, John Radcliffe Hospital, Oxford, United Kingdom
- National Institute of Mental Health, Magnuson Clinical Center, Bethesda, Maryland, United States of America
| | - Jill X. O’Reilly
- Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
| | - Jesper Anderson
- Wellcome Centre for Integrative Neuroimaging, Centre for Functional MRI of the Brain (FMRIB), Nuffield Department of Clinical Neurosciences, University of Oxford, John Radcliffe Hospital, Oxford, United Kingdom
| | - Georgios K. Papageorgiou
- Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
- McGovern Institute for Brain Research and Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America
| | - Franz X. Neubert
- Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
| | - Bashir Ahmed
- Department of Physiology, Anatomy and Genetics, University of Oxford, Oxford, United Kingdom
| | - Jackson Smith
- Department of Physiology, Anatomy and Genetics, University of Oxford, Oxford, United Kingdom
| | - Andrew H. Bell
- Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
| | - Mark J. Buckley
- Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
| | - Léa Roumazeilles
- Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
| | - Steven Cuell
- Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
| | - Mark E. Walton
- Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
| | - Kristine Krug
- Department of Physiology, Anatomy and Genetics, University of Oxford, Oxford, United Kingdom
- Otto-von-Guericke-Universität, Magdeburg, Germany
- Leibniz-Institut für Neurobiologie, Magdeburg, Germany
| | - Rogier B. Mars
- Wellcome Centre for Integrative Neuroimaging, Centre for Functional MRI of the Brain (FMRIB), Nuffield Department of Clinical Neurosciences, University of Oxford, John Radcliffe Hospital, Oxford, United Kingdom
- Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, the Netherlands
| | - Matthew F. S. Rushworth
- Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
- Wellcome Centre for Integrative Neuroimaging, Centre for Functional MRI of the Brain (FMRIB), Nuffield Department of Clinical Neurosciences, University of Oxford, John Radcliffe Hospital, Oxford, United Kingdom
| |
Collapse
|
31
|
Trait anxiety on effort allocation to monetary incentives: a behavioral and high-density EEG study. Transl Psychiatry 2019; 9:174. [PMID: 31300637 PMCID: PMC6626005 DOI: 10.1038/s41398-019-0508-4] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/12/2019] [Revised: 05/20/2019] [Accepted: 05/31/2019] [Indexed: 01/03/2023] Open
Abstract
Trait anxiety is an important phenotype in the prediction of stress-induced neuropsychiatric disorders. While the role of trait anxiety in mental effort and cognitive impairment is well documented, much less is known about its influence on motivated behaviors and physical effort. Here, we investigated trait anxiety-related differences in behavioral and neural responses in an effort-related monetary incentive delay task. Participants prompted with different incentive levels could exert handgrip responses to earn monetary rewards while a 256-channel electroencephalography (EEG) was recorded. Participants' performance was linearly dependent on incentive level, with higher stakes prompting better accuracy and higher grip force. Importantly, we found a striking association between trait anxiety and incentive-related grip force; effort exertion was related to incentive level only in high-anxious individuals. In analyses of neural efficiency associated with effort preparation involving Contingent-negative variation (CNV), we found that the CNV amplitude was sensitive to monetary incentive levels. Source imaging analyses of CNV indicated increased activity in the anterior cingulate cortex (ACC) for the highest incentive level. Importantly, we found a significant interaction between trait anxiety and incentive level on CNV modulation at the interval ranging from -2610 to -2510 ms, with greater CNV responses to the lower monetary incentive sizes in high anxiety. Subsequent mediation analyses supported a mediation of the ACC activation on the association between trait anxiety and incentive-selective grip force. Our study reveals a role for ACC in trait anxiety-related differences on incentive processing, when rewards are dependent on effortful performance.
Collapse
|
32
|
Jung K, Jeong J, Kralik JD. A Computational Model of Attention Control in Multi-Attribute, Context-Dependent Decision Making. Front Comput Neurosci 2019; 13:40. [PMID: 31354461 PMCID: PMC6635580 DOI: 10.3389/fncom.2019.00040] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2019] [Accepted: 06/11/2019] [Indexed: 11/17/2022] Open
Abstract
Real-life decisions often require a comparison of multi-attribute options with various benefits and costs, and the evaluation of each option depends partly on the others in the choice set (i.e., the choice context). Although reinforcement learning models have successfully described choice behavior, how to account for multi-attribute information when making a context-dependent decision remains unclear. Here we develop a computational model of attention control that includes context effects on multi-attribute decisions, linking a context-dependent choice model with a reinforcement learning model. The overall model suggests that the distinctiveness of attributes guides an individual's preferences among multi-attribute options via an attention-control mechanism that determines whether choices are selectively biased toward the most distinctive attribute (selective attention) or proportionally distributed based on the relative distinctiveness of attributes (divided attention). To test the model, we conducted a behavioral experiment in rhesus monkeys, in which they made simple multi-attribute decisions over three conditions that manipulated the degree of distinctiveness between alternatives: (1) four foods of different size and calorie; (2) four pieces of the same food in different colors; and (3) four identical pieces of food. The model simulation of the choice behavior captured the preference bias (i.e., overall preference structure) and the choice persistence (repeated choices) in the empirical data, providing evidence for the respective influences of attention and memory on preference bias and choice persistence. Our study provides insights into computations underlying multi-attribute decisions, linking attentional control to decision-making processes.
Collapse
Affiliation(s)
- Kanghoon Jung
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, United States
| | - Jaeseung Jeong
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea
| | - Jerald D Kralik
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, United States
| |
Collapse
|
33
|
Bakkour A, Palombo DJ, Zylberberg A, Kang YH, Reid A, Verfaellie M, Shadlen MN, Shohamy D. The hippocampus supports deliberation during value-based decisions. eLife 2019; 8:46080. [PMID: 31268419 PMCID: PMC6693920 DOI: 10.7554/elife.46080] [Citation(s) in RCA: 62] [Impact Index Per Article: 12.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2019] [Accepted: 06/29/2019] [Indexed: 11/13/2022] Open
Abstract
Choosing between two items involves deliberation and comparison of the features of each item and its value. Such decisions take more time when choosing between options of similar value, possibly because these decisions require more evidence, but the mechanisms involved are not clear. We propose that the hippocampus supports deliberation about value, given its well-known role in prospection and relational cognition. We assessed the role of the hippocampus in deliberation in two experiments. First, using fMRI in healthy participants, we found that BOLD activity in the hippocampus increased as a function of deliberation time. Second, we found that patients with hippocampal damage exhibited more stochastic choices and longer reaction times than controls, possibly due to their failure to construct value-based or internal evidence during deliberation. Both sets of results were stronger in value-based decisions compared to perceptual decisions.
Collapse
Affiliation(s)
- Akram Bakkour
- Department of Psychology, Columbia University, New York, United States
| | - Daniela J Palombo
- Memory Disorders Research Center, VA Boston Healthcare System and Boston University School of Medicine, Boston, United States
| | - Ariel Zylberberg
- Department of Neuroscience, Columbia University, New York, United States.,Mortimer B Zuckerman Mind Brain Behavior Institute, Columbia University, New York, United States.,Howard Hughes Medical Institute, Chevy Chase, United States
| | - Yul Hr Kang
- Department of Neuroscience, Columbia University, New York, United States
| | - Allison Reid
- Memory Disorders Research Center, VA Boston Healthcare System and Boston University School of Medicine, Boston, United States
| | - Mieke Verfaellie
- Memory Disorders Research Center, VA Boston Healthcare System and Boston University School of Medicine, Boston, United States
| | - Michael N Shadlen
- Department of Neuroscience, Columbia University, New York, United States.,Mortimer B Zuckerman Mind Brain Behavior Institute, Columbia University, New York, United States.,Howard Hughes Medical Institute, Chevy Chase, United States.,The Kavli Institute for Brain Science, Columbia University, New York, United States
| | - Daphna Shohamy
- Department of Psychology, Columbia University, New York, United States.,Mortimer B Zuckerman Mind Brain Behavior Institute, Columbia University, New York, United States.,The Kavli Institute for Brain Science, Columbia University, New York, United States
| |
Collapse
|
34
|
Individual Neurons in the Cingulate Cortex Encode Action Monitoring, Not Selection, during Adaptive Decision-Making. J Neurosci 2019; 39:6668-6683. [PMID: 31217329 DOI: 10.1523/jneurosci.0159-19.2019] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2019] [Revised: 05/14/2019] [Accepted: 06/13/2019] [Indexed: 11/21/2022] Open
Abstract
The cingulate cortex contributes to complex, adaptive behaviors, but the exact nature of its contributions remains unresolved. Proposals from previous studies, including evaluating past actions or selecting future ones, have been difficult to distinguish in part because of an incomplete understanding of the task-relevant variables that are encoded by individual cingulate neurons. In this study, we recorded from individual neurons in parts of both the anterior cingulate cortex (ACC) and posterior cingulate cortex (PCC) in 2 male rhesus monkeys performing a saccadic reward task. The task required them to use adaptive, feedback-driven strategies to infer the spatial location of a rewarded saccade target in the presence of different forms of uncertainty. We found that task-relevant, spatially selective feedback signals were encoded by the activity of individual neurons in both brain regions, with stronger selectivity for spatial choice and reward-target signals in PCC and stronger selectivity for feedback in ACC. Moreover, neurons in both regions were sensitive to sequential effects of feedback that partly reflected sequential behavioral patterns. However, neither brain region exhibited systematic modulations by the blockwise conditions that governed the reliability of the trial-by-trial feedback and drove adaptive behavioral patterns. There was also little evidence that single-neuron responses in either brain region directly predicted the extent to which feedback and contextual information were used to inform choices on the subsequent trial. Thus, certain cingulate neurons encode diverse, evaluative signals needed for adaptive, feedback-driven decision-making, but those signals may be integrated elsewhere in the brain to guide actions.SIGNIFICANCE STATEMENT Effective decision-making in dynamic environments requires adapting to changes in feedback and context. The anterior and posterior cingulate cortex have been implicated in adaptive decision-making, but the exact nature of their respective roles remains unresolved. Here we compare patterns of task-driven activity of subsets of individual neurons from parts of the two brain regions in monkeys performing a saccadic task with dynamically changing reward locations. We find evidence for regional specializations in neural representations of choice and feedback, including task-relevant modulations of activity that could be used for performance monitoring. However, we find little evidence that these neural representations are used directly to adjust choice behavior, which thus likely requires integration of these signals elsewhere in the brain.
Collapse
|
35
|
Bault N, di Pellegrino G, Puppi M, Opolczynski G, Monti A, Braghittoni D, Thibaut F, Rustichini A, Coricelli G. Dissociation between Private and Social Counterfactual Value Signals Following Ventromedial Prefrontal Cortex Damage. J Cogn Neurosci 2019; 31:639-656. [DOI: 10.1162/jocn_a_01372] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Individuals learn by comparing the outcome of chosen and unchosen actions. A negative counterfactual value signal is generated when this comparison is unfavorable. This can happen in private as well as in social settings—where the foregone outcome results from the choice of another person. We hypothesized that, despite sharing similar features such as supporting learning, these two counterfactual signals might implicate distinct brain networks. We conducted a neuropsychological study on the role of private and social counterfactual value signals in risky decision-making. Patients with lesions in the ventromedial prefrontal cortex (vmPFC), lesion controls, and healthy controls repeatedly chose between lotteries. In private trials, participants could observe the outcomes of their choices and the outcomes of the unselected lotteries. In social trials, participants could also see the other player's choices and outcome. At the time of outcome, vmPFC patients were insensitive to private counterfactual value signals, whereas their responses to social comparison were similar to those of control participants. At the time of choice, intact vmPFC was necessary to integrate counterfactual signals in decisions, although amelioration was observed during the course of the task, possibly driven by social trials. We conclude that if the vmPFC is critical in processing private counterfactual signals and in integrating those signals in decision-making, then distinct brain areas might support the processing of social counterfactual signals.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | | | - Giorgio Coricelli
- University of Trento, Mattarello, Italy
- University of Southern California
| |
Collapse
|
36
|
Fouragnan EF, Chau BKH, Folloni D, Kolling N, Verhagen L, Klein-Flügge M, Tankelevitch L, Papageorgiou GK, Aubry JF, Sallet J, Rushworth MFS. The macaque anterior cingulate cortex translates counterfactual choice value into actual behavioral change. Nat Neurosci 2019; 22:797-808. [PMID: 30988525 PMCID: PMC7116825 DOI: 10.1038/s41593-019-0375-6] [Citation(s) in RCA: 109] [Impact Index Per Article: 21.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2018] [Accepted: 03/06/2019] [Indexed: 12/17/2022]
Abstract
The neural mechanisms mediating sensory-guided decision making have received considerable attention but animals often pursue behaviors for which there is currently no sensory evidence. Such behaviors are guided by internal representations of choice values that have to be maintained even when these choices are unavailable. We investigated how four macaque monkeys maintained representations of the value of counterfactual choices– choices that could not be taken at the current moment but which could be taken in the future. Using functional magnetic resonance imaging, we found two different patterns of activity co-varying with values of counterfactual choices in a circuit spanning hippocampus, anterior lateral prefrontal cortex, and anterior cingulate cortex (ACC). ACC activity also reflected whether the internal value representations would be translated into actual behavioral change. To establish the causal importance of ACC for this translation process, we used a novel technique, Transcranial Focused Ultrasound Stimulation, to reversibly disrupt ACC activity.
Collapse
Affiliation(s)
- Elsa F Fouragnan
- School of Psychology, University of Plymouth, Plymouth, UK. .,Wellcome Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, UK.
| | - Bolton K H Chau
- Wellcome Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, UK.,Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong, China
| | - Davide Folloni
- Wellcome Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Nils Kolling
- Wellcome Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Lennart Verhagen
- Wellcome Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Miriam Klein-Flügge
- Wellcome Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Lev Tankelevitch
- Wellcome Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Georgios K Papageorgiou
- Wellcome Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, UK.,McGovern Institute for Brain Research and Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Jean-Francois Aubry
- Physics for Medicine Paris, Inserm, ESPCI Paris, CNRS, PSL Research University, Paris, France
| | - Jerome Sallet
- Wellcome Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Matthew F S Rushworth
- Wellcome Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, Oxford, UK.,Wellcome Integrative Neuroimaging, Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, John Radcliffe Hospital, University of Oxford, Oxford, UK
| |
Collapse
|
37
|
Beyond "incentive hope": Information sampling and learning under reward uncertainty. Behav Brain Sci 2019; 42:e56. [PMID: 30940240 DOI: 10.1017/s0140525x18001930] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Information seeking, especially when motivated by strategic learning and intrinsic curiosity, could render the new mechanism "incentive hope" proposed by Anselme & Güntürkün sufficient, but not necessary to explain how reward uncertainty promotes reward seeking and consumption. Naturalistic and foraging-like tasks can help parse motivational processes that bridge learning and foraging behaviors and identify their neural underpinnings.
Collapse
|
38
|
Monkeys are curious about counterfactual outcomes. Cognition 2019; 189:1-10. [PMID: 30889493 DOI: 10.1016/j.cognition.2019.03.009] [Citation(s) in RCA: 32] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2018] [Revised: 03/11/2019] [Accepted: 03/13/2019] [Indexed: 11/22/2022]
Abstract
Many non-human animals show exploratory behaviors. It remains unclear whether any possess human-like curiosity. We previously proposed three criteria for applying the term curiosity to animal behavior: (1) the subject is willing to sacrifice reward to obtain information, (2) the information provides no immediate instrumental or strategic benefit, and (3) the amount the subject is willing to pay depends systematically on the amount of information available. In previous work on information-seeking in animals, information generally predicts upcoming rewards, and animals' decisions may therefore be a byproduct of reinforcement processes. Here we get around this potential confound by taking advantage of macaques' ability to reason counterfactually (that is, about outcomes that could have occurred had the subject chosen differently). Specifically, macaques sacrificed fluid reward to obtain information about counterfactual outcomes. Moreover, their willingness to pay scaled with the information (Shannon entropy) offered by the counterfactual option. These results demonstrate the existence of human-like curiosity in non-human primates according to our criteria, which circumvent several confounds associated with less stringent criteria.
Collapse
|
39
|
Wei Z, Zhao Z, Zheng Y. Following the Majority: Social Influence in Trusting Behavior. Front Neurosci 2019; 13:89. [PMID: 30804747 PMCID: PMC6378867 DOI: 10.3389/fnins.2019.00089] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2018] [Accepted: 01/25/2019] [Indexed: 11/26/2022] Open
Abstract
When making decisions, people may change their behavior, sometimes against their personal preference, according to the opinions of peers. However, the effect of social influence on trust is still unknown. In our study, we used the event-related functional magnetic resonance imaging to investigate brain activity in social influence during a trust game. The behavioral results revealed that people tend to conform to others’ opinions and behaviors in a trust game. Decreased activations were observed in superior temporal gyrus during processing of social influences. Moreover, brain regions supporting value processing and reward learning were activated when subjects decided to follow the majority. These regions include the ventral medial prefrontal cortex, ventral striatum, and parahippocampal gyrus. Finally, our exploratory analysis revealed an increase in functional connectivity between the prefrontal cortex and the ventral striatum during conformity in trusting behavior. These findings indicate that the neural basis of social influence in trusting behavior are similar to the mechanisms implicated in reward learning. The brain regions involved in reward learning might reflect the reward value of agreeing with others in our study.
Collapse
Affiliation(s)
- Zhenyu Wei
- Key Laboratory for NeuroInformation of Ministry of Education, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China.,Key Laboratory of Cognition and Personality (MOE), Faculty of Psychology, Southwest University, Chongqing, China
| | - Zhiying Zhao
- Key Laboratory for NeuroInformation of Ministry of Education, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Yong Zheng
- Key Laboratory of Cognition and Personality (MOE), Faculty of Psychology, Southwest University, Chongqing, China
| |
Collapse
|
40
|
Computing Value from Quality and Quantity in Human Decision-Making. J Neurosci 2018; 39:163-176. [PMID: 30455186 PMCID: PMC6325261 DOI: 10.1523/jneurosci.0706-18.2018] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2018] [Revised: 09/20/2018] [Accepted: 09/26/2018] [Indexed: 12/04/2022] Open
Abstract
How organisms learn the value of single stimuli through experience is well described. In many decisions, however, value estimates are computed “on the fly” by combining multiple stimulus attributes. The neural basis of this computation is poorly understood. Here we explore a common scenario in which decision-makers must combine information about quality and quantity to determine the best option. Using fMRI, we examined the neural representation of quality, quantity, and their integration into an integrated subjective value signal in humans of both genders. We found that activity within inferior frontal gyrus (IFG) correlated with offer quality, while activity in the intraparietal sulcus (IPS) specifically correlated with offer quantity. Several brain regions, including the anterior cingulate cortex (ACC), were sensitive to an interaction of quality and quantity. However, the ACC was uniquely activated by quality, quantity, and their interaction, suggesting that this region provides a substrate for flexible computation of value from both quality and quantity. Furthermore, ACC signals across subjects correlated with the strength of quality and quantity signals in IFG and IPS, respectively. ACC tracking of subjective value also correlated with choice predictability. Finally, activity in the ACC was elevated for choice trials, suggesting that ACC provides a nexus for the computation of subjective value in multiattribute decision-making. SIGNIFICANCE STATEMENT Would you prefer three apples or two oranges? Many choices we make each day require us to weigh up the quality and quantity of different outcomes. Using fMRI, we show that option quality is selectively represented in the inferior frontal gyrus, while option quantity correlates with areas of the intraparietal sulcus that have previously been associated with numerical processing. We show that information about the two is integrated into a value signal in the anterior cingulate cortex, and the fidelity of this integration predicts choice predictability. Our results demonstrate how on-the-fly value estimates are computed from multiple attributes in human value-based decision-making.
Collapse
|
41
|
Ritz H, Nassar MR, Frank MJ, Shenhav A. A Control Theoretic Model of Adaptive Learning in Dynamic Environments. J Cogn Neurosci 2018; 30:1405-1421. [PMID: 29877769 PMCID: PMC6432773 DOI: 10.1162/jocn_a_01289] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
To behave adaptively in environments that are noisy and nonstationary, humans and other animals must monitor feedback from their environment and adjust their predictions and actions accordingly. An understudied approach for modeling these adaptive processes comes from the engineering field of control theory, which provides general principles for regulating dynamical systems, often without requiring a generative model. The proportional-integral-derivative (PID) controller is one of the most popular models of industrial process control. The proportional term is analogous to the "delta rule" in psychology, adjusting estimates in proportion to each error in prediction. The integral and derivative terms augment this update to simultaneously improve accuracy and stability. Here, we tested whether the PID algorithm can describe how people sequentially adjust their predictions in response to new information. Across three experiments, we found that the PID controller was an effective model of participants' decisions in noisy, changing environments. In Experiment 1, we reanalyzed a change-point detection experiment and showed that participants' behavior incorporated elements of PID updating. In Experiments 2-3, we developed a task with gradual transitions that we optimized to detect PID-like adjustments. In both experiments, the PID model offered better descriptions of behavioral adjustments than both the classical delta-rule model and its more sophisticated variant, the Kalman filter. We further examined how participants weighted different PID terms in response to salient environmental events, finding that these control terms were modulated by reward, surprise, and outcome entropy. These experiments provide preliminary evidence that adaptive learning in dynamic environments resembles PID control.
Collapse
Affiliation(s)
- Harrison Ritz
- Cognitive, Linguistic & Psychological Science, Brown University, Providence, RI
| | - Matthew R. Nassar
- Cognitive, Linguistic & Psychological Science, Brown University, Providence, RI
| | - Michael J. Frank
- Cognitive, Linguistic & Psychological Science, Brown University, Providence, RI
- Brown Institute for Brain Science, Brown University, Providence, RI
| | - Amitai Shenhav
- Cognitive, Linguistic & Psychological Science, Brown University, Providence, RI
- Brown Institute for Brain Science, Brown University, Providence, RI
| |
Collapse
|
42
|
Sweis BM, Thomas MJ, Redish AD. Beyond simple tests of value: measuring addiction as a heterogeneous disease of computation-specific valuation processes. ACTA ACUST UNITED AC 2018; 25:501-512. [PMID: 30115772 PMCID: PMC6097760 DOI: 10.1101/lm.047795.118] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2018] [Accepted: 07/06/2018] [Indexed: 12/13/2022]
Abstract
Addiction is considered to be a neurobiological disorder of learning and memory because addiction is capable of producing lasting changes in the brain. Recovering addicts chronically struggle with making poor decisions that ultimately lead to relapse, suggesting a view of addiction also as a neurobiological disorder of decision-making information processing. How the brain makes decisions depends on how decision-making processes access information stored as memories in the brain. Advancements in circuit-dissection tools and recent theories in neuroeconomics suggest that neurally dissociable valuation processes access distinct memories differently, and thus are uniquely susceptible as the brain changes during addiction. If addiction is to be considered a neurobiological disorder of memory, and thus decision-making, the heterogeneity with which information is both stored and processed must be taken into account in addiction studies. Addiction etiology can vary widely from person to person. We propose that addiction is not a single disease, nor simply a disorder of learning and memory, but rather a collection of symptoms of heterogeneous neurobiological diseases of distinct circuit-computation-specific decision-making processes.
Collapse
Affiliation(s)
- Brian M Sweis
- Graduate Program in Neuroscience and Medical Scientist Training Program, University of Minnesota, Minneapolis, Minnesota 55455, USA.,Department of Neuroscience, University of Minnesota, Minneapolis, Minnesota 55455, USA
| | - Mark J Thomas
- Department of Neuroscience, University of Minnesota, Minneapolis, Minnesota 55455, USA.,Department of Psychology, University of Minnesota, Minneapolis, Minnesota 55455, USA
| | - A David Redish
- Department of Neuroscience, University of Minnesota, Minneapolis, Minnesota 55455, USA
| |
Collapse
|
43
|
Massi B, Donahue CH, Lee D. Volatility Facilitates Value Updating in the Prefrontal Cortex. Neuron 2018; 99:598-608.e4. [PMID: 30033151 DOI: 10.1016/j.neuron.2018.06.033] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2018] [Revised: 05/13/2018] [Accepted: 06/21/2018] [Indexed: 01/24/2023]
Abstract
Adaptation of learning and decision-making might depend on the regulation of activity in the prefrontal cortex. Here we examined how volatility of reward probabilities influences learning and neural activity in the primate prefrontal cortex. We found that animals selected recently rewarded targets more often when reward probabilities of different options fluctuated across trials than when they were fixed. Additionally, neurons in the orbitofrontal cortex displayed more sustained activity related to the outcomes of their previous choices when reward probabilities changed over time. Such volatility also enhanced signals in the dorsolateral prefrontal cortex related to the current but not the previous location of the previously rewarded target. These results suggest that prefrontal activity related to choice and reward is dynamically regulated by the volatility of the environment and underscore the role of the prefrontal cortex in identifying aspects of the environment that are responsible for previous outcomes and should be learned.
Collapse
Affiliation(s)
- Bart Massi
- Interdeparmental Neuroscience Program, Yale School of Medicine, New Haven, CT 06510, USA
| | | | - Daeyeol Lee
- Interdeparmental Neuroscience Program, Yale School of Medicine, New Haven, CT 06510, USA; Department of Neuroscience, Yale School of Medicine, New Haven, CT 06510, USA; Department of Psychiatry, Yale School of Medicine, New Haven, CT 06510, USA; Kavli Institute for Neuroscience, Yale School of Medicine, New Haven, CT 06510, USA; Department of Psychology, Yale University, New Haven, CT 06520, USA.
| |
Collapse
|
44
|
Laboratory-induced learned helplessness attenuates approach motivation as indexed by posterior versus frontal theta activity. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2018; 17:904-916. [PMID: 28585017 DOI: 10.3758/s13415-017-0521-0] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/22/2023]
Abstract
Research suggests that midline posterior versus frontal electroencephalographic (EEG) theta activity (PFTA) may reflect a novel neurophysiological index of approach motivation. Elevated PFTA has been associated with approach-related tendencies both at rest and during laboratory tasks designed to enhance approach motivation. PFTA is sensitive to changes in dopamine signaling within the fronto-striatal neural circuit, which is centrally involved in approach motivation, reward processing, and goal-directed behavior. To date, however, no studies have examined PFTA during a laboratory task designed to reduce approach motivation or goal-directed behavior. Considerable animal and human research supports the hypothesis put forth by the learned helplessness theory that exposure to uncontrollable aversive stimuli decreases approach motivation by inducing a state of perceived uncontrollability. Accordingly, the present study examined the effect of perceived uncontrollability (i.e., learned helplessness) on PFTA. EEG data were collected from 74 participants (mean age = 19.21 years; 40 females) exposed to either Controllable (n = 26) or Uncontrollable (n = 25) aversive noise bursts, or a No-Noise Condition (n = 23). In line with prediction, individuals exposed to uncontrollable aversive noise bursts displayed a significant decrease in PFTA, reflecting reduced approach motivation, relative to both individuals exposed to controllable noise bursts or the No-Noise Condition. There was no relationship between perceived uncontrollability and frontal EEG alpha asymmetry, another commonly used neurophysiological index of approach motivation. Results have implications for understanding the neurophysiology of approach motivation and establishing PFTA as a neurophysiological index of approach-related tendencies.
Collapse
|
45
|
Mashhoori A, Hashemnia S, McNaughton BL, Euston DR, Gruber AJ. Rat anterior cingulate cortex recalls features of remote reward locations after disfavoured reinforcements. eLife 2018; 7:29793. [PMID: 29664400 PMCID: PMC5931797 DOI: 10.7554/elife.29793] [Citation(s) in RCA: 33] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2017] [Accepted: 04/04/2018] [Indexed: 12/30/2022] Open
Abstract
The anterior cingulate cortex (ACC) encodes information supporting mnemonic and cognitive processes. We show here that a rat’s position can be decoded with high spatiotemporal resolution from ACC activity. ACC neurons encoded the current state of the animal and task, except for brief excursions that sometimes occurred at target feeders. During excursions, the decoded position became more similar to a remote target feeder than the rat’s physical position. Excursions recruited activation of neurons encoding choice and reward, and the likelihood of excursions at a feeder was inversely correlated with feeder preference. These data suggest that the excursion phenomenon was related to evaluating real or fictive choice outcomes, particularly after disfavoured reinforcements. We propose that the multiplexing of position with choice-related information forms a mental model isomorphic with the task space, which can be mentally navigated via excursions to recall multimodal information about the utility of remote locations.
Collapse
Affiliation(s)
- Ali Mashhoori
- Canadian Centre for Behavioural Neuroscience, Department of Neuroscience, University of Lethbridge, Alberta, Canada
| | - Saeedeh Hashemnia
- Canadian Centre for Behavioural Neuroscience, Department of Neuroscience, University of Lethbridge, Alberta, Canada
| | - Bruce L McNaughton
- Canadian Centre for Behavioural Neuroscience, Department of Neuroscience, University of Lethbridge, Alberta, Canada
| | - David R Euston
- Canadian Centre for Behavioural Neuroscience, Department of Neuroscience, University of Lethbridge, Alberta, Canada
| | - Aaron J Gruber
- Canadian Centre for Behavioural Neuroscience, Department of Neuroscience, University of Lethbridge, Alberta, Canada
| |
Collapse
|
46
|
On the Flexibility of Basic Risk Attitudes in Monkeys. J Neurosci 2018; 38:4383-4398. [PMID: 29626169 DOI: 10.1523/jneurosci.2260-17.2018] [Citation(s) in RCA: 45] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2017] [Revised: 03/19/2018] [Accepted: 03/23/2018] [Indexed: 11/21/2022] Open
Abstract
Monkeys and other animals appear to share with humans two risk attitudes predicted by prospect theory: an inverse-S-shaped probability-weighting (PW) function and a steeper utility curve for losses than for gains. These findings suggest that such preferences are stable traits with common neural substrates. We hypothesized instead that animals tailor their preferences to subtle changes in task contexts, making risk attitudes flexible. Previous studies used a limited number of outcomes, trial types, and contexts. To gain a broader perspective, we examined two large datasets of male macaques' risky choices: one from a task with real (juice) gains and another from a token task with gains and losses. In contrast to previous findings, monkeys were risk seeking for both gains and losses (i.e., lacked a reflection effect) and showed steeper gain than loss curves (loss seeking). Utility curves for gains were substantially different in the two tasks. Monkeys showed nearly linear PWs in one task and S-shaped ones in the other; neither task produced a consistent inverse-S-shaped curve. To account for these observations, we developed and tested various computational models of the processes involved in the construction of reward value. We found that adaptive differential weighting of prospective gamble outcomes could partially account for the observed differences in the utility functions across the two experiments and thus provide a plausible mechanism underlying flexible risk attitudes. Together, our results support the idea that risky choices are constructed flexibly at the time of elicitation and place important constraints on neural models of economic choice.SIGNIFICANCE STATEMENT We respond in reliable ways to risk, but are our risk preferences stable traits or ephemeral states? Using various computational models, we examined two large datasets of macaque risky choices in two different tasks. We observed several deviations from "classic" risk preferences seen in humans and monkeys: no reflection effect, loss seeking as opposed to loss aversion, and linear and S-shaped, as opposed to inverse-S-shaped, probability distortion. These results challenge the idea that our risk attitudes are evolved traits shared with the last common ancestor of macaques and humans, suggesting instead that behavioral flexibility is the hallmark of risky choice in primates. We show how this flexibility can emerge partly as a result of interactions between attentional and reward systems.
Collapse
|
47
|
Abstract
Activity in a network of areas spanning the superior temporal sulcus, dorsomedial frontal cortex, and anterior cingulate cortex is concerned with how nonhuman primates negotiate the social worlds in which they live. Central aspects of these circuits are retained in humans. Activity in these areas codes for primates' interactions with one another, their attempts to find out about one another, and their attempts to prevent others from finding out too much about themselves. Moreover, important features of the social world, such as dominance status, cooperation, and competition, modulate activity in these areas. We consider the degree to which activity in these regions is simply encoding an individual's own actions and choices or whether this activity is especially and specifically concerned with social cognition. Recent advances in comparative anatomy and computational modeling may help us to gain deeper insights into the nature and boundaries of primate social cognition.
Collapse
Affiliation(s)
- Marco K Wittmann
- Department of Experimental Psychology, University of Oxford, OX1 3UD Oxford, United Kingdom; , , .,Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, OX1 3UD Oxford, United Kingdom
| | - Patricia L Lockwood
- Department of Experimental Psychology, University of Oxford, OX1 3UD Oxford, United Kingdom; , , .,Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, OX1 3UD Oxford, United Kingdom
| | - Matthew F S Rushworth
- Department of Experimental Psychology, University of Oxford, OX1 3UD Oxford, United Kingdom; , , .,Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, OX1 3UD Oxford, United Kingdom
| |
Collapse
|
48
|
Delgado MR, Beer JS, Fellows LK, Huettel SA, Platt ML, Quirk GJ, Schiller D. Viewpoints: Dialogues on the functional role of the ventromedial prefrontal cortex. Nat Neurosci 2018; 19:1545-1552. [PMID: 27898086 DOI: 10.1038/nn.4438] [Citation(s) in RCA: 110] [Impact Index Per Article: 18.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Affiliation(s)
| | - Jennifer S Beer
- Department of Psychology, University of Texas at Austin, Austin, Texas, USA
| | - Lesley K Fellows
- Department of Neurology &Neurosurgery, McGill University, Montreal, Canada
| | - Scott A Huettel
- Department of Psychology &Neuroscience, Duke University, Durham, North Carolina, USA
| | - Michael L Platt
- Department of Neuroscience, University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | - Gregory J Quirk
- Departments of Psychiatry and Anatomy &Neurobiology, University of Puerto Rico, San Juan, Puerto Rico, USA
| | - Daniela Schiller
- Departments of Psychiatry and Neuroscience and the Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| |
Collapse
|
49
|
Loh E, Kurth-Nelson Z, Berron D, Dayan P, Duzel E, Dolan R, Guitart-Masip M. Parsing the Role of the Hippocampus in Approach-Avoidance Conflict. Cereb Cortex 2018; 27:201-215. [PMID: 27993819 PMCID: PMC5939226 DOI: 10.1093/cercor/bhw378] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2016] [Accepted: 11/11/2016] [Indexed: 01/07/2023] Open
Abstract
The hippocampus plays a central role in the approach-avoidance conflict that is central to the genesis of anxiety. However, its exact functional contribution has yet to be identified. We designed a novel gambling task that generated approach-avoidance conflict while controlling for spatial processing. We fit subjects' behavior using a model that quantified the subjective values of choice options, and recorded neural signals using functional magnetic resonance imaging (fMRI). Distinct functional signals were observed in anterior hippocampus, with inferior hippocampus selectively recruited when subjects rejected a gamble, to a degree that covaried with individual differences in anxiety. The superior anterior hippocampus, in contrast, uniquely demonstrated value signals that were potentiated in the context of approach-avoidance conflict. These results implicate the anterior hippocampus in behavioral avoidance and choice monitoring, in a manner relevant to understanding its role in anxiety. Our findings highlight interactions between subregions of the hippocampus as an important focus for future study.
Collapse
Affiliation(s)
- Eleanor Loh
- Wellcome Trust Centre for Neuroimaging, University College London, London WC1n 3BG, UK
| | - Zeb Kurth-Nelson
- Wellcome Trust Centre for Neuroimaging, University College London, London WC1n 3BG, UK.,Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London WC1B 5EH, UK
| | - David Berron
- Institute of Cognitive Neurology and Dementia Research, Otto-von-Guericke University, D-39120 Magdeburg, Germany
| | - Peter Dayan
- Gatsby Computational Neuroscience Unit, University College London, London W1T 4JG, UK
| | - Emrah Duzel
- Institute of Cognitive Neurology and Dementia Research, Otto-von-Guericke University, D-39120 Magdeburg, Germany.,Institute of Cognitive Neuroscience, University College London, London WC1N 3AR, UK
| | - Ray Dolan
- Wellcome Trust Centre for Neuroimaging, University College London, London WC1n 3BG, UK.,Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London WC1B 5EH, UK
| | - Marc Guitart-Masip
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London WC1B 5EH, UK.,Ageing Research Centre, Karolinska Institute Stockholm, SE-11330 Stockholm, Sweden
| |
Collapse
|
50
|
Boschin EA, Brkic MM, Simons JS, Buckley MJ. Distinct Roles for the Anterior Cingulate and Dorsolateral Prefrontal Cortices During Conflict Between Abstract Rules. Cereb Cortex 2018; 27:34-45. [PMID: 28365775 PMCID: PMC5939207 DOI: 10.1093/cercor/bhw350] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2016] [Indexed: 11/14/2022] Open
Abstract
Distinct patterns of activity within the anterior cingulate cortex (ACC) and dorsolateral prefrontal cortex (dlPFC) reported in neuroimaging studies during tasks involving conflict between competing responses have often been cited as evidence for their key contributions to conflict-monitoring and behavioral adaptation, respectively. However, supporting evidence from neuropsychological patients has been scarce and contradictory. We administered a well-studied analog of the Wisconsin Card Sorting Test, designed to elicit conflict between 2 abstract rules, to a cohort of 6 patients with damage to ACC or dlPFC. Patients who had sustained more significant damage to the ACC were not impaired either on a measure of "conflict cost" nor on measures of "conflict-induced behavioral adaptation." In contrast, damage to dlPFC did not affect the conflict cost measure but abolished the patients' ability to adapt their behavior following exposure to conflict, compared with controls. This pattern of results complements the findings from nonhuman primates with more circumscribed lesions to ACC or dlPFC on the same task and provides converging evidence that ACC is not necessary for performance when conflict is elicited between 2 abstract rules, whereas dlPFC plays a fundamental role in behavioral adaptation.
Collapse
Affiliation(s)
- Erica A Boschin
- Department of Experimental Psychology, University of Oxford, Oxford OX1 3UD, UK
| | - Merima M Brkic
- Department of Experimental Psychology, University of Oxford, Oxford OX1 3UD, UK
| | - Jon S Simons
- Department of Psychology, University of Cambridge, Cambridge CB2 3EB, UK
| | - Mark J Buckley
- Department of Experimental Psychology, University of Oxford, Oxford OX1 3UD, UK
| |
Collapse
|