1
|
Gladys HJ, Jiayi Z, Bonetti L, Peng Hian WL, Vuust P, Agres K, Chen SHA. Understanding Music and Aging through the lens of Bayesian Inference. Neurosci Biobehav Rev 2024:105768. [PMID: 38908730 DOI: 10.1016/j.neubiorev.2024.105768] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2024] [Revised: 06/05/2024] [Accepted: 06/10/2024] [Indexed: 06/24/2024]
Abstract
Bayesian inference has recently gained momentum in explaining music perception and aging. A fundamental mechanism underlying Bayesian inference is the notion of prediction. This framework could explain how predictions pertaining to musical (melodic, rhythmic, harmonic) structures engender action, emotion, and learning, expanding related concepts of music research, such as musical expectancies, groove, pleasure, and tension. Moreover, a Bayesian perspective of music perception may shed new insights on the beneficial effects of music in aging. Aging could be framed as an optimization process of Bayesian inference. As predictive inferences refine over time, the reliance on consolidated priors increases, while the updating of prior models through Bayesian inference attenuates. This may affect the ability of older adults to estimate uncertainties in their environment, limiting their cognitive and behavioral repertoire. With Bayesian inference as an overarching framework, this review synthesizes the literature on predictive inferences in music and aging, and details how music could be a promising tool in preventive and rehabilitative interventions for older adults through the lens of Bayesian inference.
Collapse
Affiliation(s)
- Heng Jiamin Gladys
- School of Computer Science and Engineering, Nanyang Technological University, Singapore.
| | - Zhang Jiayi
- Interdisciplinary Graduate Program, Nanyang Technological University, Singapore
| | - Leonardo Bonetti
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music, Aarhus/Aalborg, Denmark; Centre for Eudaimonia and Human Flourishing, Linacre College, University of Oxford, United Kingdom; Department of Psychiatry, University of Oxford, United Kingdom; Department of Psychology, University of Bologna, Italy
| | | | - Peter Vuust
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music, Aarhus/Aalborg, Denmark
| | - Kat Agres
- Centre for Music and Health, National University of Singapore, Singapore; Yong Siew Toh Conservatory of Music, National University of Singapore, Singapore
| | - S H Annabel Chen
- School of Social Sciences, Nanyang Technological University, Singapore; Centre for Research and Development in Learning, Nanyang Technological University, Singapore; Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore; National Institute of Education, Nanyang Technological University, Singapore.
| |
Collapse
|
2
|
Kang P, Tobler PN, Dayan P. Bayesian reinforcement learning: A basic overview. Neurobiol Learn Mem 2024; 211:107924. [PMID: 38579896 DOI: 10.1016/j.nlm.2024.107924] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Revised: 03/21/2024] [Accepted: 04/02/2024] [Indexed: 04/07/2024]
Abstract
We and other animals learn because there is some aspect of the world about which we are uncertain. This uncertainty arises from initial ignorance, and from changes in the world that we do not perfectly know; the uncertainty often becomes evident when our predictions about the world are found to be erroneous. The Rescorla-Wagner learning rule, which specifies one way that prediction errors can occasion learning, has been hugely influential as a characterization of Pavlovian conditioning and, through its equivalence to the delta rule in engineering, in a much wider class of learning problems. Here, we review the embedding of the Rescorla-Wagner rule in a Bayesian context that is precise about the link between uncertainty and learning, and thereby discuss extensions to such suggestions as the Kalman filter, structure learning, and beyond, that collectively encompass a wider range of uncertainties and accommodate a wider assortment of phenomena in conditioning.
Collapse
Affiliation(s)
- Pyungwon Kang
- University of Zurich, Department of Economics, Laboratory for Social and Neural Systems Research, Zurich, Switzerland.
| | - Philippe N Tobler
- University of Zurich, Department of Economics, Laboratory for Social and Neural Systems Research, Zurich, Switzerland.
| | - Peter Dayan
- Max Planck Institute for Biological Cybernetics, Tübingen, Germany; University of Tübingen, Tübingen Germany.
| |
Collapse
|
3
|
Chakraborty S, Lee SK, Arnold SM, Haast RAM, Khan AR, Schmitz TW. Focal acetylcholinergic modulation of the human midcingulo-insular network during attention: Meta-analytic neuroimaging and behavioral evidence. J Neurochem 2024; 168:397-413. [PMID: 37864501 DOI: 10.1111/jnc.15990] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2023] [Revised: 09/18/2023] [Accepted: 09/26/2023] [Indexed: 10/23/2023]
Abstract
The basal forebrain cholinergic neurons provide acetylcholine to the cortex via large projections. Recent molecular imaging work in humans indicates that the cortical cholinergic innervation is not uniformly distributed, but rather may disproportionately innervate cortical areas relevant to supervisory attention. In this study, we therefore reexamined the spatial relationship between acetylcholinergic modulation and attention in the human cortex using meta-analytic strategies targeting both pharmacological and non-pharmacological neuroimaging studies. We found that pharmaco-modulation of acetylcholine evoked both increased activity in the anterior cingulate and decreased activity in the opercular and insular cortex. In large independent meta-analyses of non-pharmacological neuroimaging research, we demonstrate that during attentional engagement these cortical areas exhibit (1) task-related co-activation with the basal forebrain, (2) task-related co-activation with one another, and (3) spatial overlap with dense cholinergic innervations originating from the basal forebrain, as estimated by multimodal positron emission tomography and magnetic resonance imaging. Finally, we provide meta-analytic evidence that pharmaco-modulation of acetylcholine also induces a speeding of responses to targets with no apparent tradeoff in accuracy. In sum, we demonstrate in humans that acetylcholinergic modulation of midcingulo-insular hubs of the ventral attention/salience network via basal forebrain afferents may coordinate selection of task relevant information, thereby facilitating cognition and behavior.
Collapse
Affiliation(s)
- Sudesna Chakraborty
- Neuroscience Graduate Program, Western University, London, Ontario, Canada
- Department of Medical Biophysics, Western University, London, Ontario, Canada
- Robarts Research Institute, Western University, London, Ontario, Canada
- Western Institute for Neuroscience, Western University, London, Ontario, Canada
| | - Sun Kyun Lee
- Western Institute for Neuroscience, Western University, London, Ontario, Canada
- Faculty of Dentistry, University of Toronto, Toronto, Ontario, Canada
| | - Sarah M Arnold
- Western Institute for Neuroscience, Western University, London, Ontario, Canada
- Department of Chemical Engineering, McMaster University, Hamilton, Ontario, Canada
| | - Roy A M Haast
- Western Institute for Neuroscience, Western University, London, Ontario, Canada
- CRMBM, CNRS UMR 7339, Aix-Marseille University, Marseille, France
| | - Ali R Khan
- Department of Medical Biophysics, Western University, London, Ontario, Canada
- Robarts Research Institute, Western University, London, Ontario, Canada
- Western Institute for Neuroscience, Western University, London, Ontario, Canada
| | - Taylor W Schmitz
- Robarts Research Institute, Western University, London, Ontario, Canada
- Western Institute for Neuroscience, Western University, London, Ontario, Canada
- Department of Physiology and Pharmacology, Western University, London, Ontario, Canada
- Lawson Health Research Institute, London, Ontario, Canada
| |
Collapse
|
4
|
Hodson R, Mehta M, Smith R. The empirical status of predictive coding and active inference. Neurosci Biobehav Rev 2024; 157:105473. [PMID: 38030100 DOI: 10.1016/j.neubiorev.2023.105473] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Revised: 10/27/2023] [Accepted: 11/16/2023] [Indexed: 12/01/2023]
Abstract
Research on predictive processing models has focused largely on two specific algorithmic theories: Predictive Coding for perception and Active Inference for decision-making. While these interconnected theories possess broad explanatory potential, they have only recently begun to receive direct empirical evaluation. Here, we review recent studies of Predictive Coding and Active Inference with a focus on evaluating the degree to which they are empirically supported. For Predictive Coding, we find that existing empirical evidence offers modest support. However, some positive results can also be explained by alternative feedforward (e.g., feature detection-based) models. For Active Inference, most empirical studies have focused on fitting these models to behavior as a means of identifying and explaining individual or group differences. While Active Inference models tend to explain behavioral data reasonably well, there has not been a focus on testing empirical validity of active inference theory per se, which would require formal comparison to other models (e.g., non-Bayesian or model-free reinforcement learning models). This review suggests that, while promising, a number of specific research directions are still necessary to evaluate the empirical adequacy and explanatory power of these algorithms.
Collapse
Affiliation(s)
| | | | - Ryan Smith
- Laureate Institute for Brain Research, USA.
| |
Collapse
|
5
|
Fernández Velasco P, Loev S. Metacognitive Feelings: A Predictive-Processing Perspective. PERSPECTIVES ON PSYCHOLOGICAL SCIENCE 2024:17456916231221976. [PMID: 38285929 DOI: 10.1177/17456916231221976] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/31/2024]
Abstract
Metacognitive feelings are affective experiences that concern the subject's mental processes and capacities. Paradigmatic examples include the feeling of familiarity, the feeling of confidence, or the tip-of-the-tongue experience. In this article, we advance an account of metacognitive feelings based on the predictive-processing framework. The core tenet of predictive processing is that the brain is a hierarchical hypothesis-testing mechanism, predicting sensory input on the basis of prior experience and updating predictions on the basis of the incoming prediction error. According to the proposed account, metacognitive feelings arise out of a process in which visceral changes serve as cues to predict the error dynamics relating to a particular mental process. The expected rate of prediction-error reduction corresponds to the valence at the core of the emerging metacognitive feeling. Metacognitive feelings use prediction dynamics to model the agent's situation in a way that is both descriptive and directive. Thus, metacognitive feelings are not only an appraisal of ongoing cognitive performance but also a set of action policies. These action policies span predictive trajectories across bodily action, mental action, and interoceptive changes, which together transform the epistemic landscape within which metacognitive feelings unfold.
Collapse
Affiliation(s)
| | - Slawa Loev
- Philosophy of Science and the Study of Religion, Ludwig Maximilian University of Munich
| |
Collapse
|
6
|
Yasoda-Mohan A, Vanneste S. Development, Insults and Predisposing Factors of the Brain's Predictive Coding System to Chronic Perceptual Disorders-A Life-Course Examination. Brain Sci 2024; 14:86. [PMID: 38248301 PMCID: PMC10813926 DOI: 10.3390/brainsci14010086] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Revised: 01/08/2024] [Accepted: 01/09/2024] [Indexed: 01/23/2024] Open
Abstract
The predictive coding theory is currently widely accepted as the theoretical basis of perception and chronic perceptual disorders are explained as the maladaptive compensation of the brain to a prediction error. Although this gives us a general framework to work with, it is still not clear who may be more susceptible and/or vulnerable to aberrations in this system. In this paper, we study changes in predictive coding through the lens of tinnitus and pain. We take a step back to understand how the predictive coding system develops from infancy, what are the different neural and bio markers that characterise this system in the acute, transition and chronic phases and what may be the factors that pose a risk to the aberration of this system. Through this paper, we aim to identify people who may be at a higher risk of developing chronic perceptual disorders as a reflection of aberrant predictive coding, thereby giving future studies more facets to incorporate in their investigation of early markers of tinnitus, pain and other disorders of predictive coding. We therefore view this paper to encourage the thinking behind the development of preclinical biomarkers to maladaptive predictive coding.
Collapse
Affiliation(s)
- Anusha Yasoda-Mohan
- Global Brain Health Institute, Trinity College Dublin, D02 R123 Dublin, Ireland;
- Trinity College Institute for Neuroscience, Trinity College Dublin, D02 R123 Dublin, Ireland
- Lab for Clinical & Integrative Neuroscience, School of Psychology, Trinity College Dublin, D02 R123 Dublin, Ireland
| | - Sven Vanneste
- Global Brain Health Institute, Trinity College Dublin, D02 R123 Dublin, Ireland;
- Trinity College Institute for Neuroscience, Trinity College Dublin, D02 R123 Dublin, Ireland
- Lab for Clinical & Integrative Neuroscience, School of Psychology, Trinity College Dublin, D02 R123 Dublin, Ireland
| |
Collapse
|
7
|
Bottemanne H, Berkovitch L, Gauld C, Balcerac A, Schmidt L, Mouchabac S, Fossati P. Storm on predictive brain: A neurocomputational account of ketamine antidepressant effect. Neurosci Biobehav Rev 2023; 154:105410. [PMID: 37793581 DOI: 10.1016/j.neubiorev.2023.105410] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2023] [Revised: 08/24/2023] [Accepted: 09/26/2023] [Indexed: 10/06/2023]
Abstract
For the past decade, ketamine, an N-methyl-D-aspartate receptor (NMDAr) antagonist, has been considered a promising treatment for major depressive disorder (MDD). Unlike the delayed effect of monoaminergic treatment, ketamine may produce fast-acting antidepressant effects hours after a single administration at subanesthetic dose. Along with these antidepressant effects, it may also induce transient dissociative (disturbing of the sense of self and reality) symptoms during acute administration which resolve within hours. To understand ketamine's rapid-acting antidepressant effect, several biological hypotheses have been explored, but despite these promising avenues, there is a lack of model to understand the timeframe of antidepressant and dissociative effects of ketamine. In this article, we propose a neurocomputational account of ketamine's antidepressant and dissociative effects based on the Predictive Processing (PP) theory, a framework for cognitive and sensory processing. PP theory suggests that the brain produces top-down predictions to process incoming sensory signals, and generates bottom-up prediction errors (PEs) which are then used to update predictions. This iterative dynamic neural process would relies on N-methyl-D-aspartate (NMDAr) and α-amino-3-hydroxy-5-methyl-4-isoxazole-propionic receptors (AMPAr), two major component of the glutamatergic signaling. Furthermore, it has been suggested that MDD is characterized by over-rigid predictions which cannot be updated by the PEs, leading to miscalibration of hierarchical inference and self-reinforcing negative feedback loops. Based on former empirical studies using behavioral paradigms, neurophysiological recordings, and computational modeling, we suggest that ketamine impairs top-down predictions by blocking NMDA receptors, and enhances presynaptic glutamate release and PEs, producing transient dissociative symptoms and fast-acting antidepressant effect in hours following acute administration. Moreover, we present data showing that ketamine may enhance a delayed neural plasticity pathways through AMPAr potentiation, triggering a prolonged antidepressant effect up to seven days for unique administration. Taken together, the two sides of antidepressant effects with distinct timeframe could constitute the keystone of antidepressant properties of ketamine. These PP disturbances may also participate to a ketamine-induced time window of mental flexibility, which can be used to improve the psychotherapeutic process. Finally, these proposals could be used as a theoretical framework for future research into fast-acting antidepressants, and combination with existing antidepressant and psychotherapy.
Collapse
Affiliation(s)
- Hugo Bottemanne
- Paris Brain Institute - Institut du Cerveau (ICM), UMR 7225 / UMRS 1127, Sorbonne University / CNRS / INSERM, Paris, France; Sorbonne University, Department of Philosophy, Science Norm Democracy Research Unit, UMR, 8011, Paris, France; Sorbonne University, Department of Psychiatry, Pitié-Salpêtrière Hospital, Assistance Publique-Hôpitaux de Paris (AP-HP), Paris, France.
| | - Lucie Berkovitch
- Saclay CEA Centre, Neurospin, Gif-Sur-Yvette Cedex, France; Department of Psychiatry, GHU Paris Psychiatrie et Neurosciences, Service Hospitalo-Universitaire, Paris, France
| | - Christophe Gauld
- Department of Child Psychiatry, CHU de Lyon, F-69000 Lyon, France; Institut des Sciences Cognitives Marc Jeannerod, UMR 5229 CNRS & Université Claude Bernard Lyon 1, F-69000 Lyon, France
| | - Alexander Balcerac
- Paris Brain Institute - Institut du Cerveau (ICM), UMR 7225 / UMRS 1127, Sorbonne University / CNRS / INSERM, Paris, France; Sorbonne University, Department of Neurology, Pitié-Salpêtrière Hospital, Assistance Publique-Hôpitaux de Paris (AP-HP), Paris, France
| | - Liane Schmidt
- Paris Brain Institute - Institut du Cerveau (ICM), UMR 7225 / UMRS 1127, Sorbonne University / CNRS / INSERM, Paris, France
| | - Stephane Mouchabac
- Paris Brain Institute - Institut du Cerveau (ICM), UMR 7225 / UMRS 1127, Sorbonne University / CNRS / INSERM, Paris, France; Sorbonne University, Department of Psychiatry, Saint-Antoine Hospital, Assistance Publique-Hôpitaux de Paris (AP-HP), Paris, France
| | - Philippe Fossati
- Paris Brain Institute - Institut du Cerveau (ICM), UMR 7225 / UMRS 1127, Sorbonne University / CNRS / INSERM, Paris, France; Sorbonne University, Department of Philosophy, Science Norm Democracy Research Unit, UMR, 8011, Paris, France
| |
Collapse
|
8
|
Xia X, Guo M, Wang L. Learning of irrelevant stimulus-response associations modulates cognitive control. Neuroimage 2023; 276:120206. [PMID: 37263453 DOI: 10.1016/j.neuroimage.2023.120206] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2023] [Revised: 05/28/2023] [Accepted: 05/29/2023] [Indexed: 06/03/2023] Open
Abstract
It has been shown that manipulating the proportion of congruent to incongruent trials in conflict tasks (e.g., Stroop, Simon, and flanker tasks) can vary the size of conflict effects, however, by two different mechanisms. One theory is the control learning account (the brain learns the probability of conflict and uses it to proactively adjust the control demand for future trials). The other is the irrelevant stimulus-response learning account (the brain learns the probability of irrelevant stimulus-response associations and uses it to prepare responses). Previous fMRI studies have detected the brain regions that contribute to the control-learning-modulated conflict effects, but it is less known what neural substrates underlie the conflict effects modulated by irrelevant S-R learning. We here investigated this question with a model-based fMRI study, in which the proportion of congruent to incongruent trials changed dynamically in the Simon task and the models learned the probability of irrelevant S-R associations quantitatively. Behavioral analyses showed that the unsigned prediction errors (PEs) of responses generated by the learning models correlated with reaction times irrespective of congruent and incongruent trials, indicating that large unsigned PEs associated with slow responses. The fMRI results showed that the regions of fronto-parietal and cingulo-opercular network involved in cognitive control were significantly modulated by the unsigned PEs, also irrespective of congruent and incongruent trials, indicating that large unsigned PEs associated with transiently increased activity in these regions. These results together suggest that learning of irrelevant S-R associations modulates reactive control, which demonstrates a new way to modulate cognitive control compared to the control learning account.
Collapse
Affiliation(s)
- Xiaokai Xia
- Center for Studies of Psychological Application and School of Psychology, Key Laboratory of Mental Health and Cognitive Science of Guangdong Province, Key Laboratory of Brain, Cognition and Education Sciences of Ministry of Education, South China Normal University, Guangzhou 510631, China
| | - Mingqian Guo
- Center for Studies of Psychological Application and School of Psychology, Key Laboratory of Mental Health and Cognitive Science of Guangdong Province, Key Laboratory of Brain, Cognition and Education Sciences of Ministry of Education, South China Normal University, Guangzhou 510631, China
| | - Ling Wang
- Center for Studies of Psychological Application and School of Psychology, Key Laboratory of Mental Health and Cognitive Science of Guangdong Province, Key Laboratory of Brain, Cognition and Education Sciences of Ministry of Education, South China Normal University, Guangzhou 510631, China.
| |
Collapse
|
9
|
Hanssen R, Rigoux L, Kuzmanovic B, Iglesias S, Kretschmer AC, Schlamann M, Albus K, Edwin Thanarajah S, Sitnikow T, Melzer C, Cornely OA, Brüning JC, Tittgemeyer M. Liraglutide restores impaired associative learning in individuals with obesity. Nat Metab 2023; 5:1352-1363. [PMID: 37592007 PMCID: PMC10447249 DOI: 10.1038/s42255-023-00859-y] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/30/2022] [Accepted: 07/07/2023] [Indexed: 08/19/2023]
Abstract
Survival under selective pressure is driven by the ability of our brain to use sensory information to our advantage to control physiological needs. To that end, neural circuits receive and integrate external environmental cues and internal metabolic signals to form learned sensory associations, consequently motivating and adapting our behaviour. The dopaminergic midbrain plays a crucial role in learning adaptive behaviour and is particularly sensitive to peripheral metabolic signals, including intestinal peptides, such as glucagon-like peptide 1 (GLP-1). In a single-blinded, randomized, controlled, crossover basic human functional magnetic resonance imaging study relying on a computational model of the adaptive learning process underlying behavioural responses, we show that adaptive learning is reduced when metabolic sensing is impaired in obesity, as indexed by reduced insulin sensitivity (participants: N = 30 with normal insulin sensitivity; N = 24 with impaired insulin sensitivity). Treatment with the GLP-1 receptor agonist liraglutide normalizes impaired learning of sensory associations in men and women with obesity. Collectively, our findings reveal that GLP-1 receptor activation modulates associative learning in people with obesity via its central effects within the mesoaccumbens pathway. These findings provide evidence for how metabolic signals can act as neuromodulators to adapt our behaviour to our body's internal state and how GLP-1 receptor agonists work in clinics.
Collapse
Affiliation(s)
- Ruth Hanssen
- Max Planck Institute for Metabolism Research, Cologne, Germany
- Faculty of Medicine and University Hospital Cologne, Policlinic for Endocrinology, Diabetology and Preventive Medicine (PEPD), University of Cologne, Cologne, Germany
| | - Lionel Rigoux
- Max Planck Institute for Metabolism Research, Cologne, Germany
| | | | - Sandra Iglesias
- Translational Neuromodeling Unit, Institute for Biomedical Engineering, University of Zurich and Swiss Federal Institute of Technology, Zurich, Switzerland
| | - Alina C Kretschmer
- Faculty of Medicine and University Hospital Cologne, Department I of Internal Medicine, Center for Integrated Oncology Aachen Bonn Cologne Duesseldorf (CIO ABCD) and Excellence Center for Medical Mycology (ECMM), University of Cologne, Cologne, Germany
| | - Marc Schlamann
- Faculty of Medicine and University Hospital Cologne, Institute for Diagnostic and Interventional Radiology, University of Cologne, Cologne, Germany
| | - Kerstin Albus
- Cologne Excellence Cluster on Cellular Stress Responses in Aging-Associated Diseases (CECAD), University of Cologne, Cologne, Germany
| | - Sharmili Edwin Thanarajah
- Max Planck Institute for Metabolism Research, Cologne, Germany
- Department of Psychiatry, Psychosomatic Medicine and Psychotherapy, University Hospital Frankfurt, Frankfurt am Main, Germany
| | - Tamara Sitnikow
- Faculty of Medicine and University Hospital Cologne, Policlinic for Endocrinology, Diabetology and Preventive Medicine (PEPD), University of Cologne, Cologne, Germany
| | - Corina Melzer
- Max Planck Institute for Metabolism Research, Cologne, Germany
| | - Oliver A Cornely
- Faculty of Medicine and University Hospital Cologne, Department I of Internal Medicine, Center for Integrated Oncology Aachen Bonn Cologne Duesseldorf (CIO ABCD) and Excellence Center for Medical Mycology (ECMM), University of Cologne, Cologne, Germany
- Cologne Excellence Cluster on Cellular Stress Responses in Aging-Associated Diseases (CECAD), University of Cologne, Cologne, Germany
- German Centre for Infection Research (DZIF), Partner Site Bonn-Cologne, Cologne, Germany
- Faculty of Medicine and University Hospital Cologne, Clinical Trials Centre Cologne (ZKS Köln), University of Cologne, Cologne, Germany
| | - Jens C Brüning
- Max Planck Institute for Metabolism Research, Cologne, Germany
- Faculty of Medicine and University Hospital Cologne, Policlinic for Endocrinology, Diabetology and Preventive Medicine (PEPD), University of Cologne, Cologne, Germany
- Cologne Excellence Cluster on Cellular Stress Responses in Aging-Associated Diseases (CECAD), University of Cologne, Cologne, Germany
| | - Marc Tittgemeyer
- Max Planck Institute for Metabolism Research, Cologne, Germany.
- Cologne Excellence Cluster on Cellular Stress Responses in Aging-Associated Diseases (CECAD), University of Cologne, Cologne, Germany.
| |
Collapse
|
10
|
Mikus N, Eisenegger C, Mathys C, Clark L, Müller U, Robbins TW, Lamm C, Naef M. Blocking D2/D3 dopamine receptors in male participants increases volatility of beliefs when learning to trust others. Nat Commun 2023; 14:4049. [PMID: 37422466 PMCID: PMC10329681 DOI: 10.1038/s41467-023-39823-5] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Accepted: 06/29/2023] [Indexed: 07/10/2023] Open
Abstract
The ability to learn about other people is crucial for human social functioning. Dopamine has been proposed to regulate the precision of beliefs, but direct behavioural evidence of this is lacking. In this study, we investigate how a high dose of the D2/D3 dopamine receptor antagonist sulpiride impacts learning about other people's prosocial attitudes in a repeated Trust game. Using a Bayesian model of belief updating, we show that in a sample of 76 male participants sulpiride increases the volatility of beliefs, which leads to higher precision weights on prediction errors. This effect is driven by participants with genetically conferred higher dopamine availability (Taq1a polymorphism) and remains even after controlling for working memory performance. Higher precision weights are reflected in higher reciprocal behaviour in the repeated Trust game but not in single-round Trust games. Our data provide evidence that the D2 receptors are pivotal in regulating prediction error-driven belief updating in a social context.
Collapse
Affiliation(s)
- Nace Mikus
- Department of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria.
- Interacting Minds Centre, Aarhus University, Aarhus, Denmark.
| | - Christoph Eisenegger
- Department of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria
- Behavioural and Clinical Neuroscience Institute and Department of Psychology, University of Cambridge, Cambridge, UK
| | - Christoph Mathys
- Interacting Minds Centre, Aarhus University, Aarhus, Denmark
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
- Scuola Internazionale Superiore di Studi Avanzati (SISSA), Trieste, Italy
| | - Luke Clark
- Centre for Gambling Research at UBC, Department of Psychology, University of British, Columbia, Vancouver, BC, Canada
- Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, BC, Canada
| | - Ulrich Müller
- Behavioural and Clinical Neuroscience Institute and Department of Psychology, University of Cambridge, Cambridge, UK
- Adult Neurodevelopmental Services, Health & Community Services, Government of Jersey, St Helier, Jersey
| | - Trevor W Robbins
- Behavioural and Clinical Neuroscience Institute and Department of Psychology, University of Cambridge, Cambridge, UK
| | - Claus Lamm
- Department of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria.
| | - Michael Naef
- Department of Economics, University of Durham, Durham, UK.
| |
Collapse
|
11
|
Sapey-Triomphe LA, Pattyn L, Weilnhammer V, Sterzer P, Wagemans J. Neural correlates of hierarchical predictive processes in autistic adults. Nat Commun 2023; 14:3640. [PMID: 37336874 DOI: 10.1038/s41467-023-38580-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2021] [Accepted: 05/08/2023] [Indexed: 06/21/2023] Open
Abstract
Bayesian theories of autism spectrum disorders (ASD) suggest that atypical predictive mechanisms could underlie the autistic symptomatology, but little is known about their neural correlates. Twenty-six neurotypical (NT) and 26 autistic adults participated in an fMRI study where they performed an associative learning task in a volatile environment. By inverting a model of perceptual inference, we characterized the neural correlates of hierarchically structured predictions and prediction errors in ASD. Behaviorally, the predictive abilities of autistic adults were intact. Neurally, predictions were encoded hierarchically in both NT and ASD participants and biased their percepts. High-level predictions were following activity levels in a set of regions more closely in ASD than NT. Prediction errors yielded activation in shared regions in NT and ASD, but group differences were found in the anterior cingulate cortex and putamen. This study sheds light on the neural specificities of ASD that might underlie atypical predictive processing.
Collapse
Affiliation(s)
- Laurie-Anne Sapey-Triomphe
- Department of Brain and Cognition, Leuven Brain Institute, KU Leuven, 3000, Leuven, Belgium.
- Leuven Autism Research (LAuRes), KU Leuven, 3000, Leuven, Belgium.
| | - Lauren Pattyn
- Department of Brain and Cognition, Leuven Brain Institute, KU Leuven, 3000, Leuven, Belgium
| | - Veith Weilnhammer
- Department of Psychiatry, Charité-Universitätsmedizin Berlin, 10117, Berlin, Germany
- Berlin Institute of Health, Charité-Universitätsmedizin Berlin, 10178, Berlin, Germany
| | - Philipp Sterzer
- Department of Psychiatry, Charité-Universitätsmedizin Berlin, 10117, Berlin, Germany
- Berlin Institute of Health, Charité-Universitätsmedizin Berlin, 10178, Berlin, Germany
| | - Johan Wagemans
- Department of Brain and Cognition, Leuven Brain Institute, KU Leuven, 3000, Leuven, Belgium
- Leuven Autism Research (LAuRes), KU Leuven, 3000, Leuven, Belgium
| |
Collapse
|
12
|
Hassani S, Neumann A, Russell J, Jones C, Womelsdorf T. M 1-selective muscarinic allosteric modulation enhances cognitive flexibility and effective salience in nonhuman primates. Proc Natl Acad Sci U S A 2023; 120:e2216792120. [PMID: 37104474 PMCID: PMC10161096 DOI: 10.1073/pnas.2216792120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2022] [Accepted: 03/21/2023] [Indexed: 04/28/2023] Open
Abstract
Acetylcholine (ACh) in cortical neural circuits mediates how selective attention is sustained in the presence of distractors and how flexible cognition adjusts to changing task demands. The cognitive domains of attention and cognitive flexibility might be differentially supported by the M1 muscarinic acetylcholine receptor (mAChR) subtype. Understanding how M1 mAChR mechanisms support these cognitive subdomains is of highest importance for advancing novel drug treatments for conditions with altered attention and reduced cognitive control including Alzheimer's disease or schizophrenia. Here, we tested this question by assessing how the subtype-selective M1 mAChR positive allosteric modulator (PAM) VU0453595 affects visual search and flexible reward learning in nonhuman primates. We found that allosteric potentiation of M1 mAChRs enhanced flexible learning performance by improving extradimensional set shifting, reducing latent inhibition from previously experienced distractors and reducing response perseveration in the absence of adverse side effects. These procognitive effects occurred in the absence of apparent changes of attentional performance during visual search. In contrast, nonselective ACh modulation using the acetylcholinesterase inhibitor (AChEI) donepezil improved attention during visual search at doses that did not alter cognitive flexibility and that already triggered gastrointestinal cholinergic side effects. These findings illustrate that M1 mAChR positive allosteric modulation enhances cognitive flexibility without affecting attentional filtering of distraction, consistent with M1 activity boosting the effective salience of relevant over irrelevant objects specifically during learning. These results suggest that M1 PAMs are versatile compounds for enhancing cognitive flexibility in disorders spanning schizophrenia and Alzheimer's diseases.
Collapse
Affiliation(s)
- Seyed A. Hassani
- Department of Psychology, Vanderbilt University, Nashville, TN37240
| | - Adam Neumann
- Department of Psychology, Vanderbilt University, Nashville, TN37240
| | - Jason Russell
- Department of Pharmacology, Vanderbilt University, Nashville, TN37240
- Warren Center for Neuroscience Drug Discovery, Vanderbilt University, Nashville, TN37240
| | - Carrie K. Jones
- Department of Pharmacology, Vanderbilt University, Nashville, TN37240
- Warren Center for Neuroscience Drug Discovery, Vanderbilt University, Nashville, TN37240
| | - Thilo Womelsdorf
- Department of Psychology, Vanderbilt University, Nashville, TN37240
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN37240
| |
Collapse
|
13
|
Edwin Thanarajah S, DiFeliceantonio AG, Albus K, Kuzmanovic B, Rigoux L, Iglesias S, Hanßen R, Schlamann M, Cornely OA, Brüning JC, Tittgemeyer M, Small DM. Habitual daily intake of a sweet and fatty snack modulates reward processing in humans. Cell Metab 2023; 35:571-584.e6. [PMID: 36958330 DOI: 10.1016/j.cmet.2023.02.015] [Citation(s) in RCA: 16] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Revised: 10/21/2022] [Accepted: 02/23/2023] [Indexed: 03/25/2023]
Abstract
Western diets rich in fat and sugar promote excess calorie intake and weight gain; however, the underlying mechanisms are unclear. Despite a well-documented association between obesity and altered brain dopamine function, it remains elusive whether these alterations are (1) pre-existing, increasing the individual susceptibility to weight gain, (2) secondary to obesity, or (3) directly attributable to repeated exposure to western diet. To close this gap, we performed a randomized, controlled study (NCT05574660) with normal-weight participants exposed to a high-fat/high-sugar snack or a low-fat/low-sugar snack for 8 weeks in addition to their regular diet. The high-fat/high-sugar intervention decreased the preference for low-fat food while increasing brain response to food and associative learning independent of food cues or reward. These alterations were independent of changes in body weight and metabolic parameters, indicating a direct effect of high-fat, high-sugar foods on neurobehavioral adaptations that may increase the risk for overeating and weight gain.
Collapse
Affiliation(s)
- Sharmili Edwin Thanarajah
- Max Planck Institute for Metabolism Research, Cologne, Germany; Department of Psychiatry, Psychosomatic Medicine and Psychotherapy, University Hospital, Goethe University, Frankfurt, Germany
| | - Alexandra G DiFeliceantonio
- Fralin Biomedical Research Institute at Virginia Tech Carilion & Department of Human Nutrition, Foods, and Exercise, College of Agriculture and Life Sciences, Roanoke, VA, USA
| | - Kerstin Albus
- Cologne Excellence Cluster on Cellular Stress Responses in Aging-Associated Diseases (CECAD), University of Cologne, Cologne, Germany; Department I of Internal Medicine, Center for Integrated Oncology Aachen Bonn Cologne Duesseldorf (CIO ABCD) & Excellence Center for Medical Mycology (ECMM), Faculty of Medicine and University Hospital Cologne, Cologne, Germany
| | | | - Lionel Rigoux
- Max Planck Institute for Metabolism Research, Cologne, Germany
| | - Sandra Iglesias
- Translational Neuromodeling Unit, Institute for Biomedical Engineering, University of Zurich and Swiss Federal Institute of Technology, Zurich, Switzerland
| | - Ruth Hanßen
- Max Planck Institute for Metabolism Research, Cologne, Germany; Policlinic for Endocrinology, Diabetes and Preventive Medicine (PEPD), University of Cologne, Faculty of Medicine and University Hospital Cologne, Cologne, Germany
| | - Marc Schlamann
- Department of Neuroradiology, University Hospital of Cologne, Kerpener Str. 62, 50937 Cologne, Germany
| | - Oliver A Cornely
- Cologne Excellence Cluster on Cellular Stress Responses in Aging-Associated Diseases (CECAD), University of Cologne, Cologne, Germany; Department I of Internal Medicine, Center for Integrated Oncology Aachen Bonn Cologne Duesseldorf (CIO ABCD) & Excellence Center for Medical Mycology (ECMM), Faculty of Medicine and University Hospital Cologne, Cologne, Germany; German Centre for Infection Research (DZIF), Partner Site Bonn-Cologne, Cologne, Germany; Clinical Trials Centre Cologne (ZKS Köln), University of Cologne, Faculty of Medicine and University Hospital Cologne, Cologne, Germany
| | - Jens C Brüning
- Max Planck Institute for Metabolism Research, Cologne, Germany; Cologne Excellence Cluster on Cellular Stress Responses in Aging-Associated Diseases (CECAD), University of Cologne, Cologne, Germany; Policlinic for Endocrinology, Diabetes and Preventive Medicine (PEPD), University of Cologne, Faculty of Medicine and University Hospital Cologne, Cologne, Germany
| | - Marc Tittgemeyer
- Max Planck Institute for Metabolism Research, Cologne, Germany; Cologne Excellence Cluster on Cellular Stress Responses in Aging-Associated Diseases (CECAD), University of Cologne, Cologne, Germany.
| | - Dana M Small
- Modern Diet and Physiology Research Center, New Haven, CT, USA; Yale University School of Medicine, Department of Psychiatry, New Haven, CT, USA.
| |
Collapse
|
14
|
Qiao L, Zhang L, Chen A. Brain connectivity modulation by Bayesian surprise in relation to control demand drives cognitive flexibility via control engagement. Cereb Cortex 2023; 33:1985-2000. [PMID: 35553644 DOI: 10.1093/cercor/bhac187] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2022] [Revised: 04/20/2022] [Accepted: 04/27/2022] [Indexed: 11/13/2022] Open
Abstract
Human control is characterized by its flexibility and adaptability in response to the conditional probability in the environment. Previous studies have revealed that efficient conflict control could be attained by predicting and adapting to the changing control demand. However, it is unclear whether cognitive flexibility could also be gained by predicting and adapting to the changing control demand. The present study aimed to explore this issue by combining the model-based analyses of behavioral and neuroimaging data with a probabilistic cued task switching paradigm. We demonstrated that the Bayesian surprise (i.e. unsigned precision-weighted prediction error [PE]) negatively modulated the connections among stimulus processing brain regions and control regions/networks. The effect of Bayesian surprise modulation on these connections guided control engagement as reflected by the control PE effect on behavior, which in turn facilitated cognitive flexibility. These results bridge a gap in the literature by illustrating the neural and behavioral effect of control demand prediction (or PE) on cognitive flexibility and offer novel insights into the source of switch cost and the mechanism of cognitive flexibility.
Collapse
Affiliation(s)
- Lei Qiao
- School of Psychology, Shenzhen University, Shenzhen, China
| | - Lijie Zhang
- School of Psychology, Shenzhen University, Shenzhen, China
| | - Antao Chen
- Department Psychology, Shanghai Univ Sport, Shanghai 200438, Peoples R China
| |
Collapse
|
15
|
Mikulasch FA, Rudelt L, Wibral M, Priesemann V. Where is the error? Hierarchical predictive coding through dendritic error computation. Trends Neurosci 2023; 46:45-59. [PMID: 36577388 DOI: 10.1016/j.tins.2022.09.007] [Citation(s) in RCA: 19] [Impact Index Per Article: 19.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2022] [Revised: 09/28/2022] [Accepted: 09/28/2022] [Indexed: 11/19/2022]
Abstract
Top-down feedback in cortex is critical for guiding sensory processing, which has prominently been formalized in the theory of hierarchical predictive coding (hPC). However, experimental evidence for error units, which are central to the theory, is inconclusive and it remains unclear how hPC can be implemented with spiking neurons. To address this, we connect hPC to existing work on efficient coding in balanced networks with lateral inhibition and predictive computation at apical dendrites. Together, this work points to an efficient implementation of hPC with spiking neurons, where prediction errors are computed not in separate units, but locally in dendritic compartments. We then discuss the correspondence of this model to experimentally observed connectivity patterns, plasticity, and dynamics in cortex.
Collapse
Affiliation(s)
- Fabian A Mikulasch
- Max-Planck-Institute for Dynamics and Self-Organization, Göttingen, Germany.
| | - Lucas Rudelt
- Max-Planck-Institute for Dynamics and Self-Organization, Göttingen, Germany
| | - Michael Wibral
- Göttingen Campus Institute for Dynamics of Biological Networks, Georg-August University, Göttingen, Germany
| | - Viola Priesemann
- Max-Planck-Institute for Dynamics and Self-Organization, Göttingen, Germany; Bernstein Center for Computational Neuroscience (BCCN), Göttingen, Germany; Department of Physics, Georg-August University, Göttingen, Germany
| |
Collapse
|
16
|
Task-evoked pupillary responses track precision-weighted prediction errors and learning rate during interceptive visuomotor actions. Sci Rep 2022; 12:22098. [PMID: 36543845 PMCID: PMC9772236 DOI: 10.1038/s41598-022-26544-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2022] [Accepted: 12/15/2022] [Indexed: 12/24/2022] Open
Abstract
In this study, we examined the relationship between physiological encoding of surprise and the learning of anticipatory eye movements. Active inference portrays perception and action as interconnected inference processes, driven by the imperative to minimise the surprise of sensory observations. To examine this characterisation of oculomotor learning during a hand-eye coordination task, we tested whether anticipatory eye movements were updated in accordance with Bayesian principles and whether trial-by-trial learning rates tracked pupil dilation as a marker of 'surprise'. Forty-four participants completed an interception task in immersive virtual reality that required them to hit bouncing balls that had either expected or unexpected bounce profiles. We recorded anticipatory eye movements known to index participants' beliefs about likely ball bounce trajectories. By fitting a hierarchical Bayesian inference model to the trial-wise trajectories of these predictive eye movements, we were able to estimate each individual's expectations about bounce trajectories, rates of belief updating, and precision-weighted prediction errors. We found that the task-evoked pupil response tracked prediction errors and learning rates but not beliefs about ball bounciness or environmental volatility. These findings are partially consistent with active inference accounts and shed light on how encoding of surprise may shape the control of action.
Collapse
|
17
|
Liu M, Dong W, Wu Y, Verbeke P, Verguts T, Chen Q. Modulating hierarchical learning by high-definition transcranial alternating current stimulation at theta frequency. Cereb Cortex 2022; 33:4421-4431. [PMID: 36089836 DOI: 10.1093/cercor/bhac352] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2022] [Revised: 08/09/2022] [Accepted: 08/11/2022] [Indexed: 11/12/2022] Open
Abstract
Considerable evidence highlights the dorsolateral prefrontal cortex (DLPFC) as a key region for hierarchical (i.e. multilevel) learning. In a previous electroencephalography (EEG) study, we found that the low-level prediction errors were encoded by frontal theta oscillations (4-7 Hz), centered on right DLPFC (rDLPFC). However, the causal relationship between frontal theta oscillations and hierarchical learning remains poorly understood. To investigate this question, in the current study, participants received theta (6 Hz) and sham high-definition transcranial alternating current stimulation (HD-tACS) over the rDLPFC while performing the probabilistic reversal learning task. Behaviorally, theta tACS induced a significant reduction in accuracy for the stable environment, but not for the volatile environment, relative to the sham condition. Computationally, we implemented a combination of a hierarchical Bayesian learning and a decision model. Theta tACS induced a significant increase in low-level (i.e. probability-level) learning rate and uncertainty of low-level estimation relative to sham condition. Instead, the temperature parameter of the decision model, which represents (inverse) decision noise, was not significantly altered due to theta stimulation. These results indicate that theta frequency may modulate the (low-level) learning rate. Furthermore, environmental features (e.g. its stability) may determine whether learning is optimized as a result.
Collapse
Affiliation(s)
- Meng Liu
- Key Laboratory of Brain, Cognition and Education Sciences, Ministry of Education, Guangzhou 510631, China.,School of Psychology, Center for Studies of Psychological Application, and Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China
| | - Wenshan Dong
- Key Laboratory of Brain, Cognition and Education Sciences, Ministry of Education, Guangzhou 510631, China.,School of Psychology, Center for Studies of Psychological Application, and Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China
| | - Yiling Wu
- Key Laboratory of Brain, Cognition and Education Sciences, Ministry of Education, Guangzhou 510631, China.,School of Psychology, Center for Studies of Psychological Application, and Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China
| | - Pieter Verbeke
- Department of Experimental Psychology, Ghent University, B-9000 Ghent, Belgium
| | - Tom Verguts
- Department of Experimental Psychology, Ghent University, B-9000 Ghent, Belgium
| | - Qi Chen
- Key Laboratory of Brain, Cognition and Education Sciences, Ministry of Education, Guangzhou 510631, China.,School of Psychology, Center for Studies of Psychological Application, and Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China
| |
Collapse
|
18
|
Witkowski PP, Park SA, Boorman ED. Neural mechanisms of credit assignment for inferred relationships in a structured world. Neuron 2022; 110:2680-2690.e9. [PMID: 35714610 DOI: 10.1016/j.neuron.2022.05.021] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Revised: 04/12/2022] [Accepted: 05/18/2022] [Indexed: 10/18/2022]
Abstract
Animals abstract compact representations of a task's structure, which supports accelerated learning and flexible behavior. Whether and how such abstracted representations may be used to assign credit for inferred, but unobserved, relationships in structured environments are unknown. We develop a hierarchical reversal-learning task and Bayesian learning model to assess the computational and neural mechanisms underlying how humans infer specific choice-outcome associations via structured knowledge. We find that the medial prefrontal cortex (mPFC) efficiently represents hierarchically related choice-outcome associations governed by the same latent cause, using a generalized code to assign credit for both experienced and inferred outcomes. Furthermore, the mPFC and lateral orbitofrontal cortex track the current "position" within a latent association space that generalizes over stimuli. Collectively, these findings demonstrate the importance of both tracking the current position in an abstracted task space and efficient, generalizable representations in the prefrontal cortex for supporting flexible learning and inference in structured environments.
Collapse
Affiliation(s)
- Phillip P Witkowski
- Center for Mind and Brain, University of California, Davis, Davis, CA 95618; Department of Psychology, University of California, Davis, Davis, CA 95618.
| | - Seongmin A Park
- Center for Mind and Brain, University of California, Davis, Davis, CA 95618
| | - Erie D Boorman
- Center for Mind and Brain, University of California, Davis, Davis, CA 95618; Department of Psychology, University of California, Davis, Davis, CA 95618.
| |
Collapse
|
19
|
Palaniyappan L, Venkatasubramanian G. The Bayesian brain and cooperative communication in schizophrenia. J Psychiatry Neurosci 2022; 47:E48-E54. [PMID: 35135834 PMCID: PMC8834248 DOI: 10.1503/jpn.210231] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Affiliation(s)
- Lena Palaniyappan
- From the Department of Psychiatry, Schulich School of Medicine & Dentistry, Western University, London, Ont., Canada (Palaniyappan); the Robart Research Institute & Lawson Health Research Institute, London, Ont., Canada (Palaniyappan); and the InSTAR Program, Schizophrenia Clinic, Department of Psychiatry, National Institute of Mental Health and Neuro Sciences, Bangalore, India (Venkatasubramanian)
| | | |
Collapse
|
20
|
Liu M, Dong W, Qin S, Verguts T, Chen Q. Electrophysiological Signatures of Hierarchical Learning. Cereb Cortex 2021; 32:626-639. [PMID: 34339505 DOI: 10.1093/cercor/bhab245] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2021] [Revised: 06/26/2021] [Accepted: 06/27/2021] [Indexed: 11/13/2022] Open
Abstract
Human perception and learning is thought to rely on a hierarchical generative model that is continuously updated via precision-weighted prediction errors (pwPEs). However, the neural basis of such cognitive process and how it unfolds during decision-making remain poorly understood. To investigate this question, we combined a hierarchical Bayesian model (i.e., Hierarchical Gaussian Filter [HGF]) with electroencephalography (EEG), while participants performed a probabilistic reversal learning task in alternatingly stable and volatile environments. Behaviorally, the HGF fitted significantly better than two control, nonhierarchical, models. Neurally, low-level and high-level pwPEs were independently encoded by the P300 component. Low-level pwPEs were reflected in the theta (4-8 Hz) frequency band, but high-level pwPEs were not. Furthermore, the expressions of high-level pwPEs were stronger for participants with better HGF fit. These results indicate that the brain employs hierarchical learning and encodes both low- and high-level learning signals separately and adaptively.
Collapse
Affiliation(s)
- Meng Liu
- Key Laboratory of Brain, Cognition and Education Sciences (South China Normal University), Ministry of Education, 510631 Guangzhou, China.,School of Psychology, South China Normal University, 510631 Guangzhou, China.,Center for Studies of Psychological Application, South China Normal University, 510631 Guangzhou, China.,Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, 510631 Guangzhou, China
| | - Wenshan Dong
- Key Laboratory of Brain, Cognition and Education Sciences (South China Normal University), Ministry of Education, 510631 Guangzhou, China.,School of Psychology, South China Normal University, 510631 Guangzhou, China.,Center for Studies of Psychological Application, South China Normal University, 510631 Guangzhou, China.,Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, 510631 Guangzhou, China
| | - Shaozheng Qin
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, 100875 Beijing, China
| | - Tom Verguts
- Department of Experimental Psychology, Ghent University, B-9000 Ghent, Belgium
| | - Qi Chen
- Key Laboratory of Brain, Cognition and Education Sciences (South China Normal University), Ministry of Education, 510631 Guangzhou, China.,School of Psychology, South China Normal University, 510631 Guangzhou, China.,Center for Studies of Psychological Application, South China Normal University, 510631 Guangzhou, China.,Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, 510631 Guangzhou, China
| |
Collapse
|
21
|
Frässle S, Aponte EA, Bollmann S, Brodersen KH, Do CT, Harrison OK, Harrison SJ, Heinzle J, Iglesias S, Kasper L, Lomakina EI, Mathys C, Müller-Schrader M, Pereira I, Petzschner FH, Raman S, Schöbi D, Toussaint B, Weber LA, Yao Y, Stephan KE. TAPAS: An Open-Source Software Package for Translational Neuromodeling and Computational Psychiatry. Front Psychiatry 2021; 12:680811. [PMID: 34149484 PMCID: PMC8206497 DOI: 10.3389/fpsyt.2021.680811] [Citation(s) in RCA: 48] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/15/2021] [Accepted: 05/10/2021] [Indexed: 12/26/2022] Open
Abstract
Psychiatry faces fundamental challenges with regard to mechanistically guided differential diagnosis, as well as prediction of clinical trajectories and treatment response of individual patients. This has motivated the genesis of two closely intertwined fields: (i) Translational Neuromodeling (TN), which develops "computational assays" for inferring patient-specific disease processes from neuroimaging, electrophysiological, and behavioral data; and (ii) Computational Psychiatry (CP), with the goal of incorporating computational assays into clinical decision making in everyday practice. In order to serve as objective and reliable tools for clinical routine, computational assays require end-to-end pipelines from raw data (input) to clinically useful information (output). While these are yet to be established in clinical practice, individual components of this general end-to-end pipeline are being developed and made openly available for community use. In this paper, we present the Translational Algorithms for Psychiatry-Advancing Science (TAPAS) software package, an open-source collection of building blocks for computational assays in psychiatry. Collectively, the tools in TAPAS presently cover several important aspects of the desired end-to-end pipeline, including: (i) tailored experimental designs and optimization of measurement strategy prior to data acquisition, (ii) quality control during data acquisition, and (iii) artifact correction, statistical inference, and clinical application after data acquisition. Here, we review the different tools within TAPAS and illustrate how these may help provide a deeper understanding of neural and cognitive mechanisms of disease, with the ultimate goal of establishing automatized pipelines for predictions about individual patients. We hope that the openly available tools in TAPAS will contribute to the further development of TN/CP and facilitate the translation of advances in computational neuroscience into clinically relevant computational assays.
Collapse
Affiliation(s)
- Stefan Frässle
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
| | - Eduardo A. Aponte
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
| | - Saskia Bollmann
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
- Institute for Biomedical Engineering, ETH Zurich and University of Zurich, Zurich, Switzerland
- Centre for Advanced Imaging, The University of Queensland, Brisbane, QLD, Australia
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, United States
- Department of Radiology, Harvard Medical School, Charlestown, MA, United States
| | - Kay H. Brodersen
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
- Department of Computer Science, ETH Zurich, Zurich, Switzerland
| | - Cao T. Do
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
| | - Olivia K. Harrison
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
- School of Pharmacy, University of Otago, Dunedin, New Zealand
| | - Samuel J. Harrison
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
| | - Jakob Heinzle
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
| | - Sandra Iglesias
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
| | - Lars Kasper
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
- Techna Institute, University Health Network, Toronto, ON, Canada
| | - Ekaterina I. Lomakina
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
- Department of Computer Science, ETH Zurich, Zurich, Switzerland
| | - Christoph Mathys
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
- Interacting Minds Center, Aarhus University, Aarhus, Denmark
| | - Matthias Müller-Schrader
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
| | - Inês Pereira
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
| | - Frederike H. Petzschner
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
| | - Sudhir Raman
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
| | - Dario Schöbi
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
| | - Birte Toussaint
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
| | - Lilian A. Weber
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
| | - Yu Yao
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
| | - Klaas E. Stephan
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
| |
Collapse
|
22
|
Harrison SJ, Bianchi S, Heinzle J, Stephan KE, Iglesias S, Kasper L. A Hilbert-based method for processing respiratory timeseries. Neuroimage 2021; 230:117787. [PMID: 33516897 DOI: 10.1016/j.neuroimage.2021.117787] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2020] [Revised: 01/09/2021] [Accepted: 01/14/2021] [Indexed: 01/22/2023] Open
Abstract
In this technical note, we introduce a new method for estimating changes in respiratory volume per unit time (RVT) from respiratory bellows recordings. By using techniques from the electrophysiological literature, in particular the Hilbert transform, we show how we can better characterise breathing rhythms, with the goal of improving physiological noise correction in functional magnetic resonance imaging (fMRI). Specifically, our approach leads to a representation with higher time resolution and better captures atypical breathing events than current peak-based RVT estimators. Finally, we demonstrate that this leads to an increase in the amount of respiration-related variance removed from fMRI data when used as part of a typical preprocessing pipeline. Our implementation is publicly available as part of the PhysIO package, which is distributed as part of the open-source TAPAS toolbox (https://translationalneuromodeling.org/tapas).
Collapse
Affiliation(s)
- Samuel J Harrison
- Translational Neuromodeling Unit, University of Zurich & ETH Zurich, Zurich, Switzerland; FMRIB, Wellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford, UK.
| | - Samuel Bianchi
- Translational Neuromodeling Unit, University of Zurich & ETH Zurich, Zurich, Switzerland; Institute for Biomedical Engineering, ETH Zurich & University of Zurich, Zurich, Switzerland
| | - Jakob Heinzle
- Translational Neuromodeling Unit, University of Zurich & ETH Zurich, Zurich, Switzerland
| | - Klaas Enno Stephan
- Translational Neuromodeling Unit, University of Zurich & ETH Zurich, Zurich, Switzerland; Max Planck Institute for Metabolism Research, Cologne, Germany; Techna Institute, University Health Network, Toronto, Canada
| | - Sandra Iglesias
- Translational Neuromodeling Unit, University of Zurich & ETH Zurich, Zurich, Switzerland
| | - Lars Kasper
- Translational Neuromodeling Unit, University of Zurich & ETH Zurich, Zurich, Switzerland; Institute for Biomedical Engineering, ETH Zurich & University of Zurich, Zurich, Switzerland; Techna Institute, University Health Network, Toronto, Canada
| |
Collapse
|