1
|
Gregorová K, Eldar E, Deserno L, Reiter AMF. A cognitive-computational account of mood swings in adolescence. Trends Cogn Sci 2024; 28:290-303. [PMID: 38503636 DOI: 10.1016/j.tics.2024.02.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Revised: 02/06/2024] [Accepted: 02/12/2024] [Indexed: 03/21/2024]
Abstract
Teenagers have a reputation for being fickle, in both their choices and their moods. This variability may help adolescents as they begin to independently navigate novel environments. Recently, however, adolescent moodiness has also been linked to psychopathology. Here, we consider adolescents' mood swings from a novel computational perspective, grounded in reinforcement learning (RL). This model proposes that mood is determined by surprises about outcomes in the environment, and how much we learn from these surprises. It additionally suggests that mood biases learning and choice in a bidirectional manner. Integrating independent lines of research, we sketch a cognitive-computational account of how adolescents' mood, learning, and choice dynamics influence each other, with implications for normative and psychopathological development.
Collapse
Affiliation(s)
- Klára Gregorová
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital, Würzburg 97080, Germany; Department of Psychology, Julius-Maximilians-Universität, Würzburg 97070, Germany; German Center of Prevention Research on Mental Health, Würzburg 97080, Germany
| | - Eran Eldar
- Department of Psychology, Hebrew University of Jerusalem, Jerusalem 9190501, Israel; Department of Cognitive & Brain Sciences, Hebrew University of Jerusalem, Jerusalem 9190501, Israel
| | - Lorenz Deserno
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital, Würzburg 97080, Germany; Department of Psychology, Julius-Maximilians-Universität, Würzburg 97070, Germany; Department of Cognitive & Brain Sciences, Hebrew University of Jerusalem, Jerusalem 9190501, Israel; Department of Psychiatry and Psychotherapy, Technical University of Dresden, Dresden 01069, Germany
| | - Andrea M F Reiter
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital, Würzburg 97080, Germany; Department of Psychology, Julius-Maximilians-Universität, Würzburg 97070, Germany; German Center of Prevention Research on Mental Health, Würzburg 97080, Germany; Collaborative Research Centre 940 Volition and Cognitive Control, Technical University of Dresden, Dresden 01069, Germany.
| |
Collapse
|
2
|
Heerema R, Carrillo P, Daunizeau J, Vinckier F, Pessiglione M. Mood fluctuations shift cost-benefit tradeoffs in economic decisions. Sci Rep 2023; 13:18173. [PMID: 37875525 PMCID: PMC10598198 DOI: 10.1038/s41598-023-45217-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2023] [Accepted: 10/17/2023] [Indexed: 10/26/2023] Open
Abstract
Mood effects on economic choice seem blatantly irrational, but might rise from mechanisms adapted to natural environments. We have proposed a theory in which mood helps adapting the behaviour to statistical dependencies in the environment, by biasing the expected value of foraging actions (which involve taking risk, spending time and making effort to get more reward). Here, we tested the existence of this mechanism, using an established mood induction paradigm combined with independent economic choices that opposed small but uncostly rewards to larger but costly rewards (involving either risk, delay or effort). To maximise the sensitivity to mood fluctuations, we developed an algorithm ensuring that choice options were continuously adjusted to subjective indifference points. In 102 participants tested twice, we found that during episodes of positive mood (relative to negative mood), choices were biased towards better rewarded but costly options, irrespective of the cost type. Computational modelling confirmed that the incidental mood effect was best explained by a bias added to the expected value of costly options, prior to decision making. This bias is therefore automatically applied even in artificial environments where it is not adaptive, allowing mood to spill over many sorts of decisions and generate irrational behaviours.
Collapse
Affiliation(s)
- Roeland Heerema
- Motivation, Brain and Behavior (MBB) Lab, Paris Brain Institute (ICM), Pitié-Salpêtrière Hospital, 75013, Paris, France.
- Sorbonne Université, Inserm U1127, CNRS U7225, 75013, Paris, France.
| | - Pablo Carrillo
- Motivation, Brain and Behavior (MBB) Lab, Paris Brain Institute (ICM), Pitié-Salpêtrière Hospital, 75013, Paris, France
- Sorbonne Université, Inserm U1127, CNRS U7225, 75013, Paris, France
| | - Jean Daunizeau
- Motivation, Brain and Behavior (MBB) Lab, Paris Brain Institute (ICM), Pitié-Salpêtrière Hospital, 75013, Paris, France
- Sorbonne Université, Inserm U1127, CNRS U7225, 75013, Paris, France
| | - Fabien Vinckier
- Motivation, Brain and Behavior (MBB) Lab, Paris Brain Institute (ICM), Pitié-Salpêtrière Hospital, 75013, Paris, France
- Sorbonne Université, Inserm U1127, CNRS U7225, 75013, Paris, France
- Université Paris Cité, 75006, Paris, France
- Department of Psychiatry, Service Hospitalo-Universitaire, GHU Paris Psychiatrie and Neurosciences, 75014, Paris, France
| | - Mathias Pessiglione
- Motivation, Brain and Behavior (MBB) Lab, Paris Brain Institute (ICM), Pitié-Salpêtrière Hospital, 75013, Paris, France.
- Sorbonne Université, Inserm U1127, CNRS U7225, 75013, Paris, France.
| |
Collapse
|
3
|
Collomb-Clerc A, Gueguen MCM, Minotti L, Kahane P, Navarro V, Bartolomei F, Carron R, Regis J, Chabardès S, Palminteri S, Bastin J. Human thalamic low-frequency oscillations correlate with expected value and outcomes during reinforcement learning. Nat Commun 2023; 14:6534. [PMID: 37848435 PMCID: PMC10582006 DOI: 10.1038/s41467-023-42380-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2022] [Accepted: 10/09/2023] [Indexed: 10/19/2023] Open
Abstract
Reinforcement-based adaptive decision-making is believed to recruit fronto-striatal circuits. A critical node of the fronto-striatal circuit is the thalamus. However, direct evidence of its involvement in human reinforcement learning is lacking. We address this gap by analyzing intra-thalamic electrophysiological recordings from eight participants while they performed a reinforcement learning task. We found that in both the anterior thalamus (ATN) and dorsomedial thalamus (DMTN), low frequency oscillations (LFO, 4-12 Hz) correlated positively with expected value estimated from computational modeling during reward-based learning (after outcome delivery) or punishment-based learning (during the choice process). Furthermore, LFO recorded from ATN/DMTN were also negatively correlated with outcomes so that both components of reward prediction errors were signaled in the human thalamus. The observed differences in the prediction signals between rewarding and punishing conditions shed light on the neural mechanisms underlying action inhibition in punishment avoidance learning. Our results provide insight into the role of thalamus in reinforcement-based decision-making in humans.
Collapse
Affiliation(s)
- Antoine Collomb-Clerc
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut Neurosciences, 38000, Grenoble, France
| | - Maëlle C M Gueguen
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut Neurosciences, 38000, Grenoble, France
- Department of Psychiatry, Brain Health Institute and University Behavioral Health Care, Rutgers University-New Brunswick, Piscataway, NJ, USA
| | - Lorella Minotti
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut Neurosciences, 38000, Grenoble, France
- Neurology Department, University Hospital of Grenoble, Grenoble, France
| | - Philippe Kahane
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut Neurosciences, 38000, Grenoble, France
- Neurology Department, University Hospital of Grenoble, Grenoble, France
| | - Vincent Navarro
- Sorbonne Université, Paris Brain Institute - Institut du Cerveau, ICM, INSERM, CNRS, AP-HP, Pitié-Salpêtrière Hospital, Paris, France
| | - Fabrice Bartolomei
- Timone University Hospital, Sleep Unit, Epileptology and Cerebral Rhythmology, University Hospital of Marseille, Marseille, France
- Aix Marseille University, Inserm, Institut de Neurosciences des Systèmes, Marseille, France
| | - Romain Carron
- Aix Marseille University, Inserm, Institut de Neurosciences des Systèmes, Marseille, France
- Timone University Hospital, Department of functional and stereotactic neurosurgery, University Hospital of Marseille, Marseille, France
| | - Jean Regis
- Neurosurgery Department, University Hospital of Marseille, Marseille, France
| | - Stephan Chabardès
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut Neurosciences, 38000, Grenoble, France
- Neurosurgery Department, University Hospital of Grenoble, Grenoble, France
| | - Stefano Palminteri
- Laboratoire de Neurosciences Cognitives Computationnelles, Département d'Etudes Cognitives, ENS, PSL, INSERM, Paris, France
| | - Julien Bastin
- Univ. Grenoble Alpes, Inserm, U1216, CHU Grenoble Alpes, Grenoble Institut Neurosciences, 38000, Grenoble, France.
| |
Collapse
|
4
|
Saez I, Gu X. Invasive Computational Psychiatry. Biol Psychiatry 2023; 93:661-670. [PMID: 36641365 PMCID: PMC10038930 DOI: 10.1016/j.biopsych.2022.09.032] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/05/2022] [Revised: 08/25/2022] [Accepted: 09/27/2022] [Indexed: 01/16/2023]
Abstract
Computational psychiatry, a relatively new yet prolific field that aims to understand psychiatric disorders with formal theories about the brain, has seen tremendous growth in the past decade. Despite initial excitement, actual progress made by computational psychiatry seems stagnant. Meanwhile, understanding of the human brain has benefited tremendously from recent progress in intracranial neuroscience. Specifically, invasive techniques such as stereotactic electroencephalography, electrocorticography, and deep brain stimulation have provided a unique opportunity to precisely measure and causally modulate neurophysiological activity in the living human brain. In this review, we summarize progress and drawbacks in both computational psychiatry and invasive electrophysiology and propose that their combination presents a highly promising new direction-invasive computational psychiatry. The value of this approach is at least twofold. First, it advances our mechanistic understanding of the neural computations of mental states by providing a spatiotemporally precise depiction of neural activity that is traditionally unattainable using noninvasive techniques with human subjects. Second, it offers a direct and immediate way to modulate brain states through stimulation of algorithmically defined neural regions and circuits (i.e., algorithmic targeting), thus providing both causal and therapeutic insights. We then present depression as a use case where the combination of computational and invasive approaches has already shown initial success. We conclude by outlining future directions as a road map for this exciting new field as well as presenting cautions about issues such as ethical concerns and generalizability of findings.
Collapse
Affiliation(s)
- Ignacio Saez
- Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, New York; Department of Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, New York; Department of Neurology, Icahn School of Medicine at Mount Sinai, New York, New York; Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, New York.
| | - Xiaosi Gu
- Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, New York; Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, New York.
| |
Collapse
|
5
|
Müller-Pinzler L, Czekalla N, Mayer AV, Schröder A, Stolz DS, Paulus FM, Krach S. Neurocomputational mechanisms of affected beliefs. Commun Biol 2022; 5:1241. [PMCID: PMC9663730 DOI: 10.1038/s42003-022-04165-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2022] [Accepted: 10/25/2022] [Indexed: 11/16/2022] Open
Abstract
AbstractThe feedback people receive on their behavior shapes the process of belief formation and self-efficacy in mastering a particular task. However, the neural and computational mechanisms of how the subjective value of self-efficacy beliefs, and the corresponding affect, influence the learning process remain unclear. We investigated these mechanisms during self-efficacy belief formation using fMRI, pupillometry, and computational modeling, and by analyzing individual differences in affective experience. Biases in the formation of self-efficacy beliefs were associated with affect, pupil dilation, and neural activity within the anterior insula, amygdala, ventral tegmental area/ substantia nigra, and mPFC. Specifically, neural and pupil responses mapped the valence of the prediction errors in correspondence with individuals’ experienced affective states and learning biases during self-efficacy belief formation. Together with the functional connectivity dynamics of the anterior insula within this network, our results provide evidence for neural and computational mechanisms of how we arrive at affected beliefs.
Collapse
|