1
|
Bousseyrol E, Didienne S, Takillah S, Prevost-Solié C, Come M, Ahmed Yahia T, Mondoloni S, Vicq E, Tricoire L, Mourot A, Naudé J, Faure P. Dopaminergic and prefrontal dynamics co-determine mouse decisions in a spatial gambling task. Cell Rep 2023; 42:112523. [PMID: 37200189 DOI: 10.1016/j.celrep.2023.112523] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2022] [Revised: 01/28/2023] [Accepted: 05/02/2023] [Indexed: 05/20/2023] Open
Abstract
The neural mechanisms by which animals initiate goal-directed actions, choose between options, or explore opportunities remain unknown. Here, we develop a spatial gambling task in which mice, to obtain intracranial self-stimulation rewards, self-determine the initiation, direction, vigor, and pace of their actions based on their knowledge of the outcomes. Using electrophysiological recordings, pharmacology, and optogenetics, we identify a sequence of oscillations and firings in the ventral tegmental area (VTA), orbitofrontal cortex (OFC), and prefrontal cortex (PFC) that co-encodes and co-determines self-initiation and choices. This sequence appeared with learning as an uncued realignment of spontaneous dynamics. Interactions between the structures varied with the reward context, particularly the uncertainty associated with the different options. We suggest that self-generated choices arise from a distributed circuit based on an OFC-VTA core determining whether to wait for or initiate actions, while the PFC is specifically engaged by reward uncertainty in action selection and pace.
Collapse
Affiliation(s)
- Elise Bousseyrol
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005 Paris, France; Brain Plasticity Laboratory, CNRS, ESPCI Paris, PSL Research University, 75005 Paris, France
| | - Steve Didienne
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005 Paris, France; Brain Plasticity Laboratory, CNRS, ESPCI Paris, PSL Research University, 75005 Paris, France
| | - Samir Takillah
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005 Paris, France; Brain Plasticity Laboratory, CNRS, ESPCI Paris, PSL Research University, 75005 Paris, France
| | - Clement Prevost-Solié
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005 Paris, France; Brain Plasticity Laboratory, CNRS, ESPCI Paris, PSL Research University, 75005 Paris, France
| | - Maxime Come
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005 Paris, France; Brain Plasticity Laboratory, CNRS, ESPCI Paris, PSL Research University, 75005 Paris, France
| | - Tarek Ahmed Yahia
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005 Paris, France
| | - Sarah Mondoloni
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005 Paris, France
| | - Eléonore Vicq
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005 Paris, France
| | - Ludovic Tricoire
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005 Paris, France
| | - Alexandre Mourot
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005 Paris, France; Brain Plasticity Laboratory, CNRS, ESPCI Paris, PSL Research University, 75005 Paris, France
| | - Jérémie Naudé
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005 Paris, France; CNRS, Université de Montpellier, INSERM - Institut de Génomique Fonctionnelle, 34094 Montpellier, France.
| | - Philippe Faure
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005 Paris, France; Brain Plasticity Laboratory, CNRS, ESPCI Paris, PSL Research University, 75005 Paris, France.
| |
Collapse
|
2
|
Belkaid M, Bousseyrol E, Durand-de Cuttoli R, Dongelmans M, Duranté EK, Yahia TA, Didienne S, Hanesse B, Come M, Mourot A, Naudé J, Sigaud O, Faure P. Author Correction: Mice adaptively generate choice variability in a deterministic task. Commun Biol 2020; 3:54. [PMID: 32005936 PMCID: PMC6994480 DOI: 10.1038/s42003-020-0785-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
|
3
|
Belkaid M, Bousseyrol E, Durand-de Cuttoli R, Dongelmans M, Duranté EK, Ahmed Yahia T, Didienne S, Hanesse B, Come M, Mourot A, Naudé J, Sigaud O, Faure P. Mice adaptively generate choice variability in a deterministic task. Commun Biol 2020; 3:34. [PMID: 31965053 PMCID: PMC6972896 DOI: 10.1038/s42003-020-0759-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2019] [Accepted: 12/20/2019] [Indexed: 01/30/2023] Open
Abstract
Can decisions be made solely by chance? Can variability be intrinsic to the decision-maker or is it inherited from environmental conditions? To investigate these questions, we designed a deterministic setting in which mice are rewarded for non-repetitive choice sequences, and modeled the experiment using reinforcement learning. We found that mice progressively increased their choice variability. Although an optimal strategy based on sequences learning was theoretically possible and would be more rewarding, animals used a pseudo-random selection which ensures high success rate. This was not the case if the animal is exposed to a uniform probabilistic reward delivery. We also show that mice were blind to changes in the temporal structure of reward delivery once they learned to choose at random. Overall, our results demonstrate that a decision-making process can self-generate variability and randomness, even when the rules governing reward delivery are neither stochastic nor volatile.
Collapse
Affiliation(s)
- Marwen Belkaid
- Sorbonne Université, CNRS, Institut des Systèmes Intelligents et de Robotique (ISIR), 75005, Paris, France
| | - Elise Bousseyrol
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005, Paris, France
| | - Romain Durand-de Cuttoli
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005, Paris, France
| | - Malou Dongelmans
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005, Paris, France
| | - Etienne K Duranté
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005, Paris, France
| | - Tarek Ahmed Yahia
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005, Paris, France
| | - Steve Didienne
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005, Paris, France
| | - Bernadette Hanesse
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005, Paris, France
| | - Maxime Come
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005, Paris, France
| | - Alexandre Mourot
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005, Paris, France
| | - Jérémie Naudé
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005, Paris, France
| | - Olivier Sigaud
- Sorbonne Université, CNRS, Institut des Systèmes Intelligents et de Robotique (ISIR), 75005, Paris, France
| | - Philippe Faure
- Sorbonne Université, INSERM, CNRS, Neuroscience Paris Seine - Institut de Biologie Paris Seine (NPS - IBPS), 75005, Paris, France.
| |
Collapse
|