1
|
Liu Y, Wang XJ. Flexible gating between subspaces in a neural network model of internally guided task switching. Nat Commun 2024; 15:6497. [PMID: 39090084 PMCID: PMC11294624 DOI: 10.1038/s41467-024-50501-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2024] [Accepted: 07/10/2024] [Indexed: 08/04/2024] Open
Abstract
Behavioral flexibility relies on the brain's ability to switch rapidly between multiple tasks, even when the task rule is not explicitly cued but must be inferred through trial and error. The underlying neural circuit mechanism remains poorly understood. We investigated recurrent neural networks (RNNs) trained to perform an analog of the classic Wisconsin Card Sorting Test. The networks consist of two modules responsible for rule representation and sensorimotor mapping, respectively, where each module is comprised of a circuit with excitatory neurons and three major types of inhibitory neurons. We found that rule representation by self-sustained persistent activity across trials, error monitoring and gated sensorimotor mapping emerged from training. Systematic dissection of trained RNNs revealed a detailed circuit mechanism that is consistent across networks trained with different hyperparameters. The networks' dynamical trajectories for different rules resided in separate subspaces of population activity; the subspaces collapsed and performance was reduced to chance level when dendrite-targeting somatostatin-expressing interneurons were silenced, illustrating how a phenomenological description of representational subspaces is explained by a specific circuit mechanism.
Collapse
Affiliation(s)
- Yue Liu
- Center for Neural Science, New York University, New York, NY, 10003, USA
| | - Xiao-Jing Wang
- Center for Neural Science, New York University, New York, NY, 10003, USA.
| |
Collapse
|
2
|
Liu Y, Wang XJ. Flexible gating between subspaces in a neural network model of internally guided task switching. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.08.15.553375. [PMID: 37645801 PMCID: PMC10462002 DOI: 10.1101/2023.08.15.553375] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/31/2023]
Abstract
Behavioral flexibility relies on the brain's ability to switch rapidly between multiple tasks, even when the task rule is not explicitly cued but must be inferred through trial and error. The underlying neural circuit mechanism remains poorly understood. We investigated recurrent neural networks (RNNs) trained to perform an analog of the classic Wisconsin Card Sorting Test. The networks consist of two modules responsible for rule representation and sensorimotor mapping, respectively, where each module is comprised of a circuit with excitatory neurons and three major types of inhibitory neurons. We found that rule representation by self-sustained persistent activity across trials, error monitoring and gated sensorimotor mapping emerged from training. Systematic dissection of trained RNNs revealed a detailed circuit mechanism that is consistent across networks trained with different hyperparameters. The networks' dynamical trajectories for different rules resided in separate subspaces of population activity; the subspaces collapsed and performance was reduced to chance level when dendrite-targeting somatostatin-expressing interneurons were silenced, illustrating how a phenomenological description of representational subspaces is explained by a specific circuit mechanism.
Collapse
|
3
|
Juárez Tello A, van der Zouwen CI, Dejas L, Duque-Yate J, Boutin J, Medina-Ortiz K, Suresh JS, Swiegers J, Sarret P, Ryczko D. Dopamine-sensitive neurons in the mesencephalic locomotor region control locomotion initiation, stop, and turns. Cell Rep 2024; 43:114187. [PMID: 38722743 PMCID: PMC11157412 DOI: 10.1016/j.celrep.2024.114187] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2023] [Revised: 03/31/2024] [Accepted: 04/17/2024] [Indexed: 06/01/2024] Open
Abstract
The locomotor role of dopaminergic neurons is traditionally attributed to their ascending projections to the basal ganglia, which project to the mesencephalic locomotor region (MLR). In addition, descending dopaminergic projections to the MLR are present from basal vertebrates to mammals. However, the neurons targeted in the MLR and their behavioral role are unknown in mammals. Here, we identify genetically defined MLR cells that express D1 or D2 receptors and control different motor behaviors in mice. In the cuneiform nucleus, D1-expressing neurons promote locomotion, while D2-expressing neurons stop locomotion. In the pedunculopontine nucleus, D1-expressing neurons promote locomotion, while D2-expressing neurons evoke ipsilateral turns. Using RNAscope, we show that MLR dopamine-sensitive neurons comprise a combination of glutamatergic, GABAergic, and cholinergic neurons, suggesting that different neurotransmitter-based cell types work together to control distinct behavioral modules. Altogether, our study uncovers behaviorally relevant cell types in the mammalian MLR based on the expression of dopaminergic receptors.
Collapse
Affiliation(s)
- Andrea Juárez Tello
- Département de Pharmacologie-Physiologie, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Sherbrooke, QC, Canada
| | - Cornelis Immanuel van der Zouwen
- Département de Pharmacologie-Physiologie, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Sherbrooke, QC, Canada
| | - Léonie Dejas
- Département de Pharmacologie-Physiologie, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Sherbrooke, QC, Canada
| | - Juan Duque-Yate
- Département de Pharmacologie-Physiologie, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Sherbrooke, QC, Canada
| | - Joël Boutin
- Département de Pharmacologie-Physiologie, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Sherbrooke, QC, Canada
| | - Katherine Medina-Ortiz
- Département de Pharmacologie-Physiologie, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Sherbrooke, QC, Canada
| | - Jacinthlyn Sylvia Suresh
- Département de Pharmacologie-Physiologie, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Sherbrooke, QC, Canada
| | - Jordan Swiegers
- Département de Pharmacologie-Physiologie, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Sherbrooke, QC, Canada
| | - Philippe Sarret
- Département de Pharmacologie-Physiologie, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Sherbrooke, QC, Canada; Centre de recherche du Centre Hospitalier Universitaire de Sherbrooke, Sherbrooke, QC, Canada; Neurosciences Sherbrooke, Institut de Pharmacologie de Sherbrooke, Sherbrooke, QC, Canada
| | - Dimitri Ryczko
- Département de Pharmacologie-Physiologie, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Sherbrooke, QC, Canada; Centre de recherche du Centre Hospitalier Universitaire de Sherbrooke, Sherbrooke, QC, Canada; Neurosciences Sherbrooke, Institut de Pharmacologie de Sherbrooke, Sherbrooke, QC, Canada.
| |
Collapse
|
4
|
White SR, Preston MW, Swanson K, Laubach M. Learning to Choose: Behavioral Dynamics Underlying the Initial Acquisition of Decision-Making. eNeuro 2024; 11:ENEURO.0142-24.2024. [PMID: 38724267 PMCID: PMC11103646 DOI: 10.1523/eneuro.0142-24.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2024] [Revised: 04/26/2024] [Accepted: 04/30/2024] [Indexed: 05/19/2024] Open
Abstract
Current theories of decision-making propose that decisions arise through competition between choice options. Computational models of the decision process estimate how quickly information about choice options is integrated and how much information is needed to trigger a choice. Experiments using this approach typically report data from well-trained participants. As such, we do not know how the decision process evolves as a decision-making task is learned for the first time. To address this gap, we used a behavioral design separating learning the value of choice options from learning to make choices. We trained male rats to respond to single visual stimuli with different reward values. Then, we trained them to make choices between pairs of stimuli. Initially, the rats responded more slowly when presented with choices. However, as they gained experience in making choices, this slowing reduced. Response slowing on choice trials persisted throughout the testing period. We found that it was specifically associated with increased exponential variability when the rats chose the higher value stimulus. Additionally, our analysis using drift diffusion modeling revealed that the rats required less information to make choices over time. These reductions in the decision threshold occurred after just a single session of choice learning. These findings provide new insights into the learning process of decision-making tasks. They suggest that the value of choice options and the ability to make choices are learned separately and that experience plays a crucial role in improving decision-making performance.
Collapse
Affiliation(s)
- Samantha R White
- Department of Neuroscience, American University, Washington, DC 20016
| | - Michael W Preston
- Department of Neuroscience, American University, Washington, DC 20016
| | - Kyra Swanson
- Department of Neuroscience, American University, Washington, DC 20016
| | - Mark Laubach
- Department of Neuroscience, American University, Washington, DC 20016
| |
Collapse
|
5
|
White SR, Preston MW, Swanson K, Laubach M. Learning to Choose: Behavioral Dynamics Underlying the Initial Acquisition of Decision Making. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.02.28.582581. [PMID: 38464283 PMCID: PMC10925347 DOI: 10.1101/2024.02.28.582581] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/12/2024]
Abstract
Current theories of decision making propose that decisions arise through competition between choice options. Computational models of the decision process estimate how quickly information about choice options is integrated and how much information is needed to trigger a choice. Experiments using this approach typically report data from well-trained participants. As such, we do not know how the decision process evolves as a decision-making task is learned for the first time. To address this gap, we used a behavioral design separating learning the value of choice options from learning to make choices. We trained male rats to respond to single visual stimuli with different reward values. Then, we trained them to make choices between pairs of stimuli. Initially, the rats responded more slowly when presented with choices. However, as they gained experience in making choices, this slowing reduced. Response slowing on choice trials persisted throughout the testing period. We found that it was specifically associated with increased exponential variability when the rats chose the higher value stimulus. Additionally, our analysis using drift diffusion modeling revealed that the rats required less information to make choices over time. Surprisingly, we observed reductions in the decision threshold after just a single session of choice learning. These findings provide new insights into the learning process of decision-making tasks. They suggest that the value of choice options and the ability to make choices are learned separately, and that experience plays a crucial role in improving decision-making performance.
Collapse
Affiliation(s)
- Samantha R White
- Department of Neuroscience, American University, Washington, DC, USA
| | - Michael W Preston
- Department of Neuroscience, American University, Washington, DC, USA
| | - Kyra Swanson
- Department of Neuroscience, American University, Washington, DC, USA
| | - Mark Laubach
- Department of Neuroscience, American University, Washington, DC, USA
| |
Collapse
|
6
|
Kuan AT, Bondanelli G, Driscoll LN, Han J, Kim M, Hildebrand DGC, Graham BJ, Wilson DE, Thomas LA, Panzeri S, Harvey CD, Lee WCA. Synaptic wiring motifs in posterior parietal cortex support decision-making. Nature 2024; 627:367-373. [PMID: 38383788 PMCID: PMC11162200 DOI: 10.1038/s41586-024-07088-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Accepted: 01/17/2024] [Indexed: 02/23/2024]
Abstract
The posterior parietal cortex exhibits choice-selective activity during perceptual decision-making tasks1-10. However, it is not known how this selective activity arises from the underlying synaptic connectivity. Here we combined virtual-reality behaviour, two-photon calcium imaging, high-throughput electron microscopy and circuit modelling to analyse how synaptic connectivity between neurons in the posterior parietal cortex relates to their selective activity. We found that excitatory pyramidal neurons preferentially target inhibitory interneurons with the same selectivity. In turn, inhibitory interneurons preferentially target pyramidal neurons with opposite selectivity, forming an opponent inhibition motif. This motif was present even between neurons with activity peaks in different task epochs. We developed neural-circuit models of the computations performed by these motifs, and found that opponent inhibition between neural populations with opposite selectivity amplifies selective inputs, thereby improving the encoding of trial-type information. The models also predict that opponent inhibition between neurons with activity peaks in different task epochs contributes to creating choice-specific sequential activity. These results provide evidence for how synaptic connectivity in cortical circuits supports a learned decision-making task.
Collapse
Affiliation(s)
- Aaron T Kuan
- Department of Neurobiology, Harvard Medical School, Boston, MA, USA
- Department of Neuroscience, Yale School of Medicine, New Haven, CT, USA
| | - Giulio Bondanelli
- Neural Computation Laboratory, Istituto Italiano di Tecnologia, Genoa, Italy
- Department of Excellence for Neural Information Processing, University Medical Center Hamburg-Eppendorf (UKE), Hamburg, Germany
| | - Laura N Driscoll
- Department of Neurobiology, Harvard Medical School, Boston, MA, USA
- Allen Institute for Neural Dynamics, Allen Institute, Seattle, WA, USA
| | - Julie Han
- Department of Neurobiology, Harvard Medical School, Boston, MA, USA
- Khoury College of Computer Sciences, Northeastern University, Seattle, WA, USA
| | - Minsu Kim
- Department of Neurobiology, Harvard Medical School, Boston, MA, USA
| | - David G C Hildebrand
- Department of Neurobiology, Harvard Medical School, Boston, MA, USA
- Laboratory of Neural Systems, The Rockefeller University, New York, NY, USA
| | - Brett J Graham
- Department of Neurobiology, Harvard Medical School, Boston, MA, USA
- Space Telescope Science Institute, Baltimore, MD, USA
| | - Daniel E Wilson
- Department of Neurobiology, Harvard Medical School, Boston, MA, USA
| | - Logan A Thomas
- Department of Neurobiology, Harvard Medical School, Boston, MA, USA
- Biophysics Graduate Group, University of California Berkeley, Berkeley, CA, USA
| | - Stefano Panzeri
- Neural Computation Laboratory, Istituto Italiano di Tecnologia, Genoa, Italy.
- Department of Excellence for Neural Information Processing, University Medical Center Hamburg-Eppendorf (UKE), Hamburg, Germany.
| | | | - Wei-Chung Allen Lee
- Department of Neurobiology, Harvard Medical School, Boston, MA, USA.
- FM Kirby Neurobiology Center, Boston Children's Hospital, Boston, MA, USA.
| |
Collapse
|
7
|
Brown LS, Cho JR, Bolkan SS, Nieh EH, Schottdorf M, Tank DW, Brody CD, Witten IB, Goldman MS. Neural circuit models for evidence accumulation through choice-selective sequences. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.09.01.555612. [PMID: 38234715 PMCID: PMC10793437 DOI: 10.1101/2023.09.01.555612] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/19/2024]
Abstract
Decision making is traditionally thought to be mediated by populations of neurons whose firing rates persistently accumulate evidence across time. However, recent decision-making experiments in rodents have observed neurons across the brain that fire sequentially as a function of spatial position or time, rather than persistently, with the subset of neurons in the sequence depending on the animal's choice. We develop two new candidate circuit models, in which evidence is encoded either in the relative firing rates of two competing chains of neurons or in the network location of a stereotyped pattern ("bump") of neural activity. Encoded evidence is then faithfully transferred between neuronal populations representing different positions or times. Neural recordings from four different brain regions during a decision-making task showed that, during the evidence accumulation period, different brain regions displayed tuning curves consistent with different candidate models for evidence accumulation. This work provides mechanistic models and potential neural substrates for how graded-value information may be precisely accumulated within and transferred between neural populations, a set of computations fundamental to many cognitive operations.
Collapse
|
8
|
Durstewitz D, Koppe G, Thurm MI. Reconstructing computational system dynamics from neural data with recurrent neural networks. Nat Rev Neurosci 2023; 24:693-710. [PMID: 37794121 DOI: 10.1038/s41583-023-00740-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/18/2023] [Indexed: 10/06/2023]
Abstract
Computational models in neuroscience usually take the form of systems of differential equations. The behaviour of such systems is the subject of dynamical systems theory. Dynamical systems theory provides a powerful mathematical toolbox for analysing neurobiological processes and has been a mainstay of computational neuroscience for decades. Recently, recurrent neural networks (RNNs) have become a popular machine learning tool for studying the non-linear dynamics of neural and behavioural processes by emulating an underlying system of differential equations. RNNs have been routinely trained on similar behavioural tasks to those used for animal subjects to generate hypotheses about the underlying computational mechanisms. By contrast, RNNs can also be trained on the measured physiological and behavioural data, thereby directly inheriting their temporal and geometrical properties. In this way they become a formal surrogate for the experimentally probed system that can be further analysed, perturbed and simulated. This powerful approach is called dynamical system reconstruction. In this Perspective, we focus on recent trends in artificial intelligence and machine learning in this exciting and rapidly expanding field, which may be less well known in neuroscience. We discuss formal prerequisites, different model architectures and training approaches for RNN-based dynamical system reconstructions, ways to evaluate and validate model performance, how to interpret trained models in a neuroscience context, and current challenges.
Collapse
Affiliation(s)
- Daniel Durstewitz
- Dept. of Theoretical Neuroscience, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany.
- Interdisciplinary Center for Scientific Computing, Heidelberg University, Heidelberg, Germany.
- Faculty of Physics and Astronomy, Heidelberg University, Heidelberg, Germany.
| | - Georgia Koppe
- Dept. of Theoretical Neuroscience, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
- Dept. of Psychiatry and Psychotherapy, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
- Hector Institute for Artificial Intelligence in Psychiatry, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Max Ingo Thurm
- Dept. of Theoretical Neuroscience, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| |
Collapse
|
9
|
Genkin M, Shenoy KV, Chandrasekaran C, Engel TA. The dynamics and geometry of choice in premotor cortex. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.07.22.550183. [PMID: 37546748 PMCID: PMC10401920 DOI: 10.1101/2023.07.22.550183] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/08/2023]
Abstract
The brain represents sensory variables in the coordinated activity of neural populations, in which tuning curves of single neurons define the geometry of the population code. Whether the same coding principle holds for dynamic cognitive variables remains unknown because internal cognitive processes unfold with a unique time course on single trials observed only in the irregular spiking of heterogeneous neural populations. Here we show the existence of such a population code for the dynamics of choice formation in the primate premotor cortex. We developed an approach to simultaneously infer population dynamics and tuning functions of single neurons to the population state. Applied to spike data recorded during decision-making, our model revealed that populations of neurons encoded the same dynamic variable predicting choices, and heterogeneous firing rates resulted from the diverse tuning of single neurons to this decision variable. The inferred dynamics indicated an attractor mechanism for decision computation. Our results reveal a common geometric principle for neural encoding of sensory and dynamic cognitive variables.
Collapse
Affiliation(s)
| | - Krishna V Shenoy
- Howard Hughes Medical Institute, Stanford University, Stanford, CA
- Department of Electrical Engineering, Stanford University, Stanford, CA
| | - Chandramouli Chandrasekaran
- Department of Anatomy & Neurobiology, Boston University, Boston, MA
- Department of Psychological and Brain Sciences, Boston University, Boston, MA
- Center for Systems Neuroscience, Boston University, Boston, MA
| | - Tatiana A Engel
- Cold Spring Harbor Laboratory, Cold Spring Harbor, NY
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ
| |
Collapse
|
10
|
Langdon C, Genkin M, Engel TA. A unifying perspective on neural manifolds and circuits for cognition. Nat Rev Neurosci 2023; 24:363-377. [PMID: 37055616 PMCID: PMC11058347 DOI: 10.1038/s41583-023-00693-x] [Citation(s) in RCA: 19] [Impact Index Per Article: 19.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/06/2023] [Indexed: 04/15/2023]
Abstract
Two different perspectives have informed efforts to explain the link between the brain and behaviour. One approach seeks to identify neural circuit elements that carry out specific functions, emphasizing connectivity between neurons as a substrate for neural computations. Another approach centres on neural manifolds - low-dimensional representations of behavioural signals in neural population activity - and suggests that neural computations are realized by emergent dynamics. Although manifolds reveal an interpretable structure in heterogeneous neuronal activity, finding the corresponding structure in connectivity remains a challenge. We highlight examples in which establishing the correspondence between low-dimensional activity and connectivity has been possible, unifying the neural manifold and circuit perspectives. This relationship is conspicuous in systems in which the geometry of neural responses mirrors their spatial layout in the brain, such as the fly navigational system. Furthermore, we describe evidence that, in systems in which neural responses are heterogeneous, the circuit comprises interactions between activity patterns on the manifold via low-rank connectivity. We suggest that unifying the manifold and circuit approaches is important if we are to be able to causally test theories about the neural computations that underlie behaviour.
Collapse
Affiliation(s)
- Christopher Langdon
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA
- Cold Spring Harbor Laboratory, Cold Spring Harbor, NY, USA
| | - Mikhail Genkin
- Cold Spring Harbor Laboratory, Cold Spring Harbor, NY, USA
| | - Tatiana A Engel
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA.
- Cold Spring Harbor Laboratory, Cold Spring Harbor, NY, USA.
| |
Collapse
|