1
|
Goudar V, Kim JW, Liu Y, Dede AJO, Jutras MJ, Skelin I, Ruvalcaba M, Chang W, Ram B, Fairhall AL, Lin JJ, Knight RT, Buffalo EA, Wang XJ. A Comparison of Rapid Rule-Learning Strategies in Humans and Monkeys. J Neurosci 2024; 44:e0231232024. [PMID: 38871463 DOI: 10.1523/jneurosci.0231-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Revised: 05/28/2024] [Accepted: 05/31/2024] [Indexed: 06/15/2024] Open
Abstract
Interspecies comparisons are key to deriving an understanding of the behavioral and neural correlates of human cognition from animal models. We perform a detailed comparison of the strategies of female macaque monkeys to male and female humans on a variant of the Wisconsin Card Sorting Test (WCST), a widely studied and applied task that provides a multiattribute measure of cognitive function and depends on the frontal lobe. WCST performance requires the inference of a rule change given ambiguous feedback. We found that well-trained monkeys infer new rules three times more slowly than minimally instructed humans. Input-dependent hidden Markov model-generalized linear models were fit to their choices, revealing hidden states akin to feature-based attention in both species. Decision processes resembled a win-stay, lose-shift strategy with interspecies similarities as well as key differences. Monkeys and humans both test multiple rule hypotheses over a series of rule-search trials and perform inference-like computations to exclude candidate choice options. We quantitatively show that perseveration, random exploration, and poor sensitivity to negative feedback account for the slower task-switching performance in monkeys.
Collapse
Affiliation(s)
- Vishwa Goudar
- Center for Neural Science, New York University, New York 10003
| | - Jeong-Woo Kim
- Center for Neural Science, New York University, New York 10003
| | - Yue Liu
- Center for Neural Science, New York University, New York 10003
| | - Adam J O Dede
- Department of Physiology and Biophysics, University of Washington, Seattle, Washington 98195
| | - Michael J Jutras
- Department of Physiology and Biophysics, University of Washington, Seattle, Washington 98195
| | - Ivan Skelin
- Department of Neurology, University of California, Davis, California 95616
- The Center for Mind and Brain, University of California, Davis, California 95616
| | - Michael Ruvalcaba
- Helen Wills Neuroscience Institute, University of California, Berkeley, California 94720
| | - William Chang
- Helen Wills Neuroscience Institute, University of California, Berkeley, California 94720
| | - Bhargavi Ram
- Department of Neurology, University of California, Davis, California 95616
- The Center for Mind and Brain, University of California, Davis, California 95616
| | - Adrienne L Fairhall
- Department of Physiology and Biophysics, University of Washington, Seattle, Washington 98195
| | - Jack J Lin
- Department of Neurology, University of California, Davis, California 95616
- The Center for Mind and Brain, University of California, Davis, California 95616
| | - Robert T Knight
- Helen Wills Neuroscience Institute, University of California, Berkeley, California 94720
- Department of Psychology, University of California, Berkeley, California 94720
| | - Elizabeth A Buffalo
- Department of Physiology and Biophysics, University of Washington, Seattle, Washington 98195
- Washington Primate Research Center, University of Washington, Seattle, Washington 98195
| | - Xiao-Jing Wang
- Center for Neural Science, New York University, New York 10003
| |
Collapse
|
2
|
Shields BC, Yan H, Lim SSX, Burwell SCV, Cammarata CM, Fleming EA, Yousefzadeh SA, Goldenshtein VZ, Kahuno EW, Vagadia PP, Loughran MH, Zhiquan L, McDonnell ME, Scalabrino ML, Thapa M, Hawley TM, Field GD, Hull C, Schiltz GE, Glickfeld LL, Reitz AB, Tadross MR. DART.2: bidirectional synaptic pharmacology with thousandfold cellular specificity. Nat Methods 2024; 21:1288-1297. [PMID: 38877316 DOI: 10.1038/s41592-024-02292-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2022] [Accepted: 04/25/2024] [Indexed: 06/16/2024]
Abstract
Precision pharmacology aims to manipulate specific cellular interactions within complex tissues. In this pursuit, we introduce DART.2 (drug acutely restricted by tethering), a second-generation cell-specific pharmacology technology. The core advance is optimized cellular specificity-up to 3,000-fold in 15 min-enabling the targeted delivery of even epileptogenic drugs without off-target effects. Additionally, we introduce brain-wide dosing methods as an alternative to local cannulation and tracer reagents for brain-wide dose quantification. We describe four pharmaceuticals-two that antagonize excitatory and inhibitory postsynaptic receptors, and two that allosterically potentiate these receptors. Their versatility is showcased across multiple mouse-brain regions, including cerebellum, striatum, visual cortex and retina. Finally, in the ventral tegmental area, we find that blocking inhibitory inputs to dopamine neurons accelerates locomotion, contrasting with previous optogenetic and pharmacological findings. Beyond enabling the bidirectional perturbation of chemical synapses, these reagents offer intersectional precision-between genetically defined postsynaptic cells and neurotransmitter-defined presynaptic partners.
Collapse
Affiliation(s)
- Brenda C Shields
- Department of Biomedical Engineering, Duke University, Durham, NC, USA
| | - Haidun Yan
- Department of Biomedical Engineering, Duke University, Durham, NC, USA
- Department of Neurobiology, Duke University, Durham, NC, USA
| | - Shaun S X Lim
- Department of Biomedical Engineering, Duke University, Durham, NC, USA
| | | | | | | | | | | | | | - Purav P Vagadia
- Department of Chemistry, Northwestern University, Evanston, IL, USA
| | | | - Lei Zhiquan
- Department of Chemistry, Northwestern University, Evanston, IL, USA
| | | | | | - Mishek Thapa
- Department of Neurobiology, Duke University, Durham, NC, USA
| | - Tammy M Hawley
- Department of Neurobiology, Duke University, Durham, NC, USA
| | - Greg D Field
- Department of Biomedical Engineering, Duke University, Durham, NC, USA
- Department of Neurobiology, Duke University, Durham, NC, USA
| | - Court Hull
- Department of Neurobiology, Duke University, Durham, NC, USA
| | - Gary E Schiltz
- Department of Chemistry, Northwestern University, Evanston, IL, USA
| | | | - Allen B Reitz
- Fox Chase Therapeutics Discovery, Inc., Doylestown, PA, USA
| | - Michael R Tadross
- Department of Biomedical Engineering, Duke University, Durham, NC, USA.
- Department of Neurobiology, Duke University, Durham, NC, USA.
| |
Collapse
|
3
|
Chen Y, Chien J, Dai B, Lin D, Chen ZS. Identifying behavioral links to neural dynamics of multifiber photometry recordings in a mouse social behavior network. J Neural Eng 2024; 21:036051. [PMID: 38861996 DOI: 10.1088/1741-2552/ad5702] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2024] [Accepted: 06/11/2024] [Indexed: 06/13/2024]
Abstract
Objective.Distributed hypothalamic-midbrain neural circuits help orchestrate complex behavioral responses during social interactions. Given rapid advances in optical imaging, it is a fundamental question how population-averaged neural activity measured by multi-fiber photometry (MFP) for calcium fluorescence signals correlates with social behaviors is a fundamental question. This paper aims to investigate the correspondence between MFP data and social behaviors.Approach:We propose a state-space analysis framework to characterize mouse MFP data based on dynamic latent variable models, which include a continuous-state linear dynamical system and a discrete-state hidden semi-Markov model. We validate these models on extensive MFP recordings during aggressive and mating behaviors in male-male and male-female interactions, respectively.Main results:Our results show that these models are capable of capturing both temporal behavioral structure and associated neural states, and produce interpretable latent states. Our approach is also validated in computer simulations in the presence of known ground truth.Significance:Overall, these analysis approaches provide a state-space framework to examine neural dynamics underlying social behaviors and reveals mechanistic insights into the relevant networks.
Collapse
Affiliation(s)
- Yibo Chen
- Department of Psychiatry, Department of Neuroscience and Physiology, New York University School of Medicine, New York, NY, United States of America
- Program in Artificial Intelligence, University of Science and Technology of China, Hefei, Anhui, People's Republic of China
| | - Jonathan Chien
- Department of Psychiatry, Department of Neuroscience and Physiology, New York University School of Medicine, New York, NY, United States of America
| | - Bing Dai
- Neuroscience Institute, New York University Grossman School of Medicine, New York, NY, United States of America
| | - Dayu Lin
- Department of Psychiatry, Department of Neuroscience and Physiology, New York University School of Medicine, New York, NY, United States of America
- Neuroscience Institute, New York University Grossman School of Medicine, New York, NY, United States of America
- Center for Neural Science, New York University, New York, NY, United States of America
| | - Zhe Sage Chen
- Department of Psychiatry, Department of Neuroscience and Physiology, New York University School of Medicine, New York, NY, United States of America
- Neuroscience Institute, New York University Grossman School of Medicine, New York, NY, United States of America
- Department of Biomedical Engineering, NYU Tandon School of Engineering, Brooklyn, NY, United States of America
| |
Collapse
|
4
|
Wang R, Chen ZS. Large-scale foundation models and generative AI for BigData neuroscience. Neurosci Res 2024:S0168-0102(24)00075-0. [PMID: 38897235 DOI: 10.1016/j.neures.2024.06.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2023] [Revised: 04/15/2024] [Accepted: 05/15/2024] [Indexed: 06/21/2024]
Abstract
Recent advances in machine learning have led to revolutionary breakthroughs in computer games, image and natural language understanding, and scientific discovery. Foundation models and large-scale language models (LLMs) have recently achieved human-like intelligence thanks to BigData. With the help of self-supervised learning (SSL) and transfer learning, these models may potentially reshape the landscapes of neuroscience research and make a significant impact on the future. Here we present a mini-review on recent advances in foundation models and generative AI models as well as their applications in neuroscience, including natural language and speech, semantic memory, brain-machine interfaces (BMIs), and data augmentation. We argue that this paradigm-shift framework will open new avenues for many neuroscience research directions and discuss the accompanying challenges and opportunities.
Collapse
Affiliation(s)
- Ran Wang
- Department of Psychiatry, New York University Grossman School of Medicine, New York, NY 10016, USA
| | - Zhe Sage Chen
- Department of Psychiatry, New York University Grossman School of Medicine, New York, NY 10016, USA; Department of Neuroscience and Physiology, Neuroscience Institute, New York University Grossman School of Medicine, New York, NY 10016, USA; Department of Biomedical Engineering, New York University Tandon School of Engineering, Brooklyn, NY 11201, USA.
| |
Collapse
|
5
|
Locantore J, Liu Y, White J, Wallace JB, Beron CC, Sabatini BL, Wallace ML. Mixed representations of choice and outcome by GABA/glutamate cotransmitting neurons in the entopeduncular nucleus. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.06.07.597980. [PMID: 38895480 PMCID: PMC11185773 DOI: 10.1101/2024.06.07.597980] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/21/2024]
Abstract
The basal ganglia (BG) are an evolutionarily conserved and phylogenetically old set of sub-cortical nuclei that guide action selection, evaluation, and reinforcement. The entopeduncular nucleus (EP) is a major BG output nucleus that contains a population of GABA/glutamate cotransmitting neurons (EP Sst+ ) that specifically target the lateral habenula (LHb) and whose function in behavior remains mysterious. Here we use a probabilistic switching task that requires an animal to maintain flexible relationships between action selection and evaluation to examine when and how GABA/glutamate cotransmitting neurons contribute to behavior. We find that EP Sst+ neurons are strongly engaged during this task and show bidirectional changes in activity during the choice and outcome periods of a trial. We then tested the effects of either permanently blocking cotransmission or modifying the GABA/glutamate ratio on behavior in well-trained animals. Neither manipulation produced detectable changes in behavior despite significant changes in synaptic transmission in the LHb, demonstrating that the outputs of these neurons are not required for on-going action-outcome updating in a probabilistic switching task.
Collapse
|
6
|
Piet A, Ponvert N, Ollerenshaw D, Garrett M, Groblewski PA, Olsen S, Koch C, Arkhipov A. Behavioral strategy shapes activation of the Vip-Sst disinhibitory circuit in visual cortex. Neuron 2024; 112:1876-1890.e4. [PMID: 38447579 PMCID: PMC11156560 DOI: 10.1016/j.neuron.2024.02.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Revised: 11/17/2023] [Accepted: 02/08/2024] [Indexed: 03/08/2024]
Abstract
In complex environments, animals can adopt diverse strategies to find rewards. How distinct strategies differentially engage brain circuits is not well understood. Here, we investigate this question, focusing on the cortical Vip-Sst disinhibitory circuit between vasoactive intestinal peptide-postive (Vip) interneurons and somatostatin-positive (Sst) interneurons. We characterize the behavioral strategies used by mice during a visual change detection task. Using a dynamic logistic regression model, we find that individual mice use mixtures of a visual comparison strategy and a statistical timing strategy. Separately, mice also have periods of task engagement and disengagement. Two-photon calcium imaging shows large strategy-dependent differences in neural activity in excitatory, Sst inhibitory, and Vip inhibitory cells in response to both image changes and image omissions. In contrast, task engagement has limited effects on neural population activity. We find that the diversity of neural correlates of strategy can be understood parsimoniously as the increased activation of the Vip-Sst disinhibitory circuit during the visual comparison strategy, which facilitates task-appropriate responses.
Collapse
Affiliation(s)
- Alex Piet
- Allen Institute, Mindscope Program, Seattle, WA, USA.
| | - Nick Ponvert
- Allen Institute, Mindscope Program, Seattle, WA, USA
| | | | | | | | - Shawn Olsen
- Allen Institute, Mindscope Program, Seattle, WA, USA
| | - Christof Koch
- Allen Institute, Mindscope Program, Seattle, WA, USA
| | | |
Collapse
|
7
|
Bandi AC, Runyan CA. Different state-dependence of population codes across cortex. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.05.23.595581. [PMID: 38826351 PMCID: PMC11142168 DOI: 10.1101/2024.05.23.595581] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2024]
Abstract
During perceptual decision-making, behavioral performance varies with changes in internal states such as arousal, motivation, and strategy. Yet it is unknown how these internal states affect information coding across cortical regions involved in differing aspects of sensory perception and decision-making. We recorded neural activity from the primary auditory cortex (AC) and posterior parietal cortex (PPC) in mice performing a navigation-based sound localization task. We then modeled transitions in the behavioral strategies mice used during task performance. Mice transitioned between three latent performance states with differing decision-making strategies: an 'optimal' state and two 'sub-optimal' states characterized by choice bias and frequent errors. Performance states strongly influenced population activity patterns in association but not sensory cortex. Surprisingly, activity of individual PPC neurons was better explained by external inputs and behavioral variables during suboptimal behavioral performance than in the optimal performance state. Furthermore, shared variability across neurons (coupling) in PPC was strongest in the optimal state. In AC, shared variability was similarly weak across all performance states. Together, these findings indicate that neural activity in association cortex is more strongly linked to internal state than in sensory cortex.
Collapse
Affiliation(s)
- Akhil C Bandi
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA
- Center for the Neural Basis of Cognition, University of Pittsburgh, Pittsburgh, PA
| | - Caroline A Runyan
- Department of Neuroscience, University of Pittsburgh, Pittsburgh, PA
- Center for the Neural Basis of Cognition, University of Pittsburgh, Pittsburgh, PA
| |
Collapse
|
8
|
Cregg JM, Sidhu SK, Leiras R, Kiehn O. Basal ganglia-spinal cord pathway that commands locomotor gait asymmetries in mice. Nat Neurosci 2024; 27:716-727. [PMID: 38347200 PMCID: PMC11001584 DOI: 10.1038/s41593-024-01569-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Accepted: 01/05/2024] [Indexed: 04/10/2024]
Abstract
The basal ganglia are essential for executing motor actions. How the basal ganglia engage spinal motor networks has remained elusive. Medullary Chx10 gigantocellular (Gi) neurons are required for turning gait programs, suggesting that turning gaits organized by the basal ganglia are executed via this descending pathway. Performing deep brainstem recordings of Chx10 Gi Ca2+ activity in adult mice, we show that striatal projection neurons initiate turning gaits via a dominant crossed pathway to Chx10 Gi neurons on the contralateral side. Using intersectional viral tracing and cell-type-specific modulation, we uncover the principal basal ganglia-spinal cord pathway for locomotor asymmetries in mice: basal ganglia → pontine reticular nucleus, oral part (PnO) → Chx10 Gi → spinal cord. Modulating the restricted PnO → Chx10 Gi pathway restores turning competence upon striatal damage, suggesting that dysfunction of this pathway may contribute to debilitating turning deficits observed in Parkinson's disease. Our results reveal the stratified circuit architecture underlying a critical motor program.
Collapse
Affiliation(s)
- Jared M Cregg
- Department of Neuroscience, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark.
| | - Simrandeep K Sidhu
- Department of Neuroscience, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| | - Roberto Leiras
- Department of Neuroscience, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| | - Ole Kiehn
- Department of Neuroscience, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark.
- Department of Neuroscience, Karolinska Institutet, Stockholm, Sweden.
| |
Collapse
|
9
|
Cheng Y, Magnard R, Langdon AJ, Lee D, Janak PH. Chronic Ethanol Exposure Produces Persistent Impairment in Cognitive Flexibility and Decision Signals in the Striatum. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.10.584332. [PMID: 38585868 PMCID: PMC10996555 DOI: 10.1101/2024.03.10.584332] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/09/2024]
Abstract
Lack of cognitive flexibility is a hallmark of substance use disorders and has been associated with drug-induced synaptic plasticity in the dorsomedial striatum (DMS). Yet the possible impact of altered plasticity on real-time striatal neural dynamics during decision-making is unclear. Here, we identified persistent impairments induced by chronic ethanol (EtOH) exposure on cognitive flexibility and striatal decision signals. After a substantial withdrawal period from prior EtOH vapor exposure, male, but not female, rats exhibited reduced adaptability and exploratory behavior during a dynamic decision-making task. Reinforcement learning models showed that prior EtOH exposure enhanced learning from rewards over omissions. Notably, neural signals in the DMS related to the decision outcome were enhanced, while those related to choice and choice-outcome conjunction were reduced, in EtOH-treated rats compared to the controls. These findings highlight the profound impact of chronic EtOH exposure on adaptive decision-making, pinpointing specific changes in striatal representations of actions and outcomes as underlying mechanisms for cognitive deficits.
Collapse
Affiliation(s)
- Yifeng Cheng
- Department Psychological and Brain Sciences, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, MD
| | - Robin Magnard
- Department Psychological and Brain Sciences, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, MD
| | - Angela J. Langdon
- Intramural Research Program, National Institute of Mental Health, National Institutes of Health, Bethesda, MD
| | - Daeyeol Lee
- Department Psychological and Brain Sciences, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, MD
- Zanvyl Krieger Mind/Brain Institute, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, MD
- Department of Neuroscience, Johns Hopkins University School of Medicine, Baltimore, MD
- Kavli Neuroscience Discovery Institute, Johns Hopkins University, Baltimore, MD
| | - Patricia H. Janak
- Department Psychological and Brain Sciences, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, MD
- Department of Neuroscience, Johns Hopkins University School of Medicine, Baltimore, MD
- Kavli Neuroscience Discovery Institute, Johns Hopkins University, Baltimore, MD
| |
Collapse
|
10
|
Venditto SJC, Miller KJ, Brody CD, Daw ND. Dynamic reinforcement learning reveals time-dependent shifts in strategy during reward learning. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.02.28.582617. [PMID: 38464244 PMCID: PMC10925334 DOI: 10.1101/2024.02.28.582617] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/12/2024]
Abstract
Different brain systems have been hypothesized to subserve multiple "experts" that compete to generate behavior. In reinforcement learning, two general processes, one model-free (MF) and one model-based (MB), are often modeled as a mixture of agents (MoA) and hypothesized to capture differences between automaticity vs. deliberation. However, shifts in strategy cannot be captured by a static MoA. To investigate such dynamics, we present the mixture-of-agents hidden Markov model (MoA-HMM), which simultaneously learns inferred action values from a set of agents and the temporal dynamics of underlying "hidden" states that capture shifts in agent contributions over time. Applying this model to a multi-step,reward-guided task in rats reveals a progression of within-session strategies: a shift from initial MB exploration to MB exploitation, and finally to reduced engagement. The inferred states predict changes in both response time and OFC neural encoding during the task, suggesting that these states are capturing real shifts in dynamics.
Collapse
|
11
|
Jha A, Ashwood ZC, Pillow JW. Active Learning for Discrete Latent Variable Models. Neural Comput 2024; 36:437-474. [PMID: 38363661 DOI: 10.1162/neco_a_01646] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2023] [Accepted: 10/13/2023] [Indexed: 02/18/2024]
Abstract
Active learning seeks to reduce the amount of data required to fit the parameters of a model, thus forming an important class of techniques in modern machine learning. However, past work on active learning has largely overlooked latent variable models, which play a vital role in neuroscience, psychology, and a variety of other engineering and scientific disciplines. Here we address this gap by proposing a novel framework for maximum-mutual-information input selection for discrete latent variable regression models. We first apply our method to a class of models known as mixtures of linear regressions (MLR). While it is well known that active learning confers no advantage for linear-gaussian regression models, we use Fisher information to show analytically that active learning can nevertheless achieve large gains for mixtures of such models, and we validate this improvement using both simulations and real-world data. We then consider a powerful class of temporally structured latent variable models given by a hidden Markov model (HMM) with generalized linear model (GLM) observations, which has recently been used to identify discrete states from animal decision-making data. We show that our method substantially reduces the amount of data needed to fit GLM-HMMs and outperforms a variety of approximate methods based on variational and amortized inference. Infomax learning for latent variable models thus offers a powerful approach for characterizing temporally structured latent states, with a wide variety of applications in neuroscience and beyond.
Collapse
Affiliation(s)
- Aditi Jha
- Princeton Neuroscience Institute and Department of Electrical and Computer Engineering, Princeton University, Princeton, NJ 08544, U.S.A.
| | - Zoe C Ashwood
- Princeton Neuroscience Institute and Department of Computer Science, Princeton University, Princeton, NJ 08544, U.S.A.
| | - Jonathan W Pillow
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ 08544, U.S.A.
| |
Collapse
|
12
|
Gupta D, DePasquale B, Kopec CD, Brody CD. Trial-history biases in evidence accumulation can give rise to apparent lapses in decision-making. Nat Commun 2024; 15:662. [PMID: 38253526 PMCID: PMC10803295 DOI: 10.1038/s41467-024-44880-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2023] [Accepted: 01/04/2024] [Indexed: 01/24/2024] Open
Abstract
Trial history biases and lapses are two of the most common suboptimalities observed during perceptual decision-making. These suboptimalities are routinely assumed to arise from distinct processes. However, previous work has suggested that they covary in their prevalence and that their proposed neural substrates overlap. Here we demonstrate that during decision-making, history biases and apparent lapses can both arise from a common cognitive process that is optimal under mistaken beliefs that the world is changing i.e. nonstationary. This corresponds to an accumulation-to-bound model with history-dependent updates to the initial state of the accumulator. We test our model's predictions about the relative prevalence of history biases and lapses, and show that they are robustly borne out in two distinct decision-making datasets of male rats, including data from a novel reaction time task. Our model improves the ability to precisely predict decision-making dynamics within and across trials, by positing a process through which agents can generate quasi-stochastic choices.
Collapse
Affiliation(s)
- Diksha Gupta
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA.
- Sainsbury Wellcome Centre, University College London, London, UK.
| | - Brian DePasquale
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA
- Department of Biomedical Engineering, Boston University, Boston, MA, USA
| | - Charles D Kopec
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA
| | - Carlos D Brody
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA.
- Howard Hughes Medical Institute, Princeton University, Princeton, NJ, USA.
| |
Collapse
|
13
|
Brown LS, Cho JR, Bolkan SS, Nieh EH, Schottdorf M, Tank DW, Brody CD, Witten IB, Goldman MS. Neural circuit models for evidence accumulation through choice-selective sequences. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.09.01.555612. [PMID: 38234715 PMCID: PMC10793437 DOI: 10.1101/2023.09.01.555612] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/19/2024]
Abstract
Decision making is traditionally thought to be mediated by populations of neurons whose firing rates persistently accumulate evidence across time. However, recent decision-making experiments in rodents have observed neurons across the brain that fire sequentially as a function of spatial position or time, rather than persistently, with the subset of neurons in the sequence depending on the animal's choice. We develop two new candidate circuit models, in which evidence is encoded either in the relative firing rates of two competing chains of neurons or in the network location of a stereotyped pattern ("bump") of neural activity. Encoded evidence is then faithfully transferred between neuronal populations representing different positions or times. Neural recordings from four different brain regions during a decision-making task showed that, during the evidence accumulation period, different brain regions displayed tuning curves consistent with different candidate models for evidence accumulation. This work provides mechanistic models and potential neural substrates for how graded-value information may be precisely accumulated within and transferred between neural populations, a set of computations fundamental to many cognitive operations.
Collapse
|
14
|
Reinhold K, Iadarola M, Tang S, Kuwamoto W, Sun S, Hakim R, Zimmer J, Wang W, Sabatini BL. Striatum supports fast learning but not memory recall. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.11.08.566333. [PMID: 37986941 PMCID: PMC10659398 DOI: 10.1101/2023.11.08.566333] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/22/2023]
Abstract
Animals learn to carry out motor actions in specific sensory contexts to achieve goals. The striatum has been implicated in producing sensory-motor associations, yet its contribution to memory formation or recall is not clear. To investigate the contribution of striatum to these processes, mice were taught to associate a cue, consisting of optogenetic activation of striatum-projecting neurons in visual cortex, with forelimb reaches to access food pellets. As necessary to direct learning, striatal neural activity encoded both the sensory context and outcome of reaching. With training, the rate of cued reaching increased, but brief optogenetic inhibition of striatal activity arrested learning and prevented trial-to-trial improvements in performance. However, the same manipulation did not affect performance improvements already consolidated into short- (within an hour) or long-term (across days) memories. Hence, striatal activity is necessary for trial-to-trial improvements in task performance, leading to plasticity in other brain areas that mediate memory recall.
Collapse
|
15
|
Young MK, Conn KA, Das J, Zou S, Alexander S, Burne TH, Kesby JP. Activity in the Dorsomedial Striatum Underlies Serial Reversal Learning Performance Under Probabilistic Uncertainty. BIOLOGICAL PSYCHIATRY GLOBAL OPEN SCIENCE 2023; 3:1030-1041. [PMID: 37881585 PMCID: PMC10593872 DOI: 10.1016/j.bpsgos.2022.08.005] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Revised: 08/16/2022] [Accepted: 08/17/2022] [Indexed: 11/17/2022] Open
Abstract
Background Corticostriatal circuits, particularly the dorsomedial striatum (DMS) and lateral orbitofrontal cortex, are critical for navigating reversal learning under probabilistic uncertainty. These same areas are implicated in the reversal learning impairments observed in individuals with psychosis as well as their psychotic symptoms, suggesting that they may share a common neurobiological substrate. To address this question, we used psychostimulant exposure and specific activation of the DMS during reversal learning in mice to assess corticostriatal activity. Methods We used amphetamine treatment to induce psychosis-relevant neurobiology in male mice during reversal learning and to examine pathway-specific corticostriatal activation. To determine the causal role of DMS activity, we used chemogenetics to drive midbrain inputs during a range of probabilistic contingencies. Results Mice treated with amphetamine showed altered punishment learning, which was associated with decreased shifting after losses and increased perseverative errors after reversals. Reversal learning performance and strategies were dependent on increased activity in lateral orbitofrontal cortex to DMS circuits as well as in the DMS itself. Specific activation of midbrain to DMS circuits also decreased shifting after losses and reversal learning performance. However, these alterations were dependent on the probabilistic contingency. Conclusions Our work suggests that the DMS plays a multifaceted role in reversal learning. Increasing DMS activity impairs multiple reversal learning processes dependent on the level of uncertainty, confirming its role in the maintenance and selection of incoming cortical inputs. Together, these outcomes suggest that elevated dopamine levels in the DMS could contribute to decision-making impairments in individuals with psychosis.
Collapse
Affiliation(s)
- Madison K. Young
- Queensland Brain Institute, The University of Queensland, Brisbane, Queensland, Australia
| | - Kyna-Anne Conn
- Queensland Brain Institute, The University of Queensland, Brisbane, Queensland, Australia
| | - Joyosmita Das
- Queensland Brain Institute, The University of Queensland, Brisbane, Queensland, Australia
| | - Simin Zou
- Queensland Brain Institute, The University of Queensland, Brisbane, Queensland, Australia
| | - Suzy Alexander
- Queensland Brain Institute, The University of Queensland, Brisbane, Queensland, Australia
- Queensland Centre for Mental Health Research, Brisbane, Queensland, Australia
| | - Thomas H.J. Burne
- Queensland Brain Institute, The University of Queensland, Brisbane, Queensland, Australia
- Queensland Centre for Mental Health Research, Brisbane, Queensland, Australia
| | - James P. Kesby
- Queensland Brain Institute, The University of Queensland, Brisbane, Queensland, Australia
- Queensland Centre for Mental Health Research, Brisbane, Queensland, Australia
- QIMR Berghofer Medical Research Institute, Brisbane, Queensland, Australia
| |
Collapse
|
16
|
Kono A, Shikano Y, Tanaka KF, Yamaura K, Tsutsui‐Kimura I. Inhibition of the dorsomedial striatal direct pathway is essential for the execution of action sequences. Neuropsychopharmacol Rep 2023; 43:414-424. [PMID: 37553985 PMCID: PMC10496086 DOI: 10.1002/npr2.12369] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Revised: 07/13/2023] [Accepted: 07/23/2023] [Indexed: 08/10/2023] Open
Abstract
Contrary to the previous notion that the dorsomedial striatum (DMS) is crucial for acquiring new learning, accumulated evidence has suggested that the DMS also plays a role in the execution of already learned action sequences. Here, we examined how the direct and indirect pathways in the DMS regulate action sequences using a task that requires animals to press a lever consecutively. Cell-type-specific bulk Ca2+ recording revealed that the direct pathway was inhibited at the time of sequence execution. The sequence-related response was blunted in trials where the sequential behaviors were disrupted. Optogenetic activation at the sequence start caused distraction of action sequences without affecting motor function or memory of the task structure. By contrast with the direct pathway, the indirect pathway was slightly activated at the start of the sequence, but the optogenetic suppression of such sequence-related signaling did not impact the behaviors. These results suggest that the inhibition of the DMS direct pathway promotes sequence execution potentially by suppressing the formation of a new association.
Collapse
Affiliation(s)
- Anna Kono
- Division of Brain SciencesInstitute for Advanced Medical Research, Keio University School of MedicineTokyoJapan
- Division of Social Pharmacy, Center for Social Pharmacy and Pharmaceutical Care SciencesKeio University Faculty of PharmacyTokyoJapan
| | - Yu Shikano
- Division of Brain SciencesInstitute for Advanced Medical Research, Keio University School of MedicineTokyoJapan
| | - Kenji F. Tanaka
- Division of Brain SciencesInstitute for Advanced Medical Research, Keio University School of MedicineTokyoJapan
| | - Katsunori Yamaura
- Division of Social Pharmacy, Center for Social Pharmacy and Pharmaceutical Care SciencesKeio University Faculty of PharmacyTokyoJapan
| | - Iku Tsutsui‐Kimura
- Division of Brain SciencesInstitute for Advanced Medical Research, Keio University School of MedicineTokyoJapan
| |
Collapse
|
17
|
Varin C, Cornil A, Houtteman D, Bonnavion P, de Kerchove d'Exaerde A. The respective activation and silencing of striatal direct and indirect pathway neurons support behavior encoding. Nat Commun 2023; 14:4982. [PMID: 37591838 PMCID: PMC10435545 DOI: 10.1038/s41467-023-40677-0] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2022] [Accepted: 08/03/2023] [Indexed: 08/19/2023] Open
Abstract
The basal ganglia are known to control actions and modulate movements. Neuronal activity in the two efferent pathways of the dorsal striatum is critical for appropriate behavioral control. Previous evidence has led to divergent conclusions on the respective engagement of both pathways during actions. Using calcium imaging to evaluate how neurons in the direct and indirect pathways encode behaviors during self-paced spontaneous explorations in an open field, we observed that the two striatal pathways exhibit distinct tuning properties. Supervised learning algorithms revealed that direct pathway neurons encode behaviors through their activation, whereas indirect pathway neurons exhibit behavior-specific silencing. These properties remain stable for weeks. Our findings highlight a complementary encoding of behaviors with congruent activations in the direct pathway encoding multiple accessible behaviors in a given context, and in the indirect pathway encoding the suppression of competing behaviors. This model reconciles previous conflicting conclusions on motor encoding in the striatum.
Collapse
Affiliation(s)
- Christophe Varin
- Université Libre de Bruxelles (ULB), ULB Neuroscience Institute, Neurophysiology Laboratory, Brussels, Belgium
| | - Amandine Cornil
- Université Libre de Bruxelles (ULB), ULB Neuroscience Institute, Neurophysiology Laboratory, Brussels, Belgium
| | - Delphine Houtteman
- Université Libre de Bruxelles (ULB), ULB Neuroscience Institute, Neurophysiology Laboratory, Brussels, Belgium
| | - Patricia Bonnavion
- Université Libre de Bruxelles (ULB), ULB Neuroscience Institute, Neurophysiology Laboratory, Brussels, Belgium
| | - Alban de Kerchove d'Exaerde
- Université Libre de Bruxelles (ULB), ULB Neuroscience Institute, Neurophysiology Laboratory, Brussels, Belgium.
| |
Collapse
|
18
|
Isett BR, Nguyen KP, Schwenk JC, Yurek JR, Snyder CN, Vounatsos MV, Adegbesan KA, Ziausyte U, Gittis AH. The indirect pathway of the basal ganglia promotes transient punishment but not motor suppression. Neuron 2023; 111:2218-2231.e4. [PMID: 37207651 PMCID: PMC10524991 DOI: 10.1016/j.neuron.2023.04.017] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Revised: 03/19/2023] [Accepted: 04/14/2023] [Indexed: 05/21/2023]
Abstract
Optogenetic stimulation of Adora2a receptor-expressing spiny projection neurons (A2A-SPNs) in the striatum drives locomotor suppression and transient punishment, results attributed to activation of the indirect pathway. The sole long-range projection target of A2A-SPNs is the external globus pallidus (GPe). Unexpectedly, we found that inhibition of the GPe drove transient punishment but not suppression of movement. Within the striatum, A2A-SPNs inhibit other SPNs through a short-range inhibitory collateral network, and we found that optogenetic stimuli that drove motor suppression shared a common mechanism of recruiting this inhibitory collateral network. Our results suggest that the indirect pathway plays a more prominent role in transient punishment than in motor control and challenges the assumption that activity of A2A-SPNs is synonymous with indirect pathway activity.
Collapse
Affiliation(s)
- Brian R Isett
- Department of Biological Sciences, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Katrina P Nguyen
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Jenna C Schwenk
- Department of Biological Sciences, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Jeff R Yurek
- Department of Biological Sciences, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Christen N Snyder
- Department of Biological Sciences, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Maxime V Vounatsos
- Department of Biological Sciences, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Kendra A Adegbesan
- Department of Biological Sciences, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Ugne Ziausyte
- Department of Biological Sciences, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Aryn H Gittis
- Department of Biological Sciences, Carnegie Mellon University, Pittsburgh, PA, USA.
| |
Collapse
|
19
|
Williams SR, Zhou X, Fletcher LN. Compartment-specific dendritic information processing in striatal cholinergic interneurons is reconfigured by peptide neuromodulation. Neuron 2023; 111:1933-1951.e3. [PMID: 37086722 DOI: 10.1016/j.neuron.2023.03.038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2022] [Revised: 03/29/2023] [Accepted: 03/30/2023] [Indexed: 04/24/2023]
Abstract
Cholinergic interneurons are central hubs of the striatal neuronal network, controlling information processing in a behavioral-state-dependent manner. It remains unknown, however, how such state transitions influence the integrative properties of these neurons. To address this, we made simultaneous somato-dendritic recordings from identified rodent cholinergic interneurons, revealing that action potentials are initiated at dendritic sites because of a dendritic axonal origin. Functionally, this anatomical arrangement ensured that the action potential initiation threshold was lowest at axon-bearing dendritic sites, a privilege efficacy powerfully accentuated at the hyperpolarized membrane potentials achieved in cholinergic interneurons following salient behavioral stimuli. Experimental analysis revealed the voltage-dependent attenuation of the efficacy of non-axon-bearing dendritic excitatory input was mediated by the recruitment of dendritic potassium channels, a regulatory mechanism that, in turn, was controlled by the pharmacological activation of neurokinin receptors. Together, these results indicate that the neuropeptide microenvironment dynamically controls state- and compartment-dependent dendritic information processing in striatal cholinergic interneurons.
Collapse
Affiliation(s)
- Stephen R Williams
- Queensland Brain Institute, The University of Queensland, St. Lucia, QLD 4072, Australia.
| | - Xiangyu Zhou
- Queensland Brain Institute, The University of Queensland, St. Lucia, QLD 4072, Australia
| | - Lee Norman Fletcher
- Queensland Brain Institute, The University of Queensland, St. Lucia, QLD 4072, Australia.
| |
Collapse
|
20
|
Di Bisceglie Caballero S, Ces A, Liberge M, Ambroggi F, Amalric M, Ouagazzal AM. Optogenetic Globus Pallidus Stimulation Improves Motor Deficits in 6-Hydroxydopamine-Lesioned Mouse Model of Parkinson's Disease. Int J Mol Sci 2023; 24:ijms24097935. [PMID: 37175643 PMCID: PMC10178372 DOI: 10.3390/ijms24097935] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Revised: 03/31/2023] [Accepted: 04/24/2023] [Indexed: 05/15/2023] Open
Abstract
Excessive inhibition of the external globus pallidus (GPe) by striatal GABAergic neurons is considered a central mechanism contributing to motor symptoms of Parkinson's disease (PD). While electrophysiological findings support this view, behavioral studies assessing the beneficial effects of global GPe activations are scarce and the reported results are controversial. We used an optogenetic approach and the standard unilateral 6-hydroxydopamine nigrostriatal dopamine (DA) lesion model of PD to explore the effects of GPe photostimulation on motor deficits in mice. Global optogenetic GPe inhibition was used in normal mice to verify whether it reproduced the typical motor impairment induced by DA lesions. GPe activation improved ipsilateral circling, contralateral forelimb akinesia, locomotor hypoactivity, and bradykinesia in 6-OHDA-lesioned mice at ineffective photostimulation parameters (532 nm, 5 Hz, 3 mW) in normal mice. GPe photoinhibition (450 nm, 12 mW) had no effect on locomotor activity and forelimb use in normal mice. Bilateral photoinhibition (450 nm, 6 mW/side) reduced directed exploration and improved working memory performances indicating that recruitment of GPe in physiological conditions may depend on the behavioral task involved. Collectively, these findings shed new light on the functional role of GPe and suggest that it is a promising target for neuromodulatory restoration of motor deficits in PD.
Collapse
Affiliation(s)
| | - Aurelia Ces
- Aix-Marseille Université, CNRS, LNC (UMR 729), 13331 Marseille, France
| | - Martine Liberge
- Aix-Marseille Université, CNRS, LNC (UMR 729), 13331 Marseille, France
| | - Frederic Ambroggi
- Aix-Marseille Université, CNRS, LNC (UMR 729), 13331 Marseille, France
| | - Marianne Amalric
- Aix-Marseille Université, CNRS, LNC (UMR 729), 13331 Marseille, France
| | | |
Collapse
|
21
|
Gupta D, DePasquale B, Kopec CD, Brody CD. Trial-history biases in evidence accumulation can give rise to apparent lapses. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.01.18.524599. [PMID: 36778392 PMCID: PMC9915493 DOI: 10.1101/2023.01.18.524599] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 01/21/2023]
Abstract
Trial history biases and lapses are two of the most common suboptimalities observed during perceptual decision-making. These suboptimalities are routinely assumed to arise from distinct processes. However, several hints in the literature suggest that they covary in their prevalence and that their proposed neural substrates overlap - what could underlie these links? Here we demonstrate that history biases and apparent lapses can both arise from a common cognitive process that is normative under misbeliefs about non-stationarity in the world. This corresponds to an accumulation-to-bound model with history-dependent updates to the initial state of the accumulator. We test our model's predictions about the relative prevalence of history biases and lapses, and show that they are robustly borne out in two distinct rat decision-making datasets, including data from a novel reaction time task. Our model improves the ability to precisely predict decision-making dynamics within and across trials, by positing a process through which agents can generate quasi-stochastic choices.
Collapse
Affiliation(s)
- Diksha Gupta
- Princeton Neuroscience Institute, Princeton University, Princeton, United States
| | - Brian DePasquale
- Princeton Neuroscience Institute, Princeton University, Princeton, United States
| | - Charles D Kopec
- Princeton Neuroscience Institute, Princeton University, Princeton, United States
| | - Carlos D Brody
- Princeton Neuroscience Institute, Princeton University, Princeton, United States
- Howard Hughes Medical Institute, Princeton University, Princeton, United States
| |
Collapse
|
22
|
Goudar V, Kim JW, Liu Y, Dede AJO, Jutras MJ, Skelin I, Ruvalcaba M, Chang W, Fairhall AL, Lin JJ, Knight RT, Buffalo EA, Wang XJ. Comparing rapid rule-learning strategies in humans and monkeys. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.01.10.523416. [PMID: 36711889 PMCID: PMC9882042 DOI: 10.1101/2023.01.10.523416] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/18/2023]
Abstract
Inter-species comparisons are key to deriving an understanding of the behavioral and neural correlates of human cognition from animal models. We perform a detailed comparison of macaque monkey and human strategies on an analogue of the Wisconsin Card Sort Test, a widely studied and applied multi-attribute measure of cognitive function, wherein performance requires the inference of a changing rule given ambiguous feedback. We found that well-trained monkeys rapidly infer rules but are three times slower than humans. Model fits to their choices revealed hidden states akin to feature-based attention in both species, and decision processes that resembled a Win-stay lose-shift strategy with key differences. Monkeys and humans test multiple rule hypotheses over a series of rule-search trials and perform inference-like computations to exclude candidates. An attention-set based learning stage categorization revealed that perseveration, random exploration and poor sensitivity to negative feedback explain the under-performance in monkeys.
Collapse
Affiliation(s)
- Vishwa Goudar
- Center for Neural Science, New York University, NY, USA
| | - Jeong-Woo Kim
- Center for Neural Science, New York University, NY, USA
| | - Yue Liu
- Center for Neural Science, New York University, NY, USA
| | - Adam J. O. Dede
- Department of Physiology and Biophysics, University of Washington, Seattle, WA, USA
| | - Michael J. Jutras
- Department of Physiology and Biophysics, University of Washington, Seattle, WA, USA
| | - Ivan Skelin
- Department of Neurology, University of California, Davis, Davis, CA, USA
- The Center for Mind and Brain, University of California, Davis, Davis, CA, USA
| | - Michael Ruvalcaba
- Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, CA, USA
| | - William Chang
- Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, CA, USA
| | - Adrienne L. Fairhall
- Department of Physiology and Biophysics, University of Washington, Seattle, WA, USA
| | - Jack J. Lin
- Department of Neurology, University of California, Davis, Davis, CA, USA
- The Center for Mind and Brain, University of California, Davis, Davis, CA, USA
| | - Robert T. Knight
- Department of Psychology, University of California Berkeley, Berkeley, CA, USA
- Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, CA, USA
| | - Elizabeth A. Buffalo
- Department of Physiology and Biophysics, University of Washington, Seattle, WA, USA
- Washington Primate Research Center, University of Washington, Seattle, WA, USA
| | | |
Collapse
|
23
|
Dynamic control of decision and movement speed in the human basal ganglia. Nat Commun 2022; 13:7530. [PMID: 36476581 PMCID: PMC9729212 DOI: 10.1038/s41467-022-35121-8] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2022] [Accepted: 11/17/2022] [Indexed: 12/12/2022] Open
Abstract
To optimally adjust our behavior to changing environments we need to both adjust the speed of our decisions and movements. Yet little is known about the extent to which these processes are controlled by common or separate mechanisms. Furthermore, while previous evidence from computational models and empirical studies suggests that the basal ganglia play an important role during adjustments of decision-making, it remains unclear how this is implemented. Leveraging the opportunity to directly access the subthalamic nucleus of the basal ganglia in humans undergoing deep brain stimulation surgery, we here combine invasive electrophysiological recordings, electrical stimulation and computational modelling of perceptual decision-making. We demonstrate that, while similarities between subthalamic control of decision- and movement speed exist, the causal contribution of the subthalamic nucleus to these processes can be disentangled. Our results show that the basal ganglia independently control the speed of decisions and movement for each hemisphere during adaptive behavior.
Collapse
|
24
|
Delevich K, Hoshal B, Zhou LZ, Zhang Y, Vedula S, Lin WC, Chase J, Collins AGE, Wilbrecht L. Activation, but not inhibition, of the indirect pathway disrupts choice rejection in a freely moving, multiple-choice foraging task. Cell Rep 2022; 40:111129. [PMID: 35905722 PMCID: PMC10481643 DOI: 10.1016/j.celrep.2022.111129] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2020] [Revised: 03/25/2022] [Accepted: 07/01/2022] [Indexed: 11/20/2022] Open
Abstract
The dorsomedial striatum (DMS) plays a key role in action selection, but less is known about how direct and indirect pathway spiny projection neurons (dSPNs and iSPNs, respectively) contribute to choice rejection in freely moving animals. Here, we use pathway-specific chemogenetic manipulation during a serial choice foraging task to test the role of dSPNs and iSPNs in learned choice rejection. We find that chemogenetic activation, but not inhibition, of iSPNs disrupts rejection of nonrewarded choices, contrary to predictions of a simple "select/suppress" heuristic. Our findings suggest that iSPNs' role in stopping and freezing does not extend in a simple fashion to choice rejection in an ethological, freely moving context. These data may provide insights critical for the successful design of interventions for addiction or other conditions in which it is desirable to strengthen choice rejection.
Collapse
Affiliation(s)
- Kristen Delevich
- Department of Psychology, University of California, Berkeley, Berkeley, CA 94720, USA; Department of Integrative Physiology and Neuroscience, College of Veterinary Medicine, Washington State University, Pullman, WA 99164, USA
| | - Benjamin Hoshal
- Department of Molecular and Cell Biology, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Lexi Z Zhou
- Department of Molecular and Cell Biology, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Yuting Zhang
- Department of Psychology, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Satya Vedula
- Department of Psychology, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Wan Chen Lin
- Department of Psychology, University of California, Berkeley, Berkeley, CA 94720, USA; Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Juliana Chase
- Department of Psychology, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Anne G E Collins
- Department of Psychology, University of California, Berkeley, Berkeley, CA 94720, USA; Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Linda Wilbrecht
- Department of Psychology, University of California, Berkeley, Berkeley, CA 94720, USA; Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA.
| |
Collapse
|
25
|
Pinto L, Tank DW, Brody CD. Multiple timescales of sensory-evidence accumulation across the dorsal cortex. eLife 2022; 11:e70263. [PMID: 35708483 PMCID: PMC9203055 DOI: 10.7554/elife.70263] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2021] [Accepted: 05/27/2022] [Indexed: 11/13/2022] Open
Abstract
Cortical areas seem to form a hierarchy of intrinsic timescales, but the relevance of this organization for cognitive behavior remains unknown. In particular, decisions requiring the gradual accrual of sensory evidence over time recruit widespread areas across this hierarchy. Here, we tested the hypothesis that this recruitment is related to the intrinsic integration timescales of these widespread areas. We trained mice to accumulate evidence over seconds while navigating in virtual reality and optogenetically silenced the activity of many cortical areas during different brief trial epochs. We found that the inactivation of all tested areas affected the evidence-accumulation computation. Specifically, we observed distinct changes in the weighting of sensory evidence occurring during and before silencing, such that frontal inactivations led to stronger deficits on long timescales than posterior cortical ones. Inactivation of a subset of frontal areas also led to moderate effects on behavioral processes beyond evidence accumulation. Moreover, large-scale cortical Ca2+ activity during task performance displayed different temporal integration windows. Our findings suggest that the intrinsic timescale hierarchy of distributed cortical areas is an important component of evidence-accumulation mechanisms.
Collapse
Affiliation(s)
- Lucas Pinto
- Department of Neuroscience, Northwestern UniversityChicagoUnited States
- Princeton Neuroscience Institute, Princeton UniversityPrincetonUnited States
| | - David W Tank
- Princeton Neuroscience Institute, Princeton UniversityPrincetonUnited States
| | - Carlos D Brody
- Princeton Neuroscience Institute, Princeton UniversityPrincetonUnited States
| |
Collapse
|
26
|
Holly EN, Diáz-Hernández E, Fuccillo MV. A blueprint for examining striatal control of cognition. Trends Neurosci 2022; 45:649-650. [PMID: 35690496 DOI: 10.1016/j.tins.2022.05.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Accepted: 05/26/2022] [Indexed: 10/18/2022]
Abstract
In a recent study, Bolkan, Stone, and colleagues demonstrated that direct and indirect striatal pathways in mice exert opponent control over choice behavior in a task- and state-dependent manner. This work highlights the need for rigorously controlled behavioral experiments and novel behavioral modeling in investigations of the neural mechanisms of decision making.
Collapse
|