1
|
Nau M, Schmid AC, Kaplan SM, Baker CI, Kravitz DJ. Centering cognitive neuroscience on task demands and generalization. Nat Neurosci 2024:10.1038/s41593-024-01711-6. [PMID: 39075326 DOI: 10.1038/s41593-024-01711-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2023] [Accepted: 06/17/2024] [Indexed: 07/31/2024]
Abstract
Cognitive neuroscience seeks generalizable theories explaining the relationship between behavioral, physiological and mental states. In pursuit of such theories, we propose a theoretical and empirical framework that centers on understanding task demands and the mutual constraints they impose on behavior and neural activity. Task demands emerge from the interaction between an agent's sensory impressions, goals and behavior, which jointly shape the activity and structure of the nervous system on multiple spatiotemporal scales. Understanding this interaction requires multitask studies that vary more than one experimental component (for example, stimuli and instructions) combined with dense behavioral and neural sampling and explicit testing for generalization across tasks and data modalities. By centering task demands rather than mental processes that tasks are assumed to engage, this framework paves the way for the discovery of new generalizable concepts unconstrained by existing taxonomies, and moves cognitive neuroscience toward an action-oriented, dynamic and integrated view of the brain.
Collapse
Affiliation(s)
- Matthias Nau
- Laboratory of Brain and Cognition, National Institutes of Health, Bethesda, MD, USA.
| | - Alexandra C Schmid
- Laboratory of Brain and Cognition, National Institutes of Health, Bethesda, MD, USA
| | - Simon M Kaplan
- Department of Psychological & Brain Sciences, The George Washington University, Washington, DC, USA
| | - Chris I Baker
- Laboratory of Brain and Cognition, National Institutes of Health, Bethesda, MD, USA.
| | - Dwight J Kravitz
- Department of Psychological & Brain Sciences, The George Washington University, Washington, DC, USA.
- Division of Behavioral and Cognitive Sciences, Directorate for Social, Behavioral, and Economic Sciences, US National Science Foundation, Arlington, VA, USA.
| |
Collapse
|
2
|
Delamare G, Zaki Y, Cai DJ, Clopath C. Drift of neural ensembles driven by slow fluctuations of intrinsic excitability. eLife 2024; 12:RP88053. [PMID: 38712831 DOI: 10.7554/elife.88053] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/08/2024] Open
Abstract
Representational drift refers to the dynamic nature of neural representations in the brain despite the behavior being seemingly stable. Although drift has been observed in many different brain regions, the mechanisms underlying it are not known. Since intrinsic neural excitability is suggested to play a key role in regulating memory allocation, fluctuations of excitability could bias the reactivation of previously stored memory ensembles and therefore act as a motor for drift. Here, we propose a rate-based plastic recurrent neural network with slow fluctuations of intrinsic excitability. We first show that subsequent reactivations of a neural ensemble can lead to drift of this ensemble. The model predicts that drift is induced by co-activation of previously active neurons along with neurons with high excitability which leads to remodeling of the recurrent weights. Consistent with previous experimental works, the drifting ensemble is informative about its temporal history. Crucially, we show that the gradual nature of the drift is necessary for decoding temporal information from the activity of the ensemble. Finally, we show that the memory is preserved and can be decoded by an output neuron having plastic synapses with the main region.
Collapse
Affiliation(s)
- Geoffroy Delamare
- Department of Bioengineering, Imperial College London, London, United Kingdom
| | - Yosif Zaki
- Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, United States
| | - Denise J Cai
- Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, United States
| | - Claudia Clopath
- Department of Bioengineering, Imperial College London, London, United Kingdom
| |
Collapse
|
3
|
Ratzon A, Derdikman D, Barak O. Representational drift as a result of implicit regularization. eLife 2024; 12:RP90069. [PMID: 38695551 PMCID: PMC11065423 DOI: 10.7554/elife.90069] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/04/2024] Open
Abstract
Recent studies show that, even in constant environments, the tuning of single neurons changes over time in a variety of brain regions. This representational drift has been suggested to be a consequence of continuous learning under noise, but its properties are still not fully understood. To investigate the underlying mechanism, we trained an artificial network on a simplified navigational task. The network quickly reached a state of high performance, and many units exhibited spatial tuning. We then continued training the network and noticed that the activity became sparser with time. Initial learning was orders of magnitude faster than ensuing sparsification. This sparsification is consistent with recent results in machine learning, in which networks slowly move within their solution space until they reach a flat area of the loss function. We analyzed four datasets from different labs, all demonstrating that CA1 neurons become sparser and more spatially informative with exposure to the same environment. We conclude that learning is divided into three overlapping phases: (i) Fast familiarity with the environment; (ii) slow implicit regularization; and (iii) a steady state of null drift. The variability in drift dynamics opens the possibility of inferring learning algorithms from observations of drift statistics.
Collapse
Affiliation(s)
- Aviv Ratzon
- Rappaport Faculty of Medicine, Technion - Israel Institute of TechnologyHaifaIsrael
- Network Biology Research Laboratory, Technion - Israel Institute of TechnologyHaifaIsrael
| | - Dori Derdikman
- Rappaport Faculty of Medicine, Technion - Israel Institute of TechnologyHaifaIsrael
| | - Omri Barak
- Rappaport Faculty of Medicine, Technion - Israel Institute of TechnologyHaifaIsrael
- Network Biology Research Laboratory, Technion - Israel Institute of TechnologyHaifaIsrael
| |
Collapse
|
4
|
Zheng Z(S, Huszár R, Hainmueller T, Bartos M, Williams A, Buzsáki G. Perpetual step-like restructuring of hippocampal circuit dynamics. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.04.22.590576. [PMID: 38712105 PMCID: PMC11071370 DOI: 10.1101/2024.04.22.590576] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/08/2024]
Abstract
Representation of the environment by hippocampal populations is known to drift even within a familiar environment, which could reflect gradual changes in single cell activity or result from averaging across discrete switches of single neurons. Disambiguating these possibilities is crucial, as they each imply distinct mechanisms. Leveraging change point detection and model comparison, we found that CA1 population vectors decorrelated gradually within a session. In contrast, individual neurons exhibited predominantly step-like emergence and disappearance of place fields or sustained change in within-field firing. The changes were not restricted to particular parts of the maze or trials and did not require apparent behavioral changes. The same place fields emerged, disappeared, and reappeared across days, suggesting that the hippocampus reuses pre-existing assemblies, rather than forming new fields de novo. Our results suggest an internally-driven perpetual step-like reorganization of the neuronal assemblies.
Collapse
Affiliation(s)
| | - Roman Huszár
- Center for Neural Science, New York University, New York, NY, USA
- Neuroscience Institute, New York University, New York, NY, USA
| | - Thomas Hainmueller
- Department of Psychiatry, NYU Grossman School of Medicine, New York University, New York, NY, USA
| | - Marlene Bartos
- Institute for Physiology I, University of Freiburg, Medical Faculty, 79104 Freiburg, Germany
| | - Alex Williams
- Center for Neural Science, New York University, New York, NY, USA
- Neuroscience Institute, New York University, New York, NY, USA
- Center for Computational Neuroscience, Flatiron Institute
| | - György Buzsáki
- Neuroscience Institute, New York University, New York, NY, USA
- Department of Neurology, and New York University, New York, NY, USA
| |
Collapse
|
5
|
Savelli F. Spontaneous Dynamics of Hippocampal Place Fields in a Model of Combinatorial Competition among Stable Inputs. J Neurosci 2024; 44:e1663232024. [PMID: 38316560 PMCID: PMC10977031 DOI: 10.1523/jneurosci.1663-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2023] [Revised: 01/16/2024] [Accepted: 01/21/2024] [Indexed: 02/07/2024] Open
Abstract
We present computer simulations illustrating how the plastic integration of spatially stable inputs could contribute to the dynamic character of hippocampal spatial representations. In novel environments of slightly larger size than typical apparatus, the emergence of well-defined place fields in real place cells seems to rely on inputs from normally functioning grid cells. Theoretically, the grid-to-place transformation is possible if a place cell is able to respond selectively to a combination of suitably aligned grids. We previously identified the functional characteristics that allow a synaptic plasticity rule to accomplish this selection by synaptic competition during rat foraging behavior. Here, we show that the synaptic competition can outlast the formation of place fields, contributing to their spatial reorganization over time, when the model is run in larger environments and the topographical/modular organization of grid inputs is taken into account. Co-simulated cells that differ only by their randomly assigned grid inputs display different degrees and kinds of spatial reorganization-ranging from place-field remapping to more subtle in-field changes or lapses in firing. The model predicts a greater number of place fields and propensity for remapping in place cells recorded from more septal regions of the hippocampus and/or in larger environments, motivating future experimental standardization across studies and animal models. In sum, spontaneous remapping could arise from rapid synaptic learning involving inputs that are functionally homogeneous, spatially stable, and minimally stochastic.
Collapse
Affiliation(s)
- Francesco Savelli
- Department of Neuroscience, Developmental and Regenerative Biology, The University of Texas at San Antonio, San Antonio, Texas 78249
- Neurosciences Institute, The University of Texas at San Antonio, San Antonio, Texas 78249
- Brain Health Consortium, The University of Texas at San Antonio, San Antonio, Texas 78249
| |
Collapse
|
6
|
Muysers H, Chen HL, Hahn J, Folschweiller S, Sigurdsson T, Sauer JF, Bartos M. A persistent prefrontal reference frame across time and task rules. Nat Commun 2024; 15:2115. [PMID: 38459033 PMCID: PMC10923947 DOI: 10.1038/s41467-024-46350-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Accepted: 02/22/2024] [Indexed: 03/10/2024] Open
Abstract
Behavior can be remarkably consistent, even over extended time periods, yet whether this is reflected in stable or 'drifting' neuronal responses to task features remains controversial. Here, we find a persistently active ensemble of neurons in the medial prefrontal cortex (mPFC) of mice that reliably maintains trajectory-specific tuning over several weeks while performing an olfaction-guided spatial memory task. This task-specific reference frame is stabilized during learning, upon which repeatedly active neurons show little representational drift and maintain their trajectory-specific tuning across long pauses in task exposure and across repeated changes in cue-target location pairings. These data thus suggest a 'core ensemble' of prefrontal neurons forming a reference frame of task-relevant space for the performance of consistent behavior over extended periods of time.
Collapse
Affiliation(s)
- Hannah Muysers
- Institute for Physiology I, Medical Faculty, Albert-Ludwigs-University Freiburg, Freiburg im Breisgau, Germany
- Faculty of Biology, Albert-Ludwigs-University Freiburg, Freiburg im Breisgau, Germany
| | - Hung-Ling Chen
- Institute for Physiology I, Medical Faculty, Albert-Ludwigs-University Freiburg, Freiburg im Breisgau, Germany
| | - Johannes Hahn
- Institute of Neurophysiology, Goethe University Frankfurt, Frankfurt am Main, Germany
| | - Shani Folschweiller
- Institute for Physiology I, Medical Faculty, Albert-Ludwigs-University Freiburg, Freiburg im Breisgau, Germany
- Faculty of Biology, Albert-Ludwigs-University Freiburg, Freiburg im Breisgau, Germany
- Sleep-Wake-Epilepsy Center and Center for Experimental Neurology, Department of Neurology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Torfi Sigurdsson
- Institute of Neurophysiology, Goethe University Frankfurt, Frankfurt am Main, Germany
| | - Jonas-Frederic Sauer
- Institute for Physiology I, Medical Faculty, Albert-Ludwigs-University Freiburg, Freiburg im Breisgau, Germany.
| | - Marlene Bartos
- Institute for Physiology I, Medical Faculty, Albert-Ludwigs-University Freiburg, Freiburg im Breisgau, Germany.
| |
Collapse
|
7
|
Ratzon A, Derdikman D, Barak O. Representational drift as a result of implicit regularization. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.05.04.539512. [PMID: 38370656 PMCID: PMC10871206 DOI: 10.1101/2023.05.04.539512] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/20/2024]
Abstract
Recent studies show that, even in constant environments, the tuning of single neurons changes over time in a variety of brain regions. This representational drift has been suggested to be a consequence of continuous learning under noise, but its properties are still not fully understood. To investigate the underlying mechanism, we trained an artificial network on a simplified navigational task. The network quickly reached a state of high performance, and many units exhibited spatial tuning. We then continued training the network and noticed that the activity became sparser with time. Initial learning was orders of magnitude faster than ensuing sparsification. This sparsification is consistent with recent results in machine learning, in which networks slowly move within their solution space until they reach a flat area of the loss function. We analyzed four datasets from different labs, all demonstrating that CA1 neurons become sparser and more spatially informative with exposure to the same environment. We conclude that learning is divided into three overlapping phases: (i) Fast familiarity with the environment; (ii) slow implicit regularization; (iii) a steady state of null drift. The variability in drift dynamics opens the possibility of inferring learning algorithms from observations of drift statistics.
Collapse
Affiliation(s)
- Aviv Ratzon
- Rappaport Faculty of Medicine, Technion - Israel Institute of Technology, Haifa 31096, Israel
- Network Biology Research Laboratory, Technion - Israel Institute of Technology, Haifa 32000, Israel
| | - Dori Derdikman
- Rappaport Faculty of Medicine, Technion - Israel Institute of Technology, Haifa 31096, Israel
| | - Omri Barak
- Rappaport Faculty of Medicine, Technion - Israel Institute of Technology, Haifa 31096, Israel
- Network Biology Research Laboratory, Technion - Israel Institute of Technology, Haifa 32000, Israel
| |
Collapse
|
8
|
Sosa M, Plitt MH, Giocomo LM. Hippocampal sequences span experience relative to rewards. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.12.27.573490. [PMID: 38234842 PMCID: PMC10793396 DOI: 10.1101/2023.12.27.573490] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/19/2024]
Abstract
Hippocampal place cells fire in sequences that span spatial environments and non-spatial modalities, suggesting that hippocampal activity can anchor to the most behaviorally salient aspects of experience. As reward is a highly salient event, we hypothesized that sequences of hippocampal activity can anchor to rewards. To test this, we performed two-photon imaging of hippocampal CA1 neurons as mice navigated virtual environments with changing hidden reward locations. When the reward moved, the firing fields of a subpopulation of cells moved to the same relative position with respect to reward, constructing a sequence of reward-relative cells that spanned the entire task structure. The density of these reward-relative sequences increased with task experience as additional neurons were recruited to the reward-relative population. Conversely, a largely separate subpopulation maintained a spatially-based place code. These findings thus reveal separate hippocampal ensembles can flexibly encode multiple behaviorally salient reference frames, reflecting the structure of the experience.
Collapse
Affiliation(s)
- Marielena Sosa
- Department of Neurobiology, Stanford University School of Medicine; Stanford, CA, USA
| | - Mark H. Plitt
- Department of Neurobiology, Stanford University School of Medicine; Stanford, CA, USA
- Present address: Department of Molecular and Cell Biology, University of California Berkeley; Berkeley, CA, USA
| | - Lisa M. Giocomo
- Department of Neurobiology, Stanford University School of Medicine; Stanford, CA, USA
| |
Collapse
|
9
|
Margolles P, Elosegi P, Mei N, Soto D. Unconscious Manipulation of Conceptual Representations with Decoded Neurofeedback Impacts Search Behavior. J Neurosci 2024; 44:e1235232023. [PMID: 37985180 PMCID: PMC10866193 DOI: 10.1523/jneurosci.1235-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Revised: 10/04/2023] [Accepted: 10/26/2023] [Indexed: 11/22/2023] Open
Abstract
The necessity of conscious awareness in human learning has been a long-standing topic in psychology and neuroscience. Previous research on non-conscious associative learning is limited by the low signal-to-noise ratio of the subliminal stimulus, and the evidence remains controversial, including failures to replicate. Using functional MRI decoded neurofeedback, we guided participants from both sexes to generate neural patterns akin to those observed when visually perceiving real-world entities (e.g., dogs). Importantly, participants remained unaware of the actual content represented by these patterns. We utilized an associative DecNef approach to imbue perceptual meaning (e.g., dogs) into Japanese hiragana characters that held no inherent meaning for our participants, bypassing a conscious link between the characters and the dogs concept. Despite their lack of awareness regarding the neurofeedback objective, participants successfully learned to activate the target perceptual representations in the bilateral fusiform. The behavioral significance of our training was evaluated in a visual search task. DecNef and control participants searched for dogs or scissors targets that were pre-cued by the hiragana used during DecNef training or by a control hiragana. The DecNef hiragana did not prime search for its associated target but, strikingly, participants were impaired at searching for the targeted perceptual category. Hence, conscious awareness may function to support higher-order associative learning. Meanwhile, lower-level forms of re-learning, modification, or plasticity in existing neural representations can occur unconsciously, with behavioral consequences outside the original training context. The work also provides an account of DecNef effects in terms of neural representational drift.
Collapse
Affiliation(s)
- Pedro Margolles
- Basque Center on Cognition, Brain and Language (BCBL), Donostia - San Sebastián, Gipuzkoa 20009, Spain
- Universidad del País Vasco/Euskal Herriko Unibertsitatea (UPV/EHU), Leioa, Bizkaia 48940, Spain
| | - Patxi Elosegi
- Basque Center on Cognition, Brain and Language (BCBL), Donostia - San Sebastián, Gipuzkoa 20009, Spain
- Universidad del País Vasco/Euskal Herriko Unibertsitatea (UPV/EHU), Leioa, Bizkaia 48940, Spain
| | - Ning Mei
- Basque Center on Cognition, Brain and Language (BCBL), Donostia - San Sebastián, Gipuzkoa 20009, Spain
| | - David Soto
- Basque Center on Cognition, Brain and Language (BCBL), Donostia - San Sebastián, Gipuzkoa 20009, Spain
- Ikerbasque, Basque Foundation for Science, Bilbao, Bizkaia 48009, Spain
| |
Collapse
|
10
|
Krishnan S, Sheffield ME. Reward Expectation Reduces Representational Drift in the Hippocampus. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.12.21.572809. [PMID: 38187677 PMCID: PMC10769341 DOI: 10.1101/2023.12.21.572809] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/09/2024]
Abstract
Spatial memory in the hippocampus involves dynamic neural patterns that change over days, termed representational drift. While drift may aid memory updating, excessive drift could impede retrieval. Memory retrieval is influenced by reward expectation during encoding, so we hypothesized that diminished reward expectation would exacerbate representational drift. We found that high reward expectation limited drift, with CA1 representations on one day gradually re-emerging over successive trials the following day. Conversely, the absence of reward expectation resulted in increased drift, as the gradual re-emergence of the previous day's representation did not occur. At the single cell level, lowering reward expectation caused an immediate increase in the proportion of place-fields with low trial-to-trial reliability. These place fields were less likely to be reinstated the following day, underlying increased drift in this condition. In conclusion, heightened reward expectation improves memory encoding and retrieval by maintaining reliable place fields that are gradually reinstated across days, thereby minimizing representational drift.
Collapse
|
11
|
Raut RV, Rosenthal ZP, Wang X, Miao H, Zhang Z, Lee JM, Raichle ME, Bauer AQ, Brunton SL, Brunton BW, Kutz JN. Arousal as a universal embedding for spatiotemporal brain dynamics. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.11.06.565918. [PMID: 38187528 PMCID: PMC10769245 DOI: 10.1101/2023.11.06.565918] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/09/2024]
Abstract
Neural activity in awake organisms shows widespread and spatiotemporally diverse correlations with behavioral and physiological measurements. We propose that this covariation reflects in part the dynamics of a unified, arousal-related process that regulates brain-wide physiology on the timescale of seconds. Taken together with theoretical foundations in dynamical systems, this interpretation leads us to a surprising prediction: that a single, scalar measurement of arousal (e.g., pupil diameter) should suffice to reconstruct the continuous evolution of multimodal, spatiotemporal measurements of large-scale brain physiology. To test this hypothesis, we perform multimodal, cortex-wide optical imaging and behavioral monitoring in awake mice. We demonstrate that spatiotemporal measurements of neuronal calcium, metabolism, and blood-oxygen can be accurately and parsimoniously modeled from a low-dimensional state-space reconstructed from the time history of pupil diameter. Extending this framework to behavioral and electrophysiological measurements from the Allen Brain Observatory, we demonstrate the ability to integrate diverse experimental data into a unified generative model via mappings from an intrinsic arousal manifold. Our results support the hypothesis that spontaneous, spatially structured fluctuations in brain-wide physiology-widely interpreted to reflect regionally-specific neural communication-are in large part reflections of an arousal-related process. This enriched view of arousal dynamics has broad implications for interpreting observations of brain, body, and behavior as measured across modalities, contexts, and scales.
Collapse
Affiliation(s)
- Ryan V. Raut
- Allen Institute, Seattle, WA, USA
- Department of Physiology & Biophysics, University of Washington, Seattle, WA, USA
| | - Zachary P. Rosenthal
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Xiaodan Wang
- Mallinckrodt Institute of Radiology, Washington University in St. Louis, St. Louis, MO, USA
| | - Hanyang Miao
- Department of Neurology, Washington University in St. Louis, St. Louis, MO, USA
| | - Zhanqi Zhang
- Department of Computer Science & Engineering, University of California San Diego, La Jolla, CA, USA
| | - Jin-Moo Lee
- Department of Neurology, Washington University in St. Louis, St. Louis, MO, USA
| | - Marcus E. Raichle
- Mallinckrodt Institute of Radiology, Washington University in St. Louis, St. Louis, MO, USA
- Department of Neurology, Washington University in St. Louis, St. Louis, MO, USA
| | - Adam Q. Bauer
- Mallinckrodt Institute of Radiology, Washington University in St. Louis, St. Louis, MO, USA
| | - Steven L. Brunton
- Department of Mechanical Engineering, University of Washington, Seattle, WA, USA
| | | | - J. Nathan Kutz
- Department of Applied Mathematics, University of Washington, Seattle, WA, USA
| |
Collapse
|
12
|
Durstewitz D, Koppe G, Thurm MI. Reconstructing computational system dynamics from neural data with recurrent neural networks. Nat Rev Neurosci 2023; 24:693-710. [PMID: 37794121 DOI: 10.1038/s41583-023-00740-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/18/2023] [Indexed: 10/06/2023]
Abstract
Computational models in neuroscience usually take the form of systems of differential equations. The behaviour of such systems is the subject of dynamical systems theory. Dynamical systems theory provides a powerful mathematical toolbox for analysing neurobiological processes and has been a mainstay of computational neuroscience for decades. Recently, recurrent neural networks (RNNs) have become a popular machine learning tool for studying the non-linear dynamics of neural and behavioural processes by emulating an underlying system of differential equations. RNNs have been routinely trained on similar behavioural tasks to those used for animal subjects to generate hypotheses about the underlying computational mechanisms. By contrast, RNNs can also be trained on the measured physiological and behavioural data, thereby directly inheriting their temporal and geometrical properties. In this way they become a formal surrogate for the experimentally probed system that can be further analysed, perturbed and simulated. This powerful approach is called dynamical system reconstruction. In this Perspective, we focus on recent trends in artificial intelligence and machine learning in this exciting and rapidly expanding field, which may be less well known in neuroscience. We discuss formal prerequisites, different model architectures and training approaches for RNN-based dynamical system reconstructions, ways to evaluate and validate model performance, how to interpret trained models in a neuroscience context, and current challenges.
Collapse
Affiliation(s)
- Daniel Durstewitz
- Dept. of Theoretical Neuroscience, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany.
- Interdisciplinary Center for Scientific Computing, Heidelberg University, Heidelberg, Germany.
- Faculty of Physics and Astronomy, Heidelberg University, Heidelberg, Germany.
| | - Georgia Koppe
- Dept. of Theoretical Neuroscience, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
- Dept. of Psychiatry and Psychotherapy, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
- Hector Institute for Artificial Intelligence in Psychiatry, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Max Ingo Thurm
- Dept. of Theoretical Neuroscience, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| |
Collapse
|
13
|
Purandare C, Mehta M. Mega-scale movie-fields in the mouse visuo-hippocampal network. eLife 2023; 12:RP85069. [PMID: 37910428 PMCID: PMC10619982 DOI: 10.7554/elife.85069] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2023] Open
Abstract
Natural visual experience involves a continuous series of related images while the subject is immobile. How does the cortico-hippocampal circuit process a visual episode? The hippocampus is crucial for episodic memory, but most rodent single unit studies require spatial exploration or active engagement. Hence, we investigated neural responses to a silent movie (Allen Brain Observatory) in head-fixed mice without any task or locomotion demands, or rewards. Surprisingly, a third (33%, 3379/10263) of hippocampal -dentate gyrus, CA3, CA1 and subiculum- neurons showed movie-selectivity, with elevated firing in specific movie sub-segments, termed movie-fields, similar to the vast majority of thalamo-cortical (LGN, V1, AM-PM) neurons (97%, 6554/6785). Movie-tuning remained intact in immobile or spontaneously running mice. Visual neurons had >5 movie-fields per cell, but only ~2 in hippocampus. The movie-field durations in all brain regions spanned an unprecedented 1000-fold range: from 0.02s to 20s, termed mega-scale coding. Yet, the total duration of all the movie-fields of a cell was comparable across neurons and brain regions. The hippocampal responses thus showed greater continuous-sequence encoding than visual areas, as evidenced by fewer and broader movie-fields than in visual areas. Consistently, repeated presentation of the movie images in a fixed, but scrambled sequence virtually abolished hippocampal but not visual-cortical selectivity. The preference for continuous, compared to scrambled sequence was eight-fold greater in hippocampal than visual areas, further supporting episodic-sequence encoding. Movies could thus provide a unified way to probe neural mechanisms of episodic information processing and memory, even in immobile subjects, across brain regions, and species.
Collapse
Affiliation(s)
- Chinmay Purandare
- Department of Bioengineering, University of California, Los AngelesLos AngelesUnited States
- W.M. Keck Center for Neurophysics, Department of Physics and Astronomy, University of California, Los AngelesLos AngelesUnited States
- Department of Neurology, University of California, Los AngelesLos AngelesUnited States
| | - Mayank Mehta
- W.M. Keck Center for Neurophysics, Department of Physics and Astronomy, University of California, Los AngelesLos AngelesUnited States
- Department of Neurology, University of California, Los AngelesLos AngelesUnited States
- Department of Electrical and Computer Engineering, University of California, Los AngelesLos AngelesUnited States
| |
Collapse
|
14
|
Xie Y, Sadeh S. Computational assessment of visual coding across mouse brain areas and behavioural states. Front Comput Neurosci 2023; 17:1269019. [PMID: 37899886 PMCID: PMC10613063 DOI: 10.3389/fncom.2023.1269019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Accepted: 09/29/2023] [Indexed: 10/31/2023] Open
Abstract
Introduction Our brain is bombarded by a diverse range of visual stimuli, which are converted into corresponding neuronal responses and processed throughout the visual system. The neural activity patterns that result from these external stimuli vary depending on the object or scene being observed, but they also change as a result of internal or behavioural states. This raises the question of to what extent it is possible to predict the presented visual stimuli from neural activity across behavioural states, and how this varies in different brain regions. Methods To address this question, we assessed the computational capacity of decoders to extract visual information in awake behaving mice, by analysing publicly available standardised datasets from the Allen Brain Institute. We evaluated how natural movie frames can be distinguished based on the activity of units recorded in distinct brain regions and under different behavioural states. This analysis revealed the spectrum of visual information present in different brain regions in response to binary and multiclass classification tasks. Results Visual cortical areas showed highest classification accuracies, followed by thalamic and midbrain regions, with hippocampal regions showing close to chance accuracy. In addition, we found that behavioural variability led to a decrease in decoding accuracy, whereby large behavioural changes between train and test sessions reduced the classification performance of the decoders. A generalised linear model analysis suggested that this deterioration in classification might be due to an independent modulation of neural activity by stimulus and behaviour. Finally, we reconstructed the natural movie frames from optimal linear classifiers, and observed a strong similarity between reconstructed and actual movie frames. However, the similarity was significantly higher when the decoders were trained and tested on sessions with similar behavioural states. Conclusion Our analysis provides a systematic assessment of visual coding in the mouse brain, and sheds light on the spectrum of visual information present across brain areas and behavioural states.
Collapse
Affiliation(s)
| | - Sadra Sadeh
- Department of Brain Sciences, Imperial College London, London, United Kingdom
| |
Collapse
|
15
|
Lee JQ, Brandon MP. Time and experience are independent determinants of representational drift in CA1. Neuron 2023; 111:2275-2277. [PMID: 37536286 DOI: 10.1016/j.neuron.2023.07.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Revised: 07/03/2023] [Accepted: 07/04/2023] [Indexed: 08/05/2023]
Abstract
In this issue of Neuron, Khatib et al.1 and Geva et al.2 present complementary and breakthrough discoveries demonstrating that elapsed time and active experience independently affect unique aspects of representational drift in the hippocampus.
Collapse
Affiliation(s)
- J Quinn Lee
- Department of Psychiatry, Faculty of Medicine, Douglas Hospital Research Centre, McGill University, Montreal, Canada
| | - Mark P Brandon
- Department of Psychiatry, Faculty of Medicine, Douglas Hospital Research Centre, McGill University, Montreal, Canada; Integrated Program in Neuroscience, Faculty of Medicine, McGill University, Montreal, Canada.
| |
Collapse
|
16
|
Micou C, O'Leary T. Representational drift as a window into neural and behavioural plasticity. Curr Opin Neurobiol 2023; 81:102746. [PMID: 37392671 DOI: 10.1016/j.conb.2023.102746] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2023] [Revised: 05/25/2023] [Accepted: 05/31/2023] [Indexed: 07/03/2023]
Abstract
Large-scale recordings of neural activity over days and weeks have revealed that neural representations of familiar tasks, precepts and actions continually evolve without obvious changes in behaviour. We hypothesise that this steady drift in neural activity and accompanying physiological changes is due in part to the continuous application of a learning rule at the cellular and population level. Explicit predictions of this drift can be found in neural network models that use iterative learning to optimise weights. Drift therefore provides a measurable signal that can reveal systems-level properties of biological plasticity mechanisms, such as their precision and effective learning rates.
Collapse
Affiliation(s)
- Charles Micou
- Department of Engineering, University of Cambridge, United Kingdom
| | - Timothy O'Leary
- Department of Engineering, University of Cambridge, United Kingdom; Theoretical Sciences Visiting Program, Okinawa Institute of Science and Technology Graduate University, Onna, 904-0495, Japan.
| |
Collapse
|
17
|
Roth ZN, Merriam EP. Representations in human primary visual cortex drift over time. Nat Commun 2023; 14:4422. [PMID: 37479723 PMCID: PMC10361968 DOI: 10.1038/s41467-023-40144-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2022] [Accepted: 07/13/2023] [Indexed: 07/23/2023] Open
Abstract
Primary sensory regions are believed to instantiate stable neural representations, yet a number of recent rodent studies suggest instead that representations drift over time. To test whether sensory representations are stable in human visual cortex, we analyzed a large longitudinal dataset of fMRI responses to images of natural scenes. We fit the fMRI responses using an image-computable encoding model and tested how well the model generalized across sessions. We found systematic changes in model fits that exhibited cumulative drift over many months. Convergent analyses pinpoint changes in neural responsivity as the source of the drift, while population-level representational dissimilarities between visual stimuli were unchanged. These observations suggest that downstream cortical areas may read-out a stable representation, even as representations within V1 exhibit drift.
Collapse
Affiliation(s)
- Zvi N Roth
- Laboratory of Brain and Cognition, National Institute of Mental Health, NIH, Bethesda, MD, USA.
| | - Elisha P Merriam
- Laboratory of Brain and Cognition, National Institute of Mental Health, NIH, Bethesda, MD, USA
| |
Collapse
|
18
|
Geva N, Deitch D, Rubin A, Ziv Y. Time and experience differentially affect distinct aspects of hippocampal representational drift. Neuron 2023:S0896-6273(23)00378-1. [PMID: 37315556 DOI: 10.1016/j.neuron.2023.05.005] [Citation(s) in RCA: 21] [Impact Index Per Article: 21.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Revised: 02/22/2023] [Accepted: 05/08/2023] [Indexed: 06/16/2023]
Abstract
Hippocampal activity is critical for spatial memory. Within a fixed, familiar environment, hippocampal codes gradually change over timescales of days to weeks-a phenomenon known as representational drift. The passage of time and the amount of experience are two factors that profoundly affect memory. However, thus far, it has remained unclear to what extent these factors drive hippocampal representational drift. Here, we longitudinally recorded large populations of hippocampal neurons in mice while they repeatedly explored two different familiar environments that they visited at different time intervals over weeks. We found that time and experience differentially affected distinct aspects of representational drift: the passage of time drove changes in neuronal activity rates, whereas experience drove changes in the cells' spatial tuning. Changes in spatial tuning were context specific and largely independent of changes in activity rates. Thus, our results suggest that representational drift is a multi-faceted process governed by distinct neuronal mechanisms.
Collapse
Affiliation(s)
- Nitzan Geva
- Department of Brain Sciences, Weizmann Institute of Science, Rehovot, Israel
| | - Daniel Deitch
- Department of Brain Sciences, Weizmann Institute of Science, Rehovot, Israel
| | - Alon Rubin
- Department of Brain Sciences, Weizmann Institute of Science, Rehovot, Israel.
| | - Yaniv Ziv
- Department of Brain Sciences, Weizmann Institute of Science, Rehovot, Israel.
| |
Collapse
|
19
|
Jensen KT, Kadmon Harpaz N, Dhawale AK, Wolff SBE, Ölveczky BP. Long-term stability of single neuron activity in the motor system. Nat Neurosci 2022; 25:1664-1674. [PMID: 36357811 PMCID: PMC11152193 DOI: 10.1038/s41593-022-01194-3] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2021] [Accepted: 10/03/2022] [Indexed: 11/12/2022]
Abstract
How an established behavior is retained and consistently produced by a nervous system in constant flux remains a mystery. One possible solution to ensure long-term stability in motor output is to fix the activity patterns of single neurons in the relevant circuits. Alternatively, activity in single cells could drift over time provided that the population dynamics are constrained to produce the same behavior. To arbitrate between these possibilities, we recorded single-unit activity in motor cortex and striatum continuously for several weeks as rats performed stereotyped motor behaviors-both learned and innate. We found long-term stability in single neuron activity patterns across both brain regions. A small amount of drift in neural activity, observed over weeks of recording, could be explained by concomitant changes in task-irrelevant aspects of the behavior. These results suggest that long-term stable behaviors are generated by single neuron activity patterns that are themselves highly stable.
Collapse
Affiliation(s)
- Kristopher T Jensen
- Department of Organismic and Evolutionary Biology and Center for Brain Science, Harvard University, Cambridge, MA, USA
- Computational and Biological Learning Lab, Department of Engineering, University of Cambridge, Cambridge, UK
| | - Naama Kadmon Harpaz
- Department of Organismic and Evolutionary Biology and Center for Brain Science, Harvard University, Cambridge, MA, USA
| | - Ashesh K Dhawale
- Department of Organismic and Evolutionary Biology and Center for Brain Science, Harvard University, Cambridge, MA, USA
- Centre for Neuroscience, Indian Institute of Science, Bangalore, India
| | - Steffen B E Wolff
- Department of Organismic and Evolutionary Biology and Center for Brain Science, Harvard University, Cambridge, MA, USA
- Department of Pharmacology, University of Maryland School of Medicine, Baltimore, MD, USA
| | - Bence P Ölveczky
- Department of Organismic and Evolutionary Biology and Center for Brain Science, Harvard University, Cambridge, MA, USA.
| |
Collapse
|
20
|
Aitken K, Garrett M, Olsen S, Mihalas S. The geometry of representational drift in natural and artificial neural networks. PLoS Comput Biol 2022; 18:e1010716. [PMID: 36441762 PMCID: PMC9731438 DOI: 10.1371/journal.pcbi.1010716] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Revised: 12/08/2022] [Accepted: 11/07/2022] [Indexed: 11/29/2022] Open
Abstract
Neurons in sensory areas encode/represent stimuli. Surprisingly, recent studies have suggested that, even during persistent performance, these representations are not stable and change over the course of days and weeks. We examine stimulus representations from fluorescence recordings across hundreds of neurons in the visual cortex using in vivo two-photon calcium imaging and we corroborate previous studies finding that such representations change as experimental trials are repeated across days. This phenomenon has been termed "representational drift". In this study we geometrically characterize the properties of representational drift in the primary visual cortex of mice in two open datasets from the Allen Institute and propose a potential mechanism behind such drift. We observe representational drift both for passively presented stimuli, as well as for stimuli which are behaviorally relevant. Across experiments, the drift differs from in-session variance and most often occurs along directions that have the most in-class variance, leading to a significant turnover in the neurons used for a given representation. Interestingly, despite this significant change due to drift, linear classifiers trained to distinguish neuronal representations show little to no degradation in performance across days. The features we observe in the neural data are similar to properties of artificial neural networks where representations are updated by continual learning in the presence of dropout, i.e. a random masking of nodes/weights, but not other types of noise. Therefore, we conclude that a potential reason for the representational drift in biological networks is driven by an underlying dropout-like noise while continuously learning and that such a mechanism may be computational advantageous for the brain in the same way it is for artificial neural networks, e.g. preventing overfitting.
Collapse
Affiliation(s)
- Kyle Aitken
- MindScope Program, Allen Institute, Seattle, Washington, United States of America
- * E-mail:
| | - Marina Garrett
- MindScope Program, Allen Institute, Seattle, Washington, United States of America
| | - Shawn Olsen
- MindScope Program, Allen Institute, Seattle, Washington, United States of America
| | - Stefan Mihalas
- MindScope Program, Allen Institute, Seattle, Washington, United States of America
| |
Collapse
|
21
|
Jeon BB, Fuchs T, Chase SM, Kuhlman SJ. Visual experience has opposing influences on the quality of stimulus representation in adult primary visual cortex. eLife 2022; 11:80361. [PMID: 36321876 PMCID: PMC9629826 DOI: 10.7554/elife.80361] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2022] [Accepted: 10/21/2022] [Indexed: 11/07/2022] Open
Abstract
Transient dark exposure, typically 7–10 days in duration, followed by light reintroduction is an emerging treatment for improving the restoration of vision in amblyopic subjects whose occlusion is removed in adulthood. Dark exposure initiates homeostatic mechanisms that together with light-induced changes in cellular signaling pathways result in the re-engagement of juvenile-like plasticity in the adult such that previously deprived inputs can gain cortical territory. It is possible that dark exposure itself degrades visual responses, and this could place constraints on the optimal duration of dark exposure treatment. To determine whether eight days of dark exposure has a lasting negative impact on responses to classic grating stimuli, neural activity was recorded before and after dark exposure in awake head-fixed mice using two-photon calcium imaging. Neural discriminability, assessed using classifiers, was transiently reduced following dark exposure; a decrease in response reliability across a broad range of spatial frequencies likely contributed to the disruption. Both discriminability and reliability recovered. Fixed classifiers were used to demonstrate that stimulus representation rebounded to the original, pre-deprivation state, thus dark exposure did not appear to have a lasting negative impact on visual processing. Unexpectedly, we found that dark exposure significantly stabilized orientation preference and signal correlation. Our results reveal that natural vision exerts a disrupting influence on the stability of stimulus preference for classic grating stimuli and, at the same time, improves neural discriminability for both low and high-spatial frequency stimuli.
Collapse
Affiliation(s)
- Brian B Jeon
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, United States.,Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, United States.,Neuroscience Institute, Carnegie Mellon University, Pittsburgh, United States
| | - Thomas Fuchs
- Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, United States.,Neuroscience Institute, Carnegie Mellon University, Pittsburgh, United States.,Department of Biological Sciences, Carnegie Mellon University, Pittsburgh, United States
| | - Steven M Chase
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, United States.,Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, United States.,Neuroscience Institute, Carnegie Mellon University, Pittsburgh, United States
| | - Sandra J Kuhlman
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, United States.,Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, United States.,Neuroscience Institute, Carnegie Mellon University, Pittsburgh, United States.,Department of Biological Sciences, Carnegie Mellon University, Pittsburgh, United States
| |
Collapse
|