1
|
Menéndez JA, Hennig JA, Golub MD, Oby ER, Sadtler PT, Batista AP, Chase SM, Yu BM, Latham PE. A theory of brain-computer interface learning via low-dimensional control. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2025:2024.04.18.589952. [PMID: 38712193 PMCID: PMC11071278 DOI: 10.1101/2024.04.18.589952] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/08/2024]
Abstract
A remarkable demonstration of the flexibility of mammalian motor systems is primates' ability to learn to control brain-computer interfaces (BCIs). This constitutes a completely novel motor behavior, yet primates are capable of learning to control BCIs under a wide range of conditions. BCIs with carefully calibrated decoders, for example, can be learned with only minutes to hours of practice. With a few weeks of practice, even BCIs with randomly constructed decoders can be learned. What are the biological substrates of this learning process? Here, we develop a theory based on a re-aiming strategy, whereby learning operates within a low-dimensional subspace of task-relevant inputs driving the local population of recorded neurons. Through comprehensive numerical and formal analysis, we demonstrate that this theory can provide a unifying explanation for disparate phenomena previously reported in three different BCI learning tasks, and we derive a novel experimental prediction that we verify with previously published data. By explicitly modeling the underlying neural circuitry, the theory reveals an interpretation of these phenomena in terms of biological constraints on neural activity.
Collapse
Affiliation(s)
- J. A. Menéndez
- Gatsby Computational Neuroscience Unit, University College London
| | | | | | | | | | | | | | | | - P. E. Latham
- Gatsby Computational Neuroscience Unit, University College London
| |
Collapse
|
2
|
Kim JH, Daie K, Li N. A combinatorial neural code for long-term motor memory. Nature 2025; 637:663-672. [PMID: 39537930 PMCID: PMC11735397 DOI: 10.1038/s41586-024-08193-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2023] [Accepted: 10/10/2024] [Indexed: 11/16/2024]
Abstract
Motor skill repertoire can be stably retained over long periods, but the neural mechanism that underlies stable memory storage remains poorly understood1-8. Moreover, it is unknown how existing motor memories are maintained as new motor skills are continuously acquired. Here we tracked neural representation of learned actions throughout a significant portion of the lifespan of a mouse and show that learned actions are stably retained in combination with context, which protects existing memories from erasure during new motor learning. We established a continual learning paradigm in which mice learned to perform directional licking in different task contexts while we tracked motor cortex activity for up to six months using two-photon imaging. Within the same task context, activity driving directional licking was stable over time with little representational drift. When learning new task contexts, new preparatory activity emerged to drive the same licking actions. Learning created parallel new motor memories instead of modifying existing representations. Re-learning to make the same actions in the previous task context re-activated the previous preparatory activity, even months later. Continual learning of new task contexts kept creating new preparatory activity patterns. Context-specific memories, as we observed in the motor system, may provide a solution for stable memory storage throughout continual learning.
Collapse
Affiliation(s)
- Jae-Hyun Kim
- Department of Neurobiology, Duke University, Durham, NC, USA
- Department of Neuroscience, Baylor College of Medicine, Houston, TX, USA
| | - Kayvon Daie
- Allen Institute for Neural Dynamics, Seattle, WA, USA
| | - Nuo Li
- Department of Neurobiology, Duke University, Durham, NC, USA.
- Department of Neuroscience, Baylor College of Medicine, Houston, TX, USA.
| |
Collapse
|
3
|
Marino PJ, Bahureksa L, Fisac CF, Oby ER, Smoulder AL, Motiwala A, Degenhart AD, Grigsby EM, Joiner WM, Chase SM, Yu BM, Batista AP. A posture subspace in primary motor cortex. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.08.12.607361. [PMID: 39185208 PMCID: PMC11343157 DOI: 10.1101/2024.08.12.607361] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 08/27/2024]
Abstract
To generate movements, the brain must combine information about movement goal and body posture. Motor cortex (M1) is a key node for the convergence of these information streams. How are posture and goal information organized within M1's activity to permit the flexible generation of movement commands? To answer this question, we recorded M1 activity while monkeys performed a variety of tasks with the forearm in a range of postures. We found that posture- and goal-related components of neural population activity were separable and resided in nearly orthogonal subspaces. The posture subspace was stable across tasks. Within each task, neural trajectories for each goal had similar shapes across postures. Our results reveal a simpler organization of posture information in M1 than previously recognized. The compartmentalization of posture and goal information might allow the two to be flexibly combined in the service of our broad repertoire of actions.
Collapse
Affiliation(s)
- Patrick J. Marino
- Dept. of Bioengineering, University of Pittsburgh, Pittsburgh, PA 15260, USA
- Center for the Neural Basis of Cognition, Pittsburgh, PA 15213, USA
| | - Lindsay Bahureksa
- Center for the Neural Basis of Cognition, Pittsburgh, PA 15213, USA
- Dept. of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA
| | - Carmen Fernández Fisac
- Center for the Neural Basis of Cognition, Pittsburgh, PA 15213, USA
- Dept. of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA
| | - Emily R. Oby
- Dept. of Bioengineering, University of Pittsburgh, Pittsburgh, PA 15260, USA
- Center for the Neural Basis of Cognition, Pittsburgh, PA 15213, USA
- Dept. of Biomedical and Molecular Sciences, Queen’s University, Kingston, Ontario K7L 3N6, Canda
| | - Adam L. Smoulder
- Center for the Neural Basis of Cognition, Pittsburgh, PA 15213, USA
- Dept. of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA
| | - Asma Motiwala
- Center for the Neural Basis of Cognition, Pittsburgh, PA 15213, USA
- Dept. Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA
| | - Alan D. Degenhart
- Dept. of Bioengineering, University of Pittsburgh, Pittsburgh, PA 15260, USA
- Center for the Neural Basis of Cognition, Pittsburgh, PA 15213, USA
- Dept. Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA
- Starfish Neuroscience, Bellevue, WA 98004, USA
| | - Erinn M. Grigsby
- Dept. of Bioengineering, University of Pittsburgh, Pittsburgh, PA 15260, USA
- Center for the Neural Basis of Cognition, Pittsburgh, PA 15213, USA
- Dept. of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA 15260, USA
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA 15260, USA
| | - Wilsaan M. Joiner
- Dept. of Neurobiology, Physiology, and Behavior, University of California, Davis, Davis, CA 95616, USA
| | - Steven M. Chase
- Center for the Neural Basis of Cognition, Pittsburgh, PA 15213, USA
- Dept. of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA 15213, USA
- Senior author
- These authors contributed equally
| | - Byron M. Yu
- Center for the Neural Basis of Cognition, Pittsburgh, PA 15213, USA
- Dept. of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA
- Dept. Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA 15213, USA
- Senior author
- These authors contributed equally
| | - Aaron P. Batista
- Dept. of Bioengineering, University of Pittsburgh, Pittsburgh, PA 15260, USA
- Center for the Neural Basis of Cognition, Pittsburgh, PA 15213, USA
- Senior author
- These authors contributed equally
- Lead contact
| |
Collapse
|
4
|
Chang JC, Perich MG, Miller LE, Gallego JA, Clopath C. De novo motor learning creates structure in neural activity that shapes adaptation. Nat Commun 2024; 15:4084. [PMID: 38744847 PMCID: PMC11094149 DOI: 10.1038/s41467-024-48008-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Accepted: 04/18/2024] [Indexed: 05/16/2024] Open
Abstract
Animals can quickly adapt learned movements to external perturbations, and their existing motor repertoire likely influences their ease of adaptation. Long-term learning causes lasting changes in neural connectivity, which shapes the activity patterns that can be produced during adaptation. Here, we examined how a neural population's existing activity patterns, acquired through de novo learning, affect subsequent adaptation by modeling motor cortical neural population dynamics with recurrent neural networks. We trained networks on different motor repertoires comprising varying numbers of movements, which they acquired following various learning experiences. Networks with multiple movements had more constrained and robust dynamics, which were associated with more defined neural 'structure'-organization in the available population activity patterns. This structure facilitated adaptation, but only when the changes imposed by the perturbation were congruent with the organization of the inputs and the structure in neural activity acquired during de novo learning. These results highlight trade-offs in skill acquisition and demonstrate how different learning experiences can shape the geometrical properties of neural population activity and subsequent adaptation.
Collapse
Affiliation(s)
- Joanna C Chang
- Department of Bioengineering, Imperial College London, London, UK
| | - Matthew G Perich
- Département de Neurosciences, Faculté de Médecine, Université de Montréal, Montréal, QC, Canada
- Mila, Québec Artificial Intelligence Institute, Montréal, QC, Canada
| | - Lee E Miller
- Departments of Physiology, Biomedical Engineering and Physical Medicine and Rehabilitation, Northwestern University and Shirley Ryan Ability Lab, Chicago, IL, USA
| | - Juan A Gallego
- Department of Bioengineering, Imperial College London, London, UK.
| | - Claudia Clopath
- Department of Bioengineering, Imperial College London, London, UK.
| |
Collapse
|
5
|
van der Plas M, Failla A, Robertson EM. Neuroscience: Memory modification without catastrophe. Curr Biol 2024; 34:R281-R284. [PMID: 38593772 DOI: 10.1016/j.cub.2024.02.068] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/11/2024]
Abstract
Adaptive behaviour is supported by changes in neuronal networks. Insight into maintaining these memories - preventing their catastrophic loss - despite further network changes occurring due to novel learning is provided in a new study.
Collapse
Affiliation(s)
- Mircea van der Plas
- Institute of Neuroscience and Psychology, Centre for Cognitive Neuroimaging, University of Glasgow, Glasgow G12 8QB, UK
| | - Alberto Failla
- Institute of Neuroscience and Psychology, Centre for Cognitive Neuroimaging, University of Glasgow, Glasgow G12 8QB, UK
| | - Edwin M Robertson
- Institute of Neuroscience and Psychology, Centre for Cognitive Neuroimaging, University of Glasgow, Glasgow G12 8QB, UK.
| |
Collapse
|