1
|
Stöckl C, Yang Y, Maass W. Local prediction-learning in high-dimensional spaces enables neural networks to plan. Nat Commun 2024; 15:2344. [PMID: 38490999 PMCID: PMC10943103 DOI: 10.1038/s41467-024-46586-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Accepted: 03/01/2024] [Indexed: 03/18/2024] Open
Abstract
Planning and problem solving are cornerstones of higher brain function. But we do not know how the brain does that. We show that learning of a suitable cognitive map of the problem space suffices. Furthermore, this can be reduced to learning to predict the next observation through local synaptic plasticity. Importantly, the resulting cognitive map encodes relations between actions and observations, and its emergent high-dimensional geometry provides a sense of direction for reaching distant goals. This quasi-Euclidean sense of direction provides a simple heuristic for online planning that works almost as well as the best offline planning algorithms from AI. If the problem space is a physical space, this method automatically extracts structural regularities from the sequence of observations that it receives so that it can generalize to unseen parts. This speeds up learning of navigation in 2D mazes and the locomotion with complex actuator systems, such as legged bodies. The cognitive map learner that we propose does not require a teacher, similar to self-attention networks (Transformers). But in contrast to Transformers, it does not require backpropagation of errors or very large datasets for learning. Hence it provides a blue-print for future energy-efficient neuromorphic hardware that acquires advanced cognitive capabilities through autonomous on-chip learning.
Collapse
Affiliation(s)
- Christoph Stöckl
- Institute of Theoretical Computer Science, Graz University of Technology, 8010, Graz, Austria
| | - Yukun Yang
- Institute of Theoretical Computer Science, Graz University of Technology, 8010, Graz, Austria
| | - Wolfgang Maass
- Institute of Theoretical Computer Science, Graz University of Technology, 8010, Graz, Austria.
| |
Collapse
|
2
|
West SL, Aronson JD, Popa LS, Feller KD, Carter RE, Chiesl WM, Gerhart ML, Shekhar AC, Ghanbari L, Kodandaramaiah SB, Ebner TJ. Wide-Field Calcium Imaging of Dynamic Cortical Networks during Locomotion. Cereb Cortex 2022; 32:2668-2687. [PMID: 34689209 PMCID: PMC9201596 DOI: 10.1093/cercor/bhab373] [Citation(s) in RCA: 28] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2021] [Revised: 09/10/2021] [Accepted: 09/11/2021] [Indexed: 01/04/2023] Open
Abstract
Motor behavior results in complex exchanges of motor and sensory information across cortical regions. Therefore, fully understanding the cerebral cortex's role in motor behavior requires a mesoscopic-level description of the cortical regions engaged, their functional interactions, and how these functional interactions change with behavioral state. Mesoscopic Ca2+ imaging through transparent polymer skulls in mice reveals elevated activation of the dorsal cerebral cortex during locomotion. Using the correlations between the time series of Ca2+ fluorescence from 28 regions (nodes) obtained using spatial independent component analysis (sICA), we examined the changes in functional connectivity of the cortex from rest to locomotion with a goal of understanding the changes to the cortical functional state that facilitate locomotion. Both the transitions from rest to locomotion and from locomotion to rest show marked increases in correlation among most nodes. However, once a steady state of continued locomotion is reached, many nodes, including primary motor and somatosensory nodes, show decreases in correlations, while retrosplenial and the most anterior nodes of the secondary motor cortex show increases. These results highlight the changes in functional connectivity in the cerebral cortex, representing a series of changes in the cortical state from rest to locomotion and on return to rest.
Collapse
Affiliation(s)
- Sarah L West
- Department of Neuroscience, University of Minnesota, Minneapolis, MN 55455, USA
- Graduate Program in Neuroscience, University of Minnesota, Minneapolis, MN 55455, USA
| | - Justin D Aronson
- Department of Neuroscience, University of Minnesota, Minneapolis, MN 55455, USA
| | - Laurentiu S Popa
- Department of Neuroscience, University of Minnesota, Minneapolis, MN 55455, USA
| | - Kathryn D Feller
- Department of Neuroscience, University of Minnesota, Minneapolis, MN 55455, USA
- Union College Biological Sciences Department, Schenectady, NY 12308, USA
| | - Russell E Carter
- Department of Neuroscience, University of Minnesota, Minneapolis, MN 55455, USA
| | - William M Chiesl
- Department of Neuroscience, University of Minnesota, Minneapolis, MN 55455, USA
| | - Morgan L Gerhart
- Department of Neuroscience, University of Minnesota, Minneapolis, MN 55455, USA
| | - Aditya C Shekhar
- Department of Neuroscience, University of Minnesota, Minneapolis, MN 55455, USA
| | - Leila Ghanbari
- Department of Mechanical Engineering, University of Minnesota, Minneapolis, MN 55455, USA
| | - Suhasa B Kodandaramaiah
- Graduate Program in Neuroscience, University of Minnesota, Minneapolis, MN 55455, USA
- Department of Mechanical Engineering, University of Minnesota, Minneapolis, MN 55455, USA
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN 55455, USA
| | - Timothy J Ebner
- Department of Neuroscience, University of Minnesota, Minneapolis, MN 55455, USA
- Graduate Program in Neuroscience, University of Minnesota, Minneapolis, MN 55455, USA
| |
Collapse
|
3
|
Allen TA, Furtak SC. Introduction to the special issue on extrahippocampal contributions to hippocampal-dependent memory. Hippocampus 2021; 31:634-639. [PMID: 34117810 DOI: 10.1002/hipo.23370] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2021] [Accepted: 06/08/2021] [Indexed: 11/07/2022]
Affiliation(s)
- Timothy A Allen
- Cognitive Neuroscience Program, Department of Psychology, Florida International University, Miami, Florida, USA
| | - Sharon C Furtak
- Department of Psychology, California State University Sacramento, Sacramento, California, USA
| |
Collapse
|