1
|
Kim JZ, Larsen B, Parkes L. Shaping dynamical neural computations using spatiotemporal constraints. Biochem Biophys Res Commun 2024; 728:150302. [PMID: 38968771 DOI: 10.1016/j.bbrc.2024.150302] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2023] [Revised: 03/21/2024] [Accepted: 04/11/2024] [Indexed: 07/07/2024]
Abstract
Dynamics play a critical role in computation. The principled evolution of states over time enables both biological and artificial networks to represent and integrate information to make decisions. In the past few decades, significant multidisciplinary progress has been made in bridging the gap between how we understand biological versus artificial computation, including how insights gained from one can translate to the other. Research has revealed that neurobiology is a key determinant of brain network architecture, which gives rise to spatiotemporally constrained patterns of activity that underlie computation. Here, we discuss how neural systems use dynamics for computation, and claim that the biological constraints that shape brain networks may be leveraged to improve the implementation of artificial neural networks. To formalize this discussion, we consider a natural artificial analog of the brain that has been used extensively to model neural computation: the recurrent neural network (RNN). In both the brain and the RNN, we emphasize the common computational substrate atop which dynamics occur-the connectivity between neurons-and we explore the unique computational advantages offered by biophysical constraints such as resource efficiency, spatial embedding, and neurodevelopment.
Collapse
Affiliation(s)
- Jason Z Kim
- Department of Physics, Cornell University, Ithaca, NY, 14853, USA.
| | - Bart Larsen
- Department of Pediatrics, Masonic Institute for the Developing Brain, University of Minnesota, USA
| | - Linden Parkes
- Department of Psychiatry, Rutgers University, Piscataway, NJ, 08854, USA.
| |
Collapse
|
2
|
Beninger J, Rossbroich J, Tóth K, Naud R. Functional subtypes of synaptic dynamics in mouse and human. Cell Rep 2024; 43:113785. [PMID: 38363673 DOI: 10.1016/j.celrep.2024.113785] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2023] [Revised: 12/08/2023] [Accepted: 01/27/2024] [Indexed: 02/18/2024] Open
Abstract
Synapses preferentially respond to particular temporal patterns of activity with a large degree of heterogeneity that is informally or tacitly separated into classes. Yet, the precise number and properties of such classes are unclear. Do they exist on a continuum and, if so, when is it appropriate to divide that continuum into functional regions? In a large dataset of glutamatergic cortical connections, we perform model-based characterization to infer the number and characteristics of functionally distinct subtypes of synaptic dynamics. In rodent data, we find five clusters that partially converge with transgenic-associated subtypes. Strikingly, the application of the same clustering method in human data infers a highly similar number of clusters, supportive of stable clustering. This nuanced dictionary of functional subtypes shapes the heterogeneity of cortical synaptic dynamics and provides a lens into the basic motifs of information transmission in the brain.
Collapse
Affiliation(s)
- John Beninger
- Center for Neural Dynamics and Artificial Intelligence, University of Ottawa, Ottawa, ON K1H 8M5, Canada; uOttawa Brain and Mind Research Institute, University of Ottawa, Ottawa, ON K1H 8M5, Canada; Department of Cellular and Molecular Medicine, University of Ottawa, Ottawa, ON K1H 8M5, Canada
| | - Julian Rossbroich
- Friedrich Miescher Institute for Biomedical Research, Basel, Switzerland; Faculty of Science, University of Basel, Basel, Switzerland
| | - Katalin Tóth
- Center for Neural Dynamics and Artificial Intelligence, University of Ottawa, Ottawa, ON K1H 8M5, Canada; uOttawa Brain and Mind Research Institute, University of Ottawa, Ottawa, ON K1H 8M5, Canada; Department of Cellular and Molecular Medicine, University of Ottawa, Ottawa, ON K1H 8M5, Canada
| | - Richard Naud
- Center for Neural Dynamics and Artificial Intelligence, University of Ottawa, Ottawa, ON K1H 8M5, Canada; uOttawa Brain and Mind Research Institute, University of Ottawa, Ottawa, ON K1H 8M5, Canada; Department of Cellular and Molecular Medicine, University of Ottawa, Ottawa, ON K1H 8M5, Canada; Department of Physics, University of Ottawa, Ottawa, ON K1H 8M5, Canada.
| |
Collapse
|
3
|
Hwang GM, Simonian AL. Special Issue-Biosensors and Neuroscience: Is Biosensors Engineering Ready to Embrace Design Principles from Neuroscience? BIOSENSORS 2024; 14:68. [PMID: 38391987 PMCID: PMC10886788 DOI: 10.3390/bios14020068] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/24/2023] [Accepted: 01/25/2024] [Indexed: 02/24/2024]
Abstract
In partnership with the Air Force Office of Scientific Research (AFOSR), the National Science Foundation's (NSF) Emerging Frontiers and Multidisciplinary Activities (EFMA) office of the Directorate for Engineering (ENG) launched an Emerging Frontiers in Research and Innovation (EFRI) topic for the fiscal years FY22 and FY23 entitled "Brain-inspired Dynamics for Engineering Energy-Efficient Circuits and Artificial Intelligence" (BRAID) [...].
Collapse
Affiliation(s)
- Grace M. Hwang
- Johns Hopkins University Applied Physics Laboratory, 111000 Johns Hopkins Road, Laurel, MD 20723, USA
| | | |
Collapse
|
4
|
Kim JZ, Larsen B, Parkes L. Shaping dynamical neural computations using spatiotemporal constraints. ARXIV 2023:arXiv:2311.15572v1. [PMID: 38076517 PMCID: PMC10705584] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/20/2023]
Abstract
Dynamics play a critical role in computation. The principled evolution of states over time enables both biological and artificial networks to represent and integrate information to make decisions. In the past few decades, significant multidisciplinary progress has been made in bridging the gap between how we understand biological versus artificial computation, including how insights gained from one can translate to the other. Research has revealed that neurobiology is a key determinant of brain network architecture, which gives rise to spatiotemporally constrained patterns of activity that underlie computation. Here, we discuss how neural systems use dynamics for computation, and claim that the biological constraints that shape brain networks may be leveraged to improve the implementation of artificial neural networks. To formalize this discussion, we consider a natural artificial analog of the brain that has been used extensively to model neural computation: the recurrent neural network (RNN). In both the brain and the RNN, we emphasize the common computational substrate atop which dynamics occur-the connectivity between neurons-and we explore the unique computational advantages offered by biophysical constraints such as resource efficiency, spatial embedding, and neurodevelopment.
Collapse
Affiliation(s)
- Jason Z. Kim
- Department of Physics, Cornell University, Ithaca, NY 14853, USA
| | - Bart Larsen
- Department of Pediatrics, Masonic Institute for the Developing Brain, University of Minnesota
| | - Linden Parkes
- Department of Psychiatry, Rutgers University, Piscataway, NJ 08854, USA
| |
Collapse
|