1
|
Arthur BJ, Kim CM, Chen S, Preibisch S, Darshan R. A scalable implementation of the recursive least-squares algorithm for training spiking neural networks. Front Neuroinform 2023; 17:1099510. [PMID: 37441157 PMCID: PMC10333503 DOI: 10.3389/fninf.2023.1099510] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2022] [Accepted: 06/05/2023] [Indexed: 07/15/2023] Open
Abstract
Training spiking recurrent neural networks on neuronal recordings or behavioral tasks has become a popular way to study computations performed by the nervous system. As the size and complexity of neural recordings increase, there is a need for efficient algorithms that can train models in a short period of time using minimal resources. We present optimized CPU and GPU implementations of the recursive least-squares algorithm in spiking neural networks. The GPU implementation can train networks of one million neurons, with 100 million plastic synapses and a billion static synapses, about 1,000 times faster than an unoptimized reference CPU implementation. We demonstrate the code's utility by training a network, in less than an hour, to reproduce the activity of > 66, 000 recorded neurons of a mouse performing a decision-making task. The fast implementation enables a more interactive in-silico study of the dynamics and connectivity underlying multi-area computations. It also admits the possibility to train models as in-vivo experiments are being conducted, thus closing the loop between modeling and experiments.
Collapse
Affiliation(s)
- Benjamin J. Arthur
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, United States
| | - Christopher M. Kim
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, United States
- Laboratory of Biological Modeling, National Institute of Diabetes and Digestive and Kidney Diseases, National Institutes of Health, Bethesda, MD, United States
| | - Susu Chen
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, United States
| | - Stephan Preibisch
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, United States
| | - Ran Darshan
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, United States
| |
Collapse
|
2
|
Abdelfattah AS, Zheng J, Singh A, Huang YC, Reep D, Tsegaye G, Tsang A, Arthur BJ, Rehorova M, Olson CVL, Shuai Y, Zhang L, Fu TM, Milkie DE, Moya MV, Weber TD, Lemire AL, Baker CA, Falco N, Zheng Q, Grimm JB, Yip MC, Walpita D, Chase M, Campagnola L, Murphy GJ, Wong AM, Forest CR, Mertz J, Economo MN, Turner GC, Koyama M, Lin BJ, Betzig E, Novak O, Lavis LD, Svoboda K, Korff W, Chen TW, Schreiter ER, Hasseman JP, Kolb I. Sensitivity optimization of a rhodopsin-based fluorescent voltage indicator. Neuron 2023; 111:1547-1563.e9. [PMID: 37015225 PMCID: PMC10280807 DOI: 10.1016/j.neuron.2023.03.009] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2022] [Revised: 02/15/2023] [Accepted: 03/07/2023] [Indexed: 04/05/2023]
Abstract
The ability to optically image cellular transmembrane voltages at millisecond-timescale resolutions can offer unprecedented insight into the function of living brains in behaving animals. Here, we present a point mutation that increases the sensitivity of Ace2 opsin-based voltage indicators. We use the mutation to develop Voltron2, an improved chemigeneic voltage indicator that has a 65% higher sensitivity to single APs and 3-fold higher sensitivity to subthreshold potentials than Voltron. Voltron2 retained the sub-millisecond kinetics and photostability of its predecessor, although with lower baseline fluorescence. In multiple in vitro and in vivo comparisons with its predecessor across multiple species, we found Voltron2 to be more sensitive to APs and subthreshold fluctuations. Finally, we used Voltron2 to study and evaluate the possible mechanisms of interneuron synchronization in the mouse hippocampus. Overall, we have discovered a generalizable mutation that significantly increases the sensitivity of Ace2 rhodopsin-based sensors, improving their voltage reporting capability.
Collapse
Affiliation(s)
| | - Jihong Zheng
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA; GENIE Project Team, Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Amrita Singh
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Yi-Chieh Huang
- Institute of Neuroscience, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Daniel Reep
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA; GENIE Project Team, Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Getahun Tsegaye
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA; GENIE Project Team, Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Arthur Tsang
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA; GENIE Project Team, Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Benjamin J Arthur
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Monika Rehorova
- Department of Physiology, Second Faculty of Medicine, Charles University, Prague, Czech Republic
| | - Carl V L Olson
- Department of Physiology, Second Faculty of Medicine, Charles University, Prague, Czech Republic
| | - Yichun Shuai
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Lixia Zhang
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Tian-Ming Fu
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Daniel E Milkie
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Maria V Moya
- Department of Biomedical Engineering, Boston University, Boston, MA, USA
| | - Timothy D Weber
- Department of Biomedical Engineering, Boston University, Boston, MA, USA
| | - Andrew L Lemire
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | | | - Natalie Falco
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Qinsi Zheng
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Jonathan B Grimm
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Mighten C Yip
- George W. Woodruff School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, GA, USA
| | - Deepika Walpita
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | | | | | | | - Allan M Wong
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA; GENIE Project Team, Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Craig R Forest
- George W. Woodruff School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, GA, USA
| | - Jerome Mertz
- Department of Biomedical Engineering, Boston University, Boston, MA, USA
| | - Michael N Economo
- Department of Biomedical Engineering, Boston University, Boston, MA, USA
| | - Glenn C Turner
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA; GENIE Project Team, Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Minoru Koyama
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Bei-Jung Lin
- Institute of Neuroscience, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Eric Betzig
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA; Departments of Molecular and Cell Biology and Physics, Howard Hughes Medical Institute, Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, USA; Molecular Biophysics and Integrated Bioimaging Division, Lawrence Berkeley National Laboratory, Berkeley, CA, USA
| | - Ondrej Novak
- Department of Physiology, Second Faculty of Medicine, Charles University, Prague, Czech Republic
| | - Luke D Lavis
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Karel Svoboda
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Wyatt Korff
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA; GENIE Project Team, Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Tsai-Wen Chen
- Institute of Neuroscience, National Yang Ming Chiao Tung University, Taipei, Taiwan.
| | - Eric R Schreiter
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA; GENIE Project Team, Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA.
| | - Jeremy P Hasseman
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA; GENIE Project Team, Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA.
| | - Ilya Kolb
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA; GENIE Project Team, Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA.
| |
Collapse
|