1
|
Zheng H, Zheng Z, Hu R, Xiao B, Wu Y, Yu F, Liu X, Li G, Deng L. Temporal dendritic heterogeneity incorporated with spiking neural networks for learning multi-timescale dynamics. Nat Commun 2024; 15:277. [PMID: 38177124 PMCID: PMC10766638 DOI: 10.1038/s41467-023-44614-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Accepted: 12/21/2023] [Indexed: 01/06/2024] Open
Abstract
It is widely believed the brain-inspired spiking neural networks have the capability of processing temporal information owing to their dynamic attributes. However, how to understand what kind of mechanisms contributing to the learning ability and exploit the rich dynamic properties of spiking neural networks to satisfactorily solve complex temporal computing tasks in practice still remains to be explored. In this article, we identify the importance of capturing the multi-timescale components, based on which a multi-compartment spiking neural model with temporal dendritic heterogeneity, is proposed. The model enables multi-timescale dynamics by automatically learning heterogeneous timing factors on different dendritic branches. Two breakthroughs are made through extensive experiments: the working mechanism of the proposed model is revealed via an elaborated temporal spiking XOR problem to analyze the temporal feature integration at different levels; comprehensive performance benefits of the model over ordinary spiking neural networks are achieved on several temporal computing benchmarks for speech recognition, visual recognition, electroencephalogram signal recognition, and robot place recognition, which shows the best-reported accuracy and model compactness, promising robustness and generalization, and high execution efficiency on neuromorphic hardware. This work moves neuromorphic computing a significant step toward real-world applications by appropriately exploiting biological observations.
Collapse
Affiliation(s)
- Hanle Zheng
- Center for Brain Inspired Computing Research (CBICR), Department of Precision Instrument, Tsinghua University, Beijing, China
| | - Zhong Zheng
- Center for Brain Inspired Computing Research (CBICR), Department of Precision Instrument, Tsinghua University, Beijing, China
| | - Rui Hu
- Center for Brain Inspired Computing Research (CBICR), Department of Precision Instrument, Tsinghua University, Beijing, China
| | - Bo Xiao
- Center for Brain Inspired Computing Research (CBICR), Department of Precision Instrument, Tsinghua University, Beijing, China
| | - Yujie Wu
- Institute of Theoretical Computer Science, Graz University of Technology, Graz, Austria
| | - Fangwen Yu
- Center for Brain Inspired Computing Research (CBICR), Department of Precision Instrument, Tsinghua University, Beijing, China
| | - Xue Liu
- Center for Brain Inspired Computing Research (CBICR), Department of Precision Instrument, Tsinghua University, Beijing, China
| | - Guoqi Li
- Institute of Automation, Chinese Academy of Sciences, Beijing, China
| | - Lei Deng
- Center for Brain Inspired Computing Research (CBICR), Department of Precision Instrument, Tsinghua University, Beijing, China.
| |
Collapse
|
2
|
Propagation of CaMKII translocation waves in heterogeneous spiny dendrites. J Math Biol 2012; 66:1499-525. [PMID: 22588358 DOI: 10.1007/s00285-012-0542-9] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2011] [Revised: 04/18/2012] [Indexed: 10/28/2022]
Abstract
CaMKII (Ca²⁺-calmodulin-dependent protein kinase II) is a key regulator of glutamatergic synapses and plays an essential role in many forms of synaptic plasticity. It has recently been observed experimentally that stimulating a local region of dendrite not only induces the local translocation of CaMKII from the dendritic shaft to synaptic targets within spines, but also initiates a wave of CaMKII translocation that spreads distally through the dendrite with an average speed of order 1 μm/s. We have previously developed a simple reaction-diffusion model of CaMKII translocation waves that can account for the observed wavespeed and predicts wave propagation failure if the density of spines is too high. A major simplification of our previous model was to treat the distribution of spines as spatially uniform. However, there are at least two sources of heterogeneity in the spine distribution that occur on two different spatial scales. First, spines are discrete entities that are joined to a dendritic branch via a thin spine neck of submicron radius, resulting in spatial variations in spine density at the micron level. The second source of heterogeneity occurs on a much longer length scale and reflects the experimental observation that there is a slow proximal to distal variation in the density of spines. In this paper, we analyze how both sources of heterogeneity modulate the speed of CaMKII translocation waves along a spiny dendrite. We adapt methods from the study of the spread of biological invasions in heterogeneous environments, including homogenization theory of pulsating fronts and Hamilton-Jacobi dynamics of sharp interfaces.
Collapse
|
3
|
Madureira AL, Madureira DQ, Pinheiro PO. A multiscale numerical method for the heterogeneous cable equation. Neurocomputing 2012. [DOI: 10.1016/j.neucom.2011.08.007] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
|
4
|
A diffusion-activation model of CaMKII translocation waves in dendrites. J Comput Neurosci 2009; 28:77-89. [DOI: 10.1007/s10827-009-0188-9] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2009] [Revised: 08/06/2009] [Accepted: 09/16/2009] [Indexed: 11/26/2022]
|
5
|
Bressloff PC. Cable theory of protein receptor trafficking in a dendritic tree. PHYSICAL REVIEW. E, STATISTICAL, NONLINEAR, AND SOFT MATTER PHYSICS 2009; 79:041904. [PMID: 19518253 DOI: 10.1103/physreve.79.041904] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/07/2008] [Indexed: 05/27/2023]
Abstract
We develop an application of linear cable theory to protein receptor trafficking in the surface membrane of a neuron's dendritic tree. We assume that receptors diffuse freely in the dendritic membrane but exhibit periods of confined motion through interactions with small mushroomlike protrusions known as dendritic spines. We use cable theory to determine how receptor trafficking depends on the geometry of the dendritic tree and various important biophysical parameters such as membrane diffusivity, the density of spines, the strength of diffusive coupling between dendrites and spines, and the rates of constitutive recycling of receptors between the surface of spines and intracellular pools. We also use homogenization theory to determine corrections to cable theory arising from the discrete nature of spines.
Collapse
Affiliation(s)
- Paul C Bressloff
- Department of Mathematics, University of Utah, Salt Lake City, Utah 84112, USA
| |
Collapse
|