1
|
Zhou J, Jiang Z, Hou T, Chen Z, Wong KYM, Huang H. Eigenvalue spectrum of neural networks with arbitrary Hebbian length. Phys Rev E 2021; 104:064307. [PMID: 35030940 DOI: 10.1103/physreve.104.064307] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2021] [Accepted: 11/29/2021] [Indexed: 06/14/2023]
Abstract
Associative memory is a fundamental function in the brain. Here, we generalize the standard associative memory model to include long-range Hebbian interactions at the learning stage, corresponding to a large synaptic integration window. In our model, the Hebbian length can be arbitrarily large. The spectral density of the coupling matrix is derived using the replica method, which is also shown to be consistent with the results obtained by applying the free probability method. The maximal eigenvalue is then obtained by an iterative equation, related to the paramagnetic to spin glass transition in the model. Altogether, this work establishes the connection between the associative memory with arbitrary Hebbian length and the asymptotic eigen-spectrum of the neural-coupling matrix.
Collapse
Affiliation(s)
- Jianwen Zhou
- PMI Lab, School of Physics, Sun Yat-sen University, Guangzhou 510275, People's Republic of China and CAS Key Laboratory for Theoretical Physics, Institute of Theoretical Physics, Chinese Academy of Sciences, Beijing 100190, People's Republic of China
| | - Zijian Jiang
- PMI Lab, School of Physics, Sun Yat-sen University, Guangzhou 510275, People's Republic of China
| | - Tianqi Hou
- Department of Physics, the Hong Kong University of Science and Technology, Clear Water Bay, Hong Kong, People's Republic of China and Theory Lab, Central Research Institute, 2012 Labs, Huawei Technologies Co., Ltd., Hong Kong Science Park, People's Republic of China
| | - Ziming Chen
- PMI Lab, School of Physics, Sun Yat-sen University, Guangzhou 510275, People's Republic of China and Department of Electronic Engineering, Tsinghua University, Beijing 100084, People's Republic of China
| | - K Y Michael Wong
- Department of Physics, the Hong Kong University of Science and Technology, Clear Water Bay, Hong Kong, People's Republic of China
| | - Haiping Huang
- PMI Lab, School of Physics, Sun Yat-sen University, Guangzhou 510275, People's Republic of China
| |
Collapse
|