1
|
Kühn T, Monasson R. Information content in continuous attractor neural networks is preserved in the presence of moderate disordered background connectivity. Phys Rev E 2023; 108:064301. [PMID: 38243526 DOI: 10.1103/physreve.108.064301] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Accepted: 10/04/2023] [Indexed: 01/21/2024]
Abstract
Continuous attractor neural networks (CANN) form an appealing conceptual model for the storage of information in the brain. However a drawback of CANN is that they require finely tuned interactions. We here study the effect of quenched noise in the interactions on the coding of positional information within CANN. Using the replica method we compute the Fisher information for a network with position-dependent input and recurrent connections composed of a short-range (in space) and a disordered component. We find that the loss in positional information is small for not too large disorder strength, indicating that CANN have a regime in which the advantageous effects of local connectivity on information storage outweigh the detrimental ones. Furthermore, a substantial part of this information can be extracted with a simple linear readout.
Collapse
Affiliation(s)
- Tobias Kühn
- Laboratoire de Physique de l'Ecole Normale Supérieure, CNRS UMR8023 and PSL Research, Sorbonne Université, Université Paris Cité, F-75005 Paris, France
- Institut de la Vision, Sorbonne Université, CNRS, INSERM, F-75012 Paris, France
| | - Rémi Monasson
- Laboratoire de Physique de l'Ecole Normale Supérieure, CNRS UMR8023 and PSL Research, Sorbonne Université, Université Paris Cité, F-75005 Paris, France
| |
Collapse
|
2
|
Chen S, Yang Q, Lim S. Efficient inference of synaptic plasticity rule with Gaussian process regression. iScience 2023; 26:106182. [PMID: 36879810 PMCID: PMC9985048 DOI: 10.1016/j.isci.2023.106182] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Revised: 01/24/2023] [Accepted: 02/07/2023] [Indexed: 02/16/2023] Open
Abstract
Finding the form of synaptic plasticity is critical to understanding its functions underlying learning and memory. We investigated an efficient method to infer synaptic plasticity rules in various experimental settings. We considered biologically plausible models fitting a wide range of in-vitro studies and examined the recovery of their firing-rate dependence from sparse and noisy data. Among the methods assuming low-rankness or smoothness of plasticity rules, Gaussian process regression (GPR), a nonparametric Bayesian approach, performs the best. Under the conditions measuring changes in synaptic weights directly or measuring changes in neural activities as indirect observables of synaptic plasticity, which leads to different inference problems, GPR performs well. Also, GPR could simultaneously recover multiple plasticity rules and robustly perform under various plasticity rules and noise levels. Such flexibility and efficiency, particularly at the low sampling regime, make GPR suitable for recent experimental developments and inferring a broader class of plasticity models.
Collapse
Affiliation(s)
- Shirui Chen
- Department of Applied Mathematics, University of Washington, Lewis Hall 201, Box 353925, Seattle, WA 98195-3925, USA
- Neural Science, New York University Shanghai, 1555 Century Avenue, Shanghai, 200122, China
| | - Qixin Yang
- The Edmond and Lily Safra Center for Brain Sciences, The Hebrew University, The Suzanne and Charles Goodman Brain Sciences Building, Edmond J. Safra Campus, Jerusalem, 9190401, Israel
- Neural Science, New York University Shanghai, 1555 Century Avenue, Shanghai, 200122, China
| | - Sukbin Lim
- Neural Science, New York University Shanghai, 1555 Century Avenue, Shanghai, 200122, China
- NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, 3663 Zhongshan Road North, Shanghai, 200062, China
| |
Collapse
|
3
|
Williams N, Olson CR. Independent repetition suppression in macaque area V2 and inferotemporal cortex. J Neurophysiol 2022; 128:1421-1434. [PMID: 36350050 PMCID: PMC9678433 DOI: 10.1152/jn.00043.2022] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Revised: 10/11/2022] [Accepted: 10/23/2022] [Indexed: 11/11/2022] Open
Abstract
When a complexly structured natural image is presented twice in succession, first as adapter and then as test, neurons in area TE of macaque inferotemporal cortex exhibit repetition suppression, responding less strongly to the second presentation than to the first. This phenomenon, which has been studied primarily in TE, might plausibly be argued to arise in TE because TE neurons respond selectively to complex images and thus carry information adequate for determining whether an image is or is not a repeat. However, the idea has never been put to a direct test. To resolve this issue, we monitored neuronal responses to sequences of complex natural images under identical conditions in areas V2 and TE. We found that repetition suppression occurs in both areas. Moreover, in each area, suppression takes the form of a dynamic alteration whereby the initial peak of excitation is followed by a trough and then a rebound of firing rate. To assess whether repetition suppression in either area is transmitted from the other area, we analyzed the timing of the phenomenon and its degree of spatial generalization. Suppression occurs at shorter latency in V2 than in TE. Therefore it is not simply fed back from TE. Suppression occurs in TE but not in V2 under conditions in which the test and adapter are presented in different visual field quadrants. Therefore it is not simply fed forward from V2. We conclude that repetition suppression occurs independently in V2 and TE.NEW & NOTEWORTHY When a complexly structured natural image is presented twice in rapid succession, neurons in inferotemporal area TE exhibit repetition suppression, responding less strongly to the second than to the first presentation. We have explored whether this phenomenon is confined to high-order areas where neurons respond selectively to such images and thus carry information relevant to recognizing a repeat. We have found surprisingly that repetition suppression occurs even in low-order visual area V2.
Collapse
Affiliation(s)
- Nathaniel Williams
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania
- Department of Biological Sciences, Carnegie Mellon University, Pittsburgh, Pennsylvania
- Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, Pennsylvania
| | - Carl R Olson
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania
- Department of Biological Sciences, Carnegie Mellon University, Pittsburgh, Pennsylvania
- Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, Pennsylvania
| |
Collapse
|
4
|
Williams NP, Olson CR. Contribution of Individual Features to Repetition Suppression in Macaque Inferotemporal Cortex. J Neurophysiol 2022; 128:378-394. [PMID: 35830503 PMCID: PMC9359640 DOI: 10.1152/jn.00475.2021] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
When an image is presented twice in succession, neurons in area TE of macaque inferotemporal cortex exhibit repetition suppression, responding less strongly to the second presentation than to the first. Suppression is known to occur if the adapter and the test image are subtly different from each other. However, it is not known whether cross-suppression occurs between images that are radically different from each other but that share a subset of features. To explore this issue, we measured repetition suppression using colored shapes. On interleaved trials, the test image might be identical to the adapter, might share its shape or color alone or might differ from it totally. At the level of the neuronal population as a whole, suppression was especially deep when adapter and test were identical, intermediate when they shared only one attribute and minimal when they shared neither attribute. At the level of the individual neuron, the degree of suppression depended not only on the properties of the two images but also on the preferences of the neuron. Suppression was deeper when the repeated color or shape was preferred by the neuron than when it was not. This effect might arise from feature-specific adaptation or alternatively from adapter-induced fatigue. Both mechanisms conform to the principle that the degree of suppression is determined by the preferences of the neuron.
Collapse
Affiliation(s)
- Nathaniel P Williams
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, United States.,Department of Biological Sciences, Carnegie Mellon University, Pittsburgh, Pennsylvania, PA, United States.,Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA, United States
| | - Carl R Olson
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, United States.,Department of Biological Sciences, Carnegie Mellon University, Pittsburgh, Pennsylvania, PA, United States.,Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA, United States
| |
Collapse
|
5
|
Aljadeff J, Gillett M, Pereira Obilinovic U, Brunel N. From synapse to network: models of information storage and retrieval in neural circuits. Curr Opin Neurobiol 2021; 70:24-33. [PMID: 34175521 DOI: 10.1016/j.conb.2021.05.005] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2021] [Revised: 05/06/2021] [Accepted: 05/25/2021] [Indexed: 10/21/2022]
Abstract
The mechanisms of information storage and retrieval in brain circuits are still the subject of debate. It is widely believed that information is stored at least in part through changes in synaptic connectivity in networks that encode this information and that these changes lead in turn to modifications of network dynamics, such that the stored information can be retrieved at a later time. Here, we review recent progress in deriving synaptic plasticity rules from experimental data and in understanding how plasticity rules affect the dynamics of recurrent networks. We show that the dynamics generated by such networks exhibit a large degree of diversity, depending on parameters, similar to experimental observations in vivo during delayed response tasks.
Collapse
Affiliation(s)
- Johnatan Aljadeff
- Neurobiology Section, Division of Biological Sciences, UC San Diego, USA
| | | | | | - Nicolas Brunel
- Department of Neurobiology, Duke University, USA; Department of Physics, Duke University, USA.
| |
Collapse
|
6
|
|
7
|
Visual Familiarity Induced 5-Hz Oscillations and Improved Orientation and Direction Selectivities in V1. J Neurosci 2021; 41:2656-2667. [PMID: 33563727 PMCID: PMC8018737 DOI: 10.1523/jneurosci.1337-20.2021] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2020] [Revised: 01/12/2021] [Accepted: 01/17/2021] [Indexed: 11/25/2022] Open
Abstract
Neural oscillations play critical roles in information processing, communication between brain areas, learning, and memory. We have recently discovered that familiar visual stimuli can robustly induce 5-Hz oscillations in the primary visual cortex (V1) of awake mice after the visual experience. To gain more mechanistic insight into this phenomenon, we used in vivo patch-clamp recordings to monitor the subthreshold activity of individual neurons during these oscillations. Neural oscillations play critical roles in information processing, communication between brain areas, learning, and memory. We have recently discovered that familiar visual stimuli can robustly induce 5-Hz oscillations in the primary visual cortex (V1) of awake mice after the visual experience. To gain more mechanistic insight into this phenomenon, we used in vivo patch-clamp recordings to monitor the subthreshold activity of individual neurons during these oscillations. We analyzed the visual tuning properties of V1 neurons in naive and experienced mice to assess the effect of visual experience on the orientation and direction selectivity. Using optogenetic stimulation through the patch pipette in vivo, we measured the synaptic strength of specific intracortical and thalamocortical projections in vivo in the visual cortex before and after the visual experience. We found 5-Hz oscillations in membrane potential (Vm) and firing rates evoked in single neurons in response to the familiar stimulus, consistent with previous studies. Following the visual experience, the average firing rates of visual responses were reduced while the orientation and direction selectivities were increased. Light-evoked EPSCs were significantly increased for layer 5 (L5) projections to other layers of V1 after the visual experience, while the thalamocortical synaptic strength was decreased. In addition, we developed a computational model that could reproduce 5-Hz oscillations with enhanced neuronal selectivity following synaptic plasticity within the recurrent network and decreased feedforward input. SIGNIFICANCE STATEMENT Neural oscillations at around 5 Hz are involved in visual working memory and temporal expectations in primary visual cortex (V1). However, how the oscillations modulate the visual response properties of neurons in V1 and their underlying mechanism is poorly understood. Here, we show that these oscillations may alter the orientation and direction selectivity of the layer 2/3 (L2/3) neurons and correlate with the synaptic plasticity within V1. Our computational recurrent network model reproduces all these observations and provides a mechanistic framework for studying the role of 5-Hz oscillations in visual familiarity.
Collapse
|