1
|
Wang B, Aljadeff J. Multiplicative Shot-Noise: A New Route to Stability of Plastic Networks. PHYSICAL REVIEW LETTERS 2022; 129:068101. [PMID: 36018633 DOI: 10.1103/physrevlett.129.068101] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/21/2022] [Accepted: 06/30/2022] [Indexed: 06/15/2023]
Abstract
Fluctuations of synaptic weights, among many other physical, biological, and ecological quantities, are driven by coincident events of two "parent" processes. We propose a multiplicative shot-noise model that can capture the behaviors of a broad range of such natural phenomena, and analytically derive an approximation that accurately predicts its statistics. We apply our results to study the effects of a multiplicative synaptic plasticity rule that was recently extracted from measurements in physiological conditions. Using mean-field theory analysis and network simulations, we investigate how this rule shapes the connectivity and dynamics of recurrent spiking neural networks. The multiplicative plasticity rule is shown to support efficient learning of input stimuli, and it gives a stable, unimodal synaptic-weight distribution with a large fraction of strong synapses. The strong synapses remain stable over long times but do not "run away." Our results suggest that the multiplicative shot-noise offers a new route to understand the tradeoff between flexibility and stability in neural circuits and other dynamic networks.
Collapse
Affiliation(s)
- Bin Wang
- Department of Physics, University of California San Diego, La Jolla, California 92093, USA
| | - Johnatan Aljadeff
- Department of Neurobiology, University of California San Diego, La Jolla, California 92093, USA
| |
Collapse
|
2
|
An Integrate-and-Fire Spiking Neural Network Model Simulating Artificially Induced Cortical Plasticity. eNeuro 2021; 8:ENEURO.0333-20.2021. [PMID: 33632810 PMCID: PMC7986529 DOI: 10.1523/eneuro.0333-20.2021] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2020] [Revised: 02/10/2021] [Accepted: 02/16/2021] [Indexed: 11/21/2022] Open
Abstract
We describe an integrate-and-fire (IF) spiking neural network that incorporates spike-timing-dependent plasticity (STDP) and simulates the experimental outcomes of four different conditioning protocols that produce cortical plasticity. The original conditioning experiments were performed in freely moving non-human primates (NHPs) with an autonomous head-fixed bidirectional brain-computer interface (BCI). Three protocols involved closed-loop stimulation triggered from (1) spike activity of single cortical neurons, (2) electromyographic (EMG) activity from forearm muscles, and (3) cycles of spontaneous cortical beta activity. A fourth protocol involved open-loop delivery of pairs of stimuli at neighboring cortical sites. The IF network that replicates the experimental results consists of 360 units with simulated membrane potentials produced by synaptic inputs and triggering a spike when reaching threshold. The 240 cortical units produce either excitatory or inhibitory postsynaptic potentials (PSPs) in their target units. In addition to the experimentally observed conditioning effects, the model also allows computation of underlying network behavior not originally documented. Furthermore, the model makes predictions about outcomes from protocols not yet investigated, including spike-triggered inhibition, γ-triggered stimulation and disynaptic conditioning. The success of the simulations suggests that a simple voltage-based IF model incorporating STDP can capture the essential mechanisms mediating targeted plasticity with closed-loop stimulation.
Collapse
|
3
|
Saha S, Mamun KA, Ahmed K, Mostafa R, Naik GR, Darvishi S, Khandoker AH, Baumert M. Progress in Brain Computer Interface: Challenges and Opportunities. Front Syst Neurosci 2021; 15:578875. [PMID: 33716680 PMCID: PMC7947348 DOI: 10.3389/fnsys.2021.578875] [Citation(s) in RCA: 82] [Impact Index Per Article: 27.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2020] [Accepted: 01/06/2021] [Indexed: 12/13/2022] Open
Abstract
Brain computer interfaces (BCI) provide a direct communication link between the brain and a computer or other external devices. They offer an extended degree of freedom either by strengthening or by substituting human peripheral working capacity and have potential applications in various fields such as rehabilitation, affective computing, robotics, gaming, and neuroscience. Significant research efforts on a global scale have delivered common platforms for technology standardization and help tackle highly complex and non-linear brain dynamics and related feature extraction and classification challenges. Time-variant psycho-neurophysiological fluctuations and their impact on brain signals impose another challenge for BCI researchers to transform the technology from laboratory experiments to plug-and-play daily life. This review summarizes state-of-the-art progress in the BCI field over the last decades and highlights critical challenges.
Collapse
Affiliation(s)
- Simanto Saha
- School of Electrical and Electronic Engineering, The University of Adelaide, Adelaide, SA, Australia
- Department of Electrical and Electronic Engineering, United International University, Dhaka, Bangladesh
| | - Khondaker A. Mamun
- Advanced Intelligent Multidisciplinary Systems (AIMS) Lab, Department of Computer Science and Engineering, United International University, Dhaka, Bangladesh
| | - Khawza Ahmed
- Department of Electrical and Electronic Engineering, United International University, Dhaka, Bangladesh
| | - Raqibul Mostafa
- Department of Electrical and Electronic Engineering, United International University, Dhaka, Bangladesh
| | - Ganesh R. Naik
- Adelaide Institute for Sleep Health, College of Medicine and Public Health, Flinders University, Adelaide, SA, Australia
| | - Sam Darvishi
- School of Electrical and Electronic Engineering, The University of Adelaide, Adelaide, SA, Australia
| | - Ahsan H. Khandoker
- Healthcare Engineering Innovation Center, Department of Biomedical Engineering, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
| | - Mathias Baumert
- School of Electrical and Electronic Engineering, The University of Adelaide, Adelaide, SA, Australia
| |
Collapse
|
4
|
Zhang L, Zhou Y, Liu C, Zheng W, Yao Z, Wang Q, Jin Y, Zhang S, Chen W, Chen JF. Adenosine A 2A receptor blockade improves neuroprosthetic learning by volitional control of population calcium signal in M1 cortical neurons. Neuropharmacology 2020; 178:108250. [PMID: 32726599 DOI: 10.1016/j.neuropharm.2020.108250] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2020] [Revised: 07/12/2020] [Accepted: 07/20/2020] [Indexed: 10/23/2022]
Abstract
Volitional control is at the core of brain-machine interfaces (BMI) adaptation and neuroprosthetic-driven learning to restore motor function for disabled patients, but neuroplasticity changes and neuromodulation underlying volitional control of neuroprosthetic learning are largely unexplored. To better study volitional control at annotated neural population, we have developed an operant neuroprosthetic task with closed-loop feedback system by volitional conditioning of population calcium signal in the M1 cortex using fiber photometry recording. Importantly, volitional conditioning of the population calcium signal in M1 neurons did not improve within-session adaptation, but specifically enhanced across-session neuroprosthetic skill learning with reduced time-to-target and the time to complete 50 successful trials. With brain-behavior causality of the neuroprosthetic paradigm, we revealed that proficiency of neuroprosthetic learning by volitional conditioning of calcium signal was associated with the stable representational (plasticity) mapping in M1 neurons with the reduced calcium peak. Furthermore, pharmacological blockade of adenosine A2A receptors facilitated volitional conditioning of neuroprosthetic learning and converted an ineffective volitional conditioning protocol to be the effective for neuroprosthetic learning. These findings may help to harness neuroplasticity for better volitional control of neuroprosthetic training and suggest a novel pharmacological strategy to improve neuroprosthetic learning in BMI adaptation by targeting striatal A2A receptors.
Collapse
Affiliation(s)
- Liping Zhang
- The Molecular Neuropharmacology Lab, School of Optometry and Ophthalmology, Wenzhou Medical University, China; The State Key Laboratory, School of Optometry and Ophthalmology, Wenzhou Medical University, China
| | - Yuling Zhou
- The Molecular Neuropharmacology Lab, School of Optometry and Ophthalmology, Wenzhou Medical University, China; The State Key Laboratory, School of Optometry and Ophthalmology, Wenzhou Medical University, China
| | - Chengwei Liu
- The Molecular Neuropharmacology Lab, School of Optometry and Ophthalmology, Wenzhou Medical University, China; The State Key Laboratory, School of Optometry and Ophthalmology, Wenzhou Medical University, China
| | - Wu Zheng
- The Molecular Neuropharmacology Lab, School of Optometry and Ophthalmology, Wenzhou Medical University, China; The State Key Laboratory, School of Optometry and Ophthalmology, Wenzhou Medical University, China
| | - Zhimo Yao
- The Molecular Neuropharmacology Lab, School of Optometry and Ophthalmology, Wenzhou Medical University, China; The State Key Laboratory, School of Optometry and Ophthalmology, Wenzhou Medical University, China
| | - Qin Wang
- The Molecular Neuropharmacology Lab, School of Optometry and Ophthalmology, Wenzhou Medical University, China; The State Key Laboratory, School of Optometry and Ophthalmology, Wenzhou Medical University, China
| | - Yile Jin
- Qiushi Academy of Advanced Studies and College of Biomedical Engineering and Instrumental Science, Zhejiang University, China
| | - Shaomin Zhang
- Qiushi Academy of Advanced Studies and College of Biomedical Engineering and Instrumental Science, Zhejiang University, China
| | - Weidong Chen
- Qiushi Academy of Advanced Studies and College of Biomedical Engineering and Instrumental Science, Zhejiang University, China
| | - Jiang-Fan Chen
- The Molecular Neuropharmacology Lab, School of Optometry and Ophthalmology, Wenzhou Medical University, China; The State Key Laboratory, School of Optometry and Ophthalmology, Wenzhou Medical University, China.
| |
Collapse
|
5
|
Ocker GK, Doiron B. Training and Spontaneous Reinforcement of Neuronal Assemblies by Spike Timing Plasticity. Cereb Cortex 2019; 29:937-951. [PMID: 29415191 PMCID: PMC7963120 DOI: 10.1093/cercor/bhy001] [Citation(s) in RCA: 23] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2016] [Revised: 01/01/2018] [Accepted: 01/05/2018] [Indexed: 12/15/2022] Open
Abstract
The synaptic connectivity of cortex is plastic, with experience shaping the ongoing interactions between neurons. Theoretical studies of spike timing-dependent plasticity (STDP) have focused on either just pairs of neurons or large-scale simulations. A simple analytic account for how fast spike time correlations affect both microscopic and macroscopic network structure is lacking. We develop a low-dimensional mean field theory for STDP in recurrent networks and show the emergence of assemblies of strongly coupled neurons with shared stimulus preferences. After training, this connectivity is actively reinforced by spike train correlations during the spontaneous dynamics. Furthermore, the stimulus coding by cell assemblies is actively maintained by these internally generated spiking correlations, suggesting a new role for noise correlations in neural coding. Assembly formation has often been associated with firing rate-based plasticity schemes; our theory provides an alternative and complementary framework, where fine temporal correlations and STDP form and actively maintain learned structure in cortical networks.
Collapse
Affiliation(s)
- Gabriel Koch Ocker
- Department of Neuroscience, University of Pittsburgh, Pittsburgh, PA, USA
- Center for the Neural Basis of Cognition, University of Pittsburgh and Carnegie Mellon University, Pittsburgh, PA, USA
- Allen Institute for Brain Science, Seattle, WA, USA
| | - Brent Doiron
- Center for the Neural Basis of Cognition, University of Pittsburgh and Carnegie Mellon University, Pittsburgh, PA, USA
- Department of Mathematics, University of Pittsburgh, Pittsburgh, PA, USA
| |
Collapse
|
6
|
Yazdan-Shahmorad A, Silversmith DB, Kharazia V, Sabes PN. Targeted cortical reorganization using optogenetics in non-human primates. eLife 2018; 7:31034. [PMID: 29809133 PMCID: PMC5986269 DOI: 10.7554/elife.31034] [Citation(s) in RCA: 33] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2017] [Accepted: 05/05/2018] [Indexed: 12/20/2022] Open
Abstract
Brain stimulation modulates the excitability of neural circuits and drives neuroplasticity. While the local effects of stimulation have been an active area of investigation, the effects on large-scale networks remain largely unexplored. We studied stimulation-induced changes in network dynamics in two macaques. A large-scale optogenetic interface enabled simultaneous stimulation of excitatory neurons and electrocorticographic recording across primary somatosensory (S1) and motor (M1) cortex (Yazdan-Shahmorad et al., 2016). We tracked two measures of network connectivity, the network response to focal stimulation and the baseline coherence between pairs of electrodes; these were strongly correlated before stimulation. Within minutes, stimulation in S1 or M1 significantly strengthened the gross functional connectivity between these areas. At a finer scale, stimulation led to heterogeneous connectivity changes across the network. These changes reflected the correlations introduced by stimulation-evoked activity, consistent with Hebbian plasticity models. This work extends Hebbian plasticity models to large-scale circuits, with significant implications for stimulation-based neurorehabilitation. From riding a bike to reaching for a cup of coffee, all skilled actions rely on precise connections between the sensory and motor areas of the brain. While sensory areas receive and analyse input from the senses, motor areas plan and trigger muscle contractions. Precisely adjusting the connections between these and other areas enables us to learn new skills, and it also helps us to relearn skills lost as a result of brain injury or stroke. About 70 years ago, a psychologist named Donald Hebb came up with an idea for how this process might occur. He proposed that whenever two neurons are active at the same time, the connection between them becomes stronger. This idea, that ‘cells that fire together, wire together’, became known as Hebb’s rule. Many studies have since shown that Hebb’s rule can explain changes in the strength of connections between pairs of neurons. But can it also explain how connections between entire brain regions become stronger or weaker? New results show that it can. The data were obtained using a technique called optogenetics, in which viruses are used to introduce genes for light-sensitive proteins into neurons. Shining light onto the brain will then activate any cells within that area that contain the resulting proteins. Yazdan-Shahmorad, Silversmith et al. used this technique to activate small regions of either sensory or motor brain tissue in live macaque monkeys. Doing so strengthened the overall connectivity between the two areas. The effects were more variable at the level of smaller brain regions, with some connections becoming weaker rather than stronger. However, Yazdan-Shahmorad, Silversmith et al. show that Hebb’s rule explains most of the observed changes. Many neurological and psychiatric disorders stem from abnormal brain connectivity. Simple forms of brain stimulation are already used to treat certain neurological disorders, such as Parkinson’s disease. Stimulating the brain to induce specific changes in connectivity may ultimately enable us to leverage the brain’s natural learning mechanisms to cure, instead of just treat, these conditions.
Collapse
Affiliation(s)
- Azadeh Yazdan-Shahmorad
- Department of Physiology, University of California, San Francisco, San Francisco, United States.,Center for Integrative Neuroscience, University of California, San Francisco, San Francisco, United States.,Departments of Bioengineering and Electrical Engineering, University of Washington, Seattle, United States
| | - Daniel B Silversmith
- Center for Integrative Neuroscience, University of California, San Francisco, San Francisco, United States.,UC Berkeley - UCSF Graduate Program in Bioengineering, University of California, San Francisco, San Francisco, United States
| | - Viktor Kharazia
- Center for Integrative Neuroscience, University of California, San Francisco, San Francisco, United States
| | - Philip N Sabes
- Department of Physiology, University of California, San Francisco, San Francisco, United States.,Center for Integrative Neuroscience, University of California, San Francisco, San Francisco, United States.,UC Berkeley - UCSF Graduate Program in Bioengineering, University of California, San Francisco, San Francisco, United States
| |
Collapse
|