1
|
Pan W, Zhao F, Han B, Dong Y, Zeng Y. Emergence of brain-inspired small-world spiking neural network through neuroevolution. iScience 2024; 27:108845. [PMID: 38327781 PMCID: PMC10847652 DOI: 10.1016/j.isci.2024.108845] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2023] [Revised: 08/23/2023] [Accepted: 01/03/2024] [Indexed: 02/09/2024] Open
Abstract
Studies suggest that the brain's high efficiency and low energy consumption may be closely related to its small-world topology and critical dynamics. However, existing efforts on the performance-oriented structural evolution of spiking neural networks (SNNs) are time-consuming and ignore the core structural properties of the brain. Here, we introduce a multi-objective Evolutionary Liquid State Machine (ELSM), which blends the small-world coefficient and criticality to evolve models and guide the emergence of brain-inspired, efficient structures. Experiments reveal ELSM's consistent and comparable performance, achieving 97.23% on NMNIST and outperforming LSM models on MNIST and Fashion-MNIST with 98.12% and 88.81% accuracies, respectively. Further analysis shows its versatility and spontaneous evolution of topologies such as hub nodes, short paths, long-tailed degree distributions, and numerous communities. This study evolves recurrent spiking neural networks into brain-inspired energy-efficient structures, showcasing versatility in multiple tasks and potential for adaptive general artificial intelligence.
Collapse
Affiliation(s)
- Wenxuan Pan
- Brain-inspired Cognitive Intelligence Lab, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 101408, China
| | - Feifei Zhao
- Brain-inspired Cognitive Intelligence Lab, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
| | - Bing Han
- Brain-inspired Cognitive Intelligence Lab, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 101408, China
| | - Yiting Dong
- Brain-inspired Cognitive Intelligence Lab, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
- School of Future Technology, University of Chinese Academy of Sciences, Beijing 101408, China
| | - Yi Zeng
- Brain-inspired Cognitive Intelligence Lab, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 101408, China
- School of Future Technology, University of Chinese Academy of Sciences, Beijing 101408, China
- Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
| |
Collapse
|
2
|
Electrical coupling regulated by GABAergic nucleo-olivary afferent fibres facilitates cerebellar sensory-motor adaptation. Neural Netw 2022; 155:422-438. [DOI: 10.1016/j.neunet.2022.08.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2022] [Revised: 07/16/2022] [Accepted: 08/24/2022] [Indexed: 11/18/2022]
|
3
|
Abadía I, Naveros F, Ros E, Carrillo RR, Luque NR. A cerebellar-based solution to the nondeterministic time delay problem in robotic control. Sci Robot 2021; 6:eabf2756. [PMID: 34516748 DOI: 10.1126/scirobotics.abf2756] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/30/2023]
Abstract
[Figure: see text].
Collapse
Affiliation(s)
- Ignacio Abadía
- Research Centre for Information and Communication Technologies (CITIC), Department of Computer Architecture and Technology, University of Granada, Granada, Spain
| | - Francisco Naveros
- Research Centre for Information and Communication Technologies (CITIC), Department of Computer Architecture and Technology, University of Granada, Granada, Spain.,Computer School, Department of Architecture and Technology of Informatics Systems, Polytechnic University of Madrid, Madrid, Spain
| | - Eduardo Ros
- Research Centre for Information and Communication Technologies (CITIC), Department of Computer Architecture and Technology, University of Granada, Granada, Spain
| | - Richard R Carrillo
- Research Centre for Information and Communication Technologies (CITIC), Department of Computer Architecture and Technology, University of Granada, Granada, Spain
| | - Niceto R Luque
- Research Centre for Information and Communication Technologies (CITIC), Department of Computer Architecture and Technology, University of Granada, Granada, Spain
| |
Collapse
|
4
|
Tang Y, An L, Wang Q, Liu JK. Regulating synchronous oscillations of cerebellar granule cells by different types of inhibition. PLoS Comput Biol 2021; 17:e1009163. [PMID: 34181653 PMCID: PMC8270418 DOI: 10.1371/journal.pcbi.1009163] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2021] [Revised: 07/09/2021] [Accepted: 06/08/2021] [Indexed: 11/18/2022] Open
Abstract
Synchronous oscillations in neural populations are considered being controlled by inhibitory neurons. In the granular layer of the cerebellum, two major types of cells are excitatory granular cells (GCs) and inhibitory Golgi cells (GoCs). GC spatiotemporal dynamics, as the output of the granular layer, is highly regulated by GoCs. However, there are various types of inhibition implemented by GoCs. With inputs from mossy fibers, GCs and GoCs are reciprocally connected to exhibit different network motifs of synaptic connections. From the view of GCs, feedforward inhibition is expressed as the direct input from GoCs excited by mossy fibers, whereas feedback inhibition is from GoCs via GCs themselves. In addition, there are abundant gap junctions between GoCs showing another form of inhibition. It remains unclear how these diverse copies of inhibition regulate neural population oscillation changes. Leveraging a computational model of the granular layer network, we addressed this question to examine the emergence and modulation of network oscillation using different types of inhibition. We show that at the network level, feedback inhibition is crucial to generate neural oscillation. When short-term plasticity was equipped on GoC-GC synapses, oscillations were largely diminished. Robust oscillations can only appear with additional gap junctions. Moreover, there was a substantial level of cross-frequency coupling in oscillation dynamics. Such a coupling was adjusted and strengthened by GoCs through feedback inhibition. Taken together, our results suggest that the cooperation of distinct types of GoC inhibition plays an essential role in regulating synchronous oscillations of the GC population. With GCs as the sole output of the granular network, their oscillation dynamics could potentially enhance the computational capability of downstream neurons.
Collapse
Affiliation(s)
- Yuanhong Tang
- School of Computer Science and Technology, Xidian University, Xi’an, China
| | - Lingling An
- School of Computer Science and Technology, Xidian University, Xi’an, China
- Guangzhou institute of technology, Xidian University, Guangzhou, China
| | - Quan Wang
- School of Computer Science and Technology, Xidian University, Xi’an, China
| | - Jian K. Liu
- Centre for Systems Neuroscience, Department of Neuroscience, Psychology and Behaviour, University of Leicester, Leicester, United Kingdom
- School of Computing, University of Leeds, Leeds, United Kingdom
| |
Collapse
|
5
|
Abadia I, Naveros F, Garrido JA, Ros E, Luque NR. On Robot Compliance: A Cerebellar Control Approach. IEEE TRANSACTIONS ON CYBERNETICS 2021; 51:2476-2489. [PMID: 31647453 DOI: 10.1109/tcyb.2019.2945498] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
The work presented here is a novel biological approach for the compliant control of a robotic arm in real time (RT). We integrate a spiking cerebellar network at the core of a feedback control loop performing torque-driven control. The spiking cerebellar controller provides torque commands allowing for accurate and coordinated arm movements. To compute these output motor commands, the spiking cerebellar controller receives the robot's sensorial signals, the robot's goal behavior, and an instructive signal. These input signals are translated into a set of evolving spiking patterns representing univocally a specific system state at every point of time. Spike-timing-dependent plasticity (STDP) is then supported, allowing for building adaptive control. The spiking cerebellar controller continuously adapts the torque commands provided to the robot from experience as STDP is deployed. Adaptive torque commands, in turn, help the spiking cerebellar controller to cope with built-in elastic elements within the robot's actuators mimicking human muscles (inherently elastic). We propose a natural integration of a bioinspired control scheme, based on the cerebellum, with a compliant robot. We prove that our compliant approach outperforms the accuracy of the default factory-installed position control in a set of tasks used for addressing cerebellar motor behavior: controlling six degrees of freedom (DoF) in smooth movements, fast ballistic movements, and unstructured scenario compliant movements.
Collapse
|
6
|
Tang Y, An L, Yuan Y, Pei Q, Wang Q, Liu JK. Modulation of the dynamics of cerebellar Purkinje cells through the interaction of excitatory and inhibitory feedforward pathways. PLoS Comput Biol 2021; 17:e1008670. [PMID: 33566820 PMCID: PMC7909957 DOI: 10.1371/journal.pcbi.1008670] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2020] [Revised: 02/26/2021] [Accepted: 01/04/2021] [Indexed: 01/08/2023] Open
Abstract
The dynamics of cerebellar neuronal networks is controlled by the underlying building blocks of neurons and synapses between them. For which, the computation of Purkinje cells (PCs), the only output cells of the cerebellar cortex, is implemented through various types of neural pathways interactively routing excitation and inhibition converged to PCs. Such tuning of excitation and inhibition, coming from the gating of specific pathways as well as short-term plasticity (STP) of the synapses, plays a dominant role in controlling the PC dynamics in terms of firing rate and spike timing. PCs receive cascade feedforward inputs from two major neural pathways: the first one is the feedforward excitatory pathway from granule cells (GCs) to PCs; the second one is the feedforward inhibition pathway from GCs, via molecular layer interneurons (MLIs), to PCs. The GC-PC pathway, together with short-term dynamics of excitatory synapses, has been a focus over past decades, whereas recent experimental evidence shows that MLIs also greatly contribute to controlling PC activity. Therefore, it is expected that the diversity of excitation gated by STP of GC-PC synapses, modulated by strong inhibition from MLI-PC synapses, can promote the computation performed by PCs. However, it remains unclear how these two neural pathways are interacted to modulate PC dynamics. Here using a computational model of PC network installed with these two neural pathways, we addressed this question to investigate the change of PC firing dynamics at the level of single cell and network. We show that the nonlinear characteristics of excitatory STP dynamics can significantly modulate PC spiking dynamics mediated by inhibition. The changes in PC firing rate, firing phase, and temporal spike pattern, are strongly modulated by these two factors in different ways. MLIs mainly contribute to variable delays in the postsynaptic action potentials of PCs while modulated by excitation STP. Notably, the diversity of synchronization and pause response in the PC network is governed not only by the balance of excitation and inhibition, but also by the synaptic STP, depending on input burst patterns. Especially, the pause response shown in the PC network can only emerge with the interaction of both pathways. Together with other recent findings, our results show that the interaction of feedforward pathways of excitation and inhibition, incorporated with synaptic short-term dynamics, can dramatically regulate the PC activities that consequently change the network dynamics of the cerebellar circuit. It is well known that the dynamics of neuronal networks are controlled by various types of neural pathways that are interactively routing excitation and inhibition converged to postsynaptic neurons. In addition, gating of a specific neural pathway is enhanced by short-term plasticity of the synapses between neurons. However, it remains unclear how a combination of these factors, the strengths of excitation and inhibition, and their short-term dynamics respectively, contributes to the dynamics of single cells and neuronal networks. Using a network model of cerebellar Purkinje cells embedded with the feedforward excitatory pathway from granule cells and feedforward inhibition pathway of molecular layer interneurons. We show that the dynamics of firing rate, firing phase, and temporal spike pattern are notably yet differently modulated by these two pathways. At the single cell level, excitatory short-term plasticity nonlinearly modulates the input-output relationship of firing activity. At the network level, the diversity of synchronization and pause response is governed not only by the balance of excitation and inhibition, but also by synaptic short-term dynamics. Only when both neural pathways are incorporated, there is a strong pause response shown in the network. Our results, together with recent in vivo experimental observations in the cerebellum, show that the interaction of feedforward pathways of excitation and inhibition, together with synaptic short-term dynamics, can dramatically change the network dynamics of Purkinje cells.
Collapse
Affiliation(s)
- Yuanhong Tang
- School of Computer Science and Technology, Xidian University, Xi’an, China
| | - Lingling An
- School of Computer Science and Technology, Xidian University, Xi’an, China
- * E-mail: (LA); (JKL)
| | - Ye Yuan
- School of Computer Science and Technology, Xidian University, Xi’an, China
| | - Qingqi Pei
- School of Telecommunication Engineering, Xidian University, Xi’an, China
| | - Quan Wang
- School of Computer Science and Technology, Xidian University, Xi’an, China
| | - Jian K. Liu
- Centre for Systems Neuroscience, Department of Neuroscience, Psychology and Behaviour, University of Leicester, Leicester, United Kingdom
- * E-mail: (LA); (JKL)
| |
Collapse
|
7
|
Lévesque M, Gao H, Southward C, Langlois JMP, Léna C, Courtemanche R. Cerebellar Cortex 4-12 Hz Oscillations and Unit Phase Relation in the Awake Rat. Front Syst Neurosci 2020; 14:475948. [PMID: 33240052 PMCID: PMC7683574 DOI: 10.3389/fnsys.2020.475948] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2019] [Accepted: 10/13/2020] [Indexed: 11/13/2022] Open
Abstract
Oscillations in the granule cell layer (GCL) of the cerebellar cortex have been related to behavior and could facilitate communication with the cerebral cortex. These local field potential (LFP) oscillations, strong at 4–12 Hz in the rodent cerebellar cortex during awake immobility, should also be an indicator of an underlying influence on the patterns of the cerebellar cortex neuronal firing during rest. To address this hypothesis, cerebellar cortex LFPs and simultaneous single-neuron activity were collected during LFP oscillatory periods in the GCL of awake resting rats. During these oscillatory episodes, different types of units across the GCL and Purkinje cell layers showed variable phase-relation with the oscillatory cycles. Overall, 74% of the Golgi cell firing and 54% of the Purkinje cell simple spike (SS) firing were phase-locked with the oscillations, displaying a clear phase relationship. Despite this tendency, fewer Golgi cells (50%) and Purkinje cell’s SSs (25%) showed an oscillatory firing pattern. Oscillatory phase-locked spikes for the Golgi and Purkinje cells occurred towards the peak of the LFP cycle. GCL LFP oscillations had a strong capacity to predict the timing of Golgi cell spiking activity, indicating a strong influence of this oscillatory phenomenon over the GCL. Phase-locking was not as prominent for the Purkinje cell SS firing, indicating a weaker influence over the Purkinje cell layer, yet a similar phase relation. Overall, synaptic activity underlying GCL LFP oscillations likely exert an influence on neuronal population firing patterns in the cerebellar cortex in the awake resting state and could have a preparatory neural network shaping capacity serving as a neural baseline for upcoming cerebellar operations.
Collapse
Affiliation(s)
- Maxime Lévesque
- Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montréal, QC, Canada
| | - HongYing Gao
- Institut de Biologie, CNRS UMR 8197-U 1024, École Normale Supérieure, Paris, France
| | - Carla Southward
- Department of Health, Kinesiology and Applied Physiology, Center for Studies in Behavioral Neurobiology, Concordia University, Montréal, QC, Canada
| | - J M Pierre Langlois
- Département de Génie Informatique et Génie Logiciel, Polytechnique Montréal, Montréal, QC, Canada
| | - Clément Léna
- Institut de Biologie, CNRS UMR 8197-U 1024, École Normale Supérieure, Paris, France
| | - Richard Courtemanche
- Department of Health, Kinesiology and Applied Physiology, Center for Studies in Behavioral Neurobiology, Concordia University, Montréal, QC, Canada
| |
Collapse
|
8
|
Luque NR, Naveros F, Carrillo RR, Ros E, Arleo A. Spike burst-pause dynamics of Purkinje cells regulate sensorimotor adaptation. PLoS Comput Biol 2019; 15:e1006298. [PMID: 30860991 PMCID: PMC6430425 DOI: 10.1371/journal.pcbi.1006298] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2018] [Revised: 03/22/2019] [Accepted: 01/08/2019] [Indexed: 11/25/2022] Open
Abstract
Cerebellar Purkinje cells mediate accurate eye movement coordination. However, it remains unclear how oculomotor adaptation depends on the interplay between the characteristic Purkinje cell response patterns, namely tonic, bursting, and spike pauses. Here, a spiking cerebellar model assesses the role of Purkinje cell firing patterns in vestibular ocular reflex (VOR) adaptation. The model captures the cerebellar microcircuit properties and it incorporates spike-based synaptic plasticity at multiple cerebellar sites. A detailed Purkinje cell model reproduces the three spike-firing patterns that are shown to regulate the cerebellar output. Our results suggest that pauses following Purkinje complex spikes (bursts) encode transient disinhibition of target medial vestibular nuclei, critically gating the vestibular signals conveyed by mossy fibres. This gating mechanism accounts for early and coarse VOR acquisition, prior to the late reflex consolidation. In addition, properly timed and sized Purkinje cell bursts allow the ratio between long-term depression and potentiation (LTD/LTP) to be finely shaped at mossy fibre-medial vestibular nuclei synapses, which optimises VOR consolidation. Tonic Purkinje cell firing maintains the consolidated VOR through time. Importantly, pauses are crucial to facilitate VOR phase-reversal learning, by reshaping previously learnt synaptic weight distributions. Altogether, these results predict that Purkinje spike burst-pause dynamics are instrumental to VOR learning and reversal adaptation. Cerebellar Purkinje cells regulate accurate eye movement coordination. However, it remains unclear how cerebellar-dependent oculomotor adaptation depends on the interplay between Purkinje cell characteristic response patterns: tonic, high frequency bursting, and post-complex spike pauses. We explore the role of Purkinje spike burst-pause dynamics in VOR adaptation. A biophysical model of Purkinje cell is at the core of a spiking network model, which captures the cerebellar microcircuit properties and incorporates spike-based synaptic plasticity mechanisms at different cerebellar sites. We show that Purkinje spike burst-pause dynamics are critical for (1) gating the vestibular-motor response association during VOR acquisition; (2) mediating the LTD/LTP balance for VOR consolidation; (3) reshaping synaptic efficacy distributions for VOR phase-reversal adaptation; (4) explaining the reversal VOR gain discontinuities during sleeping.
Collapse
Affiliation(s)
- Niceto R. Luque
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, Paris, France
- * E-mail: (NRL); (AA)
| | - Francisco Naveros
- Department of Computer Architecture and Technology, CITIC-University of Granada, Granada, Spain
| | - Richard R. Carrillo
- Department of Computer Architecture and Technology, CITIC-University of Granada, Granada, Spain
| | - Eduardo Ros
- Department of Computer Architecture and Technology, CITIC-University of Granada, Granada, Spain
| | - Angelo Arleo
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, Paris, France
- * E-mail: (NRL); (AA)
| |
Collapse
|
9
|
Naveros F, Luque NR, Ros E, Arleo A. VOR Adaptation on a Humanoid iCub Robot Using a Spiking Cerebellar Model. IEEE TRANSACTIONS ON CYBERNETICS 2019; 50:4744-4757. [PMID: 30835236 DOI: 10.1109/tcyb.2019.2899246] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
We embed a spiking cerebellar model within an adaptive real-time (RT) control loop that is able to operate a real robotic body (iCub) when performing different vestibulo-ocular reflex (VOR) tasks. The spiking neural network computation, including event- and time-driven neural dynamics, neural activity, and spike-timing dependent plasticity (STDP) mechanisms, leads to a nondeterministic computation time caused by the neural activity volleys encountered during cerebellar simulation. This nondeterministic computation time motivates the integration of an RT supervisor module that is able to ensure a well-orchestrated neural computation time and robot operation. Actually, our neurorobotic experimental setup (VOR) benefits from the biological sensory motor delay between the cerebellum and the body to buffer the computational overloads as well as providing flexibility in adjusting the neural computation time and RT operation. The RT supervisor module provides for incremental countermeasures that dynamically slow down or speed up the cerebellar simulation by either halting the simulation or disabling certain neural computation features (i.e., STDP mechanisms, spike propagation, and neural updates) to cope with the RT constraints imposed by the real robot operation. This neurorobotic experimental setup is applied to different horizontal and vertical VOR adaptive tasks that are widely used by the neuroscientific community to address cerebellar functioning. We aim to elucidate the manner in which the combination of the cerebellar neural substrate and the distributed plasticity shapes the cerebellar neural activity to mediate motor adaptation. This paper underlies the need for a two-stage learning process to facilitate VOR acquisition.
Collapse
|
10
|
Robinson JC, Chapman CA, Courtemanche R. Gap Junction Modulation of Low-Frequency Oscillations in the Cerebellar Granule Cell Layer. THE CEREBELLUM 2018; 16:802-811. [PMID: 28421552 DOI: 10.1007/s12311-017-0858-5] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/30/2023]
Abstract
Local field potential (LFP) oscillations in the granule cell layer (GCL) of the cerebellar cortex have been identified previously in the awake rat and monkey during immobility. These low-frequency oscillations are thought to be generated through local circuit interactions between Golgi cells and granule cells within the GCL. Golgi cells display rhythmic firing and pacemaking properties, and also are electrically coupled through gap junctions within the GCL. Here, we tested if gap junctions in the rat cerebellar cortex contribute to the generation of LFP oscillations in the GCL. We recorded LFP oscillations under urethane anesthesia, and examined the effects of local infusion of gap junction blockers on 5-15 Hz oscillations. Local infusion of the gap junction blockers carbenoxolone and mefloquine resulted in significant decreases in the power of oscillations over a 30-min period, but the power of oscillations was unchanged in control experiments following vehicle injections. In addition, infusion of gap junction blockers had no significant effect on multi-unit activity, suggesting that the attenuation of low-frequency oscillations was likely due to reductions in electrical coupling rather than a decreased excitability within the granule cell layer. Our results indicate that electrical coupling among the Golgi cell networks in the cerebellar cortex contributes to the local circuit mechanisms that promote the occurrence of GCL LFP slow oscillations in the anesthetized rat.
Collapse
Affiliation(s)
- Jennifer Claire Robinson
- Department of Exercise Science, and the FRQS Groupe de Recherche en Neurobiologie Comportementale (CSBN), Concordia University, SP-165-03, 7141 Sherbrooke Street West, Montreal, QC, H4B 1R6, Canada
| | - C Andrew Chapman
- Department of Psychology, and the FRQS Groupe de Recherche en Neurobiologie Comportementale (CSBN), Concordia University, Montreal, Canada
| | - Richard Courtemanche
- Department of Exercise Science, and the FRQS Groupe de Recherche en Neurobiologie Comportementale (CSBN), Concordia University, SP-165-03, 7141 Sherbrooke Street West, Montreal, QC, H4B 1R6, Canada.
| |
Collapse
|
11
|
Sudhakar SK, Hong S, Raikov I, Publio R, Lang C, Close T, Guo D, Negrello M, De Schutter E. Spatiotemporal network coding of physiological mossy fiber inputs by the cerebellar granular layer. PLoS Comput Biol 2017; 13:e1005754. [PMID: 28934196 PMCID: PMC5626500 DOI: 10.1371/journal.pcbi.1005754] [Citation(s) in RCA: 31] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2016] [Revised: 10/03/2017] [Accepted: 08/31/2017] [Indexed: 11/18/2022] Open
Abstract
The granular layer, which mainly consists of granule and Golgi cells, is the first stage of the cerebellar cortex and processes spatiotemporal information transmitted by mossy fiber inputs with a wide variety of firing patterns. To study its dynamics at multiple time scales in response to inputs approximating real spatiotemporal patterns, we constructed a large-scale 3D network model of the granular layer. Patterned mossy fiber activity induces rhythmic Golgi cell activity that is synchronized by shared parallel fiber input and by gap junctions. This leads to long distance synchrony of Golgi cells along the transverse axis, powerfully regulating granule cell firing by imposing inhibition during a specific time window. The essential network mechanisms, including tunable Golgi cell oscillations, on-beam inhibition and NMDA receptors causing first winner keeps winning of granule cells, illustrate how fundamental properties of the granule layer operate in tandem to produce (1) well timed and spatially bound output, (2) a wide dynamic range of granule cell firing and (3) transient and coherent gating oscillations. These results substantially enrich our understanding of granule cell layer processing, which seems to promote spatial group selection of granule cell activity as a function of timing of mossy fiber input. The cerebellum is an organ of peculiar geometrical properties, and has been attributed the function of applying spatiotemporal transforms to sensorimotor data since Eccles. In this work we have analyzed the spatiotemporal response properties of the first part of the cerebellar circuit, the granule layer. On the basis of a biophysically plausible and large-scale model of the cerebellum, constrained by a wealth of anatomical data, we study the network dynamics and firing properties of individual cell populations in response to 'realistic' input patterns. We make specific predictions about the spatiotemporal features of granule layer processing regarding the effects of the gap junction coupled network of Golgi cells on a spatially restricted input, in an effect we denominate first-takes-all. Furthermore, we calculate that the granule cell layer has a wide dynamic range, indicating that this is a system that can transmit large variations of input intensities.
Collapse
Affiliation(s)
- Shyam Kumar Sudhakar
- Computational Neuroscience Unit, Okinawa Institute of Science and Technology, Onna-son, Okinawa, Japan
- Laboratory of Theoretical Neurobiology and Neuro-engineering, University of Antwerp, Wilrijk, Belgium
- Department of Psychology, University of Michigan, Ann Arbor, Michigan, United States of America
| | - Sungho Hong
- Computational Neuroscience Unit, Okinawa Institute of Science and Technology, Onna-son, Okinawa, Japan
| | - Ivan Raikov
- Computational Neuroscience Unit, Okinawa Institute of Science and Technology, Onna-son, Okinawa, Japan
| | - Rodrigo Publio
- Computational Neuroscience Unit, Okinawa Institute of Science and Technology, Onna-son, Okinawa, Japan
| | - Claus Lang
- Computational Neuroscience Unit, Okinawa Institute of Science and Technology, Onna-son, Okinawa, Japan
- Bernstein Center of Computational Neuroscience Berlin, Berlin, Germany
| | - Thomas Close
- Computational Neuroscience Unit, Okinawa Institute of Science and Technology, Onna-son, Okinawa, Japan
| | - Daqing Guo
- Computational Neuroscience Unit, Okinawa Institute of Science and Technology, Onna-son, Okinawa, Japan
| | - Mario Negrello
- Computational Neuroscience Unit, Okinawa Institute of Science and Technology, Onna-son, Okinawa, Japan
- Laboratory of Theoretical Neurobiology and Neuro-engineering, University of Antwerp, Wilrijk, Belgium
- Department of Neuroscience, Erasmus Medical Center, Rotterdam, the Netherlands
| | - Erik De Schutter
- Computational Neuroscience Unit, Okinawa Institute of Science and Technology, Onna-son, Okinawa, Japan
- Laboratory of Theoretical Neurobiology and Neuro-engineering, University of Antwerp, Wilrijk, Belgium
- * E-mail:
| |
Collapse
|
12
|
Luque NR, Garrido JA, Naveros F, Carrillo RR, D'Angelo E, Ros E. Distributed Cerebellar Motor Learning: A Spike-Timing-Dependent Plasticity Model. Front Comput Neurosci 2016; 10:17. [PMID: 26973504 PMCID: PMC4773604 DOI: 10.3389/fncom.2016.00017] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2015] [Accepted: 02/15/2016] [Indexed: 11/13/2022] Open
Abstract
Deep cerebellar nuclei neurons receive both inhibitory (GABAergic) synaptic currents from Purkinje cells (within the cerebellar cortex) and excitatory (glutamatergic) synaptic currents from mossy fibers. Those two deep cerebellar nucleus inputs are thought to be also adaptive, embedding interesting properties in the framework of accurate movements. We show that distributed spike-timing-dependent plasticity mechanisms (STDP) located at different cerebellar sites (parallel fibers to Purkinje cells, mossy fibers to deep cerebellar nucleus cells, and Purkinje cells to deep cerebellar nucleus cells) in close-loop simulations provide an explanation for the complex learning properties of the cerebellum in motor learning. Concretely, we propose a new mechanistic cerebellar spiking model. In this new model, deep cerebellar nuclei embed a dual functionality: deep cerebellar nuclei acting as a gain adaptation mechanism and as a facilitator for the slow memory consolidation at mossy fibers to deep cerebellar nucleus synapses. Equipping the cerebellum with excitatory (e-STDP) and inhibitory (i-STDP) mechanisms at deep cerebellar nuclei afferents allows the accommodation of synaptic memories that were formed at parallel fibers to Purkinje cells synapses and then transferred to mossy fibers to deep cerebellar nucleus synapses. These adaptive mechanisms also contribute to modulate the deep-cerebellar-nucleus-output firing rate (output gain modulation toward optimizing its working range).
Collapse
Affiliation(s)
- Niceto R Luque
- Department of Computer Architecture and Technology, Research Centre for Information and Communications Technologies of the University of Granada (CITIC-UGR) Granada, Spain
| | - Jesús A Garrido
- Department of Computer Architecture and Technology, Research Centre for Information and Communications Technologies of the University of Granada (CITIC-UGR) Granada, Spain
| | - Francisco Naveros
- Department of Computer Architecture and Technology, Research Centre for Information and Communications Technologies of the University of Granada (CITIC-UGR) Granada, Spain
| | - Richard R Carrillo
- Department of Computer Architecture and Technology, Research Centre for Information and Communications Technologies of the University of Granada (CITIC-UGR) Granada, Spain
| | - Egidio D'Angelo
- Brain Connectivity Center, Istituto di Ricovero e Cura a Carattere Scientifico, Istituto Neurologico Nazionale Casimiro MondinoPavia, Italy; Department of Brain and Behavioural Sciences, University of PaviaPavia, Italy
| | - Eduardo Ros
- Department of Computer Architecture and Technology, Research Centre for Information and Communications Technologies of the University of Granada (CITIC-UGR) Granada, Spain
| |
Collapse
|
13
|
Rössert C, Dean P, Porrill J. At the Edge of Chaos: How Cerebellar Granular Layer Network Dynamics Can Provide the Basis for Temporal Filters. PLoS Comput Biol 2015; 11:e1004515. [PMID: 26484859 PMCID: PMC4615637 DOI: 10.1371/journal.pcbi.1004515] [Citation(s) in RCA: 38] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2015] [Accepted: 08/24/2015] [Indexed: 02/01/2023] Open
Abstract
Models of the cerebellar microcircuit often assume that input signals from the mossy-fibers are expanded and recoded to provide a foundation from which the Purkinje cells can synthesize output filters to implement specific input-signal transformations. Details of this process are however unclear. While previous work has shown that recurrent granule cell inhibition could in principle generate a wide variety of random outputs suitable for coding signal onsets, the more general application for temporally varying signals has yet to be demonstrated. Here we show for the first time that using a mechanism very similar to reservoir computing enables random neuronal networks in the granule cell layer to provide the necessary signal separation and extension from which Purkinje cells could construct basis filters of various time-constants. The main requirement for this is that the network operates in a state of criticality close to the edge of random chaotic behavior. We further show that the lack of recurrent excitation in the granular layer as commonly required in traditional reservoir networks can be circumvented by considering other inherent granular layer features such as inverted input signals or mGluR2 inhibition of Golgi cells. Other properties that facilitate filter construction are direct mossy fiber excitation of Golgi cells, variability of synaptic weights or input signals and output-feedback via the nucleocortical pathway. Our findings are well supported by previous experimental and theoretical work and will help to bridge the gap between system-level models and detailed models of the granular layer network.
Collapse
Affiliation(s)
- Christian Rössert
- Department of Psychology, The University of Sheffield, Sheffield, United Kingdom
- * E-mail:
| | - Paul Dean
- Department of Psychology, The University of Sheffield, Sheffield, United Kingdom
| | - John Porrill
- Department of Psychology, The University of Sheffield, Sheffield, United Kingdom
| |
Collapse
|
14
|
Control of cerebellar granule cell output by sensory-evoked Golgi cell inhibition. Proc Natl Acad Sci U S A 2015; 112:13099-104. [PMID: 26432880 DOI: 10.1073/pnas.1510249112] [Citation(s) in RCA: 39] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022] Open
Abstract
Classical feed-forward inhibition involves an excitation-inhibition sequence that enhances the temporal precision of neuronal responses by narrowing the window for synaptic integration. In the input layer of the cerebellum, feed-forward inhibition is thought to preserve the temporal fidelity of granule cell spikes during mossy fiber stimulation. Although this classical feed-forward inhibitory circuit has been demonstrated in vitro, the extent to which inhibition shapes granule cell sensory responses in vivo remains unresolved. Here we combined whole-cell patch-clamp recordings in vivo and dynamic clamp recordings in vitro to directly assess the impact of Golgi cell inhibition on sensory information transmission in the granule cell layer of the cerebellum. We show that the majority of granule cells in Crus II of the cerebrocerebellum receive sensory-evoked phasic and spillover inhibition prior to mossy fiber excitation. This preceding inhibition reduces granule cell excitability and sensory-evoked spike precision, but enhances sensory response reproducibility across the granule cell population. Our findings suggest that neighboring granule cells and Golgi cells can receive segregated and functionally distinct mossy fiber inputs, enabling Golgi cells to regulate the size and reproducibility of sensory responses.
Collapse
|
15
|
Luque NR, Garrido JA, Carrillo RR, D'Angelo E, Ros E. Fast convergence of learning requires plasticity between inferior olive and deep cerebellar nuclei in a manipulation task: a closed-loop robotic simulation. Front Comput Neurosci 2014; 8:97. [PMID: 25177290 PMCID: PMC4133770 DOI: 10.3389/fncom.2014.00097] [Citation(s) in RCA: 32] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2014] [Accepted: 07/25/2014] [Indexed: 01/13/2023] Open
Abstract
The cerebellum is known to play a critical role in learning relevant patterns of activity for adaptive motor control, but the underlying network mechanisms are only partly understood. The classical long-term synaptic plasticity between parallel fibers (PFs) and Purkinje cells (PCs), which is driven by the inferior olive (IO), can only account for limited aspects of learning. Recently, the role of additional forms of plasticity in the granular layer, molecular layer and deep cerebellar nuclei (DCN) has been considered. In particular, learning at DCN synapses allows for generalization, but convergence to a stable state requires hundreds of repetitions. In this paper we have explored the putative role of the IO-DCN connection by endowing it with adaptable weights and exploring its implications in a closed-loop robotic manipulation task. Our results show that IO-DCN plasticity accelerates convergence of learning by up to two orders of magnitude without conflicting with the generalization properties conferred by DCN plasticity. Thus, this model suggests that multiple distributed learning mechanisms provide a key for explaining the complex properties of procedural learning and open up new experimental questions for synaptic plasticity in the cerebellar network.
Collapse
Affiliation(s)
- Niceto R Luque
- Department of Computer Architecture and Technology, University of Granada (CITIC) Granada, Spain
| | - Jesús A Garrido
- Consorzio Interuniversitario per le Scienze Fisiche della Materia (CNISM) Pavia, Italy ; Neurophysiology Unit, Department of Brain and Behavioral Sciences, University of Pavia Pavia, Italy
| | - Richard R Carrillo
- Department of Computer Architecture and Technology, University of Granada (CITIC) Granada, Spain
| | - Egidio D'Angelo
- Neurophysiology Unit, Department of Brain and Behavioral Sciences, University of Pavia Pavia, Italy ; Brain Connectivity Center, C. Mondino National Neurological Institute Pavia, Italy
| | - Eduardo Ros
- Department of Computer Architecture and Technology, University of Granada (CITIC) Granada, Spain
| |
Collapse
|
16
|
Yamaguchi K, Sakurai Y. Spike-Coding Mechanisms of Cerebellar Temporal Processing in Classical Conditioning and Voluntary Movements. THE CEREBELLUM 2014; 13:651-8. [DOI: 10.1007/s12311-014-0580-5] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
17
|
Yamaguchi K, Sakurai Y. Novel behavioral tasks to explore cerebellar temporal processing in milliseconds in rats. Behav Brain Res 2014; 263:138-43. [DOI: 10.1016/j.bbr.2014.01.030] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2013] [Revised: 01/18/2014] [Accepted: 01/21/2014] [Indexed: 10/25/2022]
|
18
|
Maex R, Steuber V. An integrator circuit in cerebellar cortex. Eur J Neurosci 2013; 38:2917-32. [PMID: 23731348 DOI: 10.1111/ejn.12272] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2012] [Revised: 04/24/2013] [Accepted: 05/06/2013] [Indexed: 11/27/2022]
Abstract
The brain builds dynamic models of the body and the outside world to predict the consequences of actions and stimuli. A well-known example is the oculomotor integrator, which anticipates the position-dependent elasticity forces acting on the eye ball by mathematically integrating over time oculomotor velocity commands. Many models of neural integration have been proposed, based on feedback excitation, lateral inhibition or intrinsic neuronal nonlinearities. We report here that a computational model of the cerebellar cortex, a structure thought to implement dynamic models, reveals a hitherto unrecognized integrator circuit. In this model, comprising Purkinje cells, molecular layer interneurons and parallel fibres, Purkinje cells were able to generate responses lasting more than 10 s, to which both neuronal and network mechanisms contributed. Activation of the somatic fast sodium current by subthreshold voltage fluctuations was able to maintain pulse-evoked graded persistent activity, whereas lateral inhibition among Purkinje cells via recurrent axon collaterals further prolonged the responses to step and sine wave stimulation. The responses of Purkinje cells decayed with a time-constant whose value depended on their baseline spike rate, with integration vanishing at low (< 1 per s) and high rates (> 30 per s). The model predicts that the apparently fast circuit of the cerebellar cortex may control the timing of slow processes without having to rely on sensory feedback. Thus, the cerebellar cortex may contain an adaptive temporal integrator, with the sensitivity of integration to the baseline spike rate offering a potential mechanism of plasticity of the response time-constant.
Collapse
Affiliation(s)
- Reinoud Maex
- Science and Technology Research Institute, University of Hertfordshire, College Lane, Hatfield, AL10 9AB, UK
| | | |
Collapse
|
19
|
Yamazaki T, Igarashi J. Realtime cerebellum: a large-scale spiking network model of the cerebellum that runs in realtime using a graphics processing unit. Neural Netw 2013; 47:103-11. [PMID: 23434303 DOI: 10.1016/j.neunet.2013.01.019] [Citation(s) in RCA: 59] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2012] [Revised: 01/24/2013] [Accepted: 01/25/2013] [Indexed: 11/29/2022]
Abstract
The cerebellum plays an essential role in adaptive motor control. Once we are able to build a cerebellar model that runs in realtime, which means that a computer simulation of 1 s in the simulated world completes within 1 s in the real world, the cerebellar model could be used as a realtime adaptive neural controller for physical hardware such as humanoid robots. In this paper, we introduce "Realtime Cerebellum (RC)", a new implementation of our large-scale spiking network model of the cerebellum, which was originally built to study cerebellar mechanisms for simultaneous gain and timing control and acted as a general-purpose supervised learning machine of spatiotemporal information known as reservoir computing, on a graphics processing unit (GPU). Owing to the massive parallel computing capability of a GPU, RC runs in realtime, while reproducing qualitatively the same simulation results of the Pavlovian delay eyeblink conditioning with the previous version. RC is adopted as a realtime adaptive controller of a humanoid robot, which is instructed to learn a proper timing to swing a bat to hit a flying ball online. These results suggest that RC provides a means to apply the computational power of the cerebellum as a versatile supervised learning machine towards engineering applications.
Collapse
Affiliation(s)
- Tadashi Yamazaki
- RIKEN Brain Science Institute, 2-1 Hirosawa, Wako, Saitama 351-0198, Japan.
| | | |
Collapse
|
20
|
An internal model architecture for novelty detection: implications for cerebellar and collicular roles in sensory processing. PLoS One 2012; 7:e44560. [PMID: 22957083 PMCID: PMC3434152 DOI: 10.1371/journal.pone.0044560] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2012] [Accepted: 08/06/2012] [Indexed: 11/20/2022] Open
Abstract
The cerebellum is thought to implement internal models for sensory prediction, but details of the underlying circuitry are currently obscure. We therefore investigated a specific example of internal-model based sensory prediction, namely detection of whisker contacts during whisking. Inputs from the vibrissae in rats can be affected by signals generated by whisker movement, a phenomenon also observable in whisking robots. Robot novelty-detection can be improved by adaptive noise-cancellation, in which an adaptive filter learns a forward model of the whisker plant that allows the sensory effects of whisking to be predicted and thus subtracted from the noisy sensory input. However, the forward model only uses information from an efference copy of the whisking commands. Here we show that the addition of sensory information from the whiskers allows the adaptive filter to learn a more complex internal model that performs more robustly than the forward model, particularly when the whisking-induced interference has a periodic structure. We then propose a neural equivalent of the circuitry required for adaptive novelty-detection in the robot, in which the role of the adaptive filter is carried out by the cerebellum, with the comparison of its output (an estimate of the self-induced interference) and the original vibrissal signal occurring in the superior colliculus, a structure noted for its central role in novelty detection. This proposal makes a specific prediction concerning the whisker-related functions of a region in cerebellar cortical zone A2 that in rats receives climbing fibre input from the superior colliculus (via the inferior olive). This region has not been observed in non-whisking animals such as cats and primates, and its functional role in vibrissal processing has hitherto remained mysterious. Further investigation of this system may throw light on how cerebellar-based internal models could be used in broader sensory, motor and cognitive contexts.
Collapse
|
21
|
A computational mechanism for unified gain and timing control in the cerebellum. PLoS One 2012; 7:e33319. [PMID: 22438912 PMCID: PMC3305129 DOI: 10.1371/journal.pone.0033319] [Citation(s) in RCA: 42] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2011] [Accepted: 02/07/2012] [Indexed: 11/29/2022] Open
Abstract
Precise gain and timing control is the goal of cerebellar motor learning. Because the basic neural circuitry of the cerebellum is homogeneous throughout the cerebellar cortex, a single computational mechanism may be used for simultaneous gain and timing control. Although many computational models of the cerebellum have been proposed for either gain or timing control, few models have aimed to unify them. In this paper, we hypothesize that gain and timing control can be unified by learning of the complete waveform of the desired movement profile instructed by climbing fiber signals. To justify our hypothesis, we adopted a large-scale spiking network model of the cerebellum, which was originally developed for cerebellar timing mechanisms to explain the experimental data of Pavlovian delay eyeblink conditioning, to the gain adaptation of optokinetic response (OKR) eye movements. By conducting large-scale computer simulations, we could reproduce some features of OKR adaptation, such as the learning-related change of simple spike firing of model Purkinje cells and vestibular nuclear neurons, simulated gain increase, and frequency-dependent gain increase. These results suggest that the cerebellum may use a single computational mechanism to control gain and timing simultaneously.
Collapse
|