SPANNER: A Self-Repairing Spiking Neural Network Hardware Architecture

Astrocyte's self-repairing characteristics improve working memory in spiking neuronal networks

Astrocytes play a significant role in the working memory (WM) mechanism, yet their contribution to spiking neuron-astrocyte networks (SNAN) is underexplored. This study proposes a non-probabilistic SNAN incorporating a self-repairing (SR) mechanism through endocannabinoid pathways to facilitate WM function. Four experiments were conducted with different damaging patterns, replicating close-to-realistic synaptic impairments. Simulation results suggest that the SR process enhances WM performance by improving the consistency of neuronal firing. Moreover, the intercellular astrocytic [Ca]2+ transmission via gap junctions improves WM and SR processes. With increasing damage, WM and SR activities initially fail for non-matched samples and then for smaller and minimally overlapping matched samples. Simulation results also indicate that the inclusion of the SR mechanism in both random and continuous forms of damage improves the resilience of the WM by approximately 20%. This study highlights the importance of astrocytes in synaptically impaired networks.

Tracking Control of Self-Restructuring Systems: A Low-Complexity Neuroadaptive PID Approach With Guaranteed Performance

This article investigates the tracking control problem for a class of self-restructuring systems. Different from existing studies on systems with fixed structure, this work focuses on systems with varying structures, arising from, for instance, biological self-developing, unconsciously switching, or unexpected subsystem failure. As the resultant dynamic model is complicated and uncertain, any model-based control is too costly and seldom practical. Here, we explore a nonmodel-based low-complexity proportional-integral-derivative (PID) control. Unlike traditional PID with fixed gains, the proposed one is embedded with neural-network (NN)-based self-tuning adaptive gains, where the tuning strategy is analytically built upon system stability and performance specifications, such that transient behavior and steady-state performance are ensured. Both square and nonsquare systems are addressed by using the matrix decomposition technique. The benefits and feasibility of the proposed control method are also validated and confirmed by the simulations.

Embedded Real-Time Implementation of Bio-Inspired Central Pattern Generator with Self-Repairing Function

Both robustness and self-repairing of the rhythmic behaviors generated by central pattern generators (CPGs) play significant roles in locomotion control. Although current CPG models have been established to mimic rhythmic outputs, the mechanisms by which the self-repairing capacities of CPG systems are formed are largely unknown. In this paper, a novel bio-inspired self-repairing CPG model (BiSRP-CPG) is proposed based on the tripartite synapse, which reveals the critical role of astrocytes in the dynamic coordination of CPGs. BiSRP-CPG is implemented on the parallel FPGA platform to simulate CPG systems on real physiological scale, in which a hardware implementation method without multiplier is utilized to break the limitation of FPGA hardware resources. The experimental results verified both the robustness and self-repairing capabilities of rhythm of BiSRP-CPG in the presence of stochastic synaptic inputs and “faulty” synapse. Under the synaptic failure rate of 20%, BiSRP-CPG suffered only 10.53% performance degradation, which was much lower than the 36.84% spike loss rate of CPG networks without astrocytes. This paper provides an insight into one of the possible self-repair mechanisms of brain rhythms which can be utilized to develop autonomously fault-tolerant electronic systems.

Bio-Inspired Autonomous Learning Algorithm With Application to Mobile Robot Obstacle Avoidance

Spiking Neural Networks (SNNs) are often considered the third generation of Artificial Neural Networks (ANNs), owing to their high information processing capability and the accurate simulation of biological neural network behaviors. Though the research for SNNs has been quite active in recent years, there are still some challenges to applying SNNs to various potential applications, especially for robot control. In this study, a biologically inspired autonomous learning algorithm based on reward modulated spike-timing-dependent plasticity is proposed, where a novel rewarding generation mechanism is used to generate the reward signals for both learning and decision-making processes. The proposed learning algorithm is evaluated by a mobile robot obstacle avoidance task and experimental results show that the mobile robot with the proposed algorithm exhibits a good learning ability. The robot can successfully avoid obstacles in the environment after some learning trials. This provides an alternative method to design and apply the bio-inspired robot with autonomous learning capability in the typical robotic task scenario.

Memristive Circuit Implementation of a Self-Repairing Network Based on Biological Astrocytes in Robot Application

A large number of studies have shown that astrocytes can be combined with the presynaptic terminals and postsynaptic spines of neurons to constitute a triple synapse via an endocannabinoid retrograde messenger to achieve a self-repair ability in the human brain. Inspired by the biological self-repair mechanism of astrocytes, this work proposes a self-repairing neuron network circuit that utilizes a memristor to simulate changes in neurotransmitters when a set threshold is reached. The proposed circuit simulates an astrocyte-neuron network and comprises the following: 1) a single-astrocyte-neuron circuit module; 2) an astrocyte-neuron network circuit; 3) a module to detect malfunctions; and 4) a neuron PR (release probability of synaptic transmission) enhancement module. When faults occur in a synapse, the neuron module becomes silent or near silent because of the low PR of the synapses. The circuit can detect faults automatically. The damaged neuron can be repaired by enhancing the PR of other healthy neurons, analogous to the biological repair mechanism of astrocytes. This mechanism helps to repair the damaged circuit. A simulation of the circuit revealed the following: 1) as the number of neurons in the circuit increases, the self-repair ability strengthens and 2) as the number of damaged neurons in the astrocyte-neuron network increases, the self-repair ability weakens, and there is a significant degradation in the performance of the circuit. The self-repairing circuit was used for a robot, and it effectively improved the robots' performance and reliability.

On the Self-Repair Role of Astrocytes in STDP Enabled Unsupervised SNNs

Neuromorphic computing is emerging to be a disruptive computational paradigm that attempts to emulate various facets of the underlying structure and functionalities of the brain in the algorithm and hardware design of next-generation machine learning platforms. This work goes beyond the focus of current neuromorphic computing architectures on computational models for neuron and synapse to examine other computational units of the biological brain that might contribute to cognition and especially self-repair. We draw inspiration and insights from computational neuroscience regarding functionalities of glial cells and explore their role in the fault-tolerant capacity of Spiking Neural Networks (SNNs) trained in an unsupervised fashion using Spike-Timing Dependent Plasticity (STDP). We characterize the degree of self-repair that can be enabled in such networks with varying degree of faults ranging from 50 to 90% and evaluate our proposal on the MNIST and Fashion-MNIST datasets.

A Neuromorphic Digital Circuit for Neuronal Information Encoding Using Astrocytic Calcium Oscillations

Neurophysiological observations are clarifying how astrocytes can actively participate in information processing and how they can encode information through frequency and amplitude modulation of intracellular Ca²⁺ signals. Consequently, hardware realization of astrocytes is important for developing the next generation of bio-inspired computing systems. In this paper, astrocytic calcium oscillations and neuronal firing dynamics are presented by De Pittà and IF (Integrated & Fire) models, respectively. Considering highly nonlinear equations of the astrocyte model, linear approximation and single constant multiplication (SCM) techniques are employed for efficient hardware execution while maintaining the dynamic of the original models. This low-cost hardware architecture for the astrocyte model is able to show the essential features of different types of Ca²⁺ modulation such as amplitude modulation (AM), frequency modulation (FM), or both modes (AFM). To show good agreement between the results of original models simulated in MATLAB and the proposed digital circuits executed on FPGA, quantitative, and qualitative analyses including phase plane are done. This new neuromorphic circuit of astrocyte is able to successfully demonstrate AM/FM/AFM calcium signaling in its real operation on FPGA and has applications in self-repairing systems. It also can be employed as a subsystem for linking biological cells to artificial neuronal networks using astrocytic calcium oscillations in future research.

GABA Regulation of Burst Firing in Hippocampal Astrocyte Neural Circuit: A Biophysical Model

It is now widely accepted that glia cells and gamma-aminobutyric acidergic (GABA) interneurons dynamically regulate synaptic transmission and neuronal activity in time and space. This paper presents a biophysical model that captures the interaction between an astrocyte cell, a GABA interneuron and pre/postsynaptic neurons. Specifically, GABA released from a GABA interneuron triggers in astrocytes the release of calcium (Ca²⁺) from the endoplasmic reticulum via the inositol 1, 4, 5-trisphosphate (IP₃) pathway. This results in gliotransmission which elevates the presynaptic transmission probability rate (PR) causing weight potentiation and a gradual increase in postsynaptic neuronal firing, that eventually stabilizes. However, by capturing the complex interactions between IP₃, generated from both GABA and the 2-arachidonyl glycerol (2-AG) pathway, and PR, this paper shows that this interaction not only gives rise to an initial weight potentiation phase but also this phase is followed by postsynaptic bursting behavior. Moreover, the model will show that there is a presynaptic frequency range over which burst firing can occur. The proposed model offers a novel cellular level mechanism that may underpin both seizure-like activity and neuronal synchrony across different brain regions.

Exploring Self-Repair in a Coupled Spiking Astrocyte Neural Network

It is now known that astrocytes modulate the activity at the tripartite synapses where indirect signaling via the retrograde messengers, endocannabinoids, leads to a localized self-repairing capability. In this paper, a self-repairing spiking astrocyte neural network (SANN) is proposed to demonstrate a distributed self-repairing capability at the network level. The SANN uses a novel learning rule that combines the spike-timing-dependent plasticity (STDP) and Bienenstock, Cooper, and Munro (BCM) learning rules (hereafter referred to as the BSTDP rule). In this learning rule, the synaptic weight potentiation is not only driven by the temporal difference between the presynaptic and postsynaptic neuron firing times but also by the postsynaptic neuron activity. We will show in this paper that the BSTDP modulates the height of the plasticity window to establish an input-output mapping (in the learning phase) and also maintains this mapping (via self-repair) if synaptic pathways become dysfunctional. It is the functional dependence of postsynaptic neuron firing activity on the height of the plasticity window that underpins how the proposed SANN self-repairs on the fly. The SANN also uses the coupling between the tripartite synapses and γ -GABAergic interneurons. This interaction gives rise to a presynaptic neuron frequency filtering capability that serves to route information, represented as spike trains, to different neurons in the subsequent layers of the SANN. The proposed SANN follows a feedforward architecture with multiple interneuron pathways and astrocytes modulate synaptic activity at the hidden and output neuronal layers. The self-repairing capability will be demonstrated in a robotic obstacle avoidance application, and the simulation results will show that the SANN can maintain learned maneuvers at synaptic fault densities of up to 80% regardless of the fault locations.

Computational Models for Calcium-Mediated Astrocyte Functions

The computational neuroscience field has heavily concentrated on the modeling of neuronal functions, largely ignoring other brain cells, including one type of glial cell, the astrocytes. Despite the short history of modeling astrocytic functions, we were delighted about the hundreds of models developed so far to study the role of astrocytes, most often in calcium dynamics, synchronization, information transfer, and plasticity in vitro, but also in vascular events, hyperexcitability, and homeostasis. Our goal here is to present the state-of-the-art in computational modeling of astrocytes in order to facilitate better understanding of the functions and dynamics of astrocytes in the brain. Due to the large number of models, we concentrated on a hundred models that include biophysical descriptions for calcium signaling and dynamics in astrocytes. We categorized the models into four groups: single astrocyte models, astrocyte network models, neuron-astrocyte synapse models, and neuron-astrocyte network models to ease their use in future modeling projects. We characterized the models based on which earlier models were used for building the models and which type of biological entities were described in the astrocyte models. Features of the models were compared and contrasted so that similarities and differences were more readily apparent. We discovered that most of the models were basically generated from a small set of previously published models with small variations. However, neither citations to all the previous models with similar core structure nor explanations of what was built on top of the previous models were provided, which made it possible, in some cases, to have the same models published several times without an explicit intention to make new predictions about the roles of astrocytes in brain functions. Furthermore, only a few of the models are available online which makes it difficult to reproduce the simulation results and further develop the models. Thus, we would like to emphasize that only via reproducible research are we able to build better computational models for astrocytes, which truly advance science. Our study is the first to characterize in detail the biophysical and biochemical mechanisms that have been modeled for astrocytes.