A Computational Model of Interactions Between Neuronal and Astrocytic Networks: The Role of Astrocytes in the Stability of the Neuronal Firing Rate

Astrocytes as a mechanism for contextually-guided network dynamics and function

Astrocytes are a ubiquitous and enigmatic type of non-neuronal cell and are found in the brain of all vertebrates. While traditionally viewed as being supportive of neurons, it is increasingly recognized that astrocytes play a more direct and active role in brain function and neural computation. On account of their sensitivity to a host of physiological covariates and ability to modulate neuronal activity and connectivity on slower time scales, astrocytes may be particularly well poised to modulate the dynamics of neural circuits in functionally salient ways. In the current paper, we seek to capture these features via actionable abstractions within computational models of neuron-astrocyte interaction. Specifically, we engage how nested feedback loops of neuron-astrocyte interaction, acting over separated time-scales, may endow astrocytes with the capability to enable learning in context-dependent settings, where fluctuations in task parameters may occur much more slowly than within-task requirements. We pose a general model of neuron-synapse-astrocyte interaction and use formal analysis to characterize how astrocytic modulation may constitute a form of meta-plasticity, altering the ways in which synapses and neurons adapt as a function of time. We then embed this model in a bandit-based reinforcement learning task environment, and show how the presence of time-scale separated astrocytic modulation enables learning over multiple fluctuating contexts. Indeed, these networks learn far more reliably compared to dynamically homogeneous networks and conventional non-network-based bandit algorithms. Our results fuel the notion that neuron-astrocyte interactions in the brain benefit learning over different time-scales and the conveyance of task-relevant contextual information onto circuit dynamics.

Machine learning approach for recognition and morphological analysis of isolated astrocytes in phase contrast microscopy

Astrocytes are glycolytically active cells in the central nervous system playing a crucial role in various brain processes from homeostasis to neurotransmission. Astrocytes possess a complex branched morphology, frequently examined by fluorescent microscopy. However, staining and fixation may impact the properties of astrocytes, thereby affecting the accuracy of the experimental data of astrocytes dynamics and morphology. On the other hand, phase contrast microscopy can be used to study astrocytes morphology without affecting them, but the post-processing of the resulting low-contrast images is challenging. The main result of this work is a novel approach for recognition and morphological analysis of unstained astrocytes based on machine-learning recognition of microscopic images. We conducted a series of experiments involving the cultivation of isolated astrocytes from the rat brain cortex followed by microscopy. Using the proposed approach, we tracked the temporal evolution of the average total length of branches, branching, and area per astrocyte in our experiments. We believe that the proposed approach and the obtained experimental data will be of interest and benefit to the scientific communities in cell biology, biophysics, and machine learning.

Astrocytes: new evidence, new models, new roles

Astrocytes have been in the limelight of active research for about 3 decades now. Over this period, ideas about their function and role in the nervous system have evolved from simple assistance in energy supply and homeostasis maintenance to a complex informational and metabolic hub that integrates data on local neuronal activity, sensory and arousal context, and orchestrates many crucial processes in the brain. Rapid progress in experimental techniques and data analysis produces a growing body of data, which can be used as a foundation for formulation of new hypotheses, building new refined mathematical models, and ultimately should lead to a new level of understanding of the contribution of astrocytes to the cognitive tasks performed by the brain. Here, we highlight recent progress in astrocyte research, which we believe expands our understanding of how low-level signaling at a cellular level builds up to processes at the level of the whole brain and animal behavior. We start our review with revisiting data on the role of noradrenaline-mediated astrocytic signaling in locomotion, arousal, sensory integration, memory, and sleep. We then briefly review astrocyte contribution to the regulation of cerebral blood flow regulation, which is followed by a discussion of biophysical mechanisms underlying astrocyte effects on different brain processes. The experimental section is closed by an overview of recent experimental techniques available for modulation and visualization of astrocyte dynamics. We then evaluate how the new data can be potentially incorporated into the new mathematical models or where and how it already has been done. Finally, we discuss an interesting prospect that astrocytes may be key players in important processes such as the switching between sleep and wakefulness and the removal of toxic metabolites from the brain milieu.

Parameter Inference for an Astrocyte Model using Machine Learning Approaches

Astrocytes are the largest subset of glial cells and perform structural, metabolic, and regulatory functions. They are directly involved in the communication at neuronal synapses and the maintenance of brain homeostasis. Several disorders, such as Alzheimer's, epilepsy, and schizophrenia, have been associated with astrocyte dysfunction. Computational models on various spatial levels have been proposed to aid in the understanding and research of astrocytes. The difficulty of computational astrocyte models is to fastly and precisely infer parameters. Physics informed neural networks (PINNs) use the underlying physics to infer parameters and, if necessary, dynamics that can not be observed. We have applied PINNs to estimate parameters for a computational model of an astrocytic compartment. The addition of two techniques helped with the gradient pathologies of the PINNS, the dynamic weighting of various loss components and the addition of Transformers. To overcome the issue that the neural network only learned the time dependence but did not know about eventual changes of the input stimulation to the astrocyte model, we followed an adaptation of PINNs from control theory (PINCs). In the end, we were able to infer parameters from artificial, noisy data, with stable results for the computational astrocyte model.

Information Encoding in Bursting Spiking Neural Network Modulated by Astrocytes

We investigated a mathematical model composed of a spiking neural network (SNN) interacting with astrocytes. We analysed how information content in the form of two-dimensional images can be represented by an SNN in the form of a spatiotemporal spiking pattern. The SNN includes excitatory and inhibitory neurons in some proportion, sustaining the excitation-inhibition balance of autonomous firing. The astrocytes accompanying each excitatory synapse provide a slow modulation of synaptic transmission strength. An information image was uploaded to the network in the form of excitatory stimulation pulses distributed in time reproducing the shape of the image. We found that astrocytic modulation prevented stimulation-induced SNN hyperexcitation and non-periodic bursting activity. Such homeostatic astrocytic regulation of neuronal activity makes it possible to restore the image supplied during stimulation and lost in the raster diagram of neuronal activity due to non-periodic neuronal firing. At a biological point, our model shows that astrocytes can act as an additional adaptive mechanism for regulating neural activity, which is crucial for sensory cortical representations.

Analysis of Network Models with Neuron-Astrocyte Interactions

Neural networks, composed of many neurons and governed by complex interactions between them, are a widely accepted formalism for modeling and exploring global dynamics and emergent properties in brain systems. In the past decades, experimental evidence of computationally relevant neuron-astrocyte interactions, as well as the astrocytic modulation of global neural dynamics, have accumulated. These findings motivated advances in computational glioscience and inspired several models integrating mechanisms of neuron-astrocyte interactions into the standard neural network formalism. These models were developed to study, for example, synchronization, information transfer, synaptic plasticity, and hyperexcitability, as well as classification tasks and hardware implementations. We here focus on network models of at least two neurons interacting bidirectionally with at least two astrocytes that include explicitly modeled astrocytic calcium dynamics. In this study, we analyze the evolution of these models and the biophysical, biochemical, cellular, and network mechanisms used to construct them. Based on our analysis, we propose how to systematically describe and categorize interaction schemes between cells in neuron-astrocyte networks. We additionally study the models in view of the existing experimental data and present future perspectives. Our analysis is an important first step towards understanding astrocytic contribution to brain functions. However, more advances are needed to collect comprehensive data about astrocyte morphology and physiology in vivo and to better integrate them in data-driven computational models. Broadening the discussion about theoretical approaches and expanding the computational tools is necessary to better understand astrocytes' roles in brain functions.

Enhancement of astrocytic gap junctions Connexin43 coupling can improve long-term isoflurane anesthesia-mediated brain network abnormalities and cognitive impairment

AIM

Astrocytes are connected by gap junctions Connexin43 (GJs-Cx43) forming an extensive intercellular network and maintain brain homeostasis. Perioperative neurocognitive disorder (PND) occurs frequently after anesthesia/surgery and worsens patient outcome, but the neural circuit mechanisms remain unclear. This study aimed to determine the effects of the GJs-Cx43-mediated astrocytic network on PND and ascertain the underlying neural circuit mechanism.

METHODS

Male C57BL/6 mice were treated with long-term isoflurane exposure to construct a mouse model of PND. We also exposed primary mouse astrocytes to long-term isoflurane exposure to simulate the conditions of in vivo cognitive dysfunction. Behavioral tests were performed using the Y-maze and fear conditioning (FC) tests. Manganese-enhanced magnetic resonance imaging (MEMRI) and resting-state functional magnetic resonance imaging (rs-fMRI) were used to investigate brain activity and functional connectivity. Western blot and flow cytometry analysis were used to assess protein expression.

RESULTS

Reconfiguring the astrocytic network by increasing GJs-Cx43 expression can modulate 22 subregions affected by PND in three ways: reversed activation, reversed inhibition, and intensified activation. The brain functional connectivity analysis further suggests that PND is a brain network disorder that includes sleep-wake rhythm-related brain regions, contextual and fear memory-related subregions, the hippocampal-amygdala circuit, the septo-hippocampal circuit, and the entorhinal-hippocampal circuit. Notably, remodeling the astrocytic network by upregulation of GJs-Cx43 can partially reverse the abnormalities in the above circuits. Pathophysiological degeneration in hippocampus is one of the primary hallmarks of PND pathology, and long-term isoflurane anesthesia contributes to oxidative stress and neuroinflammation in the hippocampus. However, promoting the formation of GJs-Cx43 ameliorated cognitive dysfunction induced by long-term isoflurane anesthesia through the attenuation of oxidative stress in hippocampus.

CONCLUSION

Enhancing GJs-Cx43 coupling can improve brain network abnormalities and cognitive impairment induced by long-term isoflurane anesthesia, its mechanisms might be associated with the regulation of oxidative stress and neuroinflammation.

Controlling synchronization of gamma oscillations by astrocytic modulation in a model hippocampal neural network

Recent in vitro and in vivo experiments demonstrate that astrocytes participate in the maintenance of cortical gamma oscillations and recognition memory. However, the mathematical understanding of the underlying dynamical mechanisms remains largely incomplete. Here we investigate how the interplay of slow modulatory astrocytic signaling with fast synaptic transmission controls coherent oscillations in the network of hippocampal interneurons that receive inputs from pyramidal cells. We show that the astrocytic regulation of signal transmission between neurons improves the firing synchrony and extends the region of coherent oscillations in the biologically relevant values of synaptic conductance. Astrocyte-mediated potentiation of inhibitory synaptic transmission markedly enhances the coherence of network oscillations over a broad range of model parameters. Astrocytic regulation of excitatory synaptic input improves the robustness of interneuron network gamma oscillations induced by physiologically relevant excitatory model drive. These findings suggest a mechanism, by which the astrocytes become involved in cognitive function and information processing through modulating fast neural network dynamics.

Physiological Electric Field: A Potential Construction Regulator of Human Brain Organoids

Brain organoids can reproduce the regional three-dimensional (3D) tissue structure of human brains, following the in vivo developmental trajectory at the cellular level; therefore, they are considered to present one of the best brain simulation model systems. By briefly summarizing the latest research concerning brain organoid construction methods, the basic principles, and challenges, this review intends to identify the potential role of the physiological electric field (EF) in the construction of brain organoids because of its important regulatory function in neurogenesis. EFs could initiate neural tissue formation, inducing the neuronal differentiation of NSCs, both of which capabilities make it an important element of the in vitro construction of brain organoids. More importantly, by adjusting the stimulation protocol and special/temporal distributions of EFs, neural organoids might be created following a predesigned 3D framework, particularly a specific neural network, because this promotes the orderly growth of neural processes, coordinate neuronal migration and maturation, and stimulate synapse and myelin sheath formation. Thus, the application of EF for constructing brain organoids in a3D matrix could be a promising future direction in neural tissue engineering.

Sharpening Working Memory With Real-Time Electrophysiological Brain Signals: Which Neurofeedback Paradigms Work?

Growing evidence supports the idea that the ultimate biofeedback is to reward sensory pleasure (e.g., enhanced visual clarity) in real-time to neural circuits that are associated with a desired performance, such as excellent memory retrieval. Neurofeedback is biofeedback that uses real-time sensory reward to brain activity associated with a certain performance (e.g., accurate and fast recall). Working memory is a key component of human intelligence. The challenges are in our current limited understanding of neurocognitive dysfunctions as well as in technical difficulties for closed-loop feedback in true real-time. Here we review recent advancements of real time neurofeedback to improve memory training in healthy young and older adults. With new advancements in neuromarkers of specific neurophysiological functions, neurofeedback training should be better targeted beyond a single frequency approach to include frequency interactions and event-related potentials. Our review confirms the positive trend that neurofeedback training mostly works to improve memory and cognition to some extent in most studies. Yet, the training typically takes multiple weeks with 2-3 sessions per week. We review various neurofeedback reward strategies and outcome measures. A well-known issue in such training is that some people simply do not respond to neurofeedback. Thus, we also review the literature of individual differences in psychological factors e.g., placebo effects and so-called "BCI illiteracy" (Brain Computer Interface illiteracy). We recommend the use of Neural modulation sensitivity or BCI insensitivity in the neurofeedback literature. Future directions include much needed research in mild cognitive impairment, in non-Alzheimer's dementia populations, and neurofeedback using EEG features during resting and sleep for memory enhancement and as sensitive outcome measures.

Neuronal and Astrocytic Regulations in Schizophrenia: A Computational Modelling Study

According to the tripartite synapse model, astrocytes have a modulatory effect on neuronal signal transmission. More recently, astrocyte malfunction has been associated with psychiatric diseases such as schizophrenia. Several hypotheses have been proposed on the pathological mechanisms of astrocytes in schizophrenia. For example, post-mortem examinations have revealed a reduced astrocytic density in patients with schizophrenia. Another hypothesis suggests that disease symptoms are linked to an abnormality of glutamate transmission, which is also regulated by astrocytes (glutamate hypothesis of schizophrenia). Electrophysiological findings indicate a dispute over whether the disorder causes an increase or a decrease in neuronal and astrocytic activity. Moreover, there is no consensus as to which molecular pathways and network mechanisms are altered in schizophrenia. Computational models can aid the process in finding the underlying pathological malfunctions. The effect of astrocytes on the activity of neuron-astrocyte networks has been analysed with computational models. These can reproduce experimentally observed phenomena, such as astrocytic modulation of spike and burst signalling in neuron-astrocyte networks. Using an established computational neuron-astrocyte network model, we simulate experimental data of healthy and pathological networks by using different neuronal and astrocytic parameter configurations. In our simulations, the reduction of neuronal or astrocytic cell densities yields decreased glutamate levels and a statistically significant reduction in the network activity. Amplifications of the astrocytic ATP release toward postsynaptic terminals also reduced the network activity and resulted in temporarily increased glutamate levels. In contrast, reducing either the glutamate release or re-uptake in astrocytes resulted in higher network activities. Similarly, an increase in synaptic weights of excitatory or inhibitory neurons raises the excitability of individual cells and elevates the activation level of the network. To conclude, our simulations suggest that the impairment of both neurons and astrocytes disturbs the neuronal network activity in schizophrenia.

A Computational Study on Synaptic Plasticity Regulation and Information Processing in Neuron-Astrocyte Networks

Postsynaptic ionotropic receptors critically shape synaptic currents and underpin their activity-dependent plasticity. In recent years, regulation of expression of these receptors by slow inward and outward currents mediated by gliotransmitter release from astrocytes has come under scrutiny as a potentially important mechanism for the regulation of synaptic information transfer. In this study, we consider a model of astrocyte-regulated synapses to investigate this hypothesis at the level of layered networks of interacting neurons and astrocytes. Our simulations hint that gliotransmission sustains the transfer function across layers, although it decorrelates the neuronal activity from the signal pattern. Overall, our results make clear how astrocytes could transform neuronal activity by inducing a lowfrequency modulation of postsynaptic activity.

A common role for astrocytes in rhythmic behaviours?

Astrocytes are a functionally diverse form of glial cell involved in various aspects of nervous system infrastructure, from the metabolic and structural support of neurons to direct neuromodulation of synaptic activity. Investigating how astrocytes behave in functionally related circuits may help us understand whether there is any conserved logic to the role of astrocytes within neuronal networks. Astrocytes are implicated as key neuromodulatory cells within neural circuits that control a number of rhythmic behaviours such as breathing, locomotion and circadian sleep-wake cycles. In this review, we examine the evidence that astrocytes are directly involved in the regulation of the neural circuits underlying six different rhythmic behaviours: locomotion, breathing, chewing, gastrointestinal motility, circadian sleep-wake cycles and oscillatory feeding behaviour. We discuss how astrocytes are integrated into the neuronal networks that regulate these behaviours, and identify the potential gliotransmission signalling mechanisms involved. From reviewing the evidence of astrocytic involvement in a range of rhythmic behaviours, we reveal a heterogenous array of gliotransmission mechanisms, which help to regulate neuronal networks. However, we also observe an intriguing thread of commonality, in the form of purinergic gliotransmission, which is frequently utilised to facilitate feedback inhibition within rhythmic networks to constrain a given behaviour within its operational range.

Modeling of Astrocyte Networks: Toward Realistic Topology and Dynamics

Neuronal firing and neuron-to-neuron synaptic wiring are currently widely described as orchestrated by astrocytes—elaborately ramified glial cells tiling the cortical and hippocampal space into non-overlapping domains, each covering hundreds of individual dendrites and hundreds thousands synapses. A key component to astrocytic signaling is the dynamics of cytosolic Ca²⁺ which displays multiscale spatiotemporal patterns from short confined elemental Ca²⁺ events (puffs) to Ca²⁺ waves expanding through many cells. Here, we synthesize the current understanding of astrocyte morphology, coupling local synaptic activity to astrocytic Ca²⁺ in perisynaptic astrocytic processes and morphology-defined mechanisms of Ca²⁺ regulation in a distributed model. To this end, we build simplified realistic data-driven spatial network templates and compile model equations as defined by local cell morphology. The input to the model is spatially uncorrelated stochastic synaptic activity. The proposed modeling approach is validated by statistics of simulated Ca²⁺ transients at a single cell level. In multicellular templates we observe regular sequences of cell entrainment in Ca²⁺ waves, as a result of interplay between stochastic input and morphology variability between individual astrocytes. Our approach adds spatial dimension to the existing astrocyte models by employment of realistic morphology while retaining enough flexibility and scalability to be embedded in multiscale heterocellular models of neural tissue. We conclude that the proposed approach provides a useful description of neuron-driven Ca²⁺-activity in the astrocyte syncytium.

Estimating integrated information in bidirectional neuron-astrocyte communication

There is growing evidence that suggests the importance of astrocytes as elements for neural information processing through the modulation of synaptic transmission. A key aspect of this problem is understanding the impact of astrocytes in the information carried by compound events in neurons across time. In this paper, we investigate how the astrocytes participate in the information integrated by individual neurons in an ensemble through the measurement of "integrated information." We propose a computational model that considers bidirectional communication between astrocytes and neurons through glutamate-induced calcium signaling. Our model highlights the role of astrocytes in information processing through dynamical coordination. Our findings suggest that the astrocytic feedback promotes synergetic influences in the neural communication, which is maximized when there is a balance between excess correlation and spontaneous spiking activity. The results were further linked with additional measures such as net synergy and mutual information. This result reinforces the idea that astrocytes have integrative properties in communication among neurons.

Toward Closed-Loop Electrical Stimulation of Neuronal Systems: A Review

Biological neuronal cells communicate using neurochemistry and electrical signals. The same phenomena also allow us to probe and manipulate neuronal systems and communicate with them. Neuronal system malfunctions cause a multitude of symptoms and functional deficiencies that can be assessed and sometimes alleviated by electrical stimulation. Our working hypothesis is that real-time closed-loop full-duplex measurement and stimulation paradigms can provide more in-depth insight into neuronal networks and enhance our capability to control diseases of the nervous system. In this study, we review extracellular electrical stimulation methods used in in vivo, in vitro, and in silico neuroscience research and in the clinic (excluding methods mainly aimed at neuronal growth and other similar effects) and highlight the potential of closed-loop measurement and stimulation systems. A multitude of electrical stimulation and measurement-based methods are widely used in research and the clinic. Closed-loop methods have been proposed, and some are used in the clinic. However, closed-loop systems utilizing more complex measurement analysis and adaptive stimulation systems, such as artificial intelligence systems connected to biological neuronal systems, do not yet exist. Our review promotes the research and development of intelligent paradigms aimed at meaningful communications between neuronal and information and communications technology systems, "dialogical paradigms," which have the potential to take neuroscience and clinical methods to a new level.