Brian 2, an intuitive and efficient neural simulator

Flexible circuit mechanisms for context-dependent song sequencing

Sequenced behaviours, including locomotion, reaching and vocalization, are patterned differently in different contexts, enabling animals to adjust to their environments. How contextual information shapes neural activity to flexibly alter the patterning of actions is not fully understood. Previous work has indicated that this could be achieved via parallel motor circuits, with differing sensitivities to context1,2. Here we demonstrate that a single pathway operates in two regimes dependent on recent sensory history. We leverage the Drosophila song production system3 to investigate the role of several neuron types4-7 in song patterning near versus far from the female fly. Male flies sing 'simple' trains of only one mode far from the female fly but complex song sequences comprising alternations between modes when near her. We find that ventral nerve cord (VNC) circuits are shaped by mutual inhibition and rebound excitability8 between nodes driving the two song modes. Brief sensory input to a direct brain-to-VNC excitatory pathway drives simple song far from the female, whereas prolonged input enables complex song production via simultaneous recruitment of functional disinhibition of VNC circuitry. Thus, female proximity unlocks motor circuit dynamics in the correct context. We construct a compact circuit model to demonstrate that the identified mechanisms suffice to replicate natural song dynamics. These results highlight how canonical circuit motifs8,9 can be combined to enable circuit flexibility required for dynamic communication.

Short-term neuronal and synaptic plasticity act in synergy for deviance detection in spiking networks

Sensory areas of cortex respond more strongly to infrequent stimuli when these violate previously established regularities, a phenomenon known as deviance detection (DD). Previous modeling work has mainly attempted to explain DD on the basis of synaptic plasticity. However, a large fraction of cortical neurons also exhibit firing rate adaptation, an underexplored potential mechanism. Here, we investigate DD in a spiking neuronal network model with two types of short-term plasticity, fast synaptic short-term depression (STD) and slower threshold adaptation (TA). We probe the model with an oddball stimulation paradigm and assess DD by evaluating the network responses. We find that TA is sufficient to elicit DD. It achieves this by habituating neurons near the stimulation site that respond earliest to the frequently presented standard stimulus (local fatigue), which diminishes the response and promotes the recovery (global fatigue) of the wider network. Further, we find a synergy effect between STD and TA, where they interact with each other to achieve greater DD than the sum of their individual effects. We show that this synergy is caused by the local fatigue added by STD, which inhibits the global response to the frequently presented stimulus, allowing greater recovery of TA-mediated global fatigue and making the network more responsive to the deviant stimulus. Finally, we show that the magnitude of DD strongly depends on the timescale of stimulation. We conclude that highly predictable information can be encoded in strong local fatigue, which allows greater global recovery and subsequent heightened sensitivity for DD.

Phase information is conserved in sparse, synchronous population-rate-codes via phase-to-rate recoding

Neural computation is often traced in terms of either rate- or phase-codes. However, most circuit operations will simultaneously affect information across both coding schemes. It remains unclear how phase and rate coded information is transmitted, in the face of continuous modification at consecutive processing stages. Here, we study this question in the entorhinal cortex (EC)- dentate gyrus (DG)- CA3 system using three distinct computational models. We demonstrate that DG feedback inhibition leverages EC phase information to improve rate-coding, a computation we term phase-to-rate recoding. Our results suggest that it i) supports the conservation of phase information within sparse rate-codes and ii) enhances the efficiency of plasticity in downstream CA3 via increased synchrony. Given the ubiquity of both phase-coding and feedback circuits, our results raise the question whether phase-to-rate recoding is a recurring computational motif, which supports the generation of sparse, synchronous population-rate-codes in areas beyond the DG.

From Brain Models to Robotic Embodied Cognition: How Does Biological Plausibility Inform Neuromorphic Systems?

We examine the challenging "marriage" between computational efficiency and biological plausibility-A crucial node in the domain of spiking neural networks at the intersection of neuroscience, artificial intelligence, and robotics. Through a transdisciplinary review, we retrace the historical and most recent constraining influences that these parallel fields have exerted on descriptive analysis of the brain, construction of predictive brain models, and ultimately, the embodiment of neural networks in an enacted robotic agent. We study models of Spiking Neural Networks (SNN) as the central means enabling autonomous and intelligent behaviors in biological systems. We then provide a critical comparison of the available hardware and software to emulate SNNs for investigating biological entities and their application on artificial systems. Neuromorphics is identified as a promising tool to embody SNNs in real physical systems and different neuromorphic chips are compared. The concepts required for describing SNNs are dissected and contextualized in the new no man's land between cognitive neuroscience and artificial intelligence. Although there are recent reviews on the application of neuromorphic computing in various modules of the guidance, navigation, and control of robotic systems, the focus of this paper is more on closing the cognition loop in SNN-embodied robotics. We argue that biologically viable spiking neuronal models used for electroencephalogram signals are excellent candidates for furthering our knowledge of the explainability of SNNs. We complete our survey by reviewing different robotic modules that can benefit from neuromorphic hardware, e.g., perception (with a focus on vision), localization, and cognition. We conclude that the tradeoff between symbolic computational power and biological plausibility of hardware can be best addressed by neuromorphics, whose presence in neurorobotics provides an accountable empirical testbench for investigating synthetic and natural embodied cognition. We argue this is where both theoretical and empirical future work should converge in multidisciplinary efforts involving neuroscience, artificial intelligence, and robotics.

Neuromorphic sequence learning with an event camera on routes through vegetation

For many robotics applications, it is desirable to have relatively low-power and efficient onboard solutions. We took inspiration from insects, such as ants, that are capable of learning and following routes in complex natural environments using relatively constrained sensory and neural systems. Such capabilities are particularly relevant to applications such as agricultural robotics, where visual navigation through dense vegetation remains a challenging task. In this scenario, a route is likely to have high self-similarity and be subject to changing lighting conditions and motion over uneven terrain, and the effects of wind on leaves increase the variability of the input. We used a bioinspired event camera on a terrestrial robot to collect visual sequences along routes in natural outdoor environments and applied a neural algorithm for spatiotemporal memory that is closely based on a known neural circuit in the insect brain. We show that this method is plausible to support route recognition for visual navigation and more robust than SeqSLAM when evaluated on repeated runs on the same route or routes with small lateral offsets. By encoding memory in a spiking neural network running on a neuromorphic computer, our model can evaluate visual familiarity in real time from event camera footage.

Evaluation of Spiking Neural Nets-Based Image Classification Using the Runtime Simulator RAVSim

Spiking Neural Networks (SNNs) help achieve brain-like efficiency and functionality by building neurons and synapses that mimic the human brain's transmission of electrical signals. However, optimal SNN implementation requires a precise balance of parametric values. To design such ubiquitous neural networks, a graphical tool for visualizing, analyzing, and explaining the internal behavior of spikes is crucial. Although some popular SNN simulators are available, these tools do not allow users to interact with the neural network during simulation. To this end, we have introduced the first runtime interactive simulator, called Runtime Analyzing and Visualization Simulator (RAVSim),a developed to analyze and dynamically visualize the behavior of SNNs, allowing end-users to interact, observe output concentration reactions, and make changes directly during the simulation. In this paper, we present RAVSim with the current implementation of runtime interaction using the LIF neural model with different connectivity schemes, an image classification model using SNNs, and a dataset creation feature. Our main objective is to primarily investigate binary classification using SNNs with RGB images. We created a feed-forward network using the LIF neural model for an image classification algorithm and evaluated it by using RAVSim. The algorithm classifies faces with and without masks, achieving an accuracy of 91.8% using 1000 neurons in a hidden layer, 0.0758 MSE, and an execution time of ∼10[Formula: see text]min on the CPU. The experimental results show that using RAVSim not only increases network design speed but also accelerates user learning capability.

SWsnn: A Novel Simulator for Spiking Neural Networks

Spiking neural network (SNN) simulators play an important role in neural system modeling and brain function research. They can help scientists reproduce and explore neuronal activities in brain regions, neuroscience, brain-like computing, and other fields and can also be applied to artificial intelligence, machine learning, and other fields. At present, many simulators using central processing unit (CPU) or graphics processing unit (GPU) have been developed. However, due to the randomness of connections between neurons and spiking events in SNN simulation, this causes a lot of memory access time. To alleviate this problem, we developed an SNN simulator SWsnn based on the new Sunway SW26010pro processor. The SW26010pro processor consists of six core groups, each with 16 MB of local data memory (LDM). LDM has the characteristics of high-speed read and write, which is suitable for performing simulation tasks similar to SNNs. Experimental results show that SWsnn runs faster than other mainstream GPU-based simulators when simulating a certain scale of neural network, showing a strong performance advantage. To conduct larger scale simulations, SWsnn designed a simulation computation based on a large shared model of Sunway processor and developed a multiprocessor version of SWsnn based on this mode, achieving larger scale SNN simulations.

New biophysical rate-based modeling of long-term plasticity in mean-field neuronal population models

The formation of customized neural networks as the basis of brain functions such as receptive field selectivity, learning or memory depends heavily on the long-term plasticity of synaptic connections. However, the current mean-field population models commonly used to simulate large-scale neural network dynamics lack explicit links to the underlying cellular mechanisms of long-term plasticity. In this study, we developed a new mean-field population model, the plastic density-based neural mass model (pdNMM), by incorporating a newly developed rate-based plasticity model based on the calcium control hypothesis into an existing density-based neural mass model. Derivation of the plasticity model was carried out using population density methods. Our results showed that the synaptic plasticity represented by the resulting rate-based plasticity model exhibited Bienenstock-Cooper-Munro-like learning rules. Furthermore, we demonstrated that the pdNMM accurately reproduced previous experimental observations of long-term plasticity, including characteristics of Hebbian plasticity such as longevity, associativity and input specificity, on hippocampal slices, and the formation of receptive field selectivity in the visual cortex. In conclusion, the pdNMM is a novel approach that can confer long-term plasticity to conventional mean-field neuronal population models.

A perspective on large-scale simulation as an enabler for novel biorobotics applications

Our understanding of the complex mechanisms that power biological intelligence has been greatly enhanced through the explosive growth of large-scale neuroscience and robotics simulation tools that are used by the research community to perform previously infeasible experiments, such as the simulation of the neocortex's circuitry. Nevertheless, simulation falls far from being directly applicable to biorobots due to the large discrepancy between the simulated and the real world. A possible solution for this problem is the further enhancement of existing simulation tools for robotics, AI and neuroscience with multi-physics capabilities. Previously infeasible or difficult to simulate scenarios, such as robots swimming on the water surface, interacting with soft materials, walking on granular materials etc., would be rendered possible within a multi-physics simulation environment designed for robotics. In combination with multi-physics simulation, large-scale simulation tools that integrate multiple simulation modules in a closed-loop manner help address fundamental questions around the organization of neural circuits and the interplay between the brain, body and environment. We analyze existing designs for large-scale simulation running on cloud and HPC infrastructure as well as their shortcomings. Based on this analysis we propose a next-gen modular architecture design based on multi-physics engines, that we believe would greatly benefit biorobotics and AI.

Modular architecture facilitates noise-driven control of synchrony in neuronal networks

High-level information processing in the mammalian cortex requires both segregated processing in specialized circuits and integration across multiple circuits. One possible way to implement these seemingly opposing demands is by flexibly switching between states with different levels of synchrony. However, the mechanisms behind the control of complex synchronization patterns in neuronal networks remain elusive. Here, we use precision neuroengineering to manipulate and stimulate networks of cortical neurons in vitro, in combination with an in silico model of spiking neurons and a mesoscopic model of stochastically coupled modules to show that (i) a modular architecture enhances the sensitivity of the network to noise delivered as external asynchronous stimulation and that (ii) the persistent depletion of synaptic resources in stimulated neurons is the underlying mechanism for this effect. Together, our results demonstrate that the inherent dynamical state in structured networks of excitable units is determined by both its modular architecture and the properties of the external inputs.

Exploring spiking neural networks: a comprehensive analysis of mathematical models and applications

This article presents a comprehensive analysis of spiking neural networks (SNNs) and their mathematical models for simulating the behavior of neurons through the generation of spikes. The study explores various models, including LIF and NLIF, for constructing SNNs and investigates their potential applications in different domains. However, implementation poses several challenges, including identifying the most appropriate model for classification tasks that demand high accuracy and low-performance loss. To address this issue, this research study compares the performance, behavior, and spike generation of multiple SNN models using consistent inputs and neurons. The findings of the study provide valuable insights into the benefits and challenges of SNNs and their models, emphasizing the significance of comparing multiple models to identify the most effective one. Moreover, the study quantifies the number of spiking operations required by each model to process the same inputs and produce equivalent outputs, enabling a thorough assessment of computational efficiency. The findings provide valuable insights into the benefits and limitations of SNNs and their models. The research underscores the significance of comparing different models to make informed decisions in practical applications. Additionally, the results reveal essential variations in biological plausibility and computational efficiency among the models, further emphasizing the importance of selecting the most suitable model for a given task. Overall, this study contributes to a deeper understanding of SNNs and offers practical guidelines for using their potential in real-world scenarios.

BrainCog: A spiking neural network based, brain-inspired cognitive intelligence engine for brain-inspired AI and brain simulation

Spiking neural networks (SNNs) serve as a promising computational framework for integrating insights from the brain into artificial intelligence (AI). Existing software infrastructures based on SNNs exclusively support brain simulation or brain-inspired AI, but not both simultaneously. To decode the nature of biological intelligence and create AI, we present the brain-inspired cognitive intelligence engine (BrainCog). This SNN-based platform provides essential infrastructure support for developing brain-inspired AI and brain simulation. BrainCog integrates different biological neurons, encoding strategies, learning rules, brain areas, and hardware-software co-design as essential components. Leveraging these user-friendly components, BrainCog incorporates various cognitive functions, including perception and learning, decision-making, knowledge representation and reasoning, motor control, social cognition, and brain structure and function simulations across multiple scales. BORN is an AI engine developed by BrainCog, showcasing seamless integration of BrainCog's components and cognitive functions to build advanced AI models and applications.

An in silico and in vitro human neuronal network model reveals cellular mechanisms beyond NaV1.1 underlying Dravet syndrome

Human induced pluripotent stem cell (hiPSC)-derived neuronal networks on multi-electrode arrays (MEAs) provide a unique phenotyping tool to study neurological disorders. However, it is difficult to infer cellular mechanisms underlying these phenotypes. Computational modeling can utilize the rich dataset generated by MEAs, and advance understanding of disease mechanisms. However, existing models lack biophysical detail, or validation and calibration to relevant experimental data. We developed a biophysical in silico model that accurately simulates healthy neuronal networks on MEAs. To demonstrate the potential of our model, we studied neuronal networks derived from a Dravet syndrome (DS) patient with a missense mutation in SCN1A, encoding sodium channel NaV1.1. Our in silico model revealed that sodium channel dysfunctions were insufficient to replicate the in vitro DS phenotype, and predicted decreased slow afterhyperpolarization and synaptic strengths. We verified these changes in DS patient-derived neurons, demonstrating the utility of our in silico model to predict disease mechanisms.

Geometry of population activity in spiking networks with low-rank structure

Recurrent network models are instrumental in investigating how behaviorally-relevant computations emerge from collective neural dynamics. A recently developed class of models based on low-rank connectivity provides an analytically tractable framework for understanding of how connectivity structure determines the geometry of low-dimensional dynamics and the ensuing computations. Such models however lack some fundamental biological constraints, and in particular represent individual neurons in terms of abstract units that communicate through continuous firing rates rather than discrete action potentials. Here we examine how far the theoretical insights obtained from low-rank rate networks transfer to more biologically plausible networks of spiking neurons. Adding a low-rank structure on top of random excitatory-inhibitory connectivity, we systematically compare the geometry of activity in networks of integrate-and-fire neurons to rate networks with statistically equivalent low-rank connectivity. We show that the mean-field predictions of rate networks allow us to identify low-dimensional dynamics at constant population-average activity in spiking networks, as well as novel non-linear regimes of activity such as out-of-phase oscillations and slow manifolds. We finally exploit these results to directly build spiking networks that perform nonlinear computations.

Cell anatomy and network input explain differences within but not between leech touch cells at two different locations

Mechanosensory cells in the leech share several common features with mechanoreceptors in the human glabrous skin. Previous studies showed that the six T (touch) cells in each body segment of the leech are highly variable in their responses to somatic current injection and change their excitability over time. Here, we investigate three potential reasons for this variability in excitability by comparing the responses of T cells at two soma locations (T2 and T3): (1) Differential effects of time-dependent changes in excitability, (2) divergent synaptic input from the network, and (3) different anatomical structures. These hypotheses were explored with a combination of electrophysiological double recordings, 3D reconstruction of neurobiotin-filled cells, and compartmental model simulations. Current injection triggered significantly more spikes with shorter latency and larger amplitudes in cells at soma location T2 than at T3. During longer recordings, cells at both locations increased their excitability over time in the same way. T2 and T3 cells received the same amount of synaptic input from the unstimulated network, and the polysynaptic connections between both T cells were mutually symmetric. However, we found a striking anatomical difference: While in our data set all T2 cells innervated two roots connecting the ganglion with the skin, 50% of the T3 cells had only one root process. The sub-sample of T3 cells with one root process was significantly less excitable than the T3 cells with two root processes and the T2 cells. To test if the additional root process causes higher excitability, we simulated the responses of 3D reconstructed cells of both anatomies with detailed multi-compartment models. The anatomical subtypes do not differ in excitability when identical biophysical parameters and a homogeneous channel distribution are assumed. Hence, all three hypotheses may contribute to the highly variable T cell responses, but none of them is the only factor accounting for the observed systematic difference in excitability between cells at T2 vs. T3 soma location. Therefore, future patch clamp and modeling studies are needed to analyze how biophysical properties and spatial distribution of ion channels on the cell surface contribute to the variability and systematic differences of electrophysiological phenotypes.

The dynamics and geometry of choice in premotor cortex

The brain represents sensory variables in the coordinated activity of neural populations, in which tuning curves of single neurons define the geometry of the population code. Whether the same coding principle holds for dynamic cognitive variables remains unknown because internal cognitive processes unfold with a unique time course on single trials observed only in the irregular spiking of heterogeneous neural populations. Here we show the existence of such a population code for the dynamics of choice formation in the primate premotor cortex. We developed an approach to simultaneously infer population dynamics and tuning functions of single neurons to the population state. Applied to spike data recorded during decision-making, our model revealed that populations of neurons encoded the same dynamic variable predicting choices, and heterogeneous firing rates resulted from the diverse tuning of single neurons to this decision variable. The inferred dynamics indicated an attractor mechanism for decision computation. Our results reveal a common geometric principle for neural encoding of sensory and dynamic cognitive variables.

EdgeMap: An Optimized Mapping Toolchain for Spiking Neural Network in Edge Computing

Spiking neural networks (SNNs) have attracted considerable attention as third-generation artificial neural networks, known for their powerful, intelligent features and energy-efficiency advantages. These characteristics render them ideally suited for edge computing scenarios. Nevertheless, the current mapping schemes for deploying SNNs onto neuromorphic hardware face limitations such as extended execution times, low throughput, and insufficient consideration of energy consumption and connectivity, which undermine their suitability for edge computing applications. To address these challenges, we introduce EdgeMap, an optimized mapping toolchain specifically designed for deploying SNNs onto edge devices without compromising performance. EdgeMap consists of two main stages. The first stage involves partitioning the SNN graph into small neuron clusters based on the streaming graph partition algorithm, with the sizes of neuron clusters limited by the physical neuron cores. In the subsequent mapping stage, we adopt a multi-objective optimization algorithm specifically geared towards mitigating energy costs and communication costs for efficient deployment. EdgeMap-evaluated across four typical SNN applications-substantially outperforms other state-of-the-art mapping schemes. The performance improvements include a reduction in average latency by up to 19.8%, energy consumption by 57%, and communication cost by 58%. Moreover, EdgeMap exhibits an impressive enhancement in execution time by a factor of 1225.44×, alongside a throughput increase of up to 4.02×. These results highlight EdgeMap's efficiency and effectiveness, emphasizing its utility for deploying SNN applications in edge computing scenarios.

Model of Neuromorphic Odorant-Recognition Network

We propose a new model for a neuromorphic olfactory analyzer based on memristive synapses. The model comprises a layer of receptive neurons that perceive various odors and a layer of "decoder" neurons that recognize these odors. It is demonstrated that connecting these layers with memristive synapses enables the training of the "decoder" layer to recognize two types of odorants of varying concentrations. In the absence of such synapses, the layer of "decoder" neurons does not exhibit specificity in recognizing odorants. The recognition of the 'odorant' occurs through the neural activity of a group of decoder neurons that have acquired specificity for the odorant in the learning process. The proposed phenomenological model showcases the potential use of a memristive synapse in practical odorant recognition applications.

Gap junctions desynchronize a neural circuit to stabilize insect flight

Insect asynchronous flight is one of the most prevalent forms of animal locomotion used by more than 600,000 species. Despite profound insights into the motor patterns¹, biomechanics^2,3 and aerodynamics underlying asynchronous flight^4,5, the architecture and function of the central-pattern-generating (CPG) neural network remain unclear. Here, on the basis of an experiment-theory approach including electrophysiology, optophysiology, Drosophila genetics and mathematical modelling, we identify a miniaturized circuit solution with unexpected properties. The CPG network consists of motoneurons interconnected by electrical synapses that, in contrast to doctrine, produce network activity splayed out in time instead of synchronized across neurons. Experimental and mathematical evidence support a generic mechanism for network desynchronization that relies on weak electrical synapses and specific excitability dynamics of the coupled neurons. In small networks, electrical synapses can synchronize or desynchronize network activity, depending on the neuron-intrinsic dynamics and ion channel composition. In the asynchronous flight CPG, this mechanism translates unpatterned premotor input into stereotyped neuronal firing with fixed sequences of cell activation that ensure stable wingbeat power and, as we show, is conserved across multiple species. Our findings prove a wider functional versatility of electrical synapses in the dynamic control of neural circuits and highlight the relevance of detecting electrical synapses in connectomics.

Retinal ganglion cells undergo cell type-specific functional changes in a computational model of cone-mediated retinal degeneration

Introduction

Understanding the retina in health and disease is a key issue for neuroscience and neuroengineering applications such as retinal prostheses. During degeneration, the retinal network undergoes complex and multi-stage neuroanatomical alterations, which drastically impact the retinal ganglion cell (RGC) response and are of clinical importance. Here we present a biophysically detailed in silico model of the cone pathway in the retina that simulates the network-level response to both light and electrical stimulation.

Methods

The model included 11, 138 cells belonging to nine different cell types (cone photoreceptors, horizontal cells, ON/OFF bipolar cells, ON/OFF amacrine cells, and ON/OFF ganglion cells) confined to a 300 × 300 × 210μm patch of the parafoveal retina. After verifying that the model reproduced seminal findings about the light response of retinal ganglion cells (RGCs), we systematically introduced anatomical and neurophysiological changes (e.g., reduced light sensitivity of photoreceptor, cell death, cell migration) to the network and studied their effect on network activity.

Results

The model was not only able to reproduce common findings about RGC activity in the degenerated retina, such as hyperactivity and increased electrical thresholds, but also offers testable predictions about the underlying neuroanatomical mechanisms.

Discussion

Overall, our findings demonstrate how biophysical changes typified by cone-mediated retinal degeneration may impact retinal responses to light and electrical stimulation. These insights may further our understanding of retinal processing and inform the design of retinal prostheses.

Linking cortex and contraction-Integrating models along the corticomuscular pathway

Computational models of the neuromusculoskeletal system provide a deterministic approach to investigate input-output relationships in the human motor system. Neuromusculoskeletal models are typically used to estimate muscle activations and forces that are consistent with observed motion under healthy and pathological conditions. However, many movement pathologies originate in the brain, including stroke, cerebral palsy, and Parkinson's disease, while most neuromusculoskeletal models deal exclusively with the peripheral nervous system and do not incorporate models of the motor cortex, cerebellum, or spinal cord. An integrated understanding of motor control is necessary to reveal underlying neural-input and motor-output relationships. To facilitate the development of integrated corticomuscular motor pathway models, we provide an overview of the neuromusculoskeletal modelling landscape with a focus on integrating computational models of the motor cortex, spinal cord circuitry, α-motoneurons  and skeletal muscle in regard to their role in generating voluntary muscle contraction. Further, we highlight the challenges and opportunities associated with an integrated corticomuscular pathway model, such as challenges in defining neuron connectivities, modelling standardisation, and opportunities in applying models to study emergent behaviour. Integrated corticomuscular pathway models have applications in brain-machine-interaction, education, and our understanding of neurological disease.

Microstimulation of sensory cortex engages natural sensory representations

Cortical activity patterns occupy a small subset of possible network states. If this is due to intrinsic network properties, microstimulation of sensory cortex should evoke activity patterns resembling those observed during natural sensory input. Here, we use optical microstimulation of virally transfected layer 2/3 pyramidal neurons in the mouse primary vibrissal somatosensory cortex to compare artificially evoked activity with natural activity evoked by whisker touch and movement ("whisking"). We find that photostimulation engages touch- but not whisking-responsive neurons more than expected by chance. Neurons that respond to photostimulation and touch or to touch alone exhibit higher spontaneous pairwise correlations than purely photoresponsive neurons. Exposure to several days of simultaneous touch and optogenetic stimulation raises both overlap and spontaneous activity correlations among touch and photoresponsive neurons. We thus find that cortical microstimulation engages existing cortical representations and that repeated co-presentation of natural and artificial stimulation enhances this effect.

Microscale Neuronal Activity Collectively Drives Chaotic and Inflexible Dynamics at the Macroscale in Seizures

Neuronal activity propagates through the network during seizures, engaging brain dynamics at multiple scales. Such propagating events can be described through the avalanches framework, which can relate spatiotemporal activity at the microscale with global network properties. Interestingly, propagating avalanches in healthy networks are indicative of critical dynamics, where the network is organized to a phase transition, which optimizes certain computational properties. Some have hypothesized that the pathologic brain dynamics of epileptic seizures are an emergent property of microscale neuronal networks collectively driving the brain away from criticality. Demonstrating this would provide a unifying mechanism linking microscale spatiotemporal activity with emergent brain dysfunction during seizures. Here, we investigated the effect of drug-induced seizures on critical avalanche dynamics, using in vivo whole-brain two-photon imaging of GCaMP6s larval zebrafish (males and females) at single neuron resolution. We demonstrate that single neuron activity across the whole brain exhibits a loss of critical statistics during seizures, suggesting that microscale activity collectively drives macroscale dynamics away from criticality. We also construct spiking network models at the scale of the larval zebrafish brain, to demonstrate that only densely connected networks can drive brain-wide seizure dynamics away from criticality. Importantly, such dense networks also disrupt the optimal computational capacities of critical networks, leading to chaotic dynamics, impaired network response properties and sticky states, thus helping to explain functional impairments during seizures. This study bridges the gap between microscale neuronal activity and emergent macroscale dynamics and cognitive dysfunction during seizures.SIGNIFICANCE STATEMENT Epileptic seizures are debilitating and impair normal brain function. It is unclear how the coordinated behavior of neurons collectively impairs brain function during seizures. To investigate this we perform fluorescence microscopy in larval zebrafish, which allows for the recording of whole-brain activity at single-neuron resolution. Using techniques from physics, we show that neuronal activity during seizures drives the brain away from criticality, a regime that enables both high and low activity states, into an inflexible regime that drives high activity states. Importantly, this change is caused by more connections in the network, which we show disrupts the ability of the brain to respond appropriately to its environment. Therefore, we identify key neuronal network mechanisms driving seizures and concurrent cognitive dysfunction.

Information Encoding in Bursting Spiking Neural Network Modulated by Astrocytes

We investigated a mathematical model composed of a spiking neural network (SNN) interacting with astrocytes. We analysed how information content in the form of two-dimensional images can be represented by an SNN in the form of a spatiotemporal spiking pattern. The SNN includes excitatory and inhibitory neurons in some proportion, sustaining the excitation-inhibition balance of autonomous firing. The astrocytes accompanying each excitatory synapse provide a slow modulation of synaptic transmission strength. An information image was uploaded to the network in the form of excitatory stimulation pulses distributed in time reproducing the shape of the image. We found that astrocytic modulation prevented stimulation-induced SNN hyperexcitation and non-periodic bursting activity. Such homeostatic astrocytic regulation of neuronal activity makes it possible to restore the image supplied during stimulation and lost in the raster diagram of neuronal activity due to non-periodic neuronal firing. At a biological point, our model shows that astrocytes can act as an additional adaptive mechanism for regulating neural activity, which is crucial for sensory cortical representations.

Dendrites help mitigate the plasticity-stability dilemma

With Hebbian learning 'who fires together wires together', well-known problems arise. Hebbian plasticity can cause unstable network dynamics and overwrite stored memories. Because the known homeostatic plasticity mechanisms tend to be too slow to combat unstable dynamics, it has been proposed that plasticity must be highly gated and synaptic strengths limited. While solving the issue of stability, gating and limiting plasticity does not solve the stability-plasticity dilemma. We propose that dendrites enable both stable network dynamics and considerable synaptic changes, as they allow the gating of plasticity in a compartment-specific manner. We investigate how gating plasticity influences network stability in plastic balanced spiking networks of neurons with dendrites. We compare how different ways to gate plasticity, namely via modulating excitability, learning rate, and inhibition increase stability. We investigate how dendritic versus perisomatic gating allows for different amounts of weight changes in stable networks. We suggest that the compartmentalisation of pyramidal cells enables dendritic synaptic changes while maintaining stability. We show that the coupling between dendrite and soma is critical for the plasticity-stability trade-off. Finally, we show that spatially restricted plasticity additionally improves stability.

In vitro effects of eslicarbazepine (S-licarbazepine) as a potential precision therapy on SCN8A variants causing neuropsychiatric disorders

BACKGROUND AND PURPOSE

Variants in SCN8A, the Na_V 1.6 channel's coding gene, are characterized by a variety of symptoms, including intractable epileptic seizures, psychomotor delay, progressive cognitive decline, autistic features, ataxia or dystonia. Standard anticonvulsant treatment has a limited impact on the course of disease.

EXPERIMENTAL APPROACH

We investigated the therapeutic potential of eslicarbazepine (S-licarbazepine; S-lic), an enhancer of slow inactivation of voltage gated sodium channels, on two variants with biophysical and neuronal gain-of-function (G1475R and M1760I) and one variant with biophysical gain-of-function but neuronal loss-of-function (A1622D) in neuroblastoma cells and in murine primary hippocampal neuron cultures. These three variants cover the broad spectrum of Na_V 1.6-associated disease and are linked to representative phenotypes of mild to moderate epilepsy (G1475R), developmental and epileptic encephalopathy (M1760I) and intellectual disability without epilepsy (A1622D).

KEY RESULTS

Similar to known effects on Na_V 1.6 wildtype channels, S-lic predominantly enhances slow inactivation on all tested variants, irrespective of their particular biophysical mechanisms. Beyond that, S-lic exhibits variant-specific effects including a partial reversal of pathologically slowed fast inactivation dynamics (A1622D and M1760I) and a trend to reduce enhanced persistent Na⁺ current by A1622D variant channels. Furthermore, our data in primary transfected neurons reveal that not only variant-associated hyperexcitability (M1760I and G1475R) but also hypoexcitability (A1622D) can be modulated by S-lic.

CONCLUSIONS AND IMPLICATIONS

S-lic has not only substance-specific effects but also variant-specific effects. Personalized treatment regimens optimized to achieve such variant-specific pharmacological modulation may help to reduce adverse side effects and improve the overall therapeutic outcome of SCN8A-related disease.

Models Developed for Spiking Neural Networks

Emergence of deep neural networks (DNNs) has raised enormous attention towards artificial neural networks (ANNs) once again. They have become the state-of-the-art models and have won different machine learning challenges. Although these networks are inspired by the brain, they lack biological plausibility, and they have structural differences compared to the brain. Spiking neural networks (SNNs) have been around for a long time, and they have been investigated to understand the dynamics of the brain. However, their application in real-world and complicated machine learning tasks were limited. Recently, they have shown great potential in solving such tasks. Due to their energy efficiency and temporal dynamics there are many promises in their future development. In this work, we reviewed the structures and performances of SNNs on image classification tasks. The comparisons illustrate that these networks show great capabilities for more complicated problems. Furthermore, the simple learning rules developed for SNNs, such as STDP and R-STDP, can be a potential alternative to replace the backpropagation algorithm used in DNNs.•Different building blocks of spiking neural networks are explained in this work.•Developed models for SNNs are introduced based on their characteristics and building blocks.

Integration of neuromorphic AI in event-driven distributed digitized systems: Concepts and research directions

Increasing complexity and data-generation rates in cyber-physical systems and the industrial Internet of things are calling for a corresponding increase in AI capabilities at the resource-constrained edges of the Internet. Meanwhile, the resource requirements of digital computing and deep learning are growing exponentially, in an unsustainable manner. One possible way to bridge this gap is the adoption of resource-efficient brain-inspired "neuromorphic" processing and sensing devices, which use event-driven, asynchronous, dynamic neurosynaptic elements with colocated memory for distributed processing and machine learning. However, since neuromorphic systems are fundamentally different from conventional von Neumann computers and clock-driven sensor systems, several challenges are posed to large-scale adoption and integration of neuromorphic devices into the existing distributed digital-computational infrastructure. Here, we describe the current landscape of neuromorphic computing, focusing on characteristics that pose integration challenges. Based on this analysis, we propose a microservice-based conceptual framework for neuromorphic systems integration, consisting of a neuromorphic-system proxy, which would provide virtualization and communication capabilities required in distributed systems of systems, in combination with a declarative programming approach offering engineering-process abstraction. We also present concepts that could serve as a basis for the realization of this framework, and identify directions for further research required to enable large-scale system integration of neuromorphic devices.

An electrophysiological and kinematic model of Paramecium, the "swimming neuron"

Paramecium is a large unicellular organism that swims in fresh water using cilia. When stimulated by various means (mechanically, chemically, optically, thermally), it often swims backward then turns and swims forward again in a new direction: this is called the avoiding reaction. This reaction is triggered by a calcium-based action potential. For this reason, several authors have called Paramecium the "swimming neuron". Here we present an empirically constrained model of its action potential based on electrophysiology experiments on live immobilized paramecia, together with simultaneous measurement of ciliary beating using particle image velocimetry. Using these measurements and additional behavioral measurements of free swimming, we extend the electrophysiological model by coupling calcium concentration to kinematic parameters, turning it into a swimming model. In this way, we obtain a model of autonomously behaving Paramecium. Finally, we demonstrate how the modeled organism interacts with an environment, can follow gradients and display collective behavior. This work provides a modeling basis for investigating the physiological basis of autonomous behavior of Paramecium in ecological environments.

Retinal ganglion cells undergo cell typeâ€"specific functional changes in a biophysically detailed model of retinal degeneration

Understanding the retina in health and disease is a key issue for neuroscience and neuroengineering applications such as retinal prostheses. During degeneration, the retinal network undergoes complex and multi-stage neuroanatomical alterations, which drastically impact the retinal ganglion cell (RGC) response and are of clinical importance. Here we present a biophysically detailed in silico model of retinal degeneration that simulates the network-level response to both light and electrical stimulation as a function of disease progression. The model is not only able to reproduce common findings about RGC activity in the degenerated retina, such as hyperactivity and increased electrical thresholds, but also offers testable predictions about the underlying neuroanatomical mechanisms. Overall, our findings demonstrate how biophysical changes associated with retinal degeneration affect retinal responses to both light and electrical stimulation, which may further our understanding of visual processing in the retina as well as inform the design and application of retinal prostheses.

NRN-EZ: an application to streamline biophysical modeling of synaptic integration using NEURON

One of the fundamental goals in neuroscience is to determine how the brain processes information and ultimately controls the execution of complex behaviors. Over the past four decades, there has been a steady growth in our knowledge of the morphological and functional diversity of neurons, the building blocks of the brain. These cells clearly differ not only for their anatomy and ion channel distribution, but also for the type, strength, location, and temporal pattern of activity of the many synaptic inputs they receive. Compartmental modeling programs like NEURON have become widely used in the neuroscience community to address a broad range of research questions, including how neurons integrate synaptic inputs and propagate information through complex neural networks. One of the main strengths of NEURON is its ability to incorporate user-defined information about the realistic morphology and biophysical properties of different cell types. Although the graphical user interface of the program can be used to run initial exploratory simulations, introducing a stochastic representation of synaptic weights, locations and activation times typically requires users to develop their own codes, a task that can be overwhelming for some beginner users. Here we describe NRN-EZ, an interactive application that allows users to specify complex patterns of synaptic input activity that can be integrated as part of NEURON simulations. Through its graphical user interface, NRN-EZ aims to ease the learning curve to run computational models in NEURON, for users that do not necessarily have a computer science background.

Introducing the Dendrify framework for incorporating dendrites to spiking neural networks

Computational modeling has been indispensable for understanding how subcellular neuronal features influence circuit processing. However, the role of dendritic computations in network-level operations remains largely unexplored. This is partly because existing tools do not allow the development of realistic and efficient network models that account for dendrites. Current spiking neural networks, although efficient, are usually quite simplistic, overlooking essential dendritic properties. Conversely, circuit models with morphologically detailed neuron models are computationally costly, thus impractical for large-network simulations. To bridge the gap between these two extremes and facilitate the adoption of dendritic features in spiking neural networks, we introduce Dendrify, an open-source Python package based on Brian 2. Dendrify, through simple commands, automatically generates reduced compartmental neuron models with simplified yet biologically relevant dendritic and synaptic integrative properties. Such models strike a good balance between flexibility, performance, and biological accuracy, allowing us to explore dendritic contributions to network-level functions while paving the way for developing more powerful neuromorphic systems.

Creation of Neuronal Ensembles and Cell-Specific Homeostatic Plasticity through Chronic Sparse Optogenetic Stimulation

Cortical computations emerge from the dynamics of neurons embedded in complex cortical circuits. Within these circuits, neuronal ensembles, which represent subnetworks with shared functional connectivity, emerge in an experience-dependent manner. Here we induced ensembles in ex vivo cortical circuits from mice of either sex by differentially activating subpopulations through chronic optogenetic stimulation. We observed a decrease in voltage correlation, and importantly a synaptic decoupling between the stimulated and nonstimulated populations. We also observed a decrease in firing rate during Up-states in the stimulated population. These ensemble-specific changes were accompanied by decreases in intrinsic excitability in the stimulated population, and a decrease in connectivity between stimulated and nonstimulated pyramidal neurons. By incorporating the empirically observed changes in intrinsic excitability and connectivity into a spiking neural network model, we were able to demonstrate that changes in both intrinsic excitability and connectivity accounted for the decreased firing rate, but only changes in connectivity accounted for the observed decorrelation. Our findings help ascertain the mechanisms underlying the ability of chronic patterned stimulation to create ensembles within cortical circuits and, importantly, show that while Up-states are a global network-wide phenomenon, functionally distinct ensembles can preserve their identity during Up-states through differential firing rates and correlations.SIGNIFICANCE STATEMENT The connectivity and activity patterns of local cortical circuits are shaped by experience. This experience-dependent reorganization of cortical circuits is driven by complex interactions between different local learning rules, external input, and reciprocal feedback between many distinct brain areas. Here we used an ex vivo approach to demonstrate how simple forms of chronic external stimulation can shape local cortical circuits in terms of their correlated activity and functional connectivity. The absence of feedback between different brain areas and full control of external input allowed for a tractable system to study the underlying mechanisms and development of a computational model. Results show that differential stimulation of subpopulations of neurons significantly reshapes cortical circuits and forms subnetworks referred to as neuronal ensembles.

A cortico-collicular circuit for orienting to shelter during escape

When faced with predatory threats, escape towards shelter is an adaptive action that offers long-term protection against the attacker. Animals rely on knowledge of safe locations in the environment to instinctively execute rapid shelter-directed escape actions1,2. Although previous work has identified neural mechanisms of escape initiation3,4, it is not known how the escape circuit incorporates spatial information to execute rapid flights along the most efficient route to shelter. Here we show that the mouse retrosplenial cortex (RSP) and superior colliculus (SC) form a circuit that encodes the shelter-direction vector and is specifically required for accurately orienting to shelter during escape. Shelter direction is encoded in RSP and SC neurons in egocentric coordinates and SC shelter-direction tuning depends on RSP activity. Inactivation of the RSP-SC pathway disrupts the orientation to shelter and causes escapes away from the optimal shelter-directed route, but does not lead to generic deficits in orientation or spatial navigation. We find that the RSP and SC are monosynaptically connected and form a feedforward lateral inhibition microcircuit that strongly drives the inhibitory collicular network because of higher RSP input convergence and synaptic integration efficiency in inhibitory SC neurons. This results in broad shelter-direction tuning in inhibitory SC neurons and sharply tuned excitatory SC neurons. These findings are recapitulated by a biologically constrained spiking network model in which RSP input to the local SC recurrent ring architecture generates a circular shelter-direction map. We propose that this RSP-SC circuit might be specialized for generating collicular representations of memorized spatial goals that are readily accessible to the motor system during escape, or more broadly, during navigation when the goal must be reached as fast as possible.

Intracellular chloride regulation mediates local sleep pressure in the cortex

Extended wakefulness is associated with reduced performance and the build-up of sleep pressure. In the cortex, this manifests as changes in network activity. These changes show local variation depending on the waking experience, and their underlying mechanisms represent targets for overcoming the effects of tiredness. Here, we reveal a central role for intracellular chloride regulation, which sets the strength of postsynaptic inhibition via GABAA receptors in cortical pyramidal neurons. Wakefulness results in depolarizing shifts in the equilibrium potential for GABAA receptors, reflecting local activity-dependent processes during waking and involving changes in chloride cotransporter activity. These changes underlie electrophysiological and behavioral markers of local sleep pressure within the cortex, including the levels of slow-wave activity during non-rapid eye movement sleep and low-frequency oscillatory activity and reduced performance levels in the sleep-deprived awake state. These findings identify chloride regulation as a crucial link between sleep-wake history, cortical activity and behavior.

Precise Spiking Motifs in Neurobiological and Neuromorphic Data

Why do neurons communicate through spikes? By definition, spikes are all-or-none neural events which occur at continuous times. In other words, spikes are on one side binary, existing or not without further details, and on the other, can occur at any asynchronous time, without the need for a centralized clock. This stands in stark contrast to the analog representation of values and the discretized timing classically used in digital processing and at the base of modern-day neural networks. As neural systems almost systematically use this so-called event-based representation in the living world, a better understanding of this phenomenon remains a fundamental challenge in neurobiology in order to better interpret the profusion of recorded data. With the growing need for intelligent embedded systems, it also emerges as a new computing paradigm to enable the efficient operation of a new class of sensors and event-based computers, called neuromorphic, which could enable significant gains in computation time and energy consumption-a major societal issue in the era of the digital economy and global warming. In this review paper, we provide evidence from biology, theory and engineering that the precise timing of spikes plays a crucial role in our understanding of the efficiency of neural networks.

Interneuronal network model of theta-nested fast oscillations predicts differential effects of heterogeneity, gap junctions and short term depression for hyperpolarizing versus shunting inhibition

Theta and gamma oscillations in the hippocampus have been hypothesized to play a role in the encoding and retrieval of memories. Recently, it was shown that an intrinsic fast gamma mechanism in medial entorhinal cortex can be recruited by optogenetic stimulation at theta frequencies, which can persist with fast excitatory synaptic transmission blocked, suggesting a contribution of interneuronal network gamma (ING). We calibrated the passive and active properties of a 100-neuron model network to capture the range of passive properties and frequency/current relationships of experimentally recorded PV+ neurons in the medial entorhinal cortex (mEC). The strength and probabilities of chemical and electrical synapses were also calibrated using paired recordings, as were the kinetics and short-term depression (STD) of the chemical synapses. Gap junctions that contribute a noticeable fraction of the input resistance were required for synchrony with hyperpolarizing inhibition; these networks exhibited theta-nested high frequency oscillations similar to the putative ING observed experimentally in the optogenetically-driven PV-ChR2 mice. With STD included in the model, the network desynchronized at frequencies above ~200 Hz, so for sufficiently strong drive, fast oscillations were only observed before the peak of the theta. Because hyperpolarizing synapses provide a synchronizing drive that contributes to robustness in the presence of heterogeneity, synchronization decreases as the hyperpolarizing inhibition becomes weaker. In contrast, networks with shunting inhibition required non-physiological levels of gap junctions to synchronize using conduction delays within the measured range.

Brian2Loihi: An emulator for the neuromorphic chip Loihi using the spiking neural network simulator Brian

Developing intelligent neuromorphic solutions remains a challenging endeavor. It requires a solid conceptual understanding of the hardware's fundamental building blocks. Beyond this, accessible and user-friendly prototyping is crucial to speed up the design pipeline. We developed an open source Loihi emulator based on the neural network simulator Brian that can easily be incorporated into existing simulation workflows. We demonstrate errorless Loihi emulation in software for a single neuron and for a recurrently connected spiking neural network. On-chip learning is also reviewed and implemented, with reasonable discrepancy due to stochastic rounding. This work provides a coherent presentation of Loihi's computational unit and introduces a new, easy-to-use Loihi prototyping package with the aim to help streamline conceptualization and deployment of new algorithms.

Reproducing and quantitatively validating a biologically-constrained point-neuron model of CA1 pyramidal cells

We have attempted to reproduce a biologically-constrained point-neuron model of CA1 pyramidal cells. The original models, developed for the Brian simulator, captured the frequency-current profiles of both strongly and weakly adapting cells. As part of the present study, we reproduced the model for different simulators, namely Brian2 and NEURON. The reproductions were attempted independent of the original Brian implementation, relying solely on the published article. The different implementations were quantitatively validated, to evaluate how well they mirror the original model. Additional tests were developed and packaged into a test suite, that helped further characterize and compare various aspects of these models, beyond the scope of the original study. Overall, we were able to reproduce the core features of the model, but observed certain unaccountable discrepancies. We demonstrate an approach for undertaking these evaluations, using the SciUnit framework, that allows for such quantitative validations of scientific models, to verify their accurate replication and/or reproductions. All resources employed and developed in our study have been publicly shared via the EBRAINS Live Papers platform.

Brian2CUDA: Flexible and Efficient Simulation of Spiking Neural Network Models on GPUs

Graphics processing units (GPUs) are widely available and have been used with great success to accelerate scientific computing in the last decade. These advances, however, are often not available to researchers interested in simulating spiking neural networks, but lacking the technical knowledge to write the necessary low-level code. Writing low-level code is not necessary when using the popular Brian simulator, which provides a framework to generate efficient CPU code from high-level model definitions in Python. Here, we present Brian2CUDA, an open-source software that extends the Brian simulator with a GPU backend. Our implementation generates efficient code for the numerical integration of neuronal states and for the propagation of synaptic events on GPUs, making use of their massively parallel arithmetic capabilities. We benchmark the performance improvements of our software for several model types and find that it can accelerate simulations by up to three orders of magnitude compared to Brian's CPU backend. Currently, Brian2CUDA is the only package that supports Brian's full feature set on GPUs, including arbitrary neuron and synapse models, plasticity rules, and heterogeneous delays. When comparing its performance with Brian2GeNN, another GPU-based backend for the Brian simulator with fewer features, we find that Brian2CUDA gives comparable speedups, while being typically slower for small and faster for large networks. By combining the flexibility of the Brian simulator with the simulation speed of GPUs, Brian2CUDA enables researchers to efficiently simulate spiking neural networks with minimal effort and thereby makes the advancements of GPU computing available to a larger audience of neuroscientists.

Computational models of neurotransmission at cerebellar synapses unveil the impact on network computation

The neuroscientific field benefits from the conjoint evolution of experimental and computational techniques, allowing for the reconstruction and simulation of complex models of neurons and synapses. Chemical synapses are characterized by presynaptic vesicle cycling, neurotransmitter diffusion, and postsynaptic receptor activation, which eventually lead to postsynaptic currents and subsequent membrane potential changes. These mechanisms have been accurately modeled for different synapses and receptor types (AMPA, NMDA, and GABA) of the cerebellar cortical network, allowing simulation of their impact on computation. Of special relevance is short-term synaptic plasticity, which generates spatiotemporal filtering in local microcircuits and controls burst transmission and information flow through the network. Here, we present how data-driven computational models recapitulate the properties of neurotransmission at cerebellar synapses. The simulation of microcircuit models is starting to reveal how diverse synaptic mechanisms shape the spatiotemporal profiles of circuit activity and computation.

Extended liquid state machines for speech recognition

A liquid state machine (LSM) is a biologically plausible model of a cortical microcircuit. It exists of a random, sparse reservoir of recurrently connected spiking neurons with fixed synapses and a trainable readout layer. The LSM exhibits low training complexity and enables backpropagation-free learning in a powerful, yet simple computing paradigm. In this work, the liquid state machine is enhanced by a set of bio-inspired extensions to create the extended liquid state machine (ELSM), which is evaluated on a set of speech data sets. Firstly, we ensure excitatory/inhibitory (E/I) balance to enable the LSM to operate in edge-of-chaos regime. Secondly, spike-frequency adaptation (SFA) is introduced in the LSM to improve the memory capabilities. Lastly, neuronal heterogeneity, by means of a differentiation in time constants, is introduced to extract a richer dynamical LSM response. By including E/I balance, SFA, and neuronal heterogeneity, we show that the ELSM consistently improves upon the LSM while retaining the benefits of the straightforward LSM structure and training procedure. The proposed extensions led up to an 5.2% increase in accuracy while decreasing the number of spikes in the ELSM up to 20.2% on benchmark speech data sets. On some benchmarks, the ELSM can even attain similar performances as the current state-of-the-art in spiking neural networks. Furthermore, we illustrate that the ELSM input-liquid and recurrent synaptic weights can be reduced to 4-bit resolution without any significant loss in classification performance. We thus show that the ELSM is a powerful, biologically plausible and hardware-friendly spiking neural network model that can attain near state-of-the-art accuracy on speech recognition benchmarks for spiking neural networks.

Multiple forms of working memory emerge from synapse-astrocyte interactions in a neuron-glia network model

Persistent activity in populations of neurons, time-varying activity across a neural population, or activity-silent mechanisms carried out by hidden internal states of the neural population have been proposed as different mechanisms of working memory (WM). Whether these mechanisms could be mutually exclusive or occur in the same neuronal circuit remains, however, elusive, and so do their biophysical underpinnings. While WM is traditionally regarded to depend purely on neuronal mechanisms, cortical networks also include astrocytes that can modulate neural activity. We propose and investigate a network model that includes both neurons and glia and show that glia-synapse interactions can lead to multiple stable states of synaptic transmission. Depending on parameters, these interactions can lead in turn to distinct patterns of network activity that can serve as substrates for WM.

Vector Symbolic Architectures as a Computing Framework for Emerging Hardware

This article reviews recent progress in the development of the computing framework Vector Symbolic Architectures (also known as Hyperdimensional Computing). This framework is well suited for implementation in stochastic, emerging hardware and it naturally expresses the types of cognitive operations required for Artificial Intelligence (AI). We demonstrate in this article that the field-like algebraic structure of Vector Symbolic Architectures offers simple but powerful operations on high-dimensional vectors that can support all data structures and manipulations relevant to modern computing. In addition, we illustrate the distinguishing feature of Vector Symbolic Architectures, "computing in superposition," which sets it apart from conventional computing. It also opens the door to efficient solutions to the difficult combinatorial search problems inherent in AI applications. We sketch ways of demonstrating that Vector Symbolic Architectures are computationally universal. We see them acting as a framework for computing with distributed representations that can play a role of an abstraction layer for emerging computing hardware. This article serves as a reference for computer architects by illustrating the philosophy behind Vector Symbolic Architectures, techniques of distributed computing with them, and their relevance to emerging computing hardware, such as neuromorphic computing.

Synaptic alterations in visual cortex reshape contrast-dependent gamma oscillations and inhibition-excitation ratio in a genetic mouse model of migraine

Background

Migraine affects a significant fraction of the world population, yet its etiology is not completely understood. In vitro results highlighted thalamocortical and intra-cortical glutamatergic synaptic gain-of-function associated with a monogenic form of migraine (familial-hemiplegic-migraine-type-1: FHM1). However, how these alterations reverberate on cortical activity remains unclear. As altered responsivity to visual stimuli and abnormal processing of visual sensory information are common hallmarks of migraine, herein we investigated the effects of FHM1-driven synaptic alterations in the visual cortex of awake mice.

Methods

We recorded extracellular field potentials from the primary visual cortex (V1) of head-fixed awake FHM1 knock-in (n = 12) and wild type (n = 12) mice in response to square-wave gratings with different visual contrasts. Additionally, we reproduced in silico the obtained experimental results with a novel spiking neurons network model of mouse V1, by implementing in the model both the synaptic alterations characterizing the FHM1 genetic mouse model adopted.

Results

FHM1 mice displayed similar amplitude but slower temporal evolution of visual evoked potentials. Visual contrast stimuli induced a lower increase of multi-unit activity in FHM1 mice, while the amount of information content about contrast level remained, however, similar to WT.

Spectral analysis of the local field potentials revealed an increase in the β/low γ range of WT mice following the abrupt reversal of contrast gratings. Such frequency range transitioned to the high γ range in FHM1 mice. Despite this change in the encoding channel, these oscillations preserved the amount of information conveyed about visual contrast. The computational model showed how these network effects may arise from a combination of changes in thalamocortical and intra-cortical synaptic transmission, with the former inducing a lower cortical activity and the latter inducing the higher frequencies ɣ oscillations.

Conclusions

Contrast-driven ɣ modulation in V1 activity occurs at a much higher frequency in FHM1. This is likely to play a role in the altered processing of visual information. Computational studies suggest that this shift is specifically due to enhanced cortical excitatory transmission. Our network model can help to shed light on the relationship between cellular and network levels of migraine neural alterations.

Graphical Abstract

Supplementary Information

The online version contains supplementary material available at 10.1186/s10194-022-01495-9.

The EBRAINS Hodgkin-Huxley Neuron Builder: An online resource for building data-driven neuron models

In the last decades, brain modeling has been established as a fundamental tool for understanding neural mechanisms and information processing in individual cells and circuits at different scales of observation. Building data-driven brain models requires the availability of experimental data and analysis tools as well as neural simulation environments and, often, large scale computing facilities. All these components are rarely found in a comprehensive framework and usually require ad hoc programming. To address this, we developed the EBRAINS Hodgkin-Huxley Neuron Builder (HHNB), a web resource for building single cell neural models via the extraction of activity features from electrophysiological traces, the optimization of the model parameters via a genetic algorithm executed on high performance computing facilities and the simulation of the optimized model in an interactive framework. Thanks to its inherent characteristics, the HHNB facilitates the data-driven model building workflow and its reproducibility, hence fostering a collaborative approach to brain modeling.

Center-surround interactions underlie bipolar cell motion sensitivity in the mouse retina

Motion sensing is a critical aspect of vision. We studied the representation of motion in mouse retinal bipolar cells and found that some bipolar cells are radially direction selective, preferring the origin of small object motion trajectories. Using a glutamate sensor, we directly observed bipolar cells synaptic output and found that there are radial direction selective and non-selective bipolar cell types, the majority being selective, and that radial direction selectivity relies on properties of the center-surround receptive field. We used these bipolar cell receptive fields along with connectomics to design biophysical models of downstream cells. The models and additional experiments demonstrated that bipolar cells pass radial direction selective excitation to starburst amacrine cells, which contributes to their directional tuning. As bipolar cells provide excitation to most amacrine and ganglion cells, their radial direction selectivity may contribute to motion processing throughout the visual system.

Optimal Mapping of Spiking Neural Network to Neuromorphic Hardware for Edge-AI

Neuromorphic hardware, the new generation of non-von Neumann computing system, implements spiking neurons and synapses to spiking neural network (SNN)-based applications. The energy-efficient property makes the neuromorphic hardware suitable for power-constrained environments where sensors and edge nodes of the internet of things (IoT) work. The mapping of SNNs onto neuromorphic hardware is challenging because a non-optimized mapping may result in a high network-on-chip (NoC) latency and energy consumption. In this paper, we propose NeuMap, a simple and fast toolchain, to map SNNs onto the multicore neuromorphic hardware. NeuMap first obtains the communication patterns of an SNN by calculation that simplifies the mapping process. Then, NeuMap exploits localized connections, divides the adjacent layers into a sub-network, and partitions each sub-network into multiple clusters while meeting the hardware resource constraints. Finally, we employ a meta-heuristics algorithm to search for the best cluster-to-core mapping scheme in the reduced searching space. We conduct experiments using six realistic SNN-based applications to evaluate NeuMap and two prior works (SpiNeMap and SNEAP). The experimental results show that, compared to SpiNeMap and SNEAP, NeuMap reduces the average energy consumption by 84% and 17% and has 55% and 12% lower spike latency, respectively.

Physiological noise facilitates multiplexed coding of vibrotactile-like signals in somatosensory cortex

Neurons can use different aspects of their spiking to simultaneously represent (multiplex) different features of a stimulus. For example, some pyramidal neurons in primary somatosensory cortex (S1) use the rate and timing of their spikes to, respectively, encode the intensity and frequency of vibrotactile stimuli. Doing so has several requirements. Because they fire at low rates, pyramidal neurons cannot entrain 1:1 with high-frequency (100 to 600 Hz) inputs and, instead, must skip (i.e., not respond to) some stimulus cycles. The proportion of skipped cycles must vary inversely with stimulus intensity for firing rate to encode stimulus intensity. Spikes must phase-lock to the stimulus for spike times (intervals) to encode stimulus frequency, but, in addition, skipping must occur irregularly to avoid aliasing. Using simulations and in vitro experiments in which mouse S1 pyramidal neurons were stimulated with inputs emulating those induced by vibrotactile stimuli, we show that fewer cycles are skipped as stimulus intensity increases, as required for rate coding, and that intrinsic or synaptic noise can induce irregular skipping without disrupting phase locking, as required for temporal coding. This occurs because noise can modulate the reliability without disrupting the precision of spikes evoked by small-amplitude, fast-onset signals. Specifically, in the fluctuation-driven regime associated with sparse spiking, rate and temporal coding are both paradoxically improved by the strong synaptic noise characteristic of the intact cortex. Our results demonstrate that multiplexed coding by S1 pyramidal neurons is not only feasible under in vivo conditions, but that background synaptic noise is actually beneficial.