Spike timing-dependent plasticity as the origin of the formation of clustered synaptic efficacy engrams

Moran's I quantifies spatio-temporal pattern formation in neural imaging data

Motivation

Neural activities of the brain occur through the formation of spatio-temporal patterns. In recent years, macroscopic neural imaging techniques have produced a large body of data on these patterned activities, yet a numerical measure of spatio-temporal coherence has often been reduced to the global order parameter, which does not uncover the degree of spatial correlation. Here, we propose to use the spatial autocorrelation measure Moran’s I, which can be applied to capture dynamic signatures of spatial organization. We demonstrate the application of this technique to collective cellular circadian clock activities measured in the small network of the suprachiasmatic nucleus (SCN) in the hypothalamus.

Results

We found that Moran’s I is a practical quantitative measure of the degree of spatial coherence in neural imaging data. Initially developed with a geographical context in mind, Moran’s I accounts for the spatial organization of any interacting units. Moran’s I can be modified in accordance with the characteristic length scale of a neural activity pattern. It allows a quantification of statistical significance levels for the observed patterns. We describe the technique applied to synthetic datasets and various experimental imaging time-series from cultured SCN explants. It is demonstrated that major characteristics of the collective state can be described by Moran’s I and the traditional Kuramoto order parameter R in a complementary fashion.

Availability and implementation

Python 2.7 code of illustrative examples can be found in the Supplementary Material.

Supplementary information

Supplementary data are available at Bioinformatics online.

Modulating STDP Balance Impacts the Dendritic Mosaic

The ability for cortical neurons to adapt their input/output characteristics and information processing capabilities ultimately relies on the interplay between synaptic plasticity, synapse location, and the nonlinear properties of the dendrite. Collectively, they shape both the strengths and spatial arrangements of convergent afferent inputs to neuronal dendrites. Recent experimental and theoretical studies support a clustered plasticity model, a view that synaptic plasticity promotes the formation of clusters or hotspots of synapses sharing similar properties. We have previously shown that spike timing-dependent plasticity (STDP) can lead to synaptic efficacies being arranged into spatially segregated clusters. This effectively partitions the dendritic tree into a tessellated imprint which we have called a dendritic mosaic. Here, using a biophysically detailed neuron model of a reconstructed layer 2/3 pyramidal cell and STDP learning, we investigated the impact of altered STDP balance on forming such a spatial organization. We show that cluster formation and extend depend on several factors, including the balance between potentiation and depression, the afferents' mean firing rate and crucially on the dendritic morphology. We find that STDP balance has an important role to play for this emergent mode of spatial organization since any imbalances lead to severe degradation- and in some case even destruction- of the mosaic. Our model suggests that, over a broad range of of STDP parameters, synaptic plasticity shapes the spatial arrangement of synapses, favoring the formation of clustered efficacy engrams.

Inter-synaptic learning of combination rules in a cortical network model

Selecting responses in working memory while processing combinations of stimuli depends strongly on their relations stored in long-term memory. However, the learning of XOR-like combinations of stimuli and responses according to complex rules raises the issue of the non-linear separability of the responses within the space of stimuli. One proposed solution is to add neurons that perform a stage of non-linear processing between the stimuli and responses, at the cost of increasing the network size. Based on the non-linear integration of synaptic inputs within dendritic compartments, we propose here an inter-synaptic (IS) learning algorithm that determines the probability of potentiating/depressing each synapse as a function of the co-activity of the other synapses within the same dendrite. The IS learning is effective with random connectivity and without either a priori wiring or additional neurons. Our results show that IS learning generates efficacy values that are sufficient for the processing of XOR-like combinations, on the basis of the sole correlational structure of the stimuli and responses. We analyze the types of dendrites involved in terms of the number of synapses from pre-synaptic neurons coding for the stimuli and responses. The synaptic efficacy values obtained show that different dendrites specialize in the detection of different combinations of stimuli. The resulting behavior of the cortical network model is analyzed as a function of inter-synaptic vs. Hebbian learning. Combinatorial priming effects show that the retrospective activity of neurons coding for the stimuli trigger XOR-like combination-selective prospective activity of neurons coding for the expected response. The synergistic effects of inter-synaptic learning and of mixed-coding neurons are simulated. The results show that, although each mechanism is sufficient by itself, their combined effects improve the performance of the network.

An Augmented Two-Layer Model Captures Nonlinear Analog Spatial Integration Effects in Pyramidal Neuron Dendrites

In pursuit of the goal to understand and eventually reproduce the diverse functions of the brain, a key challenge lies in reverse engineering the peculiar biology-based "technology" that underlies the brain's remarkable ability to process and store information. The basic building block of the nervous system is the nerve cell, or "neuron," yet after more than 100 years of neurophysiological study and 60 years of modeling, the information processing functions of individual neurons, and the parameters that allow them to engage in so many different types of computation (sensory, motor, mnemonic, executive, etc.) remain poorly understood. In this paper, we review both historical and recent findings that have led to our current understanding of the analog spatial processing capabilities of dendrites, the major input structures of neurons, with a focus on the principal cell type of the neocortex and hippocampus, the pyramidal neuron (PN). We encapsulate our current understanding of PN dendritic integration in an abstract layered model whose spatially sensitive branch-subunits compute multidimensional sigmoidal functions. Unlike the 1-D sigmoids found in conventional neural network models, multidimensional sigmoids allow the cell to implement a rich spectrum of nonlinear modulation effects directly within their dendritic trees.

Tunable low energy, compact and high performance neuromorphic circuit for spike-based synaptic plasticity

Cortical circuits in the brain have long been recognised for their information processing capabilities and have been studied both experimentally and theoretically via spiking neural networks. Neuromorphic engineers are primarily concerned with translating the computational capabilities of biological cortical circuits, using the Spiking Neural Network (SNN) paradigm, into in silico applications that can mimic the behaviour and capabilities of real biological circuits/systems. These capabilities include low power consumption, compactness, and relevant dynamics. In this paper, we propose a new accelerated-time circuit that has several advantages over its previous neuromorphic counterparts in terms of compactness, power consumption, and capability to mimic the outcomes of biological experiments. The presented circuit simulation results demonstrate that, in comparing the new circuit to previous published synaptic plasticity circuits, reduced silicon area and lower energy consumption for processing each spike is achieved. In addition, it can be tuned in order to closely mimic the outcomes of various spike timing- and rate-based synaptic plasticity experiments. The proposed circuit is also investigated and compared to other designs in terms of tolerance to mismatch and process variation. Monte Carlo simulation results show that the proposed design is much more stable than its previous counterparts in terms of vulnerability to transistor mismatch, which is a significant challenge in analog neuromorphic design. All these features make the proposed design an ideal circuit for use in large scale SNNs, which aim at implementing neuromorphic systems with an inherent capability that can adapt to a continuously changing environment, thus leading to systems with significant learning and computational abilities.

Stable learning in stochastic network states

The mammalian cerebral cortex is characterized in vivo by irregular spontaneous activity, but how this ongoing dynamics affects signal processing and learning remains unknown. The associative plasticity rules demonstrated in vitro, mostly in silent networks, are based on the detection of correlations between presynaptic and postsynaptic activity and hence are sensitive to spontaneous activity and spurious correlations. Therefore, they cannot operate in realistic network states. Here, we present a new class of spike-timing-dependent plasticity learning rules with local floating plasticity thresholds, the slow dynamics of which account for metaplasticity. This novel algorithm is shown to both correctly predict homeostasis in synaptic weights and solve the problem of asymptotic stable learning in noisy states. It is shown to naturally encompass many other known types of learning rule, unifying them into a single coherent framework. The mixed presynaptic and postsynaptic dependency of the floating plasticity threshold is justified by a cascade of known molecular pathways, which leads to experimentally testable predictions.