Symmetry of learning rate in synaptic plasticity modulates formation of flexible and stable memories

Comparison of visual quantities in untrained neural networks

The ability to compare quantities of visual objects with two distinct measures, proportion and difference, is observed even in newborn animals. However, how this function originates in the brain, even before visual experience, remains unknown. Here, we propose a model in which neuronal tuning for quantity comparisons can arise spontaneously in completely untrained neural circuits. Using a biologically inspired model neural network, we find that single units selective to proportions and differences between visual quantities emerge in randomly initialized feedforward wirings and that they enable the network to perform quantity comparison tasks. Notably, we find that two distinct tunings to proportion and difference originate from a random summation of monotonic, nonlinear neural activities and that a slight difference in the nonlinear response function determines the type of measure. Our results suggest that visual quantity comparisons are primitive types of functions that can emerge spontaneously before learning in young brains.

Species-specific wiring of cortical circuits for small-world networks in the primary visual cortex

Long-range horizontal connections (LRCs) are conspicuous anatomical structures in the primary visual cortex (V1) of mammals, yet their detailed functions in relation to visual processing are not fully understood. Here, we show that LRCs are key components to organize a "small-world network" optimized for each size of the visual cortex, enabling the cost-efficient integration of visual information. Using computational simulations of a biologically inspired model neural network, we found that sparse LRCs added to networks, combined with dense local connections, compose a small-world network and significantly enhance image classification performance. We confirmed that the performance of the network appeared to be strongly correlated with the small-world coefficient of the model network under various conditions. Our theoretical model demonstrates that the amount of LRCs to build a small-world network depends on each size of cortex and that LRCs are beneficial only when the size of the network exceeds a certain threshold. Our model simulation of various sizes of cortices validates this prediction and provides an explanation of the species-specific existence of LRCs in animal data. Our results provide insight into a biological strategy of the brain to balance functional performance and resource cost.

Stochastic binary synapses having sigmoidal cumulative distribution functions for unsupervised learning with spike timing-dependent plasticity

Spike timing-dependent plasticity (STDP), which is widely studied as a fundamental synaptic update rule for neuromorphic hardware, requires precise control of continuous weights. From the viewpoint of hardware implementation, a simplified update rule is desirable. Although simplified STDP with stochastic binary synapses was proposed previously, we find that it leads to degradation of memory maintenance during learning, which is unfavourable for unsupervised online learning. In this work, we propose a stochastic binary synaptic model where the cumulative probability of the weight change evolves in a sigmoidal fashion with potentiation or depression trials, which can be implemented using a pair of switching devices consisting of serially connected multiple binary memristors. As a benchmark test we perform simulations of unsupervised learning of MNIST images with a two-layer network and show that simplified STDP in combination with this model can outperform conventional rules with continuous weights not only in memory maintenance but also in recognition accuracy. Our method achieves 97.3% in recognition accuracy, which is higher than that reported with standard STDP in the same framework. We also show that the high performance of our learning rule is robust against device-to-device variability of the memristor's probabilistic behaviour.

Inhibition of RhoA/Rho kinase signaling pathway by fasudil protects against kainic acid-induced neurite injury

AIM

RhoA/Rho kinase pathway is essential for regulating cytoskeletal structure. Although its effect on normal neurite outgrowth has been demonstrated, the role of this pathway in seizure-induced neurite injury has not been revealed. The research examined the phosphorylation level of RhoA/Rho kinase signaling pathway and to clarify the effect of fasudil on RhoA/Rho kinase signaling pathway and neurite outgrowth in kainic acid (KA)-treated Neuro-2A cells and hippocampal neurons.

METHOD

Western blotting analysis was used to investigate the expression of key proteins of RhoA/Rho kinase signaling pathway and the depolymerization of actin. After incubated without serum to induce neurite outgrowth, Neuro-2A cells were fixed, and immunofluorescent assay of rhodamine-phalloidin was applied to detect the cellular morphology and neurite length. The influence of KA on neurons was detected in primary hippocampal neurons. Whole-cell patch clamp was conducted in cultured neurons or hippocampal slices to record action potentials.

RESULT

KA at the dose of 100-200 μmol/L induced the increase in phosphorylation of Rho-associated coiled-coil-containing protein kinase and decrease in phosphorylation of Lin11, Isl-1 and Mec-3 kinase and cofilin. The effect of 200 μmol/L KA was peaked at 1-2 hours, and then gradually returned to baseline after 8 hours. Pretreatment with Rho kinase inhibitor fasudil reversed KA-induced activation of RhoA/Rho kinase pathway and increase in phosphorylation of slingshot and 14-3-3, which consequently reduced the ratio of G/F-actin. KA treatment induced inhibition of neurite outgrowth and decrease in spines both in Neuro-2a cells and in cultured hippocampal neurons, and pretreatment with fasudil alleviated KA-induced neurite outgrowth inhibition and spine loss.

CONCLUSION

These data indicate that inhibiting RhoA/Rho kinase pathway might be a potential treatment for seizure-induced injury.

Retino-Cortical Mapping Ratio Predicts Columnar and Salt-and-Pepper Organization in Mammalian Visual Cortex

In the mammalian primary visual cortex, neural tuning to stimulus orientation is organized in either columnar or salt-and-pepper patterns across species. For decades, this sharp contrast has spawned fundamental questions about the origin of functional architectures in visual cortex. However, it is unknown whether these patterns reflect disparate developmental mechanisms across mammalian taxa or simply originate from variation of biological parameters under a universal development process. In this work, after the analysis of data from eight mammalian species, we show that cortical organization is predictable by a single factor, the retino-cortical mapping ratio. Groups of species with or without columnar clustering are distinguished by the feedforward sampling ratio, and model simulations with controlled mapping conditions reproduce both types of organization. Prediction from the Nyquist theorem explains this parametric division of the patterns with high accuracy. Our results imply that evolutionary variation of physical parameters may induce development of distinct functional circuitry.

Visual number sense in untrained deep neural networks

Number sense, the ability to estimate numerosity, is observed in naïve animals, but how this cognitive function emerges in the brain remains unclear. Here, using an artificial deep neural network that models the ventral visual stream of the brain, we show that number-selective neurons can arise spontaneously, even in the complete absence of learning. We also show that the responses of these neurons can induce the abstract number sense, the ability to discriminate numerosity independent of low-level visual cues. We found number tuning in a randomly initialized network originating from a combination of monotonically decreasing and increasing neuronal activities, which emerges spontaneously from the statistical properties of bottom-up projections. We confirmed that the responses of these number-selective neurons show the single- and multineuron characteristics observed in the brain and enable the network to perform number comparison tasks. These findings provide insight into the origin of innate cognitive functions.

A brain-inspired network architecture for cost-efficient object recognition in shallow hierarchical neural networks

The brain successfully performs visual object recognition with a limited number of hierarchical networks that are much shallower than artificial deep neural networks (DNNs) that perform similar tasks. Here, we show that long-range horizontal connections (LRCs), often observed in the visual cortex of mammalian species, enable such a cost-efficient visual object recognition in shallow neural networks. Using simulations of a model hierarchical network with convergent feedforward connections and LRCs, we found that the addition of LRCs to the shallow feedforward network significantly enhances the performance of networks for image classification, to a degree that is comparable to much deeper networks. We found that a combination of sparse LRCs and dense local connections dramatically increases performance per wiring cost. From network pruning with gradient-based optimization, we also confirmed that LRCs could emerge spontaneously by minimizing the total connection length while maintaining performance. Ablation of emerged LRCs led to a significant reduction of classification performance, which implies these LRCs are crucial for performing image classification. Taken together, our findings suggest a brain-inspired strategy for constructing a cost-efficient network architecture to implement parsimonious object recognition under physical constraints such as shallow hierarchical depth.

Spontaneous Retinal Waves Can Generate Long-Range Horizontal Connectivity in Visual Cortex

In the primary visual cortex (V1) of higher mammals, long-range horizontal connections (LHCs) are observed to develop, linking iso-orientation domains of cortical tuning. It is unknown how this feature-specific wiring of circuitry develops before eye-opening. Here, we suggest that LHCs in V1 may originate from spatiotemporally structured feedforward activities generated from spontaneous retinal waves. Using model simulations based on the anatomy and observed activity patterns of the retina, we show that waves propagating in retinal mosaics can initialize the wiring of LHCs by coactivating neurons of similar tuning, whereas equivalent random activities cannot induce such organizations. Simulations showed that emerged LHCs can produce the patterned activities observed in V1, matching the topography of the underlying orientation map. The model can also reproduce feature-specific microcircuits in the salt-and-pepper organizations found in rodents. Our results imply that early peripheral activities contribute significantly to cortical development of functional circuits.SIGNIFICANCE STATEMENT Long-range horizontal connections (LHCs) in the primary visual cortex (V1) are observed to emerge before the onset of visual experience, thereby selectively connecting iso-domains of orientation map. However, it is unknown how such feature-specific wirings develop before eye-opening. Here, we show that LHCs in V1 may originate from the feature-specific activation of cortical neurons by spontaneous retinal waves during early developmental stages. Our simulations of a visual cortex model show that feedforward activities from the retina initialize the spatial organization of activity patterns in V1, which induces visual feature-specific wirings in the V1 neurons. Our model also explains the origin of cortical microcircuits observed in rodents, suggesting that the proposed developmental mechanism is universally applicable to circuits of various mammalian species.

Population coupling predicts the plasticity of stimulus responses in cortical circuits

Some neurons have stimulus responses that are stable over days, whereas other neurons have highly plastic stimulus responses. Using a recurrent network model, we explore whether this could be due to an underlying diversity in their synaptic plasticity. We find that, in a network with diverse learning rates, neurons with fast rates are more coupled to population activity than neurons with slow rates. This plasticity-coupling link predicts that neurons with high population coupling exhibit more long-term stimulus response variability than neurons with low population coupling. We substantiate this prediction using recordings from the Allen Brain Observatory, finding that a neuron's population coupling is correlated with the plasticity of its orientation preference. Simulations of a simple perceptual learning task suggest a particular functional architecture: a stable 'backbone' of stimulus representation formed by neurons with low population coupling, on top of which lies a flexible substrate of neurons with high population coupling.

Learning spatiotemporal signals using a recurrent spiking network that discretizes time

Learning to produce spatiotemporal sequences is a common task that the brain has to solve. The same neurons may be used to produce different sequential behaviours. The way the brain learns and encodes such tasks remains unknown as current computational models do not typically use realistic biologically-plausible learning. Here, we propose a model where a spiking recurrent network of excitatory and inhibitory spiking neurons drives a read-out layer: the dynamics of the driver recurrent network is trained to encode time which is then mapped through the read-out neurons to encode another dimension, such as space or a phase. Different spatiotemporal patterns can be learned and encoded through the synaptic weights to the read-out neurons that follow common Hebbian learning rules. We demonstrate that the model is able to learn spatiotemporal dynamics on time scales that are behaviourally relevant and we show that the learned sequences are robustly replayed during a regime of spontaneous activity.

Distinct role of flexible and stable encodings in sequential working memory

The serial-position effect in working memory is considered important for studying how a sequence of sensory information can be retained and manipulated simultaneously in neural memory circuits. Here, via a precise analysis of the primacy and recency effects in human psychophysical experiments, we propose that stable and flexible codings take distinct roles of retaining and updating information in working memory, and that their combination induces serial-position effects spontaneously. We found that stable encoding retains memory to induce the primacy effect, while flexible encoding used for learning new inputs induces the recency effect. A model simulation based on human data, confirmed that a neural network with both flexible and stable synapses could reproduce the major characteristics of serial-position effects. Our new prediction, that the control of resource allocation by flexible-stable coding balance can modulate memory performance in sequence-specific manner, was supported by pre-cued memory performance data in humans.

Biological learning curves outperform existing ones in artificial intelligence algorithms

Recently, deep learning algorithms have outperformed human experts in various tasks across several domains; however, their characteristics are distant from current knowledge of neuroscience. The simulation results of biological learning algorithms presented herein outperform state-of-the-art optimal learning curves in supervised learning of feedforward networks. The biological learning algorithms comprise asynchronous input signals with decaying input summation, weights adaptation, and multiple outputs for an input signal. In particular, the generalization error for such biological perceptrons decreases rapidly with increasing number of examples, and it is independent of the size of the input. This is achieved using either synaptic learning, or solely through dendritic adaptation with a mechanism of swinging between reflecting boundaries, without learning steps. The proposed biological learning algorithms outperform the optimal scaling of the learning curve in a traditional perceptron. It also results in a considerable robustness to disparity between weights of two networks with very similar outputs in biological supervised learning scenarios. The simulation results indicate the potency of neurobiological mechanisms and open opportunities for developing a superior class of deep learning algorithms.

Nuclear factor-kappa β as a therapeutic target for Alzheimer's disease

Alzheimer's disease (AD) is a typical progressive, chronic neurodegenerative disorder with worldwide prevalence. Its clinical manifestation involves the presence of extracellular plaques and intracellular neurofibrillary tangles (NFTs). NFTs occur in brain tissues as a result of both Aβ agglomeration and Tau phosphorylation. Although there is no known cure for AD, research into possible cures and treatment options continues using cell-cultures and model animals/organisms. The nuclear factor-kappa β (NF-κβ) plays an active role in the progression of AD. Impairment to this signaling module triggers undesirable phenotypic changes such as neuroinflammation, activation of microglia, oxidative stress related complications, and apoptotic cell death. These imbalances further lead to homeostatic abnormalities in the brain or in initial stages of AD essentially pushing normal neurons toward the degeneration process. Interestingly, the role of NF-κβ signaling associated receptor-interacting protein kinase is currently observed in apoptotic and necrotic cell death, and has been reported in brains. Conversely, the NF-κβ signaling pathway has also been reported to be involved in normal brain functioning. This pathway plays a crucial role in maintaining synaptic plasticity and balancing between learning and memory. Since any impairment in the pathways associated with NF-κβ signaling causes altered neuronal dynamics, neurotherapeutics using compounds including, antioxidants, bioflavonoids, and non-steroidal anti-inflammatory drugs against such abnormalities offer possibilities to rectify aberrant excitatory neuronal activity in AD. In this review, we have provided an extensive overview of the crucial role of NF-κβ signaling in normal brain homeostasis. We have also thoroughly outlined several established pathomechanisms associated with NF-κβ pathways in AD, along with their respective therapeutic approaches.

Stationary log-normal distribution of weights stems from spontaneous ordering in adaptive node networks

Experimental evidence recently indicated that neural networks can learn in a different manner than was previously assumed, using adaptive nodes instead of adaptive links. Consequently, links to a node undergo the same adaptation, resulting in cooperative nonlinear dynamics with oscillating effective link weights. Here we show that the biological reality of stationary log-normal distribution of effective link weights in neural networks is a result of such adaptive nodes, although each effective link weight varies significantly in time. The underlying mechanism is a stochastic restoring force emerging from a spontaneous temporal ordering of spike pairs, generated by strong effective link preceding by a weak one. In addition, for feedforward adaptive node networks the number of dynamical attractors can scale exponentially with the number of links. These results are expected to advance deep learning capabilities and to open horizons to an interplay between adaptive node rules and the distribution of network link weights.

Adaptive nodes enrich nonlinear cooperative learning beyond traditional adaptation by links

Physical models typically assume time-independent interactions, whereas neural networks and machine learning incorporate interactions that function as adjustable parameters. Here we demonstrate a new type of abundant cooperative nonlinear dynamics where learning is attributed solely to the nodes, instead of the network links which their number is significantly larger. The nodal, neuronal, fast adaptation follows its relative anisotropic (dendritic) input timings, as indicated experimentally, similarly to the slow learning mechanism currently attributed to the links, synapses. It represents a non-local learning rule, where effectively many incoming links to a node concurrently undergo the same adaptation. The network dynamics is now counterintuitively governed by the weak links, which previously were assumed to be insignificant. This cooperative nonlinear dynamic adaptation presents a self-controlled mechanism to prevent divergence or vanishing of the learning parameters, as opposed to learning by links, and also supports self-oscillations of the effective learning parameters. It hints on a hierarchical computational complexity of nodes, following their number of anisotropic inputs and opens new horizons for advanced deep learning algorithms and artificial intelligence based applications, as well as a new mechanism for enhanced and fast learning by neural networks.