Hebbian plasticity requires compensatory processes on multiple timescales

Co-existence of synaptic plasticity and metastable dynamics in a spiking model of cortical circuits

Evidence for metastable dynamics and its role in brain function is emerging at a fast pace and is changing our understanding of neural coding by putting an emphasis on hidden states of transient activity. Clustered networks of spiking neurons have enhanced synaptic connections among groups of neurons forming structures called cell assemblies; such networks are capable of producing metastable dynamics that is in agreement with many experimental results. However, it is unclear how a clustered network structure producing metastable dynamics may emerge from a fully local plasticity rule, i.e., a plasticity rule where each synapse has only access to the activity of the neurons it connects (as opposed to the activity of other neurons or other synapses). Here, we propose a local plasticity rule producing ongoing metastable dynamics in a deterministic, recurrent network of spiking neurons. The metastable dynamics co-exists with ongoing plasticity and is the consequence of a self-tuning mechanism that keeps the synaptic weights close to the instability line where memories are spontaneously reactivated. In turn, the synaptic structure is stable to ongoing dynamics and random perturbations, yet it remains sufficiently plastic to remap sensory representations to encode new sets of stimuli. Both the plasticity rule and the metastable dynamics scale well with network size, with synaptic stability increasing with the number of neurons. Overall, our results show that it is possible to generate metastable dynamics over meaningful hidden states using a simple but biologically plausible plasticity rule which co-exists with ongoing neural dynamics.

Co-existence of synaptic plasticity and metastable dynamics in a spiking model of cortical circuits

Evidence for metastable dynamics and its role in brain function is emerging at a fast pace and is changing our understanding of neural coding by putting an emphasis on hidden states of transient activity. Clustered networks of spiking neurons have enhanced synaptic connections among groups of neurons forming structures called cell assemblies; such networks are capable of producing metastable dynamics that is in agreement with many experimental results. However, it is unclear how a clustered network structure producing metastable dynamics may emerge from a fully local plasticity rule, i.e., a plasticity rule where each synapse has only access to the activity of the neurons it connects (as opposed to the activity of other neurons or other synapses). Here, we propose a local plasticity rule producing ongoing metastable dynamics in a deterministic, recurrent network of spiking neurons. The metastable dynamics co-exists with ongoing plasticity and is the consequence of a self-tuning mechanism that keeps the synaptic weights close to the instability line where memories are spontaneously reactivated. In turn, the synaptic structure is stable to ongoing dynamics and random perturbations, yet it remains sufficiently plastic to remap sensory representations to encode new sets of stimuli. Both the plasticity rule and the metastable dynamics scale well with network size, with synaptic stability increasing with the number of neurons. Overall, our results show that it is possible to generate metastable dynamics over meaningful hidden states using a simple but biologically plausible plasticity rule which co-exists with ongoing neural dynamics.

Synaptic homeostasis transiently leverages Hebbian mechanisms for a multiphasic response to inactivity

Homeostatic regulation of synapses is vital for nervous system function and key to understanding a range of neurological conditions. Synaptic homeostasis is proposed to operate over hours to counteract the destabilizing influence of long-term potentiation (LTP) and long-term depression (LTD). The prevailing view holds that synaptic scaling is a slow first-order process that regulates postsynaptic glutamate receptors and fundamentally differs from LTP or LTD. Surprisingly, we find that the dynamics of scaling induced by neuronal inactivity are not exponential or monotonic, and the mechanism requires calcineurin and CaMKII, molecules dominant in LTD and LTP. Our quantitative model of these enzymes reconstructs the unexpected dynamics of homeostatic scaling and reveals how synapses can efficiently safeguard future capacity for synaptic plasticity. This mechanism of synaptic adaptation supports a broader set of homeostatic changes, including action potential autoregulation, and invites further inquiry into how such a mechanism varies in health and disease.

Brain topology improved spiking neural network for efficient reinforcement learning of continuous control

The brain topology highly reflects the complex cognitive functions of the biological brain after million-years of evolution. Learning from these biological topologies is a smarter and easier way to achieve brain-like intelligence with features of efficiency, robustness, and flexibility. Here we proposed a brain topology-improved spiking neural network (BT-SNN) for efficient reinforcement learning. First, hundreds of biological topologies are generated and selected as subsets of the Allen mouse brain topology with the help of the Tanimoto hierarchical clustering algorithm, which has been widely used in analyzing key features of the brain connectome. Second, a few biological constraints are used to filter out three key topology candidates, including but not limited to the proportion of node functions (e.g., sensation, memory, and motor types) and network sparsity. Third, the network topology is integrated with the hybrid numerical solver-improved leaky-integrated and fire neurons. Fourth, the algorithm is then tuned with an evolutionary algorithm named adaptive random search instead of backpropagation to guide synaptic modifications without affecting raw key features of the topology. Fifth, under the test of four animal-survival-like RL tasks (i.e., dynamic controlling in Mujoco), the BT-SNN can achieve higher scores than not only counterpart SNN using random topology but also some classical ANNs (i.e., long-short-term memory and multi-layer perception). This result indicates that the research effort of incorporating biological topology and evolutionary learning rules has much in store for the future.

A fractional-order Wilson-Cowan formulation of cortical disinhibition

This work presents a fractional-order Wilson-Cowan model derivation under Caputo's formalism, considering an order of 0 < α ≤ 1 . To that end, we propose memory-dependent response functions and average neuronal excitation functions that permit us to naturally arrive at a fractional-order model that incorporates past dynamics into the description of synaptically coupled neuronal populations' activity. We then shift our focus on a particular example, aiming to analyze the fractional-order dynamics of the disinhibited cortex. This system mimics cortical activity observed during neurological disorders such as epileptic seizures, where an imbalance between excitation and inhibition is present, which allows brain dynamics to transition to a hyperexcited activity state. In the context of the first-order mathematical model, we recover traditional results showing a transition from a low-level activity state to a potentially pathological high-level activity state as an external factor modifies cortical inhibition. On the other hand, under the fractional-order formulation, we establish novel results showing that the system resists such transition as the order is decreased, permitting the possibility of staying in the low-activity state even with increased disinhibition. Furthermore, considering the memory index interpretation of the fractional-order model motivation here developed, our results establish that by increasing the memory index, the system becomes more resistant to transitioning towards the high-level activity state. That is, one possible effect of the memory index is to stabilize neuronal activity. Noticeably, this neuronal stabilizing effect is similar to homeostatic plasticity mechanisms. To summarize our results, we present a two-parameter structural portrait describing the system's dynamics dependent on a proposed disinhibition parameter and the order. We also explore numerical model simulations to validate our results.

Learning what matters: Synaptic plasticity with invariance to second-order input correlations

Cortical populations of neurons develop sparse representations adapted to the statistics of the environment. To learn efficient population codes, synaptic plasticity mechanisms must differentiate relevant latent features from spurious input correlations, which are omnipresent in cortical networks. Here, we develop a theory for sparse coding and synaptic plasticity that is invariant to second-order correlations in the input. Going beyond classical Hebbian learning, our learning objective explains the functional form of observed excitatory plasticity mechanisms, showing how Hebbian long-term depression (LTD) cancels the sensitivity to second-order correlations so that receptive fields become aligned with features hidden in higher-order statistics. Invariance to second-order correlations enhances the versatility of biologically realistic learning models, supporting optimal decoding from noisy inputs and sparse population coding from spatially correlated stimuli. In a spiking model with triplet spike-timing-dependent plasticity (STDP), we show that individual neurons can learn localized oriented receptive fields, circumventing the need for input preprocessing, such as whitening, or population-level lateral inhibition. The theory advances our understanding of local unsupervised learning in cortical circuits, offers new interpretations of the Bienenstock-Cooper-Munro and triplet STDP models, and assigns a specific functional role to synaptic LTD mechanisms in pyramidal neurons.

Diversity-induced trivialization and resilience of neural dynamics

Heterogeneity is omnipresent across all living systems. Diversity enriches the dynamical repertoire of these systems but remains challenging to reconcile with their manifest robustness and dynamical persistence over time, a fundamental feature called resilience. To better understand the mechanism underlying resilience in neural circuits, we considered a nonlinear network model, extracting the relationship between excitability heterogeneity and resilience. To measure resilience, we quantified the number of stationary states of this network, and how they are affected by various control parameters. We analyzed both analytically and numerically gradient and non-gradient systems modeled as non-linear sparse neural networks evolving over long time scales. Our analysis shows that neuronal heterogeneity quenches the number of stationary states while decreasing the susceptibility to bifurcations: a phenomenon known as trivialization. Heterogeneity was found to implement a homeostatic control mechanism enhancing network resilience to changes in network size and connection probability by quenching the system's dynamic volatility.

Effects of Mobile Intelligent Cognitive Training for Patients with Post-Stroke Cognitive Impairment: A 12-Week, Multicenter, Randomized Controlled Study

Background

The current application effects of computerized cognitive intervention are inconsistent and limited to hospital rehabilitation settings.

Objective

To investigate the effect of mobile intelligent cognitive training (MICT) on patients with post-stroke cognitive impairment (PSCI).

Methods

This study was a multicenter, prospective, open-label, blinded endpoint, cluster-randomized controlled trial (RCT). 518 PSCI patients were stratified and assigned to four rehabilitation settings, and then patients were randomized into experimental and control groups in each rehabilitation setting through cluster randomization. All patients received comprehensive management for PSCI, while the experimental group additionally received MICT intervention. Treatment was 30 minutes daily, 5 days per week, for 12 weeks. Cognitive function, activities of daily living (ADL), and quality of life (QOL) were assessed before the treatment, at weeks 6 and 12 post-treatment, and a 16-week follow-up.

Results

Linear Mixed Effects Models showed patients with PSCI were better off than pre-treatment patients on each outcome measure (p < 0.05). Additionally, the improvement of these outcomes in the experimental group was significantly better than in the control group at week 6 post-treatment and 16-week follow-up (p < 0.05). The rehabilitation setting also affected the cognitive efficacy of MICT intervention in improving PSCI patients, and the degree of improvement in each outcome was found to be highest in hospital, followed by community, nursing home, and home settings.

Conclusions

Long-term MICT intervention can improve cognition, ADL, and QOL in patients with PSCI, with sustained effects for at least one month. Notably, different rehabilitation settings affect the cognitive intervention efficacy of MICT on PSCI patients. However, this still needs to be further determined in future studies.

Plasticity-stability dynamics during post-training processing of learning

Learning continues beyond the end of training. Post-training learning is supported by changes in plasticity and stability in the brain during both wakefulness and sleep. However, the lack of a unified measure for assessing plasticity and stability dynamics during training and post-training periods has limited our understanding of how these dynamics shape learning. Focusing primarily on procedural learning, we integrate work using behavioral paradigms and a recently developed measure, the excitatory-to-inhibitory (E/I) ratio, to explore the delicate balance between plasticity and stability and its relationship to post-training learning. This reveals plasticity-stability cycles during both wakefulness and sleep that enhance learning and protect it from new learning during post-training processing.

A dynamic attractor network model of memory formation, reinforcement and forgetting

Empirical evidence shows that memories that are frequently revisited are easy to recall, and that familiar items involve larger hippocampal representations than less familiar ones. In line with these observations, here we develop a modelling approach to provide a mechanistic understanding of how hippocampal neural assemblies evolve differently, depending on the frequency of presentation of the stimuli. For this, we added an online Hebbian learning rule, background firing activity, neural adaptation and heterosynaptic plasticity to a rate attractor network model, thus creating dynamic memory representations that can persist, increase or fade according to the frequency of presentation of the corresponding memory patterns. Specifically, we show that a dynamic interplay between Hebbian learning and background firing activity can explain the relationship between the memory assembly sizes and their frequency of stimulation. Frequently stimulated assemblies increase their size independently from each other (i.e. creating orthogonal representations that do not share neurons, thus avoiding interference). Importantly, connections between neurons of assemblies that are not further stimulated become labile so that these neurons can be recruited by other assemblies, providing a neuronal mechanism of forgetting.

Pre- and postsynaptic N-methyl-D-aspartate receptors are required for sequential printing of fear memory engrams

The organization of fear memory involves the participation of multiple brain regions. However, it is largely unknown how fear memory is formed, which circuit pathways are used for "printing" memory engrams across brain regions, and the role of identified brain circuits in memory retrieval. With advanced genetic methods, we combinatorially blocked presynaptic output and manipulated N-methyl-D-aspartate receptor (NMDAR) in the basolateral amygdala (BLA) and medial prefrontal cortex (mPFC) before and after cued fear conditioning. Further, we tagged fear-activated neurons during associative learning for optogenetic memory recall. We found that presynaptic mPFC and postsynaptic BLA NMDARs are required for fear memory formation, but not expression. Our results provide strong evidence that NMDAR-dependent synaptic plasticity drives multi-trace systems consolidation for the sequential printing of fear memory engrams from BLA to mPFC and, subsequently, to the other regions, for flexible memory retrieval.

Rapid compensatory plasticity revealed by dynamic correlated activity in monkeys in vivo

To produce adaptive behavior, neural networks must balance between plasticity and stability. Computational work has demonstrated that network stability requires plasticity mechanisms to be counterbalanced by rapid compensatory processes. However, such processes have yet to be experimentally observed. Here we demonstrate that repeated optogenetic activation of excitatory neurons in monkey visual cortex (area V1) induces a population-wide dynamic reduction in the strength of neuronal interactions over the timescale of minutes during the awake state, but not during rest. This new form of rapid plasticity was observed only in the correlation structure, with firing rates remaining stable across trials. A computational network model operating in the balanced regime confirmed experimental findings and revealed that inhibitory plasticity is responsible for the decrease in correlated activity in response to repeated light stimulation. These results provide the first experimental evidence for rapid homeostatic plasticity that primarily operates during wakefulness, which stabilizes neuronal interactions during strong network co-activation.

Learning efficient representations of environmental priors in working memory

Experience shapes our expectations and helps us learn the structure of the environment. Inference models render such learning as a gradual refinement of the observer's estimate of the environmental prior. For instance, when retaining an estimate of an object's features in working memory, learned priors may bias the estimate in the direction of common feature values. Humans display such biases when retaining color estimates on short time intervals. We propose that these systematic biases emerge from modulation of synaptic connectivity in a neural circuit based on the experienced stimulus history, shaping the persistent and collective neural activity that encodes the stimulus estimate. Resulting neural activity attractors are aligned to common stimulus values. Using recently published human response data from a delayed-estimation task in which stimuli (colors) were drawn from a heterogeneous distribution that did not necessarily correspond with reported population biases, we confirm that most subjects' response distributions are better described by experience-dependent learning models than by models with fixed biases. This work suggests systematic limitations in working memory reflect efficient representations of inferred environmental structure, providing new insights into how humans integrate environmental knowledge into their cognitive strategies.

The combination of Hebbian and predictive plasticity learns invariant object representations in deep sensory networks

Recognition of objects from sensory stimuli is essential for survival. To that end, sensory networks in the brain must form object representations invariant to stimulus changes, such as size, orientation and context. Although Hebbian plasticity is known to shape sensory networks, it fails to create invariant object representations in computational models, raising the question of how the brain achieves such processing. In the present study, we show that combining Hebbian plasticity with a predictive form of plasticity leads to invariant representations in deep neural network models. We derive a local learning rule that generalizes to spiking neural networks and naturally accounts for several experimentally observed properties of synaptic plasticity, including metaplasticity and spike-timing-dependent plasticity. Finally, our model accurately captures neuronal selectivity changes observed in the primate inferotemporal cortex in response to altered visual experience. Thus, we provide a plausible normative theory emphasizing the importance of predictive plasticity mechanisms for successful representational learning.

BTSP, not STDP, Drives Shifts in Hippocampal Representations During Familiarization

Synaptic plasticity is widely thought to support memory storage in the brain, but the rules determining impactful synaptic changes in-vivo are not known. We considered the trial-by-trial shifting dynamics of hippocampal place fields (PFs) as an indicator of ongoing plasticity during memory formation. By implementing different plasticity rules in computational models of spiking place cells and comparing to experimentally measured PFs from mice navigating familiar and novel environments, we found that Behavioral-Timescale-Synaptic-Plasticity (BTSP), rather than Hebbian Spike-Timing-Dependent-Plasticity, is the principal mechanism governing PF shifting dynamics. BTSP-triggering events are rare, but more frequent during novel experiences. During exploration, their probability is dynamic: it decays after PF onset, but continually drives a population-level representational drift. Finally, our results show that BTSP occurs in CA3 but is less frequent and phenomenologically different than in CA1. Overall, our study provides a new framework to understand how synaptic plasticity shapes neuronal representations during learning.

Intrinsic neural diversity quenches the dynamic volatility of neural networks

Heterogeneity is the norm in biology. The brain is no different: Neuronal cell types are myriad, reflected through their cellular morphology, type, excitability, connectivity motifs, and ion channel distributions. While this biophysical diversity enriches neural systems' dynamical repertoire, it remains challenging to reconcile with the robustness and persistence of brain function over time (resilience). To better understand the relationship between excitability heterogeneity (variability in excitability within a population of neurons) and resilience, we analyzed both analytically and numerically a nonlinear sparse neural network with balanced excitatory and inhibitory connections evolving over long time scales. Homogeneous networks demonstrated increases in excitability, and strong firing rate correlations-signs of instability-in response to a slowly varying modulatory fluctuation. Excitability heterogeneity tuned network stability in a context-dependent way by restraining responses to modulatory challenges and limiting firing rate correlations, while enriching dynamics during states of low modulatory drive. Excitability heterogeneity was found to implement a homeostatic control mechanism enhancing network resilience to changes in population size, connection probability, strength and variability of synaptic weights, by quenching the volatility (i.e., its susceptibility to critical transitions) of its dynamics. Together, these results highlight the fundamental role played by cell-to-cell heterogeneity in the robustness of brain function in the face of change.

Synaptic and circuit mechanisms prevent detrimentally precise correlation in the developing mammalian visual system

The developing visual thalamus and cortex extract positional information encoded in the correlated activity of retinal ganglion cells by synaptic plasticity, allowing for the refinement of connectivity. Here, we use a biophysical model of the visual thalamus during the initial visual circuit refinement period to explore the role of synaptic and circuit properties in the regulation of such neural correlations. We find that the NMDA receptor dominance, combined with weak recurrent excitation and inhibition characteristic of this age, prevents the emergence of spike-correlations between thalamocortical neurons on the millisecond timescale. Such precise correlations, which would emerge due to the broad, unrefined connections from the retina to the thalamus, reduce the spatial information contained by thalamic spikes, and therefore we term them 'parasitic' correlations. Our results suggest that developing synapses and circuits evolved mechanisms to compensate for such detrimental parasitic correlations arising from the unrefined and immature circuit.

A survey and perspective on neuromorphic continual learning systems

With the advent of low-power neuromorphic computing systems, new possibilities have emerged for deployment in various sectors, like healthcare and transport, that require intelligent autonomous applications. These applications require reliable low-power solutions for sequentially adapting to new relevant data without loss of learning. Neuromorphic systems are inherently inspired by biological neural networks that have the potential to offer an efficient solution toward the feat of continual learning. With increasing attention in this area, we present a first comprehensive review of state-of-the-art neuromorphic continual learning (NCL) paradigms. The significance of our study is multi-fold. We summarize the recent progress and propose a plausible roadmap for developing end-to-end NCL systems. We also attempt to identify the gap between research and the real-world deployment of NCL systems in multiple applications. We do so by assessing the recent contributions in neuromorphic continual learning at multiple levels-applications, algorithms, architectures, and hardware. We discuss the relevance of NCL systems and draw out application-specific requisites. We analyze the biological underpinnings that are used for acquiring high-level performance. At the hardware level, we assess the ability of the current neuromorphic platforms and emerging nano-device-based architectures to support these algorithms in the presence of several constraints. Further, we propose refinements to continual learning metrics for applying them to NCL systems. Finally, the review identifies gaps and possible solutions that are not yet focused upon for deploying application-specific NCL systems in real-life scenarios.

Dimension reduction of dynamics on modular and heterogeneous directed networks

Dimension reduction is a common strategy to study nonlinear dynamical systems composed by a large number of variables. The goal is to find a smaller version of the system whose time evolution is easier to predict while preserving some of the key dynamical features of the original system. Finding such a reduced representation for complex systems is, however, a difficult task. We address this problem for dynamics on weighted directed networks, with special emphasis on modular and heterogeneous networks. We propose a two-step dimension-reduction method that takes into account the properties of the adjacency matrix. First, units are partitioned into groups of similar connectivity profiles. Each group is associated to an observable that is a weighted average of the nodes' activities within the group. Second, we derive a set of equations that must be fulfilled for these observables to properly represent the original system's behavior, together with a method for approximately solving them. The result is a reduced adjacency matrix and an approximate system of ODEs for the observables' evolution. We show that the reduced system can be used to predict some characteristic features of the complete dynamics for different types of connectivity structures, both synthetic and derived from real data, including neuronal, ecological, and social networks. Our formalism opens a way to a systematic comparison of the effect of various structural properties on the overall network dynamics. It can thus help to identify the main structural driving forces guiding the evolution of dynamical processes on networks.

Noise-modulated multistable synapses in a Wilson-Cowan-based model of plasticity

Frequency-dependent plasticity refers to changes in synaptic strength in response to different stimulation frequencies. Resonance is a factor known to be of importance in such frequency dependence, however, the role of neural noise in the process remains elusive. Considering the brain is an inherently noisy system, understanding its effects may prove beneficial in shaping therapeutic interventions based on non-invasive brain stimulation protocols. The Wilson-Cowan (WC) model is a well-established model to describe the average dynamics of neural populations and has been shown to exhibit bistability in the presence of noise. However, the important question of how the different stable regimes in the WC model can affect synaptic plasticity when cortical populations interact has not yet been addressed. Therefore, we investigated plasticity dynamics in a WC-based model of interacting neural populations coupled with activity-dependent synapses in which a periodic stimulation was applied in the presence of noise of controlled intensity. The results indicate that for a narrow range of the noise variance, synaptic strength can be optimized. In particular, there is a regime of noise intensity for which synaptic strength presents a triple-stable state. Regulating noise intensity affects the probability that the system chooses one of the stable states, thereby controlling plasticity. These results suggest that noise is a highly influential factor in determining the outcome of plasticity induced by stimulation.

Stability and learning in excitatory synapses by nonlinear inhibitory plasticity

Synaptic changes are hypothesized to underlie learning and memory formation in the brain. But Hebbian synaptic plasticity of excitatory synapses on its own is unstable, leading to either unlimited growth of synaptic strengths or silencing of neuronal activity without additional homeostatic mechanisms. To control excitatory synaptic strengths, we propose a novel form of synaptic plasticity at inhibitory synapses. Using computational modeling, we suggest two key features of inhibitory plasticity, dominance of inhibition over excitation and a nonlinear dependence on the firing rate of postsynaptic excitatory neurons whereby inhibitory synaptic strengths change with the same sign (potentiate or depress) as excitatory synaptic strengths. We demonstrate that the stable synaptic strengths realized by this novel inhibitory plasticity model affects excitatory/inhibitory weight ratios in agreement with experimental results. Applying a disinhibitory signal can gate plasticity and lead to the generation of receptive fields and strong bidirectional connectivity in a recurrent network. Hence, a novel form of nonlinear inhibitory plasticity can simultaneously stabilize excitatory synaptic strengths and enable learning upon disinhibition.

Structural spine plasticity: Learning and forgetting of odor-specific subnetworks in the olfactory bulb

Learning to discriminate between different sensory stimuli is essential for survival. In rodents, the olfactory bulb, which contributes to odor discrimination via pattern separation, exhibits extensive structural synaptic plasticity involving the formation and removal of synaptic spines, even in adult animals. The network connectivity resulting from this plasticity is still poorly understood. To gain insight into this connectivity we present here a computational model for the structural plasticity of the reciprocal synapses between the dominant population of excitatory principal neurons and inhibitory interneurons. It incorporates the observed modulation of spine stability by odor exposure. The model captures the striking experimental observation that the exposure to odors does not always enhance their discriminability: while training with similar odors enhanced their discriminability, training with dissimilar odors actually reduced the discriminability of the training stimuli. Strikingly, this differential learning does not require the activity-dependence of the spine stability and occurs also in a model with purely random spine dynamics in which the spine density is changed homogeneously, e.g., due to a global signal. However, the experimentally observed odor-specific reduction in the response of principal cells as a result of extended odor exposure and the concurrent disinhibition of a subset of principal cells arise only in the activity-dependent model. Moreover, this model predicts the experimentally testable recovery of odor response through weak but not through strong odor re-exposure and the forgetting of odors via exposure to interfering odors. Combined with the experimental observations, the computational model provides strong support for the prediction that odor exposure leads to the formation of odor-specific subnetworks in the olfactory bulb.

A key feature of the brain is its ability to learn through the plasticity of its network. The olfactory bulb in the olfactory system is a remarkable brain area whose anatomical structure evolves substantially still in adult animals by establishing new synaptic connections and removing existing ones. We present a computational model for this process and employ it to interpret recent experimental results. By comparing the results of our model with those of a random control model we identify various experimental observations that lend strong support to the notion that the network of the olfactory bulb comprises learned, odor-specific subnetworks. Moreover, our model explains the recent observation that the learning of odors does not always improve their discriminability and provides testable predictions for the recovery of odor response after repeated odor exposure and for when the learning of new odors interferes with retaining the memory of familiar odors.

Spike-Timing-Dependent Plasticity With Activation-Dependent Scaling for Receptive Fields Development

Spike-timing-dependent plasticity (STDP) is one of the most popular and deeply biologically motivated forms of unsupervised Hebbian-type learning. In this article, we propose a variant of STDP extended by an additional activation-dependent scale factor. The consequent learning rule is an efficient algorithm, which is simple to implement and applicable to spiking neural networks (SNNs). It is demonstrated that the proposed plasticity mechanism combined with competitive learning can serve as an effective mechanism for the unsupervised development of receptive fields (RFs). Furthermore, the relationship between synaptic scaling and lateral inhibition is explored in the context of the successful development of RFs. Specifically, we demonstrate that maintaining a high level of synaptic scaling followed by its rapid increase is crucial for the development of neuronal mechanisms of selectivity. The strength of the proposed solution is assessed in classification tasks performed on the Modified National Institute of Standards and Technology (MNIST) data set with an accuracy level of 94.65% (a single network) and 95.17% (a network committee)-comparable to the state-of-the-art results of single-layer SNN architectures trained in an unsupervised manner. Furthermore, the training process leads to sparse data representation and the developed RFs have the potential to serve as local feature detectors in multilayered spiking networks. We also prove theoretically that when applied to linear Poisson neurons, our rule conserves total synaptic strength, guaranteeing the convergence of the learning process.

Synaptic balancing: A biologically plausible local learning rule that provably increases neural network noise robustness without sacrificing task performance

We introduce a novel, biologically plausible local learning rule that provably increases the robustness of neural dynamics to noise in nonlinear recurrent neural networks with homogeneous nonlinearities. Our learning rule achieves higher noise robustness without sacrificing performance on the task and without requiring any knowledge of the particular task. The plasticity dynamics—an integrable dynamical system operating on the weights of the network—maintains a multiplicity of conserved quantities, most notably the network’s entire temporal map of input to output trajectories. The outcome of our learning rule is a synaptic balancing between the incoming and outgoing synapses of every neuron. This synaptic balancing rule is consistent with many known aspects of experimentally observed heterosynaptic plasticity, and moreover makes new experimentally testable predictions relating plasticity at the incoming and outgoing synapses of individual neurons. Overall, this work provides a novel, practical local learning rule that exactly preserves overall network function and, in doing so, provides new conceptual bridges between the disparate worlds of the neurobiology of heterosynaptic plasticity, the engineering of regularized noise-robust networks, and the mathematics of integrable Lax dynamical systems.

The precise pattern of synaptic connections in a neural network entirely determines the network’s function. Learning rules are programs for modifying synapses to allow the network to attain some functional goal. By carefully tweaking synaptic connectivity, neural networks are able learn new tasks, form new memories, and stabilize neural activity. Due to the complexity of network structure, there are many different synaptic weight patterns that can in principle perform the same computation. These different solutions, however, may be more or less desirable in other other ways, such as their vulnerability to unreliable components in the network. In this paper, we present a synaptic learning rule which locates robust solutions among many synaptic weight configurations that equivalently perform the same task. Our biologically plausible rule relies on information which is entirely locally available to each neuron and possesses a number of desirable mathematical properties. Our analysis reveals that networks are most robust when the aggregate incoming and outgoing synapses are balanced in every neuron. Intriguingly, our learning rule makes predictions which resemble widely experimentally observed patterns of compensatory heterosynaptic plasticity in cortical dendrites.

Thalamic regulation of frontal interactions in human cognitive flexibility

Interactions across frontal cortex are critical for cognition. Animal studies suggest a role for mediodorsal thalamus (MD) in these interactions, but the computations performed and direct relevance to human decision making are unclear. Here, inspired by animal work, we extended a neural model of an executive frontal-MD network and trained it on a human decision-making task for which neuroimaging data were collected. Using a biologically-plausible learning rule, we found that the model MD thalamus compressed its cortical inputs (dorsolateral prefrontal cortex, dlPFC) underlying stimulus-response representations. Through direct feedback to dlPFC, this thalamic operation efficiently partitioned cortical activity patterns and enhanced task switching across different contingencies. To account for interactions with other frontal regions, we expanded the model to compute higher-order strategy signals outside dlPFC, and found that the MD offered a more efficient route for such signals to switch dlPFC activity patterns. Human fMRI data provided evidence that the MD engaged in feedback to dlPFC, and had a role in routing orbitofrontal cortex inputs when subjects switched behavioral strategy. Collectively, our findings contribute to the emerging evidence for thalamic regulation of frontal interactions in the human brain.

The expansion of frontal cortex during mammalian evolution suggested a prominent role in intelligent and adaptive behavior, overshadowing earlier parts of the brain. However, recent rodent studies have pointed to a role for the cognitive mediodorsal thalamus (MD) in sustaining and flexibly switching representations in the frontal cortex, but direct relevance to human decision-making are unclear. Here, inspired by animal work, we extended a neural model of an executive frontal-MD network and trained it on a human decision-making task for which human neuroimaging data were collected. We found that the model MD thalamus learned an abstract representation of its cortical inputs and provided direct feedback to frontal cortex leading to flexible computations and enhanced task switching. These abstract MD representations and ability to re-organize frontal computations created an efficient mechanism where MD can integrate input from other regions to select behavioral strategy dynamically. The model predicted an efficient route through the MD for frontal region interactions and we found consistent evidence in human neuroimaging data. Collectively, our findings contribute to the emerging evidence for thalamic regulation of frontal interactions in the human brain.

Organization and Priming of Long-term Memory Representations with Two-phase Plasticity

Background / Introduction

In recurrent neural networks in the brain, memories are represented by so-called Hebbian cell assemblies. Such assemblies are groups of neurons with particularly strong synaptic connections formed by synaptic plasticity and consolidated by synaptic tagging and capture (STC). To link these synaptic mechanisms to long-term memory on the level of cognition and behavior, their functional implications on the level of neural networks have to be understood.

Methods

We employ a biologically detailed recurrent network of spiking neurons featuring synaptic plasticity and STC to model the learning and consolidation of long-term memory representations. Using this, we investigate the effects of different organizational paradigms, and of priming stimulation, on the functionality of multiple memory representations. We quantify these effects by the spontaneous activation of memory representations driven by background noise.

Results

We find that the learning order of the memory representations significantly biases the likelihood of activation towards more recently learned representations, and that hub-like overlap structure counters this effect. We identify long-term depression as the mechanism underlying these findings. Finally, we demonstrate that STC has functional consequences for the interaction of long-term memory representations: 1. intermediate consolidation in between learning the individual representations strongly alters the previously described effects, and 2. STC enables the priming of a long-term memory representation on a timescale of minutes to hours.

Conclusion

Our findings show how synaptic and neuronal mechanisms can provide an explanatory basis for known cognitive effects.

Natural-gradient learning for spiking neurons

In many normative theories of synaptic plasticity, weight updates implicitly depend on the chosen parametrization of the weights. This problem relates, for example, to neuronal morphology: synapses which are functionally equivalent in terms of their impact on somatic firing can differ substantially in spine size due to their different positions along the dendritic tree. Classical theories based on Euclidean-gradient descent can easily lead to inconsistencies due to such parametrization dependence. The issues are solved in the framework of Riemannian geometry, in which we propose that plasticity instead follows natural-gradient descent. Under this hypothesis, we derive a synaptic learning rule for spiking neurons that couples functional efficiency with the explanation of several well-documented biological phenomena such as dendritic democracy, multiplicative scaling, and heterosynaptic plasticity. We therefore suggest that in its search for functional synaptic plasticity, evolution might have come up with its own version of natural-gradient descent.

Self-healing codes: How stable neural populations can track continually reconfiguring neural representations

The brain is capable of adapting while maintaining stable long-term memories and learned skills. Recent experiments show that neural responses are highly plastic in some circuits, while other circuits maintain consistent responses over time, raising the question of how these circuits interact coherently. We show how simple, biologically motivated Hebbian and homeostatic mechanisms in single neurons can allow circuits with fixed responses to continuously track a plastic, changing representation without reference to an external learning signal.

As an adaptive system, the brain must retain a faithful representation of the world while continuously integrating new information. Recent experiments have measured population activity in cortical and hippocampal circuits over many days and found that patterns of neural activity associated with fixed behavioral variables and percepts change dramatically over time. Such “representational drift” raises the question of how malleable population codes can interact coherently with stable long-term representations that are found in other circuits and with relatively rigid topographic mappings of peripheral sensory and motor signals. We explore how known plasticity mechanisms can allow single neurons to reliably read out an evolving population code without external error feedback. We find that interactions between Hebbian learning and single-cell homeostasis can exploit redundancy in a distributed population code to compensate for gradual changes in tuning. Recurrent feedback of partially stabilized readouts could allow a pool of readout cells to further correct inconsistencies introduced by representational drift. This shows how relatively simple, known mechanisms can stabilize neural tuning in the short term and provides a plausible explanation for how plastic neural codes remain integrated with consolidated, long-term representations.

Generalized neural field theory of cortical plasticity illustrated by an application to the linear phase of ocular dominance column formation in primary visual cortex

Physiologically based neural field theory (NFT) is extended to encompass cortical plasticity dynamics. An illustrative application is provided which treats the evolution of the connectivity of left- and right-eye visual stimuli to neuronal populations in the primary visual cortex (V1), and the initial, linear phase of formation of approximately one-dimensional (1D) ocular dominance columns (ODCs) that sets their transverse spatial scale. This links V1 activity, structure, and physiology within a single theory that already accounts for a range of other brain activity and connectivity phenomena, thereby enabling ODC formation and many other phenomena to be interrelated and cortical parameters to be constrained across multiple domains. The results accord with experimental ODC widths for realistic cortical parameters and are based directly on a unified description of the neuronal populations involved, their connection strengths, and the neuronal activity they support. Other key results include simple analytic approximations for ODC widths and the parameters of maximum growth rate, constraints on cortical excitatory and inhibitory gains, elucidation of the roles of specific poles of the V1 response function, and the fact that ODCs are not formed when input stimuli are fully correlated between eyes. This work provides a basis for further generalization of NFT to model other plasticity phenomena, thereby linking them to the range multiscale phenomena accounted for by NFT.

Homeostatic control of synaptic rewiring in recurrent networks induces the formation of stable memory engrams

Brain networks store new memories using functional and structural synaptic plasticity. Memory formation is generally attributed to Hebbian plasticity, while homeostatic plasticity is thought to have an ancillary role in stabilizing network dynamics. Here we report that homeostatic plasticity alone can also lead to the formation of stable memories. We analyze this phenomenon using a new theory of network remodeling, combined with numerical simulations of recurrent spiking neural networks that exhibit structural plasticity based on firing rate homeostasis. These networks are able to store repeatedly presented patterns and recall them upon the presentation of incomplete cues. Storage is fast, governed by the homeostatic drift. In contrast, forgetting is slow, driven by a diffusion process. Joint stimulation of neurons induces the growth of associative connections between them, leading to the formation of memory engrams. These memories are stored in a distributed fashion throughout connectivity matrix, and individual synaptic connections have only a small influence. Although memory-specific connections are increased in number, the total number of inputs and outputs of neurons undergo only small changes during stimulation. We find that homeostatic structural plasticity induces a specific type of "silent memories", different from conventional attractor states.

Retinal Plasticity

Brain plasticity is a well-established concept designating the ability of central nervous system (CNS) neurons to rearrange as a result of learning, when adapting to changeable environmental conditions or else while reacting to injurious factors. As a part of the CNS, the retina has been repeatedly probed for its possible ability to respond plastically to a variably altered environment or to pathological insults. However, numerous studies support the conclusion that the retina, outside the developmental stage, is endowed with only limited plasticity, exhibiting, instead, a remarkable ability to maintain a stable architectural and functional organization. Reviewed here are representative examples of hippocampal and cortical paradigms of plasticity and of retinal structural rearrangements found in organization and circuitry following altered developmental conditions or occurrence of genetic diseases leading to neuronal degeneration. The variable rate of plastic changes found in mammalian retinal neurons in different circumstances is discussed, focusing on structural plasticity. The likely adaptive value of maintaining a low level of plasticity in an organ subserving a sensory modality that is dominant for the human species and that requires elevated fidelity is discussed.

Transection of the ventral hippocampal commissure impairs spatial reference but not contextual or spatial working memory

Plasticity is a neural phenomenon in which experience induces long-lasting changes to neuronal circuits and is at the center of most neurobiological theories of learning and memory. However, too much plasticity is maladaptive and must be balanced with substrate stability. Area CA3 of the hippocampus provides such a balance via hemispheric lateralization, with the left hemisphere dominant in providing plasticity and the right specialized for stability. Left and right CA3 project bilaterally to CA1; however, it is not known whether this downstream merging of lateralized plasticity and stability is functional. We hypothesized that interhemispheric convergence of input from these pathways is essential for integrating spatial memory stored in the left CA3 with navigational working memory facilitated by the right CA3. To test this, we severed interhemispheric connections between the left and right hippocampi in mice and assessed learning and memory. Despite damage to this major hippocampal fiber tract, hippocampus-dependent navigational working memory and short- and long-term memory were both spared. However, tasks that required the integration of information retrieved from memory with ongoing navigational working memory and navigation were impaired. We propose that one function of interhemispheric communication in the mouse hippocampus is to integrate lateralized processing of plastic and stable circuits to facilitate memory-guided spatial navigation.

Sensory coding and contrast invariance emerge from the control of plastic inhibition over emergent selectivity

Visual stimuli are represented by a highly efficient code in the primary visual cortex, but the development of this code is still unclear. Two distinct factors control coding efficiency: Representational efficiency, which is determined by neuronal tuning diversity, and metabolic efficiency, which is influenced by neuronal gain. How these determinants of coding efficiency are shaped during development, supported by excitatory and inhibitory plasticity, is only partially understood. We investigate a fully plastic spiking network of the primary visual cortex, building on phenomenological plasticity rules. Our results suggest that inhibitory plasticity is key to the emergence of tuning diversity and accurate input encoding. We show that inhibitory feedback (random and specific) increases the metabolic efficiency by implementing a gain control mechanism. Interestingly, this led to the spontaneous emergence of contrast-invariant tuning curves. Our findings highlight that (1) interneuron plasticity is key to the development of tuning diversity and (2) that efficient sensory representations are an emergent property of the resulting network.

Synaptic plasticity is crucial for the development of efficient input representation in the different sensory cortices, such as the primary visual cortex. Efficient visual representation is determined by two factors: representational efficiency, i.e. how many different input features can be represented, and metabolic efficiency, i.e. how many spikes are required to represent a specific feature. Previous research has pointed out the importance of plasticity at excitatory synapses to achieve high representational efficiency and feedback inhibition as a gain control mechanism for controlling metabolic efficiency. However, it is only partially understood how the influence of inhibitory plasticity on excitatory plasticity can lead to an efficient representation. Using a spiking neural network, we show that plasticity at feed-forward and feedback inhibitory synapses is necessary for the emergence of well-distributed neuronal selectivity to improve representational efficiency. Further, the emergent balance between excitatory and inhibitory currents improves the metabolic efficiency, and leads to contrast-invariant tuning as an inherent network property. Extending previous work, our simulation results highlight the importance of plasticity at inhibitory synapses.

A Correspondence Between Normalization Strategies in Artificial and Biological Neural Networks

A fundamental challenge at the interface of machine learning and neuroscience is to uncover computational principles that are shared between artificial and biological neural networks. In deep learning, normalization methods such as batch normalization, weight normalization, and their many variants help to stabilize hidden unit activity and accelerate network training, and these methods have been called one of the most important recent innovations for optimizing deep networks. In the brain, homeostatic plasticity represents a set of mechanisms that also stabilize and normalize network activity to lie within certain ranges, and these mechanisms are critical for maintaining normal brain function. In this article, we discuss parallels between artificial and biological normalization methods at four spatial scales: normalization of a single neuron's activity, normalization of synaptic weights of a neuron, normalization of a layer of neurons, and normalization of a network of neurons. We argue that both types of methods are functionally equivalent-that is, both push activation patterns of hidden units toward a homeostatic state, where all neurons are equally used-and we argue that such representations can improve coding capacity, discrimination, and regularization. As a proof of concept, we develop an algorithm, inspired by a neural normalization technique called synaptic scaling, and show that this algorithm performs competitively against existing normalization methods on several data sets. Overall, we hope this bidirectional connection will inspire neuroscientists and machine learners in three ways: to uncover new normalization algorithms based on established neurobiological principles; to help quantify the trade-offs of different homeostatic plasticity mechanisms used in the brain; and to offer insights about how stability may not hinder, but may actually promote, plasticity.

Light-weight electrophysiology hardware and software platform for cloud-based neural recording experiments

Objective.Neural activity represents a functional readout of neurons that is increasingly important to monitor in a wide range of experiments. Extracellular recordings have emerged as a powerful technique for measuring neural activity because these methods do not lead to the destruction or degradation of the cells being measured. Current approaches to electrophysiology have a low throughput of experiments due to manual supervision and expensive equipment. This bottleneck limits broader inferences that can be achieved with numerous long-term recorded samples.Approach.We developed Piphys, an inexpensive open source neurophysiological recording platform that consists of both hardware and software. It is easily accessed and controlled via a standard web interface through Internet of Things (IoT) protocols.Main results.We used a Raspberry Pi as the primary processing device along with an Intan bioamplifier. We designed a hardware expansion circuit board and software to enable voltage sampling and user interaction. This standalone system was validated with primary human neurons, showing reliability in collecting neural activity in near real-time.Significance.The hardware modules and cloud software allow for remote control of neural recording experiments as well as horizontal scalability, enabling long-term observations of development, organization, and neural activity at scale.

Self-organization of a doubly asynchronous irregular network state for spikes and bursts

Cortical pyramidal cells (PCs) have a specialized dendritic mechanism for the generation of bursts, suggesting that these events play a special role in cortical information processing. In vivo, bursts occur at a low, but consistent rate. Theory suggests that this network state increases the amount of information they convey. However, because burst activity relies on a threshold mechanism, it is rather sensitive to dendritic input levels. In spiking network models, network states in which bursts occur rarely are therefore typically not robust, but require fine-tuning. Here, we show that this issue can be solved by a homeostatic inhibitory plasticity rule in dendrite-targeting interneurons that is consistent with experimental data. The suggested learning rule can be combined with other forms of inhibitory plasticity to self-organize a network state in which both spikes and bursts occur asynchronously and irregularly at low rate. Finally, we show that this network state creates the network conditions for a recently suggested multiplexed code and thereby indeed increases the amount of information encoded in bursts.

Astrocyte GluN2C NMDA receptors control basal synaptic strengths of hippocampal CA1 pyramidal neurons in the stratum radiatum

Experience-dependent plasticity is a key feature of brain synapses for which neuronal N-Methyl-D-Aspartate receptors (NMDARs) play a major role, from developmental circuit refinement to learning and memory. Astrocytes also express NMDARs, although their exact function has remained controversial. Here, we identify in mouse hippocampus, a circuit function for GluN2C NMDAR, a subtype highly expressed in astrocytes, in layer-specific tuning of synaptic strengths in CA1 pyramidal neurons. Interfering with astrocyte NMDAR or GluN2C NMDAR activity reduces the range of presynaptic strength distribution specifically in the stratum radiatum inputs without an appreciable change in the mean presynaptic strength. Mathematical modeling shows that narrowing of the width of presynaptic release probability distribution compromises the expression of long-term synaptic plasticity. Our findings suggest a novel feedback signaling system that uses astrocyte GluN2C NMDARs to adjust basal synaptic weight distribution of Schaffer collateral inputs, which in turn impacts computations performed by the CA1 pyramidal neuron.

Time Course of Homeostatic Structural Plasticity in Response to Optogenetic Stimulation in Mouse Anterior Cingulate Cortex

Plasticity is the mechanistic basis of development, aging, learning, and memory, both in healthy and pathological brains. Structural plasticity is rarely accounted for in computational network models due to a lack of insight into the underlying neuronal mechanisms and processes. Little is known about how the rewiring of networks is dynamically regulated. To inform such models, we characterized the time course of neural activity, the expression of synaptic proteins, and neural morphology employing an in vivo optogenetic mouse model. We stimulated pyramidal neurons in the anterior cingulate cortex of mice and harvested their brains at 1.5 h, 24 h, and $48\,\mathrm{h}$ after stimulation. Stimulus-induced cortical hyperactivity persisted up to 1.5 h and decayed to baseline after $24\,\mathrm{h}$ indicated by c-Fos expression. The synaptic proteins VGLUT1 and PSD-95, in contrast, were upregulated at $24\,\mathrm{h}$ and downregulated at $48\,\mathrm{h}$, respectively. Spine density and spine head volume were also increased at $24\,\mathrm{h}$ and decreased at $48\,\mathrm{h}$. This specific sequence of events reflects a continuous joint evolution of activity and connectivity that is characteristic of the model of homeostatic structural plasticity. Our computer simulations thus corroborate the observed empirical evidence from our animal experiments.

Plasticity in Cervical Motor Circuits following Spinal Cord Injury and Rehabilitation

Simple Summary

Spinal cord injury results in a decreased quality of life and impacts hundreds of thousands of people in the US alone. This review discusses the underlying cellular mechanisms of injury and the concurrent therapeutic hurdles that impede recovery. It then describes the phenomena of neural plasticity—the nervous system’s ability to change. The primary focus of the review is on the impact of cervical spinal cord injury on control of the upper limbs. The neural plasticity that occurs without intervention is discussed, which shows new connections growing around the injury site and the involvement of compensatory movements. Rehabilitation-driven neural plasticity is shown to have the ability to guide connections to create more normal functions. Various novel stimulation and recording technologies are outlined for their role in further improving rehabilitative outcomes and gains in independence. Finally, the importance of sensory input, an often-overlooked aspect of motor control, is shown in driving neural plasticity. Overall, this review seeks to delineate the historical and contemporary research into neural plasticity following injury and rehabilitation to guide future studies.

Abstract

Neuroplasticity is a robust mechanism by which the central nervous system attempts to adapt to a structural or chemical disruption of functional connections between neurons. Mechanical damage from spinal cord injury potentiates via neuroinflammation and can cause aberrant changes in neural circuitry known as maladaptive plasticity. Together, these alterations greatly diminish function and quality of life. This review discusses contemporary efforts to harness neuroplasticity through rehabilitation and neuromodulation to restore function with a focus on motor recovery following cervical spinal cord injury. Background information on the general mechanisms of plasticity and long-term potentiation of the nervous system, most well studied in the learning and memory fields, will be reviewed. Spontaneous plasticity of the nervous system, both maladaptive and during natural recovery following spinal cord injury is outlined to provide a baseline from which rehabilitation builds. Previous research has focused on the impact of descending motor commands in driving spinal plasticity. However, this review focuses on the influence of physical therapy and primary afferent input and interneuron modulation in driving plasticity within the spinal cord. Finally, future directions into previously untargeted primary afferent populations are presented.

Memory destabilization during reconsolidation: a consequence of homeostatic plasticity?

Remembering is not a static process: When retrieved, a memory can be destabilized and become prone to modifications. This phenomenon has been demonstrated in a number of brain regions, but the neuronal mechanisms that rule memory destabilization and its boundary conditions remain elusive. Using two distinct computational models that combine Hebbian plasticity and synaptic downscaling, we show that homeostatic plasticity can function as a destabilization mechanism, accounting for behavioral results of protein synthesis inhibition upon reactivation with different re-exposure times. Furthermore, by performing systematic reviews, we identify a series of overlapping molecular mechanisms between memory destabilization and synaptic downscaling, although direct experimental links between both phenomena remain scarce. In light of these results, we propose a theoretical framework where memory destabilization can emerge as an epiphenomenon of homeostatic adaptations prompted by memory retrieval.

A functional model of adult dentate gyrus neurogenesis

In adult dentate gyrus neurogenesis, the link between maturation of newborn neurons and their function, such as behavioral pattern separation, has remained puzzling. By analyzing a theoretical model, we show that the switch from excitation to inhibition of the GABAergic input onto maturing newborn cells is crucial for their proper functional integration. When the GABAergic input is excitatory, cooperativity drives the growth of synapses such that newborn cells become sensitive to stimuli similar to those that activate mature cells. When GABAergic input switches to inhibitory, competition pushes the configuration of synapses onto newborn cells toward stimuli that are different from previously stored ones. This enables the maturing newborn cells to code for concepts that are novel, yet similar to familiar ones. Our theory of newborn cell maturation explains both how adult-born dentate granule cells integrate into the preexisting network and why they promote separation of similar but not distinct patterns.

Homeostatic synaptic scaling establishes the specificity of an associative memory

Correlation-based (Hebbian) forms of synaptic plasticity are crucial for the initial encoding of associative memories but likely insufficient to enable the stable storage of multiple specific memories within neural circuits. Theoretical studies have suggested that homeostatic synaptic normalization rules provide an essential countervailing force that can stabilize and expand memory storage capacity. Although such homeostatic mechanisms have been identified and studied for decades, experimental evidence that they play an important role in associative memory is lacking. Here, we show that synaptic scaling, a widely studied form of homeostatic synaptic plasticity that globally renormalizes synaptic strengths, is dispensable for initial associative memory formation but crucial for the establishment of memory specificity. We used conditioned taste aversion (CTA) learning, a form of associative learning that relies on Hebbian mechanisms within gustatory cortex (GC), to show that animals conditioned to avoid saccharin initially generalized this aversion to other novel tastants. Specificity of the aversion to saccharin emerged slowly over a time course of many hours and was associated with synaptic scaling down of excitatory synapses onto conditioning-active neuronal ensembles within gustatory cortex. Blocking synaptic scaling down in the gustatory cortex enhanced the persistence of synaptic strength increases induced by conditioning and prolonged the duration of memory generalization. Taken together, these findings demonstrate that synaptic scaling is crucial for sculpting the specificity of an associative memory and suggest that the relative strengths of Hebbian and homeostatic plasticity can modulate the balance between stable memory formation and memory generalization.

Altered Heterosynaptic Plasticity Impairs Visual Discrimination Learning in Adenosine A1 Receptor Knock-Out Mice

Theoretical and modeling studies demonstrate that heterosynaptic plasticity-changes at synapses inactive during induction-facilitates fine-grained discriminative learning in Hebbian-type systems, and helps to achieve a robust ability for repetitive learning. A dearth of tools for selective manipulation has hindered experimental analysis of the proposed role of heterosynaptic plasticity in behavior. Here we circumvent this obstacle by testing specific predictions about the behavioral consequences of the impairment of heterosynaptic plasticity by experimental manipulations to adenosine A1 receptors (A1Rs). Our prior work demonstrated that the blockade of adenosine A1 receptors impairs heterosynaptic plasticity in brain slices and, when implemented in computer models, selectively impairs repetitive learning on sequential tasks. Based on this work, we predict that A1R knock-out (KO) mice will express (1) impairment of heterosynaptic plasticity and (2) behavioral deficits in learning on sequential tasks. Using electrophysiological experiments in slices and behavioral testing of animals of both sexes, we show that, compared with wild-type controls, A1R KO mice have impaired synaptic plasticity in visual cortex neurons, coupled with significant deficits in visual discrimination learning. Deficits in A1R knockouts were seen specifically during relearning, becoming progressively more apparent with learning on sequential visual discrimination tasks of increasing complexity. These behavioral results confirm our model predictions and provide the first experimental evidence for a proposed role of heterosynaptic plasticity in organism-level learning. Moreover, these results identify heterosynaptic plasticity as a new potential target for interventions that may help to enhance new learning on a background of existing memories.SIGNIFICANCE STATEMENT Understanding how interacting forms of synaptic plasticity mediate learning is fundamental for neuroscience. Theory and modeling revealed that, in addition to Hebbian-type associative plasticity, heterosynaptic changes at synapses that were not active during induction are necessary for stable system operation and fine-grained discrimination learning. However, lacking tools for selective manipulation prevented behavioral analysis of heterosynaptic plasticity. Here we circumvent this barrier: from our prior experimental and computational work we predict differential behavioral consequences of the impairment of Hebbian-type versus heterosynaptic plasticity. We show that, in adenosine A1 receptor knock-out mice, impaired synaptic plasticity in visual cortex neurons is coupled with specific deficits in learning sequential, increasingly complex visual discrimination tasks. This provides the first evidence linking heterosynaptic plasticity to organism-level learning.

Balanced networks under spike-time dependent plasticity

The dynamics of local cortical networks are irregular, but correlated. Dynamic excitatory–inhibitory balance is a plausible mechanism that generates such irregular activity, but it remains unclear how balance is achieved and maintained in plastic neural networks. In particular, it is not fully understood how plasticity induced changes in the network affect balance, and in turn, how correlated, balanced activity impacts learning. How do the dynamics of balanced networks change under different plasticity rules? How does correlated spiking activity in recurrent networks change the evolution of weights, their eventual magnitude, and structure across the network? To address these questions, we develop a theory of spike–timing dependent plasticity in balanced networks. We show that balance can be attained and maintained under plasticity–induced weight changes. We find that correlations in the input mildly affect the evolution of synaptic weights. Under certain plasticity rules, we find an emergence of correlations between firing rates and synaptic weights. Under these rules, synaptic weights converge to a stable manifold in weight space with their final configuration dependent on the initial state of the network. Lastly, we show that our framework can also describe the dynamics of plastic balanced networks when subsets of neurons receive targeted optogenetic input.

Animals are able to learn complex tasks through changes in individual synapses between cells. Such changes lead to the coevolution of neural activity patterns and the structure of neural connectivity, but the consequences of these interactions are not fully understood. We consider plasticity in model neural networks which achieve an average balance between the excitatory and inhibitory synaptic inputs to different cells, and display cortical–like, irregular activity. We extend the theory of balanced networks to account for synaptic plasticity and show which rules can maintain balance, and which will drive the network into a different state. This theory of plasticity can provide insights into the relationship between stimuli, network dynamics, and synaptic circuitry.

The Ups and Downs of Firing Rate Homeostasis

Torrado Pacheco et al. demonstrate that downward firing rate homeostasis occurs when cellular activity levels increase beyond baseline, but only during sleep-dense periods. In contrast, Hebbian-facilitated changes in firing rate occur independently of sleep and wake states.

Energetics of stochastic BCM type synaptic plasticity and storing of accurate information

Excitatory synaptic signaling in cortical circuits is thought to be metabolically expensive. Two fundamental brain functions, learning and memory, are associated with long-term synaptic plasticity, but we know very little about energetics of these slow biophysical processes. This study investigates the energy requirement of information storing in plastic synapses for an extended version of BCM plasticity with a decay term, stochastic noise, and nonlinear dependence of neuron’s firing rate on synaptic current (adaptation). It is shown that synaptic weights in this model exhibit bistability. In order to analyze the system analytically, it is reduced to a simple dynamic mean-field for a population averaged plastic synaptic current. Next, using the concepts of nonequilibrium thermodynamics, we derive the energy rate (entropy production rate) for plastic synapses and a corresponding Fisher information for coding presynaptic input. That energy, which is of chemical origin, is primarily used for battling fluctuations in the synaptic weights and presynaptic firing rates, and it increases steeply with synaptic weights, and more uniformly though nonlinearly with presynaptic firing. At the onset of synaptic bistability, Fisher information and memory lifetime both increase sharply, by a few orders of magnitude, but the plasticity energy rate changes only mildly. This implies that a huge gain in the precision of stored information does not have to cost large amounts of metabolic energy, which suggests that synaptic information is not directly limited by energy consumption. Interestingly, for very weak synaptic noise, such a limit on synaptic coding accuracy is imposed instead by a derivative of the plasticity energy rate with respect to the mean presynaptic firing, and this relationship has a general character that is independent of the plasticity type. An estimate for primate neocortex reveals that a relative metabolic cost of BCM type synaptic plasticity, as a fraction of neuronal cost related to fast synaptic transmission and spiking, can vary from negligible to substantial, depending on the synaptic noise level and presynaptic firing.

Learning the same motor task twice impairs its retention in a time- and dose-dependent manner

Anterograde interference emerges when two differing tasks are learned in close temporal proximity, an effect repeatedly attributed to a competition between differing task memories. However, recent development alternatively suggests that initial learning may trigger a refractory period that occludes neuroplasticity and impairs subsequent learning, consequently mediating interference independently of memory competition. Accordingly, this study tested the hypothesis that interference can emerge when the same motor task is being learned twice, that is when competition between memories is prevented. In a first experiment, the inter-session interval (ISI) between two identical motor learning sessions was manipulated to be 2 min, 1 h or 24 h. Results revealed that retention of the second session was impaired as compared to the first one when the ISI was 2 min but not when it was 1 h or 24 h, indicating a time-dependent process. Results from a second experiment replicated those of the first one and revealed that adding a third motor learning session with a 2 min ISI further impaired retention, indicating a dose-dependent process. Results from a third experiment revealed that the retention impairments did not take place when a learning session was preceded by simple rehearsal of the motor task without concurrent learning, thus ruling out fatigue and confirming that retention is impaired specifically when preceded by a learning session. Altogether, the present results suggest that competing memories is not the sole mechanism mediating anterograde interference and introduce the possibility that a time- and dose-dependent refractory period-independent of fatigue-also contributes to its emergence. One possibility is that learning transiently perturbs the homeostasis of learning-related neuronal substrates. Introducing additional learning when homeostasis is still perturbed may not only impair performance improvements, but also memory formation.

Towards simulations of long-term behavior of neural networks: Modeling synaptic plasticity of connections within and between human brain regions

Simulations of neural networks can be used to study the direct effect of internal or external changes on brain dynamics. However, some changes are not immediate but occur on the timescale of weeks, months, or years. Examples include effects of strokes, surgical tissue removal, or traumatic brain injury but also gradual changes during brain development. Simulating network activity over a long time, even for a small number of nodes, is a computational challenge. Here, we model a coupled network of human brain regions with a modified Wilson-Cowan model representing dynamics for each region and with synaptic plasticity adjusting connection weights within and between regions. Using strategies ranging from different models for plasticity, vectorization and a different differential equation solver setup, we achieved one second runtime for one second biological time.

Dendritic Voltage Recordings Explain Paradoxical Synaptic Plasticity: A Modeling Study

Experiments have shown that the same stimulation pattern that causes Long-Term Potentiation in proximal synapses, will induce Long-Term Depression in distal ones. In order to understand these, and other, surprising observations we use a phenomenological model of Hebbian plasticity at the location of the synapse. Our model describes the Hebbian condition of joint activity of pre- and postsynaptic neurons in a compact form as the interaction of the glutamate trace left by a presynaptic spike with the time course of the postsynaptic voltage. Instead of simulating the voltage, we test the model using experimentally recorded dendritic voltage traces in hippocampus and neocortex. We find that the time course of the voltage in the neighborhood of a stimulated synapse is a reliable predictor of whether a stimulated synapse undergoes potentiation, depression, or no change. Our computational model can explain the existence of different -at first glance seemingly paradoxical- outcomes of synaptic potentiation and depression experiments depending on the dendritic location of the synapse and the frequency or timing of the stimulation.