Intrinsic volatility of synaptic connections — a challenge to the synaptic trace theory of memory

Co-existence of synaptic plasticity and metastable dynamics in a spiking model of cortical circuits

Evidence for metastable dynamics and its role in brain function is emerging at a fast pace and is changing our understanding of neural coding by putting an emphasis on hidden states of transient activity. Clustered networks of spiking neurons have enhanced synaptic connections among groups of neurons forming structures called cell assemblies; such networks are capable of producing metastable dynamics that is in agreement with many experimental results. However, it is unclear how a clustered network structure producing metastable dynamics may emerge from a fully local plasticity rule, i.e., a plasticity rule where each synapse has only access to the activity of the neurons it connects (as opposed to the activity of other neurons or other synapses). Here, we propose a local plasticity rule producing ongoing metastable dynamics in a deterministic, recurrent network of spiking neurons. The metastable dynamics co-exists with ongoing plasticity and is the consequence of a self-tuning mechanism that keeps the synaptic weights close to the instability line where memories are spontaneously reactivated. In turn, the synaptic structure is stable to ongoing dynamics and random perturbations, yet it remains sufficiently plastic to remap sensory representations to encode new sets of stimuli. Both the plasticity rule and the metastable dynamics scale well with network size, with synaptic stability increasing with the number of neurons. Overall, our results show that it is possible to generate metastable dynamics over meaningful hidden states using a simple but biologically plausible plasticity rule which co-exists with ongoing neural dynamics.

Unsupervised restoration of a complex learned behavior after large-scale neuronal perturbation

Reliable execution of precise behaviors requires that brain circuits are resilient to variations in neuronal dynamics. Genetic perturbation of the majority of excitatory neurons in HVC, a brain region involved in song production, in adult songbirds with stereotypical songs triggered severe degradation of the song. The song fully recovered within 2 weeks, and substantial improvement occurred even when animals were prevented from singing during the recovery period, indicating that offline mechanisms enable recovery in an unsupervised manner. Song restoration was accompanied by increased excitatory synaptic input to neighboring, unmanipulated neurons in the same brain region. A model inspired by the behavioral and electrophysiological findings suggests that unsupervised single-cell and population-level homeostatic plasticity rules can support the functional restoration after large-scale disruption of networks that implement sequential dynamics. These observations suggest the existence of cellular and systems-level restorative mechanisms that ensure behavioral resilience.

A synapse-specific refractory period for plasticity at individual dendritic spines

How newly formed memories are preserved while brain plasticity is ongoing has been a source of debate. One idea is that synapses which experienced recent plasticity become resistant to further plasticity, a type of metaplasticity often referred to as saturation. Here, we probe the local dendritic mechanisms that limit plasticity at recently potentiated synapses. We show that recently potentiated individual synapses exhibit a synapse-specific refractory period for further potentiation. We further found that the refractory period is associated with reduced postsynaptic CaMKII signaling; however, stronger synaptic activation only partially restored the ability for further plasticity. Importantly, the refractory period is released after one hour, a timing that coincides with the enrichment of several postsynaptic proteins to pre-plasticity levels. Notably, increasing the level of the postsynaptic scaffolding protein, PSD95, but not of PSD93, overcomes the refractory period. Our results support a model in which potentiation at a single synapse is sufficient to initiate a synapse-specific refractory period that persists until key postsynaptic proteins regain their steady-state synaptic levels.

Representational drift as a result of implicit regularization

Recent studies show that, even in constant environments, the tuning of single neurons changes over time in a variety of brain regions. This representational drift has been suggested to be a consequence of continuous learning under noise, but its properties are still not fully understood. To investigate the underlying mechanism, we trained an artificial network on a simplified navigational task. The network quickly reached a state of high performance, and many units exhibited spatial tuning. We then continued training the network and noticed that the activity became sparser with time. Initial learning was orders of magnitude faster than ensuing sparsification. This sparsification is consistent with recent results in machine learning, in which networks slowly move within their solution space until they reach a flat area of the loss function. We analyzed four datasets from different labs, all demonstrating that CA1 neurons become sparser and more spatially informative with exposure to the same environment. We conclude that learning is divided into three overlapping phases: (i) Fast familiarity with the environment; (ii) slow implicit regularization; and (iii) a steady state of null drift. The variability in drift dynamics opens the possibility of inferring learning algorithms from observations of drift statistics.

Learning with filopodia and spines: Complementary strong and weak competition lead to specialized, graded, and protected receptive fields

Filopodia are thin synaptic protrusions that have been long known to play an important role in early development. Recently, they have been found to be more abundant in the adult cortex than previously thought, and more plastic than spines (button-shaped mature synapses). Inspired by these findings, we introduce a new model of synaptic plasticity that jointly describes learning of filopodia and spines. The model assumes that filopodia exhibit strongly competitive learning dynamics -similarly to additive spike-timing-dependent plasticity (STDP). At the same time it proposes that, if filopodia undergo sufficient potentiation, they consolidate into spines. Spines follow weakly competitive learning, classically associated with multiplicative, soft-bounded models of STDP. This makes spines more stable and sensitive to the fine structure of input correlations. We show that our learning rule has a selectivity comparable to additive STDP and captures input correlations as well as multiplicative models of STDP. We also show how it can protect previously formed memories and perform synaptic consolidation. Overall, our results can be seen as a phenomenological description of how filopodia and spines could cooperate to overcome the individual difficulties faced by strong and weak competition mechanisms.

Representational drift as a result of implicit regularization

Recent studies show that, even in constant environments, the tuning of single neurons changes over time in a variety of brain regions. This representational drift has been suggested to be a consequence of continuous learning under noise, but its properties are still not fully understood. To investigate the underlying mechanism, we trained an artificial network on a simplified navigational task. The network quickly reached a state of high performance, and many units exhibited spatial tuning. We then continued training the network and noticed that the activity became sparser with time. Initial learning was orders of magnitude faster than ensuing sparsification. This sparsification is consistent with recent results in machine learning, in which networks slowly move within their solution space until they reach a flat area of the loss function. We analyzed four datasets from different labs, all demonstrating that CA1 neurons become sparser and more spatially informative with exposure to the same environment. We conclude that learning is divided into three overlapping phases: (i) Fast familiarity with the environment; (ii) slow implicit regularization; (iii) a steady state of null drift. The variability in drift dynamics opens the possibility of inferring learning algorithms from observations of drift statistics.

An evidence-based critical review of the mind-brain identity theory

In the philosophy of mind, neuroscience, and psychology, the causal relationship between phenomenal consciousness, mentation, and brain states has always been a matter of debate. On the one hand, material monism posits consciousness and mind as pure brain epiphenomena. One of its most stringent lines of reasoning relies on a 'loss-of-function lesion premise,' according to which, since brain lesions and neurochemical modifications lead to cognitive impairment and/or altered states of consciousness, there is no reason to doubt the mind-brain identity. On the other hand, dualism or idealism (in one form or another) regard consciousness and mind as something other than the sole product of cerebral activity pointing at the ineffable, undefinable, and seemingly unphysical nature of our subjective qualitative experiences and its related mental dimension. Here, several neuroscientific findings are reviewed that question the idea that posits phenomenal experience as an emergent property of brain activity, and argue that the premise of material monism is based on a logical correlation-causation fallacy. While these (mostly ignored) findings, if considered separately from each other, could, in principle, be recast into a physicalist paradigm, once viewed from an integral perspective, they substantiate equally well an ontology that posits mind and consciousness as a primal phenomenon.

Memory: Synaptic or Cellular, That Is the Question

According to the commonly accepted opinion, memory engrams are formed and stored at the level of neural networks due to a change in the strength of synaptic connections between neurons. This hypothesis of synaptic plasticity (HSP), formulated by Donald Hebb in the 1940s, continues to dominate the directions of experimental studies and the interpretations of experimental results in the field. The universal acceptance of the HSP has transformed it from a hypothesis into an incontrovertible theory. In this article, I show that the entire body of experimental and clinical data obtained in studies of long-term memory in mammals and humans is inconsistent with the HSP. Instead, these data suggest that long-term memory is formed and stored at the intracellular level where it is reliably protected from ongoing synaptic activity, including pathological epileptic activity. It seems that the generally accepted HSP became a serious obstacle to understanding the mechanisms of memory and that progress in this field requires rethinking this doctrine and shifting experimental efforts toward exploring the intracellular mechanisms.

Representational drift as a window into neural and behavioural plasticity

Large-scale recordings of neural activity over days and weeks have revealed that neural representations of familiar tasks, precepts and actions continually evolve without obvious changes in behaviour. We hypothesise that this steady drift in neural activity and accompanying physiological changes is due in part to the continuous application of a learning rule at the cellular and population level. Explicit predictions of this drift can be found in neural network models that use iterative learning to optimise weights. Drift therefore provides a measurable signal that can reveal systems-level properties of biological plasticity mechanisms, such as their precision and effective learning rates.

The molecular memory code and synaptic plasticity: A synthesis

The most widely accepted view of memory in the brain holds that synapses are the storage sites of memory, and that memories are formed through associative modification of synapses. This view has been challenged on conceptual and empirical grounds. As an alternative, it has been proposed that molecules within the cell body are the storage sites of memory, and that memories are formed through biochemical operations on these molecules. This paper proposes a synthesis of these two views, grounded in a computational model of memory. Synapses are conceived as storage sites for the parameters of an approximate posterior probability distribution over latent causes. Intracellular molecules are conceived as storage sites for the parameters of a generative model. The model stipulates how these two components work together as part of an integrated algorithm for learning and inference.

Quantifying postsynaptic receptor dynamics: insights into synaptic function

The molecular composition of presynaptic and postsynaptic neuronal terminals is dynamic, and yet long-term stabilizations in postsynaptic responses are necessary for synaptic development and long-term plasticity. The need to reconcile these concepts is further complicated by learning- and memory-related plastic changes in the molecular make-up of synapses. Advances in single-particle tracking mean that we can now quantify the number and diffusive properties of specific synaptic molecules, while statistical thermodynamics provides a framework to analyse these molecular fluctuations. In this Review, we discuss the use of these approaches to gain quantitative descriptions of the processes underlying the turnover, long-term stability and plasticity of postsynaptic receptors and show how these can help us to understand the balance between local molecular turnover and synaptic structural identity and integrity.

Unraveling the mysteries of dendritic spine dynamics: Five key principles shaping memory and cognition

Recent research extends our understanding of brain processes beyond just action potentials and chemical transmissions within neural circuits, emphasizing the mechanical forces generated by excitatory synapses on dendritic spines to modulate presynaptic function. From in vivo and in vitro studies, we outline five central principles of synaptic mechanics in brain function: P1: Stability - Underpinning the integral relationship between the structure and function of the spine synapses. P2: Extrinsic dynamics - Highlighting synapse-selective structural plasticity which plays a crucial role in Hebbian associative learning, distinct from pathway-selective long-term potentiation (LTP) and depression (LTD). P3: Neuromodulation - Analyzing the role of G-protein-coupled receptors, particularly dopamine receptors, in time-sensitive modulation of associative learning frameworks such as Pavlovian classical conditioning and Thorndike's reinforcement learning (RL). P4: Instability - Addressing the intrinsic dynamics crucial to memory management during continual learning, spotlighting their role in "spine dysgenesis" associated with mental disorders. P5: Mechanics - Exploring how synaptic mechanics influence both sides of synapses to establish structural traces of short- and long-term memory, thereby aiding the integration of mental functions. We also delve into the historical background and foresee impending challenges.

Neurodynamical Computing at the Information Boundaries of Intelligent Systems

Artificial intelligence has not achieved defining features of biological intelligence despite models boasting more parameters than neurons in the human brain. In this perspective article, we synthesize historical approaches to understanding intelligent systems and argue that methodological and epistemic biases in these fields can be resolved by shifting away from cognitivist brain-as-computer theories and recognizing that brains exist within large, interdependent living systems. Integrating the dynamical systems view of cognition with the massive distributed feedback of perceptual control theory highlights a theoretical gap in our understanding of nonreductive neural mechanisms. Cell assemblies—properly conceived as reentrant dynamical flows and not merely as identified groups of neurons—may fill that gap by providing a minimal supraneuronal level of organization that establishes a neurodynamical base layer for computation. By considering information streams from physical embodiment and situational embedding, we discuss this computational base layer in terms of conserved oscillatory and structural properties of cortical-hippocampal networks. Our synthesis of embodied cognition, based in dynamical systems and perceptual control, aims to bypass the neurosymbolic stalemates that have arisen in artificial intelligence, cognitive science, and computational neuroscience.

The geometry of representational drift in natural and artificial neural networks

Neurons in sensory areas encode/represent stimuli. Surprisingly, recent studies have suggested that, even during persistent performance, these representations are not stable and change over the course of days and weeks. We examine stimulus representations from fluorescence recordings across hundreds of neurons in the visual cortex using in vivo two-photon calcium imaging and we corroborate previous studies finding that such representations change as experimental trials are repeated across days. This phenomenon has been termed "representational drift". In this study we geometrically characterize the properties of representational drift in the primary visual cortex of mice in two open datasets from the Allen Institute and propose a potential mechanism behind such drift. We observe representational drift both for passively presented stimuli, as well as for stimuli which are behaviorally relevant. Across experiments, the drift differs from in-session variance and most often occurs along directions that have the most in-class variance, leading to a significant turnover in the neurons used for a given representation. Interestingly, despite this significant change due to drift, linear classifiers trained to distinguish neuronal representations show little to no degradation in performance across days. The features we observe in the neural data are similar to properties of artificial neural networks where representations are updated by continual learning in the presence of dropout, i.e. a random masking of nodes/weights, but not other types of noise. Therefore, we conclude that a potential reason for the representational drift in biological networks is driven by an underlying dropout-like noise while continuously learning and that such a mechanism may be computational advantageous for the brain in the same way it is for artificial neural networks, e.g. preventing overfitting.

Tuning instability of non-columnar neurons in the salt-and-pepper whisker map in somatosensory cortex

Rodent sensory cortex contains salt-and-pepper maps of sensory features, whose structure is not fully known. Here we investigated the structure of the salt-and-pepper whisker somatotopic map among L2/3 pyramidal neurons in somatosensory cortex, in awake mice performing one-vs-all whisker discrimination. Neurons tuned for columnar (CW) and non-columnar (non-CW) whiskers were spatially intermixed, with co-tuned neurons forming local (20 µm) clusters. Whisker tuning was markedly unstable in expert mice, with 35-46% of pyramidal cells significantly shifting tuning over 5-18 days. Tuning instability was highly concentrated in non-CW tuned neurons, and thus was structured in the map. Instability of non-CW neurons was unchanged during chronic whisker paralysis and when mice discriminated individual whiskers, suggesting it is an inherent feature. Thus, L2/3 combines two distinct components: a stable columnar framework of CW-tuned cells that may promote spatial perceptual stability, plus an intermixed, non-columnar surround with highly unstable tuning.

Stochastic consolidation of lifelong memory

Humans have the remarkable ability to continually store new memories, while maintaining old memories for a lifetime. How the brain avoids catastrophic forgetting of memories due to interference between encoded memories is an open problem in computational neuroscience. Here we present a model for continual learning in a recurrent neural network combining Hebbian learning, synaptic decay and a novel memory consolidation mechanism: memories undergo stochastic rehearsals with rates proportional to the memory's basin of attraction, causing self-amplified consolidation. This mechanism gives rise to memory lifetimes that extend much longer than the synaptic decay time, and retrieval probability of memories that gracefully decays with their age. The number of retrievable memories is proportional to a power of the number of neurons. Perturbations to the circuit model cause temporally-graded retrograde and anterograde deficits, mimicking observed memory impairments following neurological trauma.

The sloppy relationship between neural circuit structure and function

Investigating and describing the relationships between the structure of a circuit and its function has a long tradition in neuroscience. Since neural circuits acquire their structure through sophisticated developmental programmes, and memories and experiences are maintained through synaptic modification, it is to be expected that structure is closely linked to function. Recent findings challenge this hypothesis from three different angles: Function does not strongly constrain circuit parameters, many parameters in neural circuits are irrelevant and contribute little to function, and circuit parameters are unstable and subject to constant random drift. At the same time however, recent work also showed that dynamics in neural circuit activity that is related to function are robust over time and across individuals. Here this apparent contradiction is addressed by considering the properties of neural manifolds that restrict circuit activity to functionally relevant subspaces, and it will be suggested that degenerate, anisotropic and unstable parameter spaces are a closely related to the structure and implementation of functionally relevant neural manifolds. Abstract figure legend What are the relationships between noisy and highly variable microscopic neural circuit variables on the one hand and the generation of behaviour on the other? Here it is proposed that an intermediate level of description exists where this relationship can be understood in terms of low-dimensional dynamics. Recordings of neural activity during unconstrained behaviour and the development of new machine learning methods will help to uncover these links. This article is protected by copyright. All rights reserved.

Long-term transverse imaging of the hippocampus with glass microperiscopes

The hippocampus consists of a stereotyped neuronal circuit repeated along the septal-temporal axis. This transverse circuit contains distinct subfields with stereotyped connectivity that support crucial cognitive processes, including episodic and spatial memory. However, comprehensive measurements across the transverse hippocampal circuit in vivo are intractable with existing techniques. Here, we developed an approach for two-photon imaging of the transverse hippocampal plane in awake mice via implanted glass microperiscopes, allowing optical access to the major hippocampal subfields and to the dendritic arbor of pyramidal neurons. Using this approach, we tracked dendritic morphological dynamics on CA1 apical dendrites and characterized spine turnover. We then used calcium imaging to quantify the prevalence of place and speed cells across subfields. Finally, we measured the anatomical distribution of spatial information, finding a non-uniform distribution of spatial selectivity along the DG-to-CA1 axis. This approach extends the existing toolbox for structural and functional measurements of hippocampal circuitry.

Drifting neuronal representations: Bug or feature?

The brain displays a remarkable ability to sustain stable memories, allowing animals to execute precise behaviors or recall stimulus associations years after they were first learned. Yet, recent long-term recording experiments have revealed that single-neuron representations continuously change over time, contravening the classical assumption that learned features remain static. How do unstable neural codes support robust perception, memories, and actions? Here, we review recent experimental evidence for such representational drift across brain areas, as well as dissections of its functional characteristics and underlying mechanisms. We emphasize theoretical proposals for how drift need not only be a form of noise for which the brain must compensate. Rather, it can emerge from computationally beneficial mechanisms in hierarchical networks performing robust probabilistic computations.

Training a spiking neuronal network model of visual-motor cortex to play a virtual racket-ball game using reinforcement learning

Recent models of spiking neuronal networks have been trained to perform behaviors in static environments using a variety of learning rules, with varying degrees of biological realism. Most of these models have not been tested in dynamic visual environments where models must make predictions on future states and adjust their behavior accordingly. The models using these learning rules are often treated as black boxes, with little analysis on circuit architectures and learning mechanisms supporting optimal performance. Here we developed visual/motor spiking neuronal network models and trained them to play a virtual racket-ball game using several reinforcement learning algorithms inspired by the dopaminergic reward system. We systematically investigated how different architectures and circuit-motifs (feed-forward, recurrent, feedback) contributed to learning and performance. We also developed a new biologically-inspired learning rule that significantly enhanced performance, while reducing training time. Our models included visual areas encoding game inputs and relaying the information to motor areas, which used this information to learn to move the racket to hit the ball. Neurons in the early visual area relayed information encoding object location and motion direction across the network. Neuronal association areas encoded spatial relationships between objects in the visual scene. Motor populations received inputs from visual and association areas representing the dorsal pathway. Two populations of motor neurons generated commands to move the racket up or down. Model-generated actions updated the environment and triggered reward or punishment signals that adjusted synaptic weights so that the models could learn which actions led to reward. Here we demonstrate that our biologically-plausible learning rules were effective in training spiking neuronal network models to solve problems in dynamic environments. We used our models to dissect the circuit architectures and learning rules most effective for learning. Our model shows that learning mechanisms involving different neural circuits produce similar performance in sensory-motor tasks. In biological networks, all learning mechanisms may complement one another, accelerating the learning capabilities of animals. Furthermore, this also highlights the resilience and redundancy in biological systems.

Beyond dimension reduction: Stable electric fields emerge from and allow representational drift

It is known that the exact neurons maintaining a given memory (the neural ensemble) change from trial to trial. This raises the question of how the brain achieves stability in the face of this representational drift. Here, we demonstrate that this stability emerges at the level of the electric fields that arise from neural activity. We show that electric fields carry information about working memory content. The electric fields, in turn, can act as "guard rails" that funnel higher dimensional variable neural activity along stable lower dimensional routes. We obtained the latent space associated with each memory. We then confirmed the stability of the electric field by mapping the latent space to different cortical patches (that comprise a neural ensemble) and reconstructing information flow between patches. Stable electric fields can allow latent states to be transferred between brain areas, in accord with modern engram theory.

Environmental enrichment enhances patterning and remodeling of synaptic nanoarchitecture as revealed by STED nanoscopy

Synaptic plasticity underlies long-lasting structural and functional changes to brain circuitry and its experience-dependent remodeling can be fundamentally enhanced by environmental enrichment. It is however unknown, whether and how the environmental enrichment alters the morphology and dynamics of individual synapses. Here, we present a virtually crosstalk-free two-color in vivo stimulated emission depletion (STED) microscope to simultaneously superresolve the dynamics of endogenous PSD95 of the post-synaptic density and spine geometry in the mouse cortex. In general, the spine head geometry and PSD95 assemblies were highly dynamic, their changes depended linearly on their original size but correlated only mildly. With environmental enrichment, the size distributions of PSD95 and spine head sizes were sharper than in controls, indicating that synaptic strength is set more uniformly. The topography of the PSD95 nanoorganization was more dynamic after environmental enrichment; changes in size were smaller but more correlated than in mice housed in standard cages. Thus, two-color in vivo time-lapse imaging of synaptic nanoorganization uncovers a unique synaptic nanoplasticity associated with the enhanced learning capabilities under environmental enrichment.

Homeostatic control of synaptic rewiring in recurrent networks induces the formation of stable memory engrams

Brain networks store new memories using functional and structural synaptic plasticity. Memory formation is generally attributed to Hebbian plasticity, while homeostatic plasticity is thought to have an ancillary role in stabilizing network dynamics. Here we report that homeostatic plasticity alone can also lead to the formation of stable memories. We analyze this phenomenon using a new theory of network remodeling, combined with numerical simulations of recurrent spiking neural networks that exhibit structural plasticity based on firing rate homeostasis. These networks are able to store repeatedly presented patterns and recall them upon the presentation of incomplete cues. Storage is fast, governed by the homeostatic drift. In contrast, forgetting is slow, driven by a diffusion process. Joint stimulation of neurons induces the growth of associative connections between them, leading to the formation of memory engrams. These memories are stored in a distributed fashion throughout connectivity matrix, and individual synaptic connections have only a small influence. Although memory-specific connections are increased in number, the total number of inputs and outputs of neurons undergo only small changes during stimulation. We find that homeostatic structural plasticity induces a specific type of "silent memories", different from conventional attractor states.

The Hippocampal Horizon: Constructing and Segmenting Experience for Episodic Memory

How do we recollect specific events that have occurred during continuous ongoing experience? There is converging evidence from non-human animals that spatially modulated cellular activity of the hippocampal formation supports the construction of ongoing events. On the other hand, recent human oriented event cognition models have outlined that our experience is segmented into discrete units, and that such segmentation can operate on shorter or longer timescales. Here, we describe a unification of how these dynamic physiological mechanisms of the hippocampus relate to ongoing externally and internally driven event segmentation, facilitating the demarcation of specific moments during experience. Our cross-species interdisciplinary approach offers a novel perspective in the way we construct and remember specific events, leading to the generation of many new hypotheses for future research.

Drifting assemblies for persistent memory: Neuron transitions and unsupervised compensation

Change is ubiquitous in living beings. In particular, the connectome and neural representations can change. Nevertheless, behaviors and memories often persist over long times. In a standard model, associative memories are represented by assemblies of strongly interconnected neurons. For faithful storage these assemblies are assumed to consist of the same neurons over time. Here we propose a contrasting memory model with complete temporal remodeling of assemblies, based on experimentally observed changes of synapses and neural representations. The assemblies drift freely as noisy autonomous network activity and spontaneous synaptic turnover induce neuron exchange. The gradual exchange allows activity-dependent and homeostatic plasticity to conserve the representational structure and keep inputs, outputs, and assemblies consistent. This leads to persistent memory. Our findings explain recent experimental results on temporal evolution of fear memory representations and suggest that memory systems need to be understood in their completeness as individual parts may constantly change.

Mouse vision: Variability and stability across the visual processing hierarchy

The response of individual neurons to stable sensory input or behavioral output can change over time. A new study provides evidence from the mouse visual system that such drift does not follow the hierarchy of information flow across the brain.

STDP and the distribution of preferred phases in the whisker system

Rats and mice use their whiskers to probe the environment. By rhythmically swiping their whiskers back and forth they can detect the existence of an object, locate it, and identify its texture. Localization can be accomplished by inferring the whisker’s position. Rhythmic neurons that track the phase of the whisking cycle encode information about the azimuthal location of the whisker. These neurons are characterized by preferred phases of firing that are narrowly distributed. Consequently, pooling the rhythmic signal from several upstream neurons is expected to result in a much narrower distribution of preferred phases in the downstream population, which however has not been observed empirically. Here, we show how spike timing dependent plasticity (STDP) can provide a solution to this conundrum. We investigated the effect of STDP on the utility of a neural population to transmit rhythmic information downstream using the framework of a modeling study. We found that under a wide range of parameters, STDP facilitated the transfer of rhythmic information despite the fact that all the synaptic weights remained dynamic. As a result, the preferred phase of the downstream neuron was not fixed, but rather drifted in time at a drift velocity that depended on the preferred phase, thus inducing a distribution of preferred phases. We further analyzed how the STDP rule governs the distribution of preferred phases in the downstream population. This link between the STDP rule and the distribution of preferred phases constitutes a natural test for our theory.

The distribution of preferred phases of whisking neurons in the somatosensory system of rats and mice presents a conundrum: a simple pooling model predicts a distribution that is an order of magnitude narrower than what is observed empirically. Here, we suggest that this non-trivial distribution may result from activity-dependent plasticity in the form of spike timing dependent plasticity (STDP). We show that under STDP, the synaptic weights do not converge to a fixed value, but rather remain dynamic. As a result, the preferred phases of the whisking neurons vary in time, hence inducing a non-trivial distribution of preferred phases, which is governed by the STDP rule. Our results imply that the considerable synaptic volatility which has long been viewed as a difficulty that needs to be overcome, may actually be an underlying principle of the organization of the central nervous system.

Optimal plasticity for memory maintenance during ongoing synaptic change

Synaptic connections in many brain circuits fluctuate, exhibiting substantial turnover and remodelling over hours to days. Surprisingly, experiments show that most of this flux in connectivity persists in the absence of learning or known plasticity signals. How can neural circuits retain learned information despite a large proportion of ongoing and potentially disruptive synaptic changes? We address this question from first principles by analysing how much compensatory plasticity would be required to optimally counteract ongoing fluctuations, regardless of whether fluctuations are random or systematic. Remarkably, we find that the answer is largely independent of plasticity mechanisms and circuit architectures: compensatory plasticity should be at most equal in magnitude to fluctuations, and often less, in direct agreement with previously unexplained experimental observations. Moreover, our analysis shows that a high proportion of learning-independent synaptic change is consistent with plasticity mechanisms that accurately compute error gradients.

Computational roles of intrinsic synaptic dynamics

Conventional theories assume that long-term information storage in the brain is implemented by modifying synaptic efficacy. Recent experimental findings challenge this view by demonstrating that dendritic spine sizes, or their corresponding synaptic weights, are highly volatile even in the absence of neural activity. Here, we review previous computational works on the roles of these intrinsic synaptic dynamics. We first present the possibility for neuronal networks to sustain stable performance in their presence, and we then hypothesize that intrinsic dynamics could be more than mere noise to withstand, but they may improve information processing in the brain.

Thalamic control of cortical dynamics in a model of flexible motor sequencing

The neural mechanisms that generate an extensible library of motor motifs and flexibly string them into arbitrary sequences are unclear. We developed a model in which inhibitory basal ganglia output neurons project to thalamic units that are themselves bidirectionally connected to a recurrent cortical network. We model the basal ganglia inhibitory patterns as silencing some thalamic neurons while leaving others disinhibited and free to interact with cortex during specific motifs. We show that a small number of disinhibited thalamic neurons can control cortical dynamics to generate specific motor output in a noise-robust way. Additionally, a single "preparatory" thalamocortical network can produce fast cortical dynamics that support rapid transitions between any pair of learned motifs. If the thalamic units associated with each sequence component are segregated, many motor outputs can be learned without interference and then combined in arbitrary orders for the flexible production of long and complex motor sequences.

Stable but not rigid: Chronic in vivo STED nanoscopy reveals extensive remodeling of spines, indicating multiple drivers of plasticity

Excitatory synapses on dendritic spines of pyramidal neurons are considered a central memory locus. To foster both continuous adaption and the storage of long-term information, spines need to be plastic and stable at the same time. Here, we advanced in vivo STED nanoscopy to superresolve distinct features of spines (head size and neck length/width) in mouse neocortex for up to 1 month. While LTP-dependent changes predict highly correlated modifications of spine geometry, we find both, uncorrelated and correlated dynamics, indicating multiple independent drivers of spine remodeling. The magnitude of this remodeling suggests substantial fluctuations in synaptic strength. Despite this high degree of volatility, all spine features exhibit persistent components that are maintained over long periods of time. Furthermore, chronic nanoscopy uncovers structural alterations in the cortex of a mouse model of neurodegeneration. Thus, at the nanoscale, stable dendritic spines exhibit a delicate balance of stability and volatility.

Spine dynamics in the brain, mental disorders and artificial neural networks

In the brain, most synapses are formed on minute protrusions known as dendritic spines. Unlike their artificial intelligence counterparts, spines are not merely tuneable memory elements: they also embody algorithms that implement the brain's ability to learn from experience and cope with new challenges. Importantly, they exhibit structural dynamics that depend on activity, excitatory input and inhibitory input (synaptic plasticity or 'extrinsic' dynamics) and dynamics independent of activity ('intrinsic' dynamics), both of which are subject to neuromodulatory influences and reinforcers such as dopamine. Here we succinctly review extrinsic and intrinsic dynamics, compare these with parallels in machine learning where they exist, describe the importance of intrinsic dynamics for memory management and adaptation, and speculate on how disruption of extrinsic and intrinsic dynamics may give rise to mental disorders. Throughout, we also highlight algorithmic features of spine dynamics that may be relevant to future artificial intelligence developments.

The central importance of nuclear mechanisms in the storage of memory

The neurobiological nature of the memory trace (engram) remains controversial. The most widely accepted hypothesis at present is that long-term memory is stored as stable, learning-induced changes in synaptic connections. This hypothesis, the synaptic plasticity hypothesis of memory, is supported by extensive experimental data gathered from over 50 years of research. Nonetheless, there are important mnemonic phenomena that the synaptic plasticity hypothesis cannot, or cannot readily, account for. Furthermore, recent work indicates that epigenetic and genomic mechanisms play heretofore underappreciated roles in memory. Here, we critically assess the evidence that supports the synaptic plasticity hypothesis and discuss alternative non-synaptic, nuclear mechanisms of memory storage, including DNA methylation and retrotransposition. We argue that long-term encoding of memory is mediated by nuclear processes; synaptic plasticity, by contrast, represents a means of relatively temporary memory storage. In addition, we propose that memories are evaluated for their mnemonic significance during an initial period of synaptic storage; if assessed as sufficiently important, the memories then undergo nuclear encoding.

Nanoscale 3D EM reconstructions reveal intrinsic mechanisms of structural diversity of chemical synapses

Chemical synapses of shared cellular origins have remarkably heterogeneous structures, but how this diversity is generated is unclear. Here, we use three-dimensional (3D) electron microscopy and artificial intelligence algorithms for image processing to reconstruct functional excitatory microcircuits in the mouse hippocampus and microcircuits in which neurotransmitter signaling is permanently suppressed with genetic tools throughout the lifespan. These nanoscale analyses reveal that experience is dispensable for morphogenesis of synapses with different geometric shapes and contents of membrane organelles and that arrangement of morphologically distinct connections in local networks is stochastic. Moreover, loss of activity increases the variability in sizes of opposed pre- and postsynaptic structures without disrupting their alignments, suggesting that inherently variable weights of naive connections become progressively matched with repetitive use. These results demonstrate that mechanisms for the structural diversity of neuronal synapses are intrinsic and provide insights into how circuits essential for memory storage assemble and integrate information.

Engram cell connectivity: an evolving substrate for information storage

Understanding memory requires an explanation for how information can be stored in the brain in a stable state. The change in the brain that accounts for a given memory is referred to as an engram. In recent years, the term engram has been operationalized as the cells that are activated by a learning experience, undergoes plasticity, and are sufficient and necessary for memory recall. Using this framework, and a growing toolbox of related experimental techniques, engram manipulation has become a central topic in behavioral, systems, and molecular neuroscience. Recent research on the topic has provided novel insights into the mechanisms of long-term memory storage, and its overlap with instinct. We propose that memory and instinct may be embodied as isomorphic topological structures within the brain's microanatomical circuitry.

New role for circuit expansion for learning in neural networks

Many sensory pathways in the brain include sparsely active populations of neurons downstream from the input stimuli. The biological purpose of this expanded structure is unclear, but it may be beneficial due to the increased expressive power of the network. In this work, we show that certain ways of expanding a neural network can improve its generalization performance even when the expanded structure is pruned after the learning period. To study this setting, we use a teacher-student framework where a perceptron teacher network generates labels corrupted with small amounts of noise. We then train a student network structurally matched to the teacher. In this scenario, the student can achieve optimal accuracy if given the teacher's synaptic weights. We find that sparse expansion of the input layer of a student perceptron network both increases its capacity and improves the generalization performance of the network when learning a noisy rule from a teacher perceptron when the expansion is pruned after learning. We find similar behavior when the expanded units are stochastic and uncorrelated with the input and analyze this network in the mean-field limit. By solving the mean-field equations, we show that the generalization error of the stochastic expanded student network continues to drop as the size of the network increases. This improvement in generalization performance occurs despite the increased complexity of the student network relative to the teacher it is trying to learn. We show that this effect is closely related to the addition of slack variables in artificial neural networks and suggest possible implications for artificial and biological neural networks.

A model integrating multiple processes of synchronization and coherence for information instantiation within a cortical area

What is the form of dynamic, e.g., sensory, information in the mammalian cortex? Information in the cortex is modeled as a coherence map of a mixed chimera state of synchronous, phasic, and disordered minicolumns. The theoretical model is built on neurophysiological evidence. Complex spatiotemporal information is instantiated through a system of interacting biological processes that generate a synchronized cortical area, a coherent aperture. Minicolumn elements are grouped in macrocolumns in an array analogous to a phased-array radar, modeled as an aperture, a "hole through which radiant energy flows." Coherence maps in a cortical area transform inputs from multiple sources into outputs to multiple targets, while reducing complexity and entropy. Coherent apertures can assume extremely large numbers of different information states as coherence maps, which can be communicated among apertures with corresponding very large bandwidths. The coherent aperture model incorporates considerable reported research, integrating five conceptually and mathematically independent processes: 1) a damped Kuramoto network model, 2) a pumped area field potential, 3) the gating of nearly coincident spikes, 4) the coherence of activity across cortical lamina, and 5) complex information formed through functions in macrocolumns. Biological processes and their interactions are described in equations and a functional circuit such that the mathematical pieces can be assembled the same way the neurophysiological ones are. The model can be conceptually convolved over the specifics of local cortical areas within and across species. A coherent aperture becomes a node in a graph of cortical areas with a corresponding distribution of information.

Reconsidering the evidence for learning in single cells

The question of whether single cells can learn led to much debate in the early 20th century. The view prevailed that they were capable of non-associative learning but not of associative learning, such as Pavlovian conditioning. Experiments indicating the contrary were considered either non-reproducible or subject to more acceptable interpretations. Recent developments suggest that the time is right to reconsider this consensus. We exhume the experiments of Beatrice Gelber on Pavlovian conditioning in the ciliate Paramecium aurelia, and suggest that criticisms of her findings can now be reinterpreted. Gelber was a remarkable scientist whose absence from the historical record testifies to the prevailing orthodoxy that single cells cannot learn. Her work, and more recent studies, suggest that such learning may be evolutionarily more widespread and fundamental to life than previously thought and we discuss the implications for different aspects of biology.

Glutamatergic Dysfunction and Synaptic Ultrastructural Alterations in Schizophrenia and Autism Spectrum Disorder: Evidence from Human and Rodent Studies

The correlation between dysfunction in the glutamatergic system and neuropsychiatric disorders, including schizophrenia and autism spectrum disorder, is undisputed. Both disorders are associated with molecular and ultrastructural alterations that affect synaptic plasticity and thus the molecular and physiological basis of learning and memory. Altered synaptic plasticity, accompanied by changes in protein synthesis and trafficking of postsynaptic proteins, as well as structural modifications of excitatory synapses, are critically involved in the postnatal development of the mammalian nervous system. In this review, we summarize glutamatergic alterations and ultrastructural changes in synapses in schizophrenia and autism spectrum disorder of genetic or drug-related origin, and briefly comment on the possible reversibility of these neuropsychiatric disorders in the light of findings in regular synaptic physiology.

Shedding light on learning and memory: optical interrogation of the synaptic circuitry

In the quest for the physical substrate of learning and memory, a consensus gradually emerges that memory traces are stored in specific neuronal populations and the synaptic circuits that connect them. In this review, we discuss recent progresses in understanding the reorganization of synaptic circuits and neuronal assemblies associated with learning and memory, with an emphasis on optical techniques for in vivo interrogations. We also highlight some open questions on the missing link between synaptic modifications and neuronal coding, and how stable memory persists despite synaptic and neuronal fluctuations.

Neuronal Activity at Synapse Resolution: Reporters and Effectors for Synaptic Neuroscience

The development of methods for the activity-dependent tagging of neurons enabled a new way to tackle the problem of engram identification at the cellular level, giving rise to groundbreaking findings in the field of memory studies. However, the resolution of activity-dependent tagging remains limited to the whole-cell level. Notably, events taking place at the synapse level play a critical role in the establishment of new memories, and strong experimental evidence shows that learning and synaptic plasticity are tightly linked. Here, we provide a comprehensive review of the currently available techniques that enable to identify and track the neuronal activity with synaptic spatial resolution. We also present recent technologies that allow to selectively interfere with specific subsets of synapses. Lastly, we discuss how these technologies can be applied to the study of learning and memory.

The ins and outs of inhibitory synaptic plasticity: Neuron types, molecular mechanisms and functional roles

GABAergic interneurons are highly diverse, and their synaptic outputs express various forms of plasticity. Compelling evidence indicates that activity-dependent changes of inhibitory synaptic transmission play a significant role in regulating neural circuits critically involved in learning and memory and circuit refinement. Here, we provide an updated overview of inhibitory synaptic plasticity with a focus on the hippocampus and neocortex. To illustrate the diversity of inhibitory interneurons, we discuss the case of two highly divergent interneuron types, parvalbumin-expressing basket cells and neurogliaform cells, which support unique roles on circuit dynamics. We also present recent progress on the molecular mechanisms underlying long-term, activity-dependent plasticity of fast inhibitory transmission. Lastly, we discuss the role of inhibitory synaptic plasticity in neuronal circuits' function. The emerging picture is that inhibitory synaptic transmission in the CNS is extremely diverse, undergoes various mechanistically distinct forms of plasticity and contributes to a much more refined computational role than initially thought. Both the remarkable diversity of inhibitory interneurons and the various forms of plasticity expressed by GABAergic synapses provide an amazingly rich inhibitory repertoire that is central to a variety of complex neural circuit functions, including memory.

Multiplexing rhythmic information by spike timing dependent plasticity

Rhythmic activity has been associated with a wide range of cognitive processes including the encoding of sensory information, navigation, the transfer of information and others. Rhythmic activity in the brain has also been suggested to be used for multiplexing information. Multiplexing is the ability to transmit more than one signal via the same channel. Here we focus on frequency division multiplexing, in which different signals are transmitted in different frequency bands. Recent work showed that spike-timing-dependent plasticity (STDP) can facilitate the transfer of rhythmic activity downstream the information processing pathway. However, STDP has also been known to generate strong winner-take-all like competition between subgroups of correlated synaptic inputs. This competition between different rhythmicity channels, induced by STDP, may prevent the multiplexing of information. Thus, raising doubts whether STDP is consistent with the idea of multiplexing. This study explores whether STDP can facilitate the multiplexing of information across multiple frequency channels, and if so, under what conditions. We address this question in a modelling study, investigating the STDP dynamics of two populations synapsing downstream onto the same neuron in a feed-forward manner. Each population was assumed to exhibit rhythmic activity, albeit in a different frequency band. Our theory reveals that the winner-take-all like competitions between the two populations is limited, in the sense that different rhythmic populations will not necessarily fully suppress each other. Furthermore, we found that for a wide range of parameters, the network converged to a solution in which the downstream neuron responded to both rhythms. Yet, the synaptic weights themselves did not converge to a fixed point, rather remained dynamic. These findings imply that STDP can support the multiplexing of rhythmic information, and demonstrate how functionality (multiplexing of information) can be retained in the face of continuous remodeling of all the synaptic weights. The constraints on the types of STDP rules that can support multiplexing provide a natural test for our theory.

Spike timing dependent plasticity (STDP) quantifies the change in the synaptic efficacy as a function of the temporal relationship between pre- and post-synaptic firing. STDP can be viewed as a microscopic unsupervised learning rule, and a wide range of such microscopic learning rules have been described empirically. Since there is no supervisor in unsupervised learning (which would provide with the system its goal), theoreticians have struggled with the question of the possible computational roles of the various STDP rules. Previous studies have focused on the possible contribution of STDP to the spontaneous development of spatial structure. However, the rich temporal repertoire of reported STDP rules has largely been ignored. Here we studied the contribution of STDP to the development of temporal structure. We show how STDP can shape synaptic efficacies to facilitate the transfer of rhythmic information downstream and to enable the multiplexing of information across different frequency channels. Our work emphasizes the relationship between the temporal structure of the STDP rule and the rhythmic activity it can support.

Modeling the Shape of Synaptic Spines by Their Actin Dynamics

Dendritic spines are the morphological basis of excitatory synapses in the cortex and their size and shape correlates with functional synaptic properties. Recent experiments show that spines exhibit large shape fluctuations that are not related to activity-dependent plasticity but nonetheless might influence memory storage at their synapses. To investigate the determinants of such spontaneous fluctuations, we propose a mathematical model for the dynamics of the spine shape and analyze it in 2D-related to experimental microscopic imagery-and in 3D. We show that the spine shape is governed by a local imbalance between membrane tension and the expansive force from actin bundles that originates from discrete actin polymerization foci. Experiments have shown that only few such polymerization foci co-exist at any time in a spine, each having limited life time. The model shows that the momentarily existing set of such foci pushes the membrane along certain directions until foci are replaced and other directions may now be affected. We explore these relations in depth and use our model to predict shape and temporal characteristics of spines from the different biophysical parameters involved in actin polymerization. Approximating the model by a single recursive equation we finally demonstrate that the temporal evolution of the number of active foci is sufficient to predict the size of the model-spines. Thus, our model provides the first platform to study the relation between molecular and morphological properties of the spine with a high degree of biophysical detail.

Activity Dependent and Independent Determinants of Synaptic Size Diversity

The extraordinary diversity of excitatory synapse sizes is commonly attributed to activity-dependent processes that drive synaptic growth and diminution. Recent studies also point to activity-independent size fluctuations, possibly driven by innate synaptic molecule dynamics, as important generators of size diversity. To examine the contributions of activity-dependent and independent processes to excitatory synapse size diversity, we studied glutamatergic synapse size dynamics and diversification in cultured rat cortical neurons (both sexes), silenced from plating. We found that in networks with no history of activity whatsoever, synaptic size diversity was no less extensive than that observed in spontaneously active networks. Synapses in silenced networks were larger, size distributions were broader, yet these were rightward-skewed and similar in shape when scaled by mean synaptic size. Silencing reduced the magnitude of size fluctuations and weakened constraints on size distributions, yet these were sufficient to explain synaptic size diversity in silenced networks. Model-based exploration followed by experimental testing indicated that silencing-associated changes in innate molecular dynamics and fluctuation characteristics might negatively impact synaptic persistence, resulting in reduced synaptic numbers. This, in turn, would increase synaptic molecule availability, promote synaptic enlargement, and ultimately alter fluctuation characteristics. These findings suggest that activity-independent size fluctuations are sufficient to fully diversify glutamatergic synaptic sizes, with activity-dependent processes primarily setting the scale rather than the shape of size distributions. Moreover, they point to reciprocal relationships between synaptic size fluctuations, size distributions, and synaptic numbers mediated by the innate dynamics of synaptic molecules as they move in, out, and between synapses.SIGNIFICANCE STATEMENT Sizes of glutamatergic synapses vary tremendously, even when formed on the same neuron. This diversity is commonly thought to reflect the outcome of activity-dependent forms of synaptic plasticity, yet activity-independent processes might also play some part. Here we show that in neurons with no history of activity whatsoever, synaptic sizes are no less diverse. We show that this diversity is the product of activity-independent size fluctuations, which are sufficient to generate a full repertoire of synaptic sizes at correct proportions. By combining modeling and experimentation we expose reciprocal relationships between size fluctuations, synaptic sizes and synaptic counts, and show how these phenomena might be connected through the dynamics of synaptic molecules as they move in, out, and between synapses.

Alzheimer's Disease: From Amyloid to Autoimmune Hypothesis

Although Alzheimer's disease (AD) was described over a century ago, there are no effective approaches to its prevention and treatment. Such a slow progress is explained, at least in part, by our incomplete understanding of the mechanisms underlying the pathogenesis of AD. Here, I champion a hypothesis whereby AD is initiated on a disruption of the blood-brain barrier (BBB) caused by either genetic or non-genetic risk factors. The BBB disruption leads to an autoimmune response against pyramidal neurons located in the allo- and neocortical structures involved in memory formation and storage. The response caused by the adaptive immune system is not strong enough to directly kill neurons but may be sufficient to make them selectively vulnerable to neurofibrillary pathology. This hypothesis is based on the recent data showing that memory formation is associated with epigenetic chromatin modifications and, therefore, may be accompanied by expression of memory-specific proteins recognized by the immune system as "non-self" antigens. The autoimmune hypothesis is testable, and I discuss potential ways for its experimental and clinical verification. If confirmed, this hypothesis can radically change therapeutic approaches to AD prevention and treatment.

Locating the engram: Should we look for plastic synapses or information-storing molecules?

Karl Lashley began the search for the engram nearly seventy years ago. In the time since, much has been learned but divisions remain. In the contemporary neurobiology of learning and memory, two profoundly different conceptions contend: the associative/connectionist (A/C) conception and the computational/representational (C/R) conception. Both theories ground themselves in the belief that the mind is emergent from the properties and processes of a material brain. Where these theories differ is in their description of what the neurobiological substrate of memory is and where it resides in the brain. The A/C theory of memory emphasizes the need to distinguish memory cognition from the memory engram and postulates that memory cognition is an emergent property of patterned neural activity routed through engram circuits. In this model, learning re-organizes synapse association strengths to guide future neural activity. Importantly, the version of the A/C theory advocated for here contends that synaptic change is not symbolic and, despite normally being necessary, is not sufficient for memory cognition. Instead, synaptic change provides the capacity and a blueprint for reinstating symbolic patterns of neural activity. Unlike the A/C theory, which posits that memory emerges at the circuit level, the C/R conception suggests that memory manifests at the level of intracellular molecular structures. In C/R theory, these intracellular structures are information-conveying and have properties compatible with the view that brain computation utilizes a read/write memory, functionally similar to that in a computer. New research has energized both sides and highlighted the need for new discussion. Both theories, the key questions each theory has yet to resolve and several potential paths forward are presented here.

Causes and consequences of representational drift

The nervous system learns new associations while maintaining memories over long periods, exhibiting a balance between flexibility and stability. Recent experiments reveal that neuronal representations of learned sensorimotor tasks continually change over days and weeks, even after animals have achieved expert behavioral performance. How is learned information stored to allow consistent behavior despite ongoing changes in neuronal activity? What functions could ongoing reconfiguration serve? We highlight recent experimental evidence for such representational drift in sensorimotor systems, and discuss how this fits into a framework of distributed population codes. We identify recent theoretical work that suggests computational roles for drift and argue that the recurrent and distributed nature of sensorimotor representations permits drift while limiting disruptive effects. We propose that representational drift may create error signals between interconnected brain regions that can be used to keep neural codes consistent in the presence of continual change. These concepts suggest experimental and theoretical approaches to studying both learning and maintenance of distributed and adaptive population codes.

Stable memory with unstable synapses

What is the physiological basis of long-term memory? The prevailing view in Neuroscience attributes changes in synaptic efficacy to memory acquisition, implying that stable memories correspond to stable connectivity patterns. However, an increasing body of experimental evidence points to significant, activity-independent fluctuations in synaptic strengths. How memories can survive these fluctuations and the accompanying stabilizing homeostatic mechanisms is a fundamental open question. Here we explore the possibility of memory storage within a global component of network connectivity, while individual connections fluctuate. We find that homeostatic stabilization of fluctuations differentially affects different aspects of network connectivity. Specifically, memories stored as time-varying attractors of neural dynamics are more resilient to erosion than fixed-points. Such dynamic attractors can be learned by biologically plausible learning-rules and support associative retrieval. Our results suggest a link between the properties of learning-rules and those of network-level memory representations, and point at experimentally measurable signatures.

How are stable memories maintained in the brain despite significant ongoing fluctuations in synaptic strengths? Here, the authors show that a model consistent with fluctuations, homeostasis and biologically plausible learning rules, naturally leads to memories implemented as dynamic attractors.