Self-healing codes: How stable neural populations can track continually reconfiguring neural representations

Unsupervised restoration of a complex learned behavior after large-scale neuronal perturbation

Reliable execution of precise behaviors requires that brain circuits are resilient to variations in neuronal dynamics. Genetic perturbation of the majority of excitatory neurons in HVC, a brain region involved in song production, in adult songbirds with stereotypical songs triggered severe degradation of the song. The song fully recovered within 2 weeks, and substantial improvement occurred even when animals were prevented from singing during the recovery period, indicating that offline mechanisms enable recovery in an unsupervised manner. Song restoration was accompanied by increased excitatory synaptic input to neighboring, unmanipulated neurons in the same brain region. A model inspired by the behavioral and electrophysiological findings suggests that unsupervised single-cell and population-level homeostatic plasticity rules can support the functional restoration after large-scale disruption of networks that implement sequential dynamics. These observations suggest the existence of cellular and systems-level restorative mechanisms that ensure behavioral resilience.

Drift of neural ensembles driven by slow fluctuations of intrinsic excitability

Representational drift refers to the dynamic nature of neural representations in the brain despite the behavior being seemingly stable. Although drift has been observed in many different brain regions, the mechanisms underlying it are not known. Since intrinsic neural excitability is suggested to play a key role in regulating memory allocation, fluctuations of excitability could bias the reactivation of previously stored memory ensembles and therefore act as a motor for drift. Here, we propose a rate-based plastic recurrent neural network with slow fluctuations of intrinsic excitability. We first show that subsequent reactivations of a neural ensemble can lead to drift of this ensemble. The model predicts that drift is induced by co-activation of previously active neurons along with neurons with high excitability which leads to remodeling of the recurrent weights. Consistent with previous experimental works, the drifting ensemble is informative about its temporal history. Crucially, we show that the gradual nature of the drift is necessary for decoding temporal information from the activity of the ensemble. Finally, we show that the memory is preserved and can be decoded by an output neuron having plastic synapses with the main region.

A persistent prefrontal reference frame across time and task rules

Behavior can be remarkably consistent, even over extended time periods, yet whether this is reflected in stable or 'drifting' neuronal responses to task features remains controversial. Here, we find a persistently active ensemble of neurons in the medial prefrontal cortex (mPFC) of mice that reliably maintains trajectory-specific tuning over several weeks while performing an olfaction-guided spatial memory task. This task-specific reference frame is stabilized during learning, upon which repeatedly active neurons show little representational drift and maintain their trajectory-specific tuning across long pauses in task exposure and across repeated changes in cue-target location pairings. These data thus suggest a 'core ensemble' of prefrontal neurons forming a reference frame of task-relevant space for the performance of consistent behavior over extended periods of time.

DNA Instability in Neurons: Lifespan Clock and Driver of Evolution

In the last ten years, the discovery of neuronal DNA postmitotic instability has changed the theoretical landscape in neuroscience and, more broadly, biology. In 2003, A. M. Olovnikov suggested that neuronal DNA is the "initial substrate of aging". Recent experimental data have significantly increased the likelihood of this hypothesis. How does neuronal DNA accumulate damage and in what genome regions? What factors contribute to this process and how are they associated with aging and lifespan? These questions will be discussed in the review. In the course of Metazoan evolution, the instability of neuronal DNA has been accompanied by searching for the pathways to reduce the biological cost of brain activity. Various processes and activities, such as sleep, evolutionary increase in the number of neurons in the vertebrate brain, adult neurogenesis, distribution of neuronal activity, somatic polyploidy, and RNA editing in cephalopods, can be reconsidered in the light of the trade-off between neuronal plasticity and DNA instability in neurons. This topic is of considerable importance for both fundamental neuroscience and translational medicine.

NMDA-driven dendritic modulation enables multitask representation learning in hierarchical sensory processing pathways

While sensory representations in the brain depend on context, it remains unclear how such modulations are implemented at the biophysical level, and how processing layers further in the hierarchy can extract useful features for each possible contextual state. Here, we demonstrate that dendritic N-Methyl-D-Aspartate spikes can, within physiological constraints, implement contextual modulation of feedforward processing. Such neuron-specific modulations exploit prior knowledge, encoded in stable feedforward weights, to achieve transfer learning across contexts. In a network of biophysically realistic neuron models with context-independent feedforward weights, we show that modulatory inputs to dendritic branches can solve linearly nonseparable learning problems with a Hebbian, error-modulated learning rule. We also demonstrate that local prediction of whether representations originate either from different inputs, or from different contextual modulations of the same input, results in representation learning of hierarchical feedforward weights across processing layers that accommodate a multitude of contexts.

Representational drift as a window into neural and behavioural plasticity

Large-scale recordings of neural activity over days and weeks have revealed that neural representations of familiar tasks, precepts and actions continually evolve without obvious changes in behaviour. We hypothesise that this steady drift in neural activity and accompanying physiological changes is due in part to the continuous application of a learning rule at the cellular and population level. Explicit predictions of this drift can be found in neural network models that use iterative learning to optimise weights. Drift therefore provides a measurable signal that can reveal systems-level properties of biological plasticity mechanisms, such as their precision and effective learning rates.

Distinct ventral stream and prefrontal cortex representational dynamics during sustained conscious visual perception

Instances of sustained stationary sensory input are ubiquitous. However, previous work focused almost exclusively on transient onset responses. This presents a critical challenge for neural theories of consciousness, which should account for the full temporal extent of experience. To address this question, we use intracranial recordings from ten human patients with epilepsy to view diverse images of multiple durations. We reveal that, in sensory regions, despite dramatic changes in activation magnitude, the distributed representation of categories and exemplars remains sustained and stable. In contrast, in frontoparietal regions, we find transient content representation at stimulus onset. Our results highlight the connection between the anatomical and temporal correlates of experience. To the extent perception is sustained, it may rely on sensory representations and to the extent perception is discrete, centered on perceptual updating, it may rely on frontoparietal representations.

Time and experience differentially affect distinct aspects of hippocampal representational drift

Hippocampal activity is critical for spatial memory. Within a fixed, familiar environment, hippocampal codes gradually change over timescales of days to weeks-a phenomenon known as representational drift. The passage of time and the amount of experience are two factors that profoundly affect memory. However, thus far, it has remained unclear to what extent these factors drive hippocampal representational drift. Here, we longitudinally recorded large populations of hippocampal neurons in mice while they repeatedly explored two different familiar environments that they visited at different time intervals over weeks. We found that time and experience differentially affected distinct aspects of representational drift: the passage of time drove changes in neuronal activity rates, whereas experience drove changes in the cells' spatial tuning. Changes in spatial tuning were context specific and largely independent of changes in activity rates. Thus, our results suggest that representational drift is a multi-faceted process governed by distinct neuronal mechanisms.

Coordinated drift of receptive fields in Hebbian/anti-Hebbian network models during noisy representation learning

Recent experiments have revealed that neural population codes in many brain areas continuously change even when animals have fully learned and stably perform their tasks. This representational 'drift' naturally leads to questions about its causes, dynamics and functions. Here we explore the hypothesis that neural representations optimize a representational objective with a degenerate solution space, and noisy synaptic updates drive the network to explore this (near-)optimal space causing representational drift. We illustrate this idea and explore its consequences in simple, biologically plausible Hebbian/anti-Hebbian network models of representation learning. We find that the drifting receptive fields of individual neurons can be characterized by a coordinated random walk, with effective diffusion constants depending on various parameters such as learning rate, noise amplitude and input statistics. Despite such drift, the representational similarity of population codes is stable over time. Our model recapitulates experimental observations in the hippocampus and posterior parietal cortex and makes testable predictions that can be probed in future experiments.

Long-term stability of single neuron activity in the motor system

How an established behavior is retained and consistently produced by a nervous system in constant flux remains a mystery. One possible solution to ensure long-term stability in motor output is to fix the activity patterns of single neurons in the relevant circuits. Alternatively, activity in single cells could drift over time provided that the population dynamics are constrained to produce the same behavior. To arbitrate between these possibilities, we recorded single-unit activity in motor cortex and striatum continuously for several weeks as rats performed stereotyped motor behaviors-both learned and innate. We found long-term stability in single neuron activity patterns across both brain regions. A small amount of drift in neural activity, observed over weeks of recording, could be explained by concomitant changes in task-irrelevant aspects of the behavior. These results suggest that long-term stable behaviors are generated by single neuron activity patterns that are themselves highly stable.

Tuning instability of non-columnar neurons in the salt-and-pepper whisker map in somatosensory cortex

Rodent sensory cortex contains salt-and-pepper maps of sensory features, whose structure is not fully known. Here we investigated the structure of the salt-and-pepper whisker somatotopic map among L2/3 pyramidal neurons in somatosensory cortex, in awake mice performing one-vs-all whisker discrimination. Neurons tuned for columnar (CW) and non-columnar (non-CW) whiskers were spatially intermixed, with co-tuned neurons forming local (20 µm) clusters. Whisker tuning was markedly unstable in expert mice, with 35-46% of pyramidal cells significantly shifting tuning over 5-18 days. Tuning instability was highly concentrated in non-CW tuned neurons, and thus was structured in the map. Instability of non-CW neurons was unchanged during chronic whisker paralysis and when mice discriminated individual whiskers, suggesting it is an inherent feature. Thus, L2/3 combines two distinct components: a stable columnar framework of CW-tuned cells that may promote spatial perceptual stability, plus an intermixed, non-columnar surround with highly unstable tuning.

Formation and computational implications of assemblies in neural circuits

In the brain, patterns of neural activity represent sensory information and store it in non-random synaptic connectivity. A prominent theoretical hypothesis states that assemblies, groups of neurons that are strongly connected to each other, are the key computational units underlying perception and memory formation. Compatible with these hypothesised assemblies, experiments have revealed groups of neurons that display synchronous activity, either spontaneously or upon stimulus presentation, and exhibit behavioural relevance. While it remains unclear how assemblies form in the brain, theoretical work has vastly contributed to the understanding of various interacting mechanisms in this process. Here, we review the recent theoretical literature on assembly formation by categorising the involved mechanisms into four components: synaptic plasticity, symmetry breaking, competition and stability. We highlight different approaches and assumptions behind assembly formation and discuss recent ideas of assemblies as the key computational unit in the brain. Abstract figure legend Assembly Formation. Assemblies are groups of strongly connected neurons formed by the interaction of multiple mechanisms and with vast computational implications. Four interacting components are thought to drive assembly formation: synaptic plasticity, symmetry breaking, competition and stability. This article is protected by copyright. All rights reserved.

Representational drift: Emerging theories for continual learning and experimental future directions

Recent work has revealed that the neural activity patterns correlated with sensation, cognition, and action often are not stable and instead undergo large scale changes over days and weeks-a phenomenon called representational drift. Here, we highlight recent observations of drift, how drift is unlikely to be explained by experimental confounds, and how the brain can likely compensate for drift to allow stable computation. We propose that drift might have important roles in neural computation to allow continual learning, both for separating and relating memories that occur at distinct times. Finally, we present an outlook on future experimental directions that are needed to further characterize drift and to test emerging theories for drift's role in computation.

The sloppy relationship between neural circuit structure and function

Investigating and describing the relationships between the structure of a circuit and its function has a long tradition in neuroscience. Since neural circuits acquire their structure through sophisticated developmental programmes, and memories and experiences are maintained through synaptic modification, it is to be expected that structure is closely linked to function. Recent findings challenge this hypothesis from three different angles: Function does not strongly constrain circuit parameters, many parameters in neural circuits are irrelevant and contribute little to function, and circuit parameters are unstable and subject to constant random drift. At the same time however, recent work also showed that dynamics in neural circuit activity that is related to function are robust over time and across individuals. Here this apparent contradiction is addressed by considering the properties of neural manifolds that restrict circuit activity to functionally relevant subspaces, and it will be suggested that degenerate, anisotropic and unstable parameter spaces are a closely related to the structure and implementation of functionally relevant neural manifolds. Abstract figure legend What are the relationships between noisy and highly variable microscopic neural circuit variables on the one hand and the generation of behaviour on the other? Here it is proposed that an intermediate level of description exists where this relationship can be understood in terms of low-dimensional dynamics. Recordings of neural activity during unconstrained behaviour and the development of new machine learning methods will help to uncover these links. This article is protected by copyright. All rights reserved.

Construction of complex memories via parallel distributed cortical–subcortical iterative integration

The construction of complex engrams requires hippocampal-cortical interactions. These include both direct interactions and ones via often-overlooked subcortical loops. Here, we review the anatomical organization of a hierarchy of parallel ‘Papez’ loops through the hypothalamus that are homologous in mammals from rats to humans. These hypothalamic loops supplement direct hippocampal-cortical connections with iterative re-processing paced by theta rhythmicity. We couple existing anatomy and lesion data with theory to propose that recirculation in these loops progressively enhances desired connections, while reducing interference from competing external goals and internal associations. This increases the signal-to-noise ratio in the distributed engrams (neocortical and cerebellar) necessary for complex learning and memory. The hypothalamic nodes provide key motivational input for engram enhancement during consolidation.