Stable Sequential Activity Underlying the Maintenance of a Precisely Executed Skilled Behavior

A combinatorial neural code for long-term motor memory

Motor skill repertoire can be stably retained over long periods, but the neural mechanism underlying stable memory storage remains poorly understood. Moreover, it is unknown how existing motor memories are maintained as new motor skills are continuously acquired. Here we tracked neural representation of learned actions throughout a significant portion of a mouse's lifespan, and we show that learned actions are stably retained in motor memory in combination with context, which protects existing memories from erasure during new motor learning. We used automated home-cage training to establish a continual learning paradigm in which mice learned to perform directional licking in different task contexts. We combined this paradigm with chronic two-photon imaging of motor cortex activity for up to 6 months. Within the same task context, activity driving directional licking was stable over time with little representational drift. When learning new task contexts, new preparatory activity emerged to drive the same licking actions. Learning created parallel new motor memories while retaining the previous memories. Re-learning to make the same actions in the previous task context re-activated the previous preparatory activity, even months later. At the same time, continual learning of new task contexts kept creating new preparatory activity patterns. Context-specific memories, as we observed in the motor system, may provide a solution for stable memory storage throughout continual learning. Learning in new contexts produces parallel new representations instead of modifying existing representations, thus protecting existing motor repertoire from erasure.

Unsupervised restoration of a complex learned behavior after large-scale neuronal perturbation

Reliable execution of precise behaviors requires that brain circuits are resilient to variations in neuronal dynamics. Genetic perturbation of the majority of excitatory neurons in HVC, a brain region involved in song production, in adult songbirds with stereotypical songs triggered severe degradation of the song. The song fully recovered within 2 weeks, and substantial improvement occurred even when animals were prevented from singing during the recovery period, indicating that offline mechanisms enable recovery in an unsupervised manner. Song restoration was accompanied by increased excitatory synaptic input to neighboring, unmanipulated neurons in the same brain region. A model inspired by the behavioral and electrophysiological findings suggests that unsupervised single-cell and population-level homeostatic plasticity rules can support the functional restoration after large-scale disruption of networks that implement sequential dynamics. These observations suggest the existence of cellular and systems-level restorative mechanisms that ensure behavioral resilience.

Volatile working memory representations crystallize with practice

Working memory, the process through which information is transiently maintained and manipulated over a brief period, is essential for most cognitive functions1-4. However, the mechanisms underlying the generation and evolution of working-memory neuronal representations at the population level over long timescales remain unclear. Here, to identify these mechanisms, we trained head-fixed mice to perform an olfactory delayed-association task in which the mice made decisions depending on the sequential identity of two odours separated by a 5 s delay. Optogenetic inhibition of secondary motor neurons during the late-delay and choice epochs strongly impaired the task performance of the mice. Mesoscopic calcium imaging of large neuronal populations of the secondary motor cortex (M2), retrosplenial cortex (RSA) and primary motor cortex (M1) showed that many late-delay-epoch-selective neurons emerged in M2 as the mice learned the task. Working-memory late-delay decoding accuracy substantially improved in the M2, but not in the M1 or RSA, as the mice became experts. During the early expert phase, working-memory representations during the late-delay epoch drifted across days, while the stimulus and choice representations stabilized. In contrast to single-plane layer 2/3 (L2/3) imaging, simultaneous volumetric calcium imaging of up to 73,307 M2 neurons, which included superficial L5 neurons, also revealed stabilization of late-delay working-memory representations with continued practice. Thus, delay- and choice-related activities that are essential for working-memory performance drift during learning and stabilize only after several days of expert performance.

Long-term, high-resolution in vivo calcium imaging in pigeons

In vivo 2-photon calcium imaging has led to fundamental advances in our understanding of sensory circuits in mammalian species. In contrast, few studies have exploited this methodology in birds, with investigators primarily relying on histological and electrophysiological techniques. Here, we report the development of in vivo 2-photon calcium imaging in awake pigeons. We show that the genetically encoded calcium indicator GCaMP6s, delivered by the adeno-associated virus rAAV2/7, allows high-quality, stable, and long-term imaging of neuronal populations at single-cell and single-dendrite resolution in the pigeon forebrain. We demonstrate the utility of our setup by investigating the processing of colors in the visual Wulst, the avian homolog of the visual cortex. We report that neurons in the Wulst are color selective and display diverse response profiles to light of different wavelengths. This technology provides a powerful tool to decipher the operating principles that underlie sensory encoding in birds.

The Representation of Decision Variables in Orbitofrontal Cortex is Longitudinally Stable

The computation and comparison of subjective values underlying economic choices rely on the orbitofrontal cortex (OFC). In this area, distinct groups of neurons encode the value of individual options, the binary choice outcome, and the chosen value. These variables capture both the input and the output of the choice process, suggesting that the cell groups found in OFC constitute the building blocks of a decision circuit. Here we show that this neural circuit is longitudinally stable. Using two-photon calcium imaging, we recorded from mice choosing between different juice flavors. Recordings of individual cells continued for up to 20 weeks. For each cell and each pair of sessions, we compared the activity profiles using cosine similarity, and we assessed whether the cell encoded the same variable in both sessions. These analyses revealed a high degree of stability and a modest representational drift. A quantitative estimate indicated this drift would not randomize the circuit within the animal's lifetime.

Daily vocal exercise is necessary for peak performance singing in a songbird

Vocal signals, including human speech and birdsong, are produced by complicated, precisely coordinated body movements, whose execution is fitness-determining in resource competition and mate choice. While the acquisition and maintenance of motor skills generally requires practice to develop and maintain both motor circuitry and muscle performance, it is unknown whether vocal muscles, like limb muscles, exhibit exercise-induced plasticity. Here, we show that juvenile and adult zebra finches (Taeniopygia castanotis) require daily vocal exercise to first gain and subsequently maintain peak vocal muscle performance. Experimentally preventing male birds from singing alters both vocal muscle physiology and vocal performance within days. Furthermore, we find females prefer song of vocally exercised males in choice experiments. Vocal output thus contains information on recent exercise status, and acts as an honest indicator of past exercise investment in songbirds, and possibly in all vocalising vertebrates.

Representational drift as a window into neural and behavioural plasticity

Large-scale recordings of neural activity over days and weeks have revealed that neural representations of familiar tasks, precepts and actions continually evolve without obvious changes in behaviour. We hypothesise that this steady drift in neural activity and accompanying physiological changes is due in part to the continuous application of a learning rule at the cellular and population level. Explicit predictions of this drift can be found in neural network models that use iterative learning to optimise weights. Drift therefore provides a measurable signal that can reveal systems-level properties of biological plasticity mechanisms, such as their precision and effective learning rates.

Thalamus drives vocal onsets in the zebra finch courtship song

While motor cortical circuits contain information related to specific movement parameters1, long-range inputs also have a critical role in action execution2,3. Thalamic projections can shape premotor activity2-6 and have been suggested7 to mediate the selection of short, stereotyped actions comprising more complex behaviours8. However, the mechanisms by which thalamus interacts with motor cortical circuits to execute such movement sequences remain unknown. Here we find that thalamic drive engages a specific subpopulation of premotor neurons within the zebra finch song nucleus HVC (proper name) and that these inputs are critical for the progression between vocal motor elements (that is, 'syllables'). In vivo two-photon imaging of thalamic axons in HVC showed robust song-related activity, and online perturbations of thalamic function caused song to be truncated at syllable boundaries. We used thalamic stimulation to identify a sparse set of thalamically driven neurons within HVC, representing ~15% of the premotor neurons within that network. Unexpectedly, this population of putative thalamorecipient neurons is robustly active immediately preceding syllable onset, leading to the possibility that thalamic input can initiate individual song components through selectively targeting these 'starter cells'. Our findings highlight the motor thalamus as a director of cortical dynamics in the context of an ethologically relevant behavioural sequence.

Coordinated drift of receptive fields in Hebbian/anti-Hebbian network models during noisy representation learning

Recent experiments have revealed that neural population codes in many brain areas continuously change even when animals have fully learned and stably perform their tasks. This representational 'drift' naturally leads to questions about its causes, dynamics and functions. Here we explore the hypothesis that neural representations optimize a representational objective with a degenerate solution space, and noisy synaptic updates drive the network to explore this (near-)optimal space causing representational drift. We illustrate this idea and explore its consequences in simple, biologically plausible Hebbian/anti-Hebbian network models of representation learning. We find that the drifting receptive fields of individual neurons can be characterized by a coordinated random walk, with effective diffusion constants depending on various parameters such as learning rate, noise amplitude and input statistics. Despite such drift, the representational similarity of population codes is stable over time. Our model recapitulates experimental observations in the hippocampus and posterior parietal cortex and makes testable predictions that can be probed in future experiments.

Stability and flexibility of odor representations in the mouse olfactory bulb

Dynamic changes in sensory representations have been basic tenants of studies in neural coding and plasticity. In olfaction, relatively little is known about the dynamic range of changes in odor representations under different brain states and over time. Here, we used time-lapse in vivo two-photon calcium imaging to describe changes in odor representation by mitral cells, the output neurons of the mouse olfactory bulb. Using anesthetics as a gross manipulation to switch between different brain states (wakefulness and under anesthesia), we found that odor representations by mitral cells undergo significant re-shaping across states but not over time within state. Odor representations were well balanced across the population in the awake state yet highly diverse under anesthesia. To evaluate differences in odor representation across states, we used linear classifiers to decode odor identity in one state based on training data from the other state. Decoding across states resulted in nearly chance-level accuracy. In contrast, repeating the same procedure for data recorded within the same state but in different time points, showed that time had a rather minor impact on odor representations. Relative to the differences across states, odor representations remained stable over months. Thus, single mitral cells can change dynamically across states but maintain robust representations across months. These findings have implications for sensory coding and plasticity in the mammalian brain.

Long-term stability of single neuron activity in the motor system

How an established behavior is retained and consistently produced by a nervous system in constant flux remains a mystery. One possible solution to ensure long-term stability in motor output is to fix the activity patterns of single neurons in the relevant circuits. Alternatively, activity in single cells could drift over time provided that the population dynamics are constrained to produce the same behavior. To arbitrate between these possibilities, we recorded single-unit activity in motor cortex and striatum continuously for several weeks as rats performed stereotyped motor behaviors-both learned and innate. We found long-term stability in single neuron activity patterns across both brain regions. A small amount of drift in neural activity, observed over weeks of recording, could be explained by concomitant changes in task-irrelevant aspects of the behavior. These results suggest that long-term stable behaviors are generated by single neuron activity patterns that are themselves highly stable.

The geometry of representational drift in natural and artificial neural networks

Neurons in sensory areas encode/represent stimuli. Surprisingly, recent studies have suggested that, even during persistent performance, these representations are not stable and change over the course of days and weeks. We examine stimulus representations from fluorescence recordings across hundreds of neurons in the visual cortex using in vivo two-photon calcium imaging and we corroborate previous studies finding that such representations change as experimental trials are repeated across days. This phenomenon has been termed "representational drift". In this study we geometrically characterize the properties of representational drift in the primary visual cortex of mice in two open datasets from the Allen Institute and propose a potential mechanism behind such drift. We observe representational drift both for passively presented stimuli, as well as for stimuli which are behaviorally relevant. Across experiments, the drift differs from in-session variance and most often occurs along directions that have the most in-class variance, leading to a significant turnover in the neurons used for a given representation. Interestingly, despite this significant change due to drift, linear classifiers trained to distinguish neuronal representations show little to no degradation in performance across days. The features we observe in the neural data are similar to properties of artificial neural networks where representations are updated by continual learning in the presence of dropout, i.e. a random masking of nodes/weights, but not other types of noise. Therefore, we conclude that a potential reason for the representational drift in biological networks is driven by an underlying dropout-like noise while continuously learning and that such a mechanism may be computational advantageous for the brain in the same way it is for artificial neural networks, e.g. preventing overfitting.

Clinical neuroscience and neurotechnology: An amazing symbiosis

In the last decades, clinical neuroscience found a novel ally in neurotechnologies, devices able to record and stimulate electrical activity in the nervous system. These technologies improved the ability to diagnose and treat neural disorders. Neurotechnologies are concurrently enabling a deeper understanding of healthy and pathological dynamics of the nervous system through stimulation and recordings during brain implants. On the other hand, clinical neurosciences are not only driving neuroengineering toward the most relevant clinical issues, but are also shaping the neurotechnologies thanks to clinical advancements. For instance, understanding the etiology of a disease informs the location of a therapeutic stimulation, but also the way stimulation patterns should be designed to be more effective/naturalistic. Here, we describe cases of fruitful integration such as Deep Brain Stimulation and cortical interfaces to highlight how this symbiosis between clinical neuroscience and neurotechnology is closer to a novel integrated framework than to a simple interdisciplinary interaction.

Two-photon calcium imaging of neuronal activity

In vivo two-photon calcium imaging (2PCI) is a technique used for recording neuronal activity in the intact brain. It is based on the principle that, when neurons fire action potentials, intracellular calcium levels rise, which can be detected using fluorescent molecules that bind to calcium. This Primer is designed for scientists who are considering embarking on experiments with 2PCI. We provide the reader with a background on the basic concepts behind calcium imaging and on the reasons why 2PCI is an increasingly powerful and versatile technique in neuroscience. The Primer explains the different steps involved in experiments with 2PCI, provides examples of what ideal preparations should look like and explains how data are analysed. We also discuss some of the current limitations of the technique, and the types of solutions to circumvent them. Finally, we conclude by anticipating what the future of 2PCI might look like, emphasizing some of the analysis pipelines that are being developed and international efforts for data sharing.

Longitudinal monitoring of prefrontal cortical ensemble dynamics reveals new insights into stress habituation

The prefrontal cortex is highly susceptible to the detrimental effects of stress and has been implicated in the pathogenesis of stress-related psychiatric disorders. It is not well understood, however, how stress is represented at the neuronal level in the prefrontal cortical neuronal ensembles. Even less understood is how the representation of stress changes over time with repeated exposure. Here we show that the prelimbic prefrontal neuronal ensemble representation of foot shock stress exhibits rapid spatial drift within and between sessions. Despite this rapid spatial drift of the ensemble, the representation of the stressor itself stabilizes over days. Our results suggest that stress is represented by rapidly drifting ensembles and despite this rapid drift, important features of the neuronal representation are stabilized, suggesting a neural correlate of stress habituation is present within prefrontal cortical neuron populations.

Representational drift: Emerging theories for continual learning and experimental future directions

Recent work has revealed that the neural activity patterns correlated with sensation, cognition, and action often are not stable and instead undergo large scale changes over days and weeks-a phenomenon called representational drift. Here, we highlight recent observations of drift, how drift is unlikely to be explained by experimental confounds, and how the brain can likely compensate for drift to allow stable computation. We propose that drift might have important roles in neural computation to allow continual learning, both for separating and relating memories that occur at distinct times. Finally, we present an outlook on future experimental directions that are needed to further characterize drift and to test emerging theories for drift's role in computation.

The sloppy relationship between neural circuit structure and function

Investigating and describing the relationships between the structure of a circuit and its function has a long tradition in neuroscience. Since neural circuits acquire their structure through sophisticated developmental programmes, and memories and experiences are maintained through synaptic modification, it is to be expected that structure is closely linked to function. Recent findings challenge this hypothesis from three different angles: Function does not strongly constrain circuit parameters, many parameters in neural circuits are irrelevant and contribute little to function, and circuit parameters are unstable and subject to constant random drift. At the same time however, recent work also showed that dynamics in neural circuit activity that is related to function are robust over time and across individuals. Here this apparent contradiction is addressed by considering the properties of neural manifolds that restrict circuit activity to functionally relevant subspaces, and it will be suggested that degenerate, anisotropic and unstable parameter spaces are a closely related to the structure and implementation of functionally relevant neural manifolds. Abstract figure legend What are the relationships between noisy and highly variable microscopic neural circuit variables on the one hand and the generation of behaviour on the other? Here it is proposed that an intermediate level of description exists where this relationship can be understood in terms of low-dimensional dynamics. Recordings of neural activity during unconstrained behaviour and the development of new machine learning methods will help to uncover these links. This article is protected by copyright. All rights reserved.

Drifting neuronal representations: Bug or feature?

The brain displays a remarkable ability to sustain stable memories, allowing animals to execute precise behaviors or recall stimulus associations years after they were first learned. Yet, recent long-term recording experiments have revealed that single-neuron representations continuously change over time, contravening the classical assumption that learned features remain static. How do unstable neural codes support robust perception, memories, and actions? Here, we review recent experimental evidence for such representational drift across brain areas, as well as dissections of its functional characteristics and underlying mechanisms. We emphasize theoretical proposals for how drift need not only be a form of noise for which the brain must compensate. Rather, it can emerge from computationally beneficial mechanisms in hierarchical networks performing robust probabilistic computations.

Transition from predictable to variable motor cortex and striatal ensemble patterning during behavioral exploration

Animals can capitalize on invariance in the environment by learning and automating highly consistent actions; however, they must also remain flexible and adapt to environmental changes. It remains unclear how primary motor cortex (M1) can drive precise movements, yet also support behavioral exploration when faced with consistent errors. Using a reach-to-grasp task in rats, along with simultaneous electrophysiological monitoring in M1 and dorsolateral striatum (DLS), we find that behavioral exploration to overcome consistent task errors is closely associated with tandem increases in M1 and DLS neural variability; subsequently, consistent ensemble patterning returns with convergence to a new successful strategy. We also show that compared to reliably patterned intracranial microstimulation in M1, variable stimulation patterns result in significantly greater movement variability. Our results thus indicate that motor and striatal areas can flexibly transition between two modes, reliable neural pattern generation for automatic and precise movements versus variable neural patterning for behavioral exploration.

It is not fully understood how behavioral flexibility is established in the context of automatic performance of a complex motor skill. Here the authors show that corticostriatal activity can flexibly transition between two modes during a reach to-grasp task in rats: reliable neural pattern generation for precise, automatic movements versus variable neural patterning for behavioral exploration.

Beyond dimension reduction: Stable electric fields emerge from and allow representational drift

It is known that the exact neurons maintaining a given memory (the neural ensemble) change from trial to trial. This raises the question of how the brain achieves stability in the face of this representational drift. Here, we demonstrate that this stability emerges at the level of the electric fields that arise from neural activity. We show that electric fields carry information about working memory content. The electric fields, in turn, can act as "guard rails" that funnel higher dimensional variable neural activity along stable lower dimensional routes. We obtained the latent space associated with each memory. We then confirmed the stability of the electric field by mapping the latent space to different cortical patches (that comprise a neural ensemble) and reconstructing information flow between patches. Stable electric fields can allow latent states to be transferred between brain areas, in accord with modern engram theory.

Self-healing codes: How stable neural populations can track continually reconfiguring neural representations

The brain is capable of adapting while maintaining stable long-term memories and learned skills. Recent experiments show that neural responses are highly plastic in some circuits, while other circuits maintain consistent responses over time, raising the question of how these circuits interact coherently. We show how simple, biologically motivated Hebbian and homeostatic mechanisms in single neurons can allow circuits with fixed responses to continuously track a plastic, changing representation without reference to an external learning signal.

As an adaptive system, the brain must retain a faithful representation of the world while continuously integrating new information. Recent experiments have measured population activity in cortical and hippocampal circuits over many days and found that patterns of neural activity associated with fixed behavioral variables and percepts change dramatically over time. Such “representational drift” raises the question of how malleable population codes can interact coherently with stable long-term representations that are found in other circuits and with relatively rigid topographic mappings of peripheral sensory and motor signals. We explore how known plasticity mechanisms can allow single neurons to reliably read out an evolving population code without external error feedback. We find that interactions between Hebbian learning and single-cell homeostasis can exploit redundancy in a distributed population code to compensate for gradual changes in tuning. Recurrent feedback of partially stabilized readouts could allow a pool of readout cells to further correct inconsistencies introduced by representational drift. This shows how relatively simple, known mechanisms can stabilize neural tuning in the short term and provides a plausible explanation for how plastic neural codes remain integrated with consolidated, long-term representations.

Distinct neuron populations for simple and compound calls in the primary auditory cortex of awake marmosets

Marmosets are highly social non-human primates that live in families. They exhibit rich vocalization, but the neural basis underlying this complex vocal communication is largely unknown. Here we report the existence of specific neuron populations in marmoset A1 that respond selectively to distinct simple or compound calls made by conspecific marmosets. These neurons were spatially dispersed within A1 but distinct from those responsive to pure tones. Call-selective responses were markedly diminished when individual domains of the call were deleted or the domain sequence was altered, indicating the importance of the global rather than local spectral-temporal properties of the sound. Compound call-selective responses also disappeared when the sequence of the two simple-call components was reversed or their interval was extended beyond 1 s. Light anesthesia largely abolished call-selective responses. Our findings demonstrate extensive inhibitory and facilitatory interactions among call-evoked responses, and provide the basis for further study of circuit mechanisms underlying vocal communication in awake non-human primates.

Sleep replay reveals premotor circuit structure for a skilled behavior

Neural circuits often exhibit sequences of activity, but the contribution of local networks to their generation remains unclear. In the zebra finch, song-related premotor sequences within HVC may result from some combination of local connectivity and long-range thalamic inputs from nucleus uvaeformis (Uva). Because lesions to either structure abolish song, we examine "sleep replay" using high-density recording methods to reconstruct precise song-related events. Replay activity persists after the upstream nucleus interfacialis of the nidopallium is lesioned and slows when HVC is cooled, demonstrating that HVC provides temporal structure for these events. To further gauge the importance of intra-HVC connectivity for shaping network dynamics, we lesion Uva during sleep and find that residual replay sequences could span syllable boundaries, supporting a model in which HVC can propagate sequences throughout the duration of the song. Our results highlight the power of studying offline activity to investigate behaviorally relevant circuit organization.

Mouse vision: Variability and stability across the visual processing hierarchy

The response of individual neurons to stable sensory input or behavioral output can change over time. A new study provides evidence from the mouse visual system that such drift does not follow the hierarchy of information flow across the brain.

Stimulus-dependent representational drift in primary visual cortex

To produce consistent sensory perception, neurons must maintain stable representations of sensory input. However, neurons in many regions exhibit progressive drift across days. Longitudinal studies have found stable responses to artificial stimuli across sessions in visual areas, but it is unclear whether this stability extends to naturalistic stimuli. We performed chronic 2-photon imaging of mouse V1 populations to directly compare the representational stability of artificial versus naturalistic visual stimuli over weeks. Responses to gratings were highly stable across sessions. However, neural responses to naturalistic movies exhibited progressive representational drift across sessions. Differential drift was present across cortical layers, in inhibitory interneurons, and could not be explained by differential response strength or higher order stimulus statistics. However, representational drift was accompanied by similar differential changes in local population correlation structure. These results suggest representational stability in V1 is stimulus-dependent and may relate to differences in preexisting circuit architecture of co-tuned neurons.

Stable representation of a naturalistic movie emerges from episodic activity with gain variability

Visual cortical responses are known to be highly variable across trials within an experimental session. However, the long-term stability of visual cortical responses is poorly understood. Here using chronic imaging of V1 in mice we show that neural responses to repeated natural movie clips are unstable across weeks. Individual neuronal responses consist of sparse episodic activity which are stable in time but unstable in gain across weeks. Further, we find that the individual episode, instead of neuron, serves as the basic unit of the week-to-week fluctuation. To investigate how population activity encodes the stimulus, we extract a stable one-dimensional representation of the time in the natural movie, using an unsupervised method. Most week-to-week fluctuation is perpendicular to the stimulus encoding direction, thus leaving the stimulus representation largely unaffected. We propose that precise episodic activity with coordinated gain changes are keys to maintain a stable stimulus representation in V1.

Local Axonal Conduction Shapes the Spatiotemporal Properties of Neural Sequences

Sequential activation of neurons has been observed during various behavioral and cognitive processes, but the underlying circuit mechanisms remain poorly understood. Here, we investigate premotor sequences in HVC (proper name) of the adult zebra finch forebrain that are central to the performance of the temporally precise courtship song. We use high-density silicon probes to measure song-related population activity, and we compare these observations with predictions from a range of network models. Our results support a circuit architecture in which heterogeneous delays between sequentially active neurons shape the spatiotemporal patterns of HVC premotor neuron activity. We gauge the impact of several delay sources, and we find the primary contributor to be slow conduction through axonal collaterals within HVC, which typically adds between 1 and 7.5 ms for each link within the sequence. Thus, local axonal "delay lines" can play an important role in determining the dynamical repertoire of neural circuits.

Neural activity temporal pattern dictates long-range propagation targets

Brain possesses a complex spatiotemporal architecture for efficient information processing and computing. However, it remains unknown how neural signal propagates to its intended targets brain-wide. Using optogenetics and functional MRI, we arbitrarily initiated various discrete neural activity pulse trains with different temporal patterns and revealed their distinct long-range propagation targets within the well-defined, topographically organized somatosensory thalamo-cortical circuit. We further observed that such neural activity propagation over long range could modulate brain-wide sensory functions. Electrophysiological analysis indicated that distinct propagation pathways arose from system level neural adaptation and facilitation in response to the neural activity temporal characteristics. Together, our findings provide fundamental insights into the long-range information transfer and processing. They directly support that temporal coding underpins the whole brain functional architecture in presence of the vast and relatively static anatomical architecture.

Learning compositional sequences with multiple time scales through a hierarchical network of spiking neurons

Sequential behaviour is often compositional and organised across multiple time scales: a set of individual elements developing on short time scales (motifs) are combined to form longer functional sequences (syntax). Such organisation leads to a natural hierarchy that can be used advantageously for learning, since the motifs and the syntax can be acquired independently. Despite mounting experimental evidence for hierarchical structures in neuroscience, models for temporal learning based on neuronal networks have mostly focused on serial methods. Here, we introduce a network model of spiking neurons with a hierarchical organisation aimed at sequence learning on multiple time scales. Using biophysically motivated neuron dynamics and local plasticity rules, the model can learn motifs and syntax independently. Furthermore, the model can relearn sequences efficiently and store multiple sequences. Compared to serial learning, the hierarchical model displays faster learning, more flexible relearning, increased capacity, and higher robustness to perturbations. The hierarchical model redistributes the variability: it achieves high motif fidelity at the cost of higher variability in the between-motif timings.

The brain in motion: How ensemble fluidity drives memory-updating and flexibility

While memories are often thought of as flashbacks to a previous experience, they do not simply conserve veridical representations of the past but must continually integrate new information to ensure survival in dynamic environments. Therefore, 'drift' in neural firing patterns, typically construed as disruptive 'instability' or an undesirable consequence of noise, may actually be useful for updating memories. In our view, continual modifications in memory representations reconcile classical theories of stable memory traces with neural drift. Here we review how memory representations are updated through dynamic recruitment of neuronal ensembles on the basis of excitability and functional connectivity at the time of learning. Overall, we emphasize the importance of considering memories not as static entities, but instead as flexible network states that reactivate and evolve across time and experience.

Innate and plastic mechanisms for maternal behaviour in auditory cortex

Infant cries evoke powerful responses in parents^1–4. To what extent are parental animals intrinsically sensitive to neonatal vocalizations, or might instead learn about vocal cues for parenting responses? In mice, pup-naive virgins do not recognize the meaning of pup distress calls, but retrieve isolated pups to the nest following cohousing with a mother and litter^5–9. Distress calls are variable, requiring co-caring virgins to generalize across calls for reliable retrieval^10,11. Here we show that the onset of maternal behavior in mice results from interactions between intrinsic mechanisms and experience-dependent plasticity in auditory cortex. In maternal females, calls with inter-syllable intervals (ISIs) from 75:375 ms elicited pup retrieval, and cortical responses generalized across these ISIs. In contrast, naive virgins were behaviorally sensitive only to the most common (‘prototypical’) ISIs. Inhibitory and excitatory neural responses were initially mismatched in naive cortex, with untuned inhibition and overly-narrow excitation. During cohousing, excitatory responses broadened to represent a wider range of ISIs, while inhibitory tuning sharpened to form a perceptual boundary. We presented synthetic calls during cohousing and observed that neurobehavioral responses adjusted to match these statistics, a process requiring cortical activity and the hypothalamic oxytocin system. Neuroplastic mechanisms therefore build on an intrinsic sensitivity in mouse auditory cortex, enabling rapid plasticity for reliable parenting behavior.

DeepCINAC: A Deep-Learning-Based Python Toolbox for Inferring Calcium Imaging Neuronal Activity Based on Movie Visualization

Two-photon calcium imaging is now widely used to infer neuronal dynamics from changes in fluorescence of an indicator. However, state-of-the-art computational tools are not optimized for the reliable detection of fluorescence transients from highly synchronous neurons located in densely packed regions such as the CA1 pyramidal layer of the hippocampus during early postnatal stages of development. Indeed, the latest analytical tools often lack proper benchmark measurements. To meet this challenge, we first developed a graphical user interface (GUI) allowing for a precise manual detection of all calcium transients from imaged neurons based on the visualization of the calcium imaging movie. Then, we analyzed movies from mouse pups using a convolutional neural network (CNN) with an attention process and a bidirectional long-short term memory (LSTM) network. This method is able to reach human performance and offers a better F1 score (harmonic mean of sensitivity and precision) than CaImAn to infer neural activity in the developing CA1 without any user intervention. It also enables automatically identifying activity originating from GABAergic neurons. Overall, DeepCINAC offers a simple, fast and flexible open-source toolbox for processing a wide variety of calcium imaging datasets while providing the tools to evaluate its performance.

Cortical Observation by Synchronous Multifocal Optical Sampling Reveals Widespread Population Encoding of Actions

To advance the measurement of distributed neuronal population representations of targeted motor actions on single trials, we developed an optical method (COSMOS) for tracking neural activity in a largely uncharacterized spatiotemporal regime. COSMOS allowed simultaneous recording of neural dynamics at ∼30 Hz from over a thousand near-cellular resolution neuronal sources spread across the entire dorsal neocortex of awake, behaving mice during a three-option lick-to-target task. We identified spatially distributed neuronal population representations spanning the dorsal cortex that precisely encoded ongoing motor actions on single trials. Neuronal correlations measured at video rate using unaveraged, whole-session data had localized spatial structure, whereas trial-averaged data exhibited widespread correlations. Separable modes of neural activity encoded history-guided motor plans, with similar population dynamics in individual areas throughout cortex. These initial experiments illustrate how COSMOS enables investigation of large-scale cortical dynamics and that information about motor actions is widely shared between areas, potentially underlying distributed computations.

Network dynamics underlie learning and performance of birdsong

Understanding the sensorimotor control of the endless variety of human speech patterns stands as one of the apex problems in neuroscience. The capacity to learn - through imitation - to rapidly sequence vocal sounds in meaningful patterns is clearly one of the most derived of human behavioral traits. Selection pressure produced an analogous capacity in numerous species of vocal-learning birds, and due to an increasing appreciation for the cognitive and computational flexibility of avian cortex and basal ganglia, a general understanding of the forebrain network that supports the learning and production of birdsong is beginning to emerge. Here, we review recent advances in experimental studies of the zebra finch (Taeniopygia guttata), which offer new insights into the network dynamics that support this surprising analogue of human speech learning and production.

Trajectory-modulated hippocampal neurons persist throughout memory-guided navigation

Trajectory-dependent splitter neurons in the hippocampus encode information about a rodent's prior trajectory during performance of a continuous alternation task. As such, they provide valuable information for supporting memory-guided behavior. Here, we employed single-photon calcium imaging in freely moving mice to investigate the emergence and fate of trajectory-dependent activity through learning and mastery of a continuous spatial alternation task. In agreement with others, the quality of trajectory-dependent information in hippocampal neurons correlated with task performance. We thus hypothesized that, due to their utility, splitter neurons would exhibit heightened stability. We find that splitter neurons were more likely to remain active and retained more consistent spatial information across multiple days than other neurons. Furthermore, we find that both splitter neurons and place cells emerged rapidly and maintained stable trajectory-dependent/spatial activity thereafter. Our results suggest that neurons with useful functional coding exhibit heightened stability to support memory guided behavior.

Investigating learning-related neural circuitry with chronic in vivo optical imaging

Fundamental aspects of brain function, including development, plasticity, learning, and memory, can take place over time scales of days to years. Chronic in vivo imaging of neural activity with cellular resolution is a powerful method for tracking the long-term activity of neural circuits. We review recent advances in our understanding of neural circuit function from diverse brain regions that have been enabled by chronic in vivo cellular imaging. Insight into the neural basis of learning and decision-making, in particular, benefit from the ability to acquire longitudinal data from genetically identified neuronal populations, deep brain areas, and subcellular structures. We propose that combining chronic imaging with further experimental and computational innovations will advance our understanding of the neural circuit mechanisms of brain function.

Causes and consequences of representational drift

The nervous system learns new associations while maintaining memories over long periods, exhibiting a balance between flexibility and stability. Recent experiments reveal that neuronal representations of learned sensorimotor tasks continually change over days and weeks, even after animals have achieved expert behavioral performance. How is learned information stored to allow consistent behavior despite ongoing changes in neuronal activity? What functions could ongoing reconfiguration serve? We highlight recent experimental evidence for such representational drift in sensorimotor systems, and discuss how this fits into a framework of distributed population codes. We identify recent theoretical work that suggests computational roles for drift and argue that the recurrent and distributed nature of sensorimotor representations permits drift while limiting disruptive effects. We propose that representational drift may create error signals between interconnected brain regions that can be used to keep neural codes consistent in the presence of continual change. These concepts suggest experimental and theoretical approaches to studying both learning and maintenance of distributed and adaptive population codes.

A Stable Neural Code for Birdsong

Proteins, synapses, and neural connections are in constant flux, yet motor behaviors somehow remain stable. In this issue of Neuron, Katlowitz et al. (2018) show that temporally precise neural activity driving birdsong production is stable for weeks.

Transitioning between preparatory and precisely sequenced neuronal activity in production of a skilled behavior

Precise neural sequences are associated with the production of well-learned skilled behaviors. Yet, how neural sequences arise in the brain remains unclear. In songbirds, premotor projection neurons in the cortical song nucleus HVC are necessary for producing learned song and exhibit precise sequential activity during singing. Using cell-type specific calcium imaging we identify populations of HVC premotor neurons associated with the beginning and ending of singing-related neural sequences. We characterize neurons that bookend singing-related sequences and neuronal populations that transition from sparse preparatory activity prior to song to precise neural sequences during singing. Recordings from downstream premotor neurons or the respiratory system suggest that pre-song activity may be involved in motor preparation to sing. These findings reveal population mechanisms associated with moving from non-vocal to vocal behavioral states and suggest that precise neural sequences begin and end as part of orchestrated activity across functionally diverse populations of cortical premotor neurons.

Variation in sequence dynamics improves maintenance of stereotyped behavior in an example from bird song

Performing a stereotyped behavior successfully over time requires both maintaining performance quality and adapting efficiently to environmental or physical changes affecting performance. The bird song system is a paradigmatic example of learning a stereotyped behavior and therefore is a good place to study the interaction of these two goals. Through a model of bird song learning, we show how instability in neural representation of stable behavior confers advantages for adaptation and maintenance with minimal cost to performance quality. A precise, temporally sparse sequence from the premotor nucleus HVC is crucial to the performance of song in songbirds. We find that learning in the presence of sequence variations facilitates rapid relearning after shifts in the target song or muscle structure and results in decreased error with neuron loss. This robustness is due to the prevention of the buildup of correlations in the learned connectivity. In the absence of sequence variations, these correlations grow, due to the relatively low dimensionality of the exploratory variation in comparison with the number of plastic synapses. Our results suggest one would expect to see variability in neural systems executing stereotyped behaviors, and this variability is an advantageous feature rather than a challenge to overcome.