Circuit reactivation dynamically regulates synaptic plasticity in neocortex

Molecular Mechanisms of Memory Consolidation That Operate During Sleep

The role of sleep for brain function has been in the focus of interest for many years. It is now firmly established that sleep and the corresponding brain activity is of central importance for memory consolidation. Less clear are the underlying molecular mechanisms and their specific contribution to the formation of long-term memory. In this review, we summarize the current knowledge of such mechanisms and we discuss the several unknowns that hinder a deeper appreciation of how molecular mechanisms of memory consolidation during sleep impact synaptic function and engram formation.

Autonomous emergence of connectivity assemblies via spike triplet interactions

Non-random connectivity can emerge without structured external input driven by activity-dependent mechanisms of synaptic plasticity based on precise spiking patterns. Here we analyze the emergence of global structures in recurrent networks based on a triplet model of spike timing dependent plasticity (STDP), which depends on the interactions of three precisely-timed spikes, and can describe plasticity experiments with varying spike frequency better than the classical pair-based STDP rule. We derive synaptic changes arising from correlations up to third-order and describe them as the sum of structural motifs, which determine how any spike in the network influences a given synaptic connection through possible connectivity paths. This motif expansion framework reveals novel structural motifs under the triplet STDP rule, which support the formation of bidirectional connections and ultimately the spontaneous emergence of global network structure in the form of self-connected groups of neurons, or assemblies. We propose that under triplet STDP assembly structure can emerge without the need for externally patterned inputs or assuming a symmetric pair-based STDP rule common in previous studies. The emergence of non-random network structure under triplet STDP occurs through internally-generated higher-order correlations, which are ubiquitous in natural stimuli and neuronal spiking activity, and important for coding. We further demonstrate how neuromodulatory mechanisms that modulate the shape of the triplet STDP rule or the synaptic transmission function differentially promote structural motifs underlying the emergence of assemblies, and quantify the differences using graph theoretic measures.

Emergent non-random connectivity structures in different brain regions are tightly related to specific patterns of neural activity and support diverse brain functions. For instance, self-connected groups of neurons, known as assemblies, have been proposed to represent functional units in brain circuits and can emerge even without patterned external instruction. Here we investigate the emergence of non-random connectivity in recurrent networks using a particular plasticity rule, triplet STDP, which relies on the interaction of spike triplets and can capture higher-order statistical dependencies in neural activity. We derive the evolution of the synaptic strengths in the network and explore the conditions for the self-organization of connectivity into assemblies. We demonstrate key differences of the triplet STDP rule compared to the classical pair-based rule in terms of how assemblies are formed, including the realistic asymmetric shape and influence of novel connectivity motifs on network plasticity driven by higher-order correlations. Assembly formation depends on the specific shape of the STDP window and synaptic transmission function, pointing towards an important role of neuromodulatory signals on formation of intrinsically generated assemblies.

Patterned activation of action potential patterns during offline states in the neocortex: replay and non-replay

Action potential generation (spiking) in the neocortex is organized into repeating non-random patterns during both awake experiential states and non-engaged states ranging from inattention to sleep to anaesthesia—and even occur in slice preparations. Repeating patterns in a given population of neurons between states may imply a common means by which cortical networks can be engaged despite brain state changes, but super-imposed on this common firing is a variability that is both specific to ongoing inputs and can be re-shaped by experience. This similarity with specifically induced variance may allow for a range of processes including perception, memory consolidation and network homeostasis. Here, we review how patterned activity in neocortical populations has been studied and what it may imply for a cortex that must be both static and plastic.

This article is part of the Theo Murphy meeting issue ‘Memory reactivation: replaying events past, present and future’.

Isolated cortical computations during delta waves support memory consolidation

Delta waves have been described as periods of generalized silence across the cortex, and their alternation with periods of endogenous activity results in the slow oscillation of slow-wave sleep. Despite evidence that delta waves are instrumental for memory consolidation, their specific role in reshaping cortical functional circuits remains puzzling. In a rat model, we found that delta waves are not periods of complete silence and that the residual activity is not mere neuronal noise. Instead, cortical cells involved in learning a spatial memory task subsequently formed cell assemblies during delta waves in response to transient reactivation of hippocampal ensembles during ripples. This process occurred selectively during endogenous or induced memory consolidation. Thus, delta waves represent isolated cortical computations tightly related to ongoing information processing underlying memory consolidation.

How rhythms of the sleeping brain tune memory and synaptic plasticity

Decades of neurobehavioral research has linked sleep-associated rhythms in various brain areas to improvements in cognitive performance. However, it remains unclear what synaptic changes might underlie sleep-dependent declarative memory consolidation and procedural task improvement, and why these same changes appear not to occur across a similar interval of wake. Here we describe recent research on how one specific feature of sleep-network rhythms characteristic of rapid eye movement and non-rapid eye movement-could drive synaptic strengthening or weakening in specific brain circuits. We provide an overview of how these rhythms could affect synaptic plasticity individually and in concert. We also present an overarching hypothesis for how all network rhythms occurring across the sleeping brain could aid in encoding new information in neural circuits.

NREM sleep in the rodent neocortex and hippocampus reflects excitable dynamics

During non-rapid eye movement (NREM) sleep, neuronal populations in the mammalian forebrain alternate between periods of spiking and inactivity. Termed the slow oscillation in the neocortex and sharp wave-ripples in the hippocampus, these alternations are often considered separately but are both crucial for NREM functions. By directly comparing experimental observations of naturally-sleeping rats with a mean field model of an adapting, recurrent neuronal population, we find that the neocortical alternations reflect a dynamical regime in which a stable active state is interrupted by transient inactive states (slow waves) while the hippocampal alternations reflect a stable inactive state interrupted by transient active states (sharp waves). We propose that during NREM sleep in the rodent, hippocampal and neocortical populations are excitable: each in a stable state from which internal fluctuations or external perturbation can evoke the stereotyped population events that mediate NREM functions.

Sequential Neural Activity in Primary Motor Cortex during Sleep

Sequential firing of neurons during sleep is thought to play a role in the consolidation of learning. However, direct evidence for such sequence replay is limited to only a few brain areas and sleep states mainly in rodents. Using a custom-designed wearable neural data logger and chronically implanted electrodes, we made long-term recordings of neural activity in the primary motor cortex of two female nonhuman primates during free behavior and natural sleep. We used the local field potential (LFP) spectrogram to characterize sleep cycles, and examined firing rates, correlations, and sequential firing of neurons at different frequency bands through the cycle. Slow-wave sleep (SWS) was characterized by low neural firing rates and high synchrony, reflecting slow oscillations between cortical down and up states. However, the order in which neurons entered up states was similar to the sequence of neural activity observed at low frequencies during waking behavior. In addition, we found evidence of brief bursts of theta oscillation, associated with non-SWS states, during which neurons fired in strikingly regular sequential order phase-locked to the LFP. Theta sequences were preserved between waking and sleep, but appeared not to resemble the order of neural activity observed at lower frequencies. The sequential firing of neurons during slow oscillations and theta bursts may contribute to the consolidation of procedural memories during sleep.SIGNIFICANCE STATEMENT Replay of sequential neural activity during sleep is believed to support consolidation of daytime learning. Despite a wealth of studies investigating sequential replay in association with episodic and spatial memory, it is unknown whether similar sequences occur in motor areas during sleep. Within long-term neural recordings from monkey motor cortex, we found two distinct patterns of sequential activity during different phases of the natural sleep cycle. Slow-wave sleep was associated with delta-band sequences that resembled low-frequency activity during movement, while occasional brief bursts of theta oscillation were associated with a different order of sequential firing. Our results are the first report of sequential sleep replay in the motor cortex, which may play an important role in consolidation of procedural learning.

Ensemble stacking mitigates biases in inference of synaptic connectivity

A promising alternative to directly measuring the anatomical connections in a neuronal population is inferring the connections from the activity. We employ simulated spiking neuronal networks to compare and contrast commonly used inference methods that identify likely excitatory synaptic connections using statistical regularities in spike timing. We find that simple adjustments to standard algorithms improve inference accuracy: A signing procedure improves the power of unsigned mutual-information-based approaches and a correction that accounts for differences in mean and variance of background timing relationships, such as those expected to be induced by heterogeneous firing rates, increases the sensitivity of frequency-based methods. We also find that different inference methods reveal distinct subsets of the synaptic network and each method exhibits different biases in the accurate detection of reciprocity and local clustering. To correct for errors and biases specific to single inference algorithms, we combine methods into an ensemble. Ensemble predictions, generated as a linear combination of multiple inference algorithms, are more sensitive than the best individual measures alone, and are more faithful to ground-truth statistics of connectivity, mitigating biases specific to single inference methods. These weightings generalize across simulated datasets, emphasizing the potential for the broad utility of ensemble-based approaches.

Activity-Dependent Downscaling of Subthreshold Synaptic Inputs during Slow-Wave-Sleep-like Activity In Vivo

Activity-dependent synaptic plasticity is critical for cortical circuit refinement. The synaptic homeostasis hypothesis suggests that synaptic connections are strengthened during wake and downscaled during sleep; however, it is not obvious how the same plasticity rules could explain both outcomes. Using whole-cell recordings and optogenetic stimulation of presynaptic input in urethane-anesthetized mice, which exhibit slow-wave-sleep (SWS)-like activity, we show that synaptic plasticity rules are gated by cortical dynamics in vivo. While Down states support conventional spike timing-dependent plasticity, Up states are biased toward depression such that presynaptic stimulation alone leads to synaptic depression, while connections contributing to postsynaptic spiking are protected against this synaptic weakening. We find that this novel activity-dependent and input-specific downscaling mechanism has two important computational advantages: (1) improved signal-to-noise ratio, and (2) preservation of previously stored information. Thus, these synaptic plasticity rules provide an attractive mechanism for SWS-related synaptic downscaling and circuit refinement.

Emergent cortical circuit dynamics contain dense, interwoven ensembles of spike sequences

Temporal codes are theoretically powerful encoding schemes, but their precise form in the neocortex remains unknown in part because of the large number of possible codes and the difficulty in disambiguating informative spikes from statistical noise. A biologically plausible and computationally powerful temporal coding scheme is the Hebbian assembly phase sequence (APS), which predicts reliable propagation of spikes between functionally related assemblies of neurons. Here, we sought to measure the inherent capacity of neocortical networks to produce reliable sequences of spikes, as would be predicted by an APS code. To record microcircuit activity, the scale at which computation is implemented, we used two-photon calcium imaging to densely sample spontaneous activity in murine neocortical networks ex vivo. We show that the population spike histogram is sufficient to produce a spatiotemporal progression of activity across the population. To more comprehensively evaluate the capacity for sequential spiking that cannot be explained by the overall population spiking, we identify statistically significant spike sequences. We found a large repertoire of sequence spikes that collectively comprise the majority of spiking in the circuit. Sequences manifest probabilistically and share neuron membership, resulting in unique ensembles of interwoven sequences characterizing individual spatiotemporal progressions of activity. Distillation of population dynamics into its constituent sequences provides a way to capture trial-to-trial variability and may prove to be a powerful decoding substrate in vivo. Informed by these data, we suggest that the Hebbian APS be reformulated as interwoven sequences with flexible assembly membership due to shared overlapping neurons.NEW & NOTEWORTHY Neocortical computation occurs largely within microcircuits comprised of individual neurons and their connections within small volumes (<500 μm³). We found evidence for a long-postulated temporal code, the Hebbian assembly phase sequence, by identifying repeated and co-occurring sequences of spikes. Variance in population activity across trials was explained in part by the ensemble of active sequences. The presence of interwoven sequences suggests that neuronal assembly structure can be variable and is determined by previous activity.

Sleep regulation of the distribution of cortical firing rates

Sleep is thought to mediate both mnemonic and homeostatic functions. However, the mechanism by which this brain state can simultaneously implement the 'selective' plasticity needed to consolidate novel memory traces and the 'general' plasticity necessary to maintain a well-functioning neuronal system is unclear. Recent findings show that both of these functions differentially affect neurons based on their intrinsic firing rate, a ubiquitous neuronal heterogeneity. Furthermore, they are both implemented by the NREM slow oscillation, which also distinguishes neurons based on firing rate during sequential activity at the DOWN→UP transition. These findings suggest a mechanism by which spiking activity during the slow oscillation acts to maintain network statistics that promote a skewed distribution of neuronal firing rates, and perturbation of that activity by hippocampal replay acts to integrate new memory traces into the existing cortical network.

Aberrant Network Activity in Schizophrenia

Brain dynamic changes associated with schizophrenia are largely equivocal, with interpretation complicated by many factors, such as the presence of therapeutic agents and the complex nature of the syndrome itself. Evidence for a brain-wide change in individual network oscillations, shared by all patients, is largely equivocal, but stronger for lower (delta) than for higher (gamma) bands. However, region-specific changes in rhythms across multiple, interdependent, nested frequencies may correlate better with pathology. Changes in synaptic excitation and inhibition in schizophrenia disrupt delta rhythm-mediated cortico-cortical communication, while enhancing thalamocortical communication in this frequency band. The contrasting relationships between delta and higher frequencies in thalamus and cortex generate frequency mismatches in inter-regional connectivity, leading to a disruption in temporal communication between higher-order brain regions associated with mental time travel.

Memory replay in balanced recurrent networks

Complex patterns of neural activity appear during up-states in the neocortex and sharp waves in the hippocampus, including sequences that resemble those during prior behavioral experience. The mechanisms underlying this replay are not well understood. How can small synaptic footprints engraved by experience control large-scale network activity during memory retrieval and consolidation? We hypothesize that sparse and weak synaptic connectivity between Hebbian assemblies are boosted by pre-existing recurrent connectivity within them. To investigate this idea, we connect sequences of assemblies in randomly connected spiking neuronal networks with a balance of excitation and inhibition. Simulations and analytical calculations show that recurrent connections within assemblies allow for a fast amplification of signals that indeed reduces the required number of inter-assembly connections. Replay can be evoked by small sensory-like cues or emerge spontaneously by activity fluctuations. Global-potentially neuromodulatory-alterations of neuronal excitability can switch between network states that favor retrieval and consolidation.

Higher-Order Synaptic Interactions Coordinate Dynamics in Recurrent Networks

Linking synaptic connectivity to dynamics is key to understanding information processing in neocortex. Circuit dynamics emerge from complex interactions of interconnected neurons, necessitating that links between connectivity and dynamics be evaluated at the network level. Here we map propagating activity in large neuronal ensembles from mouse neocortex and compare it to a recurrent network model, where connectivity can be precisely measured and manipulated. We find that a dynamical feature dominates statistical descriptions of propagating activity for both neocortex and the model: convergent clusters comprised of fan-in triangle motifs, where two input neurons are themselves connected. Fan-in triangles coordinate the timing of presynaptic inputs during ongoing activity to effectively generate postsynaptic spiking. As a result, paradoxically, fan-in triangles dominate the statistics of spike propagation even in randomly connected recurrent networks. Interplay between higher-order synaptic connectivity and the integrative properties of neurons constrains the structure of network dynamics and shapes the routing of information in neocortex.

Memory trace replay: the shaping of memory consolidation by neuromodulation

The consolidation of memories for places and events is thought to rely, at the network level, on the replay of spatially tuned neuronal firing patterns representing discrete places and spatial trajectories. This occurs in the hippocampal-entorhinal circuit during sharp wave ripple events (SWRs) that occur during sleep or rest. Here, we review theoretical models of lingering place cell excitability and behaviorally induced synaptic plasticity within cell assemblies to explain which sequences or places are replayed. We further provide new insights into how fluctuations in cholinergic tone during different behavioral states might shape the direction of replay and how dopaminergic release in response to novelty or reward can modulate which cell assemblies are replayed.

Beyond the patch clamp: nanotechnologies for intracellular recording

The patch clamp is a fundamental tool for neuroscientists, offering insights that have shaped our understanding of the brain. Advances in nanotechnology suggest that the next generation of recording methods is now within reach. We discuss the complexity and future promise of applying nanoscience to neural recording.

Sleep, Memory & Brain Rhythms

Sleep occupies roughly one-third of our lives, yet the scientific community is still not entirely clear on its purpose or function. Existing data point most strongly to its role in memory and homeostasis: that sleep helps maintain basic brain functioning via a homeostatic mechanism that loosens connections between overworked synapses, and that sleep helps consolidate and re-form important memories. In this review, we will summarize these theories, but also focus on substantial new information regarding the relation of electrical brain rhythms to sleep. In particular, while REM sleep may contribute to the homeostatic weakening of overactive synapses, a prominent and transient oscillatory rhythm called "sharp-wave ripple" seems to allow for consolidation of behaviorally relevant memories across many structures of the brain. We propose that a theory of sleep involving the division of labor between two states of sleep-REM and non-REM, the latter of which has an abundance of ripple electrical activity-might allow for a fusion of the two main sleep theories. This theory then postulates that sleep performs a combination of consolidation and homeostasis that promotes optimal knowledge retention as well as optimal waking brain function.

Acetylcholine functionally reorganizes neocortical microcircuits

Sensory information is processed and transmitted through the synaptic structure of local cortical circuits, but it is unclear how modulation of this architecture influences the cortical representation of sensory stimuli. Acetylcholine (ACh) promotes attention and arousal and is thought to increase the signal-to-noise ratio of sensory input in primary sensory cortices. Using high-speed two-photon calcium imaging in a thalamocortical somatosensory slice preparation, we recorded action potential activity of up to 900 neurons simultaneously and compared local cortical circuit activations with and without bath presence of ACh. We found that ACh reduced weak pairwise relationships and excluded neurons that were already unreliable during circuit activity. Using action potential activity from the imaged population, we generated functional wiring diagrams based on the statistical dependencies of activity between neurons. ACh pruned weak functional connections from spontaneous circuit activations and yielded a more modular and hierarchical circuit structure, which biased activity to flow in a more feedforward fashion. Neurons that were active in response to thalamic input had reduced pairwise dependencies overall, but strong correlations were conserved. This coincided with a prolonged period during which neurons showed temporally precise responses to thalamic input. Our results demonstrate that ACh reorganizes functional circuit structure in a manner that may enhance the integration and discriminability of thalamic afferent input within local neocortical circuitry.