Variable specificity of memory trace reactivation during hippocampal sharp wave ripples

The neuroscience of active learning and direct instruction

Throughout the educational system, students experiencing active learning pedagogy perform better and fail less than those taught through direct instruction. Can this be ascribed to differences in learning from a neuroscientific perspective? This review examines mechanistic, neuroscientific evidence that might explain differences in cognitive engagement contributing to learning outcomes between these instructional approaches. In classrooms, direct instruction comprehensively describes academic content, while active learning provides structured opportunities for learners to explore, apply, and manipulate content. Synaptic plasticity and its modulation by arousal or novelty are central to all learning and both approaches. As a form of social learning, direct instruction relies upon working memory. The reinforcement learning circuit, associated agency, curiosity, and peer-to-peer social interactions combine to enhance motivation, improve retention, and build higher-order-thinking skills in active learning environments. When working memory becomes overwhelmed, additionally engaging the reinforcement learning circuit improves retention, providing an explanation for the benefits of active learning. This analysis provides a mechanistic examination of how emerging neuroscience principles might inform pedagogical choices at all educational levels.

Engram mechanisms of memory linking and identity

Memories are thought to be stored in neuronal ensembles referred to as engrams. Studies have suggested that when two memories occur in quick succession, a proportion of their engrams overlap and the memories become linked (in a process known as prospective linking) while maintaining their individual identities. In this Review, we summarize the key principles of memory linking through engram overlap, as revealed by experimental and modelling studies. We describe evidence of the involvement of synaptic memory substrates, spine clustering and non-linear neuronal capacities in prospective linking, and suggest a dynamic somato-synaptic model, in which memories are shared between neurons yet remain separable through distinct dendritic and synaptic allocation patterns. We also bring into focus retrospective linking, in which memories become associated after encoding via offline reactivation, and discuss key temporal and mechanistic differences between prospective and retrospective linking, as well as the potential differences in their cognitive outcomes.

Coupling of Sharp Wave Events between Zebrafish Hippocampal and Amygdala Homologs

The mammalian hippocampus exhibits spontaneous sharp wave events (1-30 Hz) with an often-present superimposed fast ripple oscillation (120-220 Hz) to form a sharp wave ripple (SWR) complex. During slow-wave sleep or quiet restfulness, SWRs result from the sequential spiking of hippocampal cell assemblies initially activated during learned or imagined experiences. Additional cortical/subcortical areas exhibit SWR events that are coupled to hippocampal SWRs, and studies in mammals suggest that coupling may be critical for the consolidation and recall of specific memories. In the present study, we have examined juvenile male and female zebrafish and show that SWR events are intrinsically generated and maintained within the telencephalon and that their hippocampal homolog, the anterodorsolateral lobe (ADL), exhibits SW events with ∼9% containing an embedded ripple (SWR). Single-cell calcium imaging coupled to local field potential recordings revealed that ∼10% of active cells in the dorsal telencephalon participate in any given SW event. Furthermore, fluctuations in cholinergic tone modulate SW events consistent with mammalian studies. Moreover, the basolateral amygdala (BLA) homolog exhibits SW events with ∼5% containing an embedded ripple. Computing the SW peak coincidence difference between the ADL and BLA showed bidirectional communication. Simultaneous coupling occurred more frequently within the same hemisphere, and in coupled events across hemispheres, the ADL more commonly preceded BLA. Together, these data suggest conserved mechanisms across species by which SW and SWR events are modulated, and memories may be transferred and consolidated through regional coupling.

Cortical reactivations predict future sensory responses

Many theories of offline memory consolidation posit that the pattern of neurons activated during a salient sensory experience will be faithfully reactivated, thereby stabilizing the pattern1,2. However, sensory-evoked patterns are not stable but, instead, drift across repeated experiences3-6. Here, to investigate the relationship between reactivations and the drift of sensory representations, we imaged the calcium activity of thousands of excitatory neurons in the mouse lateral visual cortex. During the minute after a visual stimulus, we observed transient, stimulus-specific reactivations, often coupled with hippocampal sharp-wave ripples. Stimulus-specific reactivations were abolished by local cortical silencing during the preceding stimulus. Reactivations early in a session systematically differed from the pattern evoked by the previous stimulus-they were more similar to future stimulus response patterns, thereby predicting both within-day and across-day representational drift. In particular, neurons that participated proportionally more or less in early stimulus reactivations than in stimulus response patterns gradually increased or decreased their future stimulus responses, respectively. Indeed, we could accurately predict future changes in stimulus responses and the separation of responses to distinct stimuli using only the rate and content of reactivations. Thus, reactivations may contribute to a gradual drift and separation in sensory cortical response patterns, thereby enhancing sensory discrimination7.

Backbone spiking sequence as a basis for preplay, replay, and default states in human cortex

Sequences of spiking activity have been heavily implicated as potential substrates of memory formation and retrieval across many species. A parallel line of recent evidence also asserts that sequential activity may arise from and be constrained by pre-existing network structure. Here we reconcile these two lines of research in the human brain by measuring single unit spiking sequences in the temporal lobe cortex as participants perform an episodic memory task. We find the presence of an average backbone spiking sequence identified during pre-task rest that is stable over time and different cognitive states. We further demonstrate that these backbone sequences are composed of both rigid and flexible sequence elements, and that flexible elements within these sequences serve to promote memory specificity when forming and retrieving new memories. These results support the hypothesis that pre-existing network dynamics serve as a scaffold for ongoing neural activity in the human cortex.

From single-neuron dynamics to higher-order circuit motifs in control and pathological brain networks

The convergence of advanced single-cell in vivo functional imaging techniques, computational modelling tools and graph-based network analytics has heralded new opportunities to study single-cell dynamics across large-scale networks, providing novel insights into principles of brain communication and pointing towards potential new strategies for treating neurological disorders. A major recent finding has been the identification of unusually richly connected hub cells that have capacity to synchronize networks and may also be critical in network dysfunction. While hub neurons are traditionally defined by measures that consider solely the number and strength of connections, novel higher-order graph analytics now enables the mining of massive networks for repeating subgraph patterns called motifs. As an illustration of the power offered by higher-order analysis of neuronal networks, we highlight how recent methodological advances uncovered a new functional cell type, the superhub, that is predicted to play a major role in regulating network dynamics. Finally, we discuss open questions that will be critical for assessing the importance of higher-order cellular-scale network analytics in understanding brain function in health and disease.

Cognitive neuroscience perspective on memory: overview and summary

This paper explores memory from a cognitive neuroscience perspective and examines associated neural mechanisms. It examines the different types of memory: working, declarative, and non-declarative, and the brain regions involved in each type. The paper highlights the role of different brain regions, such as the prefrontal cortex in working memory and the hippocampus in declarative memory. The paper also examines the mechanisms that underlie the formation and consolidation of memory, including the importance of sleep in the consolidation of memory and the role of the hippocampus in linking new memories to existing cognitive schemata. The paper highlights two types of memory consolidation processes: cellular consolidation and system consolidation. Cellular consolidation is the process of stabilizing information by strengthening synaptic connections. System consolidation models suggest that memories are initially stored in the hippocampus and are gradually consolidated into the neocortex over time. The consolidation process involves a hippocampal-neocortical binding process incorporating newly acquired information into existing cognitive schemata. The paper highlights the role of the medial temporal lobe and its involvement in autobiographical memory. Further, the paper discusses the relationship between episodic and semantic memory and the role of the hippocampus. Finally, the paper underscores the need for further research into the neurobiological mechanisms underlying non-declarative memory, particularly conditioning. Overall, the paper provides a comprehensive overview from a cognitive neuroscience perspective of the different processes involved in memory consolidation of different types of memory.

Cognition from the Body-Brain Partnership: Exaptation of Memory

Examination of cognition has historically been approached from language and introspection. However, human language-dependent definitions ignore the evolutionary roots of brain mechanisms and constrain their study in experimental animals. We promote an alternative view, namely that cognition, including memory, can be explained by exaptation and expansion of the circuits and algorithms serving bodily functions. Regulation and protection of metabolic and energetic processes require time-evolving brain computations enabling the organism to prepare for altered future states. Exaptation of such circuits was likely exploited for exploration of the organism's niche. We illustrate that exploration gives rise to a cognitive map, and in turn, environment-disengaged computation allows for mental travel into the past (memory) and the future (planning). Such brain-body interactions not only occur during waking but also persist during sleep. These exaptation steps are illustrated by the dual, endocrine-homeostatic and memory, contributions of the hippocampal system, particularly during hippocampal sharp-wave ripples.

Querying hippocampal replay with subcortical inputs

During sleep, the hippocampus recapitulates neuronal patterns corresponding to behavioral trajectories during previous experiences. This hippocampal replay supports the formation of long-term memories. Yet, whether replay originates within the hippocampal circuitry or is initiated by extrahippocampal inputs is unknown. Here, I review recent findings regarding the organization of neuronal activity upstream to the hippocampus, in the head-direction (HD) and grid cell networks, and its relationship to replay. I argue that hippocampal activity at the onset of replay is under the influence of signals from primary spatial areas. In turn, hippocampal replay resets the HD network activity to select a new direction for the next replay event. This reciprocal interaction between the HD network and the hippocampus may be essential in grounding meaning to hippocampal activity, specifically by training decoders of hippocampal sequences. Neuronal dynamics in thalamo-hippocampal loops may thus be instrumental for memory processes during sleep.

Sleep prevents catastrophic forgetting in spiking neural networks by forming a joint synaptic weight representation

Artificial neural networks overwrite previously learned tasks when trained sequentially, a phenomenon known as catastrophic forgetting. In contrast, the brain learns continuously, and typically learns best when new training is interleaved with periods of sleep for memory consolidation. Here we used spiking network to study mechanisms behind catastrophic forgetting and the role of sleep in preventing it. The network could be trained to learn a complex foraging task but exhibited catastrophic forgetting when trained sequentially on different tasks. In synaptic weight space, new task training moved the synaptic weight configuration away from the manifold representing old task leading to forgetting. Interleaving new task training with periods of off-line reactivation, mimicking biological sleep, mitigated catastrophic forgetting by constraining the network synaptic weight state to the previously learned manifold, while allowing the weight configuration to converge towards the intersection of the manifolds representing old and new tasks. The study reveals a possible strategy of synaptic weights dynamics the brain applies during sleep to prevent forgetting and optimize learning.

Multiple-Timescale Representations of Space: Linking Memory to Navigation

When navigating through space, we must maintain a representation of our position in real time; when recalling a past episode, a memory can come back in a flash. Interestingly, the brain's spatial representation system, including the hippocampus, supports these two distinct timescale functions. How are neural representations of space used in the service of both real-world navigation and internal mnemonic processes? Recent progress has identified sequences of hippocampal place cells, evolving at multiple timescales in accordance with either navigational behaviors or internal oscillations, that underlie these functions. We review experimental findings on experience-dependent modulation of these sequential representations and consider how they link real-world navigation to time-compressed memories. We further discuss recent work suggesting the prevalence of these sequences beyond hippocampus and propose that these multiple-timescale mechanisms may represent a general algorithm for organizing cell assemblies, potentially unifying the dual roles of the spatial representation system in memory and navigation.

Brain-wide interactions during hippocampal sharp wave ripples

During periods of disengagement from the environment, transient population bursts, known as sharp wave ripples (SPW-Rs), occur sporadically. While numerous experiments have characterized the bidirectional relationship between SPW-Rs and activity in chosen brain areas, the topographic relationship between different segments of the hippocampus and brain-wide target areas has not been studied at high temporal and spatial resolution. Yet, such knowledge is necessary to infer the direction of communication. We analyzed two publicly available datasets with simultaneous high-density silicon probe recordings from across the mouse forebrain. We found that SPW-Rs coincide with a transient brain-wide increase in functional connectivity. In addition, we show that the diversity in SPW-R features, such as their incidence, magnitude, and intrahippocampal topography in the septotemporal axis, are correlated with slower excitability fluctuations in cortical and subcortical areas. Further, variations in SPW-R features correlated with the timing, sign, and magnitude of downstream responses with large-amplitude SPW-Rs followed by transient silence in extrahippocampal structures. Our findings expand on previous results and demonstrate that the activity patterns in extrahippocampal structures depend both on the intrahippocampal topographic origin and magnitude of hippocampal SPW-Rs.

The shallow cognitive map hypothesis: A hippocampal framework for thought disorder in schizophrenia

Memories are not formed in isolation. They are associated and organized into relational knowledge structures that allow coherent thought. Failure to express such coherent thought is a key hallmark of Schizophrenia. Here we explore the hypothesis that thought disorder arises from disorganized Hippocampal cognitive maps. In doing so, we combine insights from two key lines of investigation, one concerning the neural signatures of cognitive mapping, and another that seeks to understand lower-level cellular mechanisms of cognition within a dynamical systems framework. Specifically, we propose that multiple distinct pathological pathways converge on the shallowing of Hippocampal attractors, giving rise to disorganized Hippocampal cognitive maps and driving conceptual disorganization. We discuss the available evidence at the computational, behavioural, network, and cellular levels. We also outline testable predictions from this framework, including how it could unify major chemical and psychological theories of schizophrenia and how it can provide a rationale for understanding the aetiology and treatment of the disease.

A metabolic function of the hippocampal sharp wave-ripple

The hippocampus has previously been implicated in both cognitive and endocrine functions^1-15. We simultaneously measured electrophysiological activity from the hippocampus and interstitial glucose concentrations in the body of freely behaving rats to identify an activity pattern that may link these disparate functions of the hippocampus. Here we report that clusters of sharp wave-ripples recorded from the hippocampus reliably predicted a decrease in peripheral glucose concentrations within about 10 min. This correlation was not dependent on circadian, ultradian or meal-triggered fluctuations, could be mimicked with optogenetically induced ripples in the hippocampus (but not in the parietal cortex) and was attenuated to chance levels by pharmacogenetically suppressing activity of the lateral septum, which is the major conduit between the hippocampus and the hypothalamus. Our findings demonstrate that a function of the sharp wave-ripple is to modulate peripheral glucose homeostasis, and offer a mechanism for the link between sleep disruption and blood glucose dysregulation in type 2 diabetes^16-18.

Replay in minds and machines

Experience-related brain activity patterns reactivate during sleep, wakeful rest, and brief pauses from active behavior. In parallel, machine learning research has found that experience replay can lead to substantial performance improvements in artificial agents. Together, these lines of research suggest replay has a variety of computational benefits for decision-making and learning. Here, we provide an overview of putative computational functions of replay as suggested by machine learning and neuroscientific research. We show that replay can lead to faster learning, less forgetting, reorganization or augmentation of experiences, and support planning and generalization. In addition, we highlight the benefits of reactivating abstracted internal representations rather than veridical memories, and discuss how replay could provide a mechanism to build internal representations that improve learning and decision-making.

Aperiodic sleep networks promote memory consolidation

Hierarchical synchronization of sleep oscillations establishes communication pathways to support memory reactivation, transfer, and consolidation. From an information-theoretical perspective, oscillations constitute highly structured network states that provide limited information-coding capacity. Recent findings indicate that sleep oscillations occur in transient bursts that are interleaved with aperiodic network states, which were previously considered to be random noise. We argue that aperiodic activity exhibits unique and variable spatiotemporal patterns, providing an ideal information-rich neurophysiological substrate for imprinting new mnemonic patterns onto existing circuits. We discuss novel avenues in conceptualizing and quantifying aperiodic network states during sleep to further understand their relevance and interplay with sleep oscillations in support of memory consolidation.

Endogenous memory reactivation during sleep in humans is clocked by slow oscillation-spindle complexes

Sleep is thought to support memory consolidation via reactivation of prior experiences, with particular electrophysiological sleep signatures (slow oscillations (SOs) and sleep spindles) gating the information flow between relevant brain areas. However, empirical evidence for a role of endogenous memory reactivation (i.e., without experimentally delivered memory cues) for consolidation in humans is lacking. Here, we devised a paradigm in which participants acquired associative memories before taking a nap. Multivariate decoding was then used to capture endogenous memory reactivation during non-rapid eye movement (NREM) sleep in surface EEG recordings. Our results reveal reactivation of learning material during SO-spindle complexes, with the precision of SO-spindle coupling predicting reactivation strength. Critically, reactivation strength (i.e. classifier evidence in favor of the previously studied stimulus category) in turn predicts the level of consolidation across participants. These results elucidate the memory function of sleep in humans and emphasize the importance of SOs and spindles in clocking endogenous consolidation processes.

The evolving view of replay and its functions in wake and sleep

The term hippocampal replay originally referred to the temporally compressed reinstantiation, during rest, of sequential neural activity observed during prior active wake. Since its description in the 1990s, hippocampal replay has often been viewed as the key mechanism by which a memory trace is repeatedly rehearsed at high speeds during sleep and gradually transferred to neocortical circuits. However, the methods used to measure the occurrence of replay remain debated, and it is now clear that the underlying neural events are considerably more complicated than the traditional narratives had suggested. “Replay-like” activity happens during wake, can play out in reverse order, may represent trajectories never taken by the animal, and may have additional functions beyond memory consolidation, from learning values and solving the problem of credit assignment to decision-making and planning. Still, we know little about the role of replay in cognition, and to what extent it differs between wake and sleep. This may soon change, however, because decades-long efforts to explain replay in terms of reinforcement learning (RL) have started to yield testable predictions and possible explanations for a diverse set of observations. Here, we (1) survey the diverse features of replay, focusing especially on the latest findings; (2) discuss recent attempts at unifying disparate experimental results and putatively different cognitive functions under the banner of RL; (3) discuss methodological issues and theoretical biases that impede progress or may warrant a partial revaluation of the current literature, and finally; (4) highlight areas of considerable uncertainty and promising avenues of inquiry.

Can sleep protect memories from catastrophic forgetting?

Continual learning remains an unsolved problem in artificial neural networks. The brain has evolved mechanisms to prevent catastrophic forgetting of old knowledge during new training. Building upon data suggesting the importance of sleep in learning and memory, we tested a hypothesis that sleep protects old memories from being forgotten after new learning. In the thalamocortical model, training a new memory interfered with previously learned old memories leading to degradation and forgetting of the old memory traces. Simulating sleep after new learning reversed the damage and enhanced old and new memories. We found that when a new memory competed for previously allocated neuronal/synaptic resources, sleep replay changed the synaptic footprint of the old memory to allow overlapping neuronal populations to store multiple memories. Our study predicts that memory storage is dynamic, and sleep enables continual learning by combining consolidation of new memory traces with reconsolidation of old memory traces to minimize interference.

Naïve to expert: Considering the role of previous knowledge in memory

In humans, most of our new memories are in some way or another related to what we have already experienced. However, in memory research, especially in non-human animal research, subjects are often mostly naïve to the world. But we know that previous knowledge will change how memories are processed and which brain areas are critical at which time point. Each process from encoding, consolidation, to memory retrieval will be affected. Here, we summarise previous knowledge effects on the neurobiology of memory in both humans and non-human animals, with a special focus on schemas - associative network structures. Furthermore, we propose a new theory on how there may be a continuous gradient from naïve to expert, which would modulate the importance and role of brain areas, such as the hippocampus and prefrontal cortex.