Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval

Inhibitory plasticity supports replay generalization in the hippocampus

Memory consolidation assimilates recent experiences into long-term memory. This process requires the replay of learned sequences, although the content of these sequences remains controversial. Recent work has shown that the statistics of replay deviate from those of experience: stimuli that are experientially salient may be either recruited or suppressed from sharp-wave ripples. In this study, we found that this phenomenon can be explained parsimoniously and biologically plausibly by a Hebbian spike-time-dependent plasticity rule at inhibitory synapses. Using models at three levels of abstraction-leaky integrate-and-fire, biophysically detailed and abstract binary-we show that this rule enables efficient generalization, and we make specific predictions about the consequences of intact and perturbed inhibitory dynamics for network dynamics and cognition. Finally, we use optogenetics to artificially implant non-generalizable representations into the network in awake behaving mice, and we find that these representations also accumulate inhibition during sharp-wave ripples, experimentally validating a major prediction of our model. Our work outlines a potential direct link between the synaptic and cognitive levels of memory consolidation, with implications for both normal learning and neurological disease.

High frequency oscillations in human memory and cognition: a neurophysiological substrate of engrams?

Despite advances in understanding the cellular and molecular processes underlying memory and cognition, and recent successful modulation of cognitive performance in brain disorders, the neurophysiological mechanisms remain underexplored. High frequency oscillations beyond the classic electroencephalogram spectrum have emerged as a potential neural correlate of fundamental cognitive processes. High frequency oscillations are detected in the human mesial temporal lobe and neocortical intracranial recordings spanning gamma/epsilon (60-150 Hz), ripple (80-250 Hz) and higher frequency ranges. Separate from other non-oscillatory activities, these brief electrophysiological oscillations of distinct duration, frequency and amplitude are thought to be generated by coordinated spiking of neuronal ensembles within volumes as small as a single cortical column. Although the exact origins, mechanisms and physiological roles in health and disease remain elusive, they have been associated with human memory consolidation and cognitive processing. Recent studies suggest their involvement in encoding and recall of episodic memory with a possible role in the formation and reactivation of memory traces. High frequency oscillations are detected during encoding, throughout maintenance, and right before recall of remembered items, meeting a basic definition for an engram activity. The temporal coordination of high frequency oscillations reactivated across cortical and subcortical neural networks is ideally suited for integrating multimodal memory representations, which can be replayed and consolidated during states of wakefulness and sleep. High frequency oscillations have been shown to reflect coordinated bursts of neuronal assembly firing and offer a promising substrate for tracking and modulation of the hypothetical electrophysiological engram.

EEG signature of near-death-like experiences during syncope-induced periods of unresponsiveness

During fainting, disconnected consciousness may emerge in the form of dream-like experiences. Characterized by extra-ordinary and mystical features, these subjective experiences have been associated to near-death-like experiences (NDEs-like). We here aim to assess brain activity during syncope-induced disconnected consciousness by means of high-density EEG monitoring. Transient loss of consciousness and unresponsiveness were induced in 27 healthy volunteers through hyperventilation, orthostasis, and Valsalva maneuvers. Upon awakening, subjects were asked to report memories, if any. The Greyson NDE scale was used to evaluate the potential phenomenological content experienced during the syncope-induced periods of unresponsiveness. EEG source reconstruction assessed cortical activations during fainting, which were regressed out with subjective reports collected upon recovery of normal consciousness. We also conducted functional connectivity, graph-theoretic and complexity analyses. High quality high-density EEG data were obtained in 22 volunteers during syncope and unresponsiveness (lasting 22±8 s). NDE-like features (Greyson NDE scale total score ≥7/32) were apparent for eight volunteers and characterized by higher activity in delta, theta and beta2 bands in temporal and frontal regions. The richness of the NDE-like content was associated with delta, theta and beta2 bands cortical current densities, in temporal, parietal and frontal lobes, including insula, right temporoparietal junction, and cingulate cortex. Our analyses also revealed a higher complexity and that networks related to delta, theta, and beta2 bands were characterized by a higher overall connectivity paralleled by a higher segregation (i.e., local efficiency) and a higher integration (i.e., global efficiency) for the NDE-like group compared to the non-NDE-like group. Fainting-induced NDE-like episodes seem to be sustained by surges of neural activity representing promising markers of disconnected consciousness.

Replay-triggered brain-wide activation in humans

The consolidation of discrete experiences into a coherent narrative shapes the cognitive map, providing structured mental representations of our experiences. In this process, past memories are reactivated and replayed in sequence, fostering hippocampal-cortical dialogue. However, brain-wide engagement coinciding with sequential reactivation (or replay) of memories remains largely unexplored. In this study, employing simultaneous EEG-fMRI, we capture both the spatial and temporal dynamics of memory replay. We find that during mental simulation, past memories are replayed in fast sequences as detected via EEG. These transient replay events are associated with heightened fMRI activity in the hippocampus and medial prefrontal cortex. Replay occurrence strengthens functional connectivity between the hippocampus and the default mode network, a set of brain regions key to representing the cognitive map. On the other hand, when subjects are at rest following learning, memory reactivation of task-related items is stronger than that of pre-learning rest, and is also associated with heightened hippocampal activation and augmented hippocampal connectivity to the entorhinal cortex. Together, our findings highlight a distributed, brain-wide engagement associated with transient memory reactivation and its sequential replay.

Dentate gyrus ensembles gate context-dependent neural states and memory retrieval

Memories of events are linked to the contexts in which they were encoded. This contextual linking ensures enhanced access to those memories that are most relevant to the context at hand, including specific associations that were previously learned in that context. This principle, referred to as encoding specificity, predicts that context-specific neural states should bias retrieval of particular associations over others, potentially allowing for the disambiguation of retrieval cues that may have multiple associations or meanings. Using a context-odor paired associate learning paradigm in mice, here, we show that chemogenetic manipulation of dentate gyrus ensembles corresponding to specific contexts reinstates context-specific neural states in downstream CA1 and biases retrieval toward context-specific associations.

The translational inhibitor and amnestic agent emetine also suppresses ongoing hippocampal neural activity similarly to other blockers of protein synthesis

The consolidation of memory is thought to ultimately depend on the synthesis of new proteins, since translational inhibitors such as anisomycin and cycloheximide adversely affect the permanence of long-term memory. However, when applied directly in brain, these agents also profoundly suppress neural activity to an extent that is directly correlated to the degree of protein synthesis inhibition caused. Given that neural activity itself is likely to help mediate consolidation, this finding is a serious criticism of the strict de novo protein hypothesis of memory. Here, we test the neurophysiological effects of another translational inhibitor, emetine. Unilateral intra-hippocampal infusion of emetine suppressed ongoing local field and multiunit activity at ipsilateral sites as compared to the contralateral hippocampus in a fashion that was positively correlated to the degree of protein synthesis inhibition as confirmed by autoradiography. This suppression of activity was also specific to the circumscribed brain region in which protein synthesis inhibition took place. These experiments provide further evidence that ongoing protein synthesis is necessary and fundamental for neural function and suggest that the disruption of memory observed in behavioral experiments using translational inhibitors may be due, in large part, to neural suppression.

Synaptic weight dynamics underlying memory consolidation: implications for learning rules, circuit organization, and circuit function

Systems consolidation is a common feature of learning and memory systems, in which a long-term memory initially stored in one brain region becomes persistently stored in another region. We studied the dynamics of systems consolidation in simple circuit architectures with two sites of plasticity, one in an early-learning and one in a late-learning brain area. We show that the synaptic dynamics of the circuit during consolidation of an analog memory can be understood as a temporal integration process, by which transient changes in activity driven by plasticity in the early-learning area are accumulated into persistent synaptic changes at the late-learning site. This simple principle naturally leads to a speed-accuracy tradeoff in systems consolidation and provides insight into how the circuit mitigates the stability-plasticity dilemma of storing new memories while preserving core features of older ones. Furthermore, it imposes two constraints on the circuit. First, the plasticity rule at the late-learning site must stably support a continuum of possible outputs for a given input. We show that this is readily achieved by heterosynaptic but not standard Hebbian rules. Second, to turn off the consolidation process and prevent erroneous changes at the late-learning site, neural activity in the early-learning area must be reset to its baseline activity. We propose two biologically plausible implementations for this reset that suggest novel roles for core elements of the cerebellar circuit.

Significance Statement

How are memories transformed over time? We propose a simple organizing principle for how long term memories are moved from an initial to a final site of storage. We show that successful transfer occurs when the late site of memory storage is endowed with synaptic plasticity rules that stably accumulate changes in activity occurring at the early site of memory storage. We instantiate this principle in a simple computational model that is representative of brain circuits underlying a variety of behaviors. The model suggests how a neural circuit can store new memories while preserving core features of older ones, and suggests novel roles for core elements of the cerebellar circuit.

Mechanisms of Neuronal Reactivation in Memory Consolidation: A Perspective from Pathological Conditions

Memory consolidation refers to a process by which labile newly formed memory traces are progressively strengthened into long term memories and become more resistant to interference. Recent work has revealed that spontaneous hippocampal activity during rest, commonly referred to as "offline" activity, plays a critical role in the process of memory consolidation. Hippocampal reactivation occurs during sharp-wave ripples (SWRs), which are events associated with highly synchronous neural firing in the hippocampus and modulation of neural activity in distributed brain regions. Memory consolidation occurs primarily through a coordinated communication between hippocampus and neocortex. Cortical slow oscillations drive the repeated reactivation of hippocampal memory representations together with SWRs and thalamo-cortical spindles, inducing long-lasting cellular and network modifications responsible for memory stabilization.In this review, we aim to comprehensively cover the field of "reactivation and memory consolidation" research by detailing the physiological mechanisms of neuronal reactivation and firing patterns during SWRs and providing a discussion of more recent key findings. Several mechanistic explanations of neuropsychiatric diseases propose that impaired neural replay may underlie some of the symptoms of the disorders. Abnormalities in neuronal reactivation are a common phenomenon and cause pathological impairment in several diseases, such as Alzheimer's disease (AD), epilepsy and schizophrenia. However, the specific pathological changes and mechanisms of reactivation in each disease are different. Recent work has also enlightened some of the underlying pathological mechanisms of neuronal reactivation in these diseases. In this review, we further describe how SWRs, ripples and slow oscillations are affected in Alzheimer's disease, epilepsy, and schizophrenia. We then compare the differences of neuronal reactivation and discuss how different reactivation abnormalities cause pathological changes in these diseases. Aberrant neural reactivation provides insights into disease pathogenesis and may even serve as biomarkers for early disease progression and treatment response.

Selective consolidation of learning and memory via recall-gated plasticity

In a variety of species and behavioral contexts, learning and memory formation recruits two neural systems, with initial plasticity in one system being consolidated into the other over time. Moreover, consolidation is known to be selective; that is, some experiences are more likely to be consolidated into long-term memory than others. Here, we propose and analyze a model that captures common computational principles underlying such phenomena. The key component of this model is a mechanism by which a long-term learning and memory system prioritizes the storage of synaptic changes that are consistent with prior updates to the short-term system. This mechanism, which we refer to as recall-gated consolidation, has the effect of shielding long-term memory from spurious synaptic changes, enabling it to focus on reliable signals in the environment. We describe neural circuit implementations of this model for different types of learning problems, including supervised learning, reinforcement learning, and autoassociative memory storage. These implementations involve synaptic plasticity rules modulated by factors such as prediction accuracy, decision confidence, or familiarity. We then develop an analytical theory of the learning and memory performance of the model, in comparison to alternatives relying only on synapse-local consolidation mechanisms. We find that recall-gated consolidation provides significant advantages, substantially amplifying the signal-to-noise ratio with which memories can be stored in noisy environments. We show that recall-gated consolidation gives rise to a number of phenomena that are present in behavioral learning paradigms, including spaced learning effects, task-dependent rates of consolidation, and differing neural representations in short- and long-term pathways.

Validation of a rodent model of episodic memory replay

Vivid episodic memories in humans have been described as the replay of the flow of past events in sequential order. Recently, Panoz-Brown et al. Current Biology, 28, 1628-1634, (2018) developed an olfactory memory task in which rats were presented with a list of trial-unique odors in an encoding context; next, in a distinctive memory assessment context, the rats were rewarded for choosing the second to last item from the list while avoiding other items from the list. In a different memory assessment context, the fourth to last item was rewarded. According to the episodic memory replay hypothesis, the rat remembers the list items and searches these items to find the item at the targeted locations in the list. However, events presented sequentially differ in memory trace strength, allowing a rat to use the relative familiarity of the memory traces, instead of episodic memory replay, to solve the task. Here, we directly manipulated memory trace strength by manipulating the odor intensity of target odors in both the list presentation and memory assessment. The rats relied on episodic memory replay to solve the memory assessment in conditions in which reliance on memory trace strength is ruled out. We conclude that rats are able to replay episodic memories.

A recurrent network model of planning explains hippocampal replay and human behavior

When faced with a novel situation, people often spend substantial periods of time contemplating possible futures. For such planning to be rational, the benefits to behavior must compensate for the time spent thinking. Here, we capture these features of behavior by developing a neural network model where planning itself is controlled by the prefrontal cortex. This model consists of a meta-reinforcement learning agent augmented with the ability to plan by sampling imagined action sequences from its own policy, which we call 'rollouts'. In a spatial navigation task, the agent learns to plan when it is beneficial, which provides a normative explanation for empirical variability in human thinking times. Additionally, the patterns of policy rollouts used by the artificial agent closely resemble patterns of rodent hippocampal replays. Our work provides a theory of how the brain could implement planning through prefrontal-hippocampal interactions, where hippocampal replays are triggered by-and adaptively affect-prefrontal dynamics.

Sleep-dependent decorrelation of hippocampal spatial representations

Neuronal ensembles are crucial for episodic memory and spatial mapping. Sleep, particularly non-REM (NREM), is vital for memory consolidation, as it triggers plasticity mechanisms through brain oscillations that reactivate neuronal ensembles. Here, we assessed their role in consolidating hippocampal spatial representations during sleep. We recorded hippocampus activity in rats performing a spatial object-place recognition (OPR) memory task, during encoding and retrieval periods, separated by intervening sleep. Successful OPR retrieval correlated with NREM duration, during which cortical oscillations decreased in power and density as well as neuronal spiking, suggesting global downregulation of network excitability. However, neurons encoding specific spatial locations (i.e., place cells) or objects during OPR showed stronger synchrony with brain oscillations compared to non-encoding neurons, and the stability of spatial representations decreased proportionally with NREM duration. Our findings suggest that NREM sleep may promote flexible remapping in hippocampal ensembles, potentially aiding memory consolidation and adaptation to novel spatial contexts.

Intrinsic dynamics of randomly clustered networks generate place fields and preplay of novel environments

During both sleep and awake immobility, hippocampal place cells reactivate time-compressed versions of sequences representing recently experienced trajectories in a phenomenon known as replay. Intriguingly, spontaneous sequences can also correspond to forthcoming trajectories in novel environments experienced later, in a phenomenon known as preplay. Here, we present a model showing that sequences of spikes correlated with the place fields underlying spatial trajectories in both previously experienced and future novel environments can arise spontaneously in neural circuits with random, clustered connectivity rather than pre-configured spatial maps. Moreover, the realistic place fields themselves arise in the circuit from minimal, landmark-based inputs. We find that preplay quality depends on the network's balance of cluster isolation and overlap, with optimal preplay occurring in small-world regimes of high clustering yet short path lengths. We validate the results of our model by applying the same place field and preplay analyses to previously published rat hippocampal place cell data. Our results show that clustered recurrent connectivity can generate spontaneous preplay and immediate replay of novel environments. These findings support a framework whereby novel sensory experiences become associated with preexisting "pluripotent" internal neural activity patterns.

Engram mechanisms of memory linking and identity

Memories are thought to be stored in neuronal ensembles referred to as engrams. Studies have suggested that when two memories occur in quick succession, a proportion of their engrams overlap and the memories become linked (in a process known as prospective linking) while maintaining their individual identities. In this Review, we summarize the key principles of memory linking through engram overlap, as revealed by experimental and modelling studies. We describe evidence of the involvement of synaptic memory substrates, spine clustering and non-linear neuronal capacities in prospective linking, and suggest a dynamic somato-synaptic model, in which memories are shared between neurons yet remain separable through distinct dendritic and synaptic allocation patterns. We also bring into focus retrospective linking, in which memories become associated after encoding via offline reactivation, and discuss key temporal and mechanistic differences between prospective and retrospective linking, as well as the potential differences in their cognitive outcomes.

Subpopulations of neurons in the perirhinal cortex enable both modality-specific and modality-invariant recognition of objects

The perirhinal cortex (PER) supports multimodal object recognition, but how multimodal information of objects is integrated within the PER remains unknown. Here, we recorded single units within the PER while rats performed a PER-dependent multimodal object-recognition task. In this task, audiovisual cues were presented simultaneously (multimodally) or separately (unimodally). We identified 2 types of object-selective neurons in the PER: crossmodal cells, showing constant firing patterns for an object irrespective of its modality, and unimodal cells, showing a preference for a specific modality. Unimodal cells further dissociated unimodal and multimodal versions of the object by modulating their firing rates according to the modality condition. A population-decoding analysis confirmed that the PER could perform both modality-invariant and modality-specific object decoding-the former for recognizing an object as the same in various conditions and the latter for remembering modality-specific experiences of the same object.

Reactivation strength during cued recall is modulated by graph distance within cognitive maps

Declarative memory retrieval is thought to involve reinstatement of neuronal activity patterns elicited and encoded during a prior learning episode. Furthermore, it is suggested that two mechanisms operate during reinstatement, dependent on task demands: individual memory items can be reactivated simultaneously as a clustered occurrence or, alternatively, replayed sequentially as temporally separate instances. In the current study, participants learned associations between images that were embedded in a directed graph network and retained this information over a brief 8 min consolidation period. During a subsequent cued recall session, participants retrieved the learned information while undergoing magnetoencephalographic recording. Using a trained stimulus decoder, we found evidence for clustered reactivation of learned material. Reactivation strength of individual items during clustered reactivation decreased as a function of increasing graph distance, an ordering present solely for successful retrieval but not for retrieval failure. In line with previous research, we found evidence that sequential replay was dependent on retrieval performance and was most evident in low performers. The results provide evidence for distinct performance-dependent retrieval mechanisms, with graded clustered reactivation emerging as a plausible mechanism to search within abstract cognitive maps.

Hippocampal sharp-wave ripples correlate with periods of naturally occurring self-generated thoughts in humans

Core features of human cognition highlight the importance of the capacity to focus on information distinct from events in the here and now, such as mind wandering. However, the brain mechanisms that underpin these self-generated states remain unclear. An emerging hypothesis is that self-generated states depend on the process of memory replay, which is linked to sharp-wave ripples (SWRs), which are transient high-frequency oscillations originating in the hippocampus. Local field potentials were recorded from the hippocampus of 10 patients with epilepsy for up to 15 days, and experience sampling was used to describe their association with ongoing thought patterns. The SWR rates were higher during extended periods of time when participants' ongoing thoughts were more vivid, less desirable, had more imaginable properties, and exhibited fewer correlations with an external task. These data suggest a role for SWR in the patterns of ongoing thoughts that humans experience in daily life.

Consolidation of emotional memory during waking rest depends on trait anxiety

A short period of eyes-closed waking rest improves long-term memory for recently learned information, including declarative, spatial, and procedural memory. However, the effect of rest on emotional memory consolidation remains unknown. This preregistered study aimed to establish whether post-encoding rest affects emotional memory and how anxiety levels might modulate this effect. Participants completed a modified version of the dot-probe attention task that involved reacting to and encoding word stimuli appearing underneath emotionally negative or neutral photos. We tested the effect of waking rest on memory for these words and pictures by manipulating the state that participants entered just after this task (rest vs. active wake). Trait anxiety levels were measured using the State-Trait Anxiety Inventory and examined as a covariate. Waking rest improved emotional memory consolidation for individuals high in trait anxiety. These results suggest that the beneficial effect of waking rest on memory extends into the emotional memory domain but depends on individual characteristics such as anxiety.

Continuous decision to wait for a future reward is guided by fronto-hippocampal anticipatory dynamics

Deciding whether to wait for a future reward is crucial for surviving in an uncertain world. While seeking rewards, agents anticipate a reward in the present environment and constantly face a trade-off between staying in their environment or leaving it. It remains unclear, however, how humans make continuous decisions in such situations. Here, we show that anticipatory activity in the anterior prefrontal cortex, ventrolateral prefrontal cortex, and hippocampus underpins continuous stay-leave decision-making. Participants awaited real liquid rewards available after tens of seconds, and their continuous decision was tracked by dynamic brain activity associated with the anticipation of a reward. Participants stopped waiting more frequently and sooner after they experienced longer delays and received smaller rewards. When the dynamic anticipatory brain activity was enhanced in the anterior prefrontal cortex, participants remained in their current environment, but when this activity diminished, they left the environment. Moreover, while experiencing a delayed reward in a novel environment, the ventrolateral prefrontal cortex and hippocampus showed anticipatory activity. Finally, the activity in the anterior prefrontal cortex and ventrolateral prefrontal cortex was enhanced in participants adopting a leave strategy, whereas those remaining stationary showed enhanced hippocampal activity. Our results suggest that fronto-hippocampal anticipatory dynamics underlie continuous decision-making while anticipating a future reward.

Minicolumn-Based Episodic Memory Model With Spiking Neurons, Dendrites and Delays

Episodic memory is fundamental to the brain's cognitive function, but how neuronal activity is temporally organized during its encoding and retrieval is still unknown. In this article, combining hippocampus structure with a spiking neural network (SNN), a new bionic spiking temporal memory (BSTM) model is proposed to explore the encoding, formation, and retrieval of episodic memory. For encoding episodic memory, the spike-timing-dependent-plasticity (STDP) learning algorithm and a proposed minicolumn selection algorithm are used to encode each input item into several active minicolumns. For the formation of episodic memory, a sequential memory algorithm is proposed to store the contexts between items. For retrieval of episodic memory, the local retrieval algorithm and the global retrieval algorithm are proposed to retrieve sequence information, achieving multisentence prediction and multitime step prediction. All functions of BSTM are based on bionic spiking neurons, which have biological characteristics including columnar and dendritic structures, firing and receiving spikes, and delaying transmission. To test the performance of the BSTM model, the Children's Book Test (CBT) data set was used to conduct a series of experiments under different settings, including changing the number of minicolumns, neurons and sequences, modifying sequence items, etc. Compared to other sequence memory algorithms, the experimental results show that the proposed BSTM achieves higher accuracy and better robustness.

Cross-strata co-occurrence of ripples with theta-frequency oscillations in the hippocampus of foraging rats

Brain rhythms have been postulated to play central roles in animal cognition. A prominently reported dichotomy of hippocampal rhythms links theta-frequency oscillations (4-12 Hz) and ripples (120-250 Hz) exclusively to preparatory and consummatory behaviours, respectively. However, because of the differential power expression of these two signals across hippocampal strata, such exclusivity requires validation through analyses of simultaneous multi-strata recordings. We assessed co-occurrence of theta-frequency oscillations with ripples in multi-channel recordings of extracellular potentials across hippocampal strata from foraging rats. We detected all ripple events from an identified stratum pyramidale (SP) channel. We then defined theta epochs based on theta oscillations detected from the stratum lacunosum-moleculare (SLM) or the stratum radiatum (SR). We found ∼20% of ripple events (in SP) to co-occur with theta epochs identified from SR/SLM channels, defined here as theta ripples. Strikingly, when theta epochs were instead identified from the SP channel, such co-occurrences were significantly reduced because of a progressive reduction in theta power along the SLM-SR-SP axis. Behaviourally, we found most theta ripples to occur during immobile periods, with comparable theta power during exploratory and immobile theta epochs. Furthermore, the progressive reduction in theta power along the SLM-SR-SP axis was common to exploratory and immobile periods. Finally, we found a strong theta-phase preference of theta ripples within the fourth quadrant [3π/2 - 2π] of the associated theta oscillation. The prevalence of theta ripples expands the potential roles of ripple-frequency oscillations to span the continuum of encoding, retrieval and consolidation, achieved through interactions with theta oscillations. KEY POINTS: The brain manifests oscillations in recorded electrical potentials, with different frequencies of oscillation associated with distinct behavioural states. A prominently reported dichotomy assigns theta-frequency oscillations (4-12 Hz) and ripples (120-250 Hz) recorded in the hippocampus to be exclusively associated with preparatory and consummatory behaviours, respectively. Our multi-strata recordings from the rodent hippocampus coupled with cross-strata analyses provide direct quantitative evidence for the occurrence of ripple events nested within theta oscillations. These results highlight the need for an analysis pipeline that explicitly accounts for the specific strata where individual oscillatory power is high, in analysing simultaneously recorded data from multiple strata. Our observations open avenues for investigations involving cross-strata interactions between theta oscillations and ripples across different behavioural states.

High mirror symmetry in mouse exploratory behavior

The physicality of the world in which the animal acts-its anatomical structure, physiology, perception, emotional states, and cognitive capabilities-determines the boundaries of the behavioral space within which the animal can operate. Behavior, therefore, can be considered as the subspace that remains after secluding all actions that are not available to the animal due to constraints. The very signature of being a certain creature is reflected in these limitations that shape its behavior. A major goal of ethology is to expose those constraints that carve the intricate structure of animal behavior and reveal both uniqueness and commonalities between animals within and across taxa. Exploratory behavior in an empty arena seems to be stochastic; nevertheless, it does not mean that the moving animal is a random walker. In this study, we present how, by adding constraints to the animal's locomotion, one can gradually retain the 'mousiness' that characterizes the behaving mouse. We then introduce a novel phenomenon of high mirror symmetry along the locomotion of mice, which highlights another constraint that further compresses the complex nature of exploratory behavior in these animals. We link these findings to a known neural mechanism that could explain this phenomenon. Finally, we suggest our novel finding and derived methods to be used in the search for commonalities in the motion trajectories of various organisms across taxa.

Observational activation of anterior cingulate cortical neurons coordinates hippocampal replay in social learning

Social learning enables a subject to make decisions by observing the actions of another. How neural circuits acquire relevant information during observation to guide subsequent behavior is unknown. Utilizing an observational spatial working memory task, we show that neurons in the rat anterior cingulate cortex (ACC) associated with spatial trajectories during self-running in a maze are activated when observing another rat running the same maze. The observation-induced ACC activities are reduced in error trials and are correlated with activities of hippocampal place cells representing the same trajectories. The ACC activities during observation also predict subsequent hippocampal place cell activities during sharp-wave ripples and spatial contents of hippocampal replay prior to self-running. The results support that ACC neurons involved in decisions during self-running are reactivated during observation and coordinate hippocampal replay to guide subsequent spatial navigation.

Selection of experience for memory by hippocampal sharp wave ripples

Experiences need to be tagged during learning for further consolidation. However, neurophysiological mechanisms that select experiences for lasting memory are not known. By combining large-scale neural recordings in mice with dimensionality reduction techniques, we observed that successive maze traversals were tracked by continuously drifting populations of neurons, providing neuronal signatures of both places visited and events encountered. When the brain state changed during reward consumption, sharp wave ripples (SPW-Rs) occurred on some trials, and their specific spike content decoded the trial blocks that surrounded them. During postexperience sleep, SPW-Rs continued to replay those trial blocks that were reactivated most frequently during waking SPW-Rs. Replay content of awake SPW-Rs may thus provide a neurophysiological tagging mechanism to select aspects of experience that are preserved and consolidated for future use.

Altered patterning of neural activity in a tauopathy mouse model

Alzheimer's disease (AD) is a complex neurodegenerative condition that manifests at multiple levels and involves a spectrum of abnormalities ranging from the cellular to cognitive. Here, we investigate the impact of AD-related tau-pathology on hippocampal circuits in mice engaged in spatial navigation, and study changes of neuronal firing and dynamics of extracellular fields. While most studies are based on analyzing instantaneous or time-averaged characteristics of neuronal activity, we focus on intermediate timescales-spike trains and waveforms of oscillatory potentials, which we consider as single entities. We find that, in healthy mice, spike arrangements and wave patterns (series of crests or troughs) are coupled to the animal's location, speed, and acceleration. In contrast, in tau-mice, neural activity is structurally disarrayed: brainwave cadence is detached from locomotion, spatial selectivity is lost, the spike flow is scrambled. Importantly, these alterations start early and accumulate with age, which exposes progressive disinvolvement the hippocampus circuit in spatial navigation. These features highlight qualitatively different neurodynamics than the ones provided by conventional analyses, and are more salient, thus revealing a new level of the hippocampal circuit disruptions.

Separating cognitive and motor processes in the behaving mouse

The cognitive processes supporting complex animal behavior are closely associated with ubiquitous movements responsible for our posture, facial expressions, ability to actively sample our sensory environments, and other critical processes. These movements are strongly related to neural activity across much of the brain and are often highly correlated with ongoing cognitive processes, making it challenging to dissociate the neural dynamics that support cognitive processes from those supporting related movements. In such cases, a critical issue is whether cognitive processes are separable from related movements, or if they are driven by common neural mechanisms. Here, we demonstrate how the separability of cognitive and motor processes can be assessed, and, when separable, how the neural dynamics associated with each component can be isolated. We establish a novel two-context behavioral task in mice that involves multiple cognitive processes and show that commonly observed dynamics taken to support cognitive processes are strongly contaminated by movements. When cognitive and motor components are isolated using a novel approach for subspace decomposition, we find that they exhibit distinct dynamical trajectories. Further, properly accounting for movement revealed that largely separate populations of cells encode cognitive and motor variables, in contrast to the 'mixed selectivity' often reported. Accurately isolating the dynamics associated with particular cognitive and motor processes will be essential for developing conceptual and computational models of neural circuit function and evaluating the function of the cell types of which neural circuits are composed.

The dorsomedial prefrontal cortex prioritizes social learning during rest

Sociality is a defining feature of the human experience: We rely on others to ensure survival and cooperate in complex social networks to thrive. Are there brain mechanisms that help ensure we quickly learn about our social world to optimally navigate it? We tested whether portions of the brain's default network engage "by default" to quickly prioritize social learning during the memory consolidation process. To test this possibility, participants underwent functional MRI (fMRI) while viewing scenes from the documentary film, Samsara. This film shows footage of real people and places from around the world. We normed the footage to select scenes that differed along the dimension of sociality, while matched on valence, arousal, interestingness, and familiarity. During fMRI, participants watched the "social" and "nonsocial" scenes, completed a rest scan, and a surprise recognition memory test. Participants showed superior social (vs. nonsocial) memory performance, and the social memory advantage was associated with neural pattern reinstatement during rest in the dorsomedial prefrontal cortex (DMPFC), a key node of the default network. Moreover, it was during early rest that DMPFC social pattern reinstatement was greatest and predicted subsequent social memory performance most strongly, consistent with the "prioritization" account. Results simultaneously update 1) theories of memory consolidation, which have not addressed how social information may be prioritized in the learning process, and 2) understanding of default network function, which remains to be fully characterized. More broadly, the results underscore the inherent human drive to understand our vastly social world.

Prioritizing replay when future goals are unknown

Although hippocampal place cells replay nonlocal trajectories, the computational function of these events remains controversial. One hypothesis, formalized in a prominent reinforcement learning account, holds that replay plans routes to current goals. However, recent puzzling data appear to contradict this perspective by showing that replayed destinations lag current goals. These results may support an alternative hypothesis that replay updates route information to build a "cognitive map." Yet no similar theory exists to formalize this view, and it is unclear how such a map is represented or what role replay plays in computing it. We address these gaps by introducing a theory of replay that learns a map of routes to candidate goals, before reward is available or when its location may change. Our work extends the planning account to capture a general map-building function for replay, reconciling it with data, and revealing an unexpected relationship between the seemingly distinct hypotheses.

Ripple-locked coactivity of stimulus-specific neurons and human associative memory

Associative memory enables the encoding and retrieval of relations between different stimuli. To better understand its neural basis, we investigated whether associative memory involves temporally correlated spiking of medial temporal lobe (MTL) neurons that exhibit stimulus-specific tuning. Using single-neuron recordings from patients with epilepsy performing an associative object-location memory task, we identified the object-specific and place-specific neurons that represented the separate elements of each memory. When patients encoded and retrieved particular memories, the relevant object-specific and place-specific neurons activated together during hippocampal ripples. This ripple-locked coactivity of stimulus-specific neurons emerged over time as the patients' associative learning progressed. Between encoding and retrieval, the ripple-locked timing of coactivity shifted, suggesting flexibility in the interaction between MTL neurons and hippocampal ripples according to behavioral demands. Our results are consistent with a cellular account of associative memory, in which hippocampal ripples coordinate the activity of specialized cellular populations to facilitate links between stimuli.

Unpacking the navigation toolbox: insights from comparative cognition

The study of navigation is informed by ethological data from many species, laboratory investigation at behavioural and neurobiological levels, and computational modelling. However, the data are often species-specific, making it challenging to develop general models of how biology supports behaviour. Wiener et al. outlined a framework for organizing the results across taxa, called the 'navigation toolbox' (Wiener et al. In Animal thinking: contemporary issues in comparative cognition (eds R Menzel, J Fischer), pp. 51-76). This framework proposes that spatial cognition is a hierarchical process in which sensory inputs at the lowest level are successively combined into ever-more complex representations, culminating in a metric or quasi-metric internal model of the world (cognitive map). Some animals, notably humans, also use symbolic representations to produce an external representation, such as a verbal description, signpost or map that allows communication of spatial information or instructions between individuals. Recently, new discoveries have extended our understanding of how spatial representations are constructed, highlighting that the hierarchical relationships are bidirectional, with higher levels feeding back to influence lower levels. In the light of these new developments, we revisit the navigation toolbox, elaborate it and incorporate new findings. The toolbox provides a common framework within which the results from different taxa can be described and compared, yielding a more detailed, mechanistic and generalized understanding of navigation.

Post-encoding task engagement not attentional load is detrimental to awake consolidation

The fate of new memories depends partly on the cognitive state experienced immediately following encoding. Wakeful rest, relative to task engagement, benefits retention and this effect is typically explained through a consolidation account: rest is theorised to provide a state of minimal interference, which would otherwise disrupt consolidation. Yet, the determinants of consolidation interference, notably the contribution of attention, remain poorly characterised. Through a repeated measures design, we investigated attention load's impact on consolidation. In three phases, participants encountered a set of nonwords and underwent immediate recognition testing, experienced a 5-min delay condition, and completed a delayed recognition test for the nonwords. This cycle repeated for each phase before proceeding to the next. Delay conditions comprised of wakeful rest and two sustained attention to response tasks (SART) that were of low (SART-fixed) and high (SART-random) attention load. Immediate memory was matched across conditions, but delayed recognition was poorer after completing the SART-fixed and SART-random conditions, relative to rest. There was no difference between the two SART conditions. These data provide insights into the factors that contribute to the success of consolidation and indicate that the attention load of a task does not determine the magnitude of consolidation interference and associated forgetting.

Replay of incidentally encoded episodic memories in the rat

Although events are not always known to be important when they occur, people can remember details about such incidentally encoded information using episodic memory. Importantly, when information is explicitly encoded for use in an expected test of retention (as in most assessments in animals), it is possible that it is used to generate a planned action1,2,3; thus, the remembered action can occur without remembering the earlier episode. By contrast, when a test is unexpected, transforming information into an action plan is unlikely because the importance of the information and the nature of the test are not yet known. Thus, accurate performance in an unexpected test after incidental encoding documents episodic memory.1,2,3,4,5,6,7,8 Here, we present evidence that rats replay episodic memories of incidentally encoded information in an unexpected assessment of memory. In one task,9 rats reported the third-last item in an explicitly encoded list of trial-unique odors. In a second task,10 rats foraged in a radial maze in the absence of odors. On a critical test, rats foraged in the radial maze, but scented lids covered the food. Next, memory of the third-last odor was assessed. All participating rats correctly answered the unexpected question. These results suggest that rats encoded multiple pieces of putatively unimportant information, and later they replayed a stream of episodic memories when that information was needed to solve an unexpected problem. We propose that rats replay episodic memories of incidentally encoded information, which documents a critical aspect of human episodic memory in a non-human animal.

Intra-ripple frequency accommodation in an inhibitory network model for hippocampal ripple oscillations

Hippocampal ripple oscillations have been implicated in important cognitive functions such as memory consolidation and planning. Multiple computational models have been proposed to explain the emergence of ripple oscillations, relying either on excitation or inhibition as the main pacemaker. Nevertheless, the generating mechanism of ripples remains unclear. An interesting dynamical feature of experimentally measured ripples, which may advance model selection, is intra-ripple frequency accommodation (IFA): a decay of the instantaneous ripple frequency over the course of a ripple event. So far, only a feedback-based inhibition-first model, which relies on delayed inhibitory synaptic coupling, has been shown to reproduce IFA. Here we use an analytical mean-field approach and numerical simulations of a leaky integrate-and-fire spiking network to explain the mechanism of IFA. We develop a drift-based approximation for the oscillation dynamics of the population rate and the mean membrane potential of interneurons under strong excitatory drive and strong inhibitory coupling. For IFA, the speed at which the excitatory drive changes is critical. We demonstrate that IFA arises due to a speed-dependent hysteresis effect in the dynamics of the mean membrane potential, when the interneurons receive transient, sharp wave-associated excitation. We thus predict that the IFA asymmetry vanishes in the limit of slowly changing drive, but is otherwise a robust feature of the feedback-based inhibition-first ripple model.

An online experiment that presents challenges for translating rest-related gains in visual detail memory from the laboratory to naturalistic settings

New memories are labile and consolidate over time. Contemporary findings demonstrate that, like sleep, awake quiescence supports consolidation: people remember more new memories if they experience a brief period of post-encoding quiet rest than sensory processing. Furthermore, it was recently demonstrated that the quality of new memories can also be enhanced significantly by awake quiescence. This phenomenon offers great applied potential, for example, in education and eyewitness testimony settings. However, the translation of rest-related gains from the laboratory to everyday life remains poorly characterised and findings are mixed. Here, we report follow-on evidence demonstrating that rest-related gains in visual detail memory may be more challenging to achieve in naturalistic than laboratory-based settings. In contrast to established laboratory findings, using an online version of an established consolidation paradigm, we observed no memory benefit of post-encoding quiescence, relative to an engaging perceptual task, in the retention of detailed visual memories as measured through a lure discrimination task. This null finding could not be explained by intentional rehearsal in those who rested or between-group differences in participants' demographics or mental state, including fatigue and mood. Crucially, post-experimental reports indicated that those in the rest group experienced challenges in initiating and maintaining a state of quiescence, which may account for our null finding. Based on these findings, we propose three areas of focus for future work should rest-related gains in memory be translated from the lab to field: (1) to establish the specific environmental and individual conditions that are conducive and detrimental to awake consolidation, (2) to understand the barriers to initiating and maintaining a state of quiescence in naturalistic settings, and (3) to examine how knowledge of quiescence and its cognitive benefits can encourage the initiation and maintenance of states that are conductive to awake consolidation.

Awake ripples enhance emotional memory encoding in the human brain

Enhanced memory for emotional experiences is hypothesized to depend on amygdala-hippocampal interactions during memory consolidation. Here we show using intracranial recordings from the human amygdala and the hippocampus during an emotional memory encoding and discrimination task increased awake ripples after encoding of emotional, compared to neutrally-valenced stimuli. Further, post-encoding ripple-locked stimulus similarity is predictive of later memory discrimination. Ripple-locked stimulus similarity appears earlier in the amygdala than in hippocampus and mutual information analysis confirms amygdala influence on hippocampal activity. Finally, the joint ripple-locked stimulus similarity in the amygdala and hippocampus is predictive of correct memory discrimination. These findings provide electrophysiological evidence that post-encoding ripples enhance memory for emotional events.

Prefrontal neuronal ensembles link prior knowledge with novel actions during flexible action selection

We make decisions based on currently perceivable information or an internal model of the environment. The medial prefrontal cortex (mPFC) and its interaction with the hippocampus have been implicated in the latter, model-based decision-making; however, the underlying computational properties remain incompletely understood. We have examined mPFC spiking and hippocampal oscillatory activity while rats flexibly select new actions using a known associative structure of environmental cues and outcomes. During action selection, the mPFC reinstates representations of the associative structure. These awake reactivation events are accompanied by synchronous firings among neurons coding the associative structure and those coding actions. Moreover, their functional coupling is strengthened upon the reactivation events leading to adaptive actions. In contrast, only cue-coding neurons improve functional coupling during hippocampal sharp wave ripples. Thus, the lack of direct experience disconnects the mPFC from the hippocampus to independently form self-organized neuronal ensemble dynamics linking prior knowledge with novel actions.

Reward Expectation Reduces Representational Drift in the Hippocampus

Spatial memory in the hippocampus involves dynamic neural patterns that change over days, termed representational drift. While drift may aid memory updating, excessive drift could impede retrieval. Memory retrieval is influenced by reward expectation during encoding, so we hypothesized that diminished reward expectation would exacerbate representational drift. We found that high reward expectation limited drift, with CA1 representations on one day gradually re-emerging over successive trials the following day. Conversely, the absence of reward expectation resulted in increased drift, as the gradual re-emergence of the previous day's representation did not occur. At the single cell level, lowering reward expectation caused an immediate increase in the proportion of place-fields with low trial-to-trial reliability. These place fields were less likely to be reinstated the following day, underlying increased drift in this condition. In conclusion, heightened reward expectation improves memory encoding and retrieval by maintaining reliable place fields that are gradually reinstated across days, thereby minimizing representational drift.

Sensory cortical ensembles exhibit differential coupling to ripples in distinct hippocampal subregions

Cortical neurons activated during recent experiences often reactivate with dorsal hippocampal CA1 ripples during subsequent rest. Less is known about cortical interactions with intermediate hippocampal CA1, whose connectivity, functions, and ripple events differ from dorsal CA1. We identified three clusters of putative excitatory neurons in mouse visual cortex that are preferentially excited together with either dorsal or intermediate CA1 ripples or suppressed before both ripples. Neurons in each cluster were evenly distributed across primary and higher visual cortices and co-active even in the absence of ripples. These ensembles exhibited similar visual responses but different coupling to thalamus and pupil-indexed arousal. We observed a consistent activity sequence preceding and predicting ripples: (1) suppression of ripple-suppressed cortical neurons, (2) thalamic silence, and (3) activation of intermediate CA1-ripple-activated cortical neurons. We propose that coordinated dynamics of these ensembles relay visual experiences to distinct hippocampal subregions for incorporation into different cognitive maps.

Hippocampal interneuronal dysfunction and hyperexcitability in a porcine model of concussion

Cognitive impairment is a common symptom following mild traumatic brain injury (mTBI or concussion) and can persist for years in some individuals. Hippocampal slice preparations following closed-head, rotational acceleration injury in swine have previously demonstrated reduced axonal function and hippocampal circuitry disruption. However, electrophysiological changes in hippocampal neurons and their subtypes in a large animal mTBI model have not been examined. Using in vivo electrophysiology techniques, we examined laminar oscillatory field potentials and single unit activity in the hippocampal network 7 days post-injury in anesthetized minipigs. Concussion altered the electrophysiological properties of pyramidal cells and interneurons differently in area CA1. While the firing rate, spike width and amplitude of CA1 interneurons were significantly decreased post-mTBI, these parameters were unchanged in CA1 pyramidal neurons. In addition, CA1 pyramidal neurons in TBI animals were less entrained to hippocampal gamma (40-80 Hz) oscillations. Stimulation of the Schaffer collaterals also revealed hyperexcitability across the CA1 lamina post-mTBI. Computational simulations suggest that reported changes in interneuronal physiology may be due to alterations in voltage-gated sodium channels. These data demonstrate that a single concussion can lead to significant neuronal and circuit level changes in the hippocampus, which may contribute to cognitive dysfunction following mTBI.

Selection of experience for memory by hippocampal sharp wave ripples

A general wisdom is that experiences need to be tagged during learning for further consolidation. However, brain mechanisms that select experiences for lasting memory are not known. Combining large-scale neural recordings with a novel application of dimensionality reduction techniques, we observed that successive traversals in the maze were tracked by continuously drifting populations of neurons, providing neuronal signatures of both places visited and events encountered (trial number). When the brain state changed during reward consumption, sharp wave ripples (SPW-Rs) occurred on some trials and their unique spike content most often decoded the trial in which they occurred. In turn, during post-experience sleep, SPW-Rs continued to replay those trials that were reactivated most frequently during awake SPW-Rs. These findings suggest that replay content of awake SPW-Rs provides a tagging mechanism to select aspects of experience that are preserved and consolidated for future use.

Fast 2-photon stimulation using holographic patterns

Two decades after its introduction, optogenetics - a biological technique to control the activity of neurons or other cell types with light - remains a cutting edge and promising tool to study biological processes. Its increasing usage in research varies widely from causally exploring biological mechanisms and neural computations, to neurostimulation and sensory restauration. To stimulate neurons in the brain, a variety of approaches have been developed to generate precise spatiotemporal light patterns. Yet certain constrains still exists in the current optical techniques to activate a neuronal population with both cellular resolution and millisecond precision. Here, we describe an experimental setup allowing to stimulate a few tens of neurons in a plane at sub-millisecond rates using 2-photon activation. A liquid crystal on silicon spatial light modulator (LCoS-SLM) was used to generate spatial patterns in 2 dimensions. The image of the patterns was formed on the plane of a digital micromirror device (DMD) that was used as a fast temporal modulator of each region of interest. Using fluorescent microscopy and patch-clamp recording of neurons in culture expressing the light-gated ion channels, we characterized the temporal and spatial resolution of the microscope. We described the advantages of combining the LCoS-SLM with the DMD to maximize the temporal precision, modulate the illumination amplitude, and reduce background activation. Finally, we showed that this approach can be extended to patterns in 3 dimensions. We concluded that the methodology is well suited to address important questions about the role of temporal information in neuronal coding.

Theta-band phase locking during encoding leads to coordinated entorhinal-hippocampal replay

Precisely timed interactions between hippocampal and cortical neurons during replay epochs are thought to support learning. Indeed, research has shown that replay is associated with heightened hippocampal-cortical synchrony. Yet many caveats remain in our understanding. Namely, it remains unclear how this offline synchrony comes about, whether it is specific to particular behavioral states, and how-if at all-it relates to learning. In this study, we sought to address these questions by analyzing coordination between CA1 cells and neurons of the deep layers of the medial entorhinal cortex (dMEC) while rats learned a novel spatial task. During movement, we found a subset of dMEC cells that were particularly locked to hippocampal LFP theta-band oscillations and that were preferentially coordinated with hippocampal replay during offline periods. Further, dMEC synchrony with CA1 replay peaked ∼10 ms after replay initiation in CA1, suggesting that the distributed replay reflects extra-hippocampal information propagation and is specific to "offline" periods. Finally, theta-modulated dMEC cells showed a striking experience-dependent increase in synchronization with hippocampal replay trajectories, mirroring the animals' acquisition of the novel task and coupling to the hippocampal local field. Together, these findings provide strong support for the hypothesis that synergistic hippocampal-cortical replay supports learning and highlights phase locking to hippocampal theta oscillations as a potential mechanism by which such cross-structural synchrony comes about.

Recent advances in the neuroscience of spontaneous and off-task thought: implications for mental health

People spend a remarkable 30-50% of awake life thinking about something other than what they are currently doing. These experiences of being "off-task" can be described as spontaneous thought when mental dynamics are relatively flexible. Here we review recent neuroscience developments in this area and consider implications for mental wellbeing and illness. We provide updated overviews of the roles of the default mode network and large-scale network dynamics, and we discuss emerging candidate mechanisms involving hippocampal memory (sharp-wave ripples, replay) and neuromodulatory (noradrenergic and serotonergic) systems. We explore how distinct brain states can be associated with or give rise to adaptive and maladaptive forms of thought linked to distinguishable mental health outcomes. We conclude by outlining new directions in the neuroscience of spontaneous and off-task thought that may clarify mechanisms, lead to personalized biomarkers, and facilitate therapy developments toward the goals of better understanding and improving mental health.

Exploring Ripple Waves in the Human Brain

Ripples are brief (<150 ms) high-frequency oscillatory neural activities in the brain with a range of 140 to 200 Hz in rodents and 80 to 140 Hz in humans. Ripples are regarded as playing an essential role in several aspects of memory function, mainly in the hippocampus. This type of ripple generally occurs with sharp waves and is called a sharp-wave ripple (SPW-R). Extensive research of SPW-Rs in the rodent brain while actively awake has also linked the function of these SPW-Rs to navigation and decision making. Although many studies with rodents unveiled SPW-R function, research in humans on this subject is still sparse. Therefore, unveiling SPW-R function in the human hippocampus is warranted. A certain type of ripples may also be a biomarker of epilepsy. This type of ripple is called a pathological ripple (p-ripple). p-ripples have a wider range of frequency (80-500 Hz) than SPW-Rs, and the range of frequency is especially higher in brain regions that are intrinsically linked to epilepsy onset. Brain regions producing ripples are too small for scalp electrode recording, and intracranial recording is typically needed to detect ripples. In addition, SPW-Rs in the human hippocampus have been recorded from patients with epilepsy who may have p-ripples. Differentiating SPW-Rs and p-ripples is often not easy. We need to develop more sophisticated methods to record SPW-Rs to differentiate them from p-ripples. This paper reviews the general features and roles of ripple waves.

Bidirectional synaptic changes in deep and superficial hippocampal neurons following in vivo activity

Neuronal activity during experience is thought to induce plastic changes within the hippocampal network that underlie memory formation, although the extent and details of such changes in vivo remain unclear. Here, we employed a temporally precise marker of neuronal activity, CaMPARI2, to label active CA1 hippocampal neurons in vivo, followed by immediate acute slice preparation and electrophysiological quantification of synaptic properties. Recently active neurons in the superficial sublayer of stratum pyramidale displayed larger post-synaptic responses at excitatory synapses from area CA3, with no change in pre-synaptic release probability. In contrast, in vivo activity correlated with weaker pre- and post-synaptic excitatory weights onto pyramidal cells in the deep sublayer. In vivo activity of deep and superficial neurons within sharp-wave/ripples was bidirectionally changed across experience, consistent with the observed changes in synaptic weights. These findings reveal novel, fundamental mechanisms through which the hippocampal network is modified by experience to store information.

Sleep Differentially and Profoundly Impairs Recall Memory in a Patient with Fornix Damage

In March 2020, C.T., a kind, bright, and friendly young woman underwent surgery for a midline tumor involving her septum pellucidum and extending down into her fornices bilaterally. Following tumor diagnosis and surgery, C.T. experienced significant memory deficits: C.T.'s family reported that she could remember things throughout the day, but when she woke up in the morning or following a nap, she would expect to be in the hospital, forgetting all the information that she had learned before sleep. The current study aimed to empirically validate C.T.'s pattern of memory loss and explore its neurological underpinnings. On two successive days, C.T. and age-matched controls watched an episode of a TV show and took a nap or stayed awake before completing a memory test. Although C.T. performed numerically worse than controls in both conditions, sleep profoundly exacerbated her memory impairment, such that she could not recall any details following a nap. This effect was replicated in a second testing session. High-resolution MRI scans showed evidence of the trans-callosal surgical approach's impact on the mid-anterior corpus callosum, indicated that C.T. had perturbed white matter particularly in the right fornix column, and demonstrated that C.T.'s hippocampal volumes did not differ from controls. These findings suggest that the fornix is important for processing episodic memories during sleep. As a key output pathway of the hippocampus, the fornix may ensure that specific memories are replayed during sleep, maintain the balance of sleep stages, or allow for the retrieval of memories following sleep.

Gamma oscillations and episodic memory

Enhanced gamma oscillatory activity (30-80 Hz) accompanies the successful formation and retrieval of episodic memories. While this co-occurrence is well documented, the mechanistic contributions of gamma oscillatory activity to episodic memory remain unclear. Here, we review how gamma oscillatory activity may facilitate spike timing-dependent plasticity, neural communication, and sequence encoding/retrieval, thereby ensuring the successful formation and/or retrieval of an episodic memory. Based on the evidence reviewed, we propose that multiple, distinct forms of gamma oscillation can be found within the canonical gamma band, each of which has a complementary role in the neural processes listed above. Further exploration of these theories using causal manipulations may be key to elucidating the relevance of gamma oscillatory activity to episodic memory.

Rapid runtime learning by curating small datasets of high-quality items obtained from memory

We propose the "runtime learning" hypothesis which states that people quickly learn to perform unfamiliar tasks as the tasks arise by using task-relevant instances of concepts stored in memory during mental training. To make learning rapid, the hypothesis claims that only a few class instances are used, but these instances are especially valuable for training. The paper motivates the hypothesis by describing related ideas from the cognitive science and machine learning literatures. Using computer simulation, we show that deep neural networks (DNNs) can learn effectively from small, curated training sets, and that valuable training items tend to lie toward the centers of data item clusters in an abstract feature space. In a series of three behavioral experiments, we show that people can also learn effectively from small, curated training sets. Critically, we find that participant reaction times and fitted drift rates are best accounted for by the confidences of DNNs trained on small datasets of highly valuable items. We conclude that the runtime learning hypothesis is a novel conjecture about the relationship between learning and memory with the potential for explaining a wide variety of cognitive phenomena.

Accounting for multiscale processing in adaptive real-world decision-making via the hippocampus

For adaptive real-time behavior in real-world contexts, the brain needs to allow past information over multiple timescales to influence current processing for making choices that create the best outcome as a person goes about making choices in their everyday life. The neuroeconomics literature on value-based decision-making has formalized such choice through reinforcement learning models for two extreme strategies. These strategies are model-free (MF), which is an automatic, stimulus-response type of action, and model-based (MB), which bases choice on cognitive representations of the world and causal inference on environment-behavior structure. The emphasis of examining the neural substrates of value-based decision making has been on the striatum and prefrontal regions, especially with regards to the "here and now" decision-making. Yet, such a dichotomy does not embrace all the dynamic complexity involved. In addition, despite robust research on the role of the hippocampus in memory and spatial learning, its contribution to value-based decision making is just starting to be explored. This paper aims to better appreciate the role of the hippocampus in decision-making and advance the successor representation (SR) as a candidate mechanism for encoding state representations in the hippocampus, separate from reward representations. To this end, we review research that relates hippocampal sequences to SR models showing that the implementation of such sequences in reinforcement learning agents improves their performance. This also enables the agents to perform multiscale temporal processing in a biologically plausible manner. Altogether, we articulate a framework to advance current striatal and prefrontal-focused decision making to better account for multiscale mechanisms underlying various real-world time-related concepts such as the self that cumulates over a person's life course.

Hippocampal memory reactivation during sleep is correlated with specific cortical states of the retrosplenial and prefrontal cortices

Episodic memories are thought to be stabilized through the coordination of cortico-hippocampal activity during sleep. However, the timing and mechanism of this coordination remain unknown. To investigate this, we studied the relationship between hippocampal reactivation and slow-wave sleep up and down states of the retrosplenial cortex (RTC) and prefrontal cortex (PFC). We found that hippocampal reactivations are strongly correlated with specific cortical states. Reactivation occurred during sustained cortical Up states or during the transition from up to down state. Interestingly, the most prevalent interaction with memory reactivation in the hippocampus occurred during sustained up states of the PFC and RTC, while hippocampal reactivation and cortical up-to-down state transition in the RTC showed the strongest coordination. Reactivation usually occurred within 150-200 msec of a cortical Up state onset, indicating that a buildup of excitation during cortical Up state activity influences the probability of memory reactivation in CA1. Conversely, CA1 reactivation occurred 30-50 msec before the onset of a cortical down state, suggesting that memory reactivation affects down state initiation in the RTC and PFC, but the effect in the RTC was more robust. Our findings provide evidence that supports and highlights the complexity of bidirectional communication between cortical regions and the hippocampus during sleep.